-- Logs begin at Tue 2022-08-09 16:03:58 UTC, end at Tue 2022-08-09 18:56:52 UTC. -- Aug 09 16:52:06.580731 n-d-845781-6 systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 16:52:06.590101 n-d-845781-6 devstack@n-api.service[103912]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 16:52:06.592166 n-d-845781-6 devstack@n-api.service[103912]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 16:52:06 2022] *** Aug 09 16:52:06.592166 n-d-845781-6 devstack@n-api.service[103912]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 16:52:06.592166 n-d-845781-6 devstack@n-api.service[103912]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 16:52:06.592166 n-d-845781-6 devstack@n-api.service[103912]: nodename: n-d-845781-6 Aug 09 16:52:06.592166 n-d-845781-6 devstack@n-api.service[103912]: machine: x86_64 Aug 09 16:52:06.592166 n-d-845781-6 devstack@n-api.service[103912]: clock source: unix Aug 09 16:52:06.592166 n-d-845781-6 devstack@n-api.service[103912]: pcre jit disabled Aug 09 16:52:06.592166 n-d-845781-6 devstack@n-api.service[103912]: detected number of CPU cores: 4 Aug 09 16:52:06.592166 n-d-845781-6 devstack@n-api.service[103912]: current working directory: / Aug 09 16:52:06.592166 n-d-845781-6 devstack@n-api.service[103912]: detected binary path: /usr/bin/uwsgi-core Aug 09 16:52:06.592854 n-d-845781-6 devstack@n-api.service[103912]: your processes number limit is 47680 Aug 09 16:52:06.592854 n-d-845781-6 devstack@n-api.service[103912]: your memory page size is 4096 bytes Aug 09 16:52:06.592854 n-d-845781-6 devstack@n-api.service[103912]: detected max file descriptor number: 2048 Aug 09 16:52:06.592854 n-d-845781-6 devstack@n-api.service[103912]: lock engine: pthread robust mutexes Aug 09 16:52:06.592854 n-d-845781-6 devstack@n-api.service[103912]: thunder lock: enabled Aug 09 16:52:06.592854 n-d-845781-6 devstack@n-api.service[103912]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 16:52:06.592854 n-d-845781-6 devstack@n-api.service[103912]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 16:52:06.633077 n-d-845781-6 devstack@n-api.service[103912]: Python main interpreter initialized at 0x55caea7009c0 Aug 09 16:52:06.633077 n-d-845781-6 devstack@n-api.service[103912]: python threads support enabled Aug 09 16:52:06.633077 n-d-845781-6 devstack@n-api.service[103912]: your server socket listen backlog is limited to 100 connections Aug 09 16:52:06.633077 n-d-845781-6 devstack@n-api.service[103912]: your mercy for graceful operations on workers is 90 seconds Aug 09 16:52:06.633562 n-d-845781-6 devstack@n-api.service[103912]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 16:52:06.633562 n-d-845781-6 devstack@n-api.service[103912]: *** Operational MODE: preforking *** Aug 09 16:52:06.633770 n-d-845781-6 devstack@n-api.service[103912]: *** uWSGI is running in multiple interpreter mode *** Aug 09 16:52:06.633770 n-d-845781-6 devstack@n-api.service[103912]: spawned uWSGI master process (pid: 103912) Aug 09 16:52:06.633980 n-d-845781-6 systemd[1]: Started Devstack devstack@n-api.service. Aug 09 16:52:06.635716 n-d-845781-6 devstack@n-api.service[103912]: spawned uWSGI worker 1 (pid: 103913, cores: 1) Aug 09 16:52:06.635716 n-d-845781-6 devstack@n-api.service[103912]: spawned uWSGI worker 2 (pid: 103914, cores: 1) Aug 09 16:52:06.635716 n-d-845781-6 devstack@n-api.service[103912]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 16:52:07.298781 n-d-845781-6 devstack@n-api.service[103914]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 16:52:07.304488 n-d-845781-6 devstack@n-api.service[103913]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 16:52:08.404144 n-d-845781-6 devstack@n-api.service[103913]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:52:08.404144 n-d-845781-6 devstack@n-api.service[103913]: from cryptography.utils import int_from_bytes Aug 09 16:52:08.404958 n-d-845781-6 devstack@n-api.service[103913]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:52:08.404958 n-d-845781-6 devstack@n-api.service[103913]: from cryptography.utils import int_from_bytes Aug 09 16:52:08.452663 n-d-845781-6 devstack@n-api.service[103914]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:52:08.452663 n-d-845781-6 devstack@n-api.service[103914]: from cryptography.utils import int_from_bytes Aug 09 16:52:08.453286 n-d-845781-6 devstack@n-api.service[103914]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:52:08.453286 n-d-845781-6 devstack@n-api.service[103914]: from cryptography.utils import int_from_bytes Aug 09 16:52:10.934116 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 16:52:10.934784 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 16:52:10.934871 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 16:52:10.935236 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 16:52:10.935489 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 16:52:10.935926 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.936481 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.936669 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 16:52:10.938192 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 16:52:10.938284 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.938284 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.938441 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 16:52:10.938529 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.938616 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 16:52:10.938704 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.938789 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 16:52:10.938877 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.938964 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.939043 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.939126 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.939271 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.939352 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.939442 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.939608 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.939735 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.939824 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.939909 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-845781-6 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.940281 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.940430 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.940606 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.940746 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.940929 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.941053 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.941255 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.941371 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.941516 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.941675 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.941831 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.941996 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.942156 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-845781-6 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.942299 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.942479 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.942784 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.942878 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.943095 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.943220 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.943412 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.943535 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.943740 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.943896 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.944310 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.944400 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.944480 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.944609 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.944763 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.944869 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.945084 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.945175 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.945398 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.945486 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.945723 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.945821 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.946034 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.946130 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.946352 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.946459 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-845781-6 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.946662 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.946749 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.946981 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.947140 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.947277 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.947366 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.947602 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.947752 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.947939 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.948088 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.948332 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-845781-6 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.948419 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.948649 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.948755 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.948959 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.949048 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.949266 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.949362 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.949603 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.949744 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.949922 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.950025 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.950240 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.950326 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.950560 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.950656 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.950865 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.950984 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.951175 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.951290 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.951486 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.951573 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.951930 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.952103 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.952265 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.952418 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.952565 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.952700 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.952784 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.952862 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.952940 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.953156 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.953245 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.953469 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.953557 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.953794 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.953895 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.954103 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.954194 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.954349 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.954442 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.954645 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.954742 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.954984 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.955076 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.955301 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.955387 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.955610 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.955759 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.955941 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.956027 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.956252 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.956359 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.956514 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.956605 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.956837 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.956939 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.957145 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.957230 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.957453 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.957543 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.957761 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.957848 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.958071 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.958214 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.958378 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.958466 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.958687 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.958781 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.958996 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.959095 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.959303 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.959391 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.959612 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.959768 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.959944 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.960048 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.960262 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.960408 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.960582 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.960669 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.960887 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.960998 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.961208 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.961308 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.961523 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.961609 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.961830 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.961919 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.962139 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.962238 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.962444 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.962531 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.962761 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.962856 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.963070 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.963169 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.963382 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.963468 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.963673 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.963767 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.963955 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.964041 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.964264 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.964439 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.964583 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.964757 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.964890 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.965076 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.965203 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.965409 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.965538 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.966000 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.966113 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.966201 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.966291 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.966413 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.966502 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.966582 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.966660 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.966831 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.966965 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.967138 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.967272 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.967447 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.967575 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.967777 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.967918 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.968077 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.968226 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.968384 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.968569 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.968692 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.968841 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.968998 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.969161 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.969303 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.969469 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.969612 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.969777 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.969915 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.970083 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.970223 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.970923 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.971064 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.971254 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.971372 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.971565 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.971718 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.971899 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.972008 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.972223 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.972326 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.972530 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.972625 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.972835 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.972940 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.973153 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.973261 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.973463 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.973563 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.973771 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.973865 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.974089 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.974191 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.974390 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.974483 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.974697 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.974801 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.974999 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.975093 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.975314 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.975407 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.975638 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.975731 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.975947 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.976041 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.976251 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.976351 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.976550 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.976656 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.976861 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.976960 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.977169 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.977272 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.977470 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.977579 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.977770 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.977865 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.978070 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.978163 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.978374 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.978482 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.978677 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.978763 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.978981 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.979066 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.979283 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.979376 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.979586 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.979701 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.979912 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.980012 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.980232 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.980345 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.980552 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.980637 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.980864 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.980950 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.981173 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.981259 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.981479 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.981573 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.981798 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:52:10.981882 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.982131 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.982223 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.982454 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.982554 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.982776 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.982862 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.983090 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.983176 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.983400 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.983484 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.983735 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.983838 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.984060 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.984154 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.984380 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.984463 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.984700 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.984869 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.985015 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.985099 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.985330 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.985414 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.985647 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.985798 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.985958 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.986677 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.986841 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.986932 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.987141 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.987243 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.987463 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.987562 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.987801 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.987907 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.988116 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.988212 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.988439 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.988528 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.988753 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.988859 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.989073 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.989170 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.989399 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.989481 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.989713 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.989798 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.990023 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.990114 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.990333 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.990418 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.990656 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.990740 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.990992 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.991078 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.991310 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.991394 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.991652 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.991747 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.991966 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.992060 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.992278 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.992363 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.992589 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.992675 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.992904 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.992999 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.993219 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.993304 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.993542 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.993635 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.993859 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.993942 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.994176 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.994268 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.994490 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.994583 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.994800 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.994892 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.995111 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.995195 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.995421 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.995517 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.995755 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.995854 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.996064 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.996158 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.996371 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.996463 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.996676 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.996769 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.996986 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.997078 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.997292 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.997385 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.997627 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.997717 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.997910 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.997996 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.998216 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.998301 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.998518 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.998639 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.998823 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.998914 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.999133 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.999229 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.999440 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.999524 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.999777 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:10.999865 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.000084 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.000170 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.000397 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.000482 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.000708 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.000793 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.001014 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.001101 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.001321 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.001411 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.001655 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.002249 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.002515 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.002600 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.002826 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.002912 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.003143 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.003236 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.003457 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.003550 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.003822 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.003906 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.004136 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.004244 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.004450 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.004543 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.004762 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.004845 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.005073 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.005241 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.005384 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.005471 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.005690 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.005778 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.006007 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.006094 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.006320 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.006434 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.006648 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.006779 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.006946 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.007140 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.007259 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.007574 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.007930 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.008254 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.008360 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.008559 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.008765 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.008862 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.009166 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.009471 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.009744 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.009837 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.010072 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.010156 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.010378 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.010475 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.010694 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.010793 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.010987 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.011072 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.011292 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.011386 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.011596 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.011744 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.011939 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.012026 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.012248 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.012343 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.012553 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.012638 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.012856 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.012940 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.013160 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.013253 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.013478 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.013562 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.013786 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.013878 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.014094 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.014179 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.014401 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.014486 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.014708 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.014802 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.015015 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.015108 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.015346 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.015432 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.015675 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.015764 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.015986 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.016072 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.016296 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.016401 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.016600 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.016687 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.016915 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.017023 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.017231 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.017319 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.018112 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.018215 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.018435 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.018519 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.018746 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.018845 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.019148 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.019313 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.019404 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.019472 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.019739 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.019840 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.020049 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.020149 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.020367 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.020452 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.020687 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.020771 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.021003 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.021097 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.021325 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.021411 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.021638 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.021730 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.021949 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.022045 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.022258 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.022343 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.022566 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.022658 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.022882 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.022984 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.023194 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.023288 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.023496 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.023583 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.023838 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.023934 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.024154 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.024245 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.024476 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.024562 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.024787 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.024873 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.025109 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.025201 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.025418 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.025503 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.025733 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.025818 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.026042 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.026126 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.026353 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.026445 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.026666 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.026752 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.026981 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.027075 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.027293 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.027385 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.027603 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.027708 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.027947 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.028031 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.028259 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.028368 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.028563 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.028648 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.028877 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.029015 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.029185 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.029284 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.029493 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.029612 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.029798 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.029885 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.030111 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.030197 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.030421 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.030522 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.030727 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.030813 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.031033 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.031132 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.031348 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.031433 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.031682 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.031773 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.031979 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.032073 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.032282 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.032368 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.032587 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.032675 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.032917 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.033003 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.033230 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.033315 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.033547 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.033640 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.033861 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.033946 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.034163 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.034246 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.034464 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.034561 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.034780 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.034878 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.035087 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.035225 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.035398 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.035526 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.035720 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.035810 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.036033 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.036118 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.036374 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.036475 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.036682 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.036767 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.036986 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.037071 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.037306 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.037436 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.037602 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.037699 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.037905 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.037990 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.038218 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.038311 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.038523 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.038609 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.038829 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.038913 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.039132 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.039268 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.039437 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.039522 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.039772 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.039860 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.040085 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.040173 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.040391 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.040474 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.040701 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.040792 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.041013 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.041109 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.041319 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.041403 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.041629 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.041726 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.041936 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.042067 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.042244 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.042328 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.042547 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.042644 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.042858 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.042943 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.043165 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.043265 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.043475 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.043768 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.043858 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.044109 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.044194 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.044416 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.044507 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.044734 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.044819 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.045045 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.045136 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.045357 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.045460 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.045668 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.045762 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.045972 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.046065 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.046282 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.046381 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.046600 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.046698 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.046925 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.047172 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.047258 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.047507 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.047606 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.047847 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.047932 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.048155 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.048239 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.048461 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.048576 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.048806 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.048898 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.049138 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.049224 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.049467 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.049575 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.049779 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.049864 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.050083 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.050242 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.050370 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.050688 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.050848 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.050992 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.051161 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.051306 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.051474 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.051610 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.051817 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.051951 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.052126 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.052261 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.052436 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.052565 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.052742 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.052870 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.053055 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.053176 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.053361 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.053517 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.053669 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.053822 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.053975 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.054158 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.054280 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.054485 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.054594 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.054827 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.054914 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.055134 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.055226 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.055438 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.055524 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.055789 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.055885 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.056098 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.056196 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.056402 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.056495 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.056704 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.056789 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.057010 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.057102 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.057317 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.057401 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.057618 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.057711 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.057930 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.058024 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.058241 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.058340 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.058549 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.058635 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.058857 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.058951 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.059164 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.059259 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.059471 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.059563 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.059797 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.059886 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.060110 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.060196 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.060413 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.060498 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.060713 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.060798 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.061013 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.061098 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.061313 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.061404 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.061619 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.061706 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.061968 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.062102 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.062232 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.062315 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.062516 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.062602 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.062818 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.062902 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.063117 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.063332 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.063418 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.063495 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.063733 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.063834 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.064045 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.064624 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.064870 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.064955 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.065426 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.065519 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.065747 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.065843 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.066060 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.066153 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.066369 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.066453 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.066673 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.066760 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.066977 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.067061 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.067279 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.067362 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.067582 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.067703 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.067916 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.068001 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.068221 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.068314 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.068535 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.068629 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.068835 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.068925 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.069137 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.069221 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.069438 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.069524 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.069742 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.069835 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.070047 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.070191 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.070349 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.070467 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.070648 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.070748 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.070947 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.071073 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.071247 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.071348 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.071546 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.071669 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.071870 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.071969 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.072191 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.072278 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.072493 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.072595 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.072794 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.072888 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.073094 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.073179 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.073396 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.073489 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.073695 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.073780 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.074001 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.074094 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.074302 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.074388 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.074604 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.074689 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.074904 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.074990 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.075213 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.075299 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.075516 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.075602 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.075865 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.075951 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.076175 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.076269 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.076483 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.076568 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.076797 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.076884 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.077109 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.077194 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.077423 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.077509 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.077728 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.077813 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.078035 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.078134 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.078358 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.078443 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.078671 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.078755 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.078983 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.079077 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.079306 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.079399 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.079616 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.079777 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.079980 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.080075 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.080283 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.080366 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.080594 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.080678 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.080903 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.080999 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.081212 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.081355 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.081522 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.081666 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.081858 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.082591 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.082736 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.082929 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.083101 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.083270 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.083448 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.083543 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.083726 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.083887 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.083979 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.084203 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.084302 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.084514 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.084604 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.084819 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.084914 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.085123 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.085220 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.085437 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.085524 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.085746 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.085834 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.086053 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.086142 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.086365 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.086466 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.086661 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.086757 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.086973 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.087100 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.087274 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.087363 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.087585 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.087725 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.087929 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.088033 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.088230 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.088325 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.088545 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.088696 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.088837 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.088975 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.089146 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.089277 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.089470 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.089608 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.089781 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.089912 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.090085 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.090214 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.090395 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.090533 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.090699 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.090829 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.091011 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.091144 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.091298 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.091438 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.091737 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.091837 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.092045 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.092131 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.092358 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.092455 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.092672 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.092769 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.092968 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.093052 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.093273 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.093361 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.093575 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.093661 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.093888 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.093971 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.094188 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.094281 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.094509 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.094593 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.094904 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.094987 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.095216 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.095302 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.095543 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.095642 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.095889 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.095973 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.096194 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.096287 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.096511 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.096610 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.096828 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.096923 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.097132 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.097217 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.097435 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.097526 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.097737 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.097830 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.098063 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.098163 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.098359 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.098445 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.098679 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.098773 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.099001 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.099093 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.099314 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.099406 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.099668 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.099771 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.099953 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.100091 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.100274 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.100402 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.100595 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.100714 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.100908 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.101039 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.101229 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.101363 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.101639 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.101766 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.101958 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.102047 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.102268 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.102363 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.102576 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.102663 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.102899 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.102994 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.103204 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.103295 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.103509 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.103597 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.103845 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.103960 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.104153 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.104249 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.104456 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.104543 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.104780 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.104881 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.105105 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.105284 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.105400 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.105503 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.105714 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.105809 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.106025 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.106119 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.106336 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.106431 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.106640 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.106767 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.106962 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.107047 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.107265 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.107359 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.107606 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.107735 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.107922 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.108019 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.108237 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.108338 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.108529 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.108614 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.108845 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.108982 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.109146 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.109288 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.109459 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.109596 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.109775 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.109906 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.110069 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.110166 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.110358 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.110443 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.110660 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.110751 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.111001 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.111143 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.111310 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.111441 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.111651 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.111751 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.111979 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.112074 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.112290 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.112375 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.112608 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.112701 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.112913 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.113017 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.113237 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.113366 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.113546 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.113651 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.113851 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.113941 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.114157 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.114262 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.114462 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.114571 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.114772 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.114874 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.115077 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.115176 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.115378 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.115487 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.115709 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.115812 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.116016 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.116116 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.116324 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.116417 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.116626 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.116715 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.116926 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.117022 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.117247 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.117341 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.117550 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.117645 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.117867 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.117959 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.118176 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.118274 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.118477 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.118564 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.118780 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.118889 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.119081 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.119168 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.119385 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.119471 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.119712 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.119820 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.120023 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.120148 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.120327 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.120421 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.120629 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.120723 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.120931 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.121025 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.121250 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.121335 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.121554 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.121667 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.121869 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.121956 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.122176 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.122260 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.122488 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.122582 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.122805 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.122890 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.123114 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.123201 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.123428 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.123516 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.123766 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.123853 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.124100 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.124233 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.124451 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.124634 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.124776 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.124968 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.125096 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.125284 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.125413 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.125597 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.125731 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.125909 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.126049 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.126232 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.126373 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.126547 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.126723 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.126872 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.126994 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.127180 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.127294 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.127492 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.127610 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.127832 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.128531 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.128675 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.128848 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.128998 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.129323 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.129415 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.129664 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.129773 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.129981 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.130076 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.130297 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.130383 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.130610 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.130704 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.130924 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.131009 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.131240 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.131325 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.131551 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.131659 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.131899 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.131985 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.132209 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.132308 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.132536 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.132624 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.132835 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.132928 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.133149 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.133343 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.133469 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.133562 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.133762 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.133848 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.134077 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.134172 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.134391 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.134487 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.134701 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.134785 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.135014 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.135107 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.135327 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.135421 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.135667 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.135758 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.135985 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.136080 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.136297 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.136383 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.136611 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.136697 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.136933 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.137036 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.137240 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.137325 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.137550 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.137759 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.137846 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.138074 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.138167 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.138409 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.138498 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.138738 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.138839 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.139042 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.139127 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.139355 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.139452 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.139688 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.139777 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.140019 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.140116 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.140328 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.140428 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.140636 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.140721 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.140946 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.141031 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.141253 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.141347 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.141561 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.141772 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.141885 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.142089 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.142182 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.142479 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.142579 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.142809 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.142906 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.143134 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.143282 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.143451 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.143710 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.143813 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.144061 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.144156 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.144378 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.144465 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.144702 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.144800 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.145010 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.145096 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.145318 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.145405 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.145622 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.145716 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.145943 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.146037 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.146251 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.146337 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.146557 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.146643 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.146873 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.146980 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.147179 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.147268 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.147487 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.147737 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.147834 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.148086 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.148181 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.148400 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.148494 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.148710 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.148800 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.149020 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.149107 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.149327 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.149413 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.149631 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.149715 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.149948 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.150033 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.150251 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.150343 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.150554 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.150647 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.150865 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.150958 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.151168 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.151254 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.151471 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.151564 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.151800 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.151888 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.152107 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.152192 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.152413 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.152507 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.152715 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.152808 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.153021 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.153105 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.153323 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.153417 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.153638 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.153732 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.153947 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.154040 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.154252 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.154351 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.154554 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.154643 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.154864 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.154986 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.155173 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.155269 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.155470 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.155574 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.155800 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.155889 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.156105 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.156193 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.156414 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.156501 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.156717 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.156803 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.157025 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.157113 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.157326 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.157418 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.157638 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.157724 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.158466 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.158746 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.158833 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.159064 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.159150 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.159386 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.159473 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.159720 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.159805 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.160059 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.160144 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.160371 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.160459 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.160680 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.160777 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.160984 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.161078 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.161295 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.161381 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.161606 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.161692 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.161915 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.161999 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.162226 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.162314 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.162538 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.162769 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.162856 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.163100 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.163189 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.163420 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.163506 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.163764 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.163852 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.164077 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.164171 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.164384 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.164472 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.164691 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.164775 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.164995 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.165083 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.165302 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.165387 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.165610 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.165747 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.165917 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.166003 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.166252 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.166336 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.166573 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.166668 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.166899 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.166984 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.167217 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.167310 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.167526 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.167621 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.167859 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.167943 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.168167 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.168253 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.168473 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.168599 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.168781 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.168865 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.169090 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.169174 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.169400 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.169487 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.169707 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.169794 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.170011 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.170132 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.170349 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.170434 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.170671 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.170756 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.170990 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.171086 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.171308 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.171395 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.171657 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.171746 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.171954 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.172052 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.172263 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.172356 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.172571 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.172656 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.172877 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.172970 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.173186 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.173271 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.173530 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.173641 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.174382 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.174470 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.174690 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.174775 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.175022 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.175107 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.175327 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.175414 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.175649 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.175750 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.175960 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.176056 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.176266 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.176361 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.176584 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.176670 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.176897 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.176982 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.177199 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.177286 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.177503 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.177595 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.177811 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.177905 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.178115 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.178201 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.178419 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.178561 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.178726 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.178893 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.179026 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.179265 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.179367 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.179581 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.179693 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.179914 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.180001 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.180217 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.180301 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.180517 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.180611 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.180817 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.180910 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.181118 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.181205 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.181421 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.181518 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.181723 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.181815 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.182026 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.182113 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.182329 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.182423 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.182632 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.182741 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.182932 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.183026 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.183233 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.183330 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.183545 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.183745 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.183873 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.183959 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.184180 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.184267 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.184493 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.184592 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.184793 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.184887 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.185095 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.185182 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.185398 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.185486 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.185708 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.185793 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.186024 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.186178 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.186326 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.186422 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.186629 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.186720 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.186957 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.187046 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.187260 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.187345 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.187568 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.187690 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.187903 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.187996 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.188213 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.188298 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.188523 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.188617 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.188852 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.188937 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.189195 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.189290 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.189501 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.189599 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.189818 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.189902 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.190400 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.190492 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.190710 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.190795 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.191021 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.191116 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.191329 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.191421 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.191676 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.191767 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.191981 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.192067 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.192293 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.192378 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.192600 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.192688 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.192907 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.192999 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.193216 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.193300 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.193533 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.193621 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.193845 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.193940 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.194149 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.194242 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.194463 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.194548 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.194778 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.194864 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.195096 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.195190 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.195413 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.195500 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.195743 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.195832 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.196068 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.196168 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.196378 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.196463 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.196692 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.196778 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.197003 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.197089 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.197315 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.197414 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.197628 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.197721 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.197945 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.198032 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.198258 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.198351 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.198561 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.198645 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.198804 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 16:52:11.198932 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.199182 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.199508 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.199864 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.200178 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.200502 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.200826 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.201174 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.201490 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.201836 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.202163 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.202478 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.202792 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.203097 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:52:11.203340 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 16:52:11.357520 n-d-845781-6 devstack@n-api.service[103914]: INFO dbcounter [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Registered counter for database nova_api Aug 09 16:52:11.360500 n-d-845781-6 devstack@n-api.service[103913]: INFO dbcounter [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Registered counter for database nova_api Aug 09 16:52:11.382499 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_db.sqlalchemy.engines [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:52:11.384015 n-d-845781-6 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:52:11.389806 n-d-845781-6 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writer thread running {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:52:11.390814 n-d-845781-6 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:52:11.448103 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.context [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) {{(pid=103914) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 16:52:11.448412 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.context [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) {{(pid=103913) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 16:52:11.452058 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:11.452309 n-d-845781-6 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:11.452540 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:11.452790 n-d-845781-6 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:11.454130 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:11.454359 n-d-845781-6 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:11.455414 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:11.455731 n-d-845781-6 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:11.455884 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:11.456180 n-d-845781-6 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:11.458247 n-d-845781-6 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:11.458386 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:11.460355 n-d-845781-6 devstack@n-api.service[103913]: INFO dbcounter [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Registered counter for database nova_cell0 Aug 09 16:52:11.460479 n-d-845781-6 devstack@n-api.service[103914]: INFO dbcounter [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Registered counter for database nova_cell0 Aug 09 16:52:11.466169 n-d-845781-6 devstack@n-api.service[103913]: INFO dbcounter [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Registered counter for database nova_cell1 Aug 09 16:52:11.466344 n-d-845781-6 devstack@n-api.service[103914]: INFO dbcounter [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Registered counter for database nova_cell1 Aug 09 16:52:11.474288 n-d-845781-6 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:52:11.476047 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_db.sqlalchemy.engines [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:52:11.478688 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_db.sqlalchemy.engines [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:52:11.480674 n-d-845781-6 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:52:11.481355 n-d-845781-6 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:52:11.482661 n-d-845781-6 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writer thread running {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:52:11.620547 n-d-845781-6 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writer thread running {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:52:11.623043 n-d-845781-6 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:52:11.632954 n-d-845781-6 devstack@n-api.service[103913]: INFO dbcounter [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Registered counter for database nova_cell0 Aug 09 16:52:11.633158 n-d-845781-6 devstack@n-api.service[103914]: INFO dbcounter [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Registered counter for database nova_cell0 Aug 09 16:52:11.642624 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_db.sqlalchemy.engines [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:52:11.645725 n-d-845781-6 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:52:11.647307 n-d-845781-6 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writer thread running {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:52:11.650213 n-d-845781-6 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:52:11.994419 n-d-845781-6 devstack@n-api.service[103914]: WARNING keystonemiddleware.auth_token [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:52:12.001921 n-d-845781-6 devstack@n-api.service[103914]: WARNING keystonemiddleware.auth_token [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:52:12.007585 n-d-845781-6 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:52:12.014903 n-d-845781-6 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:52:12.347684 n-d-845781-6 devstack@n-api.service[103914]: WARNING keystonemiddleware.auth_token [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:52:12.353611 n-d-845781-6 devstack@n-api.service[103914]: WARNING keystonemiddleware.auth_token [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:52:12.358915 n-d-845781-6 devstack@n-api.service[103914]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caea7009c0 pid: 103914 (default app) Aug 09 16:52:12.361026 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:12.362226 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] 10.222.0.93 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Aug 09 16:52:12.362643 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 788 bytes} [Tue Aug 9 16:52:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:52:12.366170 n-d-845781-6 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:52:12.372271 n-d-845781-6 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-b1ba10ad-0ca4-4835-b190-9fd6f2b09b0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:52:12.378211 n-d-845781-6 devstack@n-api.service[103913]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55caea7009c0 pid: 103913 (default app) Aug 09 16:53:34.772643 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:34.774837 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002797 Aug 09 16:53:34.775240 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 2/2] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:53:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:34.788536 n-d-845781-6 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=3 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:34.790442 n-d-845781-6 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_cell0:SELECT=3 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:34.791277 n-d-845781-6 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_cell1:SELECT=3 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:34.792809 n-d-845781-6 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:35.699278 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-6dbe1eeb-b1d8-41d7-8da3-02f6b87e6d5a admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:35.732808 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-6dbe1eeb-b1d8-41d7-8da3-02f6b87e6d5a admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.949808 Aug 09 16:53:35.733591 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 1/3] 10.222.0.93 () {60 vars in 1292 bytes} [Tue Aug 9 16:53:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:38.097563 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:38.098637 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-ad71694a-ee79-4d8b-b76f-8a05777751ea None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 09 16:53:38.099098 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 3/4] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:38.684118 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-00747499-0cf0-4592-8d73-750d6fd13333 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:38.707597 n-d-845781-6 devstack@n-api.service[103913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:53:38.707597 n-d-845781-6 devstack@n-api.service[103913]: warnings.warn(msg) Aug 09 16:53:38.742526 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-00747499-0cf0-4592-8d73-750d6fd13333 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.636404 Aug 09 16:53:38.743535 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 2/5] 10.222.0.93 () {64 vars in 1283 bytes} [Tue Aug 9 16:53:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:53:38.760867 n-d-845781-6 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_api:SELECT=3 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:38.761756 n-d-845781-6 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_cell1:SELECT=3 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:38.763428 n-d-845781-6 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_cell0:SELECT=3 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:38.764506 n-d-845781-6 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:39.017589 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-9f139cde-6ce1-4e95-b766-c62b846cac70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:39.023743 n-d-845781-6 devstack@n-api.service[103914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:53:39.023743 n-d-845781-6 devstack@n-api.service[103914]: warnings.warn(msg) Aug 09 16:53:39.120177 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-9f139cde-6ce1-4e95-b766-c62b846cac70 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.366046 Aug 09 16:53:39.121532 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 4/6] 10.222.0.93 () {64 vars in 1336 bytes} [Tue Aug 9 16:53:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:41.606566 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-00747499-0cf0-4592-8d73-750d6fd13333 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:41.607944 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-00747499-0cf0-4592-8d73-750d6fd13333 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001778 Aug 09 16:53:41.608697 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 3/7] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:42.415978 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-3ceac00c-dcca-43b8-af5e-925aa861361d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds512M"}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:42.435506 n-d-845781-6 devstack@n-api.service[103914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:53:42.435506 n-d-845781-6 devstack@n-api.service[103914]: warnings.warn(msg) Aug 09 16:53:42.473804 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-3ceac00c-dcca-43b8-af5e-925aa861361d admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.856447 Aug 09 16:53:42.486124 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 5/8] 10.222.0.93 () {64 vars in 1283 bytes} [Tue Aug 9 16:53:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:53:42.492611 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-1926356e-2cf6-46d2-a953-3ace34926f08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:42.495568 n-d-845781-6 devstack@n-api.service[103913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:53:42.495568 n-d-845781-6 devstack@n-api.service[103913]: warnings.warn(msg) Aug 09 16:53:42.534191 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-1926356e-2cf6-46d2-a953-3ace34926f08 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047084 Aug 09 16:53:42.535919 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 4/9] 10.222.0.93 () {64 vars in 1336 bytes} [Tue Aug 9 16:53:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:45.609274 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-3ceac00c-dcca-43b8-af5e-925aa861361d admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:45.610958 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-3ceac00c-dcca-43b8-af5e-925aa861361d admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002237 Aug 09 16:53:45.611904 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 6/10] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:46.100285 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-4eeb5c45-bf35-4bbf-9adb-2b44a47f0cc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "disk": 10, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:46.137323 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-4eeb5c45-bf35-4bbf-9adb-2b44a47f0cc5 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.515239 Aug 09 16:53:46.144431 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 5/11] 10.222.0.93 () {64 vars in 1283 bytes} [Tue Aug 9 16:53:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:53:46.161087 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-b53aab24-ba89-4d86-ae31-e3c0537d301b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:46.209976 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-b53aab24-ba89-4d86-ae31-e3c0537d301b admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055432 Aug 09 16:53:46.224925 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 7/12] 10.222.0.93 () {64 vars in 1336 bytes} [Tue Aug 9 16:53:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:48.648088 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-4eeb5c45-bf35-4bbf-9adb-2b44a47f0cc5 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:48.649887 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-4eeb5c45-bf35-4bbf-9adb-2b44a47f0cc5 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002278 Aug 09 16:53:48.650607 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 6/13] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:53:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:49.144547 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-f5934cfd-48dc-4ff5-89d3-032a672dd231 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "disk": 10, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:49.175542 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-f5934cfd-48dc-4ff5-89d3-032a672dd231 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.517712 Aug 09 16:53:49.176147 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 8/14] 10.222.0.93 () {64 vars in 1283 bytes} [Tue Aug 9 16:53:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:53:49.191549 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-e65dd026-ce6e-43f2-bf13-4e2e7a2db270 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:49.225076 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-e65dd026-ce6e-43f2-bf13-4e2e7a2db270 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039383 Aug 09 16:53:49.225653 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 7/15] 10.222.0.93 () {64 vars in 1336 bytes} [Tue Aug 9 16:53:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:51.828796 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-f5934cfd-48dc-4ff5-89d3-032a672dd231 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:51.829821 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-f5934cfd-48dc-4ff5-89d3-032a672dd231 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 09 16:53:51.830233 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 9/16] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:52.479049 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-bcc64b90-9eff-42e4-b3e7-5dd603d7a0c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "vcpus": 4, "disk": 20}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:52.513872 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-bcc64b90-9eff-42e4-b3e7-5dd603d7a0c7 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.676476 Aug 09 16:53:52.514909 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 8/17] 10.222.0.93 () {64 vars in 1283 bytes} [Tue Aug 9 16:53:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:53:52.530845 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-6bef7c57-e99f-4409-9096-ca89c8ceddca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:52.561138 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-6bef7c57-e99f-4409-9096-ca89c8ceddca admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033911 Aug 09 16:53:52.561700 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 10/18] 10.222.0.93 () {64 vars in 1336 bytes} [Tue Aug 9 16:53:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:55.185230 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-bcc64b90-9eff-42e4-b3e7-5dd603d7a0c7 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:55.186239 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-bcc64b90-9eff-42e4-b3e7-5dd603d7a0c7 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 09 16:53:55.187428 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 9/19] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:53:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:55.796737 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-5fc14336-bd6e-41b4-b61a-026e27f2ad70 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:55.843734 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-5fc14336-bd6e-41b4-b61a-026e27f2ad70 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.648319 Aug 09 16:53:55.844979 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 11/20] 10.222.0.93 () {60 vars in 1292 bytes} [Tue Aug 9 16:53:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:53:58.452551 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-bcc64b90-9eff-42e4-b3e7-5dd603d7a0c7 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:58.453722 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-bcc64b90-9eff-42e4-b3e7-5dd603d7a0c7 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002174 Aug 09 16:53:58.454031 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 10/21] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:53:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:58.985390 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-7c279269-ef6d-47bd-a260-b1905107511c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:59.007443 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-7c279269-ef6d-47bd-a260-b1905107511c admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.546561 Aug 09 16:53:59.008016 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 12/22] 10.222.0.93 () {64 vars in 1283 bytes} [Tue Aug 9 16:53:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:53:59.027696 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-33c726b7-b72f-41c2-8907-c743540af510 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:59.061114 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-33c726b7-b72f-41c2-8907-c743540af510 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036592 Aug 09 16:53:59.062257 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 11/23] 10.222.0.93 () {64 vars in 1333 bytes} [Tue Aug 9 16:53:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:01.801310 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-7c279269-ef6d-47bd-a260-b1905107511c admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:01.802490 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-7c279269-ef6d-47bd-a260-b1905107511c admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002094 Aug 09 16:54:01.802959 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 13/24] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:54:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:02.332162 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-c7cbaedb-0ddd-474d-91b3-1c435914b94b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:02.370306 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-c7cbaedb-0ddd-474d-91b3-1c435914b94b admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.558014 Aug 09 16:54:02.370558 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 12/25] 10.222.0.93 () {64 vars in 1283 bytes} [Tue Aug 9 16:54:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:54:02.392974 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-42036e47-2d07-45a3-8405-b37ea2aa2dc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:02.427677 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-42036e47-2d07-45a3-8405-b37ea2aa2dc7 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041637 Aug 09 16:54:02.428234 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 14/26] 10.222.0.93 () {64 vars in 1333 bytes} [Tue Aug 9 16:54:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:04.809770 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-c7cbaedb-0ddd-474d-91b3-1c435914b94b admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:04.810587 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-c7cbaedb-0ddd-474d-91b3-1c435914b94b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002108 Aug 09 16:54:04.810990 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 13/27] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:54:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:05.319921 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-4e858ddf-43f2-4998-8c7e-864687f27afb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:05.351984 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-4e858ddf-43f2-4998-8c7e-864687f27afb admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.533946 Aug 09 16:54:05.353082 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 15/28] 10.222.0.93 () {64 vars in 1283 bytes} [Tue Aug 9 16:54:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:54:05.372849 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-fee267b6-4ad0-4cab-87ed-e446a477c5b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:05.378009 n-d-845781-6 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:05.405698 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-fee267b6-4ad0-4cab-87ed-e446a477c5b0 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037426 Aug 09 16:54:05.406286 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 14/29] 10.222.0.93 () {64 vars in 1333 bytes} [Tue Aug 9 16:54:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:07.858521 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-4e858ddf-43f2-4998-8c7e-864687f27afb admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:07.859572 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-4e858ddf-43f2-4998-8c7e-864687f27afb admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 09 16:54:07.860262 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 16/30] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:54:08.307954 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-ec4ad90a-05a3-4847-a221-6504746a3ad7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:08.328681 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-ec4ad90a-05a3-4847-a221-6504746a3ad7 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459141 Aug 09 16:54:08.329453 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 15/31] 10.222.0.93 () {64 vars in 1283 bytes} [Tue Aug 9 16:54:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 16:54:08.349744 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-57f89933-ca8d-4382-90de-77313d3f3f75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:08.379731 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-57f89933-ca8d-4382-90de-77313d3f3f75 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036100 Aug 09 16:54:08.380643 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 17/32] 10.222.0.93 () {64 vars in 1333 bytes} [Tue Aug 9 16:54:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:10.913882 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-ec4ad90a-05a3-4847-a221-6504746a3ad7 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:10.915745 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-ec4ad90a-05a3-4847-a221-6504746a3ad7 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002152 Aug 09 16:54:10.917277 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 16/33] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:54:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:11.463049 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-1799a154-044c-4be5-bb8c-6a514f9ca15f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:11.492425 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-1799a154-044c-4be5-bb8c-6a514f9ca15f admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.568982 Aug 09 16:54:11.500511 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 18/34] 10.222.0.93 () {64 vars in 1283 bytes} [Tue Aug 9 16:54:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:54:11.505761 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-d2da719c-2307-4fc2-95d5-0d629c8ffcad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:11.536080 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-d2da719c-2307-4fc2-95d5-0d629c8ffcad admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034159 Aug 09 16:54:11.536668 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 17/35] 10.222.0.93 () {64 vars in 1333 bytes} [Tue Aug 9 16:54:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:36.943735 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-1799a154-044c-4be5-bb8c-6a514f9ca15f admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:36.944791 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-1799a154-044c-4be5-bb8c-6a514f9ca15f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Aug 09 16:54:36.945193 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 19/36] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:54:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:36.952751 n-d-845781-6 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:37.389646 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-55431e01-0d33-4024-8d39-898f6889614d admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:37.409482 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-55431e01-0d33-4024-8d39-898f6889614d admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.457589 Aug 09 16:54:37.410084 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 18/37] 10.222.0.93 () {60 vars in 1292 bytes} [Tue Aug 9 16:54:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:38.508815 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-1799a154-044c-4be5-bb8c-6a514f9ca15f admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:38.509854 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-1799a154-044c-4be5-bb8c-6a514f9ca15f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 09 16:54:38.510250 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 20/38] 10.222.0.93 () {56 vars in 1074 bytes} [Tue Aug 9 16:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:39.162864 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-039bf550-770c-4d19-863f-c8f7d7d0cbb7 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:39.168619 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.wsgi [None req-039bf550-770c-4d19-863f-c8f7d7d0cbb7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-039bf550-770c-4d19-863f-c8f7d7d0cbb7 admin admin] Request method failure captured: Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: Accept: application/json Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: Accept-Encoding: gzip, deflate Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: Connection: keep-alive Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: Content-Length: 0 Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: Host: 10.222.0.93 Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: Openstack-Api-Version: compute 2.90 Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: Openstack-System-Scope: None Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: User-Agent: python-novaclient Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Auth-Token: gAAAAABi8pFOW9hIFEF6XxlPvu9e5sOBLwAj4FayN0SkNro_WEnqgPBLechaVoLBA6OF_OtMR-B-6e9v-Zzj-8hSs_Wx9q_UXdqk8DLzx_7dE2rKAq96cshhEU67DvEeG1G7gvHIevJfDB3aNVonSPFG0_APjfDJm55gkb3dH4gGpwgqqO1XtrI Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Domain-Id: None Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Domain-Name: None Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Identity-Status: Confirmed Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Is-Admin-Project: True Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Domain-Id: default Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Domain-Name: Default Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Name: admin Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Role: admin,reader,member Aug 09 16:54:39.171920 n-d-845781-6 devstack@n-api.service[103913]: X-Roles: admin,reader,member Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: X-Tenant: admin Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: X-Tenant-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: X-Tenant-Name: admin Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: X-User: admin Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: X-User-Domain-Id: default Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: X-User-Domain-Name: Default Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: X-User-Id: f2f86e62846c4629949a13a64f640979 Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: X-User-Name: admin Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: method: > Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: exception: Flavor 42 could not be found. Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: action_args: {'id': '42'} Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:54:39.173730 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:39.175844 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:39.177212 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-039bf550-770c-4d19-863f-c8f7d7d0cbb7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:54:39.178646 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-039bf550-770c-4d19-863f-c8f7d7d0cbb7 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.437339 Aug 09 16:54:39.178646 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 19/39] 10.222.0.93 () {60 vars in 1190 bytes} [Tue Aug 9 16:54:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 16:54:39.184220 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-4ab03c5b-b961-4f0e-88b0-734d3a53fdf0 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:39.188798 n-d-845781-6 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:39.209924 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-4ab03c5b-b961-4f0e-88b0-734d3a53fdf0 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029330 Aug 09 16:54:39.210485 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 21/40] 10.222.0.93 () {60 vars in 1210 bytes} [Tue Aug 9 16:54:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:39.240943 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-5ce3a732-8add-4a77-86e7-b667756beb72 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:39.265639 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-5ce3a732-8add-4a77-86e7-b667756beb72 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028282 Aug 09 16:54:39.266274 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 20/41] 10.222.0.93 () {60 vars in 1210 bytes} [Tue Aug 9 16:54:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:39.276249 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-2de569d8-38e6-4a54-beff-af5a09f2ddd9 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:39.283052 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.wsgi [None req-2de569d8-38e6-4a54-beff-af5a09f2ddd9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-2de569d8-38e6-4a54-beff-af5a09f2ddd9 admin admin] Request method failure captured: Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: Accept: application/json Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: Accept-Encoding: gzip, deflate Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: Connection: keep-alive Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: Content-Length: 0 Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: Host: 10.222.0.93 Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: Openstack-Api-Version: compute 2.90 Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: Openstack-System-Scope: None Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: User-Agent: python-novaclient Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Auth-Token: gAAAAABi8pFOW9hIFEF6XxlPvu9e5sOBLwAj4FayN0SkNro_WEnqgPBLechaVoLBA6OF_OtMR-B-6e9v-Zzj-8hSs_Wx9q_UXdqk8DLzx_7dE2rKAq96cshhEU67DvEeG1G7gvHIevJfDB3aNVonSPFG0_APjfDJm55gkb3dH4gGpwgqqO1XtrI Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Domain-Id: None Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Domain-Name: None Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Identity-Status: Confirmed Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Is-Admin-Project: True Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Domain-Id: default Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Domain-Name: Default Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Name: admin Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Role: admin,reader,member Aug 09 16:54:39.286345 n-d-845781-6 devstack@n-api.service[103914]: X-Roles: admin,reader,member Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: X-Tenant: admin Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: X-Tenant-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: X-Tenant-Name: admin Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: X-User: admin Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: X-User-Domain-Id: default Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: X-User-Domain-Name: Default Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: X-User-Id: f2f86e62846c4629949a13a64f640979 Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: X-User-Name: admin Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: method: > Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: exception: Flavor 42 could not be found. Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: action_args: {'id': '42'} Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:54:39.287992 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:39.289920 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:39.291249 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-2de569d8-38e6-4a54-beff-af5a09f2ddd9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:54:39.292780 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-2de569d8-38e6-4a54-beff-af5a09f2ddd9 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015520 Aug 09 16:54:39.292780 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 22/42] 10.222.0.93 () {60 vars in 1190 bytes} [Tue Aug 9 16:54:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 16:54:40.343768 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-5ce3a732-8add-4a77-86e7-b667756beb72 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:40.345408 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-5ce3a732-8add-4a77-86e7-b667756beb72 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 09 16:54:40.345803 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 21/43] 10.222.0.93 () {56 vars in 1074 bytes} [Tue Aug 9 16:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:40.940314 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-5b1afc3b-ed7e-47db-8ee6-41c211ec01d0 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:40.946411 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.wsgi [None req-5b1afc3b-ed7e-47db-8ee6-41c211ec01d0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-5b1afc3b-ed7e-47db-8ee6-41c211ec01d0 admin admin] Request method failure captured: Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: Accept: application/json Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: Accept-Encoding: gzip, deflate Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: Connection: keep-alive Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: Content-Length: 0 Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: Host: 10.222.0.93 Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: Openstack-Api-Version: compute 2.90 Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: Openstack-System-Scope: None Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: User-Agent: python-novaclient Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Auth-Token: gAAAAABi8pFQa-qroD3jjyDRx5ISpFeEeULpbfjlD78JNMTdQQFpnX4Np5OnpvAWO__qeokRu8TBCwYfqscojPad8-01YucuJn8vhBQG3zcReR3MjJ35fUj46o-0aqlL2XOKUYaRLTK9lnqFLVOojbJaX-afnzySoCC27_gXQFXmO7Zd9AAjySw Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Domain-Id: None Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Domain-Name: None Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Identity-Status: Confirmed Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Is-Admin-Project: True Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Domain-Id: default Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Domain-Name: Default Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Name: admin Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Role: admin,reader,member Aug 09 16:54:40.947939 n-d-845781-6 devstack@n-api.service[103914]: X-Roles: admin,reader,member Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: X-Tenant: admin Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: X-Tenant-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: X-Tenant-Name: admin Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: X-User: admin Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: X-User-Domain-Id: default Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: X-User-Domain-Name: Default Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: X-User-Id: f2f86e62846c4629949a13a64f640979 Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: X-User-Name: admin Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: method: > Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: exception: Flavor 84 could not be found. Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: action_args: {'id': '84'} Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:54:40.949576 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:40.950466 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:40.951788 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-5b1afc3b-ed7e-47db-8ee6-41c211ec01d0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:54:40.953024 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-5b1afc3b-ed7e-47db-8ee6-41c211ec01d0 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.449877 Aug 09 16:54:40.953024 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 23/44] 10.222.0.93 () {60 vars in 1190 bytes} [Tue Aug 9 16:54:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 16:54:40.959312 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-59c458c8-ae6a-4124-b850-3a04fc732628 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:40.974749 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-59c458c8-ae6a-4124-b850-3a04fc732628 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019197 Aug 09 16:54:40.975345 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 22/45] 10.222.0.93 () {60 vars in 1210 bytes} [Tue Aug 9 16:54:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:40.985149 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-3aec1fae-1203-4904-9645-80b883889466 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:41.000745 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-3aec1fae-1203-4904-9645-80b883889466 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019302 Aug 09 16:54:41.001961 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 24/46] 10.222.0.93 () {60 vars in 1210 bytes} [Tue Aug 9 16:54:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:41.011479 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-b027beae-c484-4963-8930-5a4d4952df78 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:41.017042 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.wsgi [None req-b027beae-c484-4963-8930-5a4d4952df78 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-b027beae-c484-4963-8930-5a4d4952df78 admin admin] Request method failure captured: Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: Accept: application/json Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: Accept-Encoding: gzip, deflate Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: Connection: keep-alive Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: Content-Length: 0 Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: Host: 10.222.0.93 Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: Openstack-Api-Version: compute 2.90 Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: Openstack-System-Scope: None Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: User-Agent: python-novaclient Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Auth-Token: gAAAAABi8pFQa-qroD3jjyDRx5ISpFeEeULpbfjlD78JNMTdQQFpnX4Np5OnpvAWO__qeokRu8TBCwYfqscojPad8-01YucuJn8vhBQG3zcReR3MjJ35fUj46o-0aqlL2XOKUYaRLTK9lnqFLVOojbJaX-afnzySoCC27_gXQFXmO7Zd9AAjySw Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Domain-Id: None Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Domain-Name: None Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Identity-Status: Confirmed Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Is-Admin-Project: True Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Domain-Id: default Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Domain-Name: Default Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Name: admin Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Role: admin,reader,member Aug 09 16:54:41.018542 n-d-845781-6 devstack@n-api.service[103913]: X-Roles: admin,reader,member Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: X-Tenant: admin Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: X-Tenant-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: X-Tenant-Name: admin Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: X-User: admin Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: X-User-Domain-Id: default Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: X-User-Domain-Name: Default Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: X-User-Id: f2f86e62846c4629949a13a64f640979 Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: X-User-Name: admin Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: method: > Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: exception: Flavor 84 could not be found. Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: action_args: {'id': '84'} Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:54:41.020914 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:41.022682 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:41.025073 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-b027beae-c484-4963-8930-5a4d4952df78 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:54:41.027257 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-b027beae-c484-4963-8930-5a4d4952df78 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012058 Aug 09 16:54:41.027257 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 23/47] 10.222.0.93 () {60 vars in 1190 bytes} [Tue Aug 9 16:54:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 16:54:42.040173 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-3aec1fae-1203-4904-9645-80b883889466 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:42.041170 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-3aec1fae-1203-4904-9645-80b883889466 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 09 16:54:42.041559 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 25/48] 10.222.0.93 () {56 vars in 1074 bytes} [Tue Aug 9 16:54:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:42.581175 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-3572cbb7-8dc8-4376-b11d-68f41dbdbdf7 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:42.587044 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.wsgi [None req-3572cbb7-8dc8-4376-b11d-68f41dbdbdf7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-3572cbb7-8dc8-4376-b11d-68f41dbdbdf7 admin admin] Request method failure captured: Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: Accept: application/json Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: Accept-Encoding: gzip, deflate Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: Connection: keep-alive Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: Content-Length: 0 Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: Host: 10.222.0.93 Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: Openstack-Api-Version: compute 2.90 Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: Openstack-System-Scope: None Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: User-Agent: python-novaclient Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Auth-Token: gAAAAABi8pFRSdDBoTXDwi4LiT1EWMNFda2rxmJpSyYiwRdZ3Da1f0RYpswFdCx4Csm3mWv-kqkFpaSYurYUEi-VqqCI9V-OYfftt2g3ZefSrn4-hrKKSXvIsrfQ8URxMHiOsV_-gjaAe3qwUWHn4TDRTfY-W_7yngPhh3h9h_j5VBhYbIuiLY0 Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Domain-Id: None Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Domain-Name: None Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Identity-Status: Confirmed Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Is-Admin-Project: True Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Domain-Id: default Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Domain-Name: Default Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Project-Name: admin Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Role: admin,reader,member Aug 09 16:54:42.588552 n-d-845781-6 devstack@n-api.service[103913]: X-Roles: admin,reader,member Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: X-Tenant: admin Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: X-Tenant-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: X-Tenant-Name: admin Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: X-User: admin Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: X-User-Domain-Id: default Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: X-User-Domain-Name: Default Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: X-User-Id: f2f86e62846c4629949a13a64f640979 Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: X-User-Name: admin Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: method: > Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: exception: Flavor 451 could not be found. Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: action_args: {'id': '451'} Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:54:42.590162 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:42.592373 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 16:54:42.593634 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-3572cbb7-8dc8-4376-b11d-68f41dbdbdf7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:54:42.594852 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-3572cbb7-8dc8-4376-b11d-68f41dbdbdf7 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.410504 Aug 09 16:54:42.594852 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 24/49] 10.222.0.93 () {60 vars in 1193 bytes} [Tue Aug 9 16:54:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 16:54:42.599787 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-94bcb992-4716-455c-a5ac-14a02505ddf0 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:42.615368 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-94bcb992-4716-455c-a5ac-14a02505ddf0 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019094 Aug 09 16:54:42.615941 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 26/50] 10.222.0.93 () {60 vars in 1210 bytes} [Tue Aug 9 16:54:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:42.626189 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:42.640965 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018946 Aug 09 16:54:42.641506 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 25/51] 10.222.0.93 () {60 vars in 1210 bytes} [Tue Aug 9 16:54:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:42.650954 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-0a2bfeaa-9de6-44fc-98cd-39b5b2f498c3 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:42.656976 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.wsgi [None req-0a2bfeaa-9de6-44fc-98cd-39b5b2f498c3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-0a2bfeaa-9de6-44fc-98cd-39b5b2f498c3 admin admin] Request method failure captured: Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: Accept: application/json Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: Accept-Encoding: gzip, deflate Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: Connection: keep-alive Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: Content-Length: 0 Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: Host: 10.222.0.93 Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: Openstack-Api-Version: compute 2.90 Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: Openstack-System-Scope: None Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: User-Agent: python-novaclient Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Auth-Token: gAAAAABi8pFRSdDBoTXDwi4LiT1EWMNFda2rxmJpSyYiwRdZ3Da1f0RYpswFdCx4Csm3mWv-kqkFpaSYurYUEi-VqqCI9V-OYfftt2g3ZefSrn4-hrKKSXvIsrfQ8URxMHiOsV_-gjaAe3qwUWHn4TDRTfY-W_7yngPhh3h9h_j5VBhYbIuiLY0 Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Domain-Id: None Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Domain-Name: None Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Identity-Status: Confirmed Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Is-Admin-Project: True Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Domain-Id: default Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Domain-Name: Default Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Project-Name: admin Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Role: admin,reader,member Aug 09 16:54:42.658525 n-d-845781-6 devstack@n-api.service[103914]: X-Roles: admin,reader,member Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ee7634a37754b189553f8da3f833b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: X-Tenant: admin Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: X-Tenant-Id: 5ee7634a37754b189553f8da3f833b8d Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: X-Tenant-Name: admin Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: X-User: admin Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: X-User-Domain-Id: default Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: X-User-Domain-Name: Default Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: X-User-Id: f2f86e62846c4629949a13a64f640979 Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: X-User-Name: admin Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: method: > Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: exception: Flavor 451 could not be found. Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: action_args: {'id': '451'} Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:54:42.660068 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:42.660936 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 16:54:42.661986 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-0a2bfeaa-9de6-44fc-98cd-39b5b2f498c3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:54:42.663120 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-0a2bfeaa-9de6-44fc-98cd-39b5b2f498c3 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012533 Aug 09 16:54:42.663120 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 27/52] 10.222.0.93 () {60 vars in 1193 bytes} [Tue Aug 9 16:54:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 16:54:43.686895 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:43.688014 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 09 16:54:43.688450 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 26/53] 10.222.0.93 () {56 vars in 1074 bytes} [Tue Aug 9 16:54:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:44.235781 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-a837491b-323e-4cdf-99f7-28118978f467 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:44.254603 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-a837491b-323e-4cdf-99f7-28118978f467 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.417800 Aug 09 16:54:44.255154 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 28/54] 10.222.0.93 () {64 vars in 1235 bytes} [Tue Aug 9 16:54:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:54:45.271982 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:45.273078 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Aug 09 16:54:45.273474 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 27/55] 10.222.0.93 () {56 vars in 1074 bytes} [Tue Aug 9 16:54:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:45.800571 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-b58203d4-7356-4399-948b-34067a18d817 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:45.820504 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-b58203d4-7356-4399-948b-34067a18d817 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408745 Aug 09 16:54:45.821050 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 29/56] 10.222.0.93 () {64 vars in 1235 bytes} [Tue Aug 9 16:54:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:54:46.791236 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:46.792278 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 09 16:54:46.792695 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 28/57] 10.222.0.93 () {56 vars in 1074 bytes} [Tue Aug 9 16:54:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:47.327153 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-5ee264fc-75fb-4cd4-b629-026c0ccb6abe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:47.347580 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-5ee264fc-75fb-4cd4-b629-026c0ccb6abe admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.415170 Aug 09 16:54:47.348153 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 30/58] 10.222.0.93 () {64 vars in 1235 bytes} [Tue Aug 9 16:54:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:54:48.412121 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:48.413235 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Aug 09 16:54:48.413704 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 29/59] 10.222.0.93 () {56 vars in 1074 bytes} [Tue Aug 9 16:54:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:48.957330 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-2c2764e9-dc34-4419-bc32-33faeca49bc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:48.975674 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-2c2764e9-dc34-4419-bc32-33faeca49bc9 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.422876 Aug 09 16:54:48.976224 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 31/60] 10.222.0.93 () {64 vars in 1235 bytes} [Tue Aug 9 16:54:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:54:49.968148 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:49.969147 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 09 16:54:49.969536 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 30/61] 10.222.0.93 () {56 vars in 1074 bytes} [Tue Aug 9 16:54:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:50.640826 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-2b776cd5-3ec5-40bb-a262-572c97480dc2 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:50.661472 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-2b776cd5-3ec5-40bb-a262-572c97480dc2 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.554385 Aug 09 16:54:50.662011 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 32/62] 10.222.0.93 () {60 vars in 1202 bytes} [Tue Aug 9 16:54:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:43.128384 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:43.129462 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-2287fb0a-1e7d-4843-89cb-87f12efde1a0 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Aug 09 16:55:43.129918 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 31/63] 10.222.0.93 () {54 vars in 931 bytes} [Tue Aug 9 16:55:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:55:43.140783 n-d-845781-6 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:43.529039 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-3bc50f40-0cf5-4243-8aca-629c68bebb5e admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:43.551258 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-3bc50f40-0cf5-4243-8aca-629c68bebb5e admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.414757 Aug 09 16:55:43.551821 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 33/64] 10.222.0.93 () {60 vars in 1292 bytes} [Tue Aug 9 16:55:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:43.574826 n-d-845781-6 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=14 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:43.579226 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-493140dc-7a8d-4792-ae5e-df54a076fb86 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:43.589609 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-493140dc-7a8d-4792-ae5e-df54a076fb86 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016355 Aug 09 16:55:43.590231 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 32/65] 10.222.0.93 () {60 vars in 1283 bytes} [Tue Aug 9 16:55:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:43.602428 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-3bd4a1c2-12e4-42fc-a92b-5e149f55bf2c admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:43.610201 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-3bd4a1c2-12e4-42fc-a92b-5e149f55bf2c admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011431 Aug 09 16:55:43.610730 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 34/66] 10.222.0.93 () {60 vars in 1286 bytes} [Tue Aug 9 16:55:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:43.623046 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-78cc3485-095f-428a-b222-53d9103241dc admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:43.631765 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-78cc3485-095f-428a-b222-53d9103241dc admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012644 Aug 09 16:55:43.632336 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 33/67] 10.222.0.93 () {60 vars in 1286 bytes} [Tue Aug 9 16:55:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:43.644435 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-addceed6-4bc9-47b5-b4ae-e5522ac344b7 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:43.652715 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-addceed6-4bc9-47b5-b4ae-e5522ac344b7 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011890 Aug 09 16:55:43.653232 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 35/68] 10.222.0.93 () {60 vars in 1283 bytes} [Tue Aug 9 16:55:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:08.979844 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-78cc3485-095f-428a-b222-53d9103241dc admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:08.981025 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-78cc3485-095f-428a-b222-53d9103241dc admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001792 Aug 09 17:01:08.981540 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 34/69] 10.222.0.93 () {56 vars in 1074 bytes} [Tue Aug 9 17:01:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:01:09.137662 n-d-845781-6 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_api:SELECT=6 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:01:09.375608 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-c543633b-9e8b-4654-80cd-f6999a1b60ff admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:09.378780 n-d-845781-6 devstack@n-api.service[103914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:01:09.378780 n-d-845781-6 devstack@n-api.service[103914]: warnings.warn(msg) Aug 09 17:01:09.380495 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-c543633b-9e8b-4654-80cd-f6999a1b60ff admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:09.381240 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-c543633b-9e8b-4654-80cd-f6999a1b60ff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:09.381957 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-c543633b-9e8b-4654-80cd-f6999a1b60ff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:09.383152 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-c543633b-9e8b-4654-80cd-f6999a1b60ff admin admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:09.385879 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-c543633b-9e8b-4654-80cd-f6999a1b60ff admin admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:09.386611 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-c543633b-9e8b-4654-80cd-f6999a1b60ff admin admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:09.448043 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-c543633b-9e8b-4654-80cd-f6999a1b60ff admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.312164 Aug 09 17:01:09.449658 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 36/70] 10.222.0.93 () {60 vars in 1193 bytes} [Tue Aug 9 17:01:09 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:01:10.482947 n-d-845781-6 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-78cc3485-095f-428a-b222-53d9103241dc admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:10.484156 n-d-845781-6 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-78cc3485-095f-428a-b222-53d9103241dc admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 09 17:01:10.484704 n-d-845781-6 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 35/71] 10.222.0.93 () {56 vars in 1074 bytes} [Tue Aug 9 17:01:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:01:10.693698 n-d-845781-6 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-699deb00-dfdd-4aac-8c7b-46fa23b2bde2 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:10.696973 n-d-845781-6 devstack@n-api.service[103914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:01:10.696973 n-d-845781-6 devstack@n-api.service[103914]: warnings.warn(msg) Aug 09 17:01:10.698510 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-699deb00-dfdd-4aac-8c7b-46fa23b2bde2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:10.699063 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-699deb00-dfdd-4aac-8c7b-46fa23b2bde2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:10.699546 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-699deb00-dfdd-4aac-8c7b-46fa23b2bde2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:10.701010 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-699deb00-dfdd-4aac-8c7b-46fa23b2bde2 admin admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:10.701621 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-699deb00-dfdd-4aac-8c7b-46fa23b2bde2 admin admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:10.702151 n-d-845781-6 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-699deb00-dfdd-4aac-8c7b-46fa23b2bde2 admin admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:10.727397 n-d-845781-6 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-699deb00-dfdd-4aac-8c7b-46fa23b2bde2 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.097994 Aug 09 17:01:10.728028 n-d-845781-6 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 37/72] 10.222.0.93 () {60 vars in 1193 bytes} [Tue Aug 9 17:01:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:02:00.833187 n-d-845781-6 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 17:02:00.834448 n-d-845781-6 devstack@n-api.service[103912]: Tue Aug 9 17:02:00 2022 - graceful shutdown triggered... Aug 09 17:02:00.835128 n-d-845781-6 devstack@n-api.service[103913]: Gracefully killing worker 1 (pid: 103913)... Aug 09 17:02:00.835707 n-d-845781-6 devstack@n-api.service[103914]: Gracefully killing worker 2 (pid: 103914)... Aug 09 17:02:01.835649 n-d-845781-6 devstack@n-api.service[103912]: worker 1 buried after 1 seconds Aug 09 17:02:01.836397 n-d-845781-6 devstack@n-api.service[103912]: worker 2 buried after 1 seconds Aug 09 17:02:01.836397 n-d-845781-6 devstack@n-api.service[103912]: goodbye to uWSGI. Aug 09 17:02:01.837844 n-d-845781-6 systemd[1]: devstack@n-api.service: Succeeded. Aug 09 17:02:01.838429 n-d-845781-6 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 17:02:01.841770 n-d-845781-6 systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 17:02:01.860492 n-d-845781-6 devstack@n-api.service[119422]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 17:02:01 2022] *** Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: nodename: n-d-845781-6 Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: machine: x86_64 Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: clock source: unix Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: pcre jit disabled Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: detected number of CPU cores: 4 Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: current working directory: / Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: detected binary path: /usr/bin/uwsgi-core Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: your processes number limit is 47680 Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: your memory page size is 4096 bytes Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: detected max file descriptor number: 2048 Aug 09 17:02:01.879326 n-d-845781-6 devstack@n-api.service[119422]: lock engine: pthread robust mutexes Aug 09 17:02:01.881303 n-d-845781-6 devstack@n-api.service[119422]: thunder lock: enabled Aug 09 17:02:01.881303 n-d-845781-6 devstack@n-api.service[119422]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 17:02:01.881303 n-d-845781-6 devstack@n-api.service[119422]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 17:02:01.959245 n-d-845781-6 devstack@n-api.service[119422]: Python main interpreter initialized at 0x559154ec19c0 Aug 09 17:02:01.959245 n-d-845781-6 devstack@n-api.service[119422]: python threads support enabled Aug 09 17:02:01.959245 n-d-845781-6 devstack@n-api.service[119422]: your server socket listen backlog is limited to 100 connections Aug 09 17:02:01.959245 n-d-845781-6 devstack@n-api.service[119422]: your mercy for graceful operations on workers is 90 seconds Aug 09 17:02:01.960014 n-d-845781-6 devstack@n-api.service[119422]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 17:02:01.960014 n-d-845781-6 devstack@n-api.service[119422]: *** Operational MODE: preforking *** Aug 09 17:02:01.960555 n-d-845781-6 devstack@n-api.service[119422]: *** uWSGI is running in multiple interpreter mode *** Aug 09 17:02:01.960555 n-d-845781-6 devstack@n-api.service[119422]: spawned uWSGI master process (pid: 119422) Aug 09 17:02:01.960847 n-d-845781-6 systemd[1]: Started Devstack devstack@n-api.service. Aug 09 17:02:01.975690 n-d-845781-6 devstack@n-api.service[119422]: spawned uWSGI worker 1 (pid: 119431, cores: 1) Aug 09 17:02:01.975690 n-d-845781-6 devstack@n-api.service[119422]: spawned uWSGI worker 2 (pid: 119432, cores: 1) Aug 09 17:02:01.975690 n-d-845781-6 devstack@n-api.service[119422]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 17:02:02.855598 n-d-845781-6 devstack@n-api.service[119432]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 17:02:03.020082 n-d-845781-6 devstack@n-api.service[119431]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 17:02:04.826634 n-d-845781-6 devstack@n-api.service[119431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:02:04.826634 n-d-845781-6 devstack@n-api.service[119431]: from cryptography.utils import int_from_bytes Aug 09 17:02:04.827441 n-d-845781-6 devstack@n-api.service[119431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:02:04.827441 n-d-845781-6 devstack@n-api.service[119431]: from cryptography.utils import int_from_bytes Aug 09 17:02:04.882347 n-d-845781-6 devstack@n-api.service[119432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:02:04.882347 n-d-845781-6 devstack@n-api.service[119432]: from cryptography.utils import int_from_bytes Aug 09 17:02:04.883129 n-d-845781-6 devstack@n-api.service[119432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 17:02:04.883129 n-d-845781-6 devstack@n-api.service[119432]: from cryptography.utils import int_from_bytes Aug 09 17:02:08.024256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 17:02:08.024949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 17:02:08.025046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 17:02:08.025396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 17:02:08.025658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 17:02:08.026049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.026377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.026701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.027029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.027360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.027692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.028401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.028833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.029161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.029505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.029829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.030165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-845781-6 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.030499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.030813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.031130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.031457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.031809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.032139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.032447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.032948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.035736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.035736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.035736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.035736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.035736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.035736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.035736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.035736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.036362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.036362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.036580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-845781-6 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.037076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.037548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.038041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.038637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.038960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.039293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.039706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.039959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.040276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.040785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.041275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.041760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.042094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.042406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.042718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.043036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.043364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.043734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.044047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.044302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.044615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.044980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.045263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.045588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.045844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.046606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.046606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.046756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.047147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.047314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.048147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.048489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.048789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.049105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.049421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.049734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.050069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.050393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.050726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.051056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.051368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.051809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.052064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.052376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.052727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.053051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.053370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.053690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.054016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.054330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.054643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.054956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.055278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.055617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.055952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.056209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.056516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.056827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.057153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.057465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.057780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.058089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.058393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.058715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.059050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.059890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.060203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.060513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.060829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.061142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.061456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.061769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.062100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.062425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.062735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.063046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.063359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.063687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.064016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.064325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.064636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.064964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.065278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.065589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.065910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.066225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.066536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.066858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.067165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.067475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.067910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.068197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.068647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.068970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.069299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.069609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.069924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.070238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.070550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.070857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.071184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.071510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.071852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.072165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.072474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.072794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.073140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.073476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.073822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.074140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.074477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.075380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.075733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.076056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.076377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.076706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.077025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.077342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.077660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.077983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.078305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.078635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.078954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.079278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.079608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.079947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.080270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.080601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.080928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.081244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.081592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.081939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.082257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.082585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.082916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.083233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.083547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.083887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.084216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.084559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.084875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.085200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.085514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.085829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.086144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.086456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.086773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.087119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.087440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.087783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.088100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.088420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.088740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.089053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.089365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.089683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.089989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.090321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.090640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.090948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.091375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.091805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.092117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.092456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.092843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.093085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.093403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.093716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.094271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.094648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.094919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.095231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.095561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.095901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.096215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.096544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.096852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.097161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.097483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.097798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.098113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.098431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.098753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.099079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.099394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.099735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.100077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.100412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.100726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.101057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.101385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.101707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.102017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.102331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.102715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.103032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.103342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.103740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.104059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.104364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.104745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.105055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.105362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.105692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.106039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.106346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.106655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.106962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.107315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.107644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.108071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.108412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.108742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.109139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.109455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.109778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.110096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.110411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.110729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.111042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.111366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.111734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.112196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.112366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.112807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.113170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.113515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.113882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.114212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.114560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.114897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.115218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.115543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.115882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.116198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.116515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.116830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.117144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.117457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.117776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.118076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.118401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.118720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.119046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.119359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.119693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.120004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.120320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.120655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.120990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.121303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.122136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.122513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.122761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.123076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.123462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.123814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.124127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.124442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.124765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.125082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.125397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.125702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.126013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.126321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.126634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.126943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.127255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.127586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.127924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.128252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.128577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.128885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.129198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.129522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.129835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.130146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.130455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.130760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.131114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.131427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.131757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.132079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.132403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.132742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.133035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.133347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.133660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.133984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.134299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.134612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.134926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.135241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.135552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.135985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.136309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.138028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.138359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.138669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.139182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.139511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.139870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.140474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.140818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.141254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.141538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.141775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.142087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.143681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.143681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.143681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.143681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.144103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.144212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.144508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.144811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.145154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.145437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.145756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.146072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.146402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.146679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.147104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.147405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.147775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.148068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.148386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.148694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.149035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.149351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.149662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.149972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.150281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.150642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.150942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.151286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.151617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.151985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.152344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.152659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.153027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.153452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.153766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.154055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.154380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.154695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.155004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.155321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.155673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.155969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.156284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.156593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.156907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.157214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.157534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.157846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.158152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.158455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.158771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.159089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.159396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.159729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.160042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.160360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.160667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.160973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.161279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.161589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.161903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.162208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.162537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.162851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.163156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.163460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.163870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.164088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.164395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.164712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.165038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.165360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.165670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.165985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.166295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.166605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.166913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.167225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.167534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.168013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.168427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.168740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.169056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.169387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.169704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.170014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.170324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.170632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.170987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.171338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.171781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.172025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.172348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.172929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.173251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.173564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.173882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.174193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.174575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.174971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.175363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.175732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.176018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.176347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.176822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.177761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.178093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.178425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.178763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.179075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.179394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.179740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.180055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.180375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.180722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.181006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.181323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.181647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.181956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.182320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.182693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.182958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.183311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.183725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.183911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.184835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.185374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.185374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.185662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.186052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.186266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.186712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.187028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.187498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.187836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.188153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.188538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.188861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.189323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.189633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.190064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.190379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.190692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.191006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.191431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.191835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.192147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.192481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.192870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.193183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.193491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.193820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.194160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.194439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.194864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.195187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.195716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.196070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.196389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.196800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.197923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.198472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.198893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.199244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.199725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.200540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.200883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.201381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.201708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.202038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.202354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.202689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.203009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.203336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.203690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.204133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.204463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.204779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.205116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.205441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.205751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.206064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.206379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.206694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.207003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.207334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.207660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.207986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.208299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.208612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.208927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.209239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.209728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.210042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.210373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.210696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.211031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.211360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.211692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.212018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.212340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.212654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.212964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.213267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.213619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.213928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.214424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.214696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.215204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.215421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.215781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.215972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.216305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.216630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.216960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.217266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.217572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.217887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.218202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.218508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.218820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.219137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.219445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.219781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.220086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.220648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.221031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.221362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.221683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.221986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.222296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.222605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.222964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.223271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.223601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.223945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.224276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.224699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.224902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.225235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.225537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.225852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.226172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.226522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.226799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.227119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.227434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.227784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.228545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.228862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.229185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.229509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.229832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.230152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.230472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.230790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.231141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.231458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.231802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.232138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.232465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.232794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.233139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.233468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.233786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.234105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.234424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.234791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.235113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.235422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.235766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.236093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.236411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.236725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.237041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.237407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.237729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.238229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.238569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.238694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.239016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.239352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.239716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.240045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.240365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.240689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.241009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.241585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.241901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.242238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.242565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.242889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.243210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.243534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.243894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.244205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.244514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.244831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.245143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.245453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.245779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.246095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.246406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.247348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.247748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.248755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.248755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.249063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.249619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.250178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.250710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.251222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.251792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.252141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.252463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.252738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.253055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.253371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.253675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.253998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.254313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.254618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.254930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.255248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.255574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.255898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.256222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.256519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.256832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.257142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.257450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.257759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.258403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.258403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.258744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.259008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.259315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.259666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.260029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.260281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.260747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.261251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.261755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.262159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.262521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.263330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.263689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.264014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.264442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.264762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.265036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.265597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.266019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.266348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.266676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.266966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.267283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.267590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.267945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.268248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.268547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.268831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.269108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.269939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.270264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.270606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.270936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.272790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.272790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.272790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.272790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.272790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.272790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.274515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.274515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.274515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.274515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.274515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.276747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.276747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.276747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.276747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.276747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.276747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.276747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.278998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.278998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.278998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.278998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.278998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.278998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.281001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.281001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.281001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.281001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.281001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.284053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.284053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.284053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.284053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.284053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.284053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.284053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.284053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.286574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.286574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.286574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.286574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.286574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.286574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.286574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.286574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.288609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.288609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.288609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.288609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.288609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.288609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.288609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.288609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.291017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.291017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.291017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.291017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.291017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.291017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.291017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.291017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.295225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.295225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.295225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.295225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.295225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.295225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.295225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.295225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.297951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.297951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.297951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.297951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.297951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.297951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.297951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.297951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.301314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.301314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.301314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.301314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.301314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.301314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.301314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.301314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.304838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.304838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.304838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.304838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.304838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.304838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.304838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.304838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.307344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.307344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.307344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.307344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.307344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.307344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.307344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.307344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.309921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.309921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.309921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.309921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.309921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.309921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.309921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.309921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.312041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.312041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 17:02:08.389364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 17:02:08.389911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 17:02:08.390156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 17:02:08.390729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 17:02:08.391152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 17:02:08.391815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.392367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.392897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.393417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.393971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.394484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.395039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.395561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.396159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.396640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.397164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.397699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-845781-6 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.398243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.398764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.399289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.399842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.400362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.400973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.401477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.402188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.402746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.403818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.404356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.404939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.405462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.405978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.406497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.407010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.407540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.408107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.408733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-845781-6 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.409253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.409759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.410291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.410932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.411441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.411975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.412512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.413040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.413576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.414119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.414635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.415171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.415862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.416595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.417147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.417665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.418193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.418733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.419262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.419732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.420259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.420783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.421311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.421840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.422298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.423011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.423542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.424093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.424598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.425116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.425717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.426222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.426729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.427241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.427784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.428303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.428841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.429363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.429881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.430381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.430894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.431509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.431999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.432499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.433057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.433580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.434130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.434655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.435186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.435727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.436249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.436757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.437286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.437818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.438343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.438798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.439299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.439830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.440347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.440866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.441377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.441887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.442391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.442896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.443398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.443977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.444498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.445010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.445516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.446029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.446543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.447173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.447919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.448444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.448947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.449449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.450520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.451035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.451559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.452125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.452642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.453170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.453679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.454181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.454706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.455207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.455765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.456295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.456801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.457303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.457817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.458336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.458840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.459339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.459881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.460380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.460898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.461417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.461920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.462548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.463154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.463815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.464342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.464865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.465438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.466455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 17:02:08.467003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.467550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.468145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.468672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.469198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.469734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.470249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.470753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.471276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.471896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.472423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.472929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.473434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.473944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.474475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.475005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.475524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.476075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.476588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.477295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.477939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.478471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.478992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.479496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.480061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.480622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.481169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.481689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.482229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.482732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.483238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.483791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.484313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.484851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.485353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.485867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.486381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.486898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.487419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.487955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.488467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.489007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.489532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.490054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.490560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.491074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.491677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.492110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.492509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.492895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.493367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.494089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.494738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.495285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.495884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.496468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.496993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.497552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.498072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.498695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.499235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.499809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.500350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.500890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.501432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.501964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.502530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.503070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.503603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.504241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.504797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.505327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.505873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.506399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.506940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.507482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.508067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.508628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.509266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.509907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.510483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.511039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.511575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.512674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.513236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.513780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.514311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.514855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.515381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.515957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.516498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.517026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.517565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.518113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.518633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.519162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.519708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.520256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.520801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.521343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.521874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.522404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.522972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.523494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.524080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.524697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.525462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.526107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.526652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.527193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.529181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.529955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.530522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.531063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.531607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.532183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.532745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.533309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.533860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.534394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.534946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.535485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.536075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.536641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.537208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.537745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.538286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.538831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.539391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.539949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.540499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.541077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.541615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.542161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.542708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.543252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.543860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.544415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.544943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.545501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.546031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.546564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.547127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.547991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.548539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.549101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.549642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.550180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.550707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.551247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.551809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.552353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.552880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.553426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.553954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.554485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.555186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.555804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.556337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.556876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.557420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.557962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.558530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.559107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.559695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.560250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.560770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.561292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.561851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.562397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.562921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.563446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.564002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.564575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.565128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.565650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.566184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.566722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.567263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.567860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.568414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.568971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.569517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.570053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.570578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.571128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.571689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.572236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.572774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.573327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.574529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.575601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.576201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.576744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.577283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.577834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.578676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.579230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.579828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.580383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.580930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.581469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.582149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.582761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.583325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.583929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.584478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.585014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.585546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.586082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.586608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.587133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.587709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.588261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.588793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.589313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.589856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.590945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.591521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.592080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.592613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.593151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.593700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.594231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.594766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.595303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.595870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.596463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.596791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.597151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.597539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.597847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.598169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.598487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.598822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.599143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.599465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.599896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.600130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.600682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.601219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.601765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.602291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.602909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.603247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.603564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.604048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.604369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.604705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.605024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.605339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.605654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.606010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.606332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.606645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.606965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.607276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.607734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.608053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.608367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.608683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.609101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.609433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.609747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.610086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.610407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.610720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.611032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.611352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.611778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.612095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.612415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.612748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.613073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.613387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.613707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.614020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.614335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.614646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.614961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.615271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.615583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.615943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.616254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.616564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.616895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.617209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.617521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.617836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.618145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.618560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.619023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.619498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.619876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.620207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.620541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.620861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.621180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.622033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.622382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.622767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.623088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.623414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.625240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.625240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.625240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.625240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.625240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.626392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.626392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.626392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.626392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.627356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.627356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.627356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.628055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.628055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.632628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.632628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.632628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.632628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.632628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.632628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.632628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.632628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.663130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.663130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.663130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.663130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.663130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.663130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.663130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.663130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.664268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.664268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.664268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.664268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.664268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.664268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.664268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.664268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.665951 n-d-845781-6 devstack@n-api.service[119432]: INFO dbcounter [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Registered counter for database nova_api Aug 09 17:02:08.666204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.666204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.666204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.666204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.666204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.666204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.666204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.666204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.667188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.667188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.667188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.667188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.667188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.667188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.667188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.667188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.668217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.668217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.668217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.668217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.668217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.668217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.668217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.668217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.669383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.669383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.669383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.669383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.669383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.669383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.669383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.669383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.670563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.670563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.670563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.670563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.670563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.670563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.670563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.670563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.671798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.671798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.671798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.671798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.671798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.671798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.671798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.671798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.673075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.673075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.673075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.673075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.673075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.673075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.673075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.673075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.674095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.674095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.674095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.674095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.674095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.674095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.674095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.674095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.675354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.675354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.675354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.675354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.675354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.675354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.675354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.675354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.676599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.676599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.676599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.676599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.676996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.677278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.678193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.678193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.678432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.678591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.678924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.679244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.687494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.687494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.687494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.687494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.687494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.687494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.687494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.687494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.689065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.689065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.689065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.689065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.689065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.689065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.689065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.689065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.690555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.690555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.690555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.692209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.692209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.692209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.692722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.692921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.693108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.693689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.694036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.694386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.694729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.695020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_db.sqlalchemy.engines [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:02:08.695334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.695334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.695948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.696130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.697102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.697446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.697865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.698301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.698487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.698974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.699398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.700613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.701163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.701557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.701894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.702280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.702612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.702935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.703133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writer thread running {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:02:08.703789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.703789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.704356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.704544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.704735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.705046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.705626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.705898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.706222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.706549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.706877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.707219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.707573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.707937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.708267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.708587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.709643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.711298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.711562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.711948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.712370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.712838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.713097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.713578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.714041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.714243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.714567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.714902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.715277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.715594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.715958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.716312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.716637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.716969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.717297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.717895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.718260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.718877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.719280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.719546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.719907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.721756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.721756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.721756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.721756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.721756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.722667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.722667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.722667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.723197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.723383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.723567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.724003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.724212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.724535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.724855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.725174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.725487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.725822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.726120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.726437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.726751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.727065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.727385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.727849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.728651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.728651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.728984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.729441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.729575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.729877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.730219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.730697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.731994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.732367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.732711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.733048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.733372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.733705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.734175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.734398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.735004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.735349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.735703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.736052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.736395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.736719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.737032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.737348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.737685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.738015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.738745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.739076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.739400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.739896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.740079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.740409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.740740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.741221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.741676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.742322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.742322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.742647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.742843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.743174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.743824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.743965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.744353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.744708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.745042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.745363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.745687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.746105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.746319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.747171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.747515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.747875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.748190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.748643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.748966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.749348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.749682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.750069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.750404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.750743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.751067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.751916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.751916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.752759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.752759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.753098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.753275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.753529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.753844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.754157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.754499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.754803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.755119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.755428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.755767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.756086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.756399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.756713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.757024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.757333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.757649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.757959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.758275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.758735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.758916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.759170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.759480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.759872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.767057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.767057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.767057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.767057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.767057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.767057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.767057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.767057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.768210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.768210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.768210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.768210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.768210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.768210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.768210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.768210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.769403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.769403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.769403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.769403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.769403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.769403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.769403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.769403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.770318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.770318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.770318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.770318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.770318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.770318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.770318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.771327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.771327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.771327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.771681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.context [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) {{(pid=119432) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 17:02:08.771844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.772020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.772276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.772605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.772957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.773276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.773594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.773940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.775458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.775458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.775458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.775458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.776247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.776247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.776760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:02:08.776961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.777145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:02:08.777334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.777334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.778191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.778517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.778842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 17:02:08.779191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:02:08.779384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 17:02:08.786562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:02:08.786562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:02:08.786562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:02:08.786562 n-d-845781-6 devstack@n-api.service[119432]: INFO dbcounter [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Registered counter for database nova_cell0 Aug 09 17:02:08.797881 n-d-845781-6 devstack@n-api.service[119432]: INFO dbcounter [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Registered counter for database nova_cell1 Aug 09 17:02:08.810038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_db.sqlalchemy.engines [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:02:08.812775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_db.sqlalchemy.engines [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:02:08.821165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writer thread running {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:02:08.822653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writer thread running {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:02:08.949799 n-d-845781-6 devstack@n-api.service[119431]: INFO dbcounter [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Registered counter for database nova_api Aug 09 17:02:08.971470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:02:08.977391 n-d-845781-6 devstack@n-api.service[119432]: INFO dbcounter [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Registered counter for database nova_cell0 Aug 09 17:02:08.981464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writer thread running {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:02:08.987172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_db.sqlalchemy.engines [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:02:08.992061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writer thread running {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:02:09.045739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.context [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) {{(pid=119431) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 17:02:09.050194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:02:09.050688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:02:09.052388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:02:09.053381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:02:09.054088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:02:09.056458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:02:09.058631 n-d-845781-6 devstack@n-api.service[119431]: INFO dbcounter [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Registered counter for database nova_cell0 Aug 09 17:02:09.063977 n-d-845781-6 devstack@n-api.service[119431]: INFO dbcounter [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Registered counter for database nova_cell1 Aug 09 17:02:09.073859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:02:09.079447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writer thread running {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:02:09.080552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:02:09.235217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writer thread running {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:02:09.246015 n-d-845781-6 devstack@n-api.service[119431]: INFO dbcounter [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Registered counter for database nova_cell0 Aug 09 17:02:09.260293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_db.sqlalchemy.engines [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 17:02:09.267967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writer thread running {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 17:02:09.335373 n-d-845781-6 devstack@n-api.service[119432]: WARNING keystonemiddleware.auth_token [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:02:09.343747 n-d-845781-6 devstack@n-api.service[119432]: WARNING keystonemiddleware.auth_token [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:02:09.705295 n-d-845781-6 devstack@n-api.service[119431]: WARNING keystonemiddleware.auth_token [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:02:09.719411 n-d-845781-6 devstack@n-api.service[119431]: WARNING keystonemiddleware.auth_token [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:02:09.755736 n-d-845781-6 devstack@n-api.service[119432]: WARNING keystonemiddleware.auth_token [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:02:09.765864 n-d-845781-6 devstack@n-api.service[119432]: WARNING keystonemiddleware.auth_token [None req-310b10e9-beb1-46eb-9a85-e546f44de884 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:02:09.781050 n-d-845781-6 devstack@n-api.service[119432]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x559154ec19c0 pid: 119432 (default app) Aug 09 17:02:10.106805 n-d-845781-6 devstack@n-api.service[119431]: WARNING keystonemiddleware.auth_token [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 17:02:10.113217 n-d-845781-6 devstack@n-api.service[119431]: WARNING keystonemiddleware.auth_token [None req-a6e46d2b-865c-4e62-9590-bc2ea97cab79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 17:02:10.119690 n-d-845781-6 devstack@n-api.service[119431]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x559154ec19c0 pid: 119431 (default app) Aug 09 17:02:54.611149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:02:54.612723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:02:54.613794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:02:54.614672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:02:56.711782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab0dc0dd-a10c-4126-a765-ecbb0b63ff60 tempest-FlavorsV261TestJSON-990702013 tempest-FlavorsV261TestJSON-990702013-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-994832442", "id": 1050160738, "os-flavor-access:is_public": "True"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:02:56.755286 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:02:56.755286 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:02:56.815565 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ab0dc0dd-a10c-4126-a765-ecbb0b63ff60 tempest-FlavorsV261TestJSON-990702013 tempest-FlavorsV261TestJSON-990702013-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 2.211987 Aug 09 17:02:56.817483 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1/1] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:02:54 2022] POST /compute/v2.1/flavors => generated 467 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:02:56.856031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:02:56.857644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:02:56.859939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:02:56.864372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:02:57.439271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab8d5957-9967-4b26-a956-cee261acfd33 tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1164341252", "id": 1482343634, "os-flavor-access:is_public": "False"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:02:57.481225 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ab8d5957-9967-4b26-a956-cee261acfd33 tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.561084 Aug 09 17:02:57.502894 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2/2] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:02:56 2022] POST /compute/v2.1/flavors => generated 431 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:02:58.265214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cf4741ce-9d9c-4970-aedd-05f803f160d5 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:02:58.278600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf4741ce-9d9c-4970-aedd-05f803f160d5 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:02:58.278600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf4741ce-9d9c-4970-aedd-05f803f160d5 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:02:58.278600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf4741ce-9d9c-4970-aedd-05f803f160d5 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:02:58.279394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf4741ce-9d9c-4970-aedd-05f803f160d5 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:02:58.280171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf4741ce-9d9c-4970-aedd-05f803f160d5 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:02:58.280905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf4741ce-9d9c-4970-aedd-05f803f160d5 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:02:58.430594 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cf4741ce-9d9c-4970-aedd-05f803f160d5 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] 10.222.0.93 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.925629 Aug 09 17:02:58.431725 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3/3] 10.222.0.93 () {58 vars in 1164 bytes} [Tue Aug 9 17:02:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:02:58.438270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-80f702d3-82f9-4a34-a4e8-e67984c28c5a tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "57776b18e21f498ca1b014bdf05a93fa"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:02:58.441541 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:02:58.441541 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:02:58.987815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7e70150f-eb65-4f62-ad30-9ef873563b71 tempest-FlavorsV261TestJSON-1236934172 tempest-FlavorsV261TestJSON-1236934172-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:02:59.021085 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7e70150f-eb65-4f62-ad30-9ef873563b71 tempest-FlavorsV261TestJSON-1236934172 tempest-FlavorsV261TestJSON-1236934172-project] 10.222.0.93 "GET /compute/v2.1/flavors/1050160738" status: 200 len: 467 microversion: 2.61 time: 2.184706 Aug 09 17:02:59.022971 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1/4] 10.222.0.93 () {60 vars in 1199 bytes} [Tue Aug 9 17:02:56 2022] GET /compute/v2.1/flavors/1050160738 => generated 467 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:02:59.028227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0744b166-0ae1-4f59-bb89-629c84bdf559 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:02:59.030265 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:02:59.030265 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:02:59.031908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0744b166-0ae1-4f59-bb89-629c84bdf559 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:02:59.032672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0744b166-0ae1-4f59-bb89-629c84bdf559 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:02:59.033332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0744b166-0ae1-4f59-bb89-629c84bdf559 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:02:59.034438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0744b166-0ae1-4f59-bb89-629c84bdf559 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:02:59.035131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0744b166-0ae1-4f59-bb89-629c84bdf559 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:02:59.035890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0744b166-0ae1-4f59-bb89-629c84bdf559 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:02:59.086040 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0744b166-0ae1-4f59-bb89-629c84bdf559 tempest-AZAdminV2TestJSON-1478890754 tempest-AZAdminV2TestJSON-1478890754-project-admin] 10.222.0.93 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.061534 Aug 09 17:02:59.087259 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2/5] 10.222.0.93 () {58 vars in 1185 bytes} [Tue Aug 9 17:02:59 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:02:59.558029 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-80f702d3-82f9-4a34-a4e8-e67984c28c5a tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1482343634/action" status: 200 len: 97 microversion: 2.1 time: 1.123133 Aug 09 17:02:59.559210 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 4/6] 10.222.0.93 () {60 vars in 1200 bytes} [Tue Aug 9 17:02:58 2022] POST /compute/v2.1/flavors/1482343634/action => generated 97 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:02:59.570409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9632e988-b7e0-422f-a2ba-2296a1c6e63e tempest-FlavorsV261TestJSON-990702013 tempest-FlavorsV261TestJSON-990702013-project-admin] Action: 'update', calling method: .version_select at 0x7fbbda5574c0>, body: {"flavor": {"description": "new"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:02:59.592110 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:02:59.592110 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:02:59.652371 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9632e988-b7e0-422f-a2ba-2296a1c6e63e tempest-FlavorsV261TestJSON-990702013 tempest-FlavorsV261TestJSON-990702013-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/1050160738" status: 200 len: 468 microversion: 2.61 time: 0.090867 Aug 09 17:02:59.655137 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 5/7] 10.222.0.93 () {62 vars in 1219 bytes} [Tue Aug 9 17:02:59 2022] PUT /compute/v2.1/flavors/1050160738 => generated 468 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:02:59.701446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '.version_select at 0x7fbbda04dca0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:02:59.702524 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:02:59.702524 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:02:59.724609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) {{(pid=119431) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 09 17:02:59.728326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:02:59.733851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:02:59.735066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:02:59.823027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:02:59.824210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:02:59.825222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:02:59.851239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:02:59.852649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:02:59.853637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:02:59.875223 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-438875c3-a9bb-439c-9f5b-624a9bb78fdb tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.786222 Aug 09 17:02:59.878587 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3/8] 10.222.0.93 () {58 vars in 1167 bytes} [Tue Aug 9 17:02:59 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:02:59.982137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Calling method '.version_select at 0x7fbbd9fc53a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:02:59.987782 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:02:59.987782 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:00.009582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) {{(pid=119432) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 09 17:03:00.012587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:00.014440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:00.015259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:00.064151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:00.065048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:00.065859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:00.093215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:00.094130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:00.095003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:00.103976 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dec4978d-6ece-48f4-a5d0-289aa85948db tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1424 microversion: 2.41 time: 0.446801 Aug 09 17:03:00.105305 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 6/9] 10.222.0.93 () {60 vars in 1208 bytes} [Tue Aug 9 17:02:59 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1424 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:03:00.363489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e5bc4f5-bd0c-4d6a-952e-2b180c0b21c3 tempest-FlavorsAccessTestJSON-1054572829 tempest-FlavorsAccessTestJSON-1054572829-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:00.375803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07c80057-0f64-4018-845d-35294334e4a9 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Calling method '.version_select at 0x7fbbda01e790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:00.377823 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:00.377823 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:00.380369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07c80057-0f64-4018-845d-35294334e4a9 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:00.381926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07c80057-0f64-4018-845d-35294334e4a9 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:00.382720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07c80057-0f64-4018-845d-35294334e4a9 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:00.407904 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e5bc4f5-bd0c-4d6a-952e-2b180c0b21c3 tempest-FlavorsAccessTestJSON-1054572829 tempest-FlavorsAccessTestJSON-1054572829-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5829 microversion: 2.1 time: 0.300716 Aug 09 17:03:00.410339 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 7/10] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:03:00 2022] GET /compute/v2.1/flavors/detail => generated 5829 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:00.437691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9bc211bf-04a1-4fba-b60a-9fb63317a8e8 tempest-FlavorsV261TestJSON-1236934172 tempest-FlavorsV261TestJSON-1236934172-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:00.449415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07c80057-0f64-4018-845d-35294334e4a9 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:00.450016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07c80057-0f64-4018-845d-35294334e4a9 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:00.450374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07c80057-0f64-4018-845d-35294334e4a9 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:00.470695 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9bc211bf-04a1-4fba-b60a-9fb63317a8e8 tempest-FlavorsV261TestJSON-1236934172 tempest-FlavorsV261TestJSON-1236934172-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.058562 Aug 09 17:03:00.471658 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 8/11] 10.222.0.93 () {60 vars in 1187 bytes} [Tue Aug 9 17:03:00 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:03:00.500665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07c80057-0f64-4018-845d-35294334e4a9 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:00.501169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07c80057-0f64-4018-845d-35294334e4a9 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:00.502131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07c80057-0f64-4018-845d-35294334e4a9 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:00.513996 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07c80057-0f64-4018-845d-35294334e4a9 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.631112 Aug 09 17:03:00.514597 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4/12] 10.222.0.93 () {60 vars in 1187 bytes} [Tue Aug 9 17:02:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:03:00.530745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4ff18b6c-cdd3-48fa-a8b9-294f85e4d1a9 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-852744702", "name": "tempest-test_aggregate-14918987"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:00.584676 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:00.584676 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:00.586481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.aggregate [None req-4ff18b6c-cdd3-48fa-a8b9-294f85e4d1a9 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Generated uuid b050bddc-224b-4758-9d5c-3a64032fda9f for aggregate {{(pid=119431) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:03:00.627428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-912616055", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:00.795921 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4ff18b6c-cdd3-48fa-a8b9-294f85e4d1a9 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.276589 Aug 09 17:03:00.797094 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 5/13] 10.222.0.93 () {60 vars in 1165 bytes} [Tue Aug 9 17:03:00 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:00.802745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd57e492-9166-41b9-8a15-9e56dc819999 tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "57776b18e21f498ca1b014bdf05a93fa"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:00.809564 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:00.809564 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:01.244359 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fd57e492-9166-41b9-8a15-9e56dc819999 tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1482343634/action" status: 200 len: 21 microversion: 2.1 time: 0.445550 Aug 09 17:03:01.250737 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 6/14] 10.222.0.93 () {60 vars in 1200 bytes} [Tue Aug 9 17:03:00 2022] POST /compute/v2.1/flavors/1482343634/action => generated 21 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:01.259906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4bf725ad-87f4-4422-ac6d-2d6b1fd44f49 tempest-FlavorsV261TestJSON-1236934172 tempest-FlavorsV261TestJSON-1236934172-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:01.308336 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4bf725ad-87f4-4422-ac6d-2d6b1fd44f49 tempest-FlavorsV261TestJSON-1236934172 tempest-FlavorsV261TestJSON-1236934172-project] 10.222.0.93 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.056009 Aug 09 17:03:01.309550 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 7/15] 10.222.0.93 () {60 vars in 1166 bytes} [Tue Aug 9 17:03:01 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:03:01.316712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64ba918e-37ae-4f4f-aa43-47d7cda3f420 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Calling method '.version_select at 0x7fbbd9749670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:01.317821 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:01.317821 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:01.319973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ba918e-37ae-4f4f-aa43-47d7cda3f420 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:01.321048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ba918e-37ae-4f4f-aa43-47d7cda3f420 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:01.322019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ba918e-37ae-4f4f-aa43-47d7cda3f420 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:01.357786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ba918e-37ae-4f4f-aa43-47d7cda3f420 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:01.358782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ba918e-37ae-4f4f-aa43-47d7cda3f420 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:01.359585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ba918e-37ae-4f4f-aa43-47d7cda3f420 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:01.371686 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-64ba918e-37ae-4f4f-aa43-47d7cda3f420 tempest-HypervisorAdminV228Test-1617848466 tempest-HypervisorAdminV228Test-1617848466-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.060727 Aug 09 17:03:01.373461 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 8/16] 10.222.0.93 () {60 vars in 1193 bytes} [Tue Aug 9 17:03:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:03:01.379593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86472f28-b047-4a73-8bc1-59df6908d576 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:01.381239 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:01.381239 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:01.416934 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86472f28-b047-4a73-8bc1-59df6908d576 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 299 microversion: 2.1 time: 0.041936 Aug 09 17:03:01.418390 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 9/17] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:03:01 2022] GET /compute/v2.1/os-aggregates => generated 299 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:01.439327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8947399c-49cf-46f3-87be-6f5361778346 tempest-FlavorsAccessTestJSON-1054572829 tempest-FlavorsAccessTestJSON-1054572829-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:01.511442 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8947399c-49cf-46f3-87be-6f5361778346 tempest-FlavorsAccessTestJSON-1054572829 tempest-FlavorsAccessTestJSON-1054572829-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.081998 Aug 09 17:03:01.529231 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 10/18] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:03:01 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:01.544691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6fdade25-4f40-4274-bb2d-a84b372946a2 tempest-FlavorsV261TestJSON-990702013 tempest-FlavorsV261TestJSON-990702013-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:01.547371 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:01.547371 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:01.601671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:03:01.669973 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6fdade25-4f40-4274-bb2d-a84b372946a2 tempest-FlavorsV261TestJSON-990702013 tempest-FlavorsV261TestJSON-990702013-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1050160738" status: 202 len: 0 microversion: 2.61 time: 0.137622 Aug 09 17:03:01.674141 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 11/19] 10.222.0.93 () {60 vars in 1202 bytes} [Tue Aug 9 17:03:01 2022] DELETE /compute/v2.1/flavors/1050160738 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:03:01.686113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7397d098-d6a1-49a1-b880-d715ae040815 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-845781-6"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:01.693999 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:01.693999 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:01.717227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7397d098-d6a1-49a1-b880-d715ae040815 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:01.717742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7397d098-d6a1-49a1-b880-d715ae040815 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:01.718189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7397d098-d6a1-49a1-b880-d715ae040815 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:02.632247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:03:02.633026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:03:02.633862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:03:02.634472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:03:02.635282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:03:02.677899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:02.680713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:02.681553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:02.683203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:02.684539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:02.685511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:02.803687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Getting quotas for project da04c602d6734ab1a12a6c388f68f415. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:03:02.821699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Getting quotas for user 4b37941288004266be2c1bd8d11a20d4 and project da04c602d6734ab1a12a6c388f68f415. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:03:02.847062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:03:02.853610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:03:03.014375 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7a98e18f-caea-4d6a-8c84-1f2d9dfa0844 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.541359 Aug 09 17:03:03.020090 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 9/20] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:03:03.034707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e8bb93a-fa0e-43d5-85e7-f624b7b7a9ea tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:03.036759 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:03.036759 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:03.075013 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7397d098-d6a1-49a1-b880-d715ae040815 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 311 microversion: 2.1 time: 1.399327 Aug 09 17:03:03.075807 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 12/21] 10.222.0.93 () {60 vars in 1191 bytes} [Tue Aug 9 17:03:01 2022] POST /compute/v2.1/os-aggregates/1/action => generated 311 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:03.117137 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e8bb93a-fa0e-43d5-85e7-f624b7b7a9ea tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1482343634" status: 202 len: 0 microversion: 2.1 time: 0.091953 Aug 09 17:03:03.122805 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 10/22] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:03:03 2022] DELETE /compute/v2.1/flavors/1482343634 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:03:03.129806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d5e59cd-c670-4d85-944a-0c0b4ebafb19 tempest-FlavorsV261TestJSON-990702013 tempest-FlavorsV261TestJSON-990702013-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:03.145237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e60e715-5494-4e24-a2cd-7800bf16bb32 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:03.155019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2e60e715-5494-4e24-a2cd-7800bf16bb32 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:03.317337 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7d5e59cd-c670-4d85-944a-0c0b4ebafb19 tempest-FlavorsV261TestJSON-990702013 tempest-FlavorsV261TestJSON-990702013-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.208777 Aug 09 17:03:03.334137 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 13/23] 10.222.0.93 () {60 vars in 1187 bytes} [Tue Aug 9 17:03:03 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:03:03.350462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8dbb02d5-2dbb-469c-9754-7855e898c1ae tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:03.413606 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8dbb02d5-2dbb-469c-9754-7855e898c1ae tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077269 Aug 09 17:03:03.439135 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 14/24] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:03:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:03.444942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1302f3ab-4200-4fb8-bb7f-8980428ca40d tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1710862860", "id": 48485825, "os-flavor-access:is_public": "False"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:03.465755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2e60e715-5494-4e24-a2cd-7800bf16bb32 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:03.466411 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:03.466411 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:03.510994 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1302f3ab-4200-4fb8-bb7f-8980428ca40d tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.069897 Aug 09 17:03:03.517083 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2e60e715-5494-4e24-a2cd-7800bf16bb32 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1219 microversion: 2.1 time: 0.390155 Aug 09 17:03:03.520498 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 15/25] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:03:03 2022] POST /compute/v2.1/flavors => generated 425 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:03.532173 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 11/26] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:03 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1219 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:03.553952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b40c86a5-159f-44fa-99b3-46c6a2f86e38 tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:03.556161 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:03.556161 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:03.588093 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b40c86a5-159f-44fa-99b3-46c6a2f86e38 tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/48485825/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.053417 Aug 09 17:03:03.592063 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 12/27] 10.222.0.93 () {58 vars in 1203 bytes} [Tue Aug 9 17:03:03 2022] GET /compute/v2.1/flavors/48485825/os-flavor-access => generated 21 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:03.602735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-89037ea0-86e6-4a0c-a714-f5b0cab8fd47 tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:03.614301 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:03.614301 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:03.648660 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-89037ea0-86e6-4a0c-a714-f5b0cab8fd47 tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/48485825" status: 202 len: 0 microversion: 2.1 time: 0.052260 Aug 09 17:03:03.650325 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 13/28] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:03:03 2022] DELETE /compute/v2.1/flavors/48485825 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:03:03.659870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-12fcbb55-1925-43bd-b6a9-7e6bcd0e5fe1 tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:03.724899 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-12fcbb55-1925-43bd-b6a9-7e6bcd0e5fe1 tempest-FlavorsAccessTestJSON-1605295669 tempest-FlavorsAccessTestJSON-1605295669-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069280 Aug 09 17:03:03.737064 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 14/29] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:03:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:04.558462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7ba9694-872d-4e6e-b72d-9876ec9b73cc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:04.560776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f7ba9694-872d-4e6e-b72d-9876ec9b73cc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:04.568674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-141858175", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "availability_zone": "tempest-test_az-852744702"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:04.630546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:04.634532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:04.635613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:04.644689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:04.645883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:04.648163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:04.862929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f7ba9694-872d-4e6e-b72d-9876ec9b73cc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:04.881597 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f7ba9694-872d-4e6e-b72d-9876ec9b73cc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1219 microversion: 2.1 time: 0.326342 Aug 09 17:03:04.883696 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 15/30] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:04 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1219 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:05.918703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5b6e26d5-e399-4172-9d60-6adc417bdcee tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:05.927895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5b6e26d5-e399-4172-9d60-6adc417bdcee tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:06.115275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6e26d5-e399-4172-9d60-6adc417bdcee tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:06.118206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6e26d5-e399-4172-9d60-6adc417bdcee tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:06.119938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6e26d5-e399-4172-9d60-6adc417bdcee tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:06.128471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6e26d5-e399-4172-9d60-6adc417bdcee tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:06.134576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6e26d5-e399-4172-9d60-6adc417bdcee tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:06.140289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6e26d5-e399-4172-9d60-6adc417bdcee tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:06.745145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5b6e26d5-e399-4172-9d60-6adc417bdcee tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:06.774076 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5b6e26d5-e399-4172-9d60-6adc417bdcee tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1223 microversion: 2.1 time: 0.868004 Aug 09 17:03:06.779813 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 16/31] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:05 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1223 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:07.473246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:03:07.824537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b36299da-6e89-4aaf-a79b-388dbbc257bc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:07.825422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b36299da-6e89-4aaf-a79b-388dbbc257bc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:07.851670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36299da-6e89-4aaf-a79b-388dbbc257bc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:07.859448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36299da-6e89-4aaf-a79b-388dbbc257bc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:07.860959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36299da-6e89-4aaf-a79b-388dbbc257bc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:07.862595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36299da-6e89-4aaf-a79b-388dbbc257bc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:07.868427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36299da-6e89-4aaf-a79b-388dbbc257bc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:07.869198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36299da-6e89-4aaf-a79b-388dbbc257bc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:08.109602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b36299da-6e89-4aaf-a79b-388dbbc257bc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:08.147025 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b36299da-6e89-4aaf-a79b-388dbbc257bc tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1289 microversion: 2.1 time: 0.325782 Aug 09 17:03:08.154259 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 17/32] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:07 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1289 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:08.231927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:03:08.234865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:03:08.236705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:03:08.237720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:03:08.238683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:03:08.274803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:08.276837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:08.278875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:08.280538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:08.281797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:08.283087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:08.406127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Getting quotas for project 6f475204b1644570bc2bc148e895a171. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:03:08.417785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Getting quotas for user ac04975ebf9041c2a34e252d3f39a32f and project 6f475204b1644570bc2bc148e895a171. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:03:08.434848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:03:08.438277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:03:08.575470 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a0ee34a-564e-41b0-b0dc-de0441bec13c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.052161 Aug 09 17:03:08.586672 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 16/33] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:03:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 5065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:03:08.589551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-853b1402-5944-42ce-b7e8-f8bea1e59fe7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:08.590189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-853b1402-5944-42ce-b7e8-f8bea1e59fe7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:08.700059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-853b1402-5944-42ce-b7e8-f8bea1e59fe7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:08.714464 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-853b1402-5944-42ce-b7e8-f8bea1e59fe7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1241 microversion: 2.1 time: 0.126694 Aug 09 17:03:08.715874 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 18/34] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:08 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:09.183182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-066ede43-57e9-4450-a162-8e59f8364f2f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:09.188182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-066ede43-57e9-4450-a162-8e59f8364f2f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:09.240426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-066ede43-57e9-4450-a162-8e59f8364f2f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:09.241851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-066ede43-57e9-4450-a162-8e59f8364f2f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:09.244954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-066ede43-57e9-4450-a162-8e59f8364f2f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:09.246668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-066ede43-57e9-4450-a162-8e59f8364f2f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:09.248598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-066ede43-57e9-4450-a162-8e59f8364f2f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:09.251260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-066ede43-57e9-4450-a162-8e59f8364f2f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:09.749044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-01975dd0-3e7b-4b77-85f6-033ce622d407 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:09.750517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-01975dd0-3e7b-4b77-85f6-033ce622d407 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:09.916437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-066ede43-57e9-4450-a162-8e59f8364f2f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:09.950271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-01975dd0-3e7b-4b77-85f6-033ce622d407 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:09.972880 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-066ede43-57e9-4450-a162-8e59f8364f2f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1277 microversion: 2.1 time: 0.798597 Aug 09 17:03:09.973495 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 17/35] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:09 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1277 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:09.988841 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-01975dd0-3e7b-4b77-85f6-033ce622d407 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1241 microversion: 2.1 time: 0.237699 Aug 09 17:03:09.993938 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 19/36] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:09 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1241 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:11.028909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-675e4e68-9860-4262-808a-d1460e7fd5e2 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:11.029578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-675e4e68-9860-4262-808a-d1460e7fd5e2 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:11.042295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675e4e68-9860-4262-808a-d1460e7fd5e2 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:11.046367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ae275f18-d2aa-4389-a608-c331b795f54f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:11.048304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ae275f18-d2aa-4389-a608-c331b795f54f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:11.056210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675e4e68-9860-4262-808a-d1460e7fd5e2 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:11.057046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675e4e68-9860-4262-808a-d1460e7fd5e2 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:11.070005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675e4e68-9860-4262-808a-d1460e7fd5e2 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:11.070579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675e4e68-9860-4262-808a-d1460e7fd5e2 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:11.071088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675e4e68-9860-4262-808a-d1460e7fd5e2 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:11.072462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae275f18-d2aa-4389-a608-c331b795f54f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:11.085075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae275f18-d2aa-4389-a608-c331b795f54f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:11.089200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae275f18-d2aa-4389-a608-c331b795f54f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:11.090937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae275f18-d2aa-4389-a608-c331b795f54f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:11.095165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae275f18-d2aa-4389-a608-c331b795f54f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:11.099358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae275f18-d2aa-4389-a608-c331b795f54f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:11.398728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ae275f18-d2aa-4389-a608-c331b795f54f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:11.412122 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ae275f18-d2aa-4389-a608-c331b795f54f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1241 microversion: 2.1 time: 0.371155 Aug 09 17:03:11.434258 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 20/37] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:11 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1241 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:11.875894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-675e4e68-9860-4262-808a-d1460e7fd5e2 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:11.891677 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-675e4e68-9860-4262-808a-d1460e7fd5e2 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 0.866635 Aug 09 17:03:11.892667 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 18/38] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:11 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:12.446263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2079310c-55bd-46dd-827f-7a3c92937ca2 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:12.448936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2079310c-55bd-46dd-827f-7a3c92937ca2 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:12.461440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2079310c-55bd-46dd-827f-7a3c92937ca2 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:12.462458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2079310c-55bd-46dd-827f-7a3c92937ca2 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:12.465677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2079310c-55bd-46dd-827f-7a3c92937ca2 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:12.478208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2079310c-55bd-46dd-827f-7a3c92937ca2 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:12.479875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2079310c-55bd-46dd-827f-7a3c92937ca2 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:12.480848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2079310c-55bd-46dd-827f-7a3c92937ca2 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:12.739943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:12.915336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c09b62f-7257-4fae-b6b7-f1efd4325b5c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:12.916823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c09b62f-7257-4fae-b6b7-f1efd4325b5c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:12.954095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c09b62f-7257-4fae-b6b7-f1efd4325b5c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:12.954645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c09b62f-7257-4fae-b6b7-f1efd4325b5c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:12.955105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c09b62f-7257-4fae-b6b7-f1efd4325b5c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:12.955972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c09b62f-7257-4fae-b6b7-f1efd4325b5c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:12.957105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c09b62f-7257-4fae-b6b7-f1efd4325b5c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:12.958644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c09b62f-7257-4fae-b6b7-f1efd4325b5c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:13.271082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2079310c-55bd-46dd-827f-7a3c92937ca2 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:13.303891 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2079310c-55bd-46dd-827f-7a3c92937ca2 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1297 microversion: 2.1 time: 0.862335 Aug 09 17:03:13.307745 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 21/39] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:12 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1297 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:14.010874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c09b62f-7257-4fae-b6b7-f1efd4325b5c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:14.047222 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c09b62f-7257-4fae-b6b7-f1efd4325b5c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 1.137017 Aug 09 17:03:14.065027 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 19/40] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:12 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:14.344055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1e87aa38-9616-4425-b451-3739fbaae005 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:14.360348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1e87aa38-9616-4425-b451-3739fbaae005 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:14.383326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:14.389259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e87aa38-9616-4425-b451-3739fbaae005 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:14.392843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e87aa38-9616-4425-b451-3739fbaae005 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:14.394217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e87aa38-9616-4425-b451-3739fbaae005 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:14.396762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e87aa38-9616-4425-b451-3739fbaae005 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:14.412137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e87aa38-9616-4425-b451-3739fbaae005 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:14.413111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e87aa38-9616-4425-b451-3739fbaae005 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:14.801853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1e87aa38-9616-4425-b451-3739fbaae005 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:14.847750 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1e87aa38-9616-4425-b451-3739fbaae005 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1295 microversion: 2.1 time: 0.503806 Aug 09 17:03:14.860882 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 22/41] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:14 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1295 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:15.091752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-65e7bb38-ed90-44fa-b2d6-65403d121851 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:15.094108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-65e7bb38-ed90-44fa-b2d6-65403d121851 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:15.152574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65e7bb38-ed90-44fa-b2d6-65403d121851 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:15.165430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65e7bb38-ed90-44fa-b2d6-65403d121851 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:15.178648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65e7bb38-ed90-44fa-b2d6-65403d121851 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:15.187336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65e7bb38-ed90-44fa-b2d6-65403d121851 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:15.193904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65e7bb38-ed90-44fa-b2d6-65403d121851 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:15.194148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65e7bb38-ed90-44fa-b2d6-65403d121851 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:16.847915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-65e7bb38-ed90-44fa-b2d6-65403d121851 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:16.875552 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-65e7bb38-ed90-44fa-b2d6-65403d121851 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 1.790696 Aug 09 17:03:16.879882 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 20/42] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:15 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:16.904586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dcc9297d-75a4-40d4-a0e2-b1ecb57f6450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:16.910269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dcc9297d-75a4-40d4-a0e2-b1ecb57f6450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:16.927489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcc9297d-75a4-40d4-a0e2-b1ecb57f6450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:16.928179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcc9297d-75a4-40d4-a0e2-b1ecb57f6450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:16.928744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcc9297d-75a4-40d4-a0e2-b1ecb57f6450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:16.929797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcc9297d-75a4-40d4-a0e2-b1ecb57f6450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:16.932758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcc9297d-75a4-40d4-a0e2-b1ecb57f6450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:16.933430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcc9297d-75a4-40d4-a0e2-b1ecb57f6450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:17.133218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dcc9297d-75a4-40d4-a0e2-b1ecb57f6450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:17.141401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-29916e1f-d26b-4da0-8d16-c543b46e1bb6 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-151201117", "ram": 512, "vcpus": 1, "disk": 10, "id": 1229294280, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:17.160391 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:17.160391 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:17.167851 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dcc9297d-75a4-40d4-a0e2-b1ecb57f6450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1295 microversion: 2.1 time: 0.276516 Aug 09 17:03:17.172721 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 21/43] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:16 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1295 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:17.280814 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-29916e1f-d26b-4da0-8d16-c543b46e1bb6 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 1.441878 Aug 09 17:03:17.281644 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 23/44] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:03:15 2022] POST /compute/v2.1/flavors => generated 415 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:17.302054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b81ba4d1-a35e-493f-a704-b77d83d7de3e tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:17.318715 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:17.318715 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:17.477936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:DELETE=4,nova_api:SAVEPOINT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:17.562146 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b81ba4d1-a35e-493f-a704-b77d83d7de3e tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1229294280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.267403 Aug 09 17:03:17.574901 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 22/45] 10.222.0.93 () {60 vars in 1224 bytes} [Tue Aug 9 17:03:17 2022] POST /compute/v2.1/flavors/1229294280/os-extra_specs => generated 66 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:03:17.904246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2507edc1-979a-4685-89a7-12a6042f5040 req-bc14d208-7039-4c0d-82dc-1b5e8f44530f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da17df6f-e2bb-4886-919f-6b90e3cf344c", "tag": "b796f8f1-54d4-4adb-88a1-0e39567a6be4"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:17.949477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2507edc1-979a-4685-89a7-12a6042f5040 req-bc14d208-7039-4c0d-82dc-1b5e8f44530f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:17.953535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2507edc1-979a-4685-89a7-12a6042f5040 req-bc14d208-7039-4c0d-82dc-1b5e8f44530f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:17.955901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2507edc1-979a-4685-89a7-12a6042f5040 req-bc14d208-7039-4c0d-82dc-1b5e8f44530f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:18.018201 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2507edc1-979a-4685-89a7-12a6042f5040 req-bc14d208-7039-4c0d-82dc-1b5e8f44530f service nova] Creating event network-changed:b796f8f1-54d4-4adb-88a1-0e39567a6be4 for instance da17df6f-e2bb-4886-919f-6b90e3cf344c on n-h1-845781-6 Aug 09 17:03:18.020009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2507edc1-979a-4685-89a7-12a6042f5040 req-bc14d208-7039-4c0d-82dc-1b5e8f44530f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:03:18.022068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2507edc1-979a-4685-89a7-12a6042f5040 req-bc14d208-7039-4c0d-82dc-1b5e8f44530f service nova] Acquired lock "compute-rpcapi-router" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:03:18.025809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0cba02f-6cf1-442e-8d8b-51f021066048 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:18.027393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0cba02f-6cf1-442e-8d8b-51f021066048 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:18.028891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0cba02f-6cf1-442e-8d8b-51f021066048 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:18.031434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0cba02f-6cf1-442e-8d8b-51f021066048 None None] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:18.032617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0cba02f-6cf1-442e-8d8b-51f021066048 None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:18.033081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0cba02f-6cf1-442e-8d8b-51f021066048 None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:18.058660 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.compute.rpcapi [None req-d0cba02f-6cf1-442e-8d8b-51f021066048 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 17:03:18.061224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0cba02f-6cf1-442e-8d8b-51f021066048 None None] Releasing lock "compute-rpcapi-router" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:03:18.103825 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d0cba02f-6cf1-442e-8d8b-51f021066048 None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.765318 Aug 09 17:03:18.104794 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 24/46] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:18.115977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-75f5f0f0-5051-4f0c-8716-ff79d09bc141 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:18.121212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-75f5f0f0-5051-4f0c-8716-ff79d09bc141 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:18.148537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75f5f0f0-5051-4f0c-8716-ff79d09bc141 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:18.155422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75f5f0f0-5051-4f0c-8716-ff79d09bc141 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:18.157829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75f5f0f0-5051-4f0c-8716-ff79d09bc141 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:18.158934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75f5f0f0-5051-4f0c-8716-ff79d09bc141 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:18.164261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75f5f0f0-5051-4f0c-8716-ff79d09bc141 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:18.168024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75f5f0f0-5051-4f0c-8716-ff79d09bc141 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:18.345926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:18.397714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a6325804-09be-40d9-babe-fa0a31e571d4 tempest-FlavorsExtraSpecsTestJSON-2009258574 tempest-FlavorsExtraSpecsTestJSON-2009258574-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:18.440472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:18.455540 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a6325804-09be-40d9-babe-fa0a31e571d4 tempest-FlavorsExtraSpecsTestJSON-2009258574 tempest-FlavorsExtraSpecsTestJSON-2009258574-project] 10.222.0.93 "GET /compute/v2.1/flavors/1229294280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.872028 Aug 09 17:03:18.473223 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 23/47] 10.222.0.93 () {58 vars in 1203 bytes} [Tue Aug 9 17:03:17 2022] GET /compute/v2.1/flavors/1229294280/os-extra_specs => generated 66 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:18.484021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-154d4359-5742-4947-952c-9f39828bd68d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:18.490448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-154d4359-5742-4947-952c-9f39828bd68d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:18.530302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154d4359-5742-4947-952c-9f39828bd68d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:18.533125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154d4359-5742-4947-952c-9f39828bd68d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:18.535253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154d4359-5742-4947-952c-9f39828bd68d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:18.542219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154d4359-5742-4947-952c-9f39828bd68d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:18.543089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154d4359-5742-4947-952c-9f39828bd68d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:18.543982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154d4359-5742-4947-952c-9f39828bd68d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:19.981675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=14 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:20.284698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-75f5f0f0-5051-4f0c-8716-ff79d09bc141 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:20.311373 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-75f5f0f0-5051-4f0c-8716-ff79d09bc141 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 2.202123 Aug 09 17:03:20.314215 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 25/48] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:18 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:20.330182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-86217b8c-2c59-45d8-a214-864e49069dfc tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:20.357734 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:20.357734 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:20.510662 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-86217b8c-2c59-45d8-a214-864e49069dfc tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1229294280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.194105 Aug 09 17:03:20.523007 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 26/49] 10.222.0.93 () {60 vars in 1224 bytes} [Tue Aug 9 17:03:20 2022] POST /compute/v2.1/flavors/1229294280/os-extra_specs => generated 66 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:20.777961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-154d4359-5742-4947-952c-9f39828bd68d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:20.814903 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-154d4359-5742-4947-952c-9f39828bd68d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 2.350845 Aug 09 17:03:20.826597 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 24/50] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:18 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:20.849659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a3300ed6-ab4f-4933-ac87-31d32d89c1a9 tempest-FlavorsExtraSpecsTestJSON-2009258574 tempest-FlavorsExtraSpecsTestJSON-2009258574-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:20.899193 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a3300ed6-ab4f-4933-ac87-31d32d89c1a9 tempest-FlavorsExtraSpecsTestJSON-2009258574 tempest-FlavorsExtraSpecsTestJSON-2009258574-project] 10.222.0.93 "GET /compute/v2.1/flavors/1229294280/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.070024 Aug 09 17:03:20.904343 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 25/51] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:03:20 2022] GET /compute/v2.1/flavors/1229294280/os-extra_specs/hw:numa_nodes => generated 22 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:20.938378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-12567213-56cc-4cdb-b522-3b5fdf136235 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:20.952495 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:20.952495 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:21.101166 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-12567213-56cc-4cdb-b522-3b5fdf136235 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1229294280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.190428 Aug 09 17:03:21.106515 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 26/52] 10.222.0.93 () {60 vars in 1224 bytes} [Tue Aug 9 17:03:20 2022] POST /compute/v2.1/flavors/1229294280/os-extra_specs => generated 66 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:21.112590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a891f491-634d-4948-ba48-b9d31cacfdcd tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:21.138466 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a891f491-634d-4948-ba48-b9d31cacfdcd tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/1229294280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029836 Aug 09 17:03:21.141807 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 27/53] 10.222.0.93 () {58 vars in 1203 bytes} [Tue Aug 9 17:03:21 2022] GET /compute/v2.1/flavors/1229294280/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:21.151004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22829fa4-5530-4eb2-9752-f45dc365759f tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:21.153807 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:21.153807 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:21.220080 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-22829fa4-5530-4eb2-9752-f45dc365759f tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/1229294280/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.072978 Aug 09 17:03:21.223098 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 28/54] 10.222.0.93 () {60 vars in 1265 bytes} [Tue Aug 9 17:03:21 2022] PUT /compute/v2.1/flavors/1229294280/os-extra_specs/hw:numa_nodes => generated 22 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:21.233868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0dab90e4-5453-4748-9a5d-748a7be3be58 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:21.258640 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0dab90e4-5453-4748-9a5d-748a7be3be58 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/1229294280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.024112 Aug 09 17:03:21.264071 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 29/55] 10.222.0.93 () {58 vars in 1203 bytes} [Tue Aug 9 17:03:21 2022] GET /compute/v2.1/flavors/1229294280/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:03:21.273175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Calling method '.version_select at 0x7fbbd8dbbb80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:21.277486 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:21.277486 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:21.278835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:21.279345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:21.279909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:21.292125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1eb7b852-c0c9-450c-9a5e-48275ed24230 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:21.292977 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:21.292977 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:21.366388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:21.366904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:21.367348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:21.419681 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1eb7b852-c0c9-450c-9a5e-48275ed24230 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1229294280/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.142561 Aug 09 17:03:21.430509 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 30/56] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:03:21 2022] DELETE /compute/v2.1/flavors/1229294280/os-extra_specs/hw:numa_nodes => generated 0 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:03:21.453899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-85e2a12d-0c49-402e-9498-73a3b822314e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:21.455055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-85e2a12d-0c49-402e-9498-73a3b822314e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:21.463608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85e2a12d-0c49-402e-9498-73a3b822314e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:21.464386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85e2a12d-0c49-402e-9498-73a3b822314e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:21.464999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85e2a12d-0c49-402e-9498-73a3b822314e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:21.466130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85e2a12d-0c49-402e-9498-73a3b822314e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:21.466752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85e2a12d-0c49-402e-9498-73a3b822314e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:21.467329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85e2a12d-0c49-402e-9498-73a3b822314e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:21.562512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:21.568207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:21.573025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:21.645925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:21.651565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:21.656742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:21.776614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:21.781201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:21.782399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:21.839003 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ade9543b-cdcf-47ca-bd93-c8e25be8d3d4 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1758 microversion: 2.53 time: 1.303122 Aug 09 17:03:21.866818 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 27/57] 10.222.0.93 () {60 vars in 1243 bytes} [Tue Aug 9 17:03:20 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1758 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:03:21.884100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-849005a0-ebf4-40df-8469-57048d5cafc6 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:21.886864 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:21.886864 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:21.944237 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-849005a0-ebf4-40df-8469-57048d5cafc6 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1229294280/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.075311 Aug 09 17:03:21.949812 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 28/58] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:03:21 2022] DELETE /compute/v2.1/flavors/1229294280/os-extra_specs/hw:cpu_policy => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:03:21.962637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-62000aed-75b8-4c20-b335-c2e7a1b81533 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:21.973612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-62000aed-75b8-4c20-b335-c2e7a1b81533 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:21.995415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62000aed-75b8-4c20-b335-c2e7a1b81533 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:21.995947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62000aed-75b8-4c20-b335-c2e7a1b81533 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:21.996397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62000aed-75b8-4c20-b335-c2e7a1b81533 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.001476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62000aed-75b8-4c20-b335-c2e7a1b81533 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.002141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62000aed-75b8-4c20-b335-c2e7a1b81533 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.002664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62000aed-75b8-4c20-b335-c2e7a1b81533 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.216202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-85e2a12d-0c49-402e-9498-73a3b822314e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:22.248359 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-85e2a12d-0c49-402e-9498-73a3b822314e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 0.810057 Aug 09 17:03:22.269708 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 31/59] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:21 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:22.466723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-62000aed-75b8-4c20-b335-c2e7a1b81533 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:22.477158 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-62000aed-75b8-4c20-b335-c2e7a1b81533 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 0.524127 Aug 09 17:03:22.478844 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 29/60] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:21 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:22.484452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Calling method '.version_select at 0x7fbbd8d65af0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:22.488468 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:22.488468 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:22.490351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.491204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.494223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.513762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.515119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.515891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.541888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.542926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.543823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.569920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.571148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.572118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.622290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.624026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.625304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.640620 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-001411e5-76a5-49f6-8702-14958af7cb93 tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.159561 Aug 09 17:03:22.643551 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 30/61] 10.222.0.93 () {60 vars in 1222 bytes} [Tue Aug 9 17:03:22 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:03:22.653575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f03912e0-4644-400b-8328-894f673511e3 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:22.681585 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f03912e0-4644-400b-8328-894f673511e3 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/1229294280/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035351 Aug 09 17:03:22.683007 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 31/62] 10.222.0.93 () {58 vars in 1203 bytes} [Tue Aug 9 17:03:22 2022] GET /compute/v2.1/flavors/1229294280/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:22.880390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd1c3831-5b35-45d3-a0c9-be70b6fba16f tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Calling method '.version_select at 0x7fbbd84b7670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:22.912107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-14c5b58f-7221-4da6-9056-4a2b61bbc19a tempest-FlavorMetadataValidation-719827486 tempest-FlavorMetadataValidation-719827486-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-650991368", "id": 2036962211, "os-flavor-access:is_public": "True"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:22.924503 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:22.924503 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:22.925656 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:22.925656 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:22.927328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1c3831-5b35-45d3-a0c9-be70b6fba16f tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.933126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1c3831-5b35-45d3-a0c9-be70b6fba16f tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.934143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1c3831-5b35-45d3-a0c9-be70b6fba16f tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.935211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1c3831-5b35-45d3-a0c9-be70b6fba16f tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.937168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1c3831-5b35-45d3-a0c9-be70b6fba16f tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.944460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1c3831-5b35-45d3-a0c9-be70b6fba16f tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.983828 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-14c5b58f-7221-4da6-9056-4a2b61bbc19a tempest-FlavorMetadataValidation-719827486 tempest-FlavorMetadataValidation-719827486-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.293168 Aug 09 17:03:22.985040 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 32/63] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:03:22 2022] POST /compute/v2.1/flavors => generated 470 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:03:22.994943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-097d81c4-8530-46a9-bb08-abb22c4b547d tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Calling method '.version_select at 0x7fbbd8dc4f70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:23.004704 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:23.004704 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:23.011148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-097d81c4-8530-46a9-bb08-abb22c4b547d tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.018337 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bd1c3831-5b35-45d3-a0c9-be70b6fba16f tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.747342 Aug 09 17:03:23.018619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-097d81c4-8530-46a9-bb08-abb22c4b547d tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.020122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-097d81c4-8530-46a9-bb08-abb22c4b547d tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:23.027798 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 32/64] 10.222.0.93 () {58 vars in 1128 bytes} [Tue Aug 9 17:03:22 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:23.037684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67432cf8-1dd7-4797-bdad-461d25ce9b62 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:23.038530 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:23.038530 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:23.077720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-097d81c4-8530-46a9-bb08-abb22c4b547d tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.078398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-097d81c4-8530-46a9-bb08-abb22c4b547d tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.080676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-097d81c4-8530-46a9-bb08-abb22c4b547d tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:23.103600 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-097d81c4-8530-46a9-bb08-abb22c4b547d tempest-HypervisorAdminV253TestBase-1312093163 tempest-HypervisorAdminV253TestBase-1312093163-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/61ca71a3-2a41-484f-81a1-46e078ce2357" status: 200 len: 793 microversion: 2.53 time: 0.113938 Aug 09 17:03:23.106225 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-67432cf8-1dd7-4797-bdad-461d25ce9b62 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1229294280" status: 202 len: 0 microversion: 2.1 time: 0.073580 Aug 09 17:03:23.111776 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 33/65] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:03:23 2022] DELETE /compute/v2.1/flavors/1229294280 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:03:23.117263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1749ead2-aa11-40f0-9bd5-30d9a64a1b57 tempest-FlavorMetadataValidation-719827486 tempest-FlavorMetadataValidation-719827486-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:23.120241 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:23.120241 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:23.128431 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 33/66] 10.222.0.93 () {60 vars in 1298 bytes} [Tue Aug 9 17:03:22 2022] GET /compute/v2.1/os-hypervisors/61ca71a3-2a41-484f-81a1-46e078ce2357 => generated 793 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:03:23.151759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f1529e2-7efb-4b3b-82ee-8eb032fac228 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Calling method '.version_select at 0x7fbbd8d24790>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:23.154460 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:23.154460 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:23.162520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f1529e2-7efb-4b3b-82ee-8eb032fac228 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.168402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f1529e2-7efb-4b3b-82ee-8eb032fac228 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.169097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f1529e2-7efb-4b3b-82ee-8eb032fac228 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:23.171800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f1529e2-7efb-4b3b-82ee-8eb032fac228 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.173874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f1529e2-7efb-4b3b-82ee-8eb032fac228 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.174587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f1529e2-7efb-4b3b-82ee-8eb032fac228 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:23.293769 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8f1529e2-7efb-4b3b-82ee-8eb032fac228 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.155186 Aug 09 17:03:23.298276 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 34/67] 10.222.0.93 () {58 vars in 1139 bytes} [Tue Aug 9 17:03:23 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:23.320171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-01bae0e3-9531-47a8-9b9a-b8bcfc8f5e89 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:23.474890 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-01bae0e3-9531-47a8-9b9a-b8bcfc8f5e89 tempest-FlavorsExtraSpecsTestJSON-1617369115 tempest-FlavorsExtraSpecsTestJSON-1617369115-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.173931 Aug 09 17:03:23.475954 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 35/68] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:03:23 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:23.511380 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1749ead2-aa11-40f0-9bd5-30d9a64a1b57 tempest-FlavorMetadataValidation-719827486 tempest-FlavorMetadataValidation-719827486-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/2036962211/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.402740 Aug 09 17:03:23.515681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6db5a329-0c4c-44d8-8ea1-3ec568623bde tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:23.516724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6db5a329-0c4c-44d8-8ea1-3ec568623bde tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:23.522604 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 34/69] 10.222.0.93 () {62 vars in 1265 bytes} [Tue Aug 9 17:03:23 2022] POST /compute/v2.1/flavors/2036962211/os-extra_specs => generated 62 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:23.534409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-02f8c4ed-3c55-434d-ad96-087a80d63e34 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Calling method '.version_select at 0x7fbbd9749670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:23.571839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6db5a329-0c4c-44d8-8ea1-3ec568623bde tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.575598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6db5a329-0c4c-44d8-8ea1-3ec568623bde tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.580220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6db5a329-0c4c-44d8-8ea1-3ec568623bde tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:23.581481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6db5a329-0c4c-44d8-8ea1-3ec568623bde tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.582318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6db5a329-0c4c-44d8-8ea1-3ec568623bde tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.583084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6db5a329-0c4c-44d8-8ea1-3ec568623bde tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:23.589314 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:23.589314 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:23.591436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02f8c4ed-3c55-434d-ad96-087a80d63e34 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.592274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02f8c4ed-3c55-434d-ad96-087a80d63e34 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.593029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02f8c4ed-3c55-434d-ad96-087a80d63e34 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:23.610992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02f8c4ed-3c55-434d-ad96-087a80d63e34 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.612033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02f8c4ed-3c55-434d-ad96-087a80d63e34 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.612775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02f8c4ed-3c55-434d-ad96-087a80d63e34 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:23.823744 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-02f8c4ed-3c55-434d-ad96-087a80d63e34 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.295158 Aug 09 17:03:23.835299 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 35/70] 10.222.0.93 () {58 vars in 1145 bytes} [Tue Aug 9 17:03:23 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:23.853031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29440119-2d1e-4deb-a8dc-43ce9c554eb0 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:23.854989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-29440119-2d1e-4deb-a8dc-43ce9c554eb0 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:23.888715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29440119-2d1e-4deb-a8dc-43ce9c554eb0 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.890453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29440119-2d1e-4deb-a8dc-43ce9c554eb0 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.896341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29440119-2d1e-4deb-a8dc-43ce9c554eb0 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:23.901744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29440119-2d1e-4deb-a8dc-43ce9c554eb0 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.902372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29440119-2d1e-4deb-a8dc-43ce9c554eb0 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.903145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29440119-2d1e-4deb-a8dc-43ce9c554eb0 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:24.020325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6db5a329-0c4c-44d8-8ea1-3ec568623bde tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:24.034738 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6db5a329-0c4c-44d8-8ea1-3ec568623bde tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 0.550269 Aug 09 17:03:24.063642 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 36/71] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:23 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:24.108125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-158eec74-6506-4ff0-a988-43c29f01341c tempest-FlavorMetadataValidation-719827486 tempest-FlavorMetadataValidation-719827486-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:24.114681 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:24.114681 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:24.170939 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-158eec74-6506-4ff0-a988-43c29f01341c tempest-FlavorMetadataValidation-719827486 tempest-FlavorMetadataValidation-719827486-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/2036962211" status: 202 len: 0 microversion: 2.86 time: 0.093334 Aug 09 17:03:24.172320 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 37/72] 10.222.0.93 () {60 vars in 1202 bytes} [Tue Aug 9 17:03:24 2022] DELETE /compute/v2.1/flavors/2036962211 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:03:24.183983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2a792857-a6d4-4561-ad49-a5b7b8d23997 tempest-FlavorMetadataValidation-719827486 tempest-FlavorMetadataValidation-719827486-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:24.217990 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2a792857-a6d4-4561-ad49-a5b7b8d23997 tempest-FlavorMetadataValidation-719827486 tempest-FlavorMetadataValidation-719827486-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.037476 Aug 09 17:03:24.220214 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 38/73] 10.222.0.93 () {60 vars in 1187 bytes} [Tue Aug 9 17:03:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:03:25.064714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-70b39eb5-0471-48e1-b26f-8c39f49cb8a7 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:25.065872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-70b39eb5-0471-48e1-b26f-8c39f49cb8a7 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:25.089216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70b39eb5-0471-48e1-b26f-8c39f49cb8a7 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:25.090203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70b39eb5-0471-48e1-b26f-8c39f49cb8a7 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:25.091157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70b39eb5-0471-48e1-b26f-8c39f49cb8a7 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:25.092518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70b39eb5-0471-48e1-b26f-8c39f49cb8a7 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:25.102413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70b39eb5-0471-48e1-b26f-8c39f49cb8a7 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:25.103563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70b39eb5-0471-48e1-b26f-8c39f49cb8a7 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:25.120368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:25.882785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-70b39eb5-0471-48e1-b26f-8c39f49cb8a7 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:25.937131 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-70b39eb5-0471-48e1-b26f-8c39f49cb8a7 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 0.876543 Aug 09 17:03:25.942913 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 39/74] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:25 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:26.443076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-29440119-2d1e-4deb-a8dc-43ce9c554eb0 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:26.481075 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-29440119-2d1e-4deb-a8dc-43ce9c554eb0 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 2.643749 Aug 09 17:03:26.482221 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 36/75] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:23 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 2646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:26.983297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3f9ce0e1-b7f4-44e5-a8cb-28146b1fb031 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:26.984349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3f9ce0e1-b7f4-44e5-a8cb-28146b1fb031 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:27.000698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9ce0e1-b7f4-44e5-a8cb-28146b1fb031 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:27.001999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9ce0e1-b7f4-44e5-a8cb-28146b1fb031 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:27.002699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9ce0e1-b7f4-44e5-a8cb-28146b1fb031 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:27.004119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9ce0e1-b7f4-44e5-a8cb-28146b1fb031 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:27.008685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9ce0e1-b7f4-44e5-a8cb-28146b1fb031 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:27.009571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9ce0e1-b7f4-44e5-a8cb-28146b1fb031 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:27.017152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=79 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:27.363276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-80b27000-7220-44ef-bf63-886de6e5fd67 req-8c1374cd-d9d0-48d7-87b6-d34ad46d216b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0", "tag": "3592f197-96f9-47ca-a37a-2420a90d3429"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:27.392083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-80b27000-7220-44ef-bf63-886de6e5fd67 req-8c1374cd-d9d0-48d7-87b6-d34ad46d216b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:27.392991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-80b27000-7220-44ef-bf63-886de6e5fd67 req-8c1374cd-d9d0-48d7-87b6-d34ad46d216b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:27.393721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-80b27000-7220-44ef-bf63-886de6e5fd67 req-8c1374cd-d9d0-48d7-87b6-d34ad46d216b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:27.433279 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-80b27000-7220-44ef-bf63-886de6e5fd67 req-8c1374cd-d9d0-48d7-87b6-d34ad46d216b service nova] Creating event network-changed:3592f197-96f9-47ca-a37a-2420a90d3429 for instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 on n-h2-845781-6 Aug 09 17:03:27.455437 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-80b27000-7220-44ef-bf63-886de6e5fd67 req-8c1374cd-d9d0-48d7-87b6-d34ad46d216b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.565823 Aug 09 17:03:27.460555 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 40/76] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:27.533023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7090331f-6367-4646-ac4c-90b81de6cc3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:27.540207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7090331f-6367-4646-ac4c-90b81de6cc3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:27.564916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7090331f-6367-4646-ac4c-90b81de6cc3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:27.567147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7090331f-6367-4646-ac4c-90b81de6cc3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:27.568356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7090331f-6367-4646-ac4c-90b81de6cc3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:27.570116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7090331f-6367-4646-ac4c-90b81de6cc3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:27.571443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7090331f-6367-4646-ac4c-90b81de6cc3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:27.572547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7090331f-6367-4646-ac4c-90b81de6cc3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:27.986362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7090331f-6367-4646-ac4c-90b81de6cc3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:27.998391 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7090331f-6367-4646-ac4c-90b81de6cc3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 0.479169 Aug 09 17:03:27.999500 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 41/77] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:27 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:28.326625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f9ce0e1-b7f4-44e5-a8cb-28146b1fb031 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:28.379056 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3f9ce0e1-b7f4-44e5-a8cb-28146b1fb031 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 1.384054 Aug 09 17:03:28.379056 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 37/78] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:26 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:29.056019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49719c0a-3b97-46a1-b9eb-8a66a61509c4 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:29.058937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-49719c0a-3b97-46a1-b9eb-8a66a61509c4 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:29.073589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49719c0a-3b97-46a1-b9eb-8a66a61509c4 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:29.075006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49719c0a-3b97-46a1-b9eb-8a66a61509c4 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:29.076374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49719c0a-3b97-46a1-b9eb-8a66a61509c4 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:29.078581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49719c0a-3b97-46a1-b9eb-8a66a61509c4 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:29.080899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49719c0a-3b97-46a1-b9eb-8a66a61509c4 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:29.082525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49719c0a-3b97-46a1-b9eb-8a66a61509c4 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:29.426579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3bd9fde-8ff5-46fc-b080-b1762a90cb10 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:29.432784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3bd9fde-8ff5-46fc-b080-b1762a90cb10 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:29.463193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3bd9fde-8ff5-46fc-b080-b1762a90cb10 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:29.468018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3bd9fde-8ff5-46fc-b080-b1762a90cb10 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:29.470970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3bd9fde-8ff5-46fc-b080-b1762a90cb10 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:29.478915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3bd9fde-8ff5-46fc-b080-b1762a90cb10 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:29.481090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3bd9fde-8ff5-46fc-b080-b1762a90cb10 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:29.485629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3bd9fde-8ff5-46fc-b080-b1762a90cb10 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:30.236232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-49719c0a-3b97-46a1-b9eb-8a66a61509c4 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:30.274008 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-49719c0a-3b97-46a1-b9eb-8a66a61509c4 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 1.226586 Aug 09 17:03:30.278581 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 42/79] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:29 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:30.736562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f3bd9fde-8ff5-46fc-b080-b1762a90cb10 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:30.794721 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3bd9fde-8ff5-46fc-b080-b1762a90cb10 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 1.383868 Aug 09 17:03:30.815984 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 38/80] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:29 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:31.316203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-822816ec-23b6-46af-906d-721484bf8cbe tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:31.317410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-822816ec-23b6-46af-906d-721484bf8cbe tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:31.396594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-822816ec-23b6-46af-906d-721484bf8cbe tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:31.400186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-822816ec-23b6-46af-906d-721484bf8cbe tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:31.400989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-822816ec-23b6-46af-906d-721484bf8cbe tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:31.411884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-822816ec-23b6-46af-906d-721484bf8cbe tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:31.412748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-822816ec-23b6-46af-906d-721484bf8cbe tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:31.413548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-822816ec-23b6-46af-906d-721484bf8cbe tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:31.851802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9814a651-ba66-404f-aa68-a5af3919d0b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:31.855726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9814a651-ba66-404f-aa68-a5af3919d0b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:31.886138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9814a651-ba66-404f-aa68-a5af3919d0b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:31.889381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9814a651-ba66-404f-aa68-a5af3919d0b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:31.889852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9814a651-ba66-404f-aa68-a5af3919d0b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:31.890880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9814a651-ba66-404f-aa68-a5af3919d0b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:31.891427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9814a651-ba66-404f-aa68-a5af3919d0b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:31.900194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9814a651-ba66-404f-aa68-a5af3919d0b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:32.499114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-822816ec-23b6-46af-906d-721484bf8cbe tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:32.580024 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-822816ec-23b6-46af-906d-721484bf8cbe tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 1.270387 Aug 09 17:03:32.624026 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 43/81] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:31 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:32.954796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9814a651-ba66-404f-aa68-a5af3919d0b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:32.988913 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9814a651-ba66-404f-aa68-a5af3919d0b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 1.141476 Aug 09 17:03:33.004063 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 39/82] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:31 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:33.640336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c73055f2-ce5d-4b0b-8358-9a1eb15cd450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:33.651664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c73055f2-ce5d-4b0b-8358-9a1eb15cd450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:33.655615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:33.677509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c73055f2-ce5d-4b0b-8358-9a1eb15cd450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:33.678297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c73055f2-ce5d-4b0b-8358-9a1eb15cd450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:33.679047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c73055f2-ce5d-4b0b-8358-9a1eb15cd450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:33.686460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c73055f2-ce5d-4b0b-8358-9a1eb15cd450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:33.690360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c73055f2-ce5d-4b0b-8358-9a1eb15cd450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:33.691866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c73055f2-ce5d-4b0b-8358-9a1eb15cd450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:34.024101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b2db49e-7319-4dfb-b91f-f80b147fdd82 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:34.024938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1b2db49e-7319-4dfb-b91f-f80b147fdd82 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:34.035863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:34.038996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2db49e-7319-4dfb-b91f-f80b147fdd82 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:34.039554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2db49e-7319-4dfb-b91f-f80b147fdd82 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:34.040035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2db49e-7319-4dfb-b91f-f80b147fdd82 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:34.043968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2db49e-7319-4dfb-b91f-f80b147fdd82 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:34.045488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2db49e-7319-4dfb-b91f-f80b147fdd82 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:34.045966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2db49e-7319-4dfb-b91f-f80b147fdd82 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:34.231258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c73055f2-ce5d-4b0b-8358-9a1eb15cd450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:34.306559 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c73055f2-ce5d-4b0b-8358-9a1eb15cd450 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 0.669378 Aug 09 17:03:34.312219 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 44/83] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:33 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:34.417291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1b2db49e-7319-4dfb-b91f-f80b147fdd82 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:34.443126 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b2db49e-7319-4dfb-b91f-f80b147fdd82 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 0.422970 Aug 09 17:03:34.448502 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 40/84] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:34 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:34.945050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad2d48cc-513f-41c0-a64a-15f6463ece38 tempest-FlavorsV255TestJSON-760543090 tempest-FlavorsV255TestJSON-760543090-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1937076943", "id": 48730581, "os-flavor-access:is_public": "True"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:34.951908 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:34.951908 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:34.994981 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad2d48cc-513f-41c0-a64a-15f6463ece38 tempest-FlavorsV255TestJSON-760543090 tempest-FlavorsV255TestJSON-760543090-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 443 microversion: 2.55 time: 0.593446 Aug 09 17:03:34.997340 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 45/85] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:03:34 2022] POST /compute/v2.1/flavors => generated 443 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 17:03:35.348618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-26c54a57-3e27-4c32-b564-3a9639bfa6ae tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:35.362297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-26c54a57-3e27-4c32-b564-3a9639bfa6ae tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:35.373755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c54a57-3e27-4c32-b564-3a9639bfa6ae tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:35.374260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c54a57-3e27-4c32-b564-3a9639bfa6ae tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:35.374706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c54a57-3e27-4c32-b564-3a9639bfa6ae tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:35.375752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c54a57-3e27-4c32-b564-3a9639bfa6ae tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:35.376227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c54a57-3e27-4c32-b564-3a9639bfa6ae tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:35.379060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c54a57-3e27-4c32-b564-3a9639bfa6ae tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:35.555936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-72effedf-9c53-4005-812a-8c6ea3a73cf8 tempest-FlavorsV255TestJSON-1572240622 tempest-FlavorsV255TestJSON-1572240622-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:35.582786 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-72effedf-9c53-4005-812a-8c6ea3a73cf8 tempest-FlavorsV255TestJSON-1572240622 tempest-FlavorsV255TestJSON-1572240622-project] 10.222.0.93 "GET /compute/v2.1/flavors/48730581" status: 200 len: 443 microversion: 2.55 time: 0.571515 Aug 09 17:03:35.583864 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 41/86] 10.222.0.93 () {60 vars in 1193 bytes} [Tue Aug 9 17:03:35 2022] GET /compute/v2.1/flavors/48730581 => generated 443 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 17:03:35.597817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ab8db21-5fa6-4f77-bb0b-ac219b79721c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:35.598466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ab8db21-5fa6-4f77-bb0b-ac219b79721c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:35.617950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ab8db21-5fa6-4f77-bb0b-ac219b79721c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:35.618551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ab8db21-5fa6-4f77-bb0b-ac219b79721c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:35.619673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ab8db21-5fa6-4f77-bb0b-ac219b79721c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:35.625279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ab8db21-5fa6-4f77-bb0b-ac219b79721c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:35.626064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ab8db21-5fa6-4f77-bb0b-ac219b79721c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:35.627044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ab8db21-5fa6-4f77-bb0b-ac219b79721c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:35.698064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-26c54a57-3e27-4c32-b564-3a9639bfa6ae tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:35.706851 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-26c54a57-3e27-4c32-b564-3a9639bfa6ae tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 0.366064 Aug 09 17:03:35.723699 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 46/87] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:35 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:35.729094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6e4e0bf7-5d66-40cd-b220-7d70afcafa3f tempest-FlavorsV255TestJSON-760543090 tempest-FlavorsV255TestJSON-760543090-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:35.733140 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:35.733140 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:35.774609 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6e4e0bf7-5d66-40cd-b220-7d70afcafa3f tempest-FlavorsV255TestJSON-760543090 tempest-FlavorsV255TestJSON-760543090-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/48730581" status: 200 len: 444 microversion: 2.55 time: 0.048752 Aug 09 17:03:35.784967 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 47/88] 10.222.0.93 () {62 vars in 1213 bytes} [Tue Aug 9 17:03:35 2022] PUT /compute/v2.1/flavors/48730581 => generated 444 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:03:35.791751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d87a73ed-b4ea-466f-b2fb-840cf803f6e5 tempest-FlavorsV255TestJSON-1572240622 tempest-FlavorsV255TestJSON-1572240622-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:35.847769 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d87a73ed-b4ea-466f-b2fb-840cf803f6e5 tempest-FlavorsV255TestJSON-1572240622 tempest-FlavorsV255TestJSON-1572240622-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5719 microversion: 2.55 time: 0.059783 Aug 09 17:03:35.848384 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 48/89] 10.222.0.93 () {60 vars in 1187 bytes} [Tue Aug 9 17:03:35 2022] GET /compute/v2.1/flavors/detail => generated 5719 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:03:35.869270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-99efb1ac-4232-4dfd-8a2d-1203a7a97041 tempest-FlavorsV255TestJSON-1572240622 tempest-FlavorsV255TestJSON-1572240622-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:35.908394 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-99efb1ac-4232-4dfd-8a2d-1203a7a97041 tempest-FlavorsV255TestJSON-1572240622 tempest-FlavorsV255TestJSON-1572240622-project] 10.222.0.93 "GET /compute/v2.1/flavors" status: 200 len: 3151 microversion: 2.55 time: 0.042945 Aug 09 17:03:35.909930 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 49/90] 10.222.0.93 () {60 vars in 1166 bytes} [Tue Aug 9 17:03:35 2022] GET /compute/v2.1/flavors => generated 3151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:03:35.939488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7b70efc1-c5b0-4ae6-b205-fbefc8795a53 tempest-FlavorsV255TestJSON-760543090 tempest-FlavorsV255TestJSON-760543090-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:35.941922 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:35.941922 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:35.953576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:36.004405 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7b70efc1-c5b0-4ae6-b205-fbefc8795a53 tempest-FlavorsV255TestJSON-760543090 tempest-FlavorsV255TestJSON-760543090-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/48730581" status: 202 len: 0 microversion: 2.55 time: 0.069668 Aug 09 17:03:36.006575 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 50/91] 10.222.0.93 () {60 vars in 1196 bytes} [Tue Aug 9 17:03:35 2022] DELETE /compute/v2.1/flavors/48730581 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:03:36.034445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-33d13771-7811-404b-89e5-0fbd5e2a99c2 tempest-FlavorsV255TestJSON-760543090 tempest-FlavorsV255TestJSON-760543090-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:36.073134 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-33d13771-7811-404b-89e5-0fbd5e2a99c2 tempest-FlavorsV255TestJSON-760543090 tempest-FlavorsV255TestJSON-760543090-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.061812 Aug 09 17:03:36.074892 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 51/92] 10.222.0.93 () {60 vars in 1187 bytes} [Tue Aug 9 17:03:36 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:03:36.158176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5ab8db21-5fa6-4f77-bb0b-ac219b79721c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:36.170947 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ab8db21-5fa6-4f77-bb0b-ac219b79721c tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 0.582382 Aug 09 17:03:36.171886 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 42/93] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:35 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:36.734389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e506004-21af-49ce-a64b-7d531eb92f3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:36.739994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2e506004-21af-49ce-a64b-7d531eb92f3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:36.766059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e506004-21af-49ce-a64b-7d531eb92f3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:36.770721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e506004-21af-49ce-a64b-7d531eb92f3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:36.771515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e506004-21af-49ce-a64b-7d531eb92f3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:36.772854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e506004-21af-49ce-a64b-7d531eb92f3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:36.773671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e506004-21af-49ce-a64b-7d531eb92f3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:36.774447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e506004-21af-49ce-a64b-7d531eb92f3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:37.212044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-412c42e6-8077-4493-8f07-cb696514d43e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:37.212868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-412c42e6-8077-4493-8f07-cb696514d43e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:37.225511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412c42e6-8077-4493-8f07-cb696514d43e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:37.226383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412c42e6-8077-4493-8f07-cb696514d43e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:37.227173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412c42e6-8077-4493-8f07-cb696514d43e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:37.229411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412c42e6-8077-4493-8f07-cb696514d43e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:37.233998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412c42e6-8077-4493-8f07-cb696514d43e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:37.234815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412c42e6-8077-4493-8f07-cb696514d43e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:37.668603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2e506004-21af-49ce-a64b-7d531eb92f3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:37.702194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-412c42e6-8077-4493-8f07-cb696514d43e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:37.716563 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-412c42e6-8077-4493-8f07-cb696514d43e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 0.509469 Aug 09 17:03:37.717593 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 43/94] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:37 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:37.719434 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2e506004-21af-49ce-a64b-7d531eb92f3c tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 0.992100 Aug 09 17:03:37.733505 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 52/95] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:36 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:38.074596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1651709819", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:38.342471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:03:38.910945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c015a70c-3d85-4638-b905-693f90fbe65b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:38.923164 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c015a70c-3d85-4638-b905-693f90fbe65b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.481631 Aug 09 17:03:38.929332 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 53/96] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:03:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:38.934818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-544fd49c-2989-46c6-a2f0-01db3d7e4b16 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:38.943550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-544fd49c-2989-46c6-a2f0-01db3d7e4b16 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:38.951398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-544fd49c-2989-46c6-a2f0-01db3d7e4b16 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:38.951922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-544fd49c-2989-46c6-a2f0-01db3d7e4b16 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:38.952530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-544fd49c-2989-46c6-a2f0-01db3d7e4b16 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:38.953438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-544fd49c-2989-46c6-a2f0-01db3d7e4b16 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:38.954112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-544fd49c-2989-46c6-a2f0-01db3d7e4b16 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:38.955018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-544fd49c-2989-46c6-a2f0-01db3d7e4b16 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:38.977467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:03:38.978054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:03:38.978868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:03:38.979541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:03:38.980227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:03:39.030983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:39.031877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:39.032629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:39.038673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:39.039523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:39.040456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:39.105582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for project 7004f453a4d944239c4641bbc394ebb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:03:39.136289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:RELEASE=9,nova_api:SAVEPOINT=8,nova_api:INSERT=3,nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:39.139674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for user 434e395144bc4443abb655a9d0a8b329 and project 7004f453a4d944239c4641bbc394ebb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:03:39.177370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:03:39.180661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:03:39.293967 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-341e732d-3273-4084-962d-3d621da652d2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575010 Aug 09 17:03:39.299669 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 44/97] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:03:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:03:39.305830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2c31e53d-bea9-4ac0-b7e8-aaef96ddf4e7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:39.308933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2c31e53d-bea9-4ac0-b7e8-aaef96ddf4e7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:39.327453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c31e53d-bea9-4ac0-b7e8-aaef96ddf4e7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:39.328574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c31e53d-bea9-4ac0-b7e8-aaef96ddf4e7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:39.329294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c31e53d-bea9-4ac0-b7e8-aaef96ddf4e7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:39.331025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c31e53d-bea9-4ac0-b7e8-aaef96ddf4e7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:39.331794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c31e53d-bea9-4ac0-b7e8-aaef96ddf4e7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:39.333079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c31e53d-bea9-4ac0-b7e8-aaef96ddf4e7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:39.608706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2c31e53d-bea9-4ac0-b7e8-aaef96ddf4e7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:39.634806 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2c31e53d-bea9-4ac0-b7e8-aaef96ddf4e7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 0.333743 Aug 09 17:03:39.635434 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 45/98] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:39 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:39.759969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-544fd49c-2989-46c6-a2f0-01db3d7e4b16 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:39.768732 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-544fd49c-2989-46c6-a2f0-01db3d7e4b16 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 0.837774 Aug 09 17:03:39.769317 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 54/99] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:38 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:39.798606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5c3b7a3-a9b7-4fcd-b88e-621fe857f975 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:39.799819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5c3b7a3-a9b7-4fcd-b88e-621fe857f975 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:39.977132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e5c3b7a3-a9b7-4fcd-b88e-621fe857f975 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:39.991920 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5c3b7a3-a9b7-4fcd-b88e-621fe857f975 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1213 microversion: 2.1 time: 0.203668 Aug 09 17:03:39.993139 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 55/100] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:39 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1213 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:40.241822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-76604afc-7a8d-4e66-8ead-7b1b6ca28ea9 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1897145705", "id": 1334699906, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:40.245511 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:40.245511 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:40.277728 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-76604afc-7a8d-4e66-8ead-7b1b6ca28ea9 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.639719 Aug 09 17:03:40.278665 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 46/101] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:03:39 2022] POST /compute/v2.1/flavors => generated 425 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:40.293189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-61986c2e-78c6-4861-995e-22a48bbde075 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:40.310914 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-61986c2e-78c6-4861-995e-22a48bbde075 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022532 Aug 09 17:03:40.311612 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 56/102] 10.222.0.93 () {58 vars in 1182 bytes} [Tue Aug 9 17:03:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:40.335884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ecc955d-81d6-48cb-97cf-d8b676e5d8f1 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1197152822", "id": 1937920356, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:40.446084 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ecc955d-81d6-48cb-97cf-d8b676e5d8f1 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.124795 Aug 09 17:03:40.447208 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 47/103] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:03:40 2022] POST /compute/v2.1/flavors => generated 425 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:40.464136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-68806bb3-b0f6-4945-9954-9efe257a255b tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:40.488429 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-68806bb3-b0f6-4945-9954-9efe257a255b tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029801 Aug 09 17:03:40.495808 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 57/104] 10.222.0.93 () {58 vars in 1182 bytes} [Tue Aug 9 17:03:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:03:40.514820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-274d291f-134f-423a-adde-12652691f3ee tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Action: 'create', calling method: .version_select at 0x7fbbd850d3a0>, body: {"keypair": {"name": "tempest-keypair-85641018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIC4c9rm/gE7ILSsijPPMIrowfeKwmhnZche9nZTyFqVAGnaG+EXqlDjZfCt7XC0/PXHDWjbinuGUG8P1pXIL3YxirnIzHfIk9ckp/Y88R3qOCDU3aJQiQUY1qiQiH8hhQ=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:40.664037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-274d291f-134f-423a-adde-12652691f3ee tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Getting quotas for project 5137eb4f54ad48b3ba4de9307b6e80ff. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:03:40.673282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a4251e74-ee1d-4087-a4ee-129cda428d76 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:40.673907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a4251e74-ee1d-4087-a4ee-129cda428d76 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:40.675867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-274d291f-134f-423a-adde-12652691f3ee tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Getting quotas for user ff70314be08b4abda96586877f4d6309 and project 5137eb4f54ad48b3ba4de9307b6e80ff. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:03:40.681379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4251e74-ee1d-4087-a4ee-129cda428d76 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:40.681887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4251e74-ee1d-4087-a4ee-129cda428d76 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:40.682330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4251e74-ee1d-4087-a4ee-129cda428d76 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:40.683073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4251e74-ee1d-4087-a4ee-129cda428d76 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:40.683532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4251e74-ee1d-4087-a4ee-129cda428d76 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:40.683987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4251e74-ee1d-4087-a4ee-129cda428d76 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:40.748070 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-274d291f-134f-423a-adde-12652691f3ee tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.240947 Aug 09 17:03:40.759424 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 48/105] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:03:40 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:40.796810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2193be08-1d0c-428b-8652-380689bf14e0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:40.797058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2193be08-1d0c-428b-8652-380689bf14e0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:40.823912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2193be08-1d0c-428b-8652-380689bf14e0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:40.824869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2193be08-1d0c-428b-8652-380689bf14e0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:40.826624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2193be08-1d0c-428b-8652-380689bf14e0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:40.827861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2193be08-1d0c-428b-8652-380689bf14e0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:40.828598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2193be08-1d0c-428b-8652-380689bf14e0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:40.829663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2193be08-1d0c-428b-8652-380689bf14e0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:41.197018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4251e74-ee1d-4087-a4ee-129cda428d76 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:41.218877 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a4251e74-ee1d-4087-a4ee-129cda428d76 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 0.549277 Aug 09 17:03:41.219974 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 58/106] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:40 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:41.225136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4d8096bb-4b87-47d8-ae62-9ef47e83887d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:41.237979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4d8096bb-4b87-47d8-ae62-9ef47e83887d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:41.261859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d8096bb-4b87-47d8-ae62-9ef47e83887d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:41.262496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d8096bb-4b87-47d8-ae62-9ef47e83887d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:41.263045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d8096bb-4b87-47d8-ae62-9ef47e83887d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:41.264380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d8096bb-4b87-47d8-ae62-9ef47e83887d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:41.272479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d8096bb-4b87-47d8-ae62-9ef47e83887d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:41.273280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d8096bb-4b87-47d8-ae62-9ef47e83887d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:41.425861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4d8096bb-4b87-47d8-ae62-9ef47e83887d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:41.450220 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4d8096bb-4b87-47d8-ae62-9ef47e83887d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1265 microversion: 2.1 time: 0.228866 Aug 09 17:03:41.450827 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 59/107] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:41 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:41.557873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2193be08-1d0c-428b-8652-380689bf14e0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:41.567408 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2193be08-1d0c-428b-8652-380689bf14e0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 0.780461 Aug 09 17:03:41.581453 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 49/108] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:40 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:42.273156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4e935af2-f8a8-434b-b648-8108db7c4f7d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:42.274317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4e935af2-f8a8-434b-b648-8108db7c4f7d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:42.316912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e935af2-f8a8-434b-b648-8108db7c4f7d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:42.317902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e935af2-f8a8-434b-b648-8108db7c4f7d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:42.318616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e935af2-f8a8-434b-b648-8108db7c4f7d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:42.322357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e935af2-f8a8-434b-b648-8108db7c4f7d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:42.323352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e935af2-f8a8-434b-b648-8108db7c4f7d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:42.324150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e935af2-f8a8-434b-b648-8108db7c4f7d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:42.497860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-32982680-70dd-437e-aa6a-aba1dc133b34 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:42.498978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-32982680-70dd-437e-aa6a-aba1dc133b34 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:42.558361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32982680-70dd-437e-aa6a-aba1dc133b34 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:42.575462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32982680-70dd-437e-aa6a-aba1dc133b34 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:42.576384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32982680-70dd-437e-aa6a-aba1dc133b34 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:42.577695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32982680-70dd-437e-aa6a-aba1dc133b34 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:42.578545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32982680-70dd-437e-aa6a-aba1dc133b34 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:42.579325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32982680-70dd-437e-aa6a-aba1dc133b34 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:42.994405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-32982680-70dd-437e-aa6a-aba1dc133b34 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:43.004986 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-32982680-70dd-437e-aa6a-aba1dc133b34 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1271 microversion: 2.1 time: 0.515168 Aug 09 17:03:43.007748 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 50/109] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:42 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1271 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:43.014514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-76d01f99-5fd3-4158-977c-de0e539105b6 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:43.021722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-76d01f99-5fd3-4158-977c-de0e539105b6 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:43.032614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4e935af2-f8a8-434b-b648-8108db7c4f7d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:43.042435 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4e935af2-f8a8-434b-b648-8108db7c4f7d tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 0.799159 Aug 09 17:03:43.050244 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 60/110] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:42 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:43.051440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d01f99-5fd3-4158-977c-de0e539105b6 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:43.058532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d01f99-5fd3-4158-977c-de0e539105b6 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:43.059148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d01f99-5fd3-4158-977c-de0e539105b6 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:43.060229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d01f99-5fd3-4158-977c-de0e539105b6 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:43.060877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d01f99-5fd3-4158-977c-de0e539105b6 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:43.061475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d01f99-5fd3-4158-977c-de0e539105b6 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:43.701985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e9943ecf-adc2-4303-a7ad-d11a4801fdd6 req-2fa88578-de1a-4a72-8f36-eb7c3408b09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0", "name": "network-vif-plugged", "status": "completed", "tag": "3592f197-96f9-47ca-a37a-2420a90d3429"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:43.726426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e9943ecf-adc2-4303-a7ad-d11a4801fdd6 req-2fa88578-de1a-4a72-8f36-eb7c3408b09b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:43.743826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e9943ecf-adc2-4303-a7ad-d11a4801fdd6 req-2fa88578-de1a-4a72-8f36-eb7c3408b09b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:43.744772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e9943ecf-adc2-4303-a7ad-d11a4801fdd6 req-2fa88578-de1a-4a72-8f36-eb7c3408b09b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:43.768661 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e9943ecf-adc2-4303-a7ad-d11a4801fdd6 req-2fa88578-de1a-4a72-8f36-eb7c3408b09b service nova] Creating event network-vif-plugged:3592f197-96f9-47ca-a37a-2420a90d3429 for instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 on n-h2-845781-6 Aug 09 17:03:43.782213 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e9943ecf-adc2-4303-a7ad-d11a4801fdd6 req-2fa88578-de1a-4a72-8f36-eb7c3408b09b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.388502 Aug 09 17:03:43.785578 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 61/111] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:43.915710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3bc8a65c-9077-44c5-8886-46d9e187c346 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Calling method '.version_select at 0x7fbbd8d245e0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:43.916906 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:43.916906 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:43.918492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc8a65c-9077-44c5-8886-46d9e187c346 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:43.919179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc8a65c-9077-44c5-8886-46d9e187c346 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:43.919839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc8a65c-9077-44c5-8886-46d9e187c346 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:43.961463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc8a65c-9077-44c5-8886-46d9e187c346 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:43.962226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc8a65c-9077-44c5-8886-46d9e187c346 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:43.962835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc8a65c-9077-44c5-8886-46d9e187c346 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:43.997468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc8a65c-9077-44c5-8886-46d9e187c346 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:43.998206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc8a65c-9077-44c5-8886-46d9e187c346 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:43.998864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc8a65c-9077-44c5-8886-46d9e187c346 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:44.026462 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3bc8a65c-9077-44c5-8886-46d9e187c346 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.238717 Aug 09 17:03:44.027698 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 62/112] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:03:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:44.033774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eab3b347-9082-440a-9ac4-5871f956b421 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:44.035503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eab3b347-9082-440a-9ac4-5871f956b421 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:44.066059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eab3b347-9082-440a-9ac4-5871f956b421 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:44.067722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eab3b347-9082-440a-9ac4-5871f956b421 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:44.070145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eab3b347-9082-440a-9ac4-5871f956b421 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:44.073398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eab3b347-9082-440a-9ac4-5871f956b421 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:44.074852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eab3b347-9082-440a-9ac4-5871f956b421 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:44.076364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eab3b347-9082-440a-9ac4-5871f956b421 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:44.337850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-76d01f99-5fd3-4158-977c-de0e539105b6 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:44.350006 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-76d01f99-5fd3-4158-977c-de0e539105b6 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 1.339257 Aug 09 17:03:44.369098 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 51/113] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:43 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:44.679800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eab3b347-9082-440a-9ac4-5871f956b421 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:44.701482 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eab3b347-9082-440a-9ac4-5871f956b421 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1313 microversion: 2.1 time: 0.672099 Aug 09 17:03:44.702447 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 63/114] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:44 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:44.724118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e589a0b6-b8f9-48ce-a349-f1d52f66d53b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:44.725223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e589a0b6-b8f9-48ce-a349-f1d52f66d53b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:44.750942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e589a0b6-b8f9-48ce-a349-f1d52f66d53b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:44.752729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e589a0b6-b8f9-48ce-a349-f1d52f66d53b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:44.754484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e589a0b6-b8f9-48ce-a349-f1d52f66d53b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:44.756322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e589a0b6-b8f9-48ce-a349-f1d52f66d53b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:44.757416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e589a0b6-b8f9-48ce-a349-f1d52f66d53b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:44.758616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e589a0b6-b8f9-48ce-a349-f1d52f66d53b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:44.833336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-760085d7-ac26-4004-ae7c-9be00177907e tempest-HypervisorAdminNegativeUnderV252Test-153200736 tempest-HypervisorAdminNegativeUnderV252Test-153200736-project] Calling method '.version_select at 0x7fbbd84a6310>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:44.846716 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:44.846716 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:44.848840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-760085d7-ac26-4004-ae7c-9be00177907e tempest-HypervisorAdminNegativeUnderV252Test-153200736 tempest-HypervisorAdminNegativeUnderV252Test-153200736-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '287be29338024e16a4d8cdcc55ba7028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ed43431d8947daa81b947d4006c14b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-760085d7-ac26-4004-ae7c-9be00177907e tempest-HypervisorAdminNegativeUnderV252Test-153200736 tempest-HypervisorAdminNegativeUnderV252Test-153200736-project] Request method failure captured: Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hypervisors/n-h2-845781-6/search HTTP/1.1 Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNt4wX8tDEv8_V0A04gWylw7fuuoR-J2CdJUZYLNItacRYt2skkfog340scS8g7PpGUd8AXUghq9CS85eyghYoFP6vGRGPAuxBTqOgyIaHcJ0FfuLwdjiBsoVoIT7fDZqEawlcFhWjxD4VEGjqUn_d6jt6yke04HusmpiGfIocn-pE Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 73ed43431d8947daa81b947d4006c14b Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-153200736 Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:03:44.893885 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_73ed43431d8947daa81b947d4006c14b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/73ed43431d8947daa81b947d4006c14b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/73ed43431d8947daa81b947d4006c14b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/73ed43431d8947daa81b947d4006c14b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-153200736 Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 73ed43431d8947daa81b947d4006c14b Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-153200736 Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-153200736-project Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 287be29338024e16a4d8cdcc55ba7028 Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-153200736-project Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 09 17:03:44.896773 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'n-h2-845781-6'} Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:03:44.898504 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 09 17:03:44.900860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:44.905250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-760085d7-ac26-4004-ae7c-9be00177907e tempest-HypervisorAdminNegativeUnderV252Test-153200736 tempest-HypervisorAdminNegativeUnderV252Test-153200736-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:03:44.907221 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-760085d7-ac26-4004-ae7c-9be00177907e tempest-HypervisorAdminNegativeUnderV252Test-153200736 tempest-HypervisorAdminNegativeUnderV252Test-153200736-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/n-h2-845781-6/search" status: 403 len: 117 microversion: 2.1 time: 0.536363 Aug 09 17:03:44.915543 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 52/115] 10.222.0.93 () {58 vars in 1209 bytes} [Tue Aug 9 17:03:44 2022] GET /compute/v2.1/os-hypervisors/n-h2-845781-6/search => generated 117 bytes in 545 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:03:44.944724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-24b0c5ea-c8a5-4693-ac21-f4f3ad5829a8 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Calling method '.version_select at 0x7fbbd845d9d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:44.961311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24b0c5ea-c8a5-4693-ac21-f4f3ad5829a8 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:44.966122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24b0c5ea-c8a5-4693-ac21-f4f3ad5829a8 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:44.973733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24b0c5ea-c8a5-4693-ac21-f4f3ad5829a8 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:45.041737 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-24b0c5ea-c8a5-4693-ac21-f4f3ad5829a8 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-24b0c5ea-c8a5-4693-ac21-f4f3ad5829a8 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Request method failure captured: Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNvAHsxuWxTvPwM2qWKG5qByS_E0eTaB_V93qFDkqnsj9xTqng_YanPWwPpGbBLpDrBQB70zWN6F5-3gVSXOfNLcATjIhWwmY1yqDY0ZNhbtKEGk_iu7oNvGfCfrbvTZ2cKUZ4n-cbqzpJYlciywVoaXArASG9d7g3BBNQPrrBDO7Y Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 2dd1288f5d29476d82f19b0b210b95f5 Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1492017804 Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:03:45.051264 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2dd1288f5d29476d82f19b0b210b95f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2dd1288f5d29476d82f19b0b210b95f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2dd1288f5d29476d82f19b0b210b95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2dd1288f5d29476d82f19b0b210b95f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1492017804 Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 2dd1288f5d29476d82f19b0b210b95f5 Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1492017804 Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 3bfcff907b1048f1a2912fb8d7233d40 Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 09 17:03:45.053900 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:45.055271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:45.058241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:45.058241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:03:45.058241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:03:45.058241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 09 17:03:45.058241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:45.065812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-24b0c5ea-c8a5-4693-ac21-f4f3ad5829a8 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:03:45.068093 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-24b0c5ea-c8a5-4693-ac21-f4f3ad5829a8 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.143375 Aug 09 17:03:45.070831 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 53/116] 10.222.0.93 () {58 vars in 1251 bytes} [Tue Aug 9 17:03:44 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:03:45.087357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3159baa5-c301-4a5e-9f48-7329eceddf63 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Calling method '.version_select at 0x7fbbda9bcc10>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:45.093822 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:45.093822 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:45.101481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3159baa5-c301-4a5e-9f48-7329eceddf63 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:45.103250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3159baa5-c301-4a5e-9f48-7329eceddf63 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:45.112104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3159baa5-c301-4a5e-9f48-7329eceddf63 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:45.158655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3159baa5-c301-4a5e-9f48-7329eceddf63 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:45.160036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3159baa5-c301-4a5e-9f48-7329eceddf63 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:45.161123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3159baa5-c301-4a5e-9f48-7329eceddf63 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:45.194965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3159baa5-c301-4a5e-9f48-7329eceddf63 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:45.196154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3159baa5-c301-4a5e-9f48-7329eceddf63 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:45.197216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3159baa5-c301-4a5e-9f48-7329eceddf63 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:45.222947 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3159baa5-c301-4a5e-9f48-7329eceddf63 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.145346 Aug 09 17:03:45.225037 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 54/117] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:03:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:45.241083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1b03633-9e25-4efd-9e22-7a47026c0d88 tempest-HypervisorAdminNegativeUnderV252Test-153200736 tempest-HypervisorAdminNegativeUnderV252Test-153200736-project] Calling method '.version_select at 0x7fbbd83c8670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:45.244783 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:45.244783 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:45.246497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d1b03633-9e25-4efd-9e22-7a47026c0d88 tempest-HypervisorAdminNegativeUnderV252Test-153200736 tempest-HypervisorAdminNegativeUnderV252Test-153200736-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '287be29338024e16a4d8cdcc55ba7028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ed43431d8947daa81b947d4006c14b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1b03633-9e25-4efd-9e22-7a47026c0d88 tempest-HypervisorAdminNegativeUnderV252Test-153200736 tempest-HypervisorAdminNegativeUnderV252Test-153200736-project] Request method failure captured: Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNt4wX8tDEv8_V0A04gWylw7fuuoR-J2CdJUZYLNItacRYt2skkfog340scS8g7PpGUd8AXUghq9CS85eyghYoFP6vGRGPAuxBTqOgyIaHcJ0FfuLwdjiBsoVoIT7fDZqEawlcFhWjxD4VEGjqUn_d6jt6yke04HusmpiGfIocn-pE Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 73ed43431d8947daa81b947d4006c14b Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-153200736 Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:03:45.248562 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_73ed43431d8947daa81b947d4006c14b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/73ed43431d8947daa81b947d4006c14b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/73ed43431d8947daa81b947d4006c14b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/73ed43431d8947daa81b947d4006c14b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-153200736 Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 73ed43431d8947daa81b947d4006c14b Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-153200736 Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-153200736-project Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 287be29338024e16a4d8cdcc55ba7028 Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-153200736-project Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 09 17:03:45.250002 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1'} Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:03:45.250830 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 09 17:03:45.252475 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:45.260687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1b03633-9e25-4efd-9e22-7a47026c0d88 tempest-HypervisorAdminNegativeUnderV252Test-153200736 tempest-HypervisorAdminNegativeUnderV252Test-153200736-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:03:45.262058 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1b03633-9e25-4efd-9e22-7a47026c0d88 tempest-HypervisorAdminNegativeUnderV252Test-153200736 tempest-HypervisorAdminNegativeUnderV252Test-153200736-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.029465 Aug 09 17:03:45.263279 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 55/118] 10.222.0.93 () {58 vars in 1176 bytes} [Tue Aug 9 17:03:45 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:03:45.279975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-275e45c0-f55f-4812-8b5d-92b128d34ad7 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Calling method '.version_select at 0x7fbbd83c8e50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:45.283193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-275e45c0-f55f-4812-8b5d-92b128d34ad7 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:45.284329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-275e45c0-f55f-4812-8b5d-92b128d34ad7 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:45.285095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-275e45c0-f55f-4812-8b5d-92b128d34ad7 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:45.295086 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-275e45c0-f55f-4812-8b5d-92b128d34ad7 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] HTTP exception thrown: No hypervisor matching '6f91f168-637b-46ec-8572-788562182b9c' could be found. Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-275e45c0-f55f-4812-8b5d-92b128d34ad7 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Request method failure captured: Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hypervisors/6f91f168-637b-46ec-8572-788562182b9c/servers HTTP/1.1 Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNvAHsxuWxTvPwM2qWKG5qByS_E0eTaB_V93qFDkqnsj9xTqng_YanPWwPpGbBLpDrBQB70zWN6F5-3gVSXOfNLcATjIhWwmY1yqDY0ZNhbtKEGk_iu7oNvGfCfrbvTZ2cKUZ4n-cbqzpJYlciywVoaXArASG9d7g3BBNQPrrBDO7Y Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 2dd1288f5d29476d82f19b0b210b95f5 Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1492017804 Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:03:45.297665 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2dd1288f5d29476d82f19b0b210b95f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2dd1288f5d29476d82f19b0b210b95f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2dd1288f5d29476d82f19b0b210b95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2dd1288f5d29476d82f19b0b210b95f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1492017804 Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 2dd1288f5d29476d82f19b0b210b95f5 Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1492017804 Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 3bfcff907b1048f1a2912fb8d7233d40 Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: exception: No hypervisor matching '6f91f168-637b-46ec-8572-788562182b9c' could be found. Aug 09 17:03:45.299184 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '6f91f168-637b-46ec-8572-788562182b9c'} Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '6f91f168-637b-46ec-8572-788562182b9c' could be found. Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:45.299963 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:45.301125 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:45.301125 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:45.301125 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:03:45.301125 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:03:45.301125 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '6f91f168-637b-46ec-8572-788562182b9c' could be found. Aug 09 17:03:45.301125 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:45.303975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-275e45c0-f55f-4812-8b5d-92b128d34ad7 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] Returning 404 to user: No hypervisor matching '6f91f168-637b-46ec-8572-788562182b9c' could be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:03:45.306002 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-275e45c0-f55f-4812-8b5d-92b128d34ad7 tempest-HypervisorAdminNegativeUnderV252Test-1492017804 tempest-HypervisorAdminNegativeUnderV252Test-1492017804-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/6f91f168-637b-46ec-8572-788562182b9c/servers" status: 404 len: 123 microversion: 2.1 time: 0.031867 Aug 09 17:03:45.307594 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 56/119] 10.222.0.93 () {58 vars in 1281 bytes} [Tue Aug 9 17:03:45 2022] GET /compute/v2.1/os-hypervisors/6f91f168-637b-46ec-8572-788562182b9c/servers => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:03:45.371513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43e6cb6a-3ee7-44fd-b27b-bd8bc4639ca0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:45.372619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-43e6cb6a-3ee7-44fd-b27b-bd8bc4639ca0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:45.390892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e6cb6a-3ee7-44fd-b27b-bd8bc4639ca0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:45.391866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e6cb6a-3ee7-44fd-b27b-bd8bc4639ca0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:45.394361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e6cb6a-3ee7-44fd-b27b-bd8bc4639ca0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:45.395465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e6cb6a-3ee7-44fd-b27b-bd8bc4639ca0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:45.405845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e6cb6a-3ee7-44fd-b27b-bd8bc4639ca0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:45.407678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e6cb6a-3ee7-44fd-b27b-bd8bc4639ca0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:45.514665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e589a0b6-b8f9-48ce-a349-f1d52f66d53b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:45.541122 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e589a0b6-b8f9-48ce-a349-f1d52f66d53b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 0.836600 Aug 09 17:03:45.542199 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 64/120] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:44 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:45.740372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6be68b7f-851b-4de4-a1c4-dc6fa442db7a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:45.741624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6be68b7f-851b-4de4-a1c4-dc6fa442db7a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:45.748636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6be68b7f-851b-4de4-a1c4-dc6fa442db7a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:45.749421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6be68b7f-851b-4de4-a1c4-dc6fa442db7a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:45.750043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6be68b7f-851b-4de4-a1c4-dc6fa442db7a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:45.752636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6be68b7f-851b-4de4-a1c4-dc6fa442db7a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:45.753710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6be68b7f-851b-4de4-a1c4-dc6fa442db7a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:45.754803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6be68b7f-851b-4de4-a1c4-dc6fa442db7a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:46.536930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-43e6cb6a-3ee7-44fd-b27b-bd8bc4639ca0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:46.540529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6be68b7f-851b-4de4-a1c4-dc6fa442db7a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:46.549032 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43e6cb6a-3ee7-44fd-b27b-bd8bc4639ca0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 1.181912 Aug 09 17:03:46.562951 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 57/121] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:45 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:46.591212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-52c90a5a-0a45-4ac0-aa31-af4668eb9085 req-94600a28-68e1-4722-b28a-5f14ad85e7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da17df6f-e2bb-4886-919f-6b90e3cf344c", "name": "network-vif-plugged", "status": "completed", "tag": "b796f8f1-54d4-4adb-88a1-0e39567a6be4"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:46.597894 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6be68b7f-851b-4de4-a1c4-dc6fa442db7a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1313 microversion: 2.1 time: 0.860726 Aug 09 17:03:46.602857 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 65/122] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:45 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1313 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:46.626218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-52c90a5a-0a45-4ac0-aa31-af4668eb9085 req-94600a28-68e1-4722-b28a-5f14ad85e7f6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:46.627480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-52c90a5a-0a45-4ac0-aa31-af4668eb9085 req-94600a28-68e1-4722-b28a-5f14ad85e7f6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:46.633939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-52c90a5a-0a45-4ac0-aa31-af4668eb9085 req-94600a28-68e1-4722-b28a-5f14ad85e7f6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:46.649862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-79bb8adc-0f85-48cd-b0e4-5a8cb4fb6f35 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:46.653458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-79bb8adc-0f85-48cd-b0e4-5a8cb4fb6f35 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:46.679790 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-52c90a5a-0a45-4ac0-aa31-af4668eb9085 req-94600a28-68e1-4722-b28a-5f14ad85e7f6 service nova] Creating event network-vif-plugged:b796f8f1-54d4-4adb-88a1-0e39567a6be4 for instance da17df6f-e2bb-4886-919f-6b90e3cf344c on n-h1-845781-6 Aug 09 17:03:46.684028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-52c90a5a-0a45-4ac0-aa31-af4668eb9085 req-94600a28-68e1-4722-b28a-5f14ad85e7f6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:03:46.684028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-52c90a5a-0a45-4ac0-aa31-af4668eb9085 req-94600a28-68e1-4722-b28a-5f14ad85e7f6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:03:46.684480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab84fdd5-69b1-4965-a22b-7f4fa5fd4ebd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:46.686138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab84fdd5-69b1-4965-a22b-7f4fa5fd4ebd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:46.686660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab84fdd5-69b1-4965-a22b-7f4fa5fd4ebd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:46.687538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab84fdd5-69b1-4965-a22b-7f4fa5fd4ebd None None] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:46.688389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab84fdd5-69b1-4965-a22b-7f4fa5fd4ebd None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:46.690922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab84fdd5-69b1-4965-a22b-7f4fa5fd4ebd None None] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:46.694385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79bb8adc-0f85-48cd-b0e4-5a8cb4fb6f35 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:46.695593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79bb8adc-0f85-48cd-b0e4-5a8cb4fb6f35 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:46.701815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79bb8adc-0f85-48cd-b0e4-5a8cb4fb6f35 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:46.704273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79bb8adc-0f85-48cd-b0e4-5a8cb4fb6f35 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:46.707000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79bb8adc-0f85-48cd-b0e4-5a8cb4fb6f35 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:46.707819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79bb8adc-0f85-48cd-b0e4-5a8cb4fb6f35 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:46.727281 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.compute.rpcapi [None req-ab84fdd5-69b1-4965-a22b-7f4fa5fd4ebd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 17:03:46.728355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab84fdd5-69b1-4965-a22b-7f4fa5fd4ebd None None] Releasing lock "compute-rpcapi-router" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:03:46.798799 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ab84fdd5-69b1-4965-a22b-7f4fa5fd4ebd None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233855 Aug 09 17:03:46.799991 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 58/123] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:47.571969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-586fe951-e474-4694-a706-f4515c83d07e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:47.572754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-586fe951-e474-4694-a706-f4515c83d07e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:47.588698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-586fe951-e474-4694-a706-f4515c83d07e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:47.589463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-586fe951-e474-4694-a706-f4515c83d07e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:47.590095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-586fe951-e474-4694-a706-f4515c83d07e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:47.591026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-586fe951-e474-4694-a706-f4515c83d07e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:47.591691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-586fe951-e474-4694-a706-f4515c83d07e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:47.592278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-586fe951-e474-4694-a706-f4515c83d07e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:47.674882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-79bb8adc-0f85-48cd-b0e4-5a8cb4fb6f35 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:47.699153 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-79bb8adc-0f85-48cd-b0e4-5a8cb4fb6f35 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1337 microversion: 2.1 time: 1.091432 Aug 09 17:03:47.702807 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 66/124] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:46 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1337 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:47.713387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c3b311e9-70c8-402b-93e1-81d8dab9f514 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:47.714458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c3b311e9-70c8-402b-93e1-81d8dab9f514 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:47.739177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3b311e9-70c8-402b-93e1-81d8dab9f514 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:47.744005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3b311e9-70c8-402b-93e1-81d8dab9f514 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:47.745303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3b311e9-70c8-402b-93e1-81d8dab9f514 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:47.750088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3b311e9-70c8-402b-93e1-81d8dab9f514 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:47.752673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3b311e9-70c8-402b-93e1-81d8dab9f514 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:47.755609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3b311e9-70c8-402b-93e1-81d8dab9f514 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:47.797792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:48.255588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c3b311e9-70c8-402b-93e1-81d8dab9f514 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:48.270664 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c3b311e9-70c8-402b-93e1-81d8dab9f514 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1313 microversion: 2.1 time: 0.565708 Aug 09 17:03:48.299478 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 67/125] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:47 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:48.309446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-153f3142-28bd-4d25-b06c-a13e5466b30d req-7738ce34-088d-4781-ad40-1b93d0284c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a21dd49-aca6-47cf-9381-0265b1a7a9c7", "tag": "25fa6b72-0892-44f5-bdbf-99073ca230d8"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:48.333161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-153f3142-28bd-4d25-b06c-a13e5466b30d req-7738ce34-088d-4781-ad40-1b93d0284c7b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:48.334224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-153f3142-28bd-4d25-b06c-a13e5466b30d req-7738ce34-088d-4781-ad40-1b93d0284c7b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:48.335140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-153f3142-28bd-4d25-b06c-a13e5466b30d req-7738ce34-088d-4781-ad40-1b93d0284c7b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:48.360056 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-153f3142-28bd-4d25-b06c-a13e5466b30d req-7738ce34-088d-4781-ad40-1b93d0284c7b service nova] Creating event network-changed:25fa6b72-0892-44f5-bdbf-99073ca230d8 for instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 on n-h1-845781-6 Aug 09 17:03:48.398578 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-153f3142-28bd-4d25-b06c-a13e5466b30d req-7738ce34-088d-4781-ad40-1b93d0284c7b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096384 Aug 09 17:03:48.405638 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 68/126] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:48.456823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-586fe951-e474-4694-a706-f4515c83d07e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:48.476472 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-586fe951-e474-4694-a706-f4515c83d07e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1319 microversion: 2.1 time: 0.908302 Aug 09 17:03:48.477987 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 59/127] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:47 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1319 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:48.743526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-54bc4a21-1c19-4d94-bb3a-210adb9c0bbf tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:48.749695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-54bc4a21-1c19-4d94-bb3a-210adb9c0bbf tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:48.778252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54bc4a21-1c19-4d94-bb3a-210adb9c0bbf tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:48.791444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54bc4a21-1c19-4d94-bb3a-210adb9c0bbf tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:48.792747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54bc4a21-1c19-4d94-bb3a-210adb9c0bbf tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:48.795150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54bc4a21-1c19-4d94-bb3a-210adb9c0bbf tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:48.797256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54bc4a21-1c19-4d94-bb3a-210adb9c0bbf tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:48.798004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54bc4a21-1c19-4d94-bb3a-210adb9c0bbf tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:49.168157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1417373815", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "1937920356", "adminPass": "***", "networks": [{"uuid": "0c6f761a-60bb-4d46-b49c-d69750590422"}], "security_groups": [{"name": "tempest-securitygroup--1892334101"}], "key_name": "tempest-keypair-85641018", "user_data": "}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:49.335666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54bc4a21-1c19-4d94-bb3a-210adb9c0bbf tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:49.366092 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-54bc4a21-1c19-4d94-bb3a-210adb9c0bbf tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1487 microversion: 2.1 time: 0.627475 Aug 09 17:03:49.367430 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 69/128] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:48 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1487 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:49.389661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49f4158a-445a-4ecb-ae6f-816bfd4c2fb3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:49.390964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-49f4158a-445a-4ecb-ae6f-816bfd4c2fb3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:49.422746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49f4158a-445a-4ecb-ae6f-816bfd4c2fb3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:49.424011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49f4158a-445a-4ecb-ae6f-816bfd4c2fb3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:49.425301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49f4158a-445a-4ecb-ae6f-816bfd4c2fb3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:49.432783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49f4158a-445a-4ecb-ae6f-816bfd4c2fb3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:49.433944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49f4158a-445a-4ecb-ae6f-816bfd4c2fb3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:49.435203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49f4158a-445a-4ecb-ae6f-816bfd4c2fb3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:49.514614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] validate_networks() for [('0c6f761a-60bb-4d46-b49c-d69750590422', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:03:49.759938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-49f4158a-445a-4ecb-ae6f-816bfd4c2fb3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:49.772116 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-49f4158a-445a-4ecb-ae6f-816bfd4c2fb3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1313 microversion: 2.1 time: 0.402357 Aug 09 17:03:49.772808 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 70/129] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:49 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:49.784677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9be0d7f-7c00-4c1c-be2a-34c0f871ac05 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:49.788180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9be0d7f-7c00-4c1c-be2a-34c0f871ac05 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:49.805408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9be0d7f-7c00-4c1c-be2a-34c0f871ac05 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:49.807861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9be0d7f-7c00-4c1c-be2a-34c0f871ac05 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:49.808573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9be0d7f-7c00-4c1c-be2a-34c0f871ac05 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:49.809445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9be0d7f-7c00-4c1c-be2a-34c0f871ac05 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:49.812013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9be0d7f-7c00-4c1c-be2a-34c0f871ac05 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:49.812618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9be0d7f-7c00-4c1c-be2a-34c0f871ac05 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:50.005042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:50.645766 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9be0d7f-7c00-4c1c-be2a-34c0f871ac05 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1638 microversion: 2.1 time: 0.871177 Aug 09 17:03:50.646922 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 71/130] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:49 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1638 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:50.679470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-90f6f231-d393-4662-b0ad-dbafbbc079ce tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:50.689828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-90f6f231-d393-4662-b0ad-dbafbbc079ce tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:50.698146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:50.713411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90f6f231-d393-4662-b0ad-dbafbbc079ce tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:50.714770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90f6f231-d393-4662-b0ad-dbafbbc079ce tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:50.716017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90f6f231-d393-4662-b0ad-dbafbbc079ce tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:50.717811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90f6f231-d393-4662-b0ad-dbafbbc079ce tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:50.720032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90f6f231-d393-4662-b0ad-dbafbbc079ce tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:50.721327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90f6f231-d393-4662-b0ad-dbafbbc079ce tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:51.115535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90f6f231-d393-4662-b0ad-dbafbbc079ce tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:51.142934 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-90f6f231-d393-4662-b0ad-dbafbbc079ce tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1469 microversion: 2.1 time: 0.491655 Aug 09 17:03:51.147708 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 72/131] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:50 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1469 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:51.163191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3e31f34b-6462-48f2-bcd2-a50696dbd1c7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:51.166361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3e31f34b-6462-48f2-bcd2-a50696dbd1c7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:51.190221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e31f34b-6462-48f2-bcd2-a50696dbd1c7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:51.191665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e31f34b-6462-48f2-bcd2-a50696dbd1c7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:51.192651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e31f34b-6462-48f2-bcd2-a50696dbd1c7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:51.193886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e31f34b-6462-48f2-bcd2-a50696dbd1c7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:51.194882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e31f34b-6462-48f2-bcd2-a50696dbd1c7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:51.196041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e31f34b-6462-48f2-bcd2-a50696dbd1c7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:51.323738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3e31f34b-6462-48f2-bcd2-a50696dbd1c7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:03:51.327505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:03:51.328647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:03:51.329863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:03:51.330810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:03:51.332001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:03:51.361499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:51.363676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:51.364817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:51.366428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:51.369700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:51.372078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:51.429916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Getting quotas for project 5137eb4f54ad48b3ba4de9307b6e80ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:03:51.440488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Getting quotas for user ff70314be08b4abda96586877f4d6309 and project 5137eb4f54ad48b3ba4de9307b6e80ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:03:51.473872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:03:51.480891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:03:51.660763 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3e31f34b-6462-48f2-bcd2-a50696dbd1c7 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 204 len: 0 microversion: 2.1 time: 0.509064 Aug 09 17:03:51.666154 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 73/132] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:03:51 2022] DELETE /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:03:51.695385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e2105d96-5534-4310-a565-96bb59181597 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:51.703547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e2105d96-5534-4310-a565-96bb59181597 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:51.742390 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-64ac5b55-58c8-4cc5-ae98-58def74b6165 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.585375 Aug 09 17:03:51.752612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2105d96-5534-4310-a565-96bb59181597 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:51.759368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2105d96-5534-4310-a565-96bb59181597 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:51.761216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2105d96-5534-4310-a565-96bb59181597 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:51.763141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2105d96-5534-4310-a565-96bb59181597 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:51.763877 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 60/133] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:03:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 2610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:03:51.764476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2105d96-5534-4310-a565-96bb59181597 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:51.765448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2105d96-5534-4310-a565-96bb59181597 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:52.548609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6326002c-b68f-447b-b64f-a7a3a9b00ee6 tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:52.549504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6326002c-b68f-447b-b64f-a7a3a9b00ee6 tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:52.606284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6326002c-b68f-447b-b64f-a7a3a9b00ee6 tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:52.607615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6326002c-b68f-447b-b64f-a7a3a9b00ee6 tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:52.608937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6326002c-b68f-447b-b64f-a7a3a9b00ee6 tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:52.610497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6326002c-b68f-447b-b64f-a7a3a9b00ee6 tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:52.611548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6326002c-b68f-447b-b64f-a7a3a9b00ee6 tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:52.612587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6326002c-b68f-447b-b64f-a7a3a9b00ee6 tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:52.930062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6326002c-b68f-447b-b64f-a7a3a9b00ee6 tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:03:53.011760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e2105d96-5534-4310-a565-96bb59181597 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:53.033292 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e2105d96-5534-4310-a565-96bb59181597 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1313 microversion: 2.1 time: 1.361829 Aug 09 17:03:53.034385 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 74/134] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:51 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1313 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:53.054971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-45203a32-c4c7-41f5-a7eb-9da6093abda9 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:53.057234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-45203a32-c4c7-41f5-a7eb-9da6093abda9 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:53.065389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45203a32-c4c7-41f5-a7eb-9da6093abda9 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:53.066313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45203a32-c4c7-41f5-a7eb-9da6093abda9 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:53.067080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45203a32-c4c7-41f5-a7eb-9da6093abda9 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:53.068202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45203a32-c4c7-41f5-a7eb-9da6093abda9 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:53.069308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45203a32-c4c7-41f5-a7eb-9da6093abda9 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:53.070065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45203a32-c4c7-41f5-a7eb-9da6093abda9 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:53.253890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:53.365401 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6326002c-b68f-447b-b64f-a7a3a9b00ee6 tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] 10.222.0.93 "DELETE /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 204 len: 0 microversion: 2.1 time: 1.599302 Aug 09 17:03:53.366026 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 61/135] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:03:51 2022] DELETE /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 0 bytes in 1602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:03:53.376660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-351bcc13-62b8-463b-bd68-e349a91629ea tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:53.377426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-351bcc13-62b8-463b-bd68-e349a91629ea tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:53.395936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-351bcc13-62b8-463b-bd68-e349a91629ea tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:53.396771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-351bcc13-62b8-463b-bd68-e349a91629ea tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:53.397537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-351bcc13-62b8-463b-bd68-e349a91629ea tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:53.398765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-351bcc13-62b8-463b-bd68-e349a91629ea tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:53.399607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-351bcc13-62b8-463b-bd68-e349a91629ea tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:53.410093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-351bcc13-62b8-463b-bd68-e349a91629ea tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:53.611603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-351bcc13-62b8-463b-bd68-e349a91629ea tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:53.652480 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-351bcc13-62b8-463b-bd68-e349a91629ea tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1280 microversion: 2.1 time: 0.283245 Aug 09 17:03:53.671833 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 62/136] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:53 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1280 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:53.681380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0260ef47-5aff-45d7-8c2a-eb31d0823343 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:53.682048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0260ef47-5aff-45d7-8c2a-eb31d0823343 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:53.699557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0260ef47-5aff-45d7-8c2a-eb31d0823343 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:53.700103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0260ef47-5aff-45d7-8c2a-eb31d0823343 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:53.700585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0260ef47-5aff-45d7-8c2a-eb31d0823343 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:53.701486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0260ef47-5aff-45d7-8c2a-eb31d0823343 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:53.702015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0260ef47-5aff-45d7-8c2a-eb31d0823343 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:53.702528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0260ef47-5aff-45d7-8c2a-eb31d0823343 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:53.809891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45203a32-c4c7-41f5-a7eb-9da6093abda9 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:53.821824 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-45203a32-c4c7-41f5-a7eb-9da6093abda9 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1493 microversion: 2.1 time: 0.771675 Aug 09 17:03:53.824537 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 75/137] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:53 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1493 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:54.172533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2aae9d11-87b4-4491-8a86-9fe7e2048689 tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714 tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:54.175786 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:54.175786 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:54.179583 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-2aae9d11-87b4-4491-8a86-9fe7e2048689 tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714 tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2aae9d11-87b4-4491-8a86-9fe7e2048689 tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714 tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714-project-admin] Request method failure captured: Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pN5Jo3eL69vPcoNt3vLbQ8GgX3sVgYjzF7LVzl5KaBClMO8CLEfsxA8ZopvvjSm4-o7gYlQWifpvkuQCsowzV6co6FldTOqnBh0sQA6VOHlUi702_gK_0yYaJ5JHyCQ9lCM9P2ZZ_Mqhj4mZ1NCPD0Y36p1AeCsPE1Z6Q2w6OoaNNA Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 174353ace2f1469d9fc7614bf522ce05 Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714 Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:03:54.191369 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:03:54.192663 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_174353ace2f1469d9fc7614bf522ce05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/174353ace2f1469d9fc7614bf522ce05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/174353ace2f1469d9fc7614bf522ce05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/174353ace2f1469d9fc7614bf522ce05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:03:54.192663 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714 Aug 09 17:03:54.192663 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 174353ace2f1469d9fc7614bf522ce05 Aug 09 17:03:54.192663 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714 Aug 09 17:03:54.192663 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714-project-admin Aug 09 17:03:54.192663 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:03:54.192663 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:03:54.192663 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 5c421c29df174f82b01bf01568e71840 Aug 09 17:03:54.192663 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714-project-admin Aug 09 17:03:54.192663 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:03:54.192663 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid timestamp for date invalid_time Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'invalid_time'} Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:03:54.193531 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 09 17:03:54.194635 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:03:54.202120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2aae9d11-87b4-4491-8a86-9fe7e2048689 tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714 tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:03:54.203266 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2aae9d11-87b4-4491-8a86-9fe7e2048689 tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714 tempest-InstanceUsageAuditLogNegativeTestJSON-1385226714-project-admin] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.377294 Aug 09 17:03:54.204009 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 76/138] 10.222.0.93 () {58 vars in 1224 bytes} [Tue Aug 9 17:03:53 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 379 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:03:54.218394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc205905-d2ac-452c-94d6-bc54794aeaf1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:54.227124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cc205905-d2ac-452c-94d6-bc54794aeaf1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:54.256807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc205905-d2ac-452c-94d6-bc54794aeaf1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:54.264979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc205905-d2ac-452c-94d6-bc54794aeaf1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:54.266123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc205905-d2ac-452c-94d6-bc54794aeaf1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:54.268066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc205905-d2ac-452c-94d6-bc54794aeaf1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:54.268939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc205905-d2ac-452c-94d6-bc54794aeaf1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:54.269952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc205905-d2ac-452c-94d6-bc54794aeaf1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:54.795388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0260ef47-5aff-45d7-8c2a-eb31d0823343 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:54.812820 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0260ef47-5aff-45d7-8c2a-eb31d0823343 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1475 microversion: 2.1 time: 1.138352 Aug 09 17:03:54.814214 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 63/139] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:53 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1475 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:55.063999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e7755416-e02b-43e5-a1e4-9f2fd11236fa tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:55.065304 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:55.065304 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:55.066990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e7755416-e02b-43e5-a1e4-9f2fd11236fa tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '6c3739ff46494748ab1dd97d4b8d8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069823a8694c43909cdcc2cd80cb1b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e7755416-e02b-43e5-a1e4-9f2fd11236fa tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project] Request method failure captured: Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pN3Yjg7Ehd6BUS_fR4YSMrnyKw5FRMRjC7GYndce0rblWRrv336fj2C9gk9mTbvQceI7YV_Yhwo1CzGAnKnbI0Sc5BMQ8HUEgre0BUsmL53aY4HgFhFeWPEbwmva5pcHzsj_e3XFTYoI7oUw6ngPPt9jJAUjmO9wkzrnEGaQxN82Hc Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 069823a8694c43909cdcc2cd80cb1b66 Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:03:55.072509 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:03:55.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_069823a8694c43909cdcc2cd80cb1b66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/069823a8694c43909cdcc2cd80cb1b66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/069823a8694c43909cdcc2cd80cb1b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/069823a8694c43909cdcc2cd80cb1b66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:03:55.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 Aug 09 17:03:55.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 069823a8694c43909cdcc2cd80cb1b66 Aug 09 17:03:55.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 Aug 09 17:03:55.073762 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project Aug 09 17:03:55.073762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:03:55.073762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:03:55.073762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6c3739ff46494748ab1dd97d4b8d8e2f Aug 09 17:03:55.073762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project Aug 09 17:03:55.073762 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: action_args: {} Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:03:55.074422 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 09 17:03:55.075576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:55.078769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e7755416-e02b-43e5-a1e4-9f2fd11236fa tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:03:55.079982 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e7755416-e02b-43e5-a1e4-9f2fd11236fa tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.263363 Aug 09 17:03:55.085575 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 64/140] 10.222.0.93 () {58 vars in 1185 bytes} [Tue Aug 9 17:03:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 270 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:03:55.097364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-346689bd-2e12-4bf9-a8cd-4d8c7ad4f023 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:55.098422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-346689bd-2e12-4bf9-a8cd-4d8c7ad4f023 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:55.114998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346689bd-2e12-4bf9-a8cd-4d8c7ad4f023 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:55.116487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346689bd-2e12-4bf9-a8cd-4d8c7ad4f023 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:55.117215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346689bd-2e12-4bf9-a8cd-4d8c7ad4f023 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:55.118214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346689bd-2e12-4bf9-a8cd-4d8c7ad4f023 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:55.118906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346689bd-2e12-4bf9-a8cd-4d8c7ad4f023 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:55.119586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346689bd-2e12-4bf9-a8cd-4d8c7ad4f023 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:55.237966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-346689bd-2e12-4bf9-a8cd-4d8c7ad4f023 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:55.247332 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-346689bd-2e12-4bf9-a8cd-4d8c7ad4f023 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1342 microversion: 2.1 time: 0.160231 Aug 09 17:03:55.251803 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 65/141] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:55 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:55.264673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aa503a17-ea5c-431b-b50f-8a8cace915a1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:55.265344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aa503a17-ea5c-431b-b50f-8a8cace915a1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:55.286398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa503a17-ea5c-431b-b50f-8a8cace915a1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:55.286906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa503a17-ea5c-431b-b50f-8a8cace915a1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:55.287530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa503a17-ea5c-431b-b50f-8a8cace915a1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:55.289185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa503a17-ea5c-431b-b50f-8a8cace915a1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:55.291146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa503a17-ea5c-431b-b50f-8a8cace915a1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:55.293643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa503a17-ea5c-431b-b50f-8a8cace915a1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:55.421890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aa503a17-ea5c-431b-b50f-8a8cace915a1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:55.432487 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aa503a17-ea5c-431b-b50f-8a8cace915a1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1322 microversion: 2.1 time: 0.175905 Aug 09 17:03:55.433100 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 66/142] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:55 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:55.442232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ddc78bc1-9abf-4811-b1cf-48d672cb6416 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:55.445957 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:55.445957 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:55.447011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cc205905-d2ac-452c-94d6-bc54794aeaf1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:55.448517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ddc78bc1-9abf-4811-b1cf-48d672cb6416 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '6c3739ff46494748ab1dd97d4b8d8e2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069823a8694c43909cdcc2cd80cb1b66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:55.463206 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cc205905-d2ac-452c-94d6-bc54794aeaf1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1313 microversion: 2.1 time: 1.257403 Aug 09 17:03:55.467576 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 77/143] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:54 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1313 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ddc78bc1-9abf-4811-b1cf-48d672cb6416 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project] Request method failure captured: Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-09%2017:03:55 HTTP/1.1 Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pN3Yjg7Ehd6BUS_fR4YSMrnyKw5FRMRjC7GYndce0rblWRrv336fj2C9gk9mTbvQceI7YV_Yhwo1CzGAnKnbI0Sc5BMQ8HUEgre0BUsmL53aY4HgFhFeWPEbwmva5pcHzsj_e3XFTYoI7oUw6ngPPt9jJAUjmO9wkzrnEGaQxN82Hc Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 069823a8694c43909cdcc2cd80cb1b66 Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:03:55.469333 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:03:55.471205 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_069823a8694c43909cdcc2cd80cb1b66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/069823a8694c43909cdcc2cd80cb1b66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/069823a8694c43909cdcc2cd80cb1b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/069823a8694c43909cdcc2cd80cb1b66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:03:55.471205 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 Aug 09 17:03:55.471205 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 069823a8694c43909cdcc2cd80cb1b66 Aug 09 17:03:55.471205 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 Aug 09 17:03:55.471205 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project Aug 09 17:03:55.471205 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:03:55.471205 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:03:55.471205 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6c3739ff46494748ab1dd97d4b8d8e2f Aug 09 17:03:55.471205 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project Aug 09 17:03:55.471205 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '2022-08-09 17:03:55'} Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:03:55.471775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 09 17:03:55.472794 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:55.473680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ddc78bc1-9abf-4811-b1cf-48d672cb6416 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:03:55.473680 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ddc78bc1-9abf-4811-b1cf-48d672cb6416 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940 tempest-InstanceUsageAuditLogNegativeTestJSON-1108435940-project] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-09 17:03:55" status: 403 len: 128 microversion: 2.1 time: 0.037734 Aug 09 17:03:55.473680 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 67/144] 10.222.0.93 () {58 vars in 1251 bytes} [Tue Aug 9 17:03:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-09%2017%3A03%3A55 => generated 128 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:03:55.490723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-cc523146-aec1-415d-b2a6-94ba6842fa50 req-c1a23c74-2c0d-4aba-81f0-2e0358d9516c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0", "name": "network-vif-deleted", "tag": "3592f197-96f9-47ca-a37a-2420a90d3429"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:55.533645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cc523146-aec1-415d-b2a6-94ba6842fa50 req-c1a23c74-2c0d-4aba-81f0-2e0358d9516c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:55.538737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cc523146-aec1-415d-b2a6-94ba6842fa50 req-c1a23c74-2c0d-4aba-81f0-2e0358d9516c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:55.539564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cc523146-aec1-415d-b2a6-94ba6842fa50 req-c1a23c74-2c0d-4aba-81f0-2e0358d9516c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:55.576124 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-cc523146-aec1-415d-b2a6-94ba6842fa50 req-c1a23c74-2c0d-4aba-81f0-2e0358d9516c service nova] Creating event network-vif-deleted:3592f197-96f9-47ca-a37a-2420a90d3429 for instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 on n-h2-845781-6 Aug 09 17:03:55.587974 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-cc523146-aec1-415d-b2a6-94ba6842fa50 req-c1a23c74-2c0d-4aba-81f0-2e0358d9516c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113064 Aug 09 17:03:55.589530 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 68/145] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:55.865990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-379c0546-a7d4-40e3-9fb2-36698c52c8bf tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:55.868180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-379c0546-a7d4-40e3-9fb2-36698c52c8bf tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:55.884126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379c0546-a7d4-40e3-9fb2-36698c52c8bf tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:55.885282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379c0546-a7d4-40e3-9fb2-36698c52c8bf tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:55.885959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379c0546-a7d4-40e3-9fb2-36698c52c8bf tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:55.888736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379c0546-a7d4-40e3-9fb2-36698c52c8bf tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:55.889582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379c0546-a7d4-40e3-9fb2-36698c52c8bf tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:55.890263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379c0546-a7d4-40e3-9fb2-36698c52c8bf tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:56.298775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c1670d4-bc2d-4f05-a6e1-aa638f8c0d7d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:56.301088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c1670d4-bc2d-4f05-a6e1-aa638f8c0d7d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:56.358386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1670d4-bc2d-4f05-a6e1-aa638f8c0d7d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:56.363972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1670d4-bc2d-4f05-a6e1-aa638f8c0d7d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:56.372716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-379c0546-a7d4-40e3-9fb2-36698c52c8bf tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:56.376762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1670d4-bc2d-4f05-a6e1-aa638f8c0d7d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:56.378058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1670d4-bc2d-4f05-a6e1-aa638f8c0d7d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:56.378919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1670d4-bc2d-4f05-a6e1-aa638f8c0d7d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:56.379746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1670d4-bc2d-4f05-a6e1-aa638f8c0d7d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:56.413518 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-379c0546-a7d4-40e3-9fb2-36698c52c8bf tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1433 microversion: 2.1 time: 0.558968 Aug 09 17:03:56.415461 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 78/146] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:55 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1433 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:56.474983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:56.480720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:56.518616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:56.522760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:56.530689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:56.534051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:56.535438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:56.538810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:56.710408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:56.711908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:56.712925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:56.716248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lazy-loading 'fault' on Instance uuid 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:03:57.070486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c1670d4-bc2d-4f05-a6e1-aa638f8c0d7d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:57.090494 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c1670d4-bc2d-4f05-a6e1-aa638f8c0d7d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1410 microversion: 2.1 time: 0.802471 Aug 09 17:03:57.091977 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 69/147] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:56 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1410 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:57.100043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cda913f4-2335-499b-963a-9e851bcaf59e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:57.101176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cda913f4-2335-499b-963a-9e851bcaf59e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:57.118099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cda913f4-2335-499b-963a-9e851bcaf59e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:57.120956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cda913f4-2335-499b-963a-9e851bcaf59e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:57.121774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cda913f4-2335-499b-963a-9e851bcaf59e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:57.122964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cda913f4-2335-499b-963a-9e851bcaf59e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:57.124131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cda913f4-2335-499b-963a-9e851bcaf59e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:57.124757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cda913f4-2335-499b-963a-9e851bcaf59e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:57.363372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac04975ebf9041c2a34e252d3f39a32f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f475204b1644570bc2bc148e895a171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:57.381451 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f772601a-c1b7-4595-8b7f-630c621d4dd1 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 200 len: 1327 microversion: 2.1 time: 0.913042 Aug 09 17:03:57.385562 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 79/148] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:56 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 1327 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:57.394885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-bad3967f-4229-454e-8993-0ebb023f0177 req-4c31f52e-a88e-43db-be61-c952abf26df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a21dd49-aca6-47cf-9381-0265b1a7a9c7", "name": "network-vif-plugged", "status": "completed", "tag": "25fa6b72-0892-44f5-bdbf-99073ca230d8"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:57.411062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-bad3967f-4229-454e-8993-0ebb023f0177 req-4c31f52e-a88e-43db-be61-c952abf26df5 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:57.421666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-bad3967f-4229-454e-8993-0ebb023f0177 req-4c31f52e-a88e-43db-be61-c952abf26df5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:57.422367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-bad3967f-4229-454e-8993-0ebb023f0177 req-4c31f52e-a88e-43db-be61-c952abf26df5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:57.443578 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-bad3967f-4229-454e-8993-0ebb023f0177 req-4c31f52e-a88e-43db-be61-c952abf26df5 service nova] Creating event network-vif-plugged:25fa6b72-0892-44f5-bdbf-99073ca230d8 for instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 on n-h1-845781-6 Aug 09 17:03:57.479993 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-bad3967f-4229-454e-8993-0ebb023f0177 req-4c31f52e-a88e-43db-be61-c952abf26df5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088009 Aug 09 17:03:57.486583 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 80/149] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:57.503536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:57.507791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:57.530256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:57.533629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:57.537952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:57.541382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:57.542157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:57.543830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:57.653724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:57.656402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:57.657131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:57.658808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lazy-loading 'fault' on Instance uuid da17df6f-e2bb-4886-919f-6b90e3cf344c {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:03:57.773152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:57.795324 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ab50593a-2fe1-478e-9bae-113c8c24529a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 200 len: 1309 microversion: 2.1 time: 0.306931 Aug 09 17:03:57.800027 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 81/150] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:57 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 1309 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:57.831831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-09fd0f9e-8142-47bf-a13e-d6fbe1faf339 req-87ae6d14-203b-4b04-a26a-1bd5ca2b5f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da17df6f-e2bb-4886-919f-6b90e3cf344c", "name": "network-vif-deleted", "tag": "b796f8f1-54d4-4adb-88a1-0e39567a6be4"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:57.849478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-09fd0f9e-8142-47bf-a13e-d6fbe1faf339 req-87ae6d14-203b-4b04-a26a-1bd5ca2b5f53 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:57.850817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-09fd0f9e-8142-47bf-a13e-d6fbe1faf339 req-87ae6d14-203b-4b04-a26a-1bd5ca2b5f53 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:57.851882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-09fd0f9e-8142-47bf-a13e-d6fbe1faf339 req-87ae6d14-203b-4b04-a26a-1bd5ca2b5f53 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:57.877602 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-09fd0f9e-8142-47bf-a13e-d6fbe1faf339 req-87ae6d14-203b-4b04-a26a-1bd5ca2b5f53 service nova] Creating event network-vif-deleted:b796f8f1-54d4-4adb-88a1-0e39567a6be4 for instance da17df6f-e2bb-4886-919f-6b90e3cf344c on n-h1-845781-6 Aug 09 17:03:57.889639 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-09fd0f9e-8142-47bf-a13e-d6fbe1faf339 req-87ae6d14-203b-4b04-a26a-1bd5ca2b5f53 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083633 Aug 09 17:03:57.891534 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 82/151] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:58.092560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cda913f4-2335-499b-963a-9e851bcaf59e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:58.102408 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cda913f4-2335-499b-963a-9e851bcaf59e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1313 microversion: 2.1 time: 1.008544 Aug 09 17:03:58.103404 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 70/152] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:57 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1313 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:58.126739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-17105846-8576-4831-831b-22681adedd2a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:58.127476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-17105846-8576-4831-831b-22681adedd2a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:58.136219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17105846-8576-4831-831b-22681adedd2a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:58.136752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17105846-8576-4831-831b-22681adedd2a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:58.137245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17105846-8576-4831-831b-22681adedd2a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:58.137980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17105846-8576-4831-831b-22681adedd2a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:58.138438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17105846-8576-4831-831b-22681adedd2a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:58.139069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17105846-8576-4831-831b-22681adedd2a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:58.424914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:58.425526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:58.431889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:58.432381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:58.432984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:58.433884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:58.434501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:58.435108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:58.462361 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] HTTP exception thrown: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Request method failure captured: Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 HTTP/1.1 Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pM-CR09eNW_Ue5Y-E4jreA1RYdDb0JgMZDc-8JsT6ws-HM2H_8QsqwlKyhOuCqYPChqm46a3pS0xAi7YOCNB_hKbNY0-yecfwLZ31m9mEsnNmRHeMyhUJP7eZ2yL98S1bGMY8XNxDLG2HM6hsQuOSjDfDexugSFuvT6jZC6-kPKjXc Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 6f475204b1644570bc2bc148e895a171 Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AggregatesAdminTestJSON-1581743881 Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:03:58.485318 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6f475204b1644570bc2bc148e895a171"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f475204b1644570bc2bc148e895a171"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f475204b1644570bc2bc148e895a171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6f475204b1644570bc2bc148e895a171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AggregatesAdminTestJSON-1581743881 Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 6f475204b1644570bc2bc148e895a171 Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1581743881 Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AggregatesAdminTestJSON-1581743881-project Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ac04975ebf9041c2a34e252d3f39a32f Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AggregatesAdminTestJSON-1581743881-project Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:03:58.486732 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0'} Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:03:58.487538 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:03:58.488693 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:03:58.489819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Returning 404 to user: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:03:58.489819 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-38f208ee-fbd9-43a0-b6b1-dcc2c03fb12f tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 404 len: 111 microversion: 2.1 time: 0.067825 Aug 09 17:03:58.492028 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 71/153] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:58 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:03:58.502085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3cdbeb6b-3e71-45b0-a2e1-28a9a37e98da tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-845781-6"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:58.506339 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:58.506339 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:58.519316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cdbeb6b-3e71-45b0-a2e1-28a9a37e98da tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:58.520064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cdbeb6b-3e71-45b0-a2e1-28a9a37e98da tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:58.520589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cdbeb6b-3e71-45b0-a2e1-28a9a37e98da tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:58.543035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-17105846-8576-4831-831b-22681adedd2a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:58.557171 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-17105846-8576-4831-831b-22681adedd2a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1410 microversion: 2.1 time: 0.435496 Aug 09 17:03:58.557764 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 83/154] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:58 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1410 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:58.844991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:58.845625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:58.857217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:58.858968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:58.859598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:58.863570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:58.864432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:58.868351 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3cdbeb6b-3e71-45b0-a2e1-28a9a37e98da tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 296 microversion: 2.1 time: 0.372533 Aug 09 17:03:58.868806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:58.871173 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 72/155] 10.222.0.93 () {60 vars in 1191 bytes} [Tue Aug 9 17:03:58 2022] POST /compute/v2.1/os-aggregates/1/action => generated 296 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:03:58.895917 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] HTTP exception thrown: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:03:58.899992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f19c3332-6d47-4c5b-88d7-6e72b1b8da1d tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Request method failure captured: Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c HTTP/1.1 Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pM_Mv8hiYyd2-2HI3hEs7Tqan5qw4RXI5emtKRi3E_y9ekmRgGshhSO9QoZMmE65EpQXLlAATcmllniIoxX9LmufEce0eERNYXR02psMMEQj7fQlMftNq2DVF8FqcySJ4GUSGX4dYwSzhwOIcWaPoeiSLlbWK0lk467M8fJbxKdSEo Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:03:58.902070 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4b37941288004266be2c1bd8d11a20d4 Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:03:58.903450 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'da17df6f-e2bb-4886-919f-6b90e3cf344c'} Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:03:58.904249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:03:58.905586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:03:58.908550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Returning 404 to user: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:03:58.909580 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-57acc103-452c-4cda-b17d-fd017a24e239 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 404 len: 111 microversion: 2.1 time: 0.071591 Aug 09 17:03:58.915322 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:58.915322 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:03:58.926837 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 84/156] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:58 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:03:58.950613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:59.018236 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f19c3332-6d47-4c5b-88d7-6e72b1b8da1d tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.132508 Aug 09 17:03:59.025526 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 73/157] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:03:58 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:03:59.050060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a9d39b1f-adf1-4f09-99a1-74d886ee934c tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-487271401"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:59.057710 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:59.057710 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:59.058825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.aggregate [None req-a9d39b1f-adf1-4f09-99a1-74d886ee934c tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Generated uuid a9e3ebe6-d17c-49bb-a5fb-c1d46beec88b for aggregate {{(pid=119432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:03:59.136247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5fe48b41-10c2-4810-9166-63bbb4ced83a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:59.140524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5fe48b41-10c2-4810-9166-63bbb4ced83a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:59.172060 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a9d39b1f-adf1-4f09-99a1-74d886ee934c tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.131069 Aug 09 17:03:59.173095 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 85/158] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:03:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:59.186477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fe48b41-10c2-4810-9166-63bbb4ced83a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:59.187530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fe48b41-10c2-4810-9166-63bbb4ced83a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:59.188425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a5af7ae-cd29-4956-9455-f9b94d922e53 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-845781-6"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:59.189573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fe48b41-10c2-4810-9166-63bbb4ced83a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:59.192084 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:03:59.192084 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:03:59.197849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fe48b41-10c2-4810-9166-63bbb4ced83a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:59.199344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fe48b41-10c2-4810-9166-63bbb4ced83a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:59.202125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fe48b41-10c2-4810-9166-63bbb4ced83a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:59.211913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a5af7ae-cd29-4956-9455-f9b94d922e53 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:59.212424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a5af7ae-cd29-4956-9455-f9b94d922e53 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:59.212942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a5af7ae-cd29-4956-9455-f9b94d922e53 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:59.228982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:59.995099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5fe48b41-10c2-4810-9166-63bbb4ced83a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:00.018154 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5fe48b41-10c2-4810-9166-63bbb4ced83a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1313 microversion: 2.1 time: 0.889930 Aug 09 17:04:00.029086 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 74/159] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:59 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1313 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:00.058545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1731343604", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:00.060865 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a5af7ae-cd29-4956-9455-f9b94d922e53 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.875937 Aug 09 17:04:00.063941 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 86/160] 10.222.0.93 () {60 vars in 1191 bytes} [Tue Aug 9 17:03:59 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:00.076292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4b3dec9e-9926-4847-87b2-4fae7ce6e658 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:00.078633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4b3dec9e-9926-4847-87b2-4fae7ce6e658 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:00.096848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b3dec9e-9926-4847-87b2-4fae7ce6e658 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:00.098111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b3dec9e-9926-4847-87b2-4fae7ce6e658 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:00.100362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b3dec9e-9926-4847-87b2-4fae7ce6e658 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:00.102369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b3dec9e-9926-4847-87b2-4fae7ce6e658 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:00.103600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b3dec9e-9926-4847-87b2-4fae7ce6e658 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:00.106825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b3dec9e-9926-4847-87b2-4fae7ce6e658 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:00.200665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:04:00.243939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:00.630122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:04:00.630794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:04:00.631515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:04:00.632031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:04:00.633504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:04:00.664711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:00.666643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:00.667700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:00.669722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:00.671161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:00.673154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:00.695357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4b3dec9e-9926-4847-87b2-4fae7ce6e658 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:00.706637 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4b3dec9e-9926-4847-87b2-4fae7ce6e658 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1389 microversion: 2.1 time: 0.640723 Aug 09 17:04:00.710285 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 87/161] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:00 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1389 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:00.732303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-6391fab1-bf08-4001-8e32-4a7c75880d7b req-345996e9-3d18-48b8-9b9f-19235ce6905e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1ebe1f-c944-4f78-84df-43776f1eb671", "tag": "a813e9bf-51e2-4577-9543-ad1edc45394e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:00.756910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6391fab1-bf08-4001-8e32-4a7c75880d7b req-345996e9-3d18-48b8-9b9f-19235ce6905e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:00.758955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6391fab1-bf08-4001-8e32-4a7c75880d7b req-345996e9-3d18-48b8-9b9f-19235ce6905e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:00.766707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6391fab1-bf08-4001-8e32-4a7c75880d7b req-345996e9-3d18-48b8-9b9f-19235ce6905e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:00.787907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Getting quotas for project da04c602d6734ab1a12a6c388f68f415. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:04:00.802489 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-6391fab1-bf08-4001-8e32-4a7c75880d7b req-345996e9-3d18-48b8-9b9f-19235ce6905e service nova] Creating event network-changed:a813e9bf-51e2-4577-9543-ad1edc45394e for instance cb1ebe1f-c944-4f78-84df-43776f1eb671 on n-h2-845781-6 Aug 09 17:04:00.808309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Getting quotas for user 4b37941288004266be2c1bd8d11a20d4 and project da04c602d6734ab1a12a6c388f68f415. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:04:00.817353 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-6391fab1-bf08-4001-8e32-4a7c75880d7b req-345996e9-3d18-48b8-9b9f-19235ce6905e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104848 Aug 09 17:04:00.819483 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 88/162] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:00.833833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0cea7216-ea3f-4fac-b059-df06f8980c9a tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:00.836535 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:00.836535 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:00.856109 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0cea7216-ea3f-4fac-b059-df06f8980c9a tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.034993 Aug 09 17:04:00.858089 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 89/163] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:04:00 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:00.875311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:04:00.879780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-051f13f2-dca3-42a6-b6b8-711523a4b2d5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-845781-6"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:00.886657 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:00.886657 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:00.894292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:04:00.913311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-051f13f2-dca3-42a6-b6b8-711523a4b2d5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:00.914084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-051f13f2-dca3-42a6-b6b8-711523a4b2d5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:00.914861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-051f13f2-dca3-42a6-b6b8-711523a4b2d5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:01.086900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df12b820-afcf-4458-8b81-b0605aca55b5 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052597 Aug 09 17:04:01.089898 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 75/164] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:04:01.117685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c6f9a95-4852-426b-be0d-d2b6712d1cbf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:01.120104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c6f9a95-4852-426b-be0d-d2b6712d1cbf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:01.160567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a95-4852-426b-be0d-d2b6712d1cbf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:01.161045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a95-4852-426b-be0d-d2b6712d1cbf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:01.161490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a95-4852-426b-be0d-d2b6712d1cbf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:01.162406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a95-4852-426b-be0d-d2b6712d1cbf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:01.162877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a95-4852-426b-be0d-d2b6712d1cbf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:01.163308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a95-4852-426b-be0d-d2b6712d1cbf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:01.324746 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-051f13f2-dca3-42a6-b6b8-711523a4b2d5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.452547 Aug 09 17:04:01.335891 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 90/165] 10.222.0.93 () {60 vars in 1191 bytes} [Tue Aug 9 17:04:00 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:01.354670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-88d0e48c-de92-47b3-932f-aae8309d7615 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:01.359456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-88d0e48c-de92-47b3-932f-aae8309d7615 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:01.539706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-88d0e48c-de92-47b3-932f-aae8309d7615 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:01.565001 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-88d0e48c-de92-47b3-932f-aae8309d7615 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1220 microversion: 2.1 time: 0.226030 Aug 09 17:04:01.566424 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 91/166] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:01 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1220 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:01.583156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe9ae137-bee3-48cc-b4fa-733a617d1537 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:01.592022 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:01.592022 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:01.665339 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fe9ae137-bee3-48cc-b4fa-733a617d1537 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.096465 Aug 09 17:04:01.667316 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 92/167] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:01 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:01.681392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2619f1fe-65ad-4084-8647-ab411a300741 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1569413009"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:01.686913 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:01.686913 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:01.690498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.aggregate [None req-2619f1fe-65ad-4084-8647-ab411a300741 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Generated uuid 5cbf3c42-ad29-4936-86d0-3f1c3463ce13 for aggregate {{(pid=119432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:01.780536 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2619f1fe-65ad-4084-8647-ab411a300741 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.105888 Aug 09 17:04:01.793947 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 93/168] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:01.815268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2cc18f05-cf99-461c-bdae-928e7a318446 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:01.816434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2cc18f05-cf99-461c-bdae-928e7a318446 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:01.840772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cc18f05-cf99-461c-bdae-928e7a318446 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:01.843527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cc18f05-cf99-461c-bdae-928e7a318446 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:01.844885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cc18f05-cf99-461c-bdae-928e7a318446 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:01.846909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cc18f05-cf99-461c-bdae-928e7a318446 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:01.847809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cc18f05-cf99-461c-bdae-928e7a318446 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:01.848426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cc18f05-cf99-461c-bdae-928e7a318446 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:02.224487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c6f9a95-4852-426b-be0d-d2b6712d1cbf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:02.272299 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c6f9a95-4852-426b-be0d-d2b6712d1cbf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1462 microversion: 2.1 time: 1.179902 Aug 09 17:04:02.282386 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 76/169] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:01 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1462 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:02.317667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a44c57f5-e014-436c-828e-af1745044afe tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-845781-6"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:02.327259 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:02.327259 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:02.370238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a44c57f5-e014-436c-828e-af1745044afe tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:02.373317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a44c57f5-e014-436c-828e-af1745044afe tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:02.374917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a44c57f5-e014-436c-828e-af1745044afe tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:02.759173 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a44c57f5-e014-436c-828e-af1745044afe tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.472972 Aug 09 17:04:02.777065 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 77/170] 10.222.0.93 () {60 vars in 1191 bytes} [Tue Aug 9 17:04:02 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:02.829276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2cc18f05-cf99-461c-bdae-928e7a318446 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:02.858089 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2cc18f05-cf99-461c-bdae-928e7a318446 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1389 microversion: 2.1 time: 1.062052 Aug 09 17:04:02.859554 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 94/171] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:01 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1389 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:02.870621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-70d9b816-a8fb-4c7a-9237-87cd1d627ad3 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:02.876281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-70d9b816-a8fb-4c7a-9237-87cd1d627ad3 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:02.924116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70d9b816-a8fb-4c7a-9237-87cd1d627ad3 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:02.926301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70d9b816-a8fb-4c7a-9237-87cd1d627ad3 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:02.933271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70d9b816-a8fb-4c7a-9237-87cd1d627ad3 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:02.935868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70d9b816-a8fb-4c7a-9237-87cd1d627ad3 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:02.936982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70d9b816-a8fb-4c7a-9237-87cd1d627ad3 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:02.938548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70d9b816-a8fb-4c7a-9237-87cd1d627ad3 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:03.279997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-542b6651-4c76-46eb-904f-da72bd12c566 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:03.282929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-542b6651-4c76-46eb-904f-da72bd12c566 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:03.313923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-542b6651-4c76-46eb-904f-da72bd12c566 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:03.319084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-542b6651-4c76-46eb-904f-da72bd12c566 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:03.320190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-542b6651-4c76-46eb-904f-da72bd12c566 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:03.321526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-542b6651-4c76-46eb-904f-da72bd12c566 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:03.322578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-542b6651-4c76-46eb-904f-da72bd12c566 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:03.323303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-542b6651-4c76-46eb-904f-da72bd12c566 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:03.712114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-70d9b816-a8fb-4c7a-9237-87cd1d627ad3 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:03.735193 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-70d9b816-a8fb-4c7a-9237-87cd1d627ad3 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1216 microversion: 2.1 time: 0.872593 Aug 09 17:04:03.741333 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 95/172] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:02 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1216 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:03.793579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8385db55-16d1-4fc1-a98e-0bf277fd240c tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:03.796073 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:03.796073 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:03.820949 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8385db55-16d1-4fc1-a98e-0bf277fd240c tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.077206 Aug 09 17:04:03.822824 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 96/173] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:04:03 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:03.845142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-40d0377f-fa3d-4eeb-b6cf-f8ce7579ea9d tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-845781-6"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:03.857768 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:03.857768 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:03.905793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40d0377f-fa3d-4eeb-b6cf-f8ce7579ea9d tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:03.907405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40d0377f-fa3d-4eeb-b6cf-f8ce7579ea9d tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:03.908294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40d0377f-fa3d-4eeb-b6cf-f8ce7579ea9d tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:04.143347 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-40d0377f-fa3d-4eeb-b6cf-f8ce7579ea9d tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.309645 Aug 09 17:04:04.161581 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 97/174] 10.222.0.93 () {60 vars in 1191 bytes} [Tue Aug 9 17:04:03 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:04.168525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-20f8021b-2b05-4cf4-9755-eeb1c44cd7cc tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:04.169169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-20f8021b-2b05-4cf4-9755-eeb1c44cd7cc tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:04.180534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20f8021b-2b05-4cf4-9755-eeb1c44cd7cc tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:04.182366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20f8021b-2b05-4cf4-9755-eeb1c44cd7cc tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:04.183354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20f8021b-2b05-4cf4-9755-eeb1c44cd7cc tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:04.184384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20f8021b-2b05-4cf4-9755-eeb1c44cd7cc tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:04.185642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20f8021b-2b05-4cf4-9755-eeb1c44cd7cc tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:04.186230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20f8021b-2b05-4cf4-9755-eeb1c44cd7cc tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:04.389764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-20f8021b-2b05-4cf4-9755-eeb1c44cd7cc tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:04.399402 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-20f8021b-2b05-4cf4-9755-eeb1c44cd7cc tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1389 microversion: 2.1 time: 0.236887 Aug 09 17:04:04.400139 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 98/175] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:04 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1389 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:04.404607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d2188810-3a06-4c4c-b966-f5eab603e3f5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:04.408220 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:04.408220 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:04.474657 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d2188810-3a06-4c4c-b966-f5eab603e3f5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.073032 Aug 09 17:04:04.475602 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 99/176] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:04 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:04.672002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1034939980", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:04.747472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:04:05.042015 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-542b6651-4c76-46eb-904f-da72bd12c566 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1613 microversion: 2.1 time: 2.261819 Aug 09 17:04:05.043608 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 78/177] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:02 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1613 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:05.068348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b94f7935-0437-42fa-952e-1564ae5ed65c tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-746563102"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:05.074513 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:05.074513 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:05.076870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.aggregate [None req-b94f7935-0437-42fa-952e-1564ae5ed65c tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Generated uuid d8093a79-9bd0-41b7-88e6-44ee32067cec for aggregate {{(pid=119431) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:05.114359 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b94f7935-0437-42fa-952e-1564ae5ed65c tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.068805 Aug 09 17:04:05.115616 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 79/178] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:05 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:05.138202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-270946a9-b621-441c-b9d8-963570c014b4 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:05.139169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-270946a9-b621-441c-b9d8-963570c014b4 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:05.163396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-270946a9-b621-441c-b9d8-963570c014b4 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:05.167012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-270946a9-b621-441c-b9d8-963570c014b4 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:05.168204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-270946a9-b621-441c-b9d8-963570c014b4 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:05.171865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-270946a9-b621-441c-b9d8-963570c014b4 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:05.174573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-270946a9-b621-441c-b9d8-963570c014b4 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:05.175594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-270946a9-b621-441c-b9d8-963570c014b4 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:05.394131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-270946a9-b621-441c-b9d8-963570c014b4 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:05.415419 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-270946a9-b621-441c-b9d8-963570c014b4 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1278 microversion: 2.1 time: 0.296411 Aug 09 17:04:05.416514 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 80/179] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:05 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1278 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:05.424465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:04:05.425967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:04:05.426690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:04:05.426810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:05.427355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:04:05.427942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:04:05.428617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:05.447757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:05.450374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:05.450878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:05.451660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:05.452141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:05.452576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:05.459977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:05.460690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:05.461182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:05.462113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:05.462586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:05.463023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:05.498728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Getting quotas for project a6aa3d7035ce484f9ea8bb3fdf7ac9a6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:04:05.518419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Getting quotas for user e225d63b357c47998d854f8fa5b4be08 and project a6aa3d7035ce484f9ea8bb3fdf7ac9a6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:04:05.547051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:04:05.549763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:04:05.656915 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f0da67df-356f-4855-a163-eaeb683a1766 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.178927 Aug 09 17:04:05.657449 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 100/180] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:04:05.659908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '017d8ebb677e4fa789c56667f7ea29eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acca86153a141918d7785f76b3dd796', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:05.661031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] flavor_id is None. Assuming migration. {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 09 17:04:05.662909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 17:04:05.676821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e75e741-efdc-422f-8f83-8d2ef6ec054e tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-845781-6"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:05.682269 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:05.682269 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:05.710654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e75e741-efdc-422f-8f83-8d2ef6ec054e tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:05.712573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e75e741-efdc-422f-8f83-8d2ef6ec054e tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:05.713103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e75e741-efdc-422f-8f83-8d2ef6ec054e tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:05.922880 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e75e741-efdc-422f-8f83-8d2ef6ec054e tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.260395 Aug 09 17:04:05.923804 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 101/181] 10.222.0.93 () {60 vars in 1191 bytes} [Tue Aug 9 17:04:05 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:05.934228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2b2e5129-ab6a-4a62-9d7b-d7c10b8cc04f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:05.936335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2b2e5129-ab6a-4a62-9d7b-d7c10b8cc04f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:05.947788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b2e5129-ab6a-4a62-9d7b-d7c10b8cc04f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:05.948608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b2e5129-ab6a-4a62-9d7b-d7c10b8cc04f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:05.951189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b2e5129-ab6a-4a62-9d7b-d7c10b8cc04f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:05.954612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b2e5129-ab6a-4a62-9d7b-d7c10b8cc04f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:05.955255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b2e5129-ab6a-4a62-9d7b-d7c10b8cc04f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:05.957075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b2e5129-ab6a-4a62-9d7b-d7c10b8cc04f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:06.555330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b2e5129-ab6a-4a62-9d7b-d7c10b8cc04f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:06.564913 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2b2e5129-ab6a-4a62-9d7b-d7c10b8cc04f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1389 microversion: 2.1 time: 0.639782 Aug 09 17:04:06.565672 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 102/182] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:05 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1389 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:06.580901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1784010326", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:06.708516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:04:06.918834 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f10abe8e-1d1d-4bc7-9353-84a5abc7a9b1 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7/action" status: 202 len: 0 microversion: 2.1 time: 1.500598 Aug 09 17:04:06.924575 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 81/183] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:04:05 2022] POST /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7/action => generated 0 bytes in 1507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:04:06.942237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a8c7096-339f-476b-8f99-10f03228e795 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-845781-6"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:06.955965 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:06.955965 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:06.988303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a8c7096-339f-476b-8f99-10f03228e795 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:06.988864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a8c7096-339f-476b-8f99-10f03228e795 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:06.989320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a8c7096-339f-476b-8f99-10f03228e795 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:07.316418 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9a8c7096-339f-476b-8f99-10f03228e795 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.389872 Aug 09 17:04:07.327286 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 82/184] 10.222.0.93 () {60 vars in 1191 bytes} [Tue Aug 9 17:04:06 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:07.342157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-944161b4-1f9e-43a5-9465-5dfd44476b0f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:07.343140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-944161b4-1f9e-43a5-9465-5dfd44476b0f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:07.364602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-944161b4-1f9e-43a5-9465-5dfd44476b0f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:07.365309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-944161b4-1f9e-43a5-9465-5dfd44476b0f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:07.365867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-944161b4-1f9e-43a5-9465-5dfd44476b0f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:07.370381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-944161b4-1f9e-43a5-9465-5dfd44476b0f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:07.371029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-944161b4-1f9e-43a5-9465-5dfd44476b0f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:07.371655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-944161b4-1f9e-43a5-9465-5dfd44476b0f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:07.441440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:07.788435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:04:07.789488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:04:07.789659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:04:07.789985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:04:07.790590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:04:07.816339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:07.819281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:07.821424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:07.822491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:07.823151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:07.823699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:07.852237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Getting quotas for project a6aa3d7035ce484f9ea8bb3fdf7ac9a6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:04:07.857893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Getting quotas for user e225d63b357c47998d854f8fa5b4be08 and project a6aa3d7035ce484f9ea8bb3fdf7ac9a6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:04:07.884279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:04:07.889488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:04:07.960820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-944161b4-1f9e-43a5-9465-5dfd44476b0f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:07.991522 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-944161b4-1f9e-43a5-9465-5dfd44476b0f tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1320 microversion: 2.1 time: 0.662292 Aug 09 17:04:08.006085 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 83/185] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:07 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1320 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:08.014397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fb215ea5-71c3-4d80-bd64-486130fea637 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:08.016280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fb215ea5-71c3-4d80-bd64-486130fea637 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:08.017807 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a4df6a39-524a-4bd3-a85d-e72202918605 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.445860 Aug 09 17:04:08.029297 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 103/186] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:04:08.030945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb215ea5-71c3-4d80-bd64-486130fea637 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:08.034177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-32f73a1f-72e7-40d0-b417-5eee8838ea34 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:08.034796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb215ea5-71c3-4d80-bd64-486130fea637 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:08.035466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb215ea5-71c3-4d80-bd64-486130fea637 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:08.036299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb215ea5-71c3-4d80-bd64-486130fea637 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:08.036782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb215ea5-71c3-4d80-bd64-486130fea637 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:08.037223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb215ea5-71c3-4d80-bd64-486130fea637 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:08.040727 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:08.040727 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:08.094289 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-32f73a1f-72e7-40d0-b417-5eee8838ea34 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.067701 Aug 09 17:04:08.103273 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 104/187] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:08 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:08.110897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e6986526-59d0-460c-bc73-cd1da2471c38 req-c1550333-7835-4749-99f9-179aed819746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a357d075-2b44-40d1-9ccd-8816ededc907", "tag": "3de121a0-09ed-476e-8f0e-cabce3982d4a"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:08.157417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e6986526-59d0-460c-bc73-cd1da2471c38 req-c1550333-7835-4749-99f9-179aed819746 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:08.158616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e6986526-59d0-460c-bc73-cd1da2471c38 req-c1550333-7835-4749-99f9-179aed819746 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:08.159664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e6986526-59d0-460c-bc73-cd1da2471c38 req-c1550333-7835-4749-99f9-179aed819746 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:08.209954 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e6986526-59d0-460c-bc73-cd1da2471c38 req-c1550333-7835-4749-99f9-179aed819746 service nova] Creating event network-changed:3de121a0-09ed-476e-8f0e-cabce3982d4a for instance a357d075-2b44-40d1-9ccd-8816ededc907 on n-h1-845781-6 Aug 09 17:04:08.241971 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e6986526-59d0-460c-bc73-cd1da2471c38 req-c1550333-7835-4749-99f9-179aed819746 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136354 Aug 09 17:04:08.242756 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 105/188] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:08.253336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-66594ed7-f49f-493e-b484-461705605fd4 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:08.254062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-66594ed7-f49f-493e-b484-461705605fd4 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:08.260813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:INSERT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:08.262685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66594ed7-f49f-493e-b484-461705605fd4 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:08.263357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66594ed7-f49f-493e-b484-461705605fd4 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:08.263835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66594ed7-f49f-493e-b484-461705605fd4 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:08.264747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66594ed7-f49f-493e-b484-461705605fd4 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:08.265351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66594ed7-f49f-493e-b484-461705605fd4 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:08.265859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66594ed7-f49f-493e-b484-461705605fd4 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:08.917794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fb215ea5-71c3-4d80-bd64-486130fea637 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:08.949540 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fb215ea5-71c3-4d80-bd64-486130fea637 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1471 microversion: 2.1 time: 0.941478 Aug 09 17:04:08.957237 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 84/189] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:08 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1471 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:08.984110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4b043937-12bf-42d0-86c7-a53041126360 req-6e3367d7-f7a9-4e32-b9a0-6ffc25fd6d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1ebe1f-c944-4f78-84df-43776f1eb671", "name": "network-vif-plugged", "status": "completed", "tag": "a813e9bf-51e2-4577-9543-ad1edc45394e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:09.050652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66594ed7-f49f-493e-b484-461705605fd4 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:09.060874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4b043937-12bf-42d0-86c7-a53041126360 req-6e3367d7-f7a9-4e32-b9a0-6ffc25fd6d74 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:09.088056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4b043937-12bf-42d0-86c7-a53041126360 req-6e3367d7-f7a9-4e32-b9a0-6ffc25fd6d74 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:09.089693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4b043937-12bf-42d0-86c7-a53041126360 req-6e3367d7-f7a9-4e32-b9a0-6ffc25fd6d74 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:09.094199 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-66594ed7-f49f-493e-b484-461705605fd4 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1389 microversion: 2.1 time: 0.847079 Aug 09 17:04:09.129284 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 106/190] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:08 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1389 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:09.140290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-08ca9c15-d488-469b-98a9-5afbaeaeb89b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:09.148948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-08ca9c15-d488-469b-98a9-5afbaeaeb89b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:09.182491 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4b043937-12bf-42d0-86c7-a53041126360 req-6e3367d7-f7a9-4e32-b9a0-6ffc25fd6d74 service nova] Creating event network-vif-plugged:a813e9bf-51e2-4577-9543-ad1edc45394e for instance cb1ebe1f-c944-4f78-84df-43776f1eb671 on n-h2-845781-6 Aug 09 17:04:09.211763 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4b043937-12bf-42d0-86c7-a53041126360 req-6e3367d7-f7a9-4e32-b9a0-6ffc25fd6d74 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243111 Aug 09 17:04:09.217265 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 85/191] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:09.256817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a58cc455-d84d-48ad-aba2-19844b5751ad tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1885098592"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:09.276014 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:09.276014 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:09.289328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.aggregate [None req-a58cc455-d84d-48ad-aba2-19844b5751ad tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Generated uuid d11e60f8-2aec-45d7-9e82-bd04a53c7b5a for aggregate {{(pid=119431) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:09.358535 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a58cc455-d84d-48ad-aba2-19844b5751ad tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.130592 Aug 09 17:04:09.363312 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 86/192] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:09.380303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aea938dd-0967-4736-be6a-d8146ee6930b tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Calling method '.version_select at 0x7fbbd81db700>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:09.411506 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:09.411506 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:09.437224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea938dd-0967-4736-be6a-d8146ee6930b tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:09.448743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea938dd-0967-4736-be6a-d8146ee6930b tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:09.457431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea938dd-0967-4736-be6a-d8146ee6930b tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:09.462655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea938dd-0967-4736-be6a-d8146ee6930b tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:09.472114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea938dd-0967-4736-be6a-d8146ee6930b tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:09.478046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea938dd-0967-4736-be6a-d8146ee6930b tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:09.532485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=9 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:09.623969 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aea938dd-0967-4736-be6a-d8146ee6930b tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.255583 Aug 09 17:04:09.626274 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 87/193] 10.222.0.93 () {58 vars in 1128 bytes} [Tue Aug 9 17:04:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:09.648231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7e79f019-bbe4-4112-b4c8-922e47204c24 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:09.650188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7e79f019-bbe4-4112-b4c8-922e47204c24 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:09.678965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e79f019-bbe4-4112-b4c8-922e47204c24 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:09.681976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e79f019-bbe4-4112-b4c8-922e47204c24 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:09.683179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e79f019-bbe4-4112-b4c8-922e47204c24 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:09.692369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e79f019-bbe4-4112-b4c8-922e47204c24 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:09.693451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e79f019-bbe4-4112-b4c8-922e47204c24 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:09.694209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e79f019-bbe4-4112-b4c8-922e47204c24 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:10.053363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-08ca9c15-d488-469b-98a9-5afbaeaeb89b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:10.079614 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-08ca9c15-d488-469b-98a9-5afbaeaeb89b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1214 microversion: 2.1 time: 0.948057 Aug 09 17:04:10.080744 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 107/194] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:09 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1214 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:10.107143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-17fa26ae-eb3b-49a2-880a-78550f3ff65c tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:10.116713 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:10.116713 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:10.169432 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-17fa26ae-eb3b-49a2-880a-78550f3ff65c tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.083709 Aug 09 17:04:10.171606 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 108/195] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:10.182638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-36e234ee-9095-4367-872a-80416e411de3 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Calling method '.version_select at 0x7fbbd82008b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:10.186685 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:10.186685 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:10.188667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36e234ee-9095-4367-872a-80416e411de3 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:10.190798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36e234ee-9095-4367-872a-80416e411de3 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:10.191456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36e234ee-9095-4367-872a-80416e411de3 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:10.192813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36e234ee-9095-4367-872a-80416e411de3 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:10.193468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36e234ee-9095-4367-872a-80416e411de3 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:10.194755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36e234ee-9095-4367-872a-80416e411de3 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:10.232983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7e79f019-bbe4-4112-b4c8-922e47204c24 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:10.248689 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-36e234ee-9095-4367-872a-80416e411de3 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.072259 Aug 09 17:04:10.249325 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 109/196] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:10 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:10.263926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-75908588-f662-416d-90f7-f299c2421ee1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:10.265002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-75908588-f662-416d-90f7-f299c2421ee1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:10.273550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75908588-f662-416d-90f7-f299c2421ee1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:10.274348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75908588-f662-416d-90f7-f299c2421ee1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:10.274966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75908588-f662-416d-90f7-f299c2421ee1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:10.275930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75908588-f662-416d-90f7-f299c2421ee1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:10.276591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75908588-f662-416d-90f7-f299c2421ee1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:10.277185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75908588-f662-416d-90f7-f299c2421ee1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:10.279898 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7e79f019-bbe4-4112-b4c8-922e47204c24 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1320 microversion: 2.1 time: 0.639290 Aug 09 17:04:10.282003 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 88/197] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:09 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1320 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:10.315466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6a0b74f-26c8-4720-9e3d-f049ef3376ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:10.317560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b6a0b74f-26c8-4720-9e3d-f049ef3376ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:10.349553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6a0b74f-26c8-4720-9e3d-f049ef3376ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:10.352124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6a0b74f-26c8-4720-9e3d-f049ef3376ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:10.354113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6a0b74f-26c8-4720-9e3d-f049ef3376ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:10.359975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6a0b74f-26c8-4720-9e3d-f049ef3376ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:10.362919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6a0b74f-26c8-4720-9e3d-f049ef3376ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:10.365108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6a0b74f-26c8-4720-9e3d-f049ef3376ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:10.738449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-75908588-f662-416d-90f7-f299c2421ee1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:10.754226 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-75908588-f662-416d-90f7-f299c2421ee1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1471 microversion: 2.1 time: 0.494733 Aug 09 17:04:10.756328 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 110/198] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:10 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1471 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:10.763071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1b598a4-e9b8-4d69-99c3-8a2830c133bd tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:10.775297 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:10.775297 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:10.785082 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-f1b598a4-e9b8-4d69-99c3-8a2830c133bd tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1b598a4-e9b8-4d69-99c3-8a2830c133bd tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Request method failure captured: Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pNCZgHJpJ9hADZ8GlxAFygCsBUjSXd3A2S8bZSqM_pkxJE5Ksq8Y_4svA59Ezd8Kvb7qcnBhYeaEQoQu09Au36oxlLfM4J7ecOWCcWn3PBvIk_Flt9RL0n0DvKg-WSggq4XwQeKfKQoEZtjVKrG-h2gM-yzr7YIO2XTKhphzXeGCvs Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f612f77cf9b04196b4359a293aa2ca93 Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:04:10.794366 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f612f77cf9b04196b4359a293aa2ca93 Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AggregatesAdminTestJSON-1689243767-project-admin Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: bd43bd26607e44e3be55b1c3a2da123d Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AggregatesAdminTestJSON-1689243767-project-admin Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: exception: Aggregate 5 could not be found. Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '5'} Aug 09 17:04:10.797117 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:10.798856 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 09 17:04:10.801342 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:10.804433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1b598a4-e9b8-4d69-99c3-8a2830c133bd tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:10.804433 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f1b598a4-e9b8-4d69-99c3-8a2830c133bd tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.038445 Aug 09 17:04:10.804433 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 111/199] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:04:10 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:04:10.822488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-37de0a05-207b-4675-8595-0b525d18accc tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Calling method '.version_select at 0x7fbbd8200b80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:10.825134 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:10.825134 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:10.826436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37de0a05-207b-4675-8595-0b525d18accc tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:10.826865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37de0a05-207b-4675-8595-0b525d18accc tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:10.827317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37de0a05-207b-4675-8595-0b525d18accc tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:10.828704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37de0a05-207b-4675-8595-0b525d18accc tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:10.829454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37de0a05-207b-4675-8595-0b525d18accc tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:10.830027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37de0a05-207b-4675-8595-0b525d18accc tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:10.853866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:10.876256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b6a0b74f-26c8-4720-9e3d-f049ef3376ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:10.922149 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6a0b74f-26c8-4720-9e3d-f049ef3376ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1389 microversion: 2.1 time: 0.623925 Aug 09 17:04:10.923221 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 89/200] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:10 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1389 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:10.982199 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-37de0a05-207b-4675-8595-0b525d18accc tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.176121 Aug 09 17:04:10.993279 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 112/201] 10.222.0.93 () {58 vars in 1128 bytes} [Tue Aug 9 17:04:10 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:10.993565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21b8eab8-b056-4adf-963c-5e3d6fc1b9e3 tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1720666018"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:10.993565 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:10.993565 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:10.993565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.aggregate [None req-21b8eab8-b056-4adf-963c-5e3d6fc1b9e3 tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Generated uuid 676c9001-eefa-4128-b468-3236f21bcdba for aggregate {{(pid=119431) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:11.002913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d6e57bf-572e-418b-aa00-c77e487ae9cf tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:11.009883 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:11.009883 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:11.054402 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-21b8eab8-b056-4adf-963c-5e3d6fc1b9e3 tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.090777 Aug 09 17:04:11.055696 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 90/202] 10.222.0.93 () {62 vars in 1205 bytes} [Tue Aug 9 17:04:10 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:04:11.060877 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-5d6e57bf-572e-418b-aa00-c77e487ae9cf tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d6e57bf-572e-418b-aa00-c77e487ae9cf tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Request method failure captured: Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pNCZgHJpJ9hADZ8GlxAFygCsBUjSXd3A2S8bZSqM_pkxJE5Ksq8Y_4svA59Ezd8Kvb7qcnBhYeaEQoQu09Au36oxlLfM4J7ecOWCcWn3PBvIk_Flt9RL0n0DvKg-WSggq4XwQeKfKQoEZtjVKrG-h2gM-yzr7YIO2XTKhphzXeGCvs Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f612f77cf9b04196b4359a293aa2ca93 Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:04:11.064953 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f612f77cf9b04196b4359a293aa2ca93 Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AggregatesAdminTestJSON-1689243767-project-admin Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: bd43bd26607e44e3be55b1c3a2da123d Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AggregatesAdminTestJSON-1689243767-project-admin Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: exception: Aggregate 5 could not be found. Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '5'} Aug 09 17:04:11.066201 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:04:11.066891 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:11.067909 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:11.069088 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:11.069088 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:11.069088 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:11.069088 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 09 17:04:11.069088 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:11.069088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d6e57bf-572e-418b-aa00-c77e487ae9cf tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:11.069088 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5d6e57bf-572e-418b-aa00-c77e487ae9cf tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.081867 Aug 09 17:04:11.076014 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 113/203] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:04:11.078564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cecdcac2-dc4a-4ec6-afb3-8108ebb945b2 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Calling method '.version_select at 0x7fbbd829a160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:11.082545 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:11.082545 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:11.086864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-443abe3a-6d59-46e5-b8f0-e824b270f2ee tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-546161044"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:11.100898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecdcac2-dc4a-4ec6-afb3-8108ebb945b2 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:11.101977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecdcac2-dc4a-4ec6-afb3-8108ebb945b2 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:11.106203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecdcac2-dc4a-4ec6-afb3-8108ebb945b2 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:11.166956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecdcac2-dc4a-4ec6-afb3-8108ebb945b2 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:11.171007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecdcac2-dc4a-4ec6-afb3-8108ebb945b2 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:11.174410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecdcac2-dc4a-4ec6-afb3-8108ebb945b2 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:11.290671 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cecdcac2-dc4a-4ec6-afb3-8108ebb945b2 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-h2-845781-6" status: 200 len: 598 microversion: 2.1 time: 0.231817 Aug 09 17:04:11.303380 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 91/204] 10.222.0.93 () {58 vars in 1170 bytes} [Tue Aug 9 17:04:11 2022] GET /compute/v2.1/os-hosts/n-h2-845781-6 => generated 598 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:11.317268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d62d7981-dfba-4404-8e36-ba77c6956f2b tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-631186765", "name": "tempest-test_aggregate-449041116"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:11.392238 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:11.392238 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:11.402958 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:11.402958 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:11.408376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.aggregate [None req-d62d7981-dfba-4404-8e36-ba77c6956f2b tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Generated uuid aac72eac-e171-4f05-bfc9-061786d39e0a for aggregate {{(pid=119431) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:11.504044 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-443abe3a-6d59-46e5-b8f0-e824b270f2ee tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.427505 Aug 09 17:04:11.505370 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 114/205] 10.222.0.93 () {62 vars in 1210 bytes} [Tue Aug 9 17:04:11 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:04:11.519661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1360eb4f-215c-4636-aa4e-cd115336e409 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:11.529181 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d62d7981-dfba-4404-8e36-ba77c6956f2b tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.224166 Aug 09 17:04:11.536683 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 92/206] 10.222.0.93 () {60 vars in 1165 bytes} [Tue Aug 9 17:04:11 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:11.540523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1360eb4f-215c-4636-aa4e-cd115336e409 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:11.556395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69e79c7f-65cd-4570-8a96-e439f53d87d8 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:11.559262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-69e79c7f-65cd-4570-8a96-e439f53d87d8 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:11.561397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1360eb4f-215c-4636-aa4e-cd115336e409 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:11.569355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1360eb4f-215c-4636-aa4e-cd115336e409 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:11.570165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1360eb4f-215c-4636-aa4e-cd115336e409 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:11.575187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1360eb4f-215c-4636-aa4e-cd115336e409 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:11.577547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1360eb4f-215c-4636-aa4e-cd115336e409 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:11.581650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1360eb4f-215c-4636-aa4e-cd115336e409 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:11.592095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69e79c7f-65cd-4570-8a96-e439f53d87d8 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:11.593786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69e79c7f-65cd-4570-8a96-e439f53d87d8 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:11.597609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69e79c7f-65cd-4570-8a96-e439f53d87d8 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:11.600580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69e79c7f-65cd-4570-8a96-e439f53d87d8 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:11.603153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69e79c7f-65cd-4570-8a96-e439f53d87d8 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:11.604812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69e79c7f-65cd-4570-8a96-e439f53d87d8 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:12.301202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1360eb4f-215c-4636-aa4e-cd115336e409 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:12.312981 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1360eb4f-215c-4636-aa4e-cd115336e409 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1266 microversion: 2.1 time: 0.805100 Aug 09 17:04:12.316934 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 115/207] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:11 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1266 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:12.328322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0565c30f-1bc6-4fdb-8041-d8e48234f083 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Calling method '.version_select at 0x7fbbd8a6fee0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:12.328861 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:12.328861 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:12.340573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0565c30f-1bc6-4fdb-8041-d8e48234f083 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:12.342217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0565c30f-1bc6-4fdb-8041-d8e48234f083 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:12.342930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0565c30f-1bc6-4fdb-8041-d8e48234f083 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:12.348634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-69e79c7f-65cd-4570-8a96-e439f53d87d8 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:12.374592 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69e79c7f-65cd-4570-8a96-e439f53d87d8 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1320 microversion: 2.1 time: 0.835249 Aug 09 17:04:12.391844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0565c30f-1bc6-4fdb-8041-d8e48234f083 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:12.391844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0565c30f-1bc6-4fdb-8041-d8e48234f083 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:12.393017 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 93/208] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:11 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1320 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:12.407664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0565c30f-1bc6-4fdb-8041-d8e48234f083 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:12.421968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ccfe9bb4-a3e8-4b60-8992-f8544588b3cc tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:12.428066 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:12.428066 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:12.453355 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ccfe9bb4-a3e8-4b60-8992-f8544588b3cc tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.057734 Aug 09 17:04:12.454769 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 94/209] 10.222.0.93 () {60 vars in 1190 bytes} [Tue Aug 9 17:04:12 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:04:12.475605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-936ec0aa-93bb-4349-84a5-39b6cd0db18a tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:12.478734 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:12.478734 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:12.496639 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0565c30f-1bc6-4fdb-8041-d8e48234f083 tempest-HostsAdminTestJSON-1899447526 tempest-HostsAdminTestJSON-1899447526-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-h1-845781-6" status: 200 len: 729 microversion: 2.1 time: 0.169932 Aug 09 17:04:12.498230 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 116/210] 10.222.0.93 () {58 vars in 1170 bytes} [Tue Aug 9 17:04:12 2022] GET /compute/v2.1/os-hosts/n-h1-845781-6 => generated 729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:12.512047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e331268-c38e-4d24-a8fb-fdd981593b84 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:12.512435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8e331268-c38e-4d24-a8fb-fdd981593b84 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:12.556955 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-936ec0aa-93bb-4349-84a5-39b6cd0db18a tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.085033 Aug 09 17:04:12.558982 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 95/211] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:12 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:12.569699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e331268-c38e-4d24-a8fb-fdd981593b84 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:12.570850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e331268-c38e-4d24-a8fb-fdd981593b84 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:12.571782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e331268-c38e-4d24-a8fb-fdd981593b84 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:12.583736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e331268-c38e-4d24-a8fb-fdd981593b84 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:12.584624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e331268-c38e-4d24-a8fb-fdd981593b84 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:12.585392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e331268-c38e-4d24-a8fb-fdd981593b84 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:12.613844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b51ac77-231b-4ea9-8bd2-adc160d3c80c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:12.619498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7b51ac77-231b-4ea9-8bd2-adc160d3c80c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:12.662534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b51ac77-231b-4ea9-8bd2-adc160d3c80c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:12.665221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b51ac77-231b-4ea9-8bd2-adc160d3c80c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:12.667461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b51ac77-231b-4ea9-8bd2-adc160d3c80c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:12.669534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b51ac77-231b-4ea9-8bd2-adc160d3c80c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:12.674314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b51ac77-231b-4ea9-8bd2-adc160d3c80c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:12.675584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b51ac77-231b-4ea9-8bd2-adc160d3c80c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:12.954770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:13.936117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8e331268-c38e-4d24-a8fb-fdd981593b84 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:13.970309 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e331268-c38e-4d24-a8fb-fdd981593b84 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1471 microversion: 2.1 time: 1.469729 Aug 09 17:04:13.980497 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 117/212] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:12 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1471 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:13.990387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9dd6091e-e761-4a65-866e-0e55270a0acd tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-845781-6"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:14.007953 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:14.007953 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:14.026166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7b51ac77-231b-4ea9-8bd2-adc160d3c80c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:14.039097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dd6091e-e761-4a65-866e-0e55270a0acd tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:14.053713 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b51ac77-231b-4ea9-8bd2-adc160d3c80c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1589 microversion: 2.1 time: 1.474941 Aug 09 17:04:14.055996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dd6091e-e761-4a65-866e-0e55270a0acd tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:14.057020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dd6091e-e761-4a65-866e-0e55270a0acd tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:14.058416 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 96/213] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:12 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1589 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:14.104939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f3e90c7-e6fd-450f-a8b6-159d749461f5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:14.114658 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:14.114658 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:14.134918 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-9f3e90c7-e6fd-450f-a8b6-159d749461f5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f3e90c7-e6fd-450f-a8b6-159d749461f5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Request method failure captured: Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNCZgHJpJ9hADZ8GlxAFygCsBUjSXd3A2S8bZSqM_pkxJE5Ksq8Y_4svA59Ezd8Kvb7qcnBhYeaEQoQu09Au36oxlLfM4J7ecOWCcWn3PBvIk_Flt9RL0n0DvKg-WSggq4XwQeKfKQoEZtjVKrG-h2gM-yzr7YIO2XTKhphzXeGCvs Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: f612f77cf9b04196b4359a293aa2ca93 Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:04:14.142944 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: f612f77cf9b04196b4359a293aa2ca93 Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AggregatesAdminTestJSON-1689243767-project-admin Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: bd43bd26607e44e3be55b1c3a2da123d Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AggregatesAdminTestJSON-1689243767-project-admin Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: exception: Aggregate 7 could not be found. Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '7'} Aug 09 17:04:14.144397 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:14.145192 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 09 17:04:14.146228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:14.152353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f3e90c7-e6fd-450f-a8b6-159d749461f5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:14.154115 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f3e90c7-e6fd-450f-a8b6-159d749461f5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.055871 Aug 09 17:04:14.158131 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 97/214] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:04:14 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:04:14.172415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4233105a-1422-4f9c-a4c6-fa0c030b6496 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:14.173453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4233105a-1422-4f9c-a4c6-fa0c030b6496 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:14.212139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4233105a-1422-4f9c-a4c6-fa0c030b6496 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:14.213028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4233105a-1422-4f9c-a4c6-fa0c030b6496 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:14.219326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4233105a-1422-4f9c-a4c6-fa0c030b6496 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:14.220764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4233105a-1422-4f9c-a4c6-fa0c030b6496 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:14.221642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4233105a-1422-4f9c-a4c6-fa0c030b6496 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:14.222416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4233105a-1422-4f9c-a4c6-fa0c030b6496 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:14.267665 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9dd6091e-e761-4a65-866e-0e55270a0acd tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 313 microversion: 2.41 time: 0.285034 Aug 09 17:04:14.278352 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 118/215] 10.222.0.93 () {62 vars in 1232 bytes} [Tue Aug 9 17:04:13 2022] POST /compute/v2.1/os-aggregates/6/action => generated 313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:04:14.284925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2a82789c-8c48-4e2d-8bc0-5baf442f0414 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:14.286070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2a82789c-8c48-4e2d-8bc0-5baf442f0414 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:14.296995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a82789c-8c48-4e2d-8bc0-5baf442f0414 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:14.298635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a82789c-8c48-4e2d-8bc0-5baf442f0414 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:14.299603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a82789c-8c48-4e2d-8bc0-5baf442f0414 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:14.300707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a82789c-8c48-4e2d-8bc0-5baf442f0414 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:14.301475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a82789c-8c48-4e2d-8bc0-5baf442f0414 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:14.302099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a82789c-8c48-4e2d-8bc0-5baf442f0414 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:14.454265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4233105a-1422-4f9c-a4c6-fa0c030b6496 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:14.471855 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4233105a-1422-4f9c-a4c6-fa0c030b6496 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1272 microversion: 2.1 time: 0.310531 Aug 09 17:04:14.474221 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 98/216] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:14 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:14.490229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c7a28603-d7db-49f2-a287-2f2631faa451 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:14.492266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c7a28603-d7db-49f2-a287-2f2631faa451 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:14.507951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7a28603-d7db-49f2-a287-2f2631faa451 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:14.509717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7a28603-d7db-49f2-a287-2f2631faa451 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:14.510825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7a28603-d7db-49f2-a287-2f2631faa451 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:14.512923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7a28603-d7db-49f2-a287-2f2631faa451 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:14.514576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7a28603-d7db-49f2-a287-2f2631faa451 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:14.515790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7a28603-d7db-49f2-a287-2f2631faa451 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:15.109804 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c7a28603-d7db-49f2-a287-2f2631faa451 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.632704 Aug 09 17:04:15.121981 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 99/217] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:04:14 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671/os-interface => generated 285 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:15.130172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25523002-d5f8-4221-a578-c5fae02c86c6 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:15.133213 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:15.133213 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:15.154916 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-25523002-d5f8-4221-a578-c5fae02c86c6 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25523002-d5f8-4221-a578-c5fae02c86c6 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Request method failure captured: Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNCZgHJpJ9hADZ8GlxAFygCsBUjSXd3A2S8bZSqM_pkxJE5Ksq8Y_4svA59Ezd8Kvb7qcnBhYeaEQoQu09Au36oxlLfM4J7ecOWCcWn3PBvIk_Flt9RL0n0DvKg-WSggq4XwQeKfKQoEZtjVKrG-h2gM-yzr7YIO2XTKhphzXeGCvs Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: f612f77cf9b04196b4359a293aa2ca93 Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:04:15.158468 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f612f77cf9b04196b4359a293aa2ca93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: f612f77cf9b04196b4359a293aa2ca93 Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1689243767 Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AggregatesAdminTestJSON-1689243767-project-admin Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: bd43bd26607e44e3be55b1c3a2da123d Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AggregatesAdminTestJSON-1689243767-project-admin Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: exception: Aggregate 7 could not be found. Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '7'} Aug 09 17:04:15.159742 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:04:15.160455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:15.161535 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:15.162792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:15.162792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:15.162792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:15.162792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 09 17:04:15.162792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:15.165684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25523002-d5f8-4221-a578-c5fae02c86c6 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:15.166592 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-25523002-d5f8-4221-a578-c5fae02c86c6 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.042918 Aug 09 17:04:15.167700 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 100/218] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:15 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:04:15.173664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-250544ee-93f3-4e26-a6ad-8ca6cfc81467 tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-845781-6"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:15.177634 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:15.177634 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:15.188698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-250544ee-93f3-4e26-a6ad-8ca6cfc81467 tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:15.189358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-250544ee-93f3-4e26-a6ad-8ca6cfc81467 tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:15.191699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-250544ee-93f3-4e26-a6ad-8ca6cfc81467 tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:15.303422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2a82789c-8c48-4e2d-8bc0-5baf442f0414 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:15.316483 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2a82789c-8c48-4e2d-8bc0-5baf442f0414 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1320 microversion: 2.1 time: 1.035613 Aug 09 17:04:15.317988 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 119/219] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:14 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1320 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:15.333801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-b1d88a51-62a9-4637-8262-73fb09600721 req-73c9689f-d615-45a6-aad5-b9ca65ba5a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a357d075-2b44-40d1-9ccd-8816ededc907", "name": "network-vif-plugged", "status": "completed", "tag": "3de121a0-09ed-476e-8f0e-cabce3982d4a"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:15.345947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b1d88a51-62a9-4637-8262-73fb09600721 req-73c9689f-d615-45a6-aad5-b9ca65ba5a36 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:15.346718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b1d88a51-62a9-4637-8262-73fb09600721 req-73c9689f-d615-45a6-aad5-b9ca65ba5a36 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:15.347789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b1d88a51-62a9-4637-8262-73fb09600721 req-73c9689f-d615-45a6-aad5-b9ca65ba5a36 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:15.364503 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-b1d88a51-62a9-4637-8262-73fb09600721 req-73c9689f-d615-45a6-aad5-b9ca65ba5a36 service nova] Creating event network-vif-plugged:3de121a0-09ed-476e-8f0e-cabce3982d4a for instance a357d075-2b44-40d1-9ccd-8816ededc907 on n-h1-845781-6 Aug 09 17:04:15.372136 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-b1d88a51-62a9-4637-8262-73fb09600721 req-73c9689f-d615-45a6-aad5-b9ca65ba5a36 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051756 Aug 09 17:04:15.373440 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 120/220] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:15.381632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ec2c238f-6546-4111-b064-7170df9dbb09 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:15.382846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ec2c238f-6546-4111-b064-7170df9dbb09 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:15.392481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec2c238f-6546-4111-b064-7170df9dbb09 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:15.393238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec2c238f-6546-4111-b064-7170df9dbb09 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:15.393923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec2c238f-6546-4111-b064-7170df9dbb09 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:15.394808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec2c238f-6546-4111-b064-7170df9dbb09 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:15.395436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec2c238f-6546-4111-b064-7170df9dbb09 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:15.396115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec2c238f-6546-4111-b064-7170df9dbb09 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:15.400230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:15.407410 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-250544ee-93f3-4e26-a6ad-8ca6cfc81467 tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.231941 Aug 09 17:04:15.420103 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 101/221] 10.222.0.93 () {62 vars in 1232 bytes} [Tue Aug 9 17:04:15 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:04:15.431457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94598f47-a363-4051-915a-5997c7b36cfe tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1033416371"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:15.444078 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:15.444078 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:15.447677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.aggregate [None req-94598f47-a363-4051-915a-5997c7b36cfe tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Generated uuid f64d4734-fe43-4feb-8437-9bda7ba8be7b for aggregate {{(pid=119431) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:15.505346 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94598f47-a363-4051-915a-5997c7b36cfe tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.090604 Aug 09 17:04:15.505346 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 102/222] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:15.514360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a5258922-5a97-44c0-a965-ee73377713ca tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:15.516886 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:15.516886 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:15.550712 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a5258922-5a97-44c0-a965-ee73377713ca tempest-AggregatesAdminTestV241-754180186 tempest-AggregatesAdminTestV241-754180186-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.043692 Aug 09 17:04:15.552468 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 103/223] 10.222.0.93 () {60 vars in 1193 bytes} [Tue Aug 9 17:04:15 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:15.557506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb8b8894-54c8-43bf-9f5b-2a76ffcc7d9c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:15.558935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eb8b8894-54c8-43bf-9f5b-2a76ffcc7d9c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:15.569985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb8b8894-54c8-43bf-9f5b-2a76ffcc7d9c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:15.570750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb8b8894-54c8-43bf-9f5b-2a76ffcc7d9c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:15.572168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb8b8894-54c8-43bf-9f5b-2a76ffcc7d9c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:15.573475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb8b8894-54c8-43bf-9f5b-2a76ffcc7d9c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:15.574142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb8b8894-54c8-43bf-9f5b-2a76ffcc7d9c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:15.574885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb8b8894-54c8-43bf-9f5b-2a76ffcc7d9c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:15.820719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eb8b8894-54c8-43bf-9f5b-2a76ffcc7d9c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:15.829352 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eb8b8894-54c8-43bf-9f5b-2a76ffcc7d9c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1272 microversion: 2.1 time: 0.275524 Aug 09 17:04:15.844287 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 104/224] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:15 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1272 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:15.850067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4cd2c8c4-905c-4b14-9603-55525ce93823 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:15.851082 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:15.851082 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:15.860247 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4cd2c8c4-905c-4b14-9603-55525ce93823 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.014610 Aug 09 17:04:15.861780 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 105/225] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:04:15 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:15.873139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29f0fb07-6e65-4a21-a053-40fc2fe424e7 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:15.876048 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:15.876048 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:15.916574 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-29f0fb07-6e65-4a21-a053-40fc2fe424e7 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.047749 Aug 09 17:04:15.917746 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 106/226] 10.222.0.93 () {60 vars in 1191 bytes} [Tue Aug 9 17:04:15 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:15.923120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ec2c238f-6546-4111-b064-7170df9dbb09 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:15.930743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-342b0bfb-c2a1-418c-a5b8-a03fab0cd8e5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:15.932128 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:15.932128 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:15.938489 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ec2c238f-6546-4111-b064-7170df9dbb09 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1471 microversion: 2.1 time: 0.563402 Aug 09 17:04:15.939100 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 121/227] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:15 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1471 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:15.943251 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-342b0bfb-c2a1-418c-a5b8-a03fab0cd8e5 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.017560 Aug 09 17:04:15.950748 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 107/228] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:04:15 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:15.967875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3acf72af-2cec-436c-a4bf-bb22ccfa6da0 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:15.971798 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:15.971798 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:16.042182 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3acf72af-2cec-436c-a4bf-bb22ccfa6da0 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.082880 Aug 09 17:04:16.057717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4311e7cc-5213-4dc2-b8cf-96af808b64b1 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1789983028", "availability_zone": "tempest-test_az-1459090210"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:16.063233 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:16.063233 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:16.064145 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 122/229] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:15 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:16.065016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.aggregate [None req-4311e7cc-5213-4dc2-b8cf-96af808b64b1 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Generated uuid f3d02a6b-15d3-4be8-a87b-b1dece072334 for aggregate {{(pid=119431) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:16.115981 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4311e7cc-5213-4dc2-b8cf-96af808b64b1 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.062349 Aug 09 17:04:16.125695 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 108/230] 10.222.0.93 () {60 vars in 1165 bytes} [Tue Aug 9 17:04:16 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:16.132584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7887ede0-9d27-42b0-8a22-d533f4c99199 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1789983028_new", "availability_zone": "tempest-test_az-1459090210_new"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:16.170048 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:16.170048 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:16.256120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7887ede0-9d27-42b0-8a22-d533f4c99199 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:16.257607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7887ede0-9d27-42b0-8a22-d533f4c99199 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:16.258660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7887ede0-9d27-42b0-8a22-d533f4c99199 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:16.341177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ced21539-63dd-4068-a099-33c8c74a35df tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:16.342251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ced21539-63dd-4068-a099-33c8c74a35df tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:16.380216 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7887ede0-9d27-42b0-8a22-d533f4c99199 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.254269 Aug 09 17:04:16.385071 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 123/231] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:04:16 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:16.388859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ced21539-63dd-4068-a099-33c8c74a35df tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:16.390609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ced21539-63dd-4068-a099-33c8c74a35df tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:16.391032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ced21539-63dd-4068-a099-33c8c74a35df tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:16.391843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ced21539-63dd-4068-a099-33c8c74a35df tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:16.392314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ced21539-63dd-4068-a099-33c8c74a35df tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:16.392751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ced21539-63dd-4068-a099-33c8c74a35df tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:16.409977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1af93521-96d0-4ffc-acfe-5fb02105761d tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:16.415857 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:16.415857 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:16.449620 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1af93521-96d0-4ffc-acfe-5fb02105761d tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.044925 Aug 09 17:04:16.451848 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 124/232] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:04:16 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:16.473723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4e99a7d8-bc4d-461e-9bf6-ecc3bff22175 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:16.487518 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:16.487518 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:16.557482 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4e99a7d8-bc4d-461e-9bf6-ecc3bff22175 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.085679 Aug 09 17:04:16.568493 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 125/233] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:16 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 09 17:04:16.589323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-38525634-91cb-4a3b-9d78-a6d957b18aa9 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1423955448"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:16.594221 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:16.594221 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:16.596291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.aggregate [None req-38525634-91cb-4a3b-9d78-a6d957b18aa9 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Generated uuid 6e09389c-c079-43b5-83c9-9c75466030a6 for aggregate {{(pid=119432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:16.650543 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-38525634-91cb-4a3b-9d78-a6d957b18aa9 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.080149 Aug 09 17:04:16.652051 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 126/234] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:16.676115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-37515e4f-6d2b-4705-9702-4b79b50233ce tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:16.678158 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:16.678158 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:16.692088 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-37515e4f-6d2b-4705-9702-4b79b50233ce tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.029059 Aug 09 17:04:16.693572 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 127/235] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:04:16 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:16.717054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a69ca0d-8a0c-445d-b43f-829fa6e114c6 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:16.719090 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:16.719090 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:16.757777 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a69ca0d-8a0c-445d-b43f-829fa6e114c6 tempest-AggregatesAdminTestJSON-1689243767 tempest-AggregatesAdminTestJSON-1689243767-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.044660 Aug 09 17:04:16.770884 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 128/236] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:16 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:16.814912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:16.819743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:16.835326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:16.836526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:16.839446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:16.839446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:16.840055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:16.841047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:16.882834 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] HTTP exception thrown: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Request method failure captured: Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 HTTP/1.1 Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pM-CR09eNW_Ue5Y-E4jreA1RYdDb0JgMZDc-8JsT6ws-HM2H_8QsqwlKyhOuCqYPChqm46a3pS0xAi7YOCNB_hKbNY0-yecfwLZ31m9mEsnNmRHeMyhUJP7eZ2yL98S1bGMY8XNxDLG2HM6hsQuOSjDfDexugSFuvT6jZC6-kPKjXc Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 6f475204b1644570bc2bc148e895a171 Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AggregatesAdminTestJSON-1581743881 Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:04:16.886802 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6f475204b1644570bc2bc148e895a171"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f475204b1644570bc2bc148e895a171"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f475204b1644570bc2bc148e895a171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6f475204b1644570bc2bc148e895a171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AggregatesAdminTestJSON-1581743881 Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 6f475204b1644570bc2bc148e895a171 Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1581743881 Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AggregatesAdminTestJSON-1581743881-project Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: ac04975ebf9041c2a34e252d3f39a32f Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AggregatesAdminTestJSON-1581743881-project Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:04:16.889212 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0'} Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:16.890530 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:04:16.895692 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:16.899777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Returning 404 to user: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:16.899777 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5faefd3c-436f-4882-8954-4f8a01aaf76b tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 404 len: 111 microversion: 2.1 time: 0.112872 Aug 09 17:04:16.899777 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 129/237] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:04:16 2022] DELETE /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:16.906654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-519d8623-2a63-4047-b38f-731b65874bab tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:16.908249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-519d8623-2a63-4047-b38f-731b65874bab tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:16.919600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-519d8623-2a63-4047-b38f-731b65874bab tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:16.920499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-519d8623-2a63-4047-b38f-731b65874bab tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:16.922172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-519d8623-2a63-4047-b38f-731b65874bab tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:16.924314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-519d8623-2a63-4047-b38f-731b65874bab tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:16.925432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-519d8623-2a63-4047-b38f-731b65874bab tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:16.926170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-519d8623-2a63-4047-b38f-731b65874bab tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:17.111240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ced21539-63dd-4068-a099-33c8c74a35df tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:17.125453 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ced21539-63dd-4068-a099-33c8c74a35df tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1320 microversion: 2.1 time: 0.789947 Aug 09 17:04:17.128621 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 109/238] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:16 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1320 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:17.138166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:17.140502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] [instance: 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:17.173953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:17.175325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:17.176795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:17.178846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:17.182440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:17.183577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:17.222252 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] HTTP exception thrown: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Request method failure captured: Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 HTTP/1.1 Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pM-CR09eNW_Ue5Y-E4jreA1RYdDb0JgMZDc-8JsT6ws-HM2H_8QsqwlKyhOuCqYPChqm46a3pS0xAi7YOCNB_hKbNY0-yecfwLZ31m9mEsnNmRHeMyhUJP7eZ2yL98S1bGMY8XNxDLG2HM6hsQuOSjDfDexugSFuvT6jZC6-kPKjXc Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 6f475204b1644570bc2bc148e895a171 Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AggregatesAdminTestJSON-1581743881 Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:04:17.225752 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6f475204b1644570bc2bc148e895a171"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f475204b1644570bc2bc148e895a171"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f475204b1644570bc2bc148e895a171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6f475204b1644570bc2bc148e895a171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AggregatesAdminTestJSON-1581743881 Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 6f475204b1644570bc2bc148e895a171 Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1581743881 Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AggregatesAdminTestJSON-1581743881-project Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ac04975ebf9041c2a34e252d3f39a32f Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AggregatesAdminTestJSON-1581743881-project Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:04:17.228424 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0'} Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:17.229873 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. Aug 09 17:04:17.234808 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:17.240903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] Returning 404 to user: Instance 5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:17.243243 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eedd2b00-c54a-45e7-89d7-5fe483770ad8 tempest-AggregatesAdminTestJSON-1581743881 tempest-AggregatesAdminTestJSON-1581743881-project] 10.222.0.93 "GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0" status: 404 len: 111 microversion: 2.1 time: 0.112215 Aug 09 17:04:17.245610 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 110/239] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:17 2022] GET /compute/v2.1/servers/5a57d0fc-e448-4a6a-bfda-6cbc0f6b48b0 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:17.260190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c90adda1-b65d-437c-b27b-42f6af4f3c3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:17.264086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c90adda1-b65d-437c-b27b-42f6af4f3c3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:17.285882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90adda1-b65d-437c-b27b-42f6af4f3c3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:17.297089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90adda1-b65d-437c-b27b-42f6af4f3c3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:17.298395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90adda1-b65d-437c-b27b-42f6af4f3c3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:17.300612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90adda1-b65d-437c-b27b-42f6af4f3c3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:17.301879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90adda1-b65d-437c-b27b-42f6af4f3c3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:17.302110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90adda1-b65d-437c-b27b-42f6af4f3c3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:17.802976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-519d8623-2a63-4047-b38f-731b65874bab tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:17.840044 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-519d8623-2a63-4047-b38f-731b65874bab tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1314 microversion: 2.1 time: 0.939981 Aug 09 17:04:17.841271 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 130/240] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:16 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1314 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:17.921430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5a6f2964-4ba2-40e6-8a71-e0b932bbb3f3 req-394cac51-3c3a-4d7d-bf6f-df24ad8adea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cce37568-9dbf-4f84-875d-0bfda5961abc", "tag": "cdac773e-042b-445a-b50f-a65814f73dae"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:17.981048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5a6f2964-4ba2-40e6-8a71-e0b932bbb3f3 req-394cac51-3c3a-4d7d-bf6f-df24ad8adea9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:17.982325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5a6f2964-4ba2-40e6-8a71-e0b932bbb3f3 req-394cac51-3c3a-4d7d-bf6f-df24ad8adea9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:17.983374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5a6f2964-4ba2-40e6-8a71-e0b932bbb3f3 req-394cac51-3c3a-4d7d-bf6f-df24ad8adea9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:18.019863 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5a6f2964-4ba2-40e6-8a71-e0b932bbb3f3 req-394cac51-3c3a-4d7d-bf6f-df24ad8adea9 service nova] Creating event network-changed:cdac773e-042b-445a-b50f-a65814f73dae for instance cce37568-9dbf-4f84-875d-0bfda5961abc on n-h2-845781-6 Aug 09 17:04:18.032775 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5a6f2964-4ba2-40e6-8a71-e0b932bbb3f3 req-394cac51-3c3a-4d7d-bf6f-df24ad8adea9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119108 Aug 09 17:04:18.034594 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 131/241] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:18.176836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5c3adea7-17bc-4e36-8927-45232e2bb174 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:18.184401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5c3adea7-17bc-4e36-8927-45232e2bb174 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:18.207001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c3adea7-17bc-4e36-8927-45232e2bb174 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:18.208648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c3adea7-17bc-4e36-8927-45232e2bb174 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:18.209745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c3adea7-17bc-4e36-8927-45232e2bb174 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:18.212812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c3adea7-17bc-4e36-8927-45232e2bb174 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:18.214152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c3adea7-17bc-4e36-8927-45232e2bb174 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:18.215161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c3adea7-17bc-4e36-8927-45232e2bb174 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:18.409719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c90adda1-b65d-437c-b27b-42f6af4f3c3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:18.440284 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c90adda1-b65d-437c-b27b-42f6af4f3c3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 1.184964 Aug 09 17:04:18.469585 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 111/242] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:17 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:18.834398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5c3adea7-17bc-4e36-8927-45232e2bb174 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:18.878193 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5c3adea7-17bc-4e36-8927-45232e2bb174 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1470 microversion: 2.1 time: 0.708492 Aug 09 17:04:18.883078 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 132/243] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:18 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1470 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:18.892111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ed826e9e-00e0-46dd-8a85-aec5f716150b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:18.899259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ed826e9e-00e0-46dd-8a85-aec5f716150b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:18.922107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed826e9e-00e0-46dd-8a85-aec5f716150b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:18.924206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed826e9e-00e0-46dd-8a85-aec5f716150b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:18.925665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed826e9e-00e0-46dd-8a85-aec5f716150b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:18.925854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-667b1588-5cf9-4aef-b09e-115dc025b67f tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:18.928652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed826e9e-00e0-46dd-8a85-aec5f716150b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:18.930638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed826e9e-00e0-46dd-8a85-aec5f716150b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:18.931801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed826e9e-00e0-46dd-8a85-aec5f716150b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:18.932242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-667b1588-5cf9-4aef-b09e-115dc025b67f tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:18.951574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-667b1588-5cf9-4aef-b09e-115dc025b67f tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:18.952936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-667b1588-5cf9-4aef-b09e-115dc025b67f tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:18.953793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-667b1588-5cf9-4aef-b09e-115dc025b67f tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:18.959747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-667b1588-5cf9-4aef-b09e-115dc025b67f tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:18.960704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-667b1588-5cf9-4aef-b09e-115dc025b67f tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:18.961541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-667b1588-5cf9-4aef-b09e-115dc025b67f tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:19.385133 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-667b1588-5cf9-4aef-b09e-115dc025b67f tempest-DeleteServersAdminTestJSON-1064744545 tempest-DeleteServersAdminTestJSON-1064744545-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907/action" status: 202 len: 0 microversion: 2.1 time: 0.468587 Aug 09 17:04:19.387026 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 133/244] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:04:18 2022] POST /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:04:19.401454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:19.402693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:19.407011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:19.417004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:19.420206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:19.421659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:19.424268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:19.426796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:19.427811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:19.525714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:19.530143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:19.532123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:19.533300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lazy-loading 'fault' on Instance uuid a357d075-2b44-40d1-9ccd-8816ededc907 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:04:19.542176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:19.897011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ed826e9e-00e0-46dd-8a85-aec5f716150b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:19.931978 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ed826e9e-00e0-46dd-8a85-aec5f716150b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1314 microversion: 2.1 time: 1.057913 Aug 09 17:04:19.968747 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 112/245] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:18 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1314 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:19.988129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-857b1b81-c8bd-451e-a38a-0d43be06f2cc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:19.989243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-857b1b81-c8bd-451e-a38a-0d43be06f2cc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:20.009262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857b1b81-c8bd-451e-a38a-0d43be06f2cc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:20.010035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857b1b81-c8bd-451e-a38a-0d43be06f2cc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:20.010879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857b1b81-c8bd-451e-a38a-0d43be06f2cc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:20.013825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857b1b81-c8bd-451e-a38a-0d43be06f2cc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:20.014367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857b1b81-c8bd-451e-a38a-0d43be06f2cc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:20.015046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857b1b81-c8bd-451e-a38a-0d43be06f2cc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:20.074532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=16 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:20.094054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:20.114218 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-198fb08c-96e1-43eb-8559-7530ccc62fb0 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1453 microversion: 2.1 time: 0.716041 Aug 09 17:04:20.116546 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 134/246] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:19 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1453 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:20.131095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-753a70fa-a349-40e0-89b5-52392e902caf req-ddba3b02-401d-4af1-9233-c9aa39c811ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3698be9-74c8-41a8-b6d8-3f3f1bfe4639", "tag": "b3e870ac-821c-49c8-a2b5-e30130f4fbf6"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:20.165040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-753a70fa-a349-40e0-89b5-52392e902caf req-ddba3b02-401d-4af1-9233-c9aa39c811ee service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:20.170542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-753a70fa-a349-40e0-89b5-52392e902caf req-ddba3b02-401d-4af1-9233-c9aa39c811ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:20.170542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-753a70fa-a349-40e0-89b5-52392e902caf req-ddba3b02-401d-4af1-9233-c9aa39c811ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:20.208310 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-753a70fa-a349-40e0-89b5-52392e902caf req-ddba3b02-401d-4af1-9233-c9aa39c811ee service nova] Creating event network-changed:b3e870ac-821c-49c8-a2b5-e30130f4fbf6 for instance d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 on n-h1-845781-6 Aug 09 17:04:20.231332 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-753a70fa-a349-40e0-89b5-52392e902caf req-ddba3b02-401d-4af1-9233-c9aa39c811ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112803 Aug 09 17:04:20.239033 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 135/247] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:20.263115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-73e068c2-cab3-471e-bd90-eefdf2ab0f39 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:20.264002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-73e068c2-cab3-471e-bd90-eefdf2ab0f39 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:20.277993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73e068c2-cab3-471e-bd90-eefdf2ab0f39 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:20.279298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73e068c2-cab3-471e-bd90-eefdf2ab0f39 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:20.279298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73e068c2-cab3-471e-bd90-eefdf2ab0f39 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:20.279705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73e068c2-cab3-471e-bd90-eefdf2ab0f39 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:20.281048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73e068c2-cab3-471e-bd90-eefdf2ab0f39 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:20.284360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73e068c2-cab3-471e-bd90-eefdf2ab0f39 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:20.449302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-73e068c2-cab3-471e-bd90-eefdf2ab0f39 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:04:20.606187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-857b1b81-c8bd-451e-a38a-0d43be06f2cc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:20.615332 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-73e068c2-cab3-471e-bd90-eefdf2ab0f39 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 204 len: 0 microversion: 2.1 time: 0.362703 Aug 09 17:04:20.620358 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-857b1b81-c8bd-451e-a38a-0d43be06f2cc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.648401 Aug 09 17:04:20.620931 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 136/248] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:04:20 2022] DELETE /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:04:20.624396 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 113/249] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:19 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:20.638644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a23fc507-4d58-4138-8fcc-0d923b9a8606 req-1d75739a-8c43-4c28-af04-5650cbccedb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1ebe1f-c944-4f78-84df-43776f1eb671", "tag": "a813e9bf-51e2-4577-9543-ad1edc45394e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:20.644567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-77198cf2-a371-48d5-8e83-d115d52b5918 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:20.645517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-77198cf2-a371-48d5-8e83-d115d52b5918 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:20.653245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77198cf2-a371-48d5-8e83-d115d52b5918 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:20.654023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77198cf2-a371-48d5-8e83-d115d52b5918 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:20.654713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77198cf2-a371-48d5-8e83-d115d52b5918 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:20.656356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77198cf2-a371-48d5-8e83-d115d52b5918 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:20.657347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77198cf2-a371-48d5-8e83-d115d52b5918 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:20.657949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77198cf2-a371-48d5-8e83-d115d52b5918 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:20.665107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a23fc507-4d58-4138-8fcc-0d923b9a8606 req-1d75739a-8c43-4c28-af04-5650cbccedb0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:20.667599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a23fc507-4d58-4138-8fcc-0d923b9a8606 req-1d75739a-8c43-4c28-af04-5650cbccedb0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:20.670346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a23fc507-4d58-4138-8fcc-0d923b9a8606 req-1d75739a-8c43-4c28-af04-5650cbccedb0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:20.699674 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a23fc507-4d58-4138-8fcc-0d923b9a8606 req-1d75739a-8c43-4c28-af04-5650cbccedb0 service nova] Creating event network-changed:a813e9bf-51e2-4577-9543-ad1edc45394e for instance cb1ebe1f-c944-4f78-84df-43776f1eb671 on n-h2-845781-6 Aug 09 17:04:20.713114 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a23fc507-4d58-4138-8fcc-0d923b9a8606 req-1d75739a-8c43-4c28-af04-5650cbccedb0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083712 Aug 09 17:04:20.716111 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 114/250] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:20.735885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:20.738254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:20.785749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:20.792599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:20.794453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:20.796930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:20.806317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:20.811262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:20.841359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:20.927714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:20.928249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:20.928819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:20.929313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lazy-loading 'fault' on Instance uuid a357d075-2b44-40d1-9ccd-8816ededc907 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:04:21.208595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-77198cf2-a371-48d5-8e83-d115d52b5918 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:21.224122 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-77198cf2-a371-48d5-8e83-d115d52b5918 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 200 len: 1589 microversion: 2.1 time: 0.601361 Aug 09 17:04:21.224738 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 137/251] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:20 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 1589 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:21.239745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b37e407c-cca5-49c6-98e8-ef211f25747b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:21.240635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b37e407c-cca5-49c6-98e8-ef211f25747b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:21.257309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b37e407c-cca5-49c6-98e8-ef211f25747b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:21.258091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b37e407c-cca5-49c6-98e8-ef211f25747b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:21.258709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b37e407c-cca5-49c6-98e8-ef211f25747b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:21.259854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b37e407c-cca5-49c6-98e8-ef211f25747b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:21.260614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b37e407c-cca5-49c6-98e8-ef211f25747b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:21.261256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b37e407c-cca5-49c6-98e8-ef211f25747b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:21.931952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b37e407c-cca5-49c6-98e8-ef211f25747b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:21.966341 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b37e407c-cca5-49c6-98e8-ef211f25747b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1314 microversion: 2.1 time: 0.733393 Aug 09 17:04:21.968079 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 138/252] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:21 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:21.980177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ae9fbe61-9592-46f7-b380-42537e623c2f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:21.994617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ae9fbe61-9592-46f7-b380-42537e623c2f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:22.007620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:22.016665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:22.018391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae9fbe61-9592-46f7-b380-42537e623c2f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:22.021131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae9fbe61-9592-46f7-b380-42537e623c2f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:22.024261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae9fbe61-9592-46f7-b380-42537e623c2f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:22.025070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae9fbe61-9592-46f7-b380-42537e623c2f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:22.029472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae9fbe61-9592-46f7-b380-42537e623c2f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:22.034906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae9fbe61-9592-46f7-b380-42537e623c2f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:22.066327 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b86fcc6-8630-4a04-939a-c42d96f2ff3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1459 microversion: 2.1 time: 1.341026 Aug 09 17:04:22.066956 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 115/253] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:20 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1459 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:22.681139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ae9fbe61-9592-46f7-b380-42537e623c2f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:22.697166 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ae9fbe61-9592-46f7-b380-42537e623c2f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.727096 Aug 09 17:04:22.721896 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 139/254] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:21 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:22.992790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1bf138f9-c100-4bd1-b8b6-da4f22e56e00 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:22.993540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1bf138f9-c100-4bd1-b8b6-da4f22e56e00 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:23.006532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf138f9-c100-4bd1-b8b6-da4f22e56e00 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:23.012968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf138f9-c100-4bd1-b8b6-da4f22e56e00 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:23.013643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf138f9-c100-4bd1-b8b6-da4f22e56e00 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:23.015580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf138f9-c100-4bd1-b8b6-da4f22e56e00 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:23.022634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf138f9-c100-4bd1-b8b6-da4f22e56e00 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:23.023722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf138f9-c100-4bd1-b8b6-da4f22e56e00 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:23.142753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:23.144472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:23.152672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:23.153744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:23.153845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:23.154754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:23.155533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:23.156158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:23.220070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:23.220584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:23.223618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:23.224440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lazy-loading 'fault' on Instance uuid a357d075-2b44-40d1-9ccd-8816ededc907 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:04:23.606229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:23.616815 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-741b20a4-c32a-4405-a9a0-9e77bd998d3a tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1459 microversion: 2.1 time: 0.513534 Aug 09 17:04:23.619285 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 140/255] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:23 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1459 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:24.086585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87a32799-2972-4a01-b03c-6a37ee8f79a5 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Calling method '.version_select at 0x7fbbd81de040>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:24.093072 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:24.093072 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:24.095385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-87a32799-2972-4a01-b03c-6a37ee8f79a5 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '503e9da159f6409b9e67ca54e45b22c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d6d35d211c447da9d63efaaa0c7460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87a32799-2972-4a01-b03c-6a37ee8f79a5 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Request method failure captured: Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOVKgMqcfORQO6p54Rs5x0Gfq1jqemakA8pyWJ82xN5ZBi5UoHZzevbCA2hJaed_WGrXE3zR58GfOtKRwtAI17XjByz20fqEo-wd8s5GqFcZRJ_5QSIyJlX-snwf1WS_kT5xOlEgE-i7beVROtrUIySyazkOA2wDlvnexnFcvQ7GOU Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: d2d6d35d211c447da9d63efaaa0c7460 Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:04:24.108845 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: d2d6d35d211c447da9d63efaaa0c7460 Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-HypervisorAdminNegativeTestJSON-1425865555-project Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 503e9da159f6409b9e67ca54e45b22c0 Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555-project Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: action_args: {} Aug 09 17:04:24.111309 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:24.112739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 09 17:04:24.114675 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:24.124894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87a32799-2972-4a01-b03c-6a37ee8f79a5 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:24.126291 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-87a32799-2972-4a01-b03c-6a37ee8f79a5 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.456336 Aug 09 17:04:24.127445 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 141/256] 10.222.0.93 () {58 vars in 1167 bytes} [Tue Aug 9 17:04:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 458 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:24.145310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e88a09a-dbe0-4898-95ab-63adbac7c00f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:24.145954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0e88a09a-dbe0-4898-95ab-63adbac7c00f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:24.167011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e88a09a-dbe0-4898-95ab-63adbac7c00f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:24.169475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e88a09a-dbe0-4898-95ab-63adbac7c00f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:24.171224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e88a09a-dbe0-4898-95ab-63adbac7c00f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:24.172027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e88a09a-dbe0-4898-95ab-63adbac7c00f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:24.172510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e88a09a-dbe0-4898-95ab-63adbac7c00f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:24.173238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e88a09a-dbe0-4898-95ab-63adbac7c00f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:24.342093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1bf138f9-c100-4bd1-b8b6-da4f22e56e00 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:24.365075 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1bf138f9-c100-4bd1-b8b6-da4f22e56e00 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1314 microversion: 2.1 time: 1.376309 Aug 09 17:04:24.366465 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 116/257] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:22 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1314 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:24.377842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea9ab2b6-bafe-4a70-be98-270470708c24 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Calling method '.version_select at 0x7fbbcbf59c10>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:24.381266 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:24.381266 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:24.384822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ea9ab2b6-bafe-4a70-be98-270470708c24 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '503e9da159f6409b9e67ca54e45b22c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d6d35d211c447da9d63efaaa0c7460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea9ab2b6-bafe-4a70-be98-270470708c24 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Request method failure captured: Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOVKgMqcfORQO6p54Rs5x0Gfq1jqemakA8pyWJ82xN5ZBi5UoHZzevbCA2hJaed_WGrXE3zR58GfOtKRwtAI17XjByz20fqEo-wd8s5GqFcZRJ_5QSIyJlX-snwf1WS_kT5xOlEgE-i7beVROtrUIySyazkOA2wDlvnexnFcvQ7GOU Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: d2d6d35d211c447da9d63efaaa0c7460 Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:04:24.388989 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: d2d6d35d211c447da9d63efaaa0c7460 Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HypervisorAdminNegativeTestJSON-1425865555-project Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 503e9da159f6409b9e67ca54e45b22c0 Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555-project Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: action_args: {} Aug 09 17:04:24.391917 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:24.394543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 09 17:04:24.399217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:24.406007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0e88a09a-dbe0-4898-95ab-63adbac7c00f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:24.407619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea9ab2b6-bafe-4a70-be98-270470708c24 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:24.410513 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e88a09a-dbe0-4898-95ab-63adbac7c00f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.281672 Aug 09 17:04:24.410942 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ea9ab2b6-bafe-4a70-be98-270470708c24 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.041305 Aug 09 17:04:24.423916 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 142/258] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:24 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:24.424034 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 117/259] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:24 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:24.437260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ff91ac7-055b-4fdb-84f9-44f5d8409de5 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Calling method '.version_select at 0x7fbbd80fbaf0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:24.438638 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:24.438638 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:24.442318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ff91ac7-055b-4fdb-84f9-44f5d8409de5 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '503e9da159f6409b9e67ca54e45b22c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d6d35d211c447da9d63efaaa0c7460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ff91ac7-055b-4fdb-84f9-44f5d8409de5 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Request method failure captured: Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOVKgMqcfORQO6p54Rs5x0Gfq1jqemakA8pyWJ82xN5ZBi5UoHZzevbCA2hJaed_WGrXE3zR58GfOtKRwtAI17XjByz20fqEo-wd8s5GqFcZRJ_5QSIyJlX-snwf1WS_kT5xOlEgE-i7beVROtrUIySyazkOA2wDlvnexnFcvQ7GOU Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: d2d6d35d211c447da9d63efaaa0c7460 Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:04:24.445952 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: d2d6d35d211c447da9d63efaaa0c7460 Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-HypervisorAdminNegativeTestJSON-1425865555-project Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 503e9da159f6409b9e67ca54e45b22c0 Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555-project Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: action_args: {} Aug 09 17:04:24.447325 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:24.448168 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 09 17:04:24.449284 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:24.452976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ff91ac7-055b-4fdb-84f9-44f5d8409de5 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:24.463551 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4ff91ac7-055b-4fdb-84f9-44f5d8409de5 tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.022965 Aug 09 17:04:24.469060 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 143/260] 10.222.0.93 () {58 vars in 1179 bytes} [Tue Aug 9 17:04:24 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:24.654173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:24.655301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:24.673163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:24.673967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:24.674586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:24.675721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:24.676382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:24.676984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:24.719473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:24.758830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:24.759577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:24.761145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:24.766221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lazy-loading 'fault' on Instance uuid a357d075-2b44-40d1-9ccd-8816ededc907 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:04:24.796667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-73e81dc8-7761-49e5-903a-5be4ee734f2a tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Calling method '.version_select at 0x7fbbd806cdc0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:24.799899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73e81dc8-7761-49e5-903a-5be4ee734f2a tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:24.807667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73e81dc8-7761-49e5-903a-5be4ee734f2a tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:24.808196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73e81dc8-7761-49e5-903a-5be4ee734f2a tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:24.863084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73e81dc8-7761-49e5-903a-5be4ee734f2a tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:24.865502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73e81dc8-7761-49e5-903a-5be4ee734f2a tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:24.869056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73e81dc8-7761-49e5-903a-5be4ee734f2a tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:24.906541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73e81dc8-7761-49e5-903a-5be4ee734f2a tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:24.908400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73e81dc8-7761-49e5-903a-5be4ee734f2a tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:24.910108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73e81dc8-7761-49e5-903a-5be4ee734f2a tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:24.932069 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-73e81dc8-7761-49e5-903a-5be4ee734f2a tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.455502 Aug 09 17:04:24.943710 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 118/261] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:24.980115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8226c099-ed5f-4c82-a208-109a5a50740b tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Calling method '.version_select at 0x7fbbd806c430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:24.987183 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:24.987183 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:24.991541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8226c099-ed5f-4c82-a208-109a5a50740b tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '503e9da159f6409b9e67ca54e45b22c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d6d35d211c447da9d63efaaa0c7460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8226c099-ed5f-4c82-a208-109a5a50740b tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Request method failure captured: Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOVKgMqcfORQO6p54Rs5x0Gfq1jqemakA8pyWJ82xN5ZBi5UoHZzevbCA2hJaed_WGrXE3zR58GfOtKRwtAI17XjByz20fqEo-wd8s5GqFcZRJ_5QSIyJlX-snwf1WS_kT5xOlEgE-i7beVROtrUIySyazkOA2wDlvnexnFcvQ7GOU Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: d2d6d35d211c447da9d63efaaa0c7460 Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:04:25.009678 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: d2d6d35d211c447da9d63efaaa0c7460 Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HypervisorAdminNegativeTestJSON-1425865555-project Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 503e9da159f6409b9e67ca54e45b22c0 Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555-project Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1'} Aug 09 17:04:25.010875 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:25.011591 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 09 17:04:25.012663 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.013656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8226c099-ed5f-4c82-a208-109a5a50740b tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:25.018145 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8226c099-ed5f-4c82-a208-109a5a50740b tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.062497 Aug 09 17:04:25.023439 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 119/262] 10.222.0.93 () {58 vars in 1173 bytes} [Tue Aug 9 17:04:24 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 73 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:25.051481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4716ee73-0fcf-4012-9902-82bf55f30f22 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Calling method '.version_select at 0x7fbbcbfbab80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:25.056505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:25.058314 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-4716ee73-0fcf-4012-9902-82bf55f30f22 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] HTTP exception thrown: Hypervisor with ID '7e77ca27-98ff-4844-8fd4-0e3b7dabeb0b' could not be found. Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4716ee73-0fcf-4012-9902-82bf55f30f22 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Request method failure captured: Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hypervisors/7e77ca27-98ff-4844-8fd4-0e3b7dabeb0b/uptime HTTP/1.1 Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOX1vw-ekMNK8yvYvOr28Bu5o6WZw96sa-Q8ZdfbGcH4kRTutXGB7r8GFOVlKJuvaQlOLh481LUXsCsRMPJmg7bsC_wnkb9pHFgTEGVF6qYaQBD8n0CZcUdVinK8BPujE3s56_NG3uHjbHUiq-EXjRtifJnabs3pkr_OXQT63mEmto Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 452282ac50064782aff16c202f6b3da6 Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756313288 Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:04:25.071361 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_452282ac50064782aff16c202f6b3da6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/452282ac50064782aff16c202f6b3da6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/452282ac50064782aff16c202f6b3da6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/452282ac50064782aff16c202f6b3da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756313288 Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 452282ac50064782aff16c202f6b3da6 Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756313288 Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a91931851e7a48689c5625730cdc54b5 Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: exception: Hypervisor with ID '7e77ca27-98ff-4844-8fd4-0e3b7dabeb0b' could not be found. Aug 09 17:04:25.073876 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '7e77ca27-98ff-4844-8fd4-0e3b7dabeb0b'} Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7e77ca27-98ff-4844-8fd4-0e3b7dabeb0b' Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 09 17:04:25.075195 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7e77ca27-98ff-4844-8fd4-0e3b7dabeb0b' could not be found. Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:25.077505 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.080890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.080890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:25.080890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:25.080890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:25.080890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:25.080890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7e77ca27-98ff-4844-8fd4-0e3b7dabeb0b' could not be found. Aug 09 17:04:25.080890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.080890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4716ee73-0fcf-4012-9902-82bf55f30f22 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Returning 404 to user: Hypervisor with ID '7e77ca27-98ff-4844-8fd4-0e3b7dabeb0b' could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:25.080890 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4716ee73-0fcf-4012-9902-82bf55f30f22 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/7e77ca27-98ff-4844-8fd4-0e3b7dabeb0b/uptime" status: 404 len: 123 microversion: 2.1 time: 0.044789 Aug 09 17:04:25.085681 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 120/263] 10.222.0.93 () {58 vars in 1278 bytes} [Tue Aug 9 17:04:25 2022] GET /compute/v2.1/os-hypervisors/7e77ca27-98ff-4844-8fd4-0e3b7dabeb0b/uptime => generated 123 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:25.097628 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-41f363c3-8d3d-4c90-9e4e-cf58470cf770 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1459 microversion: 2.1 time: 0.444265 Aug 09 17:04:25.101374 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 144/264] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:24 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1459 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:04:25.119911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4c5b9eae-a5f1-49df-a7ff-ed67ad36c6e8 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Calling method '.version_select at 0x7fbbcbfbab80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:25.119911 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:25.119911 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:25.121864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c5b9eae-a5f1-49df-a7ff-ed67ad36c6e8 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:25.122681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c5b9eae-a5f1-49df-a7ff-ed67ad36c6e8 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:25.134398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c5b9eae-a5f1-49df-a7ff-ed67ad36c6e8 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:25.206948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c5b9eae-a5f1-49df-a7ff-ed67ad36c6e8 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:25.208512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c5b9eae-a5f1-49df-a7ff-ed67ad36c6e8 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:25.209100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c5b9eae-a5f1-49df-a7ff-ed67ad36c6e8 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:25.244516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c5b9eae-a5f1-49df-a7ff-ed67ad36c6e8 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:25.246562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c5b9eae-a5f1-49df-a7ff-ed67ad36c6e8 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:25.248243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c5b9eae-a5f1-49df-a7ff-ed67ad36c6e8 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:25.270778 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4c5b9eae-a5f1-49df-a7ff-ed67ad36c6e8 tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.182599 Aug 09 17:04:25.279134 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 121/265] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:25.284452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-07a02286-5a47-4ab4-bebe-7e63d904664e req-4d3cee52-1ea8-41a7-9630-a086bce8fb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce37568-9dbf-4f84-875d-0bfda5961abc", "name": "network-vif-plugged", "status": "completed", "tag": "cdac773e-042b-445a-b50f-a65814f73dae"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:25.288365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6be70980-1001-47e0-b3af-23a15c08d17c tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Calling method '.version_select at 0x7fbbcbf59700>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:25.290635 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:25.290635 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:25.293830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6be70980-1001-47e0-b3af-23a15c08d17c tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '503e9da159f6409b9e67ca54e45b22c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d6d35d211c447da9d63efaaa0c7460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6be70980-1001-47e0-b3af-23a15c08d17c tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Request method failure captured: Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOVKgMqcfORQO6p54Rs5x0Gfq1jqemakA8pyWJ82xN5ZBi5UoHZzevbCA2hJaed_WGrXE3zR58GfOtKRwtAI17XjByz20fqEo-wd8s5GqFcZRJ_5QSIyJlX-snwf1WS_kT5xOlEgE-i7beVROtrUIySyazkOA2wDlvnexnFcvQ7GOU Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: d2d6d35d211c447da9d63efaaa0c7460 Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:04:25.303084 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d2d6d35d211c447da9d63efaaa0c7460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: d2d6d35d211c447da9d63efaaa0c7460 Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555 Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HypervisorAdminNegativeTestJSON-1425865555-project Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 503e9da159f6409b9e67ca54e45b22c0 Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1425865555-project Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1'} Aug 09 17:04:25.305483 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:25.306849 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 09 17:04:25.309160 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.311191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6be70980-1001-47e0-b3af-23a15c08d17c tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:25.311191 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6be70980-1001-47e0-b3af-23a15c08d17c tempest-HypervisorAdminNegativeTestJSON-1425865555 tempest-HypervisorAdminNegativeTestJSON-1425865555-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.024365 Aug 09 17:04:25.315661 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 122/266] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:25 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:25.322796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d9f6a6f9-00d2-448c-a2c2-d6f8356b7b3b tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Calling method '.version_select at 0x7fbbd806cd30>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:25.329755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d9f6a6f9-00d2-448c-a2c2-d6f8356b7b3b tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] HTTP exception thrown: Hypervisor with ID '7eea80a1-f88d-425c-a9b1-b4dad7493777' could not be found. Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d9f6a6f9-00d2-448c-a2c2-d6f8356b7b3b tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Request method failure captured: Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hypervisors/7eea80a1-f88d-425c-a9b1-b4dad7493777 HTTP/1.1 Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOX1vw-ekMNK8yvYvOr28Bu5o6WZw96sa-Q8ZdfbGcH4kRTutXGB7r8GFOVlKJuvaQlOLh481LUXsCsRMPJmg7bsC_wnkb9pHFgTEGVF6qYaQBD8n0CZcUdVinK8BPujE3s56_NG3uHjbHUiq-EXjRtifJnabs3pkr_OXQT63mEmto Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 452282ac50064782aff16c202f6b3da6 Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756313288 Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:04:25.338273 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_452282ac50064782aff16c202f6b3da6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/452282ac50064782aff16c202f6b3da6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/452282ac50064782aff16c202f6b3da6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/452282ac50064782aff16c202f6b3da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756313288 Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 452282ac50064782aff16c202f6b3da6 Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756313288 Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a91931851e7a48689c5625730cdc54b5 Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: exception: Hypervisor with ID '7eea80a1-f88d-425c-a9b1-b4dad7493777' could not be found. Aug 09 17:04:25.340051 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '7eea80a1-f88d-425c-a9b1-b4dad7493777'} Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7eea80a1-f88d-425c-a9b1-b4dad7493777' Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 09 17:04:25.341058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 17:04:25.343390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7eea80a1-f88d-425c-a9b1-b4dad7493777' could not be found. Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7eea80a1-f88d-425c-a9b1-b4dad7493777' could not be found. Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d9f6a6f9-00d2-448c-a2c2-d6f8356b7b3b tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] Returning 404 to user: Hypervisor with ID '7eea80a1-f88d-425c-a9b1-b4dad7493777' could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:25.344807 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d9f6a6f9-00d2-448c-a2c2-d6f8356b7b3b tempest-HypervisorAdminNegativeTestJSON-756313288 tempest-HypervisorAdminNegativeTestJSON-756313288-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/7eea80a1-f88d-425c-a9b1-b4dad7493777" status: 404 len: 123 microversion: 2.1 time: 0.025823 Aug 09 17:04:25.349653 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 123/267] 10.222.0.93 () {58 vars in 1257 bytes} [Tue Aug 9 17:04:25 2022] GET /compute/v2.1/os-hypervisors/7eea80a1-f88d-425c-a9b1-b4dad7493777 => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:04:25.371522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-07a02286-5a47-4ab4-bebe-7e63d904664e req-4d3cee52-1ea8-41a7-9630-a086bce8fb6b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:25.372419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-07a02286-5a47-4ab4-bebe-7e63d904664e req-4d3cee52-1ea8-41a7-9630-a086bce8fb6b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:25.377200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-07a02286-5a47-4ab4-bebe-7e63d904664e req-4d3cee52-1ea8-41a7-9630-a086bce8fb6b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:25.389626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aedf3450-74c9-466a-88e4-35fe0742e11c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:25.390912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aedf3450-74c9-466a-88e4-35fe0742e11c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:25.407916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aedf3450-74c9-466a-88e4-35fe0742e11c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:25.408772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aedf3450-74c9-466a-88e4-35fe0742e11c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:25.410886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aedf3450-74c9-466a-88e4-35fe0742e11c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:25.411977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aedf3450-74c9-466a-88e4-35fe0742e11c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:25.412239 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-07a02286-5a47-4ab4-bebe-7e63d904664e req-4d3cee52-1ea8-41a7-9630-a086bce8fb6b service nova] Creating event network-vif-plugged:cdac773e-042b-445a-b50f-a65814f73dae for instance cce37568-9dbf-4f84-875d-0bfda5961abc on n-h2-845781-6 Aug 09 17:04:25.414025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aedf3450-74c9-466a-88e4-35fe0742e11c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:25.414963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aedf3450-74c9-466a-88e4-35fe0742e11c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:25.426454 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-07a02286-5a47-4ab4-bebe-7e63d904664e req-4d3cee52-1ea8-41a7-9630-a086bce8fb6b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161450 Aug 09 17:04:25.428741 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 145/268] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:25.446715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b481c3c3-8a25-4d1d-b72e-6919c4362049 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:25.447114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b481c3c3-8a25-4d1d-b72e-6919c4362049 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:25.482941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b481c3c3-8a25-4d1d-b72e-6919c4362049 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:25.483553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b481c3c3-8a25-4d1d-b72e-6919c4362049 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:25.484039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b481c3c3-8a25-4d1d-b72e-6919c4362049 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:25.486421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b481c3c3-8a25-4d1d-b72e-6919c4362049 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:25.486421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b481c3c3-8a25-4d1d-b72e-6919c4362049 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:25.487789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b481c3c3-8a25-4d1d-b72e-6919c4362049 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:25.859723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b481c3c3-8a25-4d1d-b72e-6919c4362049 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:25.871104 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b481c3c3-8a25-4d1d-b72e-6919c4362049 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.429186 Aug 09 17:04:25.873347 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 146/269] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:25 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:26.131355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-53aeac03-34ef-402e-8ae6-0fa9d4238c8d req-5884c0c8-cd11-4c8c-b7a0-c109f50c6b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a357d075-2b44-40d1-9ccd-8816ededc907", "name": "network-vif-deleted", "tag": "3de121a0-09ed-476e-8f0e-cabce3982d4a"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:26.157334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-53aeac03-34ef-402e-8ae6-0fa9d4238c8d req-5884c0c8-cd11-4c8c-b7a0-c109f50c6b3b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:26.158104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-53aeac03-34ef-402e-8ae6-0fa9d4238c8d req-5884c0c8-cd11-4c8c-b7a0-c109f50c6b3b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:26.158844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-53aeac03-34ef-402e-8ae6-0fa9d4238c8d req-5884c0c8-cd11-4c8c-b7a0-c109f50c6b3b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:26.175014 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-53aeac03-34ef-402e-8ae6-0fa9d4238c8d req-5884c0c8-cd11-4c8c-b7a0-c109f50c6b3b service nova] Creating event network-vif-deleted:3de121a0-09ed-476e-8f0e-cabce3982d4a for instance a357d075-2b44-40d1-9ccd-8816ededc907 on n-h1-845781-6 Aug 09 17:04:26.205964 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-53aeac03-34ef-402e-8ae6-0fa9d4238c8d req-5884c0c8-cd11-4c8c-b7a0-c109f50c6b3b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061744 Aug 09 17:04:26.212819 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 147/270] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:26.223051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:26.224040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:26.226743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aedf3450-74c9-466a-88e4-35fe0742e11c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:26.235303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:26.236334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:26.236461 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aedf3450-74c9-466a-88e4-35fe0742e11c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1314 microversion: 2.1 time: 0.851869 Aug 09 17:04:26.238746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:26.241624 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 124/271] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:25 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:26.259293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:26.261266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:26.266706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:26.344524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:26.345893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:26.346947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:26.349274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lazy-loading 'fault' on Instance uuid a357d075-2b44-40d1-9ccd-8816ededc907 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:04:26.445293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b37941288004266be2c1bd8d11a20d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da04c602d6734ab1a12a6c388f68f415', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:26.457701 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d8c82e6c-2a46-47b9-a4bf-ca8666e2fcaa tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 200 len: 1288 microversion: 2.1 time: 0.242474 Aug 09 17:04:26.458882 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 148/272] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:26 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 1288 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:26.711407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1c4e3ac2-4fe0-4f71-acc7-1b769b45d383 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Calling method '.version_select at 0x7fbbcbf595e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:26.714422 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:26.714422 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:26.716527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4e3ac2-4fe0-4f71-acc7-1b769b45d383 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:26.717037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4e3ac2-4fe0-4f71-acc7-1b769b45d383 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:26.719140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4e3ac2-4fe0-4f71-acc7-1b769b45d383 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:26.767601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4e3ac2-4fe0-4f71-acc7-1b769b45d383 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:26.768058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4e3ac2-4fe0-4f71-acc7-1b769b45d383 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:26.768486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4e3ac2-4fe0-4f71-acc7-1b769b45d383 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:26.815692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4e3ac2-4fe0-4f71-acc7-1b769b45d383 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:26.818889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4e3ac2-4fe0-4f71-acc7-1b769b45d383 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:26.823813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4e3ac2-4fe0-4f71-acc7-1b769b45d383 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:26.838370 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1c4e3ac2-4fe0-4f71-acc7-1b769b45d383 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.595519 Aug 09 17:04:26.838986 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 125/273] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:26.861475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-47c64ee4-4c22-4fee-a2bb-3545cceca402 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Calling method '.version_select at 0x7fbbd80a7550>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:26.865852 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:26.865852 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:26.877489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c64ee4-4c22-4fee-a2bb-3545cceca402 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:26.879322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c64ee4-4c22-4fee-a2bb-3545cceca402 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:26.880701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c64ee4-4c22-4fee-a2bb-3545cceca402 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:26.907149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-082b2227-9eb0-4384-b133-c39a854d3da1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:26.908056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-082b2227-9eb0-4384-b133-c39a854d3da1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:26.922612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-082b2227-9eb0-4384-b133-c39a854d3da1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:26.932499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-082b2227-9eb0-4384-b133-c39a854d3da1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:26.939147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-082b2227-9eb0-4384-b133-c39a854d3da1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:26.939147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-082b2227-9eb0-4384-b133-c39a854d3da1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:26.939147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-082b2227-9eb0-4384-b133-c39a854d3da1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:26.939517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-082b2227-9eb0-4384-b133-c39a854d3da1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.001505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c64ee4-4c22-4fee-a2bb-3545cceca402 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.002329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c64ee4-4c22-4fee-a2bb-3545cceca402 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.003092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c64ee4-4c22-4fee-a2bb-3545cceca402 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.036139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c64ee4-4c22-4fee-a2bb-3545cceca402 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.037554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c64ee4-4c22-4fee-a2bb-3545cceca402 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.038963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c64ee4-4c22-4fee-a2bb-3545cceca402 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.055782 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-47c64ee4-4c22-4fee-a2bb-3545cceca402 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1506 microversion: 2.1 time: 0.202062 Aug 09 17:04:27.067684 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 149/274] 10.222.0.93 () {58 vars in 1167 bytes} [Tue Aug 9 17:04:26 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:27.222588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-95037b19-6892-41c7-9768-2128f5a42219 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:27.229900 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:27.229900 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:27.232212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95037b19-6892-41c7-9768-2128f5a42219 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.234143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95037b19-6892-41c7-9768-2128f5a42219 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.234920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95037b19-6892-41c7-9768-2128f5a42219 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.236909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95037b19-6892-41c7-9768-2128f5a42219 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.237786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95037b19-6892-41c7-9768-2128f5a42219 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.238517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95037b19-6892-41c7-9768-2128f5a42219 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.287528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-082b2227-9eb0-4384-b133-c39a854d3da1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:27.288252 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-95037b19-6892-41c7-9768-2128f5a42219 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.227105 Aug 09 17:04:27.289800 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 150/275] 10.222.0.93 () {58 vars in 1176 bytes} [Tue Aug 9 17:04:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:27.297401 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-082b2227-9eb0-4384-b133-c39a854d3da1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.395735 Aug 09 17:04:27.298963 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 126/276] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:26 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:27.300422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-65502a83-95cc-4b01-bc87-267589e4978d tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Calling method '.version_select at 0x7fbbd8c82b80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:27.302129 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:27.302129 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:27.304259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65502a83-95cc-4b01-bc87-267589e4978d tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.304983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65502a83-95cc-4b01-bc87-267589e4978d tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.305959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65502a83-95cc-4b01-bc87-267589e4978d tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.306809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-818df8a7-c871-46e9-b9b8-98538db7e25b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:27.307440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-818df8a7-c871-46e9-b9b8-98538db7e25b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:27.325433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-818df8a7-c871-46e9-b9b8-98538db7e25b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.327386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-818df8a7-c871-46e9-b9b8-98538db7e25b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.328564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-818df8a7-c871-46e9-b9b8-98538db7e25b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.330303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-818df8a7-c871-46e9-b9b8-98538db7e25b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.331822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-818df8a7-c871-46e9-b9b8-98538db7e25b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.332858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-818df8a7-c871-46e9-b9b8-98538db7e25b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.341440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65502a83-95cc-4b01-bc87-267589e4978d tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.342577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65502a83-95cc-4b01-bc87-267589e4978d tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.343516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65502a83-95cc-4b01-bc87-267589e4978d tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.365657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65502a83-95cc-4b01-bc87-267589e4978d tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.366478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65502a83-95cc-4b01-bc87-267589e4978d tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.367215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65502a83-95cc-4b01-bc87-267589e4978d tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.384083 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-65502a83-95cc-4b01-bc87-267589e4978d tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.092223 Aug 09 17:04:27.385752 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 151/277] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:27.406482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5a6bce41-ffe4-45ab-93f2-de155827228b tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1935702489"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:27.409700 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:27.409700 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:27.410569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.aggregate [None req-5a6bce41-ffe4-45ab-93f2-de155827228b tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Generated uuid 6a7cbb31-e289-4b7c-b593-cbe98b24f4ad for aggregate {{(pid=119432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:27.439385 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5a6bce41-ffe4-45ab-93f2-de155827228b tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.051781 Aug 09 17:04:27.440530 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 152/278] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:27.445406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba7b2aac-af86-4dcb-8195-17bdd60bf259 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Calling method '.version_select at 0x7fbbd80a7dc0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:27.446562 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:27.446562 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:27.449010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7b2aac-af86-4dcb-8195-17bdd60bf259 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.450029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7b2aac-af86-4dcb-8195-17bdd60bf259 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.450587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7b2aac-af86-4dcb-8195-17bdd60bf259 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.468914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7b2aac-af86-4dcb-8195-17bdd60bf259 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.469327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7b2aac-af86-4dcb-8195-17bdd60bf259 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.469771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7b2aac-af86-4dcb-8195-17bdd60bf259 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.477811 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ba7b2aac-af86-4dcb-8195-17bdd60bf259 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.036051 Aug 09 17:04:27.478604 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 153/279] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:27 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:27.492192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eb15bc31-72b7-4aa0-9683-8fc49dc49838 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-845781-6"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:27.495545 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:27.495545 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:27.506781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb15bc31-72b7-4aa0-9683-8fc49dc49838 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.507317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb15bc31-72b7-4aa0-9683-8fc49dc49838 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.507804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb15bc31-72b7-4aa0-9683-8fc49dc49838 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.680713 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eb15bc31-72b7-4aa0-9683-8fc49dc49838 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.200589 Aug 09 17:04:27.681894 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 154/280] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:04:27 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:27.691685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-3b702544-2e2a-4621-8d73-77a5c8d8a7c1 req-bb188dcf-f03b-4d14-9c3b-17004fc9d0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3698be9-74c8-41a8-b6d8-3f3f1bfe4639", "name": "network-vif-plugged", "status": "completed", "tag": "b3e870ac-821c-49c8-a2b5-e30130f4fbf6"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:27.710599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3b702544-2e2a-4621-8d73-77a5c8d8a7c1 req-bb188dcf-f03b-4d14-9c3b-17004fc9d0f0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.711464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3b702544-2e2a-4621-8d73-77a5c8d8a7c1 req-bb188dcf-f03b-4d14-9c3b-17004fc9d0f0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.712292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3b702544-2e2a-4621-8d73-77a5c8d8a7c1 req-bb188dcf-f03b-4d14-9c3b-17004fc9d0f0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.735957 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-3b702544-2e2a-4621-8d73-77a5c8d8a7c1 req-bb188dcf-f03b-4d14-9c3b-17004fc9d0f0 service nova] Creating event network-vif-plugged:b3e870ac-821c-49c8-a2b5-e30130f4fbf6 for instance d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 on n-h1-845781-6 Aug 09 17:04:27.745365 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-3b702544-2e2a-4621-8d73-77a5c8d8a7c1 req-bb188dcf-f03b-4d14-9c3b-17004fc9d0f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061321 Aug 09 17:04:27.746899 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 155/281] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:27.758859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:27.760262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:27.772936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.773809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.774627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.776015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.776776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.777542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.780306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-818df8a7-c871-46e9-b9b8-98538db7e25b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:27.807172 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-818df8a7-c871-46e9-b9b8-98538db7e25b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1314 microversion: 2.1 time: 0.506473 Aug 09 17:04:27.808503 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 127/282] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:27 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:27.815268 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] HTTP exception thrown: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:27.818254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c10bd4fb-93e3-41ff-9f98-f81ce259821c tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Calling method '.version_select at 0x7fbbd80c48b0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Request method failure captured: Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 HTTP/1.1 Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pM_Mv8hiYyd2-2HI3hEs7Tqan5qw4RXI5emtKRi3E_y9ekmRgGshhSO9QoZMmE65EpQXLlAATcmllniIoxX9LmufEce0eERNYXR02psMMEQj7fQlMftNq2DVF8FqcySJ4GUSGX4dYwSzhwOIcWaPoeiSLlbWK0lk467M8fJbxKdSEo Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:04:27.818526 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4b37941288004266be2c1bd8d11a20d4 Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:27.821216 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'a357d075-2b44-40d1-9ccd-8816ededc907'} Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:27.822472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:27.826679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.832678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Returning 404 to user: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:27.832678 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-daeaacb0-d559-413d-bb07-7dfcc360eea1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 404 len: 111 microversion: 2.1 time: 0.072012 Aug 09 17:04:27.832678 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 156/283] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:27 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:27.834132 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:27.834132 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:27.836711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c10bd4fb-93e3-41ff-9f98-f81ce259821c tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.838006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c10bd4fb-93e3-41ff-9f98-f81ce259821c tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.839137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c10bd4fb-93e3-41ff-9f98-f81ce259821c tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.846856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c5718d2b-3195-40c5-9ac8-4217cdfa492e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-845781-6"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:27.851561 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:27.851561 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:27.869724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5718d2b-3195-40c5-9ac8-4217cdfa492e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.870571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5718d2b-3195-40c5-9ac8-4217cdfa492e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.871889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5718d2b-3195-40c5-9ac8-4217cdfa492e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.885094 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c10bd4fb-93e3-41ff-9f98-f81ce259821c tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.074577 Aug 09 17:04:27.887952 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 128/284] 10.222.0.93 () {58 vars in 1179 bytes} [Tue Aug 9 17:04:27 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:27.907516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:27.908523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:27.921479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.922373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.923096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.925393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:27.926886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:27.928989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:27.939470 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-c5718d2b-3195-40c5-9ac8-4217cdfa492e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-845781-6. Aug 09 17:04:27.966577 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] HTTP exception thrown: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Request method failure captured: Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 HTTP/1.1 Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pM_Mv8hiYyd2-2HI3hEs7Tqan5qw4RXI5emtKRi3E_y9ekmRgGshhSO9QoZMmE65EpQXLlAATcmllniIoxX9LmufEce0eERNYXR02psMMEQj7fQlMftNq2DVF8FqcySJ4GUSGX4dYwSzhwOIcWaPoeiSLlbWK0lk467M8fJbxKdSEo Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:04:27.970842 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4b37941288004266be2c1bd8d11a20d4 Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:27.972288 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'a357d075-2b44-40d1-9ccd-8816ededc907'} Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:27.973070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:27.974267 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c5718d2b-3195-40c5-9ac8-4217cdfa492e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Request method failure captured: Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 39 Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOaFzYDKRPQ4RQERrSR0JBiLZGXbS5upr4TFzzSJ9dCVhfJ3MavZaDH701Lzb3DZHVQNNIohOd2Q9E73kTAuysLl74ytOeZqDXEK9X7uTLeVUY_WIQnCsHY9aoQWy3xrCZn8Kbs3IGZpgyJVEuNScHvT0wT5uCTaGlpBewJDr6ZfrQ Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:04:27.977052 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: dc36195a070e411594c20e6a4502803b Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: {"add_host": {"host": "n-h2-845781-6"}} Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:27.978746 n-d-845781-6 devstack@n-api.service[119432]: exception: Aggregate 11 already has host n-h2-845781-6. Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-845781-6'}}} Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result.read() Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 17:04:27.979584 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-845781-6-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi session.flush() Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 17:04:27.980939 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 17:04:27.982082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 17:04:27.988263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result.read() Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-845781-6-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 9, 17, 4, 27, 924842), 'updated_at': None, 'host': 'n-h2-845781-6', 'aggregate_id': 11}] Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:27.990291 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6607, in add_host_to_aggregate Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-845781-6. Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.992221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-845781-6. Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:27.994953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:27.996985 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-845781-6. Aug 09 17:04:27.996985 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:27.996985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c5718d2b-3195-40c5-9ac8-4217cdfa492e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-845781-6. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:27.996985 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c5718d2b-3195-40c5-9ac8-4217cdfa492e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.141566 Aug 09 17:04:27.997299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Returning 404 to user: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:27.997389 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 157/285] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:04:27 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 09 17:04:27.997471 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b3ae43ec-c679-43b5-8ff8-0f979c0ef37d tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 404 len: 111 microversion: 2.1 time: 0.094358 Aug 09 17:04:27.997471 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 129/286] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:04:27 2022] DELETE /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:27.997688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-54baeab2-847a-47bc-9efb-fb5bdeb8d55a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Calling method '.version_select at 0x7fbbcbeac820>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:27.998337 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:27.998337 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:28.000514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54baeab2-847a-47bc-9efb-fb5bdeb8d55a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.001334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54baeab2-847a-47bc-9efb-fb5bdeb8d55a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.001893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51b072c5-f2a1-4658-9582-d0e25dee9f5a tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-845781-6"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:28.002133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54baeab2-847a-47bc-9efb-fb5bdeb8d55a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.007449 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:28.007449 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:28.025946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51b072c5-f2a1-4658-9582-d0e25dee9f5a tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.028039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51b072c5-f2a1-4658-9582-d0e25dee9f5a tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.028574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51b072c5-f2a1-4658-9582-d0e25dee9f5a tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.032808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54baeab2-847a-47bc-9efb-fb5bdeb8d55a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.033553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54baeab2-847a-47bc-9efb-fb5bdeb8d55a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.034251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54baeab2-847a-47bc-9efb-fb5bdeb8d55a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.055326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54baeab2-847a-47bc-9efb-fb5bdeb8d55a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.056402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54baeab2-847a-47bc-9efb-fb5bdeb8d55a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.057369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54baeab2-847a-47bc-9efb-fb5bdeb8d55a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.080773 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-54baeab2-847a-47bc-9efb-fb5bdeb8d55a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.094982 Aug 09 17:04:28.091139 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 158/287] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:28.104365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:28.105010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: a357d075-2b44-40d1-9ccd-8816ededc907] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:28.129958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.130466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.132041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.134269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.136122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.136600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.176351 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] HTTP exception thrown: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Request method failure captured: Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 HTTP/1.1 Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pM_Mv8hiYyd2-2HI3hEs7Tqan5qw4RXI5emtKRi3E_y9ekmRgGshhSO9QoZMmE65EpQXLlAATcmllniIoxX9LmufEce0eERNYXR02psMMEQj7fQlMftNq2DVF8FqcySJ4GUSGX4dYwSzhwOIcWaPoeiSLlbWK0lk467M8fJbxKdSEo Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:04:28.177938 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4b37941288004266be2c1bd8d11a20d4 Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:28.180255 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'a357d075-2b44-40d1-9ccd-8816ededc907'} Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:28.182805 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. Aug 09 17:04:28.188441 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.192572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Returning 404 to user: Instance a357d075-2b44-40d1-9ccd-8816ededc907 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:28.192572 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a577522a-0b02-4103-8167-297d2098458e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907" status: 404 len: 111 microversion: 2.1 time: 0.087051 Aug 09 17:04:28.192572 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 159/288] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:28 2022] GET /compute/v2.1/servers/a357d075-2b44-40d1-9ccd-8816ededc907 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:28.197803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b02fe827-a3fc-40af-88d2-b3d03f16d704 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Calling method '.version_select at 0x7fbbcbeac790>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:28.198738 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:28.198738 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:28.203171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b02fe827-a3fc-40af-88d2-b3d03f16d704 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.205663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b02fe827-a3fc-40af-88d2-b3d03f16d704 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.206138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b02fe827-a3fc-40af-88d2-b3d03f16d704 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.246368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b02fe827-a3fc-40af-88d2-b3d03f16d704 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.247424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b02fe827-a3fc-40af-88d2-b3d03f16d704 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.251038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b02fe827-a3fc-40af-88d2-b3d03f16d704 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.273962 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b02fe827-a3fc-40af-88d2-b3d03f16d704 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.092025 Aug 09 17:04:28.275831 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 160/289] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:28 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:28.289629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:28.291051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:28.303523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.304647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.305612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.307283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.308418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.309413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.349784 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] HTTP exception thrown: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Request method failure captured: Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c HTTP/1.1 Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pM_Mv8hiYyd2-2HI3hEs7Tqan5qw4RXI5emtKRi3E_y9ekmRgGshhSO9QoZMmE65EpQXLlAATcmllniIoxX9LmufEce0eERNYXR02psMMEQj7fQlMftNq2DVF8FqcySJ4GUSGX4dYwSzhwOIcWaPoeiSLlbWK0lk467M8fJbxKdSEo Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:04:28.353928 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4b37941288004266be2c1bd8d11a20d4 Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:04:28.357203 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'da17df6f-e2bb-4886-919f-6b90e3cf344c'} Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:28.358898 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:04:28.362172 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.366607 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51b072c5-f2a1-4658-9582-d0e25dee9f5a tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.365549 Aug 09 17:04:28.366607 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 130/290] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:04:27 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:28.369688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Returning 404 to user: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:28.371704 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4583f58d-0b04-45fb-9f3e-f1cf98c59d7e tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "DELETE /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 404 len: 111 microversion: 2.1 time: 0.093066 Aug 09 17:04:28.372715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5adb65e8-b558-4a12-8812-2f3b397ca725 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Calling method '.version_select at 0x7fbbd815f1f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:28.374297 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 161/291] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:04:28 2022] DELETE /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:28.374715 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:28.374715 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:28.384511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1b6b2aef-9114-421b-9873-66f80733f044 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:28.388103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1b6b2aef-9114-421b-9873-66f80733f044 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:28.391006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5adb65e8-b558-4a12-8812-2f3b397ca725 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.391922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5adb65e8-b558-4a12-8812-2f3b397ca725 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.392693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5adb65e8-b558-4a12-8812-2f3b397ca725 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.403457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6b2aef-9114-421b-9873-66f80733f044 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.407843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6b2aef-9114-421b-9873-66f80733f044 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.409121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6b2aef-9114-421b-9873-66f80733f044 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.410753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6b2aef-9114-421b-9873-66f80733f044 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.412197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6b2aef-9114-421b-9873-66f80733f044 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.413241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6b2aef-9114-421b-9873-66f80733f044 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.457342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5adb65e8-b558-4a12-8812-2f3b397ca725 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.457855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5adb65e8-b558-4a12-8812-2f3b397ca725 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.461149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5adb65e8-b558-4a12-8812-2f3b397ca725 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.479020 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5adb65e8-b558-4a12-8812-2f3b397ca725 tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.112572 Aug 09 17:04:28.487934 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 131/292] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:28 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:28.504435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b78976d-b8fe-4546-b3a9-2d5d4b38e1d4 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:28.506664 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:28.506664 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:28.563279 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b78976d-b8fe-4546-b3a9-2d5d4b38e1d4 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.073418 Aug 09 17:04:28.564750 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 132/293] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:28 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:28.589545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:28.591299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] [instance: da17df6f-e2bb-4886-919f-6b90e3cf344c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:28.612968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.614034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.614841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.617259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.618100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.618840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.653739 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] HTTP exception thrown: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Request method failure captured: Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c HTTP/1.1 Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pM_Mv8hiYyd2-2HI3hEs7Tqan5qw4RXI5emtKRi3E_y9ekmRgGshhSO9QoZMmE65EpQXLlAATcmllniIoxX9LmufEce0eERNYXR02psMMEQj7fQlMftNq2DVF8FqcySJ4GUSGX4dYwSzhwOIcWaPoeiSLlbWK0lk467M8fJbxKdSEo Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:04:28.657479 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/da04c602d6734ab1a12a6c388f68f415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: da04c602d6734ab1a12a6c388f68f415 Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1234534205 Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4b37941288004266be2c1bd8d11a20d4 Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersAdminTestJSON-1234534205-project Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:04:28.659806 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'da17df6f-e2bb-4886-919f-6b90e3cf344c'} Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:28.661085 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. Aug 09 17:04:28.665425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:28.669268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] Returning 404 to user: Instance da17df6f-e2bb-4886-919f-6b90e3cf344c could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:28.669268 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cbca96b4-9793-49ef-b4b7-9b8a9901a3f1 tempest-DeleteServersAdminTestJSON-1234534205 tempest-DeleteServersAdminTestJSON-1234534205-project] 10.222.0.93 "GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c" status: 404 len: 111 microversion: 2.1 time: 0.090798 Aug 09 17:04:28.669268 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 133/294] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:28 2022] GET /compute/v2.1/servers/da17df6f-e2bb-4886-919f-6b90e3cf344c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:28.678713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6d3367be-8fc4-4a44-8129-6c8d370c142a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Calling method '.version_select at 0x7fbbcbfba0d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:28.680807 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:28.680807 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:28.685620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3367be-8fc4-4a44-8129-6c8d370c142a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.687796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3367be-8fc4-4a44-8129-6c8d370c142a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.688895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3367be-8fc4-4a44-8129-6c8d370c142a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.719437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:28.727274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3367be-8fc4-4a44-8129-6c8d370c142a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.727885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3367be-8fc4-4a44-8129-6c8d370c142a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.728366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3367be-8fc4-4a44-8129-6c8d370c142a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.747474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3367be-8fc4-4a44-8129-6c8d370c142a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.748248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3367be-8fc4-4a44-8129-6c8d370c142a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.749886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3367be-8fc4-4a44-8129-6c8d370c142a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.805156 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6d3367be-8fc4-4a44-8129-6c8d370c142a tempest-HypervisorAdminTestJSON-644083645 tempest-HypervisorAdminTestJSON-644083645-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.139564 Aug 09 17:04:28.807718 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 134/295] 10.222.0.93 () {58 vars in 1173 bytes} [Tue Aug 9 17:04:28 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:28.822981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7127c5bb-2c5b-4412-96da-cb263bba5341 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1931400279"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:28.833449 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:28.833449 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:28.836688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.aggregate [None req-7127c5bb-2c5b-4412-96da-cb263bba5341 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Generated uuid 5a20fb13-2784-42cb-aa62-73b8112bbccd for aggregate {{(pid=119431) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:28.881065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1b6b2aef-9114-421b-9873-66f80733f044 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:28.916496 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1b6b2aef-9114-421b-9873-66f80733f044 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.539441 Aug 09 17:04:28.916828 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7127c5bb-2c5b-4412-96da-cb263bba5341 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.106534 Aug 09 17:04:28.921291 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 135/296] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:28.922706 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 162/297] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:28 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:28.931198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c1cb8c7-2413-4d63-a499-8046f2860c14 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:28.939597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c1cb8c7-2413-4d63-a499-8046f2860c14 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:28.969828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1cb8c7-2413-4d63-a499-8046f2860c14 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.970566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1cb8c7-2413-4d63-a499-8046f2860c14 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.971310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1cb8c7-2413-4d63-a499-8046f2860c14 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:28.973153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1cb8c7-2413-4d63-a499-8046f2860c14 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:28.975385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1cb8c7-2413-4d63-a499-8046f2860c14 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:28.976112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1cb8c7-2413-4d63-a499-8046f2860c14 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:29.496846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c1cb8c7-2413-4d63-a499-8046f2860c14 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:29.511595 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c1cb8c7-2413-4d63-a499-8046f2860c14 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1314 microversion: 2.1 time: 0.586801 Aug 09 17:04:29.529016 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 136/298] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:28 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:29.725144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8b32f699-e646-4cbc-9413-da29ecb228ab tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-845781-6"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:29.728955 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:29.728955 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:29.730905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8b32f699-e646-4cbc-9413-da29ecb228ab tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c997c1021b4d4f01a17a631ec85d68b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b895c70b357d4c2baa9ce2fe439287f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8b32f699-e646-4cbc-9413-da29ecb228ab tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Request method failure captured: Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 39 Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOZQ2OszpqkGXpqTHclD5C4VQ-i-JAciYYz9j3SyG6zlrya01uOHSiY5mIQfMJSRhFA8CN9DMSNNDW-adMsJ98I5sRONosk8tCl0SF-h9xZKBH6qKCb1eOXZWril3Y_ICOPnWwrBiIRihiwN59sIKBIWhL5fEgwPUJi02v53Q2RpKg Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:04:29.733608 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: c997c1021b4d4f01a17a631ec85d68b5 Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: {"add_host": {"host": "n-h2-845781-6"}} Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:29.734776 n-d-845781-6 devstack@n-api.service[119432]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-845781-6'}}} Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:29.735573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 09 17:04:29.736599 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.739431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8b32f699-e646-4cbc-9413-da29ecb228ab tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:29.740757 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8b32f699-e646-4cbc-9413-da29ecb228ab tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] 10.222.0.93 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.807353 Aug 09 17:04:29.745298 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 163/299] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:04:28 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 812 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:04:29.752467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ce660013-5756-4e73-ad13-cfbe7b0a4eab tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:29.753450 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:29.753450 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:29.809051 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ce660013-5756-4e73-ad13-cfbe7b0a4eab tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.059549 Aug 09 17:04:29.812110 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 137/300] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:29 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 09 17:04:29.820610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cb86a99f-49db-437c-b8b0-a0aec1e85ca3 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1562097612"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:29.823835 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:29.823835 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:29.826301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.aggregate [None req-cb86a99f-49db-437c-b8b0-a0aec1e85ca3 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Generated uuid 1a9d3d06-9cd2-47e9-be6e-f59ef310cc28 for aggregate {{(pid=119432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:29.872507 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cb86a99f-49db-437c-b8b0-a0aec1e85ca3 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055322 Aug 09 17:04:29.874537 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 164/301] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:29.890324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2701db7a-aa1b-4df3-ab66-4f58c726fb34 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-851846516"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:29.894894 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:29.894894 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:29.908370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2701db7a-aa1b-4df3-ab66-4f58c726fb34 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:29.908869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2701db7a-aa1b-4df3-ab66-4f58c726fb34 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:29.909308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2701db7a-aa1b-4df3-ab66-4f58c726fb34 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:29.920819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2701db7a-aa1b-4df3-ab66-4f58c726fb34 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:29.921296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2701db7a-aa1b-4df3-ab66-4f58c726fb34 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:29.921859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2701db7a-aa1b-4df3-ab66-4f58c726fb34 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:29.943128 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-2701db7a-aa1b-4df3-ab66-4f58c726fb34 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-851846516 could not be found. Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2701db7a-aa1b-4df3-ab66-4f58c726fb34 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Request method failure captured: Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 57 Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOaFzYDKRPQ4RQERrSR0JBiLZGXbS5upr4TFzzSJ9dCVhfJ3MavZaDH701Lzb3DZHVQNNIohOd2Q9E73kTAuysLl74ytOeZqDXEK9X7uTLeVUY_WIQnCsHY9aoQWy3xrCZn8Kbs3IGZpgyJVEuNScHvT0wT5uCTaGlpBewJDr6ZfrQ Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:04:29.946543 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: dc36195a070e411594c20e6a4502803b Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: {"add_host": {"host": "tempest-nonexist_host-851846516"}} Aug 09 17:04:29.948036 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: exception: Compute host tempest-nonexist_host-851846516 could not be found. Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-851846516'}}} Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5962, in _get_service_in_cell_by_host Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-851846516' is not mapped to any cell Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:29.948747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5968, in _get_service_in_cell_by_host Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6587, in add_host_to_aggregate Aug 09 17:04:29.949912 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5970, in _get_service_in_cell_by_host Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-851846516 could not be found. Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-851846516 could not be found. Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:29.951084 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.952889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:29.952889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:29.952889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:29.952889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:29.952889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:29.952889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-851846516 could not be found. Aug 09 17:04:29.952889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:29.958065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2701db7a-aa1b-4df3-ab66-4f58c726fb34 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-851846516 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:29.959773 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2701db7a-aa1b-4df3-ab66-4f58c726fb34 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.076807 Aug 09 17:04:29.964307 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 138/302] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:04:29 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:29.974318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-54d57ece-10d0-47a9-8ecd-18bc5c01012c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:29.975496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-54d57ece-10d0-47a9-8ecd-18bc5c01012c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:29.978729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-211c9b05-5258-4b0c-bae2-753647481854 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:29.981599 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:29.981599 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:29.983594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54d57ece-10d0-47a9-8ecd-18bc5c01012c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:29.984324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54d57ece-10d0-47a9-8ecd-18bc5c01012c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:29.985094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54d57ece-10d0-47a9-8ecd-18bc5c01012c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:29.986180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54d57ece-10d0-47a9-8ecd-18bc5c01012c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:29.986794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54d57ece-10d0-47a9-8ecd-18bc5c01012c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:29.987838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54d57ece-10d0-47a9-8ecd-18bc5c01012c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:30.097224 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-211c9b05-5258-4b0c-bae2-753647481854 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.130129 Aug 09 17:04:30.098590 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 165/303] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:29 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:30.127661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-46392bfc-c2e8-4764-942d-a8c24b485823 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-46392bfc-c2e8-4764-942d-a8c24b485823 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Request method failure captured: Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 283 Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOaFzYDKRPQ4RQERrSR0JBiLZGXbS5upr4TFzzSJ9dCVhfJ3MavZaDH701Lzb3DZHVQNNIohOd2Q9E73kTAuysLl74ytOeZqDXEK9X7uTLeVUY_WIQnCsHY9aoQWy3xrCZn8Kbs3IGZpgyJVEuNScHvT0wT5uCTaGlpBewJDr6ZfrQ Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:04:30.200224 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:04:30.202816 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:30.202816 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.202816 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:30.202816 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.202816 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:30.202816 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:30.202816 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:30.202816 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: dc36195a070e411594c20e6a4502803b Aug 09 17:04:30.202816 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:30.202816 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:04:30.211116 n-d-845781-6 devstack@n-api.service[119432]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 09 17:04:30.211116 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:30.211116 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:04:30.211116 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 09 17:04:30.211116 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:30.211116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.211116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:04:30.211116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:04:30.211116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:04:30.211116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:30.213732 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.217792 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.224012 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:04:30.224012 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:04:30.224012 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:04:30.224012 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.224012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-46392bfc-c2e8-4764-942d-a8c24b485823 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:30.225207 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-46392bfc-c2e8-4764-942d-a8c24b485823 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.096963 Aug 09 17:04:30.225207 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 166/304] 10.222.0.93 () {60 vars in 1165 bytes} [Tue Aug 9 17:04:30 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 17:04:30.226915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3eecaf8b-4f1d-4476-9f9c-a65b2d470a9e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3eecaf8b-4f1d-4476-9f9c-a65b2d470a9e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Request method failure captured: Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 27 Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOaFzYDKRPQ4RQERrSR0JBiLZGXbS5upr4TFzzSJ9dCVhfJ3MavZaDH701Lzb3DZHVQNNIohOd2Q9E73kTAuysLl74ytOeZqDXEK9X7uTLeVUY_WIQnCsHY9aoQWy3xrCZn8Kbs3IGZpgyJVEuNScHvT0wT5uCTaGlpBewJDr6ZfrQ Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:04:30.234204 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: dc36195a070e411594c20e6a4502803b Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: {"aggregate": {"name": ""}} Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:30.235484 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi '' Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:30.236310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:04:30.237541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.238592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3eecaf8b-4f1d-4476-9f9c-a65b2d470a9e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:30.244738 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3eecaf8b-4f1d-4476-9f9c-a65b2d470a9e tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.031223 Aug 09 17:04:30.248862 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 167/305] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:30 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:04:30.259224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-28fb24cc-8e13-4480-ab47-7d7936bf7021 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1786750508"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:30.265929 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:30.265929 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:30.268264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-28fb24cc-8e13-4480-ab47-7d7936bf7021 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c997c1021b4d4f01a17a631ec85d68b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b895c70b357d4c2baa9ce2fe439287f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-28fb24cc-8e13-4480-ab47-7d7936bf7021 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Request method failure captured: Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 60 Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOZQ2OszpqkGXpqTHclD5C4VQ-i-JAciYYz9j3SyG6zlrya01uOHSiY5mIQfMJSRhFA8CN9DMSNNDW-adMsJ98I5sRONosk8tCl0SF-h9xZKBH6qKCb1eOXZWril3Y_ICOPnWwrBiIRihiwN59sIKBIWhL5fEgwPUJi02v53Q2RpKg Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:04:30.272039 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: c997c1021b4d4f01a17a631ec85d68b5 Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: {"aggregate": {"name": "tempest-test_aggregate-1786750508"}} Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:30.274652 n-d-845781-6 devstack@n-api.service[119432]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1786750508'}}} Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:30.276187 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:30.278215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 09 17:04:30.281096 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.285780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-28fb24cc-8e13-4480-ab47-7d7936bf7021 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:30.285780 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-28fb24cc-8e13-4480-ab47-7d7936bf7021 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.031976 Aug 09 17:04:30.286492 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 168/306] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:30 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:30.297456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7cdd626d-ae74-4275-8b54-eef455e96951 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-442676611"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:30.302747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.aggregate [None req-7cdd626d-ae74-4275-8b54-eef455e96951 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Generated uuid 6f288ae4-4699-4f0d-87f4-4de689037dd3 for aggregate {{(pid=119432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:30.310056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:30.372712 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7cdd626d-ae74-4275-8b54-eef455e96951 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.079837 Aug 09 17:04:30.374678 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 169/307] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:30.390845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d01288c7-9bc8-4e68-a3b0-cecba2a2145c tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-442676611"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:30.394929 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:30.394929 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:30.397263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.aggregate [None req-d01288c7-9bc8-4e68-a3b0-cecba2a2145c tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Generated uuid 978df2ee-623b-46e6-9d8c-5cc991574188 for aggregate {{(pid=119432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:30.415430 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-d01288c7-9bc8-4e68-a3b0-cecba2a2145c tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-442676611 already exists. Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d01288c7-9bc8-4e68-a3b0-cecba2a2145c tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Request method failure captured: Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 59 Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOaFzYDKRPQ4RQERrSR0JBiLZGXbS5upr4TFzzSJ9dCVhfJ3MavZaDH701Lzb3DZHVQNNIohOd2Q9E73kTAuysLl74ytOeZqDXEK9X7uTLeVUY_WIQnCsHY9aoQWy3xrCZn8Kbs3IGZpgyJVEuNScHvT0wT5uCTaGlpBewJDr6ZfrQ Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:04:30.425370 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: dc36195a070e411594c20e6a4502803b Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: {"aggregate": {"name": "tempest-test_aggregate-442676611"}} Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:30.426910 n-d-845781-6 devstack@n-api.service[119432]: exception: Aggregate tempest-test_aggregate-442676611 already exists. Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-442676611'}}} Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6424, in create_aggregate Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 09 17:04:30.427801 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-442676611 already exists. Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:30.429006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-442676611 already exists. Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-442676611 already exists. Aug 09 17:04:30.430818 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.437902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d01288c7-9bc8-4e68-a3b0-cecba2a2145c tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-442676611 already exists. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:30.439553 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d01288c7-9bc8-4e68-a3b0-cecba2a2145c tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.055358 Aug 09 17:04:30.441365 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 170/308] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:30 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:04:30.459713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-909b5747-f329-4c3c-8645-e6df5813823a tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:30.462124 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:30.462124 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:30.514940 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-909b5747-f329-4c3c-8645-e6df5813823a tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.067486 Aug 09 17:04:30.517793 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 171/309] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:30 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:30.536768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-23af3444-5379-48f9-a8a7-dbfdf37b2d33 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1906486249"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:30.544639 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:30.544639 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:30.551583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.aggregate [None req-23af3444-5379-48f9-a8a7-dbfdf37b2d33 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Generated uuid b6a8390b-0cae-40e9-9760-8c78e3754821 for aggregate {{(pid=119432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:30.587490 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-23af3444-5379-48f9-a8a7-dbfdf37b2d33 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064870 Aug 09 17:04:30.595791 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 172/310] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:30.595791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e4731512-3afe-44dd-936f-08e7db5e9f0c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:30.596808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e4731512-3afe-44dd-936f-08e7db5e9f0c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:30.617518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4731512-3afe-44dd-936f-08e7db5e9f0c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:30.618535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4731512-3afe-44dd-936f-08e7db5e9f0c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:30.619806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4731512-3afe-44dd-936f-08e7db5e9f0c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:30.621534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4731512-3afe-44dd-936f-08e7db5e9f0c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:30.622844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4731512-3afe-44dd-936f-08e7db5e9f0c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:30.624469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4731512-3afe-44dd-936f-08e7db5e9f0c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:30.671465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-54d57ece-10d0-47a9-8ecd-18bc5c01012c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:30.700840 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-54d57ece-10d0-47a9-8ecd-18bc5c01012c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.730848 Aug 09 17:04:30.751384 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 139/311] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:29 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:30.771953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-00ac2c49-f10f-490a-8a05-4ed787b6c983 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:30.776041 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:30.776041 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:30.777862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-00ac2c49-f10f-490a-8a05-4ed787b6c983 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c997c1021b4d4f01a17a631ec85d68b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b895c70b357d4c2baa9ce2fe439287f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-00ac2c49-f10f-490a-8a05-4ed787b6c983 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Request method failure captured: Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOZQ2OszpqkGXpqTHclD5C4VQ-i-JAciYYz9j3SyG6zlrya01uOHSiY5mIQfMJSRhFA8CN9DMSNNDW-adMsJ98I5sRONosk8tCl0SF-h9xZKBH6qKCb1eOXZWril3Y_ICOPnWwrBiIRihiwN59sIKBIWhL5fEgwPUJi02v53Q2RpKg Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:04:30.791526 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: c997c1021b4d4f01a17a631ec85d68b5 Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 09 17:04:30.794160 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '15'} Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:30.796962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.806005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-00ac2c49-f10f-490a-8a05-4ed787b6c983 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:30.812002 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-00ac2c49-f10f-490a-8a05-4ed787b6c983 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.040722 Aug 09 17:04:30.812002 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 140/312] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:30 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:30.835204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-895a40c6-1ed7-4946-ae3a-372d450b0db6 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:30.904199 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-895a40c6-1ed7-4946-ae3a-372d450b0db6 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.093471 Aug 09 17:04:30.906941 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 141/313] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:30 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:30.934674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3abeda40-d4d6-40a7-8a2c-1c8c8b6cb87f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:30.938282 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:30.938282 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:30.959863 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-3abeda40-d4d6-40a7-8a2c-1c8c8b6cb87f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3abeda40-d4d6-40a7-8a2c-1c8c8b6cb87f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Request method failure captured: Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOaFzYDKRPQ4RQERrSR0JBiLZGXbS5upr4TFzzSJ9dCVhfJ3MavZaDH701Lzb3DZHVQNNIohOd2Q9E73kTAuysLl74ytOeZqDXEK9X7uTLeVUY_WIQnCsHY9aoQWy3xrCZn8Kbs3IGZpgyJVEuNScHvT0wT5uCTaGlpBewJDr6ZfrQ Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:04:30.965619 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: dc36195a070e411594c20e6a4502803b Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: exception: Aggregate -1 could not be found. Aug 09 17:04:30.968414 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '-1'} Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 17:04:30.969813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.972277 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:30.974749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:30.974749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:30.974749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:30.974749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:30.974749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 09 17:04:30.974749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:30.980021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3abeda40-d4d6-40a7-8a2c-1c8c8b6cb87f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:30.982316 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3abeda40-d4d6-40a7-8a2c-1c8c8b6cb87f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.070451 Aug 09 17:04:30.986335 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 142/314] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:30 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:04:31.021887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-49324b63-dbd0-419f-ad74-6d2885c81907 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1893405512"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:31.032958 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:31.032958 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:31.035182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.aggregate [None req-49324b63-dbd0-419f-ad74-6d2885c81907 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Generated uuid 1621abf2-fd49-4cd3-af4a-3b08b2caef06 for aggregate {{(pid=119431) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:31.069695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e4731512-3afe-44dd-936f-08e7db5e9f0c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:31.087930 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e4731512-3afe-44dd-936f-08e7db5e9f0c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1463 microversion: 2.1 time: 0.496573 Aug 09 17:04:31.093485 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 173/315] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:30 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1463 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:31.114242 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-49324b63-dbd0-419f-ad74-6d2885c81907 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.120553 Aug 09 17:04:31.116916 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 143/316] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:31.127067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-97ac654d-abf3-4120-b236-90895ba9e1e5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:31.128472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-97ac654d-abf3-4120-b236-90895ba9e1e5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:31.149956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-08353da5-0b54-4ce6-b54b-979f2544abd1 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:31.152421 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:31.152421 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:31.157342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-08353da5-0b54-4ce6-b54b-979f2544abd1 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c997c1021b4d4f01a17a631ec85d68b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b895c70b357d4c2baa9ce2fe439287f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:31.166307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97ac654d-abf3-4120-b236-90895ba9e1e5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-08353da5-0b54-4ce6-b54b-979f2544abd1 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Request method failure captured: Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOZQ2OszpqkGXpqTHclD5C4VQ-i-JAciYYz9j3SyG6zlrya01uOHSiY5mIQfMJSRhFA8CN9DMSNNDW-adMsJ98I5sRONosk8tCl0SF-h9xZKBH6qKCb1eOXZWril3Y_ICOPnWwrBiIRihiwN59sIKBIWhL5fEgwPUJi02v53Q2RpKg Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:04:31.166762 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: c997c1021b4d4f01a17a631ec85d68b5 Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 09 17:04:31.169656 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '16'} Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:31.173623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 09 17:04:31.176370 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.180255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97ac654d-abf3-4120-b236-90895ba9e1e5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:31.180255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97ac654d-abf3-4120-b236-90895ba9e1e5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:31.180255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97ac654d-abf3-4120-b236-90895ba9e1e5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:31.181315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97ac654d-abf3-4120-b236-90895ba9e1e5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:31.184507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97ac654d-abf3-4120-b236-90895ba9e1e5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:31.185214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-08353da5-0b54-4ce6-b54b-979f2544abd1 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:31.185214 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-08353da5-0b54-4ce6-b54b-979f2544abd1 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] 10.222.0.93 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.050816 Aug 09 17:04:31.188352 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 144/317] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:31 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:31.211731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99591ee8-480b-47a1-9ccb-c9c879efb574 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:31.212968 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:31.212968 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:31.262685 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99591ee8-480b-47a1-9ccb-c9c879efb574 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.069931 Aug 09 17:04:31.265574 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 145/318] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:31 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:31.283844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d718f25b-16a3-48d2-bed5-eca8e41fb976 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:31.288479 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:31.288479 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:31.309558 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d718f25b-16a3-48d2-bed5-eca8e41fb976 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d718f25b-16a3-48d2-bed5-eca8e41fb976 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Request method failure captured: Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOaFzYDKRPQ4RQERrSR0JBiLZGXbS5upr4TFzzSJ9dCVhfJ3MavZaDH701Lzb3DZHVQNNIohOd2Q9E73kTAuysLl74ytOeZqDXEK9X7uTLeVUY_WIQnCsHY9aoQWy3xrCZn8Kbs3IGZpgyJVEuNScHvT0wT5uCTaGlpBewJDr6ZfrQ Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:04:31.318047 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: dc36195a070e411594c20e6a4502803b Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: exception: Aggregate -1 could not be found. Aug 09 17:04:31.322160 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '-1'} Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:31.323668 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 09 17:04:31.330514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.336855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d718f25b-16a3-48d2-bed5-eca8e41fb976 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:31.343727 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d718f25b-16a3-48d2-bed5-eca8e41fb976 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.052670 Aug 09 17:04:31.348579 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 146/319] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:31 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:04:31.377034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2355008-a161-47ef-b6c9-a189ea669334 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:31.378618 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:31.378618 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:31.380417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d2355008-a161-47ef-b6c9-a189ea669334 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c997c1021b4d4f01a17a631ec85d68b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b895c70b357d4c2baa9ce2fe439287f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2355008-a161-47ef-b6c9-a189ea669334 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Request method failure captured: Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOZQ2OszpqkGXpqTHclD5C4VQ-i-JAciYYz9j3SyG6zlrya01uOHSiY5mIQfMJSRhFA8CN9DMSNNDW-adMsJ98I5sRONosk8tCl0SF-h9xZKBH6qKCb1eOXZWril3Y_ICOPnWwrBiIRihiwN59sIKBIWhL5fEgwPUJi02v53Q2RpKg Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:04:31.383779 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: c997c1021b4d4f01a17a631ec85d68b5 Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 09 17:04:31.385226 n-d-845781-6 devstack@n-api.service[119431]: action_args: {} Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:31.385955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.387056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2355008-a161-47ef-b6c9-a189ea669334 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:31.388122 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d2355008-a161-47ef-b6c9-a189ea669334 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.027487 Aug 09 17:04:31.394066 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 147/320] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:04:31 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:31.414585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d5e270d-0711-4605-875a-e6e1a3d77736 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-607184398"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:31.426481 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:31.426481 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:31.428090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.aggregate [None req-8d5e270d-0711-4605-875a-e6e1a3d77736 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Generated uuid 411a9bad-fa94-45e3-90cb-e21c82145617 for aggregate {{(pid=119431) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:31.459739 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d5e270d-0711-4605-875a-e6e1a3d77736 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057910 Aug 09 17:04:31.461213 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 148/321] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:31.480460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cf5ebde4-3e60-4d76-ae3c-5099965d6f38 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-845781-6"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:31.488347 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:31.488347 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:31.513231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf5ebde4-3e60-4d76-ae3c-5099965d6f38 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:31.515659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf5ebde4-3e60-4d76-ae3c-5099965d6f38 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:31.516086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf5ebde4-3e60-4d76-ae3c-5099965d6f38 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:31.776288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-97ac654d-abf3-4120-b236-90895ba9e1e5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:31.798987 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cf5ebde4-3e60-4d76-ae3c-5099965d6f38 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.326512 Aug 09 17:04:31.799734 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 149/322] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:04:31 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:31.804512 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-97ac654d-abf3-4120-b236-90895ba9e1e5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1464 microversion: 2.1 time: 0.688533 Aug 09 17:04:31.806613 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 174/323] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:31 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1464 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:31.812123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eee172bf-51cc-4398-bd28-66e7931e9c80 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:31.819780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-13ce7d74-d473-4668-a21f-55add20c5687 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-845781-6"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:31.823875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eee172bf-51cc-4398-bd28-66e7931e9c80 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:31.837122 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:31.837122 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:31.839040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eee172bf-51cc-4398-bd28-66e7931e9c80 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:31.839551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eee172bf-51cc-4398-bd28-66e7931e9c80 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:31.840035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eee172bf-51cc-4398-bd28-66e7931e9c80 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:31.840781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eee172bf-51cc-4398-bd28-66e7931e9c80 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:31.841257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eee172bf-51cc-4398-bd28-66e7931e9c80 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:31.841689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eee172bf-51cc-4398-bd28-66e7931e9c80 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:31.843916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-13ce7d74-d473-4668-a21f-55add20c5687 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c997c1021b4d4f01a17a631ec85d68b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b895c70b357d4c2baa9ce2fe439287f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-13ce7d74-d473-4668-a21f-55add20c5687 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Request method failure captured: Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 42 Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOZQ2OszpqkGXpqTHclD5C4VQ-i-JAciYYz9j3SyG6zlrya01uOHSiY5mIQfMJSRhFA8CN9DMSNNDW-adMsJ98I5sRONosk8tCl0SF-h9xZKBH6qKCb1eOXZWril3Y_ICOPnWwrBiIRihiwN59sIKBIWhL5fEgwPUJi02v53Q2RpKg Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:04:31.854710 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b895c70b357d4c2baa9ce2fe439287f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: b895c70b357d4c2baa9ce2fe439287f7 Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583 Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: c997c1021b4d4f01a17a631ec85d68b5 Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1056231583-project Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: {"remove_host": {"host": "n-h2-845781-6"}} Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:31.856598 n-d-845781-6 devstack@n-api.service[119432]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-845781-6'}}} Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:31.858521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 09 17:04:31.859736 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:31.860920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-13ce7d74-d473-4668-a21f-55add20c5687 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:31.867497 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-13ce7d74-d473-4668-a21f-55add20c5687 tempest-AggregatesAdminNegativeTestJSON-1056231583 tempest-AggregatesAdminNegativeTestJSON-1056231583-project] 10.222.0.93 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.053620 Aug 09 17:04:31.870305 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 175/324] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:04:31 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 63 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:31.891977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e8a97d98-381c-43b1-b4d8-7e8fb570091d tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-845781-6"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:31.932277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8a97d98-381c-43b1-b4d8-7e8fb570091d tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:31.933252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8a97d98-381c-43b1-b4d8-7e8fb570091d tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:31.934003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8a97d98-381c-43b1-b4d8-7e8fb570091d tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:32.228376 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e8a97d98-381c-43b1-b4d8-7e8fb570091d tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.349963 Aug 09 17:04:32.230668 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 176/325] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:04:31 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:32.257203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4cc790d5-1b28-40d3-b27f-1f48de73be2b tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:32.258281 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:32.258281 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:32.322247 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4cc790d5-1b28-40d3-b27f-1f48de73be2b tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.082206 Aug 09 17:04:32.327430 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 177/326] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:32 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:32.337247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bfb0ef2f-0a9a-47b4-a33c-03cbeb4776a2 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1919766684"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:32.340688 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:32.340688 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:32.347007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.aggregate [None req-bfb0ef2f-0a9a-47b4-a33c-03cbeb4776a2 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Generated uuid 64dfd606-1860-4ddc-ab34-c9fe1ca0c868 for aggregate {{(pid=119432) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:04:32.395668 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bfb0ef2f-0a9a-47b4-a33c-03cbeb4776a2 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065956 Aug 09 17:04:32.397654 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 178/327] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:04:32 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:32.410530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:32.417703 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:32.417703 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:32.453286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:32.453701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eee172bf-51cc-4398-bd28-66e7931e9c80 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:32.456233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:32.459388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:32.470782 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eee172bf-51cc-4398-bd28-66e7931e9c80 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.663435 Aug 09 17:04:32.473157 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 150/328] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:31 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:32.477322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:32.478672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:32.479843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:32.484442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-798348829", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "cce37568-9dbf-4f84-875d-0bfda5961abc"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:32.496985 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.compute.aggregates [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 09 17:04:32.498517 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Request method failure captured: Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 42 Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOaFzYDKRPQ4RQERrSR0JBiLZGXbS5upr4TFzzSJ9dCVhfJ3MavZaDH701Lzb3DZHVQNNIohOd2Q9E73kTAuysLl74ytOeZqDXEK9X7uTLeVUY_WIQnCsHY9aoQWy3xrCZn8Kbs3IGZpgyJVEuNScHvT0wT5uCTaGlpBewJDr6ZfrQ Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:04:32.503113 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5cb7ae976a7345de8943f1dff56f3b1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5cb7ae976a7345de8943f1dff56f3b1e Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932 Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: dc36195a070e411594c20e6a4502803b Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: {"remove_host": {"host": "nonexist_host"}} Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:32.505550 n-d-845781-6 devstack@n-api.service[119432]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5962, in _get_service_in_cell_by_host Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5968, in _get_service_in_cell_by_host Aug 09 17:04:32.506942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6649, in remove_host_from_aggregate Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 09 17:04:32.513066 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5970, in _get_service_in_cell_by_host Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:32.518918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:32.523900 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:32.523900 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:32.523900 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:32.523900 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:32.523900 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 09 17:04:32.523900 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:32.525022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:32.525170 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cbcb9c87-942c-4e47-8dc2-398d475fad2f tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.118582 Aug 09 17:04:32.525994 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 179/329] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:04:32 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:04:32.549567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e7017f66-02a3-4f41-8dc3-9754a956c0d2 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:32.550449 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:32.550449 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:32.597461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:04:32.626088 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e7017f66-02a3-4f41-8dc3-9754a956c0d2 tempest-AggregatesAdminNegativeTestJSON-1465446932 tempest-AggregatesAdminNegativeTestJSON-1465446932-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.092930 Aug 09 17:04:32.627130 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 180/330] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:32 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:04:33.308725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:04:33.311008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:04:33.311893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:04:33.312501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:04:33.313286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:04:33.337542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:33.340628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:33.341286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:33.342787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:33.343452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:33.343998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:33.416628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Getting quotas for project a6aa3d7035ce484f9ea8bb3fdf7ac9a6. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:04:33.431413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Getting quotas for user e225d63b357c47998d854f8fa5b4be08 and project a6aa3d7035ce484f9ea8bb3fdf7ac9a6. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:04:33.491011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:04:33.498951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:04:33.524848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e669eae1-be73-4f62-a22e-9256833985c0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:33.530593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e669eae1-be73-4f62-a22e-9256833985c0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:33.566411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e669eae1-be73-4f62-a22e-9256833985c0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:33.570064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e669eae1-be73-4f62-a22e-9256833985c0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:33.574677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e669eae1-be73-4f62-a22e-9256833985c0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:33.581554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e669eae1-be73-4f62-a22e-9256833985c0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:33.583334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e669eae1-be73-4f62-a22e-9256833985c0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:33.584581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e669eae1-be73-4f62-a22e-9256833985c0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:33.630472 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-752add66-38b1-4f57-a6a7-7ade897f6760 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.153689 Aug 09 17:04:33.631141 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 151/331] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:04:33.653470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e4f174b-fd12-4652-b595-8fe870c8c9ef tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:33.654107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e4f174b-fd12-4652-b595-8fe870c8c9ef tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:33.846825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e669eae1-be73-4f62-a22e-9256833985c0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:33.860356 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e669eae1-be73-4f62-a22e-9256833985c0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.366248 Aug 09 17:04:33.861143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4e4f174b-fd12-4652-b595-8fe870c8c9ef tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:33.878365 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 181/332] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:33 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:33.886121 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e4f174b-fd12-4652-b595-8fe870c8c9ef tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1213 microversion: 2.1 time: 0.243393 Aug 09 17:04:33.887448 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 152/333] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:33 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1213 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:34.898477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-95502745-6c36-48c9-bd3d-8c1af7fbac03 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:34.903344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-95502745-6c36-48c9-bd3d-8c1af7fbac03 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:34.937768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95502745-6c36-48c9-bd3d-8c1af7fbac03 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:34.938776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95502745-6c36-48c9-bd3d-8c1af7fbac03 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:34.941639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95502745-6c36-48c9-bd3d-8c1af7fbac03 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:34.943540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95502745-6c36-48c9-bd3d-8c1af7fbac03 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:34.948102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95502745-6c36-48c9-bd3d-8c1af7fbac03 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:34.948754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95502745-6c36-48c9-bd3d-8c1af7fbac03 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:35.177281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-95502745-6c36-48c9-bd3d-8c1af7fbac03 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:35.191465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a1f7642d-f8bf-4a4b-a9f4-4a641a142cef tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Action: 'create', calling method: .version_select at 0x7fbbd8c82b80>, body: {"keypair": {"name": "tempest-keypair-307526165", "type": "ssh", "user_id": "83745743587e449296a38e185f5b1d8e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhJzmg+qSk7mSrVnvHWpYRj5dZprXGrXk54kZWV/Uc6js08VCQ68gD9au111CrJNjQogcHVCZedN9LF3pnATFRw4NIGYBzRktLObWXZWCyPPVb2lMspwjRnE3HRPviFtw=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:35.202774 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-95502745-6c36-48c9-bd3d-8c1af7fbac03 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.318546 Aug 09 17:04:35.204856 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 153/334] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:34 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:35.223719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ec18b1a-715f-4a39-b4a4-61263257aa21 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:35.227344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2ec18b1a-715f-4a39-b4a4-61263257aa21 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:35.255105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ec18b1a-715f-4a39-b4a4-61263257aa21 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:35.274123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a1f7642d-f8bf-4a4b-a9f4-4a641a142cef tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Getting quotas for project 1654a84b03534ed28d8968612f39fc62. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:04:35.276507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ec18b1a-715f-4a39-b4a4-61263257aa21 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:35.278401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ec18b1a-715f-4a39-b4a4-61263257aa21 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:35.281301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ec18b1a-715f-4a39-b4a4-61263257aa21 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:35.282794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ec18b1a-715f-4a39-b4a4-61263257aa21 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:35.282977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a1f7642d-f8bf-4a4b-a9f4-4a641a142cef tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Getting quotas for user a3056006343749219aab868634747772 and project 1654a84b03534ed28d8968612f39fc62. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:04:35.284055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ec18b1a-715f-4a39-b4a4-61263257aa21 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:35.405336 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a1f7642d-f8bf-4a4b-a9f4-4a641a142cef tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.757643 Aug 09 17:04:35.410605 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 182/335] 10.222.0.93 () {62 vars in 1200 bytes} [Tue Aug 9 17:04:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 764 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 17:04:35.430230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-af95f84a-79a9-4e69-8157-fec0184662e1 tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Action: 'create', calling method: .version_select at 0x7fbbd81f0940>, body: {"keypair": {"name": "tempest-keypair-938908290", "type": "ssh", "user_id": "83745743587e449296a38e185f5b1d8e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpQhIuZFv97gFJhZuAYfASeI5E2n2UAc8E+th18k3McQfyRDLhxg2Xd76+D4nkbTJjx0UIvgBs5ZycwWRfnItZ1h0CTE+sfmIt9rJiXt+9fuEQ6pnY3fTXe7aU/JLo6kQ=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:35.465865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-af95f84a-79a9-4e69-8157-fec0184662e1 tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Getting quotas for project 1654a84b03534ed28d8968612f39fc62. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:04:35.474901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-af95f84a-79a9-4e69-8157-fec0184662e1 tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Getting quotas for user a3056006343749219aab868634747772 and project 1654a84b03534ed28d8968612f39fc62. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:04:35.531456 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-af95f84a-79a9-4e69-8157-fec0184662e1 tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.109687 Aug 09 17:04:35.535589 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 183/336] 10.222.0.93 () {62 vars in 1200 bytes} [Tue Aug 9 17:04:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 09 17:04:35.554347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2ec18b1a-715f-4a39-b4a4-61263257aa21 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:35.558328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-da8c5602-d912-422a-8fc9-a369d547e0ec tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Calling method '.version_select at 0x7fbbcbeb39d0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:35.558722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:35.574753 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-da8c5602-d912-422a-8fc9-a369d547e0ec tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-307526165?user_id=83745743587e449296a38e185f5b1d8e" status: 200 len: 511 microversion: 2.10 time: 0.032319 Aug 09 17:04:35.586111 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ec18b1a-715f-4a39-b4a4-61263257aa21 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1273 microversion: 2.1 time: 0.378779 Aug 09 17:04:35.587053 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 184/337] 10.222.0.93 () {60 vars in 1337 bytes} [Tue Aug 9 17:04:35 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-307526165?user_id=83745743587e449296a38e185f5b1d8e => generated 511 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:04:35.600579 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 154/338] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:35 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1273 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:35.600732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-482d1816-24f1-41e1-9e85-b321b8e18379 tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Action: 'create', calling method: .version_select at 0x7fbbcbe68e50>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1194283717", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRyUdJZkPZVGG8ad0uiNMl53Yxjdtq+u9BpfNj8rxfDvzcaXZr08sVroAcnjwP6jSrdYQbWHunW7GDaNYefRWbBixu7NwduCkYQz0n6UIdzjkXEtRwgrDdo54M06Dqo3Q=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:35.639578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-482d1816-24f1-41e1-9e85-b321b8e18379 tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Getting quotas for project 1654a84b03534ed28d8968612f39fc62. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:04:35.657423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-482d1816-24f1-41e1-9e85-b321b8e18379 tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Getting quotas for user a3056006343749219aab868634747772 and project 1654a84b03534ed28d8968612f39fc62. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:04:35.710707 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-482d1816-24f1-41e1-9e85-b321b8e18379 tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.122063 Aug 09 17:04:35.716385 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 185/339] 10.222.0.93 () {62 vars in 1200 bytes} [Tue Aug 9 17:04:35 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 17:04:35.730235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2cc6107c-e0fa-4748-826e-f6c1d2a3a787 tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Calling method '.version_select at 0x7fbbd806c430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:35.741067 n-d-845781-6 devstack@n-api.service[119431]: WARNING oslo_db.sqlalchemy.utils [None req-2cc6107c-e0fa-4748-826e-f6c1d2a3a787 tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 17:04:35.753839 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2cc6107c-e0fa-4748-826e-f6c1d2a3a787 tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] 10.222.0.93 "GET /compute/v2.1/os-keypairs?user_id=83745743587e449296a38e185f5b1d8e" status: 200 len: 724 microversion: 2.10 time: 0.032326 Aug 09 17:04:35.757803 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 155/340] 10.222.0.93 () {60 vars in 1259 bytes} [Tue Aug 9 17:04:35 2022] GET /compute/v2.1/os-keypairs?user_id=83745743587e449296a38e185f5b1d8e => generated 724 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:04:35.774347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-67023fcc-bbfb-4d18-87af-5cc54cbc148c tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Calling method '.version_select at 0x7fbbcbe6cdc0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:35.829051 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-67023fcc-bbfb-4d18-87af-5cc54cbc148c tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1194283717" status: 204 len: 0 microversion: 2.10 time: 0.063735 Aug 09 17:04:35.830927 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 186/341] 10.222.0.93 () {60 vars in 1325 bytes} [Tue Aug 9 17:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1194283717 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:04:35.843764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19a0d343-cf41-463b-a987-4e7221189f5a tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Calling method '.version_select at 0x7fbbcbe8c670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:35.882664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19a0d343-cf41-463b-a987-4e7221189f5a tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-938908290?user_id=83745743587e449296a38e185f5b1d8e" status: 204 len: 0 microversion: 2.10 time: 0.046576 Aug 09 17:04:35.884620 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 156/342] 10.222.0.93 () {60 vars in 1340 bytes} [Tue Aug 9 17:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-938908290?user_id=83745743587e449296a38e185f5b1d8e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:04:35.901011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cfc2ddd1-0497-4469-96af-5b497ab40c4e tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] Calling method '.version_select at 0x7fbbcbe68790>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:35.948367 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cfc2ddd1-0497-4469-96af-5b497ab40c4e tempest-KeyPairsV210TestJSON-1853279327 tempest-KeyPairsV210TestJSON-1853279327-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-307526165?user_id=83745743587e449296a38e185f5b1d8e" status: 204 len: 0 microversion: 2.10 time: 0.055357 Aug 09 17:04:35.952018 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 187/343] 10.222.0.93 () {60 vars in 1340 bytes} [Tue Aug 9 17:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-307526165?user_id=83745743587e449296a38e185f5b1d8e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 17:04:36.236083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3eeb8e78-1b30-488e-971a-4d26f85a2ceb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:36.238182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3eeb8e78-1b30-488e-971a-4d26f85a2ceb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:36.262624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eeb8e78-1b30-488e-971a-4d26f85a2ceb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:36.272719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eeb8e78-1b30-488e-971a-4d26f85a2ceb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:36.273775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eeb8e78-1b30-488e-971a-4d26f85a2ceb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:36.275305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eeb8e78-1b30-488e-971a-4d26f85a2ceb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:36.276341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eeb8e78-1b30-488e-971a-4d26f85a2ceb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:36.277284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eeb8e78-1b30-488e-971a-4d26f85a2ceb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:36.630337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1fdd48df-10b4-4abd-830b-5c5a4d852e05 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:36.634059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1fdd48df-10b4-4abd-830b-5c5a4d852e05 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:36.659691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fdd48df-10b4-4abd-830b-5c5a4d852e05 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:36.661043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fdd48df-10b4-4abd-830b-5c5a4d852e05 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:36.662245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fdd48df-10b4-4abd-830b-5c5a4d852e05 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:36.664334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fdd48df-10b4-4abd-830b-5c5a4d852e05 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:36.665633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fdd48df-10b4-4abd-830b-5c5a4d852e05 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:36.667606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fdd48df-10b4-4abd-830b-5c5a4d852e05 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:36.802760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1fdd48df-10b4-4abd-830b-5c5a4d852e05 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:36.814856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:36.825829 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1fdd48df-10b4-4abd-830b-5c5a4d852e05 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1271 microversion: 2.1 time: 0.204450 Aug 09 17:04:36.827701 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 188/344] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:36 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:04:36.903905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3eeb8e78-1b30-488e-971a-4d26f85a2ceb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:36.937906 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3eeb8e78-1b30-488e-971a-4d26f85a2ceb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.709002 Aug 09 17:04:36.939502 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 157/345] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:36 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:37.859202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab470362-2570-4af8-85a1-78896b98a5f1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:37.861957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ab470362-2570-4af8-85a1-78896b98a5f1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:37.886682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab470362-2570-4af8-85a1-78896b98a5f1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:37.887199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab470362-2570-4af8-85a1-78896b98a5f1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:37.887678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab470362-2570-4af8-85a1-78896b98a5f1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:37.898994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab470362-2570-4af8-85a1-78896b98a5f1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:37.900785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab470362-2570-4af8-85a1-78896b98a5f1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:37.901527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab470362-2570-4af8-85a1-78896b98a5f1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:37.969152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-15067ab9-7bea-4e25-ac18-c2fb8969ca24 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:37.969778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-15067ab9-7bea-4e25-ac18-c2fb8969ca24 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:38.010197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15067ab9-7bea-4e25-ac18-c2fb8969ca24 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:38.016620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15067ab9-7bea-4e25-ac18-c2fb8969ca24 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:38.017604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15067ab9-7bea-4e25-ac18-c2fb8969ca24 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:38.018886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15067ab9-7bea-4e25-ac18-c2fb8969ca24 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:38.019771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15067ab9-7bea-4e25-ac18-c2fb8969ca24 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:38.029865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15067ab9-7bea-4e25-ac18-c2fb8969ca24 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:38.413757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ab470362-2570-4af8-85a1-78896b98a5f1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:38.427734 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ab470362-2570-4af8-85a1-78896b98a5f1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1313 microversion: 2.1 time: 0.582186 Aug 09 17:04:38.433342 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 189/346] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:37 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1313 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:38.551784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-15067ab9-7bea-4e25-ac18-c2fb8969ca24 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:38.573777 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-15067ab9-7bea-4e25-ac18-c2fb8969ca24 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1476 microversion: 2.1 time: 0.613360 Aug 09 17:04:38.575255 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 158/347] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:37 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1476 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:04:39.465465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-93a3e027-cdef-4bfb-97aa-d7875d6b2890 req-28bebe99-11ab-4fb2-a562-136b372445c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85044e48-08e5-4d4f-a2c2-f396b3b51bad", "tag": "5aeb30eb-e018-4a15-ac48-f3c1ab29281b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:39.486545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-93a3e027-cdef-4bfb-97aa-d7875d6b2890 req-28bebe99-11ab-4fb2-a562-136b372445c3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:39.487032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-93a3e027-cdef-4bfb-97aa-d7875d6b2890 req-28bebe99-11ab-4fb2-a562-136b372445c3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:39.487499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-93a3e027-cdef-4bfb-97aa-d7875d6b2890 req-28bebe99-11ab-4fb2-a562-136b372445c3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:39.523055 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-93a3e027-cdef-4bfb-97aa-d7875d6b2890 req-28bebe99-11ab-4fb2-a562-136b372445c3 service nova] Creating event network-changed:5aeb30eb-e018-4a15-ac48-f3c1ab29281b for instance 85044e48-08e5-4d4f-a2c2-f396b3b51bad on n-h2-845781-6 Aug 09 17:04:39.531222 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-93a3e027-cdef-4bfb-97aa-d7875d6b2890 req-28bebe99-11ab-4fb2-a562-136b372445c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069321 Aug 09 17:04:39.535966 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 159/348] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:39.541949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6dac272b-1368-4962-b7ff-268e0c3130a2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:39.558758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6dac272b-1368-4962-b7ff-268e0c3130a2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:39.565964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dac272b-1368-4962-b7ff-268e0c3130a2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:39.567595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dac272b-1368-4962-b7ff-268e0c3130a2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:39.568864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dac272b-1368-4962-b7ff-268e0c3130a2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:39.570929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dac272b-1368-4962-b7ff-268e0c3130a2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:39.573358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dac272b-1368-4962-b7ff-268e0c3130a2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:39.580067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dac272b-1368-4962-b7ff-268e0c3130a2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:39.917812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6dac272b-1368-4962-b7ff-268e0c3130a2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:39.929877 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6dac272b-1368-4962-b7ff-268e0c3130a2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1313 microversion: 2.1 time: 0.392250 Aug 09 17:04:39.931205 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 160/349] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:39 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:39.955533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f2d1586f-df0a-424d-b74f-dc6babb589c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:39.956568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f2d1586f-df0a-424d-b74f-dc6babb589c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:39.963982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d1586f-df0a-424d-b74f-dc6babb589c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:39.965294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d1586f-df0a-424d-b74f-dc6babb589c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:39.966012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d1586f-df0a-424d-b74f-dc6babb589c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:39.967889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d1586f-df0a-424d-b74f-dc6babb589c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:39.968900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d1586f-df0a-424d-b74f-dc6babb589c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:39.969558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d1586f-df0a-424d-b74f-dc6babb589c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:40.225569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-427fee26-1247-4c42-ac6e-1fe296aa0ee9 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-678126847", "id": 2084317573, "os-flavor-access:is_public": "True"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:40.229810 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:40.229810 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:40.259947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:40.262316 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-427fee26-1247-4c42-ac6e-1fe296aa0ee9 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.831707 Aug 09 17:04:40.262931 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 190/350] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:39 2022] POST /compute/v2.1/flavors => generated 429 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:40.281304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-59ac168f-ccd6-409f-93c4-d1a0a8ff70c2 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:40.282362 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:40.282362 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:40.328877 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-59ac168f-ccd6-409f-93c4-d1a0a8ff70c2 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/2084317573" status: 202 len: 0 microversion: 2.1 time: 0.051348 Aug 09 17:04:40.330533 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 191/351] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:04:40 2022] DELETE /compute/v2.1/flavors/2084317573 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:04:40.339847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-927b09ab-d207-4a8d-ae01-df00bb3ed693 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:40.402878 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-927b09ab-d207-4a8d-ae01-df00bb3ed693 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.066610 Aug 09 17:04:40.405551 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 192/352] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:40 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:04:40.445821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-29fe1ce9-08d1-4a0a-af9f-396cafb32072 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1850700604", "id": 1522596054, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:40.490052 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-29fe1ce9-08d1-4a0a-af9f-396cafb32072 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.053640 Aug 09 17:04:40.506098 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 193/353] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:40 2022] POST /compute/v2.1/flavors => generated 417 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:40.523058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-541132e1-1f6f-4523-804d-03f5c5d4544f tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:40.592965 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-541132e1-1f6f-4523-804d-03f5c5d4544f tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6228 microversion: 2.1 time: 0.082731 Aug 09 17:04:40.594282 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 194/354] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:40 2022] GET /compute/v2.1/flavors/detail => generated 6228 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:40.605571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e09a2743-e5ae-4c14-ac5d-a07644a1819d req-e377bc50-61ec-4918-ad91-7bf7d1193ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a21dd49-aca6-47cf-9381-0265b1a7a9c7", "name": "network-vif-unplugged", "status": "completed", "tag": "25fa6b72-0892-44f5-bdbf-99073ca230d8"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:40.632934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e09a2743-e5ae-4c14-ac5d-a07644a1819d req-e377bc50-61ec-4918-ad91-7bf7d1193ba7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:40.634946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e09a2743-e5ae-4c14-ac5d-a07644a1819d req-e377bc50-61ec-4918-ad91-7bf7d1193ba7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:40.635836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e09a2743-e5ae-4c14-ac5d-a07644a1819d req-e377bc50-61ec-4918-ad91-7bf7d1193ba7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:40.660932 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e09a2743-e5ae-4c14-ac5d-a07644a1819d req-e377bc50-61ec-4918-ad91-7bf7d1193ba7 service nova] Creating event network-vif-unplugged:25fa6b72-0892-44f5-bdbf-99073ca230d8 for instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 on n-h2-845781-6 Aug 09 17:04:40.694254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f2d1586f-df0a-424d-b74f-dc6babb589c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:40.696866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-e09a2743-e5ae-4c14-ac5d-a07644a1819d req-e377bc50-61ec-4918-ad91-7bf7d1193ba7 service nova] Instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:04:40.717442 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f2d1586f-df0a-424d-b74f-dc6babb589c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1475 microversion: 2.1 time: 0.768180 Aug 09 17:04:40.718008 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 161/355] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:39 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1475 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:40.722719 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e09a2743-e5ae-4c14-ac5d-a07644a1819d req-e377bc50-61ec-4918-ad91-7bf7d1193ba7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126742 Aug 09 17:04:40.733281 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 195/356] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:40.755126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-35a56f39-86b9-477a-8796-abaaf1e3c8a9 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:40.757929 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:40.757929 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:40.829318 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-35a56f39-86b9-477a-8796-abaaf1e3c8a9 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1522596054" status: 202 len: 0 microversion: 2.1 time: 0.104053 Aug 09 17:04:40.831189 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 162/357] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:04:40 2022] DELETE /compute/v2.1/flavors/1522596054 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:04:40.858113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9eaf04b2-e1c0-4099-8516-ce170d71fe0a tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:40.968661 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9eaf04b2-e1c0-4099-8516-ce170d71fe0a tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.125941 Aug 09 17:04:40.969816 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 196/358] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:40 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:04:40.989270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-41286f2b-8835-4f24-8e36-ff3b01a787df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:40.990393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-41286f2b-8835-4f24-8e36-ff3b01a787df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:41.022529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41286f2b-8835-4f24-8e36-ff3b01a787df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.023362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41286f2b-8835-4f24-8e36-ff3b01a787df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.024176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41286f2b-8835-4f24-8e36-ff3b01a787df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.025461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41286f2b-8835-4f24-8e36-ff3b01a787df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.026263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41286f2b-8835-4f24-8e36-ff3b01a787df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.027011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41286f2b-8835-4f24-8e36-ff3b01a787df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.512816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b25fafd-50d2-4cf7-97d5-95d20bc16bd2 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:41.527532 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:41.527532 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:41.532356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b25fafd-50d2-4cf7-97d5-95d20bc16bd2 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.534064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b25fafd-50d2-4cf7-97d5-95d20bc16bd2 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.537728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b25fafd-50d2-4cf7-97d5-95d20bc16bd2 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.545298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b25fafd-50d2-4cf7-97d5-95d20bc16bd2 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.546975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b25fafd-50d2-4cf7-97d5-95d20bc16bd2 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.548063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b25fafd-50d2-4cf7-97d5-95d20bc16bd2 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.631872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:41.664193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-41286f2b-8835-4f24-8e36-ff3b01a787df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:41.666350 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b25fafd-50d2-4cf7-97d5-95d20bc16bd2 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.801331 Aug 09 17:04:41.671900 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 163/359] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:04:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:41.672589 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-41286f2b-8835-4f24-8e36-ff3b01a787df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1313 microversion: 2.1 time: 0.698657 Aug 09 17:04:41.673698 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 197/360] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:40 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1313 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:41.685503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-75e82dd2-d9a4-481a-b414-4b59dd16ff4b tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:41.688831 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:41.688831 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:41.691005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75e82dd2-d9a4-481a-b414-4b59dd16ff4b tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.692333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75e82dd2-d9a4-481a-b414-4b59dd16ff4b tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.692826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8267d48e-455b-481b-aac7-68639165901e tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1061436188", "id": 897713252, "os-flavor-access:is_public": "True"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:41.696587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75e82dd2-d9a4-481a-b414-4b59dd16ff4b tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.697684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75e82dd2-d9a4-481a-b414-4b59dd16ff4b tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.698229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75e82dd2-d9a4-481a-b414-4b59dd16ff4b tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.698735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75e82dd2-d9a4-481a-b414-4b59dd16ff4b tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.700511 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:41.700511 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:41.739290 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8267d48e-455b-481b-aac7-68639165901e tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.053989 Aug 09 17:04:41.741266 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 164/361] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:41 2022] POST /compute/v2.1/flavors => generated 426 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:41.753450 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-75e82dd2-d9a4-481a-b414-4b59dd16ff4b tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=n-d-845781-6" status: 200 len: 578 microversion: 2.1 time: 0.071627 Aug 09 17:04:41.754688 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 198/362] 10.222.0.93 () {58 vars in 1172 bytes} [Tue Aug 9 17:04:41 2022] GET /compute/v2.1/os-services?host=n-d-845781-6 => generated 578 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:41.756935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c89290f-a3e3-4545-8318-dc4daf7ca4f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:41.757844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c89290f-a3e3-4545-8318-dc4daf7ca4f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:41.770846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-936e8efa-55ba-40ad-a786-462d4c0584b7 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:41.771656 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:41.771656 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:41.787399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c89290f-a3e3-4545-8318-dc4daf7ca4f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.788422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c89290f-a3e3-4545-8318-dc4daf7ca4f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.788876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c89290f-a3e3-4545-8318-dc4daf7ca4f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.789623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c89290f-a3e3-4545-8318-dc4daf7ca4f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.790359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c89290f-a3e3-4545-8318-dc4daf7ca4f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.790987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c89290f-a3e3-4545-8318-dc4daf7ca4f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.799077 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-936e8efa-55ba-40ad-a786-462d4c0584b7 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/897713252" status: 202 len: 0 microversion: 2.1 time: 0.042647 Aug 09 17:04:41.799712 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 199/363] 10.222.0.93 () {58 vars in 1158 bytes} [Tue Aug 9 17:04:41 2022] DELETE /compute/v2.1/flavors/897713252 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:04:41.807064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cb288313-272b-4505-b930-31c511adada1 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:41.810904 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:41.810904 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:41.812569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb288313-272b-4505-b930-31c511adada1 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.813547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb288313-272b-4505-b930-31c511adada1 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.814344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb288313-272b-4505-b930-31c511adada1 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.815556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb288313-272b-4505-b930-31c511adada1 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.816439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb288313-272b-4505-b930-31c511adada1 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.817372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb288313-272b-4505-b930-31c511adada1 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.854499 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cb288313-272b-4505-b930-31c511adada1 tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052688 Aug 09 17:04:41.865717 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 200/364] 10.222.0.93 () {58 vars in 1176 bytes} [Tue Aug 9 17:04:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:41.872370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-932b51a2-28aa-460d-816c-6cdc4bf951ee tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:41.897831 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-932b51a2-28aa-460d-816c-6cdc4bf951ee tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.030253 Aug 09 17:04:41.899036 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 201/365] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:41 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:41.904332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0f615aa5-d280-4a19-bcbb-fdb9a593a45a tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:41.908270 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:41.908270 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:41.910203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f615aa5-d280-4a19-bcbb-fdb9a593a45a tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.910939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f615aa5-d280-4a19-bcbb-fdb9a593a45a tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.911561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f615aa5-d280-4a19-bcbb-fdb9a593a45a tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.913158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f615aa5-d280-4a19-bcbb-fdb9a593a45a tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:41.913534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f615aa5-d280-4a19-bcbb-fdb9a593a45a tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:41.914149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f615aa5-d280-4a19-bcbb-fdb9a593a45a tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:41.952644 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0f615aa5-d280-4a19-bcbb-fdb9a593a45a tempest-ServicesAdminTestJSON-2020785873 tempest-ServicesAdminTestJSON-2020785873-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.052086 Aug 09 17:04:41.963154 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 202/366] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:04:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:41.968830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2210012c-8cdc-45a6-af90-dd2a742f77c0 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2026319676", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:41.972154 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:41.972154 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:41.999097 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2210012c-8cdc-45a6-af90-dd2a742f77c0 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.034108 Aug 09 17:04:42.008948 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 203/367] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:41 2022] POST /compute/v2.1/flavors => generated 507 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:42.009169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c89290f-a3e3-4545-8318-dc4daf7ca4f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:42.011033 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c89290f-a3e3-4545-8318-dc4daf7ca4f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1475 microversion: 2.1 time: 0.261102 Aug 09 17:04:42.011692 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 165/368] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:41 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1475 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:42.018282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-97ac14a5-3109-4a83-9a33-b6b34e616780 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:42.019332 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:42.019332 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:42.041095 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-97ac14a5-3109-4a83-9a33-b6b34e616780 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/19e24a62-d6b8-492f-9f1e-480e2c894959" status: 202 len: 0 microversion: 2.1 time: 0.026520 Aug 09 17:04:42.042013 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 204/369] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:04:42 2022] DELETE /compute/v2.1/flavors/19e24a62-d6b8-492f-9f1e-480e2c894959 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:04:42.059540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-734196b2-a7b8-4a6d-afa6-1f21e1050572 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:42.113737 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-734196b2-a7b8-4a6d-afa6-1f21e1050572 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.063540 Aug 09 17:04:42.115703 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 166/370] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:42 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:04:42.137308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2ec25e4a-f905-45d0-98fe-3dc96c3e8895 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1670114359", "id": "968c4227-34c7-473c-9e03-117f52697ac0", "os-flavor-access:is_public": "True"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:42.167135 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2ec25e4a-f905-45d0-98fe-3dc96c3e8895 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.034114 Aug 09 17:04:42.168091 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 205/371] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:42 2022] POST /compute/v2.1/flavors => generated 507 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:42.183609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bae33862-53af-471f-958c-6c10725c053d tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:42.184496 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:42.184496 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:42.205002 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bae33862-53af-471f-958c-6c10725c053d tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/968c4227-34c7-473c-9e03-117f52697ac0" status: 202 len: 0 microversion: 2.1 time: 0.025125 Aug 09 17:04:42.210237 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 167/372] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:04:42 2022] DELETE /compute/v2.1/flavors/968c4227-34c7-473c-9e03-117f52697ac0 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:04:42.214940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ddc8cc31-9004-4eaa-8f52-a25bf35c5711 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:42.243808 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ddc8cc31-9004-4eaa-8f52-a25bf35c5711 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.032654 Aug 09 17:04:42.244798 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 206/373] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:42 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:04:42.266761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0736c482-aaf6-47fd-8889-afbbaa4d4d4d tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-345548248", "id": 95125735, "os-flavor-access:is_public": "True"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:42.269947 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:42.269947 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:42.293688 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0736c482-aaf6-47fd-8889-afbbaa4d4d4d tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.1 time: 0.031969 Aug 09 17:04:42.294351 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 168/374] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:42.307308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49d438f5-4a14-459c-957e-765b4c2272b5 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:42.317365 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-49d438f5-4a14-459c-957e-765b4c2272b5 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/95125735" status: 200 len: 407 microversion: 2.1 time: 0.014541 Aug 09 17:04:42.317950 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 207/375] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:04:42 2022] GET /compute/v2.1/flavors/95125735 => generated 407 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:42.714100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-26c9fbf1-af96-487f-9f37-b26458452bc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:42.717545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-26c9fbf1-af96-487f-9f37-b26458452bc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:42.735402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c9fbf1-af96-487f-9f37-b26458452bc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:42.741703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c9fbf1-af96-487f-9f37-b26458452bc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:42.742913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c9fbf1-af96-487f-9f37-b26458452bc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:42.748619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c9fbf1-af96-487f-9f37-b26458452bc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:42.749989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c9fbf1-af96-487f-9f37-b26458452bc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:42.752741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26c9fbf1-af96-487f-9f37-b26458452bc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:42.799533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-32659da3-2d34-4363-a045-9a34eedc3e85 tempest-FlavorsAdminTestJSON-1114079693 tempest-FlavorsAdminTestJSON-1114079693-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:42.915689 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-32659da3-2d34-4363-a045-9a34eedc3e85 tempest-FlavorsAdminTestJSON-1114079693 tempest-FlavorsAdminTestJSON-1114079693-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.587629 Aug 09 17:04:42.927291 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 169/376] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:42 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:42.965939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0698c7bf-ab71-420b-bb4e-78e65044e114 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:43.081535 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0698c7bf-ab71-420b-bb4e-78e65044e114 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/95125735" status: 202 len: 0 microversion: 2.1 time: 0.134643 Aug 09 17:04:43.098188 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 170/377] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:42 2022] DELETE /compute/v2.1/flavors/95125735 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:04:43.127293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ae397832-6c4a-4c1d-81bd-c1feee256de7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:43.132566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ae397832-6c4a-4c1d-81bd-c1feee256de7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:43.178443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae397832-6c4a-4c1d-81bd-c1feee256de7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:43.180165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae397832-6c4a-4c1d-81bd-c1feee256de7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:43.181735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae397832-6c4a-4c1d-81bd-c1feee256de7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:43.183333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae397832-6c4a-4c1d-81bd-c1feee256de7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:43.184470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae397832-6c4a-4c1d-81bd-c1feee256de7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:43.185753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae397832-6c4a-4c1d-81bd-c1feee256de7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:43.711968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ae397832-6c4a-4c1d-81bd-c1feee256de7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:43.722274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ae397832-6c4a-4c1d-81bd-c1feee256de7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1475 microversion: 2.1 time: 0.622236 Aug 09 17:04:43.725785 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 171/378] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:43 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1475 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:43.738213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c7a879e3-822e-48ea-8725-1eef513fbf57 req-288c0717-f26f-4005-a885-326dabd30f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a21dd49-aca6-47cf-9381-0265b1a7a9c7", "tag": "25fa6b72-0892-44f5-bdbf-99073ca230d8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:43.775493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c7a879e3-822e-48ea-8725-1eef513fbf57 req-288c0717-f26f-4005-a885-326dabd30f0a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:43.776788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c7a879e3-822e-48ea-8725-1eef513fbf57 req-288c0717-f26f-4005-a885-326dabd30f0a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:43.777872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c7a879e3-822e-48ea-8725-1eef513fbf57 req-288c0717-f26f-4005-a885-326dabd30f0a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:43.782260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-26c9fbf1-af96-487f-9f37-b26458452bc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:43.807977 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-26c9fbf1-af96-487f-9f37-b26458452bc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1313 microversion: 2.1 time: 1.100254 Aug 09 17:04:43.810096 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 208/379] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:42 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1313 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:43.822733 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c7a879e3-822e-48ea-8725-1eef513fbf57 req-288c0717-f26f-4005-a885-326dabd30f0a service nova] Creating event network-changed:25fa6b72-0892-44f5-bdbf-99073ca230d8 for instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 on n-h2-845781-6 Aug 09 17:04:43.834326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ec5b3868-88e1-4011-8cec-bf862ca02c01 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:43.849978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-c7a879e3-822e-48ea-8725-1eef513fbf57 req-288c0717-f26f-4005-a885-326dabd30f0a service nova] Instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:04:43.874013 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c7a879e3-822e-48ea-8725-1eef513fbf57 req-288c0717-f26f-4005-a885-326dabd30f0a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142441 Aug 09 17:04:43.876092 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 172/380] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:43.927045 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ec5b3868-88e1-4011-8cec-bf862ca02c01 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.114281 Aug 09 17:04:43.928723 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 209/381] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:43 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:43.953931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:43.965554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f0316103-22df-47a3-8c4e-fa2f335de717 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-934245232", "id": 157442113, "os-flavor-access:is_public": "False"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:43.972840 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:43.972840 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:44.009380 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f0316103-22df-47a3-8c4e-fa2f335de717 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.058408 Aug 09 17:04:44.010766 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 173/382] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:43 2022] POST /compute/v2.1/flavors => generated 426 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:44.031308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a359e3f3-6a74-4e25-b01f-65107e5906cf tempest-FlavorsAdminTestJSON-1114079693 tempest-FlavorsAdminTestJSON-1114079693-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "157442113"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:44.056282 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-a359e3f3-6a74-4e25-b01f-65107e5906cf tempest-FlavorsAdminTestJSON-1114079693 tempest-FlavorsAdminTestJSON-1114079693-project] HTTP exception thrown: Flavor 157442113 could not be found. Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a359e3f3-6a74-4e25-b01f-65107e5906cf tempest-FlavorsAdminTestJSON-1114079693 tempest-FlavorsAdminTestJSON-1114079693-project] Request method failure captured: Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 106 Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOk2v5Vk3SgCkD2i_T6hrZFLl-nA3fmTSFoyMNsDD-ldyUiuRVxxVXM7dqhfv-h8XtdBqBwkK1dOcOlakpV9aVqq3iuwf-qnoHgJGnfrMRDlJGa1lPEucyNfHvd7SUB2D1yLo2P2k4_sPXZ5P2HitdPSlH-0fVaAlzKmsdBc0eCjIw Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 9df8577db7ad45a5a8de7340439b2d51 Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FlavorsAdminTestJSON-1114079693 Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:04:44.062850 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9df8577db7ad45a5a8de7340439b2d51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9df8577db7ad45a5a8de7340439b2d51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9df8577db7ad45a5a8de7340439b2d51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9df8577db7ad45a5a8de7340439b2d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FlavorsAdminTestJSON-1114079693 Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 9df8577db7ad45a5a8de7340439b2d51 Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1114079693 Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FlavorsAdminTestJSON-1114079693-project Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 578d2dc642284ad48afc49ce8c436e48 Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FlavorsAdminTestJSON-1114079693-project Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "test", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "157442113"}} Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:44.065239 n-d-845781-6 devstack@n-api.service[119432]: exception: Flavor 157442113 could not be found. Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '157442113'}}} Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 157442113 could not be found. Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:44.066740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 157442113 could not be found. Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:44.068981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:44.071511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:44.071511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:04:44.071511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:04:44.071511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 157442113 could not be found. Aug 09 17:04:44.071511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:44.076564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a359e3f3-6a74-4e25-b01f-65107e5906cf tempest-FlavorsAdminTestJSON-1114079693 tempest-FlavorsAdminTestJSON-1114079693-project] Returning 400 to user: Flavor 157442113 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:44.076564 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a359e3f3-6a74-4e25-b01f-65107e5906cf tempest-FlavorsAdminTestJSON-1114079693 tempest-FlavorsAdminTestJSON-1114079693-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.052447 Aug 09 17:04:44.078448 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 210/383] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:44 2022] POST /compute/v2.1/servers => generated 80 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:04:44.088178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75bf3df5-18c8-4f31-aae6-b6ff61bdd09b tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:44.089414 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:44.089414 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:44.127699 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75bf3df5-18c8-4f31-aae6-b6ff61bdd09b tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/157442113" status: 202 len: 0 microversion: 2.1 time: 0.044417 Aug 09 17:04:44.128523 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 174/384] 10.222.0.93 () {58 vars in 1158 bytes} [Tue Aug 9 17:04:44 2022] DELETE /compute/v2.1/flavors/157442113 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:04:44.151233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c7adfb9d-9478-4eab-9d97-6dd533c0f9b0 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:44.272576 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c7adfb9d-9478-4eab-9d97-6dd533c0f9b0 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.137595 Aug 09 17:04:44.275703 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 211/385] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:44 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:44.298802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-62396950-ea9d-46d9-9555-48640e24f483 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-946642566", "id": 851111827, "os-flavor-access:is_public": "False"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:44.347170 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-62396950-ea9d-46d9-9555-48640e24f483 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.056831 Aug 09 17:04:44.373078 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 175/386] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:44 2022] POST /compute/v2.1/flavors => generated 411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:44.381961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5f00a40c-9b94-4799-bc0a-739278da8f22 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-686081659", "id": 1546549882, "os-flavor-access:is_public": "True"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:44.392185 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:44.392185 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:44.454429 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5f00a40c-9b94-4799-bc0a-739278da8f22 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.086522 Aug 09 17:04:44.455715 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 212/387] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:44 2022] POST /compute/v2.1/flavors => generated 413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:44.470720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-79c9be52-b702-4eb9-88e9-f1e866d6e776 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:44.521493 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-79c9be52-b702-4eb9-88e9-f1e866d6e776 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.056596 Aug 09 17:04:44.526783 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 176/388] 10.222.0.93 () {58 vars in 1169 bytes} [Tue Aug 9 17:04:44 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:44.535555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b9d8228f-6a25-48d9-a0b4-427235544029 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:44.562649 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b9d8228f-6a25-48d9-a0b4-427235544029 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.030676 Aug 09 17:04:44.573691 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 213/389] 10.222.0.93 () {58 vars in 1177 bytes} [Tue Aug 9 17:04:44 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:44.607822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aefa8388-8d26-4399-ad24-731a799e218a tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:44.649878 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aefa8388-8d26-4399-ad24-731a799e218a tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.069455 Aug 09 17:04:44.653819 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 177/390] 10.222.0.93 () {58 vars in 1171 bytes} [Tue Aug 9 17:04:44 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:44.668967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-330ca08c-037e-4b76-9950-c45d97b42aaf tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:44.686963 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-330ca08c-037e-4b76-9950-c45d97b42aaf tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.022323 Aug 09 17:04:44.688215 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 214/391] 10.222.0.93 () {58 vars in 1169 bytes} [Tue Aug 9 17:04:44 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:44.710363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d7ffa216-1b82-4283-ab6c-5363dfc340e0 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:44.760314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4b80713b-2206-40db-b785-4ca521e2e77c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:44.764394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4b80713b-2206-40db-b785-4ca521e2e77c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:44.787369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b80713b-2206-40db-b785-4ca521e2e77c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:44.788577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b80713b-2206-40db-b785-4ca521e2e77c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:44.794988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b80713b-2206-40db-b785-4ca521e2e77c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:44.798357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b80713b-2206-40db-b785-4ca521e2e77c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:44.805069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b80713b-2206-40db-b785-4ca521e2e77c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:44.805836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b80713b-2206-40db-b785-4ca521e2e77c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:44.820539 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d7ffa216-1b82-4283-ab6c-5363dfc340e0 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6224 microversion: 2.1 time: 0.122430 Aug 09 17:04:44.822946 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 178/392] 10.222.0.93 () {58 vars in 1169 bytes} [Tue Aug 9 17:04:44 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:45.098456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4b80713b-2206-40db-b785-4ca521e2e77c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:45.113464 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4b80713b-2206-40db-b785-4ca521e2e77c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1473 microversion: 2.1 time: 0.361088 Aug 09 17:04:45.115853 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 215/393] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:44 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1473 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:45.129700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9ec89573-0152-4407-bb47-22ec9d657eb5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:45.130798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9ec89573-0152-4407-bb47-22ec9d657eb5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:45.142191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ec89573-0152-4407-bb47-22ec9d657eb5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:45.143905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ec89573-0152-4407-bb47-22ec9d657eb5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:45.144616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ec89573-0152-4407-bb47-22ec9d657eb5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:45.146632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ec89573-0152-4407-bb47-22ec9d657eb5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:45.147347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ec89573-0152-4407-bb47-22ec9d657eb5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:45.148082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ec89573-0152-4407-bb47-22ec9d657eb5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:45.356633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9ec89573-0152-4407-bb47-22ec9d657eb5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:45.369533 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9ec89573-0152-4407-bb47-22ec9d657eb5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1313 microversion: 2.1 time: 0.251491 Aug 09 17:04:45.370428 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 216/394] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:45 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:45.377134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8ebad6ce-44fd-4adb-84d4-3d0dd8f8a896 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:45.410142 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8ebad6ce-44fd-4adb-84d4-3d0dd8f8a896 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6224 microversion: 2.1 time: 0.037402 Aug 09 17:04:45.420802 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 217/395] 10.222.0.93 () {58 vars in 1175 bytes} [Tue Aug 9 17:04:45 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6224 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:45.438850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5325cd5-bfb2-4233-a668-cd97a1ccdadf tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:45.502304 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5325cd5-bfb2-4233-a668-cd97a1ccdadf tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6224 microversion: 2.1 time: 0.071915 Aug 09 17:04:45.520492 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 218/396] 10.222.0.93 () {58 vars in 1173 bytes} [Tue Aug 9 17:04:45 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:45.530616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93b99f7e-7ae3-42a3-939e-e99402c61f4f tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcbe8caf0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:45.562724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e63449f4-2886-4fe3-b015-f7e774babcbe tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:45.617456 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e63449f4-2886-4fe3-b015-f7e774babcbe tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6224 microversion: 2.1 time: 0.062390 Aug 09 17:04:45.621489 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 219/397] 10.222.0.93 () {58 vars in 1169 bytes} [Tue Aug 9 17:04:45 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6224 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:45.653648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-07a8f106-5e47-43c0-bca0-03c6df779dd8 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:45.654618 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:45.654618 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:45.687953 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-07a8f106-5e47-43c0-bca0-03c6df779dd8 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1546549882" status: 202 len: 0 microversion: 2.1 time: 0.040665 Aug 09 17:04:45.691707 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 220/398] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:04:45 2022] DELETE /compute/v2.1/flavors/1546549882 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:04:45.718935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bc4cbc6e-18ce-44a0-b91d-075602c51114 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:45.762126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=12 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:45.784273 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bc4cbc6e-18ce-44a0-b91d-075602c51114 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.086084 Aug 09 17:04:45.786364 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 221/399] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:45 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:04:45.822536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bf1e7002-6e62-4be7-88f1-c5548823cdfb tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:45.852245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=14,nova_api:INSERT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:45.900460 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bf1e7002-6e62-4be7-88f1-c5548823cdfb tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/851111827" status: 202 len: 0 microversion: 2.1 time: 0.084093 Aug 09 17:04:45.903072 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 222/400] 10.222.0.93 () {58 vars in 1158 bytes} [Tue Aug 9 17:04:45 2022] DELETE /compute/v2.1/flavors/851111827 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:04:45.913387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b99f7e-7ae3-42a3-939e-e99402c61f4f tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:45.914073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b99f7e-7ae3-42a3-939e-e99402c61f4f tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:45.914645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b99f7e-7ae3-42a3-939e-e99402c61f4f tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:45.915984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b99f7e-7ae3-42a3-939e-e99402c61f4f tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:45.919061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b99f7e-7ae3-42a3-939e-e99402c61f4f tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:45.920250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b99f7e-7ae3-42a3-939e-e99402c61f4f tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:45.923873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ebd6f89b-e30f-4c1c-8299-71ea23490199 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:45.975245 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ebd6f89b-e30f-4c1c-8299-71ea23490199 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.064619 Aug 09 17:04:45.976996 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 223/401] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:45 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:46.017497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-67684db7-1d4f-4a10-ab96-e5c142168f03 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1320335449", "id": 64079777, "os-flavor-access:is_public": "False"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:46.034030 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:46.034030 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:46.042981 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-93b99f7e-7ae3-42a3-939e-e99402c61f4f tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/355fb45fc4ef44eca11170b41aa7649e" status: 200 len: 240 microversion: 2.36 time: 1.206714 Aug 09 17:04:46.044466 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 179/402] 10.222.0.93 () {62 vars in 1303 bytes} [Tue Aug 9 17:04:44 2022] PUT /compute/v2.1/os-quota-sets/355fb45fc4ef44eca11170b41aa7649e => generated 240 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:04:46.067221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec4fbdb4-c62a-4598-ae43-b08924efc3b3 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Calling method '.version_select at 0x7fbbd8160ee0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:46.103102 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-67684db7-1d4f-4a10-ab96-e5c142168f03 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.106722 Aug 09 17:04:46.107326 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 224/403] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:46.134463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5964b633-f48b-4794-a3d4-2f66991811b2 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:46.196955 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5964b633-f48b-4794-a3d4-2f66991811b2 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.081222 Aug 09 17:04:46.201175 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 225/404] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:46 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:46.230456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b7346082-9013-4d4b-84c7-96ee7214e3de tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:46.235828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b7346082-9013-4d4b-84c7-96ee7214e3de tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:46.261521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7346082-9013-4d4b-84c7-96ee7214e3de tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:46.262525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7346082-9013-4d4b-84c7-96ee7214e3de tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:46.263970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7346082-9013-4d4b-84c7-96ee7214e3de tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:46.271331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7346082-9013-4d4b-84c7-96ee7214e3de tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:46.272300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7346082-9013-4d4b-84c7-96ee7214e3de tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:46.273088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7346082-9013-4d4b-84c7-96ee7214e3de tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:46.484688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec4fbdb4-c62a-4598-ae43-b08924efc3b3 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:46.487356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec4fbdb4-c62a-4598-ae43-b08924efc3b3 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:46.490154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec4fbdb4-c62a-4598-ae43-b08924efc3b3 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:46.492719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec4fbdb4-c62a-4598-ae43-b08924efc3b3 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:46.495456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec4fbdb4-c62a-4598-ae43-b08924efc3b3 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:46.499040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec4fbdb4-c62a-4598-ae43-b08924efc3b3 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:46.557954 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ec4fbdb4-c62a-4598-ae43-b08924efc3b3 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/355fb45fc4ef44eca11170b41aa7649e/detail" status: 200 len: 672 microversion: 2.36 time: 0.497745 Aug 09 17:04:46.560196 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 180/405] 10.222.0.93 () {60 vars in 1304 bytes} [Tue Aug 9 17:04:46 2022] GET /compute/v2.1/os-quota-sets/355fb45fc4ef44eca11170b41aa7649e/detail => generated 672 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:04:46.574579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7db19212-8240-4d98-9f98-f1072e2006b0 tempest-FlavorsAdminTestJSON-1114079693 tempest-FlavorsAdminTestJSON-1114079693-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:46.645045 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7db19212-8240-4d98-9f98-f1072e2006b0 tempest-FlavorsAdminTestJSON-1114079693 tempest-FlavorsAdminTestJSON-1114079693-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.082766 Aug 09 17:04:46.648902 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 181/406] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:46 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:46.664261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-72cc0548-994a-457e-8239-ab0ae578d40f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:46.666595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-72cc0548-994a-457e-8239-ab0ae578d40f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:46.687547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cc0548-994a-457e-8239-ab0ae578d40f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:46.693750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cc0548-994a-457e-8239-ab0ae578d40f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:46.695482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cc0548-994a-457e-8239-ab0ae578d40f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:46.697364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cc0548-994a-457e-8239-ab0ae578d40f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:46.699041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cc0548-994a-457e-8239-ab0ae578d40f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:46.701662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cc0548-994a-457e-8239-ab0ae578d40f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:47.350309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b7346082-9013-4d4b-84c7-96ee7214e3de tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:47.369854 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b7346082-9013-4d4b-84c7-96ee7214e3de tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1473 microversion: 2.1 time: 1.166398 Aug 09 17:04:47.374259 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 226/407] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:46 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1473 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:47.386270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-72cc0548-994a-457e-8239-ab0ae578d40f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:47.400904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-146a2ab6-710e-48ee-804e-9e7e332987b2 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:47.405293 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:47.405293 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:47.407788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-72cc0548-994a-457e-8239-ab0ae578d40f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1313 microversion: 2.1 time: 0.754130 Aug 09 17:04:47.426073 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 182/408] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:46 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1313 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:47.438265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Action: 'update', calling method: .version_select at 0x7fbbd8160ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:47.464867 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-146a2ab6-710e-48ee-804e-9e7e332987b2 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/64079777" status: 202 len: 0 microversion: 2.1 time: 0.085683 Aug 09 17:04:47.466528 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 227/409] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:04:47 2022] DELETE /compute/v2.1/flavors/64079777 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:04:47.490108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d741180-ad58-4dd0-a435-db3f245fd3ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:47.492196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0d741180-ad58-4dd0-a435-db3f245fd3ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:47.509662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d741180-ad58-4dd0-a435-db3f245fd3ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:47.510204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d741180-ad58-4dd0-a435-db3f245fd3ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:47.510815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d741180-ad58-4dd0-a435-db3f245fd3ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:47.511557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d741180-ad58-4dd0-a435-db3f245fd3ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:47.512200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d741180-ad58-4dd0-a435-db3f245fd3ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:47.513961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d741180-ad58-4dd0-a435-db3f245fd3ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:47.552134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0d741180-ad58-4dd0-a435-db3f245fd3ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:04:47.718883 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0d741180-ad58-4dd0-a435-db3f245fd3ae tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 204 len: 0 microversion: 2.1 time: 0.250704 Aug 09 17:04:47.719767 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 228/410] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:04:47 2022] DELETE /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:04:47.725201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ccb50b3a-2008-41ad-8494-375f97134cb5 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:47.753216 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ccb50b3a-2008-41ad-8494-375f97134cb5 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.031974 Aug 09 17:04:47.755496 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 229/411] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:47 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:47.776013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-f629d507-f04f-4aba-8bb2-bf97b95d6033 req-c093930f-041c-43ad-9d1a-12e8b67955ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85044e48-08e5-4d4f-a2c2-f396b3b51bad", "name": "network-vif-plugged", "status": "completed", "tag": "5aeb30eb-e018-4a15-ac48-f3c1ab29281b"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:47.799320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f629d507-f04f-4aba-8bb2-bf97b95d6033 req-c093930f-041c-43ad-9d1a-12e8b67955ac service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:47.800155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f629d507-f04f-4aba-8bb2-bf97b95d6033 req-c093930f-041c-43ad-9d1a-12e8b67955ac service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:47.800936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f629d507-f04f-4aba-8bb2-bf97b95d6033 req-c093930f-041c-43ad-9d1a-12e8b67955ac service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:47.816662 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-f629d507-f04f-4aba-8bb2-bf97b95d6033 req-c093930f-041c-43ad-9d1a-12e8b67955ac service nova] Creating event network-vif-plugged:5aeb30eb-e018-4a15-ac48-f3c1ab29281b for instance 85044e48-08e5-4d4f-a2c2-f396b3b51bad on n-h2-845781-6 Aug 09 17:04:47.826027 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-f629d507-f04f-4aba-8bb2-bf97b95d6033 req-c093930f-041c-43ad-9d1a-12e8b67955ac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067979 Aug 09 17:04:47.826773 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 230/412] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:47.832770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-195e16c5-08cf-449d-9659-e789cd861c00 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-844877790", "id": 1323727214, "os-flavor-access:is_public": "True"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:47.837084 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:47.837084 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:47.860096 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-195e16c5-08cf-449d-9659-e789cd861c00 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.031849 Aug 09 17:04:47.861238 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 231/413] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:47 2022] POST /compute/v2.1/flavors => generated 413 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:47.877756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-75ff7267-9df0-45a1-8c1c-03a07d5e31e0 tempest-FlavorsAdminTestJSON-1114079693 tempest-FlavorsAdminTestJSON-1114079693-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:47.914320 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-75ff7267-9df0-45a1-8c1c-03a07d5e31e0 tempest-FlavorsAdminTestJSON-1114079693 tempest-FlavorsAdminTestJSON-1114079693-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.040831 Aug 09 17:04:47.915050 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 232/414] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:47 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:47.949428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4acbb66d-ee66-4af2-8b1b-bafab9536053 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:47.950954 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:47.950954 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:47.999074 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4acbb66d-ee66-4af2-8b1b-bafab9536053 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1323727214" status: 202 len: 0 microversion: 2.1 time: 0.053258 Aug 09 17:04:48.002082 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 233/415] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:04:47 2022] DELETE /compute/v2.1/flavors/1323727214 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:04:48.015811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69959ed5-1684-416e-a1f9-e49d0ee5aef3 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:48.068797 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69959ed5-1684-416e-a1f9-e49d0ee5aef3 tempest-FlavorsAdminTestJSON-1218426219 tempest-FlavorsAdminTestJSON-1218426219-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.056356 Aug 09 17:04:48.070387 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 234/416] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:48 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:48.225369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:48.226303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:48.227469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:48.229538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:48.237856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:48.239262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:48.317921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-763765366", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "1334699906", "adminPass": "***", "networks": [{"uuid": "0c6f761a-60bb-4d46-b49c-d69750590422"}], "security_groups": [{"name": "tempest-securitygroup--1892334101"}], "key_name": "tempest-keypair-85641018", "user_data": "}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:48.401485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:48.402387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:48.408440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:48.410437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:48.411298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:48.412097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:48.616421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] validate_networks() for [('0c6f761a-60bb-4d46-b49c-d69750590422', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:04:48.689103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:48.746326 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-18b430a4-41cd-419d-bb75-26b90dddc386 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/355fb45fc4ef44eca11170b41aa7649e?user_id=6cf2ec076ad44e758eff8623da45a2cb" status: 200 len: 240 microversion: 2.36 time: 1.318002 Aug 09 17:04:48.770895 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 183/417] 10.222.0.93 () {62 vars in 1384 bytes} [Tue Aug 9 17:04:47 2022] PUT /compute/v2.1/os-quota-sets/355fb45fc4ef44eca11170b41aa7649e?user_id=6cf2ec076ad44e758eff8623da45a2cb => generated 240 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:04:48.797525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fc58d933-8ac9-4ef3-9805-d382b381fc9c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:48.798700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fc58d933-8ac9-4ef3-9805-d382b381fc9c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:48.825033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc58d933-8ac9-4ef3-9805-d382b381fc9c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:48.826437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc58d933-8ac9-4ef3-9805-d382b381fc9c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:48.827569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc58d933-8ac9-4ef3-9805-d382b381fc9c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:48.835370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc58d933-8ac9-4ef3-9805-d382b381fc9c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:48.836309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc58d933-8ac9-4ef3-9805-d382b381fc9c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:48.837448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc58d933-8ac9-4ef3-9805-d382b381fc9c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:49.593591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fc58d933-8ac9-4ef3-9805-d382b381fc9c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:49.610275 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fc58d933-8ac9-4ef3-9805-d382b381fc9c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1470 microversion: 2.1 time: 0.837894 Aug 09 17:04:49.610896 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 184/418] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:48 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1470 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:49.636885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-45a0720b-99e7-462b-af87-727144e40027 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:49.639747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-45a0720b-99e7-462b-af87-727144e40027 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:49.648346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0720b-99e7-462b-af87-727144e40027 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:49.649198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0720b-99e7-462b-af87-727144e40027 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:49.649920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0720b-99e7-462b-af87-727144e40027 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:49.651419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0720b-99e7-462b-af87-727144e40027 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:49.652150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0720b-99e7-462b-af87-727144e40027 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:49.652841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0720b-99e7-462b-af87-727144e40027 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:50.452183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-45a0720b-99e7-462b-af87-727144e40027 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:50.467345 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-45a0720b-99e7-462b-af87-727144e40027 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1313 microversion: 2.1 time: 0.855335 Aug 09 17:04:50.468252 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 185/419] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:49 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1313 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:50.484587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5b1f9b8a-12e9-45dc-ad45-759bd00464d4 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] Calling method '.version_select at 0x7fbbcbf04790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:50.905200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:04:50.907293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:04:50.910488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:04:50.911473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:04:50.912463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:04:50.953330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:50.954577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:50.955705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:50.957379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:50.958218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:50.959215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:50.997818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=11 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:51.031291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Getting quotas for project 5137eb4f54ad48b3ba4de9307b6e80ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:04:51.040778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Getting quotas for user ff70314be08b4abda96586877f4d6309 and project 5137eb4f54ad48b3ba4de9307b6e80ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:04:51.066993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:04:51.073388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:04:51.218650 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d63c7b95-9d26-4636-8c12-2807c09fffe9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.908653 Aug 09 17:04:51.223226 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 235/420] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:04:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:04:51.233474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8949a047-e928-4dfc-a527-7250baa0c836 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:51.235053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8949a047-e928-4dfc-a527-7250baa0c836 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:51.248745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8949a047-e928-4dfc-a527-7250baa0c836 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:51.250757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8949a047-e928-4dfc-a527-7250baa0c836 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:51.253733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8949a047-e928-4dfc-a527-7250baa0c836 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:51.255995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8949a047-e928-4dfc-a527-7250baa0c836 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:51.257782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8949a047-e928-4dfc-a527-7250baa0c836 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:51.258936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8949a047-e928-4dfc-a527-7250baa0c836 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:51.352086 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5b1f9b8a-12e9-45dc-ad45-759bd00464d4 tempest-QuotasAdminTestV236-2035475131 tempest-QuotasAdminTestV236-2035475131-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/355fb45fc4ef44eca11170b41aa7649e?user_id=6cf2ec076ad44e758eff8623da45a2cb" status: 200 len: 282 microversion: 2.36 time: 0.881263 Aug 09 17:04:51.359861 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 186/421] 10.222.0.93 () {60 vars in 1364 bytes} [Tue Aug 9 17:04:50 2022] GET /compute/v2.1/os-quota-sets/355fb45fc4ef44eca11170b41aa7649e?user_id=6cf2ec076ad44e758eff8623da45a2cb => generated 282 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:04:51.535582 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8949a047-e928-4dfc-a527-7250baa0c836 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "POST /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7/action" status: 204 len: 0 microversion: 2.1 time: 0.308647 Aug 09 17:04:51.537885 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 236/422] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:04:51 2022] POST /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7/action => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:04:51.556429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-90e38315-03e7-4b28-9caf-18d43c71d86e tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:51.561485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-90e38315-03e7-4b28-9caf-18d43c71d86e tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:51.695053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90e38315-03e7-4b28-9caf-18d43c71d86e tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:51.708285 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-90e38315-03e7-4b28-9caf-18d43c71d86e tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1262 microversion: 2.1 time: 0.163852 Aug 09 17:04:51.722532 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 237/423] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:51 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1262 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:51.743714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d133a9f5-d825-4eaf-ab7c-f0068017b38e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:51.745158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d133a9f5-d825-4eaf-ab7c-f0068017b38e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:51.762744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d133a9f5-d825-4eaf-ab7c-f0068017b38e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:51.764217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d133a9f5-d825-4eaf-ab7c-f0068017b38e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:51.765477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d133a9f5-d825-4eaf-ab7c-f0068017b38e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:51.767022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d133a9f5-d825-4eaf-ab7c-f0068017b38e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:51.768389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d133a9f5-d825-4eaf-ab7c-f0068017b38e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:51.769506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d133a9f5-d825-4eaf-ab7c-f0068017b38e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:52.065512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d133a9f5-d825-4eaf-ab7c-f0068017b38e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:52.077013 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d133a9f5-d825-4eaf-ab7c-f0068017b38e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1462 microversion: 2.1 time: 0.351470 Aug 09 17:04:52.092880 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 238/424] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:51 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1462 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:52.103168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ea94d077-f4d3-450e-927c-d34b780fbf0a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:52.111756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ea94d077-f4d3-450e-927c-d34b780fbf0a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:52.141447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea94d077-f4d3-450e-927c-d34b780fbf0a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:52.142926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea94d077-f4d3-450e-927c-d34b780fbf0a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:52.144551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea94d077-f4d3-450e-927c-d34b780fbf0a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:52.146576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea94d077-f4d3-450e-927c-d34b780fbf0a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:52.148284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea94d077-f4d3-450e-927c-d34b780fbf0a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:52.150331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea94d077-f4d3-450e-927c-d34b780fbf0a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:52.298561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af870e8a-379c-4b34-89b1-69003a0823f9 tempest-AZAdminNegativeTestJSON-711907773 tempest-AZAdminNegativeTestJSON-711907773-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:52.299520 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:52.299520 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:04:52.300450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-af870e8a-379c-4b34-89b1-69003a0823f9 tempest-AZAdminNegativeTestJSON-711907773 tempest-AZAdminNegativeTestJSON-711907773-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '59a462c4120d496f92d4d6baff45dba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1083620f694dc6840ddc790d8166b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af870e8a-379c-4b34-89b1-69003a0823f9 tempest-AZAdminNegativeTestJSON-711907773 tempest-AZAdminNegativeTestJSON-711907773-project] Request method failure captured: Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOvlqAKIXsqSZyDgjcZ5Ye3avSGIZQUBPJ3yb_4c4o80fH6QY5JMQNCOvXq0KPuw2GWiqxdkvI6ODM8s3HcR_BIHhMMd-AyVvOPJpLYoT-Ew03lzjdAQ3b4SPysGRYcSNiilq57LdYizVBCRco5Ylvu76-G4PMIdYK6KtX4BRtgoVU Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 2e1083620f694dc6840ddc790d8166b3 Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AZAdminNegativeTestJSON-711907773 Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:04:52.306861 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2e1083620f694dc6840ddc790d8166b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2e1083620f694dc6840ddc790d8166b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2e1083620f694dc6840ddc790d8166b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2e1083620f694dc6840ddc790d8166b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AZAdminNegativeTestJSON-711907773 Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 2e1083620f694dc6840ddc790d8166b3 Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-711907773 Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AZAdminNegativeTestJSON-711907773-project Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 59a462c4120d496f92d4d6baff45dba4 Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AZAdminNegativeTestJSON-711907773-project Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 09 17:04:52.308236 n-d-845781-6 devstack@n-api.service[119431]: action_args: {} Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:52.308937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:04:52.310052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af870e8a-379c-4b34-89b1-69003a0823f9 tempest-AZAdminNegativeTestJSON-711907773 tempest-AZAdminNegativeTestJSON-711907773-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:52.311665 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-af870e8a-379c-4b34-89b1-69003a0823f9 tempest-AZAdminNegativeTestJSON-711907773 tempest-AZAdminNegativeTestJSON-711907773-project] 10.222.0.93 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.952609 Aug 09 17:04:52.313697 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 187/425] 10.222.0.93 () {58 vars in 1185 bytes} [Tue Aug 9 17:04:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 958 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:52.550635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ea94d077-f4d3-450e-927c-d34b780fbf0a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:52.560820 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ea94d077-f4d3-450e-927c-d34b780fbf0a tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1470 microversion: 2.1 time: 0.466331 Aug 09 17:04:52.561494 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 239/426] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:52 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1470 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:52.730379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bcd549d2-2479-44f1-a3f4-302a1967ad4a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:52.731382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bcd549d2-2479-44f1-a3f4-302a1967ad4a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:52.744324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcd549d2-2479-44f1-a3f4-302a1967ad4a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:52.747606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcd549d2-2479-44f1-a3f4-302a1967ad4a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:52.749921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcd549d2-2479-44f1-a3f4-302a1967ad4a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:52.750883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcd549d2-2479-44f1-a3f4-302a1967ad4a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:52.754791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcd549d2-2479-44f1-a3f4-302a1967ad4a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:52.755590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcd549d2-2479-44f1-a3f4-302a1967ad4a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:52.961316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bcd549d2-2479-44f1-a3f4-302a1967ad4a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:52.983789 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bcd549d2-2479-44f1-a3f4-302a1967ad4a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1266 microversion: 2.1 time: 0.252596 Aug 09 17:04:52.984502 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 240/427] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:52 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:53.231022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-b399472c-d7b6-452d-aa83-eea308393396 req-0e9de8ca-0594-44fc-a546-9aa8d7e1cc19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a21dd49-aca6-47cf-9381-0265b1a7a9c7", "name": "network-vif-plugged", "status": "completed", "tag": "25fa6b72-0892-44f5-bdbf-99073ca230d8"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:53.265442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b399472c-d7b6-452d-aa83-eea308393396 req-0e9de8ca-0594-44fc-a546-9aa8d7e1cc19 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:53.269192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b399472c-d7b6-452d-aa83-eea308393396 req-0e9de8ca-0594-44fc-a546-9aa8d7e1cc19 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:53.270788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b399472c-d7b6-452d-aa83-eea308393396 req-0e9de8ca-0594-44fc-a546-9aa8d7e1cc19 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:53.315175 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-b399472c-d7b6-452d-aa83-eea308393396 req-0e9de8ca-0594-44fc-a546-9aa8d7e1cc19 service nova] Creating event network-vif-plugged:25fa6b72-0892-44f5-bdbf-99073ca230d8 for instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 on n-h2-845781-6 Aug 09 17:04:53.321048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:53.336726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-b399472c-d7b6-452d-aa83-eea308393396 req-0e9de8ca-0594-44fc-a546-9aa8d7e1cc19 service nova] Instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:04:53.368794 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-b399472c-d7b6-452d-aa83-eea308393396 req-0e9de8ca-0594-44fc-a546-9aa8d7e1cc19 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148062 Aug 09 17:04:53.370254 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 241/428] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 09 17:04:53.383488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-28fd63f4-10d0-4551-8b9a-587b15e47414 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:53.401547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-28fd63f4-10d0-4551-8b9a-587b15e47414 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Searching by: {'deleted': False, 'project_id': '13cc4522e7a341b09776dea87bd8c5df'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:04:53.408087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28fd63f4-10d0-4551-8b9a-587b15e47414 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:53.408607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28fd63f4-10d0-4551-8b9a-587b15e47414 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:53.409049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28fd63f4-10d0-4551-8b9a-587b15e47414 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:53.409777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28fd63f4-10d0-4551-8b9a-587b15e47414 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:53.410415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28fd63f4-10d0-4551-8b9a-587b15e47414 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:53.410999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28fd63f4-10d0-4551-8b9a-587b15e47414 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:53.586294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6c784ccf-9692-4d21-88dd-f6e43eacc417 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:53.587000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6c784ccf-9692-4d21-88dd-f6e43eacc417 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:53.616902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c784ccf-9692-4d21-88dd-f6e43eacc417 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:53.617400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c784ccf-9692-4d21-88dd-f6e43eacc417 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:53.617842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c784ccf-9692-4d21-88dd-f6e43eacc417 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:53.618709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c784ccf-9692-4d21-88dd-f6e43eacc417 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:53.619278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c784ccf-9692-4d21-88dd-f6e43eacc417 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:53.619951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c784ccf-9692-4d21-88dd-f6e43eacc417 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:53.651532 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-28fd63f4-10d0-4551-8b9a-587b15e47414 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 1.336670 Aug 09 17:04:53.669474 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 188/429] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:04:52 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:04:53.705454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:53.751284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Searching by: {'deleted': False} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:04:53.773007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:53.804554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:53.807898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:53.811036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:53.812029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:53.816783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:54.103769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6c784ccf-9692-4d21-88dd-f6e43eacc417 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:54.144271 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6c784ccf-9692-4d21-88dd-f6e43eacc417 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1470 microversion: 2.1 time: 0.561898 Aug 09 17:04:54.146772 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 242/430] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:53 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1470 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:04:54.172257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bcbf32cc-5750-414a-a342-06b263a7dc2c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:54.173588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bcbf32cc-5750-414a-a342-06b263a7dc2c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:54.191232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:04:54.212072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcbf32cc-5750-414a-a342-06b263a7dc2c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:54.213298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcbf32cc-5750-414a-a342-06b263a7dc2c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:54.214089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcbf32cc-5750-414a-a342-06b263a7dc2c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:54.217919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcbf32cc-5750-414a-a342-06b263a7dc2c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:54.220693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcbf32cc-5750-414a-a342-06b263a7dc2c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:54.229022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcbf32cc-5750-414a-a342-06b263a7dc2c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:54.506526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bcbf32cc-5750-414a-a342-06b263a7dc2c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:54.539987 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bcbf32cc-5750-414a-a342-06b263a7dc2c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1322 microversion: 2.1 time: 0.387206 Aug 09 17:04:54.541095 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 243/431] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:54 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:54.679369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:54.681510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:54.682897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:54.938218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ff1625e-52b5-4984-8414-43e6759da713 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:54.954532 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:54.954532 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:54.957788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff1625e-52b5-4984-8414-43e6759da713 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:54.958932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff1625e-52b5-4984-8414-43e6759da713 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:54.964422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff1625e-52b5-4984-8414-43e6759da713 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:54.966450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff1625e-52b5-4984-8414-43e6759da713 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:54.970823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff1625e-52b5-4984-8414-43e6759da713 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:54.972087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff1625e-52b5-4984-8414-43e6759da713 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:55.100001 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3ff1625e-52b5-4984-8414-43e6759da713 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.553791 Aug 09 17:04:55.115404 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 244/432] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:04:54 2022] GET /compute/v2.1/os-services => generated 944 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:55.125842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6a3a6524-6666-4732-8c89-c1420cf68eb0 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:55.135184 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:55.135184 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:55.140789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3a6524-6666-4732-8c89-c1420cf68eb0 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:55.141898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3a6524-6666-4732-8c89-c1420cf68eb0 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:55.142875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3a6524-6666-4732-8c89-c1420cf68eb0 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:55.146911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3a6524-6666-4732-8c89-c1420cf68eb0 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:55.147880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3a6524-6666-4732-8c89-c1420cf68eb0 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:55.148645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3a6524-6666-4732-8c89-c1420cf68eb0 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:55.274809 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6a3a6524-6666-4732-8c89-c1420cf68eb0 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.154902 Aug 09 17:04:55.276591 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 245/433] 10.222.0.93 () {58 vars in 1170 bytes} [Tue Aug 9 17:04:55 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:55.294410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-32dc1c13-f28a-4d9a-8f98-3c2e71c7dfdb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:55.301278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-32dc1c13-f28a-4d9a-8f98-3c2e71c7dfdb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:55.327727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32dc1c13-f28a-4d9a-8f98-3c2e71c7dfdb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:55.328533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32dc1c13-f28a-4d9a-8f98-3c2e71c7dfdb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:55.329325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32dc1c13-f28a-4d9a-8f98-3c2e71c7dfdb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:55.330790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32dc1c13-f28a-4d9a-8f98-3c2e71c7dfdb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:55.335501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32dc1c13-f28a-4d9a-8f98-3c2e71c7dfdb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:55.336688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32dc1c13-f28a-4d9a-8f98-3c2e71c7dfdb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:56.420253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-32dc1c13-f28a-4d9a-8f98-3c2e71c7dfdb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:56.453672 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-32dc1c13-f28a-4d9a-8f98-3c2e71c7dfdb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1470 microversion: 2.1 time: 1.171736 Aug 09 17:04:56.470898 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 246/434] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:55 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1470 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:56.485317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6f48b802-1970-48f7-8449-a0b34d59d515 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:56.488234 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:56.488234 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:56.501167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f48b802-1970-48f7-8449-a0b34d59d515 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:56.501713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f48b802-1970-48f7-8449-a0b34d59d515 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:56.502217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f48b802-1970-48f7-8449-a0b34d59d515 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:56.503030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f48b802-1970-48f7-8449-a0b34d59d515 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:56.503503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f48b802-1970-48f7-8449-a0b34d59d515 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:56.504128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f48b802-1970-48f7-8449-a0b34d59d515 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:56.567723 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6f48b802-1970-48f7-8449-a0b34d59d515 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.095523 Aug 09 17:04:56.576199 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 247/435] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:04:56 2022] GET /compute/v2.1/os-services => generated 944 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:56.594024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-41cd9f99-4094-4650-8192-b3fb8f77d1ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:56.595524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-41cd9f99-4094-4650-8192-b3fb8f77d1ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:56.607227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cd9f99-4094-4650-8192-b3fb8f77d1ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:56.608741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cd9f99-4094-4650-8192-b3fb8f77d1ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:56.609478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cd9f99-4094-4650-8192-b3fb8f77d1ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:56.610474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cd9f99-4094-4650-8192-b3fb8f77d1ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:56.611178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cd9f99-4094-4650-8192-b3fb8f77d1ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:56.611896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cd9f99-4094-4650-8192-b3fb8f77d1ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:56.823681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-41cd9f99-4094-4650-8192-b3fb8f77d1ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:56.835236 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-41cd9f99-4094-4650-8192-b3fb8f77d1ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1320 microversion: 2.1 time: 0.257680 Aug 09 17:04:56.852157 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 248/436] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:56 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:56.889773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ca6f98b4-3571-45fe-8009-4f5e0b2f4a13 req-df5918fc-b675-4a7a-8bf8-c6c124eab220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1ebe1f-c944-4f78-84df-43776f1eb671", "name": "network-vif-deleted", "tag": "a813e9bf-51e2-4577-9543-ad1edc45394e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:56.898210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=7,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:56.917395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ca6f98b4-3571-45fe-8009-4f5e0b2f4a13 req-df5918fc-b675-4a7a-8bf8-c6c124eab220 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:56.917934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ca6f98b4-3571-45fe-8009-4f5e0b2f4a13 req-df5918fc-b675-4a7a-8bf8-c6c124eab220 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:56.918891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ca6f98b4-3571-45fe-8009-4f5e0b2f4a13 req-df5918fc-b675-4a7a-8bf8-c6c124eab220 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:56.941720 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ca6f98b4-3571-45fe-8009-4f5e0b2f4a13 req-df5918fc-b675-4a7a-8bf8-c6c124eab220 service nova] Creating event network-vif-deleted:a813e9bf-51e2-4577-9543-ad1edc45394e for instance cb1ebe1f-c944-4f78-84df-43776f1eb671 on n-h2-845781-6 Aug 09 17:04:56.951491 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ca6f98b4-3571-45fe-8009-4f5e0b2f4a13 req-df5918fc-b675-4a7a-8bf8-c6c124eab220 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097544 Aug 09 17:04:56.952465 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 249/437] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:56.958393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e9203012-14a3-43ca-924e-2c37bdc18aaa tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:56.961228 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:56.961228 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:56.962584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9203012-14a3-43ca-924e-2c37bdc18aaa tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:56.963917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9203012-14a3-43ca-924e-2c37bdc18aaa tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:56.963917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9203012-14a3-43ca-924e-2c37bdc18aaa tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:56.970350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9203012-14a3-43ca-924e-2c37bdc18aaa tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:56.970856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9203012-14a3-43ca-924e-2c37bdc18aaa tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:56.971742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9203012-14a3-43ca-924e-2c37bdc18aaa tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.071646 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e9203012-14a3-43ca-924e-2c37bdc18aaa tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=n-d-845781-6&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.117480 Aug 09 17:04:57.073002 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 250/438] 10.222.0.93 () {58 vars in 1194 bytes} [Tue Aug 9 17:04:56 2022] GET /compute/v2.1/os-services?host=n-d-845781-6&binary=xxx => generated 16 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:04:57.085829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7b9e414b-b604-4b4e-9117-4dc329b28777 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:57.089876 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:57.089876 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:57.093433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b9e414b-b604-4b4e-9117-4dc329b28777 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.099608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b9e414b-b604-4b4e-9117-4dc329b28777 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.100386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b9e414b-b604-4b4e-9117-4dc329b28777 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.101482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b9e414b-b604-4b4e-9117-4dc329b28777 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.105983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b9e414b-b604-4b4e-9117-4dc329b28777 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.107438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b9e414b-b604-4b4e-9117-4dc329b28777 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.173461 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7b9e414b-b604-4b4e-9117-4dc329b28777 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.091688 Aug 09 17:04:57.182428 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 251/439] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:04:57 2022] GET /compute/v2.1/os-services => generated 944 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:57.196316 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ed88cddb-b004-45d1-a517-cce75db8e90b tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 9686 microversion: 2.1 time: 3.517351 Aug 09 17:04:57.197096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0cb9ebc3-467e-482b-8e30-bb9fbf19e869 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:57.198539 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 189/440] 10.222.0.93 () {58 vars in 1171 bytes} [Tue Aug 9 17:04:53 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 9686 bytes in 3521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:57.203728 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:57.203728 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:57.205523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cb9ebc3-467e-482b-8e30-bb9fbf19e869 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.208084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cb9ebc3-467e-482b-8e30-bb9fbf19e869 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.208609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cb9ebc3-467e-482b-8e30-bb9fbf19e869 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.211723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cb9ebc3-467e-482b-8e30-bb9fbf19e869 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.211723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cb9ebc3-467e-482b-8e30-bb9fbf19e869 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.212115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cb9ebc3-467e-482b-8e30-bb9fbf19e869 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.237625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3ea2ac7-d857-4b8f-b2de-133ab76d51ac tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:57.243939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3ea2ac7-d857-4b8f-b2de-133ab76d51ac tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Searching by: {'deleted': False, 'project_id': '13cc4522e7a341b09776dea87bd8c5df'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:04:57.259209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ac7-d857-4b8f-b2de-133ab76d51ac tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.262914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ac7-d857-4b8f-b2de-133ab76d51ac tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.263516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ac7-d857-4b8f-b2de-133ab76d51ac tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.267280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ac7-d857-4b8f-b2de-133ab76d51ac tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.269248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ac7-d857-4b8f-b2de-133ab76d51ac tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.269750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ea2ac7-d857-4b8f-b2de-133ab76d51ac tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.361329 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0cb9ebc3-467e-482b-8e30-bb9fbf19e869 tempest-ServicesAdminNegativeTestJSON-1883578112 tempest-ServicesAdminNegativeTestJSON-1883578112-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.176707 Aug 09 17:04:57.362797 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 252/441] 10.222.0.93 () {58 vars in 1198 bytes} [Tue Aug 9 17:04:57 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:04:57.383662 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3ea2ac7-d857-4b8f-b2de-133ab76d51ac tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?tenant_id=a6aa3d7035ce484f9ea8bb3fdf7ac9a6" status: 200 len: 15 microversion: 2.1 time: 0.140802 Aug 09 17:04:57.385630 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 190/442] 10.222.0.93 () {58 vars in 1231 bytes} [Tue Aug 9 17:04:57 2022] GET /compute/v2.1/servers/detail?tenant_id=a6aa3d7035ce484f9ea8bb3fdf7ac9a6 => generated 15 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:04:57.412783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:57.426443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Searching by: {'tenant_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'deleted': False} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:04:57.441247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.442839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.443360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.445924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.446512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.447054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.547654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:04:57.629879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69ee49d8-f3f5-46a6-85fd-42791ce787bb tempest-ServicesAdminNegativeTestJSON-703658036 tempest-ServicesAdminNegativeTestJSON-703658036-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:57.637703 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:04:57.637703 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:04:57.639950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69ee49d8-f3f5-46a6-85fd-42791ce787bb tempest-ServicesAdminNegativeTestJSON-703658036 tempest-ServicesAdminNegativeTestJSON-703658036-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '6ee8b682d1fc4891b668e19a24173b44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5608b64ec3a640798494f020b054d3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69ee49d8-f3f5-46a6-85fd-42791ce787bb tempest-ServicesAdminNegativeTestJSON-703658036 tempest-ServicesAdminNegativeTestJSON-703658036-project] Request method failure captured: Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOyjIoW5G0KwSABs9Ow_kEP03NODF1twUQYbaLQbj6eQmTZr0I7OAjpLzZn5Op7M3vLO7GbKAy5e6ptJ90BJY39XCgZYH5ND3dYWGJHO6RaAQBo26qNCpLmTCtSXe0rWSbvWihl3CGlckLIpnaS-NpBGA-AqSztOKIowv2Qn_jPdIo Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5608b64ec3a640798494f020b054d3d7 Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-703658036 Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:04:57.649088 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5608b64ec3a640798494f020b054d3d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5608b64ec3a640798494f020b054d3d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5608b64ec3a640798494f020b054d3d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5608b64ec3a640798494f020b054d3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-703658036 Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5608b64ec3a640798494f020b054d3d7 Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-703658036 Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServicesAdminNegativeTestJSON-703658036-project Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 6ee8b682d1fc4891b668e19a24173b44 Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-703658036-project Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 17:04:57.650897 n-d-845781-6 devstack@n-api.service[119432]: action_args: {} Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:04:57.651750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 17:04:57.653265 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:04:57.656790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69ee49d8-f3f5-46a6-85fd-42791ce787bb tempest-ServicesAdminNegativeTestJSON-703658036 tempest-ServicesAdminNegativeTestJSON-703658036-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:04:57.659754 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69ee49d8-f3f5-46a6-85fd-42791ce787bb tempest-ServicesAdminNegativeTestJSON-703658036 tempest-ServicesAdminNegativeTestJSON-703658036-project] 10.222.0.93 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.285743 Aug 09 17:04:57.663167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 253/443] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:04:57 2022] GET /compute/v2.1/os-services => generated 112 bytes in 291 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:04:57.679961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-56bb92c4-4664-4cd2-bb46-a732ab17cca8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:57.708614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-56bb92c4-4664-4cd2-bb46-a732ab17cca8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:57.749935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56bb92c4-4664-4cd2-bb46-a732ab17cca8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.750317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56bb92c4-4664-4cd2-bb46-a732ab17cca8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.750862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56bb92c4-4664-4cd2-bb46-a732ab17cca8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.773086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56bb92c4-4664-4cd2-bb46-a732ab17cca8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.780288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56bb92c4-4664-4cd2-bb46-a732ab17cca8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.781227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56bb92c4-4664-4cd2-bb46-a732ab17cca8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.862380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.862895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.875731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:58.293196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-56bb92c4-4664-4cd2-bb46-a732ab17cca8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:58.310964 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-56bb92c4-4664-4cd2-bb46-a732ab17cca8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1470 microversion: 2.1 time: 0.646151 Aug 09 17:04:58.311572 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 254/444] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:57 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1470 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:58.347127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e825bec2-471c-4229-acbd-ae93e46f6635 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:58.360053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e825bec2-471c-4229-acbd-ae93e46f6635 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:58.368865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e825bec2-471c-4229-acbd-ae93e46f6635 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:58.369555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e825bec2-471c-4229-acbd-ae93e46f6635 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:58.370194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e825bec2-471c-4229-acbd-ae93e46f6635 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:58.371280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e825bec2-471c-4229-acbd-ae93e46f6635 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:58.375953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e825bec2-471c-4229-acbd-ae93e46f6635 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:58.376732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e825bec2-471c-4229-acbd-ae93e46f6635 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:58.895301 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-74025267-b7ac-43f5-a538-2feae6418624 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a6aa3d7035ce484f9ea8bb3fdf7ac9a6" status: 200 len: 4825 microversion: 2.1 time: 1.487351 Aug 09 17:04:58.896831 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 191/445] 10.222.0.93 () {58 vars in 1257 bytes} [Tue Aug 9 17:04:57 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a6aa3d7035ce484f9ea8bb3fdf7ac9a6 => generated 4825 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:04:58.933538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-33d70281-7c1d-416d-8704-320ac2636396 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:58.969149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-33d70281-7c1d-416d-8704-320ac2636396 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Searching by: {'tenant_id': '13cc4522e7a341b09776dea87bd8c5df', 'deleted': False} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:04:58.991157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d70281-7c1d-416d-8704-320ac2636396 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:58.992172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d70281-7c1d-416d-8704-320ac2636396 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:58.994685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d70281-7c1d-416d-8704-320ac2636396 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:58.996882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d70281-7c1d-416d-8704-320ac2636396 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:58.997968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d70281-7c1d-416d-8704-320ac2636396 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:58.998652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d70281-7c1d-416d-8704-320ac2636396 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:59.066370 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-33d70281-7c1d-416d-8704-320ac2636396 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=13cc4522e7a341b09776dea87bd8c5df" status: 200 len: 15 microversion: 2.1 time: 0.144763 Aug 09 17:04:59.067777 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 192/446] 10.222.0.93 () {58 vars in 1257 bytes} [Tue Aug 9 17:04:58 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=13cc4522e7a341b09776dea87bd8c5df => generated 15 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:04:59.103051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aee18cc5-a925-4928-8586-a04b7c826f88 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:59.110345 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aee18cc5-a925-4928-8586-a04b7c826f88 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.011172 Aug 09 17:04:59.111617 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 193/447] 10.222.0.93 () {58 vars in 1189 bytes} [Tue Aug 9 17:04:59 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:04:59.146768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3feb8a6d-0ef8-41f4-bf88-2b08cf2d5a38 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:59.149792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3feb8a6d-0ef8-41f4-bf88-2b08cf2d5a38 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:59.154366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e825bec2-471c-4229-acbd-ae93e46f6635 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:59.166663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3feb8a6d-0ef8-41f4-bf88-2b08cf2d5a38 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:59.167509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3feb8a6d-0ef8-41f4-bf88-2b08cf2d5a38 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:59.170175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3feb8a6d-0ef8-41f4-bf88-2b08cf2d5a38 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:59.171223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3feb8a6d-0ef8-41f4-bf88-2b08cf2d5a38 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:59.171741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3feb8a6d-0ef8-41f4-bf88-2b08cf2d5a38 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:59.172179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3feb8a6d-0ef8-41f4-bf88-2b08cf2d5a38 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:59.192477 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e825bec2-471c-4229-acbd-ae93e46f6635 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1388 microversion: 2.1 time: 0.853710 Aug 09 17:04:59.194245 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 255/448] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:58 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1388 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:59.226871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:59.343935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a3f87762-ff07-4919-8bdb-0ffc8459793d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:59.349405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a3f87762-ff07-4919-8bdb-0ffc8459793d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:59.384011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3f87762-ff07-4919-8bdb-0ffc8459793d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:59.385487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3f87762-ff07-4919-8bdb-0ffc8459793d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:59.387532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3f87762-ff07-4919-8bdb-0ffc8459793d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:59.391019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3f87762-ff07-4919-8bdb-0ffc8459793d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:59.394993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3f87762-ff07-4919-8bdb-0ffc8459793d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:59.396338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3f87762-ff07-4919-8bdb-0ffc8459793d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:59.486520 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3feb8a6d-0ef8-41f4-bf88-2b08cf2d5a38 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action" status: 202 len: 0 microversion: 2.1 time: 0.344219 Aug 09 17:04:59.489292 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 194/449] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:04:59 2022] POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:04:59.514379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69c5e21a-a668-416f-b8f5-69ebd40b9f9f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:59.538731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-69c5e21a-a668-416f-b8f5-69ebd40b9f9f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:59.541630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-69c5e21a-a668-416f-b8f5-69ebd40b9f9f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:04:59.573209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69c5e21a-a668-416f-b8f5-69ebd40b9f9f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:59.575029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69c5e21a-a668-416f-b8f5-69ebd40b9f9f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:59.576792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69c5e21a-a668-416f-b8f5-69ebd40b9f9f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:59.578755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69c5e21a-a668-416f-b8f5-69ebd40b9f9f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:59.580443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69c5e21a-a668-416f-b8f5-69ebd40b9f9f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:59.582102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69c5e21a-a668-416f-b8f5-69ebd40b9f9f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:59.803199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-69c5e21a-a668-416f-b8f5-69ebd40b9f9f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:04:59.902009 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69c5e21a-a668-416f-b8f5-69ebd40b9f9f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.406444 Aug 09 17:04:59.917514 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 195/450] 10.222.0.93 () {58 vars in 1150 bytes} [Tue Aug 9 17:04:59 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:04:59.930738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-49a3df49-c2d4-41b6-b9b7-7a4556be2983 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:59.936778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-49a3df49-c2d4-41b6-b9b7-7a4556be2983 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:59.948511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49a3df49-c2d4-41b6-b9b7-7a4556be2983 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:59.950336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49a3df49-c2d4-41b6-b9b7-7a4556be2983 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:59.951530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49a3df49-c2d4-41b6-b9b7-7a4556be2983 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:59.953313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49a3df49-c2d4-41b6-b9b7-7a4556be2983 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:59.954618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49a3df49-c2d4-41b6-b9b7-7a4556be2983 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:59.957322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49a3df49-c2d4-41b6-b9b7-7a4556be2983 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:00.138631 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-49a3df49-c2d4-41b6-b9b7-7a4556be2983 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action" status: 202 len: 0 microversion: 2.1 time: 0.215418 Aug 09 17:05:00.144210 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 196/451] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:04:59 2022] POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:05:00.155291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-53c3d77c-e91b-4af9-8641-9a030f606643 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:00.155979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-53c3d77c-e91b-4af9-8641-9a030f606643 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:00.163248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53c3d77c-e91b-4af9-8641-9a030f606643 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:00.164080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53c3d77c-e91b-4af9-8641-9a030f606643 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:00.164602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53c3d77c-e91b-4af9-8641-9a030f606643 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:00.165976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53c3d77c-e91b-4af9-8641-9a030f606643 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:00.166600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53c3d77c-e91b-4af9-8641-9a030f606643 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:00.167033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53c3d77c-e91b-4af9-8641-9a030f606643 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:00.296821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a3f87762-ff07-4919-8bdb-0ffc8459793d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:00.312386 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a3f87762-ff07-4919-8bdb-0ffc8459793d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1462 microversion: 2.1 time: 0.980203 Aug 09 17:05:00.320188 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 256/452] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:59 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1462 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:00.326483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-65b8745d-95fa-4d90-9004-c72f7a720001 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:00.327374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-65b8745d-95fa-4d90-9004-c72f7a720001 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:00.349858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b8745d-95fa-4d90-9004-c72f7a720001 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:00.350599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b8745d-95fa-4d90-9004-c72f7a720001 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:00.351078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b8745d-95fa-4d90-9004-c72f7a720001 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:00.351947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b8745d-95fa-4d90-9004-c72f7a720001 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:00.352451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b8745d-95fa-4d90-9004-c72f7a720001 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:00.353273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b8745d-95fa-4d90-9004-c72f7a720001 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:00.875433 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-53c3d77c-e91b-4af9-8641-9a030f606643 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1615 microversion: 2.1 time: 0.730180 Aug 09 17:05:00.882576 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 197/453] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:00 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1615 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:00.902246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c8a1dc0a-6d11-485b-9626-fc44207ba499 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:00.906238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c8a1dc0a-6d11-485b-9626-fc44207ba499 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:00.917368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a1dc0a-6d11-485b-9626-fc44207ba499 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:00.918522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a1dc0a-6d11-485b-9626-fc44207ba499 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:00.919235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a1dc0a-6d11-485b-9626-fc44207ba499 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:00.922074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a1dc0a-6d11-485b-9626-fc44207ba499 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:00.926313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a1dc0a-6d11-485b-9626-fc44207ba499 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:00.928744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a1dc0a-6d11-485b-9626-fc44207ba499 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:01.070764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-65b8745d-95fa-4d90-9004-c72f7a720001 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:01.104206 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-65b8745d-95fa-4d90-9004-c72f7a720001 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1388 microversion: 2.1 time: 0.781948 Aug 09 17:05:01.105660 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 257/454] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:00 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1388 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:01.124020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d20562c6-3e18-4b19-ae13-36e2d9846c1c req-5e3d6a9d-bcbc-4baf-874a-983313bc8104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511258ee-3778-4c68-b364-923209210bb9", "tag": "06bc7206-254e-4f95-9ccf-39081996ac41"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:01.162059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d20562c6-3e18-4b19-ae13-36e2d9846c1c req-5e3d6a9d-bcbc-4baf-874a-983313bc8104 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:01.163175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d20562c6-3e18-4b19-ae13-36e2d9846c1c req-5e3d6a9d-bcbc-4baf-874a-983313bc8104 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:01.163929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d20562c6-3e18-4b19-ae13-36e2d9846c1c req-5e3d6a9d-bcbc-4baf-874a-983313bc8104 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:01.224802 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d20562c6-3e18-4b19-ae13-36e2d9846c1c req-5e3d6a9d-bcbc-4baf-874a-983313bc8104 service nova] Creating event network-changed:06bc7206-254e-4f95-9ccf-39081996ac41 for instance 511258ee-3778-4c68-b364-923209210bb9 on n-h1-845781-6 Aug 09 17:05:01.251552 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d20562c6-3e18-4b19-ae13-36e2d9846c1c req-5e3d6a9d-bcbc-4baf-874a-983313bc8104 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137180 Aug 09 17:05:01.254444 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 258/455] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:01.278423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1de227d-5b9e-4287-987d-241e34238cb3 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:01.280978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f1de227d-5b9e-4287-987d-241e34238cb3 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:01.288112 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c8a1dc0a-6d11-485b-9626-fc44207ba499 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1613 microversion: 2.1 time: 0.403101 Aug 09 17:05:01.310781 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 198/456] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:00 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1613 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:01.311382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1de227d-5b9e-4287-987d-241e34238cb3 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:01.312644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1de227d-5b9e-4287-987d-241e34238cb3 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:01.313451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1de227d-5b9e-4287-987d-241e34238cb3 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:01.316602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1de227d-5b9e-4287-987d-241e34238cb3 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:01.320131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1de227d-5b9e-4287-987d-241e34238cb3 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:01.322813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1de227d-5b9e-4287-987d-241e34238cb3 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:01.334102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-709ba205-c3d3-4238-b0e9-f38fdb525b7a tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Calling method '.version_select at 0x7fbbcbb13d30>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:01.346447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-709ba205-c3d3-4238-b0e9-f38fdb525b7a tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:01.348658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-709ba205-c3d3-4238-b0e9-f38fdb525b7a tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:01.350616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-709ba205-c3d3-4238-b0e9-f38fdb525b7a tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:01.381611 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-709ba205-c3d3-4238-b0e9-f38fdb525b7a tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 410 microversion: 2.1 time: 0.052202 Aug 09 17:05:01.386018 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 199/457] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:05:01 2022] GET /compute/v2.1/os-migrations => generated 410 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:05:01.701704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:01.888374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-143836220", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:01.927890 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f1de227d-5b9e-4287-987d-241e34238cb3 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1615 microversion: 2.1 time: 0.666941 Aug 09 17:05:01.942593 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 259/458] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:01 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1615 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:01.975049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c5113912-f2d9-408d-b65f-cf1df6d289f8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:01.992624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c5113912-f2d9-408d-b65f-cf1df6d289f8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Searching by: {'host': 'n-h2-845781-6', 'deleted': False} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:05:02.008583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5113912-f2d9-408d-b65f-cf1df6d289f8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:02.009798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5113912-f2d9-408d-b65f-cf1df6d289f8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:02.010817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5113912-f2d9-408d-b65f-cf1df6d289f8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:02.012921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5113912-f2d9-408d-b65f-cf1df6d289f8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:02.013928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5113912-f2d9-408d-b65f-cf1df6d289f8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:02.014892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5113912-f2d9-408d-b65f-cf1df6d289f8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:02.068349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:05:02.254313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-c5113912-f2d9-408d-b65f-cf1df6d289f8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:05:02.521028 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c5113912-f2d9-408d-b65f-cf1df6d289f8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers?host=n-h2-845781-6&all_tenants=1" status: 200 len: 989 microversion: 2.1 time: 0.551839 Aug 09 17:05:02.524169 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 260/459] 10.222.0.93 () {58 vars in 1190 bytes} [Tue Aug 9 17:05:01 2022] GET /compute/v2.1/servers?host=n-h2-845781-6&all_tenants=1 => generated 989 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:02.533153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad748665-fe38-4ee5-9ed8-716d2f46e01c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:02.534073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ad748665-fe38-4ee5-9ed8-716d2f46e01c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:02.546830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad748665-fe38-4ee5-9ed8-716d2f46e01c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:02.547361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad748665-fe38-4ee5-9ed8-716d2f46e01c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:02.549640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad748665-fe38-4ee5-9ed8-716d2f46e01c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:02.550495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad748665-fe38-4ee5-9ed8-716d2f46e01c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:02.553326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad748665-fe38-4ee5-9ed8-716d2f46e01c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:02.553822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad748665-fe38-4ee5-9ed8-716d2f46e01c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:02.730088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:05:02.731461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:05:02.732439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:05:02.733143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:05:02.735408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:05:02.757653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:02.758762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:02.760171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:02.763071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:02.764019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:02.765112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:02.786146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=28 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:02.822401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for project 7004f453a4d944239c4641bbc394ebb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:05:02.831762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for user 434e395144bc4443abb655a9d0a8b329 and project 7004f453a4d944239c4641bbc394ebb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:05:02.866681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ad748665-fe38-4ee5-9ed8-716d2f46e01c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:02.880058 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad748665-fe38-4ee5-9ed8-716d2f46e01c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1388 microversion: 2.1 time: 0.354256 Aug 09 17:05:02.880957 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 261/460] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:02 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1388 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:02.889588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:05:02.900693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:05:02.907365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e1fc791-5d0c-49d4-80ec-0c2ebc24016f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:02.926703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8e1fc791-5d0c-49d4-80ec-0c2ebc24016f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:05:02.932599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1fc791-5d0c-49d4-80ec-0c2ebc24016f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:02.932947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1fc791-5d0c-49d4-80ec-0c2ebc24016f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:02.933380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1fc791-5d0c-49d4-80ec-0c2ebc24016f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:02.935055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1fc791-5d0c-49d4-80ec-0c2ebc24016f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:02.935721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1fc791-5d0c-49d4-80ec-0c2ebc24016f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:02.936388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1fc791-5d0c-49d4-80ec-0c2ebc24016f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:02.974401 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e1fc791-5d0c-49d4-80ec-0c2ebc24016f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.089264 Aug 09 17:05:02.975836 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 262/461] 10.222.0.93 () {58 vars in 1196 bytes} [Tue Aug 9 17:05:02 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:05:02.999133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eae9fe4a-6f1c-4347-8dbb-3645d55941e8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:03.004936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eae9fe4a-6f1c-4347-8dbb-3645d55941e8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:03.019716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eae9fe4a-6f1c-4347-8dbb-3645d55941e8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.020535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eae9fe4a-6f1c-4347-8dbb-3645d55941e8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.021435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eae9fe4a-6f1c-4347-8dbb-3645d55941e8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:03.022358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eae9fe4a-6f1c-4347-8dbb-3645d55941e8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.023164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eae9fe4a-6f1c-4347-8dbb-3645d55941e8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.023792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eae9fe4a-6f1c-4347-8dbb-3645d55941e8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:03.087421 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ed941f41-abf5-4ec9-a25d-c2909a614f79 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.207429 Aug 09 17:05:03.092498 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 200/462] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:05:03.118492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f22e7b4b-00fe-4956-8f60-3962feeeabb4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:03.119920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f22e7b4b-00fe-4956-8f60-3962feeeabb4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:03.200773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:03.211875 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eae9fe4a-6f1c-4347-8dbb-3645d55941e8 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action" status: 202 len: 0 microversion: 2.1 time: 0.221391 Aug 09 17:05:03.219505 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 263/463] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:05:02 2022] POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:05:03.242041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:03.261044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:03.295226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.296593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.297550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:03.299432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.299656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.300574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:03.447330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f22e7b4b-00fe-4956-8f60-3962feeeabb4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:03.475864 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f22e7b4b-00fe-4956-8f60-3962feeeabb4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1212 microversion: 2.1 time: 0.372020 Aug 09 17:05:03.476930 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 201/464] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:03 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1212 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:03.511146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:05:03.512817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:05:03.514657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:05:03.515870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:05:03.516800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:05:03.711196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:03.725798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.727388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.728568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:03.731148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.732407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.733427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:03.808259 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1216ddd0-bc2a-4949-b72e-d22f768887dd tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action" status: 202 len: 1068 microversion: 2.1 time: 0.585864 Aug 09 17:05:03.811541 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 264/465] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:05:03 2022] POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action => generated 1068 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 09 17:05:03.849489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b1311128-844d-40a9-99ce-80fb2c9b3360 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:03.850531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b1311128-844d-40a9-99ce-80fb2c9b3360 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:03.879737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1311128-844d-40a9-99ce-80fb2c9b3360 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.883652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1311128-844d-40a9-99ce-80fb2c9b3360 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.887355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1311128-844d-40a9-99ce-80fb2c9b3360 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:03.891547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1311128-844d-40a9-99ce-80fb2c9b3360 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.893234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1311128-844d-40a9-99ce-80fb2c9b3360 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.895529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1311128-844d-40a9-99ce-80fb2c9b3360 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:03.905920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7c92d77d-13b5-4807-8fbd-98e023103eeb tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:03.906978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7c92d77d-13b5-4807-8fbd-98e023103eeb tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:03.944467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c92d77d-13b5-4807-8fbd-98e023103eeb tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.953486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c92d77d-13b5-4807-8fbd-98e023103eeb tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.956350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c92d77d-13b5-4807-8fbd-98e023103eeb tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:03.960414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c92d77d-13b5-4807-8fbd-98e023103eeb tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.963360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c92d77d-13b5-4807-8fbd-98e023103eeb tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.967888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c92d77d-13b5-4807-8fbd-98e023103eeb tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:04.386457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b1311128-844d-40a9-99ce-80fb2c9b3360 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:04.410336 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b1311128-844d-40a9-99ce-80fb2c9b3360 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1472 microversion: 2.1 time: 0.569479 Aug 09 17:05:04.412024 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 202/466] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:03 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1472 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:04.803716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7c92d77d-13b5-4807-8fbd-98e023103eeb tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:04.827024 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7c92d77d-13b5-4807-8fbd-98e023103eeb tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1388 microversion: 2.1 time: 0.927172 Aug 09 17:05:04.842257 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 265/467] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:03 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1388 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:04.865370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5dfe90fc-fcf3-43d1-b828-e8d72e2c1986 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:04.874910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5dfe90fc-fcf3-43d1-b828-e8d72e2c1986 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:04.894910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dfe90fc-fcf3-43d1-b828-e8d72e2c1986 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:04.895908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dfe90fc-fcf3-43d1-b828-e8d72e2c1986 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:04.896696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dfe90fc-fcf3-43d1-b828-e8d72e2c1986 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:04.897938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dfe90fc-fcf3-43d1-b828-e8d72e2c1986 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:04.898707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dfe90fc-fcf3-43d1-b828-e8d72e2c1986 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:04.899409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dfe90fc-fcf3-43d1-b828-e8d72e2c1986 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:05.196999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5dfe90fc-fcf3-43d1-b828-e8d72e2c1986 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:05.210094 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5dfe90fc-fcf3-43d1-b828-e8d72e2c1986 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1208 microversion: 2.1 time: 0.363075 Aug 09 17:05:05.211452 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 266/468] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:04 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1208 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:05.242186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ae2fe30-3cb5-4e30-b915-666dc9027dca tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Calling method '.version_select at 0x7fbbcbb25af0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:05.244286 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:05.244286 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:05.247489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae2fe30-3cb5-4e30-b915-666dc9027dca tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:05.255603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae2fe30-3cb5-4e30-b915-666dc9027dca tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:05.257210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae2fe30-3cb5-4e30-b915-666dc9027dca tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:05.326698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae2fe30-3cb5-4e30-b915-666dc9027dca tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:05.329438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae2fe30-3cb5-4e30-b915-666dc9027dca tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:05.331051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae2fe30-3cb5-4e30-b915-666dc9027dca tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:05.394035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae2fe30-3cb5-4e30-b915-666dc9027dca tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:05.400920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae2fe30-3cb5-4e30-b915-666dc9027dca tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:05.402839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae2fe30-3cb5-4e30-b915-666dc9027dca tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:05.475829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c7ad2a52-7bf0-4dd6-9945-befe852bccb2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:05.479158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c7ad2a52-7bf0-4dd6-9945-befe852bccb2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:05.481590 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ae2fe30-3cb5-4e30-b915-666dc9027dca tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.066170 Aug 09 17:05:05.484742 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 203/469] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:05:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:05.517330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11310f06-4c01-4401-9fa1-e4c4925a5bea tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Calling method '.version_select at 0x7fbbcbb254c0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:05.518335 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:05.518335 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:05.526182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ad2a52-7bf0-4dd6-9945-befe852bccb2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:05.528436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ad2a52-7bf0-4dd6-9945-befe852bccb2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:05.528900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ad2a52-7bf0-4dd6-9945-befe852bccb2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:05.529659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ad2a52-7bf0-4dd6-9945-befe852bccb2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:05.531269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11310f06-4c01-4401-9fa1-e4c4925a5bea tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:05.531942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11310f06-4c01-4401-9fa1-e4c4925a5bea tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:05.532393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11310f06-4c01-4401-9fa1-e4c4925a5bea tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:05.543156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ad2a52-7bf0-4dd6-9945-befe852bccb2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:05.544612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ad2a52-7bf0-4dd6-9945-befe852bccb2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:05.603075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11310f06-4c01-4401-9fa1-e4c4925a5bea tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:05.603999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11310f06-4c01-4401-9fa1-e4c4925a5bea tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:05.605162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11310f06-4c01-4401-9fa1-e4c4925a5bea tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:05.793560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11310f06-4c01-4401-9fa1-e4c4925a5bea tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:05.795969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11310f06-4c01-4401-9fa1-e4c4925a5bea tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:05.799751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11310f06-4c01-4401-9fa1-e4c4925a5bea tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:05.836066 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11310f06-4c01-4401-9fa1-e4c4925a5bea tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/n-h2-845781-6/servers" status: 200 len: 433 microversion: 2.1 time: 0.335938 Aug 09 17:05:05.855932 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 204/470] 10.222.0.93 () {58 vars in 1212 bytes} [Tue Aug 9 17:05:05 2022] GET /compute/v2.1/os-hypervisors/n-h2-845781-6/servers => generated 433 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:05.865366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd728585-a218-45f7-a81b-150b755aede4 tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Calling method '.version_select at 0x7fbbcbb131f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:05.868954 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:05.868954 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:05.872043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd728585-a218-45f7-a81b-150b755aede4 tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:05.873394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd728585-a218-45f7-a81b-150b755aede4 tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:05.874584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd728585-a218-45f7-a81b-150b755aede4 tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:05.919990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd728585-a218-45f7-a81b-150b755aede4 tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:05.921946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd728585-a218-45f7-a81b-150b755aede4 tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:05.925106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd728585-a218-45f7-a81b-150b755aede4 tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:05.977479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd728585-a218-45f7-a81b-150b755aede4 tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:05.980175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd728585-a218-45f7-a81b-150b755aede4 tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:05.996912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd728585-a218-45f7-a81b-150b755aede4 tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:06.029738 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bd728585-a218-45f7-a81b-150b755aede4 tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.168990 Aug 09 17:05:06.048442 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 205/471] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:05:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:06.069946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-396d49fc-2cd1-4dd6-94e5-962e5f21c798 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:06.071505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-396d49fc-2cd1-4dd6-94e5-962e5f21c798 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:06.104769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-396d49fc-2cd1-4dd6-94e5-962e5f21c798 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:06.106461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-396d49fc-2cd1-4dd6-94e5-962e5f21c798 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:06.107921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-396d49fc-2cd1-4dd6-94e5-962e5f21c798 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:06.110176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-396d49fc-2cd1-4dd6-94e5-962e5f21c798 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:06.111375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-396d49fc-2cd1-4dd6-94e5-962e5f21c798 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:06.112473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-396d49fc-2cd1-4dd6-94e5-962e5f21c798 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:06.690891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c7ad2a52-7bf0-4dd6-9945-befe852bccb2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:06.701666 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c7ad2a52-7bf0-4dd6-9945-befe852bccb2 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1472 microversion: 2.1 time: 1.250402 Aug 09 17:05:06.709429 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 267/472] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:05 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1472 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:06.754637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-94272f90-f238-407c-9599-21848e15621e tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Calling method '.version_select at 0x7fbbd80da700>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:06.756880 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:06.756880 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:06.761658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94272f90-f238-407c-9599-21848e15621e tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:06.763952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94272f90-f238-407c-9599-21848e15621e tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:06.764441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94272f90-f238-407c-9599-21848e15621e tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:06.782567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-396d49fc-2cd1-4dd6-94e5-962e5f21c798 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:06.796839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94272f90-f238-407c-9599-21848e15621e tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:06.797048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94272f90-f238-407c-9599-21848e15621e tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:06.797662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94272f90-f238-407c-9599-21848e15621e tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:06.820221 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-94272f90-f238-407c-9599-21848e15621e tempest-HypervisorAdminUnderV252Test-1243364867 tempest-HypervisorAdminUnderV252Test-1243364867-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/n-h2-845781-6/search" status: 200 len: 104 microversion: 2.1 time: 0.095957 Aug 09 17:05:06.821090 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-396d49fc-2cd1-4dd6-94e5-962e5f21c798 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1388 microversion: 2.1 time: 0.770037 Aug 09 17:05:06.823084 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 268/473] 10.222.0.93 () {58 vars in 1209 bytes} [Tue Aug 9 17:05:06 2022] GET /compute/v2.1/os-hypervisors/n-h2-845781-6/search => generated 104 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:06.859662 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 206/474] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:06 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1388 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:06.865069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6feb8937-3605-4c70-a6aa-d0efa97ac7a8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:06.865701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6feb8937-3605-4c70-a6aa-d0efa97ac7a8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:06.919418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6feb8937-3605-4c70-a6aa-d0efa97ac7a8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:06.925560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6feb8937-3605-4c70-a6aa-d0efa97ac7a8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:06.926397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6feb8937-3605-4c70-a6aa-d0efa97ac7a8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:06.927659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6feb8937-3605-4c70-a6aa-d0efa97ac7a8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:06.928750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6feb8937-3605-4c70-a6aa-d0efa97ac7a8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:06.930090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6feb8937-3605-4c70-a6aa-d0efa97ac7a8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:07.339835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6feb8937-3605-4c70-a6aa-d0efa97ac7a8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:07.365366 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6feb8937-3605-4c70-a6aa-d0efa97ac7a8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1270 microversion: 2.1 time: 0.538409 Aug 09 17:05:07.368806 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 269/475] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:06 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1270 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:07.542809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-876a0d87-512e-4994-9812-ac87715a3029 req-457d98a6-b10b-4328-a89e-a163c4dc7201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511258ee-3778-4c68-b364-923209210bb9", "name": "network-vif-plugged", "status": "completed", "tag": "06bc7206-254e-4f95-9ccf-39081996ac41"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:07.610855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-876a0d87-512e-4994-9812-ac87715a3029 req-457d98a6-b10b-4328-a89e-a163c4dc7201 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:07.623066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-876a0d87-512e-4994-9812-ac87715a3029 req-457d98a6-b10b-4328-a89e-a163c4dc7201 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:07.624601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-876a0d87-512e-4994-9812-ac87715a3029 req-457d98a6-b10b-4328-a89e-a163c4dc7201 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:07.659755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-876a0d87-512e-4994-9812-ac87715a3029 req-457d98a6-b10b-4328-a89e-a163c4dc7201 service nova] Creating event network-vif-plugged:06bc7206-254e-4f95-9ccf-39081996ac41 for instance 511258ee-3778-4c68-b364-923209210bb9 on n-h1-845781-6 Aug 09 17:05:07.672589 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-876a0d87-512e-4994-9812-ac87715a3029 req-457d98a6-b10b-4328-a89e-a163c4dc7201 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141150 Aug 09 17:05:07.679736 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 207/476] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:05:07.757387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a86e5512-5e67-4b33-bf59-900677eefdc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:07.768138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a86e5512-5e67-4b33-bf59-900677eefdc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:07.840027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a86e5512-5e67-4b33-bf59-900677eefdc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:07.841852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a86e5512-5e67-4b33-bf59-900677eefdc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:07.843233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a86e5512-5e67-4b33-bf59-900677eefdc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:07.848703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a86e5512-5e67-4b33-bf59-900677eefdc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:07.851477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a86e5512-5e67-4b33-bf59-900677eefdc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:07.853626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a86e5512-5e67-4b33-bf59-900677eefdc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:07.879142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-63beca51-22c3-4bd1-b7d3-ab3c98b01233 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:07.880781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-63beca51-22c3-4bd1-b7d3-ab3c98b01233 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:07.912595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63beca51-22c3-4bd1-b7d3-ab3c98b01233 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:07.920218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63beca51-22c3-4bd1-b7d3-ab3c98b01233 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:07.924236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63beca51-22c3-4bd1-b7d3-ab3c98b01233 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:07.930139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63beca51-22c3-4bd1-b7d3-ab3c98b01233 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:07.931710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63beca51-22c3-4bd1-b7d3-ab3c98b01233 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:07.932561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63beca51-22c3-4bd1-b7d3-ab3c98b01233 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:08.492978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-63beca51-22c3-4bd1-b7d3-ab3c98b01233 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:08.523356 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-63beca51-22c3-4bd1-b7d3-ab3c98b01233 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1388 microversion: 2.1 time: 0.648725 Aug 09 17:05:08.524866 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 208/477] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:07 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1388 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:08.559392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a86e5512-5e67-4b33-bf59-900677eefdc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:08.561986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ce7bd40-375e-43cf-b21c-6bfa0351d446 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:08.563663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2ce7bd40-375e-43cf-b21c-6bfa0351d446 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:08.575601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ce7bd40-375e-43cf-b21c-6bfa0351d446 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:08.576863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ce7bd40-375e-43cf-b21c-6bfa0351d446 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:08.577928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ce7bd40-375e-43cf-b21c-6bfa0351d446 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:08.579955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ce7bd40-375e-43cf-b21c-6bfa0351d446 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:08.581074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ce7bd40-375e-43cf-b21c-6bfa0351d446 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:08.582028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ce7bd40-375e-43cf-b21c-6bfa0351d446 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:08.604115 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a86e5512-5e67-4b33-bf59-900677eefdc0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1472 microversion: 2.1 time: 0.858236 Aug 09 17:05:08.605193 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 270/478] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:07 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1472 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:09.462890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2ce7bd40-375e-43cf-b21c-6bfa0351d446 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:09.571344 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ce7bd40-375e-43cf-b21c-6bfa0351d446 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1312 microversion: 2.1 time: 1.029004 Aug 09 17:05:09.581531 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 209/479] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:08 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1312 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:09.613926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4fd517b7-0f49-460d-bfea-1099bbdfb6c9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:09.615437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4fd517b7-0f49-460d-bfea-1099bbdfb6c9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:09.656940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd517b7-0f49-460d-bfea-1099bbdfb6c9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:09.669106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd517b7-0f49-460d-bfea-1099bbdfb6c9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:09.669873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd517b7-0f49-460d-bfea-1099bbdfb6c9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:09.671147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd517b7-0f49-460d-bfea-1099bbdfb6c9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:09.672015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd517b7-0f49-460d-bfea-1099bbdfb6c9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:09.682580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd517b7-0f49-460d-bfea-1099bbdfb6c9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:09.809892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:10.104118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1158926675", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:10.283043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:05:10.397502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4fd517b7-0f49-460d-bfea-1099bbdfb6c9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:10.422991 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4fd517b7-0f49-460d-bfea-1099bbdfb6c9 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1388 microversion: 2.1 time: 0.838173 Aug 09 17:05:10.431258 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 210/480] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:09 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1388 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:10.451906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4ce86c4-2696-444a-a308-64f902c043d8 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:10.454315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d4ce86c4-2696-444a-a308-64f902c043d8 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:10.466367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ce86c4-2696-444a-a308-64f902c043d8 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:10.471311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ce86c4-2696-444a-a308-64f902c043d8 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:10.472126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ce86c4-2696-444a-a308-64f902c043d8 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:10.473640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ce86c4-2696-444a-a308-64f902c043d8 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:10.474485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ce86c4-2696-444a-a308-64f902c043d8 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:10.475163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ce86c4-2696-444a-a308-64f902c043d8 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:10.948040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d4ce86c4-2696-444a-a308-64f902c043d8 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:10.973401 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d4ce86c4-2696-444a-a308-64f902c043d8 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1472 microversion: 2.1 time: 0.538697 Aug 09 17:05:10.987703 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 211/481] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:10 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1472 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:10.999025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc3720de-eeb1-47dd-9590-099340096ff8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:11.000458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bc3720de-eeb1-47dd-9590-099340096ff8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:11.023330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc3720de-eeb1-47dd-9590-099340096ff8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:11.028766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc3720de-eeb1-47dd-9590-099340096ff8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:11.029915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc3720de-eeb1-47dd-9590-099340096ff8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:11.031425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc3720de-eeb1-47dd-9590-099340096ff8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:11.032631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc3720de-eeb1-47dd-9590-099340096ff8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:11.038742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc3720de-eeb1-47dd-9590-099340096ff8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:11.590881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bc3720de-eeb1-47dd-9590-099340096ff8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:11.618282 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bc3720de-eeb1-47dd-9590-099340096ff8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1312 microversion: 2.1 time: 0.636003 Aug 09 17:05:11.620095 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 212/482] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:10 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1312 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:11.630388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3ccd98bc-ac95-4693-a901-45576bba477d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:11.632142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3ccd98bc-ac95-4693-a901-45576bba477d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:11.653686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ccd98bc-ac95-4693-a901-45576bba477d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:11.659444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ccd98bc-ac95-4693-a901-45576bba477d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:11.661213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ccd98bc-ac95-4693-a901-45576bba477d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:11.663721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ccd98bc-ac95-4693-a901-45576bba477d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:11.667434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ccd98bc-ac95-4693-a901-45576bba477d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:11.670685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ccd98bc-ac95-4693-a901-45576bba477d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:11.994982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3ccd98bc-ac95-4693-a901-45576bba477d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:12.014802 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3ccd98bc-ac95-4693-a901-45576bba477d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1588 microversion: 2.1 time: 0.391920 Aug 09 17:05:12.016880 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 213/483] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:11 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1588 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:12.176292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:05:12.177304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:05:12.183975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:05:12.185146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:05:12.189614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:05:12.224490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:12.225540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:12.226573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:12.228764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:12.229852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:12.230945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:12.301388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Getting quotas for project 3923904a8bc646f6b9658fa0762813ba. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:05:12.312807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Getting quotas for user 73696432c93746bba71f054c77170f96 and project 3923904a8bc646f6b9658fa0762813ba. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:05:12.342391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:05:12.347861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:05:12.575338 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1e7f35de-dfd9-4aeb-a40d-a9069bacf528 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.035298 Aug 09 17:05:12.580263 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 271/484] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:05:12.796609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:13.097199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-500495427", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:13.344746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:05:13.459669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=38 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:13.597453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-93db2fd2-1d1a-4735-97a0-e1eda12de334 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-661908940", "id": 259240633, "os-flavor-access:is_public": "False"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:13.603919 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:13.603919 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:13.646269 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-93db2fd2-1d1a-4735-97a0-e1eda12de334 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 1.062134 Aug 09 17:05:13.655540 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 272/485] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:12 2022] POST /compute/v2.1/flavors => generated 435 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:13.669912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6a9b44a9-aef4-4723-9e45-6b245aeb6ecc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:13.672003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6a9b44a9-aef4-4723-9e45-6b245aeb6ecc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:13.687898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9b44a9-aef4-4723-9e45-6b245aeb6ecc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:13.689961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9b44a9-aef4-4723-9e45-6b245aeb6ecc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:13.691111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9b44a9-aef4-4723-9e45-6b245aeb6ecc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:13.694115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9b44a9-aef4-4723-9e45-6b245aeb6ecc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:13.702421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9b44a9-aef4-4723-9e45-6b245aeb6ecc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:13.704047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9b44a9-aef4-4723-9e45-6b245aeb6ecc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:14.069983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6a9b44a9-aef4-4723-9e45-6b245aeb6ecc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:14.092773 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6a9b44a9-aef4-4723-9e45-6b245aeb6ecc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1472 microversion: 2.1 time: 0.433165 Aug 09 17:05:14.096151 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 273/486] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:13 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1472 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:14.112560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a15f7950-5930-44f4-9f3b-e52aad47a577 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:14.116157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a15f7950-5930-44f4-9f3b-e52aad47a577 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:14.131213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a15f7950-5930-44f4-9f3b-e52aad47a577 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:14.137824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a15f7950-5930-44f4-9f3b-e52aad47a577 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:14.139447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a15f7950-5930-44f4-9f3b-e52aad47a577 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:14.155889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a15f7950-5930-44f4-9f3b-e52aad47a577 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:14.160754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a15f7950-5930-44f4-9f3b-e52aad47a577 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:14.162445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a15f7950-5930-44f4-9f3b-e52aad47a577 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:14.453098 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a15f7950-5930-44f4-9f3b-e52aad47a577 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.353475 Aug 09 17:05:14.454579 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 274/487] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:05:14 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9/os-interface => generated 285 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:14.489281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-1f8f56af-00c9-4c18-a84c-bd45ea6e9eaf req-d338d8fa-82cc-40c5-b283-9674117dd900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c0e36e-ac06-4af8-9f62-13a660022181", "tag": "5c0b51c4-b352-4c21-acec-09318bb172f4"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:14.521141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1f8f56af-00c9-4c18-a84c-bd45ea6e9eaf req-d338d8fa-82cc-40c5-b283-9674117dd900 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:14.522411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1f8f56af-00c9-4c18-a84c-bd45ea6e9eaf req-d338d8fa-82cc-40c5-b283-9674117dd900 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:14.532769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1f8f56af-00c9-4c18-a84c-bd45ea6e9eaf req-d338d8fa-82cc-40c5-b283-9674117dd900 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:14.566383 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-1f8f56af-00c9-4c18-a84c-bd45ea6e9eaf req-d338d8fa-82cc-40c5-b283-9674117dd900 service nova] Creating event network-changed:5c0b51c4-b352-4c21-acec-09318bb172f4 for instance 45c0e36e-ac06-4af8-9f62-13a660022181 on n-h2-845781-6 Aug 09 17:05:14.581286 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-1f8f56af-00c9-4c18-a84c-bd45ea6e9eaf req-d338d8fa-82cc-40c5-b283-9674117dd900 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122587 Aug 09 17:05:14.585172 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 275/488] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:14.598989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87703c87-f38d-442e-9132-469c8c8dba93 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:14.602900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-87703c87-f38d-442e-9132-469c8c8dba93 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:14.633791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87703c87-f38d-442e-9132-469c8c8dba93 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:14.635384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87703c87-f38d-442e-9132-469c8c8dba93 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:14.636842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87703c87-f38d-442e-9132-469c8c8dba93 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:14.638449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87703c87-f38d-442e-9132-469c8c8dba93 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:14.640016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87703c87-f38d-442e-9132-469c8c8dba93 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:14.641592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87703c87-f38d-442e-9132-469c8c8dba93 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:14.650981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:05:14.651931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:05:14.652116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:05:14.652392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:05:14.652812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:05:14.674324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:14.674908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:14.676577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:14.678338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:14.680497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:14.684119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:14.718360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:14.737129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Getting quotas for project 4297ff3ee10c4305bccd42a8a7587016. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:05:14.749100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Getting quotas for user fd3c183a53234c1197169c4ab704ef23 and project 4297ff3ee10c4305bccd42a8a7587016. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:05:14.791282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:05:14.798917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:05:14.895683 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f20ebee0-ae46-4d3b-bab3-da5ab6c7f372 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.877217 Aug 09 17:05:14.905234 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 214/489] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:05:14.920423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67445090-cb3d-4c78-9fa6-62c69e888b44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:14.921937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-67445090-cb3d-4c78-9fa6-62c69e888b44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:14.937007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67445090-cb3d-4c78-9fa6-62c69e888b44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:14.937842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67445090-cb3d-4c78-9fa6-62c69e888b44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:14.938524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67445090-cb3d-4c78-9fa6-62c69e888b44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:14.939464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67445090-cb3d-4c78-9fa6-62c69e888b44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:14.941217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67445090-cb3d-4c78-9fa6-62c69e888b44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:14.941861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67445090-cb3d-4c78-9fa6-62c69e888b44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:15.017519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-87703c87-f38d-442e-9132-469c8c8dba93 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:15.045771 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-87703c87-f38d-442e-9132-469c8c8dba93 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1283 microversion: 2.1 time: 0.458030 Aug 09 17:05:15.068043 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 276/490] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:14 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1283 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:15.077959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-63993b1f-59dd-46ad-948b-94dbcd024266 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "629a9a14bcf446adb2c5a9bc11dcf661"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:15.087857 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:15.087857 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:15.349494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-67445090-cb3d-4c78-9fa6-62c69e888b44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:15.371958 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-67445090-cb3d-4c78-9fa6-62c69e888b44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1312 microversion: 2.1 time: 0.457773 Aug 09 17:05:15.373493 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 215/491] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:14 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1312 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:15.381955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c0fbe724-4de7-43b9-bda2-136b7e7218bb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:15.383189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c0fbe724-4de7-43b9-bda2-136b7e7218bb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:15.497483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c0fbe724-4de7-43b9-bda2-136b7e7218bb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:15.510221 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c0fbe724-4de7-43b9-bda2-136b7e7218bb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1213 microversion: 2.1 time: 0.134946 Aug 09 17:05:15.511017 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 216/492] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:15 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1213 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:15.519872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-509b3180-6f33-4ef5-bd88-67adbc4c6655 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:15.520648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-509b3180-6f33-4ef5-bd88-67adbc4c6655 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:15.538297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-509b3180-6f33-4ef5-bd88-67adbc4c6655 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:15.540514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-509b3180-6f33-4ef5-bd88-67adbc4c6655 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:15.541287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-509b3180-6f33-4ef5-bd88-67adbc4c6655 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:15.542037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-509b3180-6f33-4ef5-bd88-67adbc4c6655 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:15.542549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-509b3180-6f33-4ef5-bd88-67adbc4c6655 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:15.542968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-509b3180-6f33-4ef5-bd88-67adbc4c6655 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:15.708530 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-63993b1f-59dd-46ad-948b-94dbcd024266 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/259240633/action" status: 200 len: 96 microversion: 2.1 time: 0.639028 Aug 09 17:05:15.713608 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 277/493] 10.222.0.93 () {60 vars in 1197 bytes} [Tue Aug 9 17:05:15 2022] POST /compute/v2.1/flavors/259240633/action => generated 96 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:05:15.727233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-59093a4c-6d61-4f26-b1b5-7a758b2c5bb6 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "629a9a14bcf446adb2c5a9bc11dcf661"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:15.820269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-509b3180-6f33-4ef5-bd88-67adbc4c6655 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:15.833492 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-509b3180-6f33-4ef5-bd88-67adbc4c6655 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1472 microversion: 2.1 time: 0.319479 Aug 09 17:05:15.834773 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 217/494] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:15 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:16.092762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64ff2ab9-2f5f-4e0e-af0e-8f75594536bb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:16.093825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-64ff2ab9-2f5f-4e0e-af0e-8f75594536bb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:16.109754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ff2ab9-2f5f-4e0e-af0e-8f75594536bb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:16.110409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ff2ab9-2f5f-4e0e-af0e-8f75594536bb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:16.110961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ff2ab9-2f5f-4e0e-af0e-8f75594536bb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:16.111751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ff2ab9-2f5f-4e0e-af0e-8f75594536bb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:16.112216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ff2ab9-2f5f-4e0e-af0e-8f75594536bb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:16.126986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64ff2ab9-2f5f-4e0e-af0e-8f75594536bb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:16.139823 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-59093a4c-6d61-4f26-b1b5-7a758b2c5bb6 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project 629a9a14bcf446adb2c5a9bc11dcf661 combination. Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-59093a4c-6d61-4f26-b1b5-7a758b2c5bb6 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Request method failure captured: Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/flavors/259240633/action HTTP/1.1 Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 67 Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pPFUvz0ni-EWcIs-wNJ1cHluvNerJYOWkWXMWlQiJ74IUY2aJ72sCYGbGvHYieajQ7GGsEfpSvTbG-iTKuNi1_YNSJJtJ97Fzl0L9l_ov_tNBn1jv7d5FHfSdLsyLw7X4zvQrmDa0m-9E1ufX8lPPJJIeqDsgVACjqdQ-DPcBygC_Y Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: c6333b6a77d148368ee8b1e9b2d16da6 Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-547700676 Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:05:16.147548 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-547700676 Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: c6333b6a77d148368ee8b1e9b2d16da6 Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-547700676 Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: ed0d55520e5f4805b2ce148989cecf55 Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: {"addTenantAccess": {"tenant": "629a9a14bcf446adb2c5a9bc11dcf661"}} Aug 09 17:05:16.150557 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: exception: Flavor access already exists for flavor 34 and project 629a9a14bcf446adb2c5a9bc11dcf661 combination. Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '259240633', 'body': {'addTenantAccess': {'tenant': '629a9a14bcf446adb2c5a9bc11dcf661'}}} Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result.read() Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 17:05:16.153384 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '34-629a9a14bcf446adb2c5a9bc11dcf661' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi session.flush() Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 17:05:16.156007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 17:05:16.161694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 17:05:16.164789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result.read() Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '34-629a9a14bcf446adb2c5a9bc11dcf661' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 9, 17, 5, 16, 128882), 'updated_at': None, 'flavor_id': 34, 'project_id': '629a9a14bcf446adb2c5a9bc11dcf661'}] Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:16.167411 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 34 and project 629a9a14bcf446adb2c5a9bc11dcf661 combination. Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:16.170260 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 34 and project 629a9a14bcf446adb2c5a9bc11dcf661 combination. Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:16.175083 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:16.181319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 34 and project 629a9a14bcf446adb2c5a9bc11dcf661 combination. Aug 09 17:05:16.181319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:16.181319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-59093a4c-6d61-4f26-b1b5-7a758b2c5bb6 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project 629a9a14bcf446adb2c5a9bc11dcf661 combination. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:16.181319 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-59093a4c-6d61-4f26-b1b5-7a758b2c5bb6 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/259240633/action" status: 409 len: 152 microversion: 2.1 time: 0.427782 Aug 09 17:05:16.181319 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 278/495] 10.222.0.93 () {60 vars in 1197 bytes} [Tue Aug 9 17:05:15 2022] POST /compute/v2.1/flavors/259240633/action => generated 152 bytes in 430 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:05:16.190157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9b9bcd68-eff3-4a95-a677-31d2891579e2 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "629a9a14bcf446adb2c5a9bc11dcf661"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:16.194688 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:16.194688 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:16.268211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-64ff2ab9-2f5f-4e0e-af0e-8f75594536bb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:16.284996 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-64ff2ab9-2f5f-4e0e-af0e-8f75594536bb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1281 microversion: 2.1 time: 0.202112 Aug 09 17:05:16.287166 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 218/496] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:16 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1281 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:16.417185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af46b5c4-bda6-40f9-a669-2d151e6c461f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:16.419549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-af46b5c4-bda6-40f9-a669-2d151e6c461f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:16.433082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af46b5c4-bda6-40f9-a669-2d151e6c461f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:16.434741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af46b5c4-bda6-40f9-a669-2d151e6c461f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:16.435777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af46b5c4-bda6-40f9-a669-2d151e6c461f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:16.437820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af46b5c4-bda6-40f9-a669-2d151e6c461f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:16.439331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af46b5c4-bda6-40f9-a669-2d151e6c461f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:16.440404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af46b5c4-bda6-40f9-a669-2d151e6c461f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:16.710169 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9b9bcd68-eff3-4a95-a677-31d2891579e2 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/259240633/action" status: 200 len: 21 microversion: 2.1 time: 0.545597 Aug 09 17:05:16.717926 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 279/497] 10.222.0.93 () {60 vars in 1197 bytes} [Tue Aug 9 17:05:16 2022] POST /compute/v2.1/flavors/259240633/action => generated 21 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:05:16.748863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-77d04c26-2622-436d-94dc-52a7fcd585f5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:16.753954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-77d04c26-2622-436d-94dc-52a7fcd585f5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:16.797868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77d04c26-2622-436d-94dc-52a7fcd585f5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:16.804498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77d04c26-2622-436d-94dc-52a7fcd585f5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:16.809317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77d04c26-2622-436d-94dc-52a7fcd585f5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:16.810992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77d04c26-2622-436d-94dc-52a7fcd585f5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:16.816023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77d04c26-2622-436d-94dc-52a7fcd585f5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:16.816535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77d04c26-2622-436d-94dc-52a7fcd585f5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:16.962936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-af46b5c4-bda6-40f9-a669-2d151e6c461f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:16.976019 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-af46b5c4-bda6-40f9-a669-2d151e6c461f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1312 microversion: 2.1 time: 0.566905 Aug 09 17:05:16.998451 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 219/498] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:16 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1312 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:17.004296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1623e70-b467-47bd-b691-96ccf0714753 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:17.007522 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:17.007522 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:17.056773 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1623e70-b467-47bd-b691-96ccf0714753 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/259240633" status: 202 len: 0 microversion: 2.1 time: 0.069099 Aug 09 17:05:17.057381 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 220/499] 10.222.0.93 () {58 vars in 1158 bytes} [Tue Aug 9 17:05:16 2022] DELETE /compute/v2.1/flavors/259240633 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:05:17.069264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6ce8b47f-2ec5-41f1-a8e9-f08682a6248b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:17.072775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6ce8b47f-2ec5-41f1-a8e9-f08682a6248b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:17.099106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ce8b47f-2ec5-41f1-a8e9-f08682a6248b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:17.104280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ce8b47f-2ec5-41f1-a8e9-f08682a6248b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:17.105107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ce8b47f-2ec5-41f1-a8e9-f08682a6248b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:17.111503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ce8b47f-2ec5-41f1-a8e9-f08682a6248b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:17.112189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ce8b47f-2ec5-41f1-a8e9-f08682a6248b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:17.115202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ce8b47f-2ec5-41f1-a8e9-f08682a6248b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:17.515602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6ce8b47f-2ec5-41f1-a8e9-f08682a6248b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:17.530981 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6ce8b47f-2ec5-41f1-a8e9-f08682a6248b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1478 microversion: 2.1 time: 0.471371 Aug 09 17:05:17.532556 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 221/500] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:17 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1478 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:17.539087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c5a7d5a4-e088-4f45-bb59-13e84ca57c1d tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:17.571045 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c5a7d5a4-e088-4f45-bb59-13e84ca57c1d tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.036041 Aug 09 17:05:17.572349 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 222/501] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:05:17 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:17.578634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1fd82ad-548a-4765-b6ef-20c9cfadc0eb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:17.579855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e1fd82ad-548a-4765-b6ef-20c9cfadc0eb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:17.588317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1fd82ad-548a-4765-b6ef-20c9cfadc0eb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:17.589946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1fd82ad-548a-4765-b6ef-20c9cfadc0eb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:17.591006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1fd82ad-548a-4765-b6ef-20c9cfadc0eb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:17.592326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1fd82ad-548a-4765-b6ef-20c9cfadc0eb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:17.593295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1fd82ad-548a-4765-b6ef-20c9cfadc0eb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:17.593941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1fd82ad-548a-4765-b6ef-20c9cfadc0eb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:17.709245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e1fd82ad-548a-4765-b6ef-20c9cfadc0eb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:17.727432 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1fd82ad-548a-4765-b6ef-20c9cfadc0eb tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1281 microversion: 2.1 time: 0.153447 Aug 09 17:05:17.728576 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 223/502] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:17 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:17.748640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8af1aa33-df23-4f6c-a977-c2cf5394526d tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1081534212", "id": 1957984718, "os-flavor-access:is_public": "True"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:17.754880 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:17.754880 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:17.767989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-77d04c26-2622-436d-94dc-52a7fcd585f5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:17.781429 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-77d04c26-2622-436d-94dc-52a7fcd585f5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1209 microversion: 2.1 time: 1.058730 Aug 09 17:05:17.785306 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 280/503] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:16 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1209 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:17.809509 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8af1aa33-df23-4f6c-a977-c2cf5394526d tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.077951 Aug 09 17:05:17.814521 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 224/504] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:17 2022] POST /compute/v2.1/flavors => generated 438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:17.840124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3e127a73-c0bf-43eb-b65c-d94bc62c2186 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:17.842021 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:17.842021 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:17.860670 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-3e127a73-c0bf-43eb-b65c-d94bc62c2186 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3e127a73-c0bf-43eb-b65c-d94bc62c2186 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Request method failure captured: Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/flavors/1957984718/os-flavor-access HTTP/1.1 Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pPFUvz0ni-EWcIs-wNJ1cHluvNerJYOWkWXMWlQiJ74IUY2aJ72sCYGbGvHYieajQ7GGsEfpSvTbG-iTKuNi1_YNSJJtJ97Fzl0L9l_ov_tNBn1jv7d5FHfSdLsyLw7X4zvQrmDa0m-9E1ufX8lPPJJIeqDsgVACjqdQ-DPcBygC_Y Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: c6333b6a77d148368ee8b1e9b2d16da6 Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-547700676 Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:05:17.863854 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-547700676 Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: c6333b6a77d148368ee8b1e9b2d16da6 Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-547700676 Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: ed0d55520e5f4805b2ce148989cecf55 Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: exception: Access list not available for public flavors. Aug 09 17:05:17.866372 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'flavor_id': '1957984718'} Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 09 17:05:17.868605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:17.874486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3e127a73-c0bf-43eb-b65c-d94bc62c2186 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:17.876490 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3e127a73-c0bf-43eb-b65c-d94bc62c2186 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/1957984718/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.044100 Aug 09 17:05:17.884134 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 281/505] 10.222.0.93 () {58 vars in 1209 bytes} [Tue Aug 9 17:05:17 2022] GET /compute/v2.1/flavors/1957984718/os-flavor-access => generated 91 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:05:17.897404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eaa44588-8a50-400a-9ba3-3bb947106465 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:17.899270 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:17.899270 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:17.959572 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eaa44588-8a50-400a-9ba3-3bb947106465 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1957984718" status: 202 len: 0 microversion: 2.1 time: 0.074480 Aug 09 17:05:17.960862 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 225/506] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:05:17 2022] DELETE /compute/v2.1/flavors/1957984718 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:05:17.974098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-26a39d53-7cae-464e-b40f-ffea8367c17d tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:17.984985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:18.011097 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-26a39d53-7cae-464e-b40f-ffea8367c17d tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.043025 Aug 09 17:05:18.012330 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 282/507] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:05:17 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:18.018573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-56737b1e-8df4-4d33-8c74-11f267ece3ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:18.019735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-56737b1e-8df4-4d33-8c74-11f267ece3ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:18.031961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56737b1e-8df4-4d33-8c74-11f267ece3ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:18.033225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56737b1e-8df4-4d33-8c74-11f267ece3ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:18.034205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56737b1e-8df4-4d33-8c74-11f267ece3ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:18.035855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56737b1e-8df4-4d33-8c74-11f267ece3ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:18.040509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56737b1e-8df4-4d33-8c74-11f267ece3ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:18.041112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56737b1e-8df4-4d33-8c74-11f267ece3ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:18.063461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-80a5488b-a2c1-4eea-926c-651a0f2e25f5 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-65717695", "id": 1964702617, "os-flavor-access:is_public": "False"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:18.086823 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:18.086823 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:18.155807 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-80a5488b-a2c1-4eea-926c-651a0f2e25f5 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.092976 Aug 09 17:05:18.156988 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 283/508] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:18 2022] POST /compute/v2.1/flavors => generated 437 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:18.635021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-56737b1e-8df4-4d33-8c74-11f267ece3ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:18.641288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-287eb701-ff2c-43d5-85df-99df3267f480 tempest-FlavorsAccessNegativeTestJSON-30799578 tempest-FlavorsAccessNegativeTestJSON-30799578-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "629a9a14bcf446adb2c5a9bc11dcf661"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:18.649391 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-56737b1e-8df4-4d33-8c74-11f267ece3ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1312 microversion: 2.1 time: 0.640053 Aug 09 17:05:18.653136 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 226/509] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:18 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1312 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:18.656671 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:18.656671 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:18.660286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-287eb701-ff2c-43d5-85df-99df3267f480 tempest-FlavorsAccessNegativeTestJSON-30799578 tempest-FlavorsAccessNegativeTestJSON-30799578-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ab7dee732a334b9bbe327937365076cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a9a14bcf446adb2c5a9bc11dcf661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:18.668911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-952cb394-8acc-4705-9180-abffd220fa0b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:18.669764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-952cb394-8acc-4705-9180-abffd220fa0b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-287eb701-ff2c-43d5-85df-99df3267f480 tempest-FlavorsAccessNegativeTestJSON-30799578 tempest-FlavorsAccessNegativeTestJSON-30799578-project] Request method failure captured: Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/flavors/1964702617/action HTTP/1.1 Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 67 Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pPBF0r0063N8isSfWlHBNtOheAD2w88SRi2NJdCCA872PdfD0X7ZujAo1pRoO7AcCNSzNzim8734b_ojLtAFM0L9txbHf0S0uotUAlI864Ia3dwu6dKTuVA8O1Yx92u1ZRqnywgNXdadJkSj1ma3BEthFj0RwchqowX9jR8PRNp7aU Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 629a9a14bcf446adb2c5a9bc11dcf661 Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-30799578 Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:05:18.672448 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_629a9a14bcf446adb2c5a9bc11dcf661"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/629a9a14bcf446adb2c5a9bc11dcf661"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/629a9a14bcf446adb2c5a9bc11dcf661"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/629a9a14bcf446adb2c5a9bc11dcf661"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-30799578 Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 629a9a14bcf446adb2c5a9bc11dcf661 Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-30799578 Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FlavorsAccessNegativeTestJSON-30799578-project Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: ab7dee732a334b9bbe327937365076cc Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-30799578-project Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: {"addTenantAccess": {"tenant": "629a9a14bcf446adb2c5a9bc11dcf661"}} Aug 09 17:05:18.674030 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '1964702617', 'body': {'addTenantAccess': {'tenant': '629a9a14bcf446adb2c5a9bc11dcf661'}}} Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:05:18.674893 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 09 17:05:18.676209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:18.677558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-287eb701-ff2c-43d5-85df-99df3267f480 tempest-FlavorsAccessNegativeTestJSON-30799578 tempest-FlavorsAccessNegativeTestJSON-30799578-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:18.678811 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-287eb701-ff2c-43d5-85df-99df3267f480 tempest-FlavorsAccessNegativeTestJSON-30799578 tempest-FlavorsAccessNegativeTestJSON-30799578-project] 10.222.0.93 "POST /compute/v2.1/flavors/1964702617/action" status: 403 len: 130 microversion: 2.1 time: 0.505316 Aug 09 17:05:18.690332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-952cb394-8acc-4705-9180-abffd220fa0b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:18.690842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-952cb394-8acc-4705-9180-abffd220fa0b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:18.691291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-952cb394-8acc-4705-9180-abffd220fa0b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:18.692059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-952cb394-8acc-4705-9180-abffd220fa0b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:18.692522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-952cb394-8acc-4705-9180-abffd220fa0b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:18.692950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-952cb394-8acc-4705-9180-abffd220fa0b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:18.697164 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 284/510] 10.222.0.93 () {60 vars in 1200 bytes} [Tue Aug 9 17:05:18 2022] POST /compute/v2.1/flavors/1964702617/action => generated 130 bytes in 513 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:05:18.717731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4cf118c7-0099-48c2-aea6-d866c5cbaafe tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:18.719544 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:18.719544 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:18.808448 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4cf118c7-0099-48c2-aea6-d866c5cbaafe tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1964702617" status: 202 len: 0 microversion: 2.1 time: 0.107342 Aug 09 17:05:18.809792 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 285/511] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:05:18 2022] DELETE /compute/v2.1/flavors/1964702617 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:05:18.835682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7605829d-f146-4c25-9fd1-7618ced5a790 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:18.837312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7605829d-f146-4c25-9fd1-7618ced5a790 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:18.868779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7605829d-f146-4c25-9fd1-7618ced5a790 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:18.869653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7605829d-f146-4c25-9fd1-7618ced5a790 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:18.872789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7605829d-f146-4c25-9fd1-7618ced5a790 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:18.881938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7605829d-f146-4c25-9fd1-7618ced5a790 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:18.883247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7605829d-f146-4c25-9fd1-7618ced5a790 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:18.884326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7605829d-f146-4c25-9fd1-7618ced5a790 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:19.024167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-952cb394-8acc-4705-9180-abffd220fa0b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:19.044202 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-952cb394-8acc-4705-9180-abffd220fa0b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1478 microversion: 2.1 time: 0.379017 Aug 09 17:05:19.050441 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 227/512] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:18 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1478 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:19.106860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7605829d-f146-4c25-9fd1-7618ced5a790 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:19.118458 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7605829d-f146-4c25-9fd1-7618ced5a790 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1281 microversion: 2.1 time: 0.301460 Aug 09 17:05:19.133931 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 286/513] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:18 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1281 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:19.138679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7118ff5d-210e-479a-815e-1cfce84ab9fc tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:19.163608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2e97f921-aaf4-4c8a-b0df-25a30375a9a8 tempest-QuotaClassesAdminTestJSON-309500933 tempest-QuotaClassesAdminTestJSON-309500933-project-admin] Calling method '.version_select at 0x7fbbcbb44ee0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:19.164937 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:19.164937 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:19.184869 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7118ff5d-210e-479a-815e-1cfce84ab9fc tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.058103 Aug 09 17:05:19.185807 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 287/514] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:05:19 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:19.192318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fac20e44-57fa-47e6-baed-5e0e017a2125 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:19.193548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fac20e44-57fa-47e6-baed-5e0e017a2125 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:19.206046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fac20e44-57fa-47e6-baed-5e0e017a2125 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:19.207619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fac20e44-57fa-47e6-baed-5e0e017a2125 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:19.208253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fac20e44-57fa-47e6-baed-5e0e017a2125 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:19.212538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fac20e44-57fa-47e6-baed-5e0e017a2125 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:19.215136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fac20e44-57fa-47e6-baed-5e0e017a2125 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:19.216649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fac20e44-57fa-47e6-baed-5e0e017a2125 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:19.238223 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2e97f921-aaf4-4c8a-b0df-25a30375a9a8 tempest-QuotaClassesAdminTestJSON-309500933 tempest-QuotaClassesAdminTestJSON-309500933-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.188578 Aug 09 17:05:19.240059 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 228/515] 10.222.0.93 () {58 vars in 1185 bytes} [Tue Aug 9 17:05:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:19.254977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-18dd0d59-b84f-435a-bbc1-df7896af8821 req-32eda2cb-fafb-4daa-9b9f-95fec7a5262f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c0e36e-ac06-4af8-9f62-13a660022181", "name": "network-vif-plugged", "status": "completed", "tag": "5c0b51c4-b352-4c21-acec-09318bb172f4"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:19.282250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-18dd0d59-b84f-435a-bbc1-df7896af8821 req-32eda2cb-fafb-4daa-9b9f-95fec7a5262f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:19.283487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-18dd0d59-b84f-435a-bbc1-df7896af8821 req-32eda2cb-fafb-4daa-9b9f-95fec7a5262f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:19.284537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-18dd0d59-b84f-435a-bbc1-df7896af8821 req-32eda2cb-fafb-4daa-9b9f-95fec7a5262f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:19.307950 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-18dd0d59-b84f-435a-bbc1-df7896af8821 req-32eda2cb-fafb-4daa-9b9f-95fec7a5262f service nova] Creating event network-vif-plugged:5c0b51c4-b352-4c21-acec-09318bb172f4 for instance 45c0e36e-ac06-4af8-9f62-13a660022181 on n-h2-845781-6 Aug 09 17:05:19.316372 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-18dd0d59-b84f-435a-bbc1-df7896af8821 req-32eda2cb-fafb-4daa-9b9f-95fec7a5262f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074357 Aug 09 17:05:19.317252 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 229/516] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:19.323075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ba4e938-6c6f-4a82-856c-61f68f30d1dd tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1890119269", "id": 1688537017, "os-flavor-access:is_public": "False"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:19.327727 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:19.327727 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:19.352107 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ba4e938-6c6f-4a82-856c-61f68f30d1dd tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.033324 Aug 09 17:05:19.366076 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 230/517] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:19 2022] POST /compute/v2.1/flavors => generated 439 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:19.366076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-198d443d-c04d-414f-b798-40443a8cbaf6 tempest-QuotaClassesAdminTestJSON-309500933 tempest-QuotaClassesAdminTestJSON-309500933-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcbb7a310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:19.377102 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:19.377102 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:19.531091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fac20e44-57fa-47e6-baed-5e0e017a2125 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:19.544906 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fac20e44-57fa-47e6-baed-5e0e017a2125 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1271 microversion: 2.1 time: 0.357734 Aug 09 17:05:19.545825 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 288/518] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:19 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1271 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:19.560495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2812d34d-df73-4edf-83d7-4d5d8cd0d108 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "629a9a14bcf446adb2c5a9bc11dcf661"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:19.574367 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:19.574367 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:19.796693 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2812d34d-df73-4edf-83d7-4d5d8cd0d108 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1688537017/action" status: 200 len: 97 microversion: 2.1 time: 0.249722 Aug 09 17:05:19.797993 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 289/519] 10.222.0.93 () {60 vars in 1200 bytes} [Tue Aug 9 17:05:19 2022] POST /compute/v2.1/flavors/1688537017/action => generated 97 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:05:19.803651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ceb28b6a-ec42-47c2-b202-bd111d6a2eaf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:19.805229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ceb28b6a-ec42-47c2-b202-bd111d6a2eaf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:19.811717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=13,nova_api:DELETE=6,nova_api:UPDATE=9 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:19.815447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceb28b6a-ec42-47c2-b202-bd111d6a2eaf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:19.816548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceb28b6a-ec42-47c2-b202-bd111d6a2eaf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:19.816548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceb28b6a-ec42-47c2-b202-bd111d6a2eaf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:19.817479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceb28b6a-ec42-47c2-b202-bd111d6a2eaf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:19.818006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceb28b6a-ec42-47c2-b202-bd111d6a2eaf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:19.818509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceb28b6a-ec42-47c2-b202-bd111d6a2eaf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:19.951482 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-198d443d-c04d-414f-b798-40443a8cbaf6 tempest-QuotaClassesAdminTestJSON-309500933 tempest-QuotaClassesAdminTestJSON-309500933-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.596718 Aug 09 17:05:19.955919 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 231/520] 10.222.0.93 () {60 vars in 1206 bytes} [Tue Aug 9 17:05:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:19.965159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-947d7ed7-a886-4cc2-8bbb-fde382277ed0 tempest-FlavorsAccessNegativeTestJSON-30799578 tempest-FlavorsAccessNegativeTestJSON-30799578-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "629a9a14bcf446adb2c5a9bc11dcf661"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:19.969122 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:19.969122 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:19.971540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-947d7ed7-a886-4cc2-8bbb-fde382277ed0 tempest-FlavorsAccessNegativeTestJSON-30799578 tempest-FlavorsAccessNegativeTestJSON-30799578-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ab7dee732a334b9bbe327937365076cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629a9a14bcf446adb2c5a9bc11dcf661', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-947d7ed7-a886-4cc2-8bbb-fde382277ed0 tempest-FlavorsAccessNegativeTestJSON-30799578 tempest-FlavorsAccessNegativeTestJSON-30799578-project] Request method failure captured: Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/flavors/1688537017/action HTTP/1.1 Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 70 Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPBF0r0063N8isSfWlHBNtOheAD2w88SRi2NJdCCA872PdfD0X7ZujAo1pRoO7AcCNSzNzim8734b_ojLtAFM0L9txbHf0S0uotUAlI864Ia3dwu6dKTuVA8O1Yx92u1ZRqnywgNXdadJkSj1ma3BEthFj0RwchqowX9jR8PRNp7aU Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 629a9a14bcf446adb2c5a9bc11dcf661 Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-30799578 Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:19.976261 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_629a9a14bcf446adb2c5a9bc11dcf661"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/629a9a14bcf446adb2c5a9bc11dcf661"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/629a9a14bcf446adb2c5a9bc11dcf661"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/629a9a14bcf446adb2c5a9bc11dcf661"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-30799578 Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 629a9a14bcf446adb2c5a9bc11dcf661 Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-30799578 Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FlavorsAccessNegativeTestJSON-30799578-project Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ab7dee732a334b9bbe327937365076cc Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-30799578-project Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: {"removeTenantAccess": {"tenant": "629a9a14bcf446adb2c5a9bc11dcf661"}} Aug 09 17:05:19.978153 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1688537017', 'body': {'removeTenantAccess': {'tenant': '629a9a14bcf446adb2c5a9bc11dcf661'}}} Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can( Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:05:19.979388 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 09 17:05:19.981176 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:19.982375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-947d7ed7-a886-4cc2-8bbb-fde382277ed0 tempest-FlavorsAccessNegativeTestJSON-30799578 tempest-FlavorsAccessNegativeTestJSON-30799578-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:19.982788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-947d7ed7-a886-4cc2-8bbb-fde382277ed0 tempest-FlavorsAccessNegativeTestJSON-30799578 tempest-FlavorsAccessNegativeTestJSON-30799578-project] 10.222.0.93 "POST /compute/v2.1/flavors/1688537017/action" status: 403 len: 133 microversion: 2.1 time: 0.024915 Aug 09 17:05:19.983798 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 232/521] 10.222.0.93 () {60 vars in 1200 bytes} [Tue Aug 9 17:05:19 2022] POST /compute/v2.1/flavors/1688537017/action => generated 133 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:05:19.989450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e17c334-f6a8-4362-bdf3-eca25db2f590 tempest-QuotaClassesAdminTestJSON-309500933 tempest-QuotaClassesAdminTestJSON-309500933-project-admin] Calling method '.version_select at 0x7fbbcbb44790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:19.991261 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:19.991261 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:20.014151 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e17c334-f6a8-4362-bdf3-eca25db2f590 tempest-QuotaClassesAdminTestJSON-309500933 tempest-QuotaClassesAdminTestJSON-309500933-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.028764 Aug 09 17:05:20.021767 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 233/522] 10.222.0.93 () {58 vars in 1185 bytes} [Tue Aug 9 17:05:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:20.025780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43f601b8-325a-4c7e-804c-5189b1445671 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "629a9a14bcf446adb2c5a9bc11dcf661"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:20.198041 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43f601b8-325a-4c7e-804c-5189b1445671 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1688537017/action" status: 200 len: 21 microversion: 2.1 time: 0.180876 Aug 09 17:05:20.199134 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 234/523] 10.222.0.93 () {60 vars in 1200 bytes} [Tue Aug 9 17:05:20 2022] POST /compute/v2.1/flavors/1688537017/action => generated 21 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:05:20.204117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87aaebc8-cb1c-4042-938b-be5343e44a6c tempest-QuotaClassesAdminTestJSON-309500933 tempest-QuotaClassesAdminTestJSON-309500933-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcbe40e50>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:20.366272 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87aaebc8-cb1c-4042-938b-be5343e44a6c tempest-QuotaClassesAdminTestJSON-309500933 tempest-QuotaClassesAdminTestJSON-309500933-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.164769 Aug 09 17:05:20.375684 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 235/524] 10.222.0.93 () {60 vars in 1206 bytes} [Tue Aug 9 17:05:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:20.384383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0ead84ff-38e3-4594-be47-9dc0bd298345 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:20.386013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0ead84ff-38e3-4594-be47-9dc0bd298345 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:20.403257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ead84ff-38e3-4594-be47-9dc0bd298345 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:20.404381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ead84ff-38e3-4594-be47-9dc0bd298345 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:20.405310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ead84ff-38e3-4594-be47-9dc0bd298345 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:20.408077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ead84ff-38e3-4594-be47-9dc0bd298345 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:20.408986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ead84ff-38e3-4594-be47-9dc0bd298345 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:20.410689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ead84ff-38e3-4594-be47-9dc0bd298345 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:20.782390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0ead84ff-38e3-4594-be47-9dc0bd298345 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:20.819313 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0ead84ff-38e3-4594-be47-9dc0bd298345 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1478 microversion: 2.1 time: 0.449168 Aug 09 17:05:20.825239 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 236/525] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:20 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1478 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:20.832570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c73dc45e-680b-483c-89ed-4a3eddc875d8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:20.833652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c73dc45e-680b-483c-89ed-4a3eddc875d8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:20.847497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c73dc45e-680b-483c-89ed-4a3eddc875d8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:20.847847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c73dc45e-680b-483c-89ed-4a3eddc875d8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:20.848508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c73dc45e-680b-483c-89ed-4a3eddc875d8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:20.850110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c73dc45e-680b-483c-89ed-4a3eddc875d8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:20.851352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c73dc45e-680b-483c-89ed-4a3eddc875d8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:20.852173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c73dc45e-680b-483c-89ed-4a3eddc875d8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:21.206504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ceb28b6a-ec42-47c2-b202-bd111d6a2eaf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:21.221164 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ceb28b6a-ec42-47c2-b202-bd111d6a2eaf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1312 microversion: 2.1 time: 1.420117 Aug 09 17:05:21.247614 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 290/526] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:19 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1312 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:21.263049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4e65d612-cc45-436b-9629-69faf9a76a57 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:21.264111 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:21.264111 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:21.310555 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4e65d612-cc45-436b-9629-69faf9a76a57 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1688537017" status: 202 len: 0 microversion: 2.1 time: 0.061150 Aug 09 17:05:21.311913 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 291/527] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:05:21 2022] DELETE /compute/v2.1/flavors/1688537017 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:05:21.318250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b4edbc73-58ef-405c-9a5a-cb43ac75243c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:21.319144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b4edbc73-58ef-405c-9a5a-cb43ac75243c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:21.334184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4edbc73-58ef-405c-9a5a-cb43ac75243c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:21.344147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4edbc73-58ef-405c-9a5a-cb43ac75243c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:21.346428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4edbc73-58ef-405c-9a5a-cb43ac75243c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:21.350232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4edbc73-58ef-405c-9a5a-cb43ac75243c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:21.356133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c73dc45e-680b-483c-89ed-4a3eddc875d8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:21.358292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4edbc73-58ef-405c-9a5a-cb43ac75243c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:21.359862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4edbc73-58ef-405c-9a5a-cb43ac75243c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:21.380230 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c73dc45e-680b-483c-89ed-4a3eddc875d8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1323 microversion: 2.1 time: 0.557265 Aug 09 17:05:21.380842 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 237/528] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:20 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1323 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:21.389862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:21.399682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1554fb21-d088-4e91-85a2-e4ee5bf41dc0 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:21.467316 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1554fb21-d088-4e91-85a2-e4ee5bf41dc0 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.069899 Aug 09 17:05:21.475200 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 238/529] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:05:21 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:21.488334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b5377b4f-23be-4852-91ce-c88674582d4e req-f994e227-664b-43c3-ae0b-3debdf6c9c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce37568-9dbf-4f84-875d-0bfda5961abc", "name": "network-vif-unplugged", "status": "completed", "tag": "cdac773e-042b-445a-b50f-a65814f73dae"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:21.511760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b5377b4f-23be-4852-91ce-c88674582d4e req-f994e227-664b-43c3-ae0b-3debdf6c9c08 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:21.517511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b5377b4f-23be-4852-91ce-c88674582d4e req-f994e227-664b-43c3-ae0b-3debdf6c9c08 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:21.521431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b5377b4f-23be-4852-91ce-c88674582d4e req-f994e227-664b-43c3-ae0b-3debdf6c9c08 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:21.551674 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b5377b4f-23be-4852-91ce-c88674582d4e req-f994e227-664b-43c3-ae0b-3debdf6c9c08 service nova] Creating event network-vif-unplugged:cdac773e-042b-445a-b50f-a65814f73dae for instance cce37568-9dbf-4f84-875d-0bfda5961abc on n-h2-845781-6 Aug 09 17:05:21.569492 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b5377b4f-23be-4852-91ce-c88674582d4e req-f994e227-664b-43c3-ae0b-3debdf6c9c08 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089920 Aug 09 17:05:21.571079 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 239/530] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:21.581172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f25feaf7-85ce-47c5-a637-d62e89583fa7 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1324612462", "id": 1142711034, "os-flavor-access:is_public": "False"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:21.586642 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:21.586642 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:21.638478 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f25feaf7-85ce-47c5-a637-d62e89583fa7 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.061935 Aug 09 17:05:21.641577 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 240/531] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:21 2022] POST /compute/v2.1/flavors => generated 439 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:21.645514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b4edbc73-58ef-405c-9a5a-cb43ac75243c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:21.657086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1c6d2f1d-c377-4a83-986e-9b39c74386ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:21.658984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1c6d2f1d-c377-4a83-986e-9b39c74386ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:21.668368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b4edbc73-58ef-405c-9a5a-cb43ac75243c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1271 microversion: 2.1 time: 0.351801 Aug 09 17:05:21.671163 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 292/532] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:21 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1271 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:21.680168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6d2f1d-c377-4a83-986e-9b39c74386ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:21.682004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6d2f1d-c377-4a83-986e-9b39c74386ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:21.684483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6d2f1d-c377-4a83-986e-9b39c74386ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:21.685627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-692c202a-36fc-4836-8c9f-d7f1e04ff5fc req-7bca6385-6389-43ca-88f9-8d8f6f578f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511258ee-3778-4c68-b364-923209210bb9", "tag": "06bc7206-254e-4f95-9ccf-39081996ac41"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:21.687216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6d2f1d-c377-4a83-986e-9b39c74386ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:21.688430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6d2f1d-c377-4a83-986e-9b39c74386ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:21.690133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6d2f1d-c377-4a83-986e-9b39c74386ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:21.724759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-692c202a-36fc-4836-8c9f-d7f1e04ff5fc req-7bca6385-6389-43ca-88f9-8d8f6f578f2c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:21.726095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-692c202a-36fc-4836-8c9f-d7f1e04ff5fc req-7bca6385-6389-43ca-88f9-8d8f6f578f2c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:21.728631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-692c202a-36fc-4836-8c9f-d7f1e04ff5fc req-7bca6385-6389-43ca-88f9-8d8f6f578f2c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:21.773285 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-692c202a-36fc-4836-8c9f-d7f1e04ff5fc req-7bca6385-6389-43ca-88f9-8d8f6f578f2c service nova] Creating event network-changed:06bc7206-254e-4f95-9ccf-39081996ac41 for instance 511258ee-3778-4c68-b364-923209210bb9 on n-h1-845781-6 Aug 09 17:05:21.794799 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-692c202a-36fc-4836-8c9f-d7f1e04ff5fc req-7bca6385-6389-43ca-88f9-8d8f6f578f2c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119305 Aug 09 17:05:21.795537 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 293/533] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:21.810947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ffdf7b75-6ca3-4309-a725-a3544159b1c0 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "309b406b89a44470b60fd23d37976d85"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:21.823868 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:21.823868 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:22.250205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=19 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:22.332680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:22.334147 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ffdf7b75-6ca3-4309-a725-a3544159b1c0 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] HTTP exception thrown: Flavor access not found for 38 / 309b406b89a44470b60fd23d37976d85 combination. Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ffdf7b75-6ca3-4309-a725-a3544159b1c0 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Request method failure captured: Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/flavors/1142711034/action HTTP/1.1 Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 70 Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pPFUvz0ni-EWcIs-wNJ1cHluvNerJYOWkWXMWlQiJ74IUY2aJ72sCYGbGvHYieajQ7GGsEfpSvTbG-iTKuNi1_YNSJJtJ97Fzl0L9l_ov_tNBn1jv7d5FHfSdLsyLw7X4zvQrmDa0m-9E1ufX8lPPJJIeqDsgVACjqdQ-DPcBygC_Y Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: c6333b6a77d148368ee8b1e9b2d16da6 Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-547700676 Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:05:22.338650 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c6333b6a77d148368ee8b1e9b2d16da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-547700676 Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: c6333b6a77d148368ee8b1e9b2d16da6 Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-547700676 Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: ed0d55520e5f4805b2ce148989cecf55 Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: {"removeTenantAccess": {"tenant": "309b406b89a44470b60fd23d37976d85"}} Aug 09 17:05:22.340066 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: exception: Flavor access not found for 38 / 309b406b89a44470b60fd23d37976d85 combination. Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '1142711034', 'body': {'removeTenantAccess': {'tenant': '309b406b89a44470b60fd23d37976d85'}}} Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 09 17:05:22.340758 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 38 / 309b406b89a44470b60fd23d37976d85 combination. Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 38 / 309b406b89a44470b60fd23d37976d85 combination. Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:22.341870 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:22.342962 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:22.342962 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:22.342962 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:22.342962 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:22.342962 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 38 / 309b406b89a44470b60fd23d37976d85 combination. Aug 09 17:05:22.342962 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:22.342962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ffdf7b75-6ca3-4309-a725-a3544159b1c0 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Returning 404 to user: Flavor access not found for 38 / 309b406b89a44470b60fd23d37976d85 combination. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:22.342962 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ffdf7b75-6ca3-4309-a725-a3544159b1c0 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1142711034/action" status: 404 len: 124 microversion: 2.1 time: 0.543469 Aug 09 17:05:22.350246 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 294/534] 10.222.0.93 () {60 vars in 1200 bytes} [Tue Aug 9 17:05:21 2022] POST /compute/v2.1/flavors/1142711034/action => generated 124 bytes in 551 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:05:22.357602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-925c9f15-a91d-40c7-b991-a96b625b67da tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:22.359121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-925c9f15-a91d-40c7-b991-a96b625b67da tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:22.377215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-925c9f15-a91d-40c7-b991-a96b625b67da tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:22.377724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-925c9f15-a91d-40c7-b991-a96b625b67da tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:22.378174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-925c9f15-a91d-40c7-b991-a96b625b67da tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:22.378937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-925c9f15-a91d-40c7-b991-a96b625b67da tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:22.379440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-925c9f15-a91d-40c7-b991-a96b625b67da tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:22.381486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-925c9f15-a91d-40c7-b991-a96b625b67da tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:22.622052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1c6d2f1d-c377-4a83-986e-9b39c74386ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:22.650018 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1c6d2f1d-c377-4a83-986e-9b39c74386ab tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1588 microversion: 2.1 time: 1.006324 Aug 09 17:05:22.651573 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 241/535] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:21 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1588 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:22.662428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a8bcfd2-725d-49da-9f6a-4cd8df0ba8ac tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:22.664091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a8bcfd2-725d-49da-9f6a-4cd8df0ba8ac tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:22.684881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a8bcfd2-725d-49da-9f6a-4cd8df0ba8ac tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:22.685773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a8bcfd2-725d-49da-9f6a-4cd8df0ba8ac tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:22.686563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a8bcfd2-725d-49da-9f6a-4cd8df0ba8ac tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:22.688080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a8bcfd2-725d-49da-9f6a-4cd8df0ba8ac tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:22.689177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a8bcfd2-725d-49da-9f6a-4cd8df0ba8ac tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:22.690571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a8bcfd2-725d-49da-9f6a-4cd8df0ba8ac tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:23.042736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-925c9f15-a91d-40c7-b991-a96b625b67da tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:23.052500 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-925c9f15-a91d-40c7-b991-a96b625b67da tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1478 microversion: 2.1 time: 0.700929 Aug 09 17:05:23.059576 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 295/536] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:22 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1478 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:23.075326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5e58c4a2-3e64-41cf-932f-013bf6e3e9e7 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:23.082535 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:23.082535 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:23.137140 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5e58c4a2-3e64-41cf-932f-013bf6e3e9e7 tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1142711034" status: 202 len: 0 microversion: 2.1 time: 0.074725 Aug 09 17:05:23.138100 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 296/537] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:05:23 2022] DELETE /compute/v2.1/flavors/1142711034 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:05:23.147456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8ecfdf21-4b81-4d22-8584-87f1aa34853f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:23.149959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8ecfdf21-4b81-4d22-8584-87f1aa34853f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:23.164819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ecfdf21-4b81-4d22-8584-87f1aa34853f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:23.166276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ecfdf21-4b81-4d22-8584-87f1aa34853f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:23.168082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ecfdf21-4b81-4d22-8584-87f1aa34853f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:23.171002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ecfdf21-4b81-4d22-8584-87f1aa34853f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:23.172220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ecfdf21-4b81-4d22-8584-87f1aa34853f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:23.173236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ecfdf21-4b81-4d22-8584-87f1aa34853f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:23.296589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4a8bcfd2-725d-49da-9f6a-4cd8df0ba8ac tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:23.307439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:23.325966 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a8bcfd2-725d-49da-9f6a-4cd8df0ba8ac tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1461 microversion: 2.1 time: 0.672287 Aug 09 17:05:23.332142 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 242/538] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:22 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1461 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:23.356537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7985debc-c154-4d7e-8a3d-7c62c264149e tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:23.358486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7985debc-c154-4d7e-8a3d-7c62c264149e tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:23.394972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7985debc-c154-4d7e-8a3d-7c62c264149e tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:23.395900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7985debc-c154-4d7e-8a3d-7c62c264149e tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:23.396716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7985debc-c154-4d7e-8a3d-7c62c264149e tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:23.398066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7985debc-c154-4d7e-8a3d-7c62c264149e tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:23.398915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7985debc-c154-4d7e-8a3d-7c62c264149e tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:23.399778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7985debc-c154-4d7e-8a3d-7c62c264149e tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:23.531125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7985debc-c154-4d7e-8a3d-7c62c264149e tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:23.540368 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7985debc-c154-4d7e-8a3d-7c62c264149e tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1271 microversion: 2.1 time: 0.206049 Aug 09 17:05:23.541749 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 243/539] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:23 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:23.548730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ff306919-32e4-4404-8829-c78d49515e3b tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:23.648234 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ff306919-32e4-4404-8829-c78d49515e3b tempest-FlavorsAccessNegativeTestJSON-547700676 tempest-FlavorsAccessNegativeTestJSON-547700676-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.104320 Aug 09 17:05:23.649486 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 244/540] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:05:23 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:23.673178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8ecfdf21-4b81-4d22-8584-87f1aa34853f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:23.683521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:23.689346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:23.695289 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8ecfdf21-4b81-4d22-8584-87f1aa34853f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1323 microversion: 2.1 time: 0.555541 Aug 09 17:05:23.696150 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 297/541] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:23 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1323 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:23.718052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:23.724653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:23.726060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:23.728173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:23.729480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:23.735453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:23.928100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:23.935918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Old instance type m1.heat2, new instance type m1.heat {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 17:05:23.943074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:05:23.943495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:05:23.944001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:05:23.944398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:05:23.944982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:05:24.100640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4f2b4fdb-8b50-444e-bbb9-d7572944e972 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:24.102492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4f2b4fdb-8b50-444e-bbb9-d7572944e972 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:24.137764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f2b4fdb-8b50-444e-bbb9-d7572944e972 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:24.141564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f2b4fdb-8b50-444e-bbb9-d7572944e972 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:24.143052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f2b4fdb-8b50-444e-bbb9-d7572944e972 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:24.149044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f2b4fdb-8b50-444e-bbb9-d7572944e972 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:24.150095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f2b4fdb-8b50-444e-bbb9-d7572944e972 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:24.150944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f2b4fdb-8b50-444e-bbb9-d7572944e972 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:24.174135 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-80eedeb4-51a0-4f9d-a1cd-9377243595ce tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "POST /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181/action" status: 202 len: 0 microversion: 2.1 time: 0.522406 Aug 09 17:05:24.180470 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 245/542] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:05:23 2022] POST /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:05:24.205650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a18aae7c-d25f-43ed-9b65-1f69426df2e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:24.206507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a18aae7c-d25f-43ed-9b65-1f69426df2e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:24.223098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18aae7c-d25f-43ed-9b65-1f69426df2e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:24.226926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18aae7c-d25f-43ed-9b65-1f69426df2e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:24.227857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18aae7c-d25f-43ed-9b65-1f69426df2e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:24.252024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18aae7c-d25f-43ed-9b65-1f69426df2e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:24.258329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18aae7c-d25f-43ed-9b65-1f69426df2e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:24.259522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18aae7c-d25f-43ed-9b65-1f69426df2e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:24.695580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:24.752717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a18aae7c-d25f-43ed-9b65-1f69426df2e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:24.768454 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a18aae7c-d25f-43ed-9b65-1f69426df2e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1470 microversion: 2.1 time: 0.577999 Aug 09 17:05:24.769843 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 246/543] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:24 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1470 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:24.776619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c2c75291-25e0-4625-b39c-ee9d2c4d804f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:24.777530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c2c75291-25e0-4625-b39c-ee9d2c4d804f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:24.814732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c75291-25e0-4625-b39c-ee9d2c4d804f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:24.815807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c75291-25e0-4625-b39c-ee9d2c4d804f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:24.816736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c75291-25e0-4625-b39c-ee9d2c4d804f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:24.818406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c75291-25e0-4625-b39c-ee9d2c4d804f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:24.819588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c75291-25e0-4625-b39c-ee9d2c4d804f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:24.820563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c75291-25e0-4625-b39c-ee9d2c4d804f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:25.418751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c2c75291-25e0-4625-b39c-ee9d2c4d804f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:25.435084 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c2c75291-25e0-4625-b39c-ee9d2c4d804f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1313 microversion: 2.1 time: 0.660015 Aug 09 17:05:25.439453 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 247/544] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:24 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:25.451062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d82565e-ea60-476d-b606-60a30b2d7e5c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:25.453048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7d82565e-ea60-476d-b606-60a30b2d7e5c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:25.477920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d82565e-ea60-476d-b606-60a30b2d7e5c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:25.478418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d82565e-ea60-476d-b606-60a30b2d7e5c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:25.478843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d82565e-ea60-476d-b606-60a30b2d7e5c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:25.480138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d82565e-ea60-476d-b606-60a30b2d7e5c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:25.480603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d82565e-ea60-476d-b606-60a30b2d7e5c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:25.481075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d82565e-ea60-476d-b606-60a30b2d7e5c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:25.483810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f2b4fdb-8b50-444e-bbb9-d7572944e972 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:25.504608 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4f2b4fdb-8b50-444e-bbb9-d7572944e972 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1478 microversion: 2.1 time: 1.408484 Aug 09 17:05:25.505889 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 298/545] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:24 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1478 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:25.515950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-3adbb54d-6ec2-4025-afa5-80b944e7acf5 req-0193d46a-6a30-4218-9cbb-c3712a739b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce37568-9dbf-4f84-875d-0bfda5961abc", "name": "network-vif-plugged", "status": "completed", "tag": "cdac773e-042b-445a-b50f-a65814f73dae"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:25.536391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3adbb54d-6ec2-4025-afa5-80b944e7acf5 req-0193d46a-6a30-4218-9cbb-c3712a739b71 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:25.537136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3adbb54d-6ec2-4025-afa5-80b944e7acf5 req-0193d46a-6a30-4218-9cbb-c3712a739b71 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:25.548247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3adbb54d-6ec2-4025-afa5-80b944e7acf5 req-0193d46a-6a30-4218-9cbb-c3712a739b71 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:25.562257 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-3adbb54d-6ec2-4025-afa5-80b944e7acf5 req-0193d46a-6a30-4218-9cbb-c3712a739b71 service nova] Creating event network-vif-plugged:cdac773e-042b-445a-b50f-a65814f73dae for instance cce37568-9dbf-4f84-875d-0bfda5961abc on n-h2-845781-6 Aug 09 17:05:25.570901 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-3adbb54d-6ec2-4025-afa5-80b944e7acf5 req-0193d46a-6a30-4218-9cbb-c3712a739b71 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062561 Aug 09 17:05:25.571802 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 299/546] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:25.727535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7d82565e-ea60-476d-b606-60a30b2d7e5c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:25.766852 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7d82565e-ea60-476d-b606-60a30b2d7e5c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1323 microversion: 2.1 time: 0.325505 Aug 09 17:05:25.771711 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 248/547] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:25 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1323 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:25.804889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-caf17899-283c-4a40-b276-9e9a809e31e4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:25.805987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-caf17899-283c-4a40-b276-9e9a809e31e4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:25.823169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caf17899-283c-4a40-b276-9e9a809e31e4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:25.825098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caf17899-283c-4a40-b276-9e9a809e31e4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:25.826813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caf17899-283c-4a40-b276-9e9a809e31e4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:25.828687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caf17899-283c-4a40-b276-9e9a809e31e4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:25.830779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caf17899-283c-4a40-b276-9e9a809e31e4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:25.832183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caf17899-283c-4a40-b276-9e9a809e31e4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:26.475526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a11b74dd-ed37-4f26-af0c-657b04ff3eb2 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:26.477214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a11b74dd-ed37-4f26-af0c-657b04ff3eb2 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:26.512343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11b74dd-ed37-4f26-af0c-657b04ff3eb2 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:26.513769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11b74dd-ed37-4f26-af0c-657b04ff3eb2 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:26.518688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11b74dd-ed37-4f26-af0c-657b04ff3eb2 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:26.520390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11b74dd-ed37-4f26-af0c-657b04ff3eb2 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:26.521492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11b74dd-ed37-4f26-af0c-657b04ff3eb2 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:26.522912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11b74dd-ed37-4f26-af0c-657b04ff3eb2 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:26.905097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a11b74dd-ed37-4f26-af0c-657b04ff3eb2 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:26.953551 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a11b74dd-ed37-4f26-af0c-657b04ff3eb2 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1313 microversion: 2.1 time: 0.489646 Aug 09 17:05:26.956333 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 249/548] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:26 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:26.967511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2d63e2d-e310-4bbc-8a94-10e8aa0d0316 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:26.970061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2d63e2d-e310-4bbc-8a94-10e8aa0d0316 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:26.983855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2d63e2d-e310-4bbc-8a94-10e8aa0d0316 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:26.984534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2d63e2d-e310-4bbc-8a94-10e8aa0d0316 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:26.985695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2d63e2d-e310-4bbc-8a94-10e8aa0d0316 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:26.986681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2d63e2d-e310-4bbc-8a94-10e8aa0d0316 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:26.987242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2d63e2d-e310-4bbc-8a94-10e8aa0d0316 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:26.987789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2d63e2d-e310-4bbc-8a94-10e8aa0d0316 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:27.070193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-caf17899-283c-4a40-b276-9e9a809e31e4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:27.079554 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-caf17899-283c-4a40-b276-9e9a809e31e4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1470 microversion: 2.1 time: 1.279078 Aug 09 17:05:27.080770 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 300/549] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:25 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1470 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:27.085751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-90a65aac-a63a-4ade-beda-24e704db324f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:27.086773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-90a65aac-a63a-4ade-beda-24e704db324f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:27.094280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90a65aac-a63a-4ade-beda-24e704db324f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:27.095477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90a65aac-a63a-4ade-beda-24e704db324f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:27.095961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90a65aac-a63a-4ade-beda-24e704db324f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:27.096703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90a65aac-a63a-4ade-beda-24e704db324f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:27.097364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90a65aac-a63a-4ade-beda-24e704db324f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:27.097999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90a65aac-a63a-4ade-beda-24e704db324f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:27.324531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d2d63e2d-e310-4bbc-8a94-10e8aa0d0316 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:27.353542 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d2d63e2d-e310-4bbc-8a94-10e8aa0d0316 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1478 microversion: 2.1 time: 0.394401 Aug 09 17:05:27.354495 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 250/550] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:26 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1478 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:27.457045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e3ca4676-c96d-4f33-92ee-c64fd5f7e5eb req-9ba685d2-4510-4a84-86b2-b02fce697bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba7157e9-1f83-4ddd-803b-7a7e16a04b6e", "tag": "22ef96e6-092c-4a0f-a819-538f093d3cb4"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:27.476210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e3ca4676-c96d-4f33-92ee-c64fd5f7e5eb req-9ba685d2-4510-4a84-86b2-b02fce697bf2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:27.477070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e3ca4676-c96d-4f33-92ee-c64fd5f7e5eb req-9ba685d2-4510-4a84-86b2-b02fce697bf2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:27.477739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e3ca4676-c96d-4f33-92ee-c64fd5f7e5eb req-9ba685d2-4510-4a84-86b2-b02fce697bf2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:27.503425 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e3ca4676-c96d-4f33-92ee-c64fd5f7e5eb req-9ba685d2-4510-4a84-86b2-b02fce697bf2 service nova] Creating event network-changed:22ef96e6-092c-4a0f-a819-538f093d3cb4 for instance ba7157e9-1f83-4ddd-803b-7a7e16a04b6e on n-h1-845781-6 Aug 09 17:05:27.510076 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e3ca4676-c96d-4f33-92ee-c64fd5f7e5eb req-9ba685d2-4510-4a84-86b2-b02fce697bf2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057818 Aug 09 17:05:27.511682 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 251/551] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:05:27.679344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e467828b-b345-49b9-9e55-f76864835d20 tempest-FlavorsV2NegativeTest-1628751254 tempest-FlavorsV2NegativeTest-1628751254-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:27.692310 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e467828b-b345-49b9-9e55-f76864835d20 tempest-FlavorsV2NegativeTest-1628751254 tempest-FlavorsV2NegativeTest-1628751254-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.178844 Aug 09 17:05:27.695282 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 252/552] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:05:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:27.996260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90a65aac-a63a-4ade-beda-24e704db324f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:28.011371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d3274ec-0666-4faf-8cd3-3641f80309fb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:28.023857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5d3274ec-0666-4faf-8cd3-3641f80309fb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:28.042778 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-90a65aac-a63a-4ade-beda-24e704db324f tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1323 microversion: 2.1 time: 0.960675 Aug 09 17:05:28.045506 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 301/553] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:27 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1323 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:28.074981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d3274ec-0666-4faf-8cd3-3641f80309fb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:28.075875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d3274ec-0666-4faf-8cd3-3641f80309fb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:28.077281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d3274ec-0666-4faf-8cd3-3641f80309fb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:28.079073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d3274ec-0666-4faf-8cd3-3641f80309fb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:28.080580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d3274ec-0666-4faf-8cd3-3641f80309fb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:28.081930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d3274ec-0666-4faf-8cd3-3641f80309fb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:28.125752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1fa0de59-50c7-487f-9178-59977794a37c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:28.126471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1fa0de59-50c7-487f-9178-59977794a37c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:28.170706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fa0de59-50c7-487f-9178-59977794a37c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:28.171696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fa0de59-50c7-487f-9178-59977794a37c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:28.172328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fa0de59-50c7-487f-9178-59977794a37c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:28.173681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fa0de59-50c7-487f-9178-59977794a37c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:28.174332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fa0de59-50c7-487f-9178-59977794a37c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:28.176250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fa0de59-50c7-487f-9178-59977794a37c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:28.826926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5d3274ec-0666-4faf-8cd3-3641f80309fb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:28.841021 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5d3274ec-0666-4faf-8cd3-3641f80309fb tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1313 microversion: 2.1 time: 0.864147 Aug 09 17:05:28.842116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1fa0de59-50c7-487f-9178-59977794a37c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:28.844107 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 253/554] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:27 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1313 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:28.850112 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1fa0de59-50c7-487f-9178-59977794a37c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1470 microversion: 2.1 time: 0.731018 Aug 09 17:05:28.860204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9851cac7-ea7a-4347-a5c3-a8e1b2f06122 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:28.860959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9851cac7-ea7a-4347-a5c3-a8e1b2f06122 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:28.870824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9851cac7-ea7a-4347-a5c3-a8e1b2f06122 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:28.873036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9851cac7-ea7a-4347-a5c3-a8e1b2f06122 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:28.873264 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 302/555] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:28 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1470 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:28.875575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9851cac7-ea7a-4347-a5c3-a8e1b2f06122 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:28.875575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9851cac7-ea7a-4347-a5c3-a8e1b2f06122 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:28.876215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9851cac7-ea7a-4347-a5c3-a8e1b2f06122 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:28.876778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9851cac7-ea7a-4347-a5c3-a8e1b2f06122 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:29.315527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9851cac7-ea7a-4347-a5c3-a8e1b2f06122 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:29.328084 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9851cac7-ea7a-4347-a5c3-a8e1b2f06122 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1464 microversion: 2.1 time: 0.481640 Aug 09 17:05:29.345722 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 254/556] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:28 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1464 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:29.345722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2bcfe84d-7084-4300-bd77-457a1668774d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:29.345722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2bcfe84d-7084-4300-bd77-457a1668774d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:29.345722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:UPDATE=15,nova_api:DELETE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:29.377186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bcfe84d-7084-4300-bd77-457a1668774d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:29.377813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bcfe84d-7084-4300-bd77-457a1668774d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:29.378284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bcfe84d-7084-4300-bd77-457a1668774d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:29.379200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bcfe84d-7084-4300-bd77-457a1668774d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:29.385623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bcfe84d-7084-4300-bd77-457a1668774d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:29.386412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bcfe84d-7084-4300-bd77-457a1668774d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:29.656869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1697633207", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "b176697e-92f5-4744-9b98-692686c31e55"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:29.725349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2bcfe84d-7084-4300-bd77-457a1668774d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:29.735382 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2bcfe84d-7084-4300-bd77-457a1668774d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1323 microversion: 2.1 time: 0.405177 Aug 09 17:05:29.748890 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 255/557] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:29 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1323 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:29.766256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7492290-72f0-49aa-9764-631a1515be76 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:29.767296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b7492290-72f0-49aa-9764-631a1515be76 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:29.770281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] validate_networks() for [('b176697e-92f5-4744-9b98-692686c31e55', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:05:29.776230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7492290-72f0-49aa-9764-631a1515be76 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:29.776849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7492290-72f0-49aa-9764-631a1515be76 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:29.777378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7492290-72f0-49aa-9764-631a1515be76 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:29.778255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7492290-72f0-49aa-9764-631a1515be76 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:29.780208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7492290-72f0-49aa-9764-631a1515be76 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:29.780832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7492290-72f0-49aa-9764-631a1515be76 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:30.030970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b7492290-72f0-49aa-9764-631a1515be76 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:30.057670 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7492290-72f0-49aa-9764-631a1515be76 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1464 microversion: 2.1 time: 0.306751 Aug 09 17:05:30.062984 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 256/558] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:29 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1464 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:30.073204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8dd94cb4-bef4-46f0-80ad-6c9acb3871c4 tempest-FlavorsV2NegativeTest-1628751254 tempest-FlavorsV2NegativeTest-1628751254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-68807600", "imageRef": "3b20e8fe-4873-4e53-9b6c-14a4f3ac8cd5", "flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:30.142460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-8dd94cb4-bef4-46f0-80ad-6c9acb3871c4 tempest-FlavorsV2NegativeTest-1628751254 tempest-FlavorsV2NegativeTest-1628751254-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:05:30.355217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=52,nova_cell0:UPDATE=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:30.748527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:05:30.748989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:05:30.749452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:05:30.749877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:05:30.750306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:05:30.790432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:30.791292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:30.792584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:30.794306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:30.794790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:30.795235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:30.797733 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-8dd94cb4-bef4-46f0-80ad-6c9acb3871c4 tempest-FlavorsV2NegativeTest-1628751254 tempest-FlavorsV2NegativeTest-1628751254-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8dd94cb4-bef4-46f0-80ad-6c9acb3871c4 tempest-FlavorsV2NegativeTest-1628751254 tempest-FlavorsV2NegativeTest-1628751254-project] Request method failure captured: Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 141 Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPX2moW2UAePblK58UR_l3km1CWTlifOOaeZFWnZHjM9U-AULcF4KRtWaBPcfJr-Mi07VhMbHJgFbFgzQb00Ub6er-Z5PyvmH5J3DiuLWTzQist2vYB9DbhkYKo5bZDYMH-vdp8DijzSTsqRyMDmW0JSaxeQ6laSzCrcG_w2z_clYw Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 4fc8918fe8a0480ea2fcbb8fee9de617 Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FlavorsV2NegativeTest-1628751254 Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:30.801285 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4fc8918fe8a0480ea2fcbb8fee9de617"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4fc8918fe8a0480ea2fcbb8fee9de617"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4fc8918fe8a0480ea2fcbb8fee9de617"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4fc8918fe8a0480ea2fcbb8fee9de617"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FlavorsV2NegativeTest-1628751254 Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 4fc8918fe8a0480ea2fcbb8fee9de617 Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1628751254 Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FlavorsV2NegativeTest-1628751254-project Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1f6d7c0b488646f8950936a4116bcc6c Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FlavorsV2NegativeTest-1628751254-project Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-68807600", "imageRef": "3b20e8fe-4873-4e53-9b6c-14a4f3ac8cd5", "flavorRef": "452"}} Aug 09 17:05:30.802716 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: exception: Flavor's memory is too small for requested image. Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-68807600', 'imageRef': '3b20e8fe-4873-4e53-9b6c-14a4f3ac8cd5', 'flavorRef': '452'}}} Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:30.803431 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:30.804894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:30.807900 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:30.807900 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:30.807900 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:30.807900 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:30.807900 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 09 17:05:30.807900 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:30.807900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8dd94cb4-bef4-46f0-80ad-6c9acb3871c4 tempest-FlavorsV2NegativeTest-1628751254 tempest-FlavorsV2NegativeTest-1628751254-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:30.807900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8dd94cb4-bef4-46f0-80ad-6c9acb3871c4 tempest-FlavorsV2NegativeTest-1628751254 tempest-FlavorsV2NegativeTest-1628751254-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.738629 Aug 09 17:05:30.829220 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 257/559] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:30 2022] POST /compute/v2.1/servers => generated 93 bytes in 746 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:05:30.833244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Getting quotas for project 44129d75c58240fa867e90b1d3252554. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:05:30.839185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a23c9e2c-ee8a-4dbb-b90e-9f0af8746fe0 req-42655ec2-0a70-4282-8c0f-f8f8a1a60c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d1325b-cb1c-489f-8924-a33c03274f54", "tag": "75a144b0-9235-439b-96dc-d12fc80df75e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:30.844820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Getting quotas for user 894725e0d56b4960a8bc3e6a8e283b4e and project 44129d75c58240fa867e90b1d3252554. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:05:30.881695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a23c9e2c-ee8a-4dbb-b90e-9f0af8746fe0 req-42655ec2-0a70-4282-8c0f-f8f8a1a60c8b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:30.882291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:05:30.882933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a23c9e2c-ee8a-4dbb-b90e-9f0af8746fe0 req-42655ec2-0a70-4282-8c0f-f8f8a1a60c8b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:30.884101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a23c9e2c-ee8a-4dbb-b90e-9f0af8746fe0 req-42655ec2-0a70-4282-8c0f-f8f8a1a60c8b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:30.889095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:05:30.929872 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a23c9e2c-ee8a-4dbb-b90e-9f0af8746fe0 req-42655ec2-0a70-4282-8c0f-f8f8a1a60c8b service nova] Creating event network-changed:75a144b0-9235-439b-96dc-d12fc80df75e for instance d5d1325b-cb1c-489f-8924-a33c03274f54 on n-h2-845781-6 Aug 09 17:05:30.940861 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a23c9e2c-ee8a-4dbb-b90e-9f0af8746fe0 req-42655ec2-0a70-4282-8c0f-f8f8a1a60c8b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108793 Aug 09 17:05:30.942757 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 258/560] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:30.955530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c7100af-5ef6-469d-80ba-5f309f0606b5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:30.957738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c7100af-5ef6-469d-80ba-5f309f0606b5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:30.969893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c7100af-5ef6-469d-80ba-5f309f0606b5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:30.976111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c7100af-5ef6-469d-80ba-5f309f0606b5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:30.981845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c7100af-5ef6-469d-80ba-5f309f0606b5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:30.983381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c7100af-5ef6-469d-80ba-5f309f0606b5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:30.986151 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fe46d973-45b4-4424-b231-2735e055f8dc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.111291 Aug 09 17:05:30.987046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c7100af-5ef6-469d-80ba-5f309f0606b5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:30.988000 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 303/561] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:05:30.992049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c7100af-5ef6-469d-80ba-5f309f0606b5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:30.998614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c1cefe2b-f906-4e5c-9c26-73bb0d9a5963 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:31.017232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c1cefe2b-f906-4e5c-9c26-73bb0d9a5963 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:31.027384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1cefe2b-f906-4e5c-9c26-73bb0d9a5963 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:31.028129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1cefe2b-f906-4e5c-9c26-73bb0d9a5963 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:31.029455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1cefe2b-f906-4e5c-9c26-73bb0d9a5963 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:31.030420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1cefe2b-f906-4e5c-9c26-73bb0d9a5963 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:31.031120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1cefe2b-f906-4e5c-9c26-73bb0d9a5963 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:31.032101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1cefe2b-f906-4e5c-9c26-73bb0d9a5963 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:31.470673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c1cefe2b-f906-4e5c-9c26-73bb0d9a5963 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:31.488955 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c1cefe2b-f906-4e5c-9c26-73bb0d9a5963 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.499257 Aug 09 17:05:31.528211 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 304/562] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:30 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:31.539321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:31.558632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:31.580898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:31.587054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:31.588271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:31.589864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:31.595154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:31.596619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:31.668319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c7100af-5ef6-469d-80ba-5f309f0606b5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:31.700202 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c7100af-5ef6-469d-80ba-5f309f0606b5 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1313 microversion: 2.1 time: 0.754832 Aug 09 17:05:31.707169 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 259/563] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:30 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1313 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:31.756626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4862ac7b-51b3-45a2-9be8-4f4f79399e78 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:31.757764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4862ac7b-51b3-45a2-9be8-4f4f79399e78 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:31.790589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4862ac7b-51b3-45a2-9be8-4f4f79399e78 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:31.791887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4862ac7b-51b3-45a2-9be8-4f4f79399e78 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:31.793200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4862ac7b-51b3-45a2-9be8-4f4f79399e78 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:31.795515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4862ac7b-51b3-45a2-9be8-4f4f79399e78 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:31.797687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4862ac7b-51b3-45a2-9be8-4f4f79399e78 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:31.799284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4862ac7b-51b3-45a2-9be8-4f4f79399e78 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:31.920447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:05:31.927426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:05:31.940369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:05:31.941306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:05:31.943066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:05:32.094410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:32.124005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4862ac7b-51b3-45a2-9be8-4f4f79399e78 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:32.136760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:32.137357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:32.137820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:32.138719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:32.146541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:32.147205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:32.150093 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4862ac7b-51b3-45a2-9be8-4f4f79399e78 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1323 microversion: 2.1 time: 0.426044 Aug 09 17:05:32.153256 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 260/564] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:31 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1323 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:32.201699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1d37c69-4ddb-46b2-ae01-a48e20394323 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:32.207986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1d37c69-4ddb-46b2-ae01-a48e20394323 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:32.229320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1d37c69-4ddb-46b2-ae01-a48e20394323 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:32.235188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1d37c69-4ddb-46b2-ae01-a48e20394323 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:32.236549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1d37c69-4ddb-46b2-ae01-a48e20394323 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:32.240712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1d37c69-4ddb-46b2-ae01-a48e20394323 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:32.243477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1d37c69-4ddb-46b2-ae01-a48e20394323 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:32.246005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1d37c69-4ddb-46b2-ae01-a48e20394323 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:32.286800 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-58f88ca5-16ae-421e-9307-85609f108eae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action" status: 202 len: 1068 microversion: 2.1 time: 0.755216 Aug 09 17:05:32.301545 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 305/565] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:05:31 2022] POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action => generated 1068 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 09 17:05:32.324581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ebfd862-4dca-47bb-9084-3dc0ba4cf4a0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:32.326480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4ebfd862-4dca-47bb-9084-3dc0ba4cf4a0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:32.350604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ebfd862-4dca-47bb-9084-3dc0ba4cf4a0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:32.352171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ebfd862-4dca-47bb-9084-3dc0ba4cf4a0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:32.353678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ebfd862-4dca-47bb-9084-3dc0ba4cf4a0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:32.354995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ebfd862-4dca-47bb-9084-3dc0ba4cf4a0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:32.362282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ebfd862-4dca-47bb-9084-3dc0ba4cf4a0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:32.363207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ebfd862-4dca-47bb-9084-3dc0ba4cf4a0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:32.484895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a1d37c69-4ddb-46b2-ae01-a48e20394323 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:32.495809 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1d37c69-4ddb-46b2-ae01-a48e20394323 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1215 microversion: 2.1 time: 0.339956 Aug 09 17:05:32.496415 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 261/566] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:32 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1215 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:32.530354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-566e3656-f365-4b1c-bbe4-d113602044e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:32.531399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-566e3656-f365-4b1c-bbe4-d113602044e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:32.559975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-566e3656-f365-4b1c-bbe4-d113602044e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:32.561886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-566e3656-f365-4b1c-bbe4-d113602044e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:32.563172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-566e3656-f365-4b1c-bbe4-d113602044e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:32.565344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-566e3656-f365-4b1c-bbe4-d113602044e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:32.566762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-566e3656-f365-4b1c-bbe4-d113602044e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:32.567668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-566e3656-f365-4b1c-bbe4-d113602044e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:32.681405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:32.962563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ebfd862-4dca-47bb-9084-3dc0ba4cf4a0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:32.980092 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4ebfd862-4dca-47bb-9084-3dc0ba4cf4a0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.658541 Aug 09 17:05:32.981347 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 306/567] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:32 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:32.996392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9034020-fd36-43eb-8cb3-af88bd70b55c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:33.002508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9034020-fd36-43eb-8cb3-af88bd70b55c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:33.020374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9034020-fd36-43eb-8cb3-af88bd70b55c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:33.020954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9034020-fd36-43eb-8cb3-af88bd70b55c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:33.021537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9034020-fd36-43eb-8cb3-af88bd70b55c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:33.027800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9034020-fd36-43eb-8cb3-af88bd70b55c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:33.029753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9034020-fd36-43eb-8cb3-af88bd70b55c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:33.030454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9034020-fd36-43eb-8cb3-af88bd70b55c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:33.064462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-566e3656-f365-4b1c-bbe4-d113602044e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:33.105952 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-566e3656-f365-4b1c-bbe4-d113602044e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.575098 Aug 09 17:05:33.107169 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 262/568] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:32 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:33.178990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6d659194-4e36-4989-9f98-af7d4d66bf04 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:33.182378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6d659194-4e36-4989-9f98-af7d4d66bf04 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:33.207486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d659194-4e36-4989-9f98-af7d4d66bf04 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:33.210675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d659194-4e36-4989-9f98-af7d4d66bf04 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:33.213172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d659194-4e36-4989-9f98-af7d4d66bf04 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:33.221941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d659194-4e36-4989-9f98-af7d4d66bf04 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:33.223037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d659194-4e36-4989-9f98-af7d4d66bf04 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:33.225579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d659194-4e36-4989-9f98-af7d4d66bf04 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:33.672436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6d659194-4e36-4989-9f98-af7d4d66bf04 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:33.685457 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6d659194-4e36-4989-9f98-af7d4d66bf04 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1323 microversion: 2.1 time: 0.515195 Aug 09 17:05:33.698698 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 263/569] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:33 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1323 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:33.708284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-89c56022-88be-4fb5-961f-49623f4ebf78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:33.709068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-89c56022-88be-4fb5-961f-49623f4ebf78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:33.717338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89c56022-88be-4fb5-961f-49623f4ebf78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:33.718611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89c56022-88be-4fb5-961f-49623f4ebf78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:33.718611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89c56022-88be-4fb5-961f-49623f4ebf78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:33.719030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89c56022-88be-4fb5-961f-49623f4ebf78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:33.719888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89c56022-88be-4fb5-961f-49623f4ebf78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:33.720652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89c56022-88be-4fb5-961f-49623f4ebf78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:33.881805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-89c56022-88be-4fb5-961f-49623f4ebf78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:33.892947 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-89c56022-88be-4fb5-961f-49623f4ebf78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1269 microversion: 2.1 time: 0.192203 Aug 09 17:05:33.894209 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 264/570] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:33 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1269 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:33.958467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d9034020-fd36-43eb-8cb3-af88bd70b55c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:33.970233 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9034020-fd36-43eb-8cb3-af88bd70b55c tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1313 microversion: 2.1 time: 0.987248 Aug 09 17:05:33.971896 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 307/571] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:32 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1313 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:34.002497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c7f8d96e-9ea8-4794-b156-2bd2a2663026 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:34.003608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c7f8d96e-9ea8-4794-b156-2bd2a2663026 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:34.011547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7f8d96e-9ea8-4794-b156-2bd2a2663026 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:34.012483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7f8d96e-9ea8-4794-b156-2bd2a2663026 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:34.013380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7f8d96e-9ea8-4794-b156-2bd2a2663026 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:34.014438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7f8d96e-9ea8-4794-b156-2bd2a2663026 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:34.015240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7f8d96e-9ea8-4794-b156-2bd2a2663026 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:34.016588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7f8d96e-9ea8-4794-b156-2bd2a2663026 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:34.300359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1f13140-c244-453b-8bbd-e3b8b6eaf439 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-213673544", "ram": 512, "vcpus": 1, "disk": 10, "id": 1675437092, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:34.306086 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:34.306086 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:34.311485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c7f8d96e-9ea8-4794-b156-2bd2a2663026 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:34.323479 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c7f8d96e-9ea8-4794-b156-2bd2a2663026 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.324731 Aug 09 17:05:34.326400 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 308/572] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:33 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:34.332462 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1f13140-c244-453b-8bbd-e3b8b6eaf439 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.436740 Aug 09 17:05:34.333960 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 265/573] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:33 2022] POST /compute/v2.1/flavors => generated 415 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:34.337952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-988bb959-0c42-4702-8da0-242e8c267537 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:34.338665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-988bb959-0c42-4702-8da0-242e8c267537 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:34.352345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-988bb959-0c42-4702-8da0-242e8c267537 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:34.352345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-988bb959-0c42-4702-8da0-242e8c267537 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:34.352533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-988bb959-0c42-4702-8da0-242e8c267537 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:34.356666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-988bb959-0c42-4702-8da0-242e8c267537 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:34.357059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-988bb959-0c42-4702-8da0-242e8c267537 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:34.358026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-988bb959-0c42-4702-8da0-242e8c267537 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:34.509418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3731b2bf-635a-4b35-b97e-1e9b05c24ec1 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:34.520039 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-3731b2bf-635a-4b35-b97e-1e9b05c24ec1 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] HTTP exception thrown: Flavor 1675437092 has no extra specs with key hw:cpu_thread_policy. Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3731b2bf-635a-4b35-b97e-1e9b05c24ec1 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Request method failure captured: Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/flavors/1675437092/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPbcfujGMKpTBMwW7QZnVSN2Vct3EHvSnEMt2_UGSRPRUzRzNFMwBh0sB13TPGrwMCRVDzjp8GKjMKmBwg0Pxa2ZexB2IDntj9Vwpo1JyEWdqrHc4tX5CYyh5SYhs6vqH4TkP1ZjDFgX6RvTKGZpVx0jPwVu68C99qV3wdxjN7_l8o Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5bca825c20604166a048b7466a17a6c0 Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:34.527521 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:34.528963 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5bca825c20604166a048b7466a17a6c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:34.528963 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.528963 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5bca825c20604166a048b7466a17a6c0 Aug 09 17:05:34.528963 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.528963 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project Aug 09 17:05:34.528963 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:34.528963 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:34.528963 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 65f28b4ac271451ab4a218c96fc371c6 Aug 09 17:05:34.528963 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project Aug 09 17:05:34.528963 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:34.528963 n-d-845781-6 devstack@n-api.service[119431]: exception: Flavor 1675437092 has no extra specs with key hw:cpu_thread_policy. Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'flavor_id': '1675437092', 'id': 'hw:cpu_thread_policy'} Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1675437092 has no extra specs with key hw:cpu_thread_policy. Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:34.529635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.537033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.537033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.537033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.537033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:34.537033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:34.537033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1675437092 has no extra specs with key hw:cpu_thread_policy. Aug 09 17:05:34.537033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.537033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3731b2bf-635a-4b35-b97e-1e9b05c24ec1 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Returning 404 to user: Flavor 1675437092 has no extra specs with key hw:cpu_thread_policy. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:34.537033 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3731b2bf-635a-4b35-b97e-1e9b05c24ec1 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] 10.222.0.93 "GET /compute/v2.1/flavors/1675437092/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.185376 Aug 09 17:05:34.537033 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 266/574] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:05:34 2022] GET /compute/v2.1/flavors/1675437092/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:05:34.541483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-947c532c-b99a-44c0-9b16-913d36b86e9c tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:34.545854 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:34.545854 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:34.546925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-947c532c-b99a-44c0-9b16-913d36b86e9c tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '65f28b4ac271451ab4a218c96fc371c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca825c20604166a048b7466a17a6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-947c532c-b99a-44c0-9b16-913d36b86e9c tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Request method failure captured: Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/flavors/1675437092/os-extra_specs HTTP/1.1 Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 66 Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPbcfujGMKpTBMwW7QZnVSN2Vct3EHvSnEMt2_UGSRPRUzRzNFMwBh0sB13TPGrwMCRVDzjp8GKjMKmBwg0Pxa2ZexB2IDntj9Vwpo1JyEWdqrHc4tX5CYyh5SYhs6vqH4TkP1ZjDFgX6RvTKGZpVx0jPwVu68C99qV3wdxjN7_l8o Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5bca825c20604166a048b7466a17a6c0 Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:34.548868 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5bca825c20604166a048b7466a17a6c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5bca825c20604166a048b7466a17a6c0 Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 65f28b4ac271451ab4a218c96fc371c6 Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 09 17:05:34.550187 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'flavor_id': '1675437092', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:05:34.550982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 09 17:05:34.552246 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.555573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-947c532c-b99a-44c0-9b16-913d36b86e9c tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:34.555573 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-947c532c-b99a-44c0-9b16-913d36b86e9c tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] 10.222.0.93 "POST /compute/v2.1/flavors/1675437092/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.013714 Aug 09 17:05:34.555573 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 267/575] 10.222.0.93 () {60 vars in 1224 bytes} [Tue Aug 9 17:05:34 2022] POST /compute/v2.1/flavors/1675437092/os-extra_specs => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:05:34.562579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea74656f-449a-434f-a6e3-ffdb6ad3f1a4 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:34.601440 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ea74656f-449a-434f-a6e3-ffdb6ad3f1a4 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1675437092/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043342 Aug 09 17:05:34.602422 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 268/576] 10.222.0.93 () {60 vars in 1224 bytes} [Tue Aug 9 17:05:34 2022] POST /compute/v2.1/flavors/1675437092/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:05:34.615104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c707202a-ddeb-42e2-b73b-38976ca28b91 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:34.616267 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:34.616267 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:34.619873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c707202a-ddeb-42e2-b73b-38976ca28b91 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '65f28b4ac271451ab4a218c96fc371c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca825c20604166a048b7466a17a6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c707202a-ddeb-42e2-b73b-38976ca28b91 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Request method failure captured: Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPbcfujGMKpTBMwW7QZnVSN2Vct3EHvSnEMt2_UGSRPRUzRzNFMwBh0sB13TPGrwMCRVDzjp8GKjMKmBwg0Pxa2ZexB2IDntj9Vwpo1JyEWdqrHc4tX5CYyh5SYhs6vqH4TkP1ZjDFgX6RvTKGZpVx0jPwVu68C99qV3wdxjN7_l8o Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5bca825c20604166a048b7466a17a6c0 Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:34.622236 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:34.623867 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5bca825c20604166a048b7466a17a6c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:34.623867 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.623867 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5bca825c20604166a048b7466a17a6c0 Aug 09 17:05:34.623867 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.623867 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project Aug 09 17:05:34.623867 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:34.623867 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:34.623867 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 65f28b4ac271451ab4a218c96fc371c6 Aug 09 17:05:34.623867 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project Aug 09 17:05:34.623867 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:34.623867 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'flavor_id': '1675437092', 'id': 'hw:numa_nodes'} Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:05:34.624927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.626952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c707202a-ddeb-42e2-b73b-38976ca28b91 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:34.628667 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c707202a-ddeb-42e2-b73b-38976ca28b91 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] 10.222.0.93 "DELETE /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016428 Aug 09 17:05:34.629633 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 269/577] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:05:34 2022] DELETE /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:05:34.640316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-969b1d42-5c2a-4583-8027-7f2db45718cd tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:34.668222 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-969b1d42-5c2a-4583-8027-7f2db45718cd tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1675437092/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031948 Aug 09 17:05:34.669315 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 270/578] 10.222.0.93 () {60 vars in 1224 bytes} [Tue Aug 9 17:05:34 2022] POST /compute/v2.1/flavors/1675437092/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:05:34.679726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0752e212-b932-44ba-8387-208c5955da5e tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:34.682524 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:34.682524 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:34.683606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0752e212-b932-44ba-8387-208c5955da5e tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '65f28b4ac271451ab4a218c96fc371c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bca825c20604166a048b7466a17a6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0752e212-b932-44ba-8387-208c5955da5e tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Request method failure captured: Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: request: PUT /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 22 Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPbcfujGMKpTBMwW7QZnVSN2Vct3EHvSnEMt2_UGSRPRUzRzNFMwBh0sB13TPGrwMCRVDzjp8GKjMKmBwg0Pxa2ZexB2IDntj9Vwpo1JyEWdqrHc4tX5CYyh5SYhs6vqH4TkP1ZjDFgX6RvTKGZpVx0jPwVu68C99qV3wdxjN7_l8o Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5bca825c20604166a048b7466a17a6c0 Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:34.685443 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5bca825c20604166a048b7466a17a6c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5bca825c20604166a048b7466a17a6c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5bca825c20604166a048b7466a17a6c0 Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 65f28b4ac271451ab4a218c96fc371c6 Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: {"hw:numa_nodes": "1"} Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:34.687512 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'flavor_id': '1675437092', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:05:34.688632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 09 17:05:34.689945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.691364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0752e212-b932-44ba-8387-208c5955da5e tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:34.691806 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0752e212-b932-44ba-8387-208c5955da5e tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706 tempest-FlavorsExtraSpecsNegativeTestJSON-2003902706-project] 10.222.0.93 "PUT /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016117 Aug 09 17:05:34.692718 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 271/579] 10.222.0.93 () {60 vars in 1265 bytes} [Tue Aug 9 17:05:34 2022] PUT /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:05:34.702575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3820be8-3b4e-4bae-84db-85dfa3d28d1f tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:34.712801 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-e3820be8-3b4e-4bae-84db-85dfa3d28d1f tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] HTTP exception thrown: Flavor 1675437092 has no extra specs with key hw:cpu_thread_policy. Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3820be8-3b4e-4bae-84db-85dfa3d28d1f tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Request method failure captured: Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/flavors/1675437092/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPdBhQ6sgQ06Z9au9KkxSPMmO-wFjHv3I2Dn-8gwdnSexgK7-iY6v653gu323HCMY7ezzNxxmLDAVLTEUDLQdbgGhRi7_177QtILB3Xvi945ZAeUkXj0sISz-ZUPWBtA8sHuxSwg3zDFWlT-RGGO-zv6wRvOEDJdWmbRrXSost27-I Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: da31887542174b05a0184394fe863552 Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:05:34.715464 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:05:34.717287 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_da31887542174b05a0184394fe863552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da31887542174b05a0184394fe863552"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da31887542174b05a0184394fe863552"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/da31887542174b05a0184394fe863552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:34.717287 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 Aug 09 17:05:34.717287 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: da31887542174b05a0184394fe863552 Aug 09 17:05:34.717287 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 Aug 09 17:05:34.717287 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin Aug 09 17:05:34.717287 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:34.717287 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:34.717287 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 5d5f6d2f2e78438e8003950bd4545fcf Aug 09 17:05:34.717287 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin Aug 09 17:05:34.717287 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:34.717287 n-d-845781-6 devstack@n-api.service[119431]: exception: Flavor 1675437092 has no extra specs with key hw:cpu_thread_policy. Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'flavor_id': '1675437092', 'id': 'hw:cpu_thread_policy'} Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1675437092 has no extra specs with key hw:cpu_thread_policy. Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:34.718272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.721665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.721665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.721665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.721665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:34.721665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:34.721665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1675437092 has no extra specs with key hw:cpu_thread_policy. Aug 09 17:05:34.721665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.721665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3820be8-3b4e-4bae-84db-85dfa3d28d1f tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Returning 404 to user: Flavor 1675437092 has no extra specs with key hw:cpu_thread_policy. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:34.721665 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3820be8-3b4e-4bae-84db-85dfa3d28d1f tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1675437092/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.018128 Aug 09 17:05:34.721665 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 272/580] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:05:34 2022] DELETE /compute/v2.1/flavors/1675437092/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:05:34.728412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7da18c7-c580-4527-b36a-e836b2274ac8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:34.729755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b7da18c7-c580-4527-b36a-e836b2274ac8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:34.738033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7da18c7-c580-4527-b36a-e836b2274ac8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:34.738557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7da18c7-c580-4527-b36a-e836b2274ac8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:34.739083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7da18c7-c580-4527-b36a-e836b2274ac8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:34.739936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7da18c7-c580-4527-b36a-e836b2274ac8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:34.740515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7da18c7-c580-4527-b36a-e836b2274ac8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:34.741029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7da18c7-c580-4527-b36a-e836b2274ac8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:34.861246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-988bb959-0c42-4702-8da0-242e8c267537 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:34.872414 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-988bb959-0c42-4702-8da0-242e8c267537 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.544109 Aug 09 17:05:34.873385 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 309/581] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:34 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:34.881366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c3061c44-5041-456e-ba62-5a279ae0a8b3 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:34.884963 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:34.884963 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:34.886729 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-c3061c44-5041-456e-ba62-5a279ae0a8b3 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c3061c44-5041-456e-ba62-5a279ae0a8b3 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Request method failure captured: Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 27 Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pPdBhQ6sgQ06Z9au9KkxSPMmO-wFjHv3I2Dn-8gwdnSexgK7-iY6v653gu323HCMY7ezzNxxmLDAVLTEUDLQdbgGhRi7_177QtILB3Xvi945ZAeUkXj0sISz-ZUPWBtA8sHuxSwg3zDFWlT-RGGO-zv6wRvOEDJdWmbRrXSost27-I Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: da31887542174b05a0184394fe863552 Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:05:34.889957 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_da31887542174b05a0184394fe863552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da31887542174b05a0184394fe863552"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da31887542174b05a0184394fe863552"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/da31887542174b05a0184394fe863552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: da31887542174b05a0184394fe863552 Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 5d5f6d2f2e78438e8003950bd4545fcf Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: {"hw:cpu_policy": "shared"} Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:05:34.891316 n-d-845781-6 devstack@n-api.service[119432]: exception: Request body and URI mismatch Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'flavor_id': '1675437092', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.892130 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.893347 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:34.893347 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:34.893347 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 09 17:05:34.893347 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.893347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c3061c44-5041-456e-ba62-5a279ae0a8b3 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:34.893347 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c3061c44-5041-456e-ba62-5a279ae0a8b3 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.017045 Aug 09 17:05:34.893347 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 310/582] 10.222.0.93 () {60 vars in 1265 bytes} [Tue Aug 9 17:05:34 2022] PUT /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes => generated 73 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:05:34.904596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7c5acc15-7255-4a0d-bacb-8f396c8f39ef tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7c5acc15-7255-4a0d-bacb-8f396c8f39ef tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Request method failure captured: Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 49 Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pPdBhQ6sgQ06Z9au9KkxSPMmO-wFjHv3I2Dn-8gwdnSexgK7-iY6v653gu323HCMY7ezzNxxmLDAVLTEUDLQdbgGhRi7_177QtILB3Xvi945ZAeUkXj0sISz-ZUPWBtA8sHuxSwg3zDFWlT-RGGO-zv6wRvOEDJdWmbRrXSost27-I Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: da31887542174b05a0184394fe863552 Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:05:34.912255 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_da31887542174b05a0184394fe863552"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da31887542174b05a0184394fe863552"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/da31887542174b05a0184394fe863552"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/da31887542174b05a0184394fe863552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: da31887542174b05a0184394fe863552 Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 5d5f6d2f2e78438e8003950bd4545fcf Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 09 17:05:34.913905 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'flavor_id': '1675437092', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance: Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 09 17:05:34.914776 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.917162 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:34.918510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:34.918510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:34.918510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:05:34.918510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:05:34.918510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 09 17:05:34.918510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:34.918510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7c5acc15-7255-4a0d-bacb-8f396c8f39ef tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:34.921109 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7c5acc15-7255-4a0d-bacb-8f396c8f39ef tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.021400 Aug 09 17:05:34.922200 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 311/583] 10.222.0.93 () {60 vars in 1265 bytes} [Tue Aug 9 17:05:34 2022] PUT /compute/v2.1/flavors/1675437092/os-extra_specs/hw:numa_nodes => generated 117 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 17:05:34.944563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0f423b15-4ce1-41ce-b847-1b326600dcc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:34.945582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0f423b15-4ce1-41ce-b847-1b326600dcc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:34.953202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b7da18c7-c580-4527-b36a-e836b2274ac8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:34.960030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f423b15-4ce1-41ce-b847-1b326600dcc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:34.962895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f423b15-4ce1-41ce-b847-1b326600dcc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:34.963764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f423b15-4ce1-41ce-b847-1b326600dcc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:34.965928 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7da18c7-c580-4527-b36a-e836b2274ac8 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1323 microversion: 2.1 time: 0.246258 Aug 09 17:05:34.967188 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 273/584] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:34 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1323 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:34.972924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f423b15-4ce1-41ce-b847-1b326600dcc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:34.976796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f423b15-4ce1-41ce-b847-1b326600dcc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:34.978508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f423b15-4ce1-41ce-b847-1b326600dcc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:34.987847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-acf21846-f7f5-4676-8f46-0ae5718d4856 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:34.990731 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:34.990731 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:05:35.019751 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-acf21846-f7f5-4676-8f46-0ae5718d4856 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1675437092" status: 202 len: 0 microversion: 2.1 time: 0.051017 Aug 09 17:05:35.020559 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 274/585] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:05:34 2022] DELETE /compute/v2.1/flavors/1675437092 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:05:35.027651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6670b57-f96d-42a8-9da3-ab85aa1ce581 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:35.028903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e6670b57-f96d-42a8-9da3-ab85aa1ce581 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:35.057923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6670b57-f96d-42a8-9da3-ab85aa1ce581 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:35.058986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6670b57-f96d-42a8-9da3-ab85aa1ce581 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:35.059375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6670b57-f96d-42a8-9da3-ab85aa1ce581 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:35.060315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6670b57-f96d-42a8-9da3-ab85aa1ce581 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:35.061201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6670b57-f96d-42a8-9da3-ab85aa1ce581 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:35.061624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6670b57-f96d-42a8-9da3-ab85aa1ce581 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:35.160165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0f423b15-4ce1-41ce-b847-1b326600dcc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:35.173671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:35.178417 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0f423b15-4ce1-41ce-b847-1b326600dcc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1269 microversion: 2.1 time: 0.254342 Aug 09 17:05:35.191802 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 312/586] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:34 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1269 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:35.200121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-61894aa0-22ff-4763-8ebb-a0a756bce2a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:35.228614 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-61894aa0-22ff-4763-8ebb-a0a756bce2a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624 tempest-FlavorsExtraSpecsNegativeTestJSON-1232570624-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.037287 Aug 09 17:05:35.229744 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 313/587] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:05:35 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:35.266489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e6670b57-f96d-42a8-9da3-ab85aa1ce581 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:35.267762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-3b2dcf39-16e2-495a-a578-b6394c0f815c req-cd8bb290-05bb-4316-a89e-6d34b3827758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d1325b-cb1c-489f-8924-a33c03274f54", "name": "network-vif-plugged", "status": "completed", "tag": "75a144b0-9235-439b-96dc-d12fc80df75e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:35.278299 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e6670b57-f96d-42a8-9da3-ab85aa1ce581 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1313 microversion: 2.1 time: 0.256297 Aug 09 17:05:35.279536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 275/588] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:35 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:35.281561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:35.296509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3b2dcf39-16e2-495a-a578-b6394c0f815c req-cd8bb290-05bb-4316-a89e-6d34b3827758 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:35.297488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3b2dcf39-16e2-495a-a578-b6394c0f815c req-cd8bb290-05bb-4316-a89e-6d34b3827758 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:35.298078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3b2dcf39-16e2-495a-a578-b6394c0f815c req-cd8bb290-05bb-4316-a89e-6d34b3827758 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:35.329055 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-3b2dcf39-16e2-495a-a578-b6394c0f815c req-cd8bb290-05bb-4316-a89e-6d34b3827758 service nova] Creating event network-vif-plugged:75a144b0-9235-439b-96dc-d12fc80df75e for instance d5d1325b-cb1c-489f-8924-a33c03274f54 on n-h2-845781-6 Aug 09 17:05:35.334876 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-3b2dcf39-16e2-495a-a578-b6394c0f815c req-cd8bb290-05bb-4316-a89e-6d34b3827758 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072584 Aug 09 17:05:35.336055 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 314/589] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:05:35.351728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b8d239cf-1c43-41d6-ae04-e5d1d7ca510e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:35.352596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b8d239cf-1c43-41d6-ae04-e5d1d7ca510e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:35.379553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8d239cf-1c43-41d6-ae04-e5d1d7ca510e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:35.382976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8d239cf-1c43-41d6-ae04-e5d1d7ca510e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:35.388652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8d239cf-1c43-41d6-ae04-e5d1d7ca510e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:35.390061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8d239cf-1c43-41d6-ae04-e5d1d7ca510e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:35.393034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8d239cf-1c43-41d6-ae04-e5d1d7ca510e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:35.393789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8d239cf-1c43-41d6-ae04-e5d1d7ca510e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:35.724189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b8d239cf-1c43-41d6-ae04-e5d1d7ca510e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:35.734985 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b8d239cf-1c43-41d6-ae04-e5d1d7ca510e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.390001 Aug 09 17:05:35.736064 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 276/590] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:35 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:35.895527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7494bbfa-ccec-4c90-aa33-c161ec62bd02 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:35.896281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7494bbfa-ccec-4c90-aa33-c161ec62bd02 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:35.917828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7494bbfa-ccec-4c90-aa33-c161ec62bd02 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:35.918350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7494bbfa-ccec-4c90-aa33-c161ec62bd02 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:35.920729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7494bbfa-ccec-4c90-aa33-c161ec62bd02 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:35.923493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7494bbfa-ccec-4c90-aa33-c161ec62bd02 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:35.926838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7494bbfa-ccec-4c90-aa33-c161ec62bd02 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:35.928305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7494bbfa-ccec-4c90-aa33-c161ec62bd02 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:35.993674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3d7be3a9-3905-462d-a491-29059396d2a6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:35.995584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3d7be3a9-3905-462d-a491-29059396d2a6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:36.008722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d7be3a9-3905-462d-a491-29059396d2a6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:36.009754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d7be3a9-3905-462d-a491-29059396d2a6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:36.010593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d7be3a9-3905-462d-a491-29059396d2a6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:36.011863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d7be3a9-3905-462d-a491-29059396d2a6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:36.012609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d7be3a9-3905-462d-a491-29059396d2a6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:36.013274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d7be3a9-3905-462d-a491-29059396d2a6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:36.293837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3d7be3a9-3905-462d-a491-29059396d2a6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:36.304401 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3d7be3a9-3905-462d-a491-29059396d2a6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1323 microversion: 2.1 time: 0.315348 Aug 09 17:05:36.308998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7494bbfa-ccec-4c90-aa33-c161ec62bd02 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:36.314583 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 277/591] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:35 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:36.324031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-54f80861-c4ef-49e9-92ab-b16ce55b74c6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:36.324780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-54f80861-c4ef-49e9-92ab-b16ce55b74c6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:36.325494 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7494bbfa-ccec-4c90-aa33-c161ec62bd02 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.434306 Aug 09 17:05:36.326019 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 315/592] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:35 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:36.337235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54f80861-c4ef-49e9-92ab-b16ce55b74c6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:36.340746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54f80861-c4ef-49e9-92ab-b16ce55b74c6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:36.341407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54f80861-c4ef-49e9-92ab-b16ce55b74c6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:36.342353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54f80861-c4ef-49e9-92ab-b16ce55b74c6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:36.343048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54f80861-c4ef-49e9-92ab-b16ce55b74c6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:36.345038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69d2828b-2f5e-42e6-aa85-fbb97655939a tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:36.345976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54f80861-c4ef-49e9-92ab-b16ce55b74c6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:36.346212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-69d2828b-2f5e-42e6-aa85-fbb97655939a tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:36.362229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d2828b-2f5e-42e6-aa85-fbb97655939a tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:36.362720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d2828b-2f5e-42e6-aa85-fbb97655939a tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:36.363453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d2828b-2f5e-42e6-aa85-fbb97655939a tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:36.364459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d2828b-2f5e-42e6-aa85-fbb97655939a tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:36.365070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d2828b-2f5e-42e6-aa85-fbb97655939a tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:36.365562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d2828b-2f5e-42e6-aa85-fbb97655939a tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:36.736458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69d2828b-2f5e-42e6-aa85-fbb97655939a tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:36.752934 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69d2828b-2f5e-42e6-aa85-fbb97655939a tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1313 microversion: 2.1 time: 0.411618 Aug 09 17:05:36.770584 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 316/593] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:36 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:36.809723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1a0b2ae-ebc7-49eb-934b-59e449db81f6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:36.810877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f1a0b2ae-ebc7-49eb-934b-59e449db81f6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:36.822031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a0b2ae-ebc7-49eb-934b-59e449db81f6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:36.822935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a0b2ae-ebc7-49eb-934b-59e449db81f6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:36.824874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a0b2ae-ebc7-49eb-934b-59e449db81f6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:36.826746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a0b2ae-ebc7-49eb-934b-59e449db81f6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:36.828399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a0b2ae-ebc7-49eb-934b-59e449db81f6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:36.829665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a0b2ae-ebc7-49eb-934b-59e449db81f6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:36.860778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-54f80861-c4ef-49e9-92ab-b16ce55b74c6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:36.875503 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-54f80861-c4ef-49e9-92ab-b16ce55b74c6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1311 microversion: 2.1 time: 0.557856 Aug 09 17:05:36.876995 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 278/594] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:36 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1311 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:37.191597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ac3e1519-8f56-4b7a-b073-b1d947e13aa0 req-ce7c0638-69bc-45f5-a475-aa5aa52d0851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb84cd97-b6b0-40f0-9774-e5baa48fc7c9", "tag": "22f0d67b-a0ab-4059-b2b2-907936f07fb8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:37.193277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f1a0b2ae-ebc7-49eb-934b-59e449db81f6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:37.206382 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f1a0b2ae-ebc7-49eb-934b-59e449db81f6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.424650 Aug 09 17:05:37.207882 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 317/595] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:36 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:37.253157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ac3e1519-8f56-4b7a-b073-b1d947e13aa0 req-ce7c0638-69bc-45f5-a475-aa5aa52d0851 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:37.254754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ac3e1519-8f56-4b7a-b073-b1d947e13aa0 req-ce7c0638-69bc-45f5-a475-aa5aa52d0851 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:37.260676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ac3e1519-8f56-4b7a-b073-b1d947e13aa0 req-ce7c0638-69bc-45f5-a475-aa5aa52d0851 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:37.279377 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ac3e1519-8f56-4b7a-b073-b1d947e13aa0 req-ce7c0638-69bc-45f5-a475-aa5aa52d0851 service nova] Creating event network-changed:22f0d67b-a0ab-4059-b2b2-907936f07fb8 for instance fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 on n-h1-845781-6 Aug 09 17:05:37.285908 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ac3e1519-8f56-4b7a-b073-b1d947e13aa0 req-ce7c0638-69bc-45f5-a475-aa5aa52d0851 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100207 Aug 09 17:05:37.287455 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 279/596] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:37.339341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8b6635ca-1324-45f8-8842-9558947fe69d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:37.342663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8b6635ca-1324-45f8-8842-9558947fe69d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:37.348446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ff5e9014-4c3c-41bd-9fc8-315c60ed2966 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:37.349683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ff5e9014-4c3c-41bd-9fc8-315c60ed2966 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:37.357222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff5e9014-4c3c-41bd-9fc8-315c60ed2966 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:37.358086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff5e9014-4c3c-41bd-9fc8-315c60ed2966 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:37.358876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff5e9014-4c3c-41bd-9fc8-315c60ed2966 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:37.359897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff5e9014-4c3c-41bd-9fc8-315c60ed2966 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:37.360717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff5e9014-4c3c-41bd-9fc8-315c60ed2966 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:37.361381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff5e9014-4c3c-41bd-9fc8-315c60ed2966 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:37.371073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b6635ca-1324-45f8-8842-9558947fe69d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:37.375536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b6635ca-1324-45f8-8842-9558947fe69d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:37.379820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b6635ca-1324-45f8-8842-9558947fe69d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:37.387901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b6635ca-1324-45f8-8842-9558947fe69d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:37.388568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b6635ca-1324-45f8-8842-9558947fe69d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:37.389024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b6635ca-1324-45f8-8842-9558947fe69d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:37.671129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ff5e9014-4c3c-41bd-9fc8-315c60ed2966 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:37.681000 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ff5e9014-4c3c-41bd-9fc8-315c60ed2966 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.337078 Aug 09 17:05:37.681848 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 280/597] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:37 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:37.686778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-cd0273d8-3137-4723-93a0-8201abef5902 req-c9bf7f5d-f7db-4d94-b9fd-d583b7c852b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba7157e9-1f83-4ddd-803b-7a7e16a04b6e", "name": "network-vif-plugged", "status": "completed", "tag": "22ef96e6-092c-4a0f-a819-538f093d3cb4"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:37.698622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cd0273d8-3137-4723-93a0-8201abef5902 req-c9bf7f5d-f7db-4d94-b9fd-d583b7c852b1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:37.699556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cd0273d8-3137-4723-93a0-8201abef5902 req-c9bf7f5d-f7db-4d94-b9fd-d583b7c852b1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:37.700286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cd0273d8-3137-4723-93a0-8201abef5902 req-c9bf7f5d-f7db-4d94-b9fd-d583b7c852b1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:37.718787 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-cd0273d8-3137-4723-93a0-8201abef5902 req-c9bf7f5d-f7db-4d94-b9fd-d583b7c852b1 service nova] Creating event network-vif-plugged:22ef96e6-092c-4a0f-a819-538f093d3cb4 for instance ba7157e9-1f83-4ddd-803b-7a7e16a04b6e on n-h1-845781-6 Aug 09 17:05:37.726011 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-cd0273d8-3137-4723-93a0-8201abef5902 req-c9bf7f5d-f7db-4d94-b9fd-d583b7c852b1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042652 Aug 09 17:05:37.727100 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 281/598] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:37.795164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e989f17-ec97-4762-84a6-2398e379960f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:37.795912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e989f17-ec97-4762-84a6-2398e379960f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:37.803198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e989f17-ec97-4762-84a6-2398e379960f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:37.804243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e989f17-ec97-4762-84a6-2398e379960f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:37.804944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e989f17-ec97-4762-84a6-2398e379960f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:37.806182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e989f17-ec97-4762-84a6-2398e379960f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:37.806920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e989f17-ec97-4762-84a6-2398e379960f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:37.807739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e989f17-ec97-4762-84a6-2398e379960f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:37.818827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8b6635ca-1324-45f8-8842-9558947fe69d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:37.836449 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8b6635ca-1324-45f8-8842-9558947fe69d tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1323 microversion: 2.1 time: 0.510391 Aug 09 17:05:37.838583 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 318/599] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:37 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1323 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:37.923578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e9f85e4c-5064-4df8-a634-12121b42a619 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:37.924225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e9f85e4c-5064-4df8-a634-12121b42a619 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:37.934290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9f85e4c-5064-4df8-a634-12121b42a619 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:37.934912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9f85e4c-5064-4df8-a634-12121b42a619 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:37.935371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9f85e4c-5064-4df8-a634-12121b42a619 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:37.936787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9f85e4c-5064-4df8-a634-12121b42a619 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:37.937197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9f85e4c-5064-4df8-a634-12121b42a619 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:37.937728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9f85e4c-5064-4df8-a634-12121b42a619 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:38.034444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4e989f17-ec97-4762-84a6-2398e379960f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:38.046843 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e989f17-ec97-4762-84a6-2398e379960f tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1462 microversion: 2.1 time: 0.257034 Aug 09 17:05:38.047803 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 282/600] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:37 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1462 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:38.367772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e9f85e4c-5064-4df8-a634-12121b42a619 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:38.378034 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e9f85e4c-5064-4df8-a634-12121b42a619 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1311 microversion: 2.1 time: 0.465788 Aug 09 17:05:38.379062 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 319/601] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:37 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1311 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:38.386910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0b151f38-dce6-4f32-861c-f1ed694f4be0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:38.388109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0b151f38-dce6-4f32-861c-f1ed694f4be0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:38.398171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b151f38-dce6-4f32-861c-f1ed694f4be0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:38.399457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b151f38-dce6-4f32-861c-f1ed694f4be0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:38.400226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b151f38-dce6-4f32-861c-f1ed694f4be0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:38.401885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b151f38-dce6-4f32-861c-f1ed694f4be0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:38.403298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b151f38-dce6-4f32-861c-f1ed694f4be0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:38.404013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b151f38-dce6-4f32-861c-f1ed694f4be0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:38.484555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e499306-787b-4261-9221-795af6e6e6f5 tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Calling method '.version_select at 0x7fbbcb9f21f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:38.498778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e499306-787b-4261-9221-795af6e6e6f5 tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:38.499281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e499306-787b-4261-9221-795af6e6e6f5 tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:38.500363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e499306-787b-4261-9221-795af6e6e6f5 tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:38.545110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e499306-787b-4261-9221-795af6e6e6f5 tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:38.545923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e499306-787b-4261-9221-795af6e6e6f5 tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:38.547316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e499306-787b-4261-9221-795af6e6e6f5 tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:38.595221 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e499306-787b-4261-9221-795af6e6e6f5 tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/4297ff3ee10c4305bccd42a8a7587016?start=2022-08-08T17%3A05%3A38.061821&end=2022-08-10T17%3A05%3A38.061821" status: 200 len: 694 microversion: 2.1 time: 0.528968 Aug 09 17:05:38.612717 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 283/602] 10.222.0.93 () {58 vars in 1412 bytes} [Tue Aug 9 17:05:38 2022] GET /compute/v2.1/os-simple-tenant-usage/4297ff3ee10c4305bccd42a8a7587016?start=2022-08-08T17%3A05%3A38.061821&end=2022-08-10T17%3A05%3A38.061821 => generated 694 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:05:38.636968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df06e84f-d336-450d-a65a-b9b5553a09aa tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '.version_select at 0x7fbbcbb13b80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:38.651298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df06e84f-d336-450d-a65a-b9b5553a09aa tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:38.652051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df06e84f-d336-450d-a65a-b9b5553a09aa tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:38.652813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df06e84f-d336-450d-a65a-b9b5553a09aa tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:38.677956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df06e84f-d336-450d-a65a-b9b5553a09aa tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:38.678755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df06e84f-d336-450d-a65a-b9b5553a09aa tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:38.680051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df06e84f-d336-450d-a65a-b9b5553a09aa tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:38.709433 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df06e84f-d336-450d-a65a-b9b5553a09aa tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/4297ff3ee10c4305bccd42a8a7587016?start=2022-08-08T17%3A05%3A38.061821&end=2022-08-10T17%3A05%3A38.061821" status: 200 len: 694 microversion: 2.1 time: 0.080364 Aug 09 17:05:38.714751 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 284/603] 10.222.0.93 () {58 vars in 1412 bytes} [Tue Aug 9 17:05:38 2022] GET /compute/v2.1/os-simple-tenant-usage/4297ff3ee10c4305bccd42a8a7587016?start=2022-08-08T17%3A05%3A38.061821&end=2022-08-10T17%3A05%3A38.061821 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:38.724940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f5c2c04a-31f7-4920-a6ed-2625d6f80d54 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:38.726912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f5c2c04a-31f7-4920-a6ed-2625d6f80d54 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:38.740292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c2c04a-31f7-4920-a6ed-2625d6f80d54 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:38.741368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c2c04a-31f7-4920-a6ed-2625d6f80d54 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:38.742371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c2c04a-31f7-4920-a6ed-2625d6f80d54 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:38.744223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c2c04a-31f7-4920-a6ed-2625d6f80d54 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:38.745265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c2c04a-31f7-4920-a6ed-2625d6f80d54 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:38.746396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c2c04a-31f7-4920-a6ed-2625d6f80d54 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:38.787590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0b151f38-dce6-4f32-861c-f1ed694f4be0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:38.810917 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0b151f38-dce6-4f32-861c-f1ed694f4be0 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.430013 Aug 09 17:05:38.811737 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 320/604] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:38 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:38.830632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4bd80a34-5cea-494a-82ac-562f33edde1e tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Calling method '.version_select at 0x7fbbcbcca3a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:38.849662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd80a34-5cea-494a-82ac-562f33edde1e tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:38.852756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd80a34-5cea-494a-82ac-562f33edde1e tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:38.853544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd80a34-5cea-494a-82ac-562f33edde1e tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:38.901898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd80a34-5cea-494a-82ac-562f33edde1e tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:38.902816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd80a34-5cea-494a-82ac-562f33edde1e tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:38.905225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd80a34-5cea-494a-82ac-562f33edde1e tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:39.003139 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4bd80a34-5cea-494a-82ac-562f33edde1e tempest-TenantUsagesTestJSON-22832867 tempest-TenantUsagesTestJSON-22832867-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-08T17%3A05%3A38.061821&end=2022-08-10T17%3A05%3A38.061821&detailed=1" status: 200 len: 5999 microversion: 2.1 time: 0.189853 Aug 09 17:05:39.003798 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 321/605] 10.222.0.93 () {58 vars in 1335 bytes} [Tue Aug 9 17:05:38 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-08T17%3A05%3A38.061821&end=2022-08-10T17%3A05%3A38.061821&detailed=1 => generated 5999 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:39.020326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-96e7f75e-c228-4786-8da6-c7cf9da12888 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:39.020326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-96e7f75e-c228-4786-8da6-c7cf9da12888 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:39.045814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96e7f75e-c228-4786-8da6-c7cf9da12888 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:39.046613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96e7f75e-c228-4786-8da6-c7cf9da12888 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:39.047322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96e7f75e-c228-4786-8da6-c7cf9da12888 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:39.050861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96e7f75e-c228-4786-8da6-c7cf9da12888 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:39.051848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96e7f75e-c228-4786-8da6-c7cf9da12888 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:39.052582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96e7f75e-c228-4786-8da6-c7cf9da12888 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:39.235564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f5c2c04a-31f7-4920-a6ed-2625d6f80d54 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:39.249255 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f5c2c04a-31f7-4920-a6ed-2625d6f80d54 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.532163 Aug 09 17:05:39.249930 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 285/606] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:38 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:39.267608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be53f7e0-038f-4633-90ab-3dc14d74427b tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:39.268366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-be53f7e0-038f-4633-90ab-3dc14d74427b tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:39.275338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be53f7e0-038f-4633-90ab-3dc14d74427b tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:39.276762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be53f7e0-038f-4633-90ab-3dc14d74427b tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:39.277524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be53f7e0-038f-4633-90ab-3dc14d74427b tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:39.278812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be53f7e0-038f-4633-90ab-3dc14d74427b tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:39.279605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be53f7e0-038f-4633-90ab-3dc14d74427b tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:39.280300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be53f7e0-038f-4633-90ab-3dc14d74427b tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:39.320059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-be53f7e0-038f-4633-90ab-3dc14d74427b tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:05:39.460437 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-be53f7e0-038f-4633-90ab-3dc14d74427b tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 204 len: 0 microversion: 2.1 time: 0.208947 Aug 09 17:05:39.466458 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 286/607] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:05:39 2022] DELETE /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:05:39.477972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94b77af5-e7a5-465e-a103-915cb465ad2d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:39.479900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94b77af5-e7a5-465e-a103-915cb465ad2d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:39.492948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94b77af5-e7a5-465e-a103-915cb465ad2d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:39.492948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94b77af5-e7a5-465e-a103-915cb465ad2d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:39.493405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94b77af5-e7a5-465e-a103-915cb465ad2d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:39.494631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94b77af5-e7a5-465e-a103-915cb465ad2d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:39.496011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94b77af5-e7a5-465e-a103-915cb465ad2d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:39.496799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94b77af5-e7a5-465e-a103-915cb465ad2d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:39.741009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94b77af5-e7a5-465e-a103-915cb465ad2d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:39.758494 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94b77af5-e7a5-465e-a103-915cb465ad2d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1311 microversion: 2.1 time: 0.288283 Aug 09 17:05:39.759017 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 287/608] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:39 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1311 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:39.774572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-96e7f75e-c228-4786-8da6-c7cf9da12888 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:39.776240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b8538f0b-381e-4dca-9134-fd4c97de5300 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:39.776878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b8538f0b-381e-4dca-9134-fd4c97de5300 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:39.796229 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-96e7f75e-c228-4786-8da6-c7cf9da12888 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1323 microversion: 2.1 time: 0.790839 Aug 09 17:05:39.798494 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 322/609] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:39 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1323 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:39.812494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8538f0b-381e-4dca-9134-fd4c97de5300 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:39.813027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8538f0b-381e-4dca-9134-fd4c97de5300 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:39.813480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8538f0b-381e-4dca-9134-fd4c97de5300 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:39.814354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8538f0b-381e-4dca-9134-fd4c97de5300 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:39.814828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8538f0b-381e-4dca-9134-fd4c97de5300 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:39.815459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8538f0b-381e-4dca-9134-fd4c97de5300 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:39.844043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-219fbd89-839d-4969-9f16-ec225ab48566 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:39.845226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-219fbd89-839d-4969-9f16-ec225ab48566 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:39.880853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-219fbd89-839d-4969-9f16-ec225ab48566 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:39.882972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-219fbd89-839d-4969-9f16-ec225ab48566 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:39.884170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-219fbd89-839d-4969-9f16-ec225ab48566 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:39.887980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-219fbd89-839d-4969-9f16-ec225ab48566 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:39.889868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-219fbd89-839d-4969-9f16-ec225ab48566 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:39.890926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-219fbd89-839d-4969-9f16-ec225ab48566 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:40.021805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b8538f0b-381e-4dca-9134-fd4c97de5300 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:40.035568 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b8538f0b-381e-4dca-9134-fd4c97de5300 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1468 microversion: 2.1 time: 0.271010 Aug 09 17:05:40.037988 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 288/610] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:39 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1468 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:40.276620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a7183c3f-3ac0-4a19-aea5-c5a538ca53ee tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:40.278056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a7183c3f-3ac0-4a19-aea5-c5a538ca53ee tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:40.294826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7183c3f-3ac0-4a19-aea5-c5a538ca53ee tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:40.296755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7183c3f-3ac0-4a19-aea5-c5a538ca53ee tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:40.297814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7183c3f-3ac0-4a19-aea5-c5a538ca53ee tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:40.298827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7183c3f-3ac0-4a19-aea5-c5a538ca53ee tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:40.299550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7183c3f-3ac0-4a19-aea5-c5a538ca53ee tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:40.300376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7183c3f-3ac0-4a19-aea5-c5a538ca53ee tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:40.309840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:40.771274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a7183c3f-3ac0-4a19-aea5-c5a538ca53ee tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:40.785719 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a7183c3f-3ac0-4a19-aea5-c5a538ca53ee tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.517471 Aug 09 17:05:40.799665 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 289/611] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:40 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:40.799665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43a782c3-696d-4516-84aa-fbfddd2912c5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:40.800558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-43a782c3-696d-4516-84aa-fbfddd2912c5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:40.814034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43a782c3-696d-4516-84aa-fbfddd2912c5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:40.815030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43a782c3-696d-4516-84aa-fbfddd2912c5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:40.815853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43a782c3-696d-4516-84aa-fbfddd2912c5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:40.817128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43a782c3-696d-4516-84aa-fbfddd2912c5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:40.817814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43a782c3-696d-4516-84aa-fbfddd2912c5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:40.818558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43a782c3-696d-4516-84aa-fbfddd2912c5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:40.866631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-219fbd89-839d-4969-9f16-ec225ab48566 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:40.884262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:40.891867 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-219fbd89-839d-4969-9f16-ec225ab48566 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 1.058224 Aug 09 17:05:40.892864 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 323/612] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:39 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:40.909711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9d3deba1-f6e1-4d8a-82ee-1a56dc5b304c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:40.915911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9d3deba1-f6e1-4d8a-82ee-1a56dc5b304c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:40.945225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d3deba1-f6e1-4d8a-82ee-1a56dc5b304c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:40.946172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d3deba1-f6e1-4d8a-82ee-1a56dc5b304c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:40.948240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d3deba1-f6e1-4d8a-82ee-1a56dc5b304c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:40.952131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d3deba1-f6e1-4d8a-82ee-1a56dc5b304c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:40.953373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d3deba1-f6e1-4d8a-82ee-1a56dc5b304c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:40.954419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d3deba1-f6e1-4d8a-82ee-1a56dc5b304c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:41.562537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9d3deba1-f6e1-4d8a-82ee-1a56dc5b304c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:41.581280 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9d3deba1-f6e1-4d8a-82ee-1a56dc5b304c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1472 microversion: 2.1 time: 0.685964 Aug 09 17:05:41.584752 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 324/613] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:40 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1472 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:41.595679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ee305f63-1244-4d90-80d3-73deda16d3a0 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:41.596327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ee305f63-1244-4d90-80d3-73deda16d3a0 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:41.615976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee305f63-1244-4d90-80d3-73deda16d3a0 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:41.616666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee305f63-1244-4d90-80d3-73deda16d3a0 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:41.617156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee305f63-1244-4d90-80d3-73deda16d3a0 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:41.628059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee305f63-1244-4d90-80d3-73deda16d3a0 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:41.628855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee305f63-1244-4d90-80d3-73deda16d3a0 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:41.629574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee305f63-1244-4d90-80d3-73deda16d3a0 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:41.826344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-43a782c3-696d-4516-84aa-fbfddd2912c5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:41.851479 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43a782c3-696d-4516-84aa-fbfddd2912c5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1311 microversion: 2.1 time: 1.058456 Aug 09 17:05:41.853053 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 290/614] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:40 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1311 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:41.859967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:41.860723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:41.870280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:41.871695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:41.872681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:41.875895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:41.878876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:41.880268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:41.934850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Request method failure captured: Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e/diagnostics HTTP/1.1 Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPBMcppEzOTW6sdERgJbFL3pC4XohEqb3kg6KOCyBoELrfUQh2V_4pbbprrF-_-2gzJwHu5k8nyVQgN3jJWsJn0s7CWufWNKWBzdWydsCZB697sGIdQg2gv_BkEMM_dO7vySziGLSJlvvEJRXgSKY8Q_jdaUs02iOt2lDESXOBZwxs Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 3923904a8bc646f6b9658fa0762813ba Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1728158334 Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:41.940370 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:41.941750 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3923904a8bc646f6b9658fa0762813ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3923904a8bc646f6b9658fa0762813ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3923904a8bc646f6b9658fa0762813ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3923904a8bc646f6b9658fa0762813ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:41.941750 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1728158334 Aug 09 17:05:41.941750 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 3923904a8bc646f6b9658fa0762813ba Aug 09 17:05:41.941750 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1728158334 Aug 09 17:05:41.941750 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerDiagnosticsNegativeTest-1728158334-project Aug 09 17:05:41.941750 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:41.941750 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:41.941750 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 73696432c93746bba71f054c77170f96 Aug 09 17:05:41.941750 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1728158334-project Aug 09 17:05:41.941750 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:41.941750 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': 'ba7157e9-1f83-4ddd-803b-7a7e16a04b6e'} Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:05:41.942414 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 09 17:05:41.943525 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:41.949097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:41.950937 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ed06e688-5e67-488d-9a6b-0217020ef78c tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.095809 Aug 09 17:05:41.952223 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 291/615] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:05:41 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e/diagnostics => generated 117 bytes in 98 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:05:41.967770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9496fba2-7792-41d5-80d2-7d0a7d4be8b2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:41.969270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9496fba2-7792-41d5-80d2-7d0a7d4be8b2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:41.982277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9496fba2-7792-41d5-80d2-7d0a7d4be8b2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:41.982888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9496fba2-7792-41d5-80d2-7d0a7d4be8b2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:41.984864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9496fba2-7792-41d5-80d2-7d0a7d4be8b2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:41.987190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9496fba2-7792-41d5-80d2-7d0a7d4be8b2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:41.987807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9496fba2-7792-41d5-80d2-7d0a7d4be8b2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:41.988261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9496fba2-7792-41d5-80d2-7d0a7d4be8b2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:42.284304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ee305f63-1244-4d90-80d3-73deda16d3a0 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:42.305853 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ee305f63-1244-4d90-80d3-73deda16d3a0 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1468 microversion: 2.1 time: 0.709898 Aug 09 17:05:42.307040 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 325/616] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:41 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1468 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:42.325893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a4e270cf-7c79-4654-b2e2-5ae0b353e8fa tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:42.326937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a4e270cf-7c79-4654-b2e2-5ae0b353e8fa tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:42.350221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e270cf-7c79-4654-b2e2-5ae0b353e8fa tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:42.351143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e270cf-7c79-4654-b2e2-5ae0b353e8fa tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:42.351901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e270cf-7c79-4654-b2e2-5ae0b353e8fa tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:42.352906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e270cf-7c79-4654-b2e2-5ae0b353e8fa tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:42.354168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e270cf-7c79-4654-b2e2-5ae0b353e8fa tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:42.355780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e270cf-7c79-4654-b2e2-5ae0b353e8fa tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:42.719526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9496fba2-7792-41d5-80d2-7d0a7d4be8b2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:42.735809 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9496fba2-7792-41d5-80d2-7d0a7d4be8b2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.781724 Aug 09 17:05:42.737578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4e270cf-7c79-4654-b2e2-5ae0b353e8fa tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:42.737972 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 292/617] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:41 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:42.748268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-83af9ab1-a3a8-45f0-a1bd-4919b746b3b6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:42.749636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-83af9ab1-a3a8-45f0-a1bd-4919b746b3b6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:42.755216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:42.766767 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a4e270cf-7c79-4654-b2e2-5ae0b353e8fa tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.457709 Aug 09 17:05:42.768545 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 326/618] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:42 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:42.785229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83af9ab1-a3a8-45f0-a1bd-4919b746b3b6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:42.794062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83af9ab1-a3a8-45f0-a1bd-4919b746b3b6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:42.796979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83af9ab1-a3a8-45f0-a1bd-4919b746b3b6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:42.805096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83af9ab1-a3a8-45f0-a1bd-4919b746b3b6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:42.806071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83af9ab1-a3a8-45f0-a1bd-4919b746b3b6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:42.807445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83af9ab1-a3a8-45f0-a1bd-4919b746b3b6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:42.879728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-59717c3c-8590-46aa-ab6e-e6cfe2a5aef0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:42.880831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-59717c3c-8590-46aa-ab6e-e6cfe2a5aef0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:42.896773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59717c3c-8590-46aa-ab6e-e6cfe2a5aef0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:42.898780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59717c3c-8590-46aa-ab6e-e6cfe2a5aef0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:42.901527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59717c3c-8590-46aa-ab6e-e6cfe2a5aef0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:42.903755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59717c3c-8590-46aa-ab6e-e6cfe2a5aef0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:42.904711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59717c3c-8590-46aa-ab6e-e6cfe2a5aef0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:42.906562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59717c3c-8590-46aa-ab6e-e6cfe2a5aef0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:42.920721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-83af9ab1-a3a8-45f0-a1bd-4919b746b3b6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:05:43.275686 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-83af9ab1-a3a8-45f0-a1bd-4919b746b3b6 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 204 len: 0 microversion: 2.1 time: 0.534301 Aug 09 17:05:43.282553 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 293/619] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:05:42 2022] DELETE /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:05:43.301325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-82d8a785-a8f4-4383-a267-c34f0b33cfaa tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:43.304151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-82d8a785-a8f4-4383-a267-c34f0b33cfaa tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:43.328508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d8a785-a8f4-4383-a267-c34f0b33cfaa tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:43.329849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d8a785-a8f4-4383-a267-c34f0b33cfaa tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:43.331154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d8a785-a8f4-4383-a267-c34f0b33cfaa tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:43.333009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d8a785-a8f4-4383-a267-c34f0b33cfaa tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:43.337246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d8a785-a8f4-4383-a267-c34f0b33cfaa tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:43.338769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d8a785-a8f4-4383-a267-c34f0b33cfaa tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:43.517957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-59717c3c-8590-46aa-ab6e-e6cfe2a5aef0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:43.536837 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-59717c3c-8590-46aa-ab6e-e6cfe2a5aef0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1311 microversion: 2.1 time: 0.661508 Aug 09 17:05:43.538145 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 327/620] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:42 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1311 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:43.551583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:43.555441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:43.573550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:43.574455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:43.575093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:43.576028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:43.581135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:43.582010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:43.688167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:43.688698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:43.689157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:43.689666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lazy-loading 'fault' on Instance uuid d5d1325b-cb1c-489f-8924-a33c03274f54 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:05:43.862760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3c183a53234c1197169c4ab704ef23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4297ff3ee10c4305bccd42a8a7587016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:43.880479 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a79b2858-3f22-4eb0-9c06-6f144c4a8462 tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 200 len: 1303 microversion: 2.1 time: 0.339568 Aug 09 17:05:43.882281 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 328/621] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:43 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 1303 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:43.894430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-49797ac8-3472-46aa-8bbd-4a1947bd2477 req-fccade4f-ce11-4b59-8b78-c82980fd636c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d1325b-cb1c-489f-8924-a33c03274f54", "name": "network-vif-deleted", "tag": "75a144b0-9235-439b-96dc-d12fc80df75e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:43.916779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-49797ac8-3472-46aa-8bbd-4a1947bd2477 req-fccade4f-ce11-4b59-8b78-c82980fd636c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:43.918091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-49797ac8-3472-46aa-8bbd-4a1947bd2477 req-fccade4f-ce11-4b59-8b78-c82980fd636c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:43.919224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-49797ac8-3472-46aa-8bbd-4a1947bd2477 req-fccade4f-ce11-4b59-8b78-c82980fd636c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:43.983255 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-49797ac8-3472-46aa-8bbd-4a1947bd2477 req-fccade4f-ce11-4b59-8b78-c82980fd636c service nova] Creating event network-vif-deleted:75a144b0-9235-439b-96dc-d12fc80df75e for instance d5d1325b-cb1c-489f-8924-a33c03274f54 on n-h2-845781-6 Aug 09 17:05:43.994949 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-49797ac8-3472-46aa-8bbd-4a1947bd2477 req-fccade4f-ce11-4b59-8b78-c82980fd636c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110073 Aug 09 17:05:43.996507 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 329/622] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:44.008429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eff5e2de-0438-4b65-9ded-cd2eac367e15 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:44.010837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eff5e2de-0438-4b65-9ded-cd2eac367e15 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:44.015454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-82d8a785-a8f4-4383-a267-c34f0b33cfaa tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:44.027093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eff5e2de-0438-4b65-9ded-cd2eac367e15 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:44.028347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eff5e2de-0438-4b65-9ded-cd2eac367e15 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:44.029337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eff5e2de-0438-4b65-9ded-cd2eac367e15 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:44.031878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eff5e2de-0438-4b65-9ded-cd2eac367e15 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:44.033337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eff5e2de-0438-4b65-9ded-cd2eac367e15 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:44.034567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eff5e2de-0438-4b65-9ded-cd2eac367e15 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:44.045230 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-82d8a785-a8f4-4383-a267-c34f0b33cfaa tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1478 microversion: 2.1 time: 0.758504 Aug 09 17:05:44.049600 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 294/623] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:43 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1478 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:44.111863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c1657dc-27e4-4682-9c02-e50b0c56e683 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:44.114570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c1657dc-27e4-4682-9c02-e50b0c56e683 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:44.138965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1657dc-27e4-4682-9c02-e50b0c56e683 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:44.140970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1657dc-27e4-4682-9c02-e50b0c56e683 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:44.144061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1657dc-27e4-4682-9c02-e50b0c56e683 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:44.145171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1657dc-27e4-4682-9c02-e50b0c56e683 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:44.145964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1657dc-27e4-4682-9c02-e50b0c56e683 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:44.148659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1657dc-27e4-4682-9c02-e50b0c56e683 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:44.865554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eff5e2de-0438-4b65-9ded-cd2eac367e15 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:44.903041 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eff5e2de-0438-4b65-9ded-cd2eac367e15 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.885776 Aug 09 17:05:44.905404 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 330/624] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:43 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:44.922907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e8038bd7-21d9-472a-aa64-e298d322a487 req-7c96c966-366f-4afd-899c-17640787fd30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb84cd97-b6b0-40f0-9774-e5baa48fc7c9", "name": "network-vif-plugged", "status": "completed", "tag": "22f0d67b-a0ab-4059-b2b2-907936f07fb8"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:44.951900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e8038bd7-21d9-472a-aa64-e298d322a487 req-7c96c966-366f-4afd-899c-17640787fd30 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:44.953779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e8038bd7-21d9-472a-aa64-e298d322a487 req-7c96c966-366f-4afd-899c-17640787fd30 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:44.955129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e8038bd7-21d9-472a-aa64-e298d322a487 req-7c96c966-366f-4afd-899c-17640787fd30 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:45.002949 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e8038bd7-21d9-472a-aa64-e298d322a487 req-7c96c966-366f-4afd-899c-17640787fd30 service nova] Creating event network-vif-plugged:22f0d67b-a0ab-4059-b2b2-907936f07fb8 for instance fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 on n-h1-845781-6 Aug 09 17:05:45.021368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e8038bd7-21d9-472a-aa64-e298d322a487 req-7c96c966-366f-4afd-899c-17640787fd30 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113194 Aug 09 17:05:45.029515 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 331/625] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:45.055861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8c05f3af-6fd3-491d-a441-92a8e34d9d31 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:45.057996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8c05f3af-6fd3-491d-a441-92a8e34d9d31 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:45.081186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c05f3af-6fd3-491d-a441-92a8e34d9d31 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:45.081724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c05f3af-6fd3-491d-a441-92a8e34d9d31 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:45.082187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c05f3af-6fd3-491d-a441-92a8e34d9d31 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:45.082953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c05f3af-6fd3-491d-a441-92a8e34d9d31 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:45.083436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c05f3af-6fd3-491d-a441-92a8e34d9d31 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:45.083908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c05f3af-6fd3-491d-a441-92a8e34d9d31 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:45.314767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c1657dc-27e4-4682-9c02-e50b0c56e683 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:45.350424 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c1657dc-27e4-4682-9c02-e50b0c56e683 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 1.250427 Aug 09 17:05:45.351515 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 295/626] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:44 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:45.364285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:45.365654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] [instance: d5d1325b-cb1c-489f-8924-a33c03274f54] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:45.409914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:45.414968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:45.420442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:45.429147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:45.431396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:45.435443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:45.504889 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] HTTP exception thrown: Instance d5d1325b-cb1c-489f-8924-a33c03274f54 could not be found. Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Request method failure captured: Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 HTTP/1.1 Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPEfXSX0huFwaMFps4nyLt04qlztvheWhD0GBXQAXMZdzbBXsc13xhCVaza80rVznkNyDUWF8ztr6Wnb-qYTKlDdX9FAvBRSCWJWzB4tWuja2uam6fznJ7vaMtR_lLjBkoWF43SkM1UO7dSF7O4v7zlKBAN1ohPD1DdwZ-GLEieXN8 Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 4297ff3ee10c4305bccd42a8a7587016 Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TenantUsagesTestJSON-1134946640 Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:45.513514 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4297ff3ee10c4305bccd42a8a7587016"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4297ff3ee10c4305bccd42a8a7587016"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4297ff3ee10c4305bccd42a8a7587016"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4297ff3ee10c4305bccd42a8a7587016"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TenantUsagesTestJSON-1134946640 Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 4297ff3ee10c4305bccd42a8a7587016 Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1134946640 Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TenantUsagesTestJSON-1134946640-project Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: fd3c183a53234c1197169c4ab704ef23 Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TenantUsagesTestJSON-1134946640-project Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance d5d1325b-cb1c-489f-8924-a33c03274f54 could not be found. Aug 09 17:05:45.516418 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'd5d1325b-cb1c-489f-8924-a33c03274f54'} Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d1325b-cb1c-489f-8924-a33c03274f54 could not be found. Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:45.519294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d1325b-cb1c-489f-8924-a33c03274f54 could not be found. Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d1325b-cb1c-489f-8924-a33c03274f54 could not be found. Aug 09 17:05:45.522251 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:45.528817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] Returning 404 to user: Instance d5d1325b-cb1c-489f-8924-a33c03274f54 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:45.531072 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-be9d0f9c-0ae0-4573-a6bb-7870121b2edf tempest-TenantUsagesTestJSON-1134946640 tempest-TenantUsagesTestJSON-1134946640-project] 10.222.0.93 "GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54" status: 404 len: 111 microversion: 2.1 time: 0.177595 Aug 09 17:05:45.549524 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 296/627] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:45 2022] GET /compute/v2.1/servers/d5d1325b-cb1c-489f-8924-a33c03274f54 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:05:45.572810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eba9e21c-6d3b-409b-ac3b-5f95ab2d3b77 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:45.577163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eba9e21c-6d3b-409b-ac3b-5f95ab2d3b77 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:45.597299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8c05f3af-6fd3-491d-a441-92a8e34d9d31 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:45.605329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eba9e21c-6d3b-409b-ac3b-5f95ab2d3b77 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:45.605658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:45.608854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eba9e21c-6d3b-409b-ac3b-5f95ab2d3b77 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:45.610300 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8c05f3af-6fd3-491d-a441-92a8e34d9d31 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1311 microversion: 2.1 time: 0.578694 Aug 09 17:05:45.612312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eba9e21c-6d3b-409b-ac3b-5f95ab2d3b77 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:45.613276 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 332/628] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:45 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1311 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:45.615701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eba9e21c-6d3b-409b-ac3b-5f95ab2d3b77 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:45.622907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eba9e21c-6d3b-409b-ac3b-5f95ab2d3b77 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:45.624265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eba9e21c-6d3b-409b-ac3b-5f95ab2d3b77 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:45.928325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a318dc2-e8b5-4b2f-b41e-0457db986879 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:45.929518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3a318dc2-e8b5-4b2f-b41e-0457db986879 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:45.950090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a318dc2-e8b5-4b2f-b41e-0457db986879 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:45.954546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a318dc2-e8b5-4b2f-b41e-0457db986879 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:45.955116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a318dc2-e8b5-4b2f-b41e-0457db986879 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:45.955922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a318dc2-e8b5-4b2f-b41e-0457db986879 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:45.956408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a318dc2-e8b5-4b2f-b41e-0457db986879 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:45.956849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a318dc2-e8b5-4b2f-b41e-0457db986879 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:46.190455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eba9e21c-6d3b-409b-ac3b-5f95ab2d3b77 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:46.208740 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eba9e21c-6d3b-409b-ac3b-5f95ab2d3b77 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1478 microversion: 2.1 time: 0.655185 Aug 09 17:05:46.210009 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 297/629] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:45 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1478 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:46.379215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-34e49d2b-dca4-4b9a-9e40-ebd57746d459 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:46.381058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-34e49d2b-dca4-4b9a-9e40-ebd57746d459 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:46.408496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e49d2b-dca4-4b9a-9e40-ebd57746d459 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:46.409526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e49d2b-dca4-4b9a-9e40-ebd57746d459 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:46.411129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e49d2b-dca4-4b9a-9e40-ebd57746d459 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:46.413542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e49d2b-dca4-4b9a-9e40-ebd57746d459 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:46.414829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e49d2b-dca4-4b9a-9e40-ebd57746d459 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:46.418754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e49d2b-dca4-4b9a-9e40-ebd57746d459 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:47.082621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-34e49d2b-dca4-4b9a-9e40-ebd57746d459 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:47.097883 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-34e49d2b-dca4-4b9a-9e40-ebd57746d459 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.725216 Aug 09 17:05:47.098859 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 298/630] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:46 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:47.108118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a318dc2-e8b5-4b2f-b41e-0457db986879 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:47.119267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9607e6c8-08ea-4bef-9168-3d29d1b410ae tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:47.125648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9607e6c8-08ea-4bef-9168-3d29d1b410ae tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:47.132203 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3a318dc2-e8b5-4b2f-b41e-0457db986879 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 1.208599 Aug 09 17:05:47.139977 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 333/631] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:45 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:47.139977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a6e84003-d6eb-4b8e-bdb9-60be228de18c req-d7674f87-6fb2-4843-99fa-7375a01b47bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba7157e9-1f83-4ddd-803b-7a7e16a04b6e", "name": "network-vif-deleted", "tag": "22ef96e6-092c-4a0f-a819-538f093d3cb4"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:47.154866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9607e6c8-08ea-4bef-9168-3d29d1b410ae tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:47.155398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9607e6c8-08ea-4bef-9168-3d29d1b410ae tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:47.155925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9607e6c8-08ea-4bef-9168-3d29d1b410ae tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:47.163010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9607e6c8-08ea-4bef-9168-3d29d1b410ae tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:47.169961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9607e6c8-08ea-4bef-9168-3d29d1b410ae tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:47.170766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9607e6c8-08ea-4bef-9168-3d29d1b410ae tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:47.194087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a6e84003-d6eb-4b8e-bdb9-60be228de18c req-d7674f87-6fb2-4843-99fa-7375a01b47bf service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:47.208878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a6e84003-d6eb-4b8e-bdb9-60be228de18c req-d7674f87-6fb2-4843-99fa-7375a01b47bf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:47.209652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a6e84003-d6eb-4b8e-bdb9-60be228de18c req-d7674f87-6fb2-4843-99fa-7375a01b47bf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:47.248836 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a6e84003-d6eb-4b8e-bdb9-60be228de18c req-d7674f87-6fb2-4843-99fa-7375a01b47bf service nova] Creating event network-vif-deleted:22ef96e6-092c-4a0f-a819-538f093d3cb4 for instance ba7157e9-1f83-4ddd-803b-7a7e16a04b6e on n-h1-845781-6 Aug 09 17:05:47.267832 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a6e84003-d6eb-4b8e-bdb9-60be228de18c req-d7674f87-6fb2-4843-99fa-7375a01b47bf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128745 Aug 09 17:05:47.268762 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 334/632] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:47.288682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:47.289655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:47.308043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:47.308544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:47.309070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:47.309694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:47.310142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:47.310576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:47.413058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:47.421973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:47.423145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:47.424628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lazy-loading 'fault' on Instance uuid ba7157e9-1f83-4ddd-803b-7a7e16a04b6e {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:05:47.536137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73696432c93746bba71f054c77170f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3923904a8bc646f6b9658fa0762813ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:47.564164 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8d2574d0-289f-4cfc-9ae8-6a3fa69c0339 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 200 len: 1313 microversion: 2.1 time: 0.285868 Aug 09 17:05:47.566469 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 335/633] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:47 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:47.914523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9607e6c8-08ea-4bef-9168-3d29d1b410ae tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:47.940863 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9607e6c8-08ea-4bef-9168-3d29d1b410ae tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1494 microversion: 2.1 time: 0.840840 Aug 09 17:05:47.945239 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 299/634] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:47 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1494 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:48.151658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-97af3c87-e4e4-4251-91ff-96d776e07cbc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:48.152292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-97af3c87-e4e4-4251-91ff-96d776e07cbc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:48.164202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97af3c87-e4e4-4251-91ff-96d776e07cbc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:48.165298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97af3c87-e4e4-4251-91ff-96d776e07cbc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:48.166382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97af3c87-e4e4-4251-91ff-96d776e07cbc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:48.168061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97af3c87-e4e4-4251-91ff-96d776e07cbc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:48.168730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97af3c87-e4e4-4251-91ff-96d776e07cbc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:48.169958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97af3c87-e4e4-4251-91ff-96d776e07cbc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:48.602575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-97af3c87-e4e4-4251-91ff-96d776e07cbc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:48.633667 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-97af3c87-e4e4-4251-91ff-96d776e07cbc tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.493193 Aug 09 17:05:48.653171 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 300/635] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:48 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:48.702542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d630d9d-4d0b-4de2-b5aa-ebbfb83958dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:48.706459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1d630d9d-4d0b-4de2-b5aa-ebbfb83958dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:48.707250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e10e72b4-1c4a-4115-baa6-e7a018ef3502 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:48.718539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e10e72b4-1c4a-4115-baa6-e7a018ef3502 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:48.721653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:48.726530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d630d9d-4d0b-4de2-b5aa-ebbfb83958dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:48.728683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d630d9d-4d0b-4de2-b5aa-ebbfb83958dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:48.729900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d630d9d-4d0b-4de2-b5aa-ebbfb83958dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:48.731123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d630d9d-4d0b-4de2-b5aa-ebbfb83958dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:48.732908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d630d9d-4d0b-4de2-b5aa-ebbfb83958dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:48.734847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d630d9d-4d0b-4de2-b5aa-ebbfb83958dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:48.755171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e10e72b4-1c4a-4115-baa6-e7a018ef3502 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:48.756359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e10e72b4-1c4a-4115-baa6-e7a018ef3502 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:48.757454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e10e72b4-1c4a-4115-baa6-e7a018ef3502 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:48.760461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e10e72b4-1c4a-4115-baa6-e7a018ef3502 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:48.761402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e10e72b4-1c4a-4115-baa6-e7a018ef3502 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:48.762107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e10e72b4-1c4a-4115-baa6-e7a018ef3502 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:48.893003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:49.224206 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e10e72b4-1c4a-4115-baa6-e7a018ef3502 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1645 microversion: 2.1 time: 1.251688 Aug 09 17:05:49.247698 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 336/636] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:47 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1645 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:49.254296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:49.255428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] [instance: ba7157e9-1f83-4ddd-803b-7a7e16a04b6e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:49.265055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:49.266245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:49.267041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:49.268673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:49.269507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:49.270348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:49.299021 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] HTTP exception thrown: Instance ba7157e9-1f83-4ddd-803b-7a7e16a04b6e could not be found. Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Request method failure captured: Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e HTTP/1.1 Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pPBMcppEzOTW6sdERgJbFL3pC4XohEqb3kg6KOCyBoELrfUQh2V_4pbbprrF-_-2gzJwHu5k8nyVQgN3jJWsJn0s7CWufWNKWBzdWydsCZB697sGIdQg2gv_BkEMM_dO7vySziGLSJlvvEJRXgSKY8Q_jdaUs02iOt2lDESXOBZwxs Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 3923904a8bc646f6b9658fa0762813ba Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1728158334 Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:05:49.301180 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3923904a8bc646f6b9658fa0762813ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3923904a8bc646f6b9658fa0762813ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3923904a8bc646f6b9658fa0762813ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3923904a8bc646f6b9658fa0762813ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1728158334 Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 3923904a8bc646f6b9658fa0762813ba Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1728158334 Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerDiagnosticsNegativeTest-1728158334-project Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 73696432c93746bba71f054c77170f96 Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1728158334-project Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance ba7157e9-1f83-4ddd-803b-7a7e16a04b6e could not be found. Aug 09 17:05:49.302453 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'ba7157e9-1f83-4ddd-803b-7a7e16a04b6e'} Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba7157e9-1f83-4ddd-803b-7a7e16a04b6e could not be found. Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:49.303270 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba7157e9-1f83-4ddd-803b-7a7e16a04b6e could not be found. Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba7157e9-1f83-4ddd-803b-7a7e16a04b6e could not be found. Aug 09 17:05:49.304664 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:05:49.310448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] Returning 404 to user: Instance ba7157e9-1f83-4ddd-803b-7a7e16a04b6e could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:49.314398 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-37ec1939-f28f-45e1-b6e9-6d6e272f3970 tempest-ServerDiagnosticsNegativeTest-1728158334 tempest-ServerDiagnosticsNegativeTest-1728158334-project] 10.222.0.93 "GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e" status: 404 len: 111 microversion: 2.1 time: 0.062612 Aug 09 17:05:49.319743 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 337/637] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:49 2022] GET /compute/v2.1/servers/ba7157e9-1f83-4ddd-803b-7a7e16a04b6e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:05:49.322463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a7c9260c-39f3-4332-9c09-0c68bf608588 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:49.323196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a7c9260c-39f3-4332-9c09-0c68bf608588 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:49.343155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7c9260c-39f3-4332-9c09-0c68bf608588 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:49.343864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7c9260c-39f3-4332-9c09-0c68bf608588 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:49.344409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7c9260c-39f3-4332-9c09-0c68bf608588 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:49.345255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7c9260c-39f3-4332-9c09-0c68bf608588 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:49.346703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7c9260c-39f3-4332-9c09-0c68bf608588 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:49.347242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7c9260c-39f3-4332-9c09-0c68bf608588 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:49.459093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1d630d9d-4d0b-4de2-b5aa-ebbfb83958dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:49.478783 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1d630d9d-4d0b-4de2-b5aa-ebbfb83958dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.821491 Aug 09 17:05:49.483831 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 301/638] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:48 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:49.694393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1998ada4-8b20-4238-9f9d-faac674d3d45 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:49.695048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1998ada4-8b20-4238-9f9d-faac674d3d45 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:49.715101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1998ada4-8b20-4238-9f9d-faac674d3d45 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:49.716307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1998ada4-8b20-4238-9f9d-faac674d3d45 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:49.717243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1998ada4-8b20-4238-9f9d-faac674d3d45 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:49.722324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1998ada4-8b20-4238-9f9d-faac674d3d45 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:49.724118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1998ada4-8b20-4238-9f9d-faac674d3d45 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:49.728162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1998ada4-8b20-4238-9f9d-faac674d3d45 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:49.920432 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a7c9260c-39f3-4332-9c09-0c68bf608588 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1645 microversion: 2.1 time: 0.603262 Aug 09 17:05:49.926613 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 338/639] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:49 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1645 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:49.932280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ff52a79b-b2e5-4942-85c7-5af70698f90a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:49.938084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ff52a79b-b2e5-4942-85c7-5af70698f90a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:49.956097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff52a79b-b2e5-4942-85c7-5af70698f90a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:49.957679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff52a79b-b2e5-4942-85c7-5af70698f90a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:49.961363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff52a79b-b2e5-4942-85c7-5af70698f90a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:49.962491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff52a79b-b2e5-4942-85c7-5af70698f90a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:49.963190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff52a79b-b2e5-4942-85c7-5af70698f90a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:49.963848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff52a79b-b2e5-4942-85c7-5af70698f90a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:50.029835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ff52a79b-b2e5-4942-85c7-5af70698f90a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:05:50.243592 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ff52a79b-b2e5-4942-85c7-5af70698f90a tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "DELETE /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 204 len: 0 microversion: 2.1 time: 0.315307 Aug 09 17:05:50.245155 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 339/640] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:05:49 2022] DELETE /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:05:50.250946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c9f35f85-28e4-43ab-a78b-f0c2ce8d32c5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:50.254425 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:05:50.254425 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:05:50.265425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9f35f85-28e4-43ab-a78b-f0c2ce8d32c5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:50.266215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9f35f85-28e4-43ab-a78b-f0c2ce8d32c5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:50.266891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9f35f85-28e4-43ab-a78b-f0c2ce8d32c5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:50.268259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9f35f85-28e4-43ab-a78b-f0c2ce8d32c5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:50.268963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9f35f85-28e4-43ab-a78b-f0c2ce8d32c5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:50.269614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9f35f85-28e4-43ab-a78b-f0c2ce8d32c5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:50.301194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1998ada4-8b20-4238-9f9d-faac674d3d45 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:50.321917 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1998ada4-8b20-4238-9f9d-faac674d3d45 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.640329 Aug 09 17:05:50.323911 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 302/641] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:49 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:05:50.331456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69186b02-bda5-4b55-8989-07fde20356fd tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:50.332438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-69186b02-bda5-4b55-8989-07fde20356fd tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:50.335271 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c9f35f85-28e4-43ab-a78b-f0c2ce8d32c5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.088707 Aug 09 17:05:50.352399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69186b02-bda5-4b55-8989-07fde20356fd tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:50.353319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69186b02-bda5-4b55-8989-07fde20356fd tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:50.355826 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 340/642] 10.222.0.93 () {58 vars in 1176 bytes} [Tue Aug 9 17:05:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:50.357396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69186b02-bda5-4b55-8989-07fde20356fd tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:50.359954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69186b02-bda5-4b55-8989-07fde20356fd tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:50.361151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69186b02-bda5-4b55-8989-07fde20356fd tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:50.363231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d80d3aa-3fb7-4bf9-8428-c3b4d818996a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-845781-6", "block_migration": true, "disk_over_commit": false}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:50.363976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69186b02-bda5-4b55-8989-07fde20356fd tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:50.366822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d80d3aa-3fb7-4bf9-8428-c3b4d818996a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:50.374503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d80d3aa-3fb7-4bf9-8428-c3b4d818996a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:50.375476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d80d3aa-3fb7-4bf9-8428-c3b4d818996a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:50.376659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d80d3aa-3fb7-4bf9-8428-c3b4d818996a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:50.377966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d80d3aa-3fb7-4bf9-8428-c3b4d818996a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:50.379687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d80d3aa-3fb7-4bf9-8428-c3b4d818996a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:50.380418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d80d3aa-3fb7-4bf9-8428-c3b4d818996a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:50.743960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-69186b02-bda5-4b55-8989-07fde20356fd tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:50.757059 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69186b02-bda5-4b55-8989-07fde20356fd tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1713 microversion: 2.1 time: 0.431191 Aug 09 17:05:50.763843 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 303/643] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:50 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1713 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:50.775923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f77712a-c54c-43b7-8a6a-128048d28ea4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:50.779306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f77712a-c54c-43b7-8a6a-128048d28ea4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:50.799412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f77712a-c54c-43b7-8a6a-128048d28ea4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:50.800217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f77712a-c54c-43b7-8a6a-128048d28ea4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:50.800864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f77712a-c54c-43b7-8a6a-128048d28ea4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:50.804653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f77712a-c54c-43b7-8a6a-128048d28ea4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:50.806349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f77712a-c54c-43b7-8a6a-128048d28ea4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:50.808111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f77712a-c54c-43b7-8a6a-128048d28ea4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:50.987881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-5d80d3aa-3fb7-4bf9-8428-c3b4d818996a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lazy-loading 'flavor' on Instance uuid fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:05:51.146737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f77712a-c54c-43b7-8a6a-128048d28ea4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:51.178377 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f77712a-c54c-43b7-8a6a-128048d28ea4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.411556 Aug 09 17:05:51.183849 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 304/644] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:50 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:51.190994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d80d3aa-3fb7-4bf9-8428-c3b4d818996a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Going to try to live migrate instance to n-h2-845781-6 {{(pid=119432) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 17:05:51.743235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-890399006", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "7caaa633-fae8-4684-9370-5a4c1e16c284"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:51.913389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] validate_networks() for [('7caaa633-fae8-4684-9370-5a4c1e16c284', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:05:52.949719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:05:52.950357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:05:52.951241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:05:52.951680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:05:52.952100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:05:52.976808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:52.981861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:52.982778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:52.984772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:52.988547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:52.991378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:53.012311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:05:53.050714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Getting quotas for project 055af8e9fb964ff19213eb1b419b56cd. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:05:53.063958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Getting quotas for user 1ac722a34673411e9280ba901999b0c3 and project 055af8e9fb964ff19213eb1b419b56cd. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:05:53.119960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:05:53.127659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:05:53.318613 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f583d6f4-4ab0-4f18-af31-8575f9c1908e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.132639 Aug 09 17:05:53.319914 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 305/645] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:05:53.348827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-55d4db7d-2685-4ec1-a3c5-17b87146c028 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:53.350143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-55d4db7d-2685-4ec1-a3c5-17b87146c028 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:53.373954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d4db7d-2685-4ec1-a3c5-17b87146c028 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:53.381428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d4db7d-2685-4ec1-a3c5-17b87146c028 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:53.383322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d4db7d-2685-4ec1-a3c5-17b87146c028 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:53.392233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d4db7d-2685-4ec1-a3c5-17b87146c028 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:53.394016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d4db7d-2685-4ec1-a3c5-17b87146c028 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:53.397363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d4db7d-2685-4ec1-a3c5-17b87146c028 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:54.137585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-55d4db7d-2685-4ec1-a3c5-17b87146c028 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:54.148249 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-55d4db7d-2685-4ec1-a3c5-17b87146c028 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.824700 Aug 09 17:05:54.148825 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 306/646] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:53 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:54.166534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1be299c5-9ed8-4a5e-b043-7464bef88b70 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:54.169676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1be299c5-9ed8-4a5e-b043-7464bef88b70 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:54.190987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1be299c5-9ed8-4a5e-b043-7464bef88b70 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:54.191895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1be299c5-9ed8-4a5e-b043-7464bef88b70 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:54.192623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1be299c5-9ed8-4a5e-b043-7464bef88b70 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:54.194496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1be299c5-9ed8-4a5e-b043-7464bef88b70 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:54.197748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1be299c5-9ed8-4a5e-b043-7464bef88b70 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:54.198904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1be299c5-9ed8-4a5e-b043-7464bef88b70 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:54.429042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1be299c5-9ed8-4a5e-b043-7464bef88b70 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:54.440308 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1be299c5-9ed8-4a5e-b043-7464bef88b70 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1645 microversion: 2.1 time: 0.284364 Aug 09 17:05:54.440955 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 307/647] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:54 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1645 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:54.461642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-778740cd-2bb9-48ff-a1bd-55d4fc63ffbc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:54.462352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-778740cd-2bb9-48ff-a1bd-55d4fc63ffbc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:54.475326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-778740cd-2bb9-48ff-a1bd-55d4fc63ffbc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:54.476135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-778740cd-2bb9-48ff-a1bd-55d4fc63ffbc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:54.476774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-778740cd-2bb9-48ff-a1bd-55d4fc63ffbc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:54.477692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-778740cd-2bb9-48ff-a1bd-55d4fc63ffbc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:54.485863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-778740cd-2bb9-48ff-a1bd-55d4fc63ffbc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:54.486314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-778740cd-2bb9-48ff-a1bd-55d4fc63ffbc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:54.933055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-778740cd-2bb9-48ff-a1bd-55d4fc63ffbc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:54.947179 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-778740cd-2bb9-48ff-a1bd-55d4fc63ffbc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.493066 Aug 09 17:05:54.949891 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 308/648] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:54 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:54.955526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3db112e-7255-4a80-81ed-ffe966513a47 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:54.956858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3db112e-7255-4a80-81ed-ffe966513a47 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:54.977758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3db112e-7255-4a80-81ed-ffe966513a47 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:54.981518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3db112e-7255-4a80-81ed-ffe966513a47 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:54.982141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3db112e-7255-4a80-81ed-ffe966513a47 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:54.983537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3db112e-7255-4a80-81ed-ffe966513a47 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:54.995879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3db112e-7255-4a80-81ed-ffe966513a47 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:55.000811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3db112e-7255-4a80-81ed-ffe966513a47 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:55.246493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e3db112e-7255-4a80-81ed-ffe966513a47 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:55.263301 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3db112e-7255-4a80-81ed-ffe966513a47 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1211 microversion: 2.1 time: 0.311884 Aug 09 17:05:55.273451 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 309/649] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:54 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1211 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:55.900118 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69dc8902-aac9-43b4-b140-5a7059ef3da1 tempest-TenantUsagesNegativeTestJSON-795860084 tempest-TenantUsagesNegativeTestJSON-795860084-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-08T17%3A05%3A54.357923&end=2022-08-10T17%3A05%3A54.357923" status: 404 len: 112 microversion: - time: 0.622548 Aug 09 17:05:55.907749 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 310/650] 10.222.0.93 () {58 vars in 1316 bytes} [Tue Aug 9 17:05:55 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-08T17%3A05%3A54.357923&end=2022-08-10T17%3A05%3A54.357923 => generated 112 bytes in 626 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 17:05:55.912277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-31307d0b-919c-40c4-8cb2-1e63963afdd4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:55.922536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-31307d0b-919c-40c4-8cb2-1e63963afdd4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:55.980993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31307d0b-919c-40c4-8cb2-1e63963afdd4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:55.984138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31307d0b-919c-40c4-8cb2-1e63963afdd4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:55.991324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31307d0b-919c-40c4-8cb2-1e63963afdd4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:55.997395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31307d0b-919c-40c4-8cb2-1e63963afdd4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:55.998175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31307d0b-919c-40c4-8cb2-1e63963afdd4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:55.998790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31307d0b-919c-40c4-8cb2-1e63963afdd4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:56.494724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-31307d0b-919c-40c4-8cb2-1e63963afdd4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:56.511432 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-31307d0b-919c-40c4-8cb2-1e63963afdd4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.609194 Aug 09 17:05:56.515729 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 311/651] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:55 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:56.532164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:56.535246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:56.553999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:56.555099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:56.557322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:56.558405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:56.558906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:56.561562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:56.687716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:56.693542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:56.694532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:56.695434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lazy-loading 'fault' on Instance uuid 511258ee-3778-4c68-b364-923209210bb9 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:05:57.385646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff70314be08b4abda96586877f4d6309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5137eb4f54ad48b3ba4de9307b6e80ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:57.399401 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-04332d5d-c343-489b-b64f-02c888539489 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 200 len: 1352 microversion: 2.1 time: 0.881230 Aug 09 17:05:57.399848 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 312/652] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:56 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 1352 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:57.416840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d2e6e5b-1ab9-4913-ae98-b1cc2ea0b87f tempest-TenantUsagesNegativeTestJSON-795860084 tempest-TenantUsagesNegativeTestJSON-795860084-project-admin] Calling method '.version_select at 0x7fbbcbe56550>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:57.427980 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-7d2e6e5b-1ab9-4913-ae98-b1cc2ea0b87f tempest-TenantUsagesNegativeTestJSON-795860084 tempest-TenantUsagesNegativeTestJSON-795860084-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d2e6e5b-1ab9-4913-ae98-b1cc2ea0b87f tempest-TenantUsagesNegativeTestJSON-795860084 tempest-TenantUsagesNegativeTestJSON-795860084-project-admin] Request method failure captured: Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-simple-tenant-usage/a797e20f120d42e8aa567783b853b190?start=2022-08-10T17%3A05%3A54.357923&end=2022-08-08T17%3A05%3A54.357923 HTTP/1.1 Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPykgtgdwnagE9zMoF5pHgf6V_mkC9pvAvkIuSYLO-5DJibX4qcwlfEVkkRSOriqTLxJCf_bUMW6p5Kg4_tj6BcbH2BbeBN86nJ52hmrq9gONb1wznI4JakCpGDRfND8k0F82_U8QL0u6Wo40UXu8yeX7B7squKPyPsWZDFD529Fzc Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ac4ca0488b894e29a3844d623057d6b6 Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-795860084 Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:05:57.437966 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ac4ca0488b894e29a3844d623057d6b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ac4ca0488b894e29a3844d623057d6b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ac4ca0488b894e29a3844d623057d6b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ac4ca0488b894e29a3844d623057d6b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-795860084 Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ac4ca0488b894e29a3844d623057d6b6 Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-795860084 Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TenantUsagesNegativeTestJSON-795860084-project-admin Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ef1165259e2e4176a69fd71a435b0cc1 Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-795860084-project-admin Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid start time. The start time cannot occur after the end time. Aug 09 17:05:57.440865 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'a797e20f120d42e8aa567783b853b190'} Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 09 17:05:57.442539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 09 17:05:57.445140 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:57.445140 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:57.445140 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:57.445140 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:57.445140 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:57.445140 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:57.445140 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:57.445140 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:57.445140 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 09 17:05:57.445140 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:57.445140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d2e6e5b-1ab9-4913-ae98-b1cc2ea0b87f tempest-TenantUsagesNegativeTestJSON-795860084 tempest-TenantUsagesNegativeTestJSON-795860084-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:57.446681 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7d2e6e5b-1ab9-4913-ae98-b1cc2ea0b87f tempest-TenantUsagesNegativeTestJSON-795860084 tempest-TenantUsagesNegativeTestJSON-795860084-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/a797e20f120d42e8aa567783b853b190?start=2022-08-10T17%3A05%3A54.357923&end=2022-08-08T17%3A05%3A54.357923" status: 400 len: 111 microversion: 2.1 time: 0.041458 Aug 09 17:05:57.450991 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 313/653] 10.222.0.93 () {58 vars in 1412 bytes} [Tue Aug 9 17:05:57 2022] GET /compute/v2.1/os-simple-tenant-usage/a797e20f120d42e8aa567783b853b190?start=2022-08-10T17%3A05%3A54.357923&end=2022-08-08T17%3A05%3A54.357923 => generated 111 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:05:57.464438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-dce21361-9107-420d-8f86-52e9b5948178 req-047c4409-b045-4fea-95f4-74ea57ca4a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511258ee-3778-4c68-b364-923209210bb9", "name": "network-vif-deleted", "tag": "06bc7206-254e-4f95-9ccf-39081996ac41"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:57.493112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dce21361-9107-420d-8f86-52e9b5948178 req-047c4409-b045-4fea-95f4-74ea57ca4a21 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:57.496767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dce21361-9107-420d-8f86-52e9b5948178 req-047c4409-b045-4fea-95f4-74ea57ca4a21 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:57.498181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dce21361-9107-420d-8f86-52e9b5948178 req-047c4409-b045-4fea-95f4-74ea57ca4a21 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:57.531159 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-dce21361-9107-420d-8f86-52e9b5948178 req-047c4409-b045-4fea-95f4-74ea57ca4a21 service nova] Creating event network-vif-deleted:06bc7206-254e-4f95-9ccf-39081996ac41 for instance 511258ee-3778-4c68-b364-923209210bb9 on n-h1-845781-6 Aug 09 17:05:57.544937 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-dce21361-9107-420d-8f86-52e9b5948178 req-047c4409-b045-4fea-95f4-74ea57ca4a21 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095884 Aug 09 17:05:57.548631 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 314/654] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:57.563778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69979684-f494-47fb-a531-35a19168dbdc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:57.567304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-69979684-f494-47fb-a531-35a19168dbdc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:57.584225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69979684-f494-47fb-a531-35a19168dbdc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:57.585077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69979684-f494-47fb-a531-35a19168dbdc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:57.588083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69979684-f494-47fb-a531-35a19168dbdc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:57.592320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69979684-f494-47fb-a531-35a19168dbdc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:57.594311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69979684-f494-47fb-a531-35a19168dbdc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:57.594971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69979684-f494-47fb-a531-35a19168dbdc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:57.757743 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5d80d3aa-3fb7-4bf9-8428-c3b4d818996a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9/action" status: 202 len: 0 microversion: 2.1 time: 7.397885 Aug 09 17:05:57.759983 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 341/655] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:05:50 2022] POST /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9/action => generated 0 bytes in 7401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:05:57.771856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-15ad1c71-60c2-46a8-8428-bda85579fd92 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:57.774049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-15ad1c71-60c2-46a8-8428-bda85579fd92 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:57.801750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15ad1c71-60c2-46a8-8428-bda85579fd92 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:57.802270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15ad1c71-60c2-46a8-8428-bda85579fd92 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:57.802850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15ad1c71-60c2-46a8-8428-bda85579fd92 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:57.803971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15ad1c71-60c2-46a8-8428-bda85579fd92 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:57.804461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15ad1c71-60c2-46a8-8428-bda85579fd92 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:57.804910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15ad1c71-60c2-46a8-8428-bda85579fd92 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:57.997148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-69979684-f494-47fb-a531-35a19168dbdc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:58.023859 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69979684-f494-47fb-a531-35a19168dbdc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.468947 Aug 09 17:05:58.041379 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 315/656] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:57 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:58.263931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-15ad1c71-60c2-46a8-8428-bda85579fd92 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:58.274194 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-15ad1c71-60c2-46a8-8428-bda85579fd92 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1265 microversion: 2.1 time: 0.512306 Aug 09 17:05:58.275210 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 342/657] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:57 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1265 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:58.313568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d790aec-5f93-4a74-91b3-8bc4faf31a0a tempest-TenantUsagesNegativeTestJSON-1445131161 tempest-TenantUsagesNegativeTestJSON-1445131161-project] Calling method '.version_select at 0x7fbbcbb708b0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:58.313840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9b271eaf-ab11-4f69-a1ae-258eb2e8362c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:58.314639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9b271eaf-ab11-4f69-a1ae-258eb2e8362c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:58.320692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1d790aec-5f93-4a74-91b3-8bc4faf31a0a tempest-TenantUsagesNegativeTestJSON-1445131161 tempest-TenantUsagesNegativeTestJSON-1445131161-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'bb5787da2c434b8898ab9760b628de80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a797e20f120d42e8aa567783b853b190', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:58.326626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b271eaf-ab11-4f69-a1ae-258eb2e8362c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:58.327418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b271eaf-ab11-4f69-a1ae-258eb2e8362c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:58.327914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b271eaf-ab11-4f69-a1ae-258eb2e8362c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d790aec-5f93-4a74-91b3-8bc4faf31a0a tempest-TenantUsagesNegativeTestJSON-1445131161 tempest-TenantUsagesNegativeTestJSON-1445131161-project] Request method failure captured: Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-08T17%3A05%3A54.357923&end=2022-08-10T17%3A05%3A54.357923&detailed=1 HTTP/1.1 Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPwMjvgK1nZQ_qak_FXrhvRDWijB3J6dc1Kkrsfgvn811ZwNP7qp8HJLHpnY_yOAUuVP3zTFKjhmOUVUOO08HMLaSmwtju5kKNorHGYDafl_bjSbC-9cjN8wJGq47PzdcOG6ePMJmLzP8NuduZDvET-Wk17aBLE2dPIqRsTsbv0Fh0 Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a797e20f120d42e8aa567783b853b190 Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1445131161 Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:58.328501 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a797e20f120d42e8aa567783b853b190"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a797e20f120d42e8aa567783b853b190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a797e20f120d42e8aa567783b853b190"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a797e20f120d42e8aa567783b853b190"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1445131161 Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a797e20f120d42e8aa567783b853b190 Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1445131161 Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TenantUsagesNegativeTestJSON-1445131161-project Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: bb5787da2c434b8898ab9760b628de80 Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1445131161-project Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: action_args: {} Aug 09 17:05:58.331145 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:05:58.332867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:05:58.335248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:05:58.337697 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 09 17:05:58.337697 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:58.337984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b271eaf-ab11-4f69-a1ae-258eb2e8362c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:58.337984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b271eaf-ab11-4f69-a1ae-258eb2e8362c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:58.337984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b271eaf-ab11-4f69-a1ae-258eb2e8362c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:58.338413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d790aec-5f93-4a74-91b3-8bc4faf31a0a tempest-TenantUsagesNegativeTestJSON-1445131161 tempest-TenantUsagesNegativeTestJSON-1445131161-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:58.338413 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1d790aec-5f93-4a74-91b3-8bc4faf31a0a tempest-TenantUsagesNegativeTestJSON-1445131161 tempest-TenantUsagesNegativeTestJSON-1445131161-project] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-08T17%3A05%3A54.357923&end=2022-08-10T17%3A05%3A54.357923&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.291984 Aug 09 17:05:58.350244 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 316/658] 10.222.0.93 () {58 vars in 1335 bytes} [Tue Aug 9 17:05:58 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-08T17%3A05%3A54.357923&end=2022-08-10T17%3A05%3A54.357923&detailed=1 => generated 123 bytes in 302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:05:58.352023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-003837de-52ee-4c56-8f47-ca7b87bf7081 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:58.356412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-003837de-52ee-4c56-8f47-ca7b87bf7081 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:58.378987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-003837de-52ee-4c56-8f47-ca7b87bf7081 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:58.380241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-003837de-52ee-4c56-8f47-ca7b87bf7081 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:58.380804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-003837de-52ee-4c56-8f47-ca7b87bf7081 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:58.381922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-003837de-52ee-4c56-8f47-ca7b87bf7081 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:58.382525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-003837de-52ee-4c56-8f47-ca7b87bf7081 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:58.383044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-003837de-52ee-4c56-8f47-ca7b87bf7081 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:58.685220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9b271eaf-ab11-4f69-a1ae-258eb2e8362c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:58.698133 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9b271eaf-ab11-4f69-a1ae-258eb2e8362c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.408191 Aug 09 17:05:58.700936 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 343/659] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:58 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:58.882021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-003837de-52ee-4c56-8f47-ca7b87bf7081 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:58.896476 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-003837de-52ee-4c56-8f47-ca7b87bf7081 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1504 microversion: 2.1 time: 0.546839 Aug 09 17:05:58.902550 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 317/660] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:58 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1504 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:58.920442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:58.924618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:58.958161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:58.959122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:58.959791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:58.960875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:58.962881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:58.963684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:59.004884 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] HTTP exception thrown: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Request method failure captured: Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 HTTP/1.1 Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNLFpvZM6hoUmEG4mw0ttydpTZcER83XK7e4XeNjEZawN57ofPAm-SOBgHaRI78rGJ0U9bq0tPLJrvfGhCkIefMNVMKOe5Q9NL8GzZj4E6LldJrRfesmfeqNTcHEGcKkmWuH3mXKRcB_DoKZ5FH7PIy_oe30_UWEARUqqmcsXcWjac Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:59.007732 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ff70314be08b4abda96586877f4d6309 Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:05:59.010012 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '511258ee-3778-4c68-b364-923209210bb9'} Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:59.010955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:05:59.012779 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.016342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Returning 404 to user: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:59.017462 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c1e2cb3e-081e-484a-820e-0d74fece041b tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 404 len: 111 microversion: 2.1 time: 0.113536 Aug 09 17:05:59.018609 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 318/661] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:58 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:05:59.028828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:59.029607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:59.039083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:59.040229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:59.040991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:59.041958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:59.042626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:59.043235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:59.067065 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] HTTP exception thrown: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Request method failure captured: Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 HTTP/1.1 Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNLFpvZM6hoUmEG4mw0ttydpTZcER83XK7e4XeNjEZawN57ofPAm-SOBgHaRI78rGJ0U9bq0tPLJrvfGhCkIefMNVMKOe5Q9NL8GzZj4E6LldJrRfesmfeqNTcHEGcKkmWuH3mXKRcB_DoKZ5FH7PIy_oe30_UWEARUqqmcsXcWjac Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:59.082331 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ff70314be08b4abda96586877f4d6309 Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:05:59.083962 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'cb1ebe1f-c944-4f78-84df-43776f1eb671'} Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:59.084860 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:05:59.086316 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.088855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Returning 404 to user: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:59.090976 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-22fd65f6-9e77-4063-8191-4b6e1608635c tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 404 len: 111 microversion: 2.1 time: 0.066372 Aug 09 17:05:59.092156 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 319/662] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:05:59 2022] DELETE /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:05:59.099421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a0428438-4f61-405b-b06e-07abed8fb46f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:59.100972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a0428438-4f61-405b-b06e-07abed8fb46f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:59.110221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0428438-4f61-405b-b06e-07abed8fb46f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:59.112578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0428438-4f61-405b-b06e-07abed8fb46f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:59.114278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0428438-4f61-405b-b06e-07abed8fb46f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:59.115542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0428438-4f61-405b-b06e-07abed8fb46f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:59.116537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0428438-4f61-405b-b06e-07abed8fb46f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:59.117213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0428438-4f61-405b-b06e-07abed8fb46f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:59.331087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-260857715", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:59.472349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:05:59.534348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a0428438-4f61-405b-b06e-07abed8fb46f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:59.545600 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a0428438-4f61-405b-b06e-07abed8fb46f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.451721 Aug 09 17:05:59.565939 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 320/663] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:59 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:59.572762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:59.574082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:59.581720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:59.582298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:59.582842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:59.583676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:59.584207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:59.585184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:59.601997 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] HTTP exception thrown: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Request method failure captured: Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 HTTP/1.1 Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNLFpvZM6hoUmEG4mw0ttydpTZcER83XK7e4XeNjEZawN57ofPAm-SOBgHaRI78rGJ0U9bq0tPLJrvfGhCkIefMNVMKOe5Q9NL8GzZj4E6LldJrRfesmfeqNTcHEGcKkmWuH3mXKRcB_DoKZ5FH7PIy_oe30_UWEARUqqmcsXcWjac Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:05:59.604333 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ff70314be08b4abda96586877f4d6309 Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:05:59.605896 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'cb1ebe1f-c944-4f78-84df-43776f1eb671'} Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:59.606865 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:05:59.608287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:05:59.609940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Returning 404 to user: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:59.609940 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1ec58a0-7bf2-415e-b6bd-9847930f5a5f tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 404 len: 111 microversion: 2.1 time: 0.038742 Aug 09 17:05:59.609940 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 321/664] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:59 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:05:59.613243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-abbcdf9b-983c-4ab3-bbec-9f12c2eafb60 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:59.614001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-abbcdf9b-983c-4ab3-bbec-9f12c2eafb60 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:59.620634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-abbcdf9b-983c-4ab3-bbec-9f12c2eafb60 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:59.621385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-abbcdf9b-983c-4ab3-bbec-9f12c2eafb60 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:59.621895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-abbcdf9b-983c-4ab3-bbec-9f12c2eafb60 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:59.622618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-abbcdf9b-983c-4ab3-bbec-9f12c2eafb60 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:59.623074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-abbcdf9b-983c-4ab3-bbec-9f12c2eafb60 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:59.624190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-abbcdf9b-983c-4ab3-bbec-9f12c2eafb60 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:59.862895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-abbcdf9b-983c-4ab3-bbec-9f12c2eafb60 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:59.880167 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-abbcdf9b-983c-4ab3-bbec-9f12c2eafb60 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1307 microversion: 2.1 time: 0.271354 Aug 09 17:05:59.881231 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 322/665] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:59 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1307 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:59.891029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8474fc96-2d0d-488d-a03f-6eb97860029d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '.version_select at 0x7fbbcbb70790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:59.942631 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8474fc96-2d0d-488d-a03f-6eb97860029d tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-85641018" status: 202 len: 0 microversion: 2.1 time: 0.059955 Aug 09 17:05:59.944621 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 323/666] 10.222.0.93 () {58 vars in 1215 bytes} [Tue Aug 9 17:05:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-85641018 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:05:59.959329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3c5baa4-0860-42b9-ae47-b96d45ab895c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:59.960431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c3c5baa4-0860-42b9-ae47-b96d45ab895c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:00.015973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c5baa4-0860-42b9-ae47-b96d45ab895c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:00.020752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c5baa4-0860-42b9-ae47-b96d45ab895c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:00.026839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c5baa4-0860-42b9-ae47-b96d45ab895c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:00.027292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c5baa4-0860-42b9-ae47-b96d45ab895c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:00.027826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c5baa4-0860-42b9-ae47-b96d45ab895c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:00.028271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c5baa4-0860-42b9-ae47-b96d45ab895c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:00.160882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:06:00.163198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:06:00.164018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:06:00.164793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:06:00.166031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:06:00.188136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:00.191531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:00.194523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:00.196086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:00.198699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:00.204887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:00.243964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Getting quotas for project 09be0c4a839f45c5848413a9d99bbf66. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:06:00.256876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Getting quotas for user 5437ccd3449941079dfbb9a5e943029e and project 09be0c4a839f45c5848413a9d99bbf66. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:06:00.326431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:06:00.348094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:06:00.477402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c3c5baa4-0860-42b9-ae47-b96d45ab895c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:00.518320 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c3c5baa4-0860-42b9-ae47-b96d45ab895c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.569675 Aug 09 17:06:00.519516 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 324/667] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:59 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:00.539218 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-614e9763-13a4-4596-bc10-9fd673bad12a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.833370 Aug 09 17:06:00.542924 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 344/668] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:05:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:06:00.545089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8f03fdf4-6637-40c7-8f92-bdbc177c576b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:00.548740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8f03fdf4-6637-40c7-8f92-bdbc177c576b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:00.562568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f03fdf4-6637-40c7-8f92-bdbc177c576b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:00.564968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f03fdf4-6637-40c7-8f92-bdbc177c576b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:00.567835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a609e677-3761-4ddc-85cb-9970514b1704 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:00.570125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a609e677-3761-4ddc-85cb-9970514b1704 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:00.593170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f03fdf4-6637-40c7-8f92-bdbc177c576b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:00.594099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f03fdf4-6637-40c7-8f92-bdbc177c576b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:00.594602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f03fdf4-6637-40c7-8f92-bdbc177c576b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:00.597070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f03fdf4-6637-40c7-8f92-bdbc177c576b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:00.863551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8f03fdf4-6637-40c7-8f92-bdbc177c576b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:00.877273 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8f03fdf4-6637-40c7-8f92-bdbc177c576b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1504 microversion: 2.1 time: 0.356298 Aug 09 17:06:00.877888 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 325/669] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:00 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:00.892015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d03cad53-84ab-42b6-bf15-bba3b0b7eeca tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:00.895987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d03cad53-84ab-42b6-bf15-bba3b0b7eeca tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:00.913209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03cad53-84ab-42b6-bf15-bba3b0b7eeca tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:00.914308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03cad53-84ab-42b6-bf15-bba3b0b7eeca tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:00.916566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03cad53-84ab-42b6-bf15-bba3b0b7eeca tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:00.918442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03cad53-84ab-42b6-bf15-bba3b0b7eeca tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:00.922126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03cad53-84ab-42b6-bf15-bba3b0b7eeca tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:00.924573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03cad53-84ab-42b6-bf15-bba3b0b7eeca tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:00.971311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a609e677-3761-4ddc-85cb-9970514b1704 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:00.983248 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a609e677-3761-4ddc-85cb-9970514b1704 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1221 microversion: 2.1 time: 0.431408 Aug 09 17:06:00.986349 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 345/670] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:00 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1221 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:01.004762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6ae7cbdf-81d1-4015-83e1-a47314e00e1a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:01.005528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6ae7cbdf-81d1-4015-83e1-a47314e00e1a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:01.051694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ae7cbdf-81d1-4015-83e1-a47314e00e1a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:01.051694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ae7cbdf-81d1-4015-83e1-a47314e00e1a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:01.051694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ae7cbdf-81d1-4015-83e1-a47314e00e1a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:01.051694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ae7cbdf-81d1-4015-83e1-a47314e00e1a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:01.065591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ae7cbdf-81d1-4015-83e1-a47314e00e1a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:01.070888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ae7cbdf-81d1-4015-83e1-a47314e00e1a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:01.724843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d03cad53-84ab-42b6-bf15-bba3b0b7eeca tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:01.749221 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d03cad53-84ab-42b6-bf15-bba3b0b7eeca tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1475 microversion: 2.1 time: 0.868824 Aug 09 17:06:01.752068 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 326/671] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:00 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1475 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:01.764342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a7cbe54-bce4-4069-9f81-c0337f35cf1f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:01.767698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a7cbe54-bce4-4069-9f81-c0337f35cf1f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:01.788405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a7cbe54-bce4-4069-9f81-c0337f35cf1f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:01.789237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a7cbe54-bce4-4069-9f81-c0337f35cf1f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:01.790829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a7cbe54-bce4-4069-9f81-c0337f35cf1f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:01.791885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a7cbe54-bce4-4069-9f81-c0337f35cf1f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:01.793574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a7cbe54-bce4-4069-9f81-c0337f35cf1f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:01.794950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a7cbe54-bce4-4069-9f81-c0337f35cf1f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:01.997429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6ae7cbdf-81d1-4015-83e1-a47314e00e1a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:02.010541 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6ae7cbdf-81d1-4015-83e1-a47314e00e1a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1307 microversion: 2.1 time: 1.022120 Aug 09 17:06:02.023018 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 346/672] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:00 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1307 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:02.069273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4c9e5d51-9ce1-46cd-9365-ceb4a48431db tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:02.073104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4c9e5d51-9ce1-46cd-9365-ceb4a48431db tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:02.097849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9e5d51-9ce1-46cd-9365-ceb4a48431db tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:02.099059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9e5d51-9ce1-46cd-9365-ceb4a48431db tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:02.101184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9e5d51-9ce1-46cd-9365-ceb4a48431db tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:02.103234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9e5d51-9ce1-46cd-9365-ceb4a48431db tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:02.104501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9e5d51-9ce1-46cd-9365-ceb4a48431db tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:02.105393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9e5d51-9ce1-46cd-9365-ceb4a48431db tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:02.714072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4a7cbe54-bce4-4069-9f81-c0337f35cf1f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:02.733559 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a7cbe54-bce4-4069-9f81-c0337f35cf1f tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.977041 Aug 09 17:06:02.753246 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 327/673] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:01 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:02.768382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9b7d8eda-23af-42f6-a543-21a95aee2269 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:02.769093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9b7d8eda-23af-42f6-a543-21a95aee2269 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:02.828942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7d8eda-23af-42f6-a543-21a95aee2269 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:02.831175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7d8eda-23af-42f6-a543-21a95aee2269 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:02.833172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7d8eda-23af-42f6-a543-21a95aee2269 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:02.834639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7d8eda-23af-42f6-a543-21a95aee2269 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:02.835532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7d8eda-23af-42f6-a543-21a95aee2269 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:02.845343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7d8eda-23af-42f6-a543-21a95aee2269 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:03.016437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:03.083909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9b7d8eda-23af-42f6-a543-21a95aee2269 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:03.105394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:03.106972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:03.121999 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9b7d8eda-23af-42f6-a543-21a95aee2269 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1281 microversion: 2.1 time: 0.365922 Aug 09 17:06:03.140148 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 328/674] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:02 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1281 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:03.163971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c6e25ba7-847e-4b73-866e-d83a3595c437 req-11972669-0614-40a0-a5ea-b35a306ff3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9114d8ad-2746-443d-8799-c09c421ac55d", "tag": "72374f34-ae5a-40c5-8e9c-d64a473cbbfb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:03.189478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c6e25ba7-847e-4b73-866e-d83a3595c437 req-11972669-0614-40a0-a5ea-b35a306ff3b8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:03.190903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c6e25ba7-847e-4b73-866e-d83a3595c437 req-11972669-0614-40a0-a5ea-b35a306ff3b8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:03.192021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c6e25ba7-847e-4b73-866e-d83a3595c437 req-11972669-0614-40a0-a5ea-b35a306ff3b8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:03.236880 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c6e25ba7-847e-4b73-866e-d83a3595c437 req-11972669-0614-40a0-a5ea-b35a306ff3b8 service nova] Creating event network-changed:72374f34-ae5a-40c5-8e9c-d64a473cbbfb for instance 9114d8ad-2746-443d-8799-c09c421ac55d on n-h1-845781-6 Aug 09 17:06:03.247432 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c6e25ba7-847e-4b73-866e-d83a3595c437 req-11972669-0614-40a0-a5ea-b35a306ff3b8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103930 Aug 09 17:06:03.249023 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 329/675] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:03.260711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c976be8-cadf-4750-ac44-34405a74edc4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:03.262541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c976be8-cadf-4750-ac44-34405a74edc4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:03.276282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c976be8-cadf-4750-ac44-34405a74edc4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:03.277570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c976be8-cadf-4750-ac44-34405a74edc4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:03.278653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c976be8-cadf-4750-ac44-34405a74edc4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:03.280546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c976be8-cadf-4750-ac44-34405a74edc4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:03.281660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c976be8-cadf-4750-ac44-34405a74edc4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:03.282756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c976be8-cadf-4750-ac44-34405a74edc4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:03.721523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4c9e5d51-9ce1-46cd-9365-ceb4a48431db tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:03.754633 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4c9e5d51-9ce1-46cd-9365-ceb4a48431db tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1504 microversion: 2.1 time: 1.726115 Aug 09 17:06:03.757859 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 347/676] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:02 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1504 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:03.785971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e2dee9c0-124f-4472-a54d-86330f663659 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:03.788298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e2dee9c0-124f-4472-a54d-86330f663659 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:03.803405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2dee9c0-124f-4472-a54d-86330f663659 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:03.804713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2dee9c0-124f-4472-a54d-86330f663659 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:03.806076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2dee9c0-124f-4472-a54d-86330f663659 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:03.807360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2dee9c0-124f-4472-a54d-86330f663659 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:03.808230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2dee9c0-124f-4472-a54d-86330f663659 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:03.809008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2dee9c0-124f-4472-a54d-86330f663659 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:03.866053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c976be8-cadf-4750-ac44-34405a74edc4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:03.886349 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c976be8-cadf-4750-ac44-34405a74edc4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1474 microversion: 2.1 time: 0.635470 Aug 09 17:06:03.889720 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 330/677] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:03 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1474 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:03.904122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ede01d60-6e25-4925-b3ab-2207481437c7 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:03.908441 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:06:03.908441 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:06:03.945472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:03.954979 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ede01d60-6e25-4925-b3ab-2207481437c7 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1937920356" status: 202 len: 0 microversion: 2.1 time: 0.062518 Aug 09 17:06:03.956767 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 331/678] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:06:03 2022] DELETE /compute/v2.1/flavors/1937920356 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:06:03.971337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4564f3a9-9d7b-4d9a-ac86-02baf8d5ec43 req-4828e22b-360f-43c9-91cc-c3e27b334891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c0e36e-ac06-4af8-9f62-13a660022181", "name": "network-vif-unplugged", "status": "completed", "tag": "5c0b51c4-b352-4c21-acec-09318bb172f4"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:03.987901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4564f3a9-9d7b-4d9a-ac86-02baf8d5ec43 req-4828e22b-360f-43c9-91cc-c3e27b334891 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:03.989322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4564f3a9-9d7b-4d9a-ac86-02baf8d5ec43 req-4828e22b-360f-43c9-91cc-c3e27b334891 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:03.989897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4564f3a9-9d7b-4d9a-ac86-02baf8d5ec43 req-4828e22b-360f-43c9-91cc-c3e27b334891 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:04.011754 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4564f3a9-9d7b-4d9a-ac86-02baf8d5ec43 req-4828e22b-360f-43c9-91cc-c3e27b334891 service nova] Creating event network-vif-unplugged:5c0b51c4-b352-4c21-acec-09318bb172f4 for instance 45c0e36e-ac06-4af8-9f62-13a660022181 on n-h1-845781-6 Aug 09 17:06:04.023310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-4564f3a9-9d7b-4d9a-ac86-02baf8d5ec43 req-4828e22b-360f-43c9-91cc-c3e27b334891 service nova] Instance 45c0e36e-ac06-4af8-9f62-13a660022181 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:06:04.044511 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4564f3a9-9d7b-4d9a-ac86-02baf8d5ec43 req-4828e22b-360f-43c9-91cc-c3e27b334891 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084710 Aug 09 17:06:04.049124 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 332/679] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:04.058635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8fd1ffd6-d8fe-4ee0-a98c-e56e373197d4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:04.060517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8fd1ffd6-d8fe-4ee0-a98c-e56e373197d4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:04.069276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd1ffd6-d8fe-4ee0-a98c-e56e373197d4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:04.070244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd1ffd6-d8fe-4ee0-a98c-e56e373197d4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:04.071804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd1ffd6-d8fe-4ee0-a98c-e56e373197d4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:04.072850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd1ffd6-d8fe-4ee0-a98c-e56e373197d4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:04.073485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd1ffd6-d8fe-4ee0-a98c-e56e373197d4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:04.074117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd1ffd6-d8fe-4ee0-a98c-e56e373197d4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:04.471494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8fd1ffd6-d8fe-4ee0-a98c-e56e373197d4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:04.495344 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8fd1ffd6-d8fe-4ee0-a98c-e56e373197d4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1473 microversion: 2.1 time: 0.441081 Aug 09 17:06:04.500865 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 333/680] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:04 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1473 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:04.520082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-98acb4db-8f15-4351-8a6b-923b55ad3084 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:04.612051 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-98acb4db-8f15-4351-8a6b-923b55ad3084 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.109324 Aug 09 17:06:04.626742 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 334/681] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:06:04 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:04.642113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-30ce30e3-4c3a-4971-8932-d1d9612c1600 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:04.658367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-30ce30e3-4c3a-4971-8932-d1d9612c1600 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:04.683151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ce30e3-4c3a-4971-8932-d1d9612c1600 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:04.684103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ce30e3-4c3a-4971-8932-d1d9612c1600 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:04.684886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ce30e3-4c3a-4971-8932-d1d9612c1600 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:04.686099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ce30e3-4c3a-4971-8932-d1d9612c1600 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:04.686921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ce30e3-4c3a-4971-8932-d1d9612c1600 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:04.704870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ce30e3-4c3a-4971-8932-d1d9612c1600 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:05.058630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-30ce30e3-4c3a-4971-8932-d1d9612c1600 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:05.070288 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-30ce30e3-4c3a-4971-8932-d1d9612c1600 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1279 microversion: 2.1 time: 0.441931 Aug 09 17:06:05.074109 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 335/682] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:04 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1279 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:05.085062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-24fe410f-41b0-461e-91e9-18a0ba70a308 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:05.090768 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:06:05.090768 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:06:05.135880 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-24fe410f-41b0-461e-91e9-18a0ba70a308 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1334699906" status: 202 len: 0 microversion: 2.1 time: 0.060155 Aug 09 17:06:05.143748 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 336/683] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:06:05 2022] DELETE /compute/v2.1/flavors/1334699906 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:06:05.161826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94ed3622-4046-45ca-8885-b1e2d3b436bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:05.162500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94ed3622-4046-45ca-8885-b1e2d3b436bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:05.176851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94ed3622-4046-45ca-8885-b1e2d3b436bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:05.181772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94ed3622-4046-45ca-8885-b1e2d3b436bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:05.182854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94ed3622-4046-45ca-8885-b1e2d3b436bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:05.184920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94ed3622-4046-45ca-8885-b1e2d3b436bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:05.187937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94ed3622-4046-45ca-8885-b1e2d3b436bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:05.188703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94ed3622-4046-45ca-8885-b1e2d3b436bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:05.454743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e2dee9c0-124f-4472-a54d-86330f663659 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:05.481304 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e2dee9c0-124f-4472-a54d-86330f663659 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1307 microversion: 2.1 time: 1.719554 Aug 09 17:06:05.485929 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 348/684] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:03 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1307 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:05.492721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bc70bc30-5ad8-4e5e-ac88-5912ac478802 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:05.494157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bc70bc30-5ad8-4e5e-ac88-5912ac478802 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:05.507823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:05.511802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc70bc30-5ad8-4e5e-ac88-5912ac478802 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:05.512562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc70bc30-5ad8-4e5e-ac88-5912ac478802 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:05.513025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc70bc30-5ad8-4e5e-ac88-5912ac478802 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:05.514733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc70bc30-5ad8-4e5e-ac88-5912ac478802 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:05.515202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc70bc30-5ad8-4e5e-ac88-5912ac478802 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:05.515800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc70bc30-5ad8-4e5e-ac88-5912ac478802 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:05.527337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:05.871990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bc70bc30-5ad8-4e5e-ac88-5912ac478802 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:05.886912 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bc70bc30-5ad8-4e5e-ac88-5912ac478802 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1474 microversion: 2.1 time: 0.399381 Aug 09 17:06:05.887516 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 349/685] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:05 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1474 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:05.902447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-55b923ab-690e-4bb5-b43e-a9d60e653468 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:05.958945 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-55b923ab-690e-4bb5-b43e-a9d60e653468 tempest-ServersWithSpecificFlavorTestJSON-735991846 tempest-ServersWithSpecificFlavorTestJSON-735991846-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068946 Aug 09 17:06:05.967715 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 350/686] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:06:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:05.967715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-463020c0-c2c9-49fd-bf61-3f44d326bfa2 req-6d901e24-7ce7-4167-9aeb-2da4b0c9aaee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb84cd97-b6b0-40f0-9774-e5baa48fc7c9", "name": "network-vif-unplugged", "status": "completed", "tag": "22f0d67b-a0ab-4059-b2b2-907936f07fb8"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:05.992171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-463020c0-c2c9-49fd-bf61-3f44d326bfa2 req-6d901e24-7ce7-4167-9aeb-2da4b0c9aaee service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:05.993626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-463020c0-c2c9-49fd-bf61-3f44d326bfa2 req-6d901e24-7ce7-4167-9aeb-2da4b0c9aaee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:05.994295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-463020c0-c2c9-49fd-bf61-3f44d326bfa2 req-6d901e24-7ce7-4167-9aeb-2da4b0c9aaee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.031968 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-463020c0-c2c9-49fd-bf61-3f44d326bfa2 req-6d901e24-7ce7-4167-9aeb-2da4b0c9aaee service nova] Creating event network-vif-unplugged:22f0d67b-a0ab-4059-b2b2-907936f07fb8 for instance fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 on n-h1-845781-6 Aug 09 17:06:06.050213 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-463020c0-c2c9-49fd-bf61-3f44d326bfa2 req-6d901e24-7ce7-4167-9aeb-2da4b0c9aaee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088895 Aug 09 17:06:06.061528 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 351/687] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:06.080795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2a60d182-115e-4057-8036-3d864d88448a tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:06.088482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2a60d182-115e-4057-8036-3d864d88448a tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:06.112280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a60d182-115e-4057-8036-3d864d88448a tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.112896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a60d182-115e-4057-8036-3d864d88448a tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.114780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a60d182-115e-4057-8036-3d864d88448a tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.116172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a60d182-115e-4057-8036-3d864d88448a tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.117904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a60d182-115e-4057-8036-3d864d88448a tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.119175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a60d182-115e-4057-8036-3d864d88448a tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.393995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94ed3622-4046-45ca-8885-b1e2d3b436bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:06.421111 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94ed3622-4046-45ca-8885-b1e2d3b436bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1504 microversion: 2.1 time: 1.267047 Aug 09 17:06:06.439844 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 337/688] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:05 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1504 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:06.446465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:06.447176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:06.453634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.454546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.454990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.456141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.457416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.457939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.478375 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] HTTP exception thrown: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Request method failure captured: Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 HTTP/1.1 Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNLFpvZM6hoUmEG4mw0ttydpTZcER83XK7e4XeNjEZawN57ofPAm-SOBgHaRI78rGJ0U9bq0tPLJrvfGhCkIefMNVMKOe5Q9NL8GzZj4E6LldJrRfesmfeqNTcHEGcKkmWuH3mXKRcB_DoKZ5FH7PIy_oe30_UWEARUqqmcsXcWjac Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:06:06.480395 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ff70314be08b4abda96586877f4d6309 Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:06:06.483294 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '511258ee-3778-4c68-b364-923209210bb9'} Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:06.485069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:06:06.487944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.495817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Returning 404 to user: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:06.495817 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e51b446-8417-40b1-b114-615335bac396 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "DELETE /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 404 len: 111 microversion: 2.1 time: 0.040471 Aug 09 17:06:06.495817 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 338/689] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:06:06 2022] DELETE /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:06:06.495817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-de571efc-8170-4b61-a321-01efdd773958 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:06.495817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-de571efc-8170-4b61-a321-01efdd773958 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:06.496930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de571efc-8170-4b61-a321-01efdd773958 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.496930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de571efc-8170-4b61-a321-01efdd773958 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.496930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de571efc-8170-4b61-a321-01efdd773958 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.497643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de571efc-8170-4b61-a321-01efdd773958 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.498652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de571efc-8170-4b61-a321-01efdd773958 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.499249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de571efc-8170-4b61-a321-01efdd773958 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.583324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2a60d182-115e-4057-8036-3d864d88448a tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:06.596641 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2a60d182-115e-4057-8036-3d864d88448a tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1479 microversion: 2.1 time: 0.533387 Aug 09 17:06:06.597519 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 352/690] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:06 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1479 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:06.603849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-aa1fd5b2-d77c-4e32-b12c-f4ce4209ae66 req-c9512449-50a2-478a-8ae8-a74d358e2e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c0e36e-ac06-4af8-9f62-13a660022181", "tag": "5c0b51c4-b352-4c21-acec-09318bb172f4"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:06.617539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-aa1fd5b2-d77c-4e32-b12c-f4ce4209ae66 req-c9512449-50a2-478a-8ae8-a74d358e2e3a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.619467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-aa1fd5b2-d77c-4e32-b12c-f4ce4209ae66 req-c9512449-50a2-478a-8ae8-a74d358e2e3a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.621926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-aa1fd5b2-d77c-4e32-b12c-f4ce4209ae66 req-c9512449-50a2-478a-8ae8-a74d358e2e3a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.629291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-de571efc-8170-4b61-a321-01efdd773958 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:06.641243 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-de571efc-8170-4b61-a321-01efdd773958 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1279 microversion: 2.1 time: 0.157252 Aug 09 17:06:06.641864 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 339/691] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:06 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:06.656815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:06.657975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: 511258ee-3778-4c68-b364-923209210bb9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:06.668302 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-aa1fd5b2-d77c-4e32-b12c-f4ce4209ae66 req-c9512449-50a2-478a-8ae8-a74d358e2e3a service nova] Creating event network-changed:5c0b51c4-b352-4c21-acec-09318bb172f4 for instance 45c0e36e-ac06-4af8-9f62-13a660022181 on n-h1-845781-6 Aug 09 17:06:06.678317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-aa1fd5b2-d77c-4e32-b12c-f4ce4209ae66 req-c9512449-50a2-478a-8ae8-a74d358e2e3a service nova] Instance 45c0e36e-ac06-4af8-9f62-13a660022181 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:06:06.689711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.691894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.695079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.696302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.698164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.699223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.707388 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-aa1fd5b2-d77c-4e32-b12c-f4ce4209ae66 req-c9512449-50a2-478a-8ae8-a74d358e2e3a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108351 Aug 09 17:06:06.709255 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 353/692] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:06.721901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2620f8b7-fc77-4f1a-a2f8-466f83934e35 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:06.735898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2620f8b7-fc77-4f1a-a2f8-466f83934e35 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:06.745329 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] HTTP exception thrown: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Request method failure captured: Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 HTTP/1.1 Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNLFpvZM6hoUmEG4mw0ttydpTZcER83XK7e4XeNjEZawN57ofPAm-SOBgHaRI78rGJ0U9bq0tPLJrvfGhCkIefMNVMKOe5Q9NL8GzZj4E6LldJrRfesmfeqNTcHEGcKkmWuH3mXKRcB_DoKZ5FH7PIy_oe30_UWEARUqqmcsXcWjac Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:06:06.753976 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ff70314be08b4abda96586877f4d6309 Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:06:06.756877 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '511258ee-3778-4c68-b364-923209210bb9'} Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:06.758444 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. Aug 09 17:06:06.763593 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.771670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2620f8b7-fc77-4f1a-a2f8-466f83934e35 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.771670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2620f8b7-fc77-4f1a-a2f8-466f83934e35 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.771670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2620f8b7-fc77-4f1a-a2f8-466f83934e35 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.773985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Returning 404 to user: Instance 511258ee-3778-4c68-b364-923209210bb9 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:06.775354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2620f8b7-fc77-4f1a-a2f8-466f83934e35 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.776262 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ee62108d-63d7-493e-9f42-f7740fb1ceda tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9" status: 404 len: 111 microversion: 2.1 time: 0.133322 Aug 09 17:06:06.777079 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 340/693] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:06 2022] GET /compute/v2.1/servers/511258ee-3778-4c68-b364-923209210bb9 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:06:06.777971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2620f8b7-fc77-4f1a-a2f8-466f83934e35 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.781384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2620f8b7-fc77-4f1a-a2f8-466f83934e35 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.786306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:06.792909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:06.803806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.804310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.804758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.805524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.805990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.806422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.844938 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] HTTP exception thrown: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Request method failure captured: Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 HTTP/1.1 Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNLFpvZM6hoUmEG4mw0ttydpTZcER83XK7e4XeNjEZawN57ofPAm-SOBgHaRI78rGJ0U9bq0tPLJrvfGhCkIefMNVMKOe5Q9NL8GzZj4E6LldJrRfesmfeqNTcHEGcKkmWuH3mXKRcB_DoKZ5FH7PIy_oe30_UWEARUqqmcsXcWjac Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:06:06.851484 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ff70314be08b4abda96586877f4d6309 Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:06:06.853789 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'cb1ebe1f-c944-4f78-84df-43776f1eb671'} Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:06.854723 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:06:06.856024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.857264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Returning 404 to user: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:06.857264 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4306e625-20b7-4b45-94ff-e214aefa6857 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 404 len: 111 microversion: 2.1 time: 0.072045 Aug 09 17:06:06.859547 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 341/694] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:06:06 2022] DELETE /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:06:06.864846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:06.865844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] [instance: cb1ebe1f-c944-4f78-84df-43776f1eb671] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:06.873394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.874271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.874978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.875926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.876402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.876836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.894124 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] HTTP exception thrown: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Request method failure captured: Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 HTTP/1.1 Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNLFpvZM6hoUmEG4mw0ttydpTZcER83XK7e4XeNjEZawN57ofPAm-SOBgHaRI78rGJ0U9bq0tPLJrvfGhCkIefMNVMKOe5Q9NL8GzZj4E6LldJrRfesmfeqNTcHEGcKkmWuH3mXKRcB_DoKZ5FH7PIy_oe30_UWEARUqqmcsXcWjac Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:06:06.895849 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5137eb4f54ad48b3ba4de9307b6e80ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5137eb4f54ad48b3ba4de9307b6e80ff Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437 Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ff70314be08b4abda96586877f4d6309 Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-886731437-project Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:06:06.897339 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'cb1ebe1f-c944-4f78-84df-43776f1eb671'} Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:06.898061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. Aug 09 17:06:06.899831 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:06.900911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] Returning 404 to user: Instance cb1ebe1f-c944-4f78-84df-43776f1eb671 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:06.900911 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3c46ac4-ce4e-44d8-a822-ca4222ef1017 tempest-ServersWithSpecificFlavorTestJSON-886731437 tempest-ServersWithSpecificFlavorTestJSON-886731437-project] 10.222.0.93 "GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671" status: 404 len: 111 microversion: 2.1 time: 0.036485 Aug 09 17:06:06.900911 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 342/695] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:06 2022] GET /compute/v2.1/servers/cb1ebe1f-c944-4f78-84df-43776f1eb671 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:06:06.923733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bda0de4e-ce0b-4b77-9e0d-c9ad392a7a9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:06.924662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bda0de4e-ce0b-4b77-9e0d-c9ad392a7a9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:06.934319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bda0de4e-ce0b-4b77-9e0d-c9ad392a7a9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.935108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bda0de4e-ce0b-4b77-9e0d-c9ad392a7a9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.935819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bda0de4e-ce0b-4b77-9e0d-c9ad392a7a9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:06.936768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bda0de4e-ce0b-4b77-9e0d-c9ad392a7a9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:06.937437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bda0de4e-ce0b-4b77-9e0d-c9ad392a7a9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:06.938043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bda0de4e-ce0b-4b77-9e0d-c9ad392a7a9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:07.639255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2620f8b7-fc77-4f1a-a2f8-466f83934e35 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:07.663476 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2620f8b7-fc77-4f1a-a2f8-466f83934e35 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1307 microversion: 2.1 time: 0.952118 Aug 09 17:06:07.683617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bda0de4e-ce0b-4b77-9e0d-c9ad392a7a9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:07.701582 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 354/696] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:06 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1307 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:07.716805 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bda0de4e-ce0b-4b77-9e0d-c9ad392a7a9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1474 microversion: 2.1 time: 0.797303 Aug 09 17:06:07.718329 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 343/697] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:06 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1474 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:06:07.755230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b8f7bb58-ac0e-4276-984b-7a212d6c2bab tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:07.756528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b8f7bb58-ac0e-4276-984b-7a212d6c2bab tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:07.763979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66801f83-3589-45ee-bac6-9508e2cdeb79 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:07.765500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-66801f83-3589-45ee-bac6-9508e2cdeb79 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:07.781398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66801f83-3589-45ee-bac6-9508e2cdeb79 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:07.782233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66801f83-3589-45ee-bac6-9508e2cdeb79 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:07.783005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66801f83-3589-45ee-bac6-9508e2cdeb79 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:07.786461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66801f83-3589-45ee-bac6-9508e2cdeb79 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:07.787253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66801f83-3589-45ee-bac6-9508e2cdeb79 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:07.795822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66801f83-3589-45ee-bac6-9508e2cdeb79 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:07.801393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8f7bb58-ac0e-4276-984b-7a212d6c2bab tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:07.802276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8f7bb58-ac0e-4276-984b-7a212d6c2bab tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:07.803088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8f7bb58-ac0e-4276-984b-7a212d6c2bab tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:07.808807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8f7bb58-ac0e-4276-984b-7a212d6c2bab tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:07.812282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8f7bb58-ac0e-4276-984b-7a212d6c2bab tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:07.816365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8f7bb58-ac0e-4276-984b-7a212d6c2bab tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:08.630419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-66801f83-3589-45ee-bac6-9508e2cdeb79 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:08.646343 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66801f83-3589-45ee-bac6-9508e2cdeb79 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1479 microversion: 2.1 time: 0.924170 Aug 09 17:06:08.647357 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 344/698] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:07 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1479 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:08.654979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2c20a372-3f19-4cba-82e4-18dc50e0d1a6 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:08.665182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2c20a372-3f19-4cba-82e4-18dc50e0d1a6 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:08.691836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c20a372-3f19-4cba-82e4-18dc50e0d1a6 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:08.693385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c20a372-3f19-4cba-82e4-18dc50e0d1a6 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:08.694044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c20a372-3f19-4cba-82e4-18dc50e0d1a6 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:08.695049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c20a372-3f19-4cba-82e4-18dc50e0d1a6 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:08.695758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c20a372-3f19-4cba-82e4-18dc50e0d1a6 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:08.696877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c20a372-3f19-4cba-82e4-18dc50e0d1a6 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:09.143965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b8f7bb58-ac0e-4276-984b-7a212d6c2bab tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:09.174860 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b8f7bb58-ac0e-4276-984b-7a212d6c2bab tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1504 microversion: 2.1 time: 1.468777 Aug 09 17:06:09.178837 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 355/699] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:07 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1504 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:09.197338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-6db305cb-2daf-428e-83de-812977a3a8cf req-8b3f63f3-ffe3-4643-8c0a-2b5545ee577f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb84cd97-b6b0-40f0-9774-e5baa48fc7c9", "tag": "22f0d67b-a0ab-4059-b2b2-907936f07fb8"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:09.199801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2c20a372-3f19-4cba-82e4-18dc50e0d1a6 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:09.210199 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2c20a372-3f19-4cba-82e4-18dc50e0d1a6 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1321 microversion: 2.1 time: 0.559451 Aug 09 17:06:09.213514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6db305cb-2daf-428e-83de-812977a3a8cf req-8b3f63f3-ffe3-4643-8c0a-2b5545ee577f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:09.213847 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 345/700] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:08 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1321 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:09.214537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6db305cb-2daf-428e-83de-812977a3a8cf req-8b3f63f3-ffe3-4643-8c0a-2b5545ee577f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:09.215947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6db305cb-2daf-428e-83de-812977a3a8cf req-8b3f63f3-ffe3-4643-8c0a-2b5545ee577f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:09.223593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3b556e15-0427-4f27-841e-a060c47af586 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:09.224263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3b556e15-0427-4f27-841e-a060c47af586 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:09.239289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b556e15-0427-4f27-841e-a060c47af586 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:09.239947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b556e15-0427-4f27-841e-a060c47af586 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:09.240468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b556e15-0427-4f27-841e-a060c47af586 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:09.241517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b556e15-0427-4f27-841e-a060c47af586 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:09.242454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b556e15-0427-4f27-841e-a060c47af586 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:09.243802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b556e15-0427-4f27-841e-a060c47af586 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:09.253125 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-6db305cb-2daf-428e-83de-812977a3a8cf req-8b3f63f3-ffe3-4643-8c0a-2b5545ee577f service nova] Creating event network-changed:22f0d67b-a0ab-4059-b2b2-907936f07fb8 for instance fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 on n-h1-845781-6 Aug 09 17:06:09.269698 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-6db305cb-2daf-428e-83de-812977a3a8cf req-8b3f63f3-ffe3-4643-8c0a-2b5545ee577f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088156 Aug 09 17:06:09.271109 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 356/701] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:09.288911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-09b5a252-f7e8-4be3-aa8f-8385e84f0623 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:09.289918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-09b5a252-f7e8-4be3-aa8f-8385e84f0623 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:09.318986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09b5a252-f7e8-4be3-aa8f-8385e84f0623 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:09.319484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09b5a252-f7e8-4be3-aa8f-8385e84f0623 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:09.319993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09b5a252-f7e8-4be3-aa8f-8385e84f0623 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:09.320822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09b5a252-f7e8-4be3-aa8f-8385e84f0623 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:09.321867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09b5a252-f7e8-4be3-aa8f-8385e84f0623 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:09.327834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09b5a252-f7e8-4be3-aa8f-8385e84f0623 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:09.700803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3b556e15-0427-4f27-841e-a060c47af586 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:09.731054 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3b556e15-0427-4f27-841e-a060c47af586 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1307 microversion: 2.1 time: 0.515568 Aug 09 17:06:09.738042 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 346/702] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:09 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1307 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:09.758810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-58446112-ff88-4d31-8744-be8e6d5c75ae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:09.760707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-58446112-ff88-4d31-8744-be8e6d5c75ae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:09.782668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58446112-ff88-4d31-8744-be8e6d5c75ae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:09.788876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58446112-ff88-4d31-8744-be8e6d5c75ae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:09.790897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58446112-ff88-4d31-8744-be8e6d5c75ae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:09.793472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58446112-ff88-4d31-8744-be8e6d5c75ae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:09.794970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58446112-ff88-4d31-8744-be8e6d5c75ae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:09.798155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58446112-ff88-4d31-8744-be8e6d5c75ae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:10.219502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:10.406486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-58446112-ff88-4d31-8744-be8e6d5c75ae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:10.418394 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-58446112-ff88-4d31-8744-be8e6d5c75ae tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1479 microversion: 2.1 time: 0.677941 Aug 09 17:06:10.426100 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 347/703] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:09 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1479 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:10.435410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e4e0fe1f-e435-4beb-b282-c5a36cb48a6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:10.440345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e4e0fe1f-e435-4beb-b282-c5a36cb48a6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:10.456197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e0fe1f-e435-4beb-b282-c5a36cb48a6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:10.458599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e0fe1f-e435-4beb-b282-c5a36cb48a6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:10.462270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e0fe1f-e435-4beb-b282-c5a36cb48a6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:10.464535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e0fe1f-e435-4beb-b282-c5a36cb48a6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:10.474434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e0fe1f-e435-4beb-b282-c5a36cb48a6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:10.475183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e0fe1f-e435-4beb-b282-c5a36cb48a6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:10.791262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-09b5a252-f7e8-4be3-aa8f-8385e84f0623 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:10.822466 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-09b5a252-f7e8-4be3-aa8f-8385e84f0623 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1472 microversion: 2.1 time: 1.549583 Aug 09 17:06:10.823498 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 357/704] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:09 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1472 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:10.843822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8d89bb55-2596-49b4-aa70-d624b586394b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:10.851094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8d89bb55-2596-49b4-aa70-d624b586394b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:10.899025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d89bb55-2596-49b4-aa70-d624b586394b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:10.900332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d89bb55-2596-49b4-aa70-d624b586394b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:10.905863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d89bb55-2596-49b4-aa70-d624b586394b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:10.913160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d89bb55-2596-49b4-aa70-d624b586394b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:10.915793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d89bb55-2596-49b4-aa70-d624b586394b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:10.918058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d89bb55-2596-49b4-aa70-d624b586394b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:11.002446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:11.299202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4e0fe1f-e435-4beb-b282-c5a36cb48a6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:11.333156 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e4e0fe1f-e435-4beb-b282-c5a36cb48a6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1504 microversion: 2.1 time: 0.904722 Aug 09 17:06:11.335609 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 348/705] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:10 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1504 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:11.346686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-32654e82-b349-4a1d-8757-0ec8d0b8c263 req-aee74a96-bbfe-4d78-aa9c-d73e5b6b5b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce37568-9dbf-4f84-875d-0bfda5961abc", "name": "network-vif-plugged", "status": "completed", "tag": "cdac773e-042b-445a-b50f-a65814f73dae"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:11.401683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-32654e82-b349-4a1d-8757-0ec8d0b8c263 req-aee74a96-bbfe-4d78-aa9c-d73e5b6b5b06 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:11.408143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-32654e82-b349-4a1d-8757-0ec8d0b8c263 req-aee74a96-bbfe-4d78-aa9c-d73e5b6b5b06 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:11.413563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-32654e82-b349-4a1d-8757-0ec8d0b8c263 req-aee74a96-bbfe-4d78-aa9c-d73e5b6b5b06 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:11.444754 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-32654e82-b349-4a1d-8757-0ec8d0b8c263 req-aee74a96-bbfe-4d78-aa9c-d73e5b6b5b06 service nova] Creating event network-vif-plugged:cdac773e-042b-445a-b50f-a65814f73dae for instance cce37568-9dbf-4f84-875d-0bfda5961abc on n-h2-845781-6 Aug 09 17:06:11.466875 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-32654e82-b349-4a1d-8757-0ec8d0b8c263 req-aee74a96-bbfe-4d78-aa9c-d73e5b6b5b06 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124509 Aug 09 17:06:11.467984 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 349/706] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:11.513715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8094972b-14e6-4d48-8b6a-685ca75132b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:11.517867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8094972b-14e6-4d48-8b6a-685ca75132b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:11.568614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8094972b-14e6-4d48-8b6a-685ca75132b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:11.570557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8094972b-14e6-4d48-8b6a-685ca75132b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:11.574584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8094972b-14e6-4d48-8b6a-685ca75132b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:11.578332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8094972b-14e6-4d48-8b6a-685ca75132b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:11.579428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8094972b-14e6-4d48-8b6a-685ca75132b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:11.583110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8094972b-14e6-4d48-8b6a-685ca75132b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:11.941420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8d89bb55-2596-49b4-aa70-d624b586394b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:11.958715 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8d89bb55-2596-49b4-aa70-d624b586394b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1321 microversion: 2.1 time: 1.129542 Aug 09 17:06:11.959477 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 358/707] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:10 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1321 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:11.965287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72c114ac-f68c-4184-8c9d-caffa246938c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:11.966670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-72c114ac-f68c-4184-8c9d-caffa246938c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:11.976690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c114ac-f68c-4184-8c9d-caffa246938c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:11.985095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c114ac-f68c-4184-8c9d-caffa246938c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:11.987274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c114ac-f68c-4184-8c9d-caffa246938c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:11.989336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c114ac-f68c-4184-8c9d-caffa246938c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:11.990529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c114ac-f68c-4184-8c9d-caffa246938c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:11.991334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c114ac-f68c-4184-8c9d-caffa246938c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:12.364512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8094972b-14e6-4d48-8b6a-685ca75132b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:12.385084 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8094972b-14e6-4d48-8b6a-685ca75132b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1307 microversion: 2.1 time: 0.914181 Aug 09 17:06:12.386444 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 350/708] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:11 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1307 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:12.396026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f351c9e9-e383-4b73-a9b5-a5ec6fd0aa05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:12.397469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f351c9e9-e383-4b73-a9b5-a5ec6fd0aa05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:12.412810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f351c9e9-e383-4b73-a9b5-a5ec6fd0aa05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:12.414032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f351c9e9-e383-4b73-a9b5-a5ec6fd0aa05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:12.415593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f351c9e9-e383-4b73-a9b5-a5ec6fd0aa05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:12.417228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f351c9e9-e383-4b73-a9b5-a5ec6fd0aa05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:12.419708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f351c9e9-e383-4b73-a9b5-a5ec6fd0aa05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:12.421097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f351c9e9-e383-4b73-a9b5-a5ec6fd0aa05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:12.626415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-72c114ac-f68c-4184-8c9d-caffa246938c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:12.647843 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72c114ac-f68c-4184-8c9d-caffa246938c tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1479 microversion: 2.1 time: 0.686648 Aug 09 17:06:12.651666 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 359/709] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:11 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1479 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:12.664485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c7a84f6b-30fb-40a4-bc09-4223d58d4851 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:12.665697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c7a84f6b-30fb-40a4-bc09-4223d58d4851 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:12.680911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a84f6b-30fb-40a4-bc09-4223d58d4851 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:12.682126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a84f6b-30fb-40a4-bc09-4223d58d4851 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:12.682787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a84f6b-30fb-40a4-bc09-4223d58d4851 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:12.684528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a84f6b-30fb-40a4-bc09-4223d58d4851 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:12.685350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a84f6b-30fb-40a4-bc09-4223d58d4851 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:12.686292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a84f6b-30fb-40a4-bc09-4223d58d4851 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:12.769874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f351c9e9-e383-4b73-a9b5-a5ec6fd0aa05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:12.782203 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f351c9e9-e383-4b73-a9b5-a5ec6fd0aa05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1469 microversion: 2.1 time: 0.393807 Aug 09 17:06:12.790328 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 351/710] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:12 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1469 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:12.831516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50c4816e-a159-42aa-9e55-b4b36564aea6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:12.833020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-50c4816e-a159-42aa-9e55-b4b36564aea6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:12.845482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c4816e-a159-42aa-9e55-b4b36564aea6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:12.846900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c4816e-a159-42aa-9e55-b4b36564aea6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:12.848102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c4816e-a159-42aa-9e55-b4b36564aea6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:12.849743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c4816e-a159-42aa-9e55-b4b36564aea6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:12.850950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c4816e-a159-42aa-9e55-b4b36564aea6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:12.852200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c4816e-a159-42aa-9e55-b4b36564aea6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:12.933110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:13.006357 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-50c4816e-a159-42aa-9e55-b4b36564aea6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "POST /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181/action" status: 204 len: 0 microversion: 2.1 time: 0.181327 Aug 09 17:06:13.014699 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 352/711] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:06:12 2022] POST /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181/action => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:06:13.026795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-49fa3133-8cd9-4dd7-802e-35ca08c5d12b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:13.028833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-49fa3133-8cd9-4dd7-802e-35ca08c5d12b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:13.054100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49fa3133-8cd9-4dd7-802e-35ca08c5d12b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:13.058295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49fa3133-8cd9-4dd7-802e-35ca08c5d12b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:13.060816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49fa3133-8cd9-4dd7-802e-35ca08c5d12b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:13.063128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49fa3133-8cd9-4dd7-802e-35ca08c5d12b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:13.064548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49fa3133-8cd9-4dd7-802e-35ca08c5d12b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:13.065542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49fa3133-8cd9-4dd7-802e-35ca08c5d12b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:13.360537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-49fa3133-8cd9-4dd7-802e-35ca08c5d12b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:13.374019 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-49fa3133-8cd9-4dd7-802e-35ca08c5d12b tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1321 microversion: 2.1 time: 0.356836 Aug 09 17:06:13.375350 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 353/712] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:13 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:13.398660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-98070475-7b4f-4556-9de0-9fe346f57069 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:13.405417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-98070475-7b4f-4556-9de0-9fe346f57069 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:13.417289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98070475-7b4f-4556-9de0-9fe346f57069 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:13.419343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98070475-7b4f-4556-9de0-9fe346f57069 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:13.424616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98070475-7b4f-4556-9de0-9fe346f57069 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:13.425792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98070475-7b4f-4556-9de0-9fe346f57069 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:13.426480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98070475-7b4f-4556-9de0-9fe346f57069 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:13.427255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98070475-7b4f-4556-9de0-9fe346f57069 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:13.712837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-98070475-7b4f-4556-9de0-9fe346f57069 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:13.725048 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-98070475-7b4f-4556-9de0-9fe346f57069 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1469 microversion: 2.1 time: 0.333578 Aug 09 17:06:13.730801 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 354/713] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:13 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:13.736327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-add17e3a-4766-4ee7-ada3-814538f35cd1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:13.744616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-add17e3a-4766-4ee7-ada3-814538f35cd1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:13.759357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add17e3a-4766-4ee7-ada3-814538f35cd1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:13.764463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add17e3a-4766-4ee7-ada3-814538f35cd1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:13.765266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add17e3a-4766-4ee7-ada3-814538f35cd1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:13.766320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add17e3a-4766-4ee7-ada3-814538f35cd1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:13.767073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add17e3a-4766-4ee7-ada3-814538f35cd1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:13.769896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add17e3a-4766-4ee7-ada3-814538f35cd1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:14.248601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-add17e3a-4766-4ee7-ada3-814538f35cd1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:14.263069 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-add17e3a-4766-4ee7-ada3-814538f35cd1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1307 microversion: 2.1 time: 0.530770 Aug 09 17:06:14.270231 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 355/714] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:13 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1307 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:14.277128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1883a163-b4f2-4342-b682-a884b4899fd2 req-0b99432f-7fc9-4f8d-b049-b22bc06d76bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e83b0d7-61ec-490e-8994-0dcac0321e75", "tag": "7d7bf8b4-de32-41ee-a7b0-a3159d2f5165"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:14.308953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1883a163-b4f2-4342-b682-a884b4899fd2 req-0b99432f-7fc9-4f8d-b049-b22bc06d76bf service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:14.309740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1883a163-b4f2-4342-b682-a884b4899fd2 req-0b99432f-7fc9-4f8d-b049-b22bc06d76bf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:14.310503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1883a163-b4f2-4342-b682-a884b4899fd2 req-0b99432f-7fc9-4f8d-b049-b22bc06d76bf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:14.349126 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1883a163-b4f2-4342-b682-a884b4899fd2 req-0b99432f-7fc9-4f8d-b049-b22bc06d76bf service nova] Creating event network-changed:7d7bf8b4-de32-41ee-a7b0-a3159d2f5165 for instance 9e83b0d7-61ec-490e-8994-0dcac0321e75 on n-h1-845781-6 Aug 09 17:06:14.359506 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1883a163-b4f2-4342-b682-a884b4899fd2 req-0b99432f-7fc9-4f8d-b049-b22bc06d76bf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087322 Aug 09 17:06:14.362978 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 356/715] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:14.376379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c352d53-97a2-4730-bbc0-9571e8306035 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:14.377936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c352d53-97a2-4730-bbc0-9571e8306035 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:14.408888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c352d53-97a2-4730-bbc0-9571e8306035 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:14.409973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c352d53-97a2-4730-bbc0-9571e8306035 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:14.410592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c352d53-97a2-4730-bbc0-9571e8306035 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:14.412572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c352d53-97a2-4730-bbc0-9571e8306035 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:14.413319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c352d53-97a2-4730-bbc0-9571e8306035 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:14.413824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c352d53-97a2-4730-bbc0-9571e8306035 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:14.525601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c7a84f6b-30fb-40a4-bc09-4223d58d4851 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:14.541451 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c7a84f6b-30fb-40a4-bc09-4223d58d4851 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1504 microversion: 2.1 time: 1.886054 Aug 09 17:06:14.542431 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 360/716] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:12 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1504 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:14.553647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-6282ea13-0676-4951-9ecd-74f013dcb2ba req-8ffe3fca-98a6-4aeb-9624-b0acb33e18d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c0e36e-ac06-4af8-9f62-13a660022181", "name": "network-vif-plugged", "status": "completed", "tag": "5c0b51c4-b352-4c21-acec-09318bb172f4"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:14.580993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6282ea13-0676-4951-9ecd-74f013dcb2ba req-8ffe3fca-98a6-4aeb-9624-b0acb33e18d1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:14.581579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6282ea13-0676-4951-9ecd-74f013dcb2ba req-8ffe3fca-98a6-4aeb-9624-b0acb33e18d1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:14.582039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6282ea13-0676-4951-9ecd-74f013dcb2ba req-8ffe3fca-98a6-4aeb-9624-b0acb33e18d1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:14.650224 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-6282ea13-0676-4951-9ecd-74f013dcb2ba req-8ffe3fca-98a6-4aeb-9624-b0acb33e18d1 service nova] Creating event network-vif-plugged:5c0b51c4-b352-4c21-acec-09318bb172f4 for instance 45c0e36e-ac06-4af8-9f62-13a660022181 on n-h1-845781-6 Aug 09 17:06:14.693139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-6282ea13-0676-4951-9ecd-74f013dcb2ba req-8ffe3fca-98a6-4aeb-9624-b0acb33e18d1 service nova] Instance 45c0e36e-ac06-4af8-9f62-13a660022181 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:06:14.750781 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-6282ea13-0676-4951-9ecd-74f013dcb2ba req-8ffe3fca-98a6-4aeb-9624-b0acb33e18d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205704 Aug 09 17:06:14.751954 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 361/717] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:14.766169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-364c195e-6020-4df7-8a1d-12eda6a39344 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:14.767539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-364c195e-6020-4df7-8a1d-12eda6a39344 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:14.779897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c352d53-97a2-4730-bbc0-9571e8306035 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:14.785066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-364c195e-6020-4df7-8a1d-12eda6a39344 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:14.786142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-364c195e-6020-4df7-8a1d-12eda6a39344 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:14.787089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-364c195e-6020-4df7-8a1d-12eda6a39344 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:14.787935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-364c195e-6020-4df7-8a1d-12eda6a39344 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:14.788498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-364c195e-6020-4df7-8a1d-12eda6a39344 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:14.788945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-364c195e-6020-4df7-8a1d-12eda6a39344 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:14.795840 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c352d53-97a2-4730-bbc0-9571e8306035 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1464 microversion: 2.1 time: 0.430859 Aug 09 17:06:14.796451 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 357/718] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:14 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1464 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:14.802101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-870f17bc-e1aa-4daf-bc28-467413d5cc19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:14.804253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-870f17bc-e1aa-4daf-bc28-467413d5cc19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:14.817579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870f17bc-e1aa-4daf-bc28-467413d5cc19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:14.819327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870f17bc-e1aa-4daf-bc28-467413d5cc19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:14.819327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870f17bc-e1aa-4daf-bc28-467413d5cc19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:14.820122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870f17bc-e1aa-4daf-bc28-467413d5cc19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:14.820812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870f17bc-e1aa-4daf-bc28-467413d5cc19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:14.824396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870f17bc-e1aa-4daf-bc28-467413d5cc19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:15.465058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-870f17bc-e1aa-4daf-bc28-467413d5cc19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:15.490728 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-870f17bc-e1aa-4daf-bc28-467413d5cc19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1469 microversion: 2.1 time: 0.692142 Aug 09 17:06:15.494502 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 358/719] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:14 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1469 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:15.501605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-449c0c3b-e0a2-42ee-bfd8-48e587ce885f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:15.510469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-449c0c3b-e0a2-42ee-bfd8-48e587ce885f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:15.517303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449c0c3b-e0a2-42ee-bfd8-48e587ce885f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:15.517980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449c0c3b-e0a2-42ee-bfd8-48e587ce885f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:15.518534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449c0c3b-e0a2-42ee-bfd8-48e587ce885f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:15.519417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449c0c3b-e0a2-42ee-bfd8-48e587ce885f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:15.520042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449c0c3b-e0a2-42ee-bfd8-48e587ce885f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:15.520602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449c0c3b-e0a2-42ee-bfd8-48e587ce885f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:15.728315 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-449c0c3b-e0a2-42ee-bfd8-48e587ce885f tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action" status: 202 len: 0 microversion: 2.1 time: 0.229762 Aug 09 17:06:15.732430 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 359/720] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:06:15 2022] POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:06:15.735457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0ca8cb25-0e3c-4a48-99c0-e9e6e79aef39 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:15.736120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0ca8cb25-0e3c-4a48-99c0-e9e6e79aef39 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:15.752978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ca8cb25-0e3c-4a48-99c0-e9e6e79aef39 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:15.753503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ca8cb25-0e3c-4a48-99c0-e9e6e79aef39 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:15.753966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ca8cb25-0e3c-4a48-99c0-e9e6e79aef39 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:15.754739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ca8cb25-0e3c-4a48-99c0-e9e6e79aef39 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:15.760580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ca8cb25-0e3c-4a48-99c0-e9e6e79aef39 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:15.761099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ca8cb25-0e3c-4a48-99c0-e9e6e79aef39 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:15.986444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-364c195e-6020-4df7-8a1d-12eda6a39344 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:16.001738 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-364c195e-6020-4df7-8a1d-12eda6a39344 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1321 microversion: 2.1 time: 1.248323 Aug 09 17:06:16.002360 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 362/721] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:14 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1321 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:16.013094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5705d048-6404-4356-b106-480a13d2fdc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:16.013731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5705d048-6404-4356-b106-480a13d2fdc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:16.061361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5705d048-6404-4356-b106-480a13d2fdc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:16.062429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5705d048-6404-4356-b106-480a13d2fdc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:16.065996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5705d048-6404-4356-b106-480a13d2fdc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:16.069388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5705d048-6404-4356-b106-480a13d2fdc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:16.072410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5705d048-6404-4356-b106-480a13d2fdc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:16.077589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5705d048-6404-4356-b106-480a13d2fdc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:16.644942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0ca8cb25-0e3c-4a48-99c0-e9e6e79aef39 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:16.689482 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0ca8cb25-0e3c-4a48-99c0-e9e6e79aef39 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1307 microversion: 2.1 time: 0.934132 Aug 09 17:06:16.712973 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 360/722] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:15 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1307 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:16.728419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:16.729350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:16.738758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:16.740074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:16.744168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:16.745207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:16.745879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:16.746659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:16.830451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:16.831752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:16.832599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:16.833594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lazy-loading 'fault' on Instance uuid cce37568-9dbf-4f84-875d-0bfda5961abc {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:06:17.075813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5705d048-6404-4356-b106-480a13d2fdc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:17.091878 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5705d048-6404-4356-b106-480a13d2fdc4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1504 microversion: 2.1 time: 1.088344 Aug 09 17:06:17.103242 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 363/723] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:16 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1504 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:17.116273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5ea658d2-8036-452a-a405-4c66b2d44ac3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:17.120348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5ea658d2-8036-452a-a405-4c66b2d44ac3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:17.137516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ea658d2-8036-452a-a405-4c66b2d44ac3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:17.138444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ea658d2-8036-452a-a405-4c66b2d44ac3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:17.140169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ea658d2-8036-452a-a405-4c66b2d44ac3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:17.141331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ea658d2-8036-452a-a405-4c66b2d44ac3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:17.142079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ea658d2-8036-452a-a405-4c66b2d44ac3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:17.142724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ea658d2-8036-452a-a405-4c66b2d44ac3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:17.343361 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd1511e8-56dc-4bba-ab82-23e57bd32141 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1598 microversion: 2.1 time: 0.627373 Aug 09 17:06:17.360953 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 361/724] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:16 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1598 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:17.385481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-09e9d6b0-140a-43dc-8293-9ab8f498ad3f req-da845215-6cf7-430f-87ea-c7c575c4e617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9114d8ad-2746-443d-8799-c09c421ac55d", "name": "network-vif-plugged", "status": "completed", "tag": "72374f34-ae5a-40c5-8e9c-d64a473cbbfb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:17.418302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-09e9d6b0-140a-43dc-8293-9ab8f498ad3f req-da845215-6cf7-430f-87ea-c7c575c4e617 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:17.419146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-09e9d6b0-140a-43dc-8293-9ab8f498ad3f req-da845215-6cf7-430f-87ea-c7c575c4e617 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:17.420022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-09e9d6b0-140a-43dc-8293-9ab8f498ad3f req-da845215-6cf7-430f-87ea-c7c575c4e617 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:17.443266 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-09e9d6b0-140a-43dc-8293-9ab8f498ad3f req-da845215-6cf7-430f-87ea-c7c575c4e617 service nova] Creating event network-vif-plugged:72374f34-ae5a-40c5-8e9c-d64a473cbbfb for instance 9114d8ad-2746-443d-8799-c09c421ac55d on n-h1-845781-6 Aug 09 17:06:17.454419 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-09e9d6b0-140a-43dc-8293-9ab8f498ad3f req-da845215-6cf7-430f-87ea-c7c575c4e617 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089175 Aug 09 17:06:17.454939 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 362/725] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:17.467765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b77dc090-fa2e-4592-9e2d-6fc636625516 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:17.469442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b77dc090-fa2e-4592-9e2d-6fc636625516 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:17.483694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77dc090-fa2e-4592-9e2d-6fc636625516 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:17.484988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77dc090-fa2e-4592-9e2d-6fc636625516 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:17.486367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77dc090-fa2e-4592-9e2d-6fc636625516 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:17.488385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77dc090-fa2e-4592-9e2d-6fc636625516 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:17.489809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77dc090-fa2e-4592-9e2d-6fc636625516 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:17.491042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77dc090-fa2e-4592-9e2d-6fc636625516 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:17.853644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5ea658d2-8036-452a-a405-4c66b2d44ac3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:17.876694 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5ea658d2-8036-452a-a405-4c66b2d44ac3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1469 microversion: 2.1 time: 0.769859 Aug 09 17:06:17.880558 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 364/726] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:17 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1469 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:17.902633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9dfa7d96-9e7d-48c0-b39f-7fd9e5884bb9 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:17.915863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9dfa7d96-9e7d-48c0-b39f-7fd9e5884bb9 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:17.932950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dfa7d96-9e7d-48c0-b39f-7fd9e5884bb9 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:17.936740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dfa7d96-9e7d-48c0-b39f-7fd9e5884bb9 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:17.937635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dfa7d96-9e7d-48c0-b39f-7fd9e5884bb9 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:17.940603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dfa7d96-9e7d-48c0-b39f-7fd9e5884bb9 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:17.941945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dfa7d96-9e7d-48c0-b39f-7fd9e5884bb9 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:17.942753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dfa7d96-9e7d-48c0-b39f-7fd9e5884bb9 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:17.983015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b77dc090-fa2e-4592-9e2d-6fc636625516 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:18.046154 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b77dc090-fa2e-4592-9e2d-6fc636625516 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1321 microversion: 2.1 time: 0.586839 Aug 09 17:06:18.065782 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 363/727] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:17 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1321 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:18.122227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66c1647f-875a-41a8-b129-b0e89d3249d0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:18.134737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-66c1647f-875a-41a8-b129-b0e89d3249d0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:18.161935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c1647f-875a-41a8-b129-b0e89d3249d0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:18.166204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c1647f-875a-41a8-b129-b0e89d3249d0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:18.170088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c1647f-875a-41a8-b129-b0e89d3249d0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:18.173850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c1647f-875a-41a8-b129-b0e89d3249d0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:18.189926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c1647f-875a-41a8-b129-b0e89d3249d0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:18.203238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c1647f-875a-41a8-b129-b0e89d3249d0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:18.223681 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9dfa7d96-9e7d-48c0-b39f-7fd9e5884bb9 tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action" status: 202 len: 0 microversion: 2.1 time: 0.337394 Aug 09 17:06:18.223681 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 365/728] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:06:17 2022] POST /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:06:18.232743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f9d2ef92-ac08-4338-b813-e0e4a3227789 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:18.233371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f9d2ef92-ac08-4338-b813-e0e4a3227789 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:18.246406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9d2ef92-ac08-4338-b813-e0e4a3227789 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:18.255662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9d2ef92-ac08-4338-b813-e0e4a3227789 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:18.256113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9d2ef92-ac08-4338-b813-e0e4a3227789 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:18.256950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9d2ef92-ac08-4338-b813-e0e4a3227789 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:18.257414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9d2ef92-ac08-4338-b813-e0e4a3227789 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:18.258041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9d2ef92-ac08-4338-b813-e0e4a3227789 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:18.670723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-66c1647f-875a-41a8-b129-b0e89d3249d0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:18.685598 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66c1647f-875a-41a8-b129-b0e89d3249d0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1307 microversion: 2.1 time: 0.616695 Aug 09 17:06:18.686213 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 364/729] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:18 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1307 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:18.709168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bee5239d-e192-45f5-84bc-ab8474b315dc tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:18.710149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bee5239d-e192-45f5-84bc-ab8474b315dc tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:18.717719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bee5239d-e192-45f5-84bc-ab8474b315dc tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:18.719964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bee5239d-e192-45f5-84bc-ab8474b315dc tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:18.720892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bee5239d-e192-45f5-84bc-ab8474b315dc tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:18.722103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bee5239d-e192-45f5-84bc-ab8474b315dc tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:18.722960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bee5239d-e192-45f5-84bc-ab8474b315dc tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:18.723880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bee5239d-e192-45f5-84bc-ab8474b315dc tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:19.348505 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bee5239d-e192-45f5-84bc-ab8474b315dc tempest-ServersAdminTestJSON-1698646419 tempest-ServersAdminTestJSON-1698646419-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1615 microversion: 2.1 time: 0.650040 Aug 09 17:06:19.354551 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 365/730] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:18 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1615 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:19.372308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be7e4d17-7a82-4583-b0d4-3f52848540bc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:19.375594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-be7e4d17-7a82-4583-b0d4-3f52848540bc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:19.406216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be7e4d17-7a82-4583-b0d4-3f52848540bc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:19.410169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be7e4d17-7a82-4583-b0d4-3f52848540bc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:19.412137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be7e4d17-7a82-4583-b0d4-3f52848540bc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:19.414001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be7e4d17-7a82-4583-b0d4-3f52848540bc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:19.421019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be7e4d17-7a82-4583-b0d4-3f52848540bc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:19.422183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be7e4d17-7a82-4583-b0d4-3f52848540bc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:19.709375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f9d2ef92-ac08-4338-b813-e0e4a3227789 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:19.753083 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f9d2ef92-ac08-4338-b813-e0e4a3227789 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1504 microversion: 2.1 time: 1.530763 Aug 09 17:06:19.767949 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 366/731] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:18 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1504 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:19.781098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c968d0e1-e1e2-4fe2-9b31-ea0a4a0a28d5 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:19.782437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c968d0e1-e1e2-4fe2-9b31-ea0a4a0a28d5 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:19.784517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be7e4d17-7a82-4583-b0d4-3f52848540bc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:19.804387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c968d0e1-e1e2-4fe2-9b31-ea0a4a0a28d5 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:19.805796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c968d0e1-e1e2-4fe2-9b31-ea0a4a0a28d5 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:19.806639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c968d0e1-e1e2-4fe2-9b31-ea0a4a0a28d5 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:19.808004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c968d0e1-e1e2-4fe2-9b31-ea0a4a0a28d5 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:19.808872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c968d0e1-e1e2-4fe2-9b31-ea0a4a0a28d5 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:19.817170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c968d0e1-e1e2-4fe2-9b31-ea0a4a0a28d5 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:19.821337 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-be7e4d17-7a82-4583-b0d4-3f52848540bc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1469 microversion: 2.1 time: 0.463884 Aug 09 17:06:19.835717 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 366/732] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:19 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1469 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:19.854877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-927884ea-efbc-4869-bbd3-3f4a5b16f55d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:19.856310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-927884ea-efbc-4869-bbd3-3f4a5b16f55d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:19.880362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-927884ea-efbc-4869-bbd3-3f4a5b16f55d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:19.882869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-927884ea-efbc-4869-bbd3-3f4a5b16f55d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:19.885943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-927884ea-efbc-4869-bbd3-3f4a5b16f55d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:19.886474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:19.890204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-927884ea-efbc-4869-bbd3-3f4a5b16f55d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:19.893772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-927884ea-efbc-4869-bbd3-3f4a5b16f55d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:19.895271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-927884ea-efbc-4869-bbd3-3f4a5b16f55d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:20.045656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-927884ea-efbc-4869-bbd3-3f4a5b16f55d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:06:20.052361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:20.369555 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-927884ea-efbc-4869-bbd3-3f4a5b16f55d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "DELETE /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 204 len: 0 microversion: 2.1 time: 0.527563 Aug 09 17:06:20.372676 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 367/733] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:06:19 2022] DELETE /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:06:20.393595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1f79865e-7e51-4642-86bc-ceecea99065a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:20.393595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1f79865e-7e51-4642-86bc-ceecea99065a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:20.412710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f79865e-7e51-4642-86bc-ceecea99065a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:20.413216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f79865e-7e51-4642-86bc-ceecea99065a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:20.413661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f79865e-7e51-4642-86bc-ceecea99065a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:20.414487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f79865e-7e51-4642-86bc-ceecea99065a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:20.415448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f79865e-7e51-4642-86bc-ceecea99065a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:20.424161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f79865e-7e51-4642-86bc-ceecea99065a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:20.581413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c968d0e1-e1e2-4fe2-9b31-ea0a4a0a28d5 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:20.593898 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c968d0e1-e1e2-4fe2-9b31-ea0a4a0a28d5 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1321 microversion: 2.1 time: 0.830409 Aug 09 17:06:20.594498 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 367/734] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:19 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1321 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:20.600154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7e8bd4ff-9b6f-479e-9229-38af2d8a468b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:20.600787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7e8bd4ff-9b6f-479e-9229-38af2d8a468b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:20.621405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e8bd4ff-9b6f-479e-9229-38af2d8a468b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:20.621919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e8bd4ff-9b6f-479e-9229-38af2d8a468b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:20.622384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e8bd4ff-9b6f-479e-9229-38af2d8a468b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:20.623154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e8bd4ff-9b6f-479e-9229-38af2d8a468b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:20.623671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e8bd4ff-9b6f-479e-9229-38af2d8a468b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:20.624100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e8bd4ff-9b6f-479e-9229-38af2d8a468b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:20.676309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1f79865e-7e51-4642-86bc-ceecea99065a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:20.691827 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1f79865e-7e51-4642-86bc-ceecea99065a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1307 microversion: 2.1 time: 0.317085 Aug 09 17:06:20.704945 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 368/735] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:20 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:20.891045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-859682581", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "58c9a4df-a052-4259-baba-4eb50282dd0b"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:20.984909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] validate_networks() for [('58c9a4df-a052-4259-baba-4eb50282dd0b', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:06:21.178500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7e8bd4ff-9b6f-479e-9229-38af2d8a468b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:21.189123 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7e8bd4ff-9b6f-479e-9229-38af2d8a468b tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1468 microversion: 2.1 time: 0.593230 Aug 09 17:06:21.205910 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 368/736] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:20 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1468 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:21.212151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa522ed8-435a-4142-b460-ace4df439ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:21.213365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fa522ed8-435a-4142-b460-ace4df439ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:21.222201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa522ed8-435a-4142-b460-ace4df439ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:21.223016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa522ed8-435a-4142-b460-ace4df439ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:21.223689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa522ed8-435a-4142-b460-ace4df439ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:21.224809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa522ed8-435a-4142-b460-ace4df439ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:21.226594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa522ed8-435a-4142-b460-ace4df439ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:21.227443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa522ed8-435a-4142-b460-ace4df439ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:21.788708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:06:21.790509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:06:21.791359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:06:21.792119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:06:21.793250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:06:21.835118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:21.835807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:21.836809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:21.840403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:21.841407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:21.842651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:21.882338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Getting quotas for project 47793440cab647cc943281e2bc566c7f. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:06:21.893261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Getting quotas for user 27626b9d13c340cc9ec2fe564d1bab8d and project 47793440cab647cc943281e2bc566c7f. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:06:21.934753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:06:21.940755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:06:21.960270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:21.984232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fa522ed8-435a-4142-b460-ace4df439ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:22.002137 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fa522ed8-435a-4142-b460-ace4df439ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1494 microversion: 2.1 time: 0.794261 Aug 09 17:06:22.015910 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 369/737] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:21 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1494 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:22.031114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b8309f92-7a4e-4fcd-a88e-6135f9545cf3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:22.033353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b8309f92-7a4e-4fcd-a88e-6135f9545cf3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:22.069006 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-420152c8-c1b1-4e3c-9c5a-e9bcdb9553b6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.361278 Aug 09 17:06:22.069006 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 369/738] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:06:22.074520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8309f92-7a4e-4fcd-a88e-6135f9545cf3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:22.076424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8309f92-7a4e-4fcd-a88e-6135f9545cf3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:22.077679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8309f92-7a4e-4fcd-a88e-6135f9545cf3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:22.079437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8309f92-7a4e-4fcd-a88e-6135f9545cf3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:22.081345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8309f92-7a4e-4fcd-a88e-6135f9545cf3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:22.082473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8309f92-7a4e-4fcd-a88e-6135f9545cf3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:22.115675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3104b199-d690-4f11-a342-d8a0d78b4b71 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:22.115675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3104b199-d690-4f11-a342-d8a0d78b4b71 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:22.171419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3104b199-d690-4f11-a342-d8a0d78b4b71 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:22.180727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3104b199-d690-4f11-a342-d8a0d78b4b71 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:22.181005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3104b199-d690-4f11-a342-d8a0d78b4b71 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:22.184689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3104b199-d690-4f11-a342-d8a0d78b4b71 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:22.185311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3104b199-d690-4f11-a342-d8a0d78b4b71 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:22.185773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3104b199-d690-4f11-a342-d8a0d78b4b71 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:22.556451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3104b199-d690-4f11-a342-d8a0d78b4b71 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:22.569693 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3104b199-d690-4f11-a342-d8a0d78b4b71 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1321 microversion: 2.1 time: 0.488575 Aug 09 17:06:22.575902 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 370/739] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:22 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:22.587157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-01720e90-f63c-4616-83c0-16e56944beb5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:22.588230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-01720e90-f63c-4616-83c0-16e56944beb5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:22.595552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01720e90-f63c-4616-83c0-16e56944beb5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:22.596421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01720e90-f63c-4616-83c0-16e56944beb5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:22.607726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01720e90-f63c-4616-83c0-16e56944beb5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:22.608806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01720e90-f63c-4616-83c0-16e56944beb5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:22.610845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01720e90-f63c-4616-83c0-16e56944beb5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:22.611795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01720e90-f63c-4616-83c0-16e56944beb5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:22.973123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b8309f92-7a4e-4fcd-a88e-6135f9545cf3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:22.984302 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b8309f92-7a4e-4fcd-a88e-6135f9545cf3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1461 microversion: 2.1 time: 0.966497 Aug 09 17:06:22.987199 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 370/740] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:22 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1461 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:23.000541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ebdf115e-1349-4bfe-a952-8bb9b54b5398 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '.version_select at 0x7fbbcbad8d30>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:23.011813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebdf115e-1349-4bfe-a952-8bb9b54b5398 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:23.012312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebdf115e-1349-4bfe-a952-8bb9b54b5398 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:23.012759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebdf115e-1349-4bfe-a952-8bb9b54b5398 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:23.047101 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ebdf115e-1349-4bfe-a952-8bb9b54b5398 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 1187 microversion: 2.1 time: 0.058648 Aug 09 17:06:23.060462 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 371/741] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:06:22 2022] GET /compute/v2.1/os-migrations => generated 1187 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:23.069748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69f0a6e6-e8f2-4920-8a09-773da7d51b88 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:23.075906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-69f0a6e6-e8f2-4920-8a09-773da7d51b88 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:23.121205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-01720e90-f63c-4616-83c0-16e56944beb5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:23.131105 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-01720e90-f63c-4616-83c0-16e56944beb5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1487 microversion: 2.1 time: 0.553793 Aug 09 17:06:23.138431 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 371/742] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:22 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1487 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:23.150703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2e61e753-a6aa-4baa-bedf-e9a31ce7c847 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:23.152449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2e61e753-a6aa-4baa-bedf-e9a31ce7c847 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:23.167920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e61e753-a6aa-4baa-bedf-e9a31ce7c847 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:23.170715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e61e753-a6aa-4baa-bedf-e9a31ce7c847 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:23.172943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e61e753-a6aa-4baa-bedf-e9a31ce7c847 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:23.174587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e61e753-a6aa-4baa-bedf-e9a31ce7c847 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:23.178734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e61e753-a6aa-4baa-bedf-e9a31ce7c847 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:23.180911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e61e753-a6aa-4baa-bedf-e9a31ce7c847 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:23.287420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69f0a6e6-e8f2-4920-8a09-773da7d51b88 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:23.301994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69f0a6e6-e8f2-4920-8a09-773da7d51b88 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:23.319251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69f0a6e6-e8f2-4920-8a09-773da7d51b88 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:23.320968 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69f0a6e6-e8f2-4920-8a09-773da7d51b88 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1261 microversion: 2.25 time: 0.258847 Aug 09 17:06:23.338177 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 372/743] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:23 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1261 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:06:23.347201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2b112a31-f671-47b4-aa54-d6a9a80c8ace tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:23.348492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2b112a31-f671-47b4-aa54-d6a9a80c8ace tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:23.364901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b112a31-f671-47b4-aa54-d6a9a80c8ace tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:23.365795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b112a31-f671-47b4-aa54-d6a9a80c8ace tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:23.367382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b112a31-f671-47b4-aa54-d6a9a80c8ace tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:23.368518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b112a31-f671-47b4-aa54-d6a9a80c8ace tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:23.370430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b112a31-f671-47b4-aa54-d6a9a80c8ace tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:23.371151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b112a31-f671-47b4-aa54-d6a9a80c8ace tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:23.455226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2e61e753-a6aa-4baa-bedf-e9a31ce7c847 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:23.465389 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2e61e753-a6aa-4baa-bedf-e9a31ce7c847 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 200 len: 1426 microversion: 2.1 time: 0.325367 Aug 09 17:06:23.475868 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 372/744] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:23 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 1426 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:23.481117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9ca4c6b0-8555-4d34-8859-040668619d9e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:23.486283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9ca4c6b0-8555-4d34-8859-040668619d9e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:23.505792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ca4c6b0-8555-4d34-8859-040668619d9e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:23.509831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ca4c6b0-8555-4d34-8859-040668619d9e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:23.510650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ca4c6b0-8555-4d34-8859-040668619d9e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:23.511749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ca4c6b0-8555-4d34-8859-040668619d9e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:23.512534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ca4c6b0-8555-4d34-8859-040668619d9e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:23.513235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ca4c6b0-8555-4d34-8859-040668619d9e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:24.502094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b112a31-f671-47b4-aa54-d6a9a80c8ace tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:24.521905 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2b112a31-f671-47b4-aa54-d6a9a80c8ace tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1461 microversion: 2.1 time: 1.179788 Aug 09 17:06:24.524440 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 373/745] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:23 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1461 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:24.534343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bffd4ab4-e796-49da-aed3-30cfd8053b97 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:24.536299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bffd4ab4-e796-49da-aed3-30cfd8053b97 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:24.550544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bffd4ab4-e796-49da-aed3-30cfd8053b97 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:24.551952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bffd4ab4-e796-49da-aed3-30cfd8053b97 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:24.553309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bffd4ab4-e796-49da-aed3-30cfd8053b97 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:24.554888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bffd4ab4-e796-49da-aed3-30cfd8053b97 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:24.556441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bffd4ab4-e796-49da-aed3-30cfd8053b97 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:24.557972 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9ca4c6b0-8555-4d34-8859-040668619d9e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1645 microversion: 2.1 time: 1.077735 Aug 09 17:06:24.558770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bffd4ab4-e796-49da-aed3-30cfd8053b97 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:24.563216 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 373/746] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:23 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1645 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:24.590685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fdb661d1-f3c0-4670-a8a1-0e1eb0c4fa56 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:24.597006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fdb661d1-f3c0-4670-a8a1-0e1eb0c4fa56 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:24.619820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdb661d1-f3c0-4670-a8a1-0e1eb0c4fa56 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:24.620808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdb661d1-f3c0-4670-a8a1-0e1eb0c4fa56 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:24.621899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdb661d1-f3c0-4670-a8a1-0e1eb0c4fa56 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:24.623597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdb661d1-f3c0-4670-a8a1-0e1eb0c4fa56 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:24.624739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdb661d1-f3c0-4670-a8a1-0e1eb0c4fa56 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:24.625739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdb661d1-f3c0-4670-a8a1-0e1eb0c4fa56 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:24.924858 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bffd4ab4-e796-49da-aed3-30cfd8053b97 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "POST /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d/action" status: 202 len: 0 microversion: 2.1 time: 0.397087 Aug 09 17:06:24.926249 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 374/747] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:06:24 2022] POST /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:06:24.951620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-0ffae09b-4a46-498d-8906-ebbad9c75bda req-6a8f3fe6-9a0c-46e1-8ec6-d4eba62942ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85044e48-08e5-4d4f-a2c2-f396b3b51bad", "name": "network-vif-deleted", "tag": "5aeb30eb-e018-4a15-ac48-f3c1ab29281b"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:24.971613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0ffae09b-4a46-498d-8906-ebbad9c75bda req-6a8f3fe6-9a0c-46e1-8ec6-d4eba62942ce service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:24.972503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0ffae09b-4a46-498d-8906-ebbad9c75bda req-6a8f3fe6-9a0c-46e1-8ec6-d4eba62942ce service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:24.972886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0ffae09b-4a46-498d-8906-ebbad9c75bda req-6a8f3fe6-9a0c-46e1-8ec6-d4eba62942ce service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:24.995875 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-0ffae09b-4a46-498d-8906-ebbad9c75bda req-6a8f3fe6-9a0c-46e1-8ec6-d4eba62942ce service nova] Creating event network-vif-deleted:5aeb30eb-e018-4a15-ac48-f3c1ab29281b for instance 85044e48-08e5-4d4f-a2c2-f396b3b51bad on n-h2-845781-6 Aug 09 17:06:25.007207 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-0ffae09b-4a46-498d-8906-ebbad9c75bda req-6a8f3fe6-9a0c-46e1-8ec6-d4eba62942ce service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076340 Aug 09 17:06:25.008467 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 375/748] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:25.017111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:25.017987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:25.030360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:25.030360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:25.030360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:25.030360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:25.030836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:25.031203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:25.228955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fdb661d1-f3c0-4670-a8a1-0e1eb0c4fa56 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:25.260896 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fdb661d1-f3c0-4670-a8a1-0e1eb0c4fa56 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1321 microversion: 2.1 time: 0.695144 Aug 09 17:06:25.263696 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 374/749] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:24 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1321 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:25.281892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:25.283660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: 85044e48-08e5-4d4f-a2c2-f396b3b51bad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:25.302272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:25.312548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:25.323781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:25.326474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:25.329989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:25.331225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:25.334179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:25.337070 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3c224d99-28d2-42f5-a8bf-9aebf4be597d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1321 microversion: 2.25 time: 0.326625 Aug 09 17:06:25.338009 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 376/750] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:25 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:06:25.340058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:25.340651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:25.342942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3bba5f3a-c54e-4945-8200-9ae2ddec98b7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Action: 'create', calling method: .version_select at 0x7fbbcbc32ca0>, body: {"keypair": {"name": "tempest-keypair-245692646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDKH+5RatoVdDJgYMqKCoQ86kxfKJGchrsOS0xPjvAKjBlkvewGWPlE3Rf7MV7nXe8JJ8ZrAufDGrKiSlP6sxGirXCLzdWMvz9BI+Fyh433o0zaoL5hQd/T4JDfvCP/pg=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:25.377408 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] HTTP exception thrown: Instance 85044e48-08e5-4d4f-a2c2-f396b3b51bad could not be found. Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Request method failure captured: Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad HTTP/1.1 Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pOCBJgwk0HHGjJYU9FI7e-33aZWk2OxJQhtKyJY2cVX67U0E4DlT39U4rUSB08YbP7p0dVoX7nn1RDhpM_4zz5xjkBhZLmu-siyOFFE95leWnF5oLGbHVk_TX2SmjanSKRTSeSB2dY4z-qK-x4X_eudWwMFcSQiSjBVDOhWBUIk2Yo Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a6aa3d7035ce484f9ea8bb3fdf7ac9a6 Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersAdminTestJSON-731821145 Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:06:25.379262 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersAdminTestJSON-731821145 Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a6aa3d7035ce484f9ea8bb3fdf7ac9a6 Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersAdminTestJSON-731821145 Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersAdminTestJSON-731821145-project Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e225d63b357c47998d854f8fa5b4be08 Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersAdminTestJSON-731821145-project Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 85044e48-08e5-4d4f-a2c2-f396b3b51bad could not be found. Aug 09 17:06:25.381580 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '85044e48-08e5-4d4f-a2c2-f396b3b51bad'} Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85044e48-08e5-4d4f-a2c2-f396b3b51bad could not be found. Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:25.382368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85044e48-08e5-4d4f-a2c2-f396b3b51bad could not be found. Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85044e48-08e5-4d4f-a2c2-f396b3b51bad could not be found. Aug 09 17:06:25.385185 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:25.388288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Returning 404 to user: Instance 85044e48-08e5-4d4f-a2c2-f396b3b51bad could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:25.388288 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-710dbd23-e9ff-4d13-9116-52e7bf1804a1 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad" status: 404 len: 111 microversion: 2.1 time: 0.114839 Aug 09 17:06:25.388288 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 375/751] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:25 2022] GET /compute/v2.1/servers/85044e48-08e5-4d4f-a2c2-f396b3b51bad => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:06:25.392789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1013071832", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "b176697e-92f5-4744-9b98-692686c31e55"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:25.394651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-3bba5f3a-c54e-4945-8200-9ae2ddec98b7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for project 7004f453a4d944239c4641bbc394ebb5. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:06:25.415579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-3bba5f3a-c54e-4945-8200-9ae2ddec98b7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for user 434e395144bc4443abb655a9d0a8b329 and project 7004f453a4d944239c4641bbc394ebb5. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:06:25.467424 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3bba5f3a-c54e-4945-8200-9ae2ddec98b7 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128183 Aug 09 17:06:25.468946 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 377/752] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:06:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:25.476209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cfa5dd0e-0ee4-443c-a349-3f147b5338df tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:25.477683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cfa5dd0e-0ee4-443c-a349-3f147b5338df tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:25.487920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfa5dd0e-0ee4-443c-a349-3f147b5338df tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:25.488839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfa5dd0e-0ee4-443c-a349-3f147b5338df tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:25.489565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfa5dd0e-0ee4-443c-a349-3f147b5338df tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:25.490798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfa5dd0e-0ee4-443c-a349-3f147b5338df tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:25.493475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfa5dd0e-0ee4-443c-a349-3f147b5338df tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:25.494996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfa5dd0e-0ee4-443c-a349-3f147b5338df tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:25.532956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] validate_networks() for [('b176697e-92f5-4744-9b98-692686c31e55', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:06:26.042850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cfa5dd0e-0ee4-443c-a349-3f147b5338df tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:26.062693 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cfa5dd0e-0ee4-443c-a349-3f147b5338df tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 200 len: 1472 microversion: 2.1 time: 0.591753 Aug 09 17:06:26.064913 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 378/753] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:25 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 1472 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:26.077666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-73cb08d8-662f-4a3c-97e7-7f42cf2140f3 req-723f60f0-067f-4d32-a4a4-20c1f3b0cf52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e83b0d7-61ec-490e-8994-0dcac0321e75", "name": "network-vif-plugged", "status": "completed", "tag": "7d7bf8b4-de32-41ee-a7b0-a3159d2f5165"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:26.105655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-73cb08d8-662f-4a3c-97e7-7f42cf2140f3 req-723f60f0-067f-4d32-a4a4-20c1f3b0cf52 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:26.106186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-73cb08d8-662f-4a3c-97e7-7f42cf2140f3 req-723f60f0-067f-4d32-a4a4-20c1f3b0cf52 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:26.106632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-73cb08d8-662f-4a3c-97e7-7f42cf2140f3 req-723f60f0-067f-4d32-a4a4-20c1f3b0cf52 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:26.131904 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-73cb08d8-662f-4a3c-97e7-7f42cf2140f3 req-723f60f0-067f-4d32-a4a4-20c1f3b0cf52 service nova] Creating event network-vif-plugged:7d7bf8b4-de32-41ee-a7b0-a3159d2f5165 for instance 9e83b0d7-61ec-490e-8994-0dcac0321e75 on n-h1-845781-6 Aug 09 17:06:26.161621 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-73cb08d8-662f-4a3c-97e7-7f42cf2140f3 req-723f60f0-067f-4d32-a4a4-20c1f3b0cf52 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094880 Aug 09 17:06:26.162257 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 379/754] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:26.182876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-09d0120b-48e1-4518-a6ab-acc2e9b9c3df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:26.183670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-09d0120b-48e1-4518-a6ab-acc2e9b9c3df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:26.217271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09d0120b-48e1-4518-a6ab-acc2e9b9c3df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:26.219680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09d0120b-48e1-4518-a6ab-acc2e9b9c3df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:26.231154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09d0120b-48e1-4518-a6ab-acc2e9b9c3df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:26.234638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09d0120b-48e1-4518-a6ab-acc2e9b9c3df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:26.251675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09d0120b-48e1-4518-a6ab-acc2e9b9c3df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:26.251675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09d0120b-48e1-4518-a6ab-acc2e9b9c3df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:26.346399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:06:26.348075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:06:26.350185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:06:26.351343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:06:26.354614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:06:26.380601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:26.382138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:26.387567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-09d0120b-48e1-4518-a6ab-acc2e9b9c3df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:06:26.392223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:26.396630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:26.398250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:26.399587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:26.448049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Getting quotas for project 44129d75c58240fa867e90b1d3252554. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:06:26.480729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Getting quotas for user 894725e0d56b4960a8bc3e6a8e283b4e and project 44129d75c58240fa867e90b1d3252554. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:06:26.527710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:06:26.533574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:06:26.588062 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-09d0120b-48e1-4518-a6ab-acc2e9b9c3df tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 204 len: 0 microversion: 2.1 time: 0.418673 Aug 09 17:06:26.592761 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 380/755] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:06:26 2022] DELETE /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:06:26.599452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-61a9c0fa-e866-475b-b8fd-eca1b70180f2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-494459471"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:26.604582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-61a9c0fa-e866-475b-b8fd-eca1b70180f2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:26.613702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61a9c0fa-e866-475b-b8fd-eca1b70180f2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:26.614573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61a9c0fa-e866-475b-b8fd-eca1b70180f2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:26.615322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61a9c0fa-e866-475b-b8fd-eca1b70180f2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:26.616154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61a9c0fa-e866-475b-b8fd-eca1b70180f2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:26.616824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61a9c0fa-e866-475b-b8fd-eca1b70180f2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:26.618045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61a9c0fa-e866-475b-b8fd-eca1b70180f2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:26.701297 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0ce6573b-758b-4bc4-a8ff-4c7079340400 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311316 Aug 09 17:06:26.704667 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 376/756] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:06:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:06:26.740526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fe2794b9-5bbb-4787-9462-1ca1756041a0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:26.745034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fe2794b9-5bbb-4787-9462-1ca1756041a0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:26.804200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe2794b9-5bbb-4787-9462-1ca1756041a0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:26.806120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe2794b9-5bbb-4787-9462-1ca1756041a0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:26.807172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe2794b9-5bbb-4787-9462-1ca1756041a0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:26.808937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe2794b9-5bbb-4787-9462-1ca1756041a0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:26.814481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe2794b9-5bbb-4787-9462-1ca1756041a0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:26.816368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe2794b9-5bbb-4787-9462-1ca1756041a0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:27.208453 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-61a9c0fa-e866-475b-b8fd-eca1b70180f2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "POST /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d/action" status: 202 len: 0 microversion: 2.1 time: 0.618311 Aug 09 17:06:27.209109 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 381/757] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:06:26 2022] POST /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 17:06:27.223987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:27.224711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:27.244409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:27.244917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:27.245370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:27.246107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:27.246578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:27.247014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:27.325168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fe2794b9-5bbb-4787-9462-1ca1756041a0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:27.337436 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fe2794b9-5bbb-4787-9462-1ca1756041a0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1321 microversion: 2.1 time: 0.626645 Aug 09 17:06:27.354675 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 377/758] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:26 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1321 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:27.367963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ad0ba1eb-f890-4f69-8d69-aaea37189981 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:27.370197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ad0ba1eb-f890-4f69-8d69-aaea37189981 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:27.397300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad0ba1eb-f890-4f69-8d69-aaea37189981 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:27.397809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad0ba1eb-f890-4f69-8d69-aaea37189981 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:27.398251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad0ba1eb-f890-4f69-8d69-aaea37189981 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:27.399439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad0ba1eb-f890-4f69-8d69-aaea37189981 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:27.400302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad0ba1eb-f890-4f69-8d69-aaea37189981 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:27.401090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad0ba1eb-f890-4f69-8d69-aaea37189981 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:27.650728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:27.675083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:27.677192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:27.678687 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-352d4b47-c0a3-4eff-9ae5-da40f30785c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1361 microversion: 2.25 time: 0.468428 Aug 09 17:06:27.699684 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 382/759] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:27 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1361 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:06:27.699684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-74b0564e-4cef-4c7a-9ee9-b7f5b13eb7b1 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:27.699684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-74b0564e-4cef-4c7a-9ee9-b7f5b13eb7b1 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:27.963001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ad0ba1eb-f890-4f69-8d69-aaea37189981 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:27.978775 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ad0ba1eb-f890-4f69-8d69-aaea37189981 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1469 microversion: 2.1 time: 0.621926 Aug 09 17:06:27.981153 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 378/760] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:27 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1469 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:27.989637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2e1943e0-9a5f-4ed5-8ab1-d65e3aa65a08 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbf045e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:27.994068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-74b0564e-4cef-4c7a-9ee9-b7f5b13eb7b1 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:28.007026 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-74b0564e-4cef-4c7a-9ee9-b7f5b13eb7b1 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1211 microversion: 2.1 time: 0.317092 Aug 09 17:06:28.008107 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 383/761] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:27 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1211 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:28.165627 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2e1943e0-9a5f-4ed5-8ab1-d65e3aa65a08 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.177390 Aug 09 17:06:28.177324 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 379/762] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:27 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:28.359258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6f1ade04-ba56-4505-b6fc-de34274c2372 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:28.360876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6f1ade04-ba56-4505-b6fc-de34274c2372 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:28.375009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f1ade04-ba56-4505-b6fc-de34274c2372 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:28.376016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f1ade04-ba56-4505-b6fc-de34274c2372 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:28.376746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f1ade04-ba56-4505-b6fc-de34274c2372 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:28.380288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f1ade04-ba56-4505-b6fc-de34274c2372 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:28.381769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f1ade04-ba56-4505-b6fc-de34274c2372 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:28.384067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f1ade04-ba56-4505-b6fc-de34274c2372 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:28.750449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:28.751913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:28.773243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:28.774480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:28.778474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:28.782139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:28.789014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:28.790445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:29.234781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6f1ade04-ba56-4505-b6fc-de34274c2372 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:29.249402 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6f1ade04-ba56-4505-b6fc-de34274c2372 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1321 microversion: 2.1 time: 0.894782 Aug 09 17:06:29.266090 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 384/763] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:28 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1321 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:29.279312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4617bb9f-62d2-4204-a684-29957e9ac1c5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:29.280014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4617bb9f-62d2-4204-a684-29957e9ac1c5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:29.298011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4617bb9f-62d2-4204-a684-29957e9ac1c5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:29.298588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4617bb9f-62d2-4204-a684-29957e9ac1c5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:29.299034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4617bb9f-62d2-4204-a684-29957e9ac1c5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:29.299811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4617bb9f-62d2-4204-a684-29957e9ac1c5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:29.300276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4617bb9f-62d2-4204-a684-29957e9ac1c5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:29.300708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4617bb9f-62d2-4204-a684-29957e9ac1c5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:29.306124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:29.493934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:29.518216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:29.520840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:29.524052 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-379bd70f-b564-4997-be0d-8cbbe4621c56 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1361 microversion: 2.25 time: 0.792531 Aug 09 17:06:29.531500 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 380/764] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:28 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1361 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:06:29.539466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f617576a-a572-4d6f-8275-ef999def2b4a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:29.540527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f617576a-a572-4d6f-8275-ef999def2b4a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:29.562051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f617576a-a572-4d6f-8275-ef999def2b4a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:29.562777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f617576a-a572-4d6f-8275-ef999def2b4a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:29.563387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f617576a-a572-4d6f-8275-ef999def2b4a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:29.565526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f617576a-a572-4d6f-8275-ef999def2b4a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:29.566208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f617576a-a572-4d6f-8275-ef999def2b4a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:29.566846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f617576a-a572-4d6f-8275-ef999def2b4a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:29.642563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4617bb9f-62d2-4204-a684-29957e9ac1c5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:29.658491 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4617bb9f-62d2-4204-a684-29957e9ac1c5 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1469 microversion: 2.1 time: 0.390748 Aug 09 17:06:29.663272 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 385/765] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:29 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1469 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:29.677485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ee81ce65-3f61-4ac1-9282-05cf174a2d3b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbeb3a60>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:29.775007 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ee81ce65-3f61-4ac1-9282-05cf174a2d3b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.109748 Aug 09 17:06:29.778239 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 386/766] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:29 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:29.791721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f617576a-a572-4d6f-8275-ef999def2b4a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:29.803224 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f617576a-a572-4d6f-8275-ef999def2b4a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1263 microversion: 2.1 time: 0.270050 Aug 09 17:06:29.804804 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 381/767] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:29 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1263 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:29.808297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-38631a61-df2f-4250-bdc3-cb0dc15a9a34 req-3e02988c-411b-4fcf-938c-091e32c1b6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ddc1848-1711-406c-947a-94149934b5d3", "tag": "9f96bc34-0e5a-4ffb-909f-2a367ebfcc17"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:29.827239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-38631a61-df2f-4250-bdc3-cb0dc15a9a34 req-3e02988c-411b-4fcf-938c-091e32c1b6d8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:29.828276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-38631a61-df2f-4250-bdc3-cb0dc15a9a34 req-3e02988c-411b-4fcf-938c-091e32c1b6d8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:29.828768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-38631a61-df2f-4250-bdc3-cb0dc15a9a34 req-3e02988c-411b-4fcf-938c-091e32c1b6d8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:29.842641 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-38631a61-df2f-4250-bdc3-cb0dc15a9a34 req-3e02988c-411b-4fcf-938c-091e32c1b6d8 service nova] Creating event network-changed:9f96bc34-0e5a-4ffb-909f-2a367ebfcc17 for instance 1ddc1848-1711-406c-947a-94149934b5d3 on n-h2-845781-6 Aug 09 17:06:29.854682 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-38631a61-df2f-4250-bdc3-cb0dc15a9a34 req-3e02988c-411b-4fcf-938c-091e32c1b6d8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056952 Aug 09 17:06:29.856030 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 387/768] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:30.274075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ea51e50-ca51-44b5-a094-af18bc43058a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:30.275029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ea51e50-ca51-44b5-a094-af18bc43058a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:30.281783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea51e50-ca51-44b5-a094-af18bc43058a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:30.282533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea51e50-ca51-44b5-a094-af18bc43058a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:30.283209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea51e50-ca51-44b5-a094-af18bc43058a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:30.284174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea51e50-ca51-44b5-a094-af18bc43058a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:30.284639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea51e50-ca51-44b5-a094-af18bc43058a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:30.285646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea51e50-ca51-44b5-a094-af18bc43058a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:30.575682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:30.576688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:30.592237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:30.596153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:30.596879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:30.598038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:30.600028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:30.602028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:30.965271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5ea51e50-ca51-44b5-a094-af18bc43058a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:31.003892 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ea51e50-ca51-44b5-a094-af18bc43058a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1470 microversion: 2.1 time: 0.733753 Aug 09 17:06:31.019383 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 382/769] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:30 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1470 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:31.036663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b899e0dc-8ec2-4af4-8a27-57ce3d4a0c3e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:31.039828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b899e0dc-8ec2-4af4-8a27-57ce3d4a0c3e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:31.060623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b899e0dc-8ec2-4af4-8a27-57ce3d4a0c3e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:31.061490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b899e0dc-8ec2-4af4-8a27-57ce3d4a0c3e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:31.062090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b899e0dc-8ec2-4af4-8a27-57ce3d4a0c3e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:31.062985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b899e0dc-8ec2-4af4-8a27-57ce3d4a0c3e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:31.063613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b899e0dc-8ec2-4af4-8a27-57ce3d4a0c3e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:31.064328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b899e0dc-8ec2-4af4-8a27-57ce3d4a0c3e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:31.185298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b899e0dc-8ec2-4af4-8a27-57ce3d4a0c3e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:31.195457 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b899e0dc-8ec2-4af4-8a27-57ce3d4a0c3e tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1427 microversion: 2.1 time: 0.172520 Aug 09 17:06:31.196363 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 383/770] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:31 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1427 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:31.214813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4c5a4fc8-0f16-4de2-971a-f4b317b8ff29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbe56820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:31.378060 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4c5a4fc8-0f16-4de2-971a-f4b317b8ff29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.167032 Aug 09 17:06:31.378743 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 384/771] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:31 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:31.394182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d331fa56-019e-47a1-bc27-b54098fa97b5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:31.395706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d331fa56-019e-47a1-bc27-b54098fa97b5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:31.405453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d331fa56-019e-47a1-bc27-b54098fa97b5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:31.405972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d331fa56-019e-47a1-bc27-b54098fa97b5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:31.406439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d331fa56-019e-47a1-bc27-b54098fa97b5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:31.407166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d331fa56-019e-47a1-bc27-b54098fa97b5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:31.408001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d331fa56-019e-47a1-bc27-b54098fa97b5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:31.408446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d331fa56-019e-47a1-bc27-b54098fa97b5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:31.522406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:31.565484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:31.569948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:31.574053 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4bc311f7-e72f-43d1-8df3-d1b10403c0e6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1361 microversion: 2.25 time: 1.001778 Aug 09 17:06:31.575988 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 388/772] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:30 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1361 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:06:31.671181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d331fa56-019e-47a1-bc27-b54098fa97b5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:31.684190 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d331fa56-019e-47a1-bc27-b54098fa97b5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1269 microversion: 2.1 time: 0.294998 Aug 09 17:06:31.690677 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 385/773] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:31 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1269 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:31.712645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2eb70e9d-37d3-4e87-bc2d-cdfa634ff720 req-033e790d-004f-4aa8-b063-1369d41a1f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3698be9-74c8-41a8-b6d8-3f3f1bfe4639", "name": "network-vif-deleted", "tag": "b3e870ac-821c-49c8-a2b5-e30130f4fbf6"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:31.758530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2eb70e9d-37d3-4e87-bc2d-cdfa634ff720 req-033e790d-004f-4aa8-b063-1369d41a1f7b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:31.766186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2eb70e9d-37d3-4e87-bc2d-cdfa634ff720 req-033e790d-004f-4aa8-b063-1369d41a1f7b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:31.766950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2eb70e9d-37d3-4e87-bc2d-cdfa634ff720 req-033e790d-004f-4aa8-b063-1369d41a1f7b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:31.802523 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2eb70e9d-37d3-4e87-bc2d-cdfa634ff720 req-033e790d-004f-4aa8-b063-1369d41a1f7b service nova] Creating event network-vif-deleted:b3e870ac-821c-49c8-a2b5-e30130f4fbf6 for instance d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 on n-h1-845781-6 Aug 09 17:06:31.821569 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2eb70e9d-37d3-4e87-bc2d-cdfa634ff720 req-033e790d-004f-4aa8-b063-1369d41a1f7b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126912 Aug 09 17:06:31.825013 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 386/774] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:31.996577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d7568fe5-ddad-4004-871f-76d5216b6bd9 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:31.997600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d7568fe5-ddad-4004-871f-76d5216b6bd9 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] [instance: 7a9fa9b9-476e-4c75-8888-18f10bd03b65] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:32.033373 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-d7568fe5-ddad-4004-871f-76d5216b6bd9 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] HTTP exception thrown: Instance 7a9fa9b9-476e-4c75-8888-18f10bd03b65 could not be found. Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d7568fe5-ddad-4004-871f-76d5216b6bd9 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Request method failure captured: Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/7a9fa9b9-476e-4c75-8888-18f10bd03b65/action HTTP/1.1 Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 15 Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pP19J0ytsmLtQYF1QbzEbq1fo3bQ38AOCRCs0ggwndU_gZkXlWsR7u8_ZXBKf4LlClY1j8VHaFfMB2upVXyj6Zcnzm2u94hrBq6m9FIYZilPhMhXjK9_VF0TIGPp3wPkOgU9EbiPz2KzcFPZ1CQd2uovfl-ZbO9u0nMI65pyDdbTxg Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 4cc8e46884cd4bae9fd70045cffc3493 Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:06:32.050533 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 4cc8e46884cd4bae9fd70045cffc3493 Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersAdminNegativeTestJSON-1136760922-project-admin Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1c39efbcf12a445d85eabd5c179c8f88 Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1136760922-project-admin Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: {"migrate": {}} Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:06:32.053252 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 7a9fa9b9-476e-4c75-8888-18f10bd03b65 could not be found. Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '7a9fa9b9-476e-4c75-8888-18f10bd03b65', 'body': {'migrate': {}}} Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a9fa9b9-476e-4c75-8888-18f10bd03b65 could not be found. Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:32.056506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9fa9b9-476e-4c75-8888-18f10bd03b65 could not be found. Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9fa9b9-476e-4c75-8888-18f10bd03b65 could not be found. Aug 09 17:06:32.060986 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:32.069460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d7568fe5-ddad-4004-871f-76d5216b6bd9 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Returning 404 to user: Instance 7a9fa9b9-476e-4c75-8888-18f10bd03b65 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:32.069460 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d7568fe5-ddad-4004-871f-76d5216b6bd9 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/7a9fa9b9-476e-4c75-8888-18f10bd03b65/action" status: 404 len: 111 microversion: 2.1 time: 0.486674 Aug 09 17:06:32.069460 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 389/775] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:06:31 2022] POST /compute/v2.1/servers/7a9fa9b9-476e-4c75-8888-18f10bd03b65/action => generated 111 bytes in 492 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:06:32.222132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:32.223797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:32.242909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:32.244499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:32.244964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:32.245732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:32.275296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:32.275912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:32.350432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:32.385786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:32.386557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:32.388556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:32.390229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lazy-loading 'fault' on Instance uuid d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:06:32.394577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4151a00f-e53f-45af-ad12-0fa5d06ce3bb tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbb7a040>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:32.551351 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4151a00f-e53f-45af-ad12-0fa5d06ce3bb tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.160537 Aug 09 17:06:32.552510 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 390/776] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:32 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:06:32.573466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2137901114", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:32.699649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:32.712055 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b154405a-cde2-4967-831e-b9cbf8d68a0d tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 200 len: 1304 microversion: 2.1 time: 0.494354 Aug 09 17:06:32.712993 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 387/777] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:32 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 1304 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:06:32.729964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:32.730780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:32.745429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:32.752314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:32.753161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:32.753890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:06:32.754127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:32.754892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:32.755313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:33.576302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:06:33.577178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:06:33.577438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:06:33.577866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:06:33.578554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:06:33.584151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:33.623705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:33.624249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:33.626836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:33.631569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:33.633209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:33.636731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:33.699507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Getting quotas for project 09be0c4a839f45c5848413a9d99bbf66. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:06:33.712332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Getting quotas for user 5437ccd3449941079dfbb9a5e943029e and project 09be0c4a839f45c5848413a9d99bbf66. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:06:33.752095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:06:33.756412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:06:33.863387 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-13ad9ab5-4a3a-4651-b3d1-3f50230e07fc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.309790 Aug 09 17:06:33.864109 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 391/778] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:06:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:06:33.880554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-65f147e8-ca09-444d-8004-11ed4adef7a8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:33.881230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-65f147e8-ca09-444d-8004-11ed4adef7a8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:33.915555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65f147e8-ca09-444d-8004-11ed4adef7a8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:33.916505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65f147e8-ca09-444d-8004-11ed4adef7a8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:33.917525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65f147e8-ca09-444d-8004-11ed4adef7a8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:33.918847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65f147e8-ca09-444d-8004-11ed4adef7a8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:33.920980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65f147e8-ca09-444d-8004-11ed4adef7a8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:33.922016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65f147e8-ca09-444d-8004-11ed4adef7a8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:34.276136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:34.293532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:34.295152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:34.296380 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e41524d-e57a-46ef-a265-26d4bab02a7f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1361 microversion: 2.25 time: 1.581221 Aug 09 17:06:34.296968 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 388/779] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:32 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1361 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:06:34.531864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1255916180", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "33eed447-e2df-431f-9045-4fdaac89edae"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:34.672197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] validate_networks() for [('33eed447-e2df-431f-9045-4fdaac89edae', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:06:34.813234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-65f147e8-ca09-444d-8004-11ed4adef7a8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:34.847094 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-65f147e8-ca09-444d-8004-11ed4adef7a8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1311 microversion: 2.1 time: 0.981679 Aug 09 17:06:34.850834 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 392/780] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:33 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1311 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:34.867305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e29bd88-f775-46c6-b2e6-f64145860085 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbb7a670>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:34.978940 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e29bd88-f775-46c6-b2e6-f64145860085 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.125289 Aug 09 17:06:34.985986 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 393/781] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:34 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:35.001796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:35.006301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: d3698be9-74c8-41a8-b6d8-3f3f1bfe4639] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:35.045447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:35.045948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:35.046407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:35.047151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:35.055308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:35.057413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:35.099724 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] HTTP exception thrown: Instance d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 could not be found. Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Request method failure captured: Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 HTTP/1.1 Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOCBJgwk0HHGjJYU9FI7e-33aZWk2OxJQhtKyJY2cVX67U0E4DlT39U4rUSB08YbP7p0dVoX7nn1RDhpM_4zz5xjkBhZLmu-siyOFFE95leWnF5oLGbHVk_TX2SmjanSKRTSeSB2dY4z-qK-x4X_eudWwMFcSQiSjBVDOhWBUIk2Yo Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a6aa3d7035ce484f9ea8bb3fdf7ac9a6 Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersAdminTestJSON-731821145 Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:06:35.119116 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersAdminTestJSON-731821145 Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a6aa3d7035ce484f9ea8bb3fdf7ac9a6 Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersAdminTestJSON-731821145 Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersAdminTestJSON-731821145-project Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: e225d63b357c47998d854f8fa5b4be08 Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersAdminTestJSON-731821145-project Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 could not be found. Aug 09 17:06:35.120781 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'd3698be9-74c8-41a8-b6d8-3f3f1bfe4639'} Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 could not be found. Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:35.121563 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 could not be found. Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 could not be found. Aug 09 17:06:35.122800 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:35.124494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Returning 404 to user: Instance d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:35.126389 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7a164337-67bb-4a18-984b-93fc96f747bf tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639" status: 404 len: 111 microversion: 2.1 time: 0.139004 Aug 09 17:06:35.127679 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 394/782] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:34 2022] GET /compute/v2.1/servers/d3698be9-74c8-41a8-b6d8-3f3f1bfe4639 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:06:35.144126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2211caf5-95d4-46ad-99cd-3f41ea1d30b9 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:35.153170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2211caf5-95d4-46ad-99cd-3f41ea1d30b9 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:35.336360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2211caf5-95d4-46ad-99cd-3f41ea1d30b9 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:35.350822 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2211caf5-95d4-46ad-99cd-3f41ea1d30b9 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1222 microversion: 2.1 time: 0.220064 Aug 09 17:06:35.356191 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 395/783] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:35 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1222 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:35.384276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-01e83900-036b-4b8d-96cc-dd674a62a950 req-0a1e1f08-cd37-42bf-abe1-822fac9243bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9114d8ad-2746-443d-8799-c09c421ac55d", "name": "network-vif-plugged", "status": "completed", "tag": "72374f34-ae5a-40c5-8e9c-d64a473cbbfb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:35.423538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-01e83900-036b-4b8d-96cc-dd674a62a950 req-0a1e1f08-cd37-42bf-abe1-822fac9243bc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:35.436715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-01e83900-036b-4b8d-96cc-dd674a62a950 req-0a1e1f08-cd37-42bf-abe1-822fac9243bc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:35.437453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-01e83900-036b-4b8d-96cc-dd674a62a950 req-0a1e1f08-cd37-42bf-abe1-822fac9243bc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:35.467328 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-01e83900-036b-4b8d-96cc-dd674a62a950 req-0a1e1f08-cd37-42bf-abe1-822fac9243bc service nova] Creating event network-vif-plugged:72374f34-ae5a-40c5-8e9c-d64a473cbbfb for instance 9114d8ad-2746-443d-8799-c09c421ac55d on n-h1-845781-6 Aug 09 17:06:35.485441 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-01e83900-036b-4b8d-96cc-dd674a62a950 req-0a1e1f08-cd37-42bf-abe1-822fac9243bc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126790 Aug 09 17:06:35.492520 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 396/784] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:35.504088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5566ea96-e2cd-49bf-99e6-35aeeaee3a34 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Calling method '.version_select at 0x7fbbcbcca8b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:35.527004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5566ea96-e2cd-49bf-99e6-35aeeaee3a34 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:35.530311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5566ea96-e2cd-49bf-99e6-35aeeaee3a34 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:35.534059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5566ea96-e2cd-49bf-99e6-35aeeaee3a34 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:35.551289 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5566ea96-e2cd-49bf-99e6-35aeeaee3a34 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 1187 microversion: 2.1 time: 0.057015 Aug 09 17:06:35.567854 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 397/785] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:06:35 2022] GET /compute/v2.1/os-migrations => generated 1187 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:35.581420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d799969a-9079-4f5e-94ed-36521e0d0178 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:35.587806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d799969a-9079-4f5e-94ed-36521e0d0178 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:35.599922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d799969a-9079-4f5e-94ed-36521e0d0178 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:35.600813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d799969a-9079-4f5e-94ed-36521e0d0178 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:35.604342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d799969a-9079-4f5e-94ed-36521e0d0178 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:35.605311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d799969a-9079-4f5e-94ed-36521e0d0178 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:35.605921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d799969a-9079-4f5e-94ed-36521e0d0178 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:35.606472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d799969a-9079-4f5e-94ed-36521e0d0178 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:35.690262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d799969a-9079-4f5e-94ed-36521e0d0178 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:06:35.913588 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d799969a-9079-4f5e-94ed-36521e0d0178 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 204 len: 0 microversion: 2.1 time: 0.343756 Aug 09 17:06:35.915294 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 398/786] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:06:35 2022] DELETE /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:06:35.930971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:35.931864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:35.954385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:35.958265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:35.958856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:35.967183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:35.967958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:35.968844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:36.415579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:36.516088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:36.549799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:36.570854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:36.573313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:36.582619 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-90d52d9b-3f5c-497a-b8df-c56da4ae8442 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1361 microversion: 2.25 time: 0.665832 Aug 09 17:06:36.583602 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 399/787] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:35 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1361 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:06:36.599994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bde34d35-c941-49a2-af52-874020b10e30 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:36.626617 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bde34d35-c941-49a2-af52-874020b10e30 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041739 Aug 09 17:06:36.636494 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 400/788] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:06:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:36.658695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-85678fee-8afe-498d-b812-a63ed8e5c8ca req-7875b194-cbcf-42fa-924b-09c8a0c247f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fec2f16-7d50-4468-be26-23c4e25c2930", "tag": "e43b13de-00b3-407c-88fd-f5e04caff542"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:36.705124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-85678fee-8afe-498d-b812-a63ed8e5c8ca req-7875b194-cbcf-42fa-924b-09c8a0c247f1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:36.707887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-85678fee-8afe-498d-b812-a63ed8e5c8ca req-7875b194-cbcf-42fa-924b-09c8a0c247f1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:36.709318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-85678fee-8afe-498d-b812-a63ed8e5c8ca req-7875b194-cbcf-42fa-924b-09c8a0c247f1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:36.759368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-85678fee-8afe-498d-b812-a63ed8e5c8ca req-7875b194-cbcf-42fa-924b-09c8a0c247f1 service nova] Creating event network-changed:e43b13de-00b3-407c-88fd-f5e04caff542 for instance 2fec2f16-7d50-4468-be26-23c4e25c2930 on n-h1-845781-6 Aug 09 17:06:36.781586 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-85678fee-8afe-498d-b812-a63ed8e5c8ca req-7875b194-cbcf-42fa-924b-09c8a0c247f1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143338 Aug 09 17:06:36.783696 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 401/789] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:36.824331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-15b3bd3b-4165-4976-98e0-e6683ea7244a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:36.827090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-15b3bd3b-4165-4976-98e0-e6683ea7244a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:36.857915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15b3bd3b-4165-4976-98e0-e6683ea7244a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:36.858610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15b3bd3b-4165-4976-98e0-e6683ea7244a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:36.859387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15b3bd3b-4165-4976-98e0-e6683ea7244a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:36.860702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15b3bd3b-4165-4976-98e0-e6683ea7244a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:36.861863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15b3bd3b-4165-4976-98e0-e6683ea7244a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:36.862965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15b3bd3b-4165-4976-98e0-e6683ea7244a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:37.550271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-15b3bd3b-4165-4976-98e0-e6683ea7244a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:37.587263 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-15b3bd3b-4165-4976-98e0-e6683ea7244a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1311 microversion: 2.1 time: 0.800534 Aug 09 17:06:37.594336 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 402/790] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:36 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1311 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:37.618178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-824b56d8-5881-43d7-bf86-7ff1385d4f02 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:37.619384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-824b56d8-5881-43d7-bf86-7ff1385d4f02 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:37.637781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-824b56d8-5881-43d7-bf86-7ff1385d4f02 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:37.640153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-824b56d8-5881-43d7-bf86-7ff1385d4f02 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:37.641280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-824b56d8-5881-43d7-bf86-7ff1385d4f02 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:37.642379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-824b56d8-5881-43d7-bf86-7ff1385d4f02 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:37.643150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-824b56d8-5881-43d7-bf86-7ff1385d4f02 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:37.644954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-824b56d8-5881-43d7-bf86-7ff1385d4f02 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:38.014109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:06:38.014911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:06:38.016155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:06:38.030178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:06:38.031363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:06:38.087422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:38.088406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:38.095803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:38.097416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:38.098260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:38.099056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:38.220872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Getting quotas for project 569d108c1d9f4f82bbb69dbba49f19ed. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:06:38.277782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Getting quotas for user b147f363cb434339ad1e3f302838574c and project 569d108c1d9f4f82bbb69dbba49f19ed. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:06:38.420066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:06:38.429863 n-d-845781-6 devstack@n-api.service[119431]: WARNING nova.utils [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1255916180 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-125591618 Aug 09 17:06:38.431288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:06:38.447680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-824b56d8-5881-43d7-bf86-7ff1385d4f02 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:38.458996 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-824b56d8-5881-43d7-bf86-7ff1385d4f02 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1470 microversion: 2.1 time: 0.861266 Aug 09 17:06:38.477456 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 403/791] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:37 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1470 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:38.486632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c9926df0-2ef3-46d8-a03e-5efe0128ab29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbb7a040>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:38.605069 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c9926df0-2ef3-46d8-a03e-5efe0128ab29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.125996 Aug 09 17:06:38.620081 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 404/792] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:38 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:38.641396 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ec3bb0b-cd71-470f-8276-e34574e18b33 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.330985 Aug 09 17:06:38.655495 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 389/793] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:06:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:06:38.657312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-53b69e0f-afa2-410d-bfed-1ca34ae82a1c tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:38.659922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-53b69e0f-afa2-410d-bfed-1ca34ae82a1c tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:38.684414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9ac1a564-a7fa-494b-9da2-536bacdf3571 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-159832888", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:38.689751 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:06:38.689751 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:06:38.709338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53b69e0f-afa2-410d-bfed-1ca34ae82a1c tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:38.714738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53b69e0f-afa2-410d-bfed-1ca34ae82a1c tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:38.715294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53b69e0f-afa2-410d-bfed-1ca34ae82a1c tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:38.724985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53b69e0f-afa2-410d-bfed-1ca34ae82a1c tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:38.725732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53b69e0f-afa2-410d-bfed-1ca34ae82a1c tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:38.735060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53b69e0f-afa2-410d-bfed-1ca34ae82a1c tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:38.783291 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9ac1a564-a7fa-494b-9da2-536bacdf3571 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.131058 Aug 09 17:06:38.786974 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 390/794] 10.222.0.93 () {60 vars in 1146 bytes} [Tue Aug 9 17:06:38 2022] POST /compute/v2.1/flavors => generated 498 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:38.806944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:38.810316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:38.845486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:38.852807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:38.854609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:38.857619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:38.864656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:38.866997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:40.168226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-53b69e0f-afa2-410d-bfed-1ca34ae82a1c tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:40.179135 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-53b69e0f-afa2-410d-bfed-1ca34ae82a1c tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1280 microversion: 2.1 time: 1.556125 Aug 09 17:06:40.204054 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 405/795] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:38 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1280 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:40.219697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-92f19302-c71e-4c86-ac4a-94bafd47a573 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:40.225680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-92f19302-c71e-4c86-ac4a-94bafd47a573 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:40.287593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f19302-c71e-4c86-ac4a-94bafd47a573 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:40.288449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f19302-c71e-4c86-ac4a-94bafd47a573 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:40.304422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f19302-c71e-4c86-ac4a-94bafd47a573 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:40.305648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f19302-c71e-4c86-ac4a-94bafd47a573 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:40.306152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f19302-c71e-4c86-ac4a-94bafd47a573 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:40.309822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f19302-c71e-4c86-ac4a-94bafd47a573 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:40.760144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-92f19302-c71e-4c86-ac4a-94bafd47a573 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:40.795969 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-92f19302-c71e-4c86-ac4a-94bafd47a573 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1311 microversion: 2.1 time: 0.590091 Aug 09 17:06:40.797395 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 406/796] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:40 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1311 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:40.809079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e6a1866-0b50-47f3-9c55-66991c593f61 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:40.816669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2e6a1866-0b50-47f3-9c55-66991c593f61 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:40.848791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e6a1866-0b50-47f3-9c55-66991c593f61 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:40.849723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e6a1866-0b50-47f3-9c55-66991c593f61 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:40.850439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e6a1866-0b50-47f3-9c55-66991c593f61 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:40.857723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e6a1866-0b50-47f3-9c55-66991c593f61 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:40.858247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e6a1866-0b50-47f3-9c55-66991c593f61 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:40.860194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e6a1866-0b50-47f3-9c55-66991c593f61 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:41.036157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2e6a1866-0b50-47f3-9c55-66991c593f61 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:41.058157 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2e6a1866-0b50-47f3-9c55-66991c593f61 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1228 microversion: 2.1 time: 0.258902 Aug 09 17:06:41.060371 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 407/797] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:40 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1228 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:41.129370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-802edcb9-9f52-42eb-bd40-5d8dd2b56caa tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:41.186171 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-802edcb9-9f52-42eb-bd40-5d8dd2b56caa tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.105663 Aug 09 17:06:41.187331 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 408/798] 10.222.0.93 () {58 vars in 1182 bytes} [Tue Aug 9 17:06:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:06:41.223680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:41.225560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:41.243257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:41.246556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:41.251873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:41.255891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:41.258411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:41.259399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:41.313975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:41.361057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:41.362123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:41.362123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:41.362467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lazy-loading 'fault' on Instance uuid cce37568-9dbf-4f84-875d-0bfda5961abc {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:06:41.381851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:41.386119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:41.400775 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-139ff425-7e4a-421d-b897-282ed6a8ea6c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1361 microversion: 2.25 time: 2.609153 Aug 09 17:06:41.405858 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 391/799] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:38 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1361 bytes in 2617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:06:41.439510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-39322a49-f636-4136-87b5-e17a97be33f6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbae9550>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:41.568538 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-39322a49-f636-4136-87b5-e17a97be33f6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.146057 Aug 09 17:06:41.580547 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 392/800] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:41 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:41.585939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b86fbac8-8e68-434f-872d-249673609fe8 req-4120ccbd-5353-40db-85b2-ede9621de64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce37568-9dbf-4f84-875d-0bfda5961abc", "name": "network-vif-deleted", "tag": "cdac773e-042b-445a-b50f-a65814f73dae"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:41.631488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b86fbac8-8e68-434f-872d-249673609fe8 req-4120ccbd-5353-40db-85b2-ede9621de64d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:41.633425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b86fbac8-8e68-434f-872d-249673609fe8 req-4120ccbd-5353-40db-85b2-ede9621de64d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:41.634969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b86fbac8-8e68-434f-872d-249673609fe8 req-4120ccbd-5353-40db-85b2-ede9621de64d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:41.667766 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b86fbac8-8e68-434f-872d-249673609fe8 req-4120ccbd-5353-40db-85b2-ede9621de64d service nova] Creating event network-vif-deleted:cdac773e-042b-445a-b50f-a65814f73dae for instance cce37568-9dbf-4f84-875d-0bfda5961abc on n-h2-845781-6 Aug 09 17:06:41.683207 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b86fbac8-8e68-434f-872d-249673609fe8 req-4120ccbd-5353-40db-85b2-ede9621de64d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100394 Aug 09 17:06:41.688767 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 393/801] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:41.701347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2b6787dc-951f-49c0-b2ea-1d37e6154ce9 req-8e0221ed-0d29-4748-8682-e2a379a5fe6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddc1848-1711-406c-947a-94149934b5d3", "name": "network-vif-plugged", "status": "completed", "tag": "9f96bc34-0e5a-4ffb-909f-2a367ebfcc17"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:41.735129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2b6787dc-951f-49c0-b2ea-1d37e6154ce9 req-8e0221ed-0d29-4748-8682-e2a379a5fe6f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:41.736091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2b6787dc-951f-49c0-b2ea-1d37e6154ce9 req-8e0221ed-0d29-4748-8682-e2a379a5fe6f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:41.736749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2b6787dc-951f-49c0-b2ea-1d37e6154ce9 req-8e0221ed-0d29-4748-8682-e2a379a5fe6f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:41.768422 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2b6787dc-951f-49c0-b2ea-1d37e6154ce9 req-8e0221ed-0d29-4748-8682-e2a379a5fe6f service nova] Creating event network-vif-plugged:9f96bc34-0e5a-4ffb-909f-2a367ebfcc17 for instance 1ddc1848-1711-406c-947a-94149934b5d3 on n-h2-845781-6 Aug 09 17:06:41.783144 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2b6787dc-951f-49c0-b2ea-1d37e6154ce9 req-8e0221ed-0d29-4748-8682-e2a379a5fe6f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092532 Aug 09 17:06:41.787612 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 394/802] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:41.803448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07bdaaea-05de-4503-9743-f39781f6aa7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:41.805766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07bdaaea-05de-4503-9743-f39781f6aa7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:41.810079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e225d63b357c47998d854f8fa5b4be08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6aa3d7035ce484f9ea8bb3fdf7ac9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:41.825361 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cbf69ff6-e8e3-4294-a306-df5af7a50fc6 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 200 len: 1304 microversion: 2.1 time: 0.628079 Aug 09 17:06:41.826196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07bdaaea-05de-4503-9743-f39781f6aa7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:41.828990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07bdaaea-05de-4503-9743-f39781f6aa7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:41.830825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07bdaaea-05de-4503-9743-f39781f6aa7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:41.832429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07bdaaea-05de-4503-9743-f39781f6aa7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:41.837499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07bdaaea-05de-4503-9743-f39781f6aa7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:41.838444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07bdaaea-05de-4503-9743-f39781f6aa7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:41.840353 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 409/803] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:41 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 1304 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:41.851498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-417111871", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:41.987227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:06:42.200502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-07bdaaea-05de-4503-9743-f39781f6aa7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:42.216544 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07bdaaea-05de-4503-9743-f39781f6aa7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1280 microversion: 2.1 time: 0.424145 Aug 09 17:06:42.217396 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 395/804] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:41 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1280 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:42.235593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b02277d-89f6-45f6-b33b-2c63baf0c50b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:42.237224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b02277d-89f6-45f6-b33b-2c63baf0c50b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:42.254011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b02277d-89f6-45f6-b33b-2c63baf0c50b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:42.280798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b02277d-89f6-45f6-b33b-2c63baf0c50b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:42.282675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b02277d-89f6-45f6-b33b-2c63baf0c50b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:42.283524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b02277d-89f6-45f6-b33b-2c63baf0c50b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:42.284789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b02277d-89f6-45f6-b33b-2c63baf0c50b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:42.284789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b02277d-89f6-45f6-b33b-2c63baf0c50b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:42.884681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6b02277d-89f6-45f6-b33b-2c63baf0c50b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:42.901164 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b02277d-89f6-45f6-b33b-2c63baf0c50b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1311 microversion: 2.1 time: 0.681781 Aug 09 17:06:42.909178 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 396/805] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:42 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1311 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:42.934148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f11e352-edc6-4f30-aeef-888408dc34ee tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:42.942521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:06:42.943085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:06:42.943529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:06:42.944173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:06:42.944601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:06:42.945762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5f11e352-edc6-4f30-aeef-888408dc34ee tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:42.974900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f11e352-edc6-4f30-aeef-888408dc34ee tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:42.975783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f11e352-edc6-4f30-aeef-888408dc34ee tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:42.978711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f11e352-edc6-4f30-aeef-888408dc34ee tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:42.982731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f11e352-edc6-4f30-aeef-888408dc34ee tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:42.983533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f11e352-edc6-4f30-aeef-888408dc34ee tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:42.984269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f11e352-edc6-4f30-aeef-888408dc34ee tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:42.988837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:42.991441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:42.996565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:43.001103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:43.013857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:43.014890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:43.092122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for project 7004f453a4d944239c4641bbc394ebb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:06:43.117710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for user 434e395144bc4443abb655a9d0a8b329 and project 7004f453a4d944239c4641bbc394ebb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:06:43.202567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:06:43.212804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:06:43.237691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f11e352-edc6-4f30-aeef-888408dc34ee tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:43.269227 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f11e352-edc6-4f30-aeef-888408dc34ee tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1290 microversion: 2.1 time: 0.356462 Aug 09 17:06:43.270251 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 397/806] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:42 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1290 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:43.287660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:43.297212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:43.310255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:43.311172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:43.321147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:43.332488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:43.333471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:43.334284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:43.438901 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5d4bc50e-c32e-410a-a743-53f5304b2997 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596869 Aug 09 17:06:43.440124 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 410/807] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:06:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:06:43.458181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-66d25f32-0c94-40c1-b124-8ee5f33f5d4b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbaea5e0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:43.722708 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-66d25f32-0c94-40c1-b124-8ee5f33f5d4b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.280668 Aug 09 17:06:43.724251 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 411/808] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:43 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:43.743586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:43.747204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] [instance: cce37568-9dbf-4f84-875d-0bfda5961abc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:43.777756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:43.782144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:43.784524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:43.786144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:43.801927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:43.803389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:43.863255 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] HTTP exception thrown: Instance cce37568-9dbf-4f84-875d-0bfda5961abc could not be found. Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Request method failure captured: Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc HTTP/1.1 Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pOCBJgwk0HHGjJYU9FI7e-33aZWk2OxJQhtKyJY2cVX67U0E4DlT39U4rUSB08YbP7p0dVoX7nn1RDhpM_4zz5xjkBhZLmu-siyOFFE95leWnF5oLGbHVk_TX2SmjanSKRTSeSB2dY4z-qK-x4X_eudWwMFcSQiSjBVDOhWBUIk2Yo Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a6aa3d7035ce484f9ea8bb3fdf7ac9a6 Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersAdminTestJSON-731821145 Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:06:43.869893 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a6aa3d7035ce484f9ea8bb3fdf7ac9a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersAdminTestJSON-731821145 Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a6aa3d7035ce484f9ea8bb3fdf7ac9a6 Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersAdminTestJSON-731821145 Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersAdminTestJSON-731821145-project Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: e225d63b357c47998d854f8fa5b4be08 Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersAdminTestJSON-731821145-project Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance cce37568-9dbf-4f84-875d-0bfda5961abc could not be found. Aug 09 17:06:43.872921 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'cce37568-9dbf-4f84-875d-0bfda5961abc'} Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce37568-9dbf-4f84-875d-0bfda5961abc could not be found. Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:43.874570 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce37568-9dbf-4f84-875d-0bfda5961abc could not be found. Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce37568-9dbf-4f84-875d-0bfda5961abc could not be found. Aug 09 17:06:43.877374 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:06:43.886877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] Returning 404 to user: Instance cce37568-9dbf-4f84-875d-0bfda5961abc could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:43.891995 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b5c48ccf-e2fb-4cbc-be93-20bb19856ea4 tempest-ServersAdminTestJSON-731821145 tempest-ServersAdminTestJSON-731821145-project] 10.222.0.93 "GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc" status: 404 len: 111 microversion: 2.1 time: 0.165395 Aug 09 17:06:43.897150 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 412/809] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:43 2022] GET /compute/v2.1/servers/cce37568-9dbf-4f84-875d-0bfda5961abc => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:06:43.924819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-59ed61b6-7122-4047-9939-b03d1dd7fbba tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:43.927110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-59ed61b6-7122-4047-9939-b03d1dd7fbba tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:43.975560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59ed61b6-7122-4047-9939-b03d1dd7fbba tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:43.994143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59ed61b6-7122-4047-9939-b03d1dd7fbba tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:43.994357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59ed61b6-7122-4047-9939-b03d1dd7fbba tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:43.995196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59ed61b6-7122-4047-9939-b03d1dd7fbba tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:43.995570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59ed61b6-7122-4047-9939-b03d1dd7fbba tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:43.996179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59ed61b6-7122-4047-9939-b03d1dd7fbba tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:44.789737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:44.808230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:44.812597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:44.813643 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d3ea8f2f-233b-4168-be80-9766775408ca tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1361 microversion: 2.25 time: 1.541985 Aug 09 17:06:44.814227 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 398/810] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:43 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1361 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:06:44.831336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eed4b24c-ea60-434a-9308-bcade6109309 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:44.838642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eed4b24c-ea60-434a-9308-bcade6109309 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:44.993133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eed4b24c-ea60-434a-9308-bcade6109309 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:45.007348 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eed4b24c-ea60-434a-9308-bcade6109309 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1278 microversion: 2.1 time: 0.181979 Aug 09 17:06:45.009050 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 399/811] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:44 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:45.020755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ddd9779-fb96-4dd0-8e55-a8f4be41c4cc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:45.022584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2ddd9779-fb96-4dd0-8e55-a8f4be41c4cc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:45.069094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ddd9779-fb96-4dd0-8e55-a8f4be41c4cc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:45.069953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ddd9779-fb96-4dd0-8e55-a8f4be41c4cc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:45.070583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ddd9779-fb96-4dd0-8e55-a8f4be41c4cc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:45.071505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ddd9779-fb96-4dd0-8e55-a8f4be41c4cc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:45.072005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ddd9779-fb96-4dd0-8e55-a8f4be41c4cc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:45.072442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ddd9779-fb96-4dd0-8e55-a8f4be41c4cc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:45.442290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-59ed61b6-7122-4047-9939-b03d1dd7fbba tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:45.453569 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-59ed61b6-7122-4047-9939-b03d1dd7fbba tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1322 microversion: 2.1 time: 1.552159 Aug 09 17:06:45.458778 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 413/812] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:43 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1322 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:45.488021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a321512b-82fe-4f49-8b31-f1a6aaa89a9a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:45.490130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a321512b-82fe-4f49-8b31-f1a6aaa89a9a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:45.529975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a321512b-82fe-4f49-8b31-f1a6aaa89a9a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:45.555345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a321512b-82fe-4f49-8b31-f1a6aaa89a9a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:45.560303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a321512b-82fe-4f49-8b31-f1a6aaa89a9a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:45.565326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a321512b-82fe-4f49-8b31-f1a6aaa89a9a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:45.571853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a321512b-82fe-4f49-8b31-f1a6aaa89a9a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:45.575514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a321512b-82fe-4f49-8b31-f1a6aaa89a9a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:45.588536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:46.097225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2ddd9779-fb96-4dd0-8e55-a8f4be41c4cc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:46.148368 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ddd9779-fb96-4dd0-8e55-a8f4be41c4cc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1311 microversion: 2.1 time: 1.116691 Aug 09 17:06:46.152456 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 400/813] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:45 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1311 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:46.182452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5fb040fb-abbd-4021-b623-885aaf705e2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbb705e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:46.375609 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5fb040fb-abbd-4021-b623-885aaf705e2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.213868 Aug 09 17:06:46.377383 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 401/814] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:46 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:46.401005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-aa3deac4-7f5b-44fb-9a62-508cc1cfb05a req-9c4204bc-19ec-4fe2-9693-f9429c5b25a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fec2f16-7d50-4468-be26-23c4e25c2930", "name": "network-vif-plugged", "status": "completed", "tag": "e43b13de-00b3-407c-88fd-f5e04caff542"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:46.436772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aa3deac4-7f5b-44fb-9a62-508cc1cfb05a req-9c4204bc-19ec-4fe2-9693-f9429c5b25a6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:46.439011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aa3deac4-7f5b-44fb-9a62-508cc1cfb05a req-9c4204bc-19ec-4fe2-9693-f9429c5b25a6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:46.441789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aa3deac4-7f5b-44fb-9a62-508cc1cfb05a req-9c4204bc-19ec-4fe2-9693-f9429c5b25a6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:46.483108 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-aa3deac4-7f5b-44fb-9a62-508cc1cfb05a req-9c4204bc-19ec-4fe2-9693-f9429c5b25a6 service nova] Creating event network-vif-plugged:e43b13de-00b3-407c-88fd-f5e04caff542 for instance 2fec2f16-7d50-4468-be26-23c4e25c2930 on n-h1-845781-6 Aug 09 17:06:46.495876 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-aa3deac4-7f5b-44fb-9a62-508cc1cfb05a req-9c4204bc-19ec-4fe2-9693-f9429c5b25a6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113330 Aug 09 17:06:46.498155 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 402/815] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:46.515137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:46.518491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:46.543197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:46.543531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:46.544258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:46.545693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:46.546451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:46.548004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:47.227502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:47.239359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:47.246997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:47.248416 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eef55821-920e-4c90-aca1-7903f6494f28 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1557 microversion: 2.25 time: 0.745309 Aug 09 17:06:47.250828 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 403/816] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:46 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1557 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:06:47.258430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43d049ce-ff45-41a0-bea7-2cf953ad572d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:47.259160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-43d049ce-ff45-41a0-bea7-2cf953ad572d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:47.295209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d049ce-ff45-41a0-bea7-2cf953ad572d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:47.295845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d049ce-ff45-41a0-bea7-2cf953ad572d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:47.296722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d049ce-ff45-41a0-bea7-2cf953ad572d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:47.297704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d049ce-ff45-41a0-bea7-2cf953ad572d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:47.298361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d049ce-ff45-41a0-bea7-2cf953ad572d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:47.298998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d049ce-ff45-41a0-bea7-2cf953ad572d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:47.453710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-43d049ce-ff45-41a0-bea7-2cf953ad572d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:47.473464 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43d049ce-ff45-41a0-bea7-2cf953ad572d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1336 microversion: 2.1 time: 0.220507 Aug 09 17:06:47.487921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a321512b-82fe-4f49-8b31-f1a6aaa89a9a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:47.489994 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 404/817] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:47 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1336 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:47.497689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-56e9c3f7-cfb3-4c0d-a05a-7a0081d3733a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:47.498766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-56e9c3f7-cfb3-4c0d-a05a-7a0081d3733a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:47.500587 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a321512b-82fe-4f49-8b31-f1a6aaa89a9a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1332 microversion: 2.1 time: 2.040573 Aug 09 17:06:47.501548 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 414/818] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:45 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1332 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:47.507159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1bf3a0ef-76bf-4c44-b525-226ddd5f1885 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:47.520646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1bf3a0ef-76bf-4c44-b525-226ddd5f1885 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:47.526827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=90 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:47.529702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e9c3f7-cfb3-4c0d-a05a-7a0081d3733a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:47.529957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bf3a0ef-76bf-4c44-b525-226ddd5f1885 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:47.530744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bf3a0ef-76bf-4c44-b525-226ddd5f1885 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:47.530938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e9c3f7-cfb3-4c0d-a05a-7a0081d3733a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:47.531585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bf3a0ef-76bf-4c44-b525-226ddd5f1885 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:47.531869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e9c3f7-cfb3-4c0d-a05a-7a0081d3733a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:47.532622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bf3a0ef-76bf-4c44-b525-226ddd5f1885 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:47.533063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e9c3f7-cfb3-4c0d-a05a-7a0081d3733a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:47.533672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bf3a0ef-76bf-4c44-b525-226ddd5f1885 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:47.534454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e9c3f7-cfb3-4c0d-a05a-7a0081d3733a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:47.535078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e9c3f7-cfb3-4c0d-a05a-7a0081d3733a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:47.547679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bf3a0ef-76bf-4c44-b525-226ddd5f1885 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:48.164055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:48.231868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-56e9c3f7-cfb3-4c0d-a05a-7a0081d3733a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:48.248802 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-56e9c3f7-cfb3-4c0d-a05a-7a0081d3733a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1322 microversion: 2.1 time: 0.756793 Aug 09 17:06:48.262053 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 405/819] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:47 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1322 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:48.433205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1bf3a0ef-76bf-4c44-b525-226ddd5f1885 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:48.443086 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1bf3a0ef-76bf-4c44-b525-226ddd5f1885 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1311 microversion: 2.1 time: 0.940140 Aug 09 17:06:48.460037 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 415/820] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:47 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1311 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:48.475095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2b527584-cd48-4955-b694-25e76816e1f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbab5040>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:48.629866 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2b527584-cd48-4955-b694-25e76816e1f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.167765 Aug 09 17:06:48.637836 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 416/821] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:48 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:48.660962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-38d98468-954c-40a5-8650-971665be8b4c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:48.664567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-38d98468-954c-40a5-8650-971665be8b4c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:48.691438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38d98468-954c-40a5-8650-971665be8b4c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:48.695731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38d98468-954c-40a5-8650-971665be8b4c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:48.698732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38d98468-954c-40a5-8650-971665be8b4c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:48.700541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38d98468-954c-40a5-8650-971665be8b4c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:48.704308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38d98468-954c-40a5-8650-971665be8b4c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:48.706211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38d98468-954c-40a5-8650-971665be8b4c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:49.008500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-38d98468-954c-40a5-8650-971665be8b4c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:49.022788 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-38d98468-954c-40a5-8650-971665be8b4c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1336 microversion: 2.1 time: 0.380068 Aug 09 17:06:49.023926 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 417/822] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:48 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1336 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:49.029935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c505ff6e-1a5a-4966-9e08-b423707e5933 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:49.030843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c505ff6e-1a5a-4966-9e08-b423707e5933 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:49.046412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c505ff6e-1a5a-4966-9e08-b423707e5933 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:49.050103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c505ff6e-1a5a-4966-9e08-b423707e5933 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:49.052359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c505ff6e-1a5a-4966-9e08-b423707e5933 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:49.055842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c505ff6e-1a5a-4966-9e08-b423707e5933 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:49.059264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c505ff6e-1a5a-4966-9e08-b423707e5933 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:49.060079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c505ff6e-1a5a-4966-9e08-b423707e5933 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:49.243315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd25b8ad-b3d3-41de-9dfc-08b7b09875b3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:49.244940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd25b8ad-b3d3-41de-9dfc-08b7b09875b3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:49.271771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd25b8ad-b3d3-41de-9dfc-08b7b09875b3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:49.272799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd25b8ad-b3d3-41de-9dfc-08b7b09875b3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:49.275194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd25b8ad-b3d3-41de-9dfc-08b7b09875b3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:49.276319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd25b8ad-b3d3-41de-9dfc-08b7b09875b3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:49.278685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd25b8ad-b3d3-41de-9dfc-08b7b09875b3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:49.280185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd25b8ad-b3d3-41de-9dfc-08b7b09875b3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:49.589683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-cd25b8ad-b3d3-41de-9dfc-08b7b09875b3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid 1ddc1848-1711-406c-947a-94149934b5d3 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:06:49.767233 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd25b8ad-b3d3-41de-9dfc-08b7b09875b3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 2049 microversion: 2.25 time: 1.500596 Aug 09 17:06:49.770322 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 406/823] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:48 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 2049 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:06:49.793959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e61e4f41-0077-4201-b491-b0eece45ba54 req-14989f93-8e89-42c7-ba3b-7b24dacc9392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d072da6d-dab4-4ee5-ab0c-944b47668dc4", "tag": "5980adca-fd87-47c1-acd8-bfb70ad45f17"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:49.795592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c505ff6e-1a5a-4966-9e08-b423707e5933 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:49.811012 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c505ff6e-1a5a-4966-9e08-b423707e5933 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1332 microversion: 2.1 time: 0.784883 Aug 09 17:06:49.812101 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 418/824] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:49 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1332 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:49.829478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-774f8ae8-897e-4354-8119-237afb63c997 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:49.831018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-774f8ae8-897e-4354-8119-237afb63c997 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:49.859971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-774f8ae8-897e-4354-8119-237afb63c997 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:49.860974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-774f8ae8-897e-4354-8119-237afb63c997 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:49.861737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-774f8ae8-897e-4354-8119-237afb63c997 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:49.862744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-774f8ae8-897e-4354-8119-237afb63c997 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:49.863617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-774f8ae8-897e-4354-8119-237afb63c997 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:49.864419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-774f8ae8-897e-4354-8119-237afb63c997 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:49.865458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e61e4f41-0077-4201-b491-b0eece45ba54 req-14989f93-8e89-42c7-ba3b-7b24dacc9392 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:49.866422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e61e4f41-0077-4201-b491-b0eece45ba54 req-14989f93-8e89-42c7-ba3b-7b24dacc9392 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:49.886105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e61e4f41-0077-4201-b491-b0eece45ba54 req-14989f93-8e89-42c7-ba3b-7b24dacc9392 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:49.952308 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e61e4f41-0077-4201-b491-b0eece45ba54 req-14989f93-8e89-42c7-ba3b-7b24dacc9392 service nova] Creating event network-changed:5980adca-fd87-47c1-acd8-bfb70ad45f17 for instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 on n-h2-845781-6 Aug 09 17:06:49.981792 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e61e4f41-0077-4201-b491-b0eece45ba54 req-14989f93-8e89-42c7-ba3b-7b24dacc9392 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208421 Aug 09 17:06:49.982532 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 407/825] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:49.999379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87d4ce59-cef7-4299-801b-18f249ca9834 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:50.001847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87d4ce59-cef7-4299-801b-18f249ca9834 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:50.031475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87d4ce59-cef7-4299-801b-18f249ca9834 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:50.032033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87d4ce59-cef7-4299-801b-18f249ca9834 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:50.032484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87d4ce59-cef7-4299-801b-18f249ca9834 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:50.033226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87d4ce59-cef7-4299-801b-18f249ca9834 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:50.033700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87d4ce59-cef7-4299-801b-18f249ca9834 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:50.034139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87d4ce59-cef7-4299-801b-18f249ca9834 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:50.370297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87d4ce59-cef7-4299-801b-18f249ca9834 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:50.391615 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87d4ce59-cef7-4299-801b-18f249ca9834 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1495 microversion: 2.1 time: 0.406335 Aug 09 17:06:50.392512 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 408/826] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:49 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1495 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:50.418651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c66daece-a10a-49d5-9ac1-23be42e41e8b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbabde50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:50.568240 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c66daece-a10a-49d5-9ac1-23be42e41e8b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.156997 Aug 09 17:06:50.573477 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 409/827] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:50 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:50.595519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-afb86c0e-c95e-4f64-9d84-432ef7122711 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:50.599846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-afb86c0e-c95e-4f64-9d84-432ef7122711 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:50.661371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-afb86c0e-c95e-4f64-9d84-432ef7122711 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:50.666577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-afb86c0e-c95e-4f64-9d84-432ef7122711 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:50.673188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-afb86c0e-c95e-4f64-9d84-432ef7122711 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:50.681571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-afb86c0e-c95e-4f64-9d84-432ef7122711 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:50.683038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-afb86c0e-c95e-4f64-9d84-432ef7122711 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:50.695479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-afb86c0e-c95e-4f64-9d84-432ef7122711 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:50.900621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-774f8ae8-897e-4354-8119-237afb63c997 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:50.966969 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-774f8ae8-897e-4354-8119-237afb63c997 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1322 microversion: 2.1 time: 1.138938 Aug 09 17:06:50.973644 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 419/828] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:49 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1322 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:51.016625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0393acb0-416b-4f0b-86a0-60278d4ac7cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:51.023215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0393acb0-416b-4f0b-86a0-60278d4ac7cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:51.056220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0393acb0-416b-4f0b-86a0-60278d4ac7cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:51.059299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0393acb0-416b-4f0b-86a0-60278d4ac7cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:51.063156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0393acb0-416b-4f0b-86a0-60278d4ac7cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:51.071065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0393acb0-416b-4f0b-86a0-60278d4ac7cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:51.076384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0393acb0-416b-4f0b-86a0-60278d4ac7cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:51.082571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0393acb0-416b-4f0b-86a0-60278d4ac7cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:51.240664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-afb86c0e-c95e-4f64-9d84-432ef7122711 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid 1ddc1848-1711-406c-947a-94149934b5d3 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:06:51.276815 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-afb86c0e-c95e-4f64-9d84-432ef7122711 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 2049 microversion: 2.25 time: 0.700690 Aug 09 17:06:51.278725 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 410/829] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:06:50 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 2049 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:06:51.741271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d94e9184-b348-4c49-aaa2-d7c1a520fa09 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Calling method '.version_select at 0x7fbbcb9d6dc0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:51.798725 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d94e9184-b348-4c49-aaa2-d7c1a520fa09 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] HTTP exception thrown: Image not found. Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d94e9184-b348-4c49-aaa2-d7c1a520fa09 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Request method failure captured: Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/images/da4ee464-1525-47db-ab81-471e458e167f/metadata/os_distro HTTP/1.1 Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQqwuu61wphSUYm2Y1mbQBlKnYB3wvjLfNSDfU5RuDP5-nGr91C65j_SaOv16JoC64Y-KFmRQXxpSVaiyC-L4_5qV0K035N0sSi9-TJHhEQMrhIhDC2mLIuZWt0Rs6PEsYNyRrq78iiOWY9yAyGHVa3UT_3nyXs_-KUu6ZjjveaOpo Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:06:51.823532 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: bb924e46be614354a836e1c1bea6a002 Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'image_id': 'da4ee464-1525-47db-ab81-471e458e167f', 'id': 'os_distro'} Aug 09 17:06:51.825021 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:51.825810 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID da4ee464-1525-47db-ab81-471e458e167f Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:51.827021 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da4ee464-1525-47db-ab81-471e458e167f could not be found. Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:06:51.830270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:51.833008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d94e9184-b348-4c49-aaa2-d7c1a520fa09 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:51.835272 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d94e9184-b348-4c49-aaa2-d7c1a520fa09 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] 10.222.0.93 "DELETE /compute/v2.1/images/da4ee464-1525-47db-ab81-471e458e167f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.550659 Aug 09 17:06:51.845183 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 411/830] 10.222.0.93 () {58 vars in 1293 bytes} [Tue Aug 9 17:06:51 2022] DELETE /compute/v2.1/images/da4ee464-1525-47db-ab81-471e458e167f/metadata/os_distro => generated 62 bytes in 565 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:06:51.856081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88e3148c-269d-4ce7-a71e-28ac2f3fecad tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:51.857776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88e3148c-269d-4ce7-a71e-28ac2f3fecad tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:51.881055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e3148c-269d-4ce7-a71e-28ac2f3fecad tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:51.883688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e3148c-269d-4ce7-a71e-28ac2f3fecad tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:51.884343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e3148c-269d-4ce7-a71e-28ac2f3fecad tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:51.885347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e3148c-269d-4ce7-a71e-28ac2f3fecad tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:51.886063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e3148c-269d-4ce7-a71e-28ac2f3fecad tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:51.888918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e3148c-269d-4ce7-a71e-28ac2f3fecad tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:51.923553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:51.978227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0393acb0-416b-4f0b-86a0-60278d4ac7cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:51.988954 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0393acb0-416b-4f0b-86a0-60278d4ac7cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1378 microversion: 2.1 time: 1.011745 Aug 09 17:06:51.990491 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 420/831] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:50 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1378 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:52.010467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2bb2d567-e434-4787-aa9e-42ca0b2650ca tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:52.012192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2bb2d567-e434-4787-aa9e-42ca0b2650ca tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:52.022066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bb2d567-e434-4787-aa9e-42ca0b2650ca tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:52.022980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bb2d567-e434-4787-aa9e-42ca0b2650ca tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:52.023658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bb2d567-e434-4787-aa9e-42ca0b2650ca tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:52.024628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bb2d567-e434-4787-aa9e-42ca0b2650ca tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:52.025328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bb2d567-e434-4787-aa9e-42ca0b2650ca tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:52.025960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bb2d567-e434-4787-aa9e-42ca0b2650ca tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:52.121113 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88e3148c-269d-4ce7-a71e-28ac2f3fecad tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1646 microversion: 2.1 time: 0.273792 Aug 09 17:06:52.136692 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 412/832] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:51 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1646 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:52.144750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-36a950f5-0515-4de1-af8a-7ef78c58d189 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:52.149726 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:06:52.149726 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:06:52.151527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a950f5-0515-4de1-af8a-7ef78c58d189 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:52.152439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a950f5-0515-4de1-af8a-7ef78c58d189 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:52.153114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a950f5-0515-4de1-af8a-7ef78c58d189 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:52.154268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a950f5-0515-4de1-af8a-7ef78c58d189 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:52.154951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a950f5-0515-4de1-af8a-7ef78c58d189 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:52.155586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a950f5-0515-4de1-af8a-7ef78c58d189 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:52.204133 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-36a950f5-0515-4de1-af8a-7ef78c58d189 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.060872 Aug 09 17:06:52.209319 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 413/833] 10.222.0.93 () {60 vars in 1217 bytes} [Tue Aug 9 17:06:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:06:52.215521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b43e315f-9e46-4290-98fa-17afd58165d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbf04160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:52.349647 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b43e315f-9e46-4290-98fa-17afd58165d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.138568 Aug 09 17:06:52.351786 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 414/834] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:52 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:52.361365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b46764d4-a2d1-42ff-828d-c032ba1d39f1 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Calling method '.version_select at 0x7fbbcb984550>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:52.402012 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b46764d4-a2d1-42ff-828d-c032ba1d39f1 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] HTTP exception thrown: Image not found. Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b46764d4-a2d1-42ff-828d-c032ba1d39f1 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Request method failure captured: Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/images/7a09deb6-18de-4e4c-ada0-c38f61fa1046/metadata/os_version HTTP/1.1 Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQqwuu61wphSUYm2Y1mbQBlKnYB3wvjLfNSDfU5RuDP5-nGr91C65j_SaOv16JoC64Y-KFmRQXxpSVaiyC-L4_5qV0K035N0sSi9-TJHhEQMrhIhDC2mLIuZWt0Rs6PEsYNyRrq78iiOWY9yAyGHVa3UT_3nyXs_-KUu6ZjjveaOpo Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:06:52.405951 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: bb924e46be614354a836e1c1bea6a002 Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'image_id': '7a09deb6-18de-4e4c-ada0-c38f61fa1046', 'id': 'os_version'} Aug 09 17:06:52.407496 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:52.408502 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7a09deb6-18de-4e4c-ada0-c38f61fa1046 Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:52.410023 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7a09deb6-18de-4e4c-ada0-c38f61fa1046 could not be found. Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:06:52.411497 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:06:52.412979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:52.419061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b46764d4-a2d1-42ff-828d-c032ba1d39f1 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:52.419476 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b46764d4-a2d1-42ff-828d-c032ba1d39f1 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] 10.222.0.93 "GET /compute/v2.1/images/7a09deb6-18de-4e4c-ada0-c38f61fa1046/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.064561 Aug 09 17:06:52.421007 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 415/835] 10.222.0.93 () {58 vars in 1293 bytes} [Tue Aug 9 17:06:52 2022] GET /compute/v2.1/images/7a09deb6-18de-4e4c-ada0-c38f61fa1046/metadata/os_version => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:06:52.430679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3fba696-d4eb-43e1-b59d-eab70f4b1d6d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:52.431606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c3fba696-d4eb-43e1-b59d-eab70f4b1d6d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:52.440938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3fba696-d4eb-43e1-b59d-eab70f4b1d6d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:52.441865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3fba696-d4eb-43e1-b59d-eab70f4b1d6d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:52.442735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3fba696-d4eb-43e1-b59d-eab70f4b1d6d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:52.444974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3fba696-d4eb-43e1-b59d-eab70f4b1d6d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:52.446169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3fba696-d4eb-43e1-b59d-eab70f4b1d6d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:52.446958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3fba696-d4eb-43e1-b59d-eab70f4b1d6d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:52.748647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c3fba696-d4eb-43e1-b59d-eab70f4b1d6d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:52.759972 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c3fba696-d4eb-43e1-b59d-eab70f4b1d6d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1322 microversion: 2.1 time: 0.337560 Aug 09 17:06:52.762268 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 416/836] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:52 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:52.782039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e8761ef8-d395-4ec6-9528-b5486ee36e1b tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:52.783002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e8761ef8-d395-4ec6-9528-b5486ee36e1b tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:52.791891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8761ef8-d395-4ec6-9528-b5486ee36e1b tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:52.793190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8761ef8-d395-4ec6-9528-b5486ee36e1b tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:52.793346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8761ef8-d395-4ec6-9528-b5486ee36e1b tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:52.794430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8761ef8-d395-4ec6-9528-b5486ee36e1b tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:52.795549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8761ef8-d395-4ec6-9528-b5486ee36e1b tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:52.795549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8761ef8-d395-4ec6-9528-b5486ee36e1b tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:52.859401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2bb2d567-e434-4787-aa9e-42ca0b2650ca tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:52.868037 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2bb2d567-e434-4787-aa9e-42ca0b2650ca tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1332 microversion: 2.1 time: 0.874815 Aug 09 17:06:52.868641 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 421/837] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:51 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1332 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:52.882758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-1834c79b-4c76-49bc-aeda-6d529865e42b req-121c22c1-2847-44b1-b9ba-274dc715d635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a93360c-22e7-48a0-8f10-ab756a21325d", "tag": "8cf56997-b952-4786-979c-78c1d6c3074e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:52.907817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1834c79b-4c76-49bc-aeda-6d529865e42b req-121c22c1-2847-44b1-b9ba-274dc715d635 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:52.909924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1834c79b-4c76-49bc-aeda-6d529865e42b req-121c22c1-2847-44b1-b9ba-274dc715d635 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:52.912240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1834c79b-4c76-49bc-aeda-6d529865e42b req-121c22c1-2847-44b1-b9ba-274dc715d635 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:52.941688 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-1834c79b-4c76-49bc-aeda-6d529865e42b req-121c22c1-2847-44b1-b9ba-274dc715d635 service nova] Creating event network-changed:8cf56997-b952-4786-979c-78c1d6c3074e for instance 7a93360c-22e7-48a0-8f10-ab756a21325d on n-h1-845781-6 Aug 09 17:06:52.959947 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-1834c79b-4c76-49bc-aeda-6d529865e42b req-121c22c1-2847-44b1-b9ba-274dc715d635 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085911 Aug 09 17:06:52.968131 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 422/838] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:52.984613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-437930dc-d02b-4a49-9373-45f5c923cea6 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-845781-6", "block_migration": "auto"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:52.993226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-437930dc-d02b-4a49-9373-45f5c923cea6 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:53.004304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-437930dc-d02b-4a49-9373-45f5c923cea6 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:53.005744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-437930dc-d02b-4a49-9373-45f5c923cea6 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:53.008939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-437930dc-d02b-4a49-9373-45f5c923cea6 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:53.010119 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e8761ef8-d395-4ec6-9528-b5486ee36e1b tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1646 microversion: 2.1 time: 0.245831 Aug 09 17:06:53.023669 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 417/839] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:52 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1646 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:53.024999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-437930dc-d02b-4a49-9373-45f5c923cea6 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:53.025994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-437930dc-d02b-4a49-9373-45f5c923cea6 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:53.029665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-437930dc-d02b-4a49-9373-45f5c923cea6 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:53.030763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:53.038256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ce5e9129-58fc-41ef-b218-0f0f1ea5c6c9 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Calling method '.version_select at 0x7fbbcbf041f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:53.064586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-437930dc-d02b-4a49-9373-45f5c923cea6 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'flavor' on Instance uuid 1ddc1848-1711-406c-947a-94149934b5d3 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:06:53.075504 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-ce5e9129-58fc-41ef-b218-0f0f1ea5c6c9 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] HTTP exception thrown: Image not found. Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ce5e9129-58fc-41ef-b218-0f0f1ea5c6c9 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Request method failure captured: Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/images/0509afc3-6c0f-4ab9-85bf-8055f8293ec2/metadata HTTP/1.1 Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQqwuu61wphSUYm2Y1mbQBlKnYB3wvjLfNSDfU5RuDP5-nGr91C65j_SaOv16JoC64Y-KFmRQXxpSVaiyC-L4_5qV0K035N0sSi9-TJHhEQMrhIhDC2mLIuZWt0Rs6PEsYNyRrq78iiOWY9yAyGHVa3UT_3nyXs_-KUu6ZjjveaOpo Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:06:53.080375 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: bb924e46be614354a836e1c1bea6a002 Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'image_id': '0509afc3-6c0f-4ab9-85bf-8055f8293ec2'} Aug 09 17:06:53.081793 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:53.082622 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0509afc3-6c0f-4ab9-85bf-8055f8293ec2 Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:53.084367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0509afc3-6c0f-4ab9-85bf-8055f8293ec2 could not be found. Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:06:53.086126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.087223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ce5e9129-58fc-41ef-b218-0f0f1ea5c6c9 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:53.088344 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ce5e9129-58fc-41ef-b218-0f0f1ea5c6c9 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] 10.222.0.93 "GET /compute/v2.1/images/0509afc3-6c0f-4ab9-85bf-8055f8293ec2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.069675 Aug 09 17:06:53.088344 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 418/840] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 17:06:53 2022] GET /compute/v2.1/images/0509afc3-6c0f-4ab9-85bf-8055f8293ec2/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:06:53.088505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-437930dc-d02b-4a49-9373-45f5c923cea6 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Going to try to live migrate instance to n-h1-845781-6 {{(pid=119432) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 17:06:53.091811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-272d521e-7219-4659-a3ee-65f76419a5a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:53.092441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-272d521e-7219-4659-a3ee-65f76419a5a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:53.113598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-272d521e-7219-4659-a3ee-65f76419a5a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:53.114376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-272d521e-7219-4659-a3ee-65f76419a5a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:53.116543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-272d521e-7219-4659-a3ee-65f76419a5a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:53.118177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-272d521e-7219-4659-a3ee-65f76419a5a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:53.120710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-272d521e-7219-4659-a3ee-65f76419a5a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:53.122516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-272d521e-7219-4659-a3ee-65f76419a5a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:53.173114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=22 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:53.556377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-272d521e-7219-4659-a3ee-65f76419a5a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:53.574367 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-272d521e-7219-4659-a3ee-65f76419a5a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1378 microversion: 2.1 time: 0.490679 Aug 09 17:06:53.577398 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 419/841] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:53 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1378 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:53.591867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c141f8c4-d2ff-4aec-b231-90f54e1b096c tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:53.596148 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:06:53.596148 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:06:53.599264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c141f8c4-d2ff-4aec-b231-90f54e1b096c tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:53.599972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c141f8c4-d2ff-4aec-b231-90f54e1b096c tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:53.601201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c141f8c4-d2ff-4aec-b231-90f54e1b096c tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:53.602006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c141f8c4-d2ff-4aec-b231-90f54e1b096c tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:53.602614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c141f8c4-d2ff-4aec-b231-90f54e1b096c tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:53.603243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c141f8c4-d2ff-4aec-b231-90f54e1b096c tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:53.720257 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c141f8c4-d2ff-4aec-b231-90f54e1b096c tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.140443 Aug 09 17:06:53.727113 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 420/842] 10.222.0.93 () {58 vars in 1176 bytes} [Tue Aug 9 17:06:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:53.744769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b20c6f0-a3a8-4df7-8fc9-cdc229083133 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Action: 'update_all', calling method: .version_select at 0x7fbbcbf04550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:53.797716 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-6b20c6f0-a3a8-4df7-8fc9-cdc229083133 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] HTTP exception thrown: Image not found. Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b20c6f0-a3a8-4df7-8fc9-cdc229083133 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Request method failure captured: Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: request: PUT /compute/v2.1/images/68bf04e5-6867-40f7-97c1-e1f15f1bb1a4/metadata HTTP/1.1 Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 57 Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQqwuu61wphSUYm2Y1mbQBlKnYB3wvjLfNSDfU5RuDP5-nGr91C65j_SaOv16JoC64Y-KFmRQXxpSVaiyC-L4_5qV0K035N0sSi9-TJHhEQMrhIhDC2mLIuZWt0Rs6PEsYNyRrq78iiOWY9yAyGHVa3UT_3nyXs_-KUu6ZjjveaOpo Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:06:53.800417 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: bb924e46be614354a836e1c1bea6a002 Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:06:53.801803 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'image_id': '68bf04e5-6867-40f7-97c1-e1f15f1bb1a4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:53.802670 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 68bf04e5-6867-40f7-97c1-e1f15f1bb1a4 Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:53.804676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 68bf04e5-6867-40f7-97c1-e1f15f1bb1a4 could not be found. Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:53.805792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:06:53.808876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:53.811722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b20c6f0-a3a8-4df7-8fc9-cdc229083133 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:53.811722 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b20c6f0-a3a8-4df7-8fc9-cdc229083133 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] 10.222.0.93 "PUT /compute/v2.1/images/68bf04e5-6867-40f7-97c1-e1f15f1bb1a4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.077814 Aug 09 17:06:53.814634 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 421/843] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:06:53 2022] PUT /compute/v2.1/images/68bf04e5-6867-40f7-97c1-e1f15f1bb1a4/metadata => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:06:53.831359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11bd4a62-a08c-41fa-9d50-d49337d4c9bb tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbb13670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:53.911774 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11bd4a62-a08c-41fa-9d50-d49337d4c9bb tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.095324 Aug 09 17:06:53.912869 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 422/844] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:53 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:53.919256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6aae0fc8-0933-4ae9-bc75-65f0dceb7ff9 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:53.920116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6aae0fc8-0933-4ae9-bc75-65f0dceb7ff9 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:53.929670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6aae0fc8-0933-4ae9-bc75-65f0dceb7ff9 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:53.930354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6aae0fc8-0933-4ae9-bc75-65f0dceb7ff9 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:53.930973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6aae0fc8-0933-4ae9-bc75-65f0dceb7ff9 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:53.932084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6aae0fc8-0933-4ae9-bc75-65f0dceb7ff9 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:53.932789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6aae0fc8-0933-4ae9-bc75-65f0dceb7ff9 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:53.933543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6aae0fc8-0933-4ae9-bc75-65f0dceb7ff9 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:54.091040 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6aae0fc8-0933-4ae9-bc75-65f0dceb7ff9 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930/action" status: 202 len: 0 microversion: 2.1 time: 0.175888 Aug 09 17:06:54.092399 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 423/845] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:06:53 2022] POST /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:06:54.116466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-846e9004-1b6b-4530-845e-9b0ee3538a7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:54.117886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-846e9004-1b6b-4530-845e-9b0ee3538a7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:54.139200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846e9004-1b6b-4530-845e-9b0ee3538a7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:54.139754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846e9004-1b6b-4530-845e-9b0ee3538a7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:54.140326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846e9004-1b6b-4530-845e-9b0ee3538a7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:54.141082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846e9004-1b6b-4530-845e-9b0ee3538a7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:54.142307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846e9004-1b6b-4530-845e-9b0ee3538a7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:54.150317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846e9004-1b6b-4530-845e-9b0ee3538a7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:54.561760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-846e9004-1b6b-4530-845e-9b0ee3538a7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:54.573369 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-846e9004-1b6b-4530-845e-9b0ee3538a7d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1322 microversion: 2.1 time: 0.476238 Aug 09 17:06:54.594144 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 424/846] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:54 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:54.602650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b2d6537-c82a-449b-abb1-9736e2d248fe tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Action: 'update', calling method: .version_select at 0x7fbbcb9614c0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:54.645365 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-6b2d6537-c82a-449b-abb1-9736e2d248fe tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] HTTP exception thrown: Image not found. Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b2d6537-c82a-449b-abb1-9736e2d248fe tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Request method failure captured: Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: request: PUT /compute/v2.1/images/66b62e28-1937-4c89-b969-1f9f8812c0dd/metadata/os_distro HTTP/1.1 Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 30 Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQqwuu61wphSUYm2Y1mbQBlKnYB3wvjLfNSDfU5RuDP5-nGr91C65j_SaOv16JoC64Y-KFmRQXxpSVaiyC-L4_5qV0K035N0sSi9-TJHhEQMrhIhDC2mLIuZWt0Rs6PEsYNyRrq78iiOWY9yAyGHVa3UT_3nyXs_-KUu6ZjjveaOpo Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:06:54.657282 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: bb924e46be614354a836e1c1bea6a002 Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: {"meta": {"os_distro": "alt"}} Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:06:54.659010 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'image_id': '66b62e28-1937-4c89-b969-1f9f8812c0dd', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:54.660016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 66b62e28-1937-4c89-b969-1f9f8812c0dd Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:54.662035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66b62e28-1937-4c89-b969-1f9f8812c0dd could not be found. Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:54.664015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:06:54.665889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:54.669356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b2d6537-c82a-449b-abb1-9736e2d248fe tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:54.669356 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b2d6537-c82a-449b-abb1-9736e2d248fe tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] 10.222.0.93 "PUT /compute/v2.1/images/66b62e28-1937-4c89-b969-1f9f8812c0dd/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.062455 Aug 09 17:06:54.669356 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 425/847] 10.222.0.93 () {60 vars in 1310 bytes} [Tue Aug 9 17:06:54 2022] PUT /compute/v2.1/images/66b62e28-1937-4c89-b969-1f9f8812c0dd/metadata/os_distro => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:06:54.675486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b78f5649-d85e-4d66-915c-3a4efb3d3faa tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:54.683593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b78f5649-d85e-4d66-915c-3a4efb3d3faa tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:54.693394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b78f5649-d85e-4d66-915c-3a4efb3d3faa tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:54.693897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b78f5649-d85e-4d66-915c-3a4efb3d3faa tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:54.694376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b78f5649-d85e-4d66-915c-3a4efb3d3faa tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:54.695251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b78f5649-d85e-4d66-915c-3a4efb3d3faa tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:54.695821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b78f5649-d85e-4d66-915c-3a4efb3d3faa tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:54.696241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b78f5649-d85e-4d66-915c-3a4efb3d3faa tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:54.999410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:55.086461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b78f5649-d85e-4d66-915c-3a4efb3d3faa tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:55.115164 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b78f5649-d85e-4d66-915c-3a4efb3d3faa tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1332 microversion: 2.1 time: 0.445255 Aug 09 17:06:55.127667 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 426/848] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:54 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1332 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:55.127667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cffc32f0-433e-4c3c-9817-70881634a78d tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:55.127667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cffc32f0-433e-4c3c-9817-70881634a78d tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:55.151539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cffc32f0-433e-4c3c-9817-70881634a78d tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:55.152253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cffc32f0-433e-4c3c-9817-70881634a78d tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:55.154196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cffc32f0-433e-4c3c-9817-70881634a78d tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:55.156508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cffc32f0-433e-4c3c-9817-70881634a78d tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:55.157634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cffc32f0-433e-4c3c-9817-70881634a78d tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:55.158877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cffc32f0-433e-4c3c-9817-70881634a78d tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:55.532191 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cffc32f0-433e-4c3c-9817-70881634a78d tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1631 microversion: 2.1 time: 0.412123 Aug 09 17:06:55.534416 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 427/849] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:55 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1631 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:55.567309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-08155fbf-914d-416d-bb3a-11ed69faecdf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:55.569100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-08155fbf-914d-416d-bb3a-11ed69faecdf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:55.582342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08155fbf-914d-416d-bb3a-11ed69faecdf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:55.583854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08155fbf-914d-416d-bb3a-11ed69faecdf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:55.585557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08155fbf-914d-416d-bb3a-11ed69faecdf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:55.587844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08155fbf-914d-416d-bb3a-11ed69faecdf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:55.588957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08155fbf-914d-416d-bb3a-11ed69faecdf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:55.590035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08155fbf-914d-416d-bb3a-11ed69faecdf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:55.890029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-08155fbf-914d-416d-bb3a-11ed69faecdf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:55.900943 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-08155fbf-914d-416d-bb3a-11ed69faecdf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1378 microversion: 2.1 time: 0.362489 Aug 09 17:06:55.901789 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 428/850] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:55 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1378 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:55.908111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-357f73c2-cc26-4e5a-ba1c-98da0b588d82 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Action: 'create', calling method: .version_select at 0x7fbbcbe8ca60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:55.939190 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-357f73c2-cc26-4e5a-ba1c-98da0b588d82 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] HTTP exception thrown: Image not found. Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-357f73c2-cc26-4e5a-ba1c-98da0b588d82 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Request method failure captured: Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/images/532bfb24-0c69-425c-ace5-e71aa580acc0/metadata HTTP/1.1 Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 57 Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQqwuu61wphSUYm2Y1mbQBlKnYB3wvjLfNSDfU5RuDP5-nGr91C65j_SaOv16JoC64Y-KFmRQXxpSVaiyC-L4_5qV0K035N0sSi9-TJHhEQMrhIhDC2mLIuZWt0Rs6PEsYNyRrq78iiOWY9yAyGHVa3UT_3nyXs_-KUu6ZjjveaOpo Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:06:55.943482 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1910f3ba99a04b9eb3b758e7038fdeea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1910f3ba99a04b9eb3b758e7038fdeea Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-581857407 Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: bb924e46be614354a836e1c1bea6a002 Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-581857407-project Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:06:55.945558 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'image_id': '532bfb24-0c69-425c-ace5-e71aa580acc0', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:55.946387 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 532bfb24-0c69-425c-ace5-e71aa580acc0 Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:06:55.947439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 532bfb24-0c69-425c-ace5-e71aa580acc0 could not be found. Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:06:55.948587 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:06:55.949680 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:06:55.954641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-357f73c2-cc26-4e5a-ba1c-98da0b588d82 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:06:55.958813 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-357f73c2-cc26-4e5a-ba1c-98da0b588d82 tempest-ImagesMetadataNegativeTestJSON-581857407 tempest-ImagesMetadataNegativeTestJSON-581857407-project] 10.222.0.93 "POST /compute/v2.1/images/532bfb24-0c69-425c-ace5-e71aa580acc0/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055548 Aug 09 17:06:55.962146 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 429/851] 10.222.0.93 () {60 vars in 1281 bytes} [Tue Aug 9 17:06:55 2022] POST /compute/v2.1/images/532bfb24-0c69-425c-ace5-e71aa580acc0/metadata => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:06:55.977571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-41a6a4e3-fa20-4dfc-bc2d-ad03eae0db4b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb9610d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:56.067755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-41a6a4e3-fa20-4dfc-bc2d-ad03eae0db4b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.103992 Aug 09 17:06:56.077251 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 430/852] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:55 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:56.083201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-549cd993-2bf8-426a-be13-050e98e3a0a1 req-224dee2a-1120-48cf-8aee-eccdb1893732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a07b5bb-7014-4708-a343-520f1b468a9c", "tag": "2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:56.098894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-549cd993-2bf8-426a-be13-050e98e3a0a1 req-224dee2a-1120-48cf-8aee-eccdb1893732 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:56.101627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-549cd993-2bf8-426a-be13-050e98e3a0a1 req-224dee2a-1120-48cf-8aee-eccdb1893732 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:56.102418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-549cd993-2bf8-426a-be13-050e98e3a0a1 req-224dee2a-1120-48cf-8aee-eccdb1893732 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:56.116881 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-549cd993-2bf8-426a-be13-050e98e3a0a1 req-224dee2a-1120-48cf-8aee-eccdb1893732 service nova] Creating event network-changed:2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34 for instance 9a07b5bb-7014-4708-a343-520f1b468a9c on n-h1-845781-6 Aug 09 17:06:56.123409 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-549cd993-2bf8-426a-be13-050e98e3a0a1 req-224dee2a-1120-48cf-8aee-eccdb1893732 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044743 Aug 09 17:06:56.124681 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 431/853] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:56.138039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a80e36cc-0d8c-4f1c-b328-0775e5cf8981 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-845781-6", "block_migration": true, "disk_over_commit": false}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:56.141975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a80e36cc-0d8c-4f1c-b328-0775e5cf8981 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:56.157504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80e36cc-0d8c-4f1c-b328-0775e5cf8981 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:56.158806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80e36cc-0d8c-4f1c-b328-0775e5cf8981 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:56.159493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80e36cc-0d8c-4f1c-b328-0775e5cf8981 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:56.160490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80e36cc-0d8c-4f1c-b328-0775e5cf8981 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:56.161380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80e36cc-0d8c-4f1c-b328-0775e5cf8981 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:56.161963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80e36cc-0d8c-4f1c-b328-0775e5cf8981 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:56.282649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-a80e36cc-0d8c-4f1c-b328-0775e5cf8981 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lazy-loading 'flavor' on Instance uuid 2fec2f16-7d50-4468-be26-23c4e25c2930 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:06:56.376919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a80e36cc-0d8c-4f1c-b328-0775e5cf8981 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Going to try to live migrate instance to n-h2-845781-6 {{(pid=119431) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 17:06:57.179436 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-437930dc-d02b-4a49-9373-45f5c923cea6 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3/action" status: 202 len: 0 microversion: 2.25 time: 4.209038 Aug 09 17:06:57.183784 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 423/854] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:06:52 2022] POST /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3/action => generated 0 bytes in 4212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:06:57.188428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-c60c8aa1-9bb8-4159-99e5-38052e439af5 req-0cc95842-81c4-4da1-973c-7275ace8281d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d072da6d-dab4-4ee5-ab0c-944b47668dc4", "name": "network-vif-plugged", "status": "completed", "tag": "5980adca-fd87-47c1-acd8-bfb70ad45f17"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:06:57.230281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c60c8aa1-9bb8-4159-99e5-38052e439af5 req-0cc95842-81c4-4da1-973c-7275ace8281d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:57.231620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c60c8aa1-9bb8-4159-99e5-38052e439af5 req-0cc95842-81c4-4da1-973c-7275ace8281d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:57.234850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c60c8aa1-9bb8-4159-99e5-38052e439af5 req-0cc95842-81c4-4da1-973c-7275ace8281d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:57.265551 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-c60c8aa1-9bb8-4159-99e5-38052e439af5 req-0cc95842-81c4-4da1-973c-7275ace8281d service nova] Creating event network-vif-plugged:5980adca-fd87-47c1-acd8-bfb70ad45f17 for instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 on n-h2-845781-6 Aug 09 17:06:57.283615 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-c60c8aa1-9bb8-4159-99e5-38052e439af5 req-0cc95842-81c4-4da1-973c-7275ace8281d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101092 Aug 09 17:06:57.284991 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 424/855] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:06:57.307678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:57.310734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:57.332508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:57.338957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:57.342233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:57.345630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:57.348451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:57.350379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:58.341077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:58.378186 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1322 microversion: 2.1 time: 1.090972 Aug 09 17:06:58.379494 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 425/856] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:57 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1322 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:58.382679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:58.384854 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e55a0290-436c-4bd2-9533-721720eadcd7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003142 Aug 09 17:06:58.386833 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 426/857] 10.222.0.93 () {56 vars in 886 bytes} [Tue Aug 9 17:06:58 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 09 17:06:58.400592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f3af493e-8ba4-43d1-8cd8-36b016b3643c tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:58.401751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f3af493e-8ba4-43d1-8cd8-36b016b3643c tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:58.440828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3af493e-8ba4-43d1-8cd8-36b016b3643c tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:58.446200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3af493e-8ba4-43d1-8cd8-36b016b3643c tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:58.450187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3af493e-8ba4-43d1-8cd8-36b016b3643c tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:58.451470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3af493e-8ba4-43d1-8cd8-36b016b3643c tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:58.455071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3af493e-8ba4-43d1-8cd8-36b016b3643c tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:58.456421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3af493e-8ba4-43d1-8cd8-36b016b3643c tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:59.278568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f3af493e-8ba4-43d1-8cd8-36b016b3643c tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:06:59.299790 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f3af493e-8ba4-43d1-8cd8-36b016b3643c tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1332 microversion: 2.1 time: 0.911495 Aug 09 17:06:59.305250 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 427/858] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:58 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1332 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:06:59.325368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0940055a-6132-488d-8546-89b5121c2788 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:06:59.337614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0940055a-6132-488d-8546-89b5121c2788 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:06:59.372513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:06:59.382574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0940055a-6132-488d-8546-89b5121c2788 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:59.386392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0940055a-6132-488d-8546-89b5121c2788 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:59.392697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0940055a-6132-488d-8546-89b5121c2788 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:59.398197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0940055a-6132-488d-8546-89b5121c2788 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:06:59.403239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0940055a-6132-488d-8546-89b5121c2788 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:06:59.407819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0940055a-6132-488d-8546-89b5121c2788 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:06:59.945744 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a80e36cc-0d8c-4f1c-b328-0775e5cf8981 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930/action" status: 202 len: 0 microversion: 2.1 time: 3.819416 Aug 09 17:06:59.951285 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 432/859] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:06:56 2022] POST /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930/action => generated 0 bytes in 3826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:06:59.962842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b97178fa-0fc3-4290-bd29-41d3f381b955 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb8f0a60>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:00.024927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0940055a-6132-488d-8546-89b5121c2788 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:00.040081 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0940055a-6132-488d-8546-89b5121c2788 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1378 microversion: 2.1 time: 0.720358 Aug 09 17:07:00.042588 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 428/860] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:06:59 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1378 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:00.058566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:00.067038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:00.112458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:00.113139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:00.113833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:00.115133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:00.116530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:00.117115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:00.180034 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b97178fa-0fc3-4290-bd29-41d3f381b955 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1413 microversion: 2.1 time: 0.224965 Aug 09 17:07:00.183895 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 433/861] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:06:59 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1413 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:00.195943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0ffbf5ee-83c1-46fd-a8b1-36db97124ad9 req-73fb61fc-c234-4a05-9807-213fce638877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a93360c-22e7-48a0-8f10-ab756a21325d", "name": "network-vif-plugged", "status": "completed", "tag": "8cf56997-b952-4786-979c-78c1d6c3074e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:00.245262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0ffbf5ee-83c1-46fd-a8b1-36db97124ad9 req-73fb61fc-c234-4a05-9807-213fce638877 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:00.245987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0ffbf5ee-83c1-46fd-a8b1-36db97124ad9 req-73fb61fc-c234-4a05-9807-213fce638877 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:00.247274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0ffbf5ee-83c1-46fd-a8b1-36db97124ad9 req-73fb61fc-c234-4a05-9807-213fce638877 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:00.274482 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0ffbf5ee-83c1-46fd-a8b1-36db97124ad9 req-73fb61fc-c234-4a05-9807-213fce638877 service nova] Creating event network-vif-plugged:8cf56997-b952-4786-979c-78c1d6c3074e for instance 7a93360c-22e7-48a0-8f10-ab756a21325d on n-h1-845781-6 Aug 09 17:07:00.282456 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0ffbf5ee-83c1-46fd-a8b1-36db97124ad9 req-73fb61fc-c234-4a05-9807-213fce638877 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095891 Aug 09 17:07:00.283089 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 434/862] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:00.293336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7cfe6f99-fc31-4816-bf70-7cdc514f52e0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:00.294826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7cfe6f99-fc31-4816-bf70-7cdc514f52e0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:00.319403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cfe6f99-fc31-4816-bf70-7cdc514f52e0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:00.320393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cfe6f99-fc31-4816-bf70-7cdc514f52e0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:00.321705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cfe6f99-fc31-4816-bf70-7cdc514f52e0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:00.322729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cfe6f99-fc31-4816-bf70-7cdc514f52e0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:00.326804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cfe6f99-fc31-4816-bf70-7cdc514f52e0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:00.327732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cfe6f99-fc31-4816-bf70-7cdc514f52e0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:00.915935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:00.945371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:00.958302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7cfe6f99-fc31-4816-bf70-7cdc514f52e0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:00.969420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:00.976388 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ca47bd43-c37d-48fb-9fab-42cee7a82d00 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1567 microversion: 2.25 time: 0.932191 Aug 09 17:07:00.989395 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 429/863] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:00 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1567 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:00.999476 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7cfe6f99-fc31-4816-bf70-7cdc514f52e0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1472 microversion: 2.1 time: 0.714087 Aug 09 17:07:01.000835 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 435/864] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:00 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1472 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:01.028775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fb491ecc-3746-4062-9f35-85a97dd01170 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:01.031111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fb491ecc-3746-4062-9f35-85a97dd01170 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:01.039467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2dce6bbd-dee8-4635-85e8-a31ad186fcfe tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:01.043711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb491ecc-3746-4062-9f35-85a97dd01170 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:01.043954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2dce6bbd-dee8-4635-85e8-a31ad186fcfe tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:01.044708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb491ecc-3746-4062-9f35-85a97dd01170 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:01.045554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb491ecc-3746-4062-9f35-85a97dd01170 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:01.046677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb491ecc-3746-4062-9f35-85a97dd01170 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:01.047374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb491ecc-3746-4062-9f35-85a97dd01170 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:01.048376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb491ecc-3746-4062-9f35-85a97dd01170 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:01.056474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2dce6bbd-dee8-4635-85e8-a31ad186fcfe tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:01.057352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2dce6bbd-dee8-4635-85e8-a31ad186fcfe tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:01.058149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2dce6bbd-dee8-4635-85e8-a31ad186fcfe tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:01.059450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2dce6bbd-dee8-4635-85e8-a31ad186fcfe tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:01.060261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2dce6bbd-dee8-4635-85e8-a31ad186fcfe tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:01.060949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2dce6bbd-dee8-4635-85e8-a31ad186fcfe tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:01.447543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2dce6bbd-dee8-4635-85e8-a31ad186fcfe tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:01.472625 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2dce6bbd-dee8-4635-85e8-a31ad186fcfe tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1332 microversion: 2.1 time: 0.456942 Aug 09 17:07:01.478911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fb491ecc-3746-4062-9f35-85a97dd01170 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:01.480232 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 436/865] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:01 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1332 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:01.497090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b158014b-9235-49c3-9416-e17cdca5a8b4 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:01.497394 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fb491ecc-3746-4062-9f35-85a97dd01170 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1505 microversion: 2.1 time: 0.505838 Aug 09 17:07:01.497713 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 430/866] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:00 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:01.499287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b158014b-9235-49c3-9416-e17cdca5a8b4 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:01.517918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f993d926-70d4-4654-8b59-13e6c7718a95 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:01.518869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f993d926-70d4-4654-8b59-13e6c7718a95 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:01.525425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b158014b-9235-49c3-9416-e17cdca5a8b4 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:01.527099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b158014b-9235-49c3-9416-e17cdca5a8b4 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:01.528254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b158014b-9235-49c3-9416-e17cdca5a8b4 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:01.528894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f993d926-70d4-4654-8b59-13e6c7718a95 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:01.529845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f993d926-70d4-4654-8b59-13e6c7718a95 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:01.530030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b158014b-9235-49c3-9416-e17cdca5a8b4 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:01.530855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b158014b-9235-49c3-9416-e17cdca5a8b4 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:01.531155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f993d926-70d4-4654-8b59-13e6c7718a95 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:01.532106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b158014b-9235-49c3-9416-e17cdca5a8b4 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:01.532439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f993d926-70d4-4654-8b59-13e6c7718a95 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:01.533157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f993d926-70d4-4654-8b59-13e6c7718a95 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:01.533811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f993d926-70d4-4654-8b59-13e6c7718a95 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:01.589445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-b158014b-9235-49c3-9416-e17cdca5a8b4 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lazy-loading 'flavor' on Instance uuid d072da6d-dab4-4ee5-ab0c-944b47668dc4 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:07:01.598746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:01.720929 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b158014b-9235-49c3-9416-e17cdca5a8b4 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4/action" status: 202 len: 0 microversion: 2.1 time: 0.237943 Aug 09 17:07:01.722010 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 437/867] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:01 2022] POST /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:01.729002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ad32e50-9216-4213-ac09-ec39d9bdb3c0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb968af0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:01.801290 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ad32e50-9216-4213-ac09-ec39d9bdb3c0 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1422 microversion: 2.1 time: 0.077652 Aug 09 17:07:01.802077 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 438/868] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:07:01 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:02.021537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f993d926-70d4-4654-8b59-13e6c7718a95 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:02.039614 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f993d926-70d4-4654-8b59-13e6c7718a95 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1378 microversion: 2.1 time: 0.526717 Aug 09 17:07:02.052575 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 431/869] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:01 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1378 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:02.052575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c407b2ab-178a-48d6-b6df-1136575fd70f tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:02.052575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c407b2ab-178a-48d6-b6df-1136575fd70f tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:02.071403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c407b2ab-178a-48d6-b6df-1136575fd70f tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:02.073283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c407b2ab-178a-48d6-b6df-1136575fd70f tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:02.073791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c407b2ab-178a-48d6-b6df-1136575fd70f tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:02.074746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c407b2ab-178a-48d6-b6df-1136575fd70f tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:02.075232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c407b2ab-178a-48d6-b6df-1136575fd70f tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:02.075710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c407b2ab-178a-48d6-b6df-1136575fd70f tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:02.080878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:02.256803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ccf9eb8d-bf16-468d-99a9-9314e32edb1d tempest-ListImageFiltersNegativeTestJSON-1670875021 tempest-ListImageFiltersNegativeTestJSON-1670875021-project] Calling method '.version_select at 0x7fbbcb8f0dc0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:02.291394 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-ccf9eb8d-bf16-468d-99a9-9314e32edb1d tempest-ListImageFiltersNegativeTestJSON-1670875021 tempest-ListImageFiltersNegativeTestJSON-1670875021-project] HTTP exception thrown: Image not found. Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ccf9eb8d-bf16-468d-99a9-9314e32edb1d tempest-ListImageFiltersNegativeTestJSON-1670875021 tempest-ListImageFiltersNegativeTestJSON-1670875021-project] Request method failure captured: Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/images/4b3f4c3a-2488-4e9f-8127-1853b6739612 HTTP/1.1 Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQ1MA4ON7h7bWixzAFE3OF0lUp1jqUDVSmtRLfBrTWSTC5jpZPHu5Mqo97bSO-I7o57wMaDgwDq-7AebnMVePAvj3Ks71VoydlNPHJJJcEP3cssdmhqGZgQIfuSjiLGmgGgrj6iBFXh-WHDIOjs9o7Q2b-BZMTXYcwZxGb86GIo1M0 Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ebf87e6a39724eaf91942054dc9bd5da Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1670875021 Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:07:02.300792 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ebf87e6a39724eaf91942054dc9bd5da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ebf87e6a39724eaf91942054dc9bd5da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ebf87e6a39724eaf91942054dc9bd5da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ebf87e6a39724eaf91942054dc9bd5da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1670875021 Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ebf87e6a39724eaf91942054dc9bd5da Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1670875021 Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ListImageFiltersNegativeTestJSON-1670875021-project Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 54eb43132e7941f8b362606e6c9d84fb Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1670875021-project Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '4b3f4c3a-2488-4e9f-8127-1853b6739612'} Aug 09 17:07:02.302316 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:07:02.303137 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4b3f4c3a-2488-4e9f-8127-1853b6739612 Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:07:02.306262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b3f4c3a-2488-4e9f-8127-1853b6739612 could not be found. Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:02.309005 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:07:02.312623 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:02.317205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ccf9eb8d-bf16-468d-99a9-9314e32edb1d tempest-ListImageFiltersNegativeTestJSON-1670875021 tempest-ListImageFiltersNegativeTestJSON-1670875021-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:02.317205 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ccf9eb8d-bf16-468d-99a9-9314e32edb1d tempest-ListImageFiltersNegativeTestJSON-1670875021 tempest-ListImageFiltersNegativeTestJSON-1670875021-project] 10.222.0.93 "GET /compute/v2.1/images/4b3f4c3a-2488-4e9f-8127-1853b6739612" status: 404 len: 62 microversion: 2.1 time: 0.511300 Aug 09 17:07:02.317205 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 439/870] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:07:01 2022] GET /compute/v2.1/images/4b3f4c3a-2488-4e9f-8127-1853b6739612 => generated 62 bytes in 513 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:07:02.320939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-31d43ecb-7646-4f25-b003-3bdc81c1be88 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb968310>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:02.402790 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-31d43ecb-7646-4f25-b003-3bdc81c1be88 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 200 len: 1422 microversion: 2.1 time: 0.085709 Aug 09 17:07:02.403772 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 440/871] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:07:02 2022] GET /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:02.411550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-07b0515a-ba50-4e18-b8a2-57ae6b131176 req-542a05e1-7e98-47fe-bca0-f80326443e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddc1848-1711-406c-947a-94149934b5d3", "name": "network-vif-unplugged", "status": "completed", "tag": "9f96bc34-0e5a-4ffb-909f-2a367ebfcc17"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:02.445960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-07b0515a-ba50-4e18-b8a2-57ae6b131176 req-542a05e1-7e98-47fe-bca0-f80326443e2a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:02.446716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-07b0515a-ba50-4e18-b8a2-57ae6b131176 req-542a05e1-7e98-47fe-bca0-f80326443e2a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:02.449057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-07b0515a-ba50-4e18-b8a2-57ae6b131176 req-542a05e1-7e98-47fe-bca0-f80326443e2a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:02.480727 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-07b0515a-ba50-4e18-b8a2-57ae6b131176 req-542a05e1-7e98-47fe-bca0-f80326443e2a service nova] Creating event network-vif-unplugged:9f96bc34-0e5a-4ffb-909f-2a367ebfcc17 for instance 1ddc1848-1711-406c-947a-94149934b5d3 on n-h2-845781-6 Aug 09 17:07:02.488205 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-07b0515a-ba50-4e18-b8a2-57ae6b131176 req-542a05e1-7e98-47fe-bca0-f80326443e2a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082592 Aug 09 17:07:02.489575 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 441/872] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:02.499113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:02.500440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:02.510627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:02.511711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:02.512584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:02.515225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:02.515856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:02.516303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:02.884086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:02.901429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:02.905622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:02.909500 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-773cbe6d-dcd4-488d-919f-5d626102c673 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1567 microversion: 2.25 time: 0.417136 Aug 09 17:07:02.913327 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 442/873] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:02 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1567 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:02.922251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5b42e9c4-7cd1-481d-80e2-787d5c8d62a8 req-44573cc7-4416-4ac7-83fd-caae92618c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a07b5bb-7014-4708-a343-520f1b468a9c", "name": "network-vif-plugged", "status": "completed", "tag": "2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:02.941404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b42e9c4-7cd1-481d-80e2-787d5c8d62a8 req-44573cc7-4416-4ac7-83fd-caae92618c67 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:02.943334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b42e9c4-7cd1-481d-80e2-787d5c8d62a8 req-44573cc7-4416-4ac7-83fd-caae92618c67 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:02.945223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b42e9c4-7cd1-481d-80e2-787d5c8d62a8 req-44573cc7-4416-4ac7-83fd-caae92618c67 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:02.977864 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5b42e9c4-7cd1-481d-80e2-787d5c8d62a8 req-44573cc7-4416-4ac7-83fd-caae92618c67 service nova] Creating event network-vif-plugged:2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34 for instance 9a07b5bb-7014-4708-a343-520f1b468a9c on n-h1-845781-6 Aug 09 17:07:02.999901 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5b42e9c4-7cd1-481d-80e2-787d5c8d62a8 req-44573cc7-4416-4ac7-83fd-caae92618c67 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083822 Aug 09 17:07:03.001494 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 443/874] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:03.013632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a82493e6-c9f8-43e5-bc9f-5ac4c44a2dd6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb8400d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:03.131445 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c407b2ab-178a-48d6-b6df-1136575fd70f tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1631 microversion: 2.1 time: 1.082474 Aug 09 17:07:03.133177 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 432/875] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:02 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1631 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:03.146506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-edd8918a-151e-458c-9c1f-0a1633fbd501 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:03.148165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-edd8918a-151e-458c-9c1f-0a1633fbd501 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:03.159454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edd8918a-151e-458c-9c1f-0a1633fbd501 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:03.161122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edd8918a-151e-458c-9c1f-0a1633fbd501 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:03.162248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edd8918a-151e-458c-9c1f-0a1633fbd501 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:03.164043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edd8918a-151e-458c-9c1f-0a1633fbd501 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:03.165452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edd8918a-151e-458c-9c1f-0a1633fbd501 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:03.166615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edd8918a-151e-458c-9c1f-0a1633fbd501 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:03.657342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:04.204389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-edd8918a-151e-458c-9c1f-0a1633fbd501 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:04.237495 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-edd8918a-151e-458c-9c1f-0a1633fbd501 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1536 microversion: 2.1 time: 1.098544 Aug 09 17:07:04.238565 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 433/876] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:03 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1536 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:04.260679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c18aa4eb-a534-4ec9-a535-cd9a5f947dac tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:04.264873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c18aa4eb-a534-4ec9-a535-cd9a5f947dac tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:04.283923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c18aa4eb-a534-4ec9-a535-cd9a5f947dac tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:04.284579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c18aa4eb-a534-4ec9-a535-cd9a5f947dac tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:04.286370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c18aa4eb-a534-4ec9-a535-cd9a5f947dac tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:04.288813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c18aa4eb-a534-4ec9-a535-cd9a5f947dac tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:04.289813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c18aa4eb-a534-4ec9-a535-cd9a5f947dac tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:04.290680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c18aa4eb-a534-4ec9-a535-cd9a5f947dac tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:04.617700 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a82493e6-c9f8-43e5-bc9f-5ac4c44a2dd6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 204 len: 0 microversion: 2.1 time: 1.613642 Aug 09 17:07:04.619392 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 444/877] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:03 2022] DELETE /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 0 bytes in 1617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:07:04.626235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd0ae642-d9a2-4c92-b86f-82d4378ae1c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:04.629291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fd0ae642-d9a2-4c92-b86f-82d4378ae1c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:04.650783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd0ae642-d9a2-4c92-b86f-82d4378ae1c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:04.651489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd0ae642-d9a2-4c92-b86f-82d4378ae1c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:04.652250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd0ae642-d9a2-4c92-b86f-82d4378ae1c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:04.653136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd0ae642-d9a2-4c92-b86f-82d4378ae1c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:04.653684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd0ae642-d9a2-4c92-b86f-82d4378ae1c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:04.654146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd0ae642-d9a2-4c92-b86f-82d4378ae1c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:04.717065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c18aa4eb-a534-4ec9-a535-cd9a5f947dac tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:04.744895 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c18aa4eb-a534-4ec9-a535-cd9a5f947dac tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1505 microversion: 2.1 time: 0.501436 Aug 09 17:07:04.749627 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 434/878] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:04 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:04.771760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:04.775254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:04.802013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:04.808537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:04.811263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:04.815173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:04.818907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:04.819896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:04.969058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fd0ae642-d9a2-4c92-b86f-82d4378ae1c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:04.980475 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fd0ae642-d9a2-4c92-b86f-82d4378ae1c8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1378 microversion: 2.1 time: 0.359121 Aug 09 17:07:04.982068 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 445/879] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:04 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1378 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:04.991445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-189f0d16-9d4b-40ba-a5a7-d18b1e263184 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:04.992695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-189f0d16-9d4b-40ba-a5a7-d18b1e263184 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:05.000389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f0d16-9d4b-40ba-a5a7-d18b1e263184 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:05.001626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f0d16-9d4b-40ba-a5a7-d18b1e263184 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:05.002216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f0d16-9d4b-40ba-a5a7-d18b1e263184 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:05.003029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f0d16-9d4b-40ba-a5a7-d18b1e263184 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:05.004142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f0d16-9d4b-40ba-a5a7-d18b1e263184 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:05.004879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f0d16-9d4b-40ba-a5a7-d18b1e263184 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:05.201157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:05.216934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:05.223779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:05.230854 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-346039a2-a520-464f-94b5-c5039e7e33d1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1567 microversion: 2.25 time: 0.473114 Aug 09 17:07:05.232388 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 435/880] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:04 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1567 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:05.237596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-edeae0ed-00fd-496f-adc1-135ef5a780eb tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Action: 'create', calling method: .version_select at 0x7fbbcbc32dc0>, body: {"pool": "170ffeb2-2bf9-4cef-a3dd-e551a8cfc174"} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:05.250274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-189f0d16-9d4b-40ba-a5a7-d18b1e263184 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1614 microversion: 2.1 time: 0.266782 Aug 09 17:07:05.251573 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 446/881] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:04 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1614 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:05.268971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-28ceb6f4-bc94-41c7-9624-013e065f214f req-92fc03ff-3e02-40c0-88da-ee40fc28361c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ddc1848-1711-406c-947a-94149934b5d3", "tag": "9f96bc34-0e5a-4ffb-909f-2a367ebfcc17"}, {"server_uuid": "2fec2f16-7d50-4468-be26-23c4e25c2930", "name": "network-vif-unplugged", "status": "completed", "tag": "e43b13de-00b3-407c-88fd-f5e04caff542"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:05.288980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28ceb6f4-bc94-41c7-9624-013e065f214f req-92fc03ff-3e02-40c0-88da-ee40fc28361c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:05.289574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28ceb6f4-bc94-41c7-9624-013e065f214f req-92fc03ff-3e02-40c0-88da-ee40fc28361c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:05.290250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28ceb6f4-bc94-41c7-9624-013e065f214f req-92fc03ff-3e02-40c0-88da-ee40fc28361c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:05.306370 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-28ceb6f4-bc94-41c7-9624-013e065f214f req-92fc03ff-3e02-40c0-88da-ee40fc28361c service nova] Creating event network-changed:9f96bc34-0e5a-4ffb-909f-2a367ebfcc17 for instance 1ddc1848-1711-406c-947a-94149934b5d3 on n-h2-845781-6 Aug 09 17:07:05.306893 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-28ceb6f4-bc94-41c7-9624-013e065f214f req-92fc03ff-3e02-40c0-88da-ee40fc28361c service nova] Creating event network-vif-unplugged:e43b13de-00b3-407c-88fd-f5e04caff542 for instance 2fec2f16-7d50-4468-be26-23c4e25c2930 on n-h1-845781-6 Aug 09 17:07:05.331602 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-28ceb6f4-bc94-41c7-9624-013e065f214f req-92fc03ff-3e02-40c0-88da-ee40fc28361c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.078140 Aug 09 17:07:05.332480 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 447/882] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:05.339311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7e88dcb3-cb98-4797-9d03-171011067484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:05.340228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7e88dcb3-cb98-4797-9d03-171011067484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:05.349961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e88dcb3-cb98-4797-9d03-171011067484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:05.350932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e88dcb3-cb98-4797-9d03-171011067484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:05.351760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e88dcb3-cb98-4797-9d03-171011067484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:05.352701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e88dcb3-cb98-4797-9d03-171011067484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:05.353739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e88dcb3-cb98-4797-9d03-171011067484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:05.354367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e88dcb3-cb98-4797-9d03-171011067484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:05.395702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7e88dcb3-cb98-4797-9d03-171011067484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:07:05.570412 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7e88dcb3-cb98-4797-9d03-171011067484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 204 len: 0 microversion: 2.1 time: 0.236261 Aug 09 17:07:05.571449 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 448/883] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:07:05 2022] DELETE /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:07:05.586325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-940c0f32-6633-4ba7-a19a-f7a0f474bb64 req-483eb5e4-ef97-454b-a34e-efea7c249239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9114d8ad-2746-443d-8799-c09c421ac55d", "name": "network-vif-unplugged", "status": "completed", "tag": "72374f34-ae5a-40c5-8e9c-d64a473cbbfb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:05.599177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-940c0f32-6633-4ba7-a19a-f7a0f474bb64 req-483eb5e4-ef97-454b-a34e-efea7c249239 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:05.599696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-940c0f32-6633-4ba7-a19a-f7a0f474bb64 req-483eb5e4-ef97-454b-a34e-efea7c249239 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:05.600134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-940c0f32-6633-4ba7-a19a-f7a0f474bb64 req-483eb5e4-ef97-454b-a34e-efea7c249239 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:05.614226 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-940c0f32-6633-4ba7-a19a-f7a0f474bb64 req-483eb5e4-ef97-454b-a34e-efea7c249239 service nova] Creating event network-vif-unplugged:72374f34-ae5a-40c5-8e9c-d64a473cbbfb for instance 9114d8ad-2746-443d-8799-c09c421ac55d on n-h1-845781-6 Aug 09 17:07:05.620393 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-940c0f32-6633-4ba7-a19a-f7a0f474bb64 req-483eb5e4-ef97-454b-a34e-efea7c249239 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047240 Aug 09 17:07:05.621266 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 449/884] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:05.626546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:05.627221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:05.642635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:05.643165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:05.643611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:05.644901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:05.645695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:05.648005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:05.687308 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] HTTP exception thrown: Cannot 'migrate' instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 while it is in vm_state suspended Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Request method failure captured: Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4/action HTTP/1.1 Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 15 Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pP19J0ytsmLtQYF1QbzEbq1fo3bQ38AOCRCs0ggwndU_gZkXlWsR7u8_ZXBKf4LlClY1j8VHaFfMB2upVXyj6Zcnzm2u94hrBq6m9FIYZilPhMhXjK9_VF0TIGPp3wPkOgU9EbiPz2KzcFPZ1CQd2uovfl-ZbO9u0nMI65pyDdbTxg Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 4cc8e46884cd4bae9fd70045cffc3493 Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:07:05.690180 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 4cc8e46884cd4bae9fd70045cffc3493 Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersAdminNegativeTestJSON-1136760922-project-admin Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1c39efbcf12a445d85eabd5c179c8f88 Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1136760922-project-admin Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: {"migrate": {}} Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:07:05.693219 n-d-845781-6 devstack@n-api.service[119431]: exception: Cannot 'migrate' instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 while it is in vm_state suspended Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'd072da6d-dab4-4ee5-ab0c-944b47668dc4', 'body': {'migrate': {}}} Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 in vm_state suspended. Cannot resize while the instance is in this state. Aug 09 17:07:05.696390 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 while it is in vm_state suspended Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.699048 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:05.701802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:05.701802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:05.701802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:05.701802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:05.701802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 while it is in vm_state suspended Aug 09 17:07:05.701802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.728897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Returning 409 to user: Cannot 'migrate' instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 while it is in vm_state suspended {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:05.728897 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09db45a0-6e2a-4f19-a969-473ee28d8059 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4/action" status: 409 len: 148 microversion: 2.1 time: 0.097241 Aug 09 17:07:05.728897 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 450/885] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:05 2022] POST /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4/action => generated 148 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:07:05.752714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4c081c9-ae89-4eef-b0ec-ad6380896e19 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4c081c9-ae89-4eef-b0ec-ad6380896e19 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Request method failure captured: Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75/action HTTP/1.1 Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 39 Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pP19J0ytsmLtQYF1QbzEbq1fo3bQ38AOCRCs0ggwndU_gZkXlWsR7u8_ZXBKf4LlClY1j8VHaFfMB2upVXyj6Zcnzm2u94hrBq6m9FIYZilPhMhXjK9_VF0TIGPp3wPkOgU9EbiPz2KzcFPZ1CQd2uovfl-ZbO9u0nMI65pyDdbTxg Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 4cc8e46884cd4bae9fd70045cffc3493 Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:07:05.758682 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 4cc8e46884cd4bae9fd70045cffc3493 Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersAdminNegativeTestJSON-1136760922-project-admin Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1c39efbcf12a445d85eabd5c179c8f88 Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1136760922-project-admin Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: {"os-resetState": {"state": "invalid"}} Aug 09 17:07:05.760180 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9e83b0d7-61ec-490e-8994-0dcac0321e75', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'invalid' Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:05.760914 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:07:05.762261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 09 17:07:05.763590 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.765330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4c081c9-ae89-4eef-b0ec-ad6380896e19 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:05.766518 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d4c081c9-ae89-4eef-b0ec-ad6380896e19 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75/action" status: 400 len: 144 microversion: 2.1 time: 0.028635 Aug 09 17:07:05.767772 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 451/886] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:05 2022] POST /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75/action => generated 144 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:07:05.784459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69d957c9-8a35-4bdb-9ac9-ca86f42304d8 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69d957c9-8a35-4bdb-9ac9-ca86f42304d8 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Request method failure captured: Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75/action HTTP/1.1 Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 31 Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pP19J0ytsmLtQYF1QbzEbq1fo3bQ38AOCRCs0ggwndU_gZkXlWsR7u8_ZXBKf4LlClY1j8VHaFfMB2upVXyj6Zcnzm2u94hrBq6m9FIYZilPhMhXjK9_VF0TIGPp3wPkOgU9EbiPz2KzcFPZ1CQd2uovfl-ZbO9u0nMI65pyDdbTxg Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 4cc8e46884cd4bae9fd70045cffc3493 Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:07:05.794367 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 4cc8e46884cd4bae9fd70045cffc3493 Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersAdminNegativeTestJSON-1136760922-project-admin Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1c39efbcf12a445d85eabd5c179c8f88 Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1136760922-project-admin Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: {"os-resetState": {"state": 1}} Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:07:05.797011 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9e83b0d7-61ec-490e-8994-0dcac0321e75', 'body': {'os-resetState': {'state': 1}}} Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 1 Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:05.798606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 09 17:07:05.801268 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:05.803610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69d957c9-8a35-4bdb-9ac9-ca86f42304d8 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:05.803610 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69d957c9-8a35-4bdb-9ac9-ca86f42304d8 tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75/action" status: 400 len: 120 microversion: 2.1 time: 0.024722 Aug 09 17:07:05.806517 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 452/887] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:05 2022] POST /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75/action => generated 120 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:07:05.821967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-253a4b83-ba56-41d4-9d80-714a136b7c79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:05.823483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-253a4b83-ba56-41d4-9d80-714a136b7c79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:05.839403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-253a4b83-ba56-41d4-9d80-714a136b7c79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:05.840697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-253a4b83-ba56-41d4-9d80-714a136b7c79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:05.842460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-253a4b83-ba56-41d4-9d80-714a136b7c79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:05.843858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-253a4b83-ba56-41d4-9d80-714a136b7c79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:05.845200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-253a4b83-ba56-41d4-9d80-714a136b7c79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:05.845982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-253a4b83-ba56-41d4-9d80-714a136b7c79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:06.097202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-253a4b83-ba56-41d4-9d80-714a136b7c79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:06.107308 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-253a4b83-ba56-41d4-9d80-714a136b7c79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1505 microversion: 2.1 time: 0.300612 Aug 09 17:07:06.108107 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 453/888] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:05 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:06.114723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bebd33ad-c45b-4d99-9523-ff3d9a480a1b tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:06.118550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bebd33ad-c45b-4d99-9523-ff3d9a480a1b tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Failed to fetch instance by id 999 {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 17:07:06.119550 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-bebd33ad-c45b-4d99-9523-ff3d9a480a1b tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bebd33ad-c45b-4d99-9523-ff3d9a480a1b tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Request method failure captured: Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 37 Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pP19J0ytsmLtQYF1QbzEbq1fo3bQ38AOCRCs0ggwndU_gZkXlWsR7u8_ZXBKf4LlClY1j8VHaFfMB2upVXyj6Zcnzm2u94hrBq6m9FIYZilPhMhXjK9_VF0TIGPp3wPkOgU9EbiPz2KzcFPZ1CQd2uovfl-ZbO9u0nMI65pyDdbTxg Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 4cc8e46884cd4bae9fd70045cffc3493 Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:07:06.135575 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4cc8e46884cd4bae9fd70045cffc3493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 4cc8e46884cd4bae9fd70045cffc3493 Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1136760922 Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersAdminNegativeTestJSON-1136760922-project-admin Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1c39efbcf12a445d85eabd5c179c8f88 Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1136760922-project-admin Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: {"os-resetState": {"state": "error"}} Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:07:06.137451 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 999 could not be found. Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:06.138297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bebd33ad-c45b-4d99-9523-ff3d9a480a1b tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:06.140515 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bebd33ad-c45b-4d99-9523-ff3d9a480a1b tempest-ServersAdminNegativeTestJSON-1136760922 tempest-ServersAdminNegativeTestJSON-1136760922-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.027805 Aug 09 17:07:06.141568 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 454/889] 10.222.0.93 () {60 vars in 1179 bytes} [Tue Aug 9 17:07:06 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:07:06.143264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1069770577", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "7caaa633-fae8-4684-9370-5a4c1e16c284"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:06.243895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] validate_networks() for [('7caaa633-fae8-4684-9370-5a4c1e16c284', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:07:07.313619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:07:07.314426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:07:07.315330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:07:07.316162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:07:07.316860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:07:07.337526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:07.338886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:07.340071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:07.341767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:07.343012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:07.344070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:07.379891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Getting quotas for project 055af8e9fb964ff19213eb1b419b56cd. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:07:07.396413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Getting quotas for user 1ac722a34673411e9280ba901999b0c3 and project 055af8e9fb964ff19213eb1b419b56cd. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:07:07.425760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:07:07.431399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:07:07.551043 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0778cefd-b857-4eff-bd7d-329ff17f9b9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.411682 Aug 09 17:07:07.552868 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 455/890] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:07:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:07:07.837059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f2cb0a70-befe-438f-9ec9-33f6cd251c0a tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Calling method '.version_select at 0x7fbbcb9f2670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:07.841242 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:07.841242 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:07.842035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2cb0a70-befe-438f-9ec9-33f6cd251c0a tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:07.842200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2cb0a70-befe-438f-9ec9-33f6cd251c0a tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:07.842774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2cb0a70-befe-438f-9ec9-33f6cd251c0a tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:07.843746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2cb0a70-befe-438f-9ec9-33f6cd251c0a tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:07.844456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2cb0a70-befe-438f-9ec9-33f6cd251c0a tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:07.845136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2cb0a70-befe-438f-9ec9-33f6cd251c0a tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:07.876356 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f2cb0a70-befe-438f-9ec9-33f6cd251c0a tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.317854 Aug 09 17:07:07.884479 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 456/891] 10.222.0.93 () {58 vars in 1128 bytes} [Tue Aug 9 17:07:07 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:07.891696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-965e060b-7d73-4777-9362-ae479faffb55 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:07.892650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-965e060b-7d73-4777-9362-ae479faffb55 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:07.902303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-965e060b-7d73-4777-9362-ae479faffb55 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:07.903478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-965e060b-7d73-4777-9362-ae479faffb55 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:07.904264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-965e060b-7d73-4777-9362-ae479faffb55 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:07.905521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-965e060b-7d73-4777-9362-ae479faffb55 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:07.906465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-965e060b-7d73-4777-9362-ae479faffb55 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:07.907117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-965e060b-7d73-4777-9362-ae479faffb55 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:08.222532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-965e060b-7d73-4777-9362-ae479faffb55 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:08.248883 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-965e060b-7d73-4777-9362-ae479faffb55 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1527 microversion: 2.1 time: 0.362231 Aug 09 17:07:08.265251 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 457/892] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:07 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1527 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:08.295478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3754bfe-6d5f-4b58-b97e-deb28638555a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:08.297130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3754bfe-6d5f-4b58-b97e-deb28638555a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:08.314805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3754bfe-6d5f-4b58-b97e-deb28638555a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:08.317890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3754bfe-6d5f-4b58-b97e-deb28638555a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:08.319955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3754bfe-6d5f-4b58-b97e-deb28638555a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:08.321945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3754bfe-6d5f-4b58-b97e-deb28638555a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:08.323173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3754bfe-6d5f-4b58-b97e-deb28638555a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:08.324412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3754bfe-6d5f-4b58-b97e-deb28638555a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:08.440410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3754bfe-6d5f-4b58-b97e-deb28638555a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:07:08.687418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:08.688560 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-edeae0ed-00fd-496f-adc1-135ef5a780eb tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.454426 Aug 09 17:07:08.689582 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 436/893] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:07:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:08.734835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:08.736671 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3754bfe-6d5f-4b58-b97e-deb28638555a tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 204 len: 0 microversion: 2.1 time: 0.468816 Aug 09 17:07:08.740971 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 458/894] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:07:08 2022] DELETE /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:07:08.743618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:08.767280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2f8f94a1-50e2-4e25-b837-77c4d2d2282e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:08.775373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2f8f94a1-50e2-4e25-b837-77c4d2d2282e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:08.791973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:08.799589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:08.806935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:08.810307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:08.811605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:08.817932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f8f94a1-50e2-4e25-b837-77c4d2d2282e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:08.818545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:08.824191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f8f94a1-50e2-4e25-b837-77c4d2d2282e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:08.828324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f8f94a1-50e2-4e25-b837-77c4d2d2282e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:08.835847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f8f94a1-50e2-4e25-b837-77c4d2d2282e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:08.838961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f8f94a1-50e2-4e25-b837-77c4d2d2282e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:08.843496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f8f94a1-50e2-4e25-b837-77c4d2d2282e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:09.466017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2f8f94a1-50e2-4e25-b837-77c4d2d2282e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:09.482572 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2f8f94a1-50e2-4e25-b837-77c4d2d2282e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1505 microversion: 2.1 time: 0.740119 Aug 09 17:07:09.499873 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 459/895] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:08 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1505 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:09.514353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c3db36b4-191b-4a54-863e-89912a9ed19d req-7fbef581-815e-4f39-ac60-58b06e5297f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fec2f16-7d50-4468-be26-23c4e25c2930", "tag": "e43b13de-00b3-407c-88fd-f5e04caff542"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:09.533279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c3db36b4-191b-4a54-863e-89912a9ed19d req-7fbef581-815e-4f39-ac60-58b06e5297f6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:09.533973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c3db36b4-191b-4a54-863e-89912a9ed19d req-7fbef581-815e-4f39-ac60-58b06e5297f6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:09.534688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c3db36b4-191b-4a54-863e-89912a9ed19d req-7fbef581-815e-4f39-ac60-58b06e5297f6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:09.555285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:09.555724 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c3db36b4-191b-4a54-863e-89912a9ed19d req-7fbef581-815e-4f39-ac60-58b06e5297f6 service nova] Creating event network-changed:e43b13de-00b3-407c-88fd-f5e04caff542 for instance 2fec2f16-7d50-4468-be26-23c4e25c2930 on n-h1-845781-6 Aug 09 17:07:09.562670 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c3db36b4-191b-4a54-863e-89912a9ed19d req-7fbef581-815e-4f39-ac60-58b06e5297f6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060124 Aug 09 17:07:09.563965 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 460/896] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:09.573194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:09.575802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:09.578219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e16bd9d4-4867-470d-9c51-3799c5119cee tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:09.579055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e16bd9d4-4867-470d-9c51-3799c5119cee tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:09.579592 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-06c87e5c-a7b4-4c08-aaf1-7510b722aa35 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1567 microversion: 2.25 time: 0.886547 Aug 09 17:07:09.593878 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 437/897] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:08 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1567 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:09.613069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e16bd9d4-4867-470d-9c51-3799c5119cee tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:09.614299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e16bd9d4-4867-470d-9c51-3799c5119cee tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:09.615273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e16bd9d4-4867-470d-9c51-3799c5119cee tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:09.616644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e16bd9d4-4867-470d-9c51-3799c5119cee tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:09.617846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e16bd9d4-4867-470d-9c51-3799c5119cee tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:09.618774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e16bd9d4-4867-470d-9c51-3799c5119cee tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:09.704316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:09.910636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e16bd9d4-4867-470d-9c51-3799c5119cee tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:09.947477 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e16bd9d4-4867-470d-9c51-3799c5119cee tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1204 microversion: 2.1 time: 0.381784 Aug 09 17:07:09.953029 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 461/898] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:09 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1204 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:09.976894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e76dba0f-12aa-4ad6-a55c-b46d3fde6a3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:09.977562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e76dba0f-12aa-4ad6-a55c-b46d3fde6a3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:10.002270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e76dba0f-12aa-4ad6-a55c-b46d3fde6a3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:10.003116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e76dba0f-12aa-4ad6-a55c-b46d3fde6a3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:10.007076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e76dba0f-12aa-4ad6-a55c-b46d3fde6a3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:10.009013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e76dba0f-12aa-4ad6-a55c-b46d3fde6a3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:10.009543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e76dba0f-12aa-4ad6-a55c-b46d3fde6a3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:10.012132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e76dba0f-12aa-4ad6-a55c-b46d3fde6a3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:10.021249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6d506da3-df2a-4e43-bf25-7203dd84227e tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Calling method '.version_select at 0x7fbbcbab5940>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:10.030680 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:10.030680 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:07:10.034860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6d506da3-df2a-4e43-bf25-7203dd84227e tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '0c5e633a72c341658ba90990e256723f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d21c991382040c89cbccb4b6b4be0e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6d506da3-df2a-4e43-bf25-7203dd84227e tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Request method failure captured: Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pQ4OkYm8Odx7UcIFYggwyJ4KisLV7enrgSTuHTPeus68vdNvZ6WULiAQpv7x3BfIh1ybZlmPxz05RIho10p0jESzYIc7hDJ4nz1B6-crx7dqpd_oMmQM0YVid8SisdE5WKplMduT0NYVeujpgesF3QLbU19rVZX8qeCrJyitA7nT54 Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:07:10.051815 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 0c5e633a72c341658ba90990e256723f Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: action_args: {} Aug 09 17:07:10.054456 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:07:10.056005 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 09 17:07:10.058082 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:10.064566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6d506da3-df2a-4e43-bf25-7203dd84227e tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:10.067020 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6d506da3-df2a-4e43-bf25-7203dd84227e tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.470866 Aug 09 17:07:10.069011 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 438/899] 10.222.0.93 () {58 vars in 1128 bytes} [Tue Aug 9 17:07:09 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 474 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:07:10.083758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Action: 'action', calling method: .version_select at 0x7fbbda3cca60>, body: {"addFloatingIp": {"address": "172.25.5.196"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:10.088876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:10.112011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:10.113657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:10.114809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:10.116845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:10.117987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:10.119127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:10.533020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:07:10.538091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquired lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:07:10.667377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e76dba0f-12aa-4ad6-a55c-b46d3fde6a3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:10.677210 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e76dba0f-12aa-4ad6-a55c-b46d3fde6a3b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1527 microversion: 2.1 time: 0.722032 Aug 09 17:07:10.694314 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 462/900] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:09 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1527 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:10.694314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a5a3d047-f707-4a47-a8e4-47909866c632 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:10.694314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a5a3d047-f707-4a47-a8e4-47909866c632 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:10.713513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a3d047-f707-4a47-a8e4-47909866c632 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:10.714450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a3d047-f707-4a47-a8e4-47909866c632 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:10.717531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a3d047-f707-4a47-a8e4-47909866c632 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:10.719529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a3d047-f707-4a47-a8e4-47909866c632 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:10.720357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a3d047-f707-4a47-a8e4-47909866c632 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:10.733745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a3d047-f707-4a47-a8e4-47909866c632 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:11.738939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a5a3d047-f707-4a47-a8e4-47909866c632 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:11.769377 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a5a3d047-f707-4a47-a8e4-47909866c632 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 200 len: 1469 microversion: 2.1 time: 1.085898 Aug 09 17:07:11.779313 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 463/901] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:10 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 1469 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:11.791445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a925bbe5-9138-487a-8eb1-7bd5cc923ac3 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Calling method '.version_select at 0x7fbbcbe8ca60>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:11.794075 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:11.794075 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:11.798423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a925bbe5-9138-487a-8eb1-7bd5cc923ac3 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '0c5e633a72c341658ba90990e256723f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d21c991382040c89cbccb4b6b4be0e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a925bbe5-9138-487a-8eb1-7bd5cc923ac3 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Request method failure captured: Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hosts/n-d-845781-6/reboot HTTP/1.1 Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQ4OkYm8Odx7UcIFYggwyJ4KisLV7enrgSTuHTPeus68vdNvZ6WULiAQpv7x3BfIh1ybZlmPxz05RIho10p0jESzYIc7hDJ4nz1B6-crx7dqpd_oMmQM0YVid8SisdE5WKplMduT0NYVeujpgesF3QLbU19rVZX8qeCrJyitA7nT54 Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:07:11.805221 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 0c5e633a72c341658ba90990e256723f Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'n-d-845781-6'} Aug 09 17:07:11.808280 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:07:11.811163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 09 17:07:11.813747 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:11.830492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a925bbe5-9138-487a-8eb1-7bd5cc923ac3 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:11.836229 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a925bbe5-9138-487a-8eb1-7bd5cc923ac3 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-845781-6/reboot" status: 403 len: 111 microversion: 2.1 time: 0.051415 Aug 09 17:07:11.838958 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 464/902] 10.222.0.93 () {58 vars in 1188 bytes} [Tue Aug 9 17:07:11 2022] GET /compute/v2.1/os-hosts/n-d-845781-6/reboot => generated 111 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:07:11.863300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3ecec33-4c6d-4f7c-802c-696473d78fe7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:11.864569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3ecec33-4c6d-4f7c-802c-696473d78fe7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:11.883483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ecec33-4c6d-4f7c-802c-696473d78fe7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:11.885331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ecec33-4c6d-4f7c-802c-696473d78fe7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:11.886022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ecec33-4c6d-4f7c-802c-696473d78fe7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:11.888093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ecec33-4c6d-4f7c-802c-696473d78fe7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:11.888890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ecec33-4c6d-4f7c-802c-696473d78fe7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:11.889558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3ecec33-4c6d-4f7c-802c-696473d78fe7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:12.280661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e3ecec33-4c6d-4f7c-802c-696473d78fe7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:12.291565 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3ecec33-4c6d-4f7c-802c-696473d78fe7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1505 microversion: 2.1 time: 0.445841 Aug 09 17:07:12.300567 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 465/903] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:11 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1505 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:12.307070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:12.308711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:12.343725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:12.345929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:12.353393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:12.356328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:12.358655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:12.359885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:13.008886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:13.024032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:13.028969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:13.037574 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3732f48c-90ad-4612-96ea-ecdf81a56e8f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1567 microversion: 2.25 time: 0.735222 Aug 09 17:07:13.039275 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 466/904] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:12 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1567 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:13.048781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9770ebaf-646b-4bb9-929f-ec54c98a555b tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:13.052365 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:13.052365 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:13.092114 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9770ebaf-646b-4bb9-929f-ec54c98a555b tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3" status: 202 len: 0 microversion: 2.1 time: 0.051376 Aug 09 17:07:13.092742 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 467/905] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:07:13 2022] DELETE /compute/v2.1/flavors/3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:13.106466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-357dad9f-4cee-4663-b4a0-c4af81fde988 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:13.107111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-357dad9f-4cee-4663-b4a0-c4af81fde988 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:13.125768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-357dad9f-4cee-4663-b4a0-c4af81fde988 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:13.126514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-357dad9f-4cee-4663-b4a0-c4af81fde988 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:13.126978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-357dad9f-4cee-4663-b4a0-c4af81fde988 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:13.127761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-357dad9f-4cee-4663-b4a0-c4af81fde988 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:13.128226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-357dad9f-4cee-4663-b4a0-c4af81fde988 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:13.129073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-357dad9f-4cee-4663-b4a0-c4af81fde988 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:13.314276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-357dad9f-4cee-4663-b4a0-c4af81fde988 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:13.336869 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-357dad9f-4cee-4663-b4a0-c4af81fde988 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1266 microversion: 2.1 time: 0.242971 Aug 09 17:07:13.357042 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 468/906] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:13 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:13.366600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ff6f3e92-0126-44fd-a33c-45bc9d121987 req-94378980-fec7-43ca-870e-dbcd0d97c67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9114d8ad-2746-443d-8799-c09c421ac55d", "name": "network-vif-deleted", "tag": "72374f34-ae5a-40c5-8e9c-d64a473cbbfb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:13.411245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ff6f3e92-0126-44fd-a33c-45bc9d121987 req-94378980-fec7-43ca-870e-dbcd0d97c67c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:13.412156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ff6f3e92-0126-44fd-a33c-45bc9d121987 req-94378980-fec7-43ca-870e-dbcd0d97c67c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:13.414811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ff6f3e92-0126-44fd-a33c-45bc9d121987 req-94378980-fec7-43ca-870e-dbcd0d97c67c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:13.485477 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ff6f3e92-0126-44fd-a33c-45bc9d121987 req-94378980-fec7-43ca-870e-dbcd0d97c67c service nova] Creating event network-vif-deleted:72374f34-ae5a-40c5-8e9c-d64a473cbbfb for instance 9114d8ad-2746-443d-8799-c09c421ac55d on n-h1-845781-6 Aug 09 17:07:13.506206 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ff6f3e92-0126-44fd-a33c-45bc9d121987 req-94378980-fec7-43ca-870e-dbcd0d97c67c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144341 Aug 09 17:07:13.512195 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 469/907] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:13.554329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0ddf084e-5b2f-4bbb-8a70-42e7469c9958 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Calling method '.version_select at 0x7fbbcb7e4ee0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:13.558786 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:13.558786 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:13.604404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0ddf084e-5b2f-4bbb-8a70-42e7469c9958 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0ddf084e-5b2f-4bbb-8a70-42e7469c9958 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Request method failure captured: Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQ5BC4GHqcBUkbJRZK0mRY9hkCyfnr3Qr9d_rB0kuIRs4syDZD1Gt1TeUHV0gCs7i9cwEh7tz32WCkQC15iBMQr0YCB07DomgMmwxiK7kT-XVzfH5RoRUPpcLFihNKmJxDnBMAb-39wbxFD_14VSs_R5RqExMb0CoowGwGJ2LSnObo Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:07:13.616716 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_53aa23093f434c17a895de6b5310514e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/53aa23093f434c17a895de6b5310514e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e31f0700476b45749677df9a88edc455 Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'nonexistent_hostname'} Aug 09 17:07:13.620239 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:07:13.622016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 09 17:07:13.627304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0ddf084e-5b2f-4bbb-8a70-42e7469c9958 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:13.629674 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0ddf084e-5b2f-4bbb-8a70-42e7469c9958 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.108611 Aug 09 17:07:13.637424 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 470/908] 10.222.0.93 () {58 vars in 1212 bytes} [Tue Aug 9 17:07:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:07:13.664882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:13.667517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: d072da6d-dab4-4ee5-ab0c-944b47668dc4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:13.682283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:13.683140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:13.683789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:13.684692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:13.685607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:13.686160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:13.707464 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] HTTP exception thrown: Instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 could not be found. Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Request method failure captured: Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 HTTP/1.1 Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pP0DYBXrz8RJdgxtDfTMEhrhY_DEDasvFVLGNeszKukW5O8oZifVHqn8M99ZwFOmX6tPJfjEetjMSnQTwpdpd184Z0WUnjnf3RW3uvrbawsFr5KpHtXO_2keoxLDbMJz11c8yq1Yn0xtxMVs29f7vtMgAFq6NGhZyTzoFMQ706w54U Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 09be0c4a839f45c5848413a9d99bbf66 Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-422464435 Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:07:13.709523 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09be0c4a839f45c5848413a9d99bbf66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09be0c4a839f45c5848413a9d99bbf66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09be0c4a839f45c5848413a9d99bbf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09be0c4a839f45c5848413a9d99bbf66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersAdminNegativeTestJSON-422464435 Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 09be0c4a839f45c5848413a9d99bbf66 Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-422464435 Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersAdminNegativeTestJSON-422464435-project Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 5437ccd3449941079dfbb9a5e943029e Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersAdminNegativeTestJSON-422464435-project Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 could not be found. Aug 09 17:07:13.711119 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'd072da6d-dab4-4ee5-ab0c-944b47668dc4'} Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 could not be found. Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:13.711918 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 could not be found. Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 could not be found. Aug 09 17:07:13.716272 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:13.717374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Returning 404 to user: Instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:13.717374 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-83497879-4b28-4ce5-b538-0fe672b39ebc tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4" status: 404 len: 111 microversion: 2.1 time: 0.068095 Aug 09 17:07:13.717374 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 471/909] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:13 2022] GET /compute/v2.1/servers/d072da6d-dab4-4ee5-ab0c-944b47668dc4 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:07:13.720040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4af20f60-6c56-4e5f-be32-aceb1d111286 req-150d974b-20c6-46da-a2ac-09eb3fcb111c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d072da6d-dab4-4ee5-ab0c-944b47668dc4", "name": "network-vif-deleted", "tag": "5980adca-fd87-47c1-acd8-bfb70ad45f17"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:13.731755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4af20f60-6c56-4e5f-be32-aceb1d111286 req-150d974b-20c6-46da-a2ac-09eb3fcb111c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:13.732455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4af20f60-6c56-4e5f-be32-aceb1d111286 req-150d974b-20c6-46da-a2ac-09eb3fcb111c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:13.733154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4af20f60-6c56-4e5f-be32-aceb1d111286 req-150d974b-20c6-46da-a2ac-09eb3fcb111c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:13.750670 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4af20f60-6c56-4e5f-be32-aceb1d111286 req-150d974b-20c6-46da-a2ac-09eb3fcb111c service nova] Creating event network-vif-deleted:5980adca-fd87-47c1-acd8-bfb70ad45f17 for instance d072da6d-dab4-4ee5-ab0c-944b47668dc4 on n-h2-845781-6 Aug 09 17:07:13.758166 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4af20f60-6c56-4e5f-be32-aceb1d111286 req-150d974b-20c6-46da-a2ac-09eb3fcb111c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044067 Aug 09 17:07:13.759570 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 472/910] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:13.767026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e644b16b-e47e-4223-b5b5-bd277cfa9301 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:13.804697 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e644b16b-e47e-4223-b5b5-bd277cfa9301 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042188 Aug 09 17:07:13.806196 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 473/911] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:07:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:13.816439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69911b12-3c4a-493b-8421-3d8057e81aad tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:13.817912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-69911b12-3c4a-493b-8421-3d8057e81aad tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:13.830170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69911b12-3c4a-493b-8421-3d8057e81aad tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:13.831046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69911b12-3c4a-493b-8421-3d8057e81aad tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:13.832156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69911b12-3c4a-493b-8421-3d8057e81aad tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:13.833736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69911b12-3c4a-493b-8421-3d8057e81aad tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:13.835074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69911b12-3c4a-493b-8421-3d8057e81aad tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:13.836330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69911b12-3c4a-493b-8421-3d8057e81aad tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:14.305325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-69911b12-3c4a-493b-8421-3d8057e81aad tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:14.326269 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69911b12-3c4a-493b-8421-3d8057e81aad tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1505 microversion: 2.1 time: 0.516999 Aug 09 17:07:14.327958 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 474/912] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:13 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:14.338486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f299e05f-5368-402d-875b-f3cdb0bd6972 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Calling method '.version_select at 0x7fbbcb840f70>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:14.343074 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:14.343074 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:14.345893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f299e05f-5368-402d-875b-f3cdb0bd6972 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '0c5e633a72c341658ba90990e256723f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d21c991382040c89cbccb4b6b4be0e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f299e05f-5368-402d-875b-f3cdb0bd6972 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Request method failure captured: Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hosts/n-d-845781-6 HTTP/1.1 Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQ4OkYm8Odx7UcIFYggwyJ4KisLV7enrgSTuHTPeus68vdNvZ6WULiAQpv7x3BfIh1ybZlmPxz05RIho10p0jESzYIc7hDJ4nz1B6-crx7dqpd_oMmQM0YVid8SisdE5WKplMduT0NYVeujpgesF3QLbU19rVZX8qeCrJyitA7nT54 Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:07:14.350107 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 0c5e633a72c341658ba90990e256723f Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'n-d-845781-6'} Aug 09 17:07:14.353188 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:07:14.354676 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 09 17:07:14.359110 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:14.368949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f299e05f-5368-402d-875b-f3cdb0bd6972 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:14.368949 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f299e05f-5368-402d-875b-f3cdb0bd6972 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-845781-6" status: 403 len: 109 microversion: 2.1 time: 0.035618 Aug 09 17:07:14.368949 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 475/913] 10.222.0.93 () {58 vars in 1167 bytes} [Tue Aug 9 17:07:14 2022] GET /compute/v2.1/os-hosts/n-d-845781-6 => generated 109 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:07:14.378629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8ab34122-1cd4-4cd0-baaf-68d24530c36d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:14.379539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ab34122-1cd4-4cd0-baaf-68d24530c36d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:14.399341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ab34122-1cd4-4cd0-baaf-68d24530c36d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:14.401555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ab34122-1cd4-4cd0-baaf-68d24530c36d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:14.403166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ab34122-1cd4-4cd0-baaf-68d24530c36d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:14.404477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ab34122-1cd4-4cd0-baaf-68d24530c36d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:14.405408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ab34122-1cd4-4cd0-baaf-68d24530c36d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:14.406145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ab34122-1cd4-4cd0-baaf-68d24530c36d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:14.448194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ab34122-1cd4-4cd0-baaf-68d24530c36d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:07:14.576727 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8ab34122-1cd4-4cd0-baaf-68d24530c36d tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 204 len: 0 microversion: 2.1 time: 0.208195 Aug 09 17:07:14.578195 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 476/914] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:07:14 2022] DELETE /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:07:14.586619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:14.589891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:14.598123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:14.599808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:14.600878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:14.602036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:14.602777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:14.603463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:14.646113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:14.655520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Old instance type tempest-test_resize_flavor_-159832888, new instance type m1.heat {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 17:07:14.670696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:07:14.671199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:07:14.672422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:07:14.672422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:07:14.672882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:07:14.796889 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-548beb5e-c2dc-4fb1-a8a0-335d7d430133 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "POST /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c/action" status: 202 len: 0 microversion: 2.1 time: 0.215302 Aug 09 17:07:14.800807 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 477/915] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:14 2022] POST /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:14.804379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:14.805011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:14.814830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:14.816870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:14.816870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:14.816870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:14.817344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:14.817696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:15.465989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:15.492816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:15.495712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:15.497428 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cbe9c5c6-6834-485d-a03e-311e0f79eafd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1567 microversion: 2.25 time: 0.698345 Aug 09 17:07:15.499268 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 478/916] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:14 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1567 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:15.510313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cbaa0fc4-1503-4e39-9c2c-92af5a422e9f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:15.511484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cbaa0fc4-1503-4e39-9c2c-92af5a422e9f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:15.527233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbaa0fc4-1503-4e39-9c2c-92af5a422e9f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:15.528433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbaa0fc4-1503-4e39-9c2c-92af5a422e9f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:15.529550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbaa0fc4-1503-4e39-9c2c-92af5a422e9f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:15.532417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbaa0fc4-1503-4e39-9c2c-92af5a422e9f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:15.533435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbaa0fc4-1503-4e39-9c2c-92af5a422e9f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:15.534447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbaa0fc4-1503-4e39-9c2c-92af5a422e9f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:15.685900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cbaa0fc4-1503-4e39-9c2c-92af5a422e9f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:15.769397 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cbaa0fc4-1503-4e39-9c2c-92af5a422e9f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1266 microversion: 2.1 time: 0.259258 Aug 09 17:07:15.778845 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 479/917] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:15 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:15.809189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efc47b45-6a83-4fbb-9124-c57c2f0a33e9 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Calling method '.version_select at 0x7fbbcb8405e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:15.814191 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:15.814191 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:15.837652 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-efc47b45-6a83-4fbb-9124-c57c2f0a33e9 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efc47b45-6a83-4fbb-9124-c57c2f0a33e9 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Request method failure captured: Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQ5BC4GHqcBUkbJRZK0mRY9hkCyfnr3Qr9d_rB0kuIRs4syDZD1Gt1TeUHV0gCs7i9cwEh7tz32WCkQC15iBMQr0YCB07DomgMmwxiK7kT-XVzfH5RoRUPpcLFihNKmJxDnBMAb-39wbxFD_14VSs_R5RqExMb0CoowGwGJ2LSnObo Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:07:15.841265 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_53aa23093f434c17a895de6b5310514e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/53aa23093f434c17a895de6b5310514e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e31f0700476b45749677df9a88edc455 Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'nonexistent_hostname'} Aug 09 17:07:15.843335 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:15.844768 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:15.846889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:15.848976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efc47b45-6a83-4fbb-9124-c57c2f0a33e9 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:15.848976 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-efc47b45-6a83-4fbb-9124-c57c2f0a33e9 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.055523 Aug 09 17:07:15.852085 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 480/918] 10.222.0.93 () {58 vars in 1191 bytes} [Tue Aug 9 17:07:15 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:07:15.871453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efb8572a-f198-4a84-b933-d4fca8172df7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:15.872433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-efb8572a-f198-4a84-b933-d4fca8172df7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:15.892226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb8572a-f198-4a84-b933-d4fca8172df7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:15.893099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb8572a-f198-4a84-b933-d4fca8172df7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:15.894068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb8572a-f198-4a84-b933-d4fca8172df7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:15.897799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb8572a-f198-4a84-b933-d4fca8172df7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:15.898590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb8572a-f198-4a84-b933-d4fca8172df7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:15.899218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb8572a-f198-4a84-b933-d4fca8172df7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:16.340592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Building network info cache for instance {{(pid=119432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 17:07:16.805422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-efb8572a-f198-4a84-b933-d4fca8172df7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:16.848986 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-efb8572a-f198-4a84-b933-d4fca8172df7 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1476 microversion: 2.1 time: 0.993649 Aug 09 17:07:16.864580 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 481/919] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:15 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1476 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:16.894445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6af17b8a-1938-4c02-8224-b511aa837179 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:16.909187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6af17b8a-1938-4c02-8224-b511aa837179 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:16.937812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6af17b8a-1938-4c02-8224-b511aa837179 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:16.940398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6af17b8a-1938-4c02-8224-b511aa837179 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:16.946287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6af17b8a-1938-4c02-8224-b511aa837179 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:16.949814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6af17b8a-1938-4c02-8224-b511aa837179 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:16.964542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6af17b8a-1938-4c02-8224-b511aa837179 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:16.968124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6af17b8a-1938-4c02-8224-b511aa837179 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:17.415146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:17.537363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6af17b8a-1938-4c02-8224-b511aa837179 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:17.561124 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6af17b8a-1938-4c02-8224-b511aa837179 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1536 microversion: 2.1 time: 0.694737 Aug 09 17:07:17.561762 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 482/920] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:16 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1536 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:17.569764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d8d5021f-591e-44e8-aed0-b778448c6459 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:17.570705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d8d5021f-591e-44e8-aed0-b778448c6459 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:17.593939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8d5021f-591e-44e8-aed0-b778448c6459 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:17.594700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8d5021f-591e-44e8-aed0-b778448c6459 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:17.596676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8d5021f-591e-44e8-aed0-b778448c6459 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:17.599940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8d5021f-591e-44e8-aed0-b778448c6459 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:17.602980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8d5021f-591e-44e8-aed0-b778448c6459 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:17.603699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8d5021f-591e-44e8-aed0-b778448c6459 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:17.613232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:17.854573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:18.247892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d8d5021f-591e-44e8-aed0-b778448c6459 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:18.262941 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d8d5021f-591e-44e8-aed0-b778448c6459 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1505 microversion: 2.1 time: 0.697554 Aug 09 17:07:18.268630 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 483/921] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:17 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1505 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:18.278432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-780e0313-cd86-4e72-84c2-6baac31567d1 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Calling method '.version_select at 0x7fbbcb7f71f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:18.282034 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:18.282034 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:18.285073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-780e0313-cd86-4e72-84c2-6baac31567d1 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '0c5e633a72c341658ba90990e256723f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d21c991382040c89cbccb4b6b4be0e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-780e0313-cd86-4e72-84c2-6baac31567d1 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Request method failure captured: Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hosts/n-d-845781-6/shutdown HTTP/1.1 Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQ4OkYm8Odx7UcIFYggwyJ4KisLV7enrgSTuHTPeus68vdNvZ6WULiAQpv7x3BfIh1ybZlmPxz05RIho10p0jESzYIc7hDJ4nz1B6-crx7dqpd_oMmQM0YVid8SisdE5WKplMduT0NYVeujpgesF3QLbU19rVZX8qeCrJyitA7nT54 Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:07:18.297607 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 0c5e633a72c341658ba90990e256723f Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'n-d-845781-6'} Aug 09 17:07:18.299367 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:07:18.300264 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 09 17:07:18.301397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:18.308147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-780e0313-cd86-4e72-84c2-6baac31567d1 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:18.311544 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-780e0313-cd86-4e72-84c2-6baac31567d1 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-845781-6/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.039204 Aug 09 17:07:18.315145 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 484/922] 10.222.0.93 () {58 vars in 1194 bytes} [Tue Aug 9 17:07:18 2022] GET /compute/v2.1/os-hosts/n-d-845781-6/shutdown => generated 113 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:07:18.328561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-eec53a08-c0a5-4dd7-a323-768705aa9997 req-be45ce50-18c5-4a08-9760-c44fb7c2d2ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a93360c-22e7-48a0-8f10-ab756a21325d", "tag": "8cf56997-b952-4786-979c-78c1d6c3074e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:18.362177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-eec53a08-c0a5-4dd7-a323-768705aa9997 req-be45ce50-18c5-4a08-9760-c44fb7c2d2ff service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:18.363187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-eec53a08-c0a5-4dd7-a323-768705aa9997 req-be45ce50-18c5-4a08-9760-c44fb7c2d2ff service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:18.365169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-eec53a08-c0a5-4dd7-a323-768705aa9997 req-be45ce50-18c5-4a08-9760-c44fb7c2d2ff service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:18.390839 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-eec53a08-c0a5-4dd7-a323-768705aa9997 req-be45ce50-18c5-4a08-9760-c44fb7c2d2ff service nova] Creating event network-changed:8cf56997-b952-4786-979c-78c1d6c3074e for instance 7a93360c-22e7-48a0-8f10-ab756a21325d on n-h1-845781-6 Aug 09 17:07:18.398239 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-eec53a08-c0a5-4dd7-a323-768705aa9997 req-be45ce50-18c5-4a08-9760-c44fb7c2d2ff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081173 Aug 09 17:07:18.399323 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 485/923] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:18.410010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:18.410589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:18.432522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:18.433417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:18.434180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:18.435422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:18.442278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:18.442830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:18.970659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:18.980064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:18.981660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:18.982885 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4f653fa8-1b96-479d-addc-bdefeec8047b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1567 microversion: 2.25 time: 0.582256 Aug 09 17:07:19.008222 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 486/924] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:18 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1567 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:19.031071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-386cdba8-4443-4a98-b261-3239bf864289 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:19.032182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-386cdba8-4443-4a98-b261-3239bf864289 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:19.044024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386cdba8-4443-4a98-b261-3239bf864289 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:19.044933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386cdba8-4443-4a98-b261-3239bf864289 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:19.045540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386cdba8-4443-4a98-b261-3239bf864289 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:19.046491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386cdba8-4443-4a98-b261-3239bf864289 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:19.049813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386cdba8-4443-4a98-b261-3239bf864289 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:19.050764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386cdba8-4443-4a98-b261-3239bf864289 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:19.562166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-386cdba8-4443-4a98-b261-3239bf864289 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:19.587231 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-386cdba8-4443-4a98-b261-3239bf864289 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1308 microversion: 2.1 time: 0.576452 Aug 09 17:07:19.589019 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 487/925] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:19 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1308 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:19.595020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69731e48-9977-4e23-95c6-9c76c3268076 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:19.596204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-69731e48-9977-4e23-95c6-9c76c3268076 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:19.604156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69731e48-9977-4e23-95c6-9c76c3268076 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:19.605086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69731e48-9977-4e23-95c6-9c76c3268076 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:19.605795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69731e48-9977-4e23-95c6-9c76c3268076 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:19.606799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69731e48-9977-4e23-95c6-9c76c3268076 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:19.609024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69731e48-9977-4e23-95c6-9c76c3268076 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:19.609800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69731e48-9977-4e23-95c6-9c76c3268076 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:20.111029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=18 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:20.192405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-69731e48-9977-4e23-95c6-9c76c3268076 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5437ccd3449941079dfbb9a5e943029e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09be0c4a839f45c5848413a9d99bbf66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:20.242670 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69731e48-9977-4e23-95c6-9c76c3268076 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 200 len: 1476 microversion: 2.1 time: 0.652056 Aug 09 17:07:20.261886 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 488/926] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:19 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 1476 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:20.270979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1a232ef-3058-418d-bbd3-59bc76964255 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Calling method '.version_select at 0x7fbbcb7b61f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:20.274339 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:20.274339 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:20.294228 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-e1a232ef-3058-418d-bbd3-59bc76964255 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1a232ef-3058-418d-bbd3-59bc76964255 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Request method failure captured: Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQ5BC4GHqcBUkbJRZK0mRY9hkCyfnr3Qr9d_rB0kuIRs4syDZD1Gt1TeUHV0gCs7i9cwEh7tz32WCkQC15iBMQr0YCB07DomgMmwxiK7kT-XVzfH5RoRUPpcLFihNKmJxDnBMAb-39wbxFD_14VSs_R5RqExMb0CoowGwGJ2LSnObo Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:07:20.296321 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_53aa23093f434c17a895de6b5310514e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/53aa23093f434c17a895de6b5310514e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e31f0700476b45749677df9a88edc455 Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'nonexistent_hostname'} Aug 09 17:07:20.297691 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:07:20.298486 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 09 17:07:20.301469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1a232ef-3058-418d-bbd3-59bc76964255 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1a232ef-3058-418d-bbd3-59bc76964255 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.034390 Aug 09 17:07:20.305298 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 489/927] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:07:20 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:07:20.369522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25761629-dba2-41ad-ac6d-535ad46bd3b3 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcb823c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1765130992", "description": "tempest-description-2064723341"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:20.935827 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-25761629-dba2-41ad-ac6d-535ad46bd3b3 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.635792 Aug 09 17:07:20.937181 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 490/928] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:07:20 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:20.946235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-40b612d6-e776-403a-a5a4-b6ec1ab3c2b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:20.949168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-40b612d6-e776-403a-a5a4-b6ec1ab3c2b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:20.957297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40b612d6-e776-403a-a5a4-b6ec1ab3c2b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:20.958350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40b612d6-e776-403a-a5a4-b6ec1ab3c2b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:20.959003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40b612d6-e776-403a-a5a4-b6ec1ab3c2b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:20.961068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40b612d6-e776-403a-a5a4-b6ec1ab3c2b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:20.961788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40b612d6-e776-403a-a5a4-b6ec1ab3c2b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:20.962508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40b612d6-e776-403a-a5a4-b6ec1ab3c2b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:21.294517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Updating instance_info_cache with network_info: [{"id": "8cf56997-b952-4786-979c-78c1d6c3074e", "address": "fa:16:3e:ba:9f:40", "network": {"id": "33eed447-e2df-431f-9045-4fdaac89edae", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-137527411-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "569d108c1d9f4f82bbb69dbba49f19ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8cf56997-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:07:21.317580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-40b612d6-e776-403a-a5a4-b6ec1ab3c2b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:21.322349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Releasing lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:07:21.324110 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9477289-9082-45f3-89a8-a19c00173940 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action" status: 202 len: 0 microversion: 2.1 time: 11.251603 Aug 09 17:07:21.330322 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 439/929] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:10 2022] POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action => generated 0 bytes in 11260 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 17:07:21.340448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4700681c-997d-4a34-a2bb-7d9c6f988ad8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:21.354812 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-40b612d6-e776-403a-a5a4-b6ec1ab3c2b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1541 microversion: 2.1 time: 0.408293 Aug 09 17:07:21.359802 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 491/930] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:20 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1541 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:21.373232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:21.376642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:21.431035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4700681c-997d-4a34-a2bb-7d9c6f988ad8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:21.453043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:21.456736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:21.462856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:21.466999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4700681c-997d-4a34-a2bb-7d9c6f988ad8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:21.468461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4700681c-997d-4a34-a2bb-7d9c6f988ad8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:21.470238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4700681c-997d-4a34-a2bb-7d9c6f988ad8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:21.470493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:21.479508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:21.479508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:21.483048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4700681c-997d-4a34-a2bb-7d9c6f988ad8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:21.484503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4700681c-997d-4a34-a2bb-7d9c6f988ad8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:21.485700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4700681c-997d-4a34-a2bb-7d9c6f988ad8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:21.910030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:21.932535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:21.936560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:21.940788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6081738b-6e6f-40ae-8551-e37c2b9f79e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1557 microversion: 2.25 time: 0.575233 Aug 09 17:07:21.955988 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 492/931] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:21 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1557 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:21.965817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-72c63933-2f0f-4e8b-91ab-f89c60c5665b tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Calling method '.version_select at 0x7fbbcb79dee0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:21.965817 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:21.965817 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:21.968243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-72c63933-2f0f-4e8b-91ab-f89c60c5665b tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '0c5e633a72c341658ba90990e256723f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d21c991382040c89cbccb4b6b4be0e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-72c63933-2f0f-4e8b-91ab-f89c60c5665b tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Request method failure captured: Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-hosts/n-d-845781-6/startup HTTP/1.1 Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQ4OkYm8Odx7UcIFYggwyJ4KisLV7enrgSTuHTPeus68vdNvZ6WULiAQpv7x3BfIh1ybZlmPxz05RIho10p0jESzYIc7hDJ4nz1B6-crx7dqpd_oMmQM0YVid8SisdE5WKplMduT0NYVeujpgesF3QLbU19rVZX8qeCrJyitA7nT54 Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:07:21.978092 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 0c5e633a72c341658ba90990e256723f Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'n-d-845781-6'} Aug 09 17:07:21.981199 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:07:21.982975 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 09 17:07:21.985539 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:21.993176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-72c63933-2f0f-4e8b-91ab-f89c60c5665b tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:21.995463 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-72c63933-2f0f-4e8b-91ab-f89c60c5665b tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-845781-6/startup" status: 403 len: 110 microversion: 2.1 time: 0.051692 Aug 09 17:07:21.996916 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 493/932] 10.222.0.93 () {58 vars in 1191 bytes} [Tue Aug 9 17:07:21 2022] GET /compute/v2.1/os-hosts/n-d-845781-6/startup => generated 110 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:07:22.008798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-70271018-65ef-4aa1-aa45-de56a33e7f9c req-6bb7c0a4-b040-4d3c-a38a-452491f673e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e83b0d7-61ec-490e-8994-0dcac0321e75", "name": "network-vif-deleted", "tag": "7d7bf8b4-de32-41ee-a7b0-a3159d2f5165"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:22.035656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-70271018-65ef-4aa1-aa45-de56a33e7f9c req-6bb7c0a4-b040-4d3c-a38a-452491f673e2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:22.037016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-70271018-65ef-4aa1-aa45-de56a33e7f9c req-6bb7c0a4-b040-4d3c-a38a-452491f673e2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:22.038397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-70271018-65ef-4aa1-aa45-de56a33e7f9c req-6bb7c0a4-b040-4d3c-a38a-452491f673e2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:22.062592 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-70271018-65ef-4aa1-aa45-de56a33e7f9c req-6bb7c0a4-b040-4d3c-a38a-452491f673e2 service nova] Creating event network-vif-deleted:7d7bf8b4-de32-41ee-a7b0-a3159d2f5165 for instance 9e83b0d7-61ec-490e-8994-0dcac0321e75 on n-h1-845781-6 Aug 09 17:07:22.073468 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-70271018-65ef-4aa1-aa45-de56a33e7f9c req-6bb7c0a4-b040-4d3c-a38a-452491f673e2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074004 Aug 09 17:07:22.074721 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 494/933] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:22.085871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9915ae85-d43f-4aed-8a6c-79aedf90ea56 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:22.087166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9915ae85-d43f-4aed-8a6c-79aedf90ea56 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:22.092321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4700681c-997d-4a34-a2bb-7d9c6f988ad8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:22.102447 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4700681c-997d-4a34-a2bb-7d9c6f988ad8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1480 microversion: 2.1 time: 0.770337 Aug 09 17:07:22.102744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9915ae85-d43f-4aed-8a6c-79aedf90ea56 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:22.103436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9915ae85-d43f-4aed-8a6c-79aedf90ea56 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:22.104325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9915ae85-d43f-4aed-8a6c-79aedf90ea56 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:22.106406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9915ae85-d43f-4aed-8a6c-79aedf90ea56 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:22.107686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9915ae85-d43f-4aed-8a6c-79aedf90ea56 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:22.108630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9915ae85-d43f-4aed-8a6c-79aedf90ea56 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:22.119283 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 440/934] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:21 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1480 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:22.125614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-afe1a6ee-be93-438e-a3e5-735c59fba558 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcbcb85e0>, body: {"security_group_rule": {"parent_group_id": "ed1990a2-5b55-45f1-9fd9-f7353cff80da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:22.395692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9915ae85-d43f-4aed-8a6c-79aedf90ea56 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:22.418716 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9915ae85-d43f-4aed-8a6c-79aedf90ea56 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1308 microversion: 2.1 time: 0.341304 Aug 09 17:07:22.444634 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 495/935] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:22 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:22.457059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:22.458525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] [instance: 9e83b0d7-61ec-490e-8994-0dcac0321e75] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:22.472632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:22.474521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:22.476749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:22.479484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:22.481060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:22.482186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:22.507218 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] HTTP exception thrown: Instance 9e83b0d7-61ec-490e-8994-0dcac0321e75 could not be found. Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Request method failure captured: Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 HTTP/1.1 Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pP0DYBXrz8RJdgxtDfTMEhrhY_DEDasvFVLGNeszKukW5O8oZifVHqn8M99ZwFOmX6tPJfjEetjMSnQTwpdpd184Z0WUnjnf3RW3uvrbawsFr5KpHtXO_2keoxLDbMJz11c8yq1Yn0xtxMVs29f7vtMgAFq6NGhZyTzoFMQ706w54U Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 09be0c4a839f45c5848413a9d99bbf66 Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-422464435 Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:07:22.509038 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09be0c4a839f45c5848413a9d99bbf66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09be0c4a839f45c5848413a9d99bbf66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09be0c4a839f45c5848413a9d99bbf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09be0c4a839f45c5848413a9d99bbf66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersAdminNegativeTestJSON-422464435 Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 09be0c4a839f45c5848413a9d99bbf66 Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-422464435 Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersAdminNegativeTestJSON-422464435-project Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 5437ccd3449941079dfbb9a5e943029e Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersAdminNegativeTestJSON-422464435-project Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 9e83b0d7-61ec-490e-8994-0dcac0321e75 could not be found. Aug 09 17:07:22.511747 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9e83b0d7-61ec-490e-8994-0dcac0321e75'} Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e83b0d7-61ec-490e-8994-0dcac0321e75 could not be found. Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:22.513217 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e83b0d7-61ec-490e-8994-0dcac0321e75 could not be found. Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e83b0d7-61ec-490e-8994-0dcac0321e75 could not be found. Aug 09 17:07:22.516145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:22.519188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] Returning 404 to user: Instance 9e83b0d7-61ec-490e-8994-0dcac0321e75 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:22.519188 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e3ba71e-c99f-4b05-aae5-1f592cd01bc0 tempest-ServersAdminNegativeTestJSON-422464435 tempest-ServersAdminNegativeTestJSON-422464435-project] 10.222.0.93 "GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75" status: 404 len: 111 microversion: 2.1 time: 0.064299 Aug 09 17:07:22.525349 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 496/936] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:22 2022] GET /compute/v2.1/servers/9e83b0d7-61ec-490e-8994-0dcac0321e75 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:07:22.539978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af8da87c-4a17-4d8b-9a2a-e216cb045a54 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Action: 'create', calling method: .version_select at 0x7fbbcb8731f0>, body: {"pool": "170ffeb2-2bf9-4cef-a3dd-e551a8cfc174"} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:23.024013 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-afe1a6ee-be93-438e-a3e5-735c59fba558 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.902560 Aug 09 17:07:23.029499 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 441/937] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:07:22 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:23.056239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d2b56175-4eb1-4ca7-8046-42e9a0517d43 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '.version_select at 0x7fbbcba4a040>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:23.074632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2b56175-4eb1-4ca7-8046-42e9a0517d43 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:23.077304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2b56175-4eb1-4ca7-8046-42e9a0517d43 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:23.078666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2b56175-4eb1-4ca7-8046-42e9a0517d43 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:23.137680 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d2b56175-4eb1-4ca7-8046-42e9a0517d43 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 2788 microversion: 2.25 time: 0.105794 Aug 09 17:07:23.158640 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 442/938] 10.222.0.93 () {60 vars in 1184 bytes} [Tue Aug 9 17:07:23 2022] GET /compute/v2.1/os-migrations => generated 2788 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:23.175462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4c955d8d-97de-4922-8108-7df0821759aa tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Calling method '.version_select at 0x7fbbcbe14820>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:23.178150 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:23.178150 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:07:23.194677 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-4c955d8d-97de-4922-8108-7df0821759aa tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4c955d8d-97de-4922-8108-7df0821759aa tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Request method failure captured: Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pQ5BC4GHqcBUkbJRZK0mRY9hkCyfnr3Qr9d_rB0kuIRs4syDZD1Gt1TeUHV0gCs7i9cwEh7tz32WCkQC15iBMQr0YCB07DomgMmwxiK7kT-XVzfH5RoRUPpcLFihNKmJxDnBMAb-39wbxFD_14VSs_R5RqExMb0CoowGwGJ2LSnObo Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:07:23.198982 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_53aa23093f434c17a895de6b5310514e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/53aa23093f434c17a895de6b5310514e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: e31f0700476b45749677df9a88edc455 Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'nonexistent_hostname'} Aug 09 17:07:23.201894 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:07:23.203539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 09 17:07:23.206034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:23.208391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:23.208391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:23.208391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:23.208391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:23.208391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:23.208391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:23.208391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:23.208391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:23.208391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:23.208391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:23.208391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:23.222282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4c955d8d-97de-4922-8108-7df0821759aa tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:23.222282 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4c955d8d-97de-4922-8108-7df0821759aa tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.045395 Aug 09 17:07:23.222282 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 443/939] 10.222.0.93 () {58 vars in 1215 bytes} [Tue Aug 9 17:07:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:07:23.233006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e7cd90a3-933c-48f5-8928-c51863a8eff3 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '.version_select at 0x7fbbcbd98940>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:23.240910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7cd90a3-933c-48f5-8928-c51863a8eff3 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:23.242271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7cd90a3-933c-48f5-8928-c51863a8eff3 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:23.243333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7cd90a3-933c-48f5-8928-c51863a8eff3 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:23.266724 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e7cd90a3-933c-48f5-8928-c51863a8eff3 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 2347 microversion: 2.1 time: 0.040877 Aug 09 17:07:23.268762 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 444/940] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:07:23 2022] GET /compute/v2.1/os-migrations => generated 2347 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:23.278960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1c7c1aa2-a4af-413c-8515-d1e0b99cc038 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:23.280648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1c7c1aa2-a4af-413c-8515-d1e0b99cc038 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:23.298104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c1aa2-a4af-413c-8515-d1e0b99cc038 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:23.299599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c1aa2-a4af-413c-8515-d1e0b99cc038 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:23.301127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c1aa2-a4af-413c-8515-d1e0b99cc038 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:23.304211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c1aa2-a4af-413c-8515-d1e0b99cc038 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:23.305466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c1aa2-a4af-413c-8515-d1e0b99cc038 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:23.306651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c1aa2-a4af-413c-8515-d1e0b99cc038 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:24.117996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1c7c1aa2-a4af-413c-8515-d1e0b99cc038 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:24.133415 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1c7c1aa2-a4af-413c-8515-d1e0b99cc038 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1541 microversion: 2.1 time: 0.862442 Aug 09 17:07:24.134458 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 445/941] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:23 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1541 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:24.144699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b1a91974-0cab-49be-93ac-88072611918f tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcba4a820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-122377068", "description": "tempest-description-1402790180"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:24.380832 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b1a91974-0cab-49be-93ac-88072611918f tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.244166 Aug 09 17:07:24.396536 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 446/942] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:07:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:24.405096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dc6b3f1e-4377-4e66-b8b2-c091621c67b8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:24.406078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dc6b3f1e-4377-4e66-b8b2-c091621c67b8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:24.414134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc6b3f1e-4377-4e66-b8b2-c091621c67b8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:24.414638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc6b3f1e-4377-4e66-b8b2-c091621c67b8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:24.415071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc6b3f1e-4377-4e66-b8b2-c091621c67b8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:24.415901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc6b3f1e-4377-4e66-b8b2-c091621c67b8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:24.416259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc6b3f1e-4377-4e66-b8b2-c091621c67b8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:24.416681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc6b3f1e-4377-4e66-b8b2-c091621c67b8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:24.685079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-dc6b3f1e-4377-4e66-b8b2-c091621c67b8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid 1ddc1848-1711-406c-947a-94149934b5d3 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:07:24.896877 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dc6b3f1e-4377-4e66-b8b2-c091621c67b8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 2049 microversion: 2.25 time: 0.496514 Aug 09 17:07:24.924527 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 447/943] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:24 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 2049 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:24.924527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c969afe-46f9-468f-8161-dbabfade6891 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Action: 'update', calling method: .version_select at 0x7fbbd9ff1d30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c969afe-46f9-468f-8161-dbabfade6891 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Request method failure captured: Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/os-hosts/n-d-845781-6 HTTP/1.1 Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 51 Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pQ5BC4GHqcBUkbJRZK0mRY9hkCyfnr3Qr9d_rB0kuIRs4syDZD1Gt1TeUHV0gCs7i9cwEh7tz32WCkQC15iBMQr0YCB07DomgMmwxiK7kT-XVzfH5RoRUPpcLFihNKmJxDnBMAb-39wbxFD_14VSs_R5RqExMb0CoowGwGJ2LSnObo Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:07:24.929052 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_53aa23093f434c17a895de6b5310514e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/53aa23093f434c17a895de6b5310514e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: e31f0700476b45749677df9a88edc455 Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: {"status": "enable", "maintenance_mode": "invalid"} Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:07:24.930448 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'n-d-845781-6', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'disable', Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'Enable', Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'Disable', Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance: Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'invalid' Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:24.931276 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:24.932817 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:24.934057 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:24.934057 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:07:24.934057 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:07:24.934057 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 17:07:24.934057 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:24.942090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c969afe-46f9-468f-8161-dbabfade6891 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:24.945456 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2c969afe-46f9-468f-8161-dbabfade6891 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-845781-6" status: 400 len: 199 microversion: 2.1 time: 0.026141 Aug 09 17:07:24.953574 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 448/944] 10.222.0.93 () {60 vars in 1187 bytes} [Tue Aug 9 17:07:24 2022] PUT /compute/v2.1/os-hosts/n-d-845781-6 => generated 199 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:07:24.961227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e22be19-4c09-475d-a373-2291671d3c50 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:24.962296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0e22be19-4c09-475d-a373-2291671d3c50 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:25.000085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e22be19-4c09-475d-a373-2291671d3c50 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:25.001014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e22be19-4c09-475d-a373-2291671d3c50 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:25.001737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e22be19-4c09-475d-a373-2291671d3c50 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:25.002872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e22be19-4c09-475d-a373-2291671d3c50 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:25.003594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e22be19-4c09-475d-a373-2291671d3c50 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:25.004292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e22be19-4c09-475d-a373-2291671d3c50 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:25.316655 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-af8da87c-4a17-4d8b-9a2a-e216cb045a54 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.787674 Aug 09 17:07:25.321129 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 497/945] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:07:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:25.322400 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e22be19-4c09-475d-a373-2291671d3c50 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1631 microversion: 2.1 time: 0.367015 Aug 09 17:07:25.335450 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 449/946] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:24 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1631 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:25.335450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-3ce67316-791d-469d-96ec-b9a6f133ec35 req-53e745ed-9511-4ccf-ac02-d93b920361de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417d9361-7e22-4e97-a3a9-acd1f3a91e46", "tag": "ce57d96c-a257-41a4-a475-4abfa4213f53"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:25.335951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4dc1fcb5-b90f-406a-a843-62b0fb21c197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:25.335951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4dc1fcb5-b90f-406a-a843-62b0fb21c197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:25.347149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dc1fcb5-b90f-406a-a843-62b0fb21c197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:25.348121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dc1fcb5-b90f-406a-a843-62b0fb21c197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:25.349310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dc1fcb5-b90f-406a-a843-62b0fb21c197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:25.350682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dc1fcb5-b90f-406a-a843-62b0fb21c197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:25.352633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3ce67316-791d-469d-96ec-b9a6f133ec35 req-53e745ed-9511-4ccf-ac02-d93b920361de service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:25.352633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3ce67316-791d-469d-96ec-b9a6f133ec35 req-53e745ed-9511-4ccf-ac02-d93b920361de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:25.353297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dc1fcb5-b90f-406a-a843-62b0fb21c197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:25.353459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3ce67316-791d-469d-96ec-b9a6f133ec35 req-53e745ed-9511-4ccf-ac02-d93b920361de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:25.354440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dc1fcb5-b90f-406a-a843-62b0fb21c197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:25.378428 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-3ce67316-791d-469d-96ec-b9a6f133ec35 req-53e745ed-9511-4ccf-ac02-d93b920361de service nova] Creating event network-changed:ce57d96c-a257-41a4-a475-4abfa4213f53 for instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 on n-h2-845781-6 Aug 09 17:07:25.385111 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-3ce67316-791d-469d-96ec-b9a6f133ec35 req-53e745ed-9511-4ccf-ac02-d93b920361de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060002 Aug 09 17:07:25.386157 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 450/947] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:25.392485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-78353669-4e0a-497a-90f2-12c610af6958 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcbc921f0>, body: {"security_group_rule": {"parent_group_id": "dc05b438-fd40-41eb-85fc-caf29bef8818", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:25.559025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4dc1fcb5-b90f-406a-a843-62b0fb21c197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:25.571602 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4dc1fcb5-b90f-406a-a843-62b0fb21c197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1308 microversion: 2.1 time: 0.248259 Aug 09 17:07:25.572143 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 498/948] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:25 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1308 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:25.582226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d912127f-cf46-4da2-acf8-52078d7b2158 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcb7e4f70>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d912127f-cf46-4da2-acf8-52078d7b2158 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Request method failure captured: Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: request: PUT /compute/v2.1/os-hosts/n-d-845781-6 HTTP/1.1 Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 51 Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQ5BC4GHqcBUkbJRZK0mRY9hkCyfnr3Qr9d_rB0kuIRs4syDZD1Gt1TeUHV0gCs7i9cwEh7tz32WCkQC15iBMQr0YCB07DomgMmwxiK7kT-XVzfH5RoRUPpcLFihNKmJxDnBMAb-39wbxFD_14VSs_R5RqExMb0CoowGwGJ2LSnObo Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:07:25.588575 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_53aa23093f434c17a895de6b5310514e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/53aa23093f434c17a895de6b5310514e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e31f0700476b45749677df9a88edc455 Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: {"status": "invalid", "maintenance_mode": "enable"} Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:25.591256 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'n-d-845781-6', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'disable', Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'Enable', Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'Disable', Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance: Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'invalid' Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:25.592800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:25.598773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:25.602836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:25.602836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:07:25.602836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:07:25.602836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 17:07:25.602836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:25.602836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d912127f-cf46-4da2-acf8-52078d7b2158 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:25.602836 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d912127f-cf46-4da2-acf8-52078d7b2158 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-845781-6" status: 400 len: 189 microversion: 2.1 time: 0.016416 Aug 09 17:07:25.602836 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 499/949] 10.222.0.93 () {60 vars in 1187 bytes} [Tue Aug 9 17:07:25 2022] PUT /compute/v2.1/os-hosts/n-d-845781-6 => generated 189 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:07:25.606314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b58aad10-05ea-4019-8056-dc37b4c7e9ad tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:25.607728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b58aad10-05ea-4019-8056-dc37b4c7e9ad tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:25.615173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b58aad10-05ea-4019-8056-dc37b4c7e9ad tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:25.616454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b58aad10-05ea-4019-8056-dc37b4c7e9ad tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:25.616928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b58aad10-05ea-4019-8056-dc37b4c7e9ad tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:25.617905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b58aad10-05ea-4019-8056-dc37b4c7e9ad tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:25.618485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b58aad10-05ea-4019-8056-dc37b4c7e9ad tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:25.618924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b58aad10-05ea-4019-8056-dc37b4c7e9ad tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:25.877843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b58aad10-05ea-4019-8056-dc37b4c7e9ad tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:25.887546 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b58aad10-05ea-4019-8056-dc37b4c7e9ad tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1541 microversion: 2.1 time: 0.287354 Aug 09 17:07:25.888639 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 500/950] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:25 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1541 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:25.894225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-609564807", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "58c9a4df-a052-4259-baba-4eb50282dd0b"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:25.962268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] validate_networks() for [('58c9a4df-a052-4259-baba-4eb50282dd0b', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:07:26.134951 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-78353669-4e0a-497a-90f2-12c610af6958 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.747034 Aug 09 17:07:26.148664 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 451/951] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:07:25 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:26.158499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.39"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:26.163094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:26.176216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:26.177609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:26.179210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:26.180567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:26.181493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:26.182346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:26.224524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:07:26.225320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquired lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:07:27.065998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.39 (d4eb3970-3231-407e-8f15-5778a16fa882) with port 8cf56997-b952-4786-979c-78c1d6c3074e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 170ffeb2-2bf9-4cef-a3dd-e551a8cfc174.", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:07:27.067697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Releasing lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:07:27.068657 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.39 (d4eb3970-3231-407e-8f15-5778a16fa882) with port 8cf56997-b952-4786-979c-78c1d6c3074e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 170ffeb2-2bf9-4cef-a3dd-e551a8cfc174. Aug 09 17:07:27.068657 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-666c96ae-f4f5-4d02-a2f6-8a35bade0ef9'] Aug 09 17:07:27.085690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:07:27.086393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:07:27.087230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:07:27.088258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:07:27.089576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Request method failure captured: Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action HTTP/1.1 Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 45 Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pQZMD4hlDbq3qEREeMOUkM9aoHl8ZdoCnxDyYt_SfAJPta4QxnE9RNEmsFuXMiqr3kBxo_vERRCyLX9tvwzHk-34ZOf_Hy9HSlcu9fRR4x_7f-qBlDlAvCPyljDEoczsLBrjqba2aubfnqnGhUAYhZGgCcFGGwYd1rcIeA2CrdDvSQ Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 569d108c1d9f4f82bbb69dbba49f19ed Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:07:27.102473 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 569d108c1d9f4f82bbb69dbba49f19ed Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: b147f363cb434339ad1e3f302838574c Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: {"addFloatingIp": {"address": "172.25.5.39"}} Aug 09 17:07:27.105008 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: exception: Cannot associate floating IP 172.25.5.39 (d4eb3970-3231-407e-8f15-5778a16fa882) with port 8cf56997-b952-4786-979c-78c1d6c3074e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 170ffeb2-2bf9-4cef-a3dd-e551a8cfc174. Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-666c96ae-f4f5-4d02-a2f6-8a35bade0ef9'] Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '7a93360c-22e7-48a0-8f10-ab756a21325d', 'body': {'addFloatingIp': {'address': '172.25.5.39'}}} Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:07:27.106536 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:07:27.108861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.39 (d4eb3970-3231-407e-8f15-5778a16fa882) with port 8cf56997-b952-4786-979c-78c1d6c3074e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 170ffeb2-2bf9-4cef-a3dd-e551a8cfc174. Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-666c96ae-f4f5-4d02-a2f6-8a35bade0ef9'] Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.39 (d4eb3970-3231-407e-8f15-5778a16fa882) with port 8cf56997-b952-4786-979c-78c1d6c3074e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 170ffeb2-2bf9-4cef-a3dd-e551a8cfc174. Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-666c96ae-f4f5-4d02-a2f6-8a35bade0ef9'] Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:27.111706 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.39 (d4eb3970-3231-407e-8f15-5778a16fa882) with port 8cf56997-b952-4786-979c-78c1d6c3074e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 170ffeb2-2bf9-4cef-a3dd-e551a8cfc174. Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-666c96ae-f4f5-4d02-a2f6-8a35bade0ef9'] Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:27.114638 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:27.117723 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:27.117723 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:27.117723 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:27.117723 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:27.117723 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:27.117723 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:27.117723 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.39 (d4eb3970-3231-407e-8f15-5778a16fa882) with port 8cf56997-b952-4786-979c-78c1d6c3074e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 170ffeb2-2bf9-4cef-a3dd-e551a8cfc174. Aug 09 17:07:27.117723 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-666c96ae-f4f5-4d02-a2f6-8a35bade0ef9'] Aug 09 17:07:27.117723 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:27.119394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:27.119565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Returning 400 to user: Cannot associate floating IP 172.25.5.39 (d4eb3970-3231-407e-8f15-5778a16fa882) with port 8cf56997-b952-4786-979c-78c1d6c3074e using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 170ffeb2-2bf9-4cef-a3dd-e551a8cfc174. Aug 09 17:07:27.119565 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-666c96ae-f4f5-4d02-a2f6-8a35bade0ef9'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:27.119936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:27.120114 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5bc9f7e7-d4f6-49ca-8bc9-c87c40d4c0b9 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action" status: 400 len: 381 microversion: 2.1 time: 0.957942 Aug 09 17:07:27.120331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:27.120331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:27.120331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:27.120331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:27.121345 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 452/952] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:26 2022] POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action => generated 381 bytes in 964 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:07:27.121345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ed575987-5bf4-4939-b4fc-25238c36ef83 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Action: 'create', calling method: .version_select at 0x7fbbcbab5dc0>, body: {"keypair": {"name": "tempest-keypair-1201032910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4Tq/wLEARxlzpib9arDrUNR/Jiu6UvdZttORALrJ/8XgyLO3XAYTK6xi4WfzitfDumXACTZ0uLolAB0m5gjOK94UriEnxhmcGFydQf7WlFpx+4N6sH7Q9A/jamK/SAFw=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:27.140430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ed575987-5bf4-4939-b4fc-25238c36ef83 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Getting quotas for project 44129d75c58240fa867e90b1d3252554. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:07:27.147522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ed575987-5bf4-4939-b4fc-25238c36ef83 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Getting quotas for user 894725e0d56b4960a8bc3e6a8e283b4e and project 44129d75c58240fa867e90b1d3252554. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:07:27.155300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Getting quotas for project 47793440cab647cc943281e2bc566c7f. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:07:27.169032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Getting quotas for user 27626b9d13c340cc9ec2fe564d1bab8d and project 47793440cab647cc943281e2bc566c7f. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:07:27.176546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:27.179653 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ed575987-5bf4-4939-b4fc-25238c36ef83 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062194 Aug 09 17:07:27.180964 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 453/953] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:07:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:27.186846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5330ce63-d983-44e0-9f41-25812dfdb762 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Action: 'update', calling method: .version_select at 0x7fbbcbab5430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:27.197768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:07:27.200610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:07:27.203676 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:27.203676 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:07:27.205363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5330ce63-d983-44e0-9f41-25812dfdb762 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '0c5e633a72c341658ba90990e256723f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d21c991382040c89cbccb4b6b4be0e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5330ce63-d983-44e0-9f41-25812dfdb762 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Request method failure captured: Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/os-hosts/n-d-845781-6 HTTP/1.1 Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 50 Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pQ4OkYm8Odx7UcIFYggwyJ4KisLV7enrgSTuHTPeus68vdNvZ6WULiAQpv7x3BfIh1ybZlmPxz05RIho10p0jESzYIc7hDJ4nz1B6-crx7dqpd_oMmQM0YVid8SisdE5WKplMduT0NYVeujpgesF3QLbU19rVZX8qeCrJyitA7nT54 Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:07:27.207596 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8d21c991382040c89cbccb4b6b4be0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 8d21c991382040c89cbccb4b6b4be0e9 Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-660048578 Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 0c5e633a72c341658ba90990e256723f Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-660048578-project Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: {"status": "enable", "maintenance_mode": "enable"} Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 09 17:07:27.210911 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'n-d-845781-6', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:07:27.212709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 09 17:07:27.215204 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:27.220295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5330ce63-d983-44e0-9f41-25812dfdb762 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:27.220295 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5330ce63-d983-44e0-9f41-25812dfdb762 tempest-HostsAdminNegativeTestJSON-660048578 tempest-HostsAdminNegativeTestJSON-660048578-project] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-845781-6" status: 403 len: 111 microversion: 2.1 time: 0.026929 Aug 09 17:07:27.220295 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 454/954] 10.222.0.93 () {60 vars in 1187 bytes} [Tue Aug 9 17:07:27 2022] PUT /compute/v2.1/os-hosts/n-d-845781-6 => generated 111 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:07:27.222836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc092113-b0c7-4e09-a281-bd418fcc53e7 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcbc0e280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1875668018", "description": "tempest-description-1937163077"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:27.291527 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f26f218d-4c81-45cd-b8e1-c3a1cc999f76 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.401191 Aug 09 17:07:27.292700 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 501/955] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:07:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:07:27.298657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a29d136-824e-4a31-bfda-c27def63d076 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:27.299920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a29d136-824e-4a31-bfda-c27def63d076 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:27.313131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a29d136-824e-4a31-bfda-c27def63d076 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:27.314677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a29d136-824e-4a31-bfda-c27def63d076 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:27.315459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a29d136-824e-4a31-bfda-c27def63d076 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:27.318861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a29d136-824e-4a31-bfda-c27def63d076 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:27.320130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a29d136-824e-4a31-bfda-c27def63d076 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:27.321331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a29d136-824e-4a31-bfda-c27def63d076 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:27.716973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a29d136-824e-4a31-bfda-c27def63d076 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:27.745460 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cc092113-b0c7-4e09-a281-bd418fcc53e7 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.534193 Aug 09 17:07:27.749133 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 455/956] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:07:27 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:27.770970 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a29d136-824e-4a31-bfda-c27def63d076 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1308 microversion: 2.1 time: 0.461002 Aug 09 17:07:27.775793 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 502/957] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:27 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1308 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:27.779699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5812fd8d-90fc-47ef-9a58-1f586e24afc6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:27.791082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5812fd8d-90fc-47ef-9a58-1f586e24afc6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:27.816420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5812fd8d-90fc-47ef-9a58-1f586e24afc6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:27.817593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0f48ac84-e8ca-4a82-bdae-fbfb3057c950 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '.version_select at 0x7fbbcb79d280>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:27.819479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5812fd8d-90fc-47ef-9a58-1f586e24afc6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:27.821810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5812fd8d-90fc-47ef-9a58-1f586e24afc6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:27.824086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5812fd8d-90fc-47ef-9a58-1f586e24afc6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:27.824986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5812fd8d-90fc-47ef-9a58-1f586e24afc6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:27.826821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5812fd8d-90fc-47ef-9a58-1f586e24afc6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:28.236179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5812fd8d-90fc-47ef-9a58-1f586e24afc6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:28.262258 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5812fd8d-90fc-47ef-9a58-1f586e24afc6 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1541 microversion: 2.1 time: 0.511250 Aug 09 17:07:28.264788 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 456/958] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:27 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1541 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:28.300859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-60bc204e-174b-48df-b1e5-6ec503bc9a06 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcbc0e430>, body: {"status": null, "maintenance_mode": null} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-60bc204e-174b-48df-b1e5-6ec503bc9a06 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Request method failure captured: Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/os-hosts/n-d-845781-6 HTTP/1.1 Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 42 Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pQ5BC4GHqcBUkbJRZK0mRY9hkCyfnr3Qr9d_rB0kuIRs4syDZD1Gt1TeUHV0gCs7i9cwEh7tz32WCkQC15iBMQr0YCB07DomgMmwxiK7kT-XVzfH5RoRUPpcLFihNKmJxDnBMAb-39wbxFD_14VSs_R5RqExMb0CoowGwGJ2LSnObo Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:07:28.309364 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_53aa23093f434c17a895de6b5310514e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/53aa23093f434c17a895de6b5310514e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: e31f0700476b45749677df9a88edc455 Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: {"status": null, "maintenance_mode": null} Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 09 17:07:28.312103 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'n-d-845781-6', 'body': {'status': None, 'maintenance_mode': None}} Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'disable', Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'Enable', Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'Disable', Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance: Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi None Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:28.315474 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:28.323618 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:28.326521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:07:28.326521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:07:28.326521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 09 17:07:28.326521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:28.326521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-60bc204e-174b-48df-b1e5-6ec503bc9a06 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:28.328313 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-60bc204e-174b-48df-b1e5-6ec503bc9a06 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-845781-6" status: 400 len: 127 microversion: 2.1 time: 0.045699 Aug 09 17:07:28.330187 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 457/959] 10.222.0.93 () {60 vars in 1187 bytes} [Tue Aug 9 17:07:28 2022] PUT /compute/v2.1/os-hosts/n-d-845781-6 => generated 127 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:07:28.346481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8252e76a-a1cc-4e01-98b9-d2be17068599 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:28.358667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8252e76a-a1cc-4e01-98b9-d2be17068599 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:28.529904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8252e76a-a1cc-4e01-98b9-d2be17068599 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:28.565110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8252e76a-a1cc-4e01-98b9-d2be17068599 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:28.575256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8252e76a-a1cc-4e01-98b9-d2be17068599 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:28.578209 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8252e76a-a1cc-4e01-98b9-d2be17068599 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1261 microversion: 2.25 time: 0.245852 Aug 09 17:07:28.580587 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 458/960] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:28 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1261 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:28.622358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-10702b91-8366-42f7-bbaf-cf2707009dd5 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcbc0e9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1715862410", "description": "tempest-description-1056730503"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:29.134425 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-10702b91-8366-42f7-bbaf-cf2707009dd5 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.521080 Aug 09 17:07:29.135947 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 459/961] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:07:28 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:29.158793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a0d6fe22-9acc-4738-946c-578a19c9caa3 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcbaf8f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:29.162799 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:29.162799 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:07:29.164503 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.hosts [None req-a0d6fe22-9acc-4738-946c-578a19c9caa3 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Enabling host nonexistent_hostname. Aug 09 17:07:29.180530 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-a0d6fe22-9acc-4738-946c-578a19c9caa3 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a0d6fe22-9acc-4738-946c-578a19c9caa3 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Request method failure captured: Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 50 Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pQ5BC4GHqcBUkbJRZK0mRY9hkCyfnr3Qr9d_rB0kuIRs4syDZD1Gt1TeUHV0gCs7i9cwEh7tz32WCkQC15iBMQr0YCB07DomgMmwxiK7kT-XVzfH5RoRUPpcLFihNKmJxDnBMAb-39wbxFD_14VSs_R5RqExMb0CoowGwGJ2LSnObo Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:07:29.183357 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_53aa23093f434c17a895de6b5310514e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/53aa23093f434c17a895de6b5310514e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/53aa23093f434c17a895de6b5310514e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 53aa23093f434c17a895de6b5310514e Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-578117110 Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: e31f0700476b45749677df9a88edc455 Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-HostsAdminNegativeTestJSON-578117110-project-admin Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: {"status": "enable", "maintenance_mode": "enable"} Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:29.186536 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 17:07:29.189691 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:29.196463 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:29.206539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a0d6fe22-9acc-4738-946c-578a19c9caa3 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:29.211380 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a0d6fe22-9acc-4738-946c-578a19c9caa3 tempest-HostsAdminNegativeTestJSON-578117110 tempest-HostsAdminNegativeTestJSON-578117110-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.033633 Aug 09 17:07:29.211380 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 460/962] 10.222.0.93 () {60 vars in 1211 bytes} [Tue Aug 9 17:07:29 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:07:29.211380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-98aebe15-a89f-4a2d-ab3f-d15629bf70f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:29.211380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-98aebe15-a89f-4a2d-ab3f-d15629bf70f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:29.218592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aebe15-a89f-4a2d-ab3f-d15629bf70f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:29.218981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aebe15-a89f-4a2d-ab3f-d15629bf70f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:29.220077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aebe15-a89f-4a2d-ab3f-d15629bf70f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:29.221380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aebe15-a89f-4a2d-ab3f-d15629bf70f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:29.222331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aebe15-a89f-4a2d-ab3f-d15629bf70f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:29.223247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aebe15-a89f-4a2d-ab3f-d15629bf70f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:29.607869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-98aebe15-a89f-4a2d-ab3f-d15629bf70f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:29.646705 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-98aebe15-a89f-4a2d-ab3f-d15629bf70f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1308 microversion: 2.1 time: 0.457756 Aug 09 17:07:29.648027 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 461/963] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:29 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:30.122128 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0f48ac84-e8ca-4a82-bdae-fbfb3057c950 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/d4eb3970-3231-407e-8f15-5778a16fa882" status: 202 len: 0 microversion: 2.1 time: 2.344369 Aug 09 17:07:30.126245 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 503/964] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:07:27 2022] DELETE /compute/v2.1/os-floating-ips/d4eb3970-3231-407e-8f15-5778a16fa882 => generated 0 bytes in 2350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:30.140240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c18b63c-d6f7-49d8-9c3f-1b5a85224026 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcb7adf70>, body: {"security_group_rule": {"parent_group_id": "acb771fc-bb65-42b2-af91-7f186cb49b51", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8c82ef1e-ad9b-4aab-a3e2-6801c15f71bb"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:30.310117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f92aca13-29d5-4b8d-8fad-95494b8f7009 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcbaf8550>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:30.315850 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:30.315850 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:07:30.318455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f92aca13-29d5-4b8d-8fad-95494b8f7009 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:30.319285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f92aca13-29d5-4b8d-8fad-95494b8f7009 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:30.320037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f92aca13-29d5-4b8d-8fad-95494b8f7009 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:30.335176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f92aca13-29d5-4b8d-8fad-95494b8f7009 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:30.336568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f92aca13-29d5-4b8d-8fad-95494b8f7009 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:30.337327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f92aca13-29d5-4b8d-8fad-95494b8f7009 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:30.351429 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-f92aca13-29d5-4b8d-8fad-95494b8f7009 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] HTTP exception thrown: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f92aca13-29d5-4b8d-8fad-95494b8f7009 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Request method failure captured: Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/os-services/622d8e8b-4316-4948-b8dc-4b90fa71efae HTTP/1.1 Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 56 Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pRQuFdDGaY6TnbM9pzPqqQ6rSvwgF42WG0jzoF57dE4hBtRz3UAZ_tHrgDnPP1Cq4RicV-ma1mwShyRWyWq84JGcmJY2pcZxVaP8YeYi7WyqExdF-KqmthI--8dP8vTdypKAB6Rg90JQ6jC4IQHHZ3vh7xn_Lxx2_kkSydM3BfHGAM Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.53 Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: e01c0c768d3b47a8ae87031d68911a33 Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1599803452 Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:07:30.353200 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1599803452 Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: e01c0c768d3b47a8ae87031d68911a33 Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1599803452 Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 86b6b8351ccf4beab33be06159cdc215 Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:07:30.355705 n-d-845781-6 devstack@n-api.service[119432]: exception: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '622d8e8b-4316-4948-b8dc-4b90fa71efae', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:30.357465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:30.361626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:30.367915 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:30.367915 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:30.367915 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:30.367915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f92aca13-29d5-4b8d-8fad-95494b8f7009 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Returning 404 to user: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:30.367915 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f92aca13-29d5-4b8d-8fad-95494b8f7009 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-services/622d8e8b-4316-4948-b8dc-4b90fa71efae" status: 404 len: 110 microversion: 2.53 time: 0.705363 Aug 09 17:07:30.367915 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 462/965] 10.222.0.93 () {62 vars in 1309 bytes} [Tue Aug 9 17:07:29 2022] PUT /compute/v2.1/os-services/622d8e8b-4316-4948-b8dc-4b90fa71efae => generated 110 bytes in 713 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:07:30.369297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4545ec45-39ce-4daa-a7b6-3d3f9e73d482 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:30.369297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4545ec45-39ce-4daa-a7b6-3d3f9e73d482 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:30.375955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4545ec45-39ce-4daa-a7b6-3d3f9e73d482 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:30.376797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4545ec45-39ce-4daa-a7b6-3d3f9e73d482 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:30.377476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4545ec45-39ce-4daa-a7b6-3d3f9e73d482 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:30.378421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4545ec45-39ce-4daa-a7b6-3d3f9e73d482 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:30.379095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4545ec45-39ce-4daa-a7b6-3d3f9e73d482 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:30.379863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4545ec45-39ce-4daa-a7b6-3d3f9e73d482 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:30.698474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4545ec45-39ce-4daa-a7b6-3d3f9e73d482 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:30.713173 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4545ec45-39ce-4daa-a7b6-3d3f9e73d482 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1541 microversion: 2.1 time: 0.349787 Aug 09 17:07:30.714405 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 463/966] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:30 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1541 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:30.726219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:30.727642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:30.738539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:30.739341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:30.740320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:30.741925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:30.742761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:30.743537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:30.846167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:30.849938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:30.859700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:30.861862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:30.863029 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5b6f1b18-bf58-4626-9c6a-6c581b89e945 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1319 microversion: 2.25 time: 0.146547 Aug 09 17:07:30.863597 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 464/967] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:30 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:30.869306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d3ead13c-bb0b-4def-ba33-efa9af740923 req-07ec4304-7a98-4add-8518-9b9c53a80d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417d9361-7e22-4e97-a3a9-acd1f3a91e46", "name": "network-vif-plugged", "status": "completed", "tag": "ce57d96c-a257-41a4-a475-4abfa4213f53"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:30.880587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d3ead13c-bb0b-4def-ba33-efa9af740923 req-07ec4304-7a98-4add-8518-9b9c53a80d73 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:30.881909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d3ead13c-bb0b-4def-ba33-efa9af740923 req-07ec4304-7a98-4add-8518-9b9c53a80d73 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:30.882611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d3ead13c-bb0b-4def-ba33-efa9af740923 req-07ec4304-7a98-4add-8518-9b9c53a80d73 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:30.895949 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d3ead13c-bb0b-4def-ba33-efa9af740923 req-07ec4304-7a98-4add-8518-9b9c53a80d73 service nova] Creating event network-vif-plugged:ce57d96c-a257-41a4-a475-4abfa4213f53 for instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 on n-h2-845781-6 Aug 09 17:07:30.903002 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d3ead13c-bb0b-4def-ba33-efa9af740923 req-07ec4304-7a98-4add-8518-9b9c53a80d73 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037854 Aug 09 17:07:30.903607 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 465/968] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:30.909673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Action: 'action', calling method: .version_select at 0x7fbbda3ccc10>, body: {"removeFloatingIp": {"address": "172.25.5.196"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:31.142031 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3c18b63c-d6f7-49d8-9c3f-1b5a85224026 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.013577 Aug 09 17:07:31.143201 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 504/969] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:07:30 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:31.154256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:31.164716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e88764b9-b34a-4b57-a172-27c48c46d74e tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcbabd8b0>, body: {"status": "disabled"} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:31.168015 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:31.168015 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:31.170724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e88764b9-b34a-4b57-a172-27c48c46d74e tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:31.172004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e88764b9-b34a-4b57-a172-27c48c46d74e tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:31.172740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e88764b9-b34a-4b57-a172-27c48c46d74e tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:31.176193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:31.177272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:31.178124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:31.179391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:31.180275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:31.181137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:31.184598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e88764b9-b34a-4b57-a172-27c48c46d74e tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:31.185563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e88764b9-b34a-4b57-a172-27c48c46d74e tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:31.186428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e88764b9-b34a-4b57-a172-27c48c46d74e tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:31.200051 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-e88764b9-b34a-4b57-a172-27c48c46d74e tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] HTTP exception thrown: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e88764b9-b34a-4b57-a172-27c48c46d74e tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Request method failure captured: Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: request: PUT /compute/v2.1/os-services/622d8e8b-4316-4948-b8dc-4b90fa71efae HTTP/1.1 Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 22 Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pRQuFdDGaY6TnbM9pzPqqQ6rSvwgF42WG0jzoF57dE4hBtRz3UAZ_tHrgDnPP1Cq4RicV-ma1mwShyRWyWq84JGcmJY2pcZxVaP8YeYi7WyqExdF-KqmthI--8dP8vTdypKAB6Rg90JQ6jC4IQHHZ3vh7xn_Lxx2_kkSydM3BfHGAM Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.53 Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: e01c0c768d3b47a8ae87031d68911a33 Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1599803452 Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:07:31.204148 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1599803452 Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: e01c0c768d3b47a8ae87031d68911a33 Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1599803452 Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 86b6b8351ccf4beab33be06159cdc215 Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: {"status": "disabled"} Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: exception: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:31.207077 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '622d8e8b-4316-4948-b8dc-4b90fa71efae', 'body': {'status': 'disabled'}} Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:31.208739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:31.213145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:31.219015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:31.219015 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:31.219015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e88764b9-b34a-4b57-a172-27c48c46d74e tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Returning 404 to user: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:31.221129 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e88764b9-b34a-4b57-a172-27c48c46d74e tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-services/622d8e8b-4316-4948-b8dc-4b90fa71efae" status: 404 len: 110 microversion: 2.53 time: 0.075785 Aug 09 17:07:31.221960 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 505/970] 10.222.0.93 () {62 vars in 1309 bytes} [Tue Aug 9 17:07:31 2022] PUT /compute/v2.1/os-services/622d8e8b-4316-4948-b8dc-4b90fa71efae => generated 110 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:07:31.239096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1278212236", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "b176697e-92f5-4744-9b98-692686c31e55"}], "security_groups": [{"name": "tempest-securitygroup--641901293"}], "key_name": "tempest-keypair-1201032910", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:31.496434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] validate_networks() for [('b176697e-92f5-4744-9b98-692686c31e55', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:07:31.666108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:07:31.667060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquired lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:07:32.675714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:07:32.676271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:07:32.678516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:07:32.679042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:07:32.679470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:07:32.691897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:32.692602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:32.693283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:32.694662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:32.695144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:32.696260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:32.720800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Getting quotas for project 44129d75c58240fa867e90b1d3252554. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:07:32.727550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Getting quotas for user 894725e0d56b4960a8bc3e6a8e283b4e and project 44129d75c58240fa867e90b1d3252554. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:07:32.744694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:07:32.747587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:07:32.826001 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f438278b-9308-4617-be60-fd48ec4f1ca5 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.600517 Aug 09 17:07:32.827977 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 506/971] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:07:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:07:32.837910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8137011c-3fd0-4b49-a98d-7ee196c78a7c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:32.839509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8137011c-3fd0-4b49-a98d-7ee196c78a7c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:32.856538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8137011c-3fd0-4b49-a98d-7ee196c78a7c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:32.858757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8137011c-3fd0-4b49-a98d-7ee196c78a7c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:32.864119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8137011c-3fd0-4b49-a98d-7ee196c78a7c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:32.865827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8137011c-3fd0-4b49-a98d-7ee196c78a7c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:32.866926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8137011c-3fd0-4b49-a98d-7ee196c78a7c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:32.868012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8137011c-3fd0-4b49-a98d-7ee196c78a7c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:33.253198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8137011c-3fd0-4b49-a98d-7ee196c78a7c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:33.277102 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8137011c-3fd0-4b49-a98d-7ee196c78a7c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1488 microversion: 2.1 time: 0.446182 Aug 09 17:07:33.279762 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 507/972] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:32 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1488 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:33.293932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-db3f92fe-11f6-4e08-a089-2a6a42fa529a tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcb7e4ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-460949185", "description": "tempest-description-2124383609"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:33.805718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Building network info cache for instance {{(pid=119432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 17:07:34.366907 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-db3f92fe-11f6-4e08-a089-2a6a42fa529a tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.079137 Aug 09 17:07:34.368380 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 508/973] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:07:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:34.389066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0fc19646-2f44-4e87-8796-9a598c9cd9e0 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcb823550>, body: {"status": "enabled"} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:34.425090 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:34.425090 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:34.427386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc19646-2f44-4e87-8796-9a598c9cd9e0 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:34.432647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc19646-2f44-4e87-8796-9a598c9cd9e0 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:34.433473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc19646-2f44-4e87-8796-9a598c9cd9e0 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:34.459959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc19646-2f44-4e87-8796-9a598c9cd9e0 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:34.460869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc19646-2f44-4e87-8796-9a598c9cd9e0 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:34.461540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc19646-2f44-4e87-8796-9a598c9cd9e0 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:34.486365 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0fc19646-2f44-4e87-8796-9a598c9cd9e0 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] HTTP exception thrown: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0fc19646-2f44-4e87-8796-9a598c9cd9e0 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Request method failure captured: Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: request: PUT /compute/v2.1/os-services/622d8e8b-4316-4948-b8dc-4b90fa71efae HTTP/1.1 Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 21 Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pRQuFdDGaY6TnbM9pzPqqQ6rSvwgF42WG0jzoF57dE4hBtRz3UAZ_tHrgDnPP1Cq4RicV-ma1mwShyRWyWq84JGcmJY2pcZxVaP8YeYi7WyqExdF-KqmthI--8dP8vTdypKAB6Rg90JQ6jC4IQHHZ3vh7xn_Lxx2_kkSydM3BfHGAM Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.53 Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: e01c0c768d3b47a8ae87031d68911a33 Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1599803452 Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:07:34.492835 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e01c0c768d3b47a8ae87031d68911a33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1599803452 Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: e01c0c768d3b47a8ae87031d68911a33 Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1599803452 Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 86b6b8351ccf4beab33be06159cdc215 Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: {"status": "enabled"} Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: exception: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:34.494438 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '622d8e8b-4316-4948-b8dc-4b90fa71efae', 'body': {'status': 'enabled'}} Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:34.495286 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:34.497241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:34.499183 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. Aug 09 17:07:34.499183 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:34.499183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0fc19646-2f44-4e87-8796-9a598c9cd9e0 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Returning 404 to user: Service 622d8e8b-4316-4948-b8dc-4b90fa71efae could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:34.499183 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0fc19646-2f44-4e87-8796-9a598c9cd9e0 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-services/622d8e8b-4316-4948-b8dc-4b90fa71efae" status: 404 len: 110 microversion: 2.53 time: 0.125708 Aug 09 17:07:34.517673 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 509/974] 10.222.0.93 () {62 vars in 1309 bytes} [Tue Aug 9 17:07:34 2022] PUT /compute/v2.1/os-services/622d8e8b-4316-4948-b8dc-4b90fa71efae => generated 110 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:07:34.531806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4c17820-f67c-4488-8e18-e73ac4a4a503 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:34.534118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c4c17820-f67c-4488-8e18-e73ac4a4a503 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:34.574731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c17820-f67c-4488-8e18-e73ac4a4a503 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:34.576494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c17820-f67c-4488-8e18-e73ac4a4a503 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:34.578063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c17820-f67c-4488-8e18-e73ac4a4a503 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:34.582651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c17820-f67c-4488-8e18-e73ac4a4a503 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:34.584907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c17820-f67c-4488-8e18-e73ac4a4a503 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:34.586067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c17820-f67c-4488-8e18-e73ac4a4a503 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:35.016320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c4c17820-f67c-4488-8e18-e73ac4a4a503 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:35.030846 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c4c17820-f67c-4488-8e18-e73ac4a4a503 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1541 microversion: 2.1 time: 0.510235 Aug 09 17:07:35.031793 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 510/975] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:34 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1541 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:35.055512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:35.064806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:35.086383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:35.092532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:35.097141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:35.098276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:35.098967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:35.099845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:35.366836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:35.399423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:35.404752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:35.409126 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-028d33c6-2163-470f-a6c6-d038c343f71a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1361 microversion: 2.25 time: 0.375539 Aug 09 17:07:35.410788 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 511/976] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:35 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:35.423022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26de432b-870f-4716-b917-b6bcb74d7907 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:35.424289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-26de432b-870f-4716-b917-b6bcb74d7907 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:35.450046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26de432b-870f-4716-b917-b6bcb74d7907 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:35.451284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26de432b-870f-4716-b917-b6bcb74d7907 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:35.452593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26de432b-870f-4716-b917-b6bcb74d7907 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:35.454592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26de432b-870f-4716-b917-b6bcb74d7907 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:35.456094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26de432b-870f-4716-b917-b6bcb74d7907 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:35.458317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26de432b-870f-4716-b917-b6bcb74d7907 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:35.503794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Updating instance_info_cache with network_info: [{"id": "8cf56997-b952-4786-979c-78c1d6c3074e", "address": "fa:16:3e:ba:9f:40", "network": {"id": "33eed447-e2df-431f-9045-4fdaac89edae", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-137527411-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "569d108c1d9f4f82bbb69dbba49f19ed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8cf56997-b9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:07:35.541089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Releasing lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:07:35.542652 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-189a14ac-db58-49ae-86f1-938c6808e1b1 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action" status: 202 len: 0 microversion: 2.1 time: 4.637606 Aug 09 17:07:35.548925 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 466/977] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:30 2022] POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action => generated 0 bytes in 4640 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 17:07:35.566394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ca5bace5-090f-43e3-b354-1bf03699863e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:35.581776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5bace5-090f-43e3-b354-1bf03699863e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:35.584363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5bace5-090f-43e3-b354-1bf03699863e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:35.585658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5bace5-090f-43e3-b354-1bf03699863e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:35.630313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-26de432b-870f-4716-b917-b6bcb74d7907 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:35.663151 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-26de432b-870f-4716-b917-b6bcb74d7907 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1293 microversion: 2.1 time: 0.247168 Aug 09 17:07:35.672306 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 512/978] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:35 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1293 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:35.698956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b75aadd5-d71f-4002-9df1-4ce0e19f3762 req-c4f6721e-0b3e-416b-9e1a-6abec417382c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c3e188-8990-4500-ab50-91d07d799686", "tag": "09a3f3d2-7ab1-4737-95e8-c0be82cec011"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:35.722844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b75aadd5-d71f-4002-9df1-4ce0e19f3762 req-c4f6721e-0b3e-416b-9e1a-6abec417382c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:35.723698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b75aadd5-d71f-4002-9df1-4ce0e19f3762 req-c4f6721e-0b3e-416b-9e1a-6abec417382c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:35.724924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b75aadd5-d71f-4002-9df1-4ce0e19f3762 req-c4f6721e-0b3e-416b-9e1a-6abec417382c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:35.741648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ca5bace5-090f-43e3-b354-1bf03699863e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Going to try to stop instance {{(pid=119432) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 17:07:35.752989 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b75aadd5-d71f-4002-9df1-4ce0e19f3762 req-c4f6721e-0b3e-416b-9e1a-6abec417382c service nova] Creating event network-changed:09a3f3d2-7ab1-4737-95e8-c0be82cec011 for instance e2c3e188-8990-4500-ab50-91d07d799686 on n-h1-845781-6 Aug 09 17:07:35.764523 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b75aadd5-d71f-4002-9df1-4ce0e19f3762 req-c4f6721e-0b3e-416b-9e1a-6abec417382c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089915 Aug 09 17:07:35.766617 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 513/979] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:35.797385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-951b8a1b-af88-4359-bf58-4094f82d486a req-1d71a96b-6b10-4eb6-9825-d01759f5da37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a93360c-22e7-48a0-8f10-ab756a21325d", "tag": "8cf56997-b952-4786-979c-78c1d6c3074e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:35.832840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-951b8a1b-af88-4359-bf58-4094f82d486a req-1d71a96b-6b10-4eb6-9825-d01759f5da37 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:35.834726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-951b8a1b-af88-4359-bf58-4094f82d486a req-1d71a96b-6b10-4eb6-9825-d01759f5da37 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:35.836618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-951b8a1b-af88-4359-bf58-4094f82d486a req-1d71a96b-6b10-4eb6-9825-d01759f5da37 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:35.844134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:35.867767 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-951b8a1b-af88-4359-bf58-4094f82d486a req-1d71a96b-6b10-4eb6-9825-d01759f5da37 service nova] Creating event network-changed:8cf56997-b952-4786-979c-78c1d6c3074e for instance 7a93360c-22e7-48a0-8f10-ab756a21325d on n-h1-845781-6 Aug 09 17:07:35.879679 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-951b8a1b-af88-4359-bf58-4094f82d486a req-1d71a96b-6b10-4eb6-9825-d01759f5da37 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106977 Aug 09 17:07:35.882041 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 514/980] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:35.895861 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ca5bace5-090f-43e3-b354-1bf03699863e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "POST /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46/action" status: 202 len: 0 microversion: 2.1 time: 0.327367 Aug 09 17:07:35.899671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a8199fa-8d0e-449f-aa59-f67e56a4d88e tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcb74ed30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-569229439", "description": "tempest-description-1172353697"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:35.901565 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 467/981] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:35 2022] POST /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:35.925257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1ffdcdef-419e-4074-8c2e-2363f7fc00e9 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:35.936761 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:35.936761 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:07:35.939497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ffdcdef-419e-4074-8c2e-2363f7fc00e9 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:35.940890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ffdcdef-419e-4074-8c2e-2363f7fc00e9 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:35.942276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ffdcdef-419e-4074-8c2e-2363f7fc00e9 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:35.944853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ffdcdef-419e-4074-8c2e-2363f7fc00e9 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:35.946060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ffdcdef-419e-4074-8c2e-2363f7fc00e9 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:35.947358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ffdcdef-419e-4074-8c2e-2363f7fc00e9 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:36.009058 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1ffdcdef-419e-4074-8c2e-2363f7fc00e9 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.105348 Aug 09 17:07:36.016167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 468/982] 10.222.0.93 () {60 vars in 1178 bytes} [Tue Aug 9 17:07:35 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:36.043326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0ecccfa6-5b07-4c3d-a395-d14e1782325b tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '.version_select at 0x7fbbd8200160>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:36.734206 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a8199fa-8d0e-449f-aa59-f67e56a4d88e tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.850103 Aug 09 17:07:36.735836 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 515/983] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:07:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:36.742921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-20bfbbb6-455d-4244-b943-97cf218f902e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:36.744070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-20bfbbb6-455d-4244-b943-97cf218f902e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:36.752602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20bfbbb6-455d-4244-b943-97cf218f902e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:36.756933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20bfbbb6-455d-4244-b943-97cf218f902e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:36.758714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20bfbbb6-455d-4244-b943-97cf218f902e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:36.763845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20bfbbb6-455d-4244-b943-97cf218f902e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:36.764411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20bfbbb6-455d-4244-b943-97cf218f902e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:36.764861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20bfbbb6-455d-4244-b943-97cf218f902e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:37.578801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-20bfbbb6-455d-4244-b943-97cf218f902e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:37.589592 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-20bfbbb6-455d-4244-b943-97cf218f902e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1498 microversion: 2.1 time: 0.851545 Aug 09 17:07:37.595794 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 516/984] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:36 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1498 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:37.600727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f2d3fac2-00fc-4830-9a3a-95056dc03328 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:37.612831 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:37.612831 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:37.615615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d3fac2-00fc-4830-9a3a-95056dc03328 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:37.617327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d3fac2-00fc-4830-9a3a-95056dc03328 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:37.618264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d3fac2-00fc-4830-9a3a-95056dc03328 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:37.619092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d3fac2-00fc-4830-9a3a-95056dc03328 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:37.619550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d3fac2-00fc-4830-9a3a-95056dc03328 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:37.620015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2d3fac2-00fc-4830-9a3a-95056dc03328 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:37.666831 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f2d3fac2-00fc-4830-9a3a-95056dc03328 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.074613 Aug 09 17:07:37.669306 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 517/985] 10.222.0.93 () {60 vars in 1211 bytes} [Tue Aug 9 17:07:37 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:37.683289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f2e4def8-d7ce-44a7-acc3-2230781114cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:37.684352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f2e4def8-d7ce-44a7-acc3-2230781114cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:37.696117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e4def8-d7ce-44a7-acc3-2230781114cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:37.696989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e4def8-d7ce-44a7-acc3-2230781114cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:37.697936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e4def8-d7ce-44a7-acc3-2230781114cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:37.699251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e4def8-d7ce-44a7-acc3-2230781114cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:37.700171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e4def8-d7ce-44a7-acc3-2230781114cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:37.700909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e4def8-d7ce-44a7-acc3-2230781114cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:37.920575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f2e4def8-d7ce-44a7-acc3-2230781114cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:37.934717 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f2e4def8-d7ce-44a7-acc3-2230781114cf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1541 microversion: 2.1 time: 0.263513 Aug 09 17:07:37.936618 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 518/986] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:37 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1541 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:37.946318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:37.947301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:37.955601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:37.956711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:37.957252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:37.958059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:37.958586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:37.959294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:38.156966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:38.170703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:38.172406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:38.173793 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-be3be83f-f637-48af-b3ef-9d414a51e440 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1361 microversion: 2.25 time: 0.236074 Aug 09 17:07:38.176706 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 519/987] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:37 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:38.188415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86f4d1ee-d435-4f1e-ad52-4bbe1368ac6e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:38.189701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-86f4d1ee-d435-4f1e-ad52-4bbe1368ac6e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:38.209356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86f4d1ee-d435-4f1e-ad52-4bbe1368ac6e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:38.210263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86f4d1ee-d435-4f1e-ad52-4bbe1368ac6e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:38.211068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86f4d1ee-d435-4f1e-ad52-4bbe1368ac6e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:38.212506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86f4d1ee-d435-4f1e-ad52-4bbe1368ac6e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:38.215964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86f4d1ee-d435-4f1e-ad52-4bbe1368ac6e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:38.217461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86f4d1ee-d435-4f1e-ad52-4bbe1368ac6e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:38.416309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86f4d1ee-d435-4f1e-ad52-4bbe1368ac6e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:38.431243 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86f4d1ee-d435-4f1e-ad52-4bbe1368ac6e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1360 microversion: 2.1 time: 0.251660 Aug 09 17:07:38.432654 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 520/988] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:38 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1360 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:38.441054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-98fea250-6906-4397-b868-dda6b1725c80 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcb79d430>, body: {"security_group_rule": {"parent_group_id": "003da20e-b889-47a6-bed6-66d31babca4c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "54a3f063-a34b-44f9-904a-5f9741f75a1a"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:38.542816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:38.636670 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0ecccfa6-5b07-4c3d-a395-d14e1782325b tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/3cf05f54-bf44-49a3-a72c-47cfd8ec5662" status: 202 len: 0 microversion: 2.1 time: 2.618593 Aug 09 17:07:38.638437 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 469/989] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:07:36 2022] DELETE /compute/v2.1/os-floating-ips/3cf05f54-bf44-49a3-a72c-47cfd8ec5662 => generated 0 bytes in 2621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:38.937895 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-98fea250-6906-4397-b868-dda6b1725c80 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.502717 Aug 09 17:07:38.939920 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 521/990] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:07:38 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:38.953824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-096e9ee9-e5d4-41a5-a9f1-0736a31cf775 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:38.960107 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:38.960107 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:38.963354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096e9ee9-e5d4-41a5-a9f1-0736a31cf775 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:38.963993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096e9ee9-e5d4-41a5-a9f1-0736a31cf775 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:38.964806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096e9ee9-e5d4-41a5-a9f1-0736a31cf775 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:38.966735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096e9ee9-e5d4-41a5-a9f1-0736a31cf775 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:38.967885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096e9ee9-e5d4-41a5-a9f1-0736a31cf775 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:38.968957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096e9ee9-e5d4-41a5-a9f1-0736a31cf775 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:38.989458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8dc4bd6d-eb2c-4f18-bdad-98d4d669a021 tempest-InstanceUsageAuditLogTestJSON-2014421739 tempest-InstanceUsageAuditLogTestJSON-2014421739-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:38.991119 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:38.991119 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:07:39.025252 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8dc4bd6d-eb2c-4f18-bdad-98d4d669a021 tempest-InstanceUsageAuditLogTestJSON-2014421739 tempest-InstanceUsageAuditLogTestJSON-2014421739-project-admin] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-09 17:07:36" status: 200 len: 318 microversion: 2.1 time: 0.384917 Aug 09 17:07:39.026404 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 470/991] 10.222.0.93 () {58 vars in 1251 bytes} [Tue Aug 9 17:07:38 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-09%2017%3A07%3A36 => generated 318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:39.032939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2ff626a3-159f-4590-a122-c3457930c7a2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:39.033823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2ff626a3-159f-4590-a122-c3457930c7a2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:39.037522 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-096e9ee9-e5d4-41a5-a9f1-0736a31cf775 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.094789 Aug 09 17:07:39.047534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ff626a3-159f-4590-a122-c3457930c7a2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:39.048089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ff626a3-159f-4590-a122-c3457930c7a2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:39.048544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ff626a3-159f-4590-a122-c3457930c7a2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:39.050755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ff626a3-159f-4590-a122-c3457930c7a2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:39.051275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ff626a3-159f-4590-a122-c3457930c7a2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:39.052084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ff626a3-159f-4590-a122-c3457930c7a2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:39.052408 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 522/992] 10.222.0.93 () {60 vars in 1178 bytes} [Tue Aug 9 17:07:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:39.061805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c5b394a-ee53-4b9f-ae12-bd85a839016b tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Action: 'action', calling method: .version_select at 0x7fbbda32a160>, body: {"addFloatingIp": {"address": ""}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c5b394a-ee53-4b9f-ae12-bd85a839016b tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Request method failure captured: Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action HTTP/1.1 Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 34 Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQZMD4hlDbq3qEREeMOUkM9aoHl8ZdoCnxDyYt_SfAJPta4QxnE9RNEmsFuXMiqr3kBxo_vERRCyLX9tvwzHk-34ZOf_Hy9HSlcu9fRR4x_7f-qBlDlAvCPyljDEoczsLBrjqba2aubfnqnGhUAYhZGgCcFGGwYd1rcIeA2CrdDvSQ Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 569d108c1d9f4f82bbb69dbba49f19ed Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:07:39.069122 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 569d108c1d9f4f82bbb69dbba49f19ed Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: b147f363cb434339ad1e3f302838574c Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: {"addFloatingIp": {"address": ""}} Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:39.071894 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '7a93360c-22e7-48a0-8f10-ab756a21325d', 'body': {'addFloatingIp': {'address': ''}}} Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi '' Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:39.082613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:07:39.086145 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:07:39.090108 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 09 17:07:39.090108 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:39.090108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c5b394a-ee53-4b9f-ae12-bd85a839016b tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:39.090108 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c5b394a-ee53-4b9f-ae12-bd85a839016b tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action" status: 400 len: 142 microversion: 2.1 time: 0.017652 Aug 09 17:07:39.090108 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 523/993] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:39 2022] POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action => generated 142 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:07:39.090108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4cc13968-c046-428f-b992-eba345e28dd3 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Calling method '.version_select at 0x7fbbcb8231f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:39.387452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2ff626a3-159f-4590-a122-c3457930c7a2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:39.421359 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2ff626a3-159f-4590-a122-c3457930c7a2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1498 microversion: 2.1 time: 0.391578 Aug 09 17:07:39.424168 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 471/994] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:39 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1498 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:39.436189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5ebcf3da-30b5-4cff-bf42-00efb45a83fb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:39.437304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5ebcf3da-30b5-4cff-bf42-00efb45a83fb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:39.447089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebcf3da-30b5-4cff-bf42-00efb45a83fb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:39.447909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebcf3da-30b5-4cff-bf42-00efb45a83fb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:39.448788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebcf3da-30b5-4cff-bf42-00efb45a83fb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:39.449321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebcf3da-30b5-4cff-bf42-00efb45a83fb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:39.450004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebcf3da-30b5-4cff-bf42-00efb45a83fb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:39.450886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebcf3da-30b5-4cff-bf42-00efb45a83fb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:39.468335 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4cc13968-c046-428f-b992-eba345e28dd3 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/54a3f063-a34b-44f9-904a-5f9741f75a1a" status: 202 len: 0 microversion: 2.1 time: 0.393556 Aug 09 17:07:39.469383 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 524/995] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:07:39 2022] DELETE /compute/v2.1/os-security-groups/54a3f063-a34b-44f9-904a-5f9741f75a1a => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:39.483157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9074bcb9-79a3-4dcd-837b-9e86e9fd59b9 tempest-InstanceUsageAuditLogTestJSON-2014421739 tempest-InstanceUsageAuditLogTestJSON-2014421739-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:39.484771 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:39.484771 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:39.534976 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9074bcb9-79a3-4dcd-837b-9e86e9fd59b9 tempest-InstanceUsageAuditLogTestJSON-2014421739 tempest-InstanceUsageAuditLogTestJSON-2014421739-project-admin] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.064112 Aug 09 17:07:39.536202 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 525/996] 10.222.0.93 () {58 vars in 1185 bytes} [Tue Aug 9 17:07:39 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:39.556634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6cd31a62-daf5-4385-ad15-11f2afb92ff4 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:39.564253 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:39.564253 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:39.566947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd31a62-daf5-4385-ad15-11f2afb92ff4 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:39.568844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd31a62-daf5-4385-ad15-11f2afb92ff4 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:39.569973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd31a62-daf5-4385-ad15-11f2afb92ff4 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:39.573679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd31a62-daf5-4385-ad15-11f2afb92ff4 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:39.602672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd31a62-daf5-4385-ad15-11f2afb92ff4 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:39.605736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd31a62-daf5-4385-ad15-11f2afb92ff4 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:39.673325 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6cd31a62-daf5-4385-ad15-11f2afb92ff4 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=n-d-845781-6&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.125533 Aug 09 17:07:39.676579 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 526/997] 10.222.0.93 () {60 vars in 1235 bytes} [Tue Aug 9 17:07:39 2022] GET /compute/v2.1/os-services?host=n-d-845781-6&binary=xxx => generated 16 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:39.689638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:39.694072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:39.708325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:39.709933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:39.710844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:39.712426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:39.713352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:39.714222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:39.908706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:07:39.909809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquired lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:07:40.159281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Releasing lock "refresh_cache-7a93360c-22e7-48a0-8f10-ab756a21325d" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:07:40.160215 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] HTTP exception thrown: floating IP not found Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Request method failure captured: Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action HTTP/1.1 Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 41 Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQZMD4hlDbq3qEREeMOUkM9aoHl8ZdoCnxDyYt_SfAJPta4QxnE9RNEmsFuXMiqr3kBxo_vERRCyLX9tvwzHk-34ZOf_Hy9HSlcu9fRR4x_7f-qBlDlAvCPyljDEoczsLBrjqba2aubfnqnGhUAYhZGgCcFGGwYd1rcIeA2CrdDvSQ Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 569d108c1d9f4f82bbb69dbba49f19ed Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:07:40.185975 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 569d108c1d9f4f82bbb69dbba49f19ed Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: b147f363cb434339ad1e3f302838574c Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:40.194975 n-d-845781-6 devstack@n-api.service[119431]: exception: floating IP not found Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '7a93360c-22e7-48a0-8f10-ab756a21325d', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:40.196057 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 09 17:07:40.202775 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:40.205186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Returning 404 to user: floating IP not found {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:40.205186 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87672d76-10d8-4b6a-b35c-0e5992411221 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action" status: 404 len: 67 microversion: 2.1 time: 0.505784 Aug 09 17:07:40.205186 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 527/998] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:39 2022] POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action => generated 67 bytes in 511 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:07:40.207202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:40.209358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:40.220179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:40.221020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:40.221802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:40.223096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:40.223969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:40.224667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:40.274770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5ebcf3da-30b5-4cff-bf42-00efb45a83fb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:40.295667 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5ebcf3da-30b5-4cff-bf42-00efb45a83fb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1541 microversion: 2.1 time: 0.868234 Aug 09 17:07:40.296793 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 472/999] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:39 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1541 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:40.310055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5646c66d-d2e0-4ea3-8aed-bf5304485c21 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:40.311401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5646c66d-d2e0-4ea3-8aed-bf5304485c21 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:40.325221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5646c66d-d2e0-4ea3-8aed-bf5304485c21 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:40.326172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5646c66d-d2e0-4ea3-8aed-bf5304485c21 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:40.326993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5646c66d-d2e0-4ea3-8aed-bf5304485c21 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:40.328621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5646c66d-d2e0-4ea3-8aed-bf5304485c21 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:40.329762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5646c66d-d2e0-4ea3-8aed-bf5304485c21 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:40.329762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5646c66d-d2e0-4ea3-8aed-bf5304485c21 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:40.514868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:40.530788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:40.533861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:40.537854 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cfa0405b-7acf-4c5f-be33-e35daefec697 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1361 microversion: 2.25 time: 0.345688 Aug 09 17:07:40.538245 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 528/1000] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:40 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:40.565012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ee179ddf-d8a0-40f4-9708-1a6602b734ec tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Calling method '.version_select at 0x7fbbcb79d430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:40.716799 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ee179ddf-d8a0-40f4-9708-1a6602b734ec tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/003da20e-b889-47a6-bed6-66d31babca4c" status: 200 len: 247 microversion: 2.1 time: 0.176654 Aug 09 17:07:40.717910 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 529/1001] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:07:40 2022] GET /compute/v2.1/os-security-groups/003da20e-b889-47a6-bed6-66d31babca4c => generated 247 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:40.717910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-14159d63-661f-4190-bf59-1b0596c9e167 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:40.717910 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:40.717910 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:40.717910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14159d63-661f-4190-bf59-1b0596c9e167 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:40.734261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14159d63-661f-4190-bf59-1b0596c9e167 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:40.734261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14159d63-661f-4190-bf59-1b0596c9e167 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:40.734261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14159d63-661f-4190-bf59-1b0596c9e167 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:40.734890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14159d63-661f-4190-bf59-1b0596c9e167 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:40.734890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14159d63-661f-4190-bf59-1b0596c9e167 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:40.810508 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-14159d63-661f-4190-bf59-1b0596c9e167 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.090789 Aug 09 17:07:40.814385 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 530/1002] 10.222.0.93 () {60 vars in 1178 bytes} [Tue Aug 9 17:07:40 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:40.832059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d9891ec2-df17-4a2d-be0f-32973066cbb2 req-e045b05a-f719-455a-9159-0e6f021ebea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bde0f3f-3670-4908-bc71-f4af6b3671b2", "tag": "02f77b41-d5fc-4f8a-8aac-6e744c227b20"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:40.854325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d9891ec2-df17-4a2d-be0f-32973066cbb2 req-e045b05a-f719-455a-9159-0e6f021ebea7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:40.855171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d9891ec2-df17-4a2d-be0f-32973066cbb2 req-e045b05a-f719-455a-9159-0e6f021ebea7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:40.856119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d9891ec2-df17-4a2d-be0f-32973066cbb2 req-e045b05a-f719-455a-9159-0e6f021ebea7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:40.881376 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d9891ec2-df17-4a2d-be0f-32973066cbb2 req-e045b05a-f719-455a-9159-0e6f021ebea7 service nova] Creating event network-changed:02f77b41-d5fc-4f8a-8aac-6e744c227b20 for instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 on n-h2-845781-6 Aug 09 17:07:40.895025 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d9891ec2-df17-4a2d-be0f-32973066cbb2 req-e045b05a-f719-455a-9159-0e6f021ebea7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076128 Aug 09 17:07:40.899074 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 531/1003] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:40.916189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-27633dbc-cde9-4b52-9271-e894dab760e7 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Action: 'action', calling method: .version_select at 0x7fbbda32a1f0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:40.916427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5646c66d-d2e0-4ea3-8aed-bf5304485c21 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:40.936450 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5646c66d-d2e0-4ea3-8aed-bf5304485c21 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1360 microversion: 2.1 time: 0.633089 Aug 09 17:07:40.943187 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 473/1004] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:40 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1360 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:40.958054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b41101d5-b635-4416-815a-d285d3fd111f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:40.961066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b41101d5-b635-4416-815a-d285d3fd111f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:40.982991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b41101d5-b635-4416-815a-d285d3fd111f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:40.984026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b41101d5-b635-4416-815a-d285d3fd111f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:40.985183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b41101d5-b635-4416-815a-d285d3fd111f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:40.986954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b41101d5-b635-4416-815a-d285d3fd111f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:40.988107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b41101d5-b635-4416-815a-d285d3fd111f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:40.989126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b41101d5-b635-4416-815a-d285d3fd111f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:41.014366 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-27633dbc-cde9-4b52-9271-e894dab760e7 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-27633dbc-cde9-4b52-9271-e894dab760e7 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Request method failure captured: Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action HTTP/1.1 Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 44 Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pQZMD4hlDbq3qEREeMOUkM9aoHl8ZdoCnxDyYt_SfAJPta4QxnE9RNEmsFuXMiqr3kBxo_vERRCyLX9tvwzHk-34ZOf_Hy9HSlcu9fRR4x_7f-qBlDlAvCPyljDEoczsLBrjqba2aubfnqnGhUAYhZGgCcFGGwYd1rcIeA2CrdDvSQ Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 569d108c1d9f4f82bbb69dbba49f19ed Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:07:41.016438 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 569d108c1d9f4f82bbb69dbba49f19ed Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: b147f363cb434339ad1e3f302838574c Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:41.019601 n-d-845781-6 devstack@n-api.service[119431]: exception: Floating IP not found for address 0.0.0.0. Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '7a93360c-22e7-48a0-8f10-ab756a21325d', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:41.030369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 09 17:07:41.032594 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:41.034966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-27633dbc-cde9-4b52-9271-e894dab760e7 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:41.034966 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-27633dbc-cde9-4b52-9271-e894dab760e7 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action" status: 404 len: 88 microversion: 2.1 time: 0.116600 Aug 09 17:07:41.034966 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 532/1005] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:40 2022] POST /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d/action => generated 88 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:07:41.035379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f2f6334d-4760-4239-a499-8ede3cc50ed3 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcb68f670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-516197586", "description": "tempest-description-428566832"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:41.352305 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f2f6334d-4760-4239-a499-8ede3cc50ed3 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.329669 Aug 09 17:07:41.367886 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 533/1006] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:07:41 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:41.376880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-626aa1cc-436e-4700-8e5d-0235c4943c53 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:41.382352 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:41.382352 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:07:41.384978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-626aa1cc-436e-4700-8e5d-0235c4943c53 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:41.386369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-626aa1cc-436e-4700-8e5d-0235c4943c53 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:41.387487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-626aa1cc-436e-4700-8e5d-0235c4943c53 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:41.388941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-626aa1cc-436e-4700-8e5d-0235c4943c53 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:41.390044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-626aa1cc-436e-4700-8e5d-0235c4943c53 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:41.391251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-626aa1cc-436e-4700-8e5d-0235c4943c53 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:41.444060 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-626aa1cc-436e-4700-8e5d-0235c4943c53 tempest-ServicesAdminNegativeV253TestJSON-1599803452 tempest-ServicesAdminNegativeV253TestJSON-1599803452-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.073573 Aug 09 17:07:41.445074 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 534/1007] 10.222.0.93 () {60 vars in 1239 bytes} [Tue Aug 9 17:07:41 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:41.454314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f28c2d54-684e-4140-8100-84290eb8d7f7 req-f7a11aa9-fa3b-45c0-ad84-11222b8ff711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c3e188-8990-4500-ab50-91d07d799686", "name": "network-vif-plugged", "status": "completed", "tag": "09a3f3d2-7ab1-4737-95e8-c0be82cec011"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:41.475177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f28c2d54-684e-4140-8100-84290eb8d7f7 req-f7a11aa9-fa3b-45c0-ad84-11222b8ff711 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:41.476167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f28c2d54-684e-4140-8100-84290eb8d7f7 req-f7a11aa9-fa3b-45c0-ad84-11222b8ff711 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:41.477070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f28c2d54-684e-4140-8100-84290eb8d7f7 req-f7a11aa9-fa3b-45c0-ad84-11222b8ff711 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:41.501340 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f28c2d54-684e-4140-8100-84290eb8d7f7 req-f7a11aa9-fa3b-45c0-ad84-11222b8ff711 service nova] Creating event network-vif-plugged:09a3f3d2-7ab1-4737-95e8-c0be82cec011 for instance e2c3e188-8990-4500-ab50-91d07d799686 on n-h1-845781-6 Aug 09 17:07:41.510592 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f28c2d54-684e-4140-8100-84290eb8d7f7 req-f7a11aa9-fa3b-45c0-ad84-11222b8ff711 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062890 Aug 09 17:07:41.511756 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 535/1008] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:41.524240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d43e9903-0ae5-4f2e-9314-5230c3b72e0f tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:41.525781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d43e9903-0ae5-4f2e-9314-5230c3b72e0f tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:41.539334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b41101d5-b635-4416-815a-d285d3fd111f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:41.541954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d43e9903-0ae5-4f2e-9314-5230c3b72e0f tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:41.542975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d43e9903-0ae5-4f2e-9314-5230c3b72e0f tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:41.543920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d43e9903-0ae5-4f2e-9314-5230c3b72e0f tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:41.545364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d43e9903-0ae5-4f2e-9314-5230c3b72e0f tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:41.546320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d43e9903-0ae5-4f2e-9314-5230c3b72e0f tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:41.547360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d43e9903-0ae5-4f2e-9314-5230c3b72e0f tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:41.557277 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b41101d5-b635-4416-815a-d285d3fd111f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1498 microversion: 2.1 time: 0.612235 Aug 09 17:07:41.558798 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 474/1009] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:40 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1498 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:41.584975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d43e9903-0ae5-4f2e-9314-5230c3b72e0f tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:07:41.589313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1fc84461-e924-4081-beeb-3e20b42f89af tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:41.591813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1fc84461-e924-4081-beeb-3e20b42f89af tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:41.604758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fc84461-e924-4081-beeb-3e20b42f89af tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:41.606038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fc84461-e924-4081-beeb-3e20b42f89af tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:41.607191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fc84461-e924-4081-beeb-3e20b42f89af tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:41.608776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fc84461-e924-4081-beeb-3e20b42f89af tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:41.609868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fc84461-e924-4081-beeb-3e20b42f89af tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:41.611060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fc84461-e924-4081-beeb-3e20b42f89af tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:41.702605 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d43e9903-0ae5-4f2e-9314-5230c3b72e0f tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 204 len: 0 microversion: 2.1 time: 0.188241 Aug 09 17:07:41.703611 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 536/1010] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:07:41 2022] DELETE /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:07:41.717295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e6cbd3c-4e75-4977-965e-7e4dbdb02555 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcb6f5e50>, body: {"security_group_rule": {"parent_group_id": "6fa810bb-8962-4770-b10b-befc1985096b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:41.963244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1fc84461-e924-4081-beeb-3e20b42f89af tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:41.972634 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1fc84461-e924-4081-beeb-3e20b42f89af tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1541 microversion: 2.1 time: 0.412424 Aug 09 17:07:41.973483 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 475/1011] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:41 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1541 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:42.119996 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e6cbd3c-4e75-4977-965e-7e4dbdb02555 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.409861 Aug 09 17:07:42.121455 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 537/1012] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:07:41 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:42.132528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:42.134419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:42.142616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:42.143472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:42.144620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:42.145399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:42.146184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:42.146625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:42.378516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:42.394427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:42.396007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:42.398876 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-21f58ff7-0ea0-47dc-90a9-02672ac1d80c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1361 microversion: 2.25 time: 0.274267 Aug 09 17:07:42.400294 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 538/1013] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:42 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:42.410066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66f92784-5e98-45c9-b01c-639d525f281a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:42.412592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-66f92784-5e98-45c9-b01c-639d525f281a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:42.428517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66f92784-5e98-45c9-b01c-639d525f281a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:42.429669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66f92784-5e98-45c9-b01c-639d525f281a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:42.430507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66f92784-5e98-45c9-b01c-639d525f281a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:42.432222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66f92784-5e98-45c9-b01c-639d525f281a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:42.433511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66f92784-5e98-45c9-b01c-639d525f281a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:42.434517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66f92784-5e98-45c9-b01c-639d525f281a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:42.496687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0a159be3-7fbf-495c-916e-4625aa8c82ab tempest-ServicesAdminNegativeV253TestJSON-288111048 tempest-ServicesAdminNegativeV253TestJSON-288111048-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:42.504855 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:42.504855 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:07:42.511553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0a159be3-7fbf-495c-916e-4625aa8c82ab tempest-ServicesAdminNegativeV253TestJSON-288111048 tempest-ServicesAdminNegativeV253TestJSON-288111048-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '8fd76185898d47fa9e696d24214a5d3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbcbeb5654e403da646a4f5d5554478', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0a159be3-7fbf-495c-916e-4625aa8c82ab tempest-ServicesAdminNegativeV253TestJSON-288111048 tempest-ServicesAdminNegativeV253TestJSON-288111048-project] Request method failure captured: Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pRPATmvzkgQ9HJlk4QZIRT1mm__ENVz3KCz0zBytQyiMhj4_eJgA8QRoCIumzTk3TRLvRsD4ntjWUmexhj5gt2eWUFHlQh02pJULdaAmVACkflagUuWlmtyXFVIUgc9xgmVBtEtDoGAKvyml4N9oF1uDebdyr7E-CuwiF6gTvppuTY Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.53 Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: cfbcbeb5654e403da646a4f5d5554478 Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-288111048 Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:07:42.518010 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cfbcbeb5654e403da646a4f5d5554478"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfbcbeb5654e403da646a4f5d5554478"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cfbcbeb5654e403da646a4f5d5554478"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cfbcbeb5654e403da646a4f5d5554478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-288111048 Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: cfbcbeb5654e403da646a4f5d5554478 Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-288111048 Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServicesAdminNegativeV253TestJSON-288111048-project Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 8fd76185898d47fa9e696d24214a5d3e Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-288111048-project Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 17:07:42.521086 n-d-845781-6 devstack@n-api.service[119432]: action_args: {} Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:07:42.524771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 17:07:42.529954 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:42.538399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0a159be3-7fbf-495c-916e-4625aa8c82ab tempest-ServicesAdminNegativeV253TestJSON-288111048 tempest-ServicesAdminNegativeV253TestJSON-288111048-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:42.539384 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0a159be3-7fbf-495c-916e-4625aa8c82ab tempest-ServicesAdminNegativeV253TestJSON-288111048 tempest-ServicesAdminNegativeV253TestJSON-288111048-project] 10.222.0.93 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.564051 Aug 09 17:07:42.546400 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 476/1014] 10.222.0.93 () {60 vars in 1178 bytes} [Tue Aug 9 17:07:41 2022] GET /compute/v2.1/os-services => generated 112 bytes in 566 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:07:42.551936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fc60789d-c114-4fee-97b8-c916532abf5d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:42.553346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fc60789d-c114-4fee-97b8-c916532abf5d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:42.562459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc60789d-c114-4fee-97b8-c916532abf5d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:42.563268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc60789d-c114-4fee-97b8-c916532abf5d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:42.563784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc60789d-c114-4fee-97b8-c916532abf5d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:42.565238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc60789d-c114-4fee-97b8-c916532abf5d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:42.565842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc60789d-c114-4fee-97b8-c916532abf5d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:42.567254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc60789d-c114-4fee-97b8-c916532abf5d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:42.748809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-66f92784-5e98-45c9-b01c-639d525f281a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:42.774837 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66f92784-5e98-45c9-b01c-639d525f281a tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1542 microversion: 2.1 time: 0.372499 Aug 09 17:07:42.775844 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 539/1015] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:42 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1542 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:42.807240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-802c0945-640a-4de4-8e3b-109cc7baca4a tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Action: 'create', calling method: .version_select at 0x7fbbcb6a2310>, body: {"security_group_rule": {"parent_group_id": "6fa810bb-8962-4770-b10b-befc1985096b", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:42.980132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fc60789d-c114-4fee-97b8-c916532abf5d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:43.008533 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fc60789d-c114-4fee-97b8-c916532abf5d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1360 microversion: 2.1 time: 0.466572 Aug 09 17:07:43.013942 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 477/1016] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:42 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1360 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:43.027878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-42d484a3-e9fd-4253-95e9-812b40659554 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:43.031900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-42d484a3-e9fd-4253-95e9-812b40659554 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:43.054385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42d484a3-e9fd-4253-95e9-812b40659554 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:43.056995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42d484a3-e9fd-4253-95e9-812b40659554 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:43.058444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42d484a3-e9fd-4253-95e9-812b40659554 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:43.060534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42d484a3-e9fd-4253-95e9-812b40659554 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:43.061825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42d484a3-e9fd-4253-95e9-812b40659554 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:43.063352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42d484a3-e9fd-4253-95e9-812b40659554 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:43.275968 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-802c0945-640a-4de4-8e3b-109cc7baca4a tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.497633 Aug 09 17:07:43.278862 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 540/1017] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:07:42 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:43.294540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-84ad37b1-a526-4cd6-a944-fc155d698a05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:43.296484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-84ad37b1-a526-4cd6-a944-fc155d698a05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:43.312249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84ad37b1-a526-4cd6-a944-fc155d698a05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:43.314991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84ad37b1-a526-4cd6-a944-fc155d698a05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:43.316362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84ad37b1-a526-4cd6-a944-fc155d698a05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:43.318654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84ad37b1-a526-4cd6-a944-fc155d698a05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:43.320128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84ad37b1-a526-4cd6-a944-fc155d698a05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:43.323182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84ad37b1-a526-4cd6-a944-fc155d698a05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:43.598744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-42d484a3-e9fd-4253-95e9-812b40659554 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:43.617525 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-42d484a3-e9fd-4253-95e9-812b40659554 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1498 microversion: 2.1 time: 0.601198 Aug 09 17:07:43.628774 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 478/1018] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:43 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1498 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:43.648329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2ff43687-c4fe-41bc-a0e2-4c3e01472e69 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Calling method '.version_select at 0x7fbbcbaea1f0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:43.951080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-84ad37b1-a526-4cd6-a944-fc155d698a05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:43.966281 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-84ad37b1-a526-4cd6-a944-fc155d698a05 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1541 microversion: 2.1 time: 0.683886 Aug 09 17:07:43.984278 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 541/1019] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:43 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1541 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:44.001095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:44.001728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:44.023699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:44.024232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:44.026141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:44.030139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:44.030886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:44.032186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:44.214676 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2ff43687-c4fe-41bc-a0e2-4c3e01472e69 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/6fa810bb-8962-4770-b10b-befc1985096b" status: 200 len: 663 microversion: 2.1 time: 0.582851 Aug 09 17:07:44.217293 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 479/1020] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:07:43 2022] GET /compute/v2.1/os-security-groups/6fa810bb-8962-4770-b10b-befc1985096b => generated 663 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:44.235347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-70bba681-cf98-47aa-a712-33d9a40108b6 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:44.236692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-70bba681-cf98-47aa-a712-33d9a40108b6 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:44.265832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bba681-cf98-47aa-a712-33d9a40108b6 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:44.267461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bba681-cf98-47aa-a712-33d9a40108b6 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:44.268448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bba681-cf98-47aa-a712-33d9a40108b6 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:44.269906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bba681-cf98-47aa-a712-33d9a40108b6 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:44.271734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bba681-cf98-47aa-a712-33d9a40108b6 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:44.280264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bba681-cf98-47aa-a712-33d9a40108b6 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:44.490619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:44.501895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:44.504047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:44.506550 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ae96d9f8-ccd0-4ec9-813f-e8807ade8c39 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1361 microversion: 2.25 time: 0.517278 Aug 09 17:07:44.507764 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 542/1021] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:43 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1361 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:44.513633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6a454be6-00f1-4485-87bd-c2327d875d95 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:44.514594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6a454be6-00f1-4485-87bd-c2327d875d95 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:44.524402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a454be6-00f1-4485-87bd-c2327d875d95 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:44.526387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a454be6-00f1-4485-87bd-c2327d875d95 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:44.527569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a454be6-00f1-4485-87bd-c2327d875d95 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:44.529200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a454be6-00f1-4485-87bd-c2327d875d95 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:44.530596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a454be6-00f1-4485-87bd-c2327d875d95 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:44.531713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a454be6-00f1-4485-87bd-c2327d875d95 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:44.993695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6a454be6-00f1-4485-87bd-c2327d875d95 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:45.028681 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6a454be6-00f1-4485-87bd-c2327d875d95 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1360 microversion: 2.1 time: 0.509328 Aug 09 17:07:45.029300 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 543/1022] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:44 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1360 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:45.062198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-512e70ee-d77b-4038-9ea4-216a95a4f1de tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Calling method '.version_select at 0x7fbbcb642040>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:45.236862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-70bba681-cf98-47aa-a712-33d9a40108b6 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:45.272215 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-70bba681-cf98-47aa-a712-33d9a40108b6 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1542 microversion: 2.1 time: 1.052472 Aug 09 17:07:45.285463 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 480/1023] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:44 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1542 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:45.302295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-548780e9-38e3-40ad-b395-ac8cf9990457 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:45.320117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-548780e9-38e3-40ad-b395-ac8cf9990457 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:45.349898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-548780e9-38e3-40ad-b395-ac8cf9990457 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:45.356311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-548780e9-38e3-40ad-b395-ac8cf9990457 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:45.357842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-548780e9-38e3-40ad-b395-ac8cf9990457 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:45.361234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-548780e9-38e3-40ad-b395-ac8cf9990457 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:45.369094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-548780e9-38e3-40ad-b395-ac8cf9990457 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:45.372326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-548780e9-38e3-40ad-b395-ac8cf9990457 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:45.919828 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-512e70ee-d77b-4038-9ea4-216a95a4f1de tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-group-rules/3e497ab2-0312-4ce5-9084-73b1fdba21cf" status: 202 len: 0 microversion: 2.1 time: 0.880962 Aug 09 17:07:45.928469 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 544/1024] 10.222.0.93 () {58 vars in 1287 bytes} [Tue Aug 9 17:07:45 2022] DELETE /compute/v2.1/os-security-group-rules/3e497ab2-0312-4ce5-9084-73b1fdba21cf => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:45.928469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d943abbd-b591-4d67-925a-b2177fa3c093 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:45.932397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d943abbd-b591-4d67-925a-b2177fa3c093 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:45.953603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d943abbd-b591-4d67-925a-b2177fa3c093 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:45.954152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d943abbd-b591-4d67-925a-b2177fa3c093 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:45.954598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d943abbd-b591-4d67-925a-b2177fa3c093 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:45.955338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d943abbd-b591-4d67-925a-b2177fa3c093 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:45.955837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d943abbd-b591-4d67-925a-b2177fa3c093 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:45.961612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d943abbd-b591-4d67-925a-b2177fa3c093 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:45.966258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:46.093793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-548780e9-38e3-40ad-b395-ac8cf9990457 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:46.106938 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-548780e9-38e3-40ad-b395-ac8cf9990457 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1498 microversion: 2.1 time: 0.815240 Aug 09 17:07:46.116367 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 481/1025] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:45 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1498 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:46.123391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:46.124436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:46.151698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:46.160431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:46.169779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:46.174461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:46.175988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:46.186406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:46.644826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d943abbd-b591-4d67-925a-b2177fa3c093 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:46.655571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:46.690285 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d943abbd-b591-4d67-925a-b2177fa3c093 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1540 microversion: 2.1 time: 0.767549 Aug 09 17:07:46.692927 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 545/1026] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:45 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1540 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:46.705127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-245aff95-afa6-49cd-97f1-0d43743f2e8f tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Calling method '.version_select at 0x7fbbcb6425e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:46.984660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:46.997663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:46.999871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:47.001632 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0be4b50e-3f87-4da1-90a1-168310254354 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1557 microversion: 2.25 time: 0.883332 Aug 09 17:07:47.003265 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 482/1027] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:46 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1557 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:47.020345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-b15db3cc-d764-4e14-beee-6d8edbc0496b req-ba87a878-95fe-42e7-976d-b6717174f401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a93360c-22e7-48a0-8f10-ab756a21325d", "name": "network-vif-deleted", "tag": "8cf56997-b952-4786-979c-78c1d6c3074e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:47.041214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b15db3cc-d764-4e14-beee-6d8edbc0496b req-ba87a878-95fe-42e7-976d-b6717174f401 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:47.041792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b15db3cc-d764-4e14-beee-6d8edbc0496b req-ba87a878-95fe-42e7-976d-b6717174f401 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:47.042280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b15db3cc-d764-4e14-beee-6d8edbc0496b req-ba87a878-95fe-42e7-976d-b6717174f401 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:47.061194 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-b15db3cc-d764-4e14-beee-6d8edbc0496b req-ba87a878-95fe-42e7-976d-b6717174f401 service nova] Creating event network-vif-deleted:8cf56997-b952-4786-979c-78c1d6c3074e for instance 7a93360c-22e7-48a0-8f10-ab756a21325d on n-h1-845781-6 Aug 09 17:07:47.066779 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-b15db3cc-d764-4e14-beee-6d8edbc0496b req-ba87a878-95fe-42e7-976d-b6717174f401 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061154 Aug 09 17:07:47.068531 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 483/1028] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:47.075104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8eaa23df-49b2-4cb0-a3e6-e61e7d3a77b6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:47.075653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8eaa23df-49b2-4cb0-a3e6-e61e7d3a77b6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:47.083717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eaa23df-49b2-4cb0-a3e6-e61e7d3a77b6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:47.084508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eaa23df-49b2-4cb0-a3e6-e61e7d3a77b6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:47.085276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eaa23df-49b2-4cb0-a3e6-e61e7d3a77b6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:47.086831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eaa23df-49b2-4cb0-a3e6-e61e7d3a77b6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:47.087768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eaa23df-49b2-4cb0-a3e6-e61e7d3a77b6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:47.088493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eaa23df-49b2-4cb0-a3e6-e61e7d3a77b6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:47.207845 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-245aff95-afa6-49cd-97f1-0d43743f2e8f tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/6fa810bb-8962-4770-b10b-befc1985096b" status: 202 len: 0 microversion: 2.1 time: 0.512244 Aug 09 17:07:47.212699 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 546/1029] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:07:46 2022] DELETE /compute/v2.1/os-security-groups/6fa810bb-8962-4770-b10b-befc1985096b => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:47.223668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:47.225826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:47.239058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:47.240360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:47.241058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:47.242501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:47.243598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:47.244677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:47.337162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:47.338469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:47.339462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:47.340746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lazy-loading 'fault' on Instance uuid 7a93360c-22e7-48a0-8f10-ab756a21325d {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:07:47.468820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b147f363cb434339ad1e3f302838574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '569d108c1d9f4f82bbb69dbba49f19ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:47.486759 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c488199-49ef-430a-b57f-fd01996e95f8 tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 200 len: 1322 microversion: 2.1 time: 0.271922 Aug 09 17:07:47.489067 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 547/1030] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:47 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:47.502978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-53e99487-2db9-42f1-a298-1e56eacf2606 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:47.505522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-53e99487-2db9-42f1-a298-1e56eacf2606 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:47.512801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:47.526994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53e99487-2db9-42f1-a298-1e56eacf2606 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:47.528277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53e99487-2db9-42f1-a298-1e56eacf2606 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:47.529327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53e99487-2db9-42f1-a298-1e56eacf2606 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:47.532489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53e99487-2db9-42f1-a298-1e56eacf2606 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:47.533589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53e99487-2db9-42f1-a298-1e56eacf2606 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:47.535116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53e99487-2db9-42f1-a298-1e56eacf2606 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:47.675709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8eaa23df-49b2-4cb0-a3e6-e61e7d3a77b6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:47.705214 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8eaa23df-49b2-4cb0-a3e6-e61e7d3a77b6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1360 microversion: 2.1 time: 0.633833 Aug 09 17:07:47.706783 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 484/1031] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:47 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1360 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:47.719764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-dc7d7cd4-bdbf-4843-9ace-818df6611aa6 req-34f07c6c-4c3d-4464-8193-0518ef4f101a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a07b5bb-7014-4708-a343-520f1b468a9c", "name": "network-vif-unplugged", "status": "completed", "tag": "2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:47.756391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-dc7d7cd4-bdbf-4843-9ace-818df6611aa6 req-34f07c6c-4c3d-4464-8193-0518ef4f101a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:47.757924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-dc7d7cd4-bdbf-4843-9ace-818df6611aa6 req-34f07c6c-4c3d-4464-8193-0518ef4f101a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:47.758972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-dc7d7cd4-bdbf-4843-9ace-818df6611aa6 req-34f07c6c-4c3d-4464-8193-0518ef4f101a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:47.818463 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-dc7d7cd4-bdbf-4843-9ace-818df6611aa6 req-34f07c6c-4c3d-4464-8193-0518ef4f101a service nova] Creating event network-vif-unplugged:2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34 for instance 9a07b5bb-7014-4708-a343-520f1b468a9c on n-h2-845781-6 Aug 09 17:07:47.832047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:47.850722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-dc7d7cd4-bdbf-4843-9ace-818df6611aa6 req-34f07c6c-4c3d-4464-8193-0518ef4f101a service nova] Instance 9a07b5bb-7014-4708-a343-520f1b468a9c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:07:47.854333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-53e99487-2db9-42f1-a298-1e56eacf2606 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid e2c3e188-8990-4500-ab50-91d07d799686 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:07:47.885385 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-dc7d7cd4-bdbf-4843-9ace-818df6611aa6 req-34f07c6c-4c3d-4464-8193-0518ef4f101a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174600 Aug 09 17:07:47.887286 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 485/1032] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:47.899473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-509e8a69-dcc8-4f00-9e5a-2ce219c06d04 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:47.903394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-509e8a69-dcc8-4f00-9e5a-2ce219c06d04 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:47.930222 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-53e99487-2db9-42f1-a298-1e56eacf2606 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 2049 microversion: 2.25 time: 0.437039 Aug 09 17:07:47.940945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-509e8a69-dcc8-4f00-9e5a-2ce219c06d04 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:47.941581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-509e8a69-dcc8-4f00-9e5a-2ce219c06d04 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:47.946955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-509e8a69-dcc8-4f00-9e5a-2ce219c06d04 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:47.948415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-509e8a69-dcc8-4f00-9e5a-2ce219c06d04 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:47.950792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-509e8a69-dcc8-4f00-9e5a-2ce219c06d04 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:47.951537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-509e8a69-dcc8-4f00-9e5a-2ce219c06d04 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:47.963867 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 548/1033] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:47 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 2049 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:47.980550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44b668e3-8ee1-418a-865f-9fc62be750be tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Calling method '.version_select at 0x7fbbcb642af0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:48.074194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG neutronclient.v2_0.client [None req-44b668e3-8ee1-418a-865f-9fc62be750be tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54a3f063-a34b-44f9-904a-5f9741f75a1a does not exist", "detail": ""}} {{(pid=119431) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:07:48.081188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.security_group_api [None req-44b668e3-8ee1-418a-865f-9fc62be750be tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Neutron security group 54a3f063-a34b-44f9-904a-5f9741f75a1a not found {{(pid=119431) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:07:48.089910 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-44b668e3-8ee1-418a-865f-9fc62be750be tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] HTTP exception thrown: Security group 54a3f063-a34b-44f9-904a-5f9741f75a1a does not exist Aug 09 17:07:48.089910 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-4426fa4e-ba3b-4c82-a28e-1a2b0ba9f459'] Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44b668e3-8ee1-418a-865f-9fc62be750be tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Request method failure captured: Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/os-security-groups/54a3f063-a34b-44f9-904a-5f9741f75a1a HTTP/1.1 Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pRGw6L_O7aDoc9wMisnHQ45F47Bzgx-OQBJgw8dN16sLK9J5cvM-zaMqK2d2ANEKFeO2DmweOE5z0xpcvmY_Qg-0ja83Np0G4mtJy2490xM4tJfarOt60K_0XfExB3vYfX4V9Yl7XoqA8co6EgKKwFFan3GTuzJdm_EWkNX7SgsnMw Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 30768417af7e423d8cc7417524f3b726 Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-662440497 Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:07:48.105024 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_30768417af7e423d8cc7417524f3b726"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/30768417af7e423d8cc7417524f3b726"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/30768417af7e423d8cc7417524f3b726"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/30768417af7e423d8cc7417524f3b726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupRulesTestJSON-662440497 Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 30768417af7e423d8cc7417524f3b726 Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-662440497 Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupRulesTestJSON-662440497-project Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: eb71b58a84bd44539937e1d1855bf5b4 Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupRulesTestJSON-662440497-project Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: exception: Security group 54a3f063-a34b-44f9-904a-5f9741f75a1a does not exist Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-4426fa4e-ba3b-4c82-a28e-1a2b0ba9f459'] Aug 09 17:07:48.107949 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '54a3f063-a34b-44f9-904a-5f9741f75a1a'} Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:07:48.108886 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54a3f063-a34b-44f9-904a-5f9741f75a1a does not exist Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4426fa4e-ba3b-4c82-a28e-1a2b0ba9f459'] Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:07:48.110617 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54a3f063-a34b-44f9-904a-5f9741f75a1a does not exist Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4426fa4e-ba3b-4c82-a28e-1a2b0ba9f459'] Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54a3f063-a34b-44f9-904a-5f9741f75a1a does not exist Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4426fa4e-ba3b-4c82-a28e-1a2b0ba9f459'] Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:48.112586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:48.115177 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:48.115177 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:48.115177 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:48.115177 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:48.115177 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54a3f063-a34b-44f9-904a-5f9741f75a1a does not exist Aug 09 17:07:48.115177 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4426fa4e-ba3b-4c82-a28e-1a2b0ba9f459'] Aug 09 17:07:48.115177 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:07:48.118214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44b668e3-8ee1-418a-865f-9fc62be750be tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Returning 404 to user: Security group 54a3f063-a34b-44f9-904a-5f9741f75a1a does not exist Aug 09 17:07:48.118214 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-4426fa4e-ba3b-4c82-a28e-1a2b0ba9f459'] {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:48.119027 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-44b668e3-8ee1-418a-865f-9fc62be750be tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/54a3f063-a34b-44f9-904a-5f9741f75a1a" status: 404 len: 194 microversion: 2.1 time: 0.152498 Aug 09 17:07:48.120083 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 549/1034] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:07:47 2022] DELETE /compute/v2.1/os-security-groups/54a3f063-a34b-44f9-904a-5f9741f75a1a => generated 194 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:07:48.127789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f442bce-9a58-46fe-85d2-b26923f9de9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:48.129681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5f442bce-9a58-46fe-85d2-b26923f9de9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:48.142818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f442bce-9a58-46fe-85d2-b26923f9de9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:48.143845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f442bce-9a58-46fe-85d2-b26923f9de9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:48.144705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f442bce-9a58-46fe-85d2-b26923f9de9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:48.145945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f442bce-9a58-46fe-85d2-b26923f9de9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:48.148037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f442bce-9a58-46fe-85d2-b26923f9de9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:48.148978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f442bce-9a58-46fe-85d2-b26923f9de9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:48.473903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f442bce-9a58-46fe-85d2-b26923f9de9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:48.488907 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f442bce-9a58-46fe-85d2-b26923f9de9f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1540 microversion: 2.1 time: 0.367158 Aug 09 17:07:48.490890 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 550/1035] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:48 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1540 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:48.508754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-7014a859-a366-4904-8dc7-74d7d47ec1b9 req-235f7d3f-70ea-479f-9a9a-2c066b156eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bde0f3f-3670-4908-bc71-f4af6b3671b2", "name": "network-vif-plugged", "status": "completed", "tag": "02f77b41-d5fc-4f8a-8aac-6e744c227b20"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:48.522782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7014a859-a366-4904-8dc7-74d7d47ec1b9 req-235f7d3f-70ea-479f-9a9a-2c066b156eaf service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:48.523674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7014a859-a366-4904-8dc7-74d7d47ec1b9 req-235f7d3f-70ea-479f-9a9a-2c066b156eaf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:48.524764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7014a859-a366-4904-8dc7-74d7d47ec1b9 req-235f7d3f-70ea-479f-9a9a-2c066b156eaf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:48.548722 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-7014a859-a366-4904-8dc7-74d7d47ec1b9 req-235f7d3f-70ea-479f-9a9a-2c066b156eaf service nova] Creating event network-vif-plugged:02f77b41-d5fc-4f8a-8aac-6e744c227b20 for instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 on n-h2-845781-6 Aug 09 17:07:48.555241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-7014a859-a366-4904-8dc7-74d7d47ec1b9 req-235f7d3f-70ea-479f-9a9a-2c066b156eaf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062396 Aug 09 17:07:48.556515 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 551/1036] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:48.563083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1c5a375f-fbdf-469d-9edd-2b161e2ca2f3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:48.564155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1c5a375f-fbdf-469d-9edd-2b161e2ca2f3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:48.573337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c5a375f-fbdf-469d-9edd-2b161e2ca2f3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:48.574009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c5a375f-fbdf-469d-9edd-2b161e2ca2f3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:48.575526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c5a375f-fbdf-469d-9edd-2b161e2ca2f3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:48.576617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c5a375f-fbdf-469d-9edd-2b161e2ca2f3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:48.577491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c5a375f-fbdf-469d-9edd-2b161e2ca2f3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:48.578199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c5a375f-fbdf-469d-9edd-2b161e2ca2f3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:48.876119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-1c5a375f-fbdf-469d-9edd-2b161e2ca2f3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid e2c3e188-8990-4500-ab50-91d07d799686 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:07:48.896874 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1c5a375f-fbdf-469d-9edd-2b161e2ca2f3 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 2049 microversion: 2.25 time: 0.338190 Aug 09 17:07:48.897493 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 552/1037] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:48 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 2049 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:48.911964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f003d961-8cbc-4d06-8a47-fbe349eb29ee tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Calling method '.version_select at 0x7fbbcb642820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:49.022985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:49.269983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-509e8a69-dcc8-4f00-9e5a-2ce219c06d04 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:49.289333 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-509e8a69-dcc8-4f00-9e5a-2ce219c06d04 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1498 microversion: 2.1 time: 1.399065 Aug 09 17:07:49.291410 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 486/1038] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:47 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1498 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:49.310943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:49.312538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] [instance: 7a93360c-22e7-48a0-8f10-ab756a21325d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:49.312802 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f003d961-8cbc-4d06-8a47-fbe349eb29ee tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/003da20e-b889-47a6-bed6-66d31babca4c" status: 202 len: 0 microversion: 2.1 time: 0.412559 Aug 09 17:07:49.314832 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 553/1039] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:07:48 2022] DELETE /compute/v2.1/os-security-groups/003da20e-b889-47a6-bed6-66d31babca4c => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:49.326477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:49.327506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:49.328165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:49.328882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1c7f357-b9d5-4816-9658-d99d1bc06b13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:49.329080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:49.329944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1c7f357-b9d5-4816-9658-d99d1bc06b13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:49.330650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:49.331711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:49.349653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c7f357-b9d5-4816-9658-d99d1bc06b13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:49.350633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c7f357-b9d5-4816-9658-d99d1bc06b13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:49.352140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c7f357-b9d5-4816-9658-d99d1bc06b13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:49.357924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c7f357-b9d5-4816-9658-d99d1bc06b13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:49.359077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c7f357-b9d5-4816-9658-d99d1bc06b13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:49.359842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c7f357-b9d5-4816-9658-d99d1bc06b13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:49.363047 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] HTTP exception thrown: Instance 7a93360c-22e7-48a0-8f10-ab756a21325d could not be found. Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Request method failure captured: Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d HTTP/1.1 Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pQZMD4hlDbq3qEREeMOUkM9aoHl8ZdoCnxDyYt_SfAJPta4QxnE9RNEmsFuXMiqr3kBxo_vERRCyLX9tvwzHk-34ZOf_Hy9HSlcu9fRR4x_7f-qBlDlAvCPyljDEoczsLBrjqba2aubfnqnGhUAYhZGgCcFGGwYd1rcIeA2CrdDvSQ Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 569d108c1d9f4f82bbb69dbba49f19ed Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:07:49.367392 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:07:49.369956 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/569d108c1d9f4f82bbb69dbba49f19ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:07:49.369956 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:49.369956 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 569d108c1d9f4f82bbb69dbba49f19ed Aug 09 17:07:49.369956 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145 Aug 09 17:07:49.369956 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project Aug 09 17:07:49.369956 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:07:49.369956 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:07:49.369956 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: b147f363cb434339ad1e3f302838574c Aug 09 17:07:49.369956 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project Aug 09 17:07:49.369956 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:07:49.369956 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 7a93360c-22e7-48a0-8f10-ab756a21325d could not be found. Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '7a93360c-22e7-48a0-8f10-ab756a21325d'} Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a93360c-22e7-48a0-8f10-ab756a21325d could not be found. Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:07:49.371478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a93360c-22e7-48a0-8f10-ab756a21325d could not be found. Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a93360c-22e7-48a0-8f10-ab756a21325d could not be found. Aug 09 17:07:49.374044 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:07:49.378855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] Returning 404 to user: Instance 7a93360c-22e7-48a0-8f10-ab756a21325d could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:07:49.393664 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1bb9af48-5e72-423e-a295-a716cf03891d tempest-FloatingIPsAssociationNegativeTestJSON-452800145 tempest-FloatingIPsAssociationNegativeTestJSON-452800145-project] 10.222.0.93 "GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d" status: 404 len: 111 microversion: 2.1 time: 0.087341 Aug 09 17:07:49.399063 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 487/1040] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:49 2022] GET /compute/v2.1/servers/7a93360c-22e7-48a0-8f10-ab756a21325d => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:07:49.420780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f793b944-05a6-4f2c-aae7-054a833b71de tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:49.433336 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:07:49.433336 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:07:49.436344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f793b944-05a6-4f2c-aae7-054a833b71de tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:49.438272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f793b944-05a6-4f2c-aae7-054a833b71de tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:49.440150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f793b944-05a6-4f2c-aae7-054a833b71de tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:49.441908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f793b944-05a6-4f2c-aae7-054a833b71de tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:49.443099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f793b944-05a6-4f2c-aae7-054a833b71de tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:49.444246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f793b944-05a6-4f2c-aae7-054a833b71de tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:49.502013 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f793b944-05a6-4f2c-aae7-054a833b71de tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.099994 Aug 09 17:07:49.503464 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 488/1041] 10.222.0.93 () {60 vars in 1217 bytes} [Tue Aug 9 17:07:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:07:49.512344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aa5feb9e-2932-40ce-a318-b339dde15aa5 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Calling method '.version_select at 0x7fbbcbaea160>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:49.532294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=16 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:49.737830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a1c7f357-b9d5-4816-9658-d99d1bc06b13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:49.749117 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1c7f357-b9d5-4816-9658-d99d1bc06b13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1360 microversion: 2.1 time: 0.431355 Aug 09 17:07:49.750858 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 554/1042] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:49 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1360 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:49.759832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8bfde80c-c7bd-4029-8c5b-0a2996d5c706 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:49.760725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8bfde80c-c7bd-4029-8c5b-0a2996d5c706 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:49.770600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bfde80c-c7bd-4029-8c5b-0a2996d5c706 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:49.773176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bfde80c-c7bd-4029-8c5b-0a2996d5c706 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:49.774857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bfde80c-c7bd-4029-8c5b-0a2996d5c706 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:49.776998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bfde80c-c7bd-4029-8c5b-0a2996d5c706 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:49.777575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bfde80c-c7bd-4029-8c5b-0a2996d5c706 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:49.778340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bfde80c-c7bd-4029-8c5b-0a2996d5c706 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:50.054053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8bfde80c-c7bd-4029-8c5b-0a2996d5c706 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:50.084246 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8bfde80c-c7bd-4029-8c5b-0a2996d5c706 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1540 microversion: 2.1 time: 0.330890 Aug 09 17:07:50.088366 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 555/1043] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:49 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1540 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:50.101789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3207dc54-e271-4533-a723-98cd058cfb13 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:50.103541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3207dc54-e271-4533-a723-98cd058cfb13 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:50.117517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3207dc54-e271-4533-a723-98cd058cfb13 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:50.118742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3207dc54-e271-4533-a723-98cd058cfb13 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:50.120006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3207dc54-e271-4533-a723-98cd058cfb13 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:50.121737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3207dc54-e271-4533-a723-98cd058cfb13 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:50.123402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3207dc54-e271-4533-a723-98cd058cfb13 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:50.124469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3207dc54-e271-4533-a723-98cd058cfb13 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:50.230570 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3207dc54-e271-4533-a723-98cd058cfb13 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686/action" status: 202 len: 0 microversion: 2.25 time: 0.140337 Aug 09 17:07:50.236626 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 556/1044] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:07:50 2022] POST /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:07:50.241667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-98682ed3-a1c2-4cb3-89dd-12fa308afd47 req-62fd236d-dfd0-4e74-969c-785d6d78e775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a07b5bb-7014-4708-a343-520f1b468a9c", "tag": "2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:50.258333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-98682ed3-a1c2-4cb3-89dd-12fa308afd47 req-62fd236d-dfd0-4e74-969c-785d6d78e775 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:50.258834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-98682ed3-a1c2-4cb3-89dd-12fa308afd47 req-62fd236d-dfd0-4e74-969c-785d6d78e775 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:50.259320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-98682ed3-a1c2-4cb3-89dd-12fa308afd47 req-62fd236d-dfd0-4e74-969c-785d6d78e775 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:50.274509 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-98682ed3-a1c2-4cb3-89dd-12fa308afd47 req-62fd236d-dfd0-4e74-969c-785d6d78e775 service nova] Creating event network-changed:2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34 for instance 9a07b5bb-7014-4708-a343-520f1b468a9c on n-h2-845781-6 Aug 09 17:07:50.298895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-98682ed3-a1c2-4cb3-89dd-12fa308afd47 req-62fd236d-dfd0-4e74-969c-785d6d78e775 service nova] Instance 9a07b5bb-7014-4708-a343-520f1b468a9c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:07:50.331290 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-98682ed3-a1c2-4cb3-89dd-12fa308afd47 req-62fd236d-dfd0-4e74-969c-785d6d78e775 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096247 Aug 09 17:07:50.332214 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 557/1045] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:50.352381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c786224a-61c2-433d-ab7c-2b9dafa6ff4c tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:50.356197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c786224a-61c2-433d-ab7c-2b9dafa6ff4c tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:50.378383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c786224a-61c2-433d-ab7c-2b9dafa6ff4c tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:50.378897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c786224a-61c2-433d-ab7c-2b9dafa6ff4c tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:50.379352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c786224a-61c2-433d-ab7c-2b9dafa6ff4c tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:50.380233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c786224a-61c2-433d-ab7c-2b9dafa6ff4c tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:50.381276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c786224a-61c2-433d-ab7c-2b9dafa6ff4c tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:50.381722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c786224a-61c2-433d-ab7c-2b9dafa6ff4c tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:50.865225 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aa5feb9e-2932-40ce-a318-b339dde15aa5 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/8c82ef1e-ad9b-4aab-a3e2-6801c15f71bb" status: 202 len: 0 microversion: 2.1 time: 1.359506 Aug 09 17:07:50.871095 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 489/1046] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:07:49 2022] DELETE /compute/v2.1/os-security-groups/8c82ef1e-ad9b-4aab-a3e2-6801c15f71bb => generated 0 bytes in 1366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:50.885245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-c786224a-61c2-433d-ab7c-2b9dafa6ff4c tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid e2c3e188-8990-4500-ab50-91d07d799686 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:07:50.897958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fb3e0457-c0f6-4c56-b276-a6b81f455484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:50.901726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fb3e0457-c0f6-4c56-b276-a6b81f455484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:50.916063 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c786224a-61c2-433d-ab7c-2b9dafa6ff4c tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 2054 microversion: 2.25 time: 0.581435 Aug 09 17:07:50.917901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:50.929658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb3e0457-c0f6-4c56-b276-a6b81f455484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:50.938557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb3e0457-c0f6-4c56-b276-a6b81f455484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:50.939392 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 558/1047] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:50 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 2054 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:50.941137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb3e0457-c0f6-4c56-b276-a6b81f455484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:50.943822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb3e0457-c0f6-4c56-b276-a6b81f455484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:50.945338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb3e0457-c0f6-4c56-b276-a6b81f455484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:50.946500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb3e0457-c0f6-4c56-b276-a6b81f455484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:50.969140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d694eb08-96a6-47c3-946f-786f5c4a1f6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:50.971054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d694eb08-96a6-47c3-946f-786f5c4a1f6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:50.991135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d694eb08-96a6-47c3-946f-786f5c4a1f6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:50.992068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d694eb08-96a6-47c3-946f-786f5c4a1f6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:50.992868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d694eb08-96a6-47c3-946f-786f5c4a1f6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:50.994190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d694eb08-96a6-47c3-946f-786f5c4a1f6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:50.995072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d694eb08-96a6-47c3-946f-786f5c4a1f6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:50.995913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d694eb08-96a6-47c3-946f-786f5c4a1f6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:51.406309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=18 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:51.530332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d694eb08-96a6-47c3-946f-786f5c4a1f6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:51.556400 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d694eb08-96a6-47c3-946f-786f5c4a1f6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1543 microversion: 2.1 time: 0.612667 Aug 09 17:07:51.559091 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 559/1048] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:50 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1543 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:51.574187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a5f02e5-eb01-417d-a83f-b59d415f57ec tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Calling method '.version_select at 0x7fbbcb642f70>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:51.948485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fb3e0457-c0f6-4c56-b276-a6b81f455484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:51.976821 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fb3e0457-c0f6-4c56-b276-a6b81f455484 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1498 microversion: 2.1 time: 1.096887 Aug 09 17:07:51.979271 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 490/1049] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:50 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1498 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:51.989639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-05df7622-8910-4a21-b88f-3e57d9adec4d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:51.990964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-05df7622-8910-4a21-b88f-3e57d9adec4d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:52.010943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05df7622-8910-4a21-b88f-3e57d9adec4d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:52.012566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05df7622-8910-4a21-b88f-3e57d9adec4d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:52.014669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05df7622-8910-4a21-b88f-3e57d9adec4d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:52.016570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05df7622-8910-4a21-b88f-3e57d9adec4d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:52.018640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05df7622-8910-4a21-b88f-3e57d9adec4d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:52.019953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05df7622-8910-4a21-b88f-3e57d9adec4d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:52.203283 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a5f02e5-eb01-417d-a83f-b59d415f57ec tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/acb771fc-bb65-42b2-af91-7f186cb49b51" status: 202 len: 0 microversion: 2.1 time: 0.641455 Aug 09 17:07:52.205067 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 560/1050] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:07:51 2022] DELETE /compute/v2.1/os-security-groups/acb771fc-bb65-42b2-af91-7f186cb49b51 => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:52.216697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ba609d22-1297-44a9-9a1f-9e2c30e46a72 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:52.218636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba609d22-1297-44a9-9a1f-9e2c30e46a72 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:52.233814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba609d22-1297-44a9-9a1f-9e2c30e46a72 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:52.235717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba609d22-1297-44a9-9a1f-9e2c30e46a72 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:52.237379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba609d22-1297-44a9-9a1f-9e2c30e46a72 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:52.239782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba609d22-1297-44a9-9a1f-9e2c30e46a72 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:52.240971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba609d22-1297-44a9-9a1f-9e2c30e46a72 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:52.242899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba609d22-1297-44a9-9a1f-9e2c30e46a72 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:52.490749 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ba609d22-1297-44a9-9a1f-9e2c30e46a72 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283231 Aug 09 17:07:52.492686 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 561/1051] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:07:52 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-interface => generated 284 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:52.509667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3f4d0f42-a3c1-41a5-8dcc-69fcab1fd0e8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:52.510632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3f4d0f42-a3c1-41a5-8dcc-69fcab1fd0e8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:52.521539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4d0f42-a3c1-41a5-8dcc-69fcab1fd0e8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:52.522836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4d0f42-a3c1-41a5-8dcc-69fcab1fd0e8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:52.523545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4d0f42-a3c1-41a5-8dcc-69fcab1fd0e8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:52.524796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4d0f42-a3c1-41a5-8dcc-69fcab1fd0e8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:52.525714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4d0f42-a3c1-41a5-8dcc-69fcab1fd0e8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:52.526698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4d0f42-a3c1-41a5-8dcc-69fcab1fd0e8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:52.798789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-05df7622-8910-4a21-b88f-3e57d9adec4d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:52.812959 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-05df7622-8910-4a21-b88f-3e57d9adec4d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1474 microversion: 2.1 time: 0.831313 Aug 09 17:07:52.827793 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 491/1052] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:51 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1474 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:52.842552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f9f9b9d3-c876-4a73-a102-b149a93a760f tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Calling method '.version_select at 0x7fbbcb9425e0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:52.952532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-3f4d0f42-a3c1-41a5-8dcc-69fcab1fd0e8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid e2c3e188-8990-4500-ab50-91d07d799686 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:07:52.980542 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3f4d0f42-a3c1-41a5-8dcc-69fcab1fd0e8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 2034 microversion: 2.25 time: 0.486512 Aug 09 17:07:52.981604 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 562/1053] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:52 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 2034 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:53.008638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4d227c41-d6b5-4201-83cc-be9ecc7ce894 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-845781-6", "block_migration": "auto"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:53.012982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4d227c41-d6b5-4201-83cc-be9ecc7ce894 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:53.027686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d227c41-d6b5-4201-83cc-be9ecc7ce894 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:53.028304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d227c41-d6b5-4201-83cc-be9ecc7ce894 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:53.028765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d227c41-d6b5-4201-83cc-be9ecc7ce894 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:53.029807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d227c41-d6b5-4201-83cc-be9ecc7ce894 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:53.030281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d227c41-d6b5-4201-83cc-be9ecc7ce894 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:53.030790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d227c41-d6b5-4201-83cc-be9ecc7ce894 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:53.070783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-4d227c41-d6b5-4201-83cc-be9ecc7ce894 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'flavor' on Instance uuid e2c3e188-8990-4500-ab50-91d07d799686 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:07:53.088702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4d227c41-d6b5-4201-83cc-be9ecc7ce894 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Going to try to live migrate instance to n-h2-845781-6 {{(pid=119431) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 17:07:53.150792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:54.609383 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f9f9b9d3-c876-4a73-a102-b149a93a760f tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/dc05b438-fd40-41eb-85fc-caf29bef8818" status: 202 len: 0 microversion: 2.1 time: 1.778596 Aug 09 17:07:54.611024 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 492/1054] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:07:52 2022] DELETE /compute/v2.1/os-security-groups/dc05b438-fd40-41eb-85fc-caf29bef8818 => generated 0 bytes in 1782 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:54.622170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fde7aca5-5908-4545-ada8-708a3674b928 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:54.623061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fde7aca5-5908-4545-ada8-708a3674b928 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:54.631439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde7aca5-5908-4545-ada8-708a3674b928 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:54.632296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde7aca5-5908-4545-ada8-708a3674b928 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:54.632810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde7aca5-5908-4545-ada8-708a3674b928 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:54.633743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde7aca5-5908-4545-ada8-708a3674b928 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:54.634213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde7aca5-5908-4545-ada8-708a3674b928 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:54.634652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde7aca5-5908-4545-ada8-708a3674b928 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:55.111996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fde7aca5-5908-4545-ada8-708a3674b928 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:55.172732 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fde7aca5-5908-4545-ada8-708a3674b928 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1498 microversion: 2.1 time: 0.552946 Aug 09 17:07:55.176871 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 493/1055] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:54 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1498 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:55.190461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-24bee715-0473-4e99-b93e-0eebc5dc8192 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:55.193932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-24bee715-0473-4e99-b93e-0eebc5dc8192 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:55.211164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24bee715-0473-4e99-b93e-0eebc5dc8192 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:55.212518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24bee715-0473-4e99-b93e-0eebc5dc8192 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:55.216251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24bee715-0473-4e99-b93e-0eebc5dc8192 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:55.219818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24bee715-0473-4e99-b93e-0eebc5dc8192 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:55.223273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24bee715-0473-4e99-b93e-0eebc5dc8192 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:55.225033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24bee715-0473-4e99-b93e-0eebc5dc8192 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:55.886836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-24bee715-0473-4e99-b93e-0eebc5dc8192 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:55.908087 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-24bee715-0473-4e99-b93e-0eebc5dc8192 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1469 microversion: 2.1 time: 0.727558 Aug 09 17:07:55.910327 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 494/1056] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:55 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1469 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:55.920983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f34f5f9c-d899-4073-98f3-7c027e7e5574 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] Calling method '.version_select at 0x7fbbcbc0e4c0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:56.388142 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4d227c41-d6b5-4201-83cc-be9ecc7ce894 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686/action" status: 202 len: 0 microversion: 2.25 time: 3.383234 Aug 09 17:07:56.392050 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 563/1057] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:07:53 2022] POST /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686/action => generated 0 bytes in 3388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:07:56.419148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5b9dbf4d-88a0-4d5c-bff7-355d7bd5e2b5 req-3132e1c1-9364-4823-90b6-219ec15b2e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bde0f3f-3670-4908-bc71-f4af6b3671b2", "tag": "02f77b41-d5fc-4f8a-8aac-6e744c227b20"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:56.466906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b9dbf4d-88a0-4d5c-bff7-355d7bd5e2b5 req-3132e1c1-9364-4823-90b6-219ec15b2e98 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:56.469603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b9dbf4d-88a0-4d5c-bff7-355d7bd5e2b5 req-3132e1c1-9364-4823-90b6-219ec15b2e98 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:56.470479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b9dbf4d-88a0-4d5c-bff7-355d7bd5e2b5 req-3132e1c1-9364-4823-90b6-219ec15b2e98 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:56.532738 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5b9dbf4d-88a0-4d5c-bff7-355d7bd5e2b5 req-3132e1c1-9364-4823-90b6-219ec15b2e98 service nova] Creating event network-changed:02f77b41-d5fc-4f8a-8aac-6e744c227b20 for instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 on n-h2-845781-6 Aug 09 17:07:56.555237 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5b9dbf4d-88a0-4d5c-bff7-355d7bd5e2b5 req-3132e1c1-9364-4823-90b6-219ec15b2e98 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159986 Aug 09 17:07:56.556380 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 564/1058] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:07:56.603830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:07:56.605759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:56.634087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:56.636141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:56.637224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:56.641385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:56.642590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:56.645696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:56.716075 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f34f5f9c-d899-4073-98f3-7c027e7e5574 tempest-SecurityGroupRulesTestJSON-662440497 tempest-SecurityGroupRulesTestJSON-662440497-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/ed1990a2-5b55-45f1-9fd9-f7353cff80da" status: 202 len: 0 microversion: 2.1 time: 0.803120 Aug 09 17:07:56.722081 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 495/1059] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:07:55 2022] DELETE /compute/v2.1/os-security-groups/ed1990a2-5b55-45f1-9fd9-f7353cff80da => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:56.728808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d69f5c6-02d9-4d83-8222-aa1e9316cf29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:56.729920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0d69f5c6-02d9-4d83-8222-aa1e9316cf29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:56.748787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d69f5c6-02d9-4d83-8222-aa1e9316cf29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:56.750666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d69f5c6-02d9-4d83-8222-aa1e9316cf29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:56.751735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d69f5c6-02d9-4d83-8222-aa1e9316cf29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:56.753937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d69f5c6-02d9-4d83-8222-aa1e9316cf29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:56.756708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d69f5c6-02d9-4d83-8222-aa1e9316cf29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:56.759013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d69f5c6-02d9-4d83-8222-aa1e9316cf29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:56.852776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:56.853412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:56.855957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:56.857185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:56.863075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:56.864336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:57.034202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for project 7004f453a4d944239c4641bbc394ebb5. Resources: {'ram', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:07:57.042928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for user 434e395144bc4443abb655a9d0a8b329 and project 7004f453a4d944239c4641bbc394ebb5. Resources: {'ram', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:07:57.294297 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-246e03a8-6abd-4b79-9ca4-03914047eaa3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "POST /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c/action" status: 202 len: 0 microversion: 2.1 time: 0.725069 Aug 09 17:07:57.295273 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 565/1060] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:07:56 2022] POST /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:07:57.302763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:57.304147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:57.312212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:57.313055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:57.313662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:57.314652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:57.315302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:57.315767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:57.633958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0d69f5c6-02d9-4d83-8222-aa1e9316cf29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:57.649596 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0d69f5c6-02d9-4d83-8222-aa1e9316cf29 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1498 microversion: 2.1 time: 0.923150 Aug 09 17:07:57.652373 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 496/1061] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:56 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1498 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:57.673747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-31292e77-6d62-46bf-bc09-a34c6c078839 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:57.675537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-31292e77-6d62-46bf-bc09-a34c6c078839 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:57.686208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31292e77-6d62-46bf-bc09-a34c6c078839 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:57.687384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31292e77-6d62-46bf-bc09-a34c6c078839 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:57.688724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31292e77-6d62-46bf-bc09-a34c6c078839 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:57.691326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31292e77-6d62-46bf-bc09-a34c6c078839 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:57.693273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31292e77-6d62-46bf-bc09-a34c6c078839 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:57.694397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31292e77-6d62-46bf-bc09-a34c6c078839 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:57.916552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:57.941265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:57.949770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:57.957088 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bfb7e7a5-021d-4a24-bbc9-8dd7c46758ef tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 0.658233 Aug 09 17:07:57.960524 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 566/1062] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:57 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:07:58.690003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c32d342f-d7d1-422b-a127-058b4f414abe tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:58.703321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c32d342f-d7d1-422b-a127-058b4f414abe tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:58.738175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c32d342f-d7d1-422b-a127-058b4f414abe tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:58.740563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c32d342f-d7d1-422b-a127-058b4f414abe tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:58.741670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c32d342f-d7d1-422b-a127-058b4f414abe tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:58.744366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c32d342f-d7d1-422b-a127-058b4f414abe tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:58.745660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c32d342f-d7d1-422b-a127-058b4f414abe tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:58.750411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c32d342f-d7d1-422b-a127-058b4f414abe tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:58.814320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-31292e77-6d62-46bf-bc09-a34c6c078839 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:58.827022 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-31292e77-6d62-46bf-bc09-a34c6c078839 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1468 microversion: 2.1 time: 1.172038 Aug 09 17:07:58.840519 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 497/1063] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:57 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1468 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:07:58.987459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:07:58.988500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:07:59.012021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:59.012990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:59.013670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:59.015758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:07:59.016609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:07:59.017309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:07:59.457168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:07:59.974608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c32d342f-d7d1-422b-a127-058b4f414abe tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:07:59.990549 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c32d342f-d7d1-422b-a127-058b4f414abe tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1498 microversion: 2.1 time: 1.307970 Aug 09 17:07:59.994541 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 567/1064] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:58 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1498 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:00.002235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-95124da1-2d12-4bf9-8e27-4d02cf024777 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:00.003773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-95124da1-2d12-4bf9-8e27-4d02cf024777 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:00.052791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95124da1-2d12-4bf9-8e27-4d02cf024777 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:00.056973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95124da1-2d12-4bf9-8e27-4d02cf024777 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:00.057803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95124da1-2d12-4bf9-8e27-4d02cf024777 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:00.058872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95124da1-2d12-4bf9-8e27-4d02cf024777 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:00.063559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95124da1-2d12-4bf9-8e27-4d02cf024777 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:00.072553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95124da1-2d12-4bf9-8e27-4d02cf024777 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:00.699286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:00.738316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:00.741202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:00.743065 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-87ce3aa5-72ba-443d-a5e7-5d31bae27c73 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 1.761361 Aug 09 17:08:00.743933 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 498/1065] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:07:58 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:00.754039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-69a39551-0e32-4d0f-9f8c-efc5e148a96c req-7c7b56ed-14e1-4618-a4b0-c5e3a4539a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a07b5bb-7014-4708-a343-520f1b468a9c", "name": "network-vif-plugged", "status": "completed", "tag": "2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:00.797805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-69a39551-0e32-4d0f-9f8c-efc5e148a96c req-7c7b56ed-14e1-4618-a4b0-c5e3a4539a1b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:00.798573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-69a39551-0e32-4d0f-9f8c-efc5e148a96c req-7c7b56ed-14e1-4618-a4b0-c5e3a4539a1b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:00.800771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-69a39551-0e32-4d0f-9f8c-efc5e148a96c req-7c7b56ed-14e1-4618-a4b0-c5e3a4539a1b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:00.836615 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-69a39551-0e32-4d0f-9f8c-efc5e148a96c req-7c7b56ed-14e1-4618-a4b0-c5e3a4539a1b service nova] Creating event network-vif-plugged:2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34 for instance 9a07b5bb-7014-4708-a343-520f1b468a9c on n-h2-845781-6 Aug 09 17:08:00.872618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-69a39551-0e32-4d0f-9f8c-efc5e148a96c req-7c7b56ed-14e1-4618-a4b0-c5e3a4539a1b service nova] Instance 9a07b5bb-7014-4708-a343-520f1b468a9c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:08:00.919297 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-69a39551-0e32-4d0f-9f8c-efc5e148a96c req-7c7b56ed-14e1-4618-a4b0-c5e3a4539a1b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172577 Aug 09 17:08:00.921512 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 499/1066] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:01.045778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-88a326ea-a7ef-4dbf-8fd7-3600bc4fdac6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:01.047842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-88a326ea-a7ef-4dbf-8fd7-3600bc4fdac6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:01.061766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88a326ea-a7ef-4dbf-8fd7-3600bc4fdac6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:01.062491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88a326ea-a7ef-4dbf-8fd7-3600bc4fdac6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:01.063350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88a326ea-a7ef-4dbf-8fd7-3600bc4fdac6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:01.064521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88a326ea-a7ef-4dbf-8fd7-3600bc4fdac6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:01.065152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88a326ea-a7ef-4dbf-8fd7-3600bc4fdac6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:01.065739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88a326ea-a7ef-4dbf-8fd7-3600bc4fdac6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:01.152719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-95124da1-2d12-4bf9-8e27-4d02cf024777 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:01.171950 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-95124da1-2d12-4bf9-8e27-4d02cf024777 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1468 microversion: 2.1 time: 1.175562 Aug 09 17:08:01.196136 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 568/1067] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:07:59 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1468 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:01.801469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:01.806961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:01.822082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:01.823239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:01.824385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:01.826029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:01.828497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:01.830176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:02.632202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-88a326ea-a7ef-4dbf-8fd7-3600bc4fdac6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:02.672055 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-88a326ea-a7ef-4dbf-8fd7-3600bc4fdac6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1498 microversion: 2.1 time: 1.636265 Aug 09 17:08:02.688521 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 500/1068] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:01 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1498 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:02.712218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b75f208d-159a-4a93-b681-5a54535a0f92 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:02.713941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b75f208d-159a-4a93-b681-5a54535a0f92 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:02.726967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b75f208d-159a-4a93-b681-5a54535a0f92 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:02.728312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b75f208d-159a-4a93-b681-5a54535a0f92 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:02.729467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b75f208d-159a-4a93-b681-5a54535a0f92 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:02.731498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b75f208d-159a-4a93-b681-5a54535a0f92 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:02.732664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b75f208d-159a-4a93-b681-5a54535a0f92 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:02.734074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b75f208d-159a-4a93-b681-5a54535a0f92 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:02.784920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:02.837522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:02.851984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:02.857303 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-39f69ff3-9dd2-4f8d-89ac-bab7511ac838 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 1.073124 Aug 09 17:08:02.866546 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 569/1069] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:01 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:08:03.354271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-68286fc2-10e7-4f1c-af8a-fe631157f429 req-f08e73cc-9157-4ada-a2af-6cdb452b6e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c3e188-8990-4500-ab50-91d07d799686", "name": "network-vif-unplugged", "status": "completed", "tag": "09a3f3d2-7ab1-4737-95e8-c0be82cec011"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:03.362755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b75f208d-159a-4a93-b681-5a54535a0f92 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:03.398160 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b75f208d-159a-4a93-b681-5a54535a0f92 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1468 microversion: 2.1 time: 0.707782 Aug 09 17:08:03.401020 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 501/1070] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:02 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1468 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:03.402974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-68286fc2-10e7-4f1c-af8a-fe631157f429 req-f08e73cc-9157-4ada-a2af-6cdb452b6e4f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:03.403805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-68286fc2-10e7-4f1c-af8a-fe631157f429 req-f08e73cc-9157-4ada-a2af-6cdb452b6e4f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:03.404492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-68286fc2-10e7-4f1c-af8a-fe631157f429 req-f08e73cc-9157-4ada-a2af-6cdb452b6e4f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:03.419971 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-68286fc2-10e7-4f1c-af8a-fe631157f429 req-f08e73cc-9157-4ada-a2af-6cdb452b6e4f service nova] Creating event network-vif-unplugged:09a3f3d2-7ab1-4737-95e8-c0be82cec011 for instance e2c3e188-8990-4500-ab50-91d07d799686 on n-h1-845781-6 Aug 09 17:08:03.434815 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-68286fc2-10e7-4f1c-af8a-fe631157f429 req-f08e73cc-9157-4ada-a2af-6cdb452b6e4f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088956 Aug 09 17:08:03.436520 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 570/1071] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:03.724352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-224e1c22-4328-4669-b7fa-46a3968219e1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:03.725590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-224e1c22-4328-4669-b7fa-46a3968219e1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:03.746526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-224e1c22-4328-4669-b7fa-46a3968219e1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:03.748305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-224e1c22-4328-4669-b7fa-46a3968219e1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:03.748305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-224e1c22-4328-4669-b7fa-46a3968219e1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:03.749648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-224e1c22-4328-4669-b7fa-46a3968219e1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:03.750526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-224e1c22-4328-4669-b7fa-46a3968219e1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:03.777203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-224e1c22-4328-4669-b7fa-46a3968219e1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:03.901179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:03.903043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:03.913124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:03.914090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:03.914788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:03.916017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:03.916849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:03.917644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:04.359420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-224e1c22-4328-4669-b7fa-46a3968219e1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:04.374246 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-224e1c22-4328-4669-b7fa-46a3968219e1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 200 len: 1475 microversion: 2.1 time: 0.659032 Aug 09 17:08:04.375151 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 502/1072] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:03 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 1475 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:04.384084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:04.399577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:04.404424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:04.406851 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d451d453-eb23-457f-9566-44eb2745a43f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 0.511869 Aug 09 17:08:04.421774 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 571/1073] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:03 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:04.437738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-52eeee58-6f11-4373-a0ff-4270948d2ddf tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-919315681"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:04.441261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b62d59ef-da59-4e9f-93e8-f35849fc6742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:04.441949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b62d59ef-da59-4e9f-93e8-f35849fc6742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:04.447157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-52eeee58-6f11-4373-a0ff-4270948d2ddf tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:04.451142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b62d59ef-da59-4e9f-93e8-f35849fc6742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:04.452032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b62d59ef-da59-4e9f-93e8-f35849fc6742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:04.452700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b62d59ef-da59-4e9f-93e8-f35849fc6742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:04.453829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b62d59ef-da59-4e9f-93e8-f35849fc6742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:04.454579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b62d59ef-da59-4e9f-93e8-f35849fc6742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:04.455572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b62d59ef-da59-4e9f-93e8-f35849fc6742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:04.470029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52eeee58-6f11-4373-a0ff-4270948d2ddf tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:04.470903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52eeee58-6f11-4373-a0ff-4270948d2ddf tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:04.473552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52eeee58-6f11-4373-a0ff-4270948d2ddf tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:04.482135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52eeee58-6f11-4373-a0ff-4270948d2ddf tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:04.483020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52eeee58-6f11-4373-a0ff-4270948d2ddf tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:04.483842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52eeee58-6f11-4373-a0ff-4270948d2ddf tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:05.014253 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-52eeee58-6f11-4373-a0ff-4270948d2ddf tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "POST /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46/action" status: 202 len: 0 microversion: 2.1 time: 0.592023 Aug 09 17:08:05.023161 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 503/1074] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:08:04 2022] POST /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 09 17:08:05.041339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d53e96ea-ed27-4f9c-8c5e-81bd6beeedfa tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb942ca0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:05.122218 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d53e96ea-ed27-4f9c-8c5e-81bd6beeedfa tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.094019 Aug 09 17:08:05.133559 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 504/1075] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:05 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:05.271818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b62d59ef-da59-4e9f-93e8-f35849fc6742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:05.315942 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b62d59ef-da59-4e9f-93e8-f35849fc6742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1468 microversion: 2.1 time: 0.874988 Aug 09 17:08:05.319354 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 572/1076] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:04 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1468 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:05.448127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:05.449441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:05.475079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:05.476999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:05.478083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:05.479721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:05.480915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:05.481954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:05.598220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-730c6559-717f-4373-9439-aecd92966211 req-0abac92d-e72e-4e05-a3bf-5cb8f38624d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c3e188-8990-4500-ab50-91d07d799686", "tag": "09a3f3d2-7ab1-4737-95e8-c0be82cec011"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:05.631835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-730c6559-717f-4373-9439-aecd92966211 req-0abac92d-e72e-4e05-a3bf-5cb8f38624d1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:05.635014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-730c6559-717f-4373-9439-aecd92966211 req-0abac92d-e72e-4e05-a3bf-5cb8f38624d1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:05.637931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-730c6559-717f-4373-9439-aecd92966211 req-0abac92d-e72e-4e05-a3bf-5cb8f38624d1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:05.682933 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-730c6559-717f-4373-9439-aecd92966211 req-0abac92d-e72e-4e05-a3bf-5cb8f38624d1 service nova] Creating event network-changed:09a3f3d2-7ab1-4737-95e8-c0be82cec011 for instance e2c3e188-8990-4500-ab50-91d07d799686 on n-h1-845781-6 Aug 09 17:08:05.705006 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-730c6559-717f-4373-9439-aecd92966211 req-0abac92d-e72e-4e05-a3bf-5cb8f38624d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111450 Aug 09 17:08:05.706298 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 573/1077] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:06.144001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d6ddaca7-cda9-4ebd-be4b-b0e976620104 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb580ee0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:06.224639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:06.228632 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d6ddaca7-cda9-4ebd-be4b-b0e976620104 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.091476 Aug 09 17:08:06.229812 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 574/1078] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:06 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:06.248092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:06.250921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:06.252967 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ac2d1997-7d4c-4f3b-9299-9e9d07d9c71f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 0.811145 Aug 09 17:08:06.253892 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 505/1079] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:05 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:08:06.366250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1bf9cbbf-3be7-40fd-819d-56e6150ffcf0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:06.369914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1bf9cbbf-3be7-40fd-819d-56e6150ffcf0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:06.392370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf9cbbf-3be7-40fd-819d-56e6150ffcf0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:06.393050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf9cbbf-3be7-40fd-819d-56e6150ffcf0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:06.396542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf9cbbf-3be7-40fd-819d-56e6150ffcf0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:06.400147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf9cbbf-3be7-40fd-819d-56e6150ffcf0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:06.400951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf9cbbf-3be7-40fd-819d-56e6150ffcf0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:06.402169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf9cbbf-3be7-40fd-819d-56e6150ffcf0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:07.000893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:07.249840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fd9d062f-e743-46ee-8bba-806abda0287f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbeac8b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:07.374826 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fd9d062f-e743-46ee-8bba-806abda0287f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.128553 Aug 09 17:08:07.387506 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 506/1080] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:07 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:07.401422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:07.419268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:07.436574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:07.437620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:07.438431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:07.439616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:07.440573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:07.441550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:07.585195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1bf9cbbf-3be7-40fd-819d-56e6150ffcf0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:07.602906 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1bf9cbbf-3be7-40fd-819d-56e6150ffcf0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1534 microversion: 2.1 time: 1.247358 Aug 09 17:08:07.618280 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 575/1081] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:06 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1534 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:08.124946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b79f2907-1826-43f3-8f3f-325cfe5a6c12 req-d049a36e-122f-4583-a987-ba304b7bba6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a07b5bb-7014-4708-a343-520f1b468a9c", "name": "network-vif-unplugged", "status": "completed", "tag": "2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:08.187536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b79f2907-1826-43f3-8f3f-325cfe5a6c12 req-d049a36e-122f-4583-a987-ba304b7bba6e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:08.190580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b79f2907-1826-43f3-8f3f-325cfe5a6c12 req-d049a36e-122f-4583-a987-ba304b7bba6e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:08.203884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b79f2907-1826-43f3-8f3f-325cfe5a6c12 req-d049a36e-122f-4583-a987-ba304b7bba6e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:08.281542 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b79f2907-1826-43f3-8f3f-325cfe5a6c12 req-d049a36e-122f-4583-a987-ba304b7bba6e service nova] Creating event network-vif-unplugged:2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34 for instance 9a07b5bb-7014-4708-a343-520f1b468a9c on n-h1-845781-6 Aug 09 17:08:08.311872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-b79f2907-1826-43f3-8f3f-325cfe5a6c12 req-d049a36e-122f-4583-a987-ba304b7bba6e service nova] Instance 9a07b5bb-7014-4708-a343-520f1b468a9c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:08:08.350426 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b79f2907-1826-43f3-8f3f-325cfe5a6c12 req-d049a36e-122f-4583-a987-ba304b7bba6e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.234250 Aug 09 17:08:08.352371 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 576/1082] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:08.396207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c1b551a1-76e0-488a-b54e-9e2eecfae986 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb580c10>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:08.899334 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c1b551a1-76e0-488a-b54e-9e2eecfae986 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.511187 Aug 09 17:08:08.908393 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 577/1083] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:08 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:08.915339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-18d4af69-e781-46e0-9131-af37eedc8ce8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:08.926285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-18d4af69-e781-46e0-9131-af37eedc8ce8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:08.953310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18d4af69-e781-46e0-9131-af37eedc8ce8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:08.953830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18d4af69-e781-46e0-9131-af37eedc8ce8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:08.954282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18d4af69-e781-46e0-9131-af37eedc8ce8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:08.964151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18d4af69-e781-46e0-9131-af37eedc8ce8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:08.965098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18d4af69-e781-46e0-9131-af37eedc8ce8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:08.972813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18d4af69-e781-46e0-9131-af37eedc8ce8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:09.606114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:09.626106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:09.635171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:09.647103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:09.654180 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e55e5b56-5978-483b-880b-3e69a4c53315 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 2.261012 Aug 09 17:08:09.680260 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 507/1084] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:07 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 2282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:09.931878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-176f86c0-54ac-4dac-8ff3-31e866003b75 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb942b80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:10.112572 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-176f86c0-54ac-4dac-8ff3-31e866003b75 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.186831 Aug 09 17:08:10.113515 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 508/1085] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:09 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:10.375360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-18d4af69-e781-46e0-9131-af37eedc8ce8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:10.422623 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-18d4af69-e781-46e0-9131-af37eedc8ce8 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1534 microversion: 2.1 time: 1.504783 Aug 09 17:08:10.442801 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 578/1086] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:08 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1534 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:10.713316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:10.714222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:10.732832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:10.744497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:10.748308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:10.749261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:10.749887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:10.761063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:11.134115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-354cee67-dfea-46cd-a734-51a80cb02761 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb6809d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:11.295879 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-354cee67-dfea-46cd-a734-51a80cb02761 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.168028 Aug 09 17:08:11.296500 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 579/1087] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:11 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:11.452083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-61818e36-9244-462a-b460-86d2c28b10f0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:11.454144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61818e36-9244-462a-b460-86d2c28b10f0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:11.471526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61818e36-9244-462a-b460-86d2c28b10f0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:11.472250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61818e36-9244-462a-b460-86d2c28b10f0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:11.482453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61818e36-9244-462a-b460-86d2c28b10f0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:11.485384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61818e36-9244-462a-b460-86d2c28b10f0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:11.486603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61818e36-9244-462a-b460-86d2c28b10f0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:11.487671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61818e36-9244-462a-b460-86d2c28b10f0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:11.753779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:11.777593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:11.793725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:11.795974 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b0981d0a-2adf-4c4e-b57f-6a7a2dc8c08b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 1.097039 Aug 09 17:08:11.812489 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 509/1088] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:10 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:11.840683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-28c32761-6d95-47ac-9985-d6f75d6496c2 req-1045ad94-0496-49cd-ab4c-b092ce806de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a07b5bb-7014-4708-a343-520f1b468a9c", "tag": "2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:11.883391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-28c32761-6d95-47ac-9985-d6f75d6496c2 req-1045ad94-0496-49cd-ab4c-b092ce806de5 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:11.884490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-28c32761-6d95-47ac-9985-d6f75d6496c2 req-1045ad94-0496-49cd-ab4c-b092ce806de5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:11.885557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-28c32761-6d95-47ac-9985-d6f75d6496c2 req-1045ad94-0496-49cd-ab4c-b092ce806de5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:11.961506 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-28c32761-6d95-47ac-9985-d6f75d6496c2 req-1045ad94-0496-49cd-ab4c-b092ce806de5 service nova] Creating event network-changed:2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34 for instance 9a07b5bb-7014-4708-a343-520f1b468a9c on n-h1-845781-6 Aug 09 17:08:11.988524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-28c32761-6d95-47ac-9985-d6f75d6496c2 req-1045ad94-0496-49cd-ab4c-b092ce806de5 service nova] Instance 9a07b5bb-7014-4708-a343-520f1b468a9c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:08:12.043912 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-28c32761-6d95-47ac-9985-d6f75d6496c2 req-1045ad94-0496-49cd-ab4c-b092ce806de5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221523 Aug 09 17:08:12.045954 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 510/1089] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:12.321879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a125bd14-5926-4325-9013-22c7c9b0306c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb96cdc0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:12.345115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-61818e36-9244-462a-b460-86d2c28b10f0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:12.366480 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-61818e36-9244-462a-b460-86d2c28b10f0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1534 microversion: 2.1 time: 0.916455 Aug 09 17:08:12.384771 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 580/1090] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:11 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1534 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:12.465733 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a125bd14-5926-4325-9013-22c7c9b0306c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.151670 Aug 09 17:08:12.473862 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 511/1091] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:12 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:12.853273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:12.859811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:12.908125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:12.915263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:12.918671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:12.925718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:12.926788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:12.927594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:13.398563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6c95b809-fe7e-4ae1-8cea-3c3cb7ca3f8c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:13.400406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6c95b809-fe7e-4ae1-8cea-3c3cb7ca3f8c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:13.436542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c95b809-fe7e-4ae1-8cea-3c3cb7ca3f8c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:13.448889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c95b809-fe7e-4ae1-8cea-3c3cb7ca3f8c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:13.449768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c95b809-fe7e-4ae1-8cea-3c3cb7ca3f8c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:13.452672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c95b809-fe7e-4ae1-8cea-3c3cb7ca3f8c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:13.453694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c95b809-fe7e-4ae1-8cea-3c3cb7ca3f8c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:13.455184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c95b809-fe7e-4ae1-8cea-3c3cb7ca3f8c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:14.083019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:14.105238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:14.107329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:14.115187 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-857c33dd-05e7-4883-8681-0da98287ec26 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 1.275169 Aug 09 17:08:14.115845 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 581/1092] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:12 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:14.126128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1bd8bdd4-6809-4761-bd3f-0cb7bdcf20fc tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5d7dc0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:14.285244 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1bd8bdd4-6809-4761-bd3f-0cb7bdcf20fc tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.165819 Aug 09 17:08:14.293731 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 582/1093] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:14 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:15.163560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:15.164678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:15.177630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:15.178172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:15.178555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:15.179293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:15.179809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:15.211522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:15.302834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:15.360395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6c95b809-fe7e-4ae1-8cea-3c3cb7ca3f8c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:15.394575 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6c95b809-fe7e-4ae1-8cea-3c3cb7ca3f8c tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1534 microversion: 2.1 time: 2.002508 Aug 09 17:08:15.407938 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 512/1094] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:13 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1534 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:15.436373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-67a1ac0a-8462-4112-9fa4-ac1e7b0e20c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb9428b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:15.533538 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-67a1ac0a-8462-4112-9fa4-ac1e7b0e20c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.122880 Aug 09 17:08:15.545252 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 513/1095] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:15 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:15.684568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-4df710c7-3ba3-485e-9c08-03aa99b9b91c req-e8c001a0-7247-4525-ae36-5416028b4c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417d9361-7e22-4e97-a3a9-acd1f3a91e46", "name": "network-vif-plugged", "status": "completed", "tag": "ce57d96c-a257-41a4-a475-4abfa4213f53"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:15.747484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4df710c7-3ba3-485e-9c08-03aa99b9b91c req-e8c001a0-7247-4525-ae36-5416028b4c3c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:15.748485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4df710c7-3ba3-485e-9c08-03aa99b9b91c req-e8c001a0-7247-4525-ae36-5416028b4c3c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:15.756650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4df710c7-3ba3-485e-9c08-03aa99b9b91c req-e8c001a0-7247-4525-ae36-5416028b4c3c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:15.816360 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-4df710c7-3ba3-485e-9c08-03aa99b9b91c req-e8c001a0-7247-4525-ae36-5416028b4c3c service nova] Creating event network-vif-plugged:ce57d96c-a257-41a4-a475-4abfa4213f53 for instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 on n-h2-845781-6 Aug 09 17:08:15.840361 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-4df710c7-3ba3-485e-9c08-03aa99b9b91c req-e8c001a0-7247-4525-ae36-5416028b4c3c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155804 Aug 09 17:08:15.843222 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 514/1096] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:08:16.185657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:16.202661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:16.204967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:16.213392 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4340b8c2-934a-4032-8616-99badb85e843 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 1.055429 Aug 09 17:08:16.219765 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 583/1097] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:15 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:16.437767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-14c7e99f-bb2c-4b11-8d60-31aaf3170545 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:16.438595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-14c7e99f-bb2c-4b11-8d60-31aaf3170545 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:16.454636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14c7e99f-bb2c-4b11-8d60-31aaf3170545 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:16.460861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14c7e99f-bb2c-4b11-8d60-31aaf3170545 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:16.464714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14c7e99f-bb2c-4b11-8d60-31aaf3170545 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:16.468517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14c7e99f-bb2c-4b11-8d60-31aaf3170545 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:16.472329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14c7e99f-bb2c-4b11-8d60-31aaf3170545 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:16.476390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14c7e99f-bb2c-4b11-8d60-31aaf3170545 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:16.824786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1636147023", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "bf9538fd-ab95-4f28-9743-01ef51be592a"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:17.033265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] validate_networks() for [('bf9538fd-ab95-4f28-9743-01ef51be592a', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:08:17.215724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-14c7e99f-bb2c-4b11-8d60-31aaf3170545 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:17.251359 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-14c7e99f-bb2c-4b11-8d60-31aaf3170545 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1534 microversion: 2.1 time: 0.814319 Aug 09 17:08:17.258652 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 584/1098] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:16 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1534 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:17.278717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4abd8d8d-bbfe-49b5-824f-6380d85870f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb595e50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:17.493427 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4abd8d8d-bbfe-49b5-824f-6380d85870f4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.230032 Aug 09 17:08:17.512481 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 585/1099] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:17 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:17.531879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:17.533583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:17.548047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:17.549393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:17.550526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:17.553585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:17.554479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:17.555356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:17.898381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:17.917298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:17.919025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:17.920444 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-353b64f7-f951-4b35-b3e3-7fa9c56609a4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 0.404870 Aug 09 17:08:17.922996 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 586/1100] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:17 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:18.295146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3cb3b6b7-5b96-4599-ac38-00f95de37614 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:18.296117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3cb3b6b7-5b96-4599-ac38-00f95de37614 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:18.306406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:18.308018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cb3b6b7-5b96-4599-ac38-00f95de37614 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:18.308564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cb3b6b7-5b96-4599-ac38-00f95de37614 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:18.309039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cb3b6b7-5b96-4599-ac38-00f95de37614 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:18.313732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cb3b6b7-5b96-4599-ac38-00f95de37614 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:18.314285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cb3b6b7-5b96-4599-ac38-00f95de37614 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:18.314904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cb3b6b7-5b96-4599-ac38-00f95de37614 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:18.813738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3cb3b6b7-5b96-4599-ac38-00f95de37614 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:18.828267 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3cb3b6b7-5b96-4599-ac38-00f95de37614 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1534 microversion: 2.1 time: 0.535019 Aug 09 17:08:18.831509 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 587/1101] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:18 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1534 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:18.841809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-10940b60-9276-4920-bc04-b9143b262167 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5eb1f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:18.987570 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-10940b60-9276-4920-bc04-b9143b262167 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.154177 Aug 09 17:08:18.988213 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 588/1102] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:18 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:18.996425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:18.997070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:19.033989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:19.040026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:19.043753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:19.047457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:19.051290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:19.052768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:19.138759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:08:19.139414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:08:19.140053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:08:19.141449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:08:19.142107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:08:19.174888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:19.176186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:19.178722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:19.185004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:19.187415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:19.188576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:19.286795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Getting quotas for project fc4ac8041e634c979c8678b4fde35a4f. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:08:19.312224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Getting quotas for user d55e4a6f6b7b4766b6510072d21f1e60 and project fc4ac8041e634c979c8678b4fde35a4f. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:08:19.377691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:08:19.382581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:08:19.634264 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-85647a4d-7168-49c1-916a-c56fbf1a5421 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.386847 Aug 09 17:08:19.640073 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 515/1103] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:08:19.664013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-046b032b-9643-4849-9a1f-c3c0576e5741 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:19.665951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-046b032b-9643-4849-9a1f-c3c0576e5741 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:19.679567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:19.729909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:19.738348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:19.749178 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-da066319-69aa-4817-a0eb-45454dc4358a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 0.759548 Aug 09 17:08:19.756581 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 589/1104] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:18 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:19.884264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ef93cbb-c100-4b0a-abca-95c754316528 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:19.892344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2ef93cbb-c100-4b0a-abca-95c754316528 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:19.936495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ef93cbb-c100-4b0a-abca-95c754316528 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:19.937810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ef93cbb-c100-4b0a-abca-95c754316528 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:19.944629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ef93cbb-c100-4b0a-abca-95c754316528 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:19.946586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ef93cbb-c100-4b0a-abca-95c754316528 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:19.948226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ef93cbb-c100-4b0a-abca-95c754316528 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:19.949982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ef93cbb-c100-4b0a-abca-95c754316528 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:20.322610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-046b032b-9643-4849-9a1f-c3c0576e5741 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:20.331227 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-046b032b-9643-4849-9a1f-c3c0576e5741 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1224 microversion: 2.1 time: 0.683177 Aug 09 17:08:20.356266 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 516/1105] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:19 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1224 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:20.361925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-865814a9-4d03-4851-a38a-756ff0f0e71d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb94f790>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:20.495667 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-865814a9-4d03-4851-a38a-756ff0f0e71d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.138163 Aug 09 17:08:20.497426 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 517/1106] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:20 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:20.547148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2ef93cbb-c100-4b0a-abca-95c754316528 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:20.568873 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ef93cbb-c100-4b0a-abca-95c754316528 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1534 microversion: 2.1 time: 0.698058 Aug 09 17:08:20.570611 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 590/1107] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:19 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1534 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:20.808191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:20.810958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:20.876249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:20.877143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:20.908319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:20.909825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:20.910656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:20.916546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:21.370937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-23ea697a-7eb0-4581-85bc-495009ad9244 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:21.380560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-23ea697a-7eb0-4581-85bc-495009ad9244 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:21.694708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-23ea697a-7eb0-4581-85bc-495009ad9244 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:21.734307 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-23ea697a-7eb0-4581-85bc-495009ad9244 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1224 microversion: 2.1 time: 0.369437 Aug 09 17:08:21.740640 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 591/1108] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:21 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1224 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:21.749060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af158c75-fbb3-47fe-99ef-784c56627ba1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5821f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:21.862819 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-af158c75-fbb3-47fe-99ef-784c56627ba1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.118994 Aug 09 17:08:21.863479 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 592/1109] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:21 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:21.877739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-30e3c12c-b6c8-4320-8e33-508e443307a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:21.878395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-30e3c12c-b6c8-4320-8e33-508e443307a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:21.894649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30e3c12c-b6c8-4320-8e33-508e443307a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:21.895157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30e3c12c-b6c8-4320-8e33-508e443307a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:21.896171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30e3c12c-b6c8-4320-8e33-508e443307a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:21.896923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30e3c12c-b6c8-4320-8e33-508e443307a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:21.897392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30e3c12c-b6c8-4320-8e33-508e443307a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:21.901417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30e3c12c-b6c8-4320-8e33-508e443307a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:22.381263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:22.467896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:22.485248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:22.487851 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d0ed7421-a12e-4a34-a5f3-66123540dd1d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 1.689744 Aug 09 17:08:22.492270 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 518/1110] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:20 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:22.753089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-30e3c12c-b6c8-4320-8e33-508e443307a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:22.766077 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-30e3c12c-b6c8-4320-8e33-508e443307a5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1527 microversion: 2.1 time: 0.899985 Aug 09 17:08:22.770406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9cd78be4-ae1b-4ea4-9507-f594ce807cac tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:22.772306 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 593/1111] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:21 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1527 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:22.790913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9cd78be4-ae1b-4ea4-9507-f594ce807cac tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:22.793749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2429a9a4-b7e9-47b3-bc91-4b2fb8881477 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:22.794372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2429a9a4-b7e9-47b3-bc91-4b2fb8881477 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:22.815119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:22.821713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cd78be4-ae1b-4ea4-9507-f594ce807cac tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:22.825211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cd78be4-ae1b-4ea4-9507-f594ce807cac tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:22.828032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cd78be4-ae1b-4ea4-9507-f594ce807cac tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:22.834659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2429a9a4-b7e9-47b3-bc91-4b2fb8881477 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:22.835558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2429a9a4-b7e9-47b3-bc91-4b2fb8881477 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:22.836397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2429a9a4-b7e9-47b3-bc91-4b2fb8881477 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:22.837540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cd78be4-ae1b-4ea4-9507-f594ce807cac tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:22.839022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cd78be4-ae1b-4ea4-9507-f594ce807cac tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:22.841507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cd78be4-ae1b-4ea4-9507-f594ce807cac tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:22.856875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2429a9a4-b7e9-47b3-bc91-4b2fb8881477 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:22.857814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2429a9a4-b7e9-47b3-bc91-4b2fb8881477 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:22.867428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2429a9a4-b7e9-47b3-bc91-4b2fb8881477 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:23.240977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2429a9a4-b7e9-47b3-bc91-4b2fb8881477 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:23.260597 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2429a9a4-b7e9-47b3-bc91-4b2fb8881477 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1527 microversion: 2.1 time: 0.469780 Aug 09 17:08:23.263924 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 594/1112] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:22 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1527 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:23.279878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-db71ecc5-bce3-4295-89e7-03ecd3a182fc tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5cde50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:23.357108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9cd78be4-ae1b-4ea4-9507-f594ce807cac tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:23.371392 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9cd78be4-ae1b-4ea4-9507-f594ce807cac tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1220 microversion: 2.1 time: 0.607175 Aug 09 17:08:23.374132 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 519/1113] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:22 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1220 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:23.383536 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-db71ecc5-bce3-4295-89e7-03ecd3a182fc tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.114964 Aug 09 17:08:23.387723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0205852f-5ca2-4ef1-8508-1c0ee646aa5e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:23.389239 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:08:23.389239 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:08:23.392480 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 595/1114] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:23 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:23.410733 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-0205852f-5ca2-4ef1-8508-1c0ee646aa5e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] HTTP exception thrown: Flavor 3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3 could not be found. Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0205852f-5ca2-4ef1-8508-1c0ee646aa5e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Request method failure captured: Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/flavors/3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3 HTTP/1.1 Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pNpyo6IBCBrf3FuUMtmAeTEHfPgKk8X7BlEOTqDaa83zfBtOrmM9aY2UsWFl2faTLMAcT3Ttnsyv1nSCbl4IwfFNxtIuZgL2lqtWtRwaUc2CazFlRYyYYGcfFowhkQsq9d7C_0Sx8lWnj9nB40FA2PyDbPKWI0sOufawKzlnQHY4WI Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 9acca86153a141918d7785f76b3dd796 Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-MigrationsAdminTest-1441584186 Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:08:23.420921 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9acca86153a141918d7785f76b3dd796"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9acca86153a141918d7785f76b3dd796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9acca86153a141918d7785f76b3dd796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9acca86153a141918d7785f76b3dd796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-MigrationsAdminTest-1441584186 Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 9acca86153a141918d7785f76b3dd796 Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-MigrationsAdminTest-1441584186 Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-MigrationsAdminTest-1441584186-project-admin Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 017d8ebb677e4fa789c56667f7ea29eb Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-MigrationsAdminTest-1441584186-project-admin Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: exception: Flavor 3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3 could not be found. Aug 09 17:08:23.422666 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3'} Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3 could not be found. Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:08:23.423609 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3 could not be found. Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3 could not be found. Aug 09 17:08:23.425333 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:08:23.427225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0205852f-5ca2-4ef1-8508-1c0ee646aa5e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Returning 404 to user: Flavor 3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:08:23.428423 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0205852f-5ca2-4ef1-8508-1c0ee646aa5e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3" status: 404 len: 109 microversion: 2.1 time: 0.052973 Aug 09 17:08:23.430624 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 520/1115] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:08:23 2022] DELETE /compute/v2.1/flavors/3415d7a6-51cc-4e1d-bc47-b9f8a35b94e3 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:08:23.552078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:23.557655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:23.611109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:23.612818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:23.618851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:23.622345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:23.629591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:23.631211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:23.674918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1937236472", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:23.904251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:08:24.172125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:24.224746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:24.238929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:24.250639 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-276cd8c8-c1ce-41f9-b77e-b1b71d39d4bb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 0.717268 Aug 09 17:08:24.252066 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 596/1116] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:23 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:08:24.407170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1dadcea-40e4-4fd6-ab5f-a5d8a7120033 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5cd8b0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:24.602195 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1dadcea-40e4-4fd6-ab5f-a5d8a7120033 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.203579 Aug 09 17:08:24.603222 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 597/1117] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:24 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:24.634446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd9cdc90-9a05-4f5c-bccd-2cb63b2b94d8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:24.642213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fd9cdc90-9a05-4f5c-bccd-2cb63b2b94d8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:24.673366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9cdc90-9a05-4f5c-bccd-2cb63b2b94d8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:24.673754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9cdc90-9a05-4f5c-bccd-2cb63b2b94d8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:24.674517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9cdc90-9a05-4f5c-bccd-2cb63b2b94d8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:24.676113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9cdc90-9a05-4f5c-bccd-2cb63b2b94d8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:24.677778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9cdc90-9a05-4f5c-bccd-2cb63b2b94d8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:24.682715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9cdc90-9a05-4f5c-bccd-2cb63b2b94d8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:24.910656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fd9cdc90-9a05-4f5c-bccd-2cb63b2b94d8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:24.946354 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fd9cdc90-9a05-4f5c-bccd-2cb63b2b94d8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1282 microversion: 2.1 time: 0.337923 Aug 09 17:08:24.951891 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 598/1118] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:24 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1282 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:25.287295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:25.288935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:25.313103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:25.319012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:25.320216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:25.321792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:25.326610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:25.333728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:25.939144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:25.971873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:25.979364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:25.987946 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c63cb00a-0aac-4cc5-b5c1-78672390127f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 0.701112 Aug 09 17:08:25.991243 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 599/1119] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:25 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:08:26.007432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d0d14369-0b4f-429b-9161-8d10753f132c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5d7430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:26.125256 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d0d14369-0b4f-429b-9161-8d10753f132c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.131474 Aug 09 17:08:26.135477 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 600/1120] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:25 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:26.155440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7940e7a4-79a9-4680-8d5f-0b60af741088 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:26.160557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7940e7a4-79a9-4680-8d5f-0b60af741088 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:26.182408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7940e7a4-79a9-4680-8d5f-0b60af741088 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:26.184799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7940e7a4-79a9-4680-8d5f-0b60af741088 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:26.188807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7940e7a4-79a9-4680-8d5f-0b60af741088 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:26.189350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7940e7a4-79a9-4680-8d5f-0b60af741088 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:26.190702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7940e7a4-79a9-4680-8d5f-0b60af741088 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:26.193136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7940e7a4-79a9-4680-8d5f-0b60af741088 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:26.584947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7940e7a4-79a9-4680-8d5f-0b60af741088 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:26.605435 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7940e7a4-79a9-4680-8d5f-0b60af741088 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1282 microversion: 2.1 time: 0.466002 Aug 09 17:08:26.609090 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 601/1121] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:26 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1282 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:26.833162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:08:26.833731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:08:26.834051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:08:26.834461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:08:26.834874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:08:26.856948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:26.857443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:26.857888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:26.858641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:26.868768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:26.869346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:26.965434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for project 7004f453a4d944239c4641bbc394ebb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:08:26.991892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Getting quotas for user 434e395144bc4443abb655a9d0a8b329 and project 7004f453a4d944239c4641bbc394ebb5. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:08:27.052909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:27.057040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:27.059611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:08:27.071940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:08:27.123510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:27.130868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:27.133757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:27.137219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:27.140564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:27.147784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:27.545883 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e8a362a-944b-4d12-8d5a-5b5211694ecd tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.881854 Aug 09 17:08:27.556310 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 521/1122] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:08:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:08:27.571053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cf4e3037-9bcf-40cd-bd7d-75911b8b1663 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb9389d0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:27.823082 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cf4e3037-9bcf-40cd-bd7d-75911b8b1663 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.265280 Aug 09 17:08:27.830522 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 522/1123] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:27 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:27.836539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c82963c3-0103-4194-9fe9-711cf0068dec tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:27.839779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c82963c3-0103-4194-9fe9-711cf0068dec tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:28.374617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c82963c3-0103-4194-9fe9-711cf0068dec tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:28.405335 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c82963c3-0103-4194-9fe9-711cf0068dec tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1213 microversion: 2.1 time: 0.572767 Aug 09 17:08:28.407656 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 523/1124] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:27 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1213 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:28.429968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6493a066-acca-4514-9780-f879d916862e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:28.443961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6493a066-acca-4514-9780-f879d916862e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:28.463117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6493a066-acca-4514-9780-f879d916862e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:28.469217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6493a066-acca-4514-9780-f879d916862e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:28.470402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6493a066-acca-4514-9780-f879d916862e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:28.472045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6493a066-acca-4514-9780-f879d916862e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:28.479347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6493a066-acca-4514-9780-f879d916862e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:28.480499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6493a066-acca-4514-9780-f879d916862e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:29.079122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6493a066-acca-4514-9780-f879d916862e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:29.124297 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6493a066-acca-4514-9780-f879d916862e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1282 microversion: 2.1 time: 0.713857 Aug 09 17:08:29.129288 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 524/1125] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:28 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1282 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:29.171392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e41ff23c-2ded-4f84-9ac0-4884217582e8 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbaf8430>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:29.380984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:29.421796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:29.440537 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e41ff23c-2ded-4f84-9ac0-4884217582e8 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.291839 Aug 09 17:08:29.455757 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 525/1126] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:29 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:29.457513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:29.474335 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dff20b53-da11-409c-b400-30c2f1f735b4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1567 microversion: 2.25 time: 2.430277 Aug 09 17:08:29.476108 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 602/1127] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:27 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1567 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:29.488979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e8216022-da07-43f5-8ea0-a01257762a11 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:29.490201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e8216022-da07-43f5-8ea0-a01257762a11 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:29.511716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8216022-da07-43f5-8ea0-a01257762a11 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:29.513441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8216022-da07-43f5-8ea0-a01257762a11 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:29.514708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8216022-da07-43f5-8ea0-a01257762a11 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:29.516356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8216022-da07-43f5-8ea0-a01257762a11 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:29.517506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8216022-da07-43f5-8ea0-a01257762a11 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:29.518831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8216022-da07-43f5-8ea0-a01257762a11 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:29.887978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-80dd5d08-4e9b-4c49-8ded-089ef491c6af tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:29.889956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-80dd5d08-4e9b-4c49-8ded-089ef491c6af tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:29.930176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dd5d08-4e9b-4c49-8ded-089ef491c6af tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:29.934417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dd5d08-4e9b-4c49-8ded-089ef491c6af tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:29.938648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dd5d08-4e9b-4c49-8ded-089ef491c6af tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:29.945442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dd5d08-4e9b-4c49-8ded-089ef491c6af tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:29.953333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dd5d08-4e9b-4c49-8ded-089ef491c6af tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:29.954141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dd5d08-4e9b-4c49-8ded-089ef491c6af tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:30.666653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e8216022-da07-43f5-8ea0-a01257762a11 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:30.729288 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e8216022-da07-43f5-8ea0-a01257762a11 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1265 microversion: 2.1 time: 1.279400 Aug 09 17:08:30.731251 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 526/1128] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:29 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1265 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:30.763735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-274d72f7-944b-4081-93c9-ecf3d2e6e805 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:30.775897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-274d72f7-944b-4081-93c9-ecf3d2e6e805 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:30.825836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-274d72f7-944b-4081-93c9-ecf3d2e6e805 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:30.834482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-274d72f7-944b-4081-93c9-ecf3d2e6e805 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:30.846404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-274d72f7-944b-4081-93c9-ecf3d2e6e805 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:30.850927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-274d72f7-944b-4081-93c9-ecf3d2e6e805 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:30.881888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-274d72f7-944b-4081-93c9-ecf3d2e6e805 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:30.884335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-274d72f7-944b-4081-93c9-ecf3d2e6e805 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:31.047543 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-80dd5d08-4e9b-4c49-8ded-089ef491c6af tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1813 microversion: 2.1 time: 1.162147 Aug 09 17:08:31.064493 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 603/1129] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:29 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1813 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:31.089892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-76cdc646-9451-4ab1-bed1-ce448b7f9860 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb6f5790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:31.231663 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-76cdc646-9451-4ab1-bed1-ce448b7f9860 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.164906 Aug 09 17:08:31.239391 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 604/1130] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:31 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:31.264879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:31.266824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:31.290311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:31.291009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:31.291877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:31.301144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:31.305830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:31.306959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:31.701436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:31.782600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:31.834981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:31.845284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:31.850375 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-18986727-0cf7-4455-b371-a2f9837c143b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1542 microversion: 2.25 time: 0.606429 Aug 09 17:08:31.851447 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 605/1131] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:31 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1542 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:31.860825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9f49fe14-d983-4069-8eb8-6a888e5c82af req-9a0462c5-2896-4604-804c-65c5f8d0faf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a07b5bb-7014-4708-a343-520f1b468a9c", "name": "network-vif-plugged", "status": "completed", "tag": "2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:31.924378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9f49fe14-d983-4069-8eb8-6a888e5c82af req-9a0462c5-2896-4604-804c-65c5f8d0faf9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:31.925299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9f49fe14-d983-4069-8eb8-6a888e5c82af req-9a0462c5-2896-4604-804c-65c5f8d0faf9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:31.926108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9f49fe14-d983-4069-8eb8-6a888e5c82af req-9a0462c5-2896-4604-804c-65c5f8d0faf9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:32.035108 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9f49fe14-d983-4069-8eb8-6a888e5c82af req-9a0462c5-2896-4604-804c-65c5f8d0faf9 service nova] Creating event network-vif-plugged:2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34 for instance 9a07b5bb-7014-4708-a343-520f1b468a9c on n-h1-845781-6 Aug 09 17:08:32.065156 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9f49fe14-d983-4069-8eb8-6a888e5c82af req-9a0462c5-2896-4604-804c-65c5f8d0faf9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209080 Aug 09 17:08:32.071598 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 606/1132] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:32.095445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-783a73cd-ceba-44ab-be9c-873bacde235e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:32.113963 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:08:32.113963 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:08:32.115560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a73cd-ceba-44ab-be9c-873bacde235e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:32.119453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a73cd-ceba-44ab-be9c-873bacde235e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:32.120129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a73cd-ceba-44ab-be9c-873bacde235e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:32.128088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a73cd-ceba-44ab-be9c-873bacde235e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:32.131050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a73cd-ceba-44ab-be9c-873bacde235e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:32.131558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a73cd-ceba-44ab-be9c-873bacde235e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:32.222900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-783a73cd-ceba-44ab-be9c-873bacde235e tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.146356 Aug 09 17:08:32.224904 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 607/1133] 10.222.0.93 () {58 vars in 1176 bytes} [Tue Aug 9 17:08:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:32.289638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c70dfc08-bb6c-4866-bad4-73efca645a19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:32.291005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c70dfc08-bb6c-4866-bad4-73efca645a19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:32.356719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c70dfc08-bb6c-4866-bad4-73efca645a19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:32.357587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c70dfc08-bb6c-4866-bad4-73efca645a19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:32.370822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c70dfc08-bb6c-4866-bad4-73efca645a19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:32.376381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c70dfc08-bb6c-4866-bad4-73efca645a19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:32.377133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c70dfc08-bb6c-4866-bad4-73efca645a19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:32.382989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c70dfc08-bb6c-4866-bad4-73efca645a19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:32.803413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c70dfc08-bb6c-4866-bad4-73efca645a19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:32.870683 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c70dfc08-bb6c-4866-bad4-73efca645a19 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1271 microversion: 2.1 time: 0.644240 Aug 09 17:08:32.877543 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 608/1134] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:32 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1271 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:32.914321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b22d982a-fc5d-491a-b420-ce5915fd7c66 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '.version_select at 0x7fbbcb5e4ca0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:32.931993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b22d982a-fc5d-491a-b420-ce5915fd7c66 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:32.933956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b22d982a-fc5d-491a-b420-ce5915fd7c66 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:32.945063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b22d982a-fc5d-491a-b420-ce5915fd7c66 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:32.999011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:33.038478 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b22d982a-fc5d-491a-b420-ce5915fd7c66 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 2963 microversion: 2.25 time: 0.148134 Aug 09 17:08:33.040664 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 609/1135] 10.222.0.93 () {60 vars in 1184 bytes} [Tue Aug 9 17:08:32 2022] GET /compute/v2.1/os-migrations => generated 2963 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:33.075958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-841f3ae6-1afc-436a-9f1c-fdd51f556de1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5cd160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:33.260641 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-841f3ae6-1afc-436a-9f1c-fdd51f556de1 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.208807 Aug 09 17:08:33.266302 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 610/1136] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:33 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:33.284050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-420fb5e7-76e1-4798-9623-3b24c72530be tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:33.302392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-420fb5e7-76e1-4798-9623-3b24c72530be tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:33.383542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420fb5e7-76e1-4798-9623-3b24c72530be tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:33.385276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420fb5e7-76e1-4798-9623-3b24c72530be tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:33.388999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420fb5e7-76e1-4798-9623-3b24c72530be tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:33.396221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420fb5e7-76e1-4798-9623-3b24c72530be tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:33.412475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420fb5e7-76e1-4798-9623-3b24c72530be tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:33.421718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-420fb5e7-76e1-4798-9623-3b24c72530be tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:34.091172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-274d72f7-944b-4081-93c9-ecf3d2e6e805 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:34.119421 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-274d72f7-944b-4081-93c9-ecf3d2e6e805 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1324 microversion: 2.1 time: 3.384189 Aug 09 17:08:34.138030 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 527/1137] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:30 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1324 bytes in 3405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:34.156989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d4946315-ce7e-4a7a-853c-12c7c9efb553 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:34.169462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d4946315-ce7e-4a7a-853c-12c7c9efb553 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:34.213683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4946315-ce7e-4a7a-853c-12c7c9efb553 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:34.214612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4946315-ce7e-4a7a-853c-12c7c9efb553 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:34.215441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4946315-ce7e-4a7a-853c-12c7c9efb553 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:34.216842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4946315-ce7e-4a7a-853c-12c7c9efb553 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:34.224566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4946315-ce7e-4a7a-853c-12c7c9efb553 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:34.225976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4946315-ce7e-4a7a-853c-12c7c9efb553 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:34.336643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-420fb5e7-76e1-4798-9623-3b24c72530be tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid e2c3e188-8990-4500-ab50-91d07d799686 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:08:34.410283 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-420fb5e7-76e1-4798-9623-3b24c72530be tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 2034 microversion: 2.25 time: 1.142438 Aug 09 17:08:34.417570 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 611/1138] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:33 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 2034 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:34.460709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-72bfbc8f-e27c-45f6-bd29-3c724fe52dad tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5b7700>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:34.634683 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-72bfbc8f-e27c-45f6-bd29-3c724fe52dad tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.190728 Aug 09 17:08:34.638863 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 612/1139] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:34 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:34.675584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-58d1f729-6f1f-42e8-8978-ab2e222f713e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Action: 'create', calling method: .version_select at 0x7fbbcb6809d0>, body: {"keypair": {"name": "tempest-keypair-343264877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyMG9X7671FijcpIA4XMkU+OeFrBTvPstKCRqjCBFt6qFPTnhYGtxNfGayKloEwyirLDFNr3k2PGKkrJTUuuJHaVeCQ+DuSUPCvb+DeN2+ZvhbXc1PoUwESNUPqHWdB9g=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:34.788160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d4946315-ce7e-4a7a-853c-12c7c9efb553 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:34.809752 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d4946315-ce7e-4a7a-853c-12c7c9efb553 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1271 microversion: 2.1 time: 0.668929 Aug 09 17:08:34.831932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-58d1f729-6f1f-42e8-8978-ab2e222f713e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Getting quotas for project 47793440cab647cc943281e2bc566c7f. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:08:34.832239 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 528/1140] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:34 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1271 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:34.866743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-58d1f729-6f1f-42e8-8978-ab2e222f713e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Getting quotas for user 27626b9d13c340cc9ec2fe564d1bab8d and project 47793440cab647cc943281e2bc566c7f. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:08:34.966775 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-58d1f729-6f1f-42e8-8978-ab2e222f713e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.303761 Aug 09 17:08:34.979904 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 613/1141] 10.222.0.93 () {62 vars in 1200 bytes} [Tue Aug 9 17:08:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 337 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 17:08:35.146358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-184038aa-af18-4116-80c5-23f06b8bf389 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:35.147960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-184038aa-af18-4116-80c5-23f06b8bf389 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:35.167893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184038aa-af18-4116-80c5-23f06b8bf389 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:35.177997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184038aa-af18-4116-80c5-23f06b8bf389 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:35.186392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184038aa-af18-4116-80c5-23f06b8bf389 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:35.189202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184038aa-af18-4116-80c5-23f06b8bf389 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:35.192968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184038aa-af18-4116-80c5-23f06b8bf389 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:35.193824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184038aa-af18-4116-80c5-23f06b8bf389 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:35.656032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9be69515-9241-49ec-a952-26fe32edd2fb tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5e4a60>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:35.670196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-184038aa-af18-4116-80c5-23f06b8bf389 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:35.681048 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-184038aa-af18-4116-80c5-23f06b8bf389 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1324 microversion: 2.1 time: 0.539213 Aug 09 17:08:35.688132 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 529/1142] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:35 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1324 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:35.768404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9be69515-9241-49ec-a952-26fe32edd2fb tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.113516 Aug 09 17:08:35.777944 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 614/1143] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:35 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:35.838189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f8efa24e-658f-4505-838e-ece679ea00e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:35.842861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f8efa24e-658f-4505-838e-ece679ea00e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:35.853261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8efa24e-658f-4505-838e-ece679ea00e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:35.856802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8efa24e-658f-4505-838e-ece679ea00e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:35.858635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8efa24e-658f-4505-838e-ece679ea00e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:35.860913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8efa24e-658f-4505-838e-ece679ea00e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:35.865590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8efa24e-658f-4505-838e-ece679ea00e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:35.867106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8efa24e-658f-4505-838e-ece679ea00e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:36.102856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f8efa24e-658f-4505-838e-ece679ea00e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:36.130440 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f8efa24e-658f-4505-838e-ece679ea00e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1271 microversion: 2.1 time: 0.296879 Aug 09 17:08:36.131991 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 530/1144] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:35 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1271 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:36.712388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b5206cb4-6456-4706-b267-e5a71d4cead5 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:36.713699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b5206cb4-6456-4706-b267-e5a71d4cead5 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:36.738290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5206cb4-6456-4706-b267-e5a71d4cead5 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:36.745506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5206cb4-6456-4706-b267-e5a71d4cead5 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:36.748953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5206cb4-6456-4706-b267-e5a71d4cead5 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:36.757474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5206cb4-6456-4706-b267-e5a71d4cead5 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:36.764167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5206cb4-6456-4706-b267-e5a71d4cead5 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:36.764967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5206cb4-6456-4706-b267-e5a71d4cead5 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:36.785105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-983b89be-8b7c-4812-a3b5-f376a04241f3 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb96cb80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:36.945413 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-983b89be-8b7c-4812-a3b5-f376a04241f3 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.164393 Aug 09 17:08:36.954980 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 531/1145] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:36 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:37.152115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-633bfcf7-be2c-4831-9c5e-49298e55b161 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:37.153460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-633bfcf7-be2c-4831-9c5e-49298e55b161 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:37.156817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:37.179416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-633bfcf7-be2c-4831-9c5e-49298e55b161 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:37.181912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-633bfcf7-be2c-4831-9c5e-49298e55b161 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:37.183382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-633bfcf7-be2c-4831-9c5e-49298e55b161 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:37.190182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-633bfcf7-be2c-4831-9c5e-49298e55b161 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:37.191952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-633bfcf7-be2c-4831-9c5e-49298e55b161 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:37.194737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-633bfcf7-be2c-4831-9c5e-49298e55b161 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:37.626294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-633bfcf7-be2c-4831-9c5e-49298e55b161 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:37.648910 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-633bfcf7-be2c-4831-9c5e-49298e55b161 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1271 microversion: 2.1 time: 0.500499 Aug 09 17:08:37.650176 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 532/1146] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:37 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1271 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:37.826679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b5206cb4-6456-4706-b267-e5a71d4cead5 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:37.839919 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b5206cb4-6456-4706-b267-e5a71d4cead5 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1324 microversion: 2.1 time: 1.135385 Aug 09 17:08:37.868132 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 615/1147] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:36 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1324 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:37.972577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-061f5e58-0f22-4969-8337-d42175fc4034 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb91ef70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:38.252175 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-061f5e58-0f22-4969-8337-d42175fc4034 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.283433 Aug 09 17:08:38.253378 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 533/1148] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:37 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:38.858065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=16 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:38.863960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4a43833e-85e4-48f5-a0df-3f6ae69c5203 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:38.864691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4a43833e-85e4-48f5-a0df-3f6ae69c5203 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:38.901194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a43833e-85e4-48f5-a0df-3f6ae69c5203 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:38.901703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a43833e-85e4-48f5-a0df-3f6ae69c5203 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:38.910426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a43833e-85e4-48f5-a0df-3f6ae69c5203 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:38.913534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a43833e-85e4-48f5-a0df-3f6ae69c5203 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:38.917110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a43833e-85e4-48f5-a0df-3f6ae69c5203 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:38.918979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a43833e-85e4-48f5-a0df-3f6ae69c5203 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:39.286345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1aba578d-eac4-40d7-9d83-c804d22404b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:39.299059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1aba578d-eac4-40d7-9d83-c804d22404b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:39.350112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1aba578d-eac4-40d7-9d83-c804d22404b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:39.351604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1aba578d-eac4-40d7-9d83-c804d22404b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:39.352788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1aba578d-eac4-40d7-9d83-c804d22404b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:39.354458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1aba578d-eac4-40d7-9d83-c804d22404b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:39.355583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1aba578d-eac4-40d7-9d83-c804d22404b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:39.356671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1aba578d-eac4-40d7-9d83-c804d22404b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:40.423555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1aba578d-eac4-40d7-9d83-c804d22404b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:40.444451 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1aba578d-eac4-40d7-9d83-c804d22404b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1313 microversion: 2.1 time: 1.759566 Aug 09 17:08:40.445841 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 616/1149] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:38 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1313 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:40.465561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6154444e-4892-449d-b136-42d8beb6c43c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb595c10>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:40.621386 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6154444e-4892-449d-b136-42d8beb6c43c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.174118 Aug 09 17:08:40.622210 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 617/1150] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:40 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:40.640571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d29c338-63e2-4798-91a6-7a69be9acd38 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c53da91-4688-4de8-afb9-a0d8e2489a02", "device": "/dev/xvdb"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:40.656147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9d29c338-63e2-4798-91a6-7a69be9acd38 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:40.685689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d29c338-63e2-4798-91a6-7a69be9acd38 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:40.686306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d29c338-63e2-4798-91a6-7a69be9acd38 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:40.686765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d29c338-63e2-4798-91a6-7a69be9acd38 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:40.687517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d29c338-63e2-4798-91a6-7a69be9acd38 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:40.688012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d29c338-63e2-4798-91a6-7a69be9acd38 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:40.688439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d29c338-63e2-4798-91a6-7a69be9acd38 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:40.697083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4a43833e-85e4-48f5-a0df-3f6ae69c5203 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:40.700571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=81 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:40.715436 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4a43833e-85e4-48f5-a0df-3f6ae69c5203 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1324 microversion: 2.1 time: 1.853165 Aug 09 17:08:40.717082 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 534/1151] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:38 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1324 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:41.341950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-7faf67ff-bd4e-419e-87b6-c43c43058f70 req-370f8288-3be8-4968-b304-89d0583f1910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d4494b3-976f-4185-936c-52c1ba795d41", "tag": "8dd9f845-7b2b-4c86-856a-d0c2faf3c649"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:41.364643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7faf67ff-bd4e-419e-87b6-c43c43058f70 req-370f8288-3be8-4968-b304-89d0583f1910 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:41.372623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7faf67ff-bd4e-419e-87b6-c43c43058f70 req-370f8288-3be8-4968-b304-89d0583f1910 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:41.373498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7faf67ff-bd4e-419e-87b6-c43c43058f70 req-370f8288-3be8-4968-b304-89d0583f1910 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:41.405162 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-7faf67ff-bd4e-419e-87b6-c43c43058f70 req-370f8288-3be8-4968-b304-89d0583f1910 service nova] Creating event network-changed:8dd9f845-7b2b-4c86-856a-d0c2faf3c649 for instance 7d4494b3-976f-4185-936c-52c1ba795d41 on n-h1-845781-6 Aug 09 17:08:41.417554 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-7faf67ff-bd4e-419e-87b6-c43c43058f70 req-370f8288-3be8-4968-b304-89d0583f1910 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222183 Aug 09 17:08:41.423355 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 535/1152] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:41.479576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-180c814e-eb25-4bd6-b225-0feff3f63f82 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:41.481002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-180c814e-eb25-4bd6-b225-0feff3f63f82 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:41.491199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-180c814e-eb25-4bd6-b225-0feff3f63f82 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:41.494938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-180c814e-eb25-4bd6-b225-0feff3f63f82 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:41.500883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-180c814e-eb25-4bd6-b225-0feff3f63f82 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:41.502928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-180c814e-eb25-4bd6-b225-0feff3f63f82 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:41.503810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-180c814e-eb25-4bd6-b225-0feff3f63f82 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:41.504614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-180c814e-eb25-4bd6-b225-0feff3f63f82 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:41.906110 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9d29c338-63e2-4798-91a6-7a69be9acd38 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "POST /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.281967 Aug 09 17:08:41.916526 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 618/1153] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:08:40 2022] POST /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments => generated 194 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:41.985200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ff40748-2425-4316-ac4d-fa33b2605f3a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb50a4c0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:42.168931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:42.224151 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ff40748-2425-4316-ac4d-fa33b2605f3a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.278257 Aug 09 17:08:42.225274 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 619/1154] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:41 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:42.251283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1ecf7452-acba-4d0c-a6f6-ed3698194374 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:42.252636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1ecf7452-acba-4d0c-a6f6-ed3698194374 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:42.331311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ecf7452-acba-4d0c-a6f6-ed3698194374 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:42.334123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ecf7452-acba-4d0c-a6f6-ed3698194374 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:42.338582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ecf7452-acba-4d0c-a6f6-ed3698194374 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:42.342329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ecf7452-acba-4d0c-a6f6-ed3698194374 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:42.343138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ecf7452-acba-4d0c-a6f6-ed3698194374 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:42.344476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ecf7452-acba-4d0c-a6f6-ed3698194374 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:43.494157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-180c814e-eb25-4bd6-b225-0feff3f63f82 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:43.533589 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-180c814e-eb25-4bd6-b225-0feff3f63f82 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1313 microversion: 2.1 time: 2.058374 Aug 09 17:08:43.544186 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 536/1155] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:41 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1313 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:43.556948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-03741908-1b97-49d2-bbbc-062152ad292a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbaf8430>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:43.733543 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-03741908-1b97-49d2-bbbc-062152ad292a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.186749 Aug 09 17:08:43.735058 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 537/1156] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:43 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:43.866487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1ecf7452-acba-4d0c-a6f6-ed3698194374 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:43.902916 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1ecf7452-acba-4d0c-a6f6-ed3698194374 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1324 microversion: 2.1 time: 1.663749 Aug 09 17:08:43.904862 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 620/1157] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:42 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1324 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:44.565770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f24222ce-baaf-4688-a276-7efcbc03e783 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:44.566405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f24222ce-baaf-4688-a276-7efcbc03e783 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:44.613538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f24222ce-baaf-4688-a276-7efcbc03e783 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:44.613538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f24222ce-baaf-4688-a276-7efcbc03e783 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:44.613538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f24222ce-baaf-4688-a276-7efcbc03e783 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:44.613538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f24222ce-baaf-4688-a276-7efcbc03e783 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:44.614055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f24222ce-baaf-4688-a276-7efcbc03e783 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:44.614055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f24222ce-baaf-4688-a276-7efcbc03e783 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:44.894850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:44.921453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af9e7696-447b-4a59-99a1-6593520a4241 tempest-FloatingIPDetailsNegativeTestJSON-1651698616 tempest-FloatingIPDetailsNegativeTestJSON-1651698616-project] Calling method '.version_select at 0x7fbbcb7ad3a0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:45.146461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG neutronclient.v2_0.client [None req-af9e7696-447b-4a59-99a1-6593520a4241 tempest-FloatingIPDetailsNegativeTestJSON-1651698616 tempest-FloatingIPDetailsNegativeTestJSON-1651698616-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 67fde643-5ac8-49b4-b84e-679b05925aa1 could not be found", "detail": ""}} {{(pid=119431) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:08:45.147178 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-af9e7696-447b-4a59-99a1-6593520a4241 tempest-FloatingIPDetailsNegativeTestJSON-1651698616 tempest-FloatingIPDetailsNegativeTestJSON-1651698616-project] HTTP exception thrown: Floating IP not found for ID 67fde643-5ac8-49b4-b84e-679b05925aa1 Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af9e7696-447b-4a59-99a1-6593520a4241 tempest-FloatingIPDetailsNegativeTestJSON-1651698616 tempest-FloatingIPDetailsNegativeTestJSON-1651698616-project] Request method failure captured: Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-floating-ips/67fde643-5ac8-49b4-b84e-679b05925aa1 HTTP/1.1 Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pScrbz_dP9S3_jHO0oT44-40LudRtk-JyAXZNl9Se6GP-TMus_r32nId0tcD1BB4KtoWHo3TUfWkDflUlz9TymCopCyceMQNuF1ID2DuFIFlfsDk91cHArLV-l6udkY_al0FYe2RL2bFqZrBwtkIpi-eoYG15Pa4doKSm6Qzp-qF-0 Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: b72b23acf4af4c8bb257bb57bc9dff75 Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1651698616 Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:08:45.149782 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b72b23acf4af4c8bb257bb57bc9dff75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b72b23acf4af4c8bb257bb57bc9dff75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b72b23acf4af4c8bb257bb57bc9dff75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b72b23acf4af4c8bb257bb57bc9dff75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1651698616 Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: b72b23acf4af4c8bb257bb57bc9dff75 Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1651698616 Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1651698616-project Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ce7742bd9f1f487fb07b3fab307bd356 Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1651698616-project Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: exception: Floating IP not found for ID 67fde643-5ac8-49b4-b84e-679b05925aa1 Aug 09 17:08:45.151604 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '67fde643-5ac8-49b4-b84e-679b05925aa1'} Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:08:45.152866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 67fde643-5ac8-49b4-b84e-679b05925aa1 could not be found Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f01661a3-7953-4891-8caa-79427c8a175a'] Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 67fde643-5ac8-49b4-b84e-679b05925aa1. Aug 09 17:08:45.154360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 67fde643-5ac8-49b4-b84e-679b05925aa1 Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:08:45.155847 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:08:45.158976 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:08:45.158976 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 67fde643-5ac8-49b4-b84e-679b05925aa1 Aug 09 17:08:45.158976 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:08:45.158976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af9e7696-447b-4a59-99a1-6593520a4241 tempest-FloatingIPDetailsNegativeTestJSON-1651698616 tempest-FloatingIPDetailsNegativeTestJSON-1651698616-project] Returning 404 to user: Floating IP not found for ID 67fde643-5ac8-49b4-b84e-679b05925aa1 {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:08:45.158976 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-af9e7696-447b-4a59-99a1-6593520a4241 tempest-FloatingIPDetailsNegativeTestJSON-1651698616 tempest-FloatingIPDetailsNegativeTestJSON-1651698616-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/67fde643-5ac8-49b4-b84e-679b05925aa1" status: 404 len: 111 microversion: 2.1 time: 0.448526 Aug 09 17:08:45.158976 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 621/1158] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 17:08:44 2022] GET /compute/v2.1/os-floating-ips/67fde643-5ac8-49b4-b84e-679b05925aa1 => generated 111 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:08:45.170067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1790871737", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "58c9a4df-a052-4259-baba-4eb50282dd0b"}], "security_groups": [{"name": "tempest-securitygroup--166552294"}], "key_name": "tempest-keypair-343264877", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:45.711433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] validate_networks() for [('58c9a4df-a052-4259-baba-4eb50282dd0b', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:08:47.082676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f24222ce-baaf-4688-a276-7efcbc03e783 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:47.146843 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f24222ce-baaf-4688-a276-7efcbc03e783 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1313 microversion: 2.1 time: 2.585668 Aug 09 17:08:47.149044 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 538/1159] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:44 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1313 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:47.174579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dfffed14-daf7-45af-8ed8-b7d129754132 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb91edc0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:47.325626 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dfffed14-daf7-45af-8ed8-b7d129754132 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1413 microversion: 2.1 time: 0.166060 Aug 09 17:08:47.328297 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 539/1160] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:47 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1413 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:47.371288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-62288f6c-4cdb-4970-8f02-a3f16d1e11a7 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:47.383903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-62288f6c-4cdb-4970-8f02-a3f16d1e11a7 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:47.444873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62288f6c-4cdb-4970-8f02-a3f16d1e11a7 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:47.447473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62288f6c-4cdb-4970-8f02-a3f16d1e11a7 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:47.448211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62288f6c-4cdb-4970-8f02-a3f16d1e11a7 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:47.451925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62288f6c-4cdb-4970-8f02-a3f16d1e11a7 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:47.452504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62288f6c-4cdb-4970-8f02-a3f16d1e11a7 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:47.453016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62288f6c-4cdb-4970-8f02-a3f16d1e11a7 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:50.002261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:08:50.003129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:08:50.004035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:08:50.006216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:08:50.006999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:08:50.032405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-62288f6c-4cdb-4970-8f02-a3f16d1e11a7 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:50.037842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:50.045143 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-62288f6c-4cdb-4970-8f02-a3f16d1e11a7 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1324 microversion: 2.1 time: 2.713407 Aug 09 17:08:50.045740 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 540/1161] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:47 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1324 bytes in 2717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:50.067710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e2d90ebc-ef09-4819-940e-fae949fda1e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:50.068962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e2d90ebc-ef09-4819-940e-fae949fda1e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:50.074405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:50.087193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:50.088659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:50.092846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:50.094132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:50.098788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:50.113281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2d90ebc-ef09-4819-940e-fae949fda1e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:50.114296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2d90ebc-ef09-4819-940e-fae949fda1e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:50.115204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2d90ebc-ef09-4819-940e-fae949fda1e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:50.128985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2d90ebc-ef09-4819-940e-fae949fda1e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:50.130644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2d90ebc-ef09-4819-940e-fae949fda1e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:50.131461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2d90ebc-ef09-4819-940e-fae949fda1e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:50.148464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Getting quotas for project 47793440cab647cc943281e2bc566c7f. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:08:50.156153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Getting quotas for user 27626b9d13c340cc9ec2fe564d1bab8d and project 47793440cab647cc943281e2bc566c7f. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:08:50.193504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:08:50.197358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:08:50.298356 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8ed152ba-8bc6-4302-864f-067822791604 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 5.143353 Aug 09 17:08:50.306657 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 622/1162] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:08:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 5152 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:08:50.312698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a795e8e9-4c07-474d-a83e-3ea1e318f1e8 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb578a60>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:50.428105 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a795e8e9-4c07-474d-a83e-3ea1e318f1e8 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1422 microversion: 2.1 time: 0.119726 Aug 09 17:08:50.429565 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 623/1163] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:50 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:50.447266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0f2b7e75-e5ef-41f8-8f79-9c16cf7fe693 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:50.449522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0f2b7e75-e5ef-41f8-8f79-9c16cf7fe693 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:50.953411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0f2b7e75-e5ef-41f8-8f79-9c16cf7fe693 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:51.006800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0f2b7e75-e5ef-41f8-8f79-9c16cf7fe693 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:51.009585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0f2b7e75-e5ef-41f8-8f79-9c16cf7fe693 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:51.018432 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0f2b7e75-e5ef-41f8-8f79-9c16cf7fe693 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1285 microversion: 2.25 time: 0.576761 Aug 09 17:08:51.048540 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 624/1164] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:50 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1285 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:51.066062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4c42a801-1b44-4559-9edc-8b16da15c116 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5e43a0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:51.245313 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4c42a801-1b44-4559-9edc-8b16da15c116 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 200 len: 1422 microversion: 2.1 time: 0.194901 Aug 09 17:08:51.245921 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 625/1165] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:08:51 2022] GET /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 1422 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:51.318031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3ca08427-5cb3-4334-9918-66aec781aa18 req-36de90bc-aece-4ea0-8824-1065188a554f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c388a7-598a-45ed-b478-0d6637f4e01c", "tag": "d78a88ee-1bff-414f-892a-1adc2ebee7fc"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:51.387171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ca08427-5cb3-4334-9918-66aec781aa18 req-36de90bc-aece-4ea0-8824-1065188a554f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:51.389393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ca08427-5cb3-4334-9918-66aec781aa18 req-36de90bc-aece-4ea0-8824-1065188a554f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:51.393666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ca08427-5cb3-4334-9918-66aec781aa18 req-36de90bc-aece-4ea0-8824-1065188a554f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:51.474091 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3ca08427-5cb3-4334-9918-66aec781aa18 req-36de90bc-aece-4ea0-8824-1065188a554f service nova] Creating event network-changed:d78a88ee-1bff-414f-892a-1adc2ebee7fc for instance 32c388a7-598a-45ed-b478-0d6637f4e01c on n-h2-845781-6 Aug 09 17:08:51.497373 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3ca08427-5cb3-4334-9918-66aec781aa18 req-36de90bc-aece-4ea0-8824-1065188a554f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223641 Aug 09 17:08:51.499121 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 626/1166] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:51.525270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ff418a4-16b8-4c46-b574-81143187002a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:51.526765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7ff418a4-16b8-4c46-b574-81143187002a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:51.554038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff418a4-16b8-4c46-b574-81143187002a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:51.554944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff418a4-16b8-4c46-b574-81143187002a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:51.556016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff418a4-16b8-4c46-b574-81143187002a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:51.557510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff418a4-16b8-4c46-b574-81143187002a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:51.564427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff418a4-16b8-4c46-b574-81143187002a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:51.565437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff418a4-16b8-4c46-b574-81143187002a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:52.074199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e2d90ebc-ef09-4819-940e-fae949fda1e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:52.091955 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e2d90ebc-ef09-4819-940e-fae949fda1e1 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1313 microversion: 2.1 time: 2.041290 Aug 09 17:08:52.094793 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 541/1167] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:50 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1313 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:52.104500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-03475a94-9f4a-4d7e-9cc0-b34ec9b35469 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb91ef70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:52.361704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7ff418a4-16b8-4c46-b574-81143187002a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:52.389979 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ff418a4-16b8-4c46-b574-81143187002a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1324 microversion: 2.1 time: 0.885435 Aug 09 17:08:52.393509 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 627/1168] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:51 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1324 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:52.417364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:52.421698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:52.441284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:52.444103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:52.444768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:52.445990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:52.446645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:52.447247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:52.586057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:52.625892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:52.648471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:52.650251 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f0d1a7be-4495-4f9a-a331-065d279ad782 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1337 microversion: 2.25 time: 0.254414 Aug 09 17:08:52.656081 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 628/1169] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:52 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1337 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:53.117745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3f3c341d-d7f7-4f02-b32a-1d8fc3bf4129 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:53.118363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3f3c341d-d7f7-4f02-b32a-1d8fc3bf4129 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:53.132838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f3c341d-d7f7-4f02-b32a-1d8fc3bf4129 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:53.142805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f3c341d-d7f7-4f02-b32a-1d8fc3bf4129 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:53.143279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f3c341d-d7f7-4f02-b32a-1d8fc3bf4129 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:53.147077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f3c341d-d7f7-4f02-b32a-1d8fc3bf4129 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:53.147959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f3c341d-d7f7-4f02-b32a-1d8fc3bf4129 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:53.148576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f3c341d-d7f7-4f02-b32a-1d8fc3bf4129 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:53.727709 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-03475a94-9f4a-4d7e-9cc0-b34ec9b35469 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 204 len: 0 microversion: 2.1 time: 1.630268 Aug 09 17:08:53.728940 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 542/1170] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:52 2022] DELETE /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 0 bytes in 1632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:08:53.737724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8dfe4549-9c36-4e15-b62f-858cb2bc8ab4 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:53.745227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8dfe4549-9c36-4e15-b62f-858cb2bc8ab4 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:53.764408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:08:53.768851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dfe4549-9c36-4e15-b62f-858cb2bc8ab4 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:53.771350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dfe4549-9c36-4e15-b62f-858cb2bc8ab4 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:53.784929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dfe4549-9c36-4e15-b62f-858cb2bc8ab4 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:53.787332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dfe4549-9c36-4e15-b62f-858cb2bc8ab4 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:53.789296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dfe4549-9c36-4e15-b62f-858cb2bc8ab4 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:53.790360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dfe4549-9c36-4e15-b62f-858cb2bc8ab4 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:54.088367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f3c341d-d7f7-4f02-b32a-1d8fc3bf4129 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:54.120100 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3f3c341d-d7f7-4f02-b32a-1d8fc3bf4129 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1313 microversion: 2.1 time: 1.006190 Aug 09 17:08:54.143039 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 629/1171] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:53 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1313 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:08:54.181940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:54.188511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:54.213189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:54.217665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:54.222032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:54.225069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:54.228545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:54.232607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:54.432097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:54.460611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:54.470855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:54.491225 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-64c0b425-9481-4921-9462-fb8e926267fe tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1343 microversion: 2.25 time: 0.332017 Aug 09 17:08:54.495825 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 630/1172] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:54 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1343 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:54.513281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6de41b3f-a7be-4d50-9cab-708296a0c888 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:54.516958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6de41b3f-a7be-4d50-9cab-708296a0c888 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:54.544080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6de41b3f-a7be-4d50-9cab-708296a0c888 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:54.551422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6de41b3f-a7be-4d50-9cab-708296a0c888 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:54.552966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6de41b3f-a7be-4d50-9cab-708296a0c888 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:54.556034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6de41b3f-a7be-4d50-9cab-708296a0c888 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:54.560806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6de41b3f-a7be-4d50-9cab-708296a0c888 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:54.563075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6de41b3f-a7be-4d50-9cab-708296a0c888 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:54.639757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6de41b3f-a7be-4d50-9cab-708296a0c888 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:08:54.793193 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6de41b3f-a7be-4d50-9cab-708296a0c888 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 204 len: 0 microversion: 2.1 time: 0.295014 Aug 09 17:08:54.794178 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 631/1173] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:08:54 2022] DELETE /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:08:54.988166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-afefd00c-a871-4994-b8f0-b3629641c6c4 req-b520338b-2870-4f9d-b5db-bd73a93938dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417d9361-7e22-4e97-a3a9-acd1f3a91e46", "name": "network-vif-unplugged", "status": "completed", "tag": "ce57d96c-a257-41a4-a475-4abfa4213f53"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:55.028961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-afefd00c-a871-4994-b8f0-b3629641c6c4 req-b520338b-2870-4f9d-b5db-bd73a93938dd service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:55.038945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-afefd00c-a871-4994-b8f0-b3629641c6c4 req-b520338b-2870-4f9d-b5db-bd73a93938dd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:55.039972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-afefd00c-a871-4994-b8f0-b3629641c6c4 req-b520338b-2870-4f9d-b5db-bd73a93938dd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:55.094811 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-afefd00c-a871-4994-b8f0-b3629641c6c4 req-b520338b-2870-4f9d-b5db-bd73a93938dd service nova] Creating event network-vif-unplugged:ce57d96c-a257-41a4-a475-4abfa4213f53 for instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 on n-h2-845781-6 Aug 09 17:08:55.104964 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-afefd00c-a871-4994-b8f0-b3629641c6c4 req-b520338b-2870-4f9d-b5db-bd73a93938dd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.308821 Aug 09 17:08:55.107332 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 632/1174] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:55.118176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1517349358", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "7caaa633-fae8-4684-9370-5a4c1e16c284"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:55.219303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] validate_networks() for [('7caaa633-fae8-4684-9370-5a4c1e16c284', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:08:55.745682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8dfe4549-9c36-4e15-b62f-858cb2bc8ab4 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:55.778708 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8dfe4549-9c36-4e15-b62f-858cb2bc8ab4 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1324 microversion: 2.1 time: 2.047640 Aug 09 17:08:55.794566 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 543/1175] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:53 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1324 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:55.828368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72053959-c575-4f03-b76a-6e4322a87374 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:55.829467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-72053959-c575-4f03-b76a-6e4322a87374 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:55.843298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72053959-c575-4f03-b76a-6e4322a87374 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:55.844404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72053959-c575-4f03-b76a-6e4322a87374 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:55.845491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72053959-c575-4f03-b76a-6e4322a87374 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:55.847126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72053959-c575-4f03-b76a-6e4322a87374 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:55.850115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72053959-c575-4f03-b76a-6e4322a87374 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:55.856102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72053959-c575-4f03-b76a-6e4322a87374 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:56.967802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-72053959-c575-4f03-b76a-6e4322a87374 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:57.008070 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72053959-c575-4f03-b76a-6e4322a87374 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1313 microversion: 2.1 time: 1.193420 Aug 09 17:08:57.011195 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 544/1176] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:55 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1313 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:57.033473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:57.038983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:57.069100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:57.069100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:57.069100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:57.069100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:57.069718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:57.069718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:57.750573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:08:57.753096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:08:57.754460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:08:57.755557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:08:57.761543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:08:57.807948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:57.809843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:57.812692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:57.818058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:57.818557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:57.819004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:57.851058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:57.862969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Getting quotas for project 055af8e9fb964ff19213eb1b419b56cd. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:08:57.874998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Getting quotas for user 1ac722a34673411e9280ba901999b0c3 and project 055af8e9fb964ff19213eb1b419b56cd. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:08:57.876619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:57.881896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:57.884231 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b3439e82-c6bd-42b3-b111-4b9594177c24 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1410 microversion: 2.25 time: 0.864259 Aug 09 17:08:57.887767 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 545/1177] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:57 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1410 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:08:57.903615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-36deb442-bb08-467a-9aa0-e94f1d9731e6 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:57.918408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-36deb442-bb08-467a-9aa0-e94f1d9731e6 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:57.924973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:08:57.935829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:08:57.942274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36deb442-bb08-467a-9aa0-e94f1d9731e6 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:57.945600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36deb442-bb08-467a-9aa0-e94f1d9731e6 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:57.946573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36deb442-bb08-467a-9aa0-e94f1d9731e6 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:57.947934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36deb442-bb08-467a-9aa0-e94f1d9731e6 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:57.948869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36deb442-bb08-467a-9aa0-e94f1d9731e6 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:57.955895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36deb442-bb08-467a-9aa0-e94f1d9731e6 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:58.051727 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f4d425bf-386b-4fb5-a9fd-2b9d9a0737d4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.941739 Aug 09 17:08:58.053502 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 633/1178] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:08:58.064595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-632953cf-2bd1-43d2-9582-1e905981f3da req-4d3d8a25-5813-4a27-a283-3e225c042d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4494b3-976f-4185-936c-52c1ba795d41", "name": "network-vif-plugged", "status": "completed", "tag": "8dd9f845-7b2b-4c86-856a-d0c2faf3c649"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:08:58.102926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-632953cf-2bd1-43d2-9582-1e905981f3da req-4d3d8a25-5813-4a27-a283-3e225c042d6a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:58.105378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-632953cf-2bd1-43d2-9582-1e905981f3da req-4d3d8a25-5813-4a27-a283-3e225c042d6a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:58.105963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-632953cf-2bd1-43d2-9582-1e905981f3da req-4d3d8a25-5813-4a27-a283-3e225c042d6a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:58.148375 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-632953cf-2bd1-43d2-9582-1e905981f3da req-4d3d8a25-5813-4a27-a283-3e225c042d6a service nova] Creating event network-vif-plugged:8dd9f845-7b2b-4c86-856a-d0c2faf3c649 for instance 7d4494b3-976f-4185-936c-52c1ba795d41 on n-h1-845781-6 Aug 09 17:08:58.173786 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-632953cf-2bd1-43d2-9582-1e905981f3da req-4d3d8a25-5813-4a27-a283-3e225c042d6a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107540 Aug 09 17:08:58.175441 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 634/1179] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:08:58.182309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0243adc1-5e8d-4f87-814f-968276c5c0ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:58.183793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0243adc1-5e8d-4f87-814f-968276c5c0ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:58.203160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0243adc1-5e8d-4f87-814f-968276c5c0ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:58.204319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0243adc1-5e8d-4f87-814f-968276c5c0ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:58.205039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0243adc1-5e8d-4f87-814f-968276c5c0ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:58.206189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0243adc1-5e8d-4f87-814f-968276c5c0ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:58.211981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0243adc1-5e8d-4f87-814f-968276c5c0ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:58.213091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0243adc1-5e8d-4f87-814f-968276c5c0ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:58.852662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0243adc1-5e8d-4f87-814f-968276c5c0ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:58.896999 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0243adc1-5e8d-4f87-814f-968276c5c0ff tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1313 microversion: 2.1 time: 0.717680 Aug 09 17:08:58.899611 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 635/1180] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:58 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:58.912568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1389192-7f21-4610-b2a3-5d4a0770b317 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:58.914397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d1389192-7f21-4610-b2a3-5d4a0770b317 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:59.177110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d1389192-7f21-4610-b2a3-5d4a0770b317 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:08:59.207985 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1389192-7f21-4610-b2a3-5d4a0770b317 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1208 microversion: 2.1 time: 0.303546 Aug 09 17:08:59.210853 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 636/1181] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:58 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1208 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:08:59.232667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:08:59.237133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:08:59.255414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:59.257802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:59.260780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:59.263076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:08:59.266068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:08:59.266728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:08:59.367970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:00.175442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-36deb442-bb08-467a-9aa0-e94f1d9731e6 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:00.190388 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-36deb442-bb08-467a-9aa0-e94f1d9731e6 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1324 microversion: 2.1 time: 2.300585 Aug 09 17:09:00.191721 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 546/1182] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:08:57 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1324 bytes in 2303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:00.216584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3e639fd8-1470-450b-aa44-8b01ce645e44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:00.220796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3e639fd8-1470-450b-aa44-8b01ce645e44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:00.241030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e639fd8-1470-450b-aa44-8b01ce645e44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:00.242198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e639fd8-1470-450b-aa44-8b01ce645e44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:00.242887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e639fd8-1470-450b-aa44-8b01ce645e44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:00.243965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e639fd8-1470-450b-aa44-8b01ce645e44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:00.249853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e639fd8-1470-450b-aa44-8b01ce645e44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:00.250581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e639fd8-1470-450b-aa44-8b01ce645e44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:00.591957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:00.629789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:00.637448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:00.638729 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ce465309-961d-4e6c-b81e-5bb4381999ba tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1410 microversion: 2.25 time: 1.425646 Aug 09 17:09:00.639342 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 637/1183] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:08:59 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1410 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:09:00.884170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9025f5cb-e9f7-4fca-aee9-0295116b47e5 req-da532215-42c7-4fff-ba2a-201cce9b222f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417d9361-7e22-4e97-a3a9-acd1f3a91e46", "name": "network-vif-deleted", "tag": "ce57d96c-a257-41a4-a475-4abfa4213f53"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:00.906830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9025f5cb-e9f7-4fca-aee9-0295116b47e5 req-da532215-42c7-4fff-ba2a-201cce9b222f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:00.920941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9025f5cb-e9f7-4fca-aee9-0295116b47e5 req-da532215-42c7-4fff-ba2a-201cce9b222f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:00.921594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9025f5cb-e9f7-4fca-aee9-0295116b47e5 req-da532215-42c7-4fff-ba2a-201cce9b222f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:00.949901 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9025f5cb-e9f7-4fca-aee9-0295116b47e5 req-da532215-42c7-4fff-ba2a-201cce9b222f service nova] Creating event network-vif-deleted:ce57d96c-a257-41a4-a475-4abfa4213f53 for instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 on n-h2-845781-6 Aug 09 17:09:00.959086 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9025f5cb-e9f7-4fca-aee9-0295116b47e5 req-da532215-42c7-4fff-ba2a-201cce9b222f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293604 Aug 09 17:09:00.979035 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 638/1184] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:00.988011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-98416eca-a42b-4b2a-9850-09ba2970fbfd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:00.992155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-98416eca-a42b-4b2a-9850-09ba2970fbfd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:01.007517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98416eca-a42b-4b2a-9850-09ba2970fbfd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:01.011102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98416eca-a42b-4b2a-9850-09ba2970fbfd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:01.011918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98416eca-a42b-4b2a-9850-09ba2970fbfd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:01.015621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98416eca-a42b-4b2a-9850-09ba2970fbfd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:01.016516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98416eca-a42b-4b2a-9850-09ba2970fbfd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:01.017245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98416eca-a42b-4b2a-9850-09ba2970fbfd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:01.189250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-98416eca-a42b-4b2a-9850-09ba2970fbfd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:01.208369 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-98416eca-a42b-4b2a-9850-09ba2970fbfd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1266 microversion: 2.1 time: 0.225494 Aug 09 17:09:01.209478 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 639/1185] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:00 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:01.231402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4d02ee21-5834-4901-ab9a-d2ad4b7bf35f tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:01.233083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4d02ee21-5834-4901-ab9a-d2ad4b7bf35f tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:01.241808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d02ee21-5834-4901-ab9a-d2ad4b7bf35f tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:01.242691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d02ee21-5834-4901-ab9a-d2ad4b7bf35f tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:01.243429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d02ee21-5834-4901-ab9a-d2ad4b7bf35f tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:01.244909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d02ee21-5834-4901-ab9a-d2ad4b7bf35f tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:01.245645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d02ee21-5834-4901-ab9a-d2ad4b7bf35f tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:01.246390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d02ee21-5834-4901-ab9a-d2ad4b7bf35f tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:01.544488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3e639fd8-1470-450b-aa44-8b01ce645e44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:01.545254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4d02ee21-5834-4901-ab9a-d2ad4b7bf35f tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:01.565279 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3e639fd8-1470-450b-aa44-8b01ce645e44 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1313 microversion: 2.1 time: 1.361938 Aug 09 17:09:01.569694 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4d02ee21-5834-4901-ab9a-d2ad4b7bf35f tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1324 microversion: 2.1 time: 0.340755 Aug 09 17:09:01.572688 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 640/1186] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:01 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1324 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:01.573372 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 547/1187] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:00 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1313 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:01.653519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8da00615-cc07-4310-ada4-f7563be79066 req-acd4705c-56b0-4830-8acd-7cd6118d71ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c388a7-598a-45ed-b478-0d6637f4e01c", "name": "network-vif-plugged", "status": "completed", "tag": "d78a88ee-1bff-414f-892a-1adc2ebee7fc"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:01.665908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:01.666586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:01.682001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:01.684056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:01.685716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:01.687738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:01.696350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:01.700808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:01.702791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8da00615-cc07-4310-ada4-f7563be79066 req-acd4705c-56b0-4830-8acd-7cd6118d71ee service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:01.710351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8da00615-cc07-4310-ada4-f7563be79066 req-acd4705c-56b0-4830-8acd-7cd6118d71ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:01.710914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8da00615-cc07-4310-ada4-f7563be79066 req-acd4705c-56b0-4830-8acd-7cd6118d71ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:01.732484 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8da00615-cc07-4310-ada4-f7563be79066 req-acd4705c-56b0-4830-8acd-7cd6118d71ee service nova] Creating event network-vif-plugged:d78a88ee-1bff-414f-892a-1adc2ebee7fc for instance 32c388a7-598a-45ed-b478-0d6637f4e01c on n-h2-845781-6 Aug 09 17:09:01.757443 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8da00615-cc07-4310-ada4-f7563be79066 req-acd4705c-56b0-4830-8acd-7cd6118d71ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111273 Aug 09 17:09:01.761902 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 641/1188] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:02.246399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aed4c175-5bea-44d8-9445-bc1e7bda09f9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:02.254951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aed4c175-5bea-44d8-9445-bc1e7bda09f9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:02.284332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed4c175-5bea-44d8-9445-bc1e7bda09f9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:02.289474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed4c175-5bea-44d8-9445-bc1e7bda09f9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:02.296790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed4c175-5bea-44d8-9445-bc1e7bda09f9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:02.298423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed4c175-5bea-44d8-9445-bc1e7bda09f9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:02.299589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed4c175-5bea-44d8-9445-bc1e7bda09f9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:02.300992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed4c175-5bea-44d8-9445-bc1e7bda09f9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:02.453808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aed4c175-5bea-44d8-9445-bc1e7bda09f9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:02.479065 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aed4c175-5bea-44d8-9445-bc1e7bda09f9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1266 microversion: 2.1 time: 0.242654 Aug 09 17:09:02.480083 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 642/1189] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:02 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:02.598318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-faaaa1b7-771c-4e80-ae9d-dfa8105d9de3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:02.600871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-faaaa1b7-771c-4e80-ae9d-dfa8105d9de3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:02.636447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faaaa1b7-771c-4e80-ae9d-dfa8105d9de3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:02.640772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faaaa1b7-771c-4e80-ae9d-dfa8105d9de3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:02.644306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faaaa1b7-771c-4e80-ae9d-dfa8105d9de3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:02.649866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faaaa1b7-771c-4e80-ae9d-dfa8105d9de3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:02.652974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faaaa1b7-771c-4e80-ae9d-dfa8105d9de3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:02.656524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faaaa1b7-771c-4e80-ae9d-dfa8105d9de3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:03.010262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-faaaa1b7-771c-4e80-ae9d-dfa8105d9de3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:03.026309 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-faaaa1b7-771c-4e80-ae9d-dfa8105d9de3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1521 microversion: 2.1 time: 0.438731 Aug 09 17:09:03.041598 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 643/1190] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:02 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:09:03.042892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:03.079743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:03.080198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2705d0d5-a401-49cc-8b29-01aeb8cfc742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:03.085152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2705d0d5-a401-49cc-8b29-01aeb8cfc742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:03.086828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:03.094102 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f484fde4-b4a6-4b72-8632-c194d987cf33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1410 microversion: 2.25 time: 1.434175 Aug 09 17:09:03.096693 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 548/1191] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:09:01 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1410 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:09:03.108367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa3d68cc-1f71-4166-822d-55fcfb6f4792 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Action: 'create', calling method: .version_select at 0x7fbbcb8c4dc0>, body: {"pool": null} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:03.111510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2705d0d5-a401-49cc-8b29-01aeb8cfc742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:03.117367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2705d0d5-a401-49cc-8b29-01aeb8cfc742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:03.118195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2705d0d5-a401-49cc-8b29-01aeb8cfc742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:03.119782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2705d0d5-a401-49cc-8b29-01aeb8cfc742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:03.122387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2705d0d5-a401-49cc-8b29-01aeb8cfc742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:03.123362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2705d0d5-a401-49cc-8b29-01aeb8cfc742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:03.532879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2705d0d5-a401-49cc-8b29-01aeb8cfc742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:03.543122 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2705d0d5-a401-49cc-8b29-01aeb8cfc742 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1313 microversion: 2.1 time: 0.499936 Aug 09 17:09:03.544291 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 644/1192] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:03 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:03.570530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-89347eef-880c-4df2-83d1-b05ff91c13b9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:03.575854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-89347eef-880c-4df2-83d1-b05ff91c13b9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:03.588879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89347eef-880c-4df2-83d1-b05ff91c13b9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:03.589928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89347eef-880c-4df2-83d1-b05ff91c13b9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:03.591002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89347eef-880c-4df2-83d1-b05ff91c13b9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:03.592325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89347eef-880c-4df2-83d1-b05ff91c13b9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:03.593278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89347eef-880c-4df2-83d1-b05ff91c13b9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:03.594178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89347eef-880c-4df2-83d1-b05ff91c13b9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:03.813519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-89347eef-880c-4df2-83d1-b05ff91c13b9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:03.829154 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-89347eef-880c-4df2-83d1-b05ff91c13b9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1266 microversion: 2.1 time: 0.265304 Aug 09 17:09:03.831733 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 645/1193] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:03 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:03.848787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f98115eb-93bb-4367-91c5-ba044aec5f46 req-c477bc8a-ca7c-4c6a-9da8-f188125bffc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9bf5c5-13a8-4999-9fe7-e31ca09ad767", "tag": "4e14d13a-f750-41b6-9e8f-9ebfa131fe82"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:03.878664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f98115eb-93bb-4367-91c5-ba044aec5f46 req-c477bc8a-ca7c-4c6a-9da8-f188125bffc4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:03.881320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f98115eb-93bb-4367-91c5-ba044aec5f46 req-c477bc8a-ca7c-4c6a-9da8-f188125bffc4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:03.882942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f98115eb-93bb-4367-91c5-ba044aec5f46 req-c477bc8a-ca7c-4c6a-9da8-f188125bffc4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:03.900513 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f98115eb-93bb-4367-91c5-ba044aec5f46 req-c477bc8a-ca7c-4c6a-9da8-f188125bffc4 service nova] Creating event network-changed:4e14d13a-f750-41b6-9e8f-9ebfa131fe82 for instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 on n-h1-845781-6 Aug 09 17:09:03.912819 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f98115eb-93bb-4367-91c5-ba044aec5f46 req-c477bc8a-ca7c-4c6a-9da8-f188125bffc4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078127 Aug 09 17:09:03.914405 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 646/1194] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:04.201660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:04.203173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:04.235276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:04.237298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:04.239185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:04.242026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:04.243757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:04.245213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:05.091569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:05.108167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:05.116181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:05.120712 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87efde89-7472-428f-95cb-05d076f980df tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1410 microversion: 2.25 time: 0.981108 Aug 09 17:09:05.137096 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 647/1195] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:09:04 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1410 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:09:05.153134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0f5198da-ae9f-4643-ac2c-0c7e7f7d918b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:05.157506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0f5198da-ae9f-4643-ac2c-0c7e7f7d918b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:05.175134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f5198da-ae9f-4643-ac2c-0c7e7f7d918b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:05.176694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f5198da-ae9f-4643-ac2c-0c7e7f7d918b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:05.179421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f5198da-ae9f-4643-ac2c-0c7e7f7d918b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:05.181395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f5198da-ae9f-4643-ac2c-0c7e7f7d918b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:05.183076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f5198da-ae9f-4643-ac2c-0c7e7f7d918b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:05.186889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f5198da-ae9f-4643-ac2c-0c7e7f7d918b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:06.187763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0f5198da-ae9f-4643-ac2c-0c7e7f7d918b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:06.209183 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0f5198da-ae9f-4643-ac2c-0c7e7f7d918b tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1463 microversion: 2.1 time: 1.069954 Aug 09 17:09:06.225581 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 648/1196] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:05 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1463 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:06.244152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-051c7422-7bdc-480a-9afd-2c031b9730b5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:06.245777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-051c7422-7bdc-480a-9afd-2c031b9730b5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:06.270607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051c7422-7bdc-480a-9afd-2c031b9730b5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:06.272007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051c7422-7bdc-480a-9afd-2c031b9730b5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:06.284110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051c7422-7bdc-480a-9afd-2c031b9730b5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:06.286517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051c7422-7bdc-480a-9afd-2c031b9730b5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:06.287982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051c7422-7bdc-480a-9afd-2c031b9730b5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:06.289016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051c7422-7bdc-480a-9afd-2c031b9730b5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:07.042386 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-051c7422-7bdc-480a-9afd-2c031b9730b5 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1859 microversion: 2.1 time: 0.812873 Aug 09 17:09:07.088707 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 649/1197] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:06 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1859 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:07.109096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07b8d85c-0e8e-4d72-85d4-36c19b7b631d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:07.111282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07b8d85c-0e8e-4d72-85d4-36c19b7b631d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:07.135081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b8d85c-0e8e-4d72-85d4-36c19b7b631d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:07.140696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b8d85c-0e8e-4d72-85d4-36c19b7b631d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:07.148864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b8d85c-0e8e-4d72-85d4-36c19b7b631d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:07.151045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b8d85c-0e8e-4d72-85d4-36c19b7b631d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:07.152559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b8d85c-0e8e-4d72-85d4-36c19b7b631d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:07.153383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b8d85c-0e8e-4d72-85d4-36c19b7b631d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:07.836971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:08.014636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-07b8d85c-0e8e-4d72-85d4-36c19b7b631d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:08.056512 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07b8d85c-0e8e-4d72-85d4-36c19b7b631d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1266 microversion: 2.1 time: 0.957505 Aug 09 17:09:08.059109 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 650/1198] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:07 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1266 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:08.083869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:08.084636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:08.142693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:08.146910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:08.148318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:08.149956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:08.151269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:08.152582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:09.166534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:09.215858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=16 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:09.254891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:09.271952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:09.287524 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e95208e-0c22-4df2-a36f-fa196282afc6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1410 microversion: 2.25 time: 1.225016 Aug 09 17:09:09.319290 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 651/1199] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:09:08 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1410 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:09:10.470680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50d9ca7a-031e-41a3-9eaa-e902985c457e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:10.471398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-50d9ca7a-031e-41a3-9eaa-e902985c457e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:10.482064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d9ca7a-031e-41a3-9eaa-e902985c457e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:10.482962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d9ca7a-031e-41a3-9eaa-e902985c457e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:10.483584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d9ca7a-031e-41a3-9eaa-e902985c457e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:10.484548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d9ca7a-031e-41a3-9eaa-e902985c457e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:10.485322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d9ca7a-031e-41a3-9eaa-e902985c457e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:10.486327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d9ca7a-031e-41a3-9eaa-e902985c457e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:11.671913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=11 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:11.869866 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-50d9ca7a-031e-41a3-9eaa-e902985c457e tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1614 microversion: 2.1 time: 2.548721 Aug 09 17:09:11.871753 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 652/1200] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:09 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1614 bytes in 2551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:11.883037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-12e016c7-137c-4f39-9973-6a182d5ad743 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-845781-6", "block_migration": true, "disk_over_commit": false}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:11.892172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-12e016c7-137c-4f39-9973-6a182d5ad743 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:11.908565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12e016c7-137c-4f39-9973-6a182d5ad743 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:11.913401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12e016c7-137c-4f39-9973-6a182d5ad743 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:11.914242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12e016c7-137c-4f39-9973-6a182d5ad743 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:11.915656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12e016c7-137c-4f39-9973-6a182d5ad743 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:11.916777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12e016c7-137c-4f39-9973-6a182d5ad743 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:11.917905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12e016c7-137c-4f39-9973-6a182d5ad743 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:11.989130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-12e016c7-137c-4f39-9973-6a182d5ad743 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lazy-loading 'flavor' on Instance uuid 2bde0f3f-3670-4908-bc71-f4af6b3671b2 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:09:12.018196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-12e016c7-137c-4f39-9973-6a182d5ad743 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Going to try to live migrate instance to n-h1-845781-6 {{(pid=119431) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 17:09:13.068766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=63 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:14.386933 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fa3d68cc-1f71-4166-822d-55fcfb6f4792 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 11.287801 Aug 09 17:09:14.388948 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 549/1201] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:09:03 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 11291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:14.396402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cf15bc85-15c2-4302-95bb-d737d8d14c7f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:14.397488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cf15bc85-15c2-4302-95bb-d737d8d14c7f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:14.442640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf15bc85-15c2-4302-95bb-d737d8d14c7f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:14.449509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf15bc85-15c2-4302-95bb-d737d8d14c7f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:14.454666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf15bc85-15c2-4302-95bb-d737d8d14c7f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:14.460861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf15bc85-15c2-4302-95bb-d737d8d14c7f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:14.461804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf15bc85-15c2-4302-95bb-d737d8d14c7f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:14.463856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf15bc85-15c2-4302-95bb-d737d8d14c7f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:15.398122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cf15bc85-15c2-4302-95bb-d737d8d14c7f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:15.415976 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cf15bc85-15c2-4302-95bb-d737d8d14c7f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1308 microversion: 2.1 time: 1.023002 Aug 09 17:09:15.416941 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 550/1202] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:14 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1308 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:15.435847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:15.436773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:15.457376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:15.460704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:15.462964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:15.468519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:15.470280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:15.473277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:16.224617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:16.268234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:16.274382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:16.278436 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5a908cc7-7ee3-4214-8ad0-80e08d19e84b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1410 microversion: 2.25 time: 0.857421 Aug 09 17:09:16.282071 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 551/1203] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:09:15 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1410 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:09:16.304844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:16.305645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:16.339554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:16.340622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:16.344759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:16.346202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:16.349042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:16.350005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:16.381682 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-12e016c7-137c-4f39-9973-6a182d5ad743 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/action" status: 202 len: 0 microversion: 2.1 time: 4.507008 Aug 09 17:09:16.382833 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 653/1204] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:09:11 2022] POST /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/action => generated 0 bytes in 4511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:09:16.390251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ff7d2a5e-6524-4c50-a386-4808e013d793 req-3e741ea7-d260-42d2-b2d2-1f4d5865b419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8806f1b-fc49-46e7-a732-04de3ee9e445", "tag": "7921ceb6-216e-4e5f-9c52-c560bf15be4a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:16.464903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ff7d2a5e-6524-4c50-a386-4808e013d793 req-3e741ea7-d260-42d2-b2d2-1f4d5865b419 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:16.468284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ff7d2a5e-6524-4c50-a386-4808e013d793 req-3e741ea7-d260-42d2-b2d2-1f4d5865b419 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:16.470884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ff7d2a5e-6524-4c50-a386-4808e013d793 req-3e741ea7-d260-42d2-b2d2-1f4d5865b419 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:16.492548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:16.528772 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ff7d2a5e-6524-4c50-a386-4808e013d793 req-3e741ea7-d260-42d2-b2d2-1f4d5865b419 service nova] Creating event network-changed:7921ceb6-216e-4e5f-9c52-c560bf15be4a for instance b8806f1b-fc49-46e7-a732-04de3ee9e445 on n-h2-845781-6 Aug 09 17:09:16.544557 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ff7d2a5e-6524-4c50-a386-4808e013d793 req-3e741ea7-d260-42d2-b2d2-1f4d5865b419 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158500 Aug 09 17:09:16.548847 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 654/1205] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:16.567981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-815100494", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "bf9538fd-ab95-4f28-9743-01ef51be592a"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:16.615522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '017d8ebb677e4fa789c56667f7ea29eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9acca86153a141918d7785f76b3dd796', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:16.617919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] flavor_id is None. Assuming migration. {{(pid=119432) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 09 17:09:16.620756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119432) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 17:09:16.641344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:16.796584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] validate_networks() for [('bf9538fd-ab95-4f28-9743-01ef51be592a', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:09:17.914612 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6629e069-47ec-44ef-904f-2161dd62bfd9 tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c/action" status: 202 len: 0 microversion: 2.1 time: 1.630143 Aug 09 17:09:17.916147 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 552/1206] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:09:16 2022] POST /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c/action => generated 0 bytes in 1634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:09:17.927763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f5a1fa6d-afa3-43cd-a924-7d340153c7a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:17.929977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f5a1fa6d-afa3-43cd-a924-7d340153c7a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:17.953121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5a1fa6d-afa3-43cd-a924-7d340153c7a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:17.955262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5a1fa6d-afa3-43cd-a924-7d340153c7a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:17.957539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5a1fa6d-afa3-43cd-a924-7d340153c7a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:17.960857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5a1fa6d-afa3-43cd-a924-7d340153c7a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:17.965551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5a1fa6d-afa3-43cd-a924-7d340153c7a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:17.966559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5a1fa6d-afa3-43cd-a924-7d340153c7a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:19.099922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f5a1fa6d-afa3-43cd-a924-7d340153c7a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:19.119298 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f5a1fa6d-afa3-43cd-a924-7d340153c7a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 1.194092 Aug 09 17:09:19.120660 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 553/1207] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:17 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:19.128025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d8a4ab89-2e94-4e13-978b-d7f0a2e23fca tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:19.134499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d8a4ab89-2e94-4e13-978b-d7f0a2e23fca tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:19.154864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8a4ab89-2e94-4e13-978b-d7f0a2e23fca tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:19.156070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8a4ab89-2e94-4e13-978b-d7f0a2e23fca tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:19.156746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8a4ab89-2e94-4e13-978b-d7f0a2e23fca tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:19.158215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8a4ab89-2e94-4e13-978b-d7f0a2e23fca tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:19.160542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8a4ab89-2e94-4e13-978b-d7f0a2e23fca tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:19.163563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8a4ab89-2e94-4e13-978b-d7f0a2e23fca tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:19.632932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:09:19.633611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:09:19.634438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:09:19.635925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:09:19.636583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:09:19.700343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:19.702775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:19.704652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:19.713331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:19.714833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:19.725288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:19.846603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Getting quotas for project fc4ac8041e634c979c8678b4fde35a4f. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:09:19.869815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d8a4ab89-2e94-4e13-978b-d7f0a2e23fca tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:19.891492 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d8a4ab89-2e94-4e13-978b-d7f0a2e23fca tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1308 microversion: 2.1 time: 0.764953 Aug 09 17:09:19.901864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Getting quotas for user d55e4a6f6b7b4766b6510072d21f1e60 and project fc4ac8041e634c979c8678b4fde35a4f. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:09:19.921804 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 554/1208] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:19 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1308 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:19.953638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:19.954412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:19.978346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:09:19.981707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:09:19.989299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:19.989807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:19.990253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:19.990993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:19.991459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:20.007846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:20.110844 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-61c4ce24-18d1-4edc-9664-1754eecf55ae tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.555931 Aug 09 17:09:20.116594 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 655/1209] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:09:20.143820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a08f30fe-3996-4e1c-aa29-a4e3d42f4fa5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:20.145092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a08f30fe-3996-4e1c-aa29-a4e3d42f4fa5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:20.161629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a08f30fe-3996-4e1c-aa29-a4e3d42f4fa5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:20.166210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a08f30fe-3996-4e1c-aa29-a4e3d42f4fa5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:20.168149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a08f30fe-3996-4e1c-aa29-a4e3d42f4fa5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:20.170446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a08f30fe-3996-4e1c-aa29-a4e3d42f4fa5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:20.172905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a08f30fe-3996-4e1c-aa29-a4e3d42f4fa5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:20.174834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a08f30fe-3996-4e1c-aa29-a4e3d42f4fa5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:20.796084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a08f30fe-3996-4e1c-aa29-a4e3d42f4fa5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:20.838885 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a08f30fe-3996-4e1c-aa29-a4e3d42f4fa5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1472 microversion: 2.1 time: 0.720154 Aug 09 17:09:20.863769 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 656/1210] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:20 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1472 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:20.889701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fcb75a08-1c56-4ad1-b3b9-fffb97dc3874 req-cc5f5ceb-e635-4bb3-a8bc-30d0bc783f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9bf5c5-13a8-4999-9fe7-e31ca09ad767", "name": "network-vif-plugged", "status": "completed", "tag": "4e14d13a-f750-41b6-9e8f-9ebfa131fe82"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:20.915191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fcb75a08-1c56-4ad1-b3b9-fffb97dc3874 req-cc5f5ceb-e635-4bb3-a8bc-30d0bc783f2a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:20.920446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fcb75a08-1c56-4ad1-b3b9-fffb97dc3874 req-cc5f5ceb-e635-4bb3-a8bc-30d0bc783f2a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:20.921197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fcb75a08-1c56-4ad1-b3b9-fffb97dc3874 req-cc5f5ceb-e635-4bb3-a8bc-30d0bc783f2a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:20.962275 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fcb75a08-1c56-4ad1-b3b9-fffb97dc3874 req-cc5f5ceb-e635-4bb3-a8bc-30d0bc783f2a service nova] Creating event network-vif-plugged:4e14d13a-f750-41b6-9e8f-9ebfa131fe82 for instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 on n-h1-845781-6 Aug 09 17:09:20.983331 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fcb75a08-1c56-4ad1-b3b9-fffb97dc3874 req-cc5f5ceb-e635-4bb3-a8bc-30d0bc783f2a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116818 Aug 09 17:09:20.986092 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 657/1211] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:21.049402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd0edba8-a5da-429d-baa1-2f7fed3e2959 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:21.052773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fd0edba8-a5da-429d-baa1-2f7fed3e2959 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:21.289432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fd0edba8-a5da-429d-baa1-2f7fed3e2959 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:21.302169 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fd0edba8-a5da-429d-baa1-2f7fed3e2959 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1223 microversion: 2.1 time: 0.301327 Aug 09 17:09:21.303454 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 658/1212] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:20 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1223 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:21.328204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a496e6c-9658-4ab0-a2cd-a2c47cfbdc00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:21.328879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9a496e6c-9658-4ab0-a2cd-a2c47cfbdc00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:21.372461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a496e6c-9658-4ab0-a2cd-a2c47cfbdc00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:21.373501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a496e6c-9658-4ab0-a2cd-a2c47cfbdc00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:21.374436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a496e6c-9658-4ab0-a2cd-a2c47cfbdc00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:21.378391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a496e6c-9658-4ab0-a2cd-a2c47cfbdc00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:21.379304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a496e6c-9658-4ab0-a2cd-a2c47cfbdc00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:21.380401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a496e6c-9658-4ab0-a2cd-a2c47cfbdc00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:21.965963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9a496e6c-9658-4ab0-a2cd-a2c47cfbdc00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:22.004919 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9a496e6c-9658-4ab0-a2cd-a2c47cfbdc00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 0.689557 Aug 09 17:09:22.006211 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 659/1213] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:21 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:22.044462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3a93e32-2b1e-4171-a81a-d4be905cde11 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:22.052407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c3a93e32-2b1e-4171-a81a-d4be905cde11 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:22.083781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3a93e32-2b1e-4171-a81a-d4be905cde11 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:22.084605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3a93e32-2b1e-4171-a81a-d4be905cde11 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:22.090729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3a93e32-2b1e-4171-a81a-d4be905cde11 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:22.092582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3a93e32-2b1e-4171-a81a-d4be905cde11 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:22.096562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3a93e32-2b1e-4171-a81a-d4be905cde11 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:22.096744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3a93e32-2b1e-4171-a81a-d4be905cde11 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:22.259844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:22.311768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:22.321553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:22.335045 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9ce0a0f1-db60-4785-a80e-ec21e2425d71 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1410 microversion: 2.25 time: 2.411044 Aug 09 17:09:22.352209 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 555/1214] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:09:19 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1410 bytes in 2428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:09:22.365733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-91204155-566d-44f4-822b-26dbbf42a6e3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:22.367668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-91204155-566d-44f4-822b-26dbbf42a6e3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:22.417798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91204155-566d-44f4-822b-26dbbf42a6e3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:22.422885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91204155-566d-44f4-822b-26dbbf42a6e3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:22.426437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91204155-566d-44f4-822b-26dbbf42a6e3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:22.433193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91204155-566d-44f4-822b-26dbbf42a6e3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:22.439956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91204155-566d-44f4-822b-26dbbf42a6e3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:22.445381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91204155-566d-44f4-822b-26dbbf42a6e3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:22.777351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c3a93e32-2b1e-4171-a81a-d4be905cde11 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:22.790343 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c3a93e32-2b1e-4171-a81a-d4be905cde11 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1308 microversion: 2.1 time: 0.782807 Aug 09 17:09:22.814929 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 660/1215] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:22 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1308 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:22.844285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bb30599d-a9fc-4cb1-a17e-8aabd18bc648 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:22.845724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bb30599d-a9fc-4cb1-a17e-8aabd18bc648 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:22.886307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb30599d-a9fc-4cb1-a17e-8aabd18bc648 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:22.887541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb30599d-a9fc-4cb1-a17e-8aabd18bc648 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:22.891950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb30599d-a9fc-4cb1-a17e-8aabd18bc648 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:22.899035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb30599d-a9fc-4cb1-a17e-8aabd18bc648 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:22.904829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb30599d-a9fc-4cb1-a17e-8aabd18bc648 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:22.905362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb30599d-a9fc-4cb1-a17e-8aabd18bc648 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:23.156110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bb30599d-a9fc-4cb1-a17e-8aabd18bc648 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:23.198440 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bb30599d-a9fc-4cb1-a17e-8aabd18bc648 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1293 microversion: 2.1 time: 0.379499 Aug 09 17:09:23.207686 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 661/1216] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:22 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1293 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:23.225673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f388c75a-fa12-4ba4-bd25-5810db1f2a74 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:23.231240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f388c75a-fa12-4ba4-bd25-5810db1f2a74 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:23.262026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388c75a-fa12-4ba4-bd25-5810db1f2a74 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:23.267887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388c75a-fa12-4ba4-bd25-5810db1f2a74 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:23.268900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388c75a-fa12-4ba4-bd25-5810db1f2a74 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:23.272958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388c75a-fa12-4ba4-bd25-5810db1f2a74 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:23.277694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388c75a-fa12-4ba4-bd25-5810db1f2a74 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:23.278530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388c75a-fa12-4ba4-bd25-5810db1f2a74 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:24.165443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f388c75a-fa12-4ba4-bd25-5810db1f2a74 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:24.178043 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f388c75a-fa12-4ba4-bd25-5810db1f2a74 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 0.976387 Aug 09 17:09:24.193977 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 662/1217] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:23 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:24.208294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:24.209178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:24.239792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:24.240650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:24.242865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:24.243924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:24.245779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:24.247291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:24.256750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-91204155-566d-44f4-822b-26dbbf42a6e3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:24.278575 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-91204155-566d-44f4-822b-26dbbf42a6e3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1472 microversion: 2.1 time: 1.916431 Aug 09 17:09:24.286147 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 556/1218] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:22 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1472 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:24.300345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7a4324e4-26ac-44a7-aa01-c0ddec078787 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:24.302351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7a4324e4-26ac-44a7-aa01-c0ddec078787 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:24.322359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a4324e4-26ac-44a7-aa01-c0ddec078787 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:24.326885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a4324e4-26ac-44a7-aa01-c0ddec078787 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:24.328144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a4324e4-26ac-44a7-aa01-c0ddec078787 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:24.329789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a4324e4-26ac-44a7-aa01-c0ddec078787 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:24.330646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a4324e4-26ac-44a7-aa01-c0ddec078787 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:24.331270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a4324e4-26ac-44a7-aa01-c0ddec078787 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:24.804325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:24.813581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:24.815576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:24.825591 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d40a6633-d355-4582-8fd8-aa4d1189a2e5 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1410 microversion: 2.25 time: 0.621073 Aug 09 17:09:24.828978 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 663/1219] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:09:24 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1410 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:09:24.896142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec8f9380-7918-42e4-86ff-9192c0fd3ca1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:24.896789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ec8f9380-7918-42e4-86ff-9192c0fd3ca1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:24.949803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8f9380-7918-42e4-86ff-9192c0fd3ca1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:24.955373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8f9380-7918-42e4-86ff-9192c0fd3ca1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:24.959904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8f9380-7918-42e4-86ff-9192c0fd3ca1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:24.969579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8f9380-7918-42e4-86ff-9192c0fd3ca1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:24.975397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8f9380-7918-42e4-86ff-9192c0fd3ca1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:24.976059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8f9380-7918-42e4-86ff-9192c0fd3ca1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:25.152949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ec8f9380-7918-42e4-86ff-9192c0fd3ca1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:25.189952 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ec8f9380-7918-42e4-86ff-9192c0fd3ca1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1281 microversion: 2.1 time: 0.276410 Aug 09 17:09:25.192475 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 664/1220] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:24 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1281 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:25.217779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efacd15f-626d-49db-a563-58ebc2d0ea58 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:25.217779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-efacd15f-626d-49db-a563-58ebc2d0ea58 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:25.227447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacd15f-626d-49db-a563-58ebc2d0ea58 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:25.227447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacd15f-626d-49db-a563-58ebc2d0ea58 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:25.248673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacd15f-626d-49db-a563-58ebc2d0ea58 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:25.249793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacd15f-626d-49db-a563-58ebc2d0ea58 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:25.254445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacd15f-626d-49db-a563-58ebc2d0ea58 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:25.256423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacd15f-626d-49db-a563-58ebc2d0ea58 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:25.804995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-efacd15f-626d-49db-a563-58ebc2d0ea58 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:25.821862 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-efacd15f-626d-49db-a563-58ebc2d0ea58 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 0.617063 Aug 09 17:09:25.845597 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 665/1221] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:25 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:25.860105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f16faf2-3643-46aa-bd05-a86d67cb43f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:25.864156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f16faf2-3643-46aa-bd05-a86d67cb43f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:25.881423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f16faf2-3643-46aa-bd05-a86d67cb43f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:25.885860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f16faf2-3643-46aa-bd05-a86d67cb43f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:25.904611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f16faf2-3643-46aa-bd05-a86d67cb43f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:25.907873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f16faf2-3643-46aa-bd05-a86d67cb43f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:25.914809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f16faf2-3643-46aa-bd05-a86d67cb43f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:25.916384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f16faf2-3643-46aa-bd05-a86d67cb43f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:25.938520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7a4324e4-26ac-44a7-aa01-c0ddec078787 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:25.961148 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7a4324e4-26ac-44a7-aa01-c0ddec078787 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1308 microversion: 2.1 time: 1.670938 Aug 09 17:09:25.964067 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 557/1222] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:24 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1308 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:25.986580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:25.990759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:26.013330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:26.018436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:26.020755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:26.021776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:26.031308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:26.032231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:26.614753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9f16faf2-3643-46aa-bd05-a86d67cb43f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:26.632467 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f16faf2-3643-46aa-bd05-a86d67cb43f3 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1472 microversion: 2.1 time: 0.785242 Aug 09 17:09:26.636608 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 666/1223] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:25 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1472 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:26.653304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb2ceb12-5ca1-4e07-8ecb-c3acdcab3c07 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:26.657216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb2ceb12-5ca1-4e07-8ecb-c3acdcab3c07 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:26.681366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb2ceb12-5ca1-4e07-8ecb-c3acdcab3c07 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:26.682217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb2ceb12-5ca1-4e07-8ecb-c3acdcab3c07 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:26.683816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb2ceb12-5ca1-4e07-8ecb-c3acdcab3c07 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:26.684886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb2ceb12-5ca1-4e07-8ecb-c3acdcab3c07 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:26.688171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb2ceb12-5ca1-4e07-8ecb-c3acdcab3c07 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:26.688888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb2ceb12-5ca1-4e07-8ecb-c3acdcab3c07 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:26.959233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cb2ceb12-5ca1-4e07-8ecb-c3acdcab3c07 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:26.973387 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb2ceb12-5ca1-4e07-8ecb-c3acdcab3c07 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1281 microversion: 2.1 time: 0.335215 Aug 09 17:09:26.975541 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 667/1224] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:26 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1281 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:26.984745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fcd8b892-147e-455d-afc6-b86d2f6a16fe req-120d6ee4-1120-437f-9944-48fb5112f620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8806f1b-fc49-46e7-a732-04de3ee9e445", "name": "network-vif-plugged", "status": "completed", "tag": "7921ceb6-216e-4e5f-9c52-c560bf15be4a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:27.020308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fcd8b892-147e-455d-afc6-b86d2f6a16fe req-120d6ee4-1120-437f-9944-48fb5112f620 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:27.021401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fcd8b892-147e-455d-afc6-b86d2f6a16fe req-120d6ee4-1120-437f-9944-48fb5112f620 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:27.022289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fcd8b892-147e-455d-afc6-b86d2f6a16fe req-120d6ee4-1120-437f-9944-48fb5112f620 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:27.049480 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fcd8b892-147e-455d-afc6-b86d2f6a16fe req-120d6ee4-1120-437f-9944-48fb5112f620 service nova] Creating event network-vif-plugged:7921ceb6-216e-4e5f-9c52-c560bf15be4a for instance b8806f1b-fc49-46e7-a732-04de3ee9e445 on n-h2-845781-6 Aug 09 17:09:27.065429 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fcd8b892-147e-455d-afc6-b86d2f6a16fe req-120d6ee4-1120-437f-9944-48fb5112f620 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084429 Aug 09 17:09:27.071096 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 668/1225] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:27.092286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5cbffa66-e391-4454-99ee-f04865bcabea tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:27.096011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5cbffa66-e391-4454-99ee-f04865bcabea tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:27.128222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cbffa66-e391-4454-99ee-f04865bcabea tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:27.128819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cbffa66-e391-4454-99ee-f04865bcabea tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:27.129760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cbffa66-e391-4454-99ee-f04865bcabea tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:27.130521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cbffa66-e391-4454-99ee-f04865bcabea tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:27.147457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cbffa66-e391-4454-99ee-f04865bcabea tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:27.148259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cbffa66-e391-4454-99ee-f04865bcabea tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:27.717519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:27.739886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:27.743274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:27.744529 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b28f9292-e91d-45ad-8ac6-092f459402cf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1607 microversion: 2.25 time: 1.776944 Aug 09 17:09:27.751793 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 558/1226] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:09:25 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1607 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:09:27.762574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5cbffa66-e391-4454-99ee-f04865bcabea tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:27.776021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-db33c298-ce07-44ff-b82e-38eb2ab20d54 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:27.776746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-db33c298-ce07-44ff-b82e-38eb2ab20d54 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:27.781669 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5cbffa66-e391-4454-99ee-f04865bcabea tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 0.708994 Aug 09 17:09:27.783043 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 669/1227] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:27 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:27.808585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a149fcb-6e42-40db-81b7-b4227a131724 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:27.809721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a149fcb-6e42-40db-81b7-b4227a131724 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:27.819423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db33c298-ce07-44ff-b82e-38eb2ab20d54 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:27.820258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db33c298-ce07-44ff-b82e-38eb2ab20d54 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:27.820898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db33c298-ce07-44ff-b82e-38eb2ab20d54 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:27.826799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a149fcb-6e42-40db-81b7-b4227a131724 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:27.832174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db33c298-ce07-44ff-b82e-38eb2ab20d54 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:27.833489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db33c298-ce07-44ff-b82e-38eb2ab20d54 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:27.834391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a149fcb-6e42-40db-81b7-b4227a131724 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:27.834530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db33c298-ce07-44ff-b82e-38eb2ab20d54 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:27.839887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a149fcb-6e42-40db-81b7-b4227a131724 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:27.841729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a149fcb-6e42-40db-81b7-b4227a131724 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:27.842697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a149fcb-6e42-40db-81b7-b4227a131724 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:27.844899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a149fcb-6e42-40db-81b7-b4227a131724 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:28.412828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-db33c298-ce07-44ff-b82e-38eb2ab20d54 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:28.431247 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-db33c298-ce07-44ff-b82e-38eb2ab20d54 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1308 microversion: 2.1 time: 0.671919 Aug 09 17:09:28.431956 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 559/1228] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:27 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1308 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:28.482321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c941c794-c264-45f4-bfbf-ad5a7ca94572 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:28.486146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c941c794-c264-45f4-bfbf-ad5a7ca94572 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:28.525490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c941c794-c264-45f4-bfbf-ad5a7ca94572 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:28.528778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c941c794-c264-45f4-bfbf-ad5a7ca94572 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:28.534165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c941c794-c264-45f4-bfbf-ad5a7ca94572 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:28.541522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c941c794-c264-45f4-bfbf-ad5a7ca94572 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:28.547243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c941c794-c264-45f4-bfbf-ad5a7ca94572 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:28.548612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4a149fcb-6e42-40db-81b7-b4227a131724 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:28.551965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c941c794-c264-45f4-bfbf-ad5a7ca94572 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:28.585862 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a149fcb-6e42-40db-81b7-b4227a131724 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1477 microversion: 2.1 time: 0.799139 Aug 09 17:09:28.590118 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 670/1229] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:27 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1477 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:28.617262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e30c4897-cdb7-4dc4-82ec-f998e2763353 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:28.619047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e30c4897-cdb7-4dc4-82ec-f998e2763353 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:28.637559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e30c4897-cdb7-4dc4-82ec-f998e2763353 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:28.644254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e30c4897-cdb7-4dc4-82ec-f998e2763353 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:28.665563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e30c4897-cdb7-4dc4-82ec-f998e2763353 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:28.679465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e30c4897-cdb7-4dc4-82ec-f998e2763353 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:28.684915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e30c4897-cdb7-4dc4-82ec-f998e2763353 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:28.687214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e30c4897-cdb7-4dc4-82ec-f998e2763353 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:28.929847 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c941c794-c264-45f4-bfbf-ad5a7ca94572 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.477813 Aug 09 17:09:28.931713 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 560/1230] 10.222.0.93 () {60 vars in 1316 bytes} [Tue Aug 9 17:09:28 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-interface => generated 285 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:09:28.953513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c64e7f4-489e-44d6-975e-202c18a58d13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:28.965872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2c64e7f4-489e-44d6-975e-202c18a58d13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:29.013658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c64e7f4-489e-44d6-975e-202c18a58d13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:29.015813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c64e7f4-489e-44d6-975e-202c18a58d13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:29.028046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c64e7f4-489e-44d6-975e-202c18a58d13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:29.030439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c64e7f4-489e-44d6-975e-202c18a58d13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:29.036754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c64e7f4-489e-44d6-975e-202c18a58d13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:29.042991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c64e7f4-489e-44d6-975e-202c18a58d13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:29.778787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:29.868805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2c64e7f4-489e-44d6-975e-202c18a58d13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:29.884889 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2c64e7f4-489e-44d6-975e-202c18a58d13 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 0.951524 Aug 09 17:09:29.900457 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 561/1231] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:28 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:29.980493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9623662a-b3b5-46c4-bf5e-56548b199d3c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:29.986553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9623662a-b3b5-46c4-bf5e-56548b199d3c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:30.001815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9623662a-b3b5-46c4-bf5e-56548b199d3c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:30.006853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9623662a-b3b5-46c4-bf5e-56548b199d3c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:30.007995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9623662a-b3b5-46c4-bf5e-56548b199d3c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:30.009051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9623662a-b3b5-46c4-bf5e-56548b199d3c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:30.010232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9623662a-b3b5-46c4-bf5e-56548b199d3c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:30.011135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9623662a-b3b5-46c4-bf5e-56548b199d3c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:30.576228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e30c4897-cdb7-4dc4-82ec-f998e2763353 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:30.587893 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e30c4897-cdb7-4dc4-82ec-f998e2763353 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1323 microversion: 2.1 time: 1.993013 Aug 09 17:09:30.588517 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 671/1232] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:28 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1323 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:30.619011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e8a7d22-7b8d-439a-b40f-e9c38fbe9faf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:30.622001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3e8a7d22-7b8d-439a-b40f-e9c38fbe9faf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:30.658570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8a7d22-7b8d-439a-b40f-e9c38fbe9faf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:30.659839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8a7d22-7b8d-439a-b40f-e9c38fbe9faf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:30.661295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8a7d22-7b8d-439a-b40f-e9c38fbe9faf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:30.662898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8a7d22-7b8d-439a-b40f-e9c38fbe9faf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:30.663804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8a7d22-7b8d-439a-b40f-e9c38fbe9faf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:30.664571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8a7d22-7b8d-439a-b40f-e9c38fbe9faf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:31.297780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:31.444276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3e8a7d22-7b8d-439a-b40f-e9c38fbe9faf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:31.471014 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e8a7d22-7b8d-439a-b40f-e9c38fbe9faf tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1477 microversion: 2.1 time: 0.856415 Aug 09 17:09:31.505860 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 672/1233] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:30 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1477 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:31.532456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-92f5c975-4852-47e0-85f1-55fd65e4556e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:31.540245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-92f5c975-4852-47e0-85f1-55fd65e4556e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:31.581653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f5c975-4852-47e0-85f1-55fd65e4556e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:31.588722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f5c975-4852-47e0-85f1-55fd65e4556e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:31.589666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f5c975-4852-47e0-85f1-55fd65e4556e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:31.593244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f5c975-4852-47e0-85f1-55fd65e4556e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:31.600772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f5c975-4852-47e0-85f1-55fd65e4556e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:31.604735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f5c975-4852-47e0-85f1-55fd65e4556e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:31.771235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9623662a-b3b5-46c4-bf5e-56548b199d3c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:31.791257 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9623662a-b3b5-46c4-bf5e-56548b199d3c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1487 microversion: 2.1 time: 1.887883 Aug 09 17:09:31.801353 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 562/1234] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:29 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1487 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:31.823479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2706a08c-1be6-4f7c-abd9-3c1aefd03e3a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:31.828430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2706a08c-1be6-4f7c-abd9-3c1aefd03e3a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:31.854723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2706a08c-1be6-4f7c-abd9-3c1aefd03e3a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:31.857124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2706a08c-1be6-4f7c-abd9-3c1aefd03e3a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:31.861482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2706a08c-1be6-4f7c-abd9-3c1aefd03e3a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:31.866505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2706a08c-1be6-4f7c-abd9-3c1aefd03e3a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:31.867817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2706a08c-1be6-4f7c-abd9-3c1aefd03e3a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:31.869910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2706a08c-1be6-4f7c-abd9-3c1aefd03e3a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:33.709732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-92f5c975-4852-47e0-85f1-55fd65e4556e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:33.722059 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-92f5c975-4852-47e0-85f1-55fd65e4556e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 2.213505 Aug 09 17:09:33.724628 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 673/1235] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:31 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:33.753124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-15a05d99-fe6d-463c-9878-be645582dfab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:33.757288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-15a05d99-fe6d-463c-9878-be645582dfab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:33.783907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a05d99-fe6d-463c-9878-be645582dfab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:33.785757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a05d99-fe6d-463c-9878-be645582dfab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:33.789606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a05d99-fe6d-463c-9878-be645582dfab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:33.792132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a05d99-fe6d-463c-9878-be645582dfab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:33.796591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a05d99-fe6d-463c-9878-be645582dfab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:33.797054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a05d99-fe6d-463c-9878-be645582dfab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:33.834604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:33.877219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-15a05d99-fe6d-463c-9878-be645582dfab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lazy-loading 'flavor' on Instance uuid b8806f1b-fc49-46e7-a732-04de3ee9e445 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:09:33.999414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2706a08c-1be6-4f7c-abd9-3c1aefd03e3a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:34.028492 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2706a08c-1be6-4f7c-abd9-3c1aefd03e3a tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1323 microversion: 2.1 time: 2.223462 Aug 09 17:09:34.029357 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 563/1236] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:31 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1323 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:34.040801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5c19eb74-c311-4d7c-b350-7550b17ded98 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:34.047838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5c19eb74-c311-4d7c-b350-7550b17ded98 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:34.075989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c19eb74-c311-4d7c-b350-7550b17ded98 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:34.085090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c19eb74-c311-4d7c-b350-7550b17ded98 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:34.088269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c19eb74-c311-4d7c-b350-7550b17ded98 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:34.098284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c19eb74-c311-4d7c-b350-7550b17ded98 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:34.099004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c19eb74-c311-4d7c-b350-7550b17ded98 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:34.099465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c19eb74-c311-4d7c-b350-7550b17ded98 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:34.257763 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-15a05d99-fe6d-463c-9878-be645582dfab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "POST /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445/action" status: 202 len: 0 microversion: 2.1 time: 0.526367 Aug 09 17:09:34.258733 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 674/1237] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:09:33 2022] POST /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:09:34.272905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8f764d69-98b8-4dce-acb6-f403fb812277 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:34.274117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8f764d69-98b8-4dce-acb6-f403fb812277 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:34.289949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f764d69-98b8-4dce-acb6-f403fb812277 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:34.290779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f764d69-98b8-4dce-acb6-f403fb812277 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:34.291230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f764d69-98b8-4dce-acb6-f403fb812277 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:34.292010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f764d69-98b8-4dce-acb6-f403fb812277 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:34.296490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f764d69-98b8-4dce-acb6-f403fb812277 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:34.297627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f764d69-98b8-4dce-acb6-f403fb812277 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:35.249452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8f764d69-98b8-4dce-acb6-f403fb812277 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:35.305091 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8f764d69-98b8-4dce-acb6-f403fb812277 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1495 microversion: 2.1 time: 1.041211 Aug 09 17:09:35.308519 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 675/1238] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:34 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1495 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:35.326127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9ae240d8-cb3a-4d8d-959e-ef54a1730479 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:35.335775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9ae240d8-cb3a-4d8d-959e-ef54a1730479 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:35.367065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae240d8-cb3a-4d8d-959e-ef54a1730479 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:35.376944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae240d8-cb3a-4d8d-959e-ef54a1730479 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:35.378239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae240d8-cb3a-4d8d-959e-ef54a1730479 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:35.380509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae240d8-cb3a-4d8d-959e-ef54a1730479 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:35.381673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae240d8-cb3a-4d8d-959e-ef54a1730479 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:35.382735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae240d8-cb3a-4d8d-959e-ef54a1730479 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:36.289452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9ae240d8-cb3a-4d8d-959e-ef54a1730479 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:36.346021 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9ae240d8-cb3a-4d8d-959e-ef54a1730479 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 1.035676 Aug 09 17:09:36.376686 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 676/1239] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:35 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:36.378476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a4eef03-9748-4a47-b912-6e93cd8efdfa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:36.396268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9a4eef03-9748-4a47-b912-6e93cd8efdfa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:36.438684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4eef03-9748-4a47-b912-6e93cd8efdfa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:36.442633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4eef03-9748-4a47-b912-6e93cd8efdfa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:36.443198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4eef03-9748-4a47-b912-6e93cd8efdfa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:36.444009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4eef03-9748-4a47-b912-6e93cd8efdfa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:36.444489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4eef03-9748-4a47-b912-6e93cd8efdfa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:36.444932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4eef03-9748-4a47-b912-6e93cd8efdfa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:37.155945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5c19eb74-c311-4d7c-b350-7550b17ded98 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:37.188692 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5c19eb74-c311-4d7c-b350-7550b17ded98 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1477 microversion: 2.1 time: 3.146186 Aug 09 17:09:37.209961 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 564/1240] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:34 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1477 bytes in 3180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:37.211273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9a4eef03-9748-4a47-b912-6e93cd8efdfa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:37.224469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fde78019-1627-4312-8f96-14bcf84bcb13 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:37.226181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fde78019-1627-4312-8f96-14bcf84bcb13 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:37.234593 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9a4eef03-9748-4a47-b912-6e93cd8efdfa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1323 microversion: 2.1 time: 0.867647 Aug 09 17:09:37.238683 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 677/1241] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:36 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1323 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:37.249681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ca2a5d22-3755-4ac9-8230-5e4ccbc8c756 req-95351412-881b-4f49-a0da-c210e628fed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a42c94f-6eeb-42bc-aa25-da394ea9e613", "tag": "9804ab6e-317c-4af4-9474-17e5a74ceaec"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:37.272916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde78019-1627-4312-8f96-14bcf84bcb13 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:37.275958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde78019-1627-4312-8f96-14bcf84bcb13 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:37.279926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde78019-1627-4312-8f96-14bcf84bcb13 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:37.286333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde78019-1627-4312-8f96-14bcf84bcb13 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:37.287451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde78019-1627-4312-8f96-14bcf84bcb13 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:37.290730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fde78019-1627-4312-8f96-14bcf84bcb13 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:37.292743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ca2a5d22-3755-4ac9-8230-5e4ccbc8c756 req-95351412-881b-4f49-a0da-c210e628fed6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:37.295858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ca2a5d22-3755-4ac9-8230-5e4ccbc8c756 req-95351412-881b-4f49-a0da-c210e628fed6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:37.297160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ca2a5d22-3755-4ac9-8230-5e4ccbc8c756 req-95351412-881b-4f49-a0da-c210e628fed6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:37.314111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:37.330025 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ca2a5d22-3755-4ac9-8230-5e4ccbc8c756 req-95351412-881b-4f49-a0da-c210e628fed6 service nova] Creating event network-changed:9804ab6e-317c-4af4-9474-17e5a74ceaec for instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 on n-h1-845781-6 Aug 09 17:09:37.339354 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ca2a5d22-3755-4ac9-8230-5e4ccbc8c756 req-95351412-881b-4f49-a0da-c210e628fed6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098323 Aug 09 17:09:37.340846 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 678/1242] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:37.439342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-166f3d94-f6e8-4a18-a2b9-0d14329df25f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:37.440382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-166f3d94-f6e8-4a18-a2b9-0d14329df25f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:37.470890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-166f3d94-f6e8-4a18-a2b9-0d14329df25f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:37.480738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-166f3d94-f6e8-4a18-a2b9-0d14329df25f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:37.482185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-166f3d94-f6e8-4a18-a2b9-0d14329df25f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:37.484004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-166f3d94-f6e8-4a18-a2b9-0d14329df25f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:37.485499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-166f3d94-f6e8-4a18-a2b9-0d14329df25f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:37.486643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-166f3d94-f6e8-4a18-a2b9-0d14329df25f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:38.933852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-166f3d94-f6e8-4a18-a2b9-0d14329df25f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:38.975271 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-166f3d94-f6e8-4a18-a2b9-0d14329df25f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 1.591429 Aug 09 17:09:39.020597 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 679/1243] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:37 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:39.045636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-179fcbb2-3750-4418-8490-00bfa758e9ed req-36ea77d7-32b0-402a-91d4-e46315069784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c388a7-598a-45ed-b478-0d6637f4e01c", "name": "network-vif-unplugged", "status": "completed", "tag": "d78a88ee-1bff-414f-892a-1adc2ebee7fc"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:39.074603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-179fcbb2-3750-4418-8490-00bfa758e9ed req-36ea77d7-32b0-402a-91d4-e46315069784 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:39.075587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-179fcbb2-3750-4418-8490-00bfa758e9ed req-36ea77d7-32b0-402a-91d4-e46315069784 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:39.076266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-179fcbb2-3750-4418-8490-00bfa758e9ed req-36ea77d7-32b0-402a-91d4-e46315069784 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:39.118475 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-179fcbb2-3750-4418-8490-00bfa758e9ed req-36ea77d7-32b0-402a-91d4-e46315069784 service nova] Creating event network-vif-unplugged:d78a88ee-1bff-414f-892a-1adc2ebee7fc for instance 32c388a7-598a-45ed-b478-0d6637f4e01c on n-h1-845781-6 Aug 09 17:09:39.134691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-179fcbb2-3750-4418-8490-00bfa758e9ed req-36ea77d7-32b0-402a-91d4-e46315069784 service nova] Instance 32c388a7-598a-45ed-b478-0d6637f4e01c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:09:39.173503 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-179fcbb2-3750-4418-8490-00bfa758e9ed req-36ea77d7-32b0-402a-91d4-e46315069784 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145358 Aug 09 17:09:39.177133 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 680/1244] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:39.200510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-34491785-bf1d-409b-9681-970e69bc6c0d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:39.217250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-34491785-bf1d-409b-9681-970e69bc6c0d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:39.255590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34491785-bf1d-409b-9681-970e69bc6c0d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:39.259295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34491785-bf1d-409b-9681-970e69bc6c0d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:39.259902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34491785-bf1d-409b-9681-970e69bc6c0d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:39.260692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34491785-bf1d-409b-9681-970e69bc6c0d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:39.261180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34491785-bf1d-409b-9681-970e69bc6c0d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:39.273704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34491785-bf1d-409b-9681-970e69bc6c0d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:39.763026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fde78019-1627-4312-8f96-14bcf84bcb13 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:39.811687 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fde78019-1627-4312-8f96-14bcf84bcb13 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 200 len: 1478 microversion: 2.1 time: 2.599936 Aug 09 17:09:39.833996 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 565/1245] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:37 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 1478 bytes in 2623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:39.846772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-92ecdc56-f61a-484d-af48-9175c4f7fb44 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:39.867581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-92ecdc56-f61a-484d-af48-9175c4f7fb44 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:39.898104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92ecdc56-f61a-484d-af48-9175c4f7fb44 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:39.899067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92ecdc56-f61a-484d-af48-9175c4f7fb44 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:39.905630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92ecdc56-f61a-484d-af48-9175c4f7fb44 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:39.907518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92ecdc56-f61a-484d-af48-9175c4f7fb44 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:39.915007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92ecdc56-f61a-484d-af48-9175c4f7fb44 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:39.918956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92ecdc56-f61a-484d-af48-9175c4f7fb44 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:39.979930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-34491785-bf1d-409b-9681-970e69bc6c0d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:39.994599 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-34491785-bf1d-409b-9681-970e69bc6c0d tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1476 microversion: 2.1 time: 0.815561 Aug 09 17:09:40.010052 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 681/1246] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:39 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1476 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:40.033500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-db1ab59f-cd32-4607-aa66-3a181e306015 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-220100486"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:40.041813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-db1ab59f-cd32-4607-aa66-3a181e306015 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:40.062894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1ab59f-cd32-4607-aa66-3a181e306015 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:40.066531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1ab59f-cd32-4607-aa66-3a181e306015 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:40.067425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1ab59f-cd32-4607-aa66-3a181e306015 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:40.069212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1ab59f-cd32-4607-aa66-3a181e306015 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:40.074312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1ab59f-cd32-4607-aa66-3a181e306015 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:40.075206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1ab59f-cd32-4607-aa66-3a181e306015 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:41.472333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-92ecdc56-f61a-484d-af48-9175c4f7fb44 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:41.496192 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-92ecdc56-f61a-484d-af48-9175c4f7fb44 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1323 microversion: 2.1 time: 1.658983 Aug 09 17:09:41.556074 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 566/1247] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:39 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1323 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:41.599218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7c8e859c-66e1-42f4-8349-4ffcbbae7d98 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:41.621962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7c8e859c-66e1-42f4-8349-4ffcbbae7d98 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:41.667564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c8e859c-66e1-42f4-8349-4ffcbbae7d98 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:41.668543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c8e859c-66e1-42f4-8349-4ffcbbae7d98 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:41.669379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c8e859c-66e1-42f4-8349-4ffcbbae7d98 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:41.670708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c8e859c-66e1-42f4-8349-4ffcbbae7d98 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:41.671589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c8e859c-66e1-42f4-8349-4ffcbbae7d98 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:41.690208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c8e859c-66e1-42f4-8349-4ffcbbae7d98 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:42.702627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7c8e859c-66e1-42f4-8349-4ffcbbae7d98 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:42.759592 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7c8e859c-66e1-42f4-8349-4ffcbbae7d98 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 1.191916 Aug 09 17:09:42.761606 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 567/1248] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:41 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:42.799007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-789fb2ea-1c05-4cb3-b842-63ce69289849 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:42.806771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-789fb2ea-1c05-4cb3-b842-63ce69289849 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:42.835088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=39 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:42.843458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-789fb2ea-1c05-4cb3-b842-63ce69289849 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:42.847793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-789fb2ea-1c05-4cb3-b842-63ce69289849 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:42.849508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-789fb2ea-1c05-4cb3-b842-63ce69289849 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:42.853532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-789fb2ea-1c05-4cb3-b842-63ce69289849 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:42.854696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-789fb2ea-1c05-4cb3-b842-63ce69289849 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:42.859104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-789fb2ea-1c05-4cb3-b842-63ce69289849 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:44.681906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-789fb2ea-1c05-4cb3-b842-63ce69289849 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:44.732391 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-789fb2ea-1c05-4cb3-b842-63ce69289849 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1476 microversion: 2.1 time: 1.966727 Aug 09 17:09:44.740822 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 568/1249] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:42 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1476 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:44.749614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a897b279-afcc-406d-8b99-4e14016238d6 req-9d547ca7-3999-4a96-9179-2ccd4c454447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9bf5c5-13a8-4999-9fe7-e31ca09ad767", "tag": "4e14d13a-f750-41b6-9e8f-9ebfa131fe82"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:44.794000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a897b279-afcc-406d-8b99-4e14016238d6 req-9d547ca7-3999-4a96-9179-2ccd4c454447 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:44.795358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a897b279-afcc-406d-8b99-4e14016238d6 req-9d547ca7-3999-4a96-9179-2ccd4c454447 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:44.797640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a897b279-afcc-406d-8b99-4e14016238d6 req-9d547ca7-3999-4a96-9179-2ccd4c454447 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:44.845674 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a897b279-afcc-406d-8b99-4e14016238d6 req-9d547ca7-3999-4a96-9179-2ccd4c454447 service nova] Creating event network-changed:4e14d13a-f750-41b6-9e8f-9ebfa131fe82 for instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 on n-h1-845781-6 Aug 09 17:09:44.868840 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a897b279-afcc-406d-8b99-4e14016238d6 req-9d547ca7-3999-4a96-9179-2ccd4c454447 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125897 Aug 09 17:09:44.869484 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 569/1250] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:44.915168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d5861bbc-ab46-4c40-bc14-4feaf3f9cb32 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:44.917364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d5861bbc-ab46-4c40-bc14-4feaf3f9cb32 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:44.944859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5861bbc-ab46-4c40-bc14-4feaf3f9cb32 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:44.954277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5861bbc-ab46-4c40-bc14-4feaf3f9cb32 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:44.959706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5861bbc-ab46-4c40-bc14-4feaf3f9cb32 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:44.965010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5861bbc-ab46-4c40-bc14-4feaf3f9cb32 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:44.972844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5861bbc-ab46-4c40-bc14-4feaf3f9cb32 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:44.973317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5861bbc-ab46-4c40-bc14-4feaf3f9cb32 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:46.309357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d5861bbc-ab46-4c40-bc14-4feaf3f9cb32 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:46.348794 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d5861bbc-ab46-4c40-bc14-4feaf3f9cb32 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1323 microversion: 2.1 time: 1.462235 Aug 09 17:09:46.354575 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 570/1251] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:44 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1323 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:46.389868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ead6e8f-7162-48fe-8f50-c5e99d3ad06e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:46.393721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3ead6e8f-7162-48fe-8f50-c5e99d3ad06e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:46.427886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ead6e8f-7162-48fe-8f50-c5e99d3ad06e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:46.432859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ead6e8f-7162-48fe-8f50-c5e99d3ad06e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:46.434190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ead6e8f-7162-48fe-8f50-c5e99d3ad06e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:46.438256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ead6e8f-7162-48fe-8f50-c5e99d3ad06e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:46.439524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ead6e8f-7162-48fe-8f50-c5e99d3ad06e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:46.442506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ead6e8f-7162-48fe-8f50-c5e99d3ad06e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:47.719710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3ead6e8f-7162-48fe-8f50-c5e99d3ad06e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:47.779383 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3ead6e8f-7162-48fe-8f50-c5e99d3ad06e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 1.423052 Aug 09 17:09:47.808841 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 571/1252] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:46 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:47.820471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e106ed14-fbff-4e23-84a3-ed2e105d7fbb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:47.825474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e106ed14-fbff-4e23-84a3-ed2e105d7fbb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:47.840174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e106ed14-fbff-4e23-84a3-ed2e105d7fbb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:47.841865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e106ed14-fbff-4e23-84a3-ed2e105d7fbb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:47.843203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e106ed14-fbff-4e23-84a3-ed2e105d7fbb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:47.845043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e106ed14-fbff-4e23-84a3-ed2e105d7fbb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:47.853999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e106ed14-fbff-4e23-84a3-ed2e105d7fbb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:47.855928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e106ed14-fbff-4e23-84a3-ed2e105d7fbb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:48.345448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e106ed14-fbff-4e23-84a3-ed2e105d7fbb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:48.388421 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e106ed14-fbff-4e23-84a3-ed2e105d7fbb tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1474 microversion: 2.1 time: 0.576888 Aug 09 17:09:48.393602 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 572/1253] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:47 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1474 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:48.401428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e3d8a807-b87d-48dd-8079-4507242b92e1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:48.402980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e3d8a807-b87d-48dd-8079-4507242b92e1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:48.413663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3d8a807-b87d-48dd-8079-4507242b92e1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:48.415031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3d8a807-b87d-48dd-8079-4507242b92e1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:48.416477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3d8a807-b87d-48dd-8079-4507242b92e1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:48.419472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3d8a807-b87d-48dd-8079-4507242b92e1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:48.420648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3d8a807-b87d-48dd-8079-4507242b92e1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:48.421379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3d8a807-b87d-48dd-8079-4507242b92e1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:48.663689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e3d8a807-b87d-48dd-8079-4507242b92e1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:48.687156 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e3d8a807-b87d-48dd-8079-4507242b92e1 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1323 microversion: 2.1 time: 0.290937 Aug 09 17:09:48.688478 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 573/1254] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:48 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:48.698885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-64d0191f-e453-4810-bde8-28585c2229eb req-2ccf383c-8cec-4ebc-8bc8-27176817d3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c388a7-598a-45ed-b478-0d6637f4e01c", "tag": "d78a88ee-1bff-414f-892a-1adc2ebee7fc"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:48.750688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-64d0191f-e453-4810-bde8-28585c2229eb req-2ccf383c-8cec-4ebc-8bc8-27176817d3fc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:48.756196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-64d0191f-e453-4810-bde8-28585c2229eb req-2ccf383c-8cec-4ebc-8bc8-27176817d3fc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:48.757174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-64d0191f-e453-4810-bde8-28585c2229eb req-2ccf383c-8cec-4ebc-8bc8-27176817d3fc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:48.826906 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-64d0191f-e453-4810-bde8-28585c2229eb req-2ccf383c-8cec-4ebc-8bc8-27176817d3fc service nova] Creating event network-changed:d78a88ee-1bff-414f-892a-1adc2ebee7fc for instance 32c388a7-598a-45ed-b478-0d6637f4e01c on n-h1-845781-6 Aug 09 17:09:48.879785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-64d0191f-e453-4810-bde8-28585c2229eb req-2ccf383c-8cec-4ebc-8bc8-27176817d3fc service nova] Instance 32c388a7-598a-45ed-b478-0d6637f4e01c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:09:48.922121 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-64d0191f-e453-4810-bde8-28585c2229eb req-2ccf383c-8cec-4ebc-8bc8-27176817d3fc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222517 Aug 09 17:09:48.924788 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 574/1255] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:49.131974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-816134523", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "052ffadd-935e-4598-b902-1208975fc460"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:50.060639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:50.156975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:09:55.556407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] validate_networks() for [('052ffadd-935e-4598-b902-1208975fc460', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:09:55.673119 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-db1ab59f-cd32-4607-aa66-3a181e306015 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "POST /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445/action" status: 202 len: 0 microversion: 2.1 time: 15.655876 Aug 09 17:09:55.678187 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 682/1256] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:09:40 2022] POST /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445/action => generated 0 bytes in 15668 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 17:09:55.702143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7eeea608-ecae-4bad-a5a1-9da03a46f4ef tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:55.705417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7eeea608-ecae-4bad-a5a1-9da03a46f4ef tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:55.733415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7eeea608-ecae-4bad-a5a1-9da03a46f4ef tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:55.735108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7eeea608-ecae-4bad-a5a1-9da03a46f4ef tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:55.736316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7eeea608-ecae-4bad-a5a1-9da03a46f4ef tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:55.738613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7eeea608-ecae-4bad-a5a1-9da03a46f4ef tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:55.740039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7eeea608-ecae-4bad-a5a1-9da03a46f4ef tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:55.741137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7eeea608-ecae-4bad-a5a1-9da03a46f4ef tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:56.160499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7eeea608-ecae-4bad-a5a1-9da03a46f4ef tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:56.179354 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7eeea608-ecae-4bad-a5a1-9da03a46f4ef tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 0.489620 Aug 09 17:09:56.179354 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 683/1257] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:55 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:56.240377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ca7e65ef-bf4f-4b96-b90c-93b3013ab962 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:56.250057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ca7e65ef-bf4f-4b96-b90c-93b3013ab962 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:56.300856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca7e65ef-bf4f-4b96-b90c-93b3013ab962 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:56.309354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca7e65ef-bf4f-4b96-b90c-93b3013ab962 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:56.314228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca7e65ef-bf4f-4b96-b90c-93b3013ab962 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:56.317756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca7e65ef-bf4f-4b96-b90c-93b3013ab962 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:56.323815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca7e65ef-bf4f-4b96-b90c-93b3013ab962 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:56.326689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca7e65ef-bf4f-4b96-b90c-93b3013ab962 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:56.796563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ca7e65ef-bf4f-4b96-b90c-93b3013ab962 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:56.819086 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ca7e65ef-bf4f-4b96-b90c-93b3013ab962 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1471 microversion: 2.1 time: 0.646807 Aug 09 17:09:56.820516 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 684/1258] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:56 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1471 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:56.863664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c284d2b6-a7bc-41a2-953a-34b853d343bf tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:56.865494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c284d2b6-a7bc-41a2-953a-34b853d343bf tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:56.879689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c284d2b6-a7bc-41a2-953a-34b853d343bf tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:56.880961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c284d2b6-a7bc-41a2-953a-34b853d343bf tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:56.881996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c284d2b6-a7bc-41a2-953a-34b853d343bf tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:56.885145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c284d2b6-a7bc-41a2-953a-34b853d343bf tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:56.886242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c284d2b6-a7bc-41a2-953a-34b853d343bf tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:56.887249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c284d2b6-a7bc-41a2-953a-34b853d343bf tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:56.958318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:09:56.959147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:09:56.959337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:09:56.959661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:09:56.960090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:09:56.971753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:56.972432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:56.973107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:56.974112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:56.974820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:56.975924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:56.999058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Getting quotas for project 5f21dc5544604cbfad9a198e47639911. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:09:57.006383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Getting quotas for user 15746b3e026244a9ba11f072b26f6a46 and project 5f21dc5544604cbfad9a198e47639911. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:09:57.029098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:09:57.032045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:09:57.179133 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2f0540f6-2c2d-4631-a9be-759b4de26cc1 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.249867 Aug 09 17:09:57.180815 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 575/1259] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:09:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 8255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:09:57.193054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e91270b0-1685-4dd6-a0fb-0b475adc0a97 req-3c6ef9f0-3b32-471e-ba08-f1abc92314d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a42c94f-6eeb-42bc-aa25-da394ea9e613", "name": "network-vif-plugged", "status": "completed", "tag": "9804ab6e-317c-4af4-9474-17e5a74ceaec"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:57.204418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e91270b0-1685-4dd6-a0fb-0b475adc0a97 req-3c6ef9f0-3b32-471e-ba08-f1abc92314d5 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:57.205624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e91270b0-1685-4dd6-a0fb-0b475adc0a97 req-3c6ef9f0-3b32-471e-ba08-f1abc92314d5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:57.206278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e91270b0-1685-4dd6-a0fb-0b475adc0a97 req-3c6ef9f0-3b32-471e-ba08-f1abc92314d5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:57.223173 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e91270b0-1685-4dd6-a0fb-0b475adc0a97 req-3c6ef9f0-3b32-471e-ba08-f1abc92314d5 service nova] Creating event network-vif-plugged:9804ab6e-317c-4af4-9474-17e5a74ceaec for instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 on n-h1-845781-6 Aug 09 17:09:57.231236 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e91270b0-1685-4dd6-a0fb-0b475adc0a97 req-3c6ef9f0-3b32-471e-ba08-f1abc92314d5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047554 Aug 09 17:09:57.235084 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 576/1260] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:57.314662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-bc461700-930d-4b5c-bc10-249b06a43723 req-a3332058-1e0f-4c6e-85e2-649e6609c50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bde0f3f-3670-4908-bc71-f4af6b3671b2", "name": "network-vif-unplugged", "status": "completed", "tag": "02f77b41-d5fc-4f8a-8aac-6e744c227b20"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:57.357922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c284d2b6-a7bc-41a2-953a-34b853d343bf tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:57.361657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-bc461700-930d-4b5c-bc10-249b06a43723 req-a3332058-1e0f-4c6e-85e2-649e6609c50b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:57.364411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-bc461700-930d-4b5c-bc10-249b06a43723 req-a3332058-1e0f-4c6e-85e2-649e6609c50b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:57.365371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-bc461700-930d-4b5c-bc10-249b06a43723 req-a3332058-1e0f-4c6e-85e2-649e6609c50b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:57.385462 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c284d2b6-a7bc-41a2-953a-34b853d343bf tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1323 microversion: 2.1 time: 0.549513 Aug 09 17:09:57.392609 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-bc461700-930d-4b5c-bc10-249b06a43723 req-a3332058-1e0f-4c6e-85e2-649e6609c50b service nova] Creating event network-vif-unplugged:02f77b41-d5fc-4f8a-8aac-6e744c227b20 for instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 on n-h2-845781-6 Aug 09 17:09:57.401133 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 685/1261] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:56 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1323 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:57.415122 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-bc461700-930d-4b5c-bc10-249b06a43723 req-a3332058-1e0f-4c6e-85e2-649e6609c50b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165711 Aug 09 17:09:57.415122 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 577/1262] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:57.415122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5486b2ca-cffd-4b9c-b418-c1b3279f2b8e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:57.415122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5486b2ca-cffd-4b9c-b418-c1b3279f2b8e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:57.427146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-503a8abe-939b-41a7-a5ff-23fd444d3eae tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb4fbe50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:57.431839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5486b2ca-cffd-4b9c-b418-c1b3279f2b8e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:57.432528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5486b2ca-cffd-4b9c-b418-c1b3279f2b8e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:57.433000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5486b2ca-cffd-4b9c-b418-c1b3279f2b8e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:57.433784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5486b2ca-cffd-4b9c-b418-c1b3279f2b8e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:57.434264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5486b2ca-cffd-4b9c-b418-c1b3279f2b8e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:57.434713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5486b2ca-cffd-4b9c-b418-c1b3279f2b8e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:57.598778 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-503a8abe-939b-41a7-a5ff-23fd444d3eae tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884" status: 200 len: 1439 microversion: 2.1 time: 0.194584 Aug 09 17:09:57.616699 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 686/1263] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:09:57 2022] GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884 => generated 1439 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:57.645412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c839f936-33c1-4057-8703-c22a8a385ed6 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:57.651004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c839f936-33c1-4057-8703-c22a8a385ed6 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:57.854274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c839f936-33c1-4057-8703-c22a8a385ed6 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:57.863835 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c839f936-33c1-4057-8703-c22a8a385ed6 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1215 microversion: 2.1 time: 0.241096 Aug 09 17:09:57.864676 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 687/1264] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:57 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1215 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:57.884919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9534541d-ab7c-4675-ab34-9461a1182bf9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:57.885538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9534541d-ab7c-4675-ab34-9461a1182bf9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:57.898679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9534541d-ab7c-4675-ab34-9461a1182bf9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:57.900464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9534541d-ab7c-4675-ab34-9461a1182bf9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:57.901097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9534541d-ab7c-4675-ab34-9461a1182bf9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:57.901870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9534541d-ab7c-4675-ab34-9461a1182bf9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:57.902430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9534541d-ab7c-4675-ab34-9461a1182bf9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:57.902854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9534541d-ab7c-4675-ab34-9461a1182bf9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:57.931237 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5486b2ca-cffd-4b9c-b418-c1b3279f2b8e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "POST /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c/action" status: 202 len: 0 microversion: 2.1 time: 0.525066 Aug 09 17:09:57.931906 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 578/1265] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:09:57 2022] POST /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:09:58.288668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9534541d-ab7c-4675-ab34-9461a1182bf9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:58.302582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-79739cd9-c499-4079-9818-648ca9f0be40 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Action: 'create', calling method: .version_select at 0x7fbbcb8db5e0>, body: {"keypair": {"name": "tempest-keypair-2016277638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6JfKMHyB2rRNxR46KkhTUS1B7YxriVeez05i7lR9RkNGNPWij6/XeEaeRMMXIk8nnV98erEuHJZ1Oc3SuTxjFXE+JNE0mfOj0PitBeJWYmeI5JswMQl0DLtM90u3jbVQ=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:58.311961 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9534541d-ab7c-4675-ab34-9461a1182bf9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 0.431249 Aug 09 17:09:58.329341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-79739cd9-c499-4079-9818-648ca9f0be40 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Getting quotas for project cb4177dbe7e94a8e8381561de0e40575. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:09:58.336382 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 688/1266] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:57 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:58.336629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-79739cd9-c499-4079-9818-648ca9f0be40 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Getting quotas for user 8721b8f0cd0a46f489ab540cd8db9357 and project cb4177dbe7e94a8e8381561de0e40575. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:09:58.357571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4bbfcbf4-03aa-4106-84e4-b42c6bc540dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:58.361688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4bbfcbf4-03aa-4106-84e4-b42c6bc540dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:58.379095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bbfcbf4-03aa-4106-84e4-b42c6bc540dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:58.379095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bbfcbf4-03aa-4106-84e4-b42c6bc540dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:58.381015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bbfcbf4-03aa-4106-84e4-b42c6bc540dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:58.383614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bbfcbf4-03aa-4106-84e4-b42c6bc540dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:58.385959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bbfcbf4-03aa-4106-84e4-b42c6bc540dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:58.388973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bbfcbf4-03aa-4106-84e4-b42c6bc540dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:58.407026 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-79739cd9-c499-4079-9818-648ca9f0be40 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.473342 Aug 09 17:09:58.411448 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 579/1267] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:09:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:09:58.433407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9e85e283-f58a-4377-af48-5cb88318b144 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:58.435430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9e85e283-f58a-4377-af48-5cb88318b144 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:58.445263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e85e283-f58a-4377-af48-5cb88318b144 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:58.446081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e85e283-f58a-4377-af48-5cb88318b144 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:58.446820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e85e283-f58a-4377-af48-5cb88318b144 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:58.447816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e85e283-f58a-4377-af48-5cb88318b144 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:58.448763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e85e283-f58a-4377-af48-5cb88318b144 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:58.449931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e85e283-f58a-4377-af48-5cb88318b144 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:58.981989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9e85e283-f58a-4377-af48-5cb88318b144 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:59.013651 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9e85e283-f58a-4377-af48-5cb88318b144 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1323 microversion: 2.1 time: 0.585610 Aug 09 17:09:59.015290 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 580/1268] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:58 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1323 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:09:59.071439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-15762530-752b-4a59-9997-d58a289fcb73 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb825a60>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:59.120131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4bbfcbf4-03aa-4106-84e4-b42c6bc540dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:59.157525 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4bbfcbf4-03aa-4106-84e4-b42c6bc540dc tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1470 microversion: 2.1 time: 0.819161 Aug 09 17:09:59.168030 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 689/1269] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:58 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1470 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:59.192072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6ebc7b82-cb27-4b2d-970b-071c8beef128 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:59.195245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6ebc7b82-cb27-4b2d-970b-071c8beef128 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:59.202202 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-15762530-752b-4a59-9997-d58a289fcb73 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884" status: 200 len: 1439 microversion: 2.1 time: 0.170023 Aug 09 17:09:59.204735 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 581/1270] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:09:59 2022] GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884 => generated 1439 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:59.218380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ebc7b82-cb27-4b2d-970b-071c8beef128 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:59.222411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ebc7b82-cb27-4b2d-970b-071c8beef128 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:59.223253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ebc7b82-cb27-4b2d-970b-071c8beef128 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:59.226646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ebc7b82-cb27-4b2d-970b-071c8beef128 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:59.227482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ebc7b82-cb27-4b2d-970b-071c8beef128 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:59.228224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ebc7b82-cb27-4b2d-970b-071c8beef128 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:59.258574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2785b863-7e20-4511-bf8c-4b12d0500abe req-5566d56d-64a3-4191-9e36-24c074d3cc76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c388a7-598a-45ed-b478-0d6637f4e01c", "name": "network-vif-plugged", "status": "completed", "tag": "d78a88ee-1bff-414f-892a-1adc2ebee7fc"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:59.280312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2785b863-7e20-4511-bf8c-4b12d0500abe req-5566d56d-64a3-4191-9e36-24c074d3cc76 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:59.283181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2785b863-7e20-4511-bf8c-4b12d0500abe req-5566d56d-64a3-4191-9e36-24c074d3cc76 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:59.284226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2785b863-7e20-4511-bf8c-4b12d0500abe req-5566d56d-64a3-4191-9e36-24c074d3cc76 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:59.313690 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2785b863-7e20-4511-bf8c-4b12d0500abe req-5566d56d-64a3-4191-9e36-24c074d3cc76 service nova] Creating event network-vif-plugged:d78a88ee-1bff-414f-892a-1adc2ebee7fc for instance 32c388a7-598a-45ed-b478-0d6637f4e01c on n-h1-845781-6 Aug 09 17:09:59.331235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-2785b863-7e20-4511-bf8c-4b12d0500abe req-5566d56d-64a3-4191-9e36-24c074d3cc76 service nova] Instance 32c388a7-598a-45ed-b478-0d6637f4e01c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:09:59.361384 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-2785b863-7e20-4511-bf8c-4b12d0500abe req-5566d56d-64a3-4191-9e36-24c074d3cc76 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106898 Aug 09 17:09:59.363544 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 582/1271] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:09:59.372825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8bc0daa5-10a8-4b86-b852-f8080c1799f9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:09:59.374081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8bc0daa5-10a8-4b86-b852-f8080c1799f9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:09:59.392251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bc0daa5-10a8-4b86-b852-f8080c1799f9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:59.393680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bc0daa5-10a8-4b86-b852-f8080c1799f9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:59.396966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bc0daa5-10a8-4b86-b852-f8080c1799f9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:59.399317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bc0daa5-10a8-4b86-b852-f8080c1799f9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:59.401195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bc0daa5-10a8-4b86-b852-f8080c1799f9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:59.402518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bc0daa5-10a8-4b86-b852-f8080c1799f9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:59.414847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6ebc7b82-cb27-4b2d-970b-071c8beef128 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:09:59.454776 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6ebc7b82-cb27-4b2d-970b-071c8beef128 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1267 microversion: 2.1 time: 0.282577 Aug 09 17:09:59.469187 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 690/1272] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:59 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1267 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:09:59.516511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-aa6952ec-90ae-4fd4-920d-89ce9b39ba0f req-5429295e-22ec-48a1-ba66-59bf86af1982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bde0f3f-3670-4908-bc71-f4af6b3671b2", "tag": "02f77b41-d5fc-4f8a-8aac-6e744c227b20"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:09:59.585963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aa6952ec-90ae-4fd4-920d-89ce9b39ba0f req-5429295e-22ec-48a1-ba66-59bf86af1982 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:09:59.591317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aa6952ec-90ae-4fd4-920d-89ce9b39ba0f req-5429295e-22ec-48a1-ba66-59bf86af1982 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:09:59.592887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aa6952ec-90ae-4fd4-920d-89ce9b39ba0f req-5429295e-22ec-48a1-ba66-59bf86af1982 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:09:59.645378 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-aa6952ec-90ae-4fd4-920d-89ce9b39ba0f req-5429295e-22ec-48a1-ba66-59bf86af1982 service nova] Creating event network-changed:02f77b41-d5fc-4f8a-8aac-6e744c227b20 for instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 on n-h2-845781-6 Aug 09 17:09:59.669925 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-aa6952ec-90ae-4fd4-920d-89ce9b39ba0f req-5429295e-22ec-48a1-ba66-59bf86af1982 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174078 Aug 09 17:09:59.677268 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 691/1273] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:00.059530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66530cc9-5418-4442-bf72-060ab71d87a8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:00.060594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-66530cc9-5418-4442-bf72-060ab71d87a8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:00.074670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66530cc9-5418-4442-bf72-060ab71d87a8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:00.084468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66530cc9-5418-4442-bf72-060ab71d87a8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:00.088100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66530cc9-5418-4442-bf72-060ab71d87a8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:00.090785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66530cc9-5418-4442-bf72-060ab71d87a8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:00.091524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66530cc9-5418-4442-bf72-060ab71d87a8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:00.098621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66530cc9-5418-4442-bf72-060ab71d87a8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:00.827005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8bc0daa5-10a8-4b86-b852-f8080c1799f9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:00.847064 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8bc0daa5-10a8-4b86-b852-f8080c1799f9 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 1.481236 Aug 09 17:10:00.876073 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 583/1274] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:09:59 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:00.897622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5d4626e-b478-495b-bdec-a4155910780f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:00.908614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5d4626e-b478-495b-bdec-a4155910780f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:00.929444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d4626e-b478-495b-bdec-a4155910780f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:00.930597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d4626e-b478-495b-bdec-a4155910780f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:00.931281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d4626e-b478-495b-bdec-a4155910780f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:00.932364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d4626e-b478-495b-bdec-a4155910780f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:00.933150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d4626e-b478-495b-bdec-a4155910780f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:00.933831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d4626e-b478-495b-bdec-a4155910780f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:01.134618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-66530cc9-5418-4442-bf72-060ab71d87a8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:01.161671 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66530cc9-5418-4442-bf72-060ab71d87a8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 200 len: 1519 microversion: 2.1 time: 1.107962 Aug 09 17:10:01.176151 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 692/1275] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:00 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 1519 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:10:01.192910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29d6088e-8c8e-46bb-8d10-701a88346e34 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb642160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:01.384034 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-29d6088e-8c8e-46bb-8d10-701a88346e34 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884" status: 200 len: 1439 microversion: 2.1 time: 0.203677 Aug 09 17:10:01.401163 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 693/1276] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:10:01 2022] GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884 => generated 1439 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:01.416622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8ae72b6d-8095-43bb-ac8b-dcb520a0fa3c tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:01.428023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ae72b6d-8095-43bb-ac8b-dcb520a0fa3c tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:01.461554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae72b6d-8095-43bb-ac8b-dcb520a0fa3c tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:01.465319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae72b6d-8095-43bb-ac8b-dcb520a0fa3c tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:01.469154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae72b6d-8095-43bb-ac8b-dcb520a0fa3c tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:01.472381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae72b6d-8095-43bb-ac8b-dcb520a0fa3c tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:01.476863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae72b6d-8095-43bb-ac8b-dcb520a0fa3c tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:01.482143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae72b6d-8095-43bb-ac8b-dcb520a0fa3c tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:01.816736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8ae72b6d-8095-43bb-ac8b-dcb520a0fa3c tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:01.850625 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8ae72b6d-8095-43bb-ac8b-dcb520a0fa3c tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1273 microversion: 2.1 time: 0.444972 Aug 09 17:10:01.852266 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 694/1277] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:01 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1273 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:01.870844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.9"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:01.886212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:01.917454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:01.919064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:01.923883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:01.929768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:01.931244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:01.932407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:02.052831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "refresh_cache-7d4494b3-976f-4185-936c-52c1ba795d41" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:10:02.053937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquired lock "refresh_cache-7d4494b3-976f-4185-936c-52c1ba795d41" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:10:02.433689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e5d4626e-b478-495b-bdec-a4155910780f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:02.471976 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5d4626e-b478-495b-bdec-a4155910780f tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1470 microversion: 2.1 time: 1.593848 Aug 09 17:10:02.473681 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 584/1278] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:00 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1470 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:02.505819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-03b9a5a0-4be6-4c43-950a-f74faec87c84 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:02.521695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-03b9a5a0-4be6-4c43-950a-f74faec87c84 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:02.563234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b9a5a0-4be6-4c43-950a-f74faec87c84 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:02.564343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b9a5a0-4be6-4c43-950a-f74faec87c84 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:02.565167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b9a5a0-4be6-4c43-950a-f74faec87c84 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:02.579754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b9a5a0-4be6-4c43-950a-f74faec87c84 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:02.580439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b9a5a0-4be6-4c43-950a-f74faec87c84 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:02.580909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b9a5a0-4be6-4c43-950a-f74faec87c84 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:02.657871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:04.156924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-03b9a5a0-4be6-4c43-950a-f74faec87c84 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:04.173386 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-03b9a5a0-4be6-4c43-950a-f74faec87c84 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 1.695863 Aug 09 17:10:04.189918 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 585/1279] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:02 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:04.201726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-fa487a6c-2d6a-46e4-85cc-52e895aa08f2 req-a1769ed3-68f1-412b-a842-ec9362439e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8806f1b-fc49-46e7-a732-04de3ee9e445", "name": "network-vif-plugged", "status": "completed", "tag": "7921ceb6-216e-4e5f-9c52-c560bf15be4a"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:04.226452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fa487a6c-2d6a-46e4-85cc-52e895aa08f2 req-a1769ed3-68f1-412b-a842-ec9362439e90 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:04.229125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fa487a6c-2d6a-46e4-85cc-52e895aa08f2 req-a1769ed3-68f1-412b-a842-ec9362439e90 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:04.231523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fa487a6c-2d6a-46e4-85cc-52e895aa08f2 req-a1769ed3-68f1-412b-a842-ec9362439e90 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:04.261475 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-fa487a6c-2d6a-46e4-85cc-52e895aa08f2 req-a1769ed3-68f1-412b-a842-ec9362439e90 service nova] Creating event network-vif-plugged:7921ceb6-216e-4e5f-9c52-c560bf15be4a for instance b8806f1b-fc49-46e7-a732-04de3ee9e445 on n-h2-845781-6 Aug 09 17:10:04.277150 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-fa487a6c-2d6a-46e4-85cc-52e895aa08f2 req-a1769ed3-68f1-412b-a842-ec9362439e90 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085038 Aug 09 17:10:04.284104 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 586/1280] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:04.301077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-39d71800-14c5-4e4c-8b6a-253c32d8a77b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbc0e310>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:04.470349 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-39d71800-14c5-4e4c-8b6a-253c32d8a77b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884" status: 200 len: 1439 microversion: 2.1 time: 0.183865 Aug 09 17:10:04.479899 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 587/1281] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:10:04 2022] GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884 => generated 1439 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:04.486119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f9b05c55-1736-4aa0-9033-eef4a10cc675 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:04.490188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f9b05c55-1736-4aa0-9033-eef4a10cc675 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:04.511844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9b05c55-1736-4aa0-9033-eef4a10cc675 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:04.512693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9b05c55-1736-4aa0-9033-eef4a10cc675 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:04.513407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9b05c55-1736-4aa0-9033-eef4a10cc675 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:04.514489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9b05c55-1736-4aa0-9033-eef4a10cc675 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:04.515302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9b05c55-1736-4aa0-9033-eef4a10cc675 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:04.515953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9b05c55-1736-4aa0-9033-eef4a10cc675 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:04.726941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f9b05c55-1736-4aa0-9033-eef4a10cc675 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:04.768559 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f9b05c55-1736-4aa0-9033-eef4a10cc675 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1273 microversion: 2.1 time: 0.287016 Aug 09 17:10:04.773639 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 588/1282] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:04 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1273 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:04.792660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-42c35353-6935-4198-8394-94027648a3e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:04.796236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-42c35353-6935-4198-8394-94027648a3e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:04.824881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42c35353-6935-4198-8394-94027648a3e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:04.832145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42c35353-6935-4198-8394-94027648a3e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:04.832801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42c35353-6935-4198-8394-94027648a3e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:04.845000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42c35353-6935-4198-8394-94027648a3e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:04.845853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42c35353-6935-4198-8394-94027648a3e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:04.848455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42c35353-6935-4198-8394-94027648a3e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:06.252643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-42c35353-6935-4198-8394-94027648a3e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:06.268103 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-42c35353-6935-4198-8394-94027648a3e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1470 microversion: 2.1 time: 1.490840 Aug 09 17:10:06.290743 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 589/1283] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:04 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1470 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:06.308108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9f479ff3-45ec-453a-b630-8e0582ab0682 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:06.318253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9f479ff3-45ec-453a-b630-8e0582ab0682 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:06.341351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f479ff3-45ec-453a-b630-8e0582ab0682 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:06.346780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f479ff3-45ec-453a-b630-8e0582ab0682 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:06.350815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f479ff3-45ec-453a-b630-8e0582ab0682 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:06.354069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f479ff3-45ec-453a-b630-8e0582ab0682 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:06.355041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f479ff3-45ec-453a-b630-8e0582ab0682 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:06.359946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f479ff3-45ec-453a-b630-8e0582ab0682 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:06.579252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Building network info cache for instance {{(pid=119431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 17:10:06.990726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:07.606032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9f479ff3-45ec-453a-b630-8e0582ab0682 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:07.679816 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9f479ff3-45ec-453a-b630-8e0582ab0682 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 1.360265 Aug 09 17:10:07.709226 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 590/1284] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:06 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:07.723179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d27da41d-11e0-4b7c-85f2-96a4a9dedda4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb7b1ca0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:07.859961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:07.902365 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d27da41d-11e0-4b7c-85f2-96a4a9dedda4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884" status: 200 len: 1439 microversion: 2.1 time: 0.188690 Aug 09 17:10:07.903438 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 591/1285] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:10:07 2022] GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884 => generated 1439 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:07.944044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c31fc64-dd78-4a18-accd-b9ce0f017014 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:07.945576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2c31fc64-dd78-4a18-accd-b9ce0f017014 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:07.971040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c31fc64-dd78-4a18-accd-b9ce0f017014 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:07.979339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c31fc64-dd78-4a18-accd-b9ce0f017014 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:07.980579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c31fc64-dd78-4a18-accd-b9ce0f017014 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:07.982186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c31fc64-dd78-4a18-accd-b9ce0f017014 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:07.983284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c31fc64-dd78-4a18-accd-b9ce0f017014 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:07.989466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c31fc64-dd78-4a18-accd-b9ce0f017014 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:08.356449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=10 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:09.081025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2c31fc64-dd78-4a18-accd-b9ce0f017014 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:09.108650 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2c31fc64-dd78-4a18-accd-b9ce0f017014 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1315 microversion: 2.1 time: 1.197692 Aug 09 17:10:09.124387 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 592/1286] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:07 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1315 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:09.163940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d2ed9692-d7e5-49f1-aba0-f85f6b2e8b58 req-925566e6-c87e-498b-9110-8768a37e3f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d4494b3-976f-4185-936c-52c1ba795d41", "tag": "8dd9f845-7b2b-4c86-856a-d0c2faf3c649"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:09.201371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d2ed9692-d7e5-49f1-aba0-f85f6b2e8b58 req-925566e6-c87e-498b-9110-8768a37e3f2a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:09.202655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d2ed9692-d7e5-49f1-aba0-f85f6b2e8b58 req-925566e6-c87e-498b-9110-8768a37e3f2a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:09.203754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d2ed9692-d7e5-49f1-aba0-f85f6b2e8b58 req-925566e6-c87e-498b-9110-8768a37e3f2a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:09.233916 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d2ed9692-d7e5-49f1-aba0-f85f6b2e8b58 req-925566e6-c87e-498b-9110-8768a37e3f2a service nova] Creating event network-changed:8dd9f845-7b2b-4c86-856a-d0c2faf3c649 for instance 7d4494b3-976f-4185-936c-52c1ba795d41 on n-h1-845781-6 Aug 09 17:10:09.245526 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d2ed9692-d7e5-49f1-aba0-f85f6b2e8b58 req-925566e6-c87e-498b-9110-8768a37e3f2a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118806 Aug 09 17:10:09.252112 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 593/1287] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:09.265315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e8078fa7-6b52-47b9-8129-5b8251a1fba5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:09.267590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e8078fa7-6b52-47b9-8129-5b8251a1fba5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:09.281050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8078fa7-6b52-47b9-8129-5b8251a1fba5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:09.282232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8078fa7-6b52-47b9-8129-5b8251a1fba5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:09.283247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8078fa7-6b52-47b9-8129-5b8251a1fba5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:09.285405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8078fa7-6b52-47b9-8129-5b8251a1fba5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:09.286497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8078fa7-6b52-47b9-8129-5b8251a1fba5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:09.287521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8078fa7-6b52-47b9-8129-5b8251a1fba5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:09.446232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Updating instance_info_cache with network_info: [{"id": "8dd9f845-7b2b-4c86-856a-d0c2faf3c649", "address": "fa:16:3e:c6:f2:e8", "network": {"id": "bf9538fd-ab95-4f28-9743-01ef51be592a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1857376060-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fc4ac8041e634c979c8678b4fde35a4f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8dd9f845-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:10:09.522995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Releasing lock "refresh_cache-7d4494b3-976f-4185-936c-52c1ba795d41" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:10:09.525371 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19f5729e-a244-4f47-9730-72246a3658c2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "POST /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41/action" status: 202 len: 0 microversion: 2.1 time: 7.670711 Aug 09 17:10:09.528870 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 695/1288] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:10:01 2022] POST /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41/action => generated 0 bytes in 7676 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 17:10:09.565289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1802120539", "imageRef": "51e9af65-df9b-4cf7-afda-164e0b116bfb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a8589ab2-58e3-4740-856a-538e59c74282"}], "security_groups": [{"name": "tempest-securitygroup--1354906501"}], "key_name": "tempest-keypair-2016277638", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:10.068465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] validate_networks() for [('a8589ab2-58e3-4740-856a-538e59c74282', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:10:10.334731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e8078fa7-6b52-47b9-8129-5b8251a1fba5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:10.369809 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e8078fa7-6b52-47b9-8129-5b8251a1fba5 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1470 microversion: 2.1 time: 1.112440 Aug 09 17:10:10.381171 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 594/1289] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:09 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1470 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:10.400797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-215f118b-cfba-401c-85cc-7f0b3b91e25c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:10.402957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-215f118b-cfba-401c-85cc-7f0b3b91e25c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:10.437040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-215f118b-cfba-401c-85cc-7f0b3b91e25c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:10.438566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-215f118b-cfba-401c-85cc-7f0b3b91e25c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:10.445845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-215f118b-cfba-401c-85cc-7f0b3b91e25c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:10.447861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-215f118b-cfba-401c-85cc-7f0b3b91e25c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:10.449035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-215f118b-cfba-401c-85cc-7f0b3b91e25c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:10.450072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-215f118b-cfba-401c-85cc-7f0b3b91e25c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:11.672766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-215f118b-cfba-401c-85cc-7f0b3b91e25c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:11.701208 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-215f118b-cfba-401c-85cc-7f0b3b91e25c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1718 microversion: 2.1 time: 1.312131 Aug 09 17:10:11.705306 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 595/1290] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:10 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1718 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:11.744134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a4d59c97-ae9c-4dcf-a3c5-04b6f00c9b5b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcbe68f70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:11.956383 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a4d59c97-ae9c-4dcf-a3c5-04b6f00c9b5b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884" status: 200 len: 1439 microversion: 2.1 time: 0.249077 Aug 09 17:10:11.958428 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 596/1291] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:10:11 2022] GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884 => generated 1439 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:11.987205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.9"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:11.995441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:12.017874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:12.023374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:12.024244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:12.028293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:12.029212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:12.030037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:12.109518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "refresh_cache-8a42c94f-6eeb-42bc-aa25-da394ea9e613" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:10:12.114201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquired lock "refresh_cache-8a42c94f-6eeb-42bc-aa25-da394ea9e613" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:10:12.125058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:10:12.126642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:10:12.127848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:10:12.129609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:10:12.130366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:10:12.179910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:12.180908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:12.193694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:12.195221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:12.196427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:12.199214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:12.338480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Getting quotas for project cb4177dbe7e94a8e8381561de0e40575. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:10:12.386922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Getting quotas for user 8721b8f0cd0a46f489ab540cd8db9357 and project cb4177dbe7e94a8e8381561de0e40575. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:10:12.484937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:10:12.494773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51e9af65-df9b-4cf7-afda-164e0b116bfb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:10:12.685951 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b003304-7f64-43cf-b6ff-38aff7b8440d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.147947 Aug 09 17:10:12.701829 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 696/1292] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:10:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 3172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:10:12.714116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-15f40367-664f-4b49-923b-98b7d85f1650 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:12.736140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-15f40367-664f-4b49-923b-98b7d85f1650 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:12.766093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15f40367-664f-4b49-923b-98b7d85f1650 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:12.768838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15f40367-664f-4b49-923b-98b7d85f1650 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:12.770627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15f40367-664f-4b49-923b-98b7d85f1650 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:12.773254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15f40367-664f-4b49-923b-98b7d85f1650 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:12.774526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15f40367-664f-4b49-923b-98b7d85f1650 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:12.775744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15f40367-664f-4b49-923b-98b7d85f1650 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:13.185976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-15f40367-664f-4b49-923b-98b7d85f1650 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:13.226514 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-15f40367-664f-4b49-923b-98b7d85f1650 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1315 microversion: 2.1 time: 0.517724 Aug 09 17:10:13.231453 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 697/1293] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:12 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:13.251620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-05e66512-912f-4acb-88e4-3dc5dc32aba1 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:13.260282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-05e66512-912f-4acb-88e4-3dc5dc32aba1 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:13.287831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e66512-912f-4acb-88e4-3dc5dc32aba1 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:13.289699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e66512-912f-4acb-88e4-3dc5dc32aba1 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:13.291008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e66512-912f-4acb-88e4-3dc5dc32aba1 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:13.293250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e66512-912f-4acb-88e4-3dc5dc32aba1 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:13.295191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e66512-912f-4acb-88e4-3dc5dc32aba1 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:13.297960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e66512-912f-4acb-88e4-3dc5dc32aba1 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:13.843127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-05e66512-912f-4acb-88e4-3dc5dc32aba1 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:10:13.890845 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-05e66512-912f-4acb-88e4-3dc5dc32aba1 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 2345 microversion: 2.25 time: 0.656357 Aug 09 17:10:13.915672 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 698/1294] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:10:13 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 2345 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:10:13.915672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d249054-17ce-464c-908b-a0abbbd16c62 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:13.915672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d249054-17ce-464c-908b-a0abbbd16c62 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:13.937576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d249054-17ce-464c-908b-a0abbbd16c62 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:13.938224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d249054-17ce-464c-908b-a0abbbd16c62 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:13.938742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d249054-17ce-464c-908b-a0abbbd16c62 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:13.939513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d249054-17ce-464c-908b-a0abbbd16c62 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:13.942291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d249054-17ce-464c-908b-a0abbbd16c62 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:13.943033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d249054-17ce-464c-908b-a0abbbd16c62 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:15.144618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8d249054-17ce-464c-908b-a0abbbd16c62 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:15.160083 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d249054-17ce-464c-908b-a0abbbd16c62 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1470 microversion: 2.1 time: 1.252721 Aug 09 17:10:15.182921 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 699/1295] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:13 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1470 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:15.198357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-04169db1-228d-4c80-921f-670b474be298 req-2d2929d3-27fe-4043-a0fe-25154c391739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c388a7-598a-45ed-b478-0d6637f4e01c", "name": "network-vif-unplugged", "status": "completed", "tag": "d78a88ee-1bff-414f-892a-1adc2ebee7fc"}, {"name": "network-changed", "server_uuid": "32c388a7-598a-45ed-b478-0d6637f4e01c", "tag": "d78a88ee-1bff-414f-892a-1adc2ebee7fc"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:15.216400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-04169db1-228d-4c80-921f-670b474be298 req-2d2929d3-27fe-4043-a0fe-25154c391739 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:15.217143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-04169db1-228d-4c80-921f-670b474be298 req-2d2929d3-27fe-4043-a0fe-25154c391739 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:15.218708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-04169db1-228d-4c80-921f-670b474be298 req-2d2929d3-27fe-4043-a0fe-25154c391739 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:15.245035 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-04169db1-228d-4c80-921f-670b474be298 req-2d2929d3-27fe-4043-a0fe-25154c391739 service nova] Creating event network-vif-unplugged:d78a88ee-1bff-414f-892a-1adc2ebee7fc for instance 32c388a7-598a-45ed-b478-0d6637f4e01c on n-h2-845781-6 Aug 09 17:10:15.245983 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-04169db1-228d-4c80-921f-670b474be298 req-2d2929d3-27fe-4043-a0fe-25154c391739 service nova] Creating event network-changed:d78a88ee-1bff-414f-892a-1adc2ebee7fc for instance 32c388a7-598a-45ed-b478-0d6637f4e01c on n-h2-845781-6 Aug 09 17:10:15.257103 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-04169db1-228d-4c80-921f-670b474be298 req-2d2929d3-27fe-4043-a0fe-25154c391739 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.071196 Aug 09 17:10:15.264316 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 700/1296] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:15.279911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-bd53c447-decd-4859-9482-9432511a3b9a req-1df4991e-b003-4c6a-b36e-a4adb175ed0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a161e04-afa2-41fd-a0a2-e8cacd031ab2", "tag": "638dabef-c670-43c4-a60c-c82cc6d78bf7"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:15.307300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bd53c447-decd-4859-9482-9432511a3b9a req-1df4991e-b003-4c6a-b36e-a4adb175ed0e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:15.308581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bd53c447-decd-4859-9482-9432511a3b9a req-1df4991e-b003-4c6a-b36e-a4adb175ed0e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:15.309395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bd53c447-decd-4859-9482-9432511a3b9a req-1df4991e-b003-4c6a-b36e-a4adb175ed0e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:15.356223 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-bd53c447-decd-4859-9482-9432511a3b9a req-1df4991e-b003-4c6a-b36e-a4adb175ed0e service nova] Creating event network-changed:638dabef-c670-43c4-a60c-c82cc6d78bf7 for instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 on n-h2-845781-6 Aug 09 17:10:15.376096 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-bd53c447-decd-4859-9482-9432511a3b9a req-1df4991e-b003-4c6a-b36e-a4adb175ed0e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108625 Aug 09 17:10:15.383118 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 701/1297] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:15.397244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a216ab0d-cb8e-4f4a-b444-0be6d32d8cad tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:15.398513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a216ab0d-cb8e-4f4a-b444-0be6d32d8cad tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:15.445326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a216ab0d-cb8e-4f4a-b444-0be6d32d8cad tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:15.446371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a216ab0d-cb8e-4f4a-b444-0be6d32d8cad tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:15.449532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a216ab0d-cb8e-4f4a-b444-0be6d32d8cad tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:15.451184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a216ab0d-cb8e-4f4a-b444-0be6d32d8cad tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:15.456378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a216ab0d-cb8e-4f4a-b444-0be6d32d8cad tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:15.459347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a216ab0d-cb8e-4f4a-b444-0be6d32d8cad tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:15.861090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a216ab0d-cb8e-4f4a-b444-0be6d32d8cad tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:15.866888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:15.898724 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a216ab0d-cb8e-4f4a-b444-0be6d32d8cad tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1306 microversion: 2.1 time: 0.513333 Aug 09 17:10:15.906244 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 702/1298] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:15 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1306 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:15.922568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2f20825c-d898-4678-a858-bc27eaedb500 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:15.933269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2f20825c-d898-4678-a858-bc27eaedb500 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:15.967219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f20825c-d898-4678-a858-bc27eaedb500 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:15.980900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f20825c-d898-4678-a858-bc27eaedb500 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:15.982060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f20825c-d898-4678-a858-bc27eaedb500 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:15.983531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f20825c-d898-4678-a858-bc27eaedb500 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:15.984609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f20825c-d898-4678-a858-bc27eaedb500 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:15.985582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f20825c-d898-4678-a858-bc27eaedb500 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:16.516348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2f20825c-d898-4678-a858-bc27eaedb500 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:16.552686 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2f20825c-d898-4678-a858-bc27eaedb500 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1708 microversion: 2.1 time: 0.622578 Aug 09 17:10:16.553989 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 703/1299] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:15 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1708 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:16.562753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0becace5-feab-47c8-a88c-91920a040197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb48f9d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:20.500158 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.network.neutron [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] re-assign floating IP 172.25.5.9 from instance 7d4494b3-976f-4185-936c-52c1ba795d41 Aug 09 17:10:20.798906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Building network info cache for instance {{(pid=119432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 17:10:22.017887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:22.271713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:22.357695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Updating instance_info_cache with network_info: [{"id": "8dd9f845-7b2b-4c86-856a-d0c2faf3c649", "address": "fa:16:3e:c6:f2:e8", "network": {"id": "bf9538fd-ab95-4f28-9743-01ef51be592a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1857376060-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fc4ac8041e634c979c8678b4fde35a4f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8dd9f845-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:10:22.390407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Building network info cache for instance {{(pid=119432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 17:10:22.457678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:23.957469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Updating instance_info_cache with network_info: [{"id": "9804ab6e-317c-4af4-9474-17e5a74ceaec", "address": "fa:16:3e:42:93:11", "network": {"id": "bf9538fd-ab95-4f28-9743-01ef51be592a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1857376060-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fc4ac8041e634c979c8678b4fde35a4f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9804ab6e-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:10:23.995718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Releasing lock "refresh_cache-8a42c94f-6eeb-42bc-aa25-da394ea9e613" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:10:23.997486 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e4a03ac4-d52b-4e4f-8f7d-c84c88ce0e92 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "POST /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613/action" status: 202 len: 0 microversion: 2.1 time: 12.027241 Aug 09 17:10:24.007567 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 597/1300] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:10:11 2022] POST /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613/action => generated 0 bytes in 12049 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 17:10:24.024842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aa17956f-ab7d-4362-b3e1-663df34d30b5 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:24.031151 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:10:24.031151 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:10:24.038060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa17956f-ab7d-4362-b3e1-663df34d30b5 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:24.054437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa17956f-ab7d-4362-b3e1-663df34d30b5 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:24.055733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa17956f-ab7d-4362-b3e1-663df34d30b5 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:24.057822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa17956f-ab7d-4362-b3e1-663df34d30b5 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:24.058967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa17956f-ab7d-4362-b3e1-663df34d30b5 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:24.060176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa17956f-ab7d-4362-b3e1-663df34d30b5 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:24.176234 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aa17956f-ab7d-4362-b3e1-663df34d30b5 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.158218 Aug 09 17:10:24.177882 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 598/1301] 10.222.0.93 () {60 vars in 1217 bytes} [Tue Aug 9 17:10:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:10:24.199094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-55af57f3-2a10-40ff-a047-47b827f0a272 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:24.207840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-55af57f3-2a10-40ff-a047-47b827f0a272 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:24.234295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55af57f3-2a10-40ff-a047-47b827f0a272 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:24.238851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55af57f3-2a10-40ff-a047-47b827f0a272 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:24.245054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55af57f3-2a10-40ff-a047-47b827f0a272 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:24.246799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55af57f3-2a10-40ff-a047-47b827f0a272 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:24.249853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55af57f3-2a10-40ff-a047-47b827f0a272 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:24.251364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55af57f3-2a10-40ff-a047-47b827f0a272 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:24.718226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-55af57f3-2a10-40ff-a047-47b827f0a272 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:24.749994 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-55af57f3-2a10-40ff-a047-47b827f0a272 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1315 microversion: 2.1 time: 0.566887 Aug 09 17:10:24.767662 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 599/1302] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:24 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:24.807512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1c9d952c-b2cc-47a8-89ae-764352cbd0b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:24.814850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1c9d952c-b2cc-47a8-89ae-764352cbd0b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:24.846786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c9d952c-b2cc-47a8-89ae-764352cbd0b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:24.849010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c9d952c-b2cc-47a8-89ae-764352cbd0b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:24.850448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c9d952c-b2cc-47a8-89ae-764352cbd0b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:24.852270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c9d952c-b2cc-47a8-89ae-764352cbd0b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:24.869174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c9d952c-b2cc-47a8-89ae-764352cbd0b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:24.872550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c9d952c-b2cc-47a8-89ae-764352cbd0b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:25.381370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1c9d952c-b2cc-47a8-89ae-764352cbd0b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:25.447520 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1c9d952c-b2cc-47a8-89ae-764352cbd0b0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1463 microversion: 2.1 time: 0.684941 Aug 09 17:10:25.452840 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 600/1303] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:24 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1463 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:25.500676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d4919e0c-690f-40f6-ab6d-5ce74e9aa363 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '.version_select at 0x7fbbcbc0e8b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:25.534925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4919e0c-690f-40f6-ab6d-5ce74e9aa363 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:25.541015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4919e0c-690f-40f6-ab6d-5ce74e9aa363 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:25.543263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4919e0c-690f-40f6-ab6d-5ce74e9aa363 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:25.644884 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d4919e0c-690f-40f6-ab6d-5ce74e9aa363 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 3508 microversion: 2.1 time: 0.182188 Aug 09 17:10:25.650043 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 601/1304] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:10:25 2022] GET /compute/v2.1/os-migrations => generated 3508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:25.674518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c8fe5346-3348-416b-94ad-a7db14e66ad1 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:25.677159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c8fe5346-3348-416b-94ad-a7db14e66ad1 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:25.690538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8fe5346-3348-416b-94ad-a7db14e66ad1 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:25.692658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8fe5346-3348-416b-94ad-a7db14e66ad1 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:25.693908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8fe5346-3348-416b-94ad-a7db14e66ad1 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:25.697024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8fe5346-3348-416b-94ad-a7db14e66ad1 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:25.701370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8fe5346-3348-416b-94ad-a7db14e66ad1 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:25.702518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8fe5346-3348-416b-94ad-a7db14e66ad1 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:25.940241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:26.501071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c8fe5346-3348-416b-94ad-a7db14e66ad1 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:26.519847 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c8fe5346-3348-416b-94ad-a7db14e66ad1 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1372 microversion: 2.1 time: 0.867214 Aug 09 17:10:26.520456 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 602/1305] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:25 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1372 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:26.523335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=7 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:26.533366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-feda9c58-2de7-498a-a370-3b5b89bd4502 req-0b4ba37c-9387-4d58-9820-1777f8a58a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d4494b3-976f-4185-936c-52c1ba795d41", "tag": "8dd9f845-7b2b-4c86-856a-d0c2faf3c649"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:26.570665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-feda9c58-2de7-498a-a370-3b5b89bd4502 req-0b4ba37c-9387-4d58-9820-1777f8a58a1f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:26.573344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-feda9c58-2de7-498a-a370-3b5b89bd4502 req-0b4ba37c-9387-4d58-9820-1777f8a58a1f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:26.574031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-feda9c58-2de7-498a-a370-3b5b89bd4502 req-0b4ba37c-9387-4d58-9820-1777f8a58a1f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:26.610931 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-feda9c58-2de7-498a-a370-3b5b89bd4502 req-0b4ba37c-9387-4d58-9820-1777f8a58a1f service nova] Creating event network-changed:8dd9f845-7b2b-4c86-856a-d0c2faf3c649 for instance 7d4494b3-976f-4185-936c-52c1ba795d41 on n-h1-845781-6 Aug 09 17:10:26.624083 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-feda9c58-2de7-498a-a370-3b5b89bd4502 req-0b4ba37c-9387-4d58-9820-1777f8a58a1f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101630 Aug 09 17:10:26.634816 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 603/1306] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:26.646921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-fbb6cc3e-64ed-442a-a672-79c6cd7710ad req-38f55677-b23a-4ae8-b5ec-39bbabf6da53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c388a7-598a-45ed-b478-0d6637f4e01c", "name": "network-vif-plugged", "status": "completed", "tag": "d78a88ee-1bff-414f-892a-1adc2ebee7fc"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:26.672027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fbb6cc3e-64ed-442a-a672-79c6cd7710ad req-38f55677-b23a-4ae8-b5ec-39bbabf6da53 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:26.676368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fbb6cc3e-64ed-442a-a672-79c6cd7710ad req-38f55677-b23a-4ae8-b5ec-39bbabf6da53 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:26.681997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fbb6cc3e-64ed-442a-a672-79c6cd7710ad req-38f55677-b23a-4ae8-b5ec-39bbabf6da53 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:26.728780 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-fbb6cc3e-64ed-442a-a672-79c6cd7710ad req-38f55677-b23a-4ae8-b5ec-39bbabf6da53 service nova] Creating event network-vif-plugged:d78a88ee-1bff-414f-892a-1adc2ebee7fc for instance 32c388a7-598a-45ed-b478-0d6637f4e01c on n-h2-845781-6 Aug 09 17:10:26.745250 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-fbb6cc3e-64ed-442a-a672-79c6cd7710ad req-38f55677-b23a-4ae8-b5ec-39bbabf6da53 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108124 Aug 09 17:10:26.746731 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 604/1307] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:26.757508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2e039e98-915a-4fac-ba03-5f21eb02071d req-46ea2168-8682-4076-b28e-5cd80fbcd068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f377368-7c9c-48cb-80c1-c2253e0f5105", "tag": "4fecb257-a514-4d5d-8975-355ca5c6fce6"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:26.779923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2e039e98-915a-4fac-ba03-5f21eb02071d req-46ea2168-8682-4076-b28e-5cd80fbcd068 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:26.783748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2e039e98-915a-4fac-ba03-5f21eb02071d req-46ea2168-8682-4076-b28e-5cd80fbcd068 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:26.784511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2e039e98-915a-4fac-ba03-5f21eb02071d req-46ea2168-8682-4076-b28e-5cd80fbcd068 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:26.815242 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2e039e98-915a-4fac-ba03-5f21eb02071d req-46ea2168-8682-4076-b28e-5cd80fbcd068 service nova] Creating event network-changed:4fecb257-a514-4d5d-8975-355ca5c6fce6 for instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 on n-h1-845781-6 Aug 09 17:10:26.842883 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-2e039e98-915a-4fac-ba03-5f21eb02071d req-46ea2168-8682-4076-b28e-5cd80fbcd068 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094304 Aug 09 17:10:26.868241 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 605/1308] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:26.886567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.9"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:27.572987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:27.580839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:27.582353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:27.584104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:27.586936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:27.587822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:27.589978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:29.290370 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] HTTP exception thrown: Floating IP 172.25.5.9 is not associated with instance 7d4494b3-976f-4185-936c-52c1ba795d41. Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Request method failure captured: Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41/action HTTP/1.1 Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 47 Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pSAkY_BOBMg0pOG0M9rQefKtvlTM-IYLjqwtDgVTv-v1dnAwR6meoJvzppVeAVh8o5eAyw1lImjCSb5SPypBWmDOB5FUb2-IpVOfAZ-jRyVcmC6R7KBv6VgbeYdy5gvgsLNAI-xHY5XaE2byMGqmqp3wiQosX8aSD5pLnrMHxziLQg Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fc4ac8041e634c979c8678b4fde35a4f Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:10:29.294830 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fc4ac8041e634c979c8678b4fde35a4f Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FloatingIPsAssociationTestJSON-1691628508-project Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d55e4a6f6b7b4766b6510072d21f1e60 Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1691628508-project Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: {"removeFloatingIp": {"address": "172.25.5.9"}} Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:10:29.297606 n-d-845781-6 devstack@n-api.service[119432]: exception: Floating IP 172.25.5.9 is not associated with instance 7d4494b3-976f-4185-936c-52c1ba795d41. Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '7d4494b3-976f-4185-936c-52c1ba795d41', 'body': {'removeFloatingIp': {'address': '172.25.5.9'}}} Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.9 is not associated with instance 7d4494b3-976f-4185-936c-52c1ba795d41. Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:29.299174 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:29.303286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:29.303286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:29.303286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:10:29.303286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:10:29.303286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.9 is not associated with instance 7d4494b3-976f-4185-936c-52c1ba795d41. Aug 09 17:10:29.303286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:29.305467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Returning 409 to user: Floating IP 172.25.5.9 is not associated with instance 7d4494b3-976f-4185-936c-52c1ba795d41. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:10:29.307125 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ebe9f79b-bd71-4162-b80c-1312d6fa353e tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "POST /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41/action" status: 409 len: 144 microversion: 2.1 time: 2.435651 Aug 09 17:10:29.310798 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 606/1309] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:10:26 2022] POST /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41/action => generated 144 bytes in 2442 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:10:29.323362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0cbe0d9c-bcbf-4cb0-a44f-2d97246d6e0d tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:29.325651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0cbe0d9c-bcbf-4cb0-a44f-2d97246d6e0d tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:29.345677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbe0d9c-bcbf-4cb0-a44f-2d97246d6e0d tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:29.349034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbe0d9c-bcbf-4cb0-a44f-2d97246d6e0d tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:29.349630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbe0d9c-bcbf-4cb0-a44f-2d97246d6e0d tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:29.350650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbe0d9c-bcbf-4cb0-a44f-2d97246d6e0d tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:29.352429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbe0d9c-bcbf-4cb0-a44f-2d97246d6e0d tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:29.355801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbe0d9c-bcbf-4cb0-a44f-2d97246d6e0d tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:29.572956 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0becace5-feab-47c8-a88c-91920a040197 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884" status: 200 len: 1448 microversion: 2.1 time: 13.017288 Aug 09 17:10:29.574361 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 704/1310] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:10:16 2022] GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884 => generated 1448 bytes in 13020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:29.599159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a09dac2-c516-472f-bb35-97a52c0491ba tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:29.600665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a09dac2-c516-472f-bb35-97a52c0491ba tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:29.612127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a09dac2-c516-472f-bb35-97a52c0491ba tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:29.613080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a09dac2-c516-472f-bb35-97a52c0491ba tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:29.613868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a09dac2-c516-472f-bb35-97a52c0491ba tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:29.615199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a09dac2-c516-472f-bb35-97a52c0491ba tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:29.616167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a09dac2-c516-472f-bb35-97a52c0491ba tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:29.616861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a09dac2-c516-472f-bb35-97a52c0491ba tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:29.855279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:29.868501 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0cbe0d9c-bcbf-4cb0-a44f-2d97246d6e0d tempest-MigrationsAdminTest-1441584186 tempest-MigrationsAdminTest-1441584186-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 200 len: 1614 microversion: 2.1 time: 0.555698 Aug 09 17:10:29.870772 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 607/1311] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:29 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 1614 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:29.882986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72b5623c-777e-4d71-b32b-e6dde385cfc9 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:29.884267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-72b5623c-777e-4d71-b32b-e6dde385cfc9 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:29.894306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b5623c-777e-4d71-b32b-e6dde385cfc9 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:29.895532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b5623c-777e-4d71-b32b-e6dde385cfc9 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:29.896401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b5623c-777e-4d71-b32b-e6dde385cfc9 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:29.897547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b5623c-777e-4d71-b32b-e6dde385cfc9 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:29.898346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b5623c-777e-4d71-b32b-e6dde385cfc9 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:29.899148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b5623c-777e-4d71-b32b-e6dde385cfc9 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:30.204367 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a09dac2-c516-472f-bb35-97a52c0491ba tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1859 microversion: 2.1 time: 0.612728 Aug 09 17:10:30.213070 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 705/1312] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:29 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1859 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:30.229661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2bd1d1b3-6f54-4325-a90e-af269bf925c3 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:30.251658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2bd1d1b3-6f54-4325-a90e-af269bf925c3 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:30.267882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd1d1b3-6f54-4325-a90e-af269bf925c3 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:30.272771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd1d1b3-6f54-4325-a90e-af269bf925c3 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:30.274148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd1d1b3-6f54-4325-a90e-af269bf925c3 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:30.283509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd1d1b3-6f54-4325-a90e-af269bf925c3 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:30.285458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd1d1b3-6f54-4325-a90e-af269bf925c3 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:30.286513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd1d1b3-6f54-4325-a90e-af269bf925c3 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:30.334901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-72b5623c-777e-4d71-b32b-e6dde385cfc9 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:30.349813 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72b5623c-777e-4d71-b32b-e6dde385cfc9 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1315 microversion: 2.1 time: 0.476590 Aug 09 17:10:30.370123 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 608/1313] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:29 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:30.407318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9ef90957-6e67-4989-9001-6a0d0614db50 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8896e7c-ee31-4476-9f7c-96efa13090ac", "device": "/dev/xvdb"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:30.432420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9ef90957-6e67-4989-9001-6a0d0614db50 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:30.462282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ef90957-6e67-4989-9001-6a0d0614db50 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:30.466975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ef90957-6e67-4989-9001-6a0d0614db50 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:30.469337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ef90957-6e67-4989-9001-6a0d0614db50 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:30.471886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ef90957-6e67-4989-9001-6a0d0614db50 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:30.474333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ef90957-6e67-4989-9001-6a0d0614db50 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:30.475743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ef90957-6e67-4989-9001-6a0d0614db50 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:30.911193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2bd1d1b3-6f54-4325-a90e-af269bf925c3 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:30.949420 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2bd1d1b3-6f54-4325-a90e-af269bf925c3 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1372 microversion: 2.1 time: 0.727463 Aug 09 17:10:30.950628 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 706/1314] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:30 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1372 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:30.998830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d935b29d-52ea-4d7d-9e56-c21fd95fb322 req-8edcc27f-f0bf-4fc5-8b95-aedfaff3403e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a42c94f-6eeb-42bc-aa25-da394ea9e613", "tag": "9804ab6e-317c-4af4-9474-17e5a74ceaec"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:31.058989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d935b29d-52ea-4d7d-9e56-c21fd95fb322 req-8edcc27f-f0bf-4fc5-8b95-aedfaff3403e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:31.064376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d935b29d-52ea-4d7d-9e56-c21fd95fb322 req-8edcc27f-f0bf-4fc5-8b95-aedfaff3403e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:31.069531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d935b29d-52ea-4d7d-9e56-c21fd95fb322 req-8edcc27f-f0bf-4fc5-8b95-aedfaff3403e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:31.101740 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d935b29d-52ea-4d7d-9e56-c21fd95fb322 req-8edcc27f-f0bf-4fc5-8b95-aedfaff3403e service nova] Creating event network-changed:9804ab6e-317c-4af4-9474-17e5a74ceaec for instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 on n-h1-845781-6 Aug 09 17:10:31.113947 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d935b29d-52ea-4d7d-9e56-c21fd95fb322 req-8edcc27f-f0bf-4fc5-8b95-aedfaff3403e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143324 Aug 09 17:10:31.174031 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 707/1315] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:31.215405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-766c4af4-b594-404e-ac91-a6b03cc2aef7 req-3061edc0-6fda-4356-8893-c33d467ba718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a161e04-afa2-41fd-a0a2-e8cacd031ab2", "name": "network-vif-plugged", "status": "completed", "tag": "638dabef-c670-43c4-a60c-c82cc6d78bf7"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:31.273325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-766c4af4-b594-404e-ac91-a6b03cc2aef7 req-3061edc0-6fda-4356-8893-c33d467ba718 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:31.277233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-766c4af4-b594-404e-ac91-a6b03cc2aef7 req-3061edc0-6fda-4356-8893-c33d467ba718 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:31.281291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-766c4af4-b594-404e-ac91-a6b03cc2aef7 req-3061edc0-6fda-4356-8893-c33d467ba718 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:31.342113 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-766c4af4-b594-404e-ac91-a6b03cc2aef7 req-3061edc0-6fda-4356-8893-c33d467ba718 service nova] Creating event network-vif-plugged:638dabef-c670-43c4-a60c-c82cc6d78bf7 for instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 on n-h2-845781-6 Aug 09 17:10:31.403888 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-766c4af4-b594-404e-ac91-a6b03cc2aef7 req-3061edc0-6fda-4356-8893-c33d467ba718 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197913 Aug 09 17:10:31.413294 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 708/1316] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:31.443019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.9"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:31.647602 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9ef90957-6e67-4989-9001-6a0d0614db50 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "POST /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.274155 Aug 09 17:10:31.657233 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 609/1317] 10.222.0.93 () {62 vars in 1364 bytes} [Tue Aug 9 17:10:30 2022] POST /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 194 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:10:31.692564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-147326de-6783-4a1d-89e0-ecac7d9dc13b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb72a8b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:31.802245 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-147326de-6783-4a1d-89e0-ecac7d9dc13b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884" status: 200 len: 1448 microversion: 2.1 time: 0.143396 Aug 09 17:10:31.811953 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 610/1318] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:10:31 2022] GET /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884 => generated 1448 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:31.818027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-05d55221-9f4f-46db-93a8-a3c12eec3102 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:31.818819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-05d55221-9f4f-46db-93a8-a3c12eec3102 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:31.827346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05d55221-9f4f-46db-93a8-a3c12eec3102 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:31.828055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05d55221-9f4f-46db-93a8-a3c12eec3102 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:31.828621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05d55221-9f4f-46db-93a8-a3c12eec3102 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:31.829584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05d55221-9f4f-46db-93a8-a3c12eec3102 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:31.830175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05d55221-9f4f-46db-93a8-a3c12eec3102 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:31.830718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05d55221-9f4f-46db-93a8-a3c12eec3102 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:31.865500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-05d55221-9f4f-46db-93a8-a3c12eec3102 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:10:32.172949 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-05d55221-9f4f-46db-93a8-a3c12eec3102 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "DELETE /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 204 len: 0 microversion: 2.1 time: 0.357646 Aug 09 17:10:32.174098 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 611/1319] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:10:31 2022] DELETE /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:10:32.198414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dfa96da5-b73e-4427-822a-827303d8760f tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:32.217123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dfa96da5-b73e-4427-822a-827303d8760f tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:32.266666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa96da5-b73e-4427-822a-827303d8760f tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:32.269713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa96da5-b73e-4427-822a-827303d8760f tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:32.274861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa96da5-b73e-4427-822a-827303d8760f tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:32.278990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa96da5-b73e-4427-822a-827303d8760f tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:32.287279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa96da5-b73e-4427-822a-827303d8760f tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:32.288639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa96da5-b73e-4427-822a-827303d8760f tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:32.429181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:32.449218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:32.450255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:32.451138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:32.452598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:32.458172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:32.459316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:33.205602 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dfa96da5-b73e-4427-822a-827303d8760f tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1859 microversion: 2.1 time: 1.028661 Aug 09 17:10:33.207871 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 612/1320] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:32 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1859 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:33.229209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a93735bf-818f-403b-93f0-2a969f144734 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:33.230575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a93735bf-818f-403b-93f0-2a969f144734 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:33.274719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93735bf-818f-403b-93f0-2a969f144734 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:33.276013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93735bf-818f-403b-93f0-2a969f144734 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:33.282656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93735bf-818f-403b-93f0-2a969f144734 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:33.288146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93735bf-818f-403b-93f0-2a969f144734 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:33.292991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93735bf-818f-403b-93f0-2a969f144734 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:33.294910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93735bf-818f-403b-93f0-2a969f144734 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:33.306534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "refresh_cache-8a42c94f-6eeb-42bc-aa25-da394ea9e613" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:10:33.308266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquired lock "refresh_cache-8a42c94f-6eeb-42bc-aa25-da394ea9e613" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:10:33.832821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a93735bf-818f-403b-93f0-2a969f144734 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:33.849459 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a93735bf-818f-403b-93f0-2a969f144734 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1315 microversion: 2.1 time: 0.639888 Aug 09 17:10:33.852601 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 613/1321] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:33 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:33.861825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cae95cc5-12ec-4dc6-b5ba-96682e701859 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb73f790>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:34.096748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:36.611065 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cae95cc5-12ec-4dc6-b5ba-96682e701859 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884" status: 204 len: 0 microversion: 2.1 time: 2.756488 Aug 09 17:10:36.617855 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 614/1322] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:33 2022] DELETE /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884 => generated 0 bytes in 2759 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:10:36.624445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5029fa1-0882-4fda-92a2-eb8629d28d38 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:36.630959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5029fa1-0882-4fda-92a2-eb8629d28d38 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:36.654411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5029fa1-0882-4fda-92a2-eb8629d28d38 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:36.656625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5029fa1-0882-4fda-92a2-eb8629d28d38 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:36.661025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5029fa1-0882-4fda-92a2-eb8629d28d38 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:36.662637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5029fa1-0882-4fda-92a2-eb8629d28d38 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:36.664760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5029fa1-0882-4fda-92a2-eb8629d28d38 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:36.666674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5029fa1-0882-4fda-92a2-eb8629d28d38 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:37.245251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e5029fa1-0882-4fda-92a2-eb8629d28d38 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:37.281860 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5029fa1-0882-4fda-92a2-eb8629d28d38 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1372 microversion: 2.1 time: 0.661725 Aug 09 17:10:37.296545 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 615/1323] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:36 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1372 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:37.324520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:37.326373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 32c388a7-598a-45ed-b478-0d6637f4e01c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:37.339338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:37.349807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:37.351281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:37.353529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:37.359872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:37.362400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:37.440473 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] HTTP exception thrown: Instance 32c388a7-598a-45ed-b478-0d6637f4e01c could not be found. Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Request method failure captured: Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c HTTP/1.1 Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pNnzYLwRufAQWqYCrYTZBQm-eZHrsuD_FHRNs1wLWby_tGswdlp7J0WhU7Ebf3sGPCXqpJK7CAAiNrgTUt73DKpsNgFklEp16yxuKZNOoqXaRDSO1oLDu6i3VMChdlrubNcRk6cILQh0s_AMRdmYcDFDsdnUWtZQ08y00B6b-_s0ZE Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 7004f453a4d944239c4641bbc394ebb5 Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-MigrationsAdminTest-1309381197 Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:10:37.445044 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-MigrationsAdminTest-1309381197 Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 7004f453a4d944239c4641bbc394ebb5 Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-MigrationsAdminTest-1309381197 Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-MigrationsAdminTest-1309381197-project Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 434e395144bc4443abb655a9d0a8b329 Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-MigrationsAdminTest-1309381197-project Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 32c388a7-598a-45ed-b478-0d6637f4e01c could not be found. Aug 09 17:10:37.448168 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '32c388a7-598a-45ed-b478-0d6637f4e01c'} Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c388a7-598a-45ed-b478-0d6637f4e01c could not be found. Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:10:37.450002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c388a7-598a-45ed-b478-0d6637f4e01c could not be found. Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c388a7-598a-45ed-b478-0d6637f4e01c could not be found. Aug 09 17:10:37.458134 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:37.467711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Returning 404 to user: Instance 32c388a7-598a-45ed-b478-0d6637f4e01c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:10:37.470979 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fd0dc05d-bc57-484d-a86d-1031052cc070 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c" status: 404 len: 111 microversion: 2.1 time: 0.170966 Aug 09 17:10:37.473644 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 616/1324] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:37 2022] GET /compute/v2.1/servers/32c388a7-598a-45ed-b478-0d6637f4e01c => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:10:37.485148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a9e0ebce-e1e7-4c89-b6da-03b8e904eb11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:37.487658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a9e0ebce-e1e7-4c89-b6da-03b8e904eb11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:37.500708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e0ebce-e1e7-4c89-b6da-03b8e904eb11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:37.503028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e0ebce-e1e7-4c89-b6da-03b8e904eb11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:37.505087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e0ebce-e1e7-4c89-b6da-03b8e904eb11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:37.507401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e0ebce-e1e7-4c89-b6da-03b8e904eb11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:37.508824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e0ebce-e1e7-4c89-b6da-03b8e904eb11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:37.510298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e0ebce-e1e7-4c89-b6da-03b8e904eb11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:37.872477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-a9e0ebce-e1e7-4c89-b6da-03b8e904eb11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lazy-loading 'services' on Instance uuid 2bde0f3f-3670-4908-bc71-f4af6b3671b2 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:10:38.630366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Building network info cache for instance {{(pid=119431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 17:10:38.716558 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a9e0ebce-e1e7-4c89-b6da-03b8e904eb11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments/5c53da91-4688-4de8-afb9-a0d8e2489a02" status: 202 len: 0 microversion: 2.1 time: 1.240633 Aug 09 17:10:38.721294 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 617/1325] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:10:37 2022] DELETE /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments/5c53da91-4688-4de8-afb9-a0d8e2489a02 => generated 0 bytes in 1246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:10:38.727749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-aaf65a9d-079b-4ea9-aa4a-51e4976e53d1 req-8ffa1ad0-0efb-455e-bd11-2a88bdae7885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8806f1b-fc49-46e7-a732-04de3ee9e445", "name": "network-vif-unplugged", "status": "completed", "tag": "7921ceb6-216e-4e5f-9c52-c560bf15be4a"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:38.778006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-aaf65a9d-079b-4ea9-aa4a-51e4976e53d1 req-8ffa1ad0-0efb-455e-bd11-2a88bdae7885 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:38.786295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-aaf65a9d-079b-4ea9-aa4a-51e4976e53d1 req-8ffa1ad0-0efb-455e-bd11-2a88bdae7885 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:38.787784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-aaf65a9d-079b-4ea9-aa4a-51e4976e53d1 req-8ffa1ad0-0efb-455e-bd11-2a88bdae7885 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:38.892423 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-aaf65a9d-079b-4ea9-aa4a-51e4976e53d1 req-8ffa1ad0-0efb-455e-bd11-2a88bdae7885 service nova] Creating event network-vif-unplugged:7921ceb6-216e-4e5f-9c52-c560bf15be4a for instance b8806f1b-fc49-46e7-a732-04de3ee9e445 on n-h2-845781-6 Aug 09 17:10:38.945238 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-aaf65a9d-079b-4ea9-aa4a-51e4976e53d1 req-8ffa1ad0-0efb-455e-bd11-2a88bdae7885 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.221407 Aug 09 17:10:38.950620 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 618/1326] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:38.974630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3d860338-d667-47ac-b2c2-e8623a2a6aac tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:38.982552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3d860338-d667-47ac-b2c2-e8623a2a6aac tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:39.029568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d860338-d667-47ac-b2c2-e8623a2a6aac tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:39.030878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d860338-d667-47ac-b2c2-e8623a2a6aac tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:39.036716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d860338-d667-47ac-b2c2-e8623a2a6aac tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:39.038357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d860338-d667-47ac-b2c2-e8623a2a6aac tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:39.041915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d860338-d667-47ac-b2c2-e8623a2a6aac tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:39.043540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d860338-d667-47ac-b2c2-e8623a2a6aac tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:39.834389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d860338-d667-47ac-b2c2-e8623a2a6aac tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:39.869340 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3d860338-d667-47ac-b2c2-e8623a2a6aac tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1503 microversion: 2.1 time: 0.912838 Aug 09 17:10:39.872474 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 619/1327] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:38 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1503 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:39.884924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-26f221ab-7213-4d7e-915a-00a904cc1981 req-853fc34d-1639-4272-a5ba-99e3bd0a955b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c388a7-598a-45ed-b478-0d6637f4e01c", "name": "network-vif-deleted", "tag": "d78a88ee-1bff-414f-892a-1adc2ebee7fc"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:39.910142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-26f221ab-7213-4d7e-915a-00a904cc1981 req-853fc34d-1639-4272-a5ba-99e3bd0a955b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:39.910964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-26f221ab-7213-4d7e-915a-00a904cc1981 req-853fc34d-1639-4272-a5ba-99e3bd0a955b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:39.911820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-26f221ab-7213-4d7e-915a-00a904cc1981 req-853fc34d-1639-4272-a5ba-99e3bd0a955b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:39.947756 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-26f221ab-7213-4d7e-915a-00a904cc1981 req-853fc34d-1639-4272-a5ba-99e3bd0a955b service nova] Creating event network-vif-deleted:d78a88ee-1bff-414f-892a-1adc2ebee7fc for instance 32c388a7-598a-45ed-b478-0d6637f4e01c on n-h2-845781-6 Aug 09 17:10:39.970827 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-26f221ab-7213-4d7e-915a-00a904cc1981 req-853fc34d-1639-4272-a5ba-99e3bd0a955b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096221 Aug 09 17:10:39.976353 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 620/1328] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:39.997843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0c8e3dd6-0a49-4b16-a9a7-53c8eabb9533 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:39.998820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0c8e3dd6-0a49-4b16-a9a7-53c8eabb9533 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:40.023416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c8e3dd6-0a49-4b16-a9a7-53c8eabb9533 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:40.031315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c8e3dd6-0a49-4b16-a9a7-53c8eabb9533 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:40.032533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c8e3dd6-0a49-4b16-a9a7-53c8eabb9533 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:40.038338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c8e3dd6-0a49-4b16-a9a7-53c8eabb9533 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:40.038338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c8e3dd6-0a49-4b16-a9a7-53c8eabb9533 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:40.038743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c8e3dd6-0a49-4b16-a9a7-53c8eabb9533 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:40.152220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0c8e3dd6-0a49-4b16-a9a7-53c8eabb9533 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:10:40.365207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Updating instance_info_cache with network_info: [{"id": "9804ab6e-317c-4af4-9474-17e5a74ceaec", "address": "fa:16:3e:42:93:11", "network": {"id": "bf9538fd-ab95-4f28-9743-01ef51be592a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1857376060-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fc4ac8041e634c979c8678b4fde35a4f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9804ab6e-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:10:40.393518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Releasing lock "refresh_cache-8a42c94f-6eeb-42bc-aa25-da394ea9e613" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:10:40.398977 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d32cd9fd-2ce0-4fa1-a602-6f9066716d46 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "POST /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613/action" status: 202 len: 0 microversion: 2.1 time: 8.980896 Aug 09 17:10:40.401964 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 709/1329] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:10:31 2022] POST /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613/action => generated 0 bytes in 8988 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 17:10:40.447684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac8d7f66-afb1-4f3c-ab85-518c45308513 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:40.448522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ac8d7f66-afb1-4f3c-ab85-518c45308513 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:40.459659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac8d7f66-afb1-4f3c-ab85-518c45308513 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:40.460582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac8d7f66-afb1-4f3c-ab85-518c45308513 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:40.461847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac8d7f66-afb1-4f3c-ab85-518c45308513 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:40.463944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac8d7f66-afb1-4f3c-ab85-518c45308513 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:40.464710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac8d7f66-afb1-4f3c-ab85-518c45308513 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:40.465500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac8d7f66-afb1-4f3c-ab85-518c45308513 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:40.566952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ac8d7f66-afb1-4f3c-ab85-518c45308513 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:10:40.604099 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0c8e3dd6-0a49-4b16-a9a7-53c8eabb9533 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 204 len: 0 microversion: 2.1 time: 0.622761 Aug 09 17:10:40.605297 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 621/1330] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:10:39 2022] DELETE /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:10:40.631896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c095b4d8-690e-4a80-ada5-7635161209b0 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:40.635459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c095b4d8-690e-4a80-ada5-7635161209b0 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:40.661588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c095b4d8-690e-4a80-ada5-7635161209b0 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:40.662854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c095b4d8-690e-4a80-ada5-7635161209b0 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:40.666358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c095b4d8-690e-4a80-ada5-7635161209b0 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:40.676316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c095b4d8-690e-4a80-ada5-7635161209b0 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:40.677516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c095b4d8-690e-4a80-ada5-7635161209b0 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:40.686186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c095b4d8-690e-4a80-ada5-7635161209b0 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:40.716434 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ac8d7f66-afb1-4f3c-ab85-518c45308513 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 204 len: 0 microversion: 2.1 time: 0.300294 Aug 09 17:10:40.718877 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 710/1331] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:10:40 2022] DELETE /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:10:40.731045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-31c89f26-6b4e-4ed5-809d-3d97ba9ba200 req-d1aff520-f068-40ca-80e5-7060a120938a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a42c94f-6eeb-42bc-aa25-da394ea9e613", "tag": "9804ab6e-317c-4af4-9474-17e5a74ceaec"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:40.749683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-31c89f26-6b4e-4ed5-809d-3d97ba9ba200 req-d1aff520-f068-40ca-80e5-7060a120938a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:40.751823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-31c89f26-6b4e-4ed5-809d-3d97ba9ba200 req-d1aff520-f068-40ca-80e5-7060a120938a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:40.752917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-31c89f26-6b4e-4ed5-809d-3d97ba9ba200 req-d1aff520-f068-40ca-80e5-7060a120938a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:40.821790 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-31c89f26-6b4e-4ed5-809d-3d97ba9ba200 req-d1aff520-f068-40ca-80e5-7060a120938a service nova] Creating event network-changed:9804ab6e-317c-4af4-9474-17e5a74ceaec for instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 on n-h1-845781-6 Aug 09 17:10:40.845960 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-31c89f26-6b4e-4ed5-809d-3d97ba9ba200 req-d1aff520-f068-40ca-80e5-7060a120938a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123893 Aug 09 17:10:40.851998 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 711/1332] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:40.878922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a31ffc1c-f938-430f-90e7-e915782064cd tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:40.883892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a31ffc1c-f938-430f-90e7-e915782064cd tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:40.904652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a31ffc1c-f938-430f-90e7-e915782064cd tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:40.906790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a31ffc1c-f938-430f-90e7-e915782064cd tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:40.908018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a31ffc1c-f938-430f-90e7-e915782064cd tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:40.909522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a31ffc1c-f938-430f-90e7-e915782064cd tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:40.913352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a31ffc1c-f938-430f-90e7-e915782064cd tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:40.917739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a31ffc1c-f938-430f-90e7-e915782064cd tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:41.009233 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a31ffc1c-f938-430f-90e7-e915782064cd tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153565 Aug 09 17:10:41.010835 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 712/1333] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:10:40 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:41.024338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4ff72952-bcdf-473d-8a0b-c8997cf15f49 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:41.027257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4ff72952-bcdf-473d-8a0b-c8997cf15f49 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:41.054117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ff72952-bcdf-473d-8a0b-c8997cf15f49 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:41.054869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ff72952-bcdf-473d-8a0b-c8997cf15f49 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:41.055677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ff72952-bcdf-473d-8a0b-c8997cf15f49 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:41.057930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ff72952-bcdf-473d-8a0b-c8997cf15f49 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:41.058667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ff72952-bcdf-473d-8a0b-c8997cf15f49 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:41.059462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ff72952-bcdf-473d-8a0b-c8997cf15f49 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:41.174275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4ff72952-bcdf-473d-8a0b-c8997cf15f49 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:10:41.404801 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4ff72952-bcdf-473d-8a0b-c8997cf15f49 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 204 len: 0 microversion: 2.1 time: 0.391912 Aug 09 17:10:41.409025 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 713/1334] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:10:41 2022] DELETE /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:10:41.426602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-290099dd-3900-49f9-86be-70f3ee700e82 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:41.428138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-290099dd-3900-49f9-86be-70f3ee700e82 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:41.444827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290099dd-3900-49f9-86be-70f3ee700e82 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:41.444827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290099dd-3900-49f9-86be-70f3ee700e82 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:41.444827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290099dd-3900-49f9-86be-70f3ee700e82 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:41.444827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290099dd-3900-49f9-86be-70f3ee700e82 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:41.445603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290099dd-3900-49f9-86be-70f3ee700e82 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:41.446394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290099dd-3900-49f9-86be-70f3ee700e82 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:41.490299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c095b4d8-690e-4a80-ada5-7635161209b0 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:41.522172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-290099dd-3900-49f9-86be-70f3ee700e82 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:10:41.528510 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c095b4d8-690e-4a80-ada5-7635161209b0 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1372 microversion: 2.1 time: 0.914721 Aug 09 17:10:41.533310 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 622/1335] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:40 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1372 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:41.556449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fd47aedd-47d5-4c09-8e1d-91cf9d8acb88 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:41.558020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fd47aedd-47d5-4c09-8e1d-91cf9d8acb88 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:41.571957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd47aedd-47d5-4c09-8e1d-91cf9d8acb88 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:41.573913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd47aedd-47d5-4c09-8e1d-91cf9d8acb88 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:41.575059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd47aedd-47d5-4c09-8e1d-91cf9d8acb88 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:41.580017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd47aedd-47d5-4c09-8e1d-91cf9d8acb88 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:41.581486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd47aedd-47d5-4c09-8e1d-91cf9d8acb88 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:41.582671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd47aedd-47d5-4c09-8e1d-91cf9d8acb88 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:41.641433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:41.714939 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-290099dd-3900-49f9-86be-70f3ee700e82 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 204 len: 0 microversion: 2.1 time: 0.302668 Aug 09 17:10:41.716113 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 714/1336] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:10:41 2022] DELETE /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:10:41.722012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1865892138", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "7caaa633-fae8-4684-9370-5a4c1e16c284"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:41.922938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] validate_networks() for [('7caaa633-fae8-4684-9370-5a4c1e16c284', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:10:42.240903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fd47aedd-47d5-4c09-8e1d-91cf9d8acb88 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:42.254722 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fd47aedd-47d5-4c09-8e1d-91cf9d8acb88 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1533 microversion: 2.1 time: 0.713425 Aug 09 17:10:42.255343 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 623/1337] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:41 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1533 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:42.263480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-924fedf3-a1e8-4986-9ba4-6ac47e96cfea tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:42.264137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-924fedf3-a1e8-4986-9ba4-6ac47e96cfea tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:42.278443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-924fedf3-a1e8-4986-9ba4-6ac47e96cfea tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:42.279086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-924fedf3-a1e8-4986-9ba4-6ac47e96cfea tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:42.279778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-924fedf3-a1e8-4986-9ba4-6ac47e96cfea tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:42.286726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-924fedf3-a1e8-4986-9ba4-6ac47e96cfea tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:42.287671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-924fedf3-a1e8-4986-9ba4-6ac47e96cfea tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:42.288318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-924fedf3-a1e8-4986-9ba4-6ac47e96cfea tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:42.633330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-924fedf3-a1e8-4986-9ba4-6ac47e96cfea tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:42.649867 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-924fedf3-a1e8-4986-9ba4-6ac47e96cfea tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1509 microversion: 2.1 time: 0.391884 Aug 09 17:10:42.650462 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 624/1338] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:42 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1509 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:42.655578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.9"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:42.673657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:42.728270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:42.728935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:42.729668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:42.736753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:42.737255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:42.737754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:42.798780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "refresh_cache-7d4494b3-976f-4185-936c-52c1ba795d41" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:10:42.799942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquired lock "refresh_cache-7d4494b3-976f-4185-936c-52c1ba795d41" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:10:42.855418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:10:42.856908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:10:42.857703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:10:42.858390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:10:42.859048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:10:42.874860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:42.875946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:42.876826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:42.879080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:42.880253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:42.882992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:42.928273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Getting quotas for project 055af8e9fb964ff19213eb1b419b56cd. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:10:42.935430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Getting quotas for user 1ac722a34673411e9280ba901999b0c3 and project 055af8e9fb964ff19213eb1b419b56cd. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:10:42.954059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:10:42.957970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:10:43.043958 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c562c41-4240-4fc3-bbb3-1a6d0d7741f5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.326174 Aug 09 17:10:43.045043 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 715/1339] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:10:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:10:43.051826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a6d3163-1518-49d7-95f4-a264bf42b4e6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:43.055135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a6d3163-1518-49d7-95f4-a264bf42b4e6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:43.066085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a6d3163-1518-49d7-95f4-a264bf42b4e6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:43.066944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a6d3163-1518-49d7-95f4-a264bf42b4e6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:43.067538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a6d3163-1518-49d7-95f4-a264bf42b4e6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:43.068586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a6d3163-1518-49d7-95f4-a264bf42b4e6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:43.069280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a6d3163-1518-49d7-95f4-a264bf42b4e6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:43.070050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a6d3163-1518-49d7-95f4-a264bf42b4e6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:43.127462 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a6d3163-1518-49d7-95f4-a264bf42b4e6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081046 Aug 09 17:10:43.133769 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 716/1340] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:10:43 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:43.143491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c5afda4-a6d9-4985-8ca1-9053f9551d95 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Action: 'create', calling method: .version_select at 0x7fbbcb5eb4c0>, body: {"keypair": {"name": "tempest-keypair-1084048496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHKo216HNMlTpTORZ1gAQaiZfJz60ZXrt5Zdtk6G3sb6/dcq6Q2y3124SCnSvbUDo970iog/77ncUOqapZbQSNtEW4iLTNH9BwlxyFRcDoiEFVWBBXQg4F8HVdN2COpoA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:43.190916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-5c5afda4-a6d9-4985-8ca1-9053f9551d95 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Getting quotas for project 314d59a0480e4be59dba88bc8810b146. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:10:43.224908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-5c5afda4-a6d9-4985-8ca1-9053f9551d95 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Getting quotas for user 3fea520df5014ddabc2f232cdaa8a53f and project 314d59a0480e4be59dba88bc8810b146. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:10:43.309874 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c5afda4-a6d9-4985-8ca1-9053f9551d95 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.174610 Aug 09 17:10:43.314104 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 717/1341] 10.222.0.93 () {62 vars in 1200 bytes} [Tue Aug 9 17:10:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 17:10:43.334542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e2b95777-8958-46f6-9d30-868c69c3ef9a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:43.338144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e2b95777-8958-46f6-9d30-868c69c3ef9a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:43.352454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2b95777-8958-46f6-9d30-868c69c3ef9a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:43.363854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2b95777-8958-46f6-9d30-868c69c3ef9a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:43.364895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2b95777-8958-46f6-9d30-868c69c3ef9a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:43.366789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2b95777-8958-46f6-9d30-868c69c3ef9a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:43.369410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2b95777-8958-46f6-9d30-868c69c3ef9a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:43.370316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2b95777-8958-46f6-9d30-868c69c3ef9a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:43.720564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e2b95777-8958-46f6-9d30-868c69c3ef9a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:43.736242 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e2b95777-8958-46f6-9d30-868c69c3ef9a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1372 microversion: 2.1 time: 0.419061 Aug 09 17:10:43.736871 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 718/1342] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:43 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1372 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:43.747989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d4dcac9-9306-40d3-b5fa-8038dd99c901 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:43.748681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1d4dcac9-9306-40d3-b5fa-8038dd99c901 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:43.876987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1d4dcac9-9306-40d3-b5fa-8038dd99c901 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:43.900489 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1d4dcac9-9306-40d3-b5fa-8038dd99c901 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 200 len: 1208 microversion: 2.1 time: 0.161734 Aug 09 17:10:43.903217 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 719/1343] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:43 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 1208 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:43.920087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-81cf045c-ff3e-4cc6-ab66-9826c2e8a37e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:43.922202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-81cf045c-ff3e-4cc6-ab66-9826c2e8a37e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:43.947007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81cf045c-ff3e-4cc6-ab66-9826c2e8a37e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:43.958348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81cf045c-ff3e-4cc6-ab66-9826c2e8a37e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:43.961573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81cf045c-ff3e-4cc6-ab66-9826c2e8a37e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:43.962698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81cf045c-ff3e-4cc6-ab66-9826c2e8a37e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:43.963362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81cf045c-ff3e-4cc6-ab66-9826c2e8a37e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:43.964140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81cf045c-ff3e-4cc6-ab66-9826c2e8a37e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:44.015493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:44.358280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81cf045c-ff3e-4cc6-ab66-9826c2e8a37e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:44.398502 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-81cf045c-ff3e-4cc6-ab66-9826c2e8a37e tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1533 microversion: 2.1 time: 0.489889 Aug 09 17:10:44.431666 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 720/1344] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:43 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1533 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:44.461003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-801987dc-c8cd-4e79-8dbd-14a72749e790 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:44.463835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-801987dc-c8cd-4e79-8dbd-14a72749e790 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:44.488985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801987dc-c8cd-4e79-8dbd-14a72749e790 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:44.494952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801987dc-c8cd-4e79-8dbd-14a72749e790 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:44.496406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801987dc-c8cd-4e79-8dbd-14a72749e790 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:44.497475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801987dc-c8cd-4e79-8dbd-14a72749e790 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:44.498344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801987dc-c8cd-4e79-8dbd-14a72749e790 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:44.499112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801987dc-c8cd-4e79-8dbd-14a72749e790 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:45.292765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-801987dc-c8cd-4e79-8dbd-14a72749e790 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:45.326736 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-801987dc-c8cd-4e79-8dbd-14a72749e790 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1509 microversion: 2.1 time: 0.906459 Aug 09 17:10:45.328276 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 721/1345] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:44 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1509 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:45.357518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99bb1250-3144-4009-abab-222c7ff2fc44 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:45.364915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99bb1250-3144-4009-abab-222c7ff2fc44 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:45.390111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99bb1250-3144-4009-abab-222c7ff2fc44 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:45.391414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99bb1250-3144-4009-abab-222c7ff2fc44 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:45.392438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99bb1250-3144-4009-abab-222c7ff2fc44 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:45.398073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99bb1250-3144-4009-abab-222c7ff2fc44 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:45.399406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99bb1250-3144-4009-abab-222c7ff2fc44 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:45.400478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99bb1250-3144-4009-abab-222c7ff2fc44 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:45.483395 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99bb1250-3144-4009-abab-222c7ff2fc44 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145967 Aug 09 17:10:45.488939 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 722/1346] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:10:45 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:45.505630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f4fb088b-2a0d-4054-861a-9394b41a218e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:45.510462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f4fb088b-2a0d-4054-861a-9394b41a218e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:45.532513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4fb088b-2a0d-4054-861a-9394b41a218e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:45.533033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4fb088b-2a0d-4054-861a-9394b41a218e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:45.536113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4fb088b-2a0d-4054-861a-9394b41a218e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:45.538566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4fb088b-2a0d-4054-861a-9394b41a218e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:45.539290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4fb088b-2a0d-4054-861a-9394b41a218e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:45.541941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4fb088b-2a0d-4054-861a-9394b41a218e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:46.827588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f4fb088b-2a0d-4054-861a-9394b41a218e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:46.853588 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f4fb088b-2a0d-4054-861a-9394b41a218e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1372 microversion: 2.1 time: 1.360156 Aug 09 17:10:46.871668 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 723/1347] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:45 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1372 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:46.872217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8070f38c-376b-4229-b7f5-cd3bd7fbb329 req-9f31b908-58a7-46cf-8e3c-b07a9cfbcd08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8806f1b-fc49-46e7-a732-04de3ee9e445", "name": "network-vif-deleted", "tag": "7921ceb6-216e-4e5f-9c52-c560bf15be4a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:46.903620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8070f38c-376b-4229-b7f5-cd3bd7fbb329 req-9f31b908-58a7-46cf-8e3c-b07a9cfbcd08 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:46.905827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8070f38c-376b-4229-b7f5-cd3bd7fbb329 req-9f31b908-58a7-46cf-8e3c-b07a9cfbcd08 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:46.906414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8070f38c-376b-4229-b7f5-cd3bd7fbb329 req-9f31b908-58a7-46cf-8e3c-b07a9cfbcd08 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:46.957972 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8070f38c-376b-4229-b7f5-cd3bd7fbb329 req-9f31b908-58a7-46cf-8e3c-b07a9cfbcd08 service nova] Creating event network-vif-deleted:7921ceb6-216e-4e5f-9c52-c560bf15be4a for instance b8806f1b-fc49-46e7-a732-04de3ee9e445 on n-h2-845781-6 Aug 09 17:10:46.981378 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8070f38c-376b-4229-b7f5-cd3bd7fbb329 req-9f31b908-58a7-46cf-8e3c-b07a9cfbcd08 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119199 Aug 09 17:10:46.983739 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 724/1348] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:47.003569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-03a1ed90-0b1c-4552-bfe6-1806911a1be9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:47.005435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-03a1ed90-0b1c-4552-bfe6-1806911a1be9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:47.023747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03a1ed90-0b1c-4552-bfe6-1806911a1be9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:47.026111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03a1ed90-0b1c-4552-bfe6-1806911a1be9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:47.027377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03a1ed90-0b1c-4552-bfe6-1806911a1be9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:47.028942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03a1ed90-0b1c-4552-bfe6-1806911a1be9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:47.032375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03a1ed90-0b1c-4552-bfe6-1806911a1be9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:47.032647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03a1ed90-0b1c-4552-bfe6-1806911a1be9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:47.263662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-03a1ed90-0b1c-4552-bfe6-1806911a1be9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:47.309915 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-03a1ed90-0b1c-4552-bfe6-1806911a1be9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 200 len: 1266 microversion: 2.1 time: 0.318139 Aug 09 17:10:47.315902 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 725/1349] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:46 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:47.342530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb944b9d-e486-4711-8f64-fa25f37b16c2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:47.343979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eb944b9d-e486-4711-8f64-fa25f37b16c2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:47.355943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb944b9d-e486-4711-8f64-fa25f37b16c2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:47.356683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb944b9d-e486-4711-8f64-fa25f37b16c2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:47.357410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb944b9d-e486-4711-8f64-fa25f37b16c2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:47.358628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb944b9d-e486-4711-8f64-fa25f37b16c2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:47.359429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb944b9d-e486-4711-8f64-fa25f37b16c2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:47.360213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb944b9d-e486-4711-8f64-fa25f37b16c2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:47.974973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eb944b9d-e486-4711-8f64-fa25f37b16c2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:48.016452 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eb944b9d-e486-4711-8f64-fa25f37b16c2 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 200 len: 1491 microversion: 2.1 time: 0.697973 Aug 09 17:10:48.017976 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 726/1350] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:47 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 1491 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:48.035280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2bb27f0a-f889-4446-abc6-2f82746bee93 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:48.036437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2bb27f0a-f889-4446-abc6-2f82746bee93 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:48.062614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bb27f0a-f889-4446-abc6-2f82746bee93 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:48.063433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bb27f0a-f889-4446-abc6-2f82746bee93 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:48.064233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bb27f0a-f889-4446-abc6-2f82746bee93 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:48.066504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bb27f0a-f889-4446-abc6-2f82746bee93 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:48.067300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bb27f0a-f889-4446-abc6-2f82746bee93 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:48.077382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bb27f0a-f889-4446-abc6-2f82746bee93 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:48.890588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2bb27f0a-f889-4446-abc6-2f82746bee93 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15746b3e026244a9ba11f072b26f6a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f21dc5544604cbfad9a198e47639911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:48.919168 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2bb27f0a-f889-4446-abc6-2f82746bee93 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 200 len: 1467 microversion: 2.1 time: 0.898180 Aug 09 17:10:48.936968 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 727/1351] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:48 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 1467 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:48.959166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f95ce302-92b1-42f6-8e07-149d644c97a4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:48.963680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f95ce302-92b1-42f6-8e07-149d644c97a4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:48.979884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f95ce302-92b1-42f6-8e07-149d644c97a4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:48.981907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f95ce302-92b1-42f6-8e07-149d644c97a4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:48.983298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f95ce302-92b1-42f6-8e07-149d644c97a4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:48.985039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f95ce302-92b1-42f6-8e07-149d644c97a4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:48.986123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f95ce302-92b1-42f6-8e07-149d644c97a4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:48.987181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f95ce302-92b1-42f6-8e07-149d644c97a4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:49.120123 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f95ce302-92b1-42f6-8e07-149d644c97a4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180558 Aug 09 17:10:49.132112 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 728/1352] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:10:48 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:49.143931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-594a4e91-ec54-4761-a3c6-c75458c7109f req-d1600fd8-574c-4100-83af-d8057a4bb349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f377368-7c9c-48cb-80c1-c2253e0f5105", "name": "network-vif-plugged", "status": "completed", "tag": "4fecb257-a514-4d5d-8975-355ca5c6fce6"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:49.173695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-594a4e91-ec54-4761-a3c6-c75458c7109f req-d1600fd8-574c-4100-83af-d8057a4bb349 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:49.176189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-594a4e91-ec54-4761-a3c6-c75458c7109f req-d1600fd8-574c-4100-83af-d8057a4bb349 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:49.177268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-594a4e91-ec54-4761-a3c6-c75458c7109f req-d1600fd8-574c-4100-83af-d8057a4bb349 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:49.207797 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-594a4e91-ec54-4761-a3c6-c75458c7109f req-d1600fd8-574c-4100-83af-d8057a4bb349 service nova] Creating event network-vif-plugged:4fecb257-a514-4d5d-8975-355ca5c6fce6 for instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 on n-h1-845781-6 Aug 09 17:10:49.226393 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-594a4e91-ec54-4761-a3c6-c75458c7109f req-d1600fd8-574c-4100-83af-d8057a4bb349 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090579 Aug 09 17:10:49.228344 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 729/1353] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:49.242764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0f0b1469-8fa0-40fa-a3a0-be44809bd71e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:49.244957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0f0b1469-8fa0-40fa-a3a0-be44809bd71e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:49.286245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f0b1469-8fa0-40fa-a3a0-be44809bd71e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:49.289029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f0b1469-8fa0-40fa-a3a0-be44809bd71e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:49.290396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f0b1469-8fa0-40fa-a3a0-be44809bd71e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:49.292239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f0b1469-8fa0-40fa-a3a0-be44809bd71e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:49.293368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f0b1469-8fa0-40fa-a3a0-be44809bd71e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:49.294371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f0b1469-8fa0-40fa-a3a0-be44809bd71e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:50.089409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0f0b1469-8fa0-40fa-a3a0-be44809bd71e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:50.124457 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0f0b1469-8fa0-40fa-a3a0-be44809bd71e tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1372 microversion: 2.1 time: 0.887842 Aug 09 17:10:50.126897 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 730/1354] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:49 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1372 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:50.149642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f96ca9f1-75f5-4ea8-a3c6-ef58ad6bca8a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:50.155769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f96ca9f1-75f5-4ea8-a3c6-ef58ad6bca8a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:50.183116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96ca9f1-75f5-4ea8-a3c6-ef58ad6bca8a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:50.187265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96ca9f1-75f5-4ea8-a3c6-ef58ad6bca8a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:50.188850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96ca9f1-75f5-4ea8-a3c6-ef58ad6bca8a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:50.196095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96ca9f1-75f5-4ea8-a3c6-ef58ad6bca8a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:50.199278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96ca9f1-75f5-4ea8-a3c6-ef58ad6bca8a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:50.203581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96ca9f1-75f5-4ea8-a3c6-ef58ad6bca8a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:51.262963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f96ca9f1-75f5-4ea8-a3c6-ef58ad6bca8a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:51.278503 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f96ca9f1-75f5-4ea8-a3c6-ef58ad6bca8a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 200 len: 1308 microversion: 2.1 time: 1.148461 Aug 09 17:10:51.281183 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 731/1355] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:50 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 1308 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:51.350797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e205535a-ff9d-4ff2-af6d-900e00f7dc81 req-356283dd-1fda-4f96-803f-ca4f7970bf62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a07b5bb-7014-4708-a343-520f1b468a9c", "name": "network-vif-deleted", "tag": "2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:51.381278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:51.388123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e205535a-ff9d-4ff2-af6d-900e00f7dc81 req-356283dd-1fda-4f96-803f-ca4f7970bf62 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:51.391359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e205535a-ff9d-4ff2-af6d-900e00f7dc81 req-356283dd-1fda-4f96-803f-ca4f7970bf62 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:51.392806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e205535a-ff9d-4ff2-af6d-900e00f7dc81 req-356283dd-1fda-4f96-803f-ca4f7970bf62 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:51.456260 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e205535a-ff9d-4ff2-af6d-900e00f7dc81 req-356283dd-1fda-4f96-803f-ca4f7970bf62 service nova] Creating event network-vif-deleted:2cc4a4f1-fbfb-4a84-9ebd-32ed01e5ff34 for instance 9a07b5bb-7014-4708-a343-520f1b468a9c on n-h1-845781-6 Aug 09 17:10:51.481567 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e205535a-ff9d-4ff2-af6d-900e00f7dc81 req-356283dd-1fda-4f96-803f-ca4f7970bf62 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150253 Aug 09 17:10:51.484340 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 732/1356] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:51.510305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:51.522700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 9a07b5bb-7014-4708-a343-520f1b468a9c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:51.541755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:51.544528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:51.546273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:51.548092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:51.549454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:51.551163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:51.652248 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] HTTP exception thrown: Instance 9a07b5bb-7014-4708-a343-520f1b468a9c could not be found. Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Request method failure captured: Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c HTTP/1.1 Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNnzYLwRufAQWqYCrYTZBQm-eZHrsuD_FHRNs1wLWby_tGswdlp7J0WhU7Ebf3sGPCXqpJK7CAAiNrgTUt73DKpsNgFklEp16yxuKZNOoqXaRDSO1oLDu6i3VMChdlrubNcRk6cILQh0s_AMRdmYcDFDsdnUWtZQ08y00B6b-_s0ZE Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 7004f453a4d944239c4641bbc394ebb5 Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-MigrationsAdminTest-1309381197 Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:10:51.659082 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-MigrationsAdminTest-1309381197 Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 7004f453a4d944239c4641bbc394ebb5 Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-MigrationsAdminTest-1309381197 Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-MigrationsAdminTest-1309381197-project Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 434e395144bc4443abb655a9d0a8b329 Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-MigrationsAdminTest-1309381197-project Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 9a07b5bb-7014-4708-a343-520f1b468a9c could not be found. Aug 09 17:10:51.661870 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9a07b5bb-7014-4708-a343-520f1b468a9c'} Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a07b5bb-7014-4708-a343-520f1b468a9c could not be found. Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:10:51.663369 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a07b5bb-7014-4708-a343-520f1b468a9c could not be found. Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a07b5bb-7014-4708-a343-520f1b468a9c could not be found. Aug 09 17:10:51.667017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:51.675824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Returning 404 to user: Instance 9a07b5bb-7014-4708-a343-520f1b468a9c could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:10:51.679093 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e2344ac7-91a9-49cc-b0c8-62991e446b74 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c" status: 404 len: 111 microversion: 2.1 time: 0.192049 Aug 09 17:10:51.689058 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 733/1357] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:51 2022] GET /compute/v2.1/servers/9a07b5bb-7014-4708-a343-520f1b468a9c => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:10:51.697683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f630a883-75e1-4235-9176-40403fd936fc req-2aab3f78-e1e3-46e0-aee1-20cae89a418a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a161e04-afa2-41fd-a0a2-e8cacd031ab2", "name": "network-vif-deleted", "tag": "638dabef-c670-43c4-a60c-c82cc6d78bf7"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:51.719341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f630a883-75e1-4235-9176-40403fd936fc req-2aab3f78-e1e3-46e0-aee1-20cae89a418a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:51.720523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f630a883-75e1-4235-9176-40403fd936fc req-2aab3f78-e1e3-46e0-aee1-20cae89a418a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:51.721456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f630a883-75e1-4235-9176-40403fd936fc req-2aab3f78-e1e3-46e0-aee1-20cae89a418a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:51.762940 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f630a883-75e1-4235-9176-40403fd936fc req-2aab3f78-e1e3-46e0-aee1-20cae89a418a service nova] Creating event network-vif-deleted:638dabef-c670-43c4-a60c-c82cc6d78bf7 for instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 on n-h2-845781-6 Aug 09 17:10:51.771367 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f630a883-75e1-4235-9176-40403fd936fc req-2aab3f78-e1e3-46e0-aee1-20cae89a418a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078198 Aug 09 17:10:51.772737 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 734/1358] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:51.779106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:51.780531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:51.789778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:51.790766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:51.791382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:51.792544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:51.793204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:51.794050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:51.819578 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] HTTP exception thrown: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:51.822062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Building network info cache for instance {{(pid=119432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Request method failure captured: Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 HTTP/1.1 Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pTb7-u0_QoxYrS3Bttl1C6iNmloNyM6DGgwHGG2hOgr4XyZmLcIO31GSIoiJgbpjd6Ly99h8_wygdf9M-uGrc9Ta3HJ5yGz82KY3HS7Dac1frRLMYmGeszy1IDd_0q7M_nds8GRMqhLNf0Ykg7cUznAs2BI54KbbAyYXwc2ORjl_AI Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:10:51.826670 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f21dc5544604cbfad9a198e47639911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 15746b3e026244a9ba11f072b26f6a46 Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:51.829070 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '6a161e04-afa2-41fd-a0a2-e8cacd031ab2'} Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:10:51.830506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:51.832827 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:51.836619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Returning 404 to user: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:10:51.837891 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-029afbf1-0526-4056-9637-c0361a4f2a22 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 404 len: 111 microversion: 2.1 time: 0.063579 Aug 09 17:10:51.839023 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 735/1359] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:51 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:10:51.846008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-95d26d4e-c338-4cbc-a891-c9aa91d4b57c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:51.849643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-95d26d4e-c338-4cbc-a891-c9aa91d4b57c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:51.857230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95d26d4e-c338-4cbc-a891-c9aa91d4b57c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:51.858105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95d26d4e-c338-4cbc-a891-c9aa91d4b57c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:51.858976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95d26d4e-c338-4cbc-a891-c9aa91d4b57c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:51.860215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95d26d4e-c338-4cbc-a891-c9aa91d4b57c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:51.861030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95d26d4e-c338-4cbc-a891-c9aa91d4b57c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:51.861676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95d26d4e-c338-4cbc-a891-c9aa91d4b57c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:51.927451 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-95d26d4e-c338-4cbc-a891-c9aa91d4b57c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086756 Aug 09 17:10:51.928663 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 736/1360] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:10:51 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:51.946402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dd639f90-7e72-4c26-9bb3-f4581742fd6a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:51.949674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dd639f90-7e72-4c26-9bb3-f4581742fd6a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:51.965277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd639f90-7e72-4c26-9bb3-f4581742fd6a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:51.969955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd639f90-7e72-4c26-9bb3-f4581742fd6a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:51.970819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd639f90-7e72-4c26-9bb3-f4581742fd6a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:51.971835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd639f90-7e72-4c26-9bb3-f4581742fd6a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:51.976188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd639f90-7e72-4c26-9bb3-f4581742fd6a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:51.976970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd639f90-7e72-4c26-9bb3-f4581742fd6a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:52.537626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dd639f90-7e72-4c26-9bb3-f4581742fd6a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:52.554675 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dd639f90-7e72-4c26-9bb3-f4581742fd6a tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1559 microversion: 2.1 time: 0.616831 Aug 09 17:10:52.558574 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 737/1361] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:51 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1559 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:52.563959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a59f1238-9993-4e94-90d0-7d322ce13682 req-841d6d2d-87e8-4a6f-a66b-924be883aaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a42c94f-6eeb-42bc-aa25-da394ea9e613", "name": "network-vif-unplugged", "status": "completed", "tag": "9804ab6e-317c-4af4-9474-17e5a74ceaec"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:52.593414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a59f1238-9993-4e94-90d0-7d322ce13682 req-841d6d2d-87e8-4a6f-a66b-924be883aaa1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:52.594292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a59f1238-9993-4e94-90d0-7d322ce13682 req-841d6d2d-87e8-4a6f-a66b-924be883aaa1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:52.595324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a59f1238-9993-4e94-90d0-7d322ce13682 req-841d6d2d-87e8-4a6f-a66b-924be883aaa1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:52.661600 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a59f1238-9993-4e94-90d0-7d322ce13682 req-841d6d2d-87e8-4a6f-a66b-924be883aaa1 service nova] Creating event network-vif-unplugged:9804ab6e-317c-4af4-9474-17e5a74ceaec for instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 on n-h1-845781-6 Aug 09 17:10:52.669948 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a59f1238-9993-4e94-90d0-7d322ce13682 req-841d6d2d-87e8-4a6f-a66b-924be883aaa1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109652 Aug 09 17:10:52.675751 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 738/1362] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:52.686047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d3dbeb11-afc4-4cb3-884a-fe08be5d54ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '.version_select at 0x7fbbcb48fc10>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:52.706376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:52.749601 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d3dbeb11-afc4-4cb3-884a-fe08be5d54ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-245692646" status: 202 len: 0 microversion: 2.1 time: 0.072122 Aug 09 17:10:52.751014 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 739/1363] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-245692646 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:10:52.770179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-647259319", "metadata": {"image_type": "test"}}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:52.787168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:52.804680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:52.808720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:52.809474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:52.810810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:52.824498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:52.825343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:52.842664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] HTTP exception thrown: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Request method failure captured: Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2/action HTTP/1.1 Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 111 Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pTb7-u0_QoxYrS3Bttl1C6iNmloNyM6DGgwHGG2hOgr4XyZmLcIO31GSIoiJgbpjd6Ly99h8_wygdf9M-uGrc9Ta3HJ5yGz82KY3HS7Dac1frRLMYmGeszy1IDd_0q7M_nds8GRMqhLNf0Ykg7cUznAs2BI54KbbAyYXwc2ORjl_AI Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:10:52.845113 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f21dc5544604cbfad9a198e47639911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 15746b3e026244a9ba11f072b26f6a46 Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-647259319", "metadata": {"image_type": "test"}}} Aug 09 17:10:52.846851 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '6a161e04-afa2-41fd-a0a2-e8cacd031ab2', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-647259319', 'metadata': {'image_type': 'test'}}}} Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:52.847811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:52.849008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:52.850291 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:52.850291 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:10:52.850291 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:10:52.850291 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:52.850291 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:52.852393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Returning 404 to user: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:10:52.853583 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9d5299e7-a483-469f-b4b7-0b225ecbc678 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "POST /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2/action" status: 404 len: 111 microversion: 2.1 time: 0.100353 Aug 09 17:10:52.861029 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 740/1364] 10.222.0.93 () {60 vars in 1279 bytes} [Tue Aug 9 17:10:52 2022] POST /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2/action => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:10:52.905067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:53.040360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2958c747-801b-4bdb-8c0f-e7afb3721d82 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:53.041514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2958c747-801b-4bdb-8c0f-e7afb3721d82 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:53.054939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2958c747-801b-4bdb-8c0f-e7afb3721d82 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:53.056073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2958c747-801b-4bdb-8c0f-e7afb3721d82 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:53.056805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2958c747-801b-4bdb-8c0f-e7afb3721d82 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:53.058105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2958c747-801b-4bdb-8c0f-e7afb3721d82 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:53.058909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2958c747-801b-4bdb-8c0f-e7afb3721d82 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:53.059647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2958c747-801b-4bdb-8c0f-e7afb3721d82 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:53.625583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Updating instance_info_cache with network_info: [{"id": "8dd9f845-7b2b-4c86-856a-d0c2faf3c649", "address": "fa:16:3e:c6:f2:e8", "network": {"id": "bf9538fd-ab95-4f28-9743-01ef51be592a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1857376060-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fc4ac8041e634c979c8678b4fde35a4f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8dd9f845-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:10:53.648416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Releasing lock "refresh_cache-7d4494b3-976f-4185-936c-52c1ba795d41" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:10:53.649374 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-70fcebff-4ca8-4b0b-91cf-d47ea41e9132 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "POST /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41/action" status: 202 len: 0 microversion: 2.1 time: 10.997601 Aug 09 17:10:53.650354 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 625/1365] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:10:42 2022] POST /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41/action => generated 0 bytes in 10999 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 17:10:53.661304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6c56c20f-82c9-4e9c-b8a2-bea71a92a07d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:53.661915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6c56c20f-82c9-4e9c-b8a2-bea71a92a07d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:53.671172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c56c20f-82c9-4e9c-b8a2-bea71a92a07d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:53.672148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c56c20f-82c9-4e9c-b8a2-bea71a92a07d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:53.672968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c56c20f-82c9-4e9c-b8a2-bea71a92a07d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:53.674277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c56c20f-82c9-4e9c-b8a2-bea71a92a07d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:53.675539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c56c20f-82c9-4e9c-b8a2-bea71a92a07d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:53.676171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c56c20f-82c9-4e9c-b8a2-bea71a92a07d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:53.842655 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6c56c20f-82c9-4e9c-b8a2-bea71a92a07d tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.190760 Aug 09 17:10:53.846459 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 626/1366] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:10:53 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:53.869614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e802857f-cb4c-4a2a-8d4f-0f7f743b390e tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1309924641", "metadata": {"image_type": "test"}}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:53.878026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e802857f-cb4c-4a2a-8d4f-0f7f743b390e tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Failed to fetch instance by id tempest-invalid-1917893543 {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 17:10:53.879556 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-e802857f-cb4c-4a2a-8d4f-0f7f743b390e tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] HTTP exception thrown: Instance tempest-invalid-1917893543 could not be found. Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e802857f-cb4c-4a2a-8d4f-0f7f743b390e tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Request method failure captured: Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/tempest-invalid-1917893543/action HTTP/1.1 Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 112 Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pTb7-u0_QoxYrS3Bttl1C6iNmloNyM6DGgwHGG2hOgr4XyZmLcIO31GSIoiJgbpjd6Ly99h8_wygdf9M-uGrc9Ta3HJ5yGz82KY3HS7Dac1frRLMYmGeszy1IDd_0q7M_nds8GRMqhLNf0Ykg7cUznAs2BI54KbbAyYXwc2ORjl_AI Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:10:53.885071 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f21dc5544604cbfad9a198e47639911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 15746b3e026244a9ba11f072b26f6a46 Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1309924641", "metadata": {"image_type": "test"}}} Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:10:53.888965 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance tempest-invalid-1917893543 could not be found. Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'tempest-invalid-1917893543', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1309924641', 'metadata': {'image_type': 'test'}}}} Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1917893543 could not be found. Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:10:53.893362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1917893543 could not be found. Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1917893543 could not be found. Aug 09 17:10:53.902626 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:10:53.907420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:53.909305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e802857f-cb4c-4a2a-8d4f-0f7f743b390e tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Returning 404 to user: Instance tempest-invalid-1917893543 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:10:53.912538 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e802857f-cb4c-4a2a-8d4f-0f7f743b390e tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "POST /compute/v2.1/servers/tempest-invalid-1917893543/action" status: 404 len: 101 microversion: 2.1 time: 0.063235 Aug 09 17:10:53.920976 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 627/1367] 10.222.0.93 () {60 vars in 1249 bytes} [Tue Aug 9 17:10:53 2022] POST /compute/v2.1/servers/tempest-invalid-1917893543/action => generated 101 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:10:53.929708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f2d80079-257a-4af1-9664-10882446f92c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:53.933751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f2d80079-257a-4af1-9664-10882446f92c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:53.957471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d80079-257a-4af1-9664-10882446f92c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:53.958381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d80079-257a-4af1-9664-10882446f92c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:53.959156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d80079-257a-4af1-9664-10882446f92c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:53.961149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d80079-257a-4af1-9664-10882446f92c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:53.962033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d80079-257a-4af1-9664-10882446f92c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:53.962822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d80079-257a-4af1-9664-10882446f92c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:53.969279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2958c747-801b-4bdb-8c0f-e7afb3721d82 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:53.996707 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2958c747-801b-4bdb-8c0f-e7afb3721d82 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 200 len: 1308 microversion: 2.1 time: 1.133165 Aug 09 17:10:53.997498 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 741/1368] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:52 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 1308 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:54.032266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-49bcdcd7-2e6b-4dbc-8dc0-fc49f0ba7674 req-d6b30c1b-0424-44ef-9ef5-b915823ce291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6eeb62-35cd-4f55-9b7c-d209294fb0e1", "tag": "69d30c98-d9a6-494a-912c-95f6075b434d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:54.057108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-49bcdcd7-2e6b-4dbc-8dc0-fc49f0ba7674 req-d6b30c1b-0424-44ef-9ef5-b915823ce291 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:54.057883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-49bcdcd7-2e6b-4dbc-8dc0-fc49f0ba7674 req-d6b30c1b-0424-44ef-9ef5-b915823ce291 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:54.058652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-49bcdcd7-2e6b-4dbc-8dc0-fc49f0ba7674 req-d6b30c1b-0424-44ef-9ef5-b915823ce291 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:54.090324 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f2d80079-257a-4af1-9664-10882446f92c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.168394 Aug 09 17:10:54.096776 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-49bcdcd7-2e6b-4dbc-8dc0-fc49f0ba7674 req-d6b30c1b-0424-44ef-9ef5-b915823ce291 service nova] Creating event network-changed:69d30c98-d9a6-494a-912c-95f6075b434d for instance 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 on n-h2-845781-6 Aug 09 17:10:54.097639 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 628/1369] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:10:53 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2/os-volume_attachments => generated 25 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:10:54.111050 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-49bcdcd7-2e6b-4dbc-8dc0-fc49f0ba7674 req-d6b30c1b-0424-44ef-9ef5-b915823ce291 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089342 Aug 09 17:10:54.112346 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 742/1370] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:54.116533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e1f765d5-3c81-42fc-bf7d-81cfdcb324d2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '.version_select at 0x7fbbcb609790>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:54.130885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5e42ba21-ec71-4958-a41a-9d366cd0dc7b req-41c2b6a2-e0f9-4250-81fb-9690f4fe6566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a42c94f-6eeb-42bc-aa25-da394ea9e613", "name": "network-vif-deleted", "tag": "9804ab6e-317c-4af4-9474-17e5a74ceaec"}, {"name": "network-changed", "server_uuid": "7d4494b3-976f-4185-936c-52c1ba795d41", "tag": "8dd9f845-7b2b-4c86-856a-d0c2faf3c649"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:54.163197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5e42ba21-ec71-4958-a41a-9d366cd0dc7b req-41c2b6a2-e0f9-4250-81fb-9690f4fe6566 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:54.163757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5e42ba21-ec71-4958-a41a-9d366cd0dc7b req-41c2b6a2-e0f9-4250-81fb-9690f4fe6566 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:54.177057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5e42ba21-ec71-4958-a41a-9d366cd0dc7b req-41c2b6a2-e0f9-4250-81fb-9690f4fe6566 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:54.206431 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5e42ba21-ec71-4958-a41a-9d366cd0dc7b req-41c2b6a2-e0f9-4250-81fb-9690f4fe6566 service nova] Creating event network-vif-deleted:9804ab6e-317c-4af4-9474-17e5a74ceaec for instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 on n-h1-845781-6 Aug 09 17:10:54.207096 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5e42ba21-ec71-4958-a41a-9d366cd0dc7b req-41c2b6a2-e0f9-4250-81fb-9690f4fe6566 service nova] Creating event network-changed:8dd9f845-7b2b-4c86-856a-d0c2faf3c649 for instance 7d4494b3-976f-4185-936c-52c1ba795d41 on n-h1-845781-6 Aug 09 17:10:54.222710 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5e42ba21-ec71-4958-a41a-9d366cd0dc7b req-41c2b6a2-e0f9-4250-81fb-9690f4fe6566 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.106240 Aug 09 17:10:54.223816 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 743/1371] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:54.254983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbda6a38-f2cd-4559-9856-08f33d708f9a tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-846078000"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:54.259315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dbda6a38-f2cd-4559-9856-08f33d708f9a tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 17:10:54.260251 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-dbda6a38-f2cd-4559-9856-08f33d708f9a tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbda6a38-f2cd-4559-9856-08f33d708f9a tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Request method failure captured: Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 56 Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pTb7-u0_QoxYrS3Bttl1C6iNmloNyM6DGgwHGG2hOgr4XyZmLcIO31GSIoiJgbpjd6Ly99h8_wygdf9M-uGrc9Ta3HJ5yGz82KY3HS7Dac1frRLMYmGeszy1IDd_0q7M_nds8GRMqhLNf0Ykg7cUznAs2BI54KbbAyYXwc2ORjl_AI Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:10:54.263592 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f21dc5544604cbfad9a198e47639911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 15746b3e026244a9ba11f072b26f6a46 Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: {"createImage": {"name": "tempest-test-snap-846078000"}} Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:10:54.266275 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-846078000'}}} Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:10:54.267946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 17:10:54.270919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.281357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbda6a38-f2cd-4559-9856-08f33d708f9a tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:10:54.281357 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dbda6a38-f2cd-4559-9856-08f33d708f9a tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.038352 Aug 09 17:10:54.281357 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 744/1372] 10.222.0.93 () {60 vars in 1275 bytes} [Tue Aug 9 17:10:54 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:10:54.287304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c65745ec-2639-40f3-91d5-5a5b7ce56616 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1863975642"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:54.301525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c65745ec-2639-40f3-91d5-5a5b7ce56616 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 17:10:54.302098 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c65745ec-2639-40f3-91d5-5a5b7ce56616 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c65745ec-2639-40f3-91d5-5a5b7ce56616 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Request method failure captured: Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 57 Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pTb7-u0_QoxYrS3Bttl1C6iNmloNyM6DGgwHGG2hOgr4XyZmLcIO31GSIoiJgbpjd6Ly99h8_wygdf9M-uGrc9Ta3HJ5yGz82KY3HS7Dac1frRLMYmGeszy1IDd_0q7M_nds8GRMqhLNf0Ykg7cUznAs2BI54KbbAyYXwc2ORjl_AI Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:10:54.304260 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f21dc5544604cbfad9a198e47639911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 15746b3e026244a9ba11f072b26f6a46 Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: {"createImage": {"name": "tempest-test-snap-1863975642"}} Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:10:54.307163 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1863975642'}}} Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:10:54.308879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 17:10:54.311785 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.321135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c65745ec-2639-40f3-91d5-5a5b7ce56616 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:10:54.321135 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c65745ec-2639-40f3-91d5-5a5b7ce56616 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.028263 Aug 09 17:10:54.321135 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 745/1373] 10.222.0.93 () {60 vars in 1281 bytes} [Tue Aug 9 17:10:54 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:10:54.336852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:54.337163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:54.368486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:54.369326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:54.370088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:54.371281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:54.376588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:54.379990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:54.412422 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] HTTP exception thrown: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Request method failure captured: Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 HTTP/1.1 Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pTb7-u0_QoxYrS3Bttl1C6iNmloNyM6DGgwHGG2hOgr4XyZmLcIO31GSIoiJgbpjd6Ly99h8_wygdf9M-uGrc9Ta3HJ5yGz82KY3HS7Dac1frRLMYmGeszy1IDd_0q7M_nds8GRMqhLNf0Ykg7cUznAs2BI54KbbAyYXwc2ORjl_AI Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:10:54.417182 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f21dc5544604cbfad9a198e47639911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 15746b3e026244a9ba11f072b26f6a46 Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:54.419117 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '6a161e04-afa2-41fd-a0a2-e8cacd031ab2'} Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:10:54.420062 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:54.422175 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.435492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Returning 404 to user: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:10:54.452585 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e046ce11-bb06-4144-8227-6133cb84a621 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 404 len: 111 microversion: 2.1 time: 0.121237 Aug 09 17:10:54.473899 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 746/1374] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:10:54 2022] DELETE /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:10:54.499455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:54.500704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] [instance: 6a161e04-afa2-41fd-a0a2-e8cacd031ab2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:54.557586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:54.563261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:54.564149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:54.571136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:54.572077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:54.572881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:54.673578 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] HTTP exception thrown: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Request method failure captured: Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 HTTP/1.1 Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pTb7-u0_QoxYrS3Bttl1C6iNmloNyM6DGgwHGG2hOgr4XyZmLcIO31GSIoiJgbpjd6Ly99h8_wygdf9M-uGrc9Ta3HJ5yGz82KY3HS7Dac1frRLMYmGeszy1IDd_0q7M_nds8GRMqhLNf0Ykg7cUznAs2BI54KbbAyYXwc2ORjl_AI Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:10:54.694500 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f21dc5544604cbfad9a198e47639911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f21dc5544604cbfad9a198e47639911"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5f21dc5544604cbfad9a198e47639911 Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-697474320 Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 15746b3e026244a9ba11f072b26f6a46 Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesNegativeTestJSON-697474320-project Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:54.696361 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '6a161e04-afa2-41fd-a0a2-e8cacd031ab2'} Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:10:54.697474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. Aug 09 17:10:54.698798 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:10:54.704472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] Returning 404 to user: Instance 6a161e04-afa2-41fd-a0a2-e8cacd031ab2 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:10:54.706164 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df49dc62-6461-4983-b529-a0ae765dad23 tempest-ImagesNegativeTestJSON-697474320 tempest-ImagesNegativeTestJSON-697474320-project] 10.222.0.93 "GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2" status: 404 len: 111 microversion: 2.1 time: 0.230489 Aug 09 17:10:54.712985 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 747/1375] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:54 2022] GET /compute/v2.1/servers/6a161e04-afa2-41fd-a0a2-e8cacd031ab2 => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:10:55.025741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-46bc2931-2aed-49b9-b504-5f359ff4391e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:10:55.027110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-46bc2931-2aed-49b9-b504-5f359ff4391e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:55.042607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46bc2931-2aed-49b9-b504-5f359ff4391e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:55.047916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46bc2931-2aed-49b9-b504-5f359ff4391e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:55.048777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46bc2931-2aed-49b9-b504-5f359ff4391e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:55.050290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46bc2931-2aed-49b9-b504-5f359ff4391e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:55.050942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46bc2931-2aed-49b9-b504-5f359ff4391e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:55.051755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46bc2931-2aed-49b9-b504-5f359ff4391e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:55.096870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:10:55.657204 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e1f765d5-3c81-42fc-bf7d-81cfdcb324d2 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/278e324a-4188-4cd4-bacc-d0d7b7c2c694" status: 200 len: 183 microversion: 2.1 time: 1.555832 Aug 09 17:10:55.660280 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 629/1376] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 17:10:54 2022] GET /compute/v2.1/os-floating-ips/278e324a-4188-4cd4-bacc-d0d7b7c2c694 => generated 183 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:10:55.678460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.9"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:56.162407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:10:56.178627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:56.180182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:56.181434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:56.183218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:10:56.184564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:10:56.185702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:10:56.346624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-46bc2931-2aed-49b9-b504-5f359ff4391e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:10:56.360579 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-46bc2931-2aed-49b9-b504-5f359ff4391e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 200 len: 1308 microversion: 2.1 time: 1.339161 Aug 09 17:10:56.361599 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 748/1377] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:10:55 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 1308 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:10:56.410460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-652962285", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e7f3c62a-4596-47e0-bcb0-e90312e30949"}, {"port": "f19286e2-58f2-4f51-9878-ebb153c05f5f", "tag": "port-1"}, {"port": "2936b497-d537-4328-a229-123214f26882", "tag": "port-2"}, {"uuid": "4a3b547f-5847-4993-9809-365688978ab7", "tag": "net-1"}, {"uuid": "4a3b547f-5847-4993-9809-365688978ab7"}, {"uuid": "ccf7f19d-8b82-4307-98dc-77ba5411e41a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ccf7f19d-8b82-4307-98dc-77ba5411e41a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a59d2620-5f3b-4b77-b086-bc0efef66648", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "58037715-d0d8-48b1-9652-bf38ba24a24f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7882309b-622c-4efd-a859-8889aed8d317", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2038225668"}], "key_name": "tempest-keypair-1084048496", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:10:56.800642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "refresh_cache-7d4494b3-976f-4185-936c-52c1ba795d41" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:10:56.801373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquired lock "refresh_cache-7d4494b3-976f-4185-936c-52c1ba795d41" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:10:56.859358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] validate_networks() for [('e7f3c62a-4596-47e0-bcb0-e90312e30949', None, None, None, None, None), (None, None, 'f19286e2-58f2-4f51-9878-ebb153c05f5f', None, None, None), (None, None, '2936b497-d537-4328-a229-123214f26882', None, None, None), ('4a3b547f-5847-4993-9809-365688978ab7', None, None, None, None, None), ('4a3b547f-5847-4993-9809-365688978ab7', None, None, None, None, None), ('ccf7f19d-8b82-4307-98dc-77ba5411e41a', '10.2.2.100', None, None, None, None), ('ccf7f19d-8b82-4307-98dc-77ba5411e41a', '10.2.2.200', None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:10:59.988309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Building network info cache for instance {{(pid=119432) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 17:11:02.147094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Updating instance_info_cache with network_info: [{"id": "8dd9f845-7b2b-4c86-856a-d0c2faf3c649", "address": "fa:16:3e:c6:f2:e8", "network": {"id": "bf9538fd-ab95-4f28-9743-01ef51be592a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1857376060-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fc4ac8041e634c979c8678b4fde35a4f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8dd9f845-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119432) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:11:02.171520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Releasing lock "refresh_cache-7d4494b3-976f-4185-936c-52c1ba795d41" {{(pid=119432) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:11:02.173565 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b2db8188-fd01-454b-b19f-e95340c939f3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "POST /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41/action" status: 202 len: 0 microversion: 2.1 time: 6.502139 Aug 09 17:11:02.175232 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 630/1378] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:10:55 2022] POST /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41/action => generated 0 bytes in 6505 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 17:11:02.186498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6172d001-4f56-4b3d-afd2-1d546dfd39c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:02.187916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6172d001-4f56-4b3d-afd2-1d546dfd39c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:02.196658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6172d001-4f56-4b3d-afd2-1d546dfd39c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:02.198681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6172d001-4f56-4b3d-afd2-1d546dfd39c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:02.200238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6172d001-4f56-4b3d-afd2-1d546dfd39c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:02.203704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6172d001-4f56-4b3d-afd2-1d546dfd39c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:02.204439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6172d001-4f56-4b3d-afd2-1d546dfd39c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:02.205461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6172d001-4f56-4b3d-afd2-1d546dfd39c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:02.982692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6172d001-4f56-4b3d-afd2-1d546dfd39c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:03.000704 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6172d001-4f56-4b3d-afd2-1d546dfd39c2 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 200 len: 1308 microversion: 2.1 time: 0.822945 Aug 09 17:11:03.002725 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 631/1379] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:02 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 1308 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:03.018016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-26084c1e-c275-4738-83f1-55835ecbe8e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:03.020079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-26084c1e-c275-4738-83f1-55835ecbe8e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:03.035962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26084c1e-c275-4738-83f1-55835ecbe8e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:03.037243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26084c1e-c275-4738-83f1-55835ecbe8e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:03.038518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26084c1e-c275-4738-83f1-55835ecbe8e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:03.041375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26084c1e-c275-4738-83f1-55835ecbe8e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:03.042839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26084c1e-c275-4738-83f1-55835ecbe8e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:03.044297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26084c1e-c275-4738-83f1-55835ecbe8e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:03.106001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-26084c1e-c275-4738-83f1-55835ecbe8e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:11:03.326400 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-26084c1e-c275-4738-83f1-55835ecbe8e0 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "DELETE /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 204 len: 0 microversion: 2.1 time: 0.320001 Aug 09 17:11:03.329161 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 632/1380] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:11:03 2022] DELETE /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:11:03.360273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-22125018-85a8-4a1f-9706-b35c91502265 req-cc6111fb-fe83-4ee2-88ba-eaf642beb148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f377368-7c9c-48cb-80c1-c2253e0f5105", "tag": "4fecb257-a514-4d5d-8975-355ca5c6fce6"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:03.390094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-22125018-85a8-4a1f-9706-b35c91502265 req-cc6111fb-fe83-4ee2-88ba-eaf642beb148 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:03.391735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-22125018-85a8-4a1f-9706-b35c91502265 req-cc6111fb-fe83-4ee2-88ba-eaf642beb148 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:03.396382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-22125018-85a8-4a1f-9706-b35c91502265 req-cc6111fb-fe83-4ee2-88ba-eaf642beb148 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:03.433826 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-22125018-85a8-4a1f-9706-b35c91502265 req-cc6111fb-fe83-4ee2-88ba-eaf642beb148 service nova] Creating event network-changed:4fecb257-a514-4d5d-8975-355ca5c6fce6 for instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 on n-h1-845781-6 Aug 09 17:11:03.451525 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-22125018-85a8-4a1f-9706-b35c91502265 req-cc6111fb-fe83-4ee2-88ba-eaf642beb148 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118967 Aug 09 17:11:03.453435 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 633/1381] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:03.464707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-1b112c24-a3ca-4847-b464-aa8189552f3e req-906a3446-4b7c-4479-aded-1da4e6304549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6eeb62-35cd-4f55-9b7c-d209294fb0e1", "name": "network-vif-plugged", "status": "completed", "tag": "69d30c98-d9a6-494a-912c-95f6075b434d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:03.506885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1b112c24-a3ca-4847-b464-aa8189552f3e req-906a3446-4b7c-4479-aded-1da4e6304549 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:03.507812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1b112c24-a3ca-4847-b464-aa8189552f3e req-906a3446-4b7c-4479-aded-1da4e6304549 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:03.508751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1b112c24-a3ca-4847-b464-aa8189552f3e req-906a3446-4b7c-4479-aded-1da4e6304549 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:03.531700 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-1b112c24-a3ca-4847-b464-aa8189552f3e req-906a3446-4b7c-4479-aded-1da4e6304549 service nova] Creating event network-vif-plugged:69d30c98-d9a6-494a-912c-95f6075b434d for instance 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 on n-h2-845781-6 Aug 09 17:11:03.549134 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-1b112c24-a3ca-4847-b464-aa8189552f3e req-906a3446-4b7c-4479-aded-1da4e6304549 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092350 Aug 09 17:11:03.551695 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 634/1382] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:03.562481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:03.562883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:03.577915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:03.578724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:03.579673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:03.581017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:03.581912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:03.582700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:03.633013 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] HTTP exception thrown: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Request method failure captured: Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 HTTP/1.1 Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pSAkY_BOBMg0pOG0M9rQefKtvlTM-IYLjqwtDgVTv-v1dnAwR6meoJvzppVeAVh8o5eAyw1lImjCSb5SPypBWmDOB5FUb2-IpVOfAZ-jRyVcmC6R7KBv6VgbeYdy5gvgsLNAI-xHY5XaE2byMGqmqp3wiQosX8aSD5pLnrMHxziLQg Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fc4ac8041e634c979c8678b4fde35a4f Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:11:03.648014 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fc4ac8041e634c979c8678b4fde35a4f Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FloatingIPsAssociationTestJSON-1691628508-project Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d55e4a6f6b7b4766b6510072d21f1e60 Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1691628508-project Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. Aug 09 17:11:03.650688 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '8a42c94f-6eeb-42bc-aa25-da394ea9e613'} Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:03.652497 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. Aug 09 17:11:03.656464 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:03.661417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Returning 404 to user: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:03.664493 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1db8de18-1950-43b9-920a-edaa02f6c4fb tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 404 len: 111 microversion: 2.1 time: 0.110614 Aug 09 17:11:03.668750 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 635/1383] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:11:03 2022] DELETE /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:11:03.683981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-25751111-2618-4920-8fe5-742ea8fc082b tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:03.685683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-25751111-2618-4920-8fe5-742ea8fc082b tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:03.716569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25751111-2618-4920-8fe5-742ea8fc082b tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:03.722177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25751111-2618-4920-8fe5-742ea8fc082b tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:03.722992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25751111-2618-4920-8fe5-742ea8fc082b tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:03.724071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25751111-2618-4920-8fe5-742ea8fc082b tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:03.724572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25751111-2618-4920-8fe5-742ea8fc082b tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:03.725016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25751111-2618-4920-8fe5-742ea8fc082b tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:03.995481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:11:03.996791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:11:03.997574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:11:03.998130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:11:03.998808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:11:04.034033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:04.037087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:04.037741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:04.039227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:04.040285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:04.041213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:04.079497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Getting quotas for project 314d59a0480e4be59dba88bc8810b146. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:11:04.089059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Getting quotas for user 3fea520df5014ddabc2f232cdaa8a53f and project 314d59a0480e4be59dba88bc8810b146. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:11:04.313613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:11:04.320081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a59d2620-5f3b-4b77-b086-bc0efef66648',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='58037715-d0d8-48b1-9652-bf38ba24a24f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7882309b-622c-4efd-a859-8889aed8d317',volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:11:04.559103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-25751111-2618-4920-8fe5-742ea8fc082b tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:11:04.583557 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-25751111-2618-4920-8fe5-742ea8fc082b tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 2423 microversion: 2.25 time: 0.905254 Aug 09 17:11:04.626989 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 636/1384] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:03 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 2423 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:04.635294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d415a8c7-6d8b-48e5-b836-177601d4c844 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:04.636632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d415a8c7-6d8b-48e5-b836-177601d4c844 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:04.648074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d415a8c7-6d8b-48e5-b836-177601d4c844 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:04.649258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d415a8c7-6d8b-48e5-b836-177601d4c844 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:04.650001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d415a8c7-6d8b-48e5-b836-177601d4c844 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:04.651030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d415a8c7-6d8b-48e5-b836-177601d4c844 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:04.652175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d415a8c7-6d8b-48e5-b836-177601d4c844 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:04.653849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d415a8c7-6d8b-48e5-b836-177601d4c844 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:05.321747 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-710f4c6f-14a4-4025-8d18-a1b199a0c75f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.914042 Aug 09 17:11:05.323026 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 749/1385] 10.222.0.93 () {62 vars in 1189 bytes} [Tue Aug 9 17:10:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 8918 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 09 17:11:05.341243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:05.343022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 8a42c94f-6eeb-42bc-aa25-da394ea9e613] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:05.356641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:05.359540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:05.361009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:05.363476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:05.365966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:05.367863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:05.401028 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] HTTP exception thrown: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Request method failure captured: Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 HTTP/1.1 Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pSAkY_BOBMg0pOG0M9rQefKtvlTM-IYLjqwtDgVTv-v1dnAwR6meoJvzppVeAVh8o5eAyw1lImjCSb5SPypBWmDOB5FUb2-IpVOfAZ-jRyVcmC6R7KBv6VgbeYdy5gvgsLNAI-xHY5XaE2byMGqmqp3wiQosX8aSD5pLnrMHxziLQg Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fc4ac8041e634c979c8678b4fde35a4f Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:11:05.403826 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fc4ac8041e634c979c8678b4fde35a4f Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FloatingIPsAssociationTestJSON-1691628508-project Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d55e4a6f6b7b4766b6510072d21f1e60 Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1691628508-project Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. Aug 09 17:11:05.406509 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8a42c94f-6eeb-42bc-aa25-da394ea9e613'} Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:05.408040 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. Aug 09 17:11:05.410719 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:05.413000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Returning 404 to user: Instance 8a42c94f-6eeb-42bc-aa25-da394ea9e613 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:05.413000 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-806fa3de-dc2f-4f81-9464-accbe053a3c3 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613" status: 404 len: 111 microversion: 2.1 time: 0.080128 Aug 09 17:11:05.413000 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 750/1386] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:05 2022] GET /compute/v2.1/servers/8a42c94f-6eeb-42bc-aa25-da394ea9e613 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:11:05.413477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-964a158e-1f44-4537-b218-bb337eb7b58b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:05.415699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-964a158e-1f44-4537-b218-bb337eb7b58b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:05.422801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-964a158e-1f44-4537-b218-bb337eb7b58b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:05.423376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-964a158e-1f44-4537-b218-bb337eb7b58b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:05.424406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-964a158e-1f44-4537-b218-bb337eb7b58b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:05.426732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-964a158e-1f44-4537-b218-bb337eb7b58b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:05.427422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-964a158e-1f44-4537-b218-bb337eb7b58b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:05.427955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-964a158e-1f44-4537-b218-bb337eb7b58b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:05.638127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d415a8c7-6d8b-48e5-b836-177601d4c844 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:05.659992 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d415a8c7-6d8b-48e5-b836-177601d4c844 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 200 len: 1467 microversion: 2.1 time: 1.026358 Aug 09 17:11:05.661809 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 637/1387] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:04 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 1467 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:05.699493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7b7ea3ad-8431-4813-b00e-283003e79d1a tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-845781-6", "block_migration": "auto"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:05.703168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7b7ea3ad-8431-4813-b00e-283003e79d1a tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:05.712112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3ad-8431-4813-b00e-283003e79d1a tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:05.712928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3ad-8431-4813-b00e-283003e79d1a tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:05.713385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3ad-8431-4813-b00e-283003e79d1a tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:05.714155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3ad-8431-4813-b00e-283003e79d1a tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:05.714625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3ad-8431-4813-b00e-283003e79d1a tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:05.715271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7ea3ad-8431-4813-b00e-283003e79d1a tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:05.747842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-7b7ea3ad-8431-4813-b00e-283003e79d1a tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'flavor' on Instance uuid 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:11:05.768777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7b7ea3ad-8431-4813-b00e-283003e79d1a tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Going to try to live migrate instance to n-h2-845781-6 {{(pid=119432) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 17:11:05.896985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=5,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:06.197453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-964a158e-1f44-4537-b218-bb337eb7b58b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:06.224566 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-964a158e-1f44-4537-b218-bb337eb7b58b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 200 len: 1487 microversion: 2.1 time: 0.816996 Aug 09 17:11:06.225989 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 751/1388] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:05 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 1487 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:06.246160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-720abd4c-49c5-4685-95ad-4f088d4e881c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:06.247155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-720abd4c-49c5-4685-95ad-4f088d4e881c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:06.476763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-720abd4c-49c5-4685-95ad-4f088d4e881c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:06.506183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-720abd4c-49c5-4685-95ad-4f088d4e881c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:06.517898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-720abd4c-49c5-4685-95ad-4f088d4e881c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:06.527696 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-720abd4c-49c5-4685-95ad-4f088d4e881c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1285 microversion: 2.42 time: 0.299249 Aug 09 17:11:06.559686 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 752/1389] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:06 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1285 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:06.559686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-539d54c7-0c29-4e77-9717-6e6565775496 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '.version_select at 0x7fbbcb7ad160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:09.156388 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-539d54c7-0c29-4e77-9717-6e6565775496 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/278e324a-4188-4cd4-bacc-d0d7b7c2c694" status: 202 len: 0 microversion: 2.1 time: 2.603651 Aug 09 17:11:09.159206 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 753/1390] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:11:06 2022] DELETE /compute/v2.1/os-floating-ips/278e324a-4188-4cd4-bacc-d0d7b7c2c694 => generated 0 bytes in 2611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:11:09.181202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-44fd1d8c-232e-4995-a2de-ce7128cbe319 req-219772b8-07c0-4b57-9a5e-3a9b861e8cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d4494b3-976f-4185-936c-52c1ba795d41", "tag": "8dd9f845-7b2b-4c86-856a-d0c2faf3c649"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:09.223950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-44fd1d8c-232e-4995-a2de-ce7128cbe319 req-219772b8-07c0-4b57-9a5e-3a9b861e8cfc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:09.228556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-44fd1d8c-232e-4995-a2de-ce7128cbe319 req-219772b8-07c0-4b57-9a5e-3a9b861e8cfc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:09.229628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-44fd1d8c-232e-4995-a2de-ce7128cbe319 req-219772b8-07c0-4b57-9a5e-3a9b861e8cfc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:09.257588 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-44fd1d8c-232e-4995-a2de-ce7128cbe319 req-219772b8-07c0-4b57-9a5e-3a9b861e8cfc service nova] Creating event network-changed:8dd9f845-7b2b-4c86-856a-d0c2faf3c649 for instance 7d4494b3-976f-4185-936c-52c1ba795d41 on n-h1-845781-6 Aug 09 17:11:09.264584 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-44fd1d8c-232e-4995-a2de-ce7128cbe319 req-219772b8-07c0-4b57-9a5e-3a9b861e8cfc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101542 Aug 09 17:11:09.266321 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 754/1391] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:09.275324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d30165e0-87a8-4e2e-b8b4-fd7fd1f30a1c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1764539315"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:09.278460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d30165e0-87a8-4e2e-b8b4-fd7fd1f30a1c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:09.288394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30165e0-87a8-4e2e-b8b4-fd7fd1f30a1c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:09.289156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30165e0-87a8-4e2e-b8b4-fd7fd1f30a1c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:09.289884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30165e0-87a8-4e2e-b8b4-fd7fd1f30a1c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:09.291362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30165e0-87a8-4e2e-b8b4-fd7fd1f30a1c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:09.292146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30165e0-87a8-4e2e-b8b4-fd7fd1f30a1c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:09.293049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30165e0-87a8-4e2e-b8b4-fd7fd1f30a1c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:09.716663 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d30165e0-87a8-4e2e-b8b4-fd7fd1f30a1c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "POST /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1/action" status: 202 len: 0 microversion: 2.1 time: 0.447853 Aug 09 17:11:09.717759 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 755/1392] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:11:09 2022] POST /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 17:11:09.724354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:09.726339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 45c0e36e-ac06-4af8-9f62-13a660022181] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:09.741533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:09.742052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:09.742661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:09.744004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:09.744863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:09.746672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:09.778850 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] HTTP exception thrown: Instance 45c0e36e-ac06-4af8-9f62-13a660022181 could not be found. Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Request method failure captured: Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 HTTP/1.1 Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pNnzYLwRufAQWqYCrYTZBQm-eZHrsuD_FHRNs1wLWby_tGswdlp7J0WhU7Ebf3sGPCXqpJK7CAAiNrgTUt73DKpsNgFklEp16yxuKZNOoqXaRDSO1oLDu6i3VMChdlrubNcRk6cILQh0s_AMRdmYcDFDsdnUWtZQ08y00B6b-_s0ZE Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 7004f453a4d944239c4641bbc394ebb5 Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-MigrationsAdminTest-1309381197 Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:11:09.781768 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-MigrationsAdminTest-1309381197 Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 7004f453a4d944239c4641bbc394ebb5 Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-MigrationsAdminTest-1309381197 Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-MigrationsAdminTest-1309381197-project Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 434e395144bc4443abb655a9d0a8b329 Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-MigrationsAdminTest-1309381197-project Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 45c0e36e-ac06-4af8-9f62-13a660022181 could not be found. Aug 09 17:11:09.783404 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '45c0e36e-ac06-4af8-9f62-13a660022181'} Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c0e36e-ac06-4af8-9f62-13a660022181 could not be found. Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:09.784233 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c0e36e-ac06-4af8-9f62-13a660022181 could not be found. Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c0e36e-ac06-4af8-9f62-13a660022181 could not be found. Aug 09 17:11:09.786496 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:09.789006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Returning 404 to user: Instance 45c0e36e-ac06-4af8-9f62-13a660022181 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:09.790369 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51e0e4ff-a179-4633-9c99-cac52086c4f4 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181" status: 404 len: 111 microversion: 2.1 time: 0.070957 Aug 09 17:11:09.791149 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 756/1393] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:09 2022] GET /compute/v2.1/servers/45c0e36e-ac06-4af8-9f62-13a660022181 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:11:09.806395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:09.807749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:09.816082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:09.816841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:09.817752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:09.818856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:09.819862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:09.820506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:10.357398 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7b7ea3ad-8431-4813-b00e-283003e79d1a tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/action" status: 202 len: 0 microversion: 2.25 time: 4.668546 Aug 09 17:11:10.373383 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 638/1394] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:11:05 2022] POST /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/action => generated 0 bytes in 4699 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:11:10.373700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:10.386804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6408e757-907a-4da2-bcc6-73092a69d1f8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:10.388564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6408e757-907a-4da2-bcc6-73092a69d1f8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:10.403859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6408e757-907a-4da2-bcc6-73092a69d1f8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:10.405926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6408e757-907a-4da2-bcc6-73092a69d1f8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:10.408472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6408e757-907a-4da2-bcc6-73092a69d1f8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:10.410879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6408e757-907a-4da2-bcc6-73092a69d1f8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:10.412295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6408e757-907a-4da2-bcc6-73092a69d1f8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:10.413242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:10.413821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6408e757-907a-4da2-bcc6-73092a69d1f8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:10.416184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:10.423873 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f6d0ddc6-33f0-48ee-8287-47ea73f05cba tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1593 microversion: 2.42 time: 0.622225 Aug 09 17:11:10.435983 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 757/1395] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:09 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1593 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:10.448478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f45a63d-c306-4afc-822c-13bb41c318ae tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb746ee0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:10.569704 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6f45a63d-c306-4afc-822c-13bb41c318ae tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611" status: 200 len: 1414 microversion: 2.1 time: 0.139486 Aug 09 17:11:10.570293 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 758/1396] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:11:10 2022] GET /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611 => generated 1414 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:10.582592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ecb8e75e-2e79-42ab-ac23-74b331eb84ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:10.592199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ecb8e75e-2e79-42ab-ac23-74b331eb84ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:10.607497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecb8e75e-2e79-42ab-ac23-74b331eb84ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:10.608034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecb8e75e-2e79-42ab-ac23-74b331eb84ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:10.608226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6408e757-907a-4da2-bcc6-73092a69d1f8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:11:10.608531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecb8e75e-2e79-42ab-ac23-74b331eb84ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:10.609211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecb8e75e-2e79-42ab-ac23-74b331eb84ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:10.609884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecb8e75e-2e79-42ab-ac23-74b331eb84ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:10.610602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecb8e75e-2e79-42ab-ac23-74b331eb84ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:10.724257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ecb8e75e-2e79-42ab-ac23-74b331eb84ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:11:10.946490 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6408e757-907a-4da2-bcc6-73092a69d1f8 tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 204 len: 0 microversion: 2.1 time: 0.562188 Aug 09 17:11:10.955986 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 639/1397] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:11:10 2022] DELETE /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:11:10.971460 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ecb8e75e-2e79-42ab-ac23-74b331eb84ed tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 204 len: 0 microversion: 2.1 time: 0.397300 Aug 09 17:11:10.971878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:10.975312 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 759/1398] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:11:10 2022] DELETE /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:11:10.979900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:10.991971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9ccfe818-5299-4606-ad89-0072b803f28f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb75db80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:11.019309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:11.021984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:11.022598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:11.025687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:11.026191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:11.026673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:11.123257 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9ccfe818-5299-4606-ad89-0072b803f28f tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611" status: 200 len: 1414 microversion: 2.1 time: 0.144659 Aug 09 17:11:11.124591 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 760/1399] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:11:10 2022] GET /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611 => generated 1414 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:11.137124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07ab9e40-0919-4319-9cee-f4eb31a5dcaa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:11.138256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07ab9e40-0919-4319-9cee-f4eb31a5dcaa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:11.161963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ab9e40-0919-4319-9cee-f4eb31a5dcaa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:11.162762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ab9e40-0919-4319-9cee-f4eb31a5dcaa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:11.163392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ab9e40-0919-4319-9cee-f4eb31a5dcaa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:11.164397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ab9e40-0919-4319-9cee-f4eb31a5dcaa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:11.166501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ab9e40-0919-4319-9cee-f4eb31a5dcaa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:11.168451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ab9e40-0919-4319-9cee-f4eb31a5dcaa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:11.383718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:11.413688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:11.422910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:11.424519 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a71a5ac2-eaf7-41d6-887e-bfeae72e038a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.470714 Aug 09 17:11:11.427363 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 640/1400] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:10 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:11.452025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-95afdf32-8ccb-43ad-a897-60a917a31e49 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:11.460881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-95afdf32-8ccb-43ad-a897-60a917a31e49 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:11.485237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95afdf32-8ccb-43ad-a897-60a917a31e49 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:11.485918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95afdf32-8ccb-43ad-a897-60a917a31e49 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:11.486357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95afdf32-8ccb-43ad-a897-60a917a31e49 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:11.487129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95afdf32-8ccb-43ad-a897-60a917a31e49 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:11.494312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95afdf32-8ccb-43ad-a897-60a917a31e49 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:11.496149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95afdf32-8ccb-43ad-a897-60a917a31e49 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:12.142786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-07ab9e40-0919-4319-9cee-f4eb31a5dcaa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:12.174890 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07ab9e40-0919-4319-9cee-f4eb31a5dcaa tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1527 microversion: 2.1 time: 1.045640 Aug 09 17:11:12.179460 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 761/1401] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:11 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1527 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:12.200648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e49676fb-c40b-46c4-9bd5-dbda15e321a3 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5a9040>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:12.557275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-95afdf32-8ccb-43ad-a897-60a917a31e49 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:12.586491 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-95afdf32-8ccb-43ad-a897-60a917a31e49 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1468 microversion: 2.1 time: 1.157044 Aug 09 17:11:12.594920 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e49676fb-c40b-46c4-9bd5-dbda15e321a3 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611" status: 204 len: 0 microversion: 2.1 time: 0.413608 Aug 09 17:11:12.601065 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 762/1402] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:12 2022] DELETE /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:11:12.610495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c878d9ba-58da-4082-859b-49afdb1973a1 req-65b2ac91-4f92-43be-bdd0-27c36445cc15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c0e36e-ac06-4af8-9f62-13a660022181", "name": "network-vif-deleted", "tag": "5c0b51c4-b352-4c21-acec-09318bb172f4"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:12.619837 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 641/1403] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:11 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1468 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:12.640901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:12.646187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:12.668247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:12.669087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:12.669783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c878d9ba-58da-4082-859b-49afdb1973a1 req-65b2ac91-4f92-43be-bdd0-27c36445cc15 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:12.670727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c878d9ba-58da-4082-859b-49afdb1973a1 req-65b2ac91-4f92-43be-bdd0-27c36445cc15 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:12.671660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c878d9ba-58da-4082-859b-49afdb1973a1 req-65b2ac91-4f92-43be-bdd0-27c36445cc15 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:12.671959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:12.680792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:12.684224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:12.685075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:12.726359 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c878d9ba-58da-4082-859b-49afdb1973a1 req-65b2ac91-4f92-43be-bdd0-27c36445cc15 service nova] Creating event network-vif-deleted:5c0b51c4-b352-4c21-acec-09318bb172f4 for instance 45c0e36e-ac06-4af8-9f62-13a660022181 on n-h1-845781-6 Aug 09 17:11:12.745541 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c878d9ba-58da-4082-859b-49afdb1973a1 req-65b2ac91-4f92-43be-bdd0-27c36445cc15 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141758 Aug 09 17:11:12.747391 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 763/1404] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:12.767784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:12.769907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:12.798720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:12.809108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:12.810004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:12.815679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:12.821691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:12.823001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:13.279089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:13.303696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:13.319423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:13.321667 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3d817cf1-bfa0-4403-8e0f-fab18ddc0f63 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1593 microversion: 2.42 time: 0.699638 Aug 09 17:11:13.341219 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 642/1405] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:12 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1593 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:13.496222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:13.522275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:13.527060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:13.539585 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e04b927-7826-45b7-ace6-7fa39f693879 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.787835 Aug 09 17:11:13.547009 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 764/1406] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:12 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:13.562542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8553fbd1-a951-451e-9816-78260662077e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb75d310>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:13.631965 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-8553fbd1-a951-451e-9816-78260662077e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Image not found. Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8553fbd1-a951-451e-9816-78260662077e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611 HTTP/1.1 Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:11:13.637038 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'f2abf154-6e11-4079-bdaf-d79683444611'} Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:13.639024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f2abf154-6e11-4079-bdaf-d79683444611 Aug 09 17:11:13.640197 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:11:13.642533 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f2abf154-6e11-4079-bdaf-d79683444611 could not be found. Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:11:13.644098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:11:13.645939 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:13.648846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8553fbd1-a951-451e-9816-78260662077e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:13.650136 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8553fbd1-a951-451e-9816-78260662077e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611" status: 404 len: 62 microversion: 2.1 time: 0.101322 Aug 09 17:11:13.651244 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 765/1407] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:11:13 2022] GET /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611 => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:11:13.666658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94f1948e-5655-49df-bee3-e865c0e05ead tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:13.669191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94f1948e-5655-49df-bee3-e865c0e05ead tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:13.699999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94f1948e-5655-49df-bee3-e865c0e05ead tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:13.701421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94f1948e-5655-49df-bee3-e865c0e05ead tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:13.702087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94f1948e-5655-49df-bee3-e865c0e05ead tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:13.703100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94f1948e-5655-49df-bee3-e865c0e05ead tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:13.704105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94f1948e-5655-49df-bee3-e865c0e05ead tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:13.704820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94f1948e-5655-49df-bee3-e865c0e05ead tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:13.843860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-618418922", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:14.025339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:11:14.065866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:14.270902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94f1948e-5655-49df-bee3-e865c0e05ead tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd55e4a6f6b7b4766b6510072d21f1e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ac8041e634c979c8678b4fde35a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:14.311939 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94f1948e-5655-49df-bee3-e865c0e05ead tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 200 len: 1527 microversion: 2.1 time: 0.658679 Aug 09 17:11:14.321077 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 766/1408] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:13 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 1527 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:14.330716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-52339139-9762-4747-9961-bfa39d9f34ba tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:14.340389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-52339139-9762-4747-9961-bfa39d9f34ba tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:14.383473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52339139-9762-4747-9961-bfa39d9f34ba tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:14.384924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52339139-9762-4747-9961-bfa39d9f34ba tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:14.386045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52339139-9762-4747-9961-bfa39d9f34ba tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:14.387753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52339139-9762-4747-9961-bfa39d9f34ba tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:14.388941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52339139-9762-4747-9961-bfa39d9f34ba tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:14.390025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52339139-9762-4747-9961-bfa39d9f34ba tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:14.843800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-52339139-9762-4747-9961-bfa39d9f34ba tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e395144bc4443abb655a9d0a8b329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7004f453a4d944239c4641bbc394ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:14.863209 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-52339139-9762-4747-9961-bfa39d9f34ba tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 200 len: 1426 microversion: 2.1 time: 0.540038 Aug 09 17:11:14.863874 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 767/1409] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:14 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 1426 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:14.876613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b49df9c7-e9c4-414f-a98d-5707f08aa21e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:14.877294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b49df9c7-e9c4-414f-a98d-5707f08aa21e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:14.916500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b49df9c7-e9c4-414f-a98d-5707f08aa21e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:14.917012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b49df9c7-e9c4-414f-a98d-5707f08aa21e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:14.917466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b49df9c7-e9c4-414f-a98d-5707f08aa21e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:14.918229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b49df9c7-e9c4-414f-a98d-5707f08aa21e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:14.918710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b49df9c7-e9c4-414f-a98d-5707f08aa21e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:14.919153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b49df9c7-e9c4-414f-a98d-5707f08aa21e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:15.617085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:11:15.618025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:11:15.618219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:11:15.619133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:11:15.619588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:11:15.653477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:15.654376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:15.655022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:15.655871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:15.656334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:15.657037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:15.710073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Getting quotas for project 58824a6471f34f1c9c371381b8140158. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:11:15.728334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Getting quotas for user 6251fca3070f46e88dea986cf6db9f07 and project 58824a6471f34f1c9c371381b8140158. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:11:15.801334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:11:15.805629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:11:15.934461 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f2c1a7fb-af41-4291-bb83-cd1dbb1b94cc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.587611 Aug 09 17:11:15.938081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b49df9c7-e9c4-414f-a98d-5707f08aa21e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:15.943851 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 643/1410] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:11:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:11:15.950425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:15.951837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:15.964612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:15.965190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:15.965716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:15.967013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:15.967526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:15.968574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:15.969259 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b49df9c7-e9c4-414f-a98d-5707f08aa21e tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 200 len: 1487 microversion: 2.1 time: 1.102177 Aug 09 17:11:15.975116 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 768/1411] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:14 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 1487 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:15.985397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-050c8773-eb0b-400b-b9d5-6ec63c0c50a1 req-e8225be0-07e1-4524-bf25-5b79f079d748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6eeb62-35cd-4f55-9b7c-d209294fb0e1", "name": "network-vif-plugged", "status": "completed", "tag": "69d30c98-d9a6-494a-912c-95f6075b434d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:16.006373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-050c8773-eb0b-400b-b9d5-6ec63c0c50a1 req-e8225be0-07e1-4524-bf25-5b79f079d748 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:16.020776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-050c8773-eb0b-400b-b9d5-6ec63c0c50a1 req-e8225be0-07e1-4524-bf25-5b79f079d748 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:16.022068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-050c8773-eb0b-400b-b9d5-6ec63c0c50a1 req-e8225be0-07e1-4524-bf25-5b79f079d748 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:16.074208 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-050c8773-eb0b-400b-b9d5-6ec63c0c50a1 req-e8225be0-07e1-4524-bf25-5b79f079d748 service nova] Creating event network-vif-plugged:69d30c98-d9a6-494a-912c-95f6075b434d for instance 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 on n-h2-845781-6 Aug 09 17:11:16.115279 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-050c8773-eb0b-400b-b9d5-6ec63c0c50a1 req-e8225be0-07e1-4524-bf25-5b79f079d748 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136856 Aug 09 17:11:16.117099 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 769/1412] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:16.170005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:16.181207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:16.206335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:16.223696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:16.231095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:16.234605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:16.236540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:16.239964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:16.486646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:16.517495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:16.562260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:16.565167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:16.574436 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c2c92d9d-1abb-41f0-bfdf-addbf35e6bbd tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1708 microversion: 2.42 time: 0.627686 Aug 09 17:11:16.579167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 644/1413] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:15 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1708 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:16.610303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-f678e6fa-980d-454c-a7b8-f079c239beac req-f8cb31be-ab50-4533-bd11-0e247496c1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a21dd49-aca6-47cf-9381-0265b1a7a9c7", "name": "network-vif-deleted", "tag": "25fa6b72-0892-44f5-bdbf-99073ca230d8"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:16.702439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f678e6fa-980d-454c-a7b8-f079c239beac req-f8cb31be-ab50-4533-bd11-0e247496c1a9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:16.709280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f678e6fa-980d-454c-a7b8-f079c239beac req-f8cb31be-ab50-4533-bd11-0e247496c1a9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:16.711997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f678e6fa-980d-454c-a7b8-f079c239beac req-f8cb31be-ab50-4533-bd11-0e247496c1a9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:16.756294 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-f678e6fa-980d-454c-a7b8-f079c239beac req-f8cb31be-ab50-4533-bd11-0e247496c1a9 service nova] Creating event network-vif-deleted:25fa6b72-0892-44f5-bdbf-99073ca230d8 for instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 on n-h2-845781-6 Aug 09 17:11:16.787599 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-f678e6fa-980d-454c-a7b8-f079c239beac req-f8cb31be-ab50-4533-bd11-0e247496c1a9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194376 Aug 09 17:11:16.792586 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 645/1414] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:16.827438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:16.834878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] [instance: 7d4494b3-976f-4185-936c-52c1ba795d41] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:16.884164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:16.886306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:16.888625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:16.890670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:16.900295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:16.903243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:16.943212 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] HTTP exception thrown: Instance 7d4494b3-976f-4185-936c-52c1ba795d41 could not be found. Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Request method failure captured: Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 HTTP/1.1 Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pSAkY_BOBMg0pOG0M9rQefKtvlTM-IYLjqwtDgVTv-v1dnAwR6meoJvzppVeAVh8o5eAyw1lImjCSb5SPypBWmDOB5FUb2-IpVOfAZ-jRyVcmC6R7KBv6VgbeYdy5gvgsLNAI-xHY5XaE2byMGqmqp3wiQosX8aSD5pLnrMHxziLQg Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fc4ac8041e634c979c8678b4fde35a4f Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:11:16.946277 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fc4ac8041e634c979c8678b4fde35a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fc4ac8041e634c979c8678b4fde35a4f Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1691628508 Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FloatingIPsAssociationTestJSON-1691628508-project Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d55e4a6f6b7b4766b6510072d21f1e60 Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1691628508-project Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 7d4494b3-976f-4185-936c-52c1ba795d41 could not be found. Aug 09 17:11:16.948374 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '7d4494b3-976f-4185-936c-52c1ba795d41'} Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4494b3-976f-4185-936c-52c1ba795d41 could not be found. Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:16.949714 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4494b3-976f-4185-936c-52c1ba795d41 could not be found. Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4494b3-976f-4185-936c-52c1ba795d41 could not be found. Aug 09 17:11:16.951306 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:16.955127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] Returning 404 to user: Instance 7d4494b3-976f-4185-936c-52c1ba795d41 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:16.956902 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-01d965c1-49e3-4be0-b8ae-6119bfb48bbc tempest-FloatingIPsAssociationTestJSON-1691628508 tempest-FloatingIPsAssociationTestJSON-1691628508-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41" status: 404 len: 111 microversion: 2.1 time: 0.162567 Aug 09 17:11:16.959560 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 646/1415] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:16 2022] GET /compute/v2.1/servers/7d4494b3-976f-4185-936c-52c1ba795d41 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:11:16.965612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:16.966779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] [instance: 6a21dd49-aca6-47cf-9381-0265b1a7a9c7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:16.977296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:16.978399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:16.979322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:16.981299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:16.983330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:16.984226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:17.014219 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] HTTP exception thrown: Instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 could not be found. Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Request method failure captured: Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 HTTP/1.1 Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pNnzYLwRufAQWqYCrYTZBQm-eZHrsuD_FHRNs1wLWby_tGswdlp7J0WhU7Ebf3sGPCXqpJK7CAAiNrgTUt73DKpsNgFklEp16yxuKZNOoqXaRDSO1oLDu6i3VMChdlrubNcRk6cILQh0s_AMRdmYcDFDsdnUWtZQ08y00B6b-_s0ZE Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 7004f453a4d944239c4641bbc394ebb5 Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-MigrationsAdminTest-1309381197 Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:11:17.016554 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7004f453a4d944239c4641bbc394ebb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-MigrationsAdminTest-1309381197 Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 7004f453a4d944239c4641bbc394ebb5 Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-MigrationsAdminTest-1309381197 Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-MigrationsAdminTest-1309381197-project Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 434e395144bc4443abb655a9d0a8b329 Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-MigrationsAdminTest-1309381197-project Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 could not be found. Aug 09 17:11:17.018343 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '6a21dd49-aca6-47cf-9381-0265b1a7a9c7'} Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 could not be found. Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:17.019834 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 could not be found. Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 could not be found. Aug 09 17:11:17.021406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:17.024166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] Returning 404 to user: Instance 6a21dd49-aca6-47cf-9381-0265b1a7a9c7 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:17.025767 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9eff59a4-2d7a-4ceb-a9fa-c0bf46624361 tempest-MigrationsAdminTest-1309381197 tempest-MigrationsAdminTest-1309381197-project] 10.222.0.93 "GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7" status: 404 len: 111 microversion: 2.1 time: 0.064368 Aug 09 17:11:17.026608 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 647/1416] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:16 2022] GET /compute/v2.1/servers/6a21dd49-aca6-47cf-9381-0265b1a7a9c7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:11:17.069747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8cad7761-4d53-483e-9e0a-293c734a0c5d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:17.073894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8cad7761-4d53-483e-9e0a-293c734a0c5d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:17.255859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:17.277255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:17.283944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:17.290889 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d5b0c88e-d929-44a3-b7ff-2ce487d79745 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 1.146647 Aug 09 17:11:17.303665 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 770/1417] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:16 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:17.309223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-010827a6-9aa3-460e-a658-08e58632cd4a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:17.309223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-010827a6-9aa3-460e-a658-08e58632cd4a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:17.344290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-010827a6-9aa3-460e-a658-08e58632cd4a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:17.345282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-010827a6-9aa3-460e-a658-08e58632cd4a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:17.348121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-010827a6-9aa3-460e-a658-08e58632cd4a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:17.351526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-010827a6-9aa3-460e-a658-08e58632cd4a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:17.355076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8cad7761-4d53-483e-9e0a-293c734a0c5d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:17.356300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-010827a6-9aa3-460e-a658-08e58632cd4a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:17.357180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-010827a6-9aa3-460e-a658-08e58632cd4a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:17.386586 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8cad7761-4d53-483e-9e0a-293c734a0c5d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1216 microversion: 2.1 time: 0.351162 Aug 09 17:11:17.402003 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 648/1418] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:17 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1216 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:17.469611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-010827a6-9aa3-460e-a658-08e58632cd4a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:11:17.503512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:17.607713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:17.609479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:17.646436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:17.652898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:17.654209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:17.660461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:17.661992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:17.663220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:17.859261 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-010827a6-9aa3-460e-a658-08e58632cd4a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 204 len: 0 microversion: 2.1 time: 0.565067 Aug 09 17:11:17.881433 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 771/1419] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:11:17 2022] DELETE /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:11:17.907751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c40fb86-5e6d-4478-9111-7350592ad0f3 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb75d8b0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:17.991511 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-3c40fb86-5e6d-4478-9111-7350592ad0f3 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Image not found. Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c40fb86-5e6d-4478-9111-7350592ad0f3 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611 HTTP/1.1 Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:11:17.994107 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'f2abf154-6e11-4079-bdaf-d79683444611'} Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:17.995571 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f2abf154-6e11-4079-bdaf-d79683444611 to delete Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:17.996672 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f2abf154-6e11-4079-bdaf-d79683444611 could not be found. Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:17.997928 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:11:17.999215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:18.001888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c40fb86-5e6d-4478-9111-7350592ad0f3 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:18.003161 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3c40fb86-5e6d-4478-9111-7350592ad0f3 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611" status: 404 len: 62 microversion: 2.1 time: 0.119502 Aug 09 17:11:18.004966 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 772/1420] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:17 2022] DELETE /compute/v2.1/images/f2abf154-6e11-4079-bdaf-d79683444611 => generated 62 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:11:18.016385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8ca66003-b7ca-4215-8818-f77fcaa5c4a5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:18.018088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ca66003-b7ca-4215-8818-f77fcaa5c4a5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:18.027174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ca66003-b7ca-4215-8818-f77fcaa5c4a5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:18.028132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ca66003-b7ca-4215-8818-f77fcaa5c4a5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:18.028807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ca66003-b7ca-4215-8818-f77fcaa5c4a5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:18.029775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ca66003-b7ca-4215-8818-f77fcaa5c4a5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:18.030473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ca66003-b7ca-4215-8818-f77fcaa5c4a5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:18.032177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ca66003-b7ca-4215-8818-f77fcaa5c4a5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:18.085147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ca66003-b7ca-4215-8818-f77fcaa5c4a5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:11:18.225426 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.compute.api [None req-8ca66003-b7ca-4215-8818-f77fcaa5c4a5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Instance is already in deleting state, ignoring this request Aug 09 17:11:18.229748 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8ca66003-b7ca-4215-8818-f77fcaa5c4a5 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 204 len: 0 microversion: 2.1 time: 0.218923 Aug 09 17:11:18.243077 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 773/1421] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:11:18 2022] DELETE /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:11:18.280683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f5e76c00-b4bb-4c51-9d76-725a2aae8ab9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:18.282752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f5e76c00-b4bb-4c51-9d76-725a2aae8ab9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:18.308685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:18.321969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5e76c00-b4bb-4c51-9d76-725a2aae8ab9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:18.323129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5e76c00-b4bb-4c51-9d76-725a2aae8ab9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:18.323916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5e76c00-b4bb-4c51-9d76-725a2aae8ab9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:18.325233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5e76c00-b4bb-4c51-9d76-725a2aae8ab9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:18.326036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5e76c00-b4bb-4c51-9d76-725a2aae8ab9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:18.329491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5e76c00-b4bb-4c51-9d76-725a2aae8ab9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:18.656083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f5e76c00-b4bb-4c51-9d76-725a2aae8ab9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:18.668232 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f5e76c00-b4bb-4c51-9d76-725a2aae8ab9 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 200 len: 1493 microversion: 2.1 time: 0.419837 Aug 09 17:11:18.672192 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 774/1422] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:18 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 1493 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:18.689298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:18.690097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:18.717389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:18.717936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:18.720377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:18.723452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:18.724239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:18.724710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:19.197764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:19.235384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:19.255385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:19.265409 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-165962ee-c05a-4a96-aead-f1ee42f29592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1708 microversion: 2.42 time: 1.664670 Aug 09 17:11:19.277235 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 649/1423] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:17 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1708 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:19.304567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-952da4c2-6f88-4452-8b48-c05ea1cdac0e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:19.306018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-952da4c2-6f88-4452-8b48-c05ea1cdac0e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:19.316146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952da4c2-6f88-4452-8b48-c05ea1cdac0e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:19.317287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952da4c2-6f88-4452-8b48-c05ea1cdac0e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:19.317938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952da4c2-6f88-4452-8b48-c05ea1cdac0e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:19.318927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952da4c2-6f88-4452-8b48-c05ea1cdac0e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:19.321801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952da4c2-6f88-4452-8b48-c05ea1cdac0e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:19.322973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952da4c2-6f88-4452-8b48-c05ea1cdac0e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:19.535221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-952da4c2-6f88-4452-8b48-c05ea1cdac0e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:19.589112 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-952da4c2-6f88-4452-8b48-c05ea1cdac0e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1286 microversion: 2.1 time: 0.309977 Aug 09 17:11:19.591997 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 650/1424] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:19 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1286 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:19.597949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-945d43c3-94a4-4232-bc9d-983d6a6b2e9a req-8c51633c-a546-496b-910d-d1265c2f9b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6eeb62-35cd-4f55-9b7c-d209294fb0e1", "name": "network-vif-unplugged", "status": "completed", "tag": "69d30c98-d9a6-494a-912c-95f6075b434d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:19.626376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-945d43c3-94a4-4232-bc9d-983d6a6b2e9a req-8c51633c-a546-496b-910d-d1265c2f9b83 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:19.633905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-945d43c3-94a4-4232-bc9d-983d6a6b2e9a req-8c51633c-a546-496b-910d-d1265c2f9b83 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:19.639912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-945d43c3-94a4-4232-bc9d-983d6a6b2e9a req-8c51633c-a546-496b-910d-d1265c2f9b83 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:19.685849 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-945d43c3-94a4-4232-bc9d-983d6a6b2e9a req-8c51633c-a546-496b-910d-d1265c2f9b83 service nova] Creating event network-vif-unplugged:69d30c98-d9a6-494a-912c-95f6075b434d for instance 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 on n-h2-845781-6 Aug 09 17:11:19.704731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:19.717642 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-945d43c3-94a4-4232-bc9d-983d6a6b2e9a req-8c51633c-a546-496b-910d-d1265c2f9b83 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123652 Aug 09 17:11:19.722288 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 651/1425] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:19.732243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-3fa4514e-3224-4a9b-96f6-4be3f8569c5b req-38b3bfa0-9f51-4b85-8a9e-46c85d288722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d4494b3-976f-4185-936c-52c1ba795d41", "name": "network-vif-deleted", "tag": "8dd9f845-7b2b-4c86-856a-d0c2faf3c649"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:19.759167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3fa4514e-3224-4a9b-96f6-4be3f8569c5b req-38b3bfa0-9f51-4b85-8a9e-46c85d288722 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:19.768820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3fa4514e-3224-4a9b-96f6-4be3f8569c5b req-38b3bfa0-9f51-4b85-8a9e-46c85d288722 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:19.773530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3fa4514e-3224-4a9b-96f6-4be3f8569c5b req-38b3bfa0-9f51-4b85-8a9e-46c85d288722 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:19.810596 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-3fa4514e-3224-4a9b-96f6-4be3f8569c5b req-38b3bfa0-9f51-4b85-8a9e-46c85d288722 service nova] Creating event network-vif-deleted:8dd9f845-7b2b-4c86-856a-d0c2faf3c649 for instance 7d4494b3-976f-4185-936c-52c1ba795d41 on n-h1-845781-6 Aug 09 17:11:19.824654 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-3fa4514e-3224-4a9b-96f6-4be3f8569c5b req-38b3bfa0-9f51-4b85-8a9e-46c85d288722 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100331 Aug 09 17:11:19.825859 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 652/1426] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:19.842701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-06543a44-2036-4291-aba1-2e1da4e5f51b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:19.843090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:19.845147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:19.846414 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-13c8a0e5-c26b-4dbf-9fa8-b655ac9971d2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 1.172822 Aug 09 17:11:19.849941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-06543a44-2036-4291-aba1-2e1da4e5f51b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:19.856016 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 775/1427] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:18 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:19.870361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06543a44-2036-4291-aba1-2e1da4e5f51b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:19.871197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06543a44-2036-4291-aba1-2e1da4e5f51b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:19.871844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06543a44-2036-4291-aba1-2e1da4e5f51b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:19.876158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06543a44-2036-4291-aba1-2e1da4e5f51b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:19.876928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06543a44-2036-4291-aba1-2e1da4e5f51b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:19.877677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06543a44-2036-4291-aba1-2e1da4e5f51b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:20.307903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:20.308540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:20.330708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:20.330708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:20.336759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:20.338063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:20.339643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:20.342928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:20.791575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:20.827277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:20.835666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:20.838570 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b3759992-ee8c-4b5a-a6f9-0780ac6b0b91 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1755 microversion: 2.42 time: 0.534942 Aug 09 17:11:20.859600 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 776/1428] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:20 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1755 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:20.859600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-856f6b84-1cea-4072-8a90-5f6016be51ad tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:20.859600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-856f6b84-1cea-4072-8a90-5f6016be51ad tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:20.864955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856f6b84-1cea-4072-8a90-5f6016be51ad tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:20.865957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856f6b84-1cea-4072-8a90-5f6016be51ad tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:20.866826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856f6b84-1cea-4072-8a90-5f6016be51ad tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:20.867884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856f6b84-1cea-4072-8a90-5f6016be51ad tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:20.872602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856f6b84-1cea-4072-8a90-5f6016be51ad tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:20.876431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856f6b84-1cea-4072-8a90-5f6016be51ad tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:21.009210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-856f6b84-1cea-4072-8a90-5f6016be51ad tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:21.049977 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-856f6b84-1cea-4072-8a90-5f6016be51ad tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1274 microversion: 2.1 time: 0.198910 Aug 09 17:11:21.050679 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 777/1429] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:20 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:21.338771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-06543a44-2036-4291-aba1-2e1da4e5f51b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:21.356380 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-06543a44-2036-4291-aba1-2e1da4e5f51b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 200 len: 1493 microversion: 2.1 time: 1.524388 Aug 09 17:11:21.357305 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 653/1430] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:19 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 1493 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:21.641757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:21.642925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:21.650685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:21.655302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:21.662264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:21.662830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:21.663569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:21.664329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:21.895466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:21.900253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:21.940389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:21.942109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:21.942924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:21.944332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:21.945183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:21.945973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:22.262777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:22.276842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:22.284628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:22.286047 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-03767e1a-5376-49bf-ac94-6943da852b33 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 1.198543 Aug 09 17:11:22.289134 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 778/1431] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:21 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:22.305683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-021ee55a-02ff-4dde-8e93-ce58a4cd9fd1 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:22.306693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-021ee55a-02ff-4dde-8e93-ce58a4cd9fd1 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:22.322693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021ee55a-02ff-4dde-8e93-ce58a4cd9fd1 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:22.323836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021ee55a-02ff-4dde-8e93-ce58a4cd9fd1 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:22.324827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021ee55a-02ff-4dde-8e93-ce58a4cd9fd1 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:22.326157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021ee55a-02ff-4dde-8e93-ce58a4cd9fd1 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:22.328451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021ee55a-02ff-4dde-8e93-ce58a4cd9fd1 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:22.329239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021ee55a-02ff-4dde-8e93-ce58a4cd9fd1 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:22.525752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-021ee55a-02ff-4dde-8e93-ce58a4cd9fd1 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:22.535981 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-021ee55a-02ff-4dde-8e93-ce58a4cd9fd1 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1274 microversion: 2.1 time: 0.244642 Aug 09 17:11:22.537338 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 779/1432] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:22 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:22.544452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1257820-58bc-4329-aa4b-3ee97b335d2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:22.545505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e1257820-58bc-4329-aa4b-3ee97b335d2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:22.553396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1257820-58bc-4329-aa4b-3ee97b335d2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:22.554588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1257820-58bc-4329-aa4b-3ee97b335d2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:22.555485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1257820-58bc-4329-aa4b-3ee97b335d2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:22.556657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1257820-58bc-4329-aa4b-3ee97b335d2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:22.557517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1257820-58bc-4329-aa4b-3ee97b335d2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:22.558221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1257820-58bc-4329-aa4b-3ee97b335d2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:22.779716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e1257820-58bc-4329-aa4b-3ee97b335d2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac722a34673411e9280ba901999b0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055af8e9fb964ff19213eb1b419b56cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:22.801682 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1257820-58bc-4329-aa4b-3ee97b335d2c tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 200 len: 1451 microversion: 2.1 time: 0.260660 Aug 09 17:11:22.807007 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 780/1433] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:22 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 1451 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:22.850761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:22.956263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:22.960126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e6f857f6-d688-4d8e-900d-51f8e8315030 req-897afefa-d900-4021-aef3-3956eb320cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6eeb62-35cd-4f55-9b7c-d209294fb0e1", "name": "network-vif-deleted", "tag": "69d30c98-d9a6-494a-912c-95f6075b434d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:22.973948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:22.980391 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dd5997a7-7817-42fb-8b6c-1ec2658db502 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1802 microversion: 2.42 time: 1.102516 Aug 09 17:11:22.983936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e6f857f6-d688-4d8e-900d-51f8e8315030 req-897afefa-d900-4021-aef3-3956eb320cd0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:22.984530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e6f857f6-d688-4d8e-900d-51f8e8315030 req-897afefa-d900-4021-aef3-3956eb320cd0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:22.986523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e6f857f6-d688-4d8e-900d-51f8e8315030 req-897afefa-d900-4021-aef3-3956eb320cd0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:22.996510 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 654/1434] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:21 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1802 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:23.017450 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e6f857f6-d688-4d8e-900d-51f8e8315030 req-897afefa-d900-4021-aef3-3956eb320cd0 service nova] Creating event network-vif-deleted:69d30c98-d9a6-494a-912c-95f6075b434d for instance 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 on n-h2-845781-6 Aug 09 17:11:23.032028 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e6f857f6-d688-4d8e-900d-51f8e8315030 req-897afefa-d900-4021-aef3-3956eb320cd0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075243 Aug 09 17:11:23.034487 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 781/1435] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:23.356947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:23.359518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:23.371073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:23.408981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:23.411870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:23.412200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:23.413204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:23.416976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:23.417667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:23.575885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bfb9f414-dd51-4cbe-96b5-d6565609f9df tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:23.576705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bfb9f414-dd51-4cbe-96b5-d6565609f9df tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:23.593209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb9f414-dd51-4cbe-96b5-d6565609f9df tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:23.597353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb9f414-dd51-4cbe-96b5-d6565609f9df tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:23.599231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb9f414-dd51-4cbe-96b5-d6565609f9df tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:23.600140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb9f414-dd51-4cbe-96b5-d6565609f9df tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:23.603019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb9f414-dd51-4cbe-96b5-d6565609f9df tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:23.603552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfb9f414-dd51-4cbe-96b5-d6565609f9df tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:23.756667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bfb9f414-dd51-4cbe-96b5-d6565609f9df tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:23.796068 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bfb9f414-dd51-4cbe-96b5-d6565609f9df tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1274 microversion: 2.1 time: 0.224541 Aug 09 17:11:23.799135 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 782/1436] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:23 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1274 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:11:23.845233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:23.846469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:23.876343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:23.879618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:23.880344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:23.882828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:23.883328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:23.883812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:23.927529 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Instance 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 could not be found. Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 HTTP/1.1 Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:11:23.958644 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 could not be found. Aug 09 17:11:23.961571 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1e6eeb62-35cd-4f55-9b7c-d209294fb0e1'} Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 could not be found. Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:23.963321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 could not be found. Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 could not be found. Aug 09 17:11:23.965786 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:23.971456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Instance 1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:23.984522 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c676b325-c593-46d8-a10a-881b22a6bc20 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1" status: 404 len: 111 microversion: 2.1 time: 0.128271 Aug 09 17:11:23.998315 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 783/1437] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:23 2022] GET /compute/v2.1/servers/1e6eeb62-35cd-4f55-9b7c-d209294fb0e1 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:11:24.033987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11b13411-5813-4b0b-bbdf-cd510488f2b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb78a790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:24.045332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:24.061547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:24.066682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:24.068794 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-54df4550-8448-4871-bf80-1ace50211bce tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.739427 Aug 09 17:11:24.072742 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 655/1438] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:23 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:24.087866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:24.089000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:24.124232 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-11b13411-5813-4b0b-bbdf-cd510488f2b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Image not found. Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11b13411-5813-4b0b-bbdf-cd510488f2b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884 HTTP/1.1 Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:11:24.129211 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'ba6ddcdc-be04-485f-a5c8-91c779046884'} Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:24.133324 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ba6ddcdc-be04-485f-a5c8-91c779046884 to delete Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.135282 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ba6ddcdc-be04-485f-a5c8-91c779046884 could not be found. Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:24.140129 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:11:24.146194 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.150934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:24.150934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:24.150934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:24.150934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:24.152322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:24.152322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:24.152727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11b13411-5813-4b0b-bbdf-cd510488f2b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:24.156207 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11b13411-5813-4b0b-bbdf-cd510488f2b4 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884" status: 404 len: 62 microversion: 2.1 time: 0.147984 Aug 09 17:11:24.163057 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 784/1439] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:24 2022] DELETE /compute/v2.1/images/ba6ddcdc-be04-485f-a5c8-91c779046884 => generated 62 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:11:24.193527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:24.201447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:24.239506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:24.240829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:24.241874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:24.244501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:24.245720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:24.247397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:24.296752 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 HTTP/1.1 Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:11:24.299051 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. Aug 09 17:11:24.302801 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b8806f1b-fc49-46e7-a732-04de3ee9e445'} Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:24.303933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. Aug 09 17:11:24.305988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.310747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:24.322829 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fd3fc191-86c5-4dc1-b4f6-9113521159d6 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 404 len: 111 microversion: 2.1 time: 0.152422 Aug 09 17:11:24.323946 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 785/1440] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:11:24 2022] DELETE /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:11:24.346412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:24.350586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: b8806f1b-fc49-46e7-a732-04de3ee9e445] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:24.382640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:24.383582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:24.388513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:24.406177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:24.407081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:24.407908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:24.474089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 HTTP/1.1 Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:11:24.481842 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. Aug 09 17:11:24.483801 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b8806f1b-fc49-46e7-a732-04de3ee9e445'} Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:24.487058 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. Aug 09 17:11:24.491371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.494238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Instance b8806f1b-fc49-46e7-a732-04de3ee9e445 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:24.494238 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fd59b47c-edce-45f0-8622-0f4841bf9d8d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445" status: 404 len: 111 microversion: 2.1 time: 0.153928 Aug 09 17:11:24.511518 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 786/1441] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:24 2022] GET /compute/v2.1/servers/b8806f1b-fc49-46e7-a732-04de3ee9e445 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:11:24.524166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea48590f-7893-4402-a519-63ecf423df58 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb8040d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:24.618326 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-ea48590f-7893-4402-a519-63ecf423df58 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Image not found. Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea48590f-7893-4402-a519-63ecf423df58 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 HTTP/1.1 Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:11:24.621678 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '4b296faa-dfad-4a75-a66f-75772f1f5f17'} Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:24.624696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4b296faa-dfad-4a75-a66f-75772f1f5f17 to delete Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.626717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b296faa-dfad-4a75-a66f-75772f1f5f17 could not be found. Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:24.630111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea48590f-7893-4402-a519-63ecf423df58 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:24.632706 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ea48590f-7893-4402-a519-63ecf423df58 tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17" status: 404 len: 62 microversion: 2.1 time: 0.110626 Aug 09 17:11:24.639100 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 787/1442] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:24 2022] DELETE /compute/v2.1/images/4b296faa-dfad-4a75-a66f-75772f1f5f17 => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:11:24.656816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:24.657713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:24.717277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:24.718428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:24.720583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:24.733676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:24.735173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:24.736477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:24.855830 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 HTTP/1.1 Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:11:24.859031 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. Aug 09 17:11:24.862219 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '417d9361-7e22-4e97-a3a9-acd1f3a91e46'} Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:24.864589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. Aug 09 17:11:24.867526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:11:24.870855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:24.870855 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bf6b5cda-56b7-4758-895e-f5bee73efd9b tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 404 len: 111 microversion: 2.1 time: 0.220768 Aug 09 17:11:24.872131 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 788/1443] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:11:24 2022] DELETE /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:11:24.892664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f9900d0-d05a-4bae-85f0-a28489a95150 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:24.906519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6f9900d0-d05a-4bae-85f0-a28489a95150 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:24.940039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f9900d0-d05a-4bae-85f0-a28489a95150 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:24.941266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f9900d0-d05a-4bae-85f0-a28489a95150 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:24.942858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f9900d0-d05a-4bae-85f0-a28489a95150 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:24.946039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f9900d0-d05a-4bae-85f0-a28489a95150 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:24.946910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f9900d0-d05a-4bae-85f0-a28489a95150 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:24.953000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f9900d0-d05a-4bae-85f0-a28489a95150 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:25.346227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:25.368590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:25.377020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:25.379236 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4297016b-ba26-49bc-94b1-c4112266ada8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1849 microversion: 2.42 time: 1.304186 Aug 09 17:11:25.393512 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 656/1444] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:24 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1849 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:25.399066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:25.403293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 417d9361-7e22-4e97-a3a9-acd1f3a91e46] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:25.412738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6f9900d0-d05a-4bae-85f0-a28489a95150 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:25.423692 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6f9900d0-d05a-4bae-85f0-a28489a95150 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1274 microversion: 2.1 time: 0.549690 Aug 09 17:11:25.430019 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 789/1445] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:24 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1274 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:25.436721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:25.438352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:25.452365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:25.452884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:25.453346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:25.454106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:25.454580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:25.458389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:25.461352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:25.462244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:25.466188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:25.468879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:25.472204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:25.473157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:25.495213 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 HTTP/1.1 Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:11:25.500934 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. Aug 09 17:11:25.507921 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '417d9361-7e22-4e97-a3a9-acd1f3a91e46'} Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:25.510376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. Aug 09 17:11:25.519320 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.524601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Instance 417d9361-7e22-4e97-a3a9-acd1f3a91e46 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:25.524601 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9bffdef-a036-4d71-b6d2-818c2f9584dd tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46" status: 404 len: 111 microversion: 2.1 time: 0.112000 Aug 09 17:11:25.524601 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 657/1446] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:25 2022] GET /compute/v2.1/servers/417d9361-7e22-4e97-a3a9-acd1f3a91e46 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:11:25.526693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-96294732-5656-482d-8d17-cc75e84b98ab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '.version_select at 0x7fbbcb5b8160>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:25.577219 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-96294732-5656-482d-8d17-cc75e84b98ab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Image not found. Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-96294732-5656-482d-8d17-cc75e84b98ab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff HTTP/1.1 Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:11:25.597475 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: exception: Image not found. Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'fe4bd57b-17fc-44f4-8348-a529996f3cff'} Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:25.600616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fe4bd57b-17fc-44f4-8348-a529996f3cff to delete Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.602844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fe4bd57b-17fc-44f4-8348-a529996f3cff could not be found. Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:25.605601 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-96294732-5656-482d-8d17-cc75e84b98ab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Image not found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-96294732-5656-482d-8d17-cc75e84b98ab tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff" status: 404 len: 62 microversion: 2.1 time: 0.088686 Aug 09 17:11:25.615132 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 658/1447] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:25 2022] DELETE /compute/v2.1/images/fe4bd57b-17fc-44f4-8348-a529996f3cff => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:11:25.620784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:25.629534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:25.654784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:25.660707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:25.661282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:25.662146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:25.663608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:25.664393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:25.672343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:25.713886 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d HTTP/1.1 Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:11:25.717388 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. Aug 09 17:11:25.719218 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9114d8ad-2746-443d-8799-c09c421ac55d'} Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:25.720305 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. Aug 09 17:11:25.722525 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.724239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:25.726056 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fa0c76fe-4ca3-4c99-a331-04c3d1fb667a tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 404 len: 111 microversion: 2.1 time: 0.115937 Aug 09 17:11:25.727918 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 659/1448] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:11:25 2022] DELETE /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:11:25.745117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:25.746799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] [instance: 9114d8ad-2746-443d-8799-c09c421ac55d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:25.761396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:25.766532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:25.767359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:25.768256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:25.769517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:25.771148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:25.809999 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] HTTP exception thrown: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Request method failure captured: Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d HTTP/1.1 Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pPueYteFMZgdOl96KWrzvXSeUGrfiwL-xAyMcXJqDheDFuLThICp6UI-1oYdB-mlcSadMYcx9r5idtglClqxQES7QTa7cvwSkVi0YbRRxMuhjoFfuePQjwC1u1IT1eA19LLgCS5TlO19_V1yo-RYoGpjMkoIVrFRb9uWJ1qvja6csY Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:11:25.811730 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/055af8e9fb964ff19213eb1b419b56cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 055af8e9fb964ff19213eb1b419b56cd Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesTestJSON-1129039389 Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1ac722a34673411e9280ba901999b0c3 Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesTestJSON-1129039389-project Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. Aug 09 17:11:25.813506 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9114d8ad-2746-443d-8799-c09c421ac55d'} Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:11:25.814633 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. Aug 09 17:11:25.816379 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:11:25.818489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] Returning 404 to user: Instance 9114d8ad-2746-443d-8799-c09c421ac55d could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:11:25.820703 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3b2b3e3e-36f1-4351-bd4c-615f4f72e69d tempest-ImagesTestJSON-1129039389 tempest-ImagesTestJSON-1129039389-project] 10.222.0.93 "GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d" status: 404 len: 111 microversion: 2.1 time: 0.082469 Aug 09 17:11:25.821515 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 660/1449] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:25 2022] GET /compute/v2.1/servers/9114d8ad-2746-443d-8799-c09c421ac55d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:11:26.080489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:26.091736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:26.105166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:26.109499 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c57f475c-76a0-4782-b099-b400f8ab864d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.677698 Aug 09 17:11:26.111447 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 790/1450] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:25 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:26.300915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-18dbe301-1a99-4ae7-b50b-9836a04db860 tempest-NetworksTest-1234163288 tempest-NetworksTest-1234163288-project-admin] Calling method '.version_select at 0x7fbbcb5428b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:26.432316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:26.435710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:26.473036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:26.473807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:26.474460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:26.476814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:26.477570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:26.478409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:26.853642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:26.857721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:26.883528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:26.892303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:26.898230 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1a1536ba-4027-4889-9d15-d581a5e2dd86 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1849 microversion: 2.42 time: 0.488506 Aug 09 17:11:26.900519 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 791/1451] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:26 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1849 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:11:26.902678 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-18dbe301-1a99-4ae7-b50b-9836a04db860 tempest-NetworksTest-1234163288 tempest-NetworksTest-1234163288-project-admin] 10.222.0.93 "GET /compute/v2.1/os-networks" status: 200 len: 10140 microversion: 2.1 time: 0.790714 Aug 09 17:11:26.909498 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 661/1452] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:11:26 2022] GET /compute/v2.1/os-networks => generated 10140 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:11:26.913919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1e5584fe-fdc8-4512-91b2-01a32cf60324 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:26.914646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1e5584fe-fdc8-4512-91b2-01a32cf60324 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:26.919988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0d9ae392-e4ae-40ab-95ff-4f12f373c9e4 req-32504fc0-f955-4fc5-aeec-82c24807b219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "tag": "709f91d0-ee6e-4efa-ad7d-a941e3f4fefb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:26.930124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e5584fe-fdc8-4512-91b2-01a32cf60324 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:26.932663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e5584fe-fdc8-4512-91b2-01a32cf60324 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:26.933680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e5584fe-fdc8-4512-91b2-01a32cf60324 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:26.934528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e5584fe-fdc8-4512-91b2-01a32cf60324 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:26.937444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e5584fe-fdc8-4512-91b2-01a32cf60324 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:26.938243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e5584fe-fdc8-4512-91b2-01a32cf60324 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:26.952366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0d9ae392-e4ae-40ab-95ff-4f12f373c9e4 req-32504fc0-f955-4fc5-aeec-82c24807b219 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:26.954099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0d9ae392-e4ae-40ab-95ff-4f12f373c9e4 req-32504fc0-f955-4fc5-aeec-82c24807b219 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:26.955441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0d9ae392-e4ae-40ab-95ff-4f12f373c9e4 req-32504fc0-f955-4fc5-aeec-82c24807b219 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:26.976041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:26.994711 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0d9ae392-e4ae-40ab-95ff-4f12f373c9e4 req-32504fc0-f955-4fc5-aeec-82c24807b219 service nova] Creating event network-changed:709f91d0-ee6e-4efa-ad7d-a941e3f4fefb for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:11:27.017727 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0d9ae392-e4ae-40ab-95ff-4f12f373c9e4 req-32504fc0-f955-4fc5-aeec-82c24807b219 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114152 Aug 09 17:11:27.019811 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 792/1453] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:27.035061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8307b08-dfdd-448d-8b7d-00c1580150c1 tempest-NetworksTest-1234163288 tempest-NetworksTest-1234163288-project-admin] Calling method '.version_select at 0x7fbbcb75d430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:27.305870 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f8307b08-dfdd-448d-8b7d-00c1580150c1 tempest-NetworksTest-1234163288 tempest-NetworksTest-1234163288-project-admin] 10.222.0.93 "GET /compute/v2.1/os-networks/170ffeb2-2bf9-4cef-a3dd-e551a8cfc174" status: 200 len: 652 microversion: 2.1 time: 0.283498 Aug 09 17:11:27.307983 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 793/1454] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:11:27 2022] GET /compute/v2.1/os-networks/170ffeb2-2bf9-4cef-a3dd-e551a8cfc174 => generated 652 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:27.315411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:27.319711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:27.336280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:27.337076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:27.337717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:27.338695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:27.339512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:27.340194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:27.359688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:28.134653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:28.168478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:28.172681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:28.175541 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c2241b42-1b82-48c3-a23f-f8d261fe7180 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.865258 Aug 09 17:11:28.182592 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 794/1455] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:27 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:28.198321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a231836-8d06-4a97-9fda-d69def38f6a0 tempest-NetworksTest-1234163288 tempest-NetworksTest-1234163288-project-admin] Calling method '.version_select at 0x7fbbcb7f7550>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:28.412588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1e5584fe-fdc8-4512-91b2-01a32cf60324 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:28.431438 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1e5584fe-fdc8-4512-91b2-01a32cf60324 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1316 microversion: 2.1 time: 1.526609 Aug 09 17:11:28.432667 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 662/1456] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:26 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1316 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:28.443669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:28.460806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:28.468069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:28.468908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:28.469676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:28.474426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:28.475226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:28.481960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:28.991250 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a231836-8d06-4a97-9fda-d69def38f6a0 tempest-NetworksTest-1234163288 tempest-NetworksTest-1234163288-project-admin] 10.222.0.93 "GET /compute/v2.1/os-networks" status: 200 len: 10140 microversion: 2.1 time: 0.806313 Aug 09 17:11:28.992613 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 795/1457] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:11:28 2022] GET /compute/v2.1/os-networks => generated 10140 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:11:29.223981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:29.224620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:29.236016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:29.249328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:29.251323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:29.252371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:29.253092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:29.254244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:29.735067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:29.748795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:29.756520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:29.762544 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-478779ff-a919-42e9-86e4-df57649f22dd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.540172 Aug 09 17:11:29.763982 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 796/1458] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:29 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:29.780828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4b1c5e1-87b5-4d0b-b179-c0eb9fa7fc07 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:29.785840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c4b1c5e1-87b5-4d0b-b179-c0eb9fa7fc07 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:29.827181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4b1c5e1-87b5-4d0b-b179-c0eb9fa7fc07 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:29.842134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4b1c5e1-87b5-4d0b-b179-c0eb9fa7fc07 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:29.844605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4b1c5e1-87b5-4d0b-b179-c0eb9fa7fc07 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:29.845952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4b1c5e1-87b5-4d0b-b179-c0eb9fa7fc07 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:29.846823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4b1c5e1-87b5-4d0b-b179-c0eb9fa7fc07 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:29.847723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4b1c5e1-87b5-4d0b-b179-c0eb9fa7fc07 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:30.170616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:30.190445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:30.197109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:30.200651 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4012a4c2-3855-4e18-9136-36b519e0255d tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1870 microversion: 2.42 time: 1.766648 Aug 09 17:11:30.204735 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 663/1459] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:28 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1870 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:30.436484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-92bc4925-8c7d-4b8f-93c9-bca9330473d6 req-7e76cb3b-4691-4498-baa9-a043a38f0071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "tag": "f19286e2-58f2-4f51-9878-ebb153c05f5f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:30.459894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-92bc4925-8c7d-4b8f-93c9-bca9330473d6 req-7e76cb3b-4691-4498-baa9-a043a38f0071 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:30.466986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-92bc4925-8c7d-4b8f-93c9-bca9330473d6 req-7e76cb3b-4691-4498-baa9-a043a38f0071 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:30.467650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-92bc4925-8c7d-4b8f-93c9-bca9330473d6 req-7e76cb3b-4691-4498-baa9-a043a38f0071 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:30.497577 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-92bc4925-8c7d-4b8f-93c9-bca9330473d6 req-7e76cb3b-4691-4498-baa9-a043a38f0071 service nova] Creating event network-changed:f19286e2-58f2-4f51-9878-ebb153c05f5f for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:11:30.511240 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-92bc4925-8c7d-4b8f-93c9-bca9330473d6 req-7e76cb3b-4691-4498-baa9-a043a38f0071 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079117 Aug 09 17:11:30.514857 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 664/1460] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:11:30.805127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:30.806306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:30.824052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:30.824961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:30.825689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:30.826724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:30.830464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:30.831541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:30.984063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c4b1c5e1-87b5-4d0b-b179-c0eb9fa7fc07 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:31.014203 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c4b1c5e1-87b5-4d0b-b179-c0eb9fa7fc07 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1316 microversion: 2.1 time: 1.245813 Aug 09 17:11:31.034422 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 797/1461] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:29 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1316 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:31.260557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:31.262264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:31.300262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:31.302294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:31.303487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:31.305191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:31.306342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:31.307939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:31.504841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:31.537953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:31.547156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:31.550202 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-747c6d45-cc68-43d1-9f9b-9b78aaff38e8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.755471 Aug 09 17:11:31.561388 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 665/1462] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:30 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:31.651270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-f8508548-17dd-4041-bc6e-e0404039dcc6 req-097a5d52-e852-46a8-901f-663ee9ca3b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ef8234b-af34-48f6-b84a-e4800e432eb8", "tag": "b426bae7-bfa2-43b9-8167-bbe3433a1e83"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:31.693101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f8508548-17dd-4041-bc6e-e0404039dcc6 req-097a5d52-e852-46a8-901f-663ee9ca3b94 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:31.693655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f8508548-17dd-4041-bc6e-e0404039dcc6 req-097a5d52-e852-46a8-901f-663ee9ca3b94 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:31.694095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f8508548-17dd-4041-bc6e-e0404039dcc6 req-097a5d52-e852-46a8-901f-663ee9ca3b94 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:31.730211 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-f8508548-17dd-4041-bc6e-e0404039dcc6 req-097a5d52-e852-46a8-901f-663ee9ca3b94 service nova] Creating event network-changed:b426bae7-bfa2-43b9-8167-bbe3433a1e83 for instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 on n-h1-845781-6 Aug 09 17:11:31.736045 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-f8508548-17dd-4041-bc6e-e0404039dcc6 req-097a5d52-e852-46a8-901f-663ee9ca3b94 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092054 Aug 09 17:11:31.737069 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 666/1463] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:11:32.052071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9eaa3f8a-d83e-4a2e-ba62-658522db80f8 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:32.052708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9eaa3f8a-d83e-4a2e-ba62-658522db80f8 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:32.069704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eaa3f8a-d83e-4a2e-ba62-658522db80f8 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:32.076246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eaa3f8a-d83e-4a2e-ba62-658522db80f8 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:32.077162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eaa3f8a-d83e-4a2e-ba62-658522db80f8 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:32.077965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eaa3f8a-d83e-4a2e-ba62-658522db80f8 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:32.078811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eaa3f8a-d83e-4a2e-ba62-658522db80f8 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:32.079314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9eaa3f8a-d83e-4a2e-ba62-658522db80f8 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:32.746756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9eaa3f8a-d83e-4a2e-ba62-658522db80f8 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:32.764442 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9eaa3f8a-d83e-4a2e-ba62-658522db80f8 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1316 microversion: 2.1 time: 0.717891 Aug 09 17:11:32.765521 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 667/1464] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:32 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1316 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:32.771326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:32.789376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:32.839004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:32.840745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:32.841615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:32.843947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:32.853356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:32.855077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:32.969042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:33.054938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:33.070306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:33.082137 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0cadcd79-df5c-44e2-a912-6ca0749f7af8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1870 microversion: 2.42 time: 1.829183 Aug 09 17:11:33.089069 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 798/1465] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:31 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1870 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:33.611344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:33.638428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:33.640866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:33.642740 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-367458cc-b493-4a0f-beee-59bc46809d75 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.875877 Aug 09 17:11:33.644983 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 668/1466] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:32 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:33.809724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b442fbd5-314f-478c-a27b-313ce6a2df44 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:33.813033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b442fbd5-314f-478c-a27b-313ce6a2df44 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:33.853659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b442fbd5-314f-478c-a27b-313ce6a2df44 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:33.856773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b442fbd5-314f-478c-a27b-313ce6a2df44 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:33.861753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b442fbd5-314f-478c-a27b-313ce6a2df44 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:33.874384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b442fbd5-314f-478c-a27b-313ce6a2df44 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:33.880065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b442fbd5-314f-478c-a27b-313ce6a2df44 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:33.882700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b442fbd5-314f-478c-a27b-313ce6a2df44 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:34.139585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:34.146108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:34.169850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:34.176729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:34.178121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:34.179848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:34.184883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:34.186486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:35.051056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:35.082986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:35.087823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:35.095873 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-650f9c01-597f-412a-9f7a-ba238b30432a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 0.959924 Aug 09 17:11:35.099139 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 669/1467] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:34 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:35.113871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:35.115075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:35.129959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:35.135391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:35.136496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:35.137527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:35.138241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:35.140030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:35.378817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b442fbd5-314f-478c-a27b-313ce6a2df44 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:35.390990 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b442fbd5-314f-478c-a27b-313ce6a2df44 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1316 microversion: 2.1 time: 1.594906 Aug 09 17:11:35.395185 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 799/1468] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:33 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1316 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:35.970121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f68a0eb0-ba44-4eac-8df1-efbd57cd178b req-17c01cef-d67e-4ded-9942-d8d0137664b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "tag": "2936b497-d537-4328-a229-123214f26882"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:36.014899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f68a0eb0-ba44-4eac-8df1-efbd57cd178b req-17c01cef-d67e-4ded-9942-d8d0137664b4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:36.018366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f68a0eb0-ba44-4eac-8df1-efbd57cd178b req-17c01cef-d67e-4ded-9942-d8d0137664b4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:36.020764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f68a0eb0-ba44-4eac-8df1-efbd57cd178b req-17c01cef-d67e-4ded-9942-d8d0137664b4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:36.067745 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f68a0eb0-ba44-4eac-8df1-efbd57cd178b req-17c01cef-d67e-4ded-9942-d8d0137664b4 service nova] Creating event network-changed:2936b497-d537-4328-a229-123214f26882 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:11:36.094662 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f68a0eb0-ba44-4eac-8df1-efbd57cd178b req-17c01cef-d67e-4ded-9942-d8d0137664b4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133333 Aug 09 17:11:36.096985 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 800/1469] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:11:36.165149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:36.167082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:36.185880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:36.187182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:36.188322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:36.200258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:36.201535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:36.202654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:36.236021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:36.269621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:36.279185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:36.286239 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e023ff19-290e-47b3-9420-48780c3d4f0d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 1.182811 Aug 09 17:11:36.290096 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 670/1470] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:35 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:36.422658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-def76eb6-46ef-43c3-b633-bf5d3c16c16f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:36.423792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-def76eb6-46ef-43c3-b633-bf5d3c16c16f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:36.440479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-def76eb6-46ef-43c3-b633-bf5d3c16c16f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:36.441873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-def76eb6-46ef-43c3-b633-bf5d3c16c16f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:36.442397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-def76eb6-46ef-43c3-b633-bf5d3c16c16f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:36.443786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-def76eb6-46ef-43c3-b633-bf5d3c16c16f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:36.444630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-def76eb6-46ef-43c3-b633-bf5d3c16c16f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:36.445240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-def76eb6-46ef-43c3-b633-bf5d3c16c16f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:37.269557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-def76eb6-46ef-43c3-b633-bf5d3c16c16f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:37.325939 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-def76eb6-46ef-43c3-b633-bf5d3c16c16f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1316 microversion: 2.1 time: 0.907844 Aug 09 17:11:37.327126 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 671/1471] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:36 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1316 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:37.357769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-22373d64-6914-4a00-ae98-31318328622f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2186be9e-51fb-4629-a323-87510d649e8d"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:37.400168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-22373d64-6914-4a00-ae98-31318328622f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:37.442753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22373d64-6914-4a00-ae98-31318328622f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:37.443693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22373d64-6914-4a00-ae98-31318328622f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:37.444486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22373d64-6914-4a00-ae98-31318328622f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:37.445776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22373d64-6914-4a00-ae98-31318328622f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:37.452768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22373d64-6914-4a00-ae98-31318328622f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:37.453598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22373d64-6914-4a00-ae98-31318328622f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:38.236449 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-22373d64-6914-4a00-ae98-31318328622f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "POST /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.905176 Aug 09 17:11:38.246223 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 672/1472] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:11:37 2022] POST /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:38.271284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:38.284320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:38.296866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:38.327378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:38.334852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:38.335882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:38.336860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:38.339165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:38.339773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:38.340850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:38.352216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:38.354885 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2047cd64-e50d-4052-950d-13bac56c1085 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 2.210491 Aug 09 17:11:38.376945 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 801/1473] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:36 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:11:38.422266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-408660725", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b176697e-92f5-4744-9b98-692686c31e55"}], "block_device_mapping_v2": [{"uuid": "525283bd-4d43-47f8-8fdd-a236e20bc213", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:39.164449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:39.183069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:39.189374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:39.194034 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-086a71ed-4c0e-4e29-813d-08801a7e7a30 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.953171 Aug 09 17:11:39.221870 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 673/1474] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:38 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:39.247795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-59084dc7-4889-4e90-9742-e8ed22a42767 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:39.249048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-59084dc7-4889-4e90-9742-e8ed22a42767 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:39.273626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59084dc7-4889-4e90-9742-e8ed22a42767 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:39.274772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59084dc7-4889-4e90-9742-e8ed22a42767 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:39.275989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59084dc7-4889-4e90-9742-e8ed22a42767 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:39.277578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59084dc7-4889-4e90-9742-e8ed22a42767 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:39.294075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59084dc7-4889-4e90-9742-e8ed22a42767 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:39.295004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59084dc7-4889-4e90-9742-e8ed22a42767 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:40.883130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-59084dc7-4889-4e90-9742-e8ed22a42767 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:40.910745 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-59084dc7-4889-4e90-9742-e8ed22a42767 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1316 microversion: 2.1 time: 1.686368 Aug 09 17:11:40.912129 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 674/1475] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:39 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1316 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:40.947947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:40.949056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:40.983857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:40.984893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:40.985690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:40.987247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:40.988891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:40.989889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:41.838407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:41.889199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:41.904041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:41.915986 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2314ded1-29ac-484a-9271-33778c0eb904 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 0.986421 Aug 09 17:11:41.921141 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 675/1476] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:40 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:41.939549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d37b29b9-60ab-462a-bf34-fce0187d3ea6 req-4bf34549-d850-4de4-8795-1c8734cc43a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "tag": "087d8ab6-d0b8-451a-a98f-0e8b6e72b4a6"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:41.979022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d37b29b9-60ab-462a-bf34-fce0187d3ea6 req-4bf34549-d850-4de4-8795-1c8734cc43a7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:41.982941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d37b29b9-60ab-462a-bf34-fce0187d3ea6 req-4bf34549-d850-4de4-8795-1c8734cc43a7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:41.983395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d37b29b9-60ab-462a-bf34-fce0187d3ea6 req-4bf34549-d850-4de4-8795-1c8734cc43a7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:42.015971 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d37b29b9-60ab-462a-bf34-fce0187d3ea6 req-4bf34549-d850-4de4-8795-1c8734cc43a7 service nova] Creating event network-changed:087d8ab6-d0b8-451a-a98f-0e8b6e72b4a6 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:11:42.026945 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d37b29b9-60ab-462a-bf34-fce0187d3ea6 req-4bf34549-d850-4de4-8795-1c8734cc43a7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103914 Aug 09 17:11:42.033427 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 676/1477] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:42.049499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:42.052390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:42.062291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] validate_networks() for [('b176697e-92f5-4744-9b98-692686c31e55', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:11:42.068951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:42.072410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:42.073355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:42.074499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:42.075026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:42.075613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:44.019897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:44.053891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:44.077014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:44.084603 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0866b7a1-a178-4897-a61d-393ac1391a45 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 2.049338 Aug 09 17:11:44.090237 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 677/1478] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:42 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:44.104544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e016215f-08ec-4216-915c-de5e91472d10 req-a0c9edb8-fc1b-42bf-8dd8-caf33cdae783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef8234b-af34-48f6-b84a-e4800e432eb8", "name": "network-vif-plugged", "status": "completed", "tag": "b426bae7-bfa2-43b9-8167-bbe3433a1e83"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:44.151486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e016215f-08ec-4216-915c-de5e91472d10 req-a0c9edb8-fc1b-42bf-8dd8-caf33cdae783 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:44.156731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e016215f-08ec-4216-915c-de5e91472d10 req-a0c9edb8-fc1b-42bf-8dd8-caf33cdae783 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:44.158005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e016215f-08ec-4216-915c-de5e91472d10 req-a0c9edb8-fc1b-42bf-8dd8-caf33cdae783 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:44.210096 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e016215f-08ec-4216-915c-de5e91472d10 req-a0c9edb8-fc1b-42bf-8dd8-caf33cdae783 service nova] Creating event network-vif-plugged:b426bae7-bfa2-43b9-8167-bbe3433a1e83 for instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 on n-h1-845781-6 Aug 09 17:11:44.232934 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e016215f-08ec-4216-915c-de5e91472d10 req-a0c9edb8-fc1b-42bf-8dd8-caf33cdae783 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139574 Aug 09 17:11:44.234034 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 678/1479] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:44.244901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6bff5bc7-85ae-4e53-b264-31cba733fc7d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:44.246505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6bff5bc7-85ae-4e53-b264-31cba733fc7d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:44.283722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bff5bc7-85ae-4e53-b264-31cba733fc7d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:44.284667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bff5bc7-85ae-4e53-b264-31cba733fc7d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:44.285465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bff5bc7-85ae-4e53-b264-31cba733fc7d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:44.286719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bff5bc7-85ae-4e53-b264-31cba733fc7d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:44.287565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bff5bc7-85ae-4e53-b264-31cba733fc7d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:44.288387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bff5bc7-85ae-4e53-b264-31cba733fc7d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:44.635924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:11:44.636401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:11:44.637261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:11:44.637530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:11:44.637961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:11:44.656123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:44.656640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:44.661882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:44.663936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:44.666397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:44.667129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:44.696829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Getting quotas for project 44129d75c58240fa867e90b1d3252554. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:11:44.703960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Getting quotas for user 894725e0d56b4960a8bc3e6a8e283b4e and project 44129d75c58240fa867e90b1d3252554. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:11:45.438319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6bff5bc7-85ae-4e53-b264-31cba733fc7d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:45.463591 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6bff5bc7-85ae-4e53-b264-31cba733fc7d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1316 microversion: 2.1 time: 1.225706 Aug 09 17:11:45.466557 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 679/1480] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:44 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1316 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:45.483086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:45.484824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:45.502286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:45.502809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:45.505213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:45.506283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:45.508563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:45.510038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:45.547336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:46.081937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:46.092895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:46.103134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:46.104782 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9e3e2bc1-2c45-4a02-818b-d7f4b152be2b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 0.635834 Aug 09 17:11:46.107198 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 680/1481] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:45 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:46.116883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-953837cd-f905-4faa-b7f1-fa753a490bb0 req-9135c526-6d99-4505-99c5-1857e54e6018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9bf5c5-13a8-4999-9fe7-e31ca09ad767", "name": "network-vif-unplugged", "status": "completed", "tag": "4e14d13a-f750-41b6-9e8f-9ebfa131fe82"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:46.146905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-953837cd-f905-4faa-b7f1-fa753a490bb0 req-9135c526-6d99-4505-99c5-1857e54e6018 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:46.147747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-953837cd-f905-4faa-b7f1-fa753a490bb0 req-9135c526-6d99-4505-99c5-1857e54e6018 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:46.150617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-953837cd-f905-4faa-b7f1-fa753a490bb0 req-9135c526-6d99-4505-99c5-1857e54e6018 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:46.179495 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-953837cd-f905-4faa-b7f1-fa753a490bb0 req-9135c526-6d99-4505-99c5-1857e54e6018 service nova] Creating event network-vif-unplugged:4e14d13a-f750-41b6-9e8f-9ebfa131fe82 for instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 on n-h1-845781-6 Aug 09 17:11:46.201751 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-953837cd-f905-4faa-b7f1-fa753a490bb0 req-9135c526-6d99-4505-99c5-1857e54e6018 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088475 Aug 09 17:11:46.205241 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 681/1482] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:46.215894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-9cfaa69b-d931-4042-a10a-7402e5d8117d req-bfb15fdc-6cb7-489a-9ff3-80780b622a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "tag": "1fe00816-1d9d-4c9b-8d71-db94ffc93bf9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:46.231714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9cfaa69b-d931-4042-a10a-7402e5d8117d req-bfb15fdc-6cb7-489a-9ff3-80780b622a27 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:46.232759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9cfaa69b-d931-4042-a10a-7402e5d8117d req-bfb15fdc-6cb7-489a-9ff3-80780b622a27 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:46.233621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9cfaa69b-d931-4042-a10a-7402e5d8117d req-bfb15fdc-6cb7-489a-9ff3-80780b622a27 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:46.254418 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-9cfaa69b-d931-4042-a10a-7402e5d8117d req-bfb15fdc-6cb7-489a-9ff3-80780b622a27 service nova] Creating event network-changed:1fe00816-1d9d-4c9b-8d71-db94ffc93bf9 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:11:46.270526 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-9cfaa69b-d931-4042-a10a-7402e5d8117d req-bfb15fdc-6cb7-489a-9ff3-80780b622a27 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061273 Aug 09 17:11:46.276556 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 682/1483] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:46.970252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc08a3b4-1879-4bc3-b234-52b70364b043 tempest-QuotaClassesAdmin257Test-860898456 tempest-QuotaClassesAdmin257Test-860898456-project-admin] Calling method '.version_select at 0x7fbbcb7175e0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:46.975065 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:11:46.975065 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:11:47.046422 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cc08a3b4-1879-4bc3-b234-52b70364b043 tempest-QuotaClassesAdmin257Test-860898456 tempest-QuotaClassesAdmin257Test-860898456-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.762508 Aug 09 17:11:47.061072 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 683/1484] 10.222.0.93 () {60 vars in 1226 bytes} [Tue Aug 9 17:11:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:11:47.071361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:47.073352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:47.088289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:47.089707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:47.091471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:47.093168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:47.094420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:47.095246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:48.872105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:48.914165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:48.919581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:48.924524 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0858f50d-a806-4df9-aa2b-d260c961f9fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 1.858972 Aug 09 17:11:48.928964 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 684/1485] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:47 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:48.944496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-156b6a43-9f72-4be3-b04e-6635f7ca5a56 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:48.950640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-156b6a43-9f72-4be3-b04e-6635f7ca5a56 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:48.970274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-156b6a43-9f72-4be3-b04e-6635f7ca5a56 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:48.972720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-156b6a43-9f72-4be3-b04e-6635f7ca5a56 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:48.973570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-156b6a43-9f72-4be3-b04e-6635f7ca5a56 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:48.975038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-156b6a43-9f72-4be3-b04e-6635f7ca5a56 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:48.976285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-156b6a43-9f72-4be3-b04e-6635f7ca5a56 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:48.979991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-156b6a43-9f72-4be3-b04e-6635f7ca5a56 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:49.881607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-156b6a43-9f72-4be3-b04e-6635f7ca5a56 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:49.905644 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-156b6a43-9f72-4be3-b04e-6635f7ca5a56 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1465 microversion: 2.1 time: 0.974009 Aug 09 17:11:49.921715 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 685/1486] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:48 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1465 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:49.934133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5670a9f2-e00d-4dbd-8c1e-d8a2fa0e9156 tempest-QuotaClassesAdmin257Test-860898456 tempest-QuotaClassesAdmin257Test-860898456-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcb577e50>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:49.943360 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:11:49.943360 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:11:50.193739 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5670a9f2-e00d-4dbd-8c1e-d8a2fa0e9156 tempest-QuotaClassesAdmin257Test-860898456 tempest-QuotaClassesAdmin257Test-860898456-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.268811 Aug 09 17:11:50.197946 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 686/1487] 10.222.0.93 () {62 vars in 1247 bytes} [Tue Aug 9 17:11:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:11:50.219833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:50.220877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:50.240091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:50.240746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:50.243041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:50.245858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:50.250097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:50.251309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:51.140033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:51.160042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:51.161803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:51.173216 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a2110d20-f59e-4650-a97f-a504291b0ca8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 0.970118 Aug 09 17:11:51.174379 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 687/1488] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:50 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:51.179914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-0c5ab08d-5b86-4c78-897f-cdf79c7d7f2a req-e68be918-c044-4993-8d75-7b5dceb936c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "tag": "1e899611-18b4-4b55-9bae-c961a398310b"}, {"name": "network-changed", "server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "tag": "52bfc239-226f-4b52-bc62-3939a1c70d53"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:51.208504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0c5ab08d-5b86-4c78-897f-cdf79c7d7f2a req-e68be918-c044-4993-8d75-7b5dceb936c2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:51.209095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0c5ab08d-5b86-4c78-897f-cdf79c7d7f2a req-e68be918-c044-4993-8d75-7b5dceb936c2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:51.209612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0c5ab08d-5b86-4c78-897f-cdf79c7d7f2a req-e68be918-c044-4993-8d75-7b5dceb936c2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:51.234297 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-0c5ab08d-5b86-4c78-897f-cdf79c7d7f2a req-e68be918-c044-4993-8d75-7b5dceb936c2 service nova] Creating event network-changed:1e899611-18b4-4b55-9bae-c961a398310b for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:11:51.237427 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-0c5ab08d-5b86-4c78-897f-cdf79c7d7f2a req-e68be918-c044-4993-8d75-7b5dceb936c2 service nova] Creating event network-changed:52bfc239-226f-4b52-bc62-3939a1c70d53 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:11:51.249246 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-0c5ab08d-5b86-4c78-897f-cdf79c7d7f2a req-e68be918-c044-4993-8d75-7b5dceb936c2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072258 Aug 09 17:11:51.251532 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 688/1489] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:51.265899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2a595c50-79d9-43c5-b2af-a7411597f1f7 req-e9d13b2c-c1ee-4499-a82c-c931f33bf897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9bf5c5-13a8-4999-9fe7-e31ca09ad767", "tag": "4e14d13a-f750-41b6-9e8f-9ebfa131fe82"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:51.293351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2a595c50-79d9-43c5-b2af-a7411597f1f7 req-e9d13b2c-c1ee-4499-a82c-c931f33bf897 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:51.294807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2a595c50-79d9-43c5-b2af-a7411597f1f7 req-e9d13b2c-c1ee-4499-a82c-c931f33bf897 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:51.296040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2a595c50-79d9-43c5-b2af-a7411597f1f7 req-e9d13b2c-c1ee-4499-a82c-c931f33bf897 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:51.323474 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2a595c50-79d9-43c5-b2af-a7411597f1f7 req-e9d13b2c-c1ee-4499-a82c-c931f33bf897 service nova] Creating event network-changed:4e14d13a-f750-41b6-9e8f-9ebfa131fe82 for instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 on n-h1-845781-6 Aug 09 17:11:51.336932 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-2a595c50-79d9-43c5-b2af-a7411597f1f7 req-e9d13b2c-c1ee-4499-a82c-c931f33bf897 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080712 Aug 09 17:11:51.338922 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 689/1490] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:11:51.355098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:51.358653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:51.375486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:51.376898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:51.378142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:51.381125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:51.382452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:51.385452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:52.275070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:52.299346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:52.305269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:52.308658 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1f593bd8-cd87-4ef6-96aa-48c0714fffeb tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.966316 Aug 09 17:11:52.325504 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 690/1491] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:51 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:52.351379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-480467b0-795e-4bad-ac3d-835df729d15c tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-569530132", "metadata": {"image_type": "test"}}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:52.355728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-480467b0-795e-4bad-ac3d-835df729d15c tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:52.376126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-480467b0-795e-4bad-ac3d-835df729d15c tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:52.377389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-480467b0-795e-4bad-ac3d-835df729d15c tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:52.379408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-480467b0-795e-4bad-ac3d-835df729d15c tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:52.381340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-480467b0-795e-4bad-ac3d-835df729d15c tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:52.382992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-480467b0-795e-4bad-ac3d-835df729d15c tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:52.384145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-480467b0-795e-4bad-ac3d-835df729d15c tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:52.460315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-480467b0-795e-4bad-ac3d-835df729d15c tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Getting quotas for project 58824a6471f34f1c9c371381b8140158. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:11:52.467965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-480467b0-795e-4bad-ac3d-835df729d15c tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Getting quotas for user 6251fca3070f46e88dea986cf6db9f07 and project 58824a6471f34f1c9c371381b8140158. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:11:52.894595 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-480467b0-795e-4bad-ac3d-835df729d15c tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "POST /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8/action" status: 202 len: 0 microversion: 2.1 time: 0.562425 Aug 09 17:11:52.919458 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 691/1492] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:11:52 2022] POST /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 17:11:52.954688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9e66b9a0-3416-4733-bd6f-ed00c9ff3b3a tempest-QuotaClassesAdmin257Test-860898456 tempest-QuotaClassesAdmin257Test-860898456-project-admin] Calling method '.version_select at 0x7fbbcb48bdc0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:52.957922 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:11:52.957922 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:11:52.991111 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9e66b9a0-3416-4733-bd6f-ed00c9ff3b3a tempest-QuotaClassesAdmin257Test-860898456 tempest-QuotaClassesAdmin257Test-860898456-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.067012 Aug 09 17:11:52.998178 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 692/1493] 10.222.0.93 () {60 vars in 1226 bytes} [Tue Aug 9 17:11:52 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:11:53.020707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:53.022530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:53.031418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=7,nova_api:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:53.057358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:53.058576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:53.062767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:53.066027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:53.071685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:53.073326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:54.329115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:54.346114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:54.356753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:54.358303 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cf2768ec-0b6d-402b-a345-edbcbabf894b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 1.357496 Aug 09 17:11:54.359593 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 693/1494] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:52 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:54.365105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3c3ef17c-0ce0-4b39-a742-41ffe8504a16 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb5779d0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:54.442371 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3c3ef17c-0ce0-4b39-a742-41ffe8504a16 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.081422 Aug 09 17:11:54.450577 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 694/1495] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:11:54 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:54.457954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc9a919f-4707-4af9-b061-e93f964cf6ac tempest-QuotaClassesAdmin257Test-860898456 tempest-QuotaClassesAdmin257Test-860898456-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcb48b700>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:11:54.461322 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:11:54.461322 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:11:54.598573 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cc9a919f-4707-4af9-b061-e93f964cf6ac tempest-QuotaClassesAdmin257Test-860898456 tempest-QuotaClassesAdmin257Test-860898456-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.146618 Aug 09 17:11:54.608420 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 695/1496] 10.222.0.93 () {62 vars in 1247 bytes} [Tue Aug 9 17:11:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:11:54.614286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:54.615153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:54.630943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:54.631673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:54.632234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:54.633268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:54.634059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:54.634291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:54.686771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:54.689509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=43 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:54.715968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:54.725173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=58 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:11:55.046366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:55.063084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:55.076051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:55.077612 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-60232cbe-cc91-4544-aa5f-6044c6f292fd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.468064 Aug 09 17:11:55.078323 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 696/1497] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:54 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:55.408324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:55.409212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:55.438467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:55.439314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:55.444504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:55.446635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:55.447368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:55.460561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:56.197375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:56.270978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:56.286748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:56.295507 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0531ce12-bfbf-4832-a5a0-e2e55f4927da tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 0.891666 Aug 09 17:11:56.306206 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 697/1498] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:55 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:11:56.346453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bdbef59e-8b66-4f0a-a853-8a99b0a53541 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb73ff70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:56.552368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bdbef59e-8b66-4f0a-a853-8a99b0a53541 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.239078 Aug 09 17:11:56.583686 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 698/1499] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:11:56 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:56.636474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:56.638235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:56.719509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:56.721206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:56.727160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:56.729528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:56.731137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:56.739581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:56.884287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:11:56.889317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='525283bd-4d43-47f8-8fdd-a236e20bc213',volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:11:58.451230 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2135e3a6-fc78-4fb8-ad88-53e131a48f46 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 20.067134 Aug 09 17:11:58.453832 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 802/1500] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:11:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 20076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:11:58.485626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:58.488662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:58.513711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:58.514784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:58.521815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:58.523116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:58.528217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:58.529032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:58.719570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:58.754764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:58.764169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:58.772189 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d4760346-e5fd-438f-b317-4fc33f70004e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 2.183486 Aug 09 17:11:58.776691 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 699/1501] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:56 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:11:58.804969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-808eb63f-5cd0-43a4-9015-9f629b456687 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb4cd670>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:58.973904 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-808eb63f-5cd0-43a4-9015-9f629b456687 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.192200 Aug 09 17:11:58.975854 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 700/1502] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:11:58 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:58.982106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a00c8c6f-9696-492e-8df4-13e1600d9758 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:58.983925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a00c8c6f-9696-492e-8df4-13e1600d9758 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:59.260094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a00c8c6f-9696-492e-8df4-13e1600d9758 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:11:59.293450 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a00c8c6f-9696-492e-8df4-13e1600d9758 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1052 microversion: 2.1 time: 0.315429 Aug 09 17:11:59.297477 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 701/1503] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:11:58 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1052 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:11:59.815685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:11:59.819874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:11:59.867396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:59.873828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:59.877516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:11:59.883531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:11:59.886869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:11:59.895024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:00.091110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:00.117314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:00.119565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:00.129311 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0902c75d-ae6c-4707-89ab-b79140eeb47b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 1.666471 Aug 09 17:12:00.130475 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 803/1504] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:58 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:00.150476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c426ac3f-828c-47a4-a300-c051c6a3a0b2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb961160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:00.389777 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c426ac3f-828c-47a4-a300-c051c6a3a0b2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.256216 Aug 09 17:12:00.400346 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 804/1505] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:00 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:00.415205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c8e4a5b-90d1-4c54-824d-5387e61e4f11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:00.416110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c8e4a5b-90d1-4c54-824d-5387e61e4f11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:00.455406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8e4a5b-90d1-4c54-824d-5387e61e4f11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:00.458767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8e4a5b-90d1-4c54-824d-5387e61e4f11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:00.462401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8e4a5b-90d1-4c54-824d-5387e61e4f11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:00.465637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8e4a5b-90d1-4c54-824d-5387e61e4f11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:00.467406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8e4a5b-90d1-4c54-824d-5387e61e4f11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:00.469772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8e4a5b-90d1-4c54-824d-5387e61e4f11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:00.693070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c8e4a5b-90d1-4c54-824d-5387e61e4f11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:00.712636 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c8e4a5b-90d1-4c54-824d-5387e61e4f11 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1102 microversion: 2.1 time: 0.305263 Aug 09 17:12:00.713943 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 805/1506] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:00 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1102 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:01.175988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:01.177296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:01.194220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:01.195044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:01.196629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:01.199588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:01.201498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:01.202159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:01.442843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:01.470535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:01.482066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:01.483920 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b6ee24be-15d7-4c41-ac98-6ac1bad3db9f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 1.681230 Aug 09 17:12:01.485050 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 702/1507] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:11:59 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:01.502861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-34292a77-71e0-46ce-90a0-17d6fe0842b2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb48bb80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:01.728033 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-34292a77-71e0-46ce-90a0-17d6fe0842b2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.241489 Aug 09 17:12:01.738133 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 703/1508] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:01 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:01.751096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a788edd-3e4c-4119-8cf5-87c7c9e86899 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:01.754905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9a788edd-3e4c-4119-8cf5-87c7c9e86899 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:01.774053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a788edd-3e4c-4119-8cf5-87c7c9e86899 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:01.775027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a788edd-3e4c-4119-8cf5-87c7c9e86899 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:01.775833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a788edd-3e4c-4119-8cf5-87c7c9e86899 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:01.778624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a788edd-3e4c-4119-8cf5-87c7c9e86899 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:01.780487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a788edd-3e4c-4119-8cf5-87c7c9e86899 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:01.782411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a788edd-3e4c-4119-8cf5-87c7c9e86899 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:01.966570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:01.986353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:01.992302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:01.997176 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-491a7acf-f4c5-4e48-9763-06ab0c85d348 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 0.826191 Aug 09 17:12:02.014345 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 806/1509] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:01 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:12:02.402371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a788edd-3e4c-4119-8cf5-87c7c9e86899 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:02.439917 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a788edd-3e4c-4119-8cf5-87c7c9e86899 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1150 microversion: 2.1 time: 0.696493 Aug 09 17:12:02.441084 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 704/1510] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:01 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1150 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:02.539670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:02.542176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:02.563680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:02.564804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:02.566155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:02.570235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:02.574250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:02.575558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:02.745141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-65452b6b-8d3b-4bf2-b662-7876ec9a3b98 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb5b8310>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:02.961862 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-65452b6b-8d3b-4bf2-b662-7876ec9a3b98 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.220724 Aug 09 17:12:02.969582 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 705/1511] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:02 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:03.036450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:03.042325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:03.075098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:03.076408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:03.077391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:03.081001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:03.083893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:03.084879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:03.859274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:03.920315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:03.929138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:03.942219 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5c4cca43-c0e1-46b6-a786-2103e9646306 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 0.917027 Aug 09 17:12:03.946877 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 706/1512] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:03 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:03.975039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-75c5fb60-c1e3-4bdc-9e64-e235a78bef6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:03.977141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-75c5fb60-c1e3-4bdc-9e64-e235a78bef6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:03.979049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:04.015779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:04.021358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5fb60-c1e3-4bdc-9e64-e235a78bef6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:04.022619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5fb60-c1e3-4bdc-9e64-e235a78bef6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:04.027439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5fb60-c1e3-4bdc-9e64-e235a78bef6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:04.033343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5fb60-c1e3-4bdc-9e64-e235a78bef6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:04.035221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5fb60-c1e3-4bdc-9e64-e235a78bef6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:04.038061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5fb60-c1e3-4bdc-9e64-e235a78bef6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:04.041705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:04.044340 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2edf21f7-09ef-4fa3-a013-217e66af891c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 1.512116 Aug 09 17:12:04.045421 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 807/1513] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:02 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:04.082979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d179eb9a-0a01-42d7-a07e-99dd4e59967f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbd81295e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:04.367020 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d179eb9a-0a01-42d7-a07e-99dd4e59967f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.306967 Aug 09 17:12:04.369442 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 808/1514] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:04 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:04.982591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:04.991433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:05.052750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:05.057994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:05.063915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:05.068584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:05.079211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:05.084660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:05.816196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-75c5fb60-c1e3-4bdc-9e64-e235a78bef6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:05.858528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:12:05.869141 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-75c5fb60-c1e3-4bdc-9e64-e235a78bef6c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1168 microversion: 2.1 time: 1.918490 Aug 09 17:12:05.875385 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 707/1515] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:03 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1168 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:06.853187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba7e2dd3-c5ca-46f1-ba8f-5edf6a42f808 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] Calling method '.version_select at 0x7fbbcb4711f0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:07.001075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:07.052479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:07.056143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:07.061780 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3841bd23-0688-4c16-8206-8d06bb44decc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 2.091321 Aug 09 17:12:07.069435 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 809/1516] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:04 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:07.098537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:07.100539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:07.121669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:07.123302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:07.124395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:07.130281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:07.131664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:07.133442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:07.554305 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ba7e2dd3-c5ca-46f1-ba8f-5edf6a42f808 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.675922 Aug 09 17:12:07.555489 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 708/1517] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:12:05 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:12:07.599427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8156e121-591e-419f-9a36-87c0eece89a5 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb44f700>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:07.828199 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8156e121-591e-419f-9a36-87c0eece89a5 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.257601 Aug 09 17:12:07.828885 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 709/1518] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:07 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:07.849544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c9ef529f-15f1-4bb7-995f-e756c25748f0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:07.853367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c9ef529f-15f1-4bb7-995f-e756c25748f0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:07.893545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9ef529f-15f1-4bb7-995f-e756c25748f0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:07.908403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9ef529f-15f1-4bb7-995f-e756c25748f0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:07.909793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9ef529f-15f1-4bb7-995f-e756c25748f0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:07.912577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9ef529f-15f1-4bb7-995f-e756c25748f0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:07.913730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9ef529f-15f1-4bb7-995f-e756c25748f0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:07.924213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9ef529f-15f1-4bb7-995f-e756c25748f0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:08.209639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:08.280155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:08.282570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:08.287439 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ba186791-5ec0-41db-ad41-ae98f671ef06 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 1.212619 Aug 09 17:12:08.290122 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 810/1519] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:07 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:08.304416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67c41f55-8a6e-4c2e-9bb9-55bb458a1cd0 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] Action: 'create', calling method: .version_select at 0x7fbbcbf59430>, body: {"pool": "non_exist_pool"} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:08.515433 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-67c41f55-8a6e-4c2e-9bb9-55bb458a1cd0 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] HTTP exception thrown: Floating IP pool not found. Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67c41f55-8a6e-4c2e-9bb9-55bb458a1cd0 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] Request method failure captured: Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 26 Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pVkY9QjPqLbu2VIeHJFoRW5dvOab_AKXDcoeL_QVWZA7Ecm8D9yZbRhCGI8WPmUmNAVBr-cVg_BtAPhvmVnOPEF2hOMOQYSXVZTxCyIZc6VGWNj5sbCwDW9kKxHihE7ARxS2bBYPnYquseOP4SQkIy7EIOdC80UAy0X0Wj2LnBIH5M Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1fb9bd7bc1714973b143c5058cf41656 Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1528193435 Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:12:08.521337 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1fb9bd7bc1714973b143c5058cf41656"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1fb9bd7bc1714973b143c5058cf41656"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1fb9bd7bc1714973b143c5058cf41656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1fb9bd7bc1714973b143c5058cf41656"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1528193435 Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1fb9bd7bc1714973b143c5058cf41656 Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1528193435 Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FloatingIPsNegativeTestJSON-1528193435-project Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: cf98c90b7dfa49d79ae2dfeac7d8482c Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1528193435-project Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: {"pool": "non_exist_pool"} Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: exception: Floating IP pool not found. Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 09 17:12:08.524494 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:12:08.526889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 09 17:12:08.536082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:08.540779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67c41f55-8a6e-4c2e-9bb9-55bb458a1cd0 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] Returning 404 to user: Floating IP pool not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:12:08.544755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-67c41f55-8a6e-4c2e-9bb9-55bb458a1cd0 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.252682 Aug 09 17:12:08.553180 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 811/1520] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:12:08 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:12:08.583340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:08.585510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:08.619389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:08.620697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:08.621709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:08.633205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:08.633973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:08.634801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:08.807558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c9ef529f-15f1-4bb7-995f-e756c25748f0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:08.857342 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c9ef529f-15f1-4bb7-995f-e756c25748f0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1210 microversion: 2.1 time: 1.009416 Aug 09 17:12:08.858578 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 710/1521] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:07 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1210 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:08.891604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-356fe2d5-dc40-408c-b0e7-2528f9d0ee75 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] Calling method '.version_select at 0x7fbbcb496550>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:09.279004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=16,nova_cell0:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:12:09.366223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-356fe2d5-dc40-408c-b0e7-2528f9d0ee75 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 69fb8ef7-e332-4884-92ca-f3c40f8eba33 could not be found", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:12:09.368061 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-356fe2d5-dc40-408c-b0e7-2528f9d0ee75 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] HTTP exception thrown: Floating IP not found for ID 69fb8ef7-e332-4884-92ca-f3c40f8eba33 Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-356fe2d5-dc40-408c-b0e7-2528f9d0ee75 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] Request method failure captured: Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-floating-ips/69fb8ef7-e332-4884-92ca-f3c40f8eba33 HTTP/1.1 Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pVkY9QjPqLbu2VIeHJFoRW5dvOab_AKXDcoeL_QVWZA7Ecm8D9yZbRhCGI8WPmUmNAVBr-cVg_BtAPhvmVnOPEF2hOMOQYSXVZTxCyIZc6VGWNj5sbCwDW9kKxHihE7ARxS2bBYPnYquseOP4SQkIy7EIOdC80UAy0X0Wj2LnBIH5M Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1fb9bd7bc1714973b143c5058cf41656 Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1528193435 Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:12:09.374475 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1fb9bd7bc1714973b143c5058cf41656"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1fb9bd7bc1714973b143c5058cf41656"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1fb9bd7bc1714973b143c5058cf41656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1fb9bd7bc1714973b143c5058cf41656"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1528193435 Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1fb9bd7bc1714973b143c5058cf41656 Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1528193435 Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-FloatingIPsNegativeTestJSON-1528193435-project Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: cf98c90b7dfa49d79ae2dfeac7d8482c Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1528193435-project Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: exception: Floating IP not found for ID 69fb8ef7-e332-4884-92ca-f3c40f8eba33 Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '69fb8ef7-e332-4884-92ca-f3c40f8eba33'} Aug 09 17:12:09.377774 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:12:09.380953 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 69fb8ef7-e332-4884-92ca-f3c40f8eba33 could not be found Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0dfbc879-0afd-4a21-8bb2-8ee17e459ed8'] Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 69fb8ef7-e332-4884-92ca-f3c40f8eba33. Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:09.383605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 69fb8ef7-e332-4884-92ca-f3c40f8eba33 Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:12:09.391778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:12:09.396579 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 69fb8ef7-e332-4884-92ca-f3c40f8eba33 Aug 09 17:12:09.396579 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:09.406571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-356fe2d5-dc40-408c-b0e7-2528f9d0ee75 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] Returning 404 to user: Floating IP not found for ID 69fb8ef7-e332-4884-92ca-f3c40f8eba33 {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:12:09.411660 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-356fe2d5-dc40-408c-b0e7-2528f9d0ee75 tempest-FloatingIPsNegativeTestJSON-1528193435 tempest-FloatingIPsNegativeTestJSON-1528193435-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/69fb8ef7-e332-4884-92ca-f3c40f8eba33" status: 404 len: 111 microversion: 2.1 time: 0.551103 Aug 09 17:12:09.419506 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 711/1522] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:12:08 2022] DELETE /compute/v2.1/os-floating-ips/69fb8ef7-e332-4884-92ca-f3c40f8eba33 => generated 111 bytes in 560 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:12:09.451515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dbb45344-898c-4994-b688-ada65669bba6 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb49b160>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:09.617604 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dbb45344-898c-4994-b688-ada65669bba6 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.195503 Aug 09 17:12:09.619914 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 712/1523] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:09 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:09.637255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:09.637898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:09.650530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:09.651046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:09.651502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:09.652381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:09.652864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:09.653310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:09.858967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:09.894334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:09.903651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:09.912433 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f9d98a9-5edd-4baf-8875-b3831dbcd516 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 1.356772 Aug 09 17:12:09.914580 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 812/1524] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:08 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:10.335078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1294cd7-0d59-4a02-b0f5-5971fda130cf tempest-SecurityGroupsTestAdminJSON-1506246785 tempest-SecurityGroupsTestAdminJSON-1506246785-project] Action: 'create', calling method: .version_select at 0x7fbbcb5e45e0>, body: {"security_group": {"name": "tempest-securitygroup-1198454652", "description": "tempest-description-1205560455"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:10.365302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:10.384860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:10.389734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:10.394697 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e41c30f1-7445-43d4-87fe-02468dcfc082 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.766434 Aug 09 17:12:10.395405 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 713/1525] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:09 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:10.417889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-51f8ddc5-2011-46e1-bb3e-5be518ec0eb3 req-c8523b4a-61b4-4d7a-b463-505a7db4313e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef8234b-af34-48f6-b84a-e4800e432eb8", "name": "network-vif-plugged", "status": "completed", "tag": "b426bae7-bfa2-43b9-8167-bbe3433a1e83"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:10.459269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-51f8ddc5-2011-46e1-bb3e-5be518ec0eb3 req-c8523b4a-61b4-4d7a-b463-505a7db4313e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:10.465092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-51f8ddc5-2011-46e1-bb3e-5be518ec0eb3 req-c8523b4a-61b4-4d7a-b463-505a7db4313e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:10.469581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-51f8ddc5-2011-46e1-bb3e-5be518ec0eb3 req-c8523b4a-61b4-4d7a-b463-505a7db4313e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:10.520218 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-51f8ddc5-2011-46e1-bb3e-5be518ec0eb3 req-c8523b4a-61b4-4d7a-b463-505a7db4313e service nova] Creating event network-vif-plugged:b426bae7-bfa2-43b9-8167-bbe3433a1e83 for instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 on n-h1-845781-6 Aug 09 17:12:10.540471 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-51f8ddc5-2011-46e1-bb3e-5be518ec0eb3 req-c8523b4a-61b4-4d7a-b463-505a7db4313e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142026 Aug 09 17:12:10.541096 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 714/1526] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:10.547932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-28315105-c0c2-4f8a-8d7a-5969fb73b71e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:10.549614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-28315105-c0c2-4f8a-8d7a-5969fb73b71e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:10.568403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28315105-c0c2-4f8a-8d7a-5969fb73b71e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:10.574678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28315105-c0c2-4f8a-8d7a-5969fb73b71e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:10.576208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28315105-c0c2-4f8a-8d7a-5969fb73b71e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:10.577367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28315105-c0c2-4f8a-8d7a-5969fb73b71e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:10.578140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28315105-c0c2-4f8a-8d7a-5969fb73b71e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:10.579023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28315105-c0c2-4f8a-8d7a-5969fb73b71e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:11.550675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-28315105-c0c2-4f8a-8d7a-5969fb73b71e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:11.581962 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-28315105-c0c2-4f8a-8d7a-5969fb73b71e tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1210 microversion: 2.1 time: 1.038125 Aug 09 17:12:11.604060 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 715/1527] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:10 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1210 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:11.619368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-85fa79bf-53f7-48e1-8ae4-59d7278c1ecc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb4964c0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:11.841055 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-85fa79bf-53f7-48e1-8ae4-59d7278c1ecc tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.234290 Aug 09 17:12:11.844081 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 716/1528] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:11 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:11.859748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:11.882802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:11.915893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:11.933816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:11.944762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:11.946960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:11.953755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:11.960519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:13.148699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:13.190084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:13.192178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:13.213060 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e64afb65-91ce-468b-b998-e06aa5d4e61a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1891 microversion: 2.42 time: 1.366935 Aug 09 17:12:13.216084 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 717/1529] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:11 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1891 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:13.260984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:13.261980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:13.279266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:13.284816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:13.285599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:13.286578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:13.291336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:13.292460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:13.537149 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1294cd7-0d59-4a02-b0f5-5971fda130cf tempest-SecurityGroupsTestAdminJSON-1506246785 tempest-SecurityGroupsTestAdminJSON-1506246785-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 3.612829 Aug 09 17:12:13.538279 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 813/1530] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:12:09 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 3623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:13.584744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50c80044-9283-4249-810f-35dbca19cadd tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:13.590566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-50c80044-9283-4249-810f-35dbca19cadd tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:13.632735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c80044-9283-4249-810f-35dbca19cadd tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:13.634062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c80044-9283-4249-810f-35dbca19cadd tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:13.635396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c80044-9283-4249-810f-35dbca19cadd tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:13.637011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c80044-9283-4249-810f-35dbca19cadd tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:13.638125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c80044-9283-4249-810f-35dbca19cadd tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:13.639190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50c80044-9283-4249-810f-35dbca19cadd tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:13.820262 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-50c80044-9283-4249-810f-35dbca19cadd tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.257890 Aug 09 17:12:13.838443 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 814/1531] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:12:13 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-volume_attachments => generated 197 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:13.858243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3efc0adc-b20b-421e-8b3e-3e7074fbc519 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:13.859944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3efc0adc-b20b-421e-8b3e-3e7074fbc519 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:13.872106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3efc0adc-b20b-421e-8b3e-3e7074fbc519 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:13.873566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3efc0adc-b20b-421e-8b3e-3e7074fbc519 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:13.874987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3efc0adc-b20b-421e-8b3e-3e7074fbc519 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:13.876902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3efc0adc-b20b-421e-8b3e-3e7074fbc519 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:13.878385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3efc0adc-b20b-421e-8b3e-3e7074fbc519 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:13.879613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3efc0adc-b20b-421e-8b3e-3e7074fbc519 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:13.996479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:14.041099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:14.043146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:14.053487 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-01d9bb2e-d453-48aa-8b43-984db6509ddf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.835418 Aug 09 17:12:14.056018 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 718/1532] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:13 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:14.210936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c15377e5-9c74-467f-b471-cc0968d35507 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Calling method '.version_select at 0x7fbbcb6738b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:14.305842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-c15377e5-9c74-467f-b471-cc0968d35507 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0 does not exist", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:12:14.306980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.security_group_api [None req-c15377e5-9c74-467f-b471-cc0968d35507 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Neutron security group d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0 not found {{(pid=119432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:12:14.307782 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-c15377e5-9c74-467f-b471-cc0968d35507 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] HTTP exception thrown: Security group d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0 does not exist Aug 09 17:12:14.307782 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-7b89e417-8c9e-419f-a0f3-92f3f55ce6b7'] Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c15377e5-9c74-467f-b471-cc0968d35507 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Request method failure captured: Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-security-groups/d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0 HTTP/1.1 Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pVs6V8JplF3I3QjRf6dsNd499z85z_ZBtWUSqrZFuD5gx9Q7aWVEF7l-zSegZnsP0FTHc9T955Io3uQzmtF19jYFQ2_d7JHB_AaOX7Swpd9Cqug2xLSNXhM20gJ4_Kb5WV6HPELR54QYX2iWB50l1LR4yt2nDoed4AEwIdHJNZ91oM Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: d28d8250ec49450f9823f1dacb49a415 Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:12:14.310886 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: d28d8250ec49450f9823f1dacb49a415 Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsNegativeTestJSON-1132628244-project Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 7b657487ab5d4f059bea15c0b1730dfb Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244-project Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: exception: Security group d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0 does not exist Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-7b89e417-8c9e-419f-a0f3-92f3f55ce6b7'] Aug 09 17:12:14.312615 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'd50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0'} Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:14.313974 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0 does not exist Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b89e417-8c9e-419f-a0f3-92f3f55ce6b7'] Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:12:14.315287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0 does not exist Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b89e417-8c9e-419f-a0f3-92f3f55ce6b7'] Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0 does not exist Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b89e417-8c9e-419f-a0f3-92f3f55ce6b7'] Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:14.316642 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:14.318070 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:14.318070 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:14.318070 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:12:14.318070 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:12:14.318070 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0 does not exist Aug 09 17:12:14.318070 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b89e417-8c9e-419f-a0f3-92f3f55ce6b7'] Aug 09 17:12:14.318070 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:12:14.321599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c15377e5-9c74-467f-b471-cc0968d35507 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Returning 404 to user: Security group d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0 does not exist Aug 09 17:12:14.321599 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-7b89e417-8c9e-419f-a0f3-92f3f55ce6b7'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:12:14.323038 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c15377e5-9c74-467f-b471-cc0968d35507 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0" status: 404 len: 194 microversion: 2.1 time: 0.264495 Aug 09 17:12:14.324227 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 719/1533] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:12:14 2022] DELETE /compute/v2.1/os-security-groups/d50e2fd5-8c5e-4437-a3d0-bc06dad5e3a0 => generated 194 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:12:14.339703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3af1ffd2-e876-4ca6-9b76-e26347e48ea9 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb471670>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:14.473708 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3af1ffd2-e876-4ca6-9b76-e26347e48ea9 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.147833 Aug 09 17:12:14.479976 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 720/1534] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:14 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:14.489192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3004994b-6377-4e0c-8211-8aace5d2698a tempest-SecurityGroupsTestAdminJSON-1506246785 tempest-SecurityGroupsTestAdminJSON-1506246785-project] Action: 'create', calling method: .version_select at 0x7fbbcb48bf70>, body: {"security_group": {"name": "tempest-securitygroup-1277963492", "description": "tempest-description-879395469"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:15.119610 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3004994b-6377-4e0c-8211-8aace5d2698a tempest-SecurityGroupsTestAdminJSON-1506246785 tempest-SecurityGroupsTestAdminJSON-1506246785-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.637959 Aug 09 17:12:15.122397 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 721/1535] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:12:14 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:15.129683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c51b4f8d-b551-421d-a493-70c8302f5173 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:15.132864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c51b4f8d-b551-421d-a493-70c8302f5173 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:15.142705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c51b4f8d-b551-421d-a493-70c8302f5173 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:15.145076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c51b4f8d-b551-421d-a493-70c8302f5173 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:15.145826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c51b4f8d-b551-421d-a493-70c8302f5173 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:15.146785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c51b4f8d-b551-421d-a493-70c8302f5173 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:15.147519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c51b4f8d-b551-421d-a493-70c8302f5173 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:15.148153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c51b4f8d-b551-421d-a493-70c8302f5173 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:15.250485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3efc0adc-b20b-421e-8b3e-3e7074fbc519 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:15.289273 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3efc0adc-b20b-421e-8b3e-3e7074fbc519 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1210 microversion: 2.1 time: 1.438333 Aug 09 17:12:15.298974 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 815/1536] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:13 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1210 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:15.327502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:15.336787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:15.377952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:15.396754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:15.401071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-c51b4f8d-b551-421d-a493-70c8302f5173 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lazy-loading 'services' on Instance uuid 2f377368-7c9c-48cb-80c1-c2253e0f5105 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:12:15.402900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:15.406837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:15.415841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:15.419954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:15.763314 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c51b4f8d-b551-421d-a493-70c8302f5173 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-volume_attachments/2186be9e-51fb-4629-a323-87510d649e8d" status: 202 len: 0 microversion: 2.1 time: 0.638329 Aug 09 17:12:15.790011 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 722/1537] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:12:15 2022] DELETE /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-volume_attachments/2186be9e-51fb-4629-a323-87510d649e8d => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:12:15.853737 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2b6eeee4-2188-4163-9698-c59fa7cab004 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.053729 Aug 09 17:12:15.854370 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 723/1538] 10.222.0.93 () {58 vars in 1164 bytes} [Tue Aug 9 17:12:15 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 17:12:15.867868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-3e880c72-9a51-4980-818e-c6df7be3cbd3 req-6a2cbbf1-e0be-4429-be9f-33759d3c8648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "376cf93a-be81-477e-a0c7-656834c3d899", "tag": "808a2a00-f141-4144-9ff7-439ca998a941"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:15.934335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3e880c72-9a51-4980-818e-c6df7be3cbd3 req-6a2cbbf1-e0be-4429-be9f-33759d3c8648 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:15.948935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3e880c72-9a51-4980-818e-c6df7be3cbd3 req-6a2cbbf1-e0be-4429-be9f-33759d3c8648 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:15.954834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3e880c72-9a51-4980-818e-c6df7be3cbd3 req-6a2cbbf1-e0be-4429-be9f-33759d3c8648 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:16.055699 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-3e880c72-9a51-4980-818e-c6df7be3cbd3 req-6a2cbbf1-e0be-4429-be9f-33759d3c8648 service nova] Creating event network-changed:808a2a00-f141-4144-9ff7-439ca998a941 for instance 376cf93a-be81-477e-a0c7-656834c3d899 on n-h2-845781-6 Aug 09 17:12:16.082744 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-3e880c72-9a51-4980-818e-c6df7be3cbd3 req-6a2cbbf1-e0be-4429-be9f-33759d3c8648 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220176 Aug 09 17:12:16.084811 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 724/1539] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:16.114630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:16.116317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:16.138607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:16.140349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:16.140349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:16.141529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:16.142310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:16.155940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:16.646361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:16.690950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:16.703576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:16.706702 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ea51c58f-6a5d-42a8-8322-b43ed9ccf532 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.619279 Aug 09 17:12:16.727676 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 725/1540] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:16 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:16.857316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a054621c-c434-4dae-9fb7-5eaf95b42b95 tempest-SecurityGroupsTestAdminJSON-897327192 tempest-SecurityGroupsTestAdminJSON-897327192-project-admin] Action: 'create', calling method: .version_select at 0x7fbbcb4048b0>, body: {"security_group": {"name": "tempest-securitygroup-988045276", "description": "tempest-description-1255026662"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:17.453031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:17.499725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:17.502061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:17.503348 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1a244fd7-7820-465e-b8a7-1227d02a88e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 2.201888 Aug 09 17:12:17.526628 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 816/1541] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:15 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 2227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:17.558266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f1103267-1721-47dc-948c-4e8d23c0cac0 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcbad3e50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:17.676101 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f1103267-1721-47dc-948c-4e8d23c0cac0 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.129316 Aug 09 17:12:17.677023 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 817/1542] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:17 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:17.712260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-04c67a34-9dca-4262-b97c-3dca15403cca tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Calling method '.version_select at 0x7fbbcb7f7790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:17.891145 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a054621c-c434-4dae-9fb7-5eaf95b42b95 tempest-SecurityGroupsTestAdminJSON-897327192 tempest-SecurityGroupsTestAdminJSON-897327192-project-admin] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.176276 Aug 09 17:12:17.902384 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 726/1543] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:12:16 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:17.921067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-257273b6-ec5f-4cbb-a52c-ba38e91fff00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:17.936141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-257273b6-ec5f-4cbb-a52c-ba38e91fff00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:17.970226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257273b6-ec5f-4cbb-a52c-ba38e91fff00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:17.974605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257273b6-ec5f-4cbb-a52c-ba38e91fff00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:17.975537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257273b6-ec5f-4cbb-a52c-ba38e91fff00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:17.976891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257273b6-ec5f-4cbb-a52c-ba38e91fff00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:17.977779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257273b6-ec5f-4cbb-a52c-ba38e91fff00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:17.985295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257273b6-ec5f-4cbb-a52c-ba38e91fff00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:18.412427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-257273b6-ec5f-4cbb-a52c-ba38e91fff00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:18.465976 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-257273b6-ec5f-4cbb-a52c-ba38e91fff00 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1210 microversion: 2.1 time: 0.554761 Aug 09 17:12:18.470856 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 727/1544] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:17 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1210 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:18.484357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:18.486394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:18.511125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:18.513593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:18.514714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:18.516343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:18.517518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:18.518499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:18.949157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:18.969489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:18.974237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:18.977065 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4236f105-8e19-4d6b-8c0d-f0378e6f1fc7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.499985 Aug 09 17:12:18.978430 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 728/1545] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:18 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:18.986729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bba893d5-7bbc-4aa7-b3bd-4f8c4f66b8ce tempest-SecurityGroupsTestAdminJSON-897327192 tempest-SecurityGroupsTestAdminJSON-897327192-project-admin] Action: 'create', calling method: .version_select at 0x7fbbcb496550>, body: {"security_group": {"name": "tempest-securitygroup-1901432634", "description": "tempest-description-338060074"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:19.132109 n-d-845781-6 devstack@n-api.service[119432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:12:19.132395 n-d-845781-6 devstack@n-api.service[119432]: Tue Aug 9 17:12:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups (ip 10.222.0.93) !!! Aug 09 17:12:19.497991 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bba893d5-7bbc-4aa7-b3bd-4f8c4f66b8ce tempest-SecurityGroupsTestAdminJSON-897327192 tempest-SecurityGroupsTestAdminJSON-897327192-project-admin] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.516305 Aug 09 17:12:19.501284 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 729/1546] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:12:18 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:19.523768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:19.532340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:19.604191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:19.605485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:19.606417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:19.617798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:19.620008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:19.621325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:20.125475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:20.150858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:20.161127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:20.164030 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4f90e038-1d64-4360-8102-a8851b4817e1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 0.660793 Aug 09 17:12:20.166132 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 730/1547] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:19 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:20.178861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e9ea9f3d-a613-4171-bf97-83ebe1f171ac tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb49b8b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:20.302909 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-04c67a34-9dca-4262-b97c-3dca15403cca tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.605167 Aug 09 17:12:20.305009 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 818/1548] 10.222.0.93 () {58 vars in 1158 bytes} [Tue Aug 9 17:12:17 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:20.323486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9e0e8375-b66f-47e8-8cde-ff652ca66821 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:20.330169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9e0e8375-b66f-47e8-8cde-ff652ca66821 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:20.346705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0e8375-b66f-47e8-8cde-ff652ca66821 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:20.348860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0e8375-b66f-47e8-8cde-ff652ca66821 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:20.349653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0e8375-b66f-47e8-8cde-ff652ca66821 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:20.350804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0e8375-b66f-47e8-8cde-ff652ca66821 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:20.351587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0e8375-b66f-47e8-8cde-ff652ca66821 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:20.352646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0e8375-b66f-47e8-8cde-ff652ca66821 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:20.363089 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e9ea9f3d-a613-4171-bf97-83ebe1f171ac tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.193740 Aug 09 17:12:20.375208 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 731/1549] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:20 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:20.395854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d08a6c50-70bb-4cca-957d-75901d59eea0 tempest-SecurityGroupsTestAdminJSON-897327192 tempest-SecurityGroupsTestAdminJSON-897327192-project-admin] Calling method '.version_select at 0x7fbbcb49b280>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:21.106478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9e0e8375-b66f-47e8-8cde-ff652ca66821 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:21.126496 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9e0e8375-b66f-47e8-8cde-ff652ca66821 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1210 microversion: 2.1 time: 0.809839 Aug 09 17:12:21.127391 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 819/1550] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:20 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1210 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:21.136050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:21.150722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:21.177222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:21.192178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:21.195574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:21.196633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:21.199400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:21.202185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:21.674148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:21.712721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:21.719418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:21.726330 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3bf267a8-4f91-4545-9bde-80a30b3a6d7d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.593990 Aug 09 17:12:21.739305 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 820/1551] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:21 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:21.749234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d57bc5e-d98c-4985-8ae7-bacb9f6efef5 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Calling method '.version_select at 0x7fbbcbad38b0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:22.581359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG neutronclient.v2_0.client [None req-7d57bc5e-d98c-4985-8ae7-bacb9f6efef5 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119431) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:12:22.583367 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-7d57bc5e-d98c-4985-8ae7-bacb9f6efef5 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 09 17:12:22.583367 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-e17cf236-6842-4262-b474-3c93ee995391'] Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d57bc5e-d98c-4985-8ae7-bacb9f6efef5 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Request method failure captured: Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/os-security-groups/0c94d2fe-72b8-4aff-a845-69df6f49b021 HTTP/1.1 Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pVs6V8JplF3I3QjRf6dsNd499z85z_ZBtWUSqrZFuD5gx9Q7aWVEF7l-zSegZnsP0FTHc9T955Io3uQzmtF19jYFQ2_d7JHB_AaOX7Swpd9Cqug2xLSNXhM20gJ4_Kb5WV6HPELR54QYX2iWB50l1LR4yt2nDoed4AEwIdHJNZ91oM Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: d28d8250ec49450f9823f1dacb49a415 Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:12:22.587856 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: d28d8250ec49450f9823f1dacb49a415 Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupsNegativeTestJSON-1132628244-project Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 7b657487ab5d4f059bea15c0b1730dfb Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244-project Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: exception: Insufficient rights for removing default security group. Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-e17cf236-6842-4262-b474-3c93ee995391'] Aug 09 17:12:22.591017 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '0c94d2fe-72b8-4aff-a845-69df6f49b021'} Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:22.593119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e17cf236-6842-4262-b474-3c93ee995391'] Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 09 17:12:22.596114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e17cf236-6842-4262-b474-3c93ee995391'] Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e17cf236-6842-4262-b474-3c93ee995391'] Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:22.599562 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:22.602555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:22.602555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:12:22.602555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:12:22.602555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 09 17:12:22.602555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e17cf236-6842-4262-b474-3c93ee995391'] Aug 09 17:12:22.602555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:22.607667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d57bc5e-d98c-4985-8ae7-bacb9f6efef5 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 09 17:12:22.607667 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-e17cf236-6842-4262-b474-3c93ee995391'] {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:12:22.607667 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7d57bc5e-d98c-4985-8ae7-bacb9f6efef5 tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/0c94d2fe-72b8-4aff-a845-69df6f49b021" status: 400 len: 182 microversion: 2.1 time: 0.864956 Aug 09 17:12:22.607667 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 821/1552] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:12:21 2022] DELETE /compute/v2.1/os-security-groups/0c94d2fe-72b8-4aff-a845-69df6f49b021 => generated 182 bytes in 867 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:12:22.633348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:22.639666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:22.668145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:22.668693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:22.669167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:22.669946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:22.670447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:22.671700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:23.344204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:23.377336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:23.380949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:23.391702 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f939070d-5b47-4cc3-871f-c6b43d9bd2db tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 0.769614 Aug 09 17:12:23.393332 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 822/1553] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:22 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:23.402319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ada0b9d0-5ee0-4f07-a493-05846d779524 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb7b6d30>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:23.484925 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ada0b9d0-5ee0-4f07-a493-05846d779524 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.089502 Aug 09 17:12:23.485524 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 823/1554] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:23 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:23.493749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-81541f1a-eb3e-428f-b327-7a6c640e4ac8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:23.500170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-81541f1a-eb3e-428f-b327-7a6c640e4ac8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:23.517291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81541f1a-eb3e-428f-b327-7a6c640e4ac8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:23.518076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81541f1a-eb3e-428f-b327-7a6c640e4ac8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:23.518752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81541f1a-eb3e-428f-b327-7a6c640e4ac8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:23.519807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81541f1a-eb3e-428f-b327-7a6c640e4ac8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:23.520452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81541f1a-eb3e-428f-b327-7a6c640e4ac8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:23.521079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81541f1a-eb3e-428f-b327-7a6c640e4ac8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:23.926982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81541f1a-eb3e-428f-b327-7a6c640e4ac8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:23.940779 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-81541f1a-eb3e-428f-b327-7a6c640e4ac8 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1210 microversion: 2.1 time: 0.450808 Aug 09 17:12:23.963607 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 824/1555] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:23 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1210 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:23.970916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9aa25a08-3715-438d-8328-430c447d730a tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Calling method '.version_select at 0x7fbbcb968790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:23.998930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG neutronclient.v2_0.client [None req-9aa25a08-3715-438d-8328-430c447d730a tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 43a2256b-a904-46bd-a476-195dcaa5b3ee does not exist", "detail": ""}} {{(pid=119431) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:12:23.999659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.security_group_api [None req-9aa25a08-3715-438d-8328-430c447d730a tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Neutron security group 43a2256b-a904-46bd-a476-195dcaa5b3ee not found {{(pid=119431) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:12:24.000451 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-9aa25a08-3715-438d-8328-430c447d730a tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] HTTP exception thrown: Security group 43a2256b-a904-46bd-a476-195dcaa5b3ee does not exist Aug 09 17:12:24.000451 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-4e9e3cef-6b59-41a4-b909-d639fb200839'] Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9aa25a08-3715-438d-8328-430c447d730a tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Request method failure captured: Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-security-groups/43a2256b-a904-46bd-a476-195dcaa5b3ee HTTP/1.1 Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pVs6V8JplF3I3QjRf6dsNd499z85z_ZBtWUSqrZFuD5gx9Q7aWVEF7l-zSegZnsP0FTHc9T955Io3uQzmtF19jYFQ2_d7JHB_AaOX7Swpd9Cqug2xLSNXhM20gJ4_Kb5WV6HPELR54QYX2iWB50l1LR4yt2nDoed4AEwIdHJNZ91oM Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: d28d8250ec49450f9823f1dacb49a415 Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:12:24.002807 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: d28d8250ec49450f9823f1dacb49a415 Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupsNegativeTestJSON-1132628244-project Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 7b657487ab5d4f059bea15c0b1730dfb Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244-project Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: exception: Security group 43a2256b-a904-46bd-a476-195dcaa5b3ee does not exist Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-4e9e3cef-6b59-41a4-b909-d639fb200839'] Aug 09 17:12:24.005289 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '43a2256b-a904-46bd-a476-195dcaa5b3ee'} Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:24.006371 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 43a2256b-a904-46bd-a476-195dcaa5b3ee does not exist Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e9e3cef-6b59-41a4-b909-d639fb200839'] Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:12:24.007944 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 43a2256b-a904-46bd-a476-195dcaa5b3ee does not exist Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e9e3cef-6b59-41a4-b909-d639fb200839'] Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 43a2256b-a904-46bd-a476-195dcaa5b3ee does not exist Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e9e3cef-6b59-41a4-b909-d639fb200839'] Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.009613 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:24.013728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:24.013728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:24.013728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:12:24.013728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:12:24.013728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 43a2256b-a904-46bd-a476-195dcaa5b3ee does not exist Aug 09 17:12:24.013728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e9e3cef-6b59-41a4-b909-d639fb200839'] Aug 09 17:12:24.013728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.013728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9aa25a08-3715-438d-8328-430c447d730a tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Returning 404 to user: Security group 43a2256b-a904-46bd-a476-195dcaa5b3ee does not exist Aug 09 17:12:24.013728 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-4e9e3cef-6b59-41a4-b909-d639fb200839'] {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:12:24.013728 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9aa25a08-3715-438d-8328-430c447d730a tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/43a2256b-a904-46bd-a476-195dcaa5b3ee" status: 404 len: 194 microversion: 2.1 time: 0.040970 Aug 09 17:12:24.014596 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 825/1556] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:12:23 2022] GET /compute/v2.1/os-security-groups/43a2256b-a904-46bd-a476-195dcaa5b3ee => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:12:24.022788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:24.024001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:24.032822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:24.033499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:24.034053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:24.035411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:24.036167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:24.036828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:24.313844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:24.329259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:24.331644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:24.335658 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c21f659f-e714-40db-aa12-a7dd380ddd4b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1814 microversion: 2.25 time: 0.317243 Aug 09 17:12:24.337668 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 826/1557] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:24 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1814 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:24.345340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3a4df4e-9eed-49b5-aec2-b636819c873e tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Action: 'update', calling method: .version_select at 0x7fbbcbabddc0>, body: {"security_group": {"name": "tempest-sg-907491375", "description": "tempest-description-481151889"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:24.384524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG neutronclient.v2_0.client [None req-c3a4df4e-9eed-49b5-aec2-b636819c873e tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 79065921-e2ce-462e-a3e4-61daf6b35b72 does not exist", "detail": ""}} {{(pid=119431) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:12:24.385456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.security_group_api [None req-c3a4df4e-9eed-49b5-aec2-b636819c873e tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Neutron security group 79065921-e2ce-462e-a3e4-61daf6b35b72 not found {{(pid=119431) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:12:24.386181 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c3a4df4e-9eed-49b5-aec2-b636819c873e tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] HTTP exception thrown: Security group 79065921-e2ce-462e-a3e4-61daf6b35b72 does not exist Aug 09 17:12:24.386181 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-3b402892-4bbf-4329-bf2a-1a465199806f'] Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3a4df4e-9eed-49b5-aec2-b636819c873e tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Request method failure captured: Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: request: PUT /compute/v2.1/os-security-groups/79065921-e2ce-462e-a3e4-61daf6b35b72 HTTP/1.1 Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 100 Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pVs6V8JplF3I3QjRf6dsNd499z85z_ZBtWUSqrZFuD5gx9Q7aWVEF7l-zSegZnsP0FTHc9T955Io3uQzmtF19jYFQ2_d7JHB_AaOX7Swpd9Cqug2xLSNXhM20gJ4_Kb5WV6HPELR54QYX2iWB50l1LR4yt2nDoed4AEwIdHJNZ91oM Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: d28d8250ec49450f9823f1dacb49a415 Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:12:24.388609 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d28d8250ec49450f9823f1dacb49a415"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: d28d8250ec49450f9823f1dacb49a415 Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244 Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupsNegativeTestJSON-1132628244-project Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 7b657487ab5d4f059bea15c0b1730dfb Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1132628244-project Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: {"security_group": {"name": "tempest-sg-907491375", "description": "tempest-description-481151889"}} Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:12:24.390404 n-d-845781-6 devstack@n-api.service[119431]: exception: Security group 79065921-e2ce-462e-a3e4-61daf6b35b72 does not exist Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-3b402892-4bbf-4329-bf2a-1a465199806f'] Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '79065921-e2ce-462e-a3e4-61daf6b35b72', 'body': {'security_group': {'name': 'tempest-sg-907491375', 'description': 'tempest-description-481151889'}}} Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:12:24.391906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 79065921-e2ce-462e-a3e4-61daf6b35b72 does not exist Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b402892-4bbf-4329-bf2a-1a465199806f'] Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:12:24.393499 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 79065921-e2ce-462e-a3e4-61daf6b35b72 does not exist Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b402892-4bbf-4329-bf2a-1a465199806f'] Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 79065921-e2ce-462e-a3e4-61daf6b35b72 does not exist Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b402892-4bbf-4329-bf2a-1a465199806f'] Aug 09 17:12:24.395568 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.397298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:24.397298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.397298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:24.397298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:24.397298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:24.397298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:12:24.397298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:12:24.397298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 79065921-e2ce-462e-a3e4-61daf6b35b72 does not exist Aug 09 17:12:24.397298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b402892-4bbf-4329-bf2a-1a465199806f'] Aug 09 17:12:24.397298 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:24.399394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3a4df4e-9eed-49b5-aec2-b636819c873e tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] Returning 404 to user: Security group 79065921-e2ce-462e-a3e4-61daf6b35b72 does not exist Aug 09 17:12:24.399394 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-3b402892-4bbf-4329-bf2a-1a465199806f'] {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:12:24.400619 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c3a4df4e-9eed-49b5-aec2-b636819c873e tempest-SecurityGroupsNegativeTestJSON-1132628244 tempest-SecurityGroupsNegativeTestJSON-1132628244-project] 10.222.0.93 "PUT /compute/v2.1/os-security-groups/79065921-e2ce-462e-a3e4-61daf6b35b72" status: 404 len: 194 microversion: 2.1 time: 0.061696 Aug 09 17:12:24.401468 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 827/1558] 10.222.0.93 () {60 vars in 1290 bytes} [Tue Aug 9 17:12:24 2022] PUT /compute/v2.1/os-security-groups/79065921-e2ce-462e-a3e4-61daf6b35b72 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:12:24.431210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:24.432274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:24.455077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:24.460591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:24.461407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:24.463720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:24.465909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:24.471179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:25.137879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:25.141111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=95 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:12:25.160258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:25.162043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:25.170355 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-17821f6b-54a9-4f8a-aaa8-ae153f10282f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 0.746923 Aug 09 17:12:25.190663 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 828/1559] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:24 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:25.198669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5b4f53b3-c73d-4286-8451-9d66f1b1bd6a tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb9d65e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:25.314934 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5b4f53b3-c73d-4286-8451-9d66f1b1bd6a tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.122987 Aug 09 17:12:25.316576 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 829/1560] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:25 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:25.329653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a72222a0-d3f0-4c85-a552-9965669161d4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:25.333663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a72222a0-d3f0-4c85-a552-9965669161d4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:25.343574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:12:25.345991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a72222a0-d3f0-4c85-a552-9965669161d4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:25.347470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a72222a0-d3f0-4c85-a552-9965669161d4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:25.348247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a72222a0-d3f0-4c85-a552-9965669161d4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:25.349238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a72222a0-d3f0-4c85-a552-9965669161d4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:25.349981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a72222a0-d3f0-4c85-a552-9965669161d4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:25.350976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a72222a0-d3f0-4c85-a552-9965669161d4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:25.750322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a72222a0-d3f0-4c85-a552-9965669161d4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:25.830825 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a72222a0-d3f0-4c85-a552-9965669161d4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1210 microversion: 2.1 time: 0.507246 Aug 09 17:12:25.834267 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 830/1561] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:25 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1210 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:25.867675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:25.872221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:25.906592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:25.908181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:25.914747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:25.917013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:25.918705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:25.919909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:26.485834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:26.509025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:26.518466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:26.527665 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e4ad722b-52e8-4c04-a40e-4d89a7c7e199 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1804 microversion: 2.25 time: 0.687099 Aug 09 17:12:26.547092 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 831/1562] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:25 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1804 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:26.569980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:26.571982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:26.600918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:26.606778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:26.607538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:26.616059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:26.617594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:26.618310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:28.184192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:28.226809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:28.233840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:28.241776 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3a58988a-3563-44d1-8e60-f06e5ea7e592 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 1.691895 Aug 09 17:12:28.270088 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 832/1563] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:26 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:28.277657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-12442598-d5e8-4f26-948b-38c6bb9d0b53 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb9d6700>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:28.402810 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-12442598-d5e8-4f26-948b-38c6bb9d0b53 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.130841 Aug 09 17:12:28.407563 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 833/1564] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:28 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:28.422861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c0d207cb-8961-4775-91fd-88520fb19f77 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '.version_select at 0x7fbbcb8f00d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:28.453166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d207cb-8961-4775-91fd-88520fb19f77 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:28.456512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d207cb-8961-4775-91fd-88520fb19f77 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:28.458031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d207cb-8961-4775-91fd-88520fb19f77 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:28.497975 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c0d207cb-8961-4775-91fd-88520fb19f77 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 2537 microversion: 2.25 time: 0.086545 Aug 09 17:12:28.498968 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 834/1565] 10.222.0.93 () {60 vars in 1184 bytes} [Tue Aug 9 17:12:28 2022] GET /compute/v2.1/os-migrations => generated 2537 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:28.516096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d5b5c58e-f852-4a3a-9e37-c8ab611fddb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:28.516886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d5b5c58e-f852-4a3a-9e37-c8ab611fddb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:28.535006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b5c58e-f852-4a3a-9e37-c8ab611fddb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:28.535398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b5c58e-f852-4a3a-9e37-c8ab611fddb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:28.535914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b5c58e-f852-4a3a-9e37-c8ab611fddb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:28.536691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b5c58e-f852-4a3a-9e37-c8ab611fddb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:28.537141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b5c58e-f852-4a3a-9e37-c8ab611fddb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:28.537797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5b5c58e-f852-4a3a-9e37-c8ab611fddb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:28.657365 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d08a6c50-70bb-4cca-957d-75901d59eea0 tempest-SecurityGroupsTestAdminJSON-897327192 tempest-SecurityGroupsTestAdminJSON-897327192-project-admin] 10.222.0.93 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 14292 microversion: 2.1 time: 8.279169 Aug 09 17:12:28.658112 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 732/1566] 10.222.0.93 () {58 vars in 1191 bytes} [Tue Aug 9 17:12:20 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 14292 bytes in 8282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:12:28.664311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-54ec7d6b-fce1-4414-afde-ce4ace3e243e tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:28.670364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-54ec7d6b-fce1-4414-afde-ce4ace3e243e tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:28.685431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=7 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:12:28.692756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ec7d6b-fce1-4414-afde-ce4ace3e243e tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:28.693525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ec7d6b-fce1-4414-afde-ce4ace3e243e tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:28.694224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ec7d6b-fce1-4414-afde-ce4ace3e243e tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:28.695295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ec7d6b-fce1-4414-afde-ce4ace3e243e tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:28.702976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ec7d6b-fce1-4414-afde-ce4ace3e243e tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:28.703428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ec7d6b-fce1-4414-afde-ce4ace3e243e tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:28.904780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d5b5c58e-f852-4a3a-9e37-c8ab611fddb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:28.935055 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d5b5c58e-f852-4a3a-9e37-c8ab611fddb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1210 microversion: 2.1 time: 0.420489 Aug 09 17:12:28.936168 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 835/1567] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:28 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1210 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:28.960115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66e739f8-8d1a-48ff-be89-d45ac765ef99 tempest-SecurityGroupsTestAdminJSON-1506246785 tempest-SecurityGroupsTestAdminJSON-1506246785-project] Calling method '.version_select at 0x7fbbcbe035e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:29.036265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-54ec7d6b-fce1-4414-afde-ce4ace3e243e tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:12:29.054263 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-54ec7d6b-fce1-4414-afde-ce4ace3e243e tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 2423 microversion: 2.25 time: 0.394660 Aug 09 17:12:29.055137 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 733/1568] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:28 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 2423 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:29.109274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cf640eb0-c87f-4010-aa35-d727861ff761 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:29.110648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cf640eb0-c87f-4010-aa35-d727861ff761 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:29.128504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf640eb0-c87f-4010-aa35-d727861ff761 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:29.129872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf640eb0-c87f-4010-aa35-d727861ff761 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:29.130547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf640eb0-c87f-4010-aa35-d727861ff761 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:29.131548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf640eb0-c87f-4010-aa35-d727861ff761 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:29.132432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf640eb0-c87f-4010-aa35-d727861ff761 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:29.133241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf640eb0-c87f-4010-aa35-d727861ff761 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:29.520029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-cf640eb0-c87f-4010-aa35-d727861ff761 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:12:29.578975 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cf640eb0-c87f-4010-aa35-d727861ff761 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 2423 microversion: 2.25 time: 0.473913 Aug 09 17:12:29.590216 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 734/1569] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:29 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 2423 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:29.596196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:29.603373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:29.618254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:29.619372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:29.620125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:29.621688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:29.622194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:29.623122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:29.846546 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66e739f8-8d1a-48ff-be89-d45ac765ef99 tempest-SecurityGroupsTestAdminJSON-1506246785 tempest-SecurityGroupsTestAdminJSON-1506246785-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.897351 Aug 09 17:12:29.848878 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 836/1570] 10.222.0.93 () {58 vars in 1191 bytes} [Tue Aug 9 17:12:28 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:29.854392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-24beeabc-4b18-4fd6-a546-22f07ee2eaa9 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcbf59040>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:29.954720 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-24beeabc-4b18-4fd6-a546-22f07ee2eaa9 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.104315 Aug 09 17:12:29.955501 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 837/1571] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:29 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:29.974390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ee36e41-e13c-4f28-ac2e-9e4e9b77576f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:29.978333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ee36e41-e13c-4f28-ac2e-9e4e9b77576f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:29.993278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee36e41-e13c-4f28-ac2e-9e4e9b77576f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:29.994558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee36e41-e13c-4f28-ac2e-9e4e9b77576f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:29.995296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee36e41-e13c-4f28-ac2e-9e4e9b77576f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:30.001323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee36e41-e13c-4f28-ac2e-9e4e9b77576f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:30.002226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee36e41-e13c-4f28-ac2e-9e4e9b77576f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:30.002970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee36e41-e13c-4f28-ac2e-9e4e9b77576f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:30.133076 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ee36e41-e13c-4f28-ac2e-9e4e9b77576f tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.175080 Aug 09 17:12:30.134104 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 838/1572] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:12:29 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-volume_attachments => generated 25 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:12:30.158451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2490c1fe-fe2c-49fd-b1de-32a3cc75e33c tempest-SecurityGroupsTestAdminJSON-897327192 tempest-SecurityGroupsTestAdminJSON-897327192-project-admin] Calling method '.version_select at 0x7fbbcb840820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:30.309084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:30.324908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:30.327064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:30.329060 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c3eb1358-213b-4b66-a909-f8cf0b9c794f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 0.737226 Aug 09 17:12:30.329996 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 735/1573] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:29 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:30.336015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5451d35c-c083-4df1-b7aa-1f1c9c443ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:30.337157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5451d35c-c083-4df1-b7aa-1f1c9c443ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:30.345311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5451d35c-c083-4df1-b7aa-1f1c9c443ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:30.346221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5451d35c-c083-4df1-b7aa-1f1c9c443ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:30.347441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5451d35c-c083-4df1-b7aa-1f1c9c443ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:30.348863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5451d35c-c083-4df1-b7aa-1f1c9c443ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:30.349617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5451d35c-c083-4df1-b7aa-1f1c9c443ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:30.350334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5451d35c-c083-4df1-b7aa-1f1c9c443ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:30.647287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5451d35c-c083-4df1-b7aa-1f1c9c443ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:30.661887 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5451d35c-c083-4df1-b7aa-1f1c9c443ace tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1210 microversion: 2.1 time: 0.330003 Aug 09 17:12:30.692846 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 736/1574] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:30 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1210 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:30.709329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-664acc5a-d0aa-4f28-b5ea-82b1770d60a1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:30.710627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-664acc5a-d0aa-4f28-b5ea-82b1770d60a1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:30.723546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-664acc5a-d0aa-4f28-b5ea-82b1770d60a1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:30.724053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-664acc5a-d0aa-4f28-b5ea-82b1770d60a1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:30.724492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-664acc5a-d0aa-4f28-b5ea-82b1770d60a1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:30.725219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-664acc5a-d0aa-4f28-b5ea-82b1770d60a1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:30.730363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-664acc5a-d0aa-4f28-b5ea-82b1770d60a1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:30.730927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-664acc5a-d0aa-4f28-b5ea-82b1770d60a1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:30.773803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:12:30.884153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-664acc5a-d0aa-4f28-b5ea-82b1770d60a1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lazy-loading 'services' on Instance uuid 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:12:31.033351 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-664acc5a-d0aa-4f28-b5ea-82b1770d60a1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments/b8896e7c-ee31-4476-9f7c-96efa13090ac" status: 202 len: 0 microversion: 2.25 time: 0.337530 Aug 09 17:12:31.051905 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 737/1575] 10.222.0.93 () {60 vars in 1457 bytes} [Tue Aug 9 17:12:30 2022] DELETE /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments/b8896e7c-ee31-4476-9f7c-96efa13090ac => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:12:31.061804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d65c907f-5812-41d5-a07b-1637fcf3c3df tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:31.065239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d65c907f-5812-41d5-a07b-1637fcf3c3df tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:31.073571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65c907f-5812-41d5-a07b-1637fcf3c3df tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:31.074238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65c907f-5812-41d5-a07b-1637fcf3c3df tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:31.074957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65c907f-5812-41d5-a07b-1637fcf3c3df tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:31.075940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65c907f-5812-41d5-a07b-1637fcf3c3df tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:31.076642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65c907f-5812-41d5-a07b-1637fcf3c3df tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:31.077251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65c907f-5812-41d5-a07b-1637fcf3c3df tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:31.187603 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d65c907f-5812-41d5-a07b-1637fcf3c3df tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129189 Aug 09 17:12:31.193254 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2490c1fe-fe2c-49fd-b1de-32a3cc75e33c tempest-SecurityGroupsTestAdminJSON-897327192 tempest-SecurityGroupsTestAdminJSON-897327192-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/56dfac72-c936-49d0-91b6-695b467717fd" status: 202 len: 0 microversion: 2.1 time: 1.040607 Aug 09 17:12:31.195737 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 839/1576] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:12:30 2022] DELETE /compute/v2.1/os-security-groups/56dfac72-c936-49d0-91b6-695b467717fd => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:12:31.197949 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 738/1577] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:12:31 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:12:31.213145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a97cc68d-ec2a-449b-8f3c-08ae514bba70 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb9d60d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:31.217410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4f27e6b0-21fa-4124-810e-1dfcb08d733a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:31.219999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4f27e6b0-21fa-4124-810e-1dfcb08d733a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:31.297396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f27e6b0-21fa-4124-810e-1dfcb08d733a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:31.300368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f27e6b0-21fa-4124-810e-1dfcb08d733a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:31.304815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f27e6b0-21fa-4124-810e-1dfcb08d733a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:31.310506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f27e6b0-21fa-4124-810e-1dfcb08d733a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:31.311458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f27e6b0-21fa-4124-810e-1dfcb08d733a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:31.321374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f27e6b0-21fa-4124-810e-1dfcb08d733a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:31.361503 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a97cc68d-ec2a-449b-8f3c-08ae514bba70 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1421 microversion: 2.1 time: 0.163496 Aug 09 17:12:31.381351 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 840/1578] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:31 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1421 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:31.405638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-641e9575-d167-4827-9303-fe2b56a29fbf tempest-SecurityGroupsTestAdminJSON-897327192 tempest-SecurityGroupsTestAdminJSON-897327192-project-admin] Calling method '.version_select at 0x7fbbcb840430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:31.539684 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4f27e6b0-21fa-4124-810e-1dfcb08d733a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.337429 Aug 09 17:12:31.545800 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 739/1579] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:31 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 197 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:12:31.583213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:31.589714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:31.622186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:31.623027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:31.623731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:31.624669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:31.625327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:31.626031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:31.836888 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-641e9575-d167-4827-9303-fe2b56a29fbf tempest-SecurityGroupsTestAdminJSON-897327192 tempest-SecurityGroupsTestAdminJSON-897327192-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/7526d867-6a33-4d13-93e7-d51200ef493b" status: 202 len: 0 microversion: 2.1 time: 0.453660 Aug 09 17:12:31.838004 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 841/1580] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:12:31 2022] DELETE /compute/v2.1/os-security-groups/7526d867-6a33-4d13-93e7-d51200ef493b => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:12:31.843494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87a8ecde-a1c5-4c54-bf16-25bfb21ccb63 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:31.844354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87a8ecde-a1c5-4c54-bf16-25bfb21ccb63 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:31.853225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87a8ecde-a1c5-4c54-bf16-25bfb21ccb63 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:31.853942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87a8ecde-a1c5-4c54-bf16-25bfb21ccb63 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:31.854560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87a8ecde-a1c5-4c54-bf16-25bfb21ccb63 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:31.855793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87a8ecde-a1c5-4c54-bf16-25bfb21ccb63 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:31.856516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87a8ecde-a1c5-4c54-bf16-25bfb21ccb63 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:31.857172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87a8ecde-a1c5-4c54-bf16-25bfb21ccb63 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:31.933610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87a8ecde-a1c5-4c54-bf16-25bfb21ccb63 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:12:32.210814 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87a8ecde-a1c5-4c54-bf16-25bfb21ccb63 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 204 len: 0 microversion: 2.1 time: 0.370960 Aug 09 17:12:32.212928 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 842/1581] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:12:31 2022] DELETE /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:12:32.229667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-48e97f09-9e4d-41f2-97a2-dfa217f03c78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:32.231749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-48e97f09-9e4d-41f2-97a2-dfa217f03c78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:32.249420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48e97f09-9e4d-41f2-97a2-dfa217f03c78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:32.250496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48e97f09-9e4d-41f2-97a2-dfa217f03c78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:32.251417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48e97f09-9e4d-41f2-97a2-dfa217f03c78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:32.257792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48e97f09-9e4d-41f2-97a2-dfa217f03c78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:32.258802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48e97f09-9e4d-41f2-97a2-dfa217f03c78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:32.261242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48e97f09-9e4d-41f2-97a2-dfa217f03c78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:32.713548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-48e97f09-9e4d-41f2-97a2-dfa217f03c78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:32.728749 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-48e97f09-9e4d-41f2-97a2-dfa217f03c78 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1210 microversion: 2.1 time: 0.510335 Aug 09 17:12:32.730773 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 843/1582] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:32 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1210 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:32.737092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0c494b43-6d16-4f1f-aa1a-3e514b98e817 tempest-SecurityGroupsTestAdminJSON-1506246785 tempest-SecurityGroupsTestAdminJSON-1506246785-project] Calling method '.version_select at 0x7fbbd816b820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:33.012621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:33.029243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:33.037206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:33.038507 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-39340f61-5be7-4052-8c30-24678db66df5 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 1.487512 Aug 09 17:12:33.052366 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 740/1583] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:31 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:33.060394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3219920c-44cf-4885-9c1b-13c9b2640d43 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:33.060394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3219920c-44cf-4885-9c1b-13c9b2640d43 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:33.074889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3219920c-44cf-4885-9c1b-13c9b2640d43 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:33.074889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3219920c-44cf-4885-9c1b-13c9b2640d43 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:33.075324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3219920c-44cf-4885-9c1b-13c9b2640d43 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:33.080755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3219920c-44cf-4885-9c1b-13c9b2640d43 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:33.083405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3219920c-44cf-4885-9c1b-13c9b2640d43 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:33.084415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3219920c-44cf-4885-9c1b-13c9b2640d43 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:33.141815 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0c494b43-6d16-4f1f-aa1a-3e514b98e817 tempest-SecurityGroupsTestAdminJSON-1506246785 tempest-SecurityGroupsTestAdminJSON-1506246785-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/bc7b4d4d-12e6-462b-ac75-05fd15fef2e9" status: 202 len: 0 microversion: 2.1 time: 0.409162 Aug 09 17:12:33.142728 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 844/1584] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:12:32 2022] DELETE /compute/v2.1/os-security-groups/bc7b4d4d-12e6-462b-ac75-05fd15fef2e9 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:12:33.148407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec3d78a7-0a61-429f-b18e-93dc6c32c126 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcbabdc10>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:33.229343 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ec3d78a7-0a61-429f-b18e-93dc6c32c126 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1430 microversion: 2.1 time: 0.085066 Aug 09 17:12:33.240695 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 845/1585] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:33 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1430 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:33.246591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3df6ba3-88b5-4d09-abab-53ca86279999 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:33.249516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3df6ba3-88b5-4d09-abab-53ca86279999 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:33.257120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3df6ba3-88b5-4d09-abab-53ca86279999 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:33.258048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3df6ba3-88b5-4d09-abab-53ca86279999 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:33.258740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3df6ba3-88b5-4d09-abab-53ca86279999 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:33.259815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3df6ba3-88b5-4d09-abab-53ca86279999 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:33.260537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3df6ba3-88b5-4d09-abab-53ca86279999 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:33.261516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3df6ba3-88b5-4d09-abab-53ca86279999 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:33.319491 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3df6ba3-88b5-4d09-abab-53ca86279999 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.077212 Aug 09 17:12:33.320588 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 846/1586] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:33 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:12:33.328813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-106b9ba4-6c18-4639-8827-f0d4ca554602 tempest-SecurityGroupsTestAdminJSON-1506246785 tempest-SecurityGroupsTestAdminJSON-1506246785-project] Calling method '.version_select at 0x7fbbcb8409d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:33.618512 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-106b9ba4-6c18-4639-8827-f0d4ca554602 tempest-SecurityGroupsTestAdminJSON-1506246785 tempest-SecurityGroupsTestAdminJSON-1506246785-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/7d36e6ae-2adf-428e-9384-bd0b7a446f39" status: 202 len: 0 microversion: 2.1 time: 0.296541 Aug 09 17:12:33.619701 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 847/1587] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:12:33 2022] DELETE /compute/v2.1/os-security-groups/7d36e6ae-2adf-428e-9384-bd0b7a446f39 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:12:33.625032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1a68eaa3-872c-46ae-90a5-d995fb2765ba tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb840940>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:33.734627 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1a68eaa3-872c-46ae-90a5-d995fb2765ba tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 200 len: 1430 microversion: 2.1 time: 0.111793 Aug 09 17:12:33.748453 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 848/1588] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:33 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 1430 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:33.804106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8f61f18c-a52a-4641-8d6c-8bfc259771ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:33.809686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8f61f18c-a52a-4641-8d6c-8bfc259771ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:33.829329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f61f18c-a52a-4641-8d6c-8bfc259771ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:33.830358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f61f18c-a52a-4641-8d6c-8bfc259771ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:33.831230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f61f18c-a52a-4641-8d6c-8bfc259771ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:33.835304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f61f18c-a52a-4641-8d6c-8bfc259771ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:33.838208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f61f18c-a52a-4641-8d6c-8bfc259771ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:33.839766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f61f18c-a52a-4641-8d6c-8bfc259771ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:33.863053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3219920c-44cf-4885-9c1b-13c9b2640d43 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:33.877801 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3219920c-44cf-4885-9c1b-13c9b2640d43 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1684 microversion: 2.1 time: 0.832571 Aug 09 17:12:33.899118 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 741/1589] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:33 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1684 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:33.920546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87996a4a-1851-42ce-bbfb-3c0626bfeca2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:33.923038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-87996a4a-1851-42ce-bbfb-3c0626bfeca2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:33.954637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87996a4a-1851-42ce-bbfb-3c0626bfeca2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:33.957483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87996a4a-1851-42ce-bbfb-3c0626bfeca2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:33.958027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87996a4a-1851-42ce-bbfb-3c0626bfeca2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:33.958796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87996a4a-1851-42ce-bbfb-3c0626bfeca2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:33.964674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87996a4a-1851-42ce-bbfb-3c0626bfeca2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:33.966002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87996a4a-1851-42ce-bbfb-3c0626bfeca2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:34.347964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-87996a4a-1851-42ce-bbfb-3c0626bfeca2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:34.363917 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-87996a4a-1851-42ce-bbfb-3c0626bfeca2 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1478 microversion: 2.1 time: 0.458679 Aug 09 17:12:34.367541 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 742/1590] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:33 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1478 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:34.380701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:34.382318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:34.404066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:34.412644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:34.415692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:34.415692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:34.415692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:34.415692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:34.419804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8f61f18c-a52a-4641-8d6c-8bfc259771ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:34.428529 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8f61f18c-a52a-4641-8d6c-8bfc259771ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1210 microversion: 2.1 time: 0.668686 Aug 09 17:12:34.451519 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 849/1591] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:33 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1210 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:34.465780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-211d835f-c312-49a8-a4b4-758f2074e594 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:34.473041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-211d835f-c312-49a8-a4b4-758f2074e594 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:34.495676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-211d835f-c312-49a8-a4b4-758f2074e594 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:34.496184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-211d835f-c312-49a8-a4b4-758f2074e594 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:34.499436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-211d835f-c312-49a8-a4b4-758f2074e594 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:34.500384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-211d835f-c312-49a8-a4b4-758f2074e594 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:34.502149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-211d835f-c312-49a8-a4b4-758f2074e594 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:34.502607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-211d835f-c312-49a8-a4b4-758f2074e594 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:34.596764 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-211d835f-c312-49a8-a4b4-758f2074e594 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.137541 Aug 09 17:12:34.598747 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 850/1592] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:34 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:12:34.908273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c84661dd-462f-4d2e-88cf-f28372fbb266 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:34.908835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c84661dd-462f-4d2e-88cf-f28372fbb266 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:34.930492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84661dd-462f-4d2e-88cf-f28372fbb266 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:34.931178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84661dd-462f-4d2e-88cf-f28372fbb266 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:34.931664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84661dd-462f-4d2e-88cf-f28372fbb266 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:34.934831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84661dd-462f-4d2e-88cf-f28372fbb266 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:34.936111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84661dd-462f-4d2e-88cf-f28372fbb266 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:34.936631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84661dd-462f-4d2e-88cf-f28372fbb266 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:35.340579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:35.361219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:35.368322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:35.370016 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bfc14aad-2ebf-4f00-9732-5318af1ffaf4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 1.000705 Aug 09 17:12:35.380126 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 743/1593] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:34 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:35.392769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-19f30796-5fb6-4155-901b-7d9fc27b67ab tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:35.393858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-19f30796-5fb6-4155-901b-7d9fc27b67ab tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:35.403992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19f30796-5fb6-4155-901b-7d9fc27b67ab tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:35.404949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19f30796-5fb6-4155-901b-7d9fc27b67ab tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:35.405680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19f30796-5fb6-4155-901b-7d9fc27b67ab tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:35.406853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19f30796-5fb6-4155-901b-7d9fc27b67ab tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:35.407590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19f30796-5fb6-4155-901b-7d9fc27b67ab tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:35.408218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19f30796-5fb6-4155-901b-7d9fc27b67ab tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:35.693487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c84661dd-462f-4d2e-88cf-f28372fbb266 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:35.727749 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c84661dd-462f-4d2e-88cf-f28372fbb266 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1684 microversion: 2.1 time: 0.825487 Aug 09 17:12:35.728795 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 851/1594] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:34 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1684 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:12:35.756080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-242afd91-86cb-43c3-b3ed-31bc0a237673 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:35.757412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-242afd91-86cb-43c3-b3ed-31bc0a237673 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:35.812248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-242afd91-86cb-43c3-b3ed-31bc0a237673 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:35.813565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-242afd91-86cb-43c3-b3ed-31bc0a237673 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:35.820925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-242afd91-86cb-43c3-b3ed-31bc0a237673 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:35.829581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-242afd91-86cb-43c3-b3ed-31bc0a237673 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:35.831001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-242afd91-86cb-43c3-b3ed-31bc0a237673 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:35.832605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-242afd91-86cb-43c3-b3ed-31bc0a237673 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:36.266770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-242afd91-86cb-43c3-b3ed-31bc0a237673 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:36.287303 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-242afd91-86cb-43c3-b3ed-31bc0a237673 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 0.551972 Aug 09 17:12:36.288793 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 852/1595] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:35 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:36.294198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-46e10348-6991-4135-a19d-44ccc876e8a7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:36.301998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-46e10348-6991-4135-a19d-44ccc876e8a7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:36.320843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e10348-6991-4135-a19d-44ccc876e8a7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:36.321241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e10348-6991-4135-a19d-44ccc876e8a7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:36.321694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e10348-6991-4135-a19d-44ccc876e8a7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:36.322440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e10348-6991-4135-a19d-44ccc876e8a7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:36.322908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e10348-6991-4135-a19d-44ccc876e8a7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:36.323342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e10348-6991-4135-a19d-44ccc876e8a7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:36.427087 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-46e10348-6991-4135-a19d-44ccc876e8a7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131138 Aug 09 17:12:36.429615 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 853/1596] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:36 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:12:36.440075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-355699a9-01e9-49d7-bc83-38be6da2acb0 req-50c71acc-3050-442f-828e-a93d98a1188e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f377368-7c9c-48cb-80c1-c2253e0f5105", "name": "network-vif-deleted", "tag": "4fecb257-a514-4d5d-8975-355ca5c6fce6"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:36.457820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-355699a9-01e9-49d7-bc83-38be6da2acb0 req-50c71acc-3050-442f-828e-a93d98a1188e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:36.459727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-355699a9-01e9-49d7-bc83-38be6da2acb0 req-50c71acc-3050-442f-828e-a93d98a1188e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:36.460553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-355699a9-01e9-49d7-bc83-38be6da2acb0 req-50c71acc-3050-442f-828e-a93d98a1188e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:36.488364 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-355699a9-01e9-49d7-bc83-38be6da2acb0 req-50c71acc-3050-442f-828e-a93d98a1188e service nova] Creating event network-vif-deleted:4fecb257-a514-4d5d-8975-355ca5c6fce6 for instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 on n-h1-845781-6 Aug 09 17:12:36.500836 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-355699a9-01e9-49d7-bc83-38be6da2acb0 req-50c71acc-3050-442f-828e-a93d98a1188e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067699 Aug 09 17:12:36.510440 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 854/1597] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:36.528296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:36.530507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:36.545856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:36.547923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:36.549141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:36.551012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:36.552546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:36.553711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:36.616354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-19f30796-5fb6-4155-901b-7d9fc27b67ab tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:36.652018 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-19f30796-5fb6-4155-901b-7d9fc27b67ab tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1465 microversion: 2.1 time: 1.264109 Aug 09 17:12:36.667682 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 744/1598] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:35 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1465 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:36.706891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-837dddd6-e459-42b1-b224-d7a83c93d41d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb4360d0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:36.819223 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-837dddd6-e459-42b1-b224-d7a83c93d41d tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/f484be58-00e8-4507-b378-ca7d3c0dd32d" status: 200 len: 784 microversion: 2.1 time: 0.120553 Aug 09 17:12:36.821359 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 745/1599] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:36 2022] GET /compute/v2.1/images/f484be58-00e8-4507-b378-ca7d3c0dd32d => generated 784 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:36.833743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:36.837632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:36.857723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:36.860971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:36.862459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:36.865125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:36.865982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:36.868253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:36.966765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:36.973392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:36.975423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:36.976172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lazy-loading 'fault' on Instance uuid 2f377368-7c9c-48cb-80c1-c2253e0f5105 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:12:37.034256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:37.052390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:37.061552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:37.063247 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f81322f6-8ff8-49bf-8a24-8f2f23c49808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 0.548248 Aug 09 17:12:37.064155 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 855/1600] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:36 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:37.070918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a99c2f56-233a-448c-b1fd-97e2ab4cc4a0 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:37.094413 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a99c2f56-233a-448c-b1fd-97e2ab4cc4a0 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029104 Aug 09 17:12:37.095729 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 856/1601] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:12:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:37.107979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d9829c9-8b0d-4189-b5da-72e93664df95 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb746dc0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:37.453686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8721b8f0cd0a46f489ab540cd8db9357', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4177dbe7e94a8e8381561de0e40575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:37.467205 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f7bfa121-c52d-4f2f-be1e-efc67fb989ce tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 200 len: 1332 microversion: 2.1 time: 0.643832 Aug 09 17:12:37.469631 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 746/1602] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:36 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 1332 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:37.495266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8668b9d4-7d6d-4299-b433-20c28da0a777 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:37.507963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8668b9d4-7d6d-4299-b433-20c28da0a777 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:37.534150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8668b9d4-7d6d-4299-b433-20c28da0a777 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:37.535115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8668b9d4-7d6d-4299-b433-20c28da0a777 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:37.535865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8668b9d4-7d6d-4299-b433-20c28da0a777 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:37.536946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8668b9d4-7d6d-4299-b433-20c28da0a777 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:37.542756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8668b9d4-7d6d-4299-b433-20c28da0a777 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:37.544620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8668b9d4-7d6d-4299-b433-20c28da0a777 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:38.122025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8668b9d4-7d6d-4299-b433-20c28da0a777 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:38.141163 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8668b9d4-7d6d-4299-b433-20c28da0a777 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 0.668385 Aug 09 17:12:38.141506 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 747/1603] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:37 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:38.152181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-430422d7-b9bf-4bd9-9cfe-72cd853c6583 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:38.152181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-430422d7-b9bf-4bd9-9cfe-72cd853c6583 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:38.184945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-430422d7-b9bf-4bd9-9cfe-72cd853c6583 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:38.185633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-430422d7-b9bf-4bd9-9cfe-72cd853c6583 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:38.186782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-430422d7-b9bf-4bd9-9cfe-72cd853c6583 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:38.198652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-430422d7-b9bf-4bd9-9cfe-72cd853c6583 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:38.203498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-430422d7-b9bf-4bd9-9cfe-72cd853c6583 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:38.212005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-430422d7-b9bf-4bd9-9cfe-72cd853c6583 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:38.366621 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-430422d7-b9bf-4bd9-9cfe-72cd853c6583 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.223811 Aug 09 17:12:38.367224 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 748/1604] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:38 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:12:38.385175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:38.398559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:38.433975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:38.434487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:38.435602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:38.439571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:38.440289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:38.440818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:38.887268 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5d9829c9-8b0d-4189-b5da-72e93664df95 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "DELETE /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 204 len: 0 microversion: 2.1 time: 1.783365 Aug 09 17:12:38.889827 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 857/1605] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:37 2022] DELETE /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 0 bytes in 1786 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:12:38.899656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:38.903644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:38.937794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:38.941905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:38.943113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:38.947341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:38.947993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:38.948539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:38.952446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:12:38.997217 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] HTTP exception thrown: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Request method failure captured: Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 HTTP/1.1 Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pSBIOvxEnbLUF3A463zf920ozI7ZEV6TE96D4Drymrocw32HyrMLGKx-zIFZA4AJa-KcsI_dWyhOU9WMkyhkKUHj5ZlCZpb7qibSTSac6qYb6bIgw9cbIDJTqHCnZ7d3x2m-TRs_K9Ej2ctrjbv2OFCrgkBQ6Y47JEqiGKUKuoSeJE Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: cb4177dbe7e94a8e8381561de0e40575 Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1598089833 Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:12:39.013574 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1598089833 Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: cb4177dbe7e94a8e8381561de0e40575 Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1598089833 Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachSCSIVolumeTestJSON-1598089833-project Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 8721b8f0cd0a46f489ab540cd8db9357 Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1598089833-project Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:12:39.016437 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '2f377368-7c9c-48cb-80c1-c2253e0f5105'} Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:12:39.020229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:12:39.026199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.033187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Returning 404 to user: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:12:39.033187 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bc32049f-5a04-4960-a968-30dcc5e16abc tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 404 len: 111 microversion: 2.1 time: 0.125298 Aug 09 17:12:39.033187 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 858/1606] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:38 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:12:39.037315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d5626db-cf80-4e8b-91f5-fc5f378240a9 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcbeb6670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:39.107940 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0d5626db-cf80-4e8b-91f5-fc5f378240a9 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] HTTP exception thrown: Image not found. Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d5626db-cf80-4e8b-91f5-fc5f378240a9 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Request method failure captured: Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 HTTP/1.1 Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pUw7j32cQ2Szs9Z5td_r0YWSHPtBk67kk09km8vQSiVojXb9kGi7TGePU1lVKRqKmW0mmN3PyRmT3w0nnEvUgLj7s88nepkkuEKg_47o6lVQ-2ZYgyrI1DlZd--APWyvi8vTaKJigzU4dRrrh7YQu7smasSIok5afbQx-VVphq0MCc Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 58824a6471f34f1c9c371381b8140158 Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesOneServerTestJSON-799240187 Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:12:39.112289 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_58824a6471f34f1c9c371381b8140158"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/58824a6471f34f1c9c371381b8140158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/58824a6471f34f1c9c371381b8140158"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/58824a6471f34f1c9c371381b8140158"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesOneServerTestJSON-799240187 Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 58824a6471f34f1c9c371381b8140158 Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-799240187 Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesOneServerTestJSON-799240187-project Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6251fca3070f46e88dea986cf6db9f07 Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesOneServerTestJSON-799240187-project Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '993df035-36b2-4750-b6f5-f9717e948f17'} Aug 09 17:12:39.115789 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:12:39.118359 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 993df035-36b2-4750-b6f5-f9717e948f17 Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:12:39.121875 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 993df035-36b2-4750-b6f5-f9717e948f17 could not be found. Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:12:39.124957 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d5626db-cf80-4e8b-91f5-fc5f378240a9 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:12:39.126386 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0d5626db-cf80-4e8b-91f5-fc5f378240a9 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 404 len: 62 microversion: 2.1 time: 0.088609 Aug 09 17:12:39.131058 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 859/1607] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:39 2022] GET /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:12:39.151298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3275631c-4293-443e-af42-a64e2e826021 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '.version_select at 0x7fbbcbad3d30>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:39.213955 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3275631c-4293-443e-af42-a64e2e826021 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016277638" status: 202 len: 0 microversion: 2.1 time: 0.081260 Aug 09 17:12:39.215326 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 860/1608] 10.222.0.93 () {58 vars in 1221 bytes} [Tue Aug 9 17:12:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016277638 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:12:39.224450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aacff846-07fa-4429-89f6-75475891cf2f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1352894355"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:39.237105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aacff846-07fa-4429-89f6-75475891cf2f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:39.252345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aacff846-07fa-4429-89f6-75475891cf2f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:39.256472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aacff846-07fa-4429-89f6-75475891cf2f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:39.257324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aacff846-07fa-4429-89f6-75475891cf2f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:39.258362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aacff846-07fa-4429-89f6-75475891cf2f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:39.260666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aacff846-07fa-4429-89f6-75475891cf2f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:39.264354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aacff846-07fa-4429-89f6-75475891cf2f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:39.529821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:39.565277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:39.569558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:39.573865 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3bd2bf7d-7b00-499f-97c5-700a9f9bc1f6 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 1.199801 Aug 09 17:12:39.589533 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 749/1609] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:38 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:39.620239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6157b390-3321-4dab-866c-759a96bfa449 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:39.621829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6157b390-3321-4dab-866c-759a96bfa449 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:39.653332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6157b390-3321-4dab-866c-759a96bfa449 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:39.654091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6157b390-3321-4dab-866c-759a96bfa449 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:39.654839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6157b390-3321-4dab-866c-759a96bfa449 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:39.659344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6157b390-3321-4dab-866c-759a96bfa449 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:39.660295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6157b390-3321-4dab-866c-759a96bfa449 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:39.670596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6157b390-3321-4dab-866c-759a96bfa449 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:40.053752 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aacff846-07fa-4429-89f6-75475891cf2f tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "POST /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8/action" status: 202 len: 0 microversion: 2.1 time: 0.815372 Aug 09 17:12:40.067567 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 861/1610] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:12:39 2022] POST /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8/action => generated 0 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 17:12:40.126358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-48bd5f5f-62df-43d7-b114-baabc353f984 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:40.142583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-48bd5f5f-62df-43d7-b114-baabc353f984 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:40.189913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48bd5f5f-62df-43d7-b114-baabc353f984 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:40.193756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48bd5f5f-62df-43d7-b114-baabc353f984 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:40.200238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48bd5f5f-62df-43d7-b114-baabc353f984 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:40.216447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48bd5f5f-62df-43d7-b114-baabc353f984 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:40.235910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48bd5f5f-62df-43d7-b114-baabc353f984 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:40.238266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48bd5f5f-62df-43d7-b114-baabc353f984 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:40.434180 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-48bd5f5f-62df-43d7-b114-baabc353f984 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.356756 Aug 09 17:12:40.441572 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 862/1611] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:40 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 197 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:12:40.467539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-18789664-c69a-434e-a4e8-475c01d7fd05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbd815fc10>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:40.695193 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-18789664-c69a-434e-a4e8-475c01d7fd05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87" status: 200 len: 1427 microversion: 2.1 time: 0.253174 Aug 09 17:12:40.697257 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 863/1612] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:40 2022] GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87 => generated 1427 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:40.722428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:40.723958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:40.741658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:40.742900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:40.749933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:40.751960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:40.753563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:40.759591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:40.773983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6157b390-3321-4dab-866c-759a96bfa449 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:40.786945 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6157b390-3321-4dab-866c-759a96bfa449 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 1.195771 Aug 09 17:12:40.790550 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 750/1613] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:39 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:41.220297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-8d73b642-8f1f-42ee-b6d4-e098cffc1da4 req-9476e9b3-54f4-4fc5-86de-31232079c902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef8234b-af34-48f6-b84a-e4800e432eb8", "name": "network-vif-unplugged", "status": "completed", "tag": "b426bae7-bfa2-43b9-8167-bbe3433a1e83"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:41.242786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8d73b642-8f1f-42ee-b6d4-e098cffc1da4 req-9476e9b3-54f4-4fc5-86de-31232079c902 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:41.242786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8d73b642-8f1f-42ee-b6d4-e098cffc1da4 req-9476e9b3-54f4-4fc5-86de-31232079c902 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:41.242786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8d73b642-8f1f-42ee-b6d4-e098cffc1da4 req-9476e9b3-54f4-4fc5-86de-31232079c902 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:41.272140 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-8d73b642-8f1f-42ee-b6d4-e098cffc1da4 req-9476e9b3-54f4-4fc5-86de-31232079c902 service nova] Creating event network-vif-unplugged:b426bae7-bfa2-43b9-8167-bbe3433a1e83 for instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 on n-h1-845781-6 Aug 09 17:12:41.280782 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-8d73b642-8f1f-42ee-b6d4-e098cffc1da4 req-9476e9b3-54f4-4fc5-86de-31232079c902 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066256 Aug 09 17:12:41.281711 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 751/1614] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:12:41.410381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:41.429732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:41.431523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:41.437349 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9596093b-4820-4ea9-8709-9868b1b9d970 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 0.736832 Aug 09 17:12:41.438878 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 864/1615] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:40 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:41.473926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa0fdd09-d2a5-4b54-a315-30e7c66cfc40 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:41.496110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fa0fdd09-d2a5-4b54-a315-30e7c66cfc40 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:41.540981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0fdd09-d2a5-4b54-a315-30e7c66cfc40 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:41.543038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0fdd09-d2a5-4b54-a315-30e7c66cfc40 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:41.547425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0fdd09-d2a5-4b54-a315-30e7c66cfc40 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:41.554760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0fdd09-d2a5-4b54-a315-30e7c66cfc40 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:41.559870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0fdd09-d2a5-4b54-a315-30e7c66cfc40 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:41.563664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa0fdd09-d2a5-4b54-a315-30e7c66cfc40 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:41.653166 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fa0fdd09-d2a5-4b54-a315-30e7c66cfc40 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.198403 Aug 09 17:12:41.656651 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 752/1616] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:41 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:12:41.720298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44e7898a-dfdb-4382-b5a4-f866264a4c22 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcbad3670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:41.806783 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-44e7898a-dfdb-4382-b5a4-f866264a4c22 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87" status: 200 len: 1427 microversion: 2.1 time: 0.093232 Aug 09 17:12:41.809421 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 865/1617] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:41 2022] GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87 => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:41.825830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9e5fec8f-bef4-419c-aeb9-7ca933f3b60b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:41.832254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9e5fec8f-bef4-419c-aeb9-7ca933f3b60b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:41.852735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e5fec8f-bef4-419c-aeb9-7ca933f3b60b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:41.853269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e5fec8f-bef4-419c-aeb9-7ca933f3b60b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:41.853691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e5fec8f-bef4-419c-aeb9-7ca933f3b60b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:41.854440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e5fec8f-bef4-419c-aeb9-7ca933f3b60b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:41.868502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e5fec8f-bef4-419c-aeb9-7ca933f3b60b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:41.871298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e5fec8f-bef4-419c-aeb9-7ca933f3b60b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:42.496013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:42.509170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:42.516967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9e5fec8f-bef4-419c-aeb9-7ca933f3b60b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:42.573335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:42.576006 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9e5fec8f-bef4-419c-aeb9-7ca933f3b60b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 0.753770 Aug 09 17:12:42.576571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:42.583856 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 753/1618] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:41 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:42.597721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:42.599254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:42.614960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:42.615498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:42.676565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-32ed1395-fd5b-44b8-a517-ab0cd40b583f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:42.688754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-32ed1395-fd5b-44b8-a517-ab0cd40b583f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:42.725918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32ed1395-fd5b-44b8-a517-ab0cd40b583f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:42.734017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32ed1395-fd5b-44b8-a517-ab0cd40b583f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:42.735450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32ed1395-fd5b-44b8-a517-ab0cd40b583f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:42.741147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32ed1395-fd5b-44b8-a517-ab0cd40b583f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:42.747129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32ed1395-fd5b-44b8-a517-ab0cd40b583f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:42.748512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32ed1395-fd5b-44b8-a517-ab0cd40b583f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:42.921332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:12:42.964604 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-32ed1395-fd5b-44b8-a517-ab0cd40b583f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.290518 Aug 09 17:12:42.964604 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 754/1619] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:42 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 197 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:12:42.978171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-11d65811-78fb-408c-98c5-e12f17684052 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb4365e0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:43.207306 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-11d65811-78fb-408c-98c5-e12f17684052 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87" status: 200 len: 1427 microversion: 2.1 time: 0.237415 Aug 09 17:12:43.208489 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 755/1620] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:42 2022] GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87 => generated 1427 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:43.630210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b5a80d99-9267-41af-aec8-a8cfa195fa8b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:43.636055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b5a80d99-9267-41af-aec8-a8cfa195fa8b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:43.673760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5a80d99-9267-41af-aec8-a8cfa195fa8b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:43.679614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5a80d99-9267-41af-aec8-a8cfa195fa8b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:43.680914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5a80d99-9267-41af-aec8-a8cfa195fa8b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:43.687152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5a80d99-9267-41af-aec8-a8cfa195fa8b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:43.693143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5a80d99-9267-41af-aec8-a8cfa195fa8b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:43.695556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5a80d99-9267-41af-aec8-a8cfa195fa8b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:43.877897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:43.952572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:43.966033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:43.973239 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-589c57b2-1dee-45d0-8b49-692e32cb317c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 1.485895 Aug 09 17:12:43.991461 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 866/1621] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:42 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:44.014016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e79e6932-db7b-40dd-94b3-117ca31e7fdc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:44.024834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e79e6932-db7b-40dd-94b3-117ca31e7fdc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:44.061905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e79e6932-db7b-40dd-94b3-117ca31e7fdc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:44.062430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e79e6932-db7b-40dd-94b3-117ca31e7fdc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:44.062958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e79e6932-db7b-40dd-94b3-117ca31e7fdc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:44.063793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e79e6932-db7b-40dd-94b3-117ca31e7fdc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:44.083969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e79e6932-db7b-40dd-94b3-117ca31e7fdc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:44.084472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e79e6932-db7b-40dd-94b3-117ca31e7fdc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:44.220555 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e79e6932-db7b-40dd-94b3-117ca31e7fdc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.223709 Aug 09 17:12:44.230415 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 867/1622] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:43 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:12:44.851977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-218e1153-a069-48f4-a028-f662237067ee tempest-QuotasTestJSON-1986918504 tempest-QuotasTestJSON-1986918504-project] Calling method '.version_select at 0x7fbbcb8f0790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:45.050703 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-218e1153-a069-48f4-a028-f662237067ee tempest-QuotasTestJSON-1986918504 tempest-QuotasTestJSON-1986918504-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/8831a5c5678a4754b757fa130ebc299a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.811716 Aug 09 17:12:45.059256 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 868/1623] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:12:44 2022] GET /compute/v2.1/os-quota-sets/8831a5c5678a4754b757fa130ebc299a/defaults => generated 371 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:45.082411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e3d67cf-4322-488b-8a60-d756798fe014 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb961160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:45.102459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b5a80d99-9267-41af-aec8-a8cfa195fa8b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:45.166289 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b5a80d99-9267-41af-aec8-a8cfa195fa8b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 1.545882 Aug 09 17:12:45.176572 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 756/1624] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:43 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:12:45.184716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:45.185357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:45.226397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:45.226915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:45.237640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:45.238472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:45.238980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:45.239432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:45.264042 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e3d67cf-4322-488b-8a60-d756798fe014 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87" status: 200 len: 1427 microversion: 2.1 time: 0.195392 Aug 09 17:12:45.265598 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 869/1625] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:45 2022] GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87 => generated 1427 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:45.280992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69feb55c-74f6-4f63-946c-ea1db784a52e tempest-QuotasTestJSON-1986918504 tempest-QuotasTestJSON-1986918504-project] Calling method '.version_select at 0x7fbbcb8f05e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:45.499535 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69feb55c-74f6-4f63-946c-ea1db784a52e tempest-QuotasTestJSON-1986918504 tempest-QuotasTestJSON-1986918504-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/8831a5c5678a4754b757fa130ebc299a" status: 200 len: 371 microversion: 2.1 time: 0.232726 Aug 09 17:12:45.502404 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 870/1626] 10.222.0.93 () {58 vars in 1242 bytes} [Tue Aug 9 17:12:45 2022] GET /compute/v2.1/os-quota-sets/8831a5c5678a4754b757fa130ebc299a => generated 371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:45.524607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-772976c3-e3de-4eb6-a60f-a07216fef4c4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:45.534127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-772976c3-e3de-4eb6-a60f-a07216fef4c4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:45.550432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772976c3-e3de-4eb6-a60f-a07216fef4c4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:45.554070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772976c3-e3de-4eb6-a60f-a07216fef4c4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:45.558236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772976c3-e3de-4eb6-a60f-a07216fef4c4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:45.571580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772976c3-e3de-4eb6-a60f-a07216fef4c4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:45.573386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772976c3-e3de-4eb6-a60f-a07216fef4c4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:45.578681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772976c3-e3de-4eb6-a60f-a07216fef4c4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:45.727695 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-772976c3-e3de-4eb6-a60f-a07216fef4c4 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.223839 Aug 09 17:12:45.733191 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 871/1627] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:45 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:12:45.748631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-152731d2-c9bc-46ba-bf77-60a7fdb376f1 tempest-QuotasTestJSON-1986918504 tempest-QuotasTestJSON-1986918504-project] Calling method '.version_select at 0x7fbbcbabddc0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:45.867944 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-152731d2-c9bc-46ba-bf77-60a7fdb376f1 tempest-QuotasTestJSON-1986918504 tempest-QuotasTestJSON-1986918504-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/8831a5c5678a4754b757fa130ebc299a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.133106 Aug 09 17:12:45.876628 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 872/1628] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:12:45 2022] GET /compute/v2.1/os-quota-sets/8831a5c5678a4754b757fa130ebc299a/defaults => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:45.891190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-325a65b8-5a39-4474-aab5-9fc0207f8e74 tempest-QuotasTestJSON-1986918504 tempest-QuotasTestJSON-1986918504-project] Calling method '.version_select at 0x7fbbd806cd30>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:46.136636 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-325a65b8-5a39-4474-aab5-9fc0207f8e74 tempest-QuotasTestJSON-1986918504 tempest-QuotasTestJSON-1986918504-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/8831a5c5678a4754b757fa130ebc299a" status: 200 len: 371 microversion: 2.1 time: 0.255709 Aug 09 17:12:46.139002 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 873/1629] 10.222.0.93 () {58 vars in 1242 bytes} [Tue Aug 9 17:12:45 2022] GET /compute/v2.1/os-quota-sets/8831a5c5678a4754b757fa130ebc299a => generated 371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:46.159482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2e9041af-4ad7-4605-80d4-d6267e50c4f9 tempest-QuotasTestJSON-1986918504 tempest-QuotasTestJSON-1986918504-project] Calling method '.version_select at 0x7fbbcb746e50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:46.376983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:46.397046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:46.399943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:46.408511 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c03cc173-3fc0-4e28-a935-70ac7934f764 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 1.229583 Aug 09 17:12:46.409106 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 757/1630] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:45 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:46.426318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a773c088-e29b-461b-8c2f-8deac9103272 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:46.428208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a773c088-e29b-461b-8c2f-8deac9103272 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:46.444626 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2e9041af-4ad7-4605-80d4-d6267e50c4f9 tempest-QuotasTestJSON-1986918504 tempest-QuotasTestJSON-1986918504-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/8831a5c5678a4754b757fa130ebc299a?user_id=ae87ead351424da79c207f04152f7b9c" status: 200 len: 371 microversion: 2.1 time: 0.294816 Aug 09 17:12:46.447352 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 874/1631] 10.222.0.93 () {58 vars in 1323 bytes} [Tue Aug 9 17:12:46 2022] GET /compute/v2.1/os-quota-sets/8831a5c5678a4754b757fa130ebc299a?user_id=ae87ead351424da79c207f04152f7b9c => generated 371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:12:46.460418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a2e57b6-d8ea-4e2e-baf4-dd39c817d349 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcbad34c0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:46.491458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a773c088-e29b-461b-8c2f-8deac9103272 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:46.497761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a773c088-e29b-461b-8c2f-8deac9103272 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:46.498411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a773c088-e29b-461b-8c2f-8deac9103272 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:46.507360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a773c088-e29b-461b-8c2f-8deac9103272 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:46.510495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a773c088-e29b-461b-8c2f-8deac9103272 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:46.512297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a773c088-e29b-461b-8c2f-8deac9103272 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:46.549070 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a2e57b6-d8ea-4e2e-baf4-dd39c817d349 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87" status: 200 len: 1427 microversion: 2.1 time: 0.100286 Aug 09 17:12:46.552165 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 875/1632] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:46 2022] GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87 => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:46.740552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-668c68c2-5d2c-43a0-bb2b-f80bf466cad6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:46.743555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-668c68c2-5d2c-43a0-bb2b-f80bf466cad6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:46.790751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-668c68c2-5d2c-43a0-bb2b-f80bf466cad6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:46.801338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-668c68c2-5d2c-43a0-bb2b-f80bf466cad6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:46.803411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-668c68c2-5d2c-43a0-bb2b-f80bf466cad6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:46.806997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-668c68c2-5d2c-43a0-bb2b-f80bf466cad6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:46.807516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-668c68c2-5d2c-43a0-bb2b-f80bf466cad6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:46.808022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-668c68c2-5d2c-43a0-bb2b-f80bf466cad6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:46.957857 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-668c68c2-5d2c-43a0-bb2b-f80bf466cad6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.221375 Aug 09 17:12:46.975493 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 876/1633] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:46 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 17:12:47.324734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a773c088-e29b-461b-8c2f-8deac9103272 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:47.346512 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a773c088-e29b-461b-8c2f-8deac9103272 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 0.923597 Aug 09 17:12:47.350367 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 758/1634] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:46 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:47.436237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:47.437046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:47.450803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:47.464075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:47.465938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:47.466805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:47.473339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:47.473840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:47.567969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d7eae9b9-33c4-42ea-8e29-314770c5b470 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb728f70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:47.696548 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d7eae9b9-33c4-42ea-8e29-314770c5b470 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87" status: 200 len: 1427 microversion: 2.1 time: 0.133813 Aug 09 17:12:47.706233 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 759/1635] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:47 2022] GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87 => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:12:47.982773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a5fa958e-5f8f-4af5-862e-79180450baa6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:48.001112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a5fa958e-5f8f-4af5-862e-79180450baa6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:48.038258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5fa958e-5f8f-4af5-862e-79180450baa6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:48.039069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5fa958e-5f8f-4af5-862e-79180450baa6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:48.046046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5fa958e-5f8f-4af5-862e-79180450baa6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:48.051245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5fa958e-5f8f-4af5-862e-79180450baa6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:48.063541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5fa958e-5f8f-4af5-862e-79180450baa6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:48.069768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5fa958e-5f8f-4af5-862e-79180450baa6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:48.228873 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a5fa958e-5f8f-4af5-862e-79180450baa6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.261353 Aug 09 17:12:48.230973 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 760/1636] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:12:47 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767/os-volume_attachments => generated 25 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:48.416332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9b2cfb31-ccb5-4ba6-b092-b8bf073ccc77 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:48.417505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9b2cfb31-ccb5-4ba6-b092-b8bf073ccc77 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:48.445807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b2cfb31-ccb5-4ba6-b092-b8bf073ccc77 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:48.446717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b2cfb31-ccb5-4ba6-b092-b8bf073ccc77 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:48.447532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b2cfb31-ccb5-4ba6-b092-b8bf073ccc77 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:48.448882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b2cfb31-ccb5-4ba6-b092-b8bf073ccc77 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:48.449714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b2cfb31-ccb5-4ba6-b092-b8bf073ccc77 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:48.452774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b2cfb31-ccb5-4ba6-b092-b8bf073ccc77 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:48.866931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:48.883072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:48.927136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:48.935738 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-520104dc-8993-43f4-a953-1f466dbc0b84 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 1.503588 Aug 09 17:12:48.944951 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 877/1637] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:47 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:48.964526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f7d9a035-47d5-487c-980a-a6be82cda7d6 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcbf59040>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:49.162761 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f7d9a035-47d5-487c-980a-a6be82cda7d6 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87" status: 200 len: 1427 microversion: 2.1 time: 0.207551 Aug 09 17:12:49.164229 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 878/1638] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:48 2022] GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87 => generated 1427 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:49.955789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9b2cfb31-ccb5-4ba6-b092-b8bf073ccc77 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:49.979716 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9b2cfb31-ccb5-4ba6-b092-b8bf073ccc77 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 1.579868 Aug 09 17:12:49.980012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:49.980823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:49.982157 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 761/1639] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:48 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:12:50.007062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:50.007284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:50.007775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:50.012946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:50.013655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:50.019692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:50.191183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9f4583a2-c4bc-4e0c-a064-756f24c656a9 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb4363a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:50.378279 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9f4583a2-c4bc-4e0c-a064-756f24c656a9 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87" status: 200 len: 1427 microversion: 2.1 time: 0.202889 Aug 09 17:12:50.380100 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 762/1640] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:50 2022] GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87 => generated 1427 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:12:51.006655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d35e7745-e1b1-48a0-b68d-93205ee868d0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:51.008071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d35e7745-e1b1-48a0-b68d-93205ee868d0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:51.032196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d35e7745-e1b1-48a0-b68d-93205ee868d0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:51.045966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d35e7745-e1b1-48a0-b68d-93205ee868d0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:51.048520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d35e7745-e1b1-48a0-b68d-93205ee868d0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:51.055532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d35e7745-e1b1-48a0-b68d-93205ee868d0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:51.057311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d35e7745-e1b1-48a0-b68d-93205ee868d0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:51.060608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d35e7745-e1b1-48a0-b68d-93205ee868d0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:51.955443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d35e7745-e1b1-48a0-b68d-93205ee868d0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:51.975796 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d35e7745-e1b1-48a0-b68d-93205ee868d0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 0.973292 Aug 09 17:12:51.980543 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 763/1641] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:50 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:51.990400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1a9a9ea5-cf87-4da9-a99e-1f7961bf1d77 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb728ca0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:52.092485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:52.102922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:52.112554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:52.114127 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-80d31f37-99ae-4a09-9522-5013944111e2 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 2.144528 Aug 09 17:12:52.118320 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 879/1642] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:49 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:12:52.876619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9aa78669-ff86-493a-948f-b096f90152fd tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Action: 'create', calling method: .version_select at 0x7fbbcb9d60d0>, body: {"keypair": {"name": "tempest-keypair-989659443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXyJLhYTQscCslf0hSP5eKvTXEKnUCpcKYsN58GCwWKgHJqsWPbm0AXvAQ5Ct42inRifKjYf70zxzqrxunN4CqgitZj2JlnNAPvpxUjoJawF600tPrI8qgbJFaRIprqPA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:53.033048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-9aa78669-ff86-493a-948f-b096f90152fd tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Getting quotas for project d5c9f623336e43cf97c9566a49f1b064. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:12:53.052117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-9aa78669-ff86-493a-948f-b096f90152fd tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Getting quotas for user db013fb9179d4e008d5e7ba5087cfcf2 and project d5c9f623336e43cf97c9566a49f1b064. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:12:53.130401 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9aa78669-ff86-493a-948f-b096f90152fd tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.009535 Aug 09 17:12:53.136141 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 880/1643] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:12:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:53.170360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d3662644-5938-467b-b57a-f8dbd00c49a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:53.173961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d3662644-5938-467b-b57a-f8dbd00c49a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:53.216584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3662644-5938-467b-b57a-f8dbd00c49a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:53.218722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3662644-5938-467b-b57a-f8dbd00c49a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:53.219424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3662644-5938-467b-b57a-f8dbd00c49a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:53.220625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3662644-5938-467b-b57a-f8dbd00c49a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:53.223366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3662644-5938-467b-b57a-f8dbd00c49a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:53.228712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3662644-5938-467b-b57a-f8dbd00c49a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:54.644695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3662644-5938-467b-b57a-f8dbd00c49a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:54.655976 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d3662644-5938-467b-b57a-f8dbd00c49a0 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 1.517613 Aug 09 17:12:54.659996 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 881/1644] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:53 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:54.696109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:54.704856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:54.731734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:54.733313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:54.736935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:54.740026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:54.740855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:54.742385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:56.538083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:56.571552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:56.574193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:56.589216 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b97c4121-22cf-4f81-86c4-b8b718c432ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 1.911048 Aug 09 17:12:56.592746 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 882/1645] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:54 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:56.604286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a6211c4c-d0b0-4084-bbf2-ee608783dfc4 req-eb36a1fb-7a16-4581-9444-2a67c3e9354b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef8234b-af34-48f6-b84a-e4800e432eb8", "name": "network-vif-plugged", "status": "completed", "tag": "b426bae7-bfa2-43b9-8167-bbe3433a1e83"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:12:56.619782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:12:56.646830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a6211c4c-d0b0-4084-bbf2-ee608783dfc4 req-eb36a1fb-7a16-4581-9444-2a67c3e9354b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:56.648930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a6211c4c-d0b0-4084-bbf2-ee608783dfc4 req-eb36a1fb-7a16-4581-9444-2a67c3e9354b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:56.659207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a6211c4c-d0b0-4084-bbf2-ee608783dfc4 req-eb36a1fb-7a16-4581-9444-2a67c3e9354b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:56.696203 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a6211c4c-d0b0-4084-bbf2-ee608783dfc4 req-eb36a1fb-7a16-4581-9444-2a67c3e9354b service nova] Creating event network-vif-plugged:b426bae7-bfa2-43b9-8167-bbe3433a1e83 for instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 on n-h1-845781-6 Aug 09 17:12:56.709868 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a6211c4c-d0b0-4084-bbf2-ee608783dfc4 req-eb36a1fb-7a16-4581-9444-2a67c3e9354b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114931 Aug 09 17:12:56.716455 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 883/1646] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:12:56.739415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2d6f860f-1a11-47b1-946e-24172ef21cb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:56.753875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2d6f860f-1a11-47b1-946e-24172ef21cb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:56.777707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d6f860f-1a11-47b1-946e-24172ef21cb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:56.779899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d6f860f-1a11-47b1-946e-24172ef21cb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:56.781516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d6f860f-1a11-47b1-946e-24172ef21cb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:56.782686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d6f860f-1a11-47b1-946e-24172ef21cb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:56.785340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d6f860f-1a11-47b1-946e-24172ef21cb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:56.787018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d6f860f-1a11-47b1-946e-24172ef21cb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:58.211539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2d6f860f-1a11-47b1-946e-24172ef21cb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:58.227476 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2d6f860f-1a11-47b1-946e-24172ef21cb7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 1.505089 Aug 09 17:12:58.228315 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 884/1647] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:12:56 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:12:58.240981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:12:58.241863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:12:58.284381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:58.285732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:58.286504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:58.290936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:12:58.292012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:12:58.292638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:12:59.309888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:59.368447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:59.382306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:12:59.402959 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5fac187d-f3d3-4ca2-a551-26912f51e023 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 1.160664 Aug 09 17:12:59.405402 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 885/1648] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:12:58 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:12:59.441767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "bc5d3635-a84a-4755-8187-308b39b2e7ef"}], "security_groups": [{"name": "tempest-securitygroup--50112231"}], "key_name": "tempest-keypair-989659443", "user_data": "}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:01.031951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=55 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:01.970413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=37 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:03.066133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:09.320368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:09.548798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=7 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:19.241949 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1a9a9ea5-cf87-4da9-a99e-1f7961bf1d77 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87" status: 200 len: 1436 microversion: 2.1 time: 27.259921 Aug 09 17:13:19.253139 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 764/1649] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:12:51 2022] GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87 => generated 1436 bytes in 27272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:19.262372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:19.272964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:19.295164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:19.296549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:19.297379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:19.298292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:19.298841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:19.300778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:19.338434 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] HTTP exception thrown: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:13:19.343139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] validate_networks() for [('bc5d3635-a84a-4755-8187-308b39b2e7ef', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Request method failure captured: Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 HTTP/1.1 Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pSBIOvxEnbLUF3A463zf920ozI7ZEV6TE96D4Drymrocw32HyrMLGKx-zIFZA4AJa-KcsI_dWyhOU9WMkyhkKUHj5ZlCZpb7qibSTSac6qYb6bIgw9cbIDJTqHCnZ7d3x2m-TRs_K9Ej2ctrjbv2OFCrgkBQ6Y47JEqiGKUKuoSeJE Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: cb4177dbe7e94a8e8381561de0e40575 Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1598089833 Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:13:19.346115 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1598089833 Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: cb4177dbe7e94a8e8381561de0e40575 Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1598089833 Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AttachSCSIVolumeTestJSON-1598089833-project Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 8721b8f0cd0a46f489ab540cd8db9357 Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1598089833-project Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:13:19.349039 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '2f377368-7c9c-48cb-80c1-c2253e0f5105'} Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:19.350223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:13:19.352118 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:19.357028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Returning 404 to user: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:19.357028 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fe8586f9-fea5-4c60-8ff5-92d3da4b7999 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 404 len: 111 microversion: 2.1 time: 0.094354 Aug 09 17:13:19.357028 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 765/1650] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:13:19 2022] DELETE /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:13:19.377368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-357f5950-eb52-4374-8de1-0f5617c2b074 req-13f0e195-2829-4a58-8323-e35d58c554db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-plugged", "status": "completed", "tag": "1e899611-18b4-4b55-9bae-c961a398310b"}, {"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-plugged", "status": "completed", "tag": "1fe00816-1d9d-4c9b-8d71-db94ffc93bf9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:19.412148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-357f5950-eb52-4374-8de1-0f5617c2b074 req-13f0e195-2829-4a58-8323-e35d58c554db service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:19.412653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-357f5950-eb52-4374-8de1-0f5617c2b074 req-13f0e195-2829-4a58-8323-e35d58c554db service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:19.413297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-357f5950-eb52-4374-8de1-0f5617c2b074 req-13f0e195-2829-4a58-8323-e35d58c554db service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:19.453820 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-357f5950-eb52-4374-8de1-0f5617c2b074 req-13f0e195-2829-4a58-8323-e35d58c554db service nova] Creating event network-vif-plugged:1e899611-18b4-4b55-9bae-c961a398310b for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:13:19.456127 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-357f5950-eb52-4374-8de1-0f5617c2b074 req-13f0e195-2829-4a58-8323-e35d58c554db service nova] Creating event network-vif-plugged:1fe00816-1d9d-4c9b-8d71-db94ffc93bf9 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:13:19.470902 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-357f5950-eb52-4374-8de1-0f5617c2b074 req-13f0e195-2829-4a58-8323-e35d58c554db service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.116408 Aug 09 17:13:19.473247 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 766/1651] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:19.483235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ebcfa658-655f-42bd-aad6-5d87b93b908d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:19.484787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ebcfa658-655f-42bd-aad6-5d87b93b908d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:19.499547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebcfa658-655f-42bd-aad6-5d87b93b908d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:19.499547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebcfa658-655f-42bd-aad6-5d87b93b908d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:19.499547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebcfa658-655f-42bd-aad6-5d87b93b908d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:19.501386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebcfa658-655f-42bd-aad6-5d87b93b908d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:19.502221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebcfa658-655f-42bd-aad6-5d87b93b908d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:19.502956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebcfa658-655f-42bd-aad6-5d87b93b908d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:19.859296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ebcfa658-655f-42bd-aad6-5d87b93b908d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:19.876210 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ebcfa658-655f-42bd-aad6-5d87b93b908d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 0.400692 Aug 09 17:13:19.876800 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 767/1652] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:19 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:19.885072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:19.885983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:19.895343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:19.900054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:19.902260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:19.903271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:19.903793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:19.904235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:20.281506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:20.305185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:20.325763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:20.332072 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3e74b8d8-a1cb-410b-a7d8-138a9ef0f6d0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 0.449072 Aug 09 17:13:20.333290 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 768/1653] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:19 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:20.906090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5b18729b-2076-49e3-94f2-ed539353d49b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Action: 'create', calling method: .version_select at 0x7fbbcb803820>, body: {"keypair": {"name": "tempest-keypair-1107143736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGhLMpWbXSapcjR2nXlW5Hb0x6EZrOgxpByRG4znOwRlir8PkCnIku1ccHFZtS8+MmINQIGi88oT+Qvf4fO0LJexdblFE4Xixki0Ry/SMSh0tqk0iPdUbXc5N4xLao8sQ=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:20.942916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-5b18729b-2076-49e3-94f2-ed539353d49b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Getting quotas for project 5458faa4b45e4eab8ec22d1d4a13f6c0. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:13:20.952464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-5b18729b-2076-49e3-94f2-ed539353d49b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Getting quotas for user db2a6f289c7e4b1abea4713412897236 and project 5458faa4b45e4eab8ec22d1d4a13f6c0. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:13:20.969168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:13:20.970248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:13:20.970934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:13:20.971530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:13:20.972294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:13:20.984815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:20.985576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:20.986240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:20.987220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:20.988514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:20.989136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:21.010467 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5b18729b-2076-49e3-94f2-ed539353d49b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.672586 Aug 09 17:13:21.012019 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 769/1654] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:13:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:21.025371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-95721699-33a0-4204-bf96-abf34bf56a91 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb91eca0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:21.064071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Getting quotas for project d5c9f623336e43cf97c9566a49f1b064. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:13:21.079033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Getting quotas for user db013fb9179d4e008d5e7ba5087cfcf2 and project d5c9f623336e43cf97c9566a49f1b064. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:13:21.118130 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-95721699-33a0-4204-bf96-abf34bf56a91 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87" status: 200 len: 1436 microversion: 2.1 time: 0.104670 Aug 09 17:13:21.121035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:13:21.126962 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 770/1655] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:13:21 2022] GET /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87 => generated 1436 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:21.128818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:13:21.136441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:21.137075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] [instance: 2f377368-7c9c-48cb-80c1-c2253e0f5105] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:21.154084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:21.161251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:21.161724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:21.162690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:21.163185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:21.163638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:21.196151 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] HTTP exception thrown: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Request method failure captured: Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 HTTP/1.1 Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pSBIOvxEnbLUF3A463zf920ozI7ZEV6TE96D4Drymrocw32HyrMLGKx-zIFZA4AJa-KcsI_dWyhOU9WMkyhkKUHj5ZlCZpb7qibSTSac6qYb6bIgw9cbIDJTqHCnZ7d3x2m-TRs_K9Ej2ctrjbv2OFCrgkBQ6Y47JEqiGKUKuoSeJE Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: cb4177dbe7e94a8e8381561de0e40575 Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1598089833 Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:13:21.197910 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/cb4177dbe7e94a8e8381561de0e40575"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1598089833 Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: cb4177dbe7e94a8e8381561de0e40575 Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1598089833 Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AttachSCSIVolumeTestJSON-1598089833-project Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 8721b8f0cd0a46f489ab540cd8db9357 Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1598089833-project Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:13:21.199921 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '2f377368-7c9c-48cb-80c1-c2253e0f5105'} Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:21.200820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. Aug 09 17:13:21.202203 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:21.203876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] Returning 404 to user: Instance 2f377368-7c9c-48cb-80c1-c2253e0f5105 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:21.203876 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b93eb286-c66a-4242-bd2a-a460ebc22639 tempest-AttachSCSIVolumeTestJSON-1598089833 tempest-AttachSCSIVolumeTestJSON-1598089833-project] 10.222.0.93 "GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105" status: 404 len: 111 microversion: 2.1 time: 0.071385 Aug 09 17:13:21.203876 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 771/1656] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:21 2022] GET /compute/v2.1/servers/2f377368-7c9c-48cb-80c1-c2253e0f5105 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:13:21.208338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-538f7842-d833-4910-b7b5-ca344d3c9528 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:21.208980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-538f7842-d833-4910-b7b5-ca344d3c9528 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:21.216139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-538f7842-d833-4910-b7b5-ca344d3c9528 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:21.216677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-538f7842-d833-4910-b7b5-ca344d3c9528 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:21.217143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-538f7842-d833-4910-b7b5-ca344d3c9528 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:21.218188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-538f7842-d833-4910-b7b5-ca344d3c9528 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:21.218834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-538f7842-d833-4910-b7b5-ca344d3c9528 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:21.219457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-538f7842-d833-4910-b7b5-ca344d3c9528 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:21.289915 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-98f7b8b6-db67-48fc-9647-a2511ea9351f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 21.878222 Aug 09 17:13:21.295422 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 886/1657] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:12:59 2022] POST /compute/v2.1/servers => generated 407 bytes in 21884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:13:21.323389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b143390f-3aeb-441e-8334-fafb18b6ea19 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:21.324068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b143390f-3aeb-441e-8334-fafb18b6ea19 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:21.359680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b143390f-3aeb-441e-8334-fafb18b6ea19 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:21.360381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b143390f-3aeb-441e-8334-fafb18b6ea19 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:21.360848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b143390f-3aeb-441e-8334-fafb18b6ea19 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:21.361570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b143390f-3aeb-441e-8334-fafb18b6ea19 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:21.362380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b143390f-3aeb-441e-8334-fafb18b6ea19 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:21.363197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b143390f-3aeb-441e-8334-fafb18b6ea19 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:21.718749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-538f7842-d833-4910-b7b5-ca344d3c9528 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:21.752067 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-538f7842-d833-4910-b7b5-ca344d3c9528 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 0.550013 Aug 09 17:13:21.782531 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 772/1658] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:21 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:21.790561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b143390f-3aeb-441e-8334-fafb18b6ea19 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:21.807954 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b143390f-3aeb-441e-8334-fafb18b6ea19 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1465 microversion: 2.1 time: 0.511238 Aug 09 17:13:21.812643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-21824019-ec33-49eb-8909-0bbb67ee8e91 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:21.817099 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 887/1659] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:21 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1465 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:21.827212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:21.828128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:21.830075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-21824019-ec33-49eb-8909-0bbb67ee8e91 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:21.857672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:21.858181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:21.858625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:21.898324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:21.898851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:21.899303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:22.147264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-21824019-ec33-49eb-8909-0bbb67ee8e91 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:22.156963 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-21824019-ec33-49eb-8909-0bbb67ee8e91 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1225 microversion: 2.1 time: 0.372471 Aug 09 17:13:22.163250 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 773/1660] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:21 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1225 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:22.177277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-61c29e83-ef03-471b-bc61-1311083fba9d req-561bd293-31d2-4ee0-a99a-3aa5671c9ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-plugged", "status": "completed", "tag": "f19286e2-58f2-4f51-9878-ebb153c05f5f"}, {"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-plugged", "status": "completed", "tag": "52bfc239-226f-4b52-bc62-3939a1c70d53"}, {"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-plugged", "status": "completed", "tag": "087d8ab6-d0b8-451a-a98f-0e8b6e72b4a6"}, {"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-plugged", "status": "completed", "tag": "709f91d0-ee6e-4efa-ad7d-a941e3f4fefb"}, {"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-plugged", "status": "completed", "tag": "2936b497-d537-4328-a229-123214f26882"}, {"server_uuid": "376cf93a-be81-477e-a0c7-656834c3d899", "name": "network-vif-plugged", "status": "completed", "tag": "808a2a00-f141-4144-9ff7-439ca998a941"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:22.213593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-61c29e83-ef03-471b-bc61-1311083fba9d req-561bd293-31d2-4ee0-a99a-3aa5671c9ce4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:22.214487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-61c29e83-ef03-471b-bc61-1311083fba9d req-561bd293-31d2-4ee0-a99a-3aa5671c9ce4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:22.217155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-61c29e83-ef03-471b-bc61-1311083fba9d req-561bd293-31d2-4ee0-a99a-3aa5671c9ce4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:22.244683 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-61c29e83-ef03-471b-bc61-1311083fba9d req-561bd293-31d2-4ee0-a99a-3aa5671c9ce4 service nova] Creating event network-vif-plugged:f19286e2-58f2-4f51-9878-ebb153c05f5f for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:13:22.248130 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-61c29e83-ef03-471b-bc61-1311083fba9d req-561bd293-31d2-4ee0-a99a-3aa5671c9ce4 service nova] Creating event network-vif-plugged:52bfc239-226f-4b52-bc62-3939a1c70d53 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:13:22.250633 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-61c29e83-ef03-471b-bc61-1311083fba9d req-561bd293-31d2-4ee0-a99a-3aa5671c9ce4 service nova] Creating event network-vif-plugged:087d8ab6-d0b8-451a-a98f-0e8b6e72b4a6 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:13:22.253276 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-61c29e83-ef03-471b-bc61-1311083fba9d req-561bd293-31d2-4ee0-a99a-3aa5671c9ce4 service nova] Creating event network-vif-plugged:709f91d0-ee6e-4efa-ad7d-a941e3f4fefb for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:13:22.254886 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-61c29e83-ef03-471b-bc61-1311083fba9d req-561bd293-31d2-4ee0-a99a-3aa5671c9ce4 service nova] Creating event network-vif-plugged:2936b497-d537-4328-a229-123214f26882 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:13:22.258171 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-61c29e83-ef03-471b-bc61-1311083fba9d req-561bd293-31d2-4ee0-a99a-3aa5671c9ce4 service nova] Creating event network-vif-plugged:808a2a00-f141-4144-9ff7-439ca998a941 for instance 376cf93a-be81-477e-a0c7-656834c3d899 on n-h2-845781-6 Aug 09 17:13:22.269798 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-61c29e83-ef03-471b-bc61-1311083fba9d req-561bd293-31d2-4ee0-a99a-3aa5671c9ce4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.104641 Aug 09 17:13:22.273080 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 774/1661] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:22.286282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cf26a43c-0806-4ebc-bd84-5abb74f10f21 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcb5b88b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:23.297731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:23.333781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:23.337658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:23.348264 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11283c0a-e98b-49a6-aad7-7f37d191976b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 1.524644 Aug 09 17:13:23.352136 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 888/1662] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:21 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:23.372356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-23ebb744-6655-4e77-8a67-176bbb44010d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:23.374117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-23ebb744-6655-4e77-8a67-176bbb44010d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:23.404476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23ebb744-6655-4e77-8a67-176bbb44010d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:23.405342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23ebb744-6655-4e77-8a67-176bbb44010d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:23.406113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23ebb744-6655-4e77-8a67-176bbb44010d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:23.407207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23ebb744-6655-4e77-8a67-176bbb44010d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:23.408095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23ebb744-6655-4e77-8a67-176bbb44010d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:23.408867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23ebb744-6655-4e77-8a67-176bbb44010d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:24.371455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-23ebb744-6655-4e77-8a67-176bbb44010d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:24.438032 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-23ebb744-6655-4e77-8a67-176bbb44010d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1198 microversion: 2.1 time: 1.083562 Aug 09 17:13:24.444762 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 889/1663] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:23 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1198 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:24.498044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3436ff49-90dc-4541-9fc9-bbdecd64e8d0 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:24.506192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3436ff49-90dc-4541-9fc9-bbdecd64e8d0 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:24.539016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3436ff49-90dc-4541-9fc9-bbdecd64e8d0 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:24.543126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3436ff49-90dc-4541-9fc9-bbdecd64e8d0 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:24.546132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3436ff49-90dc-4541-9fc9-bbdecd64e8d0 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:24.556571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3436ff49-90dc-4541-9fc9-bbdecd64e8d0 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:24.558422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3436ff49-90dc-4541-9fc9-bbdecd64e8d0 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:24.559595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3436ff49-90dc-4541-9fc9-bbdecd64e8d0 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:24.805346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3436ff49-90dc-4541-9fc9-bbdecd64e8d0 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:24.844913 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3436ff49-90dc-4541-9fc9-bbdecd64e8d0 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1277 microversion: 2.1 time: 0.368249 Aug 09 17:13:24.862590 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 890/1664] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:24 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1277 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:24.905127 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cf26a43c-0806-4ebc-bd84-5abb74f10f21 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "DELETE /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87" status: 204 len: 0 microversion: 2.1 time: 2.626340 Aug 09 17:13:24.905913 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 775/1665] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:22 2022] DELETE /compute/v2.1/images/bb6cbc66-4b83-46ac-a7b4-fac02d96ad87 => generated 0 bytes in 2630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:13:24.906719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-48a89a45-3dbe-4f45-b4a0-0935b2cb34d8 req-5644babe-d959-4fcc-a630-2310d64be74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef8234b-af34-48f6-b84a-e4800e432eb8", "name": "network-vif-unplugged", "status": "completed", "tag": "b426bae7-bfa2-43b9-8167-bbe3433a1e83"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:24.912342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:24.916576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:24.940524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:24.941999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:24.942740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:24.946014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:24.946951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:24.949240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:24.963265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-48a89a45-3dbe-4f45-b4a0-0935b2cb34d8 req-5644babe-d959-4fcc-a630-2310d64be74b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:24.965677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-48a89a45-3dbe-4f45-b4a0-0935b2cb34d8 req-5644babe-d959-4fcc-a630-2310d64be74b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:24.971421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-48a89a45-3dbe-4f45-b4a0-0935b2cb34d8 req-5644babe-d959-4fcc-a630-2310d64be74b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:25.041067 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-48a89a45-3dbe-4f45-b4a0-0935b2cb34d8 req-5644babe-d959-4fcc-a630-2310d64be74b service nova] Creating event network-vif-unplugged:b426bae7-bfa2-43b9-8167-bbe3433a1e83 for instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 on n-h1-845781-6 Aug 09 17:13:25.072611 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-48a89a45-3dbe-4f45-b4a0-0935b2cb34d8 req-5644babe-d959-4fcc-a630-2310d64be74b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.189040 Aug 09 17:13:25.077607 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 891/1666] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:25.098418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac57f349-ae9d-405a-b9b9-41fe96eae4e6 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '.version_select at 0x7fbbcbc2db80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:25.171051 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-ac57f349-ae9d-405a-b9b9-41fe96eae4e6 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] HTTP exception thrown: Image not found. Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac57f349-ae9d-405a-b9b9-41fe96eae4e6 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Request method failure captured: Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 HTTP/1.1 Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pUw7j32cQ2Szs9Z5td_r0YWSHPtBk67kk09km8vQSiVojXb9kGi7TGePU1lVKRqKmW0mmN3PyRmT3w0nnEvUgLj7s88nepkkuEKg_47o6lVQ-2ZYgyrI1DlZd--APWyvi8vTaKJigzU4dRrrh7YQu7smasSIok5afbQx-VVphq0MCc Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 58824a6471f34f1c9c371381b8140158 Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesOneServerTestJSON-799240187 Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:13:25.177610 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_58824a6471f34f1c9c371381b8140158"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/58824a6471f34f1c9c371381b8140158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/58824a6471f34f1c9c371381b8140158"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/58824a6471f34f1c9c371381b8140158"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesOneServerTestJSON-799240187 Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 58824a6471f34f1c9c371381b8140158 Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-799240187 Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesOneServerTestJSON-799240187-project Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6251fca3070f46e88dea986cf6db9f07 Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesOneServerTestJSON-799240187-project Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '993df035-36b2-4750-b6f5-f9717e948f17'} Aug 09 17:13:25.180762 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 993df035-36b2-4750-b6f5-f9717e948f17 to delete Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:25.182728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 993df035-36b2-4750-b6f5-f9717e948f17 could not be found. Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:25.185606 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:13:25.189822 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:25.194283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac57f349-ae9d-405a-b9b9-41fe96eae4e6 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:25.199159 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ac57f349-ae9d-405a-b9b9-41fe96eae4e6 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "DELETE /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17" status: 404 len: 62 microversion: 2.1 time: 0.110752 Aug 09 17:13:25.202639 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 892/1667] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:25 2022] DELETE /compute/v2.1/images/993df035-36b2-4750-b6f5-f9717e948f17 => generated 62 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:13:25.226538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-518a23f3-76d3-4ac8-9292-2e40861c1c4e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:25.229043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-518a23f3-76d3-4ac8-9292-2e40861c1c4e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:25.253075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-518a23f3-76d3-4ac8-9292-2e40861c1c4e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:25.255927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-518a23f3-76d3-4ac8-9292-2e40861c1c4e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:25.256900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-518a23f3-76d3-4ac8-9292-2e40861c1c4e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:25.259221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-518a23f3-76d3-4ac8-9292-2e40861c1c4e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:25.260662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-518a23f3-76d3-4ac8-9292-2e40861c1c4e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:25.262050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-518a23f3-76d3-4ac8-9292-2e40861c1c4e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:25.316253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-518a23f3-76d3-4ac8-9292-2e40861c1c4e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:13:25.522939 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-518a23f3-76d3-4ac8-9292-2e40861c1c4e tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 204 len: 0 microversion: 2.1 time: 0.314672 Aug 09 17:13:25.526893 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 893/1668] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:13:25 2022] DELETE /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:13:25.536711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d759ae7f-668d-4507-b8c8-93902aff2bf6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:25.538010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d759ae7f-668d-4507-b8c8-93902aff2bf6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:25.557349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d759ae7f-668d-4507-b8c8-93902aff2bf6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:25.558257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d759ae7f-668d-4507-b8c8-93902aff2bf6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:25.559372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d759ae7f-668d-4507-b8c8-93902aff2bf6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:25.561723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d759ae7f-668d-4507-b8c8-93902aff2bf6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:25.562973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d759ae7f-668d-4507-b8c8-93902aff2bf6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:25.565330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d759ae7f-668d-4507-b8c8-93902aff2bf6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:25.920718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:25.970530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:25.980846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:25.990896 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-38f7740e-9faa-4e14-9241-c2ad24f2385b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1879 microversion: 2.42 time: 1.082287 Aug 09 17:13:25.999387 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 776/1669] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:24 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1879 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:26.063033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3f0d237c-40d7-424f-8d1e-a9313f2c5857 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:26.076141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3f0d237c-40d7-424f-8d1e-a9313f2c5857 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:26.133397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f0d237c-40d7-424f-8d1e-a9313f2c5857 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:26.138612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f0d237c-40d7-424f-8d1e-a9313f2c5857 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:26.143745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f0d237c-40d7-424f-8d1e-a9313f2c5857 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:26.150567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f0d237c-40d7-424f-8d1e-a9313f2c5857 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:26.151581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f0d237c-40d7-424f-8d1e-a9313f2c5857 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:26.156896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f0d237c-40d7-424f-8d1e-a9313f2c5857 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:26.374178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d759ae7f-668d-4507-b8c8-93902aff2bf6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:26.387235 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d759ae7f-668d-4507-b8c8-93902aff2bf6 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1382 microversion: 2.1 time: 0.857982 Aug 09 17:13:26.390643 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 894/1670] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:25 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1382 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:26.434756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50d790ba-9baf-4b1f-98a4-5f5b56b327c1 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:26.437302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-50d790ba-9baf-4b1f-98a4-5f5b56b327c1 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:26.489279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d790ba-9baf-4b1f-98a4-5f5b56b327c1 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:26.490861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d790ba-9baf-4b1f-98a4-5f5b56b327c1 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:26.494409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d790ba-9baf-4b1f-98a4-5f5b56b327c1 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:26.497240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d790ba-9baf-4b1f-98a4-5f5b56b327c1 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:26.498384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d790ba-9baf-4b1f-98a4-5f5b56b327c1 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:26.499400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d790ba-9baf-4b1f-98a4-5f5b56b327c1 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:26.783000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-50d790ba-9baf-4b1f-98a4-5f5b56b327c1 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:26.803737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3f0d237c-40d7-424f-8d1e-a9313f2c5857 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:26.819593 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3f0d237c-40d7-424f-8d1e-a9313f2c5857 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1471 microversion: 2.1 time: 0.813612 Aug 09 17:13:26.820688 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 777/1671] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:25 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1471 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:26.841228 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-50d790ba-9baf-4b1f-98a4-5f5b56b327c1 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1283 microversion: 2.1 time: 0.431481 Aug 09 17:13:26.842245 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 895/1672] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:26 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1283 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:27.034586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:27.036079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:27.063385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:27.074194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:27.075356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:27.076737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:27.077679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:27.078536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:27.298865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f5696a30-2fcf-4f1b-929f-e163ae93ff34 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:27.299709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f5696a30-2fcf-4f1b-929f-e163ae93ff34 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:27.314471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5696a30-2fcf-4f1b-929f-e163ae93ff34 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:27.315014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5696a30-2fcf-4f1b-929f-e163ae93ff34 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:27.318973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5696a30-2fcf-4f1b-929f-e163ae93ff34 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:27.321759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5696a30-2fcf-4f1b-929f-e163ae93ff34 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:27.322377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5696a30-2fcf-4f1b-929f-e163ae93ff34 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:27.322837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5696a30-2fcf-4f1b-929f-e163ae93ff34 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:27.631843 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f5696a30-2fcf-4f1b-929f-e163ae93ff34 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1533 microversion: 2.1 time: 0.805540 Aug 09 17:13:27.646806 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 778/1673] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:26 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1533 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:27.650729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1944759262", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "aa755713-4017-4819-b6c1-fd28f8dcd18a"}], "security_groups": [{"name": "tempest-securitygroup--1801557601"}], "key_name": "tempest-keypair-1107143736", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:27.945897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] validate_networks() for [('aa755713-4017-4819-b6c1-fd28f8dcd18a', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:13:28.002942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:28.067477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:28.070688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:28.073653 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f5a3b4e-4289-434b-90f0-28bd15332a40 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2837 microversion: 2.42 time: 1.054566 Aug 09 17:13:28.074896 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 896/1674] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:27 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2837 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:13:28.083135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-606cdaea-7560-40c1-bbb4-22e84e305e20 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:28.084153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-606cdaea-7560-40c1-bbb4-22e84e305e20 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:28.094715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-606cdaea-7560-40c1-bbb4-22e84e305e20 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:28.095747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-606cdaea-7560-40c1-bbb4-22e84e305e20 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:28.096650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-606cdaea-7560-40c1-bbb4-22e84e305e20 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:28.097866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-606cdaea-7560-40c1-bbb4-22e84e305e20 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:28.098582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-606cdaea-7560-40c1-bbb4-22e84e305e20 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:28.099499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-606cdaea-7560-40c1-bbb4-22e84e305e20 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:29.191835 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-606cdaea-7560-40c1-bbb4-22e84e305e20 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1533 microversion: 2.1 time: 1.112399 Aug 09 17:13:29.210513 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 897/1675] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:28 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1533 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:29.247959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b2c5ed92-b79f-4d29-9101-37b7f6c09d05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:29.249956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b2c5ed92-b79f-4d29-9101-37b7f6c09d05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:29.269815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c5ed92-b79f-4d29-9101-37b7f6c09d05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:29.271180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c5ed92-b79f-4d29-9101-37b7f6c09d05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:29.272332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c5ed92-b79f-4d29-9101-37b7f6c09d05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:29.276750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c5ed92-b79f-4d29-9101-37b7f6c09d05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:29.278218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c5ed92-b79f-4d29-9101-37b7f6c09d05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:29.279342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c5ed92-b79f-4d29-9101-37b7f6c09d05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:29.563080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:13:29.571926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:13:29.573362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:13:29.578292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:13:29.581127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:13:29.588900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b2c5ed92-b79f-4d29-9101-37b7f6c09d05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6251fca3070f46e88dea986cf6db9f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58824a6471f34f1c9c371381b8140158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:29.607946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:29.609180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:29.610342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:29.612425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:29.613576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:29.616161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:29.621775 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b2c5ed92-b79f-4d29-9101-37b7f6c09d05 tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 200 len: 1429 microversion: 2.1 time: 0.408759 Aug 09 17:13:29.622542 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 898/1676] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:29 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 1429 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:29.664635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Getting quotas for project 5458faa4b45e4eab8ec22d1d4a13f6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:13:29.680136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Getting quotas for user db2a6f289c7e4b1abea4713412897236 and project 5458faa4b45e4eab8ec22d1d4a13f6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:13:29.681175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74516017-b342-4006-93ce-1f702927187a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:29.682339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-74516017-b342-4006-93ce-1f702927187a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:29.718946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:13:29.719788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74516017-b342-4006-93ce-1f702927187a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:29.721023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74516017-b342-4006-93ce-1f702927187a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:29.721816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74516017-b342-4006-93ce-1f702927187a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:29.724221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74516017-b342-4006-93ce-1f702927187a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:29.730121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74516017-b342-4006-93ce-1f702927187a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:29.731485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74516017-b342-4006-93ce-1f702927187a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:29.752255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:13:29.891102 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-de81b0c0-b41a-40b1-ab89-301b2651486c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.253807 Aug 09 17:13:29.894209 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 779/1677] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:13:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:13:29.928075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6601759b-4577-4444-8aab-21fe8e44a28c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:29.928922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6601759b-4577-4444-8aab-21fe8e44a28c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:29.938372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6601759b-4577-4444-8aab-21fe8e44a28c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:29.939241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6601759b-4577-4444-8aab-21fe8e44a28c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:29.939992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6601759b-4577-4444-8aab-21fe8e44a28c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:29.941977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6601759b-4577-4444-8aab-21fe8e44a28c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:29.943742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6601759b-4577-4444-8aab-21fe8e44a28c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:29.944678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6601759b-4577-4444-8aab-21fe8e44a28c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:30.140846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-74516017-b342-4006-93ce-1f702927187a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:30.150981 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-74516017-b342-4006-93ce-1f702927187a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1283 microversion: 2.1 time: 0.505146 Aug 09 17:13:30.151583 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 899/1678] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:29 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1283 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:30.159533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-500598a9-f3bf-421f-93ab-000a5f132472 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:30.178398 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:13:30.178398 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:13:30.184129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-500598a9-f3bf-421f-93ab-000a5f132472 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:30.186856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-500598a9-f3bf-421f-93ab-000a5f132472 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:30.187527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-500598a9-f3bf-421f-93ab-000a5f132472 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:30.189061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-500598a9-f3bf-421f-93ab-000a5f132472 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:30.191449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-500598a9-f3bf-421f-93ab-000a5f132472 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:30.193042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-500598a9-f3bf-421f-93ab-000a5f132472 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:30.298857 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-500598a9-f3bf-421f-93ab-000a5f132472 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.142974 Aug 09 17:13:30.299985 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 900/1679] 10.222.0.93 () {58 vars in 1176 bytes} [Tue Aug 9 17:13:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:30.322002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5f7d42d5-276e-4e7b-b401-6970a4c8a6e8 req-36e707fd-1d06-48fc-99a9-1ed5ff820e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef8234b-af34-48f6-b84a-e4800e432eb8", "name": "network-vif-deleted", "tag": "b426bae7-bfa2-43b9-8167-bbe3433a1e83"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:30.344034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5f7d42d5-276e-4e7b-b401-6970a4c8a6e8 req-36e707fd-1d06-48fc-99a9-1ed5ff820e6b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:30.345243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5f7d42d5-276e-4e7b-b401-6970a4c8a6e8 req-36e707fd-1d06-48fc-99a9-1ed5ff820e6b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:30.346562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5f7d42d5-276e-4e7b-b401-6970a4c8a6e8 req-36e707fd-1d06-48fc-99a9-1ed5ff820e6b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:30.379209 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5f7d42d5-276e-4e7b-b401-6970a4c8a6e8 req-36e707fd-1d06-48fc-99a9-1ed5ff820e6b service nova] Creating event network-vif-deleted:b426bae7-bfa2-43b9-8167-bbe3433a1e83 for instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 on n-h1-845781-6 Aug 09 17:13:30.409123 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5f7d42d5-276e-4e7b-b401-6970a4c8a6e8 req-36e707fd-1d06-48fc-99a9-1ed5ff820e6b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093471 Aug 09 17:13:30.412136 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 901/1680] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:30.420625 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6601759b-4577-4444-8aab-21fe8e44a28c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.523938 Aug 09 17:13:30.421837 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 780/1681] 10.222.0.93 () {60 vars in 1316 bytes} [Tue Aug 9 17:13:29 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf/os-interface => generated 1830 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:30.427745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e4f016ec-3589-44d9-b093-365c00cf19f9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:30.429810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e4f016ec-3589-44d9-b093-365c00cf19f9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:30.442208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9776ee7-49f0-4872-877a-828e28a0e8c0 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-845781-6", "block_migration": false, "disk_over_commit": false}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:30.459378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9776ee7-49f0-4872-877a-828e28a0e8c0 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:30.484819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9776ee7-49f0-4872-877a-828e28a0e8c0 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:30.485193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9776ee7-49f0-4872-877a-828e28a0e8c0 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:30.485505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9776ee7-49f0-4872-877a-828e28a0e8c0 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:30.486217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9776ee7-49f0-4872-877a-828e28a0e8c0 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:30.489620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9776ee7-49f0-4872-877a-828e28a0e8c0 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:30.503753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9776ee7-49f0-4872-877a-828e28a0e8c0 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:30.621475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-d9776ee7-49f0-4872-877a-828e28a0e8c0 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lazy-loading 'flavor' on Instance uuid 376cf93a-be81-477e-a0c7-656834c3d899 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:13:30.672412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9776ee7-49f0-4872-877a-828e28a0e8c0 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Going to try to live migrate instance to n-h1-845781-6 {{(pid=119432) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 17:13:30.825518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4f016ec-3589-44d9-b093-365c00cf19f9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:30.851060 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e4f016ec-3589-44d9-b093-365c00cf19f9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1242 microversion: 2.1 time: 0.435107 Aug 09 17:13:30.853262 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 902/1682] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:30 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1242 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:30.875016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:30.876482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] [instance: 1ef8234b-af34-48f6-b84a-e4800e432eb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:30.893855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:30.894465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:30.894993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:30.897323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:30.908007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:30.908510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:30.962545 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] HTTP exception thrown: Instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 could not be found. Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Request method failure captured: Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 HTTP/1.1 Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pUw7j32cQ2Szs9Z5td_r0YWSHPtBk67kk09km8vQSiVojXb9kGi7TGePU1lVKRqKmW0mmN3PyRmT3w0nnEvUgLj7s88nepkkuEKg_47o6lVQ-2ZYgyrI1DlZd--APWyvi8vTaKJigzU4dRrrh7YQu7smasSIok5afbQx-VVphq0MCc Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 58824a6471f34f1c9c371381b8140158 Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesOneServerTestJSON-799240187 Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:13:30.964375 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_58824a6471f34f1c9c371381b8140158"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/58824a6471f34f1c9c371381b8140158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/58824a6471f34f1c9c371381b8140158"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/58824a6471f34f1c9c371381b8140158"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesOneServerTestJSON-799240187 Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 58824a6471f34f1c9c371381b8140158 Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-799240187 Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesOneServerTestJSON-799240187-project Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6251fca3070f46e88dea986cf6db9f07 Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesOneServerTestJSON-799240187-project Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 could not be found. Aug 09 17:13:30.966522 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1ef8234b-af34-48f6-b84a-e4800e432eb8'} Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 could not be found. Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:30.967565 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 could not be found. Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 could not be found. Aug 09 17:13:30.969522 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:30.971081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] Returning 404 to user: Instance 1ef8234b-af34-48f6-b84a-e4800e432eb8 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:30.971081 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0af608c4-01b1-437b-80d4-b043216173bf tempest-ImagesOneServerTestJSON-799240187 tempest-ImagesOneServerTestJSON-799240187-project] 10.222.0.93 "GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8" status: 404 len: 111 microversion: 2.1 time: 0.110055 Aug 09 17:13:30.984264 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 903/1683] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:30 2022] GET /compute/v2.1/servers/1ef8234b-af34-48f6-b84a-e4800e432eb8 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:13:31.205174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8968a1c8-6912-4dc0-95ba-eeb8b2bf139b tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:31.211537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8968a1c8-6912-4dc0-95ba-eeb8b2bf139b tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:31.247883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8968a1c8-6912-4dc0-95ba-eeb8b2bf139b tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:31.258314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8968a1c8-6912-4dc0-95ba-eeb8b2bf139b tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:31.259542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8968a1c8-6912-4dc0-95ba-eeb8b2bf139b tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:31.261303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8968a1c8-6912-4dc0-95ba-eeb8b2bf139b tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:31.263710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8968a1c8-6912-4dc0-95ba-eeb8b2bf139b tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:31.266600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8968a1c8-6912-4dc0-95ba-eeb8b2bf139b tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:33.870700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8968a1c8-6912-4dc0-95ba-eeb8b2bf139b tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:33.907889 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8968a1c8-6912-4dc0-95ba-eeb8b2bf139b tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1349 microversion: 2.1 time: 2.715435 Aug 09 17:13:33.909118 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 904/1684] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:31 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1349 bytes in 2719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:33.948593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-76c148fd-51d7-4c5a-9c63-fd754ded9787 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:33.950740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-76c148fd-51d7-4c5a-9c63-fd754ded9787 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:33.969657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76c148fd-51d7-4c5a-9c63-fd754ded9787 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:33.970628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76c148fd-51d7-4c5a-9c63-fd754ded9787 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:33.971389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76c148fd-51d7-4c5a-9c63-fd754ded9787 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:33.973152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76c148fd-51d7-4c5a-9c63-fd754ded9787 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:33.976224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76c148fd-51d7-4c5a-9c63-fd754ded9787 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:33.977011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76c148fd-51d7-4c5a-9c63-fd754ded9787 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:34.532801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-76c148fd-51d7-4c5a-9c63-fd754ded9787 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:34.549603 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-76c148fd-51d7-4c5a-9c63-fd754ded9787 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1300 microversion: 2.1 time: 0.629992 Aug 09 17:13:34.597097 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 905/1685] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:33 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1300 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:34.939597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87f75356-3e1d-442a-a428-d544d7466db5 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:34.943771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87f75356-3e1d-442a-a428-d544d7466db5 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:34.960385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87f75356-3e1d-442a-a428-d544d7466db5 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:34.961936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87f75356-3e1d-442a-a428-d544d7466db5 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:34.962797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87f75356-3e1d-442a-a428-d544d7466db5 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:34.964005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87f75356-3e1d-442a-a428-d544d7466db5 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:34.965317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87f75356-3e1d-442a-a428-d544d7466db5 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:34.966741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87f75356-3e1d-442a-a428-d544d7466db5 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:34.978495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:35.609180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87f75356-3e1d-442a-a428-d544d7466db5 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:35.622208 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87f75356-3e1d-442a-a428-d544d7466db5 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1349 microversion: 2.1 time: 0.692430 Aug 09 17:13:35.622932 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 906/1686] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:34 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1349 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:35.646828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-36926315-b266-4751-b355-2f1f6c6375c9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:35.651213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-36926315-b266-4751-b355-2f1f6c6375c9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:35.674513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36926315-b266-4751-b355-2f1f6c6375c9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:35.676432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36926315-b266-4751-b355-2f1f6c6375c9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:35.679654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36926315-b266-4751-b355-2f1f6c6375c9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:35.683762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36926315-b266-4751-b355-2f1f6c6375c9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:35.687056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36926315-b266-4751-b355-2f1f6c6375c9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:35.687931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36926315-b266-4751-b355-2f1f6c6375c9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:36.531902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-36926315-b266-4751-b355-2f1f6c6375c9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:36.599755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-36926315-b266-4751-b355-2f1f6c6375c9 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1368 microversion: 2.1 time: 0.972816 Aug 09 17:13:36.603940 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 907/1687] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:35 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1368 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:36.973763 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9776ee7-49f0-4872-877a-828e28a0e8c0 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899/action" status: 202 len: 0 microversion: 2.1 time: 6.543749 Aug 09 17:13:36.992933 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 781/1688] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:13:30 2022] POST /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899/action => generated 0 bytes in 6570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:13:37.049640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1082524665", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "58c9a4df-a052-4259-baba-4eb50282dd0b"}], "block_device_mapping_v2": [{"uuid": "3f6e1852-3929-4e09-adcd-c490b3898b75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:37.219231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f0807ca1-caaa-4f28-bba3-fb2c81857737 tempest-ListImagesTestJSON-825831345 tempest-ListImagesTestJSON-825831345-project] Calling method '.version_select at 0x7fbbcbad3550>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:37.236734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] validate_networks() for [('58c9a4df-a052-4259-baba-4eb50282dd0b', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:13:37.307516 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f0807ca1-caaa-4f28-bba3-fb2c81857737 tempest-ListImagesTestJSON-825831345 tempest-ListImagesTestJSON-825831345-project] 10.222.0.93 "GET /compute/v2.1/images/f484be58-00e8-4507-b378-ca7d3c0dd32d" status: 200 len: 784 microversion: 2.1 time: 0.687264 Aug 09 17:13:37.309348 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 908/1689] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:13:36 2022] GET /compute/v2.1/images/f484be58-00e8-4507-b378-ca7d3c0dd32d => generated 784 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:37.314630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5b0dabe8-ce8c-42a8-a422-adc246b57f33 req-5441fbe1-6c1e-4b4a-a80a-52d806634c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "tag": "709f91d0-ee6e-4efa-ad7d-a941e3f4fefb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:37.343145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b0dabe8-ce8c-42a8-a422-adc246b57f33 req-5441fbe1-6c1e-4b4a-a80a-52d806634c04 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:37.343767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b0dabe8-ce8c-42a8-a422-adc246b57f33 req-5441fbe1-6c1e-4b4a-a80a-52d806634c04 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:37.356296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b0dabe8-ce8c-42a8-a422-adc246b57f33 req-5441fbe1-6c1e-4b4a-a80a-52d806634c04 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:37.369301 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5b0dabe8-ce8c-42a8-a422-adc246b57f33 req-5441fbe1-6c1e-4b4a-a80a-52d806634c04 service nova] Creating event network-changed:709f91d0-ee6e-4efa-ad7d-a941e3f4fefb for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:13:37.375293 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5b0dabe8-ce8c-42a8-a422-adc246b57f33 req-5441fbe1-6c1e-4b4a-a80a-52d806634c04 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064357 Aug 09 17:13:37.376125 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 909/1690] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:37.383609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3cf2650f-c596-4a79-9a68-26898414cd2a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:37.384746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3cf2650f-c596-4a79-9a68-26898414cd2a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:37.393751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cf2650f-c596-4a79-9a68-26898414cd2a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:37.394860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cf2650f-c596-4a79-9a68-26898414cd2a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:37.395455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cf2650f-c596-4a79-9a68-26898414cd2a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:37.396261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cf2650f-c596-4a79-9a68-26898414cd2a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:37.396951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cf2650f-c596-4a79-9a68-26898414cd2a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:37.397594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cf2650f-c596-4a79-9a68-26898414cd2a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:38.420636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:13:38.421808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:13:38.422654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:13:38.423313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:13:38.424252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:13:38.444233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:38.445288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:38.446281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:38.447542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:38.448445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:38.449298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:38.505797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Getting quotas for project 47793440cab647cc943281e2bc566c7f. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:13:38.521708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Getting quotas for user 27626b9d13c340cc9ec2fe564d1bab8d and project 47793440cab647cc943281e2bc566c7f. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:13:38.674300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:13:38.678863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f6e1852-3929-4e09-adcd-c490b3898b75',volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:13:38.858608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3cf2650f-c596-4a79-9a68-26898414cd2a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:38.867928 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3cf2650f-c596-4a79-9a68-26898414cd2a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1349 microversion: 2.1 time: 1.488945 Aug 09 17:13:38.872340 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 910/1691] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:37 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1349 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:38.887265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e7d77dc-08c2-4f01-8821-e132976d8ca2 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:38.888331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3e7d77dc-08c2-4f01-8821-e132976d8ca2 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:38.897614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d77dc-08c2-4f01-8821-e132976d8ca2 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:38.898715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d77dc-08c2-4f01-8821-e132976d8ca2 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:38.899382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d77dc-08c2-4f01-8821-e132976d8ca2 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:38.900244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d77dc-08c2-4f01-8821-e132976d8ca2 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:38.900941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d77dc-08c2-4f01-8821-e132976d8ca2 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:38.901589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d77dc-08c2-4f01-8821-e132976d8ca2 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:38.984167 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a9fc1167-9a03-4477-bb28-6c8caa1d305e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.983745 Aug 09 17:13:38.986517 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 782/1692] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:13:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1993 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:13:39.001633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ac32c5b-556c-42cb-b717-115d6fec1e2a tempest-ListImagesTestJSON-825831345 tempest-ListImagesTestJSON-825831345-project] Calling method '.version_select at 0x7fbbcb7b1670>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:39.144162 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4ac32c5b-556c-42cb-b717-115d6fec1e2a tempest-ListImagesTestJSON-825831345 tempest-ListImagesTestJSON-825831345-project] 10.222.0.93 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.147467 Aug 09 17:13:39.161205 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 783/1693] 10.222.0.93 () {58 vars in 1122 bytes} [Tue Aug 9 17:13:38 2022] GET /compute/v2.1/images => generated 445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:39.161205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-959c3e9e-6716-4e80-9792-1b2a478312ee tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:39.161205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-959c3e9e-6716-4e80-9792-1b2a478312ee tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:39.180990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-959c3e9e-6716-4e80-9792-1b2a478312ee tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:39.181818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-959c3e9e-6716-4e80-9792-1b2a478312ee tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:39.182459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-959c3e9e-6716-4e80-9792-1b2a478312ee tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:39.183193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-959c3e9e-6716-4e80-9792-1b2a478312ee tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:39.183686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-959c3e9e-6716-4e80-9792-1b2a478312ee tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:39.184111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-959c3e9e-6716-4e80-9792-1b2a478312ee tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:39.858066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-959c3e9e-6716-4e80-9792-1b2a478312ee tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:39.867136 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-959c3e9e-6716-4e80-9792-1b2a478312ee tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1368 microversion: 2.1 time: 0.713202 Aug 09 17:13:39.868537 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 784/1694] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:39 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1368 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:39.892119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-80e782a8-c440-4448-9cc2-aedcda8d8992 req-618b52f5-d62c-4200-8f2c-80f151da089e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15affa7d-ca83-47fa-b24b-cec8a05fcda3", "tag": "a77d9b7e-e498-4db6-84eb-6ac98cfc71de"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:39.914899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-80e782a8-c440-4448-9cc2-aedcda8d8992 req-618b52f5-d62c-4200-8f2c-80f151da089e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:39.917410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-80e782a8-c440-4448-9cc2-aedcda8d8992 req-618b52f5-d62c-4200-8f2c-80f151da089e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:39.917622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-80e782a8-c440-4448-9cc2-aedcda8d8992 req-618b52f5-d62c-4200-8f2c-80f151da089e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:39.951160 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-80e782a8-c440-4448-9cc2-aedcda8d8992 req-618b52f5-d62c-4200-8f2c-80f151da089e service nova] Creating event network-changed:a77d9b7e-e498-4db6-84eb-6ac98cfc71de for instance 15affa7d-ca83-47fa-b24b-cec8a05fcda3 on n-h1-845781-6 Aug 09 17:13:39.969279 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-80e782a8-c440-4448-9cc2-aedcda8d8992 req-618b52f5-d62c-4200-8f2c-80f151da089e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099122 Aug 09 17:13:39.970426 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 785/1695] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:39.992061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:39.992913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:40.005539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:40.007342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:40.008305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:40.010576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:40.011247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:40.011999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:40.192506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:40.203806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:40.210222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:40.211947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:40.213851 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-beed6e00-18cf-4ac6-a054-5fb16eda8f27 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1185 microversion: 2.25 time: 0.240172 Aug 09 17:13:40.217708 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 786/1696] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:39 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1185 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:40.233036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6820ee95-22d2-45aa-9101-083f6e36410d tempest-ListImagesTestJSON-825831345 tempest-ListImagesTestJSON-825831345-project] Calling method '.version_select at 0x7fbbcb825790>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:40.308912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3e7d77dc-08c2-4f01-8821-e132976d8ca2 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:40.315264 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6820ee95-22d2-45aa-9101-083f6e36410d tempest-ListImagesTestJSON-825831345 tempest-ListImagesTestJSON-825831345-project] 10.222.0.93 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.094536 Aug 09 17:13:40.329926 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e7d77dc-08c2-4f01-8821-e132976d8ca2 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 1.449923 Aug 09 17:13:40.344425 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 911/1697] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:38 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:40.350938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b5802f43-ff4d-446b-8471-888584afd517 req-0d704bb0-2570-4300-b966-8a4e26f6b8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fcdaafd-e14c-4307-aa16-fd4860b74633", "tag": "46ee644e-0b30-4955-a95a-7804f485464b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:40.351169 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 787/1698] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:13:40 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:40.356437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-340a9b2a-a274-48e4-b790-ec9fad6f6654 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:40.357206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-340a9b2a-a274-48e4-b790-ec9fad6f6654 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:40.391555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-340a9b2a-a274-48e4-b790-ec9fad6f6654 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:40.392660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-340a9b2a-a274-48e4-b790-ec9fad6f6654 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:40.393565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-340a9b2a-a274-48e4-b790-ec9fad6f6654 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:40.395206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-340a9b2a-a274-48e4-b790-ec9fad6f6654 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:40.395964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b5802f43-ff4d-446b-8471-888584afd517 req-0d704bb0-2570-4300-b966-8a4e26f6b8d3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:40.396638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b5802f43-ff4d-446b-8471-888584afd517 req-0d704bb0-2570-4300-b966-8a4e26f6b8d3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:40.396815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-340a9b2a-a274-48e4-b790-ec9fad6f6654 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:40.398922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b5802f43-ff4d-446b-8471-888584afd517 req-0d704bb0-2570-4300-b966-8a4e26f6b8d3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:40.404532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-340a9b2a-a274-48e4-b790-ec9fad6f6654 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:40.440368 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b5802f43-ff4d-446b-8471-888584afd517 req-0d704bb0-2570-4300-b966-8a4e26f6b8d3 service nova] Creating event network-changed:46ee644e-0b30-4955-a95a-7804f485464b for instance 0fcdaafd-e14c-4307-aa16-fd4860b74633 on n-h1-845781-6 Aug 09 17:13:40.475095 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b5802f43-ff4d-446b-8471-888584afd517 req-0d704bb0-2570-4300-b966-8a4e26f6b8d3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131877 Aug 09 17:13:40.476476 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 912/1699] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:40.905258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:40.910307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd65c327-4b8f-4a61-ab25-f6595bb797bb tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:40.911508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bd65c327-4b8f-4a61-ab25-f6595bb797bb tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:40.922954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd65c327-4b8f-4a61-ab25-f6595bb797bb tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:40.926142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd65c327-4b8f-4a61-ab25-f6595bb797bb tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:40.926601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd65c327-4b8f-4a61-ab25-f6595bb797bb tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:40.928563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd65c327-4b8f-4a61-ab25-f6595bb797bb tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:40.929937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd65c327-4b8f-4a61-ab25-f6595bb797bb tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:40.932928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd65c327-4b8f-4a61-ab25-f6595bb797bb tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:41.328005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bd65c327-4b8f-4a61-ab25-f6595bb797bb tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:41.338592 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bd65c327-4b8f-4a61-ab25-f6595bb797bb tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1368 microversion: 2.1 time: 0.434183 Aug 09 17:13:41.339201 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 913/1700] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:40 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1368 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:41.346178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:41.347492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:41.356051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:41.357216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:41.357681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:41.358430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:41.360174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:41.360671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:41.440689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-340a9b2a-a274-48e4-b790-ec9fad6f6654 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:41.458619 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-340a9b2a-a274-48e4-b790-ec9fad6f6654 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1349 microversion: 2.1 time: 1.106355 Aug 09 17:13:41.460248 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 788/1701] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:40 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1349 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:41.466411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d24df89d-1b52-46de-b602-670df6583965 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:41.467332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d24df89d-1b52-46de-b602-670df6583965 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:41.479045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:41.487430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d24df89d-1b52-46de-b602-670df6583965 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:41.488384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d24df89d-1b52-46de-b602-670df6583965 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:41.492351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d24df89d-1b52-46de-b602-670df6583965 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:41.493551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d24df89d-1b52-46de-b602-670df6583965 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:41.496944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d24df89d-1b52-46de-b602-670df6583965 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:41.497778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d24df89d-1b52-46de-b602-670df6583965 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:41.540244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:41.554575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:41.557226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:41.560024 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b3e9ac78-7d03-4216-855e-336caa530b54 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1233 microversion: 2.25 time: 0.219073 Aug 09 17:13:41.561307 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 914/1702] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:41 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1233 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:41.884328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d24df89d-1b52-46de-b602-670df6583965 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:41.911344 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d24df89d-1b52-46de-b602-670df6583965 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.445976 Aug 09 17:13:41.918142 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 789/1703] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:41 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:42.365521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c8418f8a-581e-475e-a7c9-2570c8e9a047 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:42.373058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c8418f8a-581e-475e-a7c9-2570c8e9a047 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:42.427111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8418f8a-581e-475e-a7c9-2570c8e9a047 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:42.432204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8418f8a-581e-475e-a7c9-2570c8e9a047 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:42.439917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8418f8a-581e-475e-a7c9-2570c8e9a047 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:42.442218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8418f8a-581e-475e-a7c9-2570c8e9a047 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:42.443869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8418f8a-581e-475e-a7c9-2570c8e9a047 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:42.445909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8418f8a-581e-475e-a7c9-2570c8e9a047 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:42.493737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dd9e704f-cb71-4b05-9006-f8dd5adec570 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:42.499479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dd9e704f-cb71-4b05-9006-f8dd5adec570 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:42.527875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd9e704f-cb71-4b05-9006-f8dd5adec570 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:42.533860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd9e704f-cb71-4b05-9006-f8dd5adec570 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:42.539120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd9e704f-cb71-4b05-9006-f8dd5adec570 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:42.544471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd9e704f-cb71-4b05-9006-f8dd5adec570 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:42.548315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd9e704f-cb71-4b05-9006-f8dd5adec570 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:42.551831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd9e704f-cb71-4b05-9006-f8dd5adec570 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:42.579000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:43.335979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dd9e704f-cb71-4b05-9006-f8dd5adec570 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:43.366057 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dd9e704f-cb71-4b05-9006-f8dd5adec570 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1349 microversion: 2.1 time: 0.883173 Aug 09 17:13:43.367645 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 790/1704] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:42 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1349 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:13:43.399174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:43.401050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:43.423686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:43.424724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:43.425553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:43.426963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:43.434665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:43.440662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:43.619217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:43.668210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:43.673849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:43.676851 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-570421e0-19cb-426e-84f9-4ddc22c13b7a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1251 microversion: 2.25 time: 0.307089 Aug 09 17:13:43.679728 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 791/1705] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:43 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1251 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:43.706526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3b77268b-afa8-4165-9498-15460018b18d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:43.710308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3b77268b-afa8-4165-9498-15460018b18d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:43.734784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b77268b-afa8-4165-9498-15460018b18d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:43.736424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b77268b-afa8-4165-9498-15460018b18d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:43.737711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b77268b-afa8-4165-9498-15460018b18d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:43.742330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b77268b-afa8-4165-9498-15460018b18d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:43.743815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b77268b-afa8-4165-9498-15460018b18d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:43.745006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b77268b-afa8-4165-9498-15460018b18d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:44.106721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c8418f8a-581e-475e-a7c9-2570c8e9a047 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:44.164881 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c8418f8a-581e-475e-a7c9-2570c8e9a047 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1368 microversion: 2.1 time: 1.798923 Aug 09 17:13:44.175678 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 915/1706] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:42 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1368 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:44.183859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3b77268b-afa8-4165-9498-15460018b18d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:44.203384 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3b77268b-afa8-4165-9498-15460018b18d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.517895 Aug 09 17:13:44.205735 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 792/1707] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:43 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:44.389448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75765e29-51eb-44c8-9e20-e58735ca0184 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:44.390179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75765e29-51eb-44c8-9e20-e58735ca0184 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:44.406612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75765e29-51eb-44c8-9e20-e58735ca0184 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:44.413619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75765e29-51eb-44c8-9e20-e58735ca0184 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:44.417140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75765e29-51eb-44c8-9e20-e58735ca0184 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:44.424971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75765e29-51eb-44c8-9e20-e58735ca0184 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:44.429677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75765e29-51eb-44c8-9e20-e58735ca0184 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:44.430970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75765e29-51eb-44c8-9e20-e58735ca0184 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:44.708044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:44.708917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:44.736468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:44.737575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:44.739339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:44.741162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:44.759169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:44.762015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:44.893537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:44.915619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:44.918468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:44.920833 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1d5720a5-b49f-4f4c-8f9d-98543a3bf9e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1251 microversion: 2.25 time: 0.218344 Aug 09 17:13:44.923065 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 793/1708] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:44 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1251 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:13:45.450643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-da5eba0c-1d80-49c1-a009-a7d158d22908 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Action: 'create', calling method: .version_select at 0x7fbbcb9380d0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo6N5JVLJROoVKhIBmRcciu0PC1t0wzbHHHulBzOlOdGjtFfqS9WWAEMGl9VpPRfFY839T7elKWIR3wM82SFpXIxA6sTYi+4mMgUyJOYhNrEEIoY72UbFifHAVAS4ojDA=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-da5eba0c-1d80-49c1-a009-a7d158d22908 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Request method failure captured: Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 257 Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXIT9Zw0CAU-zrkaRZDBcIS4Qgfp8jDpURJPsD-NEJ4xKMqaZ0h3nJLJKsONiLVRc5xQPf9qcB_uPgHdizD_BBG4wN5uDf4vvwMaG-Z01iD2i1oRM6zTOWg3eEnm10a6YUvR7bXmuX_FtrcHSI763uZOK_0lTHOroRXy1eESDKaE0o Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:13:45.455353 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:13:45.459150 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:45.459150 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:45.459150 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:45.459150 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:45.459150 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:45.459150 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:13:45.459150 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:13:45.459150 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:45.459150 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:45.459150 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:13:45.459150 n-d-845781-6 devstack@n-api.service[119432]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo6N5JVLJROoVKhIBmRcciu0PC1t0wzbHHHulBzOlOdGjtFfqS9WWAEMGl9VpPRfFY839T7elKWIR3wM82SFpXIxA6sTYi+4mMgUyJOYhNrEEIoY72UbFifHAVAS4ojDA=="}} Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo6N5JVLJROoVKhIBmRcciu0PC1t0wzbHHHulBzOlOdGjtFfqS9WWAEMGl9VpPRfFY839T7elKWIR3wM82SFpXIxA6sTYi+4mMgUyJOYhNrEEIoY72UbFifHAVAS4ojDA=='}}} Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:45.460755 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:13:45.463126 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:13:45.471081 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:13:45.481746 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 09 17:13:45.481746 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:45.481746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-da5eba0c-1d80-49c1-a009-a7d158d22908 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:45.481746 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-da5eba0c-1d80-49c1-a009-a7d158d22908 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.310160 Aug 09 17:13:45.481746 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 794/1709] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:13:45 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 312 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:13:45.484148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ed87f36b-0df2-4794-8a93-25d6cecf5f9d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:45.484827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ed87f36b-0df2-4794-8a93-25d6cecf5f9d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:45.498125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed87f36b-0df2-4794-8a93-25d6cecf5f9d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:45.500734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed87f36b-0df2-4794-8a93-25d6cecf5f9d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:45.501193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed87f36b-0df2-4794-8a93-25d6cecf5f9d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:45.502415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed87f36b-0df2-4794-8a93-25d6cecf5f9d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:45.502415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed87f36b-0df2-4794-8a93-25d6cecf5f9d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:45.502896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed87f36b-0df2-4794-8a93-25d6cecf5f9d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:45.736810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ed87f36b-0df2-4794-8a93-25d6cecf5f9d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:45.748923 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ed87f36b-0df2-4794-8a93-25d6cecf5f9d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1368 microversion: 2.1 time: 0.289850 Aug 09 17:13:45.766422 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 795/1710] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:45 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1368 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:45.785273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad1ffd6f-6956-4e33-9fd7-763dcb9e8766 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:45.786539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ad1ffd6f-6956-4e33-9fd7-763dcb9e8766 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:45.798344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad1ffd6f-6956-4e33-9fd7-763dcb9e8766 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:45.799749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad1ffd6f-6956-4e33-9fd7-763dcb9e8766 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:45.800492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad1ffd6f-6956-4e33-9fd7-763dcb9e8766 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:45.801921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad1ffd6f-6956-4e33-9fd7-763dcb9e8766 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:45.802618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad1ffd6f-6956-4e33-9fd7-763dcb9e8766 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:45.803293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad1ffd6f-6956-4e33-9fd7-763dcb9e8766 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:46.057344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-75765e29-51eb-44c8-9e20-e58735ca0184 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:46.097221 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75765e29-51eb-44c8-9e20-e58735ca0184 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1349 microversion: 2.1 time: 1.711531 Aug 09 17:13:46.125129 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 916/1711] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:44 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1349 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:13:46.138470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea18e8c2-8fe6-4dab-b001-fc83dc98f383 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Action: 'create', calling method: .version_select at 0x7fbbcb9d6700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-835577964", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:46.186198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-ea18e8c2-8fe6-4dab-b001-fc83dc98f383 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Getting quotas for project 56370e4af3164980a3d627351f9d6a9d. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:13:46.196444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ad1ffd6f-6956-4e33-9fd7-763dcb9e8766 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:46.197071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-ea18e8c2-8fe6-4dab-b001-fc83dc98f383 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Getting quotas for user 59d008d32b234ff2a47e4677d8b03161 and project 56370e4af3164980a3d627351f9d6a9d. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:13:46.231772 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-ea18e8c2-8fe6-4dab-b001-fc83dc98f383 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:46.236508 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad1ffd6f-6956-4e33-9fd7-763dcb9e8766 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.459359 Aug 09 17:13:46.237813 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 796/1712] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:45 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea18e8c2-8fe6-4dab-b001-fc83dc98f383 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Request method failure captured: Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 2166 Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pXIT9Zw0CAU-zrkaRZDBcIS4Qgfp8jDpURJPsD-NEJ4xKMqaZ0h3nJLJKsONiLVRc5xQPf9qcB_uPgHdizD_BBG4wN5uDf4vvwMaG-Z01iD2i1oRM6zTOWg3eEnm10a6YUvR7bXmuX_FtrcHSI763uZOK_0lTHOroRXy1eESDKaE0o Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-835577964", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:13:46.256369 n-d-845781-6 devstack@n-api.service[119431]: exception: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-835577964', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:46.258917 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:46.264890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.270981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea18e8c2-8fe6-4dab-b001-fc83dc98f383 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:46.271569 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ea18e8c2-8fe6-4dab-b001-fc83dc98f383 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.144662 Aug 09 17:13:46.272882 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 917/1713] 10.222.0.93 () {60 vars in 1160 bytes} [Tue Aug 9 17:13:46 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:13:46.277493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:46.278771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:46.287248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a0d2643c-61fe-49de-b04a-d98f9199a686 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Action: 'create', calling method: .version_select at 0x7fbbcbb25b80>, body: {"keypair": {"name": "tempest-keypair-767788149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzuWCLRmcosCKwp/yVGeTfidtJk6d7RgdvyZBd/VWNaPzvNSgMp+6G7hacao18M9fg2CuXQfxJ5EAltWL6vhcLwdGPyUW4SDNs/ZPNSzwG4eIP/GaDb5aPYPQBOMnpnrQ=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:46.290971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:46.292036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:46.292925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:46.294299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:46.295228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:46.296376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:46.381551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a0d2643c-61fe-49de-b04a-d98f9199a686 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Getting quotas for project 56370e4af3164980a3d627351f9d6a9d. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:13:46.400750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a0d2643c-61fe-49de-b04a-d98f9199a686 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Getting quotas for user 59d008d32b234ff2a47e4677d8b03161 and project 56370e4af3164980a3d627351f9d6a9d. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:13:46.409245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:46.468929 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a0d2643c-61fe-49de-b04a-d98f9199a686 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.184151 Aug 09 17:13:46.473761 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 918/1714] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:13:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:13:46.506562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fdecc4df-0d6a-48fe-ac59-3531904efb6d req-f7f0e536-0660-49a0-91d0-7a676d3bb209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15affa7d-ca83-47fa-b24b-cec8a05fcda3", "name": "network-vif-plugged", "status": "completed", "tag": "a77d9b7e-e498-4db6-84eb-6ac98cfc71de"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:46.531458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:46.554949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:46.567203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:46.569902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fdecc4df-0d6a-48fe-ac59-3531904efb6d req-f7f0e536-0660-49a0-91d0-7a676d3bb209 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:46.572620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fdecc4df-0d6a-48fe-ac59-3531904efb6d req-f7f0e536-0660-49a0-91d0-7a676d3bb209 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:46.573429 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0df2c6fd-e892-402d-9c14-a524d9146248 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1251 microversion: 2.25 time: 0.317090 Aug 09 17:13:46.574576 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 797/1715] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:46 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1251 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:46.575362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fdecc4df-0d6a-48fe-ac59-3531904efb6d req-f7f0e536-0660-49a0-91d0-7a676d3bb209 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:46.593557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8d9498bf-4f78-4e7f-bfce-102bed806fe0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Action: 'create', calling method: .version_select at 0x7fbbcb6ec430>, body: {"keypair": {"name": "tempest-keypair-767788149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGESKKZ7j9T2sFsYAm24r3dj0STi0oRppXifn4ysUtOWaZGqVL8U3DEd3cLoG3AU1vtJ7cx+lt3mmHAyoAAEu4/Re2k1mR545yjCmvzp29lIocdlfxSRVmXs/rDIbFA+Q=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:46.610481 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fdecc4df-0d6a-48fe-ac59-3531904efb6d req-f7f0e536-0660-49a0-91d0-7a676d3bb209 service nova] Creating event network-vif-plugged:a77d9b7e-e498-4db6-84eb-6ac98cfc71de for instance 15affa7d-ca83-47fa-b24b-cec8a05fcda3 on n-h1-845781-6 Aug 09 17:13:46.626409 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fdecc4df-0d6a-48fe-ac59-3531904efb6d req-f7f0e536-0660-49a0-91d0-7a676d3bb209 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148137 Aug 09 17:13:46.630200 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 919/1716] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:46.671991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8d9498bf-4f78-4e7f-bfce-102bed806fe0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Getting quotas for project 56370e4af3164980a3d627351f9d6a9d. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:13:46.691707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8d9498bf-4f78-4e7f-bfce-102bed806fe0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Getting quotas for user 59d008d32b234ff2a47e4677d8b03161 and project 56370e4af3164980a3d627351f9d6a9d. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:13:46.764806 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-8d9498bf-4f78-4e7f-bfce-102bed806fe0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] HTTP exception thrown: Key pair 'tempest-keypair-767788149' already exists. Aug 09 17:13:46.780480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-560b5387-f57e-4bf5-8eb8-32878aa63192 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:46.782149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-560b5387-f57e-4bf5-8eb8-32878aa63192 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8d9498bf-4f78-4e7f-bfce-102bed806fe0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Request method failure captured: Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 272 Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXIT9Zw0CAU-zrkaRZDBcIS4Qgfp8jDpURJPsD-NEJ4xKMqaZ0h3nJLJKsONiLVRc5xQPf9qcB_uPgHdizD_BBG4wN5uDf4vvwMaG-Z01iD2i1oRM6zTOWg3eEnm10a6YUvR7bXmuX_FtrcHSI763uZOK_0lTHOroRXy1eESDKaE0o Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: {"keypair": {"name": "tempest-keypair-767788149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGESKKZ7j9T2sFsYAm24r3dj0STi0oRppXifn4ysUtOWaZGqVL8U3DEd3cLoG3AU1vtJ7cx+lt3mmHAyoAAEu4/Re2k1mR545yjCmvzp29lIocdlfxSRVmXs/rDIbFA+Q=="}} Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: exception: Key pair 'tempest-keypair-767788149' already exists. Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-767788149', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGESKKZ7j9T2sFsYAm24r3dj0STi0oRppXifn4ysUtOWaZGqVL8U3DEd3cLoG3AU1vtJ7cx+lt3mmHAyoAAEu4/Re2k1mR545yjCmvzp29lIocdlfxSRVmXs/rDIbFA+Q=='}}} Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result.read() Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '59d008d32b234ff2a47e4677d8b03161-tempest-keypair-767788149' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 09 17:13:46.790735 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi session.flush() Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result.read() Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 17:13:46.799733 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '59d008d32b234ff2a47e4677d8b03161-tempest-keypair-767788149' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 9, 17, 13, 46, 743094), 'updated_at': None, 'name': 'tempest-keypair-767788149', 'user_id': '59d008d32b234ff2a47e4677d8b03161', 'fingerprint': '8d:fd:a5:14:cc:fa:ce:e7:30:a3:9b:91:f7:17:94:bd', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGESKKZ7j9T2sFsYAm24r3dj0STi0oRppXifn4ysUtOWaZGqVL8U3DEd3cLoG3AU1vtJ7cx+lt3mmHAyoAAEu4/Re2k1mR545yjCmvzp29lIocdlfxSRVmXs/rDIbFA+Q==', 'type': 'ssh'}] Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6743, in import_key_pair Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi keypair.create() Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._create() Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-767788149' already exists. Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 09 17:13:46.814037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-767788149' already exists. Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-767788149' already exists. Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8d9498bf-4f78-4e7f-bfce-102bed806fe0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Returning 409 to user: Key pair 'tempest-keypair-767788149' already exists. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8d9498bf-4f78-4e7f-bfce-102bed806fe0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.216782 Aug 09 17:13:46.829432 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 798/1717] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:13:46 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 218 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:13:46.833802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-560b5387-f57e-4bf5-8eb8-32878aa63192 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:46.833802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-560b5387-f57e-4bf5-8eb8-32878aa63192 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:46.833802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-560b5387-f57e-4bf5-8eb8-32878aa63192 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:46.833802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-560b5387-f57e-4bf5-8eb8-32878aa63192 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:46.833802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-560b5387-f57e-4bf5-8eb8-32878aa63192 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:46.833802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-560b5387-f57e-4bf5-8eb8-32878aa63192 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:46.838874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4caac39e-aef6-4bb9-9acc-9e207912b70c tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Calling method '.version_select at 0x7fbbcb6ec310>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:46.890828 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4caac39e-aef6-4bb9-9acc-9e207912b70c tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-767788149" status: 202 len: 0 microversion: 2.1 time: 0.089905 Aug 09 17:13:46.893390 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 799/1718] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:13:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-767788149 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:13:46.907736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f4a2152-a9d5-4f7b-9179-b3e03db86a37 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Action: 'create', calling method: .version_select at 0x7fbbcb623700>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDydaeuYSPeKNZiKa3wiBhubRH5DiQK6UbONPWR5nBWcd+CbK9sS2Np8yazsrndRKk14/s6p0XLe3HHRMAphA5Aq9+7l2QXoIMYJar+O1iAWYeIiqk9ZxXcy3RrofYR9WA=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f4a2152-a9d5-4f7b-9179-b3e03db86a37 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Request method failure captured: Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 247 Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXIT9Zw0CAU-zrkaRZDBcIS4Qgfp8jDpURJPsD-NEJ4xKMqaZ0h3nJLJKsONiLVRc5xQPf9qcB_uPgHdizD_BBG4wN5uDf4vvwMaG-Z01iD2i1oRM6zTOWg3eEnm10a6YUvR7bXmuX_FtrcHSI763uZOK_0lTHOroRXy1eESDKaE0o Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDydaeuYSPeKNZiKa3wiBhubRH5DiQK6UbONPWR5nBWcd+CbK9sS2Np8yazsrndRKk14/s6p0XLe3HHRMAphA5Aq9+7l2QXoIMYJar+O1iAWYeIiqk9ZxXcy3RrofYR9WA=="}} Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDydaeuYSPeKNZiKa3wiBhubRH5DiQK6UbONPWR5nBWcd+CbK9sS2Np8yazsrndRKk14/s6p0XLe3HHRMAphA5Aq9+7l2QXoIMYJar+O1iAWYeIiqk9ZxXcy3RrofYR9WA=='}}} Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi '' Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:13:46.913084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f4a2152-a9d5-4f7b-9179-b3e03db86a37 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8f4a2152-a9d5-4f7b-9179-b3e03db86a37 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.012109 Aug 09 17:13:46.922336 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 800/1719] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:13:46 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:13:46.929285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3eb6252f-ae3f-4d69-b128-64488f7279fb tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Action: 'create', calling method: .version_select at 0x7fbbcb8dbb80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1176204589", "public_key": " "}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:46.949838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-3eb6252f-ae3f-4d69-b128-64488f7279fb tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Getting quotas for project 56370e4af3164980a3d627351f9d6a9d. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:13:46.963644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-3eb6252f-ae3f-4d69-b128-64488f7279fb tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Getting quotas for user 59d008d32b234ff2a47e4677d8b03161 and project 56370e4af3164980a3d627351f9d6a9d. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:13:46.993015 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-3eb6252f-ae3f-4d69-b128-64488f7279fb tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3eb6252f-ae3f-4d69-b128-64488f7279fb tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Request method failure captured: Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 95 Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXIT9Zw0CAU-zrkaRZDBcIS4Qgfp8jDpURJPsD-NEJ4xKMqaZ0h3nJLJKsONiLVRc5xQPf9qcB_uPgHdizD_BBG4wN5uDf4vvwMaG-Z01iD2i1oRM6zTOWg3eEnm10a6YUvR7bXmuX_FtrcHSI763uZOK_0lTHOroRXy1eESDKaE0o Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1176204589", "public_key": " "}} Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: exception: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1176204589', 'public_key': ' '}}} Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:46.996198 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3eb6252f-ae3f-4d69-b128-64488f7279fb tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:47.003927 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3eb6252f-ae3f-4d69-b128-64488f7279fb tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.075252 Aug 09 17:13:47.013956 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 801/1720] 10.222.0.93 () {60 vars in 1158 bytes} [Tue Aug 9 17:13:46 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:13:47.020182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-31bed9c3-ddb5-45bb-97ae-f201d5bef579 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Action: 'create', calling method: .version_select at 0x7fbbcb6ecee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa5dcLDDjuz3WpPjYtHao+wCtI+YxuhKDQvzlYpN9GBlVoVZodty7QrtU4NVq3HkPL7KD/UIm1VKUGmFGvj/CzoreUOGmWpUKOotMPtYgR3m8KNKqQPP6GaIwgZboixgg=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-31bed9c3-ddb5-45bb-97ae-f201d5bef579 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Request method failure captured: Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 507 Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXIT9Zw0CAU-zrkaRZDBcIS4Qgfp8jDpURJPsD-NEJ4xKMqaZ0h3nJLJKsONiLVRc5xQPf9qcB_uPgHdizD_BBG4wN5uDf4vvwMaG-Z01iD2i1oRM6zTOWg3eEnm10a6YUvR7bXmuX_FtrcHSI763uZOK_0lTHOroRXy1eESDKaE0o Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa5dcLDDjuz3WpPjYtHao+wCtI+YxuhKDQvzlYpN9GBlVoVZodty7QrtU4NVq3HkPL7KD/UIm1VKUGmFGvj/CzoreUOGmWpUKOotMPtYgR3m8KNKqQPP6GaIwgZboixgg=="}} Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa5dcLDDjuz3WpPjYtHao+wCtI+YxuhKDQvzlYpN9GBlVoVZodty7QrtU4NVq3HkPL7KD/UIm1VKUGmFGvj/CzoreUOGmWpUKOotMPtYgR3m8KNKqQPP6GaIwgZboixgg=='}}} Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 09 17:13:47.026844 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-31bed9c3-ddb5-45bb-97ae-f201d5bef579 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:47.030739 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-31bed9c3-ddb5-45bb-97ae-f201d5bef579 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.017473 Aug 09 17:13:47.039512 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 802/1721] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:13:47 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:13:47.050030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fbc3f09c-a90a-4b34-92be-a8615af367c5 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Action: 'create', calling method: .version_select at 0x7fbbcb436040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1750108955", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:47.074408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fbc3f09c-a90a-4b34-92be-a8615af367c5 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Getting quotas for project 56370e4af3164980a3d627351f9d6a9d. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:13:47.084695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fbc3f09c-a90a-4b34-92be-a8615af367c5 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Getting quotas for user 59d008d32b234ff2a47e4677d8b03161 and project 56370e4af3164980a3d627351f9d6a9d. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:13:47.107095 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-fbc3f09c-a90a-4b34-92be-a8615af367c5 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fbc3f09c-a90a-4b34-92be-a8615af367c5 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Request method failure captured: Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 118 Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXIT9Zw0CAU-zrkaRZDBcIS4Qgfp8jDpURJPsD-NEJ4xKMqaZ0h3nJLJKsONiLVRc5xQPf9qcB_uPgHdizD_BBG4wN5uDf4vvwMaG-Z01iD2i1oRM6zTOWg3eEnm10a6YUvR7bXmuX_FtrcHSI763uZOK_0lTHOroRXy1eESDKaE0o Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1750108955", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: exception: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1750108955', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 09 17:13:47.109581 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fbc3f09c-a90a-4b34-92be-a8615af367c5 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:47.115556 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fbc3f09c-a90a-4b34-92be-a8615af367c5 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.072638 Aug 09 17:13:47.121377 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 803/1722] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:13:47 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:13:47.125433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-814b9df0-e138-4256-9e84-35f3b64934b0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Calling method '.version_select at 0x7fbbcb803e50>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:47.142675 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-814b9df0-e138-4256-9e84-35f3b64934b0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-669657128 not found for user 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-814b9df0-e138-4256-9e84-35f3b64934b0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Request method failure captured: Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-669657128 HTTP/1.1 Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXIT9Zw0CAU-zrkaRZDBcIS4Qgfp8jDpURJPsD-NEJ4xKMqaZ0h3nJLJKsONiLVRc5xQPf9qcB_uPgHdizD_BBG4wN5uDf4vvwMaG-Z01iD2i1oRM6zTOWg3eEnm10a6YUvR7bXmuX_FtrcHSI763uZOK_0lTHOroRXy1eESDKaE0o Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/56370e4af3164980a3d627351f9d6a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 56370e4af3164980a3d627351f9d6a9d Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-847742746 Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-KeyPairsNegativeTestJSON-847742746-project Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: exception: Keypair tempest-keypair-non-existent-669657128 not found for user 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'tempest-keypair-non-existent-669657128'} Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6827, in delete_key_pair Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6848, in get_key_pair Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-669657128 not found for user 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.144721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-669657128 not found for user 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-669657128 not found for user 59d008d32b234ff2a47e4677d8b03161 Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-814b9df0-e138-4256-9e84-35f3b64934b0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] Returning 404 to user: Keypair tempest-keypair-non-existent-669657128 not found for user 59d008d32b234ff2a47e4677d8b03161 {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:13:47.150455 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-814b9df0-e138-4256-9e84-35f3b64934b0 tempest-KeyPairsNegativeTestJSON-847742746 tempest-KeyPairsNegativeTestJSON-847742746-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-669657128" status: 404 len: 144 microversion: 2.1 time: 0.024738 Aug 09 17:13:47.157146 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 804/1723] 10.222.0.93 () {58 vars in 1257 bytes} [Tue Aug 9 17:13:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-669657128 => generated 144 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:13:47.179817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8a1e6918-256d-426e-8c83-1ef30427b772 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:47.188240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8a1e6918-256d-426e-8c83-1ef30427b772 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:47.207889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a1e6918-256d-426e-8c83-1ef30427b772 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:47.210121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a1e6918-256d-426e-8c83-1ef30427b772 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:47.210735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a1e6918-256d-426e-8c83-1ef30427b772 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:47.213069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a1e6918-256d-426e-8c83-1ef30427b772 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:47.215278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a1e6918-256d-426e-8c83-1ef30427b772 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:47.216041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a1e6918-256d-426e-8c83-1ef30427b772 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:47.751720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8a1e6918-256d-426e-8c83-1ef30427b772 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:47.768855 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8a1e6918-256d-426e-8c83-1ef30427b772 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1349 microversion: 2.1 time: 0.601273 Aug 09 17:13:47.772475 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 805/1724] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:47 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1349 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:47.780071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2a311972-6da2-4342-a390-a6ec6e44960d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:47.781368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2a311972-6da2-4342-a390-a6ec6e44960d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:47.790214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a311972-6da2-4342-a390-a6ec6e44960d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:47.791382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a311972-6da2-4342-a390-a6ec6e44960d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:47.794828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a311972-6da2-4342-a390-a6ec6e44960d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:47.798988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a311972-6da2-4342-a390-a6ec6e44960d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:47.799566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a311972-6da2-4342-a390-a6ec6e44960d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:47.799985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a311972-6da2-4342-a390-a6ec6e44960d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:48.136518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2a311972-6da2-4342-a390-a6ec6e44960d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:48.156777 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2a311972-6da2-4342-a390-a6ec6e44960d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.380141 Aug 09 17:13:48.169519 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 806/1725] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:47 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:48.177820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:48.179019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:48.194859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-560b5387-f57e-4bf5-8eb8-32878aa63192 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:48.202716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:48.203475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:48.205842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:48.208741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:48.209351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:48.211318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:48.211913 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-560b5387-f57e-4bf5-8eb8-32878aa63192 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1368 microversion: 2.1 time: 1.441558 Aug 09 17:13:48.213395 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 920/1726] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:46 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1368 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:48.483516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:48.491356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:48.531579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:48.536621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:48.542318 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3a20659b-0e55-4350-86b0-90fe41d6cc7b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1293 microversion: 2.25 time: 0.372029 Aug 09 17:13:48.543408 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 807/1727] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:48 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1293 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:48.686238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b64fc0ab-b94c-4c98-878d-9fc31de56d09 req-f8bfdcd7-39b0-4dbe-bb9e-b04f9682a664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcdaafd-e14c-4307-aa16-fd4860b74633", "name": "network-vif-plugged", "status": "completed", "tag": "46ee644e-0b30-4955-a95a-7804f485464b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:48.730657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b64fc0ab-b94c-4c98-878d-9fc31de56d09 req-f8bfdcd7-39b0-4dbe-bb9e-b04f9682a664 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:48.731254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b64fc0ab-b94c-4c98-878d-9fc31de56d09 req-f8bfdcd7-39b0-4dbe-bb9e-b04f9682a664 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:48.732256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b64fc0ab-b94c-4c98-878d-9fc31de56d09 req-f8bfdcd7-39b0-4dbe-bb9e-b04f9682a664 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:48.762290 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b64fc0ab-b94c-4c98-878d-9fc31de56d09 req-f8bfdcd7-39b0-4dbe-bb9e-b04f9682a664 service nova] Creating event network-vif-plugged:46ee644e-0b30-4955-a95a-7804f485464b for instance 0fcdaafd-e14c-4307-aa16-fd4860b74633 on n-h1-845781-6 Aug 09 17:13:48.784242 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b64fc0ab-b94c-4c98-878d-9fc31de56d09 req-f8bfdcd7-39b0-4dbe-bb9e-b04f9682a664 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100954 Aug 09 17:13:48.793940 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 921/1728] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:48.819377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7408af40-1b6c-44c2-bf0c-201564e54219 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:48.821147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7408af40-1b6c-44c2-bf0c-201564e54219 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:48.842727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7408af40-1b6c-44c2-bf0c-201564e54219 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:48.843600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7408af40-1b6c-44c2-bf0c-201564e54219 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:48.844541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7408af40-1b6c-44c2-bf0c-201564e54219 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:48.849511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7408af40-1b6c-44c2-bf0c-201564e54219 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:48.850471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7408af40-1b6c-44c2-bf0c-201564e54219 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:48.851353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7408af40-1b6c-44c2-bf0c-201564e54219 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:49.201958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fa108d21-f209-481b-902e-88ea42dec4bb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:49.207385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fa108d21-f209-481b-902e-88ea42dec4bb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:49.230590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7408af40-1b6c-44c2-bf0c-201564e54219 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:49.239543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa108d21-f209-481b-902e-88ea42dec4bb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:49.246011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa108d21-f209-481b-902e-88ea42dec4bb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:49.247426 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7408af40-1b6c-44c2-bf0c-201564e54219 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1349 microversion: 2.1 time: 0.434182 Aug 09 17:13:49.248725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa108d21-f209-481b-902e-88ea42dec4bb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:49.264590 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 808/1729] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:48 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1349 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:49.266834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa108d21-f209-481b-902e-88ea42dec4bb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:49.279667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bb197d6a-232e-4576-8238-40ca698c24e1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:49.279667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bb197d6a-232e-4576-8238-40ca698c24e1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:49.279667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb197d6a-232e-4576-8238-40ca698c24e1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:49.280425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb197d6a-232e-4576-8238-40ca698c24e1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:49.281787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa108d21-f209-481b-902e-88ea42dec4bb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:49.288839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb197d6a-232e-4576-8238-40ca698c24e1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:49.290235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa108d21-f209-481b-902e-88ea42dec4bb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:49.291602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb197d6a-232e-4576-8238-40ca698c24e1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:49.294059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb197d6a-232e-4576-8238-40ca698c24e1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:49.296805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb197d6a-232e-4576-8238-40ca698c24e1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:49.948916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bb197d6a-232e-4576-8238-40ca698c24e1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:49.982151 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bb197d6a-232e-4576-8238-40ca698c24e1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1368 microversion: 2.1 time: 0.723064 Aug 09 17:13:50.023290 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 809/1730] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:49 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1368 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:50.040433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:50.051894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:50.067550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:50.078038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:50.078918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:50.081398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:50.083411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:50.084277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:50.338877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fa108d21-f209-481b-902e-88ea42dec4bb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:50.355538 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fa108d21-f209-481b-902e-88ea42dec4bb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 1.161165 Aug 09 17:13:50.358179 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 922/1731] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:49 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:50.376201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a417aac0-bc9c-4b5e-ac39-0991446aaa9a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:50.378036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a417aac0-bc9c-4b5e-ac39-0991446aaa9a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:50.406889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a417aac0-bc9c-4b5e-ac39-0991446aaa9a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:50.411250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a417aac0-bc9c-4b5e-ac39-0991446aaa9a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:50.412343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a417aac0-bc9c-4b5e-ac39-0991446aaa9a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:50.414974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a417aac0-bc9c-4b5e-ac39-0991446aaa9a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:50.416846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a417aac0-bc9c-4b5e-ac39-0991446aaa9a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:50.417576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a417aac0-bc9c-4b5e-ac39-0991446aaa9a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:50.468272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:50.507375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:50.514810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:50.518288 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ddea63f9-4019-4edf-a335-2035b5f56880 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1293 microversion: 2.25 time: 0.492588 Aug 09 17:13:50.524621 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 810/1732] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:50 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1293 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:51.036512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f2c413e-e7dd-4812-86d4-5f80c24adff4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:51.040750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8f2c413e-e7dd-4812-86d4-5f80c24adff4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:51.071950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2c413e-e7dd-4812-86d4-5f80c24adff4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:51.073271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2c413e-e7dd-4812-86d4-5f80c24adff4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:51.084862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2c413e-e7dd-4812-86d4-5f80c24adff4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:51.086858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2c413e-e7dd-4812-86d4-5f80c24adff4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:51.088379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2c413e-e7dd-4812-86d4-5f80c24adff4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:51.089529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2c413e-e7dd-4812-86d4-5f80c24adff4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:51.510716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8f2c413e-e7dd-4812-86d4-5f80c24adff4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:51.524037 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8f2c413e-e7dd-4812-86d4-5f80c24adff4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1368 microversion: 2.1 time: 0.496795 Aug 09 17:13:51.525641 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 811/1733] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:51 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1368 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:51.532899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5726e1a1-3667-4d2e-9d2b-7db765190a2b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:51.533604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5726e1a1-3667-4d2e-9d2b-7db765190a2b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:51.547458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5726e1a1-3667-4d2e-9d2b-7db765190a2b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:51.551079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5726e1a1-3667-4d2e-9d2b-7db765190a2b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:51.551880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5726e1a1-3667-4d2e-9d2b-7db765190a2b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:51.552825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5726e1a1-3667-4d2e-9d2b-7db765190a2b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:51.553500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5726e1a1-3667-4d2e-9d2b-7db765190a2b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:51.554178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5726e1a1-3667-4d2e-9d2b-7db765190a2b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:51.705767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a417aac0-bc9c-4b5e-ac39-0991446aaa9a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:51.735911 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a417aac0-bc9c-4b5e-ac39-0991446aaa9a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1539 microversion: 2.1 time: 1.371161 Aug 09 17:13:51.738289 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 923/1734] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:50 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1539 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:51.752756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:51.757834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:51.782942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:51.784257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:51.786849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:51.788940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:51.791409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:51.794155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:51.966659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5726e1a1-3667-4d2e-9d2b-7db765190a2b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:51.986945 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5726e1a1-3667-4d2e-9d2b-7db765190a2b tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.458517 Aug 09 17:13:51.988308 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 812/1735] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:51 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:52.012954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1112badc-1aa3-44eb-80cd-c83e5a0f28b7 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:52.013850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1112badc-1aa3-44eb-80cd-c83e5a0f28b7 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:52.032866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1112badc-1aa3-44eb-80cd-c83e5a0f28b7 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:52.033375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1112badc-1aa3-44eb-80cd-c83e5a0f28b7 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:52.039094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1112badc-1aa3-44eb-80cd-c83e5a0f28b7 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:52.040171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1112badc-1aa3-44eb-80cd-c83e5a0f28b7 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:52.041068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1112badc-1aa3-44eb-80cd-c83e5a0f28b7 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:52.041519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1112badc-1aa3-44eb-80cd-c83e5a0f28b7 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:52.187734 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1112badc-1aa3-44eb-80cd-c83e5a0f28b7 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192786 Aug 09 17:13:52.188681 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 813/1736] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:13:51 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:52.451299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:52.468629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:52.471211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:52.476116 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-28a1e10f-9fea-4d48-977f-4713ea59e577 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1293 microversion: 2.25 time: 0.734499 Aug 09 17:13:52.477100 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 924/1737] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:51 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1293 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:52.571778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0be81658-29bd-4505-8858-e415172f627d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:52.572607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0be81658-29bd-4505-8858-e415172f627d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:52.586134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be81658-29bd-4505-8858-e415172f627d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:52.589429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be81658-29bd-4505-8858-e415172f627d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:52.589982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be81658-29bd-4505-8858-e415172f627d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:52.590938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be81658-29bd-4505-8858-e415172f627d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:52.592326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be81658-29bd-4505-8858-e415172f627d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:52.595178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0be81658-29bd-4505-8858-e415172f627d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:52.862322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3d5c6613-b378-45ec-b02b-0274c06c5d3d req-ddae5af7-cb28-4840-95fa-3bf7e4187bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa81dada-6ad4-4d36-9deb-1a9d8e59fa29", "tag": "284be49d-a456-4cf0-93f3-b75907df99a5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:52.895468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3d5c6613-b378-45ec-b02b-0274c06c5d3d req-ddae5af7-cb28-4840-95fa-3bf7e4187bd1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:52.898340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3d5c6613-b378-45ec-b02b-0274c06c5d3d req-ddae5af7-cb28-4840-95fa-3bf7e4187bd1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:52.900114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3d5c6613-b378-45ec-b02b-0274c06c5d3d req-ddae5af7-cb28-4840-95fa-3bf7e4187bd1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:52.950235 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3d5c6613-b378-45ec-b02b-0274c06c5d3d req-ddae5af7-cb28-4840-95fa-3bf7e4187bd1 service nova] Creating event network-changed:284be49d-a456-4cf0-93f3-b75907df99a5 for instance fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 on n-h1-845781-6 Aug 09 17:13:52.967442 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3d5c6613-b378-45ec-b02b-0274c06c5d3d req-ddae5af7-cb28-4840-95fa-3bf7e4187bd1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115260 Aug 09 17:13:52.970789 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 925/1738] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:13:53.013661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c770b60-e736-4550-9c32-d5af59be9a67 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:53.015359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c770b60-e736-4550-9c32-d5af59be9a67 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:53.036819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c770b60-e736-4550-9c32-d5af59be9a67 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:53.040822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c770b60-e736-4550-9c32-d5af59be9a67 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:53.044737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c770b60-e736-4550-9c32-d5af59be9a67 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:53.049951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c770b60-e736-4550-9c32-d5af59be9a67 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:53.055216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c770b60-e736-4550-9c32-d5af59be9a67 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:53.056618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c770b60-e736-4550-9c32-d5af59be9a67 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:53.525436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0be81658-29bd-4505-8858-e415172f627d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:53.541445 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0be81658-29bd-4505-8858-e415172f627d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1558 microversion: 2.1 time: 0.974697 Aug 09 17:13:53.547695 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 814/1739] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:52 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1558 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:13:53.573729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:53.574815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:53.585222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:53.588444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:53.591888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:53.593178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:53.594199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:53.594799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:53.608298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c770b60-e736-4550-9c32-d5af59be9a67 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:53.614222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:53.622485 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c770b60-e736-4550-9c32-d5af59be9a67 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.613318 Aug 09 17:13:53.627445 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 926/1740] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:53 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:13:53.645472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a46c1c1b-c5e4-47f1-ae08-36c46c6e6eb4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:53.647078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a46c1c1b-c5e4-47f1-ae08-36c46c6e6eb4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:53.666879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a46c1c1b-c5e4-47f1-ae08-36c46c6e6eb4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:53.668486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a46c1c1b-c5e4-47f1-ae08-36c46c6e6eb4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:53.669672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a46c1c1b-c5e4-47f1-ae08-36c46c6e6eb4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:53.673258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a46c1c1b-c5e4-47f1-ae08-36c46c6e6eb4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:53.676256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a46c1c1b-c5e4-47f1-ae08-36c46c6e6eb4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:53.679935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a46c1c1b-c5e4-47f1-ae08-36c46c6e6eb4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:54.222150 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a46c1c1b-c5e4-47f1-ae08-36c46c6e6eb4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.592714 Aug 09 17:13:54.236181 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 927/1741] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:13:53 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-interface => generated 284 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:54.666789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a36ba37b-a055-48f5-9d18-473cdf08e655 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:54.671207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a36ba37b-a055-48f5-9d18-473cdf08e655 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:54.697545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a36ba37b-a055-48f5-9d18-473cdf08e655 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:54.698677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a36ba37b-a055-48f5-9d18-473cdf08e655 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:54.703808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a36ba37b-a055-48f5-9d18-473cdf08e655 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:54.706276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a36ba37b-a055-48f5-9d18-473cdf08e655 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:54.712403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a36ba37b-a055-48f5-9d18-473cdf08e655 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:54.713949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a36ba37b-a055-48f5-9d18-473cdf08e655 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:54.842879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:54.866584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:54.877168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:54.880238 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0cc1f99b-2bb6-41d2-8ad5-ce765a309c52 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1293 microversion: 2.25 time: 1.330685 Aug 09 17:13:54.884911 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 815/1742] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:53 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1293 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:55.931998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:55.931998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:55.951995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:55.952564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:55.954303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:55.959135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:55.960280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:55.960988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:56.418763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:56.825508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:56.849466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:56.853967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:56.858478 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-327b742a-af44-4f00-92b9-6730c6dc633c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1293 microversion: 2.25 time: 0.935428 Aug 09 17:13:56.861057 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 816/1743] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:55 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1293 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:57.094469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=30 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:57.306805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-310515c8-e117-4895-a9c0-e17ec3b2f06d req-c95faedb-8f26-4aeb-a0fd-e344b0b2e975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15affa7d-ca83-47fa-b24b-cec8a05fcda3", "tag": "a77d9b7e-e498-4db6-84eb-6ac98cfc71de"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:13:57.329583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-310515c8-e117-4895-a9c0-e17ec3b2f06d req-c95faedb-8f26-4aeb-a0fd-e344b0b2e975 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:57.330505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-310515c8-e117-4895-a9c0-e17ec3b2f06d req-c95faedb-8f26-4aeb-a0fd-e344b0b2e975 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:57.331371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-310515c8-e117-4895-a9c0-e17ec3b2f06d req-c95faedb-8f26-4aeb-a0fd-e344b0b2e975 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:57.374088 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-310515c8-e117-4895-a9c0-e17ec3b2f06d req-c95faedb-8f26-4aeb-a0fd-e344b0b2e975 service nova] Creating event network-changed:a77d9b7e-e498-4db6-84eb-6ac98cfc71de for instance 15affa7d-ca83-47fa-b24b-cec8a05fcda3 on n-h1-845781-6 Aug 09 17:13:57.380815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a36ba37b-a055-48f5-9d18-473cdf08e655 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:57.428849 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-310515c8-e117-4895-a9c0-e17ec3b2f06d req-c95faedb-8f26-4aeb-a0fd-e344b0b2e975 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.562672 Aug 09 17:13:57.442842 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a36ba37b-a055-48f5-9d18-473cdf08e655 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 2.782187 Aug 09 17:13:57.443607 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 817/1744] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:13:57.444580 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 928/1745] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:54 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 2788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:13:57.902740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:57.906622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:57.939388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:57.942210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:57.945655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:57.950306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:57.952226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:57.959122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:58.460982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:58.471081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e70480d-79be-43e2-a160-7f3882296ce4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:58.471769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e70480d-79be-43e2-a160-7f3882296ce4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:58.478966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:58.481789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:13:58.484236 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4fd259e8-3728-4617-8c64-04c75c68bebc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1293 microversion: 2.25 time: 0.595589 Aug 09 17:13:58.487288 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 818/1746] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:57 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1293 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:13:58.489997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e70480d-79be-43e2-a160-7f3882296ce4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:58.490642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e70480d-79be-43e2-a160-7f3882296ce4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:58.491094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e70480d-79be-43e2-a160-7f3882296ce4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:58.493259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e70480d-79be-43e2-a160-7f3882296ce4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:58.493781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e70480d-79be-43e2-a160-7f3882296ce4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:58.497883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e70480d-79be-43e2-a160-7f3882296ce4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:58.567087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:13:59.546441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:13:59.563702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:13:59.598996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:59.607480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:59.613656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:13:59.615886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:13:59.617418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:13:59.618744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:00.743756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:00.821462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:00.841088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:00.846874 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-77096e5e-b7b3-406e-98e1-3e42fd6e158e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1293 microversion: 2.25 time: 1.310389 Aug 09 17:14:00.850645 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 819/1747] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:13:59 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1293 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:01.446941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e70480d-79be-43e2-a160-7f3882296ce4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:01.478321 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e70480d-79be-43e2-a160-7f3882296ce4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 3.010497 Aug 09 17:14:01.545496 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 929/1748] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:13:58 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 3077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:14:01.911482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:01.912401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:01.926243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:01.933408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:01.934387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:01.938670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:01.939266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:01.939886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:02.516301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:02.530176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:02.539415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:02.541338 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-58f1f8de-3a3d-429c-a601-5385d31d892f tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1293 microversion: 2.25 time: 0.634631 Aug 09 17:14:02.544400 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 820/1749] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:01 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1293 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:14:02.546657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0a52a5bc-a63c-4748-bb5e-7f4e4da8ef79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:02.548090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0a52a5bc-a63c-4748-bb5e-7f4e4da8ef79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:02.567056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a52a5bc-a63c-4748-bb5e-7f4e4da8ef79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:02.568826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a52a5bc-a63c-4748-bb5e-7f4e4da8ef79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:02.570008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a52a5bc-a63c-4748-bb5e-7f4e4da8ef79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:02.572117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a52a5bc-a63c-4748-bb5e-7f4e4da8ef79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:02.573568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a52a5bc-a63c-4748-bb5e-7f4e4da8ef79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:02.574677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a52a5bc-a63c-4748-bb5e-7f4e4da8ef79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:02.911033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-0890fa2c-c063-45e2-b73f-e62a38d2f0fc req-303c2e9d-7fd9-4904-a772-e2254f368957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fcdaafd-e14c-4307-aa16-fd4860b74633", "tag": "46ee644e-0b30-4955-a95a-7804f485464b"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:02.925165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0890fa2c-c063-45e2-b73f-e62a38d2f0fc req-303c2e9d-7fd9-4904-a772-e2254f368957 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:02.926730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0890fa2c-c063-45e2-b73f-e62a38d2f0fc req-303c2e9d-7fd9-4904-a772-e2254f368957 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:02.926730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0890fa2c-c063-45e2-b73f-e62a38d2f0fc req-303c2e9d-7fd9-4904-a772-e2254f368957 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:02.941245 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-0890fa2c-c063-45e2-b73f-e62a38d2f0fc req-303c2e9d-7fd9-4904-a772-e2254f368957 service nova] Creating event network-changed:46ee644e-0b30-4955-a95a-7804f485464b for instance 0fcdaafd-e14c-4307-aa16-fd4860b74633 on n-h1-845781-6 Aug 09 17:14:02.955757 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-0890fa2c-c063-45e2-b73f-e62a38d2f0fc req-303c2e9d-7fd9-4904-a772-e2254f368957 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.345277 Aug 09 17:14:02.957729 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 821/1750] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:14:03.463448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0a52a5bc-a63c-4748-bb5e-7f4e4da8ef79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:03.492043 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0a52a5bc-a63c-4748-bb5e-7f4e4da8ef79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.956095 Aug 09 17:14:03.497493 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 930/1751] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:02 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:03.587776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:03.589308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:03.612155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:03.616377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:03.617121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:03.620382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:03.621185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:03.624429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:03.890561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:03.903476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:03.906367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:03.909126 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-56324e8b-f75b-45c2-a137-ebcd8362c905 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1293 microversion: 2.25 time: 0.325684 Aug 09 17:14:03.911155 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 822/1752] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:03 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1293 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:14:04.524057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6cd8583e-ea3d-49d0-aa94-3acc48ab3290 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:04.524840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6cd8583e-ea3d-49d0-aa94-3acc48ab3290 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:04.556832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd8583e-ea3d-49d0-aa94-3acc48ab3290 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:04.559526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd8583e-ea3d-49d0-aa94-3acc48ab3290 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:04.564199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd8583e-ea3d-49d0-aa94-3acc48ab3290 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:04.568397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd8583e-ea3d-49d0-aa94-3acc48ab3290 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:04.573822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd8583e-ea3d-49d0-aa94-3acc48ab3290 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:04.576101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd8583e-ea3d-49d0-aa94-3acc48ab3290 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:04.949685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:04.951046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:04.972275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:04.973676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:04.974350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:04.975321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:04.976012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:04.976640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:05.273179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6cd8583e-ea3d-49d0-aa94-3acc48ab3290 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:05.286978 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6cd8583e-ea3d-49d0-aa94-3acc48ab3290 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.767623 Aug 09 17:14:05.291794 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 931/1753] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:04 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:14:05.325057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:05.366397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:05.374956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:05.378215 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e5ae794-b833-45bb-a5eb-4f90d4592f9c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1293 microversion: 2.25 time: 0.432176 Aug 09 17:14:05.399485 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 823/1754] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:04 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1293 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:14:06.322191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ef15e421-ac13-46c0-bdae-651a9eefa3eb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:06.323404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ef15e421-ac13-46c0-bdae-651a9eefa3eb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:06.347180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef15e421-ac13-46c0-bdae-651a9eefa3eb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:06.348699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef15e421-ac13-46c0-bdae-651a9eefa3eb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:06.349866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef15e421-ac13-46c0-bdae-651a9eefa3eb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:06.351458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef15e421-ac13-46c0-bdae-651a9eefa3eb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:06.352595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef15e421-ac13-46c0-bdae-651a9eefa3eb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:06.353620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef15e421-ac13-46c0-bdae-651a9eefa3eb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:06.423945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:06.431391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:06.455303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:06.456451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:06.457230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:06.458497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:06.460111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:06.461317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:07.126810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:07.152767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:07.163608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:07.167756 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-49bec65b-fc6a-4759-b850-47ac5b0656c7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1281 microversion: 2.25 time: 0.750415 Aug 09 17:14:07.170322 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 824/1755] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:06 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1281 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:07.432212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ef15e421-ac13-46c0-bdae-651a9eefa3eb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:07.451095 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ef15e421-ac13-46c0-bdae-651a9eefa3eb tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 1.137500 Aug 09 17:14:07.452408 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 932/1756] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:06 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:14:08.182351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-8815f397-6019-491f-a215-6287dd98c27f req-998821e7-018a-4efb-93a8-af645ade52b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "376cf93a-be81-477e-a0c7-656834c3d899", "name": "network-vif-unplugged", "status": "completed", "tag": "808a2a00-f141-4144-9ff7-439ca998a941"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:08.202977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:08.205858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:08.240783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8815f397-6019-491f-a215-6287dd98c27f req-998821e7-018a-4efb-93a8-af645ade52b0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:08.241627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8815f397-6019-491f-a215-6287dd98c27f req-998821e7-018a-4efb-93a8-af645ade52b0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:08.242219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:08.242475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8815f397-6019-491f-a215-6287dd98c27f req-998821e7-018a-4efb-93a8-af645ade52b0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:08.245015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:08.246942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:08.252721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:08.256714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:08.259702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:08.272767 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-8815f397-6019-491f-a215-6287dd98c27f req-998821e7-018a-4efb-93a8-af645ade52b0 service nova] Creating event network-vif-unplugged:808a2a00-f141-4144-9ff7-439ca998a941 for instance 376cf93a-be81-477e-a0c7-656834c3d899 on n-h2-845781-6 Aug 09 17:14:08.285454 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-8815f397-6019-491f-a215-6287dd98c27f req-998821e7-018a-4efb-93a8-af645ade52b0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110589 Aug 09 17:14:08.296041 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 825/1757] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:08.499207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-db2977e6-db29-4b9a-ba49-71265054ac97 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:08.504503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-db2977e6-db29-4b9a-ba49-71265054ac97 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:08.527002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db2977e6-db29-4b9a-ba49-71265054ac97 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:08.528206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db2977e6-db29-4b9a-ba49-71265054ac97 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:08.529022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db2977e6-db29-4b9a-ba49-71265054ac97 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:08.530406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db2977e6-db29-4b9a-ba49-71265054ac97 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:08.531168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db2977e6-db29-4b9a-ba49-71265054ac97 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:08.542440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db2977e6-db29-4b9a-ba49-71265054ac97 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:09.128450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:09.146289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:09.154311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:09.159384 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-16a9a9c4-e146-4dfe-a243-6e0142449736 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1281 microversion: 2.25 time: 0.965914 Aug 09 17:14:09.164201 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 933/1758] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:08 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1281 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:09.695834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-db2977e6-db29-4b9a-ba49-71265054ac97 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:09.730352 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-db2977e6-db29-4b9a-ba49-71265054ac97 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 1.237951 Aug 09 17:14:09.740488 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 826/1759] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:08 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:14:10.203836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:10.206196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:10.268255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:10.274968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:10.280070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:10.281847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:10.284735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:10.286899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:10.435855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-491eef73-f787-4c96-b10f-f4fe64effd60 req-deb5c0ca-f050-4967-9ab4-71db17de8fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "376cf93a-be81-477e-a0c7-656834c3d899", "tag": "808a2a00-f141-4144-9ff7-439ca998a941"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:10.471117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-491eef73-f787-4c96-b10f-f4fe64effd60 req-deb5c0ca-f050-4967-9ab4-71db17de8fa3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:10.476397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-491eef73-f787-4c96-b10f-f4fe64effd60 req-deb5c0ca-f050-4967-9ab4-71db17de8fa3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:10.481435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-491eef73-f787-4c96-b10f-f4fe64effd60 req-deb5c0ca-f050-4967-9ab4-71db17de8fa3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:10.541483 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-491eef73-f787-4c96-b10f-f4fe64effd60 req-deb5c0ca-f050-4967-9ab4-71db17de8fa3 service nova] Creating event network-changed:808a2a00-f141-4144-9ff7-439ca998a941 for instance 376cf93a-be81-477e-a0c7-656834c3d899 on n-h2-845781-6 Aug 09 17:14:10.560282 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-491eef73-f787-4c96-b10f-f4fe64effd60 req-deb5c0ca-f050-4967-9ab4-71db17de8fa3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131274 Aug 09 17:14:10.562693 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 827/1760] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:10.766641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ffed8268-f81e-45d7-b8da-a6d84690fe79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:10.775832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ffed8268-f81e-45d7-b8da-a6d84690fe79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:10.784245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:14:10.818431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffed8268-f81e-45d7-b8da-a6d84690fe79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:10.820507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffed8268-f81e-45d7-b8da-a6d84690fe79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:10.823477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffed8268-f81e-45d7-b8da-a6d84690fe79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:10.825593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffed8268-f81e-45d7-b8da-a6d84690fe79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:10.830217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffed8268-f81e-45d7-b8da-a6d84690fe79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:10.831245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffed8268-f81e-45d7-b8da-a6d84690fe79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:11.216651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:11.258861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:11.268468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:11.275851 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-884eb5de-5ae5-43c7-b63d-cdc9d4ea68ea tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1281 microversion: 2.25 time: 1.088450 Aug 09 17:14:11.281844 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 934/1761] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:10 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1281 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:11.490978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ffed8268-f81e-45d7-b8da-a6d84690fe79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:11.524373 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ffed8268-f81e-45d7-b8da-a6d84690fe79 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.767061 Aug 09 17:14:11.540356 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 828/1762] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:10 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:12.312593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:12.319328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:12.371101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:12.372397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:12.376498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:12.382323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:12.384044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:12.387798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:12.560811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-45de6113-5e11-4a8a-bee4-ef4e1fc39302 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:12.563402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-45de6113-5e11-4a8a-bee4-ef4e1fc39302 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:12.579568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45de6113-5e11-4a8a-bee4-ef4e1fc39302 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:12.581039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45de6113-5e11-4a8a-bee4-ef4e1fc39302 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:12.582405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45de6113-5e11-4a8a-bee4-ef4e1fc39302 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:12.584384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45de6113-5e11-4a8a-bee4-ef4e1fc39302 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:12.585810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45de6113-5e11-4a8a-bee4-ef4e1fc39302 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:12.587491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45de6113-5e11-4a8a-bee4-ef4e1fc39302 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:13.232505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:13.275838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:13.288417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:13.291485 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-32ef75cb-0bed-4510-b003-8cd75f2daf43 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1281 microversion: 2.25 time: 0.990964 Aug 09 17:14:13.294016 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 935/1763] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:12 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1281 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:14:13.534215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45de6113-5e11-4a8a-bee4-ef4e1fc39302 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:13.561709 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-45de6113-5e11-4a8a-bee4-ef4e1fc39302 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 1.011826 Aug 09 17:14:13.572632 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 829/1764] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:12 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:14.250764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6414a42e-ce66-408d-bdf7-1b536f5d0db6 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'create', calling method: .version_select at 0x7fbbcb6a5b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-308521833", "description": "tempest-description-171783042"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:14.324347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:14.332914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:14.385937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:14.390928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:14.392248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:14.395804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:14.399059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:14.401782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:14.769023 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6414a42e-ce66-408d-bdf7-1b536f5d0db6 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.239985 Aug 09 17:14:14.770800 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 936/1765] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:14:13 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:14:14.793436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-888a394d-dbe9-4f74-8407-89b1c7d12e8f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:14.795309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-888a394d-dbe9-4f74-8407-89b1c7d12e8f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:14.840398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888a394d-dbe9-4f74-8407-89b1c7d12e8f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:14.841305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888a394d-dbe9-4f74-8407-89b1c7d12e8f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:14.841840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888a394d-dbe9-4f74-8407-89b1c7d12e8f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:14.842981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888a394d-dbe9-4f74-8407-89b1c7d12e8f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:14.843547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888a394d-dbe9-4f74-8407-89b1c7d12e8f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:14.858753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888a394d-dbe9-4f74-8407-89b1c7d12e8f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:14.904186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:14.930666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:14.943329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:14.947246 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-800dfd34-d011-42ca-b745-d4d3b990ba55 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1281 microversion: 2.25 time: 0.631151 Aug 09 17:14:14.951338 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 830/1766] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:14 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1281 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:14:14.967299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0936f319-8a38-4f83-b287-21d3ba1fabba tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'create', calling method: .version_select at 0x7fbbcb8c7ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-531500027", "description": "tempest-description-558532736"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:15.324715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-888a394d-dbe9-4f74-8407-89b1c7d12e8f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:15.367793 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-888a394d-dbe9-4f74-8407-89b1c7d12e8f tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.590953 Aug 09 17:14:15.370093 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 937/1767] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:14 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:15.995962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:16.004871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:16.036619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:16.037733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:16.041192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:16.046383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:16.056303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:16.061716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:16.111494 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0936f319-8a38-4f83-b287-21d3ba1fabba tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.158160 Aug 09 17:14:16.112623 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 831/1768] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:14:14 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:16.403210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-163cf951-e709-49fb-b822-3dc56e751c73 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:16.419159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-163cf951-e709-49fb-b822-3dc56e751c73 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:16.492606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-163cf951-e709-49fb-b822-3dc56e751c73 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:16.493500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-163cf951-e709-49fb-b822-3dc56e751c73 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:16.494295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-163cf951-e709-49fb-b822-3dc56e751c73 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:16.508814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-163cf951-e709-49fb-b822-3dc56e751c73 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:16.512805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-163cf951-e709-49fb-b822-3dc56e751c73 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:16.517710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-163cf951-e709-49fb-b822-3dc56e751c73 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:16.636545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:16.653280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:16.655661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:16.659285 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dbd7c19c-b311-4f99-b137-a8e920308b04 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1281 microversion: 2.25 time: 0.691452 Aug 09 17:14:16.663483 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 938/1769] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:15 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1281 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:16.679432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-113904271", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "25d74a20-a9e8-476d-a8b6-c80effe85c41"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:16.726358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:14:16.813022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] validate_networks() for [('25d74a20-a9e8-476d-a8b6-c80effe85c41', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:14:17.260529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-163cf951-e709-49fb-b822-3dc56e751c73 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:17.277399 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-163cf951-e709-49fb-b822-3dc56e751c73 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.883706 Aug 09 17:14:17.280890 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 832/1770] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:16 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:14:17.692220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:17.692911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:17.707927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:17.709619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:17.710295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:17.716451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:17.717235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:17.717913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:18.463863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:14:18.464681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:14:18.465188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:14:18.465868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:14:18.466449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:14:18.492019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:18.493525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:18.497968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:18.499083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:18.499750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:18.500343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:18.526901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Getting quotas for project f8ff2acea44b4a108d6bd1083b255e72. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:14:18.538428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Getting quotas for user 4fbccf8cda9b43fda5ec9ae0fc0be735 and project f8ff2acea44b4a108d6bd1083b255e72. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:14:18.563170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:14:18.564362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:18.567285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:14:18.600889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:18.604106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:18.610916 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5d55b518-650a-4c0d-9224-f9cb64a77331 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1281 microversion: 2.25 time: 0.923190 Aug 09 17:14:18.614934 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 833/1771] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:17 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1281 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:14:18.632952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-caffb114-2909-4d6b-bdfa-54e8d2ddcafe tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:18.650217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-caffb114-2909-4d6b-bdfa-54e8d2ddcafe tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:18.654509 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c1c9c414-ab79-4317-9783-e87987f75177 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.986371 Aug 09 17:14:18.656132 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 939/1772] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:14:18.681975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-623de73b-5735-4fb7-9795-e9737d0a3e38 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:18.683103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-623de73b-5735-4fb7-9795-e9737d0a3e38 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:18.693552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caffb114-2909-4d6b-bdfa-54e8d2ddcafe tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:18.694130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caffb114-2909-4d6b-bdfa-54e8d2ddcafe tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:18.698533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caffb114-2909-4d6b-bdfa-54e8d2ddcafe tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:18.703116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caffb114-2909-4d6b-bdfa-54e8d2ddcafe tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:18.710000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caffb114-2909-4d6b-bdfa-54e8d2ddcafe tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:18.712649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-caffb114-2909-4d6b-bdfa-54e8d2ddcafe tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:18.921260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-623de73b-5735-4fb7-9795-e9737d0a3e38 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:18.942000 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-623de73b-5735-4fb7-9795-e9737d0a3e38 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1215 microversion: 2.1 time: 0.271862 Aug 09 17:14:18.948214 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 940/1773] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:18 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1215 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:18.987076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:19.003096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:19.022137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:19.037665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:19.038442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:19.040172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:19.040995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:19.041736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:19.432560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-caffb114-2909-4d6b-bdfa-54e8d2ddcafe tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:19.469898 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-caffb114-2909-4d6b-bdfa-54e8d2ddcafe tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.846805 Aug 09 17:14:19.477040 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 834/1774] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:18 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:19.653505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:19.656862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:19.696053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:19.711312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:19.714668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:19.717626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:19.724056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:19.726563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:19.819653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:14:19.926031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:19.963584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:19.974085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:19.980845 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1dc6b47d-6314-44b8-a18d-453d4122662f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2956 microversion: 2.42 time: 1.000899 Aug 09 17:14:19.988131 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 941/1775] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:18 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2956 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:20.007060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22e15f54-d981-4e4b-9df9-04c0a243d834 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:20.013203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-22e15f54-d981-4e4b-9df9-04c0a243d834 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:20.271034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-22e15f54-d981-4e4b-9df9-04c0a243d834 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:20.302784 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-22e15f54-d981-4e4b-9df9-04c0a243d834 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1215 microversion: 2.1 time: 0.308889 Aug 09 17:14:20.307046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:20.333025 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 942/1776] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:19 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:20.345478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a3cb9bc6-78fb-4f8f-b54a-44d4529b44ee tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:20.346894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a3cb9bc6-78fb-4f8f-b54a-44d4529b44ee tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:20.347123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:20.354857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:20.362508 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c7c631a2-c1bf-455d-8835-c19c37356d84 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1281 microversion: 2.25 time: 0.719570 Aug 09 17:14:20.364355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3cb9bc6-78fb-4f8f-b54a-44d4529b44ee tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:20.365423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3cb9bc6-78fb-4f8f-b54a-44d4529b44ee tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:20.365790 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 835/1777] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:19 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1281 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:20.382628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3cb9bc6-78fb-4f8f-b54a-44d4529b44ee tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:20.384161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3cb9bc6-78fb-4f8f-b54a-44d4529b44ee tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:20.386637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3cb9bc6-78fb-4f8f-b54a-44d4529b44ee tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:20.388125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3cb9bc6-78fb-4f8f-b54a-44d4529b44ee tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:20.503047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-33cb6285-49b9-4ab3-ad2e-5eb2553d6db4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:20.504627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-33cb6285-49b9-4ab3-ad2e-5eb2553d6db4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:20.547692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33cb6285-49b9-4ab3-ad2e-5eb2553d6db4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:20.551581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33cb6285-49b9-4ab3-ad2e-5eb2553d6db4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:20.552408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33cb6285-49b9-4ab3-ad2e-5eb2553d6db4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:20.569865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33cb6285-49b9-4ab3-ad2e-5eb2553d6db4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:20.570355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33cb6285-49b9-4ab3-ad2e-5eb2553d6db4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:20.570807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33cb6285-49b9-4ab3-ad2e-5eb2553d6db4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:20.976998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-33cb6285-49b9-4ab3-ad2e-5eb2553d6db4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:20.994021 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-33cb6285-49b9-4ab3-ad2e-5eb2553d6db4 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.496293 Aug 09 17:14:21.000210 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 836/1778] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:20 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:14:21.796738 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a3cb9bc6-78fb-4f8f-b54a-44d4529b44ee tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf/os-interface" status: 200 len: 1830 microversion: 2.42 time: 1.461029 Aug 09 17:14:21.798151 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 943/1779] 10.222.0.93 () {60 vars in 1316 bytes} [Tue Aug 9 17:14:20 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf/os-interface => generated 1830 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:21.819539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cf648eff-fe9e-458a-8ebe-9682dd1489ab tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:21.823992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cf648eff-fe9e-458a-8ebe-9682dd1489ab tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:21.855373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf648eff-fe9e-458a-8ebe-9682dd1489ab tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:21.857799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf648eff-fe9e-458a-8ebe-9682dd1489ab tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:21.860158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf648eff-fe9e-458a-8ebe-9682dd1489ab tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:21.866079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf648eff-fe9e-458a-8ebe-9682dd1489ab tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:21.872877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf648eff-fe9e-458a-8ebe-9682dd1489ab tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:21.876335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf648eff-fe9e-458a-8ebe-9682dd1489ab tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:21.924413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-b85bcfca-057d-4373-9ef8-85572f9d1764 req-f1d8a43e-cb00-4872-9cf3-51cddeefa147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa81dada-6ad4-4d36-9deb-1a9d8e59fa29", "name": "network-vif-plugged", "status": "completed", "tag": "284be49d-a456-4cf0-93f3-b75907df99a5"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:21.968668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b85bcfca-057d-4373-9ef8-85572f9d1764 req-f1d8a43e-cb00-4872-9cf3-51cddeefa147 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:21.971578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b85bcfca-057d-4373-9ef8-85572f9d1764 req-f1d8a43e-cb00-4872-9cf3-51cddeefa147 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:21.974019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b85bcfca-057d-4373-9ef8-85572f9d1764 req-f1d8a43e-cb00-4872-9cf3-51cddeefa147 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:22.059501 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-b85bcfca-057d-4373-9ef8-85572f9d1764 req-f1d8a43e-cb00-4872-9cf3-51cddeefa147 service nova] Creating event network-vif-plugged:284be49d-a456-4cf0-93f3-b75907df99a5 for instance fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 on n-h1-845781-6 Aug 09 17:14:22.080430 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-b85bcfca-057d-4373-9ef8-85572f9d1764 req-f1d8a43e-cb00-4872-9cf3-51cddeefa147 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.760240 Aug 09 17:14:22.088303 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 837/1780] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:14:22.122586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cf648eff-fe9e-458a-8ebe-9682dd1489ab tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:22.136946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:22.141707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:22.160460 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cf648eff-fe9e-458a-8ebe-9682dd1489ab tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1285 microversion: 2.1 time: 0.351474 Aug 09 17:14:22.163277 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 944/1781] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:21 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1285 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:22.201606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:22.205573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:22.207856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:22.214012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:22.220751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:22.224614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:22.380483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1ef91572-3cf3-4ce5-9eab-d85611d84989 tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Action: 'create', calling method: .version_select at 0x7fbbcbb25a60>, body: {"pool": null} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:22.853048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:22.883098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:22.895337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:22.897810 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3a32cf96-0ee6-4af3-b794-428cb1c5ba0c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1281 microversion: 2.25 time: 0.806731 Aug 09 17:14:22.898955 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 838/1782] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:22 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1281 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:22.930021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7824cc2d-18b5-4d56-a090-b4e95ac7fec3 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:22.931307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7824cc2d-18b5-4d56-a090-b4e95ac7fec3 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:22.943050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7824cc2d-18b5-4d56-a090-b4e95ac7fec3 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:22.944069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7824cc2d-18b5-4d56-a090-b4e95ac7fec3 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:22.945025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7824cc2d-18b5-4d56-a090-b4e95ac7fec3 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:22.946254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7824cc2d-18b5-4d56-a090-b4e95ac7fec3 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:22.947283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7824cc2d-18b5-4d56-a090-b4e95ac7fec3 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:22.949013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7824cc2d-18b5-4d56-a090-b4e95ac7fec3 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:23.540314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7824cc2d-18b5-4d56-a090-b4e95ac7fec3 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:23.557649 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7824cc2d-18b5-4d56-a090-b4e95ac7fec3 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.637899 Aug 09 17:14:23.575258 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 839/1783] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:22 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:23.587348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d32c253b-f997-4358-a93d-4467ec789a0e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:23.592803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d32c253b-f997-4358-a93d-4467ec789a0e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:23.609295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d32c253b-f997-4358-a93d-4467ec789a0e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:23.611143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d32c253b-f997-4358-a93d-4467ec789a0e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:23.613731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d32c253b-f997-4358-a93d-4467ec789a0e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:23.614838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d32c253b-f997-4358-a93d-4467ec789a0e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:23.617409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d32c253b-f997-4358-a93d-4467ec789a0e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:23.619449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d32c253b-f997-4358-a93d-4467ec789a0e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:24.491523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d32c253b-f997-4358-a93d-4467ec789a0e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:24.515242 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d32c253b-f997-4358-a93d-4467ec789a0e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1315 microversion: 2.1 time: 0.937464 Aug 09 17:14:24.536169 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 840/1784] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:23 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:24.538635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:24.542147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:24.566117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:24.570389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:24.571571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:24.574271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:24.576263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:24.578397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:25.388478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:25.410855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:25.416020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:25.420573 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9ba878db-4aca-4cb6-9d40-08ddee88b517 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1477 microversion: 2.25 time: 0.896912 Aug 09 17:14:25.424035 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 841/1785] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:24 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1477 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:25.445378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-243c4626-2b42-468e-a2ad-007e579ae687 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:25.447932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-243c4626-2b42-468e-a2ad-007e579ae687 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:25.474436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-243c4626-2b42-468e-a2ad-007e579ae687 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:25.475175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-243c4626-2b42-468e-a2ad-007e579ae687 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:25.475719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-243c4626-2b42-468e-a2ad-007e579ae687 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:25.478740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-243c4626-2b42-468e-a2ad-007e579ae687 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:25.480095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-243c4626-2b42-468e-a2ad-007e579ae687 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:25.483201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-243c4626-2b42-468e-a2ad-007e579ae687 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:25.964078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-243c4626-2b42-468e-a2ad-007e579ae687 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:25.985145 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-243c4626-2b42-468e-a2ad-007e579ae687 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1392 microversion: 2.1 time: 0.557235 Aug 09 17:14:25.986555 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 842/1786] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:25 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1392 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:26.001679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-350cc6f1-92c1-4764-a117-d2c46ee33006 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:26.003192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-350cc6f1-92c1-4764-a117-d2c46ee33006 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:26.023112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-350cc6f1-92c1-4764-a117-d2c46ee33006 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:26.023614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-350cc6f1-92c1-4764-a117-d2c46ee33006 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:26.024082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-350cc6f1-92c1-4764-a117-d2c46ee33006 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:26.028991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-350cc6f1-92c1-4764-a117-d2c46ee33006 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:26.036593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-350cc6f1-92c1-4764-a117-d2c46ee33006 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:26.037682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-350cc6f1-92c1-4764-a117-d2c46ee33006 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:26.640365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-350cc6f1-92c1-4764-a117-d2c46ee33006 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:14:26.676555 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-350cc6f1-92c1-4764-a117-d2c46ee33006 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1970 microversion: 2.25 time: 0.685058 Aug 09 17:14:26.677547 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 843/1787] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:25 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1970 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:26.685019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-16011ba0-f56a-4962-bf46-fb06cc7f4c6b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:26.685983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-16011ba0-f56a-4962-bf46-fb06cc7f4c6b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:26.700806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16011ba0-f56a-4962-bf46-fb06cc7f4c6b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:26.701316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16011ba0-f56a-4962-bf46-fb06cc7f4c6b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:26.702085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16011ba0-f56a-4962-bf46-fb06cc7f4c6b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:26.702823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16011ba0-f56a-4962-bf46-fb06cc7f4c6b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:26.703283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16011ba0-f56a-4962-bf46-fb06cc7f4c6b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:26.703752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16011ba0-f56a-4962-bf46-fb06cc7f4c6b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:27.180016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-16011ba0-f56a-4962-bf46-fb06cc7f4c6b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:27.197419 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-16011ba0-f56a-4962-bf46-fb06cc7f4c6b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1315 microversion: 2.1 time: 0.517733 Aug 09 17:14:27.198017 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 844/1788] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:26 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:27.205624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a22e6403-4818-4d98-9bf4-f48212c71b4f tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:27.206259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a22e6403-4818-4d98-9bf4-f48212c71b4f tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:27.241330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a22e6403-4818-4d98-9bf4-f48212c71b4f tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:27.242017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a22e6403-4818-4d98-9bf4-f48212c71b4f tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:27.242530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a22e6403-4818-4d98-9bf4-f48212c71b4f tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:27.245647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a22e6403-4818-4d98-9bf4-f48212c71b4f tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:27.249572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a22e6403-4818-4d98-9bf4-f48212c71b4f tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:27.250038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a22e6403-4818-4d98-9bf4-f48212c71b4f tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:27.312545 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1ef91572-3cf3-4ce5-9eab-d85611d84989 tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.127411 Aug 09 17:14:27.313593 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 945/1789] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:14:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:27.334859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-28321bf2-4d54-4783-9112-5ae9eee39bec tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:27.335893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-28321bf2-4d54-4783-9112-5ae9eee39bec tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:27.349331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28321bf2-4d54-4783-9112-5ae9eee39bec tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:27.350989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28321bf2-4d54-4783-9112-5ae9eee39bec tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:27.352285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28321bf2-4d54-4783-9112-5ae9eee39bec tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:27.355219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28321bf2-4d54-4783-9112-5ae9eee39bec tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:27.355927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28321bf2-4d54-4783-9112-5ae9eee39bec tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:27.358235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28321bf2-4d54-4783-9112-5ae9eee39bec tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:27.537169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-a22e6403-4818-4d98-9bf4-f48212c71b4f tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:14:27.559946 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a22e6403-4818-4d98-9bf4-f48212c71b4f tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1970 microversion: 2.25 time: 0.360179 Aug 09 17:14:27.561208 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 845/1790] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:27 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1970 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:27.567124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-b162dea1-9f0f-4a75-8136-4365568fcdf5 req-c16015a7-00dc-45b0-b39d-d3df1039b55f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5", "tag": "96686b6e-95b8-47d5-945e-72122d48ef23"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:27.578205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b162dea1-9f0f-4a75-8136-4365568fcdf5 req-c16015a7-00dc-45b0-b39d-d3df1039b55f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:27.579269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b162dea1-9f0f-4a75-8136-4365568fcdf5 req-c16015a7-00dc-45b0-b39d-d3df1039b55f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:27.579856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b162dea1-9f0f-4a75-8136-4365568fcdf5 req-c16015a7-00dc-45b0-b39d-d3df1039b55f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:27.598885 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-b162dea1-9f0f-4a75-8136-4365568fcdf5 req-c16015a7-00dc-45b0-b39d-d3df1039b55f service nova] Creating event network-changed:96686b6e-95b8-47d5-945e-72122d48ef23 for instance dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 on n-h2-845781-6 Aug 09 17:14:27.606750 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-b162dea1-9f0f-4a75-8136-4365568fcdf5 req-c16015a7-00dc-45b0-b39d-d3df1039b55f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043335 Aug 09 17:14:27.608075 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 846/1791] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:27.621255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fcda7a12-55de-44ac-9f31-37ce419cb2d2 tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Calling method '.version_select at 0x7fbbcb91e310>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:27.636114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28321bf2-4d54-4783-9112-5ae9eee39bec tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:27.652005 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-28321bf2-4d54-4783-9112-5ae9eee39bec tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1382 microversion: 2.1 time: 0.325999 Aug 09 17:14:27.652629 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 946/1792] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:27 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1382 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:27.658009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9dabd411-b1c2-4e39-82a5-05509219eec8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:27.666043 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:14:27.666043 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:14:27.668643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9dabd411-b1c2-4e39-82a5-05509219eec8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:27.670035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9dabd411-b1c2-4e39-82a5-05509219eec8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:27.670730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9dabd411-b1c2-4e39-82a5-05509219eec8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:27.672689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9dabd411-b1c2-4e39-82a5-05509219eec8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:27.673988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9dabd411-b1c2-4e39-82a5-05509219eec8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:27.674674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9dabd411-b1c2-4e39-82a5-05509219eec8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:27.746053 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9dabd411-b1c2-4e39-82a5-05509219eec8 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.089870 Aug 09 17:14:27.752970 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 947/1793] 10.222.0.93 () {60 vars in 1217 bytes} [Tue Aug 9 17:14:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:14:27.771279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a2502d86-40be-4266-84df-0ec64909183a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '.version_select at 0x7fbbd83de3a0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:27.779546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2502d86-40be-4266-84df-0ec64909183a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:27.783943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2502d86-40be-4266-84df-0ec64909183a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:27.784735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2502d86-40be-4266-84df-0ec64909183a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:27.810045 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a2502d86-40be-4266-84df-0ec64909183a tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.054288 Aug 09 17:14:27.819858 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 948/1794] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:14:27 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:27.825264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1ff0ddc-96db-4adf-bb05-10f42c8b0802 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-845781-6", "block_migration": "auto"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:27.830119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1ff0ddc-96db-4adf-bb05-10f42c8b0802 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:27.851776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1ff0ddc-96db-4adf-bb05-10f42c8b0802 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:27.852853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1ff0ddc-96db-4adf-bb05-10f42c8b0802 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:27.853853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1ff0ddc-96db-4adf-bb05-10f42c8b0802 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:27.856130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1ff0ddc-96db-4adf-bb05-10f42c8b0802 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:27.856718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1ff0ddc-96db-4adf-bb05-10f42c8b0802 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:27.857177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1ff0ddc-96db-4adf-bb05-10f42c8b0802 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:27.918688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-a1ff0ddc-96db-4adf-bb05-10f42c8b0802 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'flavor' on Instance uuid fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:14:27.951199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1ff0ddc-96db-4adf-bb05-10f42c8b0802 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Going to try to live migrate instance to n-h2-845781-6 {{(pid=119431) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 17:14:28.151015 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fcda7a12-55de-44ac-9f31-37ce419cb2d2 tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/0bb4b8ad-784a-4b3a-99e7-66848b89c9db" status: 200 len: 142 microversion: 2.1 time: 0.540596 Aug 09 17:14:28.159489 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 847/1795] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 17:14:27 2022] GET /compute/v2.1/os-floating-ips/0bb4b8ad-784a-4b3a-99e7-66848b89c9db => generated 142 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:28.166474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-74c75b14-0c3f-4c92-9e38-d8b0c06437a8 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:28.167983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-74c75b14-0c3f-4c92-9e38-d8b0c06437a8 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:28.177559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74c75b14-0c3f-4c92-9e38-d8b0c06437a8 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:28.178420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74c75b14-0c3f-4c92-9e38-d8b0c06437a8 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:28.178854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74c75b14-0c3f-4c92-9e38-d8b0c06437a8 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:28.180266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74c75b14-0c3f-4c92-9e38-d8b0c06437a8 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:28.181075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74c75b14-0c3f-4c92-9e38-d8b0c06437a8 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:28.181271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74c75b14-0c3f-4c92-9e38-d8b0c06437a8 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:28.560353 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-74c75b14-0c3f-4c92-9e38-d8b0c06437a8 tempest-LiveMigrationTest-818563637 tempest-LiveMigrationTest-818563637-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1533 microversion: 2.1 time: 0.388475 Aug 09 17:14:28.561267 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 848/1796] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:28 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1533 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:28.568208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f28960a0-449e-4b8a-a552-108ce44fb91f tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Calling method '.version_select at 0x7fbbcbb7a1f0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:28.926718 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f28960a0-449e-4b8a-a552-108ce44fb91f tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.363377 Aug 09 17:14:28.927658 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 849/1797] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:14:28 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:28.933936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d2896b3d-c7bc-4c6f-b486-4181bbc3fa84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:28.934773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d2896b3d-c7bc-4c6f-b486-4181bbc3fa84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:28.946294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2896b3d-c7bc-4c6f-b486-4181bbc3fa84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:28.947763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2896b3d-c7bc-4c6f-b486-4181bbc3fa84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:28.948588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2896b3d-c7bc-4c6f-b486-4181bbc3fa84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:28.949757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2896b3d-c7bc-4c6f-b486-4181bbc3fa84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:28.950789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2896b3d-c7bc-4c6f-b486-4181bbc3fa84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:28.951724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2896b3d-c7bc-4c6f-b486-4181bbc3fa84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:29.174948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d2896b3d-c7bc-4c6f-b486-4181bbc3fa84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:29.189764 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d2896b3d-c7bc-4c6f-b486-4181bbc3fa84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1315 microversion: 2.1 time: 0.260467 Aug 09 17:14:29.190778 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 850/1798] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:28 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:29.199490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ac30d8a2-c9c9-416b-b524-471fde33041d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:29.200749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ac30d8a2-c9c9-416b-b524-471fde33041d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:29.212774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac30d8a2-c9c9-416b-b524-471fde33041d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:29.213658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac30d8a2-c9c9-416b-b524-471fde33041d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:29.214620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac30d8a2-c9c9-416b-b524-471fde33041d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:29.216035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac30d8a2-c9c9-416b-b524-471fde33041d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:29.216765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac30d8a2-c9c9-416b-b524-471fde33041d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:29.217505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac30d8a2-c9c9-416b-b524-471fde33041d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:29.266734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ac30d8a2-c9c9-416b-b524-471fde33041d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:14:29.404083 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ac30d8a2-c9c9-416b-b524-471fde33041d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "DELETE /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 204 len: 0 microversion: 2.1 time: 0.210742 Aug 09 17:14:29.405225 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 851/1799] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:14:29 2022] DELETE /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:14:29.416987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fb0d1346-7375-42cf-b4d4-180804b067d4 tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Calling method '.version_select at 0x7fbbcbcb8e50>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:30.286516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:14:31.229337 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1ff0ddc-96db-4adf-bb05-10f42c8b0802 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29/action" status: 202 len: 0 microversion: 2.25 time: 3.416411 Aug 09 17:14:31.241760 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 949/1800] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:14:27 2022] POST /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29/action => generated 0 bytes in 3430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:14:31.292240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6eb8b3f-ac93-4337-bdc2-a5faecb1442c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:31.293447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b6eb8b3f-ac93-4337-bdc2-a5faecb1442c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:31.355912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6eb8b3f-ac93-4337-bdc2-a5faecb1442c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:31.364909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6eb8b3f-ac93-4337-bdc2-a5faecb1442c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:31.365933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6eb8b3f-ac93-4337-bdc2-a5faecb1442c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:31.367286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6eb8b3f-ac93-4337-bdc2-a5faecb1442c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:31.370494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6eb8b3f-ac93-4337-bdc2-a5faecb1442c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:31.371193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6eb8b3f-ac93-4337-bdc2-a5faecb1442c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:31.494634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:14:31.635653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b6eb8b3f-ac93-4337-bdc2-a5faecb1442c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:31.667839 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6eb8b3f-ac93-4337-bdc2-a5faecb1442c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1346 microversion: 2.1 time: 0.423886 Aug 09 17:14:31.668902 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 950/1801] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:31 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1346 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:31.683401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7ec4810-c1f2-49fd-9558-e8d8d0a3bd68 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:31.684512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b7ec4810-c1f2-49fd-9558-e8d8d0a3bd68 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:31.693126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ec4810-c1f2-49fd-9558-e8d8d0a3bd68 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:31.694320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ec4810-c1f2-49fd-9558-e8d8d0a3bd68 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:31.695319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ec4810-c1f2-49fd-9558-e8d8d0a3bd68 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:31.696392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ec4810-c1f2-49fd-9558-e8d8d0a3bd68 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:31.697128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ec4810-c1f2-49fd-9558-e8d8d0a3bd68 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:31.697816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ec4810-c1f2-49fd-9558-e8d8d0a3bd68 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:31.846038 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fb0d1346-7375-42cf-b4d4-180804b067d4 tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/0bb4b8ad-784a-4b3a-99e7-66848b89c9db" status: 202 len: 0 microversion: 2.1 time: 2.437810 Aug 09 17:14:31.847218 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 852/1802] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:14:29 2022] DELETE /compute/v2.1/os-floating-ips/0bb4b8ad-784a-4b3a-99e7-66848b89c9db => generated 0 bytes in 2441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:14:31.865545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:31.872524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:31.909709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:31.910612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:31.911418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:31.926243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:31.927593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:31.931919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:32.256656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b7ec4810-c1f2-49fd-9558-e8d8d0a3bd68 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:32.266146 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7ec4810-c1f2-49fd-9558-e8d8d0a3bd68 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1315 microversion: 2.1 time: 0.595689 Aug 09 17:14:32.267441 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 951/1803] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:31 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:32.273035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6033dba2-fc40-4520-86bf-d4f22bc9b8ce req-584716cd-7d5d-4fe0-b31a-7b56ef902c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "376cf93a-be81-477e-a0c7-656834c3d899", "name": "network-vif-deleted", "tag": "808a2a00-f141-4144-9ff7-439ca998a941"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:32.285956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6033dba2-fc40-4520-86bf-d4f22bc9b8ce req-584716cd-7d5d-4fe0-b31a-7b56ef902c74 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:32.286899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6033dba2-fc40-4520-86bf-d4f22bc9b8ce req-584716cd-7d5d-4fe0-b31a-7b56ef902c74 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:32.287612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6033dba2-fc40-4520-86bf-d4f22bc9b8ce req-584716cd-7d5d-4fe0-b31a-7b56ef902c74 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:32.302215 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6033dba2-fc40-4520-86bf-d4f22bc9b8ce req-584716cd-7d5d-4fe0-b31a-7b56ef902c74 service nova] Creating event network-vif-deleted:808a2a00-f141-4144-9ff7-439ca998a941 for instance 376cf93a-be81-477e-a0c7-656834c3d899 on n-h1-845781-6 Aug 09 17:14:32.314488 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6033dba2-fc40-4520-86bf-d4f22bc9b8ce req-584716cd-7d5d-4fe0-b31a-7b56ef902c74 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045174 Aug 09 17:14:32.319204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:32.320413 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 952/1804] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:32.329331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19ab0b0f-c800-4f4c-9729-af639e8e132f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:32.332756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19ab0b0f-c800-4f4c-9729-af639e8e132f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:32.352620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19ab0b0f-c800-4f4c-9729-af639e8e132f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:32.353526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19ab0b0f-c800-4f4c-9729-af639e8e132f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:32.354197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19ab0b0f-c800-4f4c-9729-af639e8e132f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:32.355177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19ab0b0f-c800-4f4c-9729-af639e8e132f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:32.355923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19ab0b0f-c800-4f4c-9729-af639e8e132f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:32.356603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19ab0b0f-c800-4f4c-9729-af639e8e132f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:32.360067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:32.363900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:32.370850 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f3d733fd-82ca-4b53-8d2a-f2676dfc10ff tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.521093 Aug 09 17:14:32.372603 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 853/1805] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:31 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:32.378533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-323b62b7-95c0-4f34-8ef1-45709d04d420 tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Action: 'create', calling method: .version_select at 0x7fbbcb5d38b0>, body: {"pool": null} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:32.410981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19ab0b0f-c800-4f4c-9729-af639e8e132f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:14:32.653296 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19ab0b0f-c800-4f4c-9729-af639e8e132f tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "DELETE /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 204 len: 0 microversion: 2.1 time: 0.324994 Aug 09 17:14:32.659550 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 953/1806] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:14:32 2022] DELETE /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:14:32.669371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b631c3cd-af86-4140-be78-a1221d23061e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:32.673579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b631c3cd-af86-4140-be78-a1221d23061e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:32.692909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b631c3cd-af86-4140-be78-a1221d23061e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:32.696296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b631c3cd-af86-4140-be78-a1221d23061e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:32.697105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b631c3cd-af86-4140-be78-a1221d23061e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:32.698129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b631c3cd-af86-4140-be78-a1221d23061e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:32.699904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b631c3cd-af86-4140-be78-a1221d23061e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:32.701136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b631c3cd-af86-4140-be78-a1221d23061e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:33.087451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b631c3cd-af86-4140-be78-a1221d23061e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:33.103817 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b631c3cd-af86-4140-be78-a1221d23061e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1663 microversion: 2.1 time: 0.435999 Aug 09 17:14:33.107034 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 954/1807] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:32 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1663 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:14:33.118858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fbdc41ea-cab6-496e-824a-979323ca41a7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:33.122882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fbdc41ea-cab6-496e-824a-979323ca41a7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:33.134546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbdc41ea-cab6-496e-824a-979323ca41a7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:33.135903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbdc41ea-cab6-496e-824a-979323ca41a7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:33.136918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbdc41ea-cab6-496e-824a-979323ca41a7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:33.139872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbdc41ea-cab6-496e-824a-979323ca41a7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:33.140681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbdc41ea-cab6-496e-824a-979323ca41a7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:33.142799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbdc41ea-cab6-496e-824a-979323ca41a7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:33.275271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fbdc41ea-cab6-496e-824a-979323ca41a7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:33.289191 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fbdc41ea-cab6-496e-824a-979323ca41a7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1183 microversion: 2.1 time: 0.179301 Aug 09 17:14:33.305820 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 955/1808] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:33 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:33.319356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0a95d3ab-25f2-48d4-938e-1878a2858a79 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:33.322125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0a95d3ab-25f2-48d4-938e-1878a2858a79 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:33.344208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a95d3ab-25f2-48d4-938e-1878a2858a79 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:33.345480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a95d3ab-25f2-48d4-938e-1878a2858a79 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:33.346364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a95d3ab-25f2-48d4-938e-1878a2858a79 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:33.348754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a95d3ab-25f2-48d4-938e-1878a2858a79 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:33.349665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a95d3ab-25f2-48d4-938e-1878a2858a79 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:33.350384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a95d3ab-25f2-48d4-938e-1878a2858a79 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:33.706700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0a95d3ab-25f2-48d4-938e-1878a2858a79 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:33.716954 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0a95d3ab-25f2-48d4-938e-1878a2858a79 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1315 microversion: 2.1 time: 0.405097 Aug 09 17:14:33.720988 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 956/1809] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:33 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:33.727257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:33.728521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:33.751129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:33.760951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:33.763989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:33.821478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:33.821478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:33.821478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:34.793676 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-323b62b7-95c0-4f34-8ef1-45709d04d420 tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.419623 Aug 09 17:14:34.796765 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 854/1810] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:14:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:34.809867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-430416ee-88dc-45c6-b668-ca92067b84f6 req-07994de7-f35b-405a-83f1-97eafd378369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5", "name": "network-vif-plugged", "status": "completed", "tag": "96686b6e-95b8-47d5-945e-72122d48ef23"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:34.822714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-430416ee-88dc-45c6-b668-ca92067b84f6 req-07994de7-f35b-405a-83f1-97eafd378369 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:34.823558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-430416ee-88dc-45c6-b668-ca92067b84f6 req-07994de7-f35b-405a-83f1-97eafd378369 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:34.824919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-430416ee-88dc-45c6-b668-ca92067b84f6 req-07994de7-f35b-405a-83f1-97eafd378369 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:34.831039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:14:34.842230 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-430416ee-88dc-45c6-b668-ca92067b84f6 req-07994de7-f35b-405a-83f1-97eafd378369 service nova] Creating event network-vif-plugged:96686b6e-95b8-47d5-945e-72122d48ef23 for instance dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 on n-h2-845781-6 Aug 09 17:14:34.849714 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-430416ee-88dc-45c6-b668-ca92067b84f6 req-07994de7-f35b-405a-83f1-97eafd378369 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050771 Aug 09 17:14:34.851856 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 855/1811] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:34.872118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:34.880396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2d27334a-7211-41e8-8cd0-c931de2ce8ee tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:34.882073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2d27334a-7211-41e8-8cd0-c931de2ce8ee tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:34.891125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d27334a-7211-41e8-8cd0-c931de2ce8ee tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:34.893142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d27334a-7211-41e8-8cd0-c931de2ce8ee tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:34.893826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d27334a-7211-41e8-8cd0-c931de2ce8ee tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:34.895299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d27334a-7211-41e8-8cd0-c931de2ce8ee tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:34.895958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d27334a-7211-41e8-8cd0-c931de2ce8ee tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:34.896528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d27334a-7211-41e8-8cd0-c931de2ce8ee tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:34.899608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:34.912387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:34.914354 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5043f19f-6c06-42ef-89ff-14ab7971a5b2 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 1.191404 Aug 09 17:14:34.915119 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 957/1812] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:33 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:34.930329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4b1a205-c979-40eb-b10f-d82a98c80588 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:34.931840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a4b1a205-c979-40eb-b10f-d82a98c80588 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:34.961431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4b1a205-c979-40eb-b10f-d82a98c80588 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:34.962534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4b1a205-c979-40eb-b10f-d82a98c80588 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:34.965681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4b1a205-c979-40eb-b10f-d82a98c80588 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:34.967641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4b1a205-c979-40eb-b10f-d82a98c80588 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:34.971967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4b1a205-c979-40eb-b10f-d82a98c80588 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:34.975179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4b1a205-c979-40eb-b10f-d82a98c80588 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:35.166470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2d27334a-7211-41e8-8cd0-c931de2ce8ee tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:35.176595 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2d27334a-7211-41e8-8cd0-c931de2ce8ee tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1663 microversion: 2.1 time: 0.322625 Aug 09 17:14:35.177210 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 856/1813] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:34 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1663 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:35.189848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4fd0f9a8-c051-4a10-972f-f2ce5f88937c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:35.192316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4fd0f9a8-c051-4a10-972f-f2ce5f88937c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:35.192793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a4b1a205-c979-40eb-b10f-d82a98c80588 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:35.202103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd0f9a8-c051-4a10-972f-f2ce5f88937c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:35.202874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd0f9a8-c051-4a10-972f-f2ce5f88937c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:35.203849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd0f9a8-c051-4a10-972f-f2ce5f88937c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:35.206735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd0f9a8-c051-4a10-972f-f2ce5f88937c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:35.208047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd0f9a8-c051-4a10-972f-f2ce5f88937c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:35.208613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fd0f9a8-c051-4a10-972f-f2ce5f88937c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:35.219856 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4b1a205-c979-40eb-b10f-d82a98c80588 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1183 microversion: 2.1 time: 0.300334 Aug 09 17:14:35.221228 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 958/1814] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:34 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:35.249325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86f6c160-14d9-41c4-83a3-b9e69a88cdcd tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Calling method '.version_select at 0x7fbbcba3faf0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:35.443180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4fd0f9a8-c051-4a10-972f-f2ce5f88937c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:35.454006 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4fd0f9a8-c051-4a10-972f-f2ce5f88937c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1315 microversion: 2.1 time: 0.275368 Aug 09 17:14:35.454825 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 857/1815] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:35 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:35.968401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:35.970616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:35.985722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:35.987140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:35.988160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:35.990289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:35.991383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:35.992477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:36.345092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:36.356388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:36.359034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:36.360615 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d113f391-31e0-4a43-a832-ccccc91a553d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.399917 Aug 09 17:14:36.362022 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 858/1816] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:35 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:14:36.368207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c8c77b2c-f31f-4309-90f8-6e0f8d6b545a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:36.369120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c8c77b2c-f31f-4309-90f8-6e0f8d6b545a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:36.387259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c77b2c-f31f-4309-90f8-6e0f8d6b545a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:36.389341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c77b2c-f31f-4309-90f8-6e0f8d6b545a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:36.391267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c77b2c-f31f-4309-90f8-6e0f8d6b545a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:36.392266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c77b2c-f31f-4309-90f8-6e0f8d6b545a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:36.395024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c77b2c-f31f-4309-90f8-6e0f8d6b545a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:36.401591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c77b2c-f31f-4309-90f8-6e0f8d6b545a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:36.675906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c8c77b2c-f31f-4309-90f8-6e0f8d6b545a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db013fb9179d4e008d5e7ba5087cfcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c9f623336e43cf97c9566a49f1b064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:36.702842 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c8c77b2c-f31f-4309-90f8-6e0f8d6b545a tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 200 len: 1663 microversion: 2.1 time: 0.339081 Aug 09 17:14:36.709706 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 859/1817] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:36 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 1663 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:36.725230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4aac936a-2197-4792-8e10-7867c0c8e168 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:36.729988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4aac936a-2197-4792-8e10-7867c0c8e168 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:36.745926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4aac936a-2197-4792-8e10-7867c0c8e168 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:36.747065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4aac936a-2197-4792-8e10-7867c0c8e168 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:36.748853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4aac936a-2197-4792-8e10-7867c0c8e168 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:36.750096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4aac936a-2197-4792-8e10-7867c0c8e168 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:36.751048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4aac936a-2197-4792-8e10-7867c0c8e168 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:36.751768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4aac936a-2197-4792-8e10-7867c0c8e168 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:36.879669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4aac936a-2197-4792-8e10-7867c0c8e168 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:36.892251 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4aac936a-2197-4792-8e10-7867c0c8e168 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1183 microversion: 2.1 time: 0.180714 Aug 09 17:14:36.900983 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 860/1818] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:36 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:36.920571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-24093cfa-70b5-4a8f-9e8d-6bebd8da51bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:36.921666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-24093cfa-70b5-4a8f-9e8d-6bebd8da51bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:36.934542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24093cfa-70b5-4a8f-9e8d-6bebd8da51bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:36.935444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24093cfa-70b5-4a8f-9e8d-6bebd8da51bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:36.936272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24093cfa-70b5-4a8f-9e8d-6bebd8da51bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:36.937174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24093cfa-70b5-4a8f-9e8d-6bebd8da51bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:36.937794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24093cfa-70b5-4a8f-9e8d-6bebd8da51bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:36.938460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24093cfa-70b5-4a8f-9e8d-6bebd8da51bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:37.264222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-24093cfa-70b5-4a8f-9e8d-6bebd8da51bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:37.327604 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-24093cfa-70b5-4a8f-9e8d-6bebd8da51bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1503 microversion: 2.1 time: 0.417982 Aug 09 17:14:37.337638 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 861/1819] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:36 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:37.364298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1044e4fd-1d82-4749-bcc3-4586d65249a2 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-308521833"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:37.365336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1044e4fd-1d82-4749-bcc3-4586d65249a2 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:37.374749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1044e4fd-1d82-4749-bcc3-4586d65249a2 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:37.375799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1044e4fd-1d82-4749-bcc3-4586d65249a2 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:37.376635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1044e4fd-1d82-4749-bcc3-4586d65249a2 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:37.378355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1044e4fd-1d82-4749-bcc3-4586d65249a2 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:37.379801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1044e4fd-1d82-4749-bcc3-4586d65249a2 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:37.380446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1044e4fd-1d82-4749-bcc3-4586d65249a2 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:37.641131 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.network.security_group_api [None req-1044e4fd-1d82-4749-bcc3-4586d65249a2 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Adding security group 2289a7af-41f4-45ce-991f-e3ca1c8e2a2f to port 96686b6e-95b8-47d5-945e-72122d48ef23 Aug 09 17:14:37.686494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:14:37.941221 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86f6c160-14d9-41c4-83a3-b9e69a88cdcd tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f" status: 202 len: 0 microversion: 2.1 time: 2.716090 Aug 09 17:14:37.945246 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 959/1820] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:14:35 2022] DELETE /compute/v2.1/os-floating-ips/1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f => generated 0 bytes in 2722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:14:37.962112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:37.964058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:38.019243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:38.021411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:38.022709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:38.024702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:38.026315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:38.027682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:38.513396 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1044e4fd-1d82-4749-bcc3-4586d65249a2 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5/action" status: 202 len: 0 microversion: 2.1 time: 1.156245 Aug 09 17:14:38.515544 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 862/1821] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:14:37 2022] POST /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5/action => generated 0 bytes in 1159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:14:38.523483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-56447c27-063f-4455-8681-9f6957713baa req-46124900-e039-43b3-bf5a-0561f4bf77b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15affa7d-ca83-47fa-b24b-cec8a05fcda3", "name": "network-vif-deleted", "tag": "a77d9b7e-e498-4db6-84eb-6ac98cfc71de"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:38.544543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:38.574819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:38.592580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:38.592913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-56447c27-063f-4455-8681-9f6957713baa req-46124900-e039-43b3-bf5a-0561f4bf77b8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:38.593317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-56447c27-063f-4455-8681-9f6957713baa req-46124900-e039-43b3-bf5a-0561f4bf77b8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:38.595873 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d3f3c899-29db-41e1-8467-21abc3620692 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.648006 Aug 09 17:14:38.596373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-56447c27-063f-4455-8681-9f6957713baa req-46124900-e039-43b3-bf5a-0561f4bf77b8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:38.597529 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 960/1822] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:37 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:38.619207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:38.620689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] [instance: 15affa7d-ca83-47fa-b24b-cec8a05fcda3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:38.638255 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-56447c27-063f-4455-8681-9f6957713baa req-46124900-e039-43b3-bf5a-0561f4bf77b8 service nova] Creating event network-vif-deleted:a77d9b7e-e498-4db6-84eb-6ac98cfc71de for instance 15affa7d-ca83-47fa-b24b-cec8a05fcda3 on n-h1-845781-6 Aug 09 17:14:38.639739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:38.642200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:38.642911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:38.646378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:38.648419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:38.648918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:38.657907 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-56447c27-063f-4455-8681-9f6957713baa req-46124900-e039-43b3-bf5a-0561f4bf77b8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138461 Aug 09 17:14:38.658867 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 863/1823] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:38.676509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bde67f69-7778-4c4b-bedd-28eb785a4333 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:38.682029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bde67f69-7778-4c4b-bedd-28eb785a4333 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:38.700575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bde67f69-7778-4c4b-bedd-28eb785a4333 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:38.700690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bde67f69-7778-4c4b-bedd-28eb785a4333 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:38.701473 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] HTTP exception thrown: Instance 15affa7d-ca83-47fa-b24b-cec8a05fcda3 could not be found. Aug 09 17:14:38.713079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bde67f69-7778-4c4b-bedd-28eb785a4333 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:38.714312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bde67f69-7778-4c4b-bedd-28eb785a4333 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:38.715484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bde67f69-7778-4c4b-bedd-28eb785a4333 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Request method failure captured: Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 HTTP/1.1 Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pWT6P7BfBaUyBLPF4mUhyU9vjkUJN907Z4_6WvwFIinJSflZ08uBdUSMR9EeV8caxkymE8plhTAs-dVgy7ieom_Lwq4FEDXNV6qEbiIFV7z2L5N3OuMInni7-sBSgi32CwkQsX-ObSnu84dpzMUrheQMNyQxLnJPNWfKroZTSALBoQ Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: d5c9f623336e43cf97c9566a49f1b064 Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestFqdnHostnames-1983990722 Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d5c9f623336e43cf97c9566a49f1b064"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d5c9f623336e43cf97c9566a49f1b064"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d5c9f623336e43cf97c9566a49f1b064"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d5c9f623336e43cf97c9566a49f1b064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestFqdnHostnames-1983990722 Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: d5c9f623336e43cf97c9566a49f1b064 Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1983990722 Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestFqdnHostnames-1983990722-project Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: db013fb9179d4e008d5e7ba5087cfcf2 Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestFqdnHostnames-1983990722-project Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 15affa7d-ca83-47fa-b24b-cec8a05fcda3 could not be found. Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '15affa7d-ca83-47fa-b24b-cec8a05fcda3'} Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15affa7d-ca83-47fa-b24b-cec8a05fcda3 could not be found. Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15affa7d-ca83-47fa-b24b-cec8a05fcda3 could not be found. Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:38.717223 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.721589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:38.721589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:38.721589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:38.721589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:14:38.721589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:14:38.721589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15affa7d-ca83-47fa-b24b-cec8a05fcda3 could not be found. Aug 09 17:14:38.721589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.723250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Returning 404 to user: Instance 15affa7d-ca83-47fa-b24b-cec8a05fcda3 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:14:38.723785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bde67f69-7778-4c4b-bedd-28eb785a4333 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:38.724730 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9476af33-9bfd-435e-8c13-4ae8b78fbd5e tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3" status: 404 len: 111 microversion: 2.1 time: 0.124064 Aug 09 17:14:38.726338 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 961/1824] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:38 2022] GET /compute/v2.1/servers/15affa7d-ca83-47fa-b24b-cec8a05fcda3 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:14:38.745422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ad434e38-9fbb-4705-b572-e21edf8d9deb tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Calling method '.version_select at 0x7fbbcbf04dc0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:38.880534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bde67f69-7778-4c4b-bedd-28eb785a4333 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:38.889839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG neutronclient.v2_0.client [None req-ad434e38-9fbb-4705-b572-e21edf8d9deb tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f could not be found", "detail": ""}} {{(pid=119431) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:14:38.891152 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-ad434e38-9fbb-4705-b572-e21edf8d9deb tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] HTTP exception thrown: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f Aug 09 17:14:38.892272 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bde67f69-7778-4c4b-bedd-28eb785a4333 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1183 microversion: 2.1 time: 0.228393 Aug 09 17:14:38.893433 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 864/1825] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:38 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ad434e38-9fbb-4705-b572-e21edf8d9deb tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Request method failure captured: Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-floating-ips/1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f HTTP/1.1 Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pXtxssln8Dzmf0wvgTFsddKItOPJCaZMbF82LQZIGWA3OQTz41NBsp17xD0NW6u0aKQBZR43fcl3q0s3Tf6trwVeDGYUwSUvdVo2xBIYStLqEyHJUAlH2rDYMeJKsjb--6S2PCWyQxSwLvg9sEtpDDUOXrwWYi3BmaOCvOKQ-zvuH0 Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: b98ca564a74b402d965282ae6152e19e Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FloatingIPsTestJSON-1889309061 Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b98ca564a74b402d965282ae6152e19e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b98ca564a74b402d965282ae6152e19e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b98ca564a74b402d965282ae6152e19e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b98ca564a74b402d965282ae6152e19e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FloatingIPsTestJSON-1889309061 Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: b98ca564a74b402d965282ae6152e19e Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1889309061 Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FloatingIPsTestJSON-1889309061-project Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 7a318f5a15a44de786c36d7275393678 Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FloatingIPsTestJSON-1889309061-project Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: exception: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f'} Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f could not be found Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2877e1de-d950-4316-b17d-c03abba80a56'] Aug 09 17:14:38.895524 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f. Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ad434e38-9fbb-4705-b572-e21edf8d9deb tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Returning 404 to user: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ad434e38-9fbb-4705-b572-e21edf8d9deb tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f" status: 404 len: 111 microversion: 2.1 time: 0.169197 Aug 09 17:14:38.900669 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 962/1826] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 17:14:38 2022] GET /compute/v2.1/os-floating-ips/1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:14:38.909514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8284d423-ecf1-4e9b-b89a-0da9520dd807 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-531500027"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:38.910916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8284d423-ecf1-4e9b-b89a-0da9520dd807 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:38.918289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1de47fb9-5884-48b7-87b2-d79ea72e9c99 req-0ce4119f-f525-4bb4-90b9-af31d53769db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5", "tag": "96686b6e-95b8-47d5-945e-72122d48ef23"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:38.927580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8284d423-ecf1-4e9b-b89a-0da9520dd807 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:38.929467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8284d423-ecf1-4e9b-b89a-0da9520dd807 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:38.930571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8284d423-ecf1-4e9b-b89a-0da9520dd807 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:38.933027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8284d423-ecf1-4e9b-b89a-0da9520dd807 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:38.934381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8284d423-ecf1-4e9b-b89a-0da9520dd807 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:38.936274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8284d423-ecf1-4e9b-b89a-0da9520dd807 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:38.961346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1de47fb9-5884-48b7-87b2-d79ea72e9c99 req-0ce4119f-f525-4bb4-90b9-af31d53769db service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:38.962344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1de47fb9-5884-48b7-87b2-d79ea72e9c99 req-0ce4119f-f525-4bb4-90b9-af31d53769db service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:38.963304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1de47fb9-5884-48b7-87b2-d79ea72e9c99 req-0ce4119f-f525-4bb4-90b9-af31d53769db service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:39.012113 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1de47fb9-5884-48b7-87b2-d79ea72e9c99 req-0ce4119f-f525-4bb4-90b9-af31d53769db service nova] Creating event network-changed:96686b6e-95b8-47d5-945e-72122d48ef23 for instance dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 on n-h2-845781-6 Aug 09 17:14:39.026241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1de47fb9-5884-48b7-87b2-d79ea72e9c99 req-0ce4119f-f525-4bb4-90b9-af31d53769db service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123483 Aug 09 17:14:39.027931 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 963/1827] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:39.063650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d9e3c25e-0a92-41cc-be70-563a9232d377 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] Calling method '.version_select at 0x7fbbcb78a9d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:39.133538 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d9e3c25e-0a92-41cc-be70-563a9232d377 tempest-ServersTestFqdnHostnames-1983990722 tempest-ServersTestFqdnHostnames-1983990722-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989659443" status: 202 len: 0 microversion: 2.1 time: 0.103168 Aug 09 17:14:39.134441 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 964/1828] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:14:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989659443 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:14:39.148668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d09a5015-0250-4fcc-b87b-8673894dcedd tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Calling method '.version_select at 0x7fbbdc9ce1f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:39.316267 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.network.security_group_api [None req-8284d423-ecf1-4e9b-b89a-0da9520dd807 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Adding security group 5f8b9dce-6269-4be8-9ca7-4890f17332e9 to port 96686b6e-95b8-47d5-945e-72122d48ef23 Aug 09 17:14:39.375143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG neutronclient.v2_0.client [None req-d09a5015-0250-4fcc-b87b-8673894dcedd tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f could not be found", "detail": ""}} {{(pid=119431) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:14:39.376838 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d09a5015-0250-4fcc-b87b-8673894dcedd tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] HTTP exception thrown: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d09a5015-0250-4fcc-b87b-8673894dcedd tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Request method failure captured: Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/os-floating-ips/1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f HTTP/1.1 Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pXtxssln8Dzmf0wvgTFsddKItOPJCaZMbF82LQZIGWA3OQTz41NBsp17xD0NW6u0aKQBZR43fcl3q0s3Tf6trwVeDGYUwSUvdVo2xBIYStLqEyHJUAlH2rDYMeJKsjb--6S2PCWyQxSwLvg9sEtpDDUOXrwWYi3BmaOCvOKQ-zvuH0 Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: b98ca564a74b402d965282ae6152e19e Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-FloatingIPsTestJSON-1889309061 Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b98ca564a74b402d965282ae6152e19e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b98ca564a74b402d965282ae6152e19e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b98ca564a74b402d965282ae6152e19e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b98ca564a74b402d965282ae6152e19e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-FloatingIPsTestJSON-1889309061 Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: b98ca564a74b402d965282ae6152e19e Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1889309061 Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-FloatingIPsTestJSON-1889309061-project Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 7a318f5a15a44de786c36d7275393678 Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-FloatingIPsTestJSON-1889309061-project Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: exception: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f'} Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f could not be found Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7ace7f2-56c8-422a-b3bb-3918811de0ff'] Aug 09 17:14:39.381540 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f. Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f Aug 09 17:14:39.389546 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:39.398386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d09a5015-0250-4fcc-b87b-8673894dcedd tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] Returning 404 to user: Floating IP not found for ID 1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:14:39.398386 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d09a5015-0250-4fcc-b87b-8673894dcedd tempest-FloatingIPsTestJSON-1889309061 tempest-FloatingIPsTestJSON-1889309061-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f" status: 404 len: 111 microversion: 2.1 time: 0.253852 Aug 09 17:14:39.404986 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 965/1829] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:14:39 2022] DELETE /compute/v2.1/os-floating-ips/1f4ccedd-ac87-4871-ab00-c16fc8d6ad2f => generated 111 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:14:39.658926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:39.670266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:39.700608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:39.701509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:39.703365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:39.713748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:39.714924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:39.715972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:40.042737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:40.053261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:40.065966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:40.068409 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b0402d91-fa1d-40c9-821d-f91f6493d1e1 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.419012 Aug 09 17:14:40.069367 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 966/1830] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:39 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:40.074852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-baba98de-11dd-4c06-a3e4-7915163a2887 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:40.088899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-baba98de-11dd-4c06-a3e4-7915163a2887 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:40.106164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baba98de-11dd-4c06-a3e4-7915163a2887 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:40.107487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baba98de-11dd-4c06-a3e4-7915163a2887 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:40.108443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baba98de-11dd-4c06-a3e4-7915163a2887 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:40.109690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baba98de-11dd-4c06-a3e4-7915163a2887 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:40.110471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baba98de-11dd-4c06-a3e4-7915163a2887 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:40.111176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baba98de-11dd-4c06-a3e4-7915163a2887 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:40.260951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-baba98de-11dd-4c06-a3e4-7915163a2887 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:40.275420 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-baba98de-11dd-4c06-a3e4-7915163a2887 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 200 len: 1183 microversion: 2.1 time: 0.204611 Aug 09 17:14:40.295692 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 967/1831] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:40 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 1183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:40.477959 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8284d423-ecf1-4e9b-b89a-0da9520dd807 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5/action" status: 202 len: 0 microversion: 2.1 time: 1.583393 Aug 09 17:14:40.496903 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 865/1832] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:14:38 2022] POST /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5/action => generated 0 bytes in 1603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:14:40.505060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0c8bf2fc-37f2-4dd2-a0ec-29e23066131b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:40.518043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0c8bf2fc-37f2-4dd2-a0ec-29e23066131b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:40.550688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c8bf2fc-37f2-4dd2-a0ec-29e23066131b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:40.554064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c8bf2fc-37f2-4dd2-a0ec-29e23066131b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:40.554891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c8bf2fc-37f2-4dd2-a0ec-29e23066131b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:40.556191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c8bf2fc-37f2-4dd2-a0ec-29e23066131b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:40.557015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c8bf2fc-37f2-4dd2-a0ec-29e23066131b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:40.561861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c8bf2fc-37f2-4dd2-a0ec-29e23066131b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:41.100133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-30161ff6-778c-495d-a10d-e134b63aff6c req-49a5053e-9469-4bf8-9ad1-67828162b75c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5", "tag": "96686b6e-95b8-47d5-945e-72122d48ef23"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:41.117755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:14:41.136594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-30161ff6-778c-495d-a10d-e134b63aff6c req-49a5053e-9469-4bf8-9ad1-67828162b75c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:41.140859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-30161ff6-778c-495d-a10d-e134b63aff6c req-49a5053e-9469-4bf8-9ad1-67828162b75c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:41.142227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-30161ff6-778c-495d-a10d-e134b63aff6c req-49a5053e-9469-4bf8-9ad1-67828162b75c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:41.196255 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-30161ff6-778c-495d-a10d-e134b63aff6c req-49a5053e-9469-4bf8-9ad1-67828162b75c service nova] Creating event network-changed:96686b6e-95b8-47d5-945e-72122d48ef23 for instance dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 on n-h2-845781-6 Aug 09 17:14:41.226948 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-30161ff6-778c-495d-a10d-e134b63aff6c req-49a5053e-9469-4bf8-9ad1-67828162b75c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143640 Aug 09 17:14:41.228656 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 866/1833] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:41.242568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:41.246131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:41.281914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:41.292631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:41.300661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:41.302210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:41.303117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:41.303972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:42.451343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:42.484045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:42.495199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:42.498030 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bbb5e51d-59ae-40aa-b981-8af9cfc63d65 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 1.267165 Aug 09 17:14:42.508977 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 867/1834] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:41 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:42.518359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:42.529289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 376cf93a-be81-477e-a0c7-656834c3d899] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:42.552622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:42.553862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:42.554901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:42.556595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:42.558732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:42.559881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:42.603000 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] HTTP exception thrown: Instance 376cf93a-be81-477e-a0c7-656834c3d899 could not be found. Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Request method failure captured: Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 HTTP/1.1 Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pO9dVfxkYNOAwgTl3f0K6Lywkb0QX-AYXJvKdW9se_yvhAmrpqVKZWa-PEP7GXSDfD_NZF_SQrLy3lt-ad6hWDhNkyNnkajtocoBOkt_Vm-3gGycg-SNTjGmJGRi6_A1GwIjK01eDJ0dHz9ugwI872ViBZcPwyTgRByUWTxkQFN8b0 Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 44129d75c58240fa867e90b1d3252554 Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-LiveMigrationTest-837947133 Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_44129d75c58240fa867e90b1d3252554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/44129d75c58240fa867e90b1d3252554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/44129d75c58240fa867e90b1d3252554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/44129d75c58240fa867e90b1d3252554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-LiveMigrationTest-837947133 Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 44129d75c58240fa867e90b1d3252554 Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-LiveMigrationTest-837947133 Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-LiveMigrationTest-837947133-project Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 894725e0d56b4960a8bc3e6a8e283b4e Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-LiveMigrationTest-837947133-project Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 376cf93a-be81-477e-a0c7-656834c3d899 could not be found. Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '376cf93a-be81-477e-a0c7-656834c3d899'} Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 376cf93a-be81-477e-a0c7-656834c3d899 could not be found. Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 376cf93a-be81-477e-a0c7-656834c3d899 could not be found. Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:42.606511 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:42.614188 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:42.614188 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:42.614188 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:42.614188 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:14:42.614188 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:14:42.614188 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 376cf93a-be81-477e-a0c7-656834c3d899 could not be found. Aug 09 17:14:42.614188 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:42.614188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Returning 404 to user: Instance 376cf93a-be81-477e-a0c7-656834c3d899 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:14:42.614188 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-12f10d5d-b5a6-4da3-8c16-7858e232d15a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899" status: 404 len: 111 microversion: 2.1 time: 0.098128 Aug 09 17:14:42.625575 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 868/1835] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:42 2022] GET /compute/v2.1/servers/376cf93a-be81-477e-a0c7-656834c3d899 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:14:43.371170 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0c8bf2fc-37f2-4dd2-a0ec-29e23066131b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 2.882733 Aug 09 17:14:43.373769 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 968/1836] 10.222.0.93 () {58 vars in 1293 bytes} [Tue Aug 9 17:14:40 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5/os-security-groups => generated 1155 bytes in 2887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:43.404112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1c118559-09ef-4d8e-a3c8-f02158b98591 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'create', calling method: .version_select at 0x7fbbcbccac10>, body: {"security_group": {"name": " tempest-securitygroup -2079883938 ", "description": "tempest-description-545053008"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:43.538186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:43.539117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:43.546612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:43.547383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:43.548486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:43.549749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:43.550399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:43.551279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:43.656308 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1c118559-09ef-4d8e-a3c8-f02158b98591 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.258118 Aug 09 17:14:43.657476 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 869/1837] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:14:43 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:43.677624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4f766d6e-7c06-4446-867a-955086298ee0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb94fb80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:43.739243 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4f766d6e-7c06-4446-867a-955086298ee0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/9537d57a-1547-4914-ade0-fb4450affa88" status: 200 len: 223 microversion: 2.1 time: 0.065955 Aug 09 17:14:43.747744 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 870/1838] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:14:43 2022] GET /compute/v2.1/os-security-groups/9537d57a-1547-4914-ade0-fb4450affa88 => generated 223 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:43.753558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-10abaeed-73ce-440e-9320-29aafea953f5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb542550>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:44.116118 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-10abaeed-73ce-440e-9320-29aafea953f5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/9537d57a-1547-4914-ade0-fb4450affa88" status: 202 len: 0 microversion: 2.1 time: 0.363618 Aug 09 17:14:44.119013 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 871/1839] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:14:43 2022] DELETE /compute/v2.1/os-security-groups/9537d57a-1547-4914-ade0-fb4450affa88 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:14:44.140893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3f5359f3-133f-4556-a127-399512cfbd03 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08c32e8b-08f2-4cab-8418-dde313bdb1cd"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:44.149293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3f5359f3-133f-4556-a127-399512cfbd03 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:44.158184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f5359f3-133f-4556-a127-399512cfbd03 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:44.158879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f5359f3-133f-4556-a127-399512cfbd03 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:44.159346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f5359f3-133f-4556-a127-399512cfbd03 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:44.160205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f5359f3-133f-4556-a127-399512cfbd03 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:44.160712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f5359f3-133f-4556-a127-399512cfbd03 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:44.161161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f5359f3-133f-4556-a127-399512cfbd03 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:44.248185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:44.278387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:44.286825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:44.296360 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9251f808-3c06-46dd-8679-5b76f6a8ae81 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.761122 Aug 09 17:14:44.314443 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 969/1840] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:43 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:44.327949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f06529fd-d71b-4536-b033-55622556f4a4 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbdc9c1700>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:44.470276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG neutronclient.v2_0.client [None req-f06529fd-d71b-4536-b033-55622556f4a4 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist", "detail": ""}} {{(pid=119431) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:14:44.472355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.security_group_api [None req-f06529fd-d71b-4536-b033-55622556f4a4 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Neutron security group 9537d57a-1547-4914-ade0-fb4450affa88 not found {{(pid=119431) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:14:44.475085 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f06529fd-d71b-4536-b033-55622556f4a4 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:14:44.475085 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-4d3dba28-6045-4d66-90c6-bc080edcbe31'] Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f06529fd-d71b-4536-b033-55622556f4a4 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-security-groups/9537d57a-1547-4914-ade0-fb4450affa88 HTTP/1.1 Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: exception: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-4d3dba28-6045-4d66-90c6-bc080edcbe31'] Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9537d57a-1547-4914-ade0-fb4450affa88'} Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:14:44.479961 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d3dba28-6045-4d66-90c6-bc080edcbe31'] Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d3dba28-6045-4d66-90c6-bc080edcbe31'] Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d3dba28-6045-4d66-90c6-bc080edcbe31'] Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4d3dba28-6045-4d66-90c6-bc080edcbe31'] Aug 09 17:14:44.483434 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:44.486205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f06529fd-d71b-4536-b033-55622556f4a4 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:14:44.486205 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-4d3dba28-6045-4d66-90c6-bc080edcbe31'] {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:14:44.491034 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f06529fd-d71b-4536-b033-55622556f4a4 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/9537d57a-1547-4914-ade0-fb4450affa88" status: 404 len: 194 microversion: 2.1 time: 0.177021 Aug 09 17:14:44.498900 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 970/1841] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:14:44 2022] GET /compute/v2.1/os-security-groups/9537d57a-1547-4914-ade0-fb4450affa88 => generated 194 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:14:44.510403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cc0af26d-c07f-4c4c-925d-d6bd1defd23b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'create', calling method: .version_select at 0x7fbbdc9ecca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1217907606", "description": "tempest-description-278325120"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:44.665072 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3f5359f3-133f-4556-a127-399512cfbd03 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "POST /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543001 Aug 09 17:14:44.680328 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 872/1842] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:14:44 2022] POST /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:45.357882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:45.359715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:45.373144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:45.374386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:45.375452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:45.377213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:45.378406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:45.379936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:45.416286 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cc0af26d-c07f-4c4c-925d-d6bd1defd23b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.915879 Aug 09 17:14:45.417297 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 971/1843] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:14:44 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:14:45.442312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2357b50d-2c3c-4e5a-9588-b358ff694c4e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'create', calling method: .version_select at 0x7fbbcb5eb040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1263785028", "description": "tempest-description-958398287"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:45.665182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:45.706277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:45.714800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:45.717793 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bd9f8aed-09c6-4e0f-8d1d-3cc7ab675adc tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.370081 Aug 09 17:14:45.769006 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 873/1844] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:45 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:14:46.777007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:46.783721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:46.823366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:46.826202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:46.828912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:46.836322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:46.837422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:46.838535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:47.150545 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2357b50d-2c3c-4e5a-9588-b358ff694c4e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.716910 Aug 09 17:14:47.159344 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 972/1845] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:14:45 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:47.165744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ae716ebd-3d30-4755-afea-9a5695615c0b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'create', calling method: .version_select at 0x7fbbdc9f2700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-862605441", "description": "tempest-description-263095168"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:47.227883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:47.254704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:47.256379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:47.257637 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c50f86d8-8ddf-4ad9-825e-85e53209e50b tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.489040 Aug 09 17:14:47.258240 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 874/1846] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:46 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:47.681070 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ae716ebd-3d30-4755-afea-9a5695615c0b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.519587 Aug 09 17:14:47.682387 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 973/1847] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:14:47 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:47.695209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a922a4d-5133-405d-bdb1-45b4b1c43c94 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb577790>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:48.082402 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a922a4d-5133-405d-bdb1-45b4b1c43c94 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 0.390339 Aug 09 17:14:48.083412 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 875/1848] 10.222.0.93 () {58 vars in 1158 bytes} [Tue Aug 9 17:14:47 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:48.098938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a34339eb-a83d-4675-b214-a180088e5c91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcbcbf790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:48.307021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:48.312407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:48.364207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:48.369147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:48.372951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:48.374733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:48.377848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:48.383273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:48.916848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:48.932914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:48.934826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:48.936259 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-55c6ef82-a3e2-4ea8-a04b-7a635c8940c9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.641722 Aug 09 17:14:48.947702 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 876/1849] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:48 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:49.967411 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a34339eb-a83d-4675-b214-a180088e5c91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/506c5b74-35fc-4081-806e-58e9804548ca" status: 202 len: 0 microversion: 2.1 time: 1.873766 Aug 09 17:14:49.987904 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 974/1850] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:14:48 2022] DELETE /compute/v2.1/os-security-groups/506c5b74-35fc-4081-806e-58e9804548ca => generated 0 bytes in 1895 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:14:50.014298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ff4fa8f8-6e05-46d4-aba2-91a5c9879de7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb803670>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:50.045118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:50.058634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:50.091100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:14:50.101270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:50.104946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:50.105807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:50.109476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:50.116489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:50.119200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:51.406814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:51.447905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:51.463433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:51.470009 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b72aeb99-83c2-4243-a452-1d6ea504ff9e tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 1.469067 Aug 09 17:14:51.472640 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 975/1851] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:49 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:51.586266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-ff4fa8f8-6e05-46d4-aba2-91a5c9879de7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:14:51.587942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.security_group_api [None req-ff4fa8f8-6e05-46d4-aba2-91a5c9879de7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Neutron security group 506c5b74-35fc-4081-806e-58e9804548ca not found {{(pid=119432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:14:51.589064 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ff4fa8f8-6e05-46d4-aba2-91a5c9879de7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:14:51.589064 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-b58b7607-4fe3-4191-8638-ffa0a952dd43'] Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ff4fa8f8-6e05-46d4-aba2-91a5c9879de7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/os-security-groups/506c5b74-35fc-4081-806e-58e9804548ca HTTP/1.1 Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: exception: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-b58b7607-4fe3-4191-8638-ffa0a952dd43'] Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '506c5b74-35fc-4081-806e-58e9804548ca'} Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:14:51.591705 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b58b7607-4fe3-4191-8638-ffa0a952dd43'] Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b58b7607-4fe3-4191-8638-ffa0a952dd43'] Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b58b7607-4fe3-4191-8638-ffa0a952dd43'] Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b58b7607-4fe3-4191-8638-ffa0a952dd43'] Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ff4fa8f8-6e05-46d4-aba2-91a5c9879de7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:14:51.598968 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-b58b7607-4fe3-4191-8638-ffa0a952dd43'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:14:51.604877 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ff4fa8f8-6e05-46d4-aba2-91a5c9879de7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/506c5b74-35fc-4081-806e-58e9804548ca" status: 404 len: 194 microversion: 2.1 time: 1.618042 Aug 09 17:14:51.604877 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 877/1852] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:14:49 2022] GET /compute/v2.1/os-security-groups/506c5b74-35fc-4081-806e-58e9804548ca => generated 194 bytes in 1624 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:14:51.617118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6cb089f-53ef-4215-bf74-11e76eece35e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbdc9f5430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:52.537123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:52.540551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:52.581101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:52.593552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:52.597915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:52.603374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:52.610789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:52.620536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:52.718377 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6cb089f-53ef-4215-bf74-11e76eece35e tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/9f897521-953a-4422-bc6b-6f678cde515e" status: 202 len: 0 microversion: 2.1 time: 1.110310 Aug 09 17:14:52.721123 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 976/1853] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:14:51 2022] DELETE /compute/v2.1/os-security-groups/9f897521-953a-4422-bc6b-6f678cde515e => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:14:52.743768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c73871f0-c3d3-4cbe-b91f-25b976e57be7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbdc9fb430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:52.884905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG neutronclient.v2_0.client [None req-c73871f0-c3d3-4cbe-b91f-25b976e57be7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist", "detail": ""}} {{(pid=119431) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:14:52.886687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.security_group_api [None req-c73871f0-c3d3-4cbe-b91f-25b976e57be7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Neutron security group 9f897521-953a-4422-bc6b-6f678cde515e not found {{(pid=119431) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:14:52.887919 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c73871f0-c3d3-4cbe-b91f-25b976e57be7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:14:52.887919 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-668b3b3b-09fa-4017-8256-ba7111c91484'] Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c73871f0-c3d3-4cbe-b91f-25b976e57be7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-security-groups/9f897521-953a-4422-bc6b-6f678cde515e HTTP/1.1 Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: exception: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-668b3b3b-09fa-4017-8256-ba7111c91484'] Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9f897521-953a-4422-bc6b-6f678cde515e'} Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:14:52.903997 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-668b3b3b-09fa-4017-8256-ba7111c91484'] Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-668b3b3b-09fa-4017-8256-ba7111c91484'] Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-668b3b3b-09fa-4017-8256-ba7111c91484'] Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-668b3b3b-09fa-4017-8256-ba7111c91484'] Aug 09 17:14:52.912028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:14:52.919674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c73871f0-c3d3-4cbe-b91f-25b976e57be7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:14:52.919674 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-668b3b3b-09fa-4017-8256-ba7111c91484'] {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:14:52.936531 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c73871f0-c3d3-4cbe-b91f-25b976e57be7 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/9f897521-953a-4422-bc6b-6f678cde515e" status: 404 len: 194 microversion: 2.1 time: 0.208641 Aug 09 17:14:52.942427 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 977/1854] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:14:52 2022] GET /compute/v2.1/os-security-groups/9f897521-953a-4422-bc6b-6f678cde515e => generated 194 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:14:52.969051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c250a08-e36d-4ae0-9c53-8a08dc4c2327 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb8045e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:53.173627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:53.213950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:14:53.236522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:53.256373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:53.266704 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-713e784d-70ee-421b-aba9-b5ce01ffbbe9 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.736915 Aug 09 17:14:53.285497 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 878/1855] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:52 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:53.668726 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c250a08-e36d-4ae0-9c53-8a08dc4c2327 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/7f025f9b-b7e8-4df5-90f9-9ea14f16f99e" status: 202 len: 0 microversion: 2.1 time: 0.718378 Aug 09 17:14:53.670759 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 978/1856] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:14:52 2022] DELETE /compute/v2.1/os-security-groups/7f025f9b-b7e8-4df5-90f9-9ea14f16f99e => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:14:53.701379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a6934494-1535-4f12-8e00-afa7878a79a3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb803b80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:54.032382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-a6934494-1535-4f12-8e00-afa7878a79a3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:14:54.037758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.security_group_api [None req-a6934494-1535-4f12-8e00-afa7878a79a3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Neutron security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e not found {{(pid=119432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:14:54.039551 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-a6934494-1535-4f12-8e00-afa7878a79a3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:14:54.039551 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-568c2958-f8f1-4025-aa17-2874edf37025'] Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a6934494-1535-4f12-8e00-afa7878a79a3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/os-security-groups/7f025f9b-b7e8-4df5-90f9-9ea14f16f99e HTTP/1.1 Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: exception: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-568c2958-f8f1-4025-aa17-2874edf37025'] Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '7f025f9b-b7e8-4df5-90f9-9ea14f16f99e'} Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:14:54.071808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-568c2958-f8f1-4025-aa17-2874edf37025'] Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-568c2958-f8f1-4025-aa17-2874edf37025'] Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-568c2958-f8f1-4025-aa17-2874edf37025'] Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-568c2958-f8f1-4025-aa17-2874edf37025'] Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a6934494-1535-4f12-8e00-afa7878a79a3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:14:54.080122 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-568c2958-f8f1-4025-aa17-2874edf37025'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:14:54.088323 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a6934494-1535-4f12-8e00-afa7878a79a3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/7f025f9b-b7e8-4df5-90f9-9ea14f16f99e" status: 404 len: 194 microversion: 2.1 time: 0.401778 Aug 09 17:14:54.088323 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 879/1857] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:14:53 2022] GET /compute/v2.1/os-security-groups/7f025f9b-b7e8-4df5-90f9-9ea14f16f99e => generated 194 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:14:54.120307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bb4b0afa-d865-4985-8d35-c343e3915efc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbdc9f4160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:54.328731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:54.333052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:54.389592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:54.390744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:54.396690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:54.398223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:54.404869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:54.407135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:55.181513 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bb4b0afa-d865-4985-8d35-c343e3915efc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 1.090157 Aug 09 17:14:55.184426 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 979/1858] 10.222.0.93 () {58 vars in 1158 bytes} [Tue Aug 9 17:14:54 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:14:55.218274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-56dca03b-11a4-41a4-b9a4-a12d453ee491 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'create', calling method: .version_select at 0x7fbbdc9f45e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-648158405", "description": "tempest-description-564890610"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:55.539569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:55.577216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:55.589539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:55.594154 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a0c2da5-83ba-47e2-94c7-29a90f1180d8 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 1.274334 Aug 09 17:14:55.598302 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 880/1859] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:54 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:55.614403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1ea59550-10d1-4def-9036-5e885570c76d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:55.614914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1ea59550-10d1-4def-9036-5e885570c76d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:55.641531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ea59550-10d1-4def-9036-5e885570c76d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:55.644069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ea59550-10d1-4def-9036-5e885570c76d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:55.645801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ea59550-10d1-4def-9036-5e885570c76d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:55.650207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ea59550-10d1-4def-9036-5e885570c76d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:55.650697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ea59550-10d1-4def-9036-5e885570c76d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:55.651164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1ea59550-10d1-4def-9036-5e885570c76d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:55.783890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1ea59550-10d1-4def-9036-5e885570c76d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:14:55.866897 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-56dca03b-11a4-41a4-b9a4-a12d453ee491 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.656875 Aug 09 17:14:55.868993 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 980/1860] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:14:55 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:14:55.905057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fab2efff-d7a8-4245-97e4-2ffe01287935 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'create', calling method: .version_select at 0x7fbbdc9f50d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1920885425", "description": "tempest-description-568100282"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:55.969416 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1ea59550-10d1-4def-9036-5e885570c76d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 204 len: 0 microversion: 2.1 time: 0.369554 Aug 09 17:14:55.970201 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 881/1861] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:14:55 2022] DELETE /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:14:56.015758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-45a261a6-14fb-4b1c-b830-61737a195d37 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:56.016976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-45a261a6-14fb-4b1c-b830-61737a195d37 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:56.035804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45a261a6-14fb-4b1c-b830-61737a195d37 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:56.046607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45a261a6-14fb-4b1c-b830-61737a195d37 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:56.047586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45a261a6-14fb-4b1c-b830-61737a195d37 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:56.057331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45a261a6-14fb-4b1c-b830-61737a195d37 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:56.058400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45a261a6-14fb-4b1c-b830-61737a195d37 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:56.061154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45a261a6-14fb-4b1c-b830-61737a195d37 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:56.356365 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fab2efff-d7a8-4245-97e4-2ffe01287935 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.452230 Aug 09 17:14:56.358796 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 981/1862] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:14:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:14:56.599226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1983018954", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "25d74a20-a9e8-476d-a8b6-c80effe85c41"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:14:56.700499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45a261a6-14fb-4b1c-b830-61737a195d37 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:56.709958 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-45a261a6-14fb-4b1c-b830-61737a195d37 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1668 microversion: 2.1 time: 0.732959 Aug 09 17:14:56.717995 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 882/1863] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:55 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1668 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:14:56.748670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:56.749603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:56.757800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:56.770442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:56.771031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:56.771853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:56.772336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:56.772780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:56.899991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] validate_networks() for [('25d74a20-a9e8-476d-a8b6-c80effe85c41', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:14:57.633525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:57.667729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:57.671780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:57.674836 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-92fd6be4-0f09-4de7-9950-5b2682025fe0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.954430 Aug 09 17:14:57.680299 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 883/1864] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:56 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:14:57.742473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a66c1894-e214-4355-9937-d2d9da8e3499 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:57.745644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a66c1894-e214-4355-9937-d2d9da8e3499 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:57.769978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a66c1894-e214-4355-9937-d2d9da8e3499 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:57.771341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a66c1894-e214-4355-9937-d2d9da8e3499 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:57.774202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a66c1894-e214-4355-9937-d2d9da8e3499 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:57.779383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a66c1894-e214-4355-9937-d2d9da8e3499 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:57.780723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a66c1894-e214-4355-9937-d2d9da8e3499 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:57.784804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a66c1894-e214-4355-9937-d2d9da8e3499 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:58.368072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a66c1894-e214-4355-9937-d2d9da8e3499 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:58.380564 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a66c1894-e214-4355-9937-d2d9da8e3499 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1668 microversion: 2.1 time: 0.645565 Aug 09 17:14:58.394380 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 884/1865] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:57 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1668 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:14:58.736767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:58.738139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:58.748650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:58.750485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:58.754295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:58.755602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:58.756503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:58.757613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:59.453702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:59.477911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:59.481585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:14:59.483482 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-05cd4e6d-16ed-48da-b184-4e56fe3bad2d tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.753802 Aug 09 17:14:59.484932 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 885/1866] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:14:58 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:14:59.492605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2b94f8be-0e05-4f43-a728-8c7f5dc7e2ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:14:59.493771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2b94f8be-0e05-4f43-a728-8c7f5dc7e2ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:14:59.504039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b94f8be-0e05-4f43-a728-8c7f5dc7e2ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:59.505607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b94f8be-0e05-4f43-a728-8c7f5dc7e2ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:59.506800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b94f8be-0e05-4f43-a728-8c7f5dc7e2ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:59.507940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b94f8be-0e05-4f43-a728-8c7f5dc7e2ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:59.508812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b94f8be-0e05-4f43-a728-8c7f5dc7e2ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:59.509595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b94f8be-0e05-4f43-a728-8c7f5dc7e2ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:59.800480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:14:59.801584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:14:59.803223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:14:59.804232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:14:59.805137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:14:59.851056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:59.854528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:59.858300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:59.862824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:14:59.867719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:14:59.870217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:14:59.931489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Getting quotas for project f8ff2acea44b4a108d6bd1083b255e72. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:14:59.943179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Getting quotas for user 4fbccf8cda9b43fda5ec9ae0fc0be735 and project f8ff2acea44b4a108d6bd1083b255e72. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:14:59.969529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:14:59.976633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:15:00.039892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b94f8be-0e05-4f43-a728-8c7f5dc7e2ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:00.048158 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2b94f8be-0e05-4f43-a728-8c7f5dc7e2ce tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1668 microversion: 2.1 time: 0.561532 Aug 09 17:15:00.049021 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 886/1867] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:14:59 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1668 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:00.132544 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-15894ef3-77f1-40c7-be13-733c17788d58 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.558583 Aug 09 17:15:00.134435 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 982/1868] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:15:00.147144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a1cfd38b-3118-46a0-ac62-a8aac1413f21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:00.148209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a1cfd38b-3118-46a0-ac62-a8aac1413f21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:00.518069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a1cfd38b-3118-46a0-ac62-a8aac1413f21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:00.529301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:00.530295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:00.549996 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a1cfd38b-3118-46a0-ac62-a8aac1413f21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1216 microversion: 2.1 time: 0.406033 Aug 09 17:15:00.551198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:00.551853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:00.554800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:00.558272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:00.558784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:00.559240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:00.570034 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 887/1869] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:00 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1216 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:00.589013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:01.091889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-764391df-db46-4f09-af70-22c7873a1a9a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:01.093953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-764391df-db46-4f09-af70-22c7873a1a9a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:01.119974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-764391df-db46-4f09-af70-22c7873a1a9a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:01.120290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-764391df-db46-4f09-af70-22c7873a1a9a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:01.120981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-764391df-db46-4f09-af70-22c7873a1a9a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:01.122016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-764391df-db46-4f09-af70-22c7873a1a9a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:01.122795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-764391df-db46-4f09-af70-22c7873a1a9a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:01.123492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-764391df-db46-4f09-af70-22c7873a1a9a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:01.391668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-764391df-db46-4f09-af70-22c7873a1a9a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:01.421270 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-764391df-db46-4f09-af70-22c7873a1a9a tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 200 len: 1601 microversion: 2.1 time: 0.346004 Aug 09 17:15:01.428131 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 888/1870] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:01 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 1601 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:01.447100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-764b1dbc-4fbb-423c-9d83-4ba3f26f250f req-816c3fe0-8c51-43ca-8002-ecd80491fab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bde0f3f-3670-4908-bc71-f4af6b3671b2", "name": "network-vif-deleted", "tag": "02f77b41-d5fc-4f8a-8aac-6e744c227b20"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:01.482490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-764b1dbc-4fbb-423c-9d83-4ba3f26f250f req-816c3fe0-8c51-43ca-8002-ecd80491fab4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:01.482490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-764b1dbc-4fbb-423c-9d83-4ba3f26f250f req-816c3fe0-8c51-43ca-8002-ecd80491fab4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:01.483531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-764b1dbc-4fbb-423c-9d83-4ba3f26f250f req-816c3fe0-8c51-43ca-8002-ecd80491fab4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:01.496087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:01.519306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:01.525595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:01.531893 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-27d4011d-6149-452b-8712-07240d65f804 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 1.006025 Aug 09 17:15:01.533565 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 983/1871] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:00 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:15:01.541034 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-764b1dbc-4fbb-423c-9d83-4ba3f26f250f req-816c3fe0-8c51-43ca-8002-ecd80491fab4 service nova] Creating event network-vif-deleted:02f77b41-d5fc-4f8a-8aac-6e744c227b20 for instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 on n-h1-845781-6 Aug 09 17:15:01.565860 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-764b1dbc-4fbb-423c-9d83-4ba3f26f250f req-816c3fe0-8c51-43ca-8002-ecd80491fab4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133105 Aug 09 17:15:01.573738 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 889/1872] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:01.614576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e84cd00-f532-42e6-8f10-988fa5af1c1f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:01.620598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3e84cd00-f532-42e6-8f10-988fa5af1c1f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:01.644922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e84cd00-f532-42e6-8f10-988fa5af1c1f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:01.646211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e84cd00-f532-42e6-8f10-988fa5af1c1f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:01.649002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e84cd00-f532-42e6-8f10-988fa5af1c1f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:01.652272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e84cd00-f532-42e6-8f10-988fa5af1c1f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:01.653582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e84cd00-f532-42e6-8f10-988fa5af1c1f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:01.655872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e84cd00-f532-42e6-8f10-988fa5af1c1f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:02.052148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3e84cd00-f532-42e6-8f10-988fa5af1c1f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:02.105484 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e84cd00-f532-42e6-8f10-988fa5af1c1f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1220 microversion: 2.1 time: 0.514174 Aug 09 17:15:02.114190 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 984/1873] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:01 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1220 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:02.450099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:02.450974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2bde0f3f-3670-4908-bc71-f4af6b3671b2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:02.475605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:02.477102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:02.478437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:02.481284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:02.483340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:02.486048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:02.535373 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] HTTP exception thrown: Instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 could not be found. Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Request method failure captured: Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 HTTP/1.1 Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pO9dVfxkYNOAwgTl3f0K6Lywkb0QX-AYXJvKdW9se_yvhAmrpqVKZWa-PEP7GXSDfD_NZF_SQrLy3lt-ad6hWDhNkyNnkajtocoBOkt_Vm-3gGycg-SNTjGmJGRi6_A1GwIjK01eDJ0dHz9ugwI872ViBZcPwyTgRByUWTxkQFN8b0 Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 44129d75c58240fa867e90b1d3252554 Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-LiveMigrationTest-837947133 Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_44129d75c58240fa867e90b1d3252554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/44129d75c58240fa867e90b1d3252554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/44129d75c58240fa867e90b1d3252554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/44129d75c58240fa867e90b1d3252554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-LiveMigrationTest-837947133 Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 44129d75c58240fa867e90b1d3252554 Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-LiveMigrationTest-837947133 Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-LiveMigrationTest-837947133-project Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 894725e0d56b4960a8bc3e6a8e283b4e Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-LiveMigrationTest-837947133-project Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 could not be found. Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '2bde0f3f-3670-4908-bc71-f4af6b3671b2'} Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 could not be found. Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 could not be found. Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:02.537981 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:02.542000 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:02.542000 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:02.542000 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:02.542000 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:15:02.542000 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:15:02.542000 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 could not be found. Aug 09 17:15:02.542000 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:02.545378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Returning 404 to user: Instance 2bde0f3f-3670-4908-bc71-f4af6b3671b2 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:15:02.547165 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8c83dd61-5a59-40c5-a97e-596fd21fc11d tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2" status: 404 len: 111 microversion: 2.1 time: 0.104045 Aug 09 17:15:02.552556 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 890/1874] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:02 2022] GET /compute/v2.1/servers/2bde0f3f-3670-4908-bc71-f4af6b3671b2 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:15:02.565209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9fda51fc-733a-419c-981b-4724fa0a2530 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '.version_select at 0x7fbbcb823820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:02.589641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:02.591605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:02.621487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:02.625852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:02.627005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:02.633210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:02.636032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:02.637498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:02.652209 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9fda51fc-733a-419c-981b-4724fa0a2530 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201032910" status: 202 len: 0 microversion: 2.1 time: 0.094187 Aug 09 17:15:02.672419 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 985/1875] 10.222.0.93 () {58 vars in 1221 bytes} [Tue Aug 9 17:15:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201032910 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:15:03.155957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0dbddd0a-2fd6-48da-a646-7e66bb06f967 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:03.158488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0dbddd0a-2fd6-48da-a646-7e66bb06f967 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:03.223803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dbddd0a-2fd6-48da-a646-7e66bb06f967 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:03.225936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dbddd0a-2fd6-48da-a646-7e66bb06f967 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:03.228304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dbddd0a-2fd6-48da-a646-7e66bb06f967 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:03.232074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dbddd0a-2fd6-48da-a646-7e66bb06f967 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:03.233971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dbddd0a-2fd6-48da-a646-7e66bb06f967 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:03.236249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dbddd0a-2fd6-48da-a646-7e66bb06f967 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:03.601268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0dbddd0a-2fd6-48da-a646-7e66bb06f967 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:03.628307 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0dbddd0a-2fd6-48da-a646-7e66bb06f967 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1276 microversion: 2.1 time: 0.479650 Aug 09 17:15:03.635132 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 986/1876] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:03 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1276 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:03.670909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-404b5962-1545-472b-8c8c-61811769eb7d req-7bcf835f-7c4f-494d-bdd1-c0d8fc2c4bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa81dada-6ad4-4d36-9deb-1a9d8e59fa29", "name": "network-vif-unplugged", "status": "completed", "tag": "284be49d-a456-4cf0-93f3-b75907df99a5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:03.706351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:03.784179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-404b5962-1545-472b-8c8c-61811769eb7d req-7bcf835f-7c4f-494d-bdd1-c0d8fc2c4bca service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:03.791093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-404b5962-1545-472b-8c8c-61811769eb7d req-7bcf835f-7c4f-494d-bdd1-c0d8fc2c4bca service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:03.793459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-404b5962-1545-472b-8c8c-61811769eb7d req-7bcf835f-7c4f-494d-bdd1-c0d8fc2c4bca service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:03.808085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:03.818888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:03.827836 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a04a0904-8adc-4c12-bcdc-8ac277e2e238 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 1.253183 Aug 09 17:15:03.827836 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 891/1877] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:02 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:03.879054 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-404b5962-1545-472b-8c8c-61811769eb7d req-7bcf835f-7c4f-494d-bdd1-c0d8fc2c4bca service nova] Creating event network-vif-unplugged:284be49d-a456-4cf0-93f3-b75907df99a5 for instance fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 on n-h1-845781-6 Aug 09 17:15:03.897207 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-404b5962-1545-472b-8c8c-61811769eb7d req-7bcf835f-7c4f-494d-bdd1-c0d8fc2c4bca service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.257724 Aug 09 17:15:03.901764 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 987/1878] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:04.682005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a72dca5d-9eaa-45b9-b96f-8e118f04b46a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:04.683819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a72dca5d-9eaa-45b9-b96f-8e118f04b46a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:04.718544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a72dca5d-9eaa-45b9-b96f-8e118f04b46a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:04.719436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a72dca5d-9eaa-45b9-b96f-8e118f04b46a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:04.722300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a72dca5d-9eaa-45b9-b96f-8e118f04b46a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:04.725596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a72dca5d-9eaa-45b9-b96f-8e118f04b46a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:04.726736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a72dca5d-9eaa-45b9-b96f-8e118f04b46a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:04.727799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a72dca5d-9eaa-45b9-b96f-8e118f04b46a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:04.863843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:04.891993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:04.978216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:04.980894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:04.986204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:04.990875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:04.996274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:05.001763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:05.077446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a72dca5d-9eaa-45b9-b96f-8e118f04b46a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:05.092437 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a72dca5d-9eaa-45b9-b96f-8e118f04b46a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1274 microversion: 2.1 time: 0.422353 Aug 09 17:15:05.101300 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 892/1879] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:04 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1274 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:05.493739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f8e6fdd6-29dd-4ce8-8e5d-ebeb071761bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:05.494715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f8e6fdd6-29dd-4ce8-8e5d-ebeb071761bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:05.504820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8e6fdd6-29dd-4ce8-8e5d-ebeb071761bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:05.505673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8e6fdd6-29dd-4ce8-8e5d-ebeb071761bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:05.506450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8e6fdd6-29dd-4ce8-8e5d-ebeb071761bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:05.508276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8e6fdd6-29dd-4ce8-8e5d-ebeb071761bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:05.508964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8e6fdd6-29dd-4ce8-8e5d-ebeb071761bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:05.509544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8e6fdd6-29dd-4ce8-8e5d-ebeb071761bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:05.573042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f8e6fdd6-29dd-4ce8-8e5d-ebeb071761bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:15:05.838820 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f8e6fdd6-29dd-4ce8-8e5d-ebeb071761bc tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 204 len: 0 microversion: 2.1 time: 0.354782 Aug 09 17:15:05.843561 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 893/1880] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:15:05 2022] DELETE /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:15:05.851970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b8212506-8dc1-481a-9e69-30d74f21264c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:05.853943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b8212506-8dc1-481a-9e69-30d74f21264c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:05.861926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8212506-8dc1-481a-9e69-30d74f21264c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:05.864261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8212506-8dc1-481a-9e69-30d74f21264c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:05.865317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8212506-8dc1-481a-9e69-30d74f21264c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:05.866324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8212506-8dc1-481a-9e69-30d74f21264c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:05.867495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8212506-8dc1-481a-9e69-30d74f21264c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:05.868788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8212506-8dc1-481a-9e69-30d74f21264c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:06.117376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:06.134498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:06.137065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:06.138623 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-28248664-f4f5-4405-8fa5-7f4ca2dc7b5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 1.283825 Aug 09 17:15:06.140243 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 988/1881] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:04 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:06.146171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-925733f9-b6bd-48f4-a1a6-2a0b2d2f8a82 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:06.147842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-925733f9-b6bd-48f4-a1a6-2a0b2d2f8a82 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:06.164223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-925733f9-b6bd-48f4-a1a6-2a0b2d2f8a82 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:06.165032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-925733f9-b6bd-48f4-a1a6-2a0b2d2f8a82 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:06.165770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-925733f9-b6bd-48f4-a1a6-2a0b2d2f8a82 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:06.167133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-925733f9-b6bd-48f4-a1a6-2a0b2d2f8a82 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:06.168430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-925733f9-b6bd-48f4-a1a6-2a0b2d2f8a82 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:06.169291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-925733f9-b6bd-48f4-a1a6-2a0b2d2f8a82 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:06.437152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-925733f9-b6bd-48f4-a1a6-2a0b2d2f8a82 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:06.450289 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-925733f9-b6bd-48f4-a1a6-2a0b2d2f8a82 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1274 microversion: 2.1 time: 0.307419 Aug 09 17:15:06.450953 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 989/1882] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:06 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1274 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:06.892349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b8212506-8dc1-481a-9e69-30d74f21264c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:06.908815 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b8212506-8dc1-481a-9e69-30d74f21264c tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1486 microversion: 2.1 time: 1.062337 Aug 09 17:15:06.910330 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 894/1883] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:05 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1486 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:07.070158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e6234585-3530-4246-9124-e54033548293 req-9a110e08-12d8-431d-95fc-f84363c734f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa81dada-6ad4-4d36-9deb-1a9d8e59fa29", "tag": "284be49d-a456-4cf0-93f3-b75907df99a5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:07.102527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e6234585-3530-4246-9124-e54033548293 req-9a110e08-12d8-431d-95fc-f84363c734f2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:07.104088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e6234585-3530-4246-9124-e54033548293 req-9a110e08-12d8-431d-95fc-f84363c734f2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:07.105650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e6234585-3530-4246-9124-e54033548293 req-9a110e08-12d8-431d-95fc-f84363c734f2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:07.183165 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e6234585-3530-4246-9124-e54033548293 req-9a110e08-12d8-431d-95fc-f84363c734f2 service nova] Creating event network-changed:284be49d-a456-4cf0-93f3-b75907df99a5 for instance fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 on n-h1-845781-6 Aug 09 17:15:07.183928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:07.187282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:07.207673 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e6234585-3530-4246-9124-e54033548293 req-9a110e08-12d8-431d-95fc-f84363c734f2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152232 Aug 09 17:15:07.210159 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 990/1884] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:07.219428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:07.225962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:07.228762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:07.236614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:07.237680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:07.240903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:07.287228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:07.485839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9ee4dd60-69d2-46cc-9abd-5995ebac729d tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:07.487324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9ee4dd60-69d2-46cc-9abd-5995ebac729d tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:07.512062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd60-69d2-46cc-9abd-5995ebac729d tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:07.513548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd60-69d2-46cc-9abd-5995ebac729d tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:07.513548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd60-69d2-46cc-9abd-5995ebac729d tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:07.514215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd60-69d2-46cc-9abd-5995ebac729d tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:07.514809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd60-69d2-46cc-9abd-5995ebac729d tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:07.515355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ee4dd60-69d2-46cc-9abd-5995ebac729d tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:08.203577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:08.221918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9ee4dd60-69d2-46cc-9abd-5995ebac729d tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:08.230006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:08.234741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:08.238151 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eafc037a-a860-40b6-a3b8-a99dc3f43def tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 1.064704 Aug 09 17:15:08.240564 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 895/1885] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:07 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:08.251799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-98157fe7-16fc-41da-8edb-c5cbfc633183 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:08.253914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-98157fe7-16fc-41da-8edb-c5cbfc633183 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:08.263495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98157fe7-16fc-41da-8edb-c5cbfc633183 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:08.264429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98157fe7-16fc-41da-8edb-c5cbfc633183 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:08.265938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98157fe7-16fc-41da-8edb-c5cbfc633183 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:08.267100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98157fe7-16fc-41da-8edb-c5cbfc633183 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:08.267917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98157fe7-16fc-41da-8edb-c5cbfc633183 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:08.268660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98157fe7-16fc-41da-8edb-c5cbfc633183 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:08.292535 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9ee4dd60-69d2-46cc-9abd-5995ebac729d tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1316 microversion: 2.1 time: 0.820607 Aug 09 17:15:08.294604 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 991/1886] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:07 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1316 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:09.282440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:09.283076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:09.298375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:09.299150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:09.299606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:09.302717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:09.303217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:09.309373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:09.347007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-98157fe7-16fc-41da-8edb-c5cbfc633183 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:09.363370 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-98157fe7-16fc-41da-8edb-c5cbfc633183 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 200 len: 1486 microversion: 2.1 time: 1.120530 Aug 09 17:15:09.371583 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 896/1887] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:08 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 1486 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:09.390176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7b2b22c-95dc-412c-8881-73dceb0c9a21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:09.397754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f7b2b22c-95dc-412c-8881-73dceb0c9a21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:09.447919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7b2b22c-95dc-412c-8881-73dceb0c9a21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:09.448436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7b2b22c-95dc-412c-8881-73dceb0c9a21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:09.458393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7b2b22c-95dc-412c-8881-73dceb0c9a21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:09.459593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7b2b22c-95dc-412c-8881-73dceb0c9a21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:09.460310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7b2b22c-95dc-412c-8881-73dceb0c9a21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:09.462504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7b2b22c-95dc-412c-8881-73dceb0c9a21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:09.895377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f7b2b22c-95dc-412c-8881-73dceb0c9a21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:09.913907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:09.935706 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f7b2b22c-95dc-412c-8881-73dceb0c9a21 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1316 microversion: 2.1 time: 0.558534 Aug 09 17:15:09.943692 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 897/1888] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:09 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:09.955295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-9d8e3470-5e94-4c3d-b941-f09c8ee42b6e req-27cd9947-738c-47c0-bda0-db26d547d2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fec2f16-7d50-4468-be26-23c4e25c2930", "name": "network-vif-deleted", "tag": "e43b13de-00b3-407c-88fd-f5e04caff542"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:09.958042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:10.018845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9d8e3470-5e94-4c3d-b941-f09c8ee42b6e req-27cd9947-738c-47c0-bda0-db26d547d2f3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:10.020943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9d8e3470-5e94-4c3d-b941-f09c8ee42b6e req-27cd9947-738c-47c0-bda0-db26d547d2f3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:10.024848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9d8e3470-5e94-4c3d-b941-f09c8ee42b6e req-27cd9947-738c-47c0-bda0-db26d547d2f3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:10.068299 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-9d8e3470-5e94-4c3d-b941-f09c8ee42b6e req-27cd9947-738c-47c0-bda0-db26d547d2f3 service nova] Creating event network-vif-deleted:e43b13de-00b3-407c-88fd-f5e04caff542 for instance 2fec2f16-7d50-4468-be26-23c4e25c2930 on n-h2-845781-6 Aug 09 17:15:10.082588 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-9d8e3470-5e94-4c3d-b941-f09c8ee42b6e req-27cd9947-738c-47c0-bda0-db26d547d2f3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135861 Aug 09 17:15:10.085136 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 898/1889] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:10.281631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:10.294258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:10.302934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:10.306780 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-628f5844-cd8a-4f76-85e7-54be846383d3 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 1.027548 Aug 09 17:15:10.307960 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 992/1890] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:09 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:15:10.400104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:10.401355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: 2fec2f16-7d50-4468-be26-23c4e25c2930] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:10.422341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:10.423170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:10.428885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:10.451318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:10.452495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:10.457071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:10.534377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:10.538243 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] HTTP exception thrown: Instance 2fec2f16-7d50-4468-be26-23c4e25c2930 could not be found. Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Request method failure captured: Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 HTTP/1.1 Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pO9dVfxkYNOAwgTl3f0K6Lywkb0QX-AYXJvKdW9se_yvhAmrpqVKZWa-PEP7GXSDfD_NZF_SQrLy3lt-ad6hWDhNkyNnkajtocoBOkt_Vm-3gGycg-SNTjGmJGRi6_A1GwIjK01eDJ0dHz9ugwI872ViBZcPwyTgRByUWTxkQFN8b0 Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 44129d75c58240fa867e90b1d3252554 Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-LiveMigrationTest-837947133 Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_44129d75c58240fa867e90b1d3252554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/44129d75c58240fa867e90b1d3252554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/44129d75c58240fa867e90b1d3252554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/44129d75c58240fa867e90b1d3252554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-LiveMigrationTest-837947133 Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 44129d75c58240fa867e90b1d3252554 Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-LiveMigrationTest-837947133 Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-LiveMigrationTest-837947133-project Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 894725e0d56b4960a8bc3e6a8e283b4e Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-LiveMigrationTest-837947133-project Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 2fec2f16-7d50-4468-be26-23c4e25c2930 could not be found. Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '2fec2f16-7d50-4468-be26-23c4e25c2930'} Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fec2f16-7d50-4468-be26-23c4e25c2930 could not be found. Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fec2f16-7d50-4468-be26-23c4e25c2930 could not be found. Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:10.541573 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:10.545252 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:10.545252 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:10.545252 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:10.545252 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:15:10.545252 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:15:10.545252 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fec2f16-7d50-4468-be26-23c4e25c2930 could not be found. Aug 09 17:15:10.545252 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:10.545252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Returning 404 to user: Instance 2fec2f16-7d50-4468-be26-23c4e25c2930 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:15:10.545252 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d359a99f-140b-4d82-8e31-722fd8181c27 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930" status: 404 len: 111 microversion: 2.1 time: 0.152788 Aug 09 17:15:10.553167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 899/1891] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:10 2022] GET /compute/v2.1/servers/2fec2f16-7d50-4468-be26-23c4e25c2930 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:15:10.557331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-02b913d6-aab2-4237-a1ca-86059e257095 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:10.558489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-02b913d6-aab2-4237-a1ca-86059e257095 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:10.571190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02b913d6-aab2-4237-a1ca-86059e257095 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:10.572559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02b913d6-aab2-4237-a1ca-86059e257095 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:10.573315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02b913d6-aab2-4237-a1ca-86059e257095 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:10.575325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02b913d6-aab2-4237-a1ca-86059e257095 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:10.576787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02b913d6-aab2-4237-a1ca-86059e257095 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:10.577546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02b913d6-aab2-4237-a1ca-86059e257095 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:10.624537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-02b913d6-aab2-4237-a1ca-86059e257095 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:15:10.779155 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-02b913d6-aab2-4237-a1ca-86059e257095 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 204 len: 0 microversion: 2.1 time: 0.227951 Aug 09 17:15:10.784625 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 993/1892] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:15:10 2022] DELETE /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:15:10.801281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d22ee39d-83f3-465e-8a21-6214fe2b4735 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:10.806288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d22ee39d-83f3-465e-8a21-6214fe2b4735 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:10.823187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d22ee39d-83f3-465e-8a21-6214fe2b4735 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:10.824581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d22ee39d-83f3-465e-8a21-6214fe2b4735 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:10.825846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d22ee39d-83f3-465e-8a21-6214fe2b4735 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:10.827508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d22ee39d-83f3-465e-8a21-6214fe2b4735 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:10.828854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d22ee39d-83f3-465e-8a21-6214fe2b4735 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:10.829993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d22ee39d-83f3-465e-8a21-6214fe2b4735 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:10.966671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b11af06e-b987-48c6-b2f5-eb6434e62cca tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:10.968939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b11af06e-b987-48c6-b2f5-eb6434e62cca tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:10.992420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b11af06e-b987-48c6-b2f5-eb6434e62cca tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:10.995021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b11af06e-b987-48c6-b2f5-eb6434e62cca tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:10.996417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b11af06e-b987-48c6-b2f5-eb6434e62cca tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:11.001996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b11af06e-b987-48c6-b2f5-eb6434e62cca tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:11.003547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b11af06e-b987-48c6-b2f5-eb6434e62cca tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:11.005848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b11af06e-b987-48c6-b2f5-eb6434e62cca tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:11.744037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d22ee39d-83f3-465e-8a21-6214fe2b4735 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:11.765500 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d22ee39d-83f3-465e-8a21-6214fe2b4735 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1500 microversion: 2.1 time: 0.979352 Aug 09 17:15:11.790149 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 900/1893] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:10 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1500 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:11.817557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:11.821162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:11.886952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:11.898336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:11.899283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:11.900447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:11.901993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:11.903301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:11.904297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:12.179706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b11af06e-b987-48c6-b2f5-eb6434e62cca tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:12.199937 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b11af06e-b987-48c6-b2f5-eb6434e62cca tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1316 microversion: 2.1 time: 1.238425 Aug 09 17:15:12.204644 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 994/1894] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:10 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1316 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:15:12.223648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-14ee332a-256c-4226-a252-eaf71a4dbffe req-69c90aea-9d3c-4a52-a939-02a239ed2154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d16bcba-8ad6-47eb-b715-130c8906d546", "tag": "91ca63ca-509b-4db2-8205-e89c4c1a4ff6"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:12.254853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-14ee332a-256c-4226-a252-eaf71a4dbffe req-69c90aea-9d3c-4a52-a939-02a239ed2154 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:12.258289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-14ee332a-256c-4226-a252-eaf71a4dbffe req-69c90aea-9d3c-4a52-a939-02a239ed2154 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:12.259027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-14ee332a-256c-4226-a252-eaf71a4dbffe req-69c90aea-9d3c-4a52-a939-02a239ed2154 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:12.278260 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-14ee332a-256c-4226-a252-eaf71a4dbffe req-69c90aea-9d3c-4a52-a939-02a239ed2154 service nova] Creating event network-changed:91ca63ca-509b-4db2-8205-e89c4c1a4ff6 for instance 4d16bcba-8ad6-47eb-b715-130c8906d546 on n-h1-845781-6 Aug 09 17:15:12.288901 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-14ee332a-256c-4226-a252-eaf71a4dbffe req-69c90aea-9d3c-4a52-a939-02a239ed2154 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080670 Aug 09 17:15:12.290715 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 995/1895] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:12.552347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:12.575728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:12.577418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:12.590809 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-551a8feb-8677-40a9-943a-496dee5ea436 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.797342 Aug 09 17:15:12.592166 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 901/1896] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:11 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:12.798004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-65c70b71-4ad5-4b64-93ea-e35048493595 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:12.800858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-65c70b71-4ad5-4b64-93ea-e35048493595 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:12.825362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65c70b71-4ad5-4b64-93ea-e35048493595 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:12.826129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65c70b71-4ad5-4b64-93ea-e35048493595 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:12.827237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65c70b71-4ad5-4b64-93ea-e35048493595 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:12.830644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65c70b71-4ad5-4b64-93ea-e35048493595 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:12.835322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65c70b71-4ad5-4b64-93ea-e35048493595 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:12.836046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65c70b71-4ad5-4b64-93ea-e35048493595 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:13.229209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7875fa93-cfe2-4d40-8c1e-1ff7c6a90f91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:13.232201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7875fa93-cfe2-4d40-8c1e-1ff7c6a90f91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:13.248959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7875fa93-cfe2-4d40-8c1e-1ff7c6a90f91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:13.252167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7875fa93-cfe2-4d40-8c1e-1ff7c6a90f91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:13.252685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7875fa93-cfe2-4d40-8c1e-1ff7c6a90f91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:13.256326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7875fa93-cfe2-4d40-8c1e-1ff7c6a90f91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:13.257426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7875fa93-cfe2-4d40-8c1e-1ff7c6a90f91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:13.267428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7875fa93-cfe2-4d40-8c1e-1ff7c6a90f91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:13.842497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-65c70b71-4ad5-4b64-93ea-e35048493595 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:13.867218 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-65c70b71-4ad5-4b64-93ea-e35048493595 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1458 microversion: 2.1 time: 1.072098 Aug 09 17:15:13.867949 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 996/1897] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:12 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1458 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:13.885818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:13.886458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:13.921251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:13.921856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:13.922357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:13.927541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:13.932335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:13.933429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:14.460893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7875fa93-cfe2-4d40-8c1e-1ff7c6a90f91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:14.528155 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7875fa93-cfe2-4d40-8c1e-1ff7c6a90f91 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1316 microversion: 2.1 time: 1.301906 Aug 09 17:15:14.541901 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 902/1898] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:13 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1316 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:14.644236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:14.669029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:14.676135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:14.683602 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-55aeb3d8-4d30-4a51-ad62-b4ab3e16df07 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.810511 Aug 09 17:15:14.688626 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 997/1899] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:13 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:14.706209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9972e948-00d3-461b-9fc8-07412ecf1a53 req-dbc01bfa-391a-4439-99f2-570af6595b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb84cd97-b6b0-40f0-9774-e5baa48fc7c9", "name": "network-vif-deleted", "tag": "22f0d67b-a0ab-4059-b2b2-907936f07fb8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:14.748581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9972e948-00d3-461b-9fc8-07412ecf1a53 req-dbc01bfa-391a-4439-99f2-570af6595b09 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:14.754778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9972e948-00d3-461b-9fc8-07412ecf1a53 req-dbc01bfa-391a-4439-99f2-570af6595b09 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:14.755725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9972e948-00d3-461b-9fc8-07412ecf1a53 req-dbc01bfa-391a-4439-99f2-570af6595b09 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:14.822853 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9972e948-00d3-461b-9fc8-07412ecf1a53 req-dbc01bfa-391a-4439-99f2-570af6595b09 service nova] Creating event network-vif-deleted:22f0d67b-a0ab-4059-b2b2-907936f07fb8 for instance fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 on n-h2-845781-6 Aug 09 17:15:14.844267 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9972e948-00d3-461b-9fc8-07412ecf1a53 req-dbc01bfa-391a-4439-99f2-570af6595b09 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151603 Aug 09 17:15:14.854178 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 998/1900] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:14.916733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:14.920619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:14.978062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:14.984297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:14.987589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:14.991821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:15.001451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:15.010272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:15.326327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:15.327575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:15.328510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:15.329527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lazy-loading 'fault' on Instance uuid fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:15:15.517847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894725e0d56b4960a8bc3e6a8e283b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44129d75c58240fa867e90b1d3252554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:15.553161 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c5aadc6b-f4e2-4d6d-80ab-ea2334a8b321 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 200 len: 1301 microversion: 2.1 time: 0.643332 Aug 09 17:15:15.560837 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 999/1901] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:14 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 1301 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:15:15.587974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-62b51b0c-9b96-4a98-b41f-036e65262ba3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:15.589250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-62b51b0c-9b96-4a98-b41f-036e65262ba3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:15.617347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "239b5922-7df5-4781-ba9f-1cdb64172dbd"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:15.618107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b51b0c-9b96-4a98-b41f-036e65262ba3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:15.618107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b51b0c-9b96-4a98-b41f-036e65262ba3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:15.618313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b51b0c-9b96-4a98-b41f-036e65262ba3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:15.619130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b51b0c-9b96-4a98-b41f-036e65262ba3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:15.619727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b51b0c-9b96-4a98-b41f-036e65262ba3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:15.620257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b51b0c-9b96-4a98-b41f-036e65262ba3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:15.647994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:15.682639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:15.685504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:15.694404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:15.695982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:15.701735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:15.704988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:16.012004 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] HTTP exception thrown: Volume 239b5922-7df5-4781-ba9f-1cdb64172dbd could not be found. Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Request method failure captured: Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments/08c32e8b-08f2-4cab-8418-dde313bdb1cd HTTP/1.1 Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 74 Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pWu_WXFpYxGhQx82NrAeAR81zaoSZsLeV261bwD_Be6SrO0f8iEoeg9GLREG32Vucz9H5V9to5RDRTaUE7Q8Ii28kPZ_GOOqR_Vtich3rTj8l6TmA2jNElBeDWp3cW2FIVYiOmjiDBDAhBKXfFPuCdbgpxBQTb79K5bvja6Au46cbQ Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 67046aef914b4179b7bbb61b1501783a Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesAdminNegativeTest-351068267 Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_67046aef914b4179b7bbb61b1501783a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/67046aef914b4179b7bbb61b1501783a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/67046aef914b4179b7bbb61b1501783a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/67046aef914b4179b7bbb61b1501783a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesAdminNegativeTest-351068267 Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 67046aef914b4179b7bbb61b1501783a Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-351068267 Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesAdminNegativeTest-351068267-project-admin Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 9f33527c941e46dba7ba2ed26f316fa6 Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesAdminNegativeTest-351068267-project-admin Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: {"volumeAttachment": {"volumeId": "239b5922-7df5-4781-ba9f-1cdb64172dbd"}} Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: exception: Volume 239b5922-7df5-4781-ba9f-1cdb64172dbd could not be found. Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'server_id': '0fcdaafd-e14c-4307-aa16-fd4860b74633', 'id': '08c32e8b-08f2-4cab-8418-dde313bdb1cd', 'body': {'volumeAttachment': {'volumeId': '239b5922-7df5-4781-ba9f-1cdb64172dbd'}}} Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 239b5922-7df5-4781-ba9f-1cdb64172dbd could not be found. (HTTP 404) (Request-ID: req-608736a2-1201-476b-aae7-b8183d308206) Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:15:16.048236 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 239b5922-7df5-4781-ba9f-1cdb64172dbd could not be found. Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 239b5922-7df5-4781-ba9f-1cdb64172dbd could not be found. Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 239b5922-7df5-4781-ba9f-1cdb64172dbd could not be found. Aug 09 17:15:16.052362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.056218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Returning 400 to user: Volume 239b5922-7df5-4781-ba9f-1cdb64172dbd could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:15:16.057678 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c2d330a0-ecc8-4237-80a1-1e082cca7372 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] 10.222.0.93 "PUT /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments/08c32e8b-08f2-4cab-8418-dde313bdb1cd" status: 400 len: 107 microversion: 2.1 time: 1.510827 Aug 09 17:15:16.058815 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 903/1902] 10.222.0.93 () {60 vars in 1433 bytes} [Tue Aug 9 17:15:14 2022] PUT /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments/08c32e8b-08f2-4cab-8418-dde313bdb1cd => generated 107 bytes in 1514 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:15:16.065332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:16.068834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:16.093241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:16.099380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:16.102234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:16.103952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:16.104783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:16.105564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:16.257217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-62b51b0c-9b96-4a98-b41f-036e65262ba3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:16.278003 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-62b51b0c-9b96-4a98-b41f-036e65262ba3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1316 microversion: 2.1 time: 0.690928 Aug 09 17:15:16.281585 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1000/1903] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:15 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1316 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:16.295205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66bd9e6d-8992-4cde-b8d0-f1611e5a419b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:16.296470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-66bd9e6d-8992-4cde-b8d0-f1611e5a419b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:16.313104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bd9e6d-8992-4cde-b8d0-f1611e5a419b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:16.313758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bd9e6d-8992-4cde-b8d0-f1611e5a419b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:16.316968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bd9e6d-8992-4cde-b8d0-f1611e5a419b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:16.321049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bd9e6d-8992-4cde-b8d0-f1611e5a419b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:16.322038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bd9e6d-8992-4cde-b8d0-f1611e5a419b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:16.324005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bd9e6d-8992-4cde-b8d0-f1611e5a419b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:16.470961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:16.563583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:16.577662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:16.584921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:16.586581 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5e190dd8-fb43-4b8a-9e70-7254eecfe1b0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.526462 Aug 09 17:15:16.589788 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 904/1904] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:16 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:16.598913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:16.605657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] [instance: fb84cd97-b6b0-40f0-9774-e5baa48fc7c9] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:16.630514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-66bd9e6d-8992-4cde-b8d0-f1611e5a419b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lazy-loading 'services' on Instance uuid 0fcdaafd-e14c-4307-aa16-fd4860b74633 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:15:16.638599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:16.646203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:16.648746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:16.650814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:16.651307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:16.656306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:16.693841 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] HTTP exception thrown: Instance fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 could not be found. Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Request method failure captured: Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 HTTP/1.1 Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pO9dVfxkYNOAwgTl3f0K6Lywkb0QX-AYXJvKdW9se_yvhAmrpqVKZWa-PEP7GXSDfD_NZF_SQrLy3lt-ad6hWDhNkyNnkajtocoBOkt_Vm-3gGycg-SNTjGmJGRi6_A1GwIjK01eDJ0dHz9ugwI872ViBZcPwyTgRByUWTxkQFN8b0 Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 44129d75c58240fa867e90b1d3252554 Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-LiveMigrationTest-837947133 Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_44129d75c58240fa867e90b1d3252554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/44129d75c58240fa867e90b1d3252554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/44129d75c58240fa867e90b1d3252554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/44129d75c58240fa867e90b1d3252554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-LiveMigrationTest-837947133 Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 44129d75c58240fa867e90b1d3252554 Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-LiveMigrationTest-837947133 Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-LiveMigrationTest-837947133-project Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 894725e0d56b4960a8bc3e6a8e283b4e Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-LiveMigrationTest-837947133-project Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 could not be found. Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'fb84cd97-b6b0-40f0-9774-e5baa48fc7c9'} Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 could not be found. Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 could not be found. Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:16.700337 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.707173 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:16.707173 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:16.707173 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:16.707173 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:15:16.707173 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:15:16.707173 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 could not be found. Aug 09 17:15:16.707173 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:16.713898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] Returning 404 to user: Instance fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:15:16.715937 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dc2cd25a-d5e9-47d1-80e3-c2e56b66c6c7 tempest-LiveMigrationTest-837947133 tempest-LiveMigrationTest-837947133-project] 10.222.0.93 "GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9" status: 404 len: 111 microversion: 2.1 time: 0.124504 Aug 09 17:15:16.717803 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 905/1905] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:16 2022] GET /compute/v2.1/servers/fb84cd97-b6b0-40f0-9774-e5baa48fc7c9 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:15:16.988286 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66bd9e6d-8992-4cde-b8d0-f1611e5a419b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments/08c32e8b-08f2-4cab-8418-dde313bdb1cd" status: 202 len: 0 microversion: 2.1 time: 0.703660 Aug 09 17:15:16.998005 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1001/1906] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:15:16 2022] DELETE /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments/08c32e8b-08f2-4cab-8418-dde313bdb1cd => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:15:17.015219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c1c4ed8a-56fa-4e77-9198-ed050cca0909 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:17.021456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c1c4ed8a-56fa-4e77-9198-ed050cca0909 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:17.047174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1c4ed8a-56fa-4e77-9198-ed050cca0909 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:17.050916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1c4ed8a-56fa-4e77-9198-ed050cca0909 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:17.053305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1c4ed8a-56fa-4e77-9198-ed050cca0909 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:17.058799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1c4ed8a-56fa-4e77-9198-ed050cca0909 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:17.060147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1c4ed8a-56fa-4e77-9198-ed050cca0909 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:17.067508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1c4ed8a-56fa-4e77-9198-ed050cca0909 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:17.198040 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c1c4ed8a-56fa-4e77-9198-ed050cca0909 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198286 Aug 09 17:15:17.205737 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 906/1907] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:15:16 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:17.308585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fa814b3e-b060-461f-818c-022607cac277 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:17.309339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fa814b3e-b060-461f-818c-022607cac277 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:17.325684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa814b3e-b060-461f-818c-022607cac277 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:17.326323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa814b3e-b060-461f-818c-022607cac277 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:17.326787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa814b3e-b060-461f-818c-022607cac277 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:17.327644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa814b3e-b060-461f-818c-022607cac277 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:17.328349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa814b3e-b060-461f-818c-022607cac277 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:17.329004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa814b3e-b060-461f-818c-022607cac277 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:17.624624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:17.633195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:17.652718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:17.660699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:17.664039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:17.667922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:17.669933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:17.677574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:18.524057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:18.537892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:18.539824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:18.541244 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4ae2cd9e-cd0d-479d-86df-142aa48946cd tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.926609 Aug 09 17:15:18.550172 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 907/1908] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:17 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:18.564440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b2f01af6-c03d-4cc5-b85a-f3e022f7612b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:18.567311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b2f01af6-c03d-4cc5-b85a-f3e022f7612b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:18.577228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2f01af6-c03d-4cc5-b85a-f3e022f7612b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:18.582999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2f01af6-c03d-4cc5-b85a-f3e022f7612b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:18.590537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2f01af6-c03d-4cc5-b85a-f3e022f7612b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:18.591570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2f01af6-c03d-4cc5-b85a-f3e022f7612b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:18.592239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2f01af6-c03d-4cc5-b85a-f3e022f7612b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:18.592929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2f01af6-c03d-4cc5-b85a-f3e022f7612b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:18.624128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fa814b3e-b060-461f-818c-022607cac277 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:18.651166 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b2f01af6-c03d-4cc5-b85a-f3e022f7612b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099475 Aug 09 17:15:18.652548 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 908/1909] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:15:18 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:18.665681 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fa814b3e-b060-461f-818c-022607cac277 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1316 microversion: 2.1 time: 1.361154 Aug 09 17:15:18.668642 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1002/1910] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:17 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1316 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:15:19.609657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:19.610297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:19.622847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:19.623281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:19.623789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:19.624545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:19.625017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:19.625451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:19.668179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df026625-1821-4f3f-b31b-06b950154d18 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:19.671301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df026625-1821-4f3f-b31b-06b950154d18 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:19.692872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df026625-1821-4f3f-b31b-06b950154d18 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:19.697157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df026625-1821-4f3f-b31b-06b950154d18 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:19.701308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df026625-1821-4f3f-b31b-06b950154d18 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:19.707954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df026625-1821-4f3f-b31b-06b950154d18 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:19.714093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df026625-1821-4f3f-b31b-06b950154d18 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:19.716563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df026625-1821-4f3f-b31b-06b950154d18 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:19.781374 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df026625-1821-4f3f-b31b-06b950154d18 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116693 Aug 09 17:15:19.786901 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1003/1911] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:15:19 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:19.803416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94409dee-539e-46a0-8f82-3e4bee1ad3ce tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:19.804154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94409dee-539e-46a0-8f82-3e4bee1ad3ce tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:19.821529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94409dee-539e-46a0-8f82-3e4bee1ad3ce tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:19.822042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94409dee-539e-46a0-8f82-3e4bee1ad3ce tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:19.824392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94409dee-539e-46a0-8f82-3e4bee1ad3ce tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:19.825171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94409dee-539e-46a0-8f82-3e4bee1ad3ce tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:19.825650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94409dee-539e-46a0-8f82-3e4bee1ad3ce tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:19.826130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94409dee-539e-46a0-8f82-3e4bee1ad3ce tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:20.260597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:20.304961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:20.310875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:20.314087 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-70bca0df-0de3-4c9f-a585-589120c5cbe6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.708948 Aug 09 17:15:20.315967 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 909/1912] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:19 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:15:20.801162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4824a687-f0de-4831-b385-c97618d3f810 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:20.805084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4824a687-f0de-4831-b385-c97618d3f810 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:20.839885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4824a687-f0de-4831-b385-c97618d3f810 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:20.841103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4824a687-f0de-4831-b385-c97618d3f810 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:20.849348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4824a687-f0de-4831-b385-c97618d3f810 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:20.850879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4824a687-f0de-4831-b385-c97618d3f810 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:20.852036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4824a687-f0de-4831-b385-c97618d3f810 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:20.852851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4824a687-f0de-4831-b385-c97618d3f810 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:20.985529 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4824a687-f0de-4831-b385-c97618d3f810 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193282 Aug 09 17:15:20.990490 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 910/1913] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:15:20 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:15:21.367406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:21.368063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:21.401310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:21.406205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:21.406671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:21.407463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:21.407971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:21.408403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:21.484560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94409dee-539e-46a0-8f82-3e4bee1ad3ce tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:21.515501 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94409dee-539e-46a0-8f82-3e4bee1ad3ce tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1316 microversion: 2.1 time: 1.725257 Aug 09 17:15:21.519256 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1004/1914] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:19 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1316 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:22.011499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0735610f-5630-460d-93e2-2922b815e513 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:22.021848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0735610f-5630-460d-93e2-2922b815e513 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:22.033600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:22.051937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0735610f-5630-460d-93e2-2922b815e513 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:22.052912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0735610f-5630-460d-93e2-2922b815e513 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:22.053837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0735610f-5630-460d-93e2-2922b815e513 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:22.071893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0735610f-5630-460d-93e2-2922b815e513 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:22.073260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0735610f-5630-460d-93e2-2922b815e513 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:22.074381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0735610f-5630-460d-93e2-2922b815e513 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:22.203756 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0735610f-5630-460d-93e2-2922b815e513 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202288 Aug 09 17:15:22.205153 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1005/1915] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:15:21 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:15:22.545421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-892868d6-9e76-4e67-b720-0186bac5bf0c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:22.556651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-892868d6-9e76-4e67-b720-0186bac5bf0c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:22.560325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:22.571479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-892868d6-9e76-4e67-b720-0186bac5bf0c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:22.575701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-892868d6-9e76-4e67-b720-0186bac5bf0c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:22.576456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-892868d6-9e76-4e67-b720-0186bac5bf0c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:22.577821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:22.579540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:22.581219 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-08a3b2dc-1638-47d4-8cb7-8b81f6a44607 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 1.228525 Aug 09 17:15:22.581481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-892868d6-9e76-4e67-b720-0186bac5bf0c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:22.582232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-892868d6-9e76-4e67-b720-0186bac5bf0c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:22.583460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-892868d6-9e76-4e67-b720-0186bac5bf0c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:22.609844 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 911/1916] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:21 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:23.209832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-892868d6-9e76-4e67-b720-0186bac5bf0c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:23.222013 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-892868d6-9e76-4e67-b720-0186bac5bf0c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1316 microversion: 2.1 time: 0.681927 Aug 09 17:15:23.222992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b6891038-ff89-4d46-893f-cb96f61c73c2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:23.240368 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1006/1917] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:22 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:23.242947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b6891038-ff89-4d46-893f-cb96f61c73c2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:23.276853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6891038-ff89-4d46-893f-cb96f61c73c2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:23.286903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6891038-ff89-4d46-893f-cb96f61c73c2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:23.289844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6891038-ff89-4d46-893f-cb96f61c73c2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:23.291858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6891038-ff89-4d46-893f-cb96f61c73c2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:23.292963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6891038-ff89-4d46-893f-cb96f61c73c2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:23.293850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6891038-ff89-4d46-893f-cb96f61c73c2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:23.386028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-bc6ed0f5-8350-4f04-8867-6eae31d5c383 req-5b18266e-76a6-464c-b4b5-80e57576d2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d16bcba-8ad6-47eb-b715-130c8906d546", "name": "network-vif-plugged", "status": "completed", "tag": "91ca63ca-509b-4db2-8205-e89c4c1a4ff6"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:23.444319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bc6ed0f5-8350-4f04-8867-6eae31d5c383 req-5b18266e-76a6-464c-b4b5-80e57576d2c9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:23.445621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bc6ed0f5-8350-4f04-8867-6eae31d5c383 req-5b18266e-76a6-464c-b4b5-80e57576d2c9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:23.446743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bc6ed0f5-8350-4f04-8867-6eae31d5c383 req-5b18266e-76a6-464c-b4b5-80e57576d2c9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:23.517997 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-bc6ed0f5-8350-4f04-8867-6eae31d5c383 req-5b18266e-76a6-464c-b4b5-80e57576d2c9 service nova] Creating event network-vif-plugged:91ca63ca-509b-4db2-8205-e89c4c1a4ff6 for instance 4d16bcba-8ad6-47eb-b715-130c8906d546 on n-h1-845781-6 Aug 09 17:15:23.537562 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b6891038-ff89-4d46-893f-cb96f61c73c2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.314910 Aug 09 17:15:23.541346 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 912/1918] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:15:23 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 197 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:23.559988 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-bc6ed0f5-8350-4f04-8867-6eae31d5c383 req-5b18266e-76a6-464c-b4b5-80e57576d2c9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171849 Aug 09 17:15:23.566274 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1007/1919] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:15:23.616672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:23.617825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:23.650874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:23.655813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:23.656603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:23.660056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:23.672557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:23.673700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:24.264831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f0145c5c-27fd-486b-8305-9ba5021c6790 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:24.266713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f0145c5c-27fd-486b-8305-9ba5021c6790 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:24.293369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0145c5c-27fd-486b-8305-9ba5021c6790 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:24.304201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0145c5c-27fd-486b-8305-9ba5021c6790 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:24.305708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0145c5c-27fd-486b-8305-9ba5021c6790 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:24.307298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0145c5c-27fd-486b-8305-9ba5021c6790 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:24.312169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0145c5c-27fd-486b-8305-9ba5021c6790 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:24.313297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0145c5c-27fd-486b-8305-9ba5021c6790 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:24.556828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:24.574024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:24.579743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:24.586526 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2c9ea8bd-96fb-4f39-91ce-20bcd367b081 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.978798 Aug 09 17:15:24.591342 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 913/1920] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:23 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:24.605659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-515ea203-bee0-4bd1-87cf-a0f3775ed58d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:24.613109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-515ea203-bee0-4bd1-87cf-a0f3775ed58d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:24.626310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-515ea203-bee0-4bd1-87cf-a0f3775ed58d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:24.627194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-515ea203-bee0-4bd1-87cf-a0f3775ed58d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:24.627450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-515ea203-bee0-4bd1-87cf-a0f3775ed58d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:24.632372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-515ea203-bee0-4bd1-87cf-a0f3775ed58d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:24.633166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-515ea203-bee0-4bd1-87cf-a0f3775ed58d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:24.635348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-515ea203-bee0-4bd1-87cf-a0f3775ed58d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:24.709218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:24.841860 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-515ea203-bee0-4bd1-87cf-a0f3775ed58d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.246478 Aug 09 17:15:24.853635 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 914/1921] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:15:24 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 197 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:25.308650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f0145c5c-27fd-486b-8305-9ba5021c6790 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:25.367045 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f0145c5c-27fd-486b-8305-9ba5021c6790 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1316 microversion: 2.1 time: 1.115269 Aug 09 17:15:25.370237 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1008/1922] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:24 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1316 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:25.637959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:25.639412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:25.656006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:25.657486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:25.658232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:25.662671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:25.663527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:25.664238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:25.864491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d31b1f4-14b2-48bd-b672-f3781c030428 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:25.885139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d31b1f4-14b2-48bd-b672-f3781c030428 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:25.914868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d31b1f4-14b2-48bd-b672-f3781c030428 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:25.917219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d31b1f4-14b2-48bd-b672-f3781c030428 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:25.919318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d31b1f4-14b2-48bd-b672-f3781c030428 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:25.926710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d31b1f4-14b2-48bd-b672-f3781c030428 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:25.930783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d31b1f4-14b2-48bd-b672-f3781c030428 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:25.935757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d31b1f4-14b2-48bd-b672-f3781c030428 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:26.100279 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d31b1f4-14b2-48bd-b672-f3781c030428 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.243681 Aug 09 17:15:26.104929 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1009/1923] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:15:25 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:26.415005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d0dbea2-4c47-4651-a9b8-bbf59f6801bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:26.416067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1d0dbea2-4c47-4651-a9b8-bbf59f6801bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:26.444887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d0dbea2-4c47-4651-a9b8-bbf59f6801bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:26.446959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d0dbea2-4c47-4651-a9b8-bbf59f6801bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:26.448155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d0dbea2-4c47-4651-a9b8-bbf59f6801bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:26.452914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d0dbea2-4c47-4651-a9b8-bbf59f6801bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:26.457287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d0dbea2-4c47-4651-a9b8-bbf59f6801bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:26.460998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d0dbea2-4c47-4651-a9b8-bbf59f6801bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:26.835573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:26.904615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:26.926120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:26.928777 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d3e0200f-84c4-46ad-87b6-c09101db2e1c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 1.294963 Aug 09 17:15:26.939262 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 915/1924] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:25 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:15:27.131413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9e048000-f2a2-4342-bb10-75c79da92a2a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:27.135871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9e048000-f2a2-4342-bb10-75c79da92a2a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:27.175121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e048000-f2a2-4342-bb10-75c79da92a2a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:27.183365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e048000-f2a2-4342-bb10-75c79da92a2a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:27.184310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e048000-f2a2-4342-bb10-75c79da92a2a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:27.185771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e048000-f2a2-4342-bb10-75c79da92a2a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:27.187232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e048000-f2a2-4342-bb10-75c79da92a2a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:27.187524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e048000-f2a2-4342-bb10-75c79da92a2a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:27.336345 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9e048000-f2a2-4342-bb10-75c79da92a2a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.223823 Aug 09 17:15:27.349349 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 916/1925] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:15:27 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:27.710749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1d0dbea2-4c47-4651-a9b8-bbf59f6801bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:27.726225 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1d0dbea2-4c47-4651-a9b8-bbf59f6801bc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1504 microversion: 2.1 time: 1.318362 Aug 09 17:15:27.729288 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1010/1926] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:26 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1504 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:15:27.781586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-316176e2-a94e-4be6-acbf-e6fb32d38a49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-648158405"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:27.784024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-316176e2-a94e-4be6-acbf-e6fb32d38a49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:27.827822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-316176e2-a94e-4be6-acbf-e6fb32d38a49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:27.836305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-316176e2-a94e-4be6-acbf-e6fb32d38a49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:27.845464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-316176e2-a94e-4be6-acbf-e6fb32d38a49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:27.850092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-316176e2-a94e-4be6-acbf-e6fb32d38a49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:27.865114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-316176e2-a94e-4be6-acbf-e6fb32d38a49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:27.872734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-316176e2-a94e-4be6-acbf-e6fb32d38a49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:28.004394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:28.014032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:28.055330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:28.057508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:28.064505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:28.070948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:28.078448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:28.080966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:28.594516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:28.616977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:28.623114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:28.629715 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-34e58f55-dff3-4e4b-9bbd-e06e64618a02 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1487 microversion: 2.25 time: 0.646440 Aug 09 17:15:28.633478 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1011/1927] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:27 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1487 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:28.959117 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.network.security_group_api [None req-316176e2-a94e-4be6-acbf-e6fb32d38a49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Adding security group 1f717e42-e785-4345-8e13-e138b0196f20 to port 91ca63ca-509b-4db2-8205-e89c4c1a4ff6 Aug 09 17:15:29.583830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-95fcfd17-6b4e-46f5-92c9-c36748b9cd4e tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] Action: 'create', calling method: .version_select at 0x7fbbdc8c58b0>, body: {"pool": null} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:30.428933 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-316176e2-a94e-4be6-acbf-e6fb32d38a49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546/action" status: 202 len: 0 microversion: 2.1 time: 2.657445 Aug 09 17:15:30.431972 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 917/1928] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:15:27 2022] POST /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546/action => generated 0 bytes in 2662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:15:30.450592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c8e3e8c6-99a1-4c06-bd5b-334077fc4edc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:30.467922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c8e3e8c6-99a1-4c06-bd5b-334077fc4edc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:30.510420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e3e8c6-99a1-4c06-bd5b-334077fc4edc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:30.511866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e3e8c6-99a1-4c06-bd5b-334077fc4edc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:30.512886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e3e8c6-99a1-4c06-bd5b-334077fc4edc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:30.514437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e3e8c6-99a1-4c06-bd5b-334077fc4edc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:30.515607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e3e8c6-99a1-4c06-bd5b-334077fc4edc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:30.518528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e3e8c6-99a1-4c06-bd5b-334077fc4edc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:30.651997 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c8e3e8c6-99a1-4c06-bd5b-334077fc4edc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213362 Aug 09 17:15:30.662193 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 918/1929] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:15:30 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:30.668364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:30.669282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:30.688610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:30.689473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:30.690173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:30.693364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:30.694655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:30.695665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:31.127334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:31.140154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:31.143990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:31.147187 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a2257ed8-204e-4fe1-a256-3d295478cf5c tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1477 microversion: 2.25 time: 0.483562 Aug 09 17:15:31.148864 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 919/1930] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:30 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1477 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:31.154957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-410b3a24-4bc6-429d-a459-b540ce533bcb tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbd80da310>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:31.433550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-410b3a24-4bc6-429d-a459-b540ce533bcb tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 1f717e42-e785-4345-8e13-e138b0196f20 in use.", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:15:31.434421 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-410b3a24-4bc6-429d-a459-b540ce533bcb tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security Group 1f717e42-e785-4345-8e13-e138b0196f20 in use. Aug 09 17:15:31.434421 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-20f45a41-3c93-425f-8e6c-33142342ab1b'] Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-410b3a24-4bc6-429d-a459-b540ce533bcb tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-security-groups/1f717e42-e785-4345-8e13-e138b0196f20 HTTP/1.1 Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: exception: Security Group 1f717e42-e785-4345-8e13-e138b0196f20 in use. Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-20f45a41-3c93-425f-8e6c-33142342ab1b'] Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '1f717e42-e785-4345-8e13-e138b0196f20'} Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:15:31.438335 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 1f717e42-e785-4345-8e13-e138b0196f20 in use. Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20f45a41-3c93-425f-8e6c-33142342ab1b'] Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 1f717e42-e785-4345-8e13-e138b0196f20 in use. Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20f45a41-3c93-425f-8e6c-33142342ab1b'] Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 1f717e42-e785-4345-8e13-e138b0196f20 in use. Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20f45a41-3c93-425f-8e6c-33142342ab1b'] Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 1f717e42-e785-4345-8e13-e138b0196f20 in use. Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20f45a41-3c93-425f-8e6c-33142342ab1b'] Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-410b3a24-4bc6-429d-a459-b540ce533bcb tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 400 to user: Security Group 1f717e42-e785-4345-8e13-e138b0196f20 in use. Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-20f45a41-3c93-425f-8e6c-33142342ab1b'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-410b3a24-4bc6-429d-a459-b540ce533bcb tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/1f717e42-e785-4345-8e13-e138b0196f20" status: 400 len: 185 microversion: 2.1 time: 0.289915 Aug 09 17:15:31.441837 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 920/1931] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:15:31 2022] DELETE /compute/v2.1/os-security-groups/1f717e42-e785-4345-8e13-e138b0196f20 => generated 185 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:15:31.449328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-783431ca-a8da-468a-bc0e-17473f5abb5a req-96c1d435-0919-4794-8749-0a3af166cfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d16bcba-8ad6-47eb-b715-130c8906d546", "tag": "91ca63ca-509b-4db2-8205-e89c4c1a4ff6"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:31.492553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-783431ca-a8da-468a-bc0e-17473f5abb5a req-96c1d435-0919-4794-8749-0a3af166cfa0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:31.493108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-783431ca-a8da-468a-bc0e-17473f5abb5a req-96c1d435-0919-4794-8749-0a3af166cfa0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:31.493475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-783431ca-a8da-468a-bc0e-17473f5abb5a req-96c1d435-0919-4794-8749-0a3af166cfa0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:31.525815 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-783431ca-a8da-468a-bc0e-17473f5abb5a req-96c1d435-0919-4794-8749-0a3af166cfa0 service nova] Creating event network-changed:91ca63ca-509b-4db2-8205-e89c4c1a4ff6 for instance 4d16bcba-8ad6-47eb-b715-130c8906d546 on n-h1-845781-6 Aug 09 17:15:31.546437 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-783431ca-a8da-468a-bc0e-17473f5abb5a req-96c1d435-0919-4794-8749-0a3af166cfa0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099883 Aug 09 17:15:31.562295 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 921/1932] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:31.844844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-198757604", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ad48ae09-8243-461d-b010-943470de6d49"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:32.007542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] validate_networks() for [('ad48ae09-8243-461d-b010-943470de6d49', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:15:33.426363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:15:33.428676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:15:33.429871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:15:33.430876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:15:33.431863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:15:33.454375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:33.455852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:33.457063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:33.459353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:33.460734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:33.461763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:33.524791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:15:33.539315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for user d8e1dc1f64fe429ea6a8c746b7c84ae6 and project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:15:33.568284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:15:33.575034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:15:33.805642 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a6948d17-4990-4801-afff-a4151338a398 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.225746 Aug 09 17:15:33.809515 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 922/1933] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:15:33.828289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-64fd0e6f-297e-4bd7-9db8-e8128c3fc294 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '.version_select at 0x7fbbcb5d3280>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:33.846165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64fd0e6f-297e-4bd7-9db8-e8128c3fc294 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:33.851730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64fd0e6f-297e-4bd7-9db8-e8128c3fc294 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:33.854042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64fd0e6f-297e-4bd7-9db8-e8128c3fc294 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:33.904598 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-64fd0e6f-297e-4bd7-9db8-e8128c3fc294 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 1698 microversion: 2.25 time: 0.085202 Aug 09 17:15:33.913997 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 923/1934] 10.222.0.93 () {60 vars in 1184 bytes} [Tue Aug 9 17:15:33 2022] GET /compute/v2.1/os-migrations => generated 1698 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:33.932273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ce471271-c1af-4c51-ba06-ed59abf5a3ef tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:33.940668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ce471271-c1af-4c51-ba06-ed59abf5a3ef tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:33.961766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce471271-c1af-4c51-ba06-ed59abf5a3ef tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:33.962779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce471271-c1af-4c51-ba06-ed59abf5a3ef tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:33.963678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce471271-c1af-4c51-ba06-ed59abf5a3ef tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:33.965341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce471271-c1af-4c51-ba06-ed59abf5a3ef tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:33.966287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce471271-c1af-4c51-ba06-ed59abf5a3ef tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:33.967220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce471271-c1af-4c51-ba06-ed59abf5a3ef tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:34.289380 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ce471271-c1af-4c51-ba06-ed59abf5a3ef tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546/action" status: 202 len: 0 microversion: 2.1 time: 0.372340 Aug 09 17:15:34.291431 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 924/1935] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:15:33 2022] POST /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:15:34.306888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a7f21680-679a-4faa-a858-ed1ae11ee50e tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:34.313498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a7f21680-679a-4faa-a858-ed1ae11ee50e tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:34.330425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f21680-679a-4faa-a858-ed1ae11ee50e tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:34.331738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f21680-679a-4faa-a858-ed1ae11ee50e tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:34.335948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f21680-679a-4faa-a858-ed1ae11ee50e tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:34.340938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f21680-679a-4faa-a858-ed1ae11ee50e tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:34.344566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f21680-679a-4faa-a858-ed1ae11ee50e tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:34.349567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f21680-679a-4faa-a858-ed1ae11ee50e tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:34.509999 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a7f21680-679a-4faa-a858-ed1ae11ee50e tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.213342 Aug 09 17:15:34.510963 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 925/1936] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:15:34 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633/os-volume_attachments => generated 25 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:15:34.527095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f136b160-8e92-4cb3-8a52-a6f89a920216 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:34.534677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f136b160-8e92-4cb3-8a52-a6f89a920216 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:35.115942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f136b160-8e92-4cb3-8a52-a6f89a920216 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:35.161798 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f136b160-8e92-4cb3-8a52-a6f89a920216 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 200 len: 1214 microversion: 2.1 time: 0.646329 Aug 09 17:15:35.180979 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 926/1937] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:34 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 1214 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:35.211984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ffeb7c81-a7f2-40f8-b810-cbcafc3d27b4 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:35.214242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ffeb7c81-a7f2-40f8-b810-cbcafc3d27b4 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:35.231020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c81-a7f2-40f8-b810-cbcafc3d27b4 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:35.235074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c81-a7f2-40f8-b810-cbcafc3d27b4 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:35.240033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c81-a7f2-40f8-b810-cbcafc3d27b4 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:35.250273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c81-a7f2-40f8-b810-cbcafc3d27b4 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:35.252754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c81-a7f2-40f8-b810-cbcafc3d27b4 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:35.253339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c81-a7f2-40f8-b810-cbcafc3d27b4 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:36.069994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-ffeb7c81-a7f2-40f8-b810-cbcafc3d27b4 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] Lazy-loading 'services' on Instance uuid fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:15:36.108965 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ffeb7c81-a7f2-40f8-b810-cbcafc3d27b4 tempest-LiveAutoBlockMigrationV225Test-768475025 tempest-LiveAutoBlockMigrationV225Test-768475025-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1970 microversion: 2.25 time: 0.921582 Aug 09 17:15:36.124776 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 927/1938] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:35 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1970 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:36.200268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-82b337bb-62ab-4061-9432-5af151ce1a9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:36.202138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-82b337bb-62ab-4061-9432-5af151ce1a9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:36.221040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82b337bb-62ab-4061-9432-5af151ce1a9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:36.221819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82b337bb-62ab-4061-9432-5af151ce1a9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:36.222679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82b337bb-62ab-4061-9432-5af151ce1a9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:36.224744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82b337bb-62ab-4061-9432-5af151ce1a9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:36.225939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82b337bb-62ab-4061-9432-5af151ce1a9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:36.227103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82b337bb-62ab-4061-9432-5af151ce1a9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:36.780468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-82b337bb-62ab-4061-9432-5af151ce1a9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:36.803273 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-82b337bb-62ab-4061-9432-5af151ce1a9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1574 microversion: 2.1 time: 0.676391 Aug 09 17:15:36.812592 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 928/1939] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:36 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1574 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:36.829881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1513200081", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "aa755713-4017-4819-b6c1-fd28f8dcd18a"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:36.997172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] validate_networks() for [('aa755713-4017-4819-b6c1-fd28f8dcd18a', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:15:37.696638 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-95fcfd17-6b4e-46f5-92c9-c36748b9cd4e tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.059517 Aug 09 17:15:37.697508 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1012/1940] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:15:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:37.704419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6092e29d-3b18-4e6c-9ae6-788d46b0a83a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:37.711936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6092e29d-3b18-4e6c-9ae6-788d46b0a83a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:37.735016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6092e29d-3b18-4e6c-9ae6-788d46b0a83a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:37.736194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6092e29d-3b18-4e6c-9ae6-788d46b0a83a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:37.737148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6092e29d-3b18-4e6c-9ae6-788d46b0a83a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:37.738114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6092e29d-3b18-4e6c-9ae6-788d46b0a83a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:37.738767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6092e29d-3b18-4e6c-9ae6-788d46b0a83a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:37.743163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6092e29d-3b18-4e6c-9ae6-788d46b0a83a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:37.840775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6092e29d-3b18-4e6c-9ae6-788d46b0a83a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:15:38.107517 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6092e29d-3b18-4e6c-9ae6-788d46b0a83a tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 204 len: 0 microversion: 2.25 time: 0.408378 Aug 09 17:15:38.108627 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1013/1941] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:15:37 2022] DELETE /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:15:38.127198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07cb49fd-ef0a-4a27-9bfe-00d7d1ff4a12 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:38.128318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07cb49fd-ef0a-4a27-9bfe-00d7d1ff4a12 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:38.140095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07cb49fd-ef0a-4a27-9bfe-00d7d1ff4a12 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:38.140872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07cb49fd-ef0a-4a27-9bfe-00d7d1ff4a12 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:38.141559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07cb49fd-ef0a-4a27-9bfe-00d7d1ff4a12 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:38.142532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07cb49fd-ef0a-4a27-9bfe-00d7d1ff4a12 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:38.143385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07cb49fd-ef0a-4a27-9bfe-00d7d1ff4a12 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:38.143995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07cb49fd-ef0a-4a27-9bfe-00d7d1ff4a12 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:38.577436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-07cb49fd-ef0a-4a27-9bfe-00d7d1ff4a12 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:38.594849 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07cb49fd-ef0a-4a27-9bfe-00d7d1ff4a12 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 200 len: 1272 microversion: 2.1 time: 0.484224 Aug 09 17:15:38.596175 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1014/1942] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:38 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 1272 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:38.614450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d5a9e3f8-ca56-40ed-9413-f39dd0506e95 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] Action: 'create', calling method: .version_select at 0x7fbbdc8e6d30>, body: {"pool": null} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:39.895014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:15:39.896113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:15:39.897158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:15:39.898303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:15:39.899201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:15:39.960506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:39.968955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:39.969828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:39.970871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:39.971717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:39.972428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:40.028870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Getting quotas for project 5458faa4b45e4eab8ec22d1d4a13f6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:15:40.040810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Getting quotas for user db2a6f289c7e4b1abea4713412897236 and project 5458faa4b45e4eab8ec22d1d4a13f6c0. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:15:40.080073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:15:40.085027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:15:40.226802 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1b835034-1a09-4b2b-a6a8-a2adf7aef15d tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.411430 Aug 09 17:15:40.232028 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 929/1943] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:15:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:15:40.260431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-efc6247d-1b31-434d-ac17-cc77a2ed0dcc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:40.277014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-efc6247d-1b31-434d-ac17-cc77a2ed0dcc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:40.298392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efc6247d-1b31-434d-ac17-cc77a2ed0dcc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:40.299608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efc6247d-1b31-434d-ac17-cc77a2ed0dcc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:40.301836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efc6247d-1b31-434d-ac17-cc77a2ed0dcc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:40.306457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efc6247d-1b31-434d-ac17-cc77a2ed0dcc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:40.309099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efc6247d-1b31-434d-ac17-cc77a2ed0dcc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:40.314538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efc6247d-1b31-434d-ac17-cc77a2ed0dcc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:40.963852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-efc6247d-1b31-434d-ac17-cc77a2ed0dcc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:40.999325 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-efc6247d-1b31-434d-ac17-cc77a2ed0dcc tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1572 microversion: 2.1 time: 0.756650 Aug 09 17:15:41.000552 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 930/1944] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:40 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1572 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:41.021966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:41.023875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:41.043725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:41.046714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:41.048946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:41.052050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:41.053105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:41.054293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:41.294414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:41.316296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:41.320917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:41.323472 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3bc90bb5-2f23-4ca0-8f49-b987ac5c92ec tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1441 microversion: 2.25 time: 0.315333 Aug 09 17:15:41.324960 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 931/1945] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:41 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1441 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:41.839279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-070f1c0c-adc7-4325-9622-18f385a4591e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393-project-admin] Calling method '.version_select at 0x7fbbcb6a0820>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:41.845123 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:15:41.845123 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:15:41.853172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-070f1c0c-adc7-4325-9622-18f385a4591e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:41.854535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-070f1c0c-adc7-4325-9622-18f385a4591e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:41.857837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-070f1c0c-adc7-4325-9622-18f385a4591e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:41.892397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-070f1c0c-adc7-4325-9622-18f385a4591e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:41.893623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-070f1c0c-adc7-4325-9622-18f385a4591e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:41.894920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-070f1c0c-adc7-4325-9622-18f385a4591e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:41.918193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-070f1c0c-adc7-4325-9622-18f385a4591e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:41.919323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-070f1c0c-adc7-4325-9622-18f385a4591e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:41.920355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-070f1c0c-adc7-4325-9622-18f385a4591e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:41.936216 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-070f1c0c-adc7-4325-9622-18f385a4591e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1750156393-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.609127 Aug 09 17:15:41.947335 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 932/1946] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:15:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:41.969255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-85a8156c-501c-4eb5-8359-a7ac3d1fdcda tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:41.970342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-85a8156c-501c-4eb5-8359-a7ac3d1fdcda tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:41.997223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85a8156c-501c-4eb5-8359-a7ac3d1fdcda tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:41.999709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85a8156c-501c-4eb5-8359-a7ac3d1fdcda tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:42.002875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85a8156c-501c-4eb5-8359-a7ac3d1fdcda tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:42.011895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85a8156c-501c-4eb5-8359-a7ac3d1fdcda tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:42.013165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85a8156c-501c-4eb5-8359-a7ac3d1fdcda tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:42.017355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85a8156c-501c-4eb5-8359-a7ac3d1fdcda tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:42.968932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-85a8156c-501c-4eb5-8359-a7ac3d1fdcda tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:42.993152 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-85a8156c-501c-4eb5-8359-a7ac3d1fdcda tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 200 len: 1314 microversion: 2.1 time: 1.053745 Aug 09 17:15:42.994125 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 933/1947] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:41 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 1314 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:43.021938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b9006ad9-e1b6-4167-9224-50a1b5e7a32a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:43.025892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b9006ad9-e1b6-4167-9224-50a1b5e7a32a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:43.030231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:43.048535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9006ad9-e1b6-4167-9224-50a1b5e7a32a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:43.049380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9006ad9-e1b6-4167-9224-50a1b5e7a32a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:43.050022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9006ad9-e1b6-4167-9224-50a1b5e7a32a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:43.051227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9006ad9-e1b6-4167-9224-50a1b5e7a32a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:43.052527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9006ad9-e1b6-4167-9224-50a1b5e7a32a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:43.053132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9006ad9-e1b6-4167-9224-50a1b5e7a32a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:43.335569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b9006ad9-e1b6-4167-9224-50a1b5e7a32a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:43.338467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:43.356908 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b9006ad9-e1b6-4167-9224-50a1b5e7a32a tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 200 len: 1276 microversion: 2.1 time: 0.341278 Aug 09 17:15:43.358564 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 934/1948] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:42 2022] GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 1276 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:43.371677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d7300aaa-45b7-4ae0-a011-5e7448458c20 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1920885425"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:43.372408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d7300aaa-45b7-4ae0-a011-5e7448458c20 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:43.393168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7300aaa-45b7-4ae0-a011-5e7448458c20 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:43.393558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7300aaa-45b7-4ae0-a011-5e7448458c20 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:43.394339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7300aaa-45b7-4ae0-a011-5e7448458c20 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:43.395489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7300aaa-45b7-4ae0-a011-5e7448458c20 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:43.396166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7300aaa-45b7-4ae0-a011-5e7448458c20 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:43.397040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7300aaa-45b7-4ae0-a011-5e7448458c20 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:43.725172 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d5a9e3f8-ca56-40ed-9413-f39dd0506e95 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.125649 Aug 09 17:15:43.726288 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1015/1949] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:15:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:43.736628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-79919f18-b703-4ff9-9f7a-4c8c50ae7508 req-86c3fcb3-8d7c-4f03-8f91-5599c39693b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa81dada-6ad4-4d36-9deb-1a9d8e59fa29", "name": "network-vif-deleted", "tag": "284be49d-a456-4cf0-93f3-b75907df99a5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:43.757041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-79919f18-b703-4ff9-9f7a-4c8c50ae7508 req-86c3fcb3-8d7c-4f03-8f91-5599c39693b3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:43.757972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-79919f18-b703-4ff9-9f7a-4c8c50ae7508 req-86c3fcb3-8d7c-4f03-8f91-5599c39693b3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:43.759193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-79919f18-b703-4ff9-9f7a-4c8c50ae7508 req-86c3fcb3-8d7c-4f03-8f91-5599c39693b3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:43.783745 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-79919f18-b703-4ff9-9f7a-4c8c50ae7508 req-86c3fcb3-8d7c-4f03-8f91-5599c39693b3 service nova] Creating event network-vif-deleted:284be49d-a456-4cf0-93f3-b75907df99a5 for instance fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 on n-h2-845781-6 Aug 09 17:15:43.795204 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-79919f18-b703-4ff9-9f7a-4c8c50ae7508 req-86c3fcb3-8d7c-4f03-8f91-5599c39693b3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066377 Aug 09 17:15:43.796927 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1016/1950] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:43.808196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:43.809987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:43.823494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:43.824783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:43.825834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:43.827429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:43.828657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:43.829756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:44.015217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:44.041796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:44.049515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:44.052681 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f78afa03-93dd-41ac-8e57-e2892500d2f6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1266 microversion: 2.25 time: 0.253218 Aug 09 17:15:44.054894 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1017/1951] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:43 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:44.063870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-dca8bb61-6784-4be3-a9c8-2c4d5c6f625b req-37ee000f-2bc3-4aa5-aecf-58dc9ee47fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330a79ba-42cf-4f1b-a572-c5143e3096cc", "tag": "9df81729-97f0-409f-ade5-2051ca68ec21"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:44.081744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dca8bb61-6784-4be3-a9c8-2c4d5c6f625b req-37ee000f-2bc3-4aa5-aecf-58dc9ee47fe0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:44.084035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dca8bb61-6784-4be3-a9c8-2c4d5c6f625b req-37ee000f-2bc3-4aa5-aecf-58dc9ee47fe0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:44.085181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dca8bb61-6784-4be3-a9c8-2c4d5c6f625b req-37ee000f-2bc3-4aa5-aecf-58dc9ee47fe0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:44.135760 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-dca8bb61-6784-4be3-a9c8-2c4d5c6f625b req-37ee000f-2bc3-4aa5-aecf-58dc9ee47fe0 service nova] Creating event network-changed:9df81729-97f0-409f-ade5-2051ca68ec21 for instance 330a79ba-42cf-4f1b-a572-c5143e3096cc on n-h1-845781-6 Aug 09 17:15:44.161727 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-dca8bb61-6784-4be3-a9c8-2c4d5c6f625b req-37ee000f-2bc3-4aa5-aecf-58dc9ee47fe0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103578 Aug 09 17:15:44.176150 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1018/1952] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:44.186501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7a1093a-e1e1-402d-afb2-1ced0aca6623 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] Action: 'create', calling method: .version_select at 0x7fbbdc934550>, body: {"pool": null} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:44.782622 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.network.security_group_api [None req-d7300aaa-45b7-4ae0-a011-5e7448458c20 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Adding security group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f to port 91ca63ca-509b-4db2-8205-e89c4c1a4ff6 Aug 09 17:15:46.712982 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d7300aaa-45b7-4ae0-a011-5e7448458c20 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546/action" status: 202 len: 0 microversion: 2.1 time: 3.352374 Aug 09 17:15:46.718966 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 935/1953] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:15:43 2022] POST /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546/action => generated 0 bytes in 3355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:15:46.723533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0c100a07-e1c5-4c82-8fb0-097441c69d23 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:46.724902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0c100a07-e1c5-4c82-8fb0-097441c69d23 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:46.755463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c100a07-e1c5-4c82-8fb0-097441c69d23 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:46.758801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c100a07-e1c5-4c82-8fb0-097441c69d23 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:46.759823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c100a07-e1c5-4c82-8fb0-097441c69d23 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:46.775901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c100a07-e1c5-4c82-8fb0-097441c69d23 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:46.777115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c100a07-e1c5-4c82-8fb0-097441c69d23 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:46.778008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c100a07-e1c5-4c82-8fb0-097441c69d23 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:48.077018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0c100a07-e1c5-4c82-8fb0-097441c69d23 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:48.106286 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0c100a07-e1c5-4c82-8fb0-097441c69d23 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 200 len: 1314 microversion: 2.1 time: 1.390254 Aug 09 17:15:48.109853 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 936/1954] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:46 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 1314 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:48.148803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-03807718-a09b-4bef-ac36-a04e5eaba7f5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:48.151003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-03807718-a09b-4bef-ac36-a04e5eaba7f5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:48.169214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03807718-a09b-4bef-ac36-a04e5eaba7f5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:48.175169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03807718-a09b-4bef-ac36-a04e5eaba7f5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:48.177913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03807718-a09b-4bef-ac36-a04e5eaba7f5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:48.180439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03807718-a09b-4bef-ac36-a04e5eaba7f5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:48.181832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03807718-a09b-4bef-ac36-a04e5eaba7f5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:48.183369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03807718-a09b-4bef-ac36-a04e5eaba7f5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:49.255977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-03807718-a09b-4bef-ac36-a04e5eaba7f5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:49.287364 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-03807718-a09b-4bef-ac36-a04e5eaba7f5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 200 len: 1318 microversion: 2.1 time: 1.174471 Aug 09 17:15:49.305129 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 937/1955] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:48 2022] GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 1318 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:49.330485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:49.333383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:49.352009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:49.354572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:49.361707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:49.363522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:49.365664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:49.365664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:49.607967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:49.631575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:49.633430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:49.635445 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d5fa6ab7-9e5b-4804-a401-32be0eba0732 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 200 len: 1266 microversion: 2.25 time: 0.327125 Aug 09 17:15:49.676102 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 938/1956] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:49 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 1266 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:15:49.689166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-83385fc4-d8c1-4fc8-80d8-0d60f8ec63f3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbdca0a160>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:50.010811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:50.066652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=14 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:50.139679 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7a1093a-e1e1-402d-afb2-1ced0aca6623 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.961003 Aug 09 17:15:50.141496 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1019/1957] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:15:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:50.148126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-552dc864-f548-48f3-ac4a-4fafc3ce1703 req-0830e466-38a5-4deb-8c05-ec8b8621fbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d16bcba-8ad6-47eb-b715-130c8906d546", "tag": "91ca63ca-509b-4db2-8205-e89c4c1a4ff6"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:50.183068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-552dc864-f548-48f3-ac4a-4fafc3ce1703 req-0830e466-38a5-4deb-8c05-ec8b8621fbf3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:50.185743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-552dc864-f548-48f3-ac4a-4fafc3ce1703 req-0830e466-38a5-4deb-8c05-ec8b8621fbf3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:50.187755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-552dc864-f548-48f3-ac4a-4fafc3ce1703 req-0830e466-38a5-4deb-8c05-ec8b8621fbf3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:50.213816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:50.220153 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-552dc864-f548-48f3-ac4a-4fafc3ce1703 req-0830e466-38a5-4deb-8c05-ec8b8621fbf3 service nova] Creating event network-changed:91ca63ca-509b-4db2-8205-e89c4c1a4ff6 for instance 4d16bcba-8ad6-47eb-b715-130c8906d546 on n-h1-845781-6 Aug 09 17:15:50.252826 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-552dc864-f548-48f3-ac4a-4fafc3ce1703 req-0830e466-38a5-4deb-8c05-ec8b8621fbf3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109424 Aug 09 17:15:50.254338 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1020/1958] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:50.270720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-10bdcfa8-f230-412c-b8ff-1b630ebf5903 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:50.273177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-10bdcfa8-f230-412c-b8ff-1b630ebf5903 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:50.308297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10bdcfa8-f230-412c-b8ff-1b630ebf5903 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:50.313182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10bdcfa8-f230-412c-b8ff-1b630ebf5903 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:50.313923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10bdcfa8-f230-412c-b8ff-1b630ebf5903 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:50.315400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10bdcfa8-f230-412c-b8ff-1b630ebf5903 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:50.316120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10bdcfa8-f230-412c-b8ff-1b630ebf5903 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:50.319174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10bdcfa8-f230-412c-b8ff-1b630ebf5903 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:50.620504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-83385fc4-d8c1-4fc8-80d8-0d60f8ec63f3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f in use.", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:15:50.621762 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-83385fc4-d8c1-4fc8-80d8-0d60f8ec63f3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security Group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f in use. Aug 09 17:15:50.621762 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-f47172b3-a64c-4a77-b7a5-0bb496299707'] Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-83385fc4-d8c1-4fc8-80d8-0d60f8ec63f3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-security-groups/cd57cec9-21d1-4bcc-9bf4-bbe4a299786f HTTP/1.1 Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: exception: Security Group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f in use. Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-f47172b3-a64c-4a77-b7a5-0bb496299707'] Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'cd57cec9-21d1-4bcc-9bf4-bbe4a299786f'} Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:15:50.626484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f in use. Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f47172b3-a64c-4a77-b7a5-0bb496299707'] Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f in use. Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f47172b3-a64c-4a77-b7a5-0bb496299707'] Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f in use. Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f47172b3-a64c-4a77-b7a5-0bb496299707'] Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f in use. Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f47172b3-a64c-4a77-b7a5-0bb496299707'] Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-83385fc4-d8c1-4fc8-80d8-0d60f8ec63f3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 400 to user: Security Group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f in use. Aug 09 17:15:50.632116 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-f47172b3-a64c-4a77-b7a5-0bb496299707'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:15:50.636596 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-83385fc4-d8c1-4fc8-80d8-0d60f8ec63f3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/cd57cec9-21d1-4bcc-9bf4-bbe4a299786f" status: 400 len: 185 microversion: 2.1 time: 0.954450 Aug 09 17:15:50.636759 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 939/1959] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:15:49 2022] DELETE /compute/v2.1/os-security-groups/cd57cec9-21d1-4bcc-9bf4-bbe4a299786f => generated 185 bytes in 960 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:15:50.650220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c3cc508e-7a7c-4930-be91-3be7d63bfea3 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] Action: 'create', calling method: .version_select at 0x7fbbd9ff1d30>, body: {"pool": null} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:51.019016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-10bdcfa8-f230-412c-b8ff-1b630ebf5903 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:51.038011 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-10bdcfa8-f230-412c-b8ff-1b630ebf5903 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 200 len: 1314 microversion: 2.1 time: 0.777855 Aug 09 17:15:51.052632 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1021/1960] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:50 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:51.071401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c1d49872-4e9d-4a8f-a3ec-3329131eeff5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:51.080658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c1d49872-4e9d-4a8f-a3ec-3329131eeff5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:51.105206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1d49872-4e9d-4a8f-a3ec-3329131eeff5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:51.112664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1d49872-4e9d-4a8f-a3ec-3329131eeff5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:51.114748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1d49872-4e9d-4a8f-a3ec-3329131eeff5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:51.115772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1d49872-4e9d-4a8f-a3ec-3329131eeff5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:51.120954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1d49872-4e9d-4a8f-a3ec-3329131eeff5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:51.122784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1d49872-4e9d-4a8f-a3ec-3329131eeff5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:52.184238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c1d49872-4e9d-4a8f-a3ec-3329131eeff5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:52.203542 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c1d49872-4e9d-4a8f-a3ec-3329131eeff5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 200 len: 1318 microversion: 2.1 time: 1.148482 Aug 09 17:15:52.206066 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1022/1961] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:51 2022] GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 1318 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:52.236968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-58b378ff-d2dd-4aa6-adce-9335726a44ad tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:52.239675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-58b378ff-d2dd-4aa6-adce-9335726a44ad tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:52.267285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:15:52.271973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b378ff-d2dd-4aa6-adce-9335726a44ad tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:52.273310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b378ff-d2dd-4aa6-adce-9335726a44ad tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:52.277769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b378ff-d2dd-4aa6-adce-9335726a44ad tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:52.279736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b378ff-d2dd-4aa6-adce-9335726a44ad tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:52.281617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b378ff-d2dd-4aa6-adce-9335726a44ad tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:52.284028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b378ff-d2dd-4aa6-adce-9335726a44ad tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:52.405943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-58b378ff-d2dd-4aa6-adce-9335726a44ad tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:15:52.650388 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-58b378ff-d2dd-4aa6-adce-9335726a44ad tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 204 len: 0 microversion: 2.1 time: 0.441960 Aug 09 17:15:52.651208 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1023/1962] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:15:52 2022] DELETE /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:15:52.667845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:52.671094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: fa81dada-6ad4-4d36-9deb-1a9d8e59fa29] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:52.685332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:52.687381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:52.687649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:52.689428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:52.690088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:52.690637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:52.726900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] HTTP exception thrown: Instance fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 could not be found. Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Request method failure captured: Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 HTTP/1.1 Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pP3wFuvmZ0bsdK9sIpnm7Ni_hUvZzwNrWwR2IIVmgfER-V8KL4xGoe9CLKL0FKr_BF11gKVIWanRtzypFIK2Or67fPmxb_31yG_yybIzD_mkoaOhqVu5jk4_n3KEU3j94KK4lU_fWQGMrwob3FU_vRzae3cG3JRu1BjJTxe3kfE78U Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.25 Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 47793440cab647cc943281e2bc566c7f Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_47793440cab647cc943281e2bc566c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47793440cab647cc943281e2bc566c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47793440cab647cc943281e2bc566c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/47793440cab647cc943281e2bc566c7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 47793440cab647cc943281e2bc566c7f Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-LiveAutoBlockMigrationV225Test-1470783713-project Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 27626b9d13c340cc9ec2fe564d1bab8d Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713-project Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 could not be found. Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'fa81dada-6ad4-4d36-9deb-1a9d8e59fa29'} Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 could not be found. Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 could not be found. Aug 09 17:15:52.736060 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:15:52.748228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:52.748228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:15:52.748228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:52.748228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:52.748228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:52.748228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:15:52.748228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:15:52.748228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 could not be found. Aug 09 17:15:52.748228 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:15:52.756077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Returning 404 to user: Instance fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:15:52.758317 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1d75de0a-14e1-4506-933a-c8d58a8d8bc0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29" status: 404 len: 111 microversion: 2.25 time: 0.105016 Aug 09 17:15:52.761619 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1024/1963] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:15:52 2022] GET /compute/v2.1/servers/fa81dada-6ad4-4d36-9deb-1a9d8e59fa29 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:15:52.788970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8706850b-b435-441b-9ced-7707ab04ca6a req-0b8533f6-adf6-4a5a-ba8a-15195c99247a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330a79ba-42cf-4f1b-a572-c5143e3096cc", "name": "network-vif-plugged", "status": "completed", "tag": "9df81729-97f0-409f-ade5-2051ca68ec21"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:52.833925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8706850b-b435-441b-9ced-7707ab04ca6a req-0b8533f6-adf6-4a5a-ba8a-15195c99247a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:52.836213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8706850b-b435-441b-9ced-7707ab04ca6a req-0b8533f6-adf6-4a5a-ba8a-15195c99247a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:52.837130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8706850b-b435-441b-9ced-7707ab04ca6a req-0b8533f6-adf6-4a5a-ba8a-15195c99247a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:52.885420 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8706850b-b435-441b-9ced-7707ab04ca6a req-0b8533f6-adf6-4a5a-ba8a-15195c99247a service nova] Creating event network-vif-plugged:9df81729-97f0-409f-ade5-2051ca68ec21 for instance 330a79ba-42cf-4f1b-a572-c5143e3096cc on n-h1-845781-6 Aug 09 17:15:52.899869 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8706850b-b435-441b-9ced-7707ab04ca6a req-0b8533f6-adf6-4a5a-ba8a-15195c99247a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132674 Aug 09 17:15:52.902037 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1025/1964] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:52.918945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0abfc05f-dd99-47a0-8d2d-95e74aba27fa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:52.921866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0abfc05f-dd99-47a0-8d2d-95e74aba27fa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:52.944115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abfc05f-dd99-47a0-8d2d-95e74aba27fa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:52.946057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abfc05f-dd99-47a0-8d2d-95e74aba27fa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:52.949052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abfc05f-dd99-47a0-8d2d-95e74aba27fa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:52.951389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abfc05f-dd99-47a0-8d2d-95e74aba27fa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:52.953159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abfc05f-dd99-47a0-8d2d-95e74aba27fa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:52.954629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abfc05f-dd99-47a0-8d2d-95e74aba27fa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:53.771975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0abfc05f-dd99-47a0-8d2d-95e74aba27fa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:53.787275 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0abfc05f-dd99-47a0-8d2d-95e74aba27fa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 200 len: 1314 microversion: 2.1 time: 0.878594 Aug 09 17:15:53.787275 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1026/1965] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:52 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:53.791380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2d13d648-819c-411c-a1c6-8f2c82829ed1 req-e64c6586-8bb6-4b5e-9b96-7c53fe456c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6024eb-923e-4e73-9361-1f54a16a9760", "tag": "3cf8b2af-ab05-4485-b574-a07824bc13cd"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:53.818831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2d13d648-819c-411c-a1c6-8f2c82829ed1 req-e64c6586-8bb6-4b5e-9b96-7c53fe456c57 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:53.819326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2d13d648-819c-411c-a1c6-8f2c82829ed1 req-e64c6586-8bb6-4b5e-9b96-7c53fe456c57 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:53.819795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2d13d648-819c-411c-a1c6-8f2c82829ed1 req-e64c6586-8bb6-4b5e-9b96-7c53fe456c57 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:53.853564 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2d13d648-819c-411c-a1c6-8f2c82829ed1 req-e64c6586-8bb6-4b5e-9b96-7c53fe456c57 service nova] Creating event network-changed:3cf8b2af-ab05-4485-b574-a07824bc13cd for instance 6f6024eb-923e-4e73-9361-1f54a16a9760 on n-h2-845781-6 Aug 09 17:15:53.872678 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2d13d648-819c-411c-a1c6-8f2c82829ed1 req-e64c6586-8bb6-4b5e-9b96-7c53fe456c57 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086733 Aug 09 17:15:53.873780 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1027/1966] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:53.892469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f4a7b003-a0cc-4b71-883d-9b7dd2065d3a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:53.893187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f4a7b003-a0cc-4b71-883d-9b7dd2065d3a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:53.915147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a7b003-a0cc-4b71-883d-9b7dd2065d3a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:53.915819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a7b003-a0cc-4b71-883d-9b7dd2065d3a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:53.916318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a7b003-a0cc-4b71-883d-9b7dd2065d3a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:53.917027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a7b003-a0cc-4b71-883d-9b7dd2065d3a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:53.917487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a7b003-a0cc-4b71-883d-9b7dd2065d3a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:53.917914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a7b003-a0cc-4b71-883d-9b7dd2065d3a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:54.774846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f4a7b003-a0cc-4b71-883d-9b7dd2065d3a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:54.789669 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f4a7b003-a0cc-4b71-883d-9b7dd2065d3a tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1647 microversion: 2.1 time: 0.913050 Aug 09 17:15:54.795101 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1028/1967] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:53 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1647 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:54.806086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-684b9cda-7d05-4ab4-b170-38c1b68f1411 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:54.808402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-684b9cda-7d05-4ab4-b170-38c1b68f1411 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:54.827803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-684b9cda-7d05-4ab4-b170-38c1b68f1411 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:54.828429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-684b9cda-7d05-4ab4-b170-38c1b68f1411 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:54.829074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-684b9cda-7d05-4ab4-b170-38c1b68f1411 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:54.830703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-684b9cda-7d05-4ab4-b170-38c1b68f1411 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:54.830703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-684b9cda-7d05-4ab4-b170-38c1b68f1411 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:54.831032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-684b9cda-7d05-4ab4-b170-38c1b68f1411 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:55.324953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-684b9cda-7d05-4ab4-b170-38c1b68f1411 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:55.338374 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-684b9cda-7d05-4ab4-b170-38c1b68f1411 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 200 len: 1318 microversion: 2.1 time: 0.541662 Aug 09 17:15:55.339413 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1029/1968] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:54 2022] GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:55.354036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cbd146a1-1638-4ecc-ae8a-a5982ea1bfdc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:55.354674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cbd146a1-1638-4ecc-ae8a-a5982ea1bfdc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:55.367259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbd146a1-1638-4ecc-ae8a-a5982ea1bfdc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:55.367806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbd146a1-1638-4ecc-ae8a-a5982ea1bfdc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:55.368251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbd146a1-1638-4ecc-ae8a-a5982ea1bfdc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:55.368983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbd146a1-1638-4ecc-ae8a-a5982ea1bfdc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:55.369439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbd146a1-1638-4ecc-ae8a-a5982ea1bfdc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:55.369871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbd146a1-1638-4ecc-ae8a-a5982ea1bfdc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:55.818317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cbd146a1-1638-4ecc-ae8a-a5982ea1bfdc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:55.838340 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cbd146a1-1638-4ecc-ae8a-a5982ea1bfdc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 200 len: 1314 microversion: 2.1 time: 0.494964 Aug 09 17:15:55.842783 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1030/1969] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:55 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:55.865203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9272b7f4-2bae-4856-8eeb-6f9f92cb62b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:55.865824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9272b7f4-2bae-4856-8eeb-6f9f92cb62b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:55.890782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9272b7f4-2bae-4856-8eeb-6f9f92cb62b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:55.891284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9272b7f4-2bae-4856-8eeb-6f9f92cb62b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:55.891763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9272b7f4-2bae-4856-8eeb-6f9f92cb62b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:55.892602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9272b7f4-2bae-4856-8eeb-6f9f92cb62b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:55.898815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9272b7f4-2bae-4856-8eeb-6f9f92cb62b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:55.899751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9272b7f4-2bae-4856-8eeb-6f9f92cb62b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:56.046353 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c3cc508e-7a7c-4930-be91-3be7d63bfea3 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.408272 Aug 09 17:15:56.048044 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 940/1970] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:15:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:56.069101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-731b3904-8ba9-4be5-a5dc-edba7066465e tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] Calling method '.version_select at 0x7fbbcb94fe50>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:56.836215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9272b7f4-2bae-4856-8eeb-6f9f92cb62b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:56.852788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9272b7f4-2bae-4856-8eeb-6f9f92cb62b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 200 len: 1647 microversion: 2.1 time: 1.008438 Aug 09 17:15:56.863361 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1031/1971] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:55 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 1647 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:56.877143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6286029-982b-4513-b237-f87371a6fef4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:56.877143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e6286029-982b-4513-b237-f87371a6fef4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:56.907936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6286029-982b-4513-b237-f87371a6fef4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:56.908689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6286029-982b-4513-b237-f87371a6fef4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:56.909352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6286029-982b-4513-b237-f87371a6fef4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:56.911733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6286029-982b-4513-b237-f87371a6fef4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:56.930031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6286029-982b-4513-b237-f87371a6fef4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:56.930959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6286029-982b-4513-b237-f87371a6fef4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:57.126967 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-731b3904-8ba9-4be5-a5dc-edba7066465e tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/6ac8caa4-fda6-4990-b305-eeea748fd928" status: 200 len: 141 microversion: 2.1 time: 1.061693 Aug 09 17:15:57.128274 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 941/1972] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 17:15:56 2022] GET /compute/v2.1/os-floating-ips/6ac8caa4-fda6-4990-b305-eeea748fd928 => generated 141 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:15:57.135595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bbe845aa-3760-41f4-a5e4-fa2ec104b81b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:57.136951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bbe845aa-3760-41f4-a5e4-fa2ec104b81b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:57.164633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbe845aa-3760-41f4-a5e4-fa2ec104b81b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:57.165768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbe845aa-3760-41f4-a5e4-fa2ec104b81b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:57.168427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbe845aa-3760-41f4-a5e4-fa2ec104b81b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:57.169424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbe845aa-3760-41f4-a5e4-fa2ec104b81b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:57.170087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbe845aa-3760-41f4-a5e4-fa2ec104b81b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:57.176563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbe845aa-3760-41f4-a5e4-fa2ec104b81b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:57.626204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bbe845aa-3760-41f4-a5e4-fa2ec104b81b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:57.657816 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bbe845aa-3760-41f4-a5e4-fa2ec104b81b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 200 len: 1502 microversion: 2.1 time: 0.527836 Aug 09 17:15:57.675678 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 942/1973] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:57 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 1502 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:57.675678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d792c7f-7b54-4258-9769-e000cb088737 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] Calling method '.version_select at 0x7fbbcb71b310>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:57.941220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e6286029-982b-4513-b237-f87371a6fef4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:57.981136 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e6286029-982b-4513-b237-f87371a6fef4 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 200 len: 1318 microversion: 2.1 time: 1.112421 Aug 09 17:15:58.003706 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1032/1974] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:56 2022] GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 1318 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:58.027458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-25aa8b87-bdb2-418e-8674-546179c8fe74 req-c78a0ae7-6541-4a30-930f-eb7391f01389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d16bcba-8ad6-47eb-b715-130c8906d546", "name": "network-vif-deleted", "tag": "91ca63ca-509b-4db2-8205-e89c4c1a4ff6"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:15:58.088859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-25aa8b87-bdb2-418e-8674-546179c8fe74 req-c78a0ae7-6541-4a30-930f-eb7391f01389 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:58.101903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-25aa8b87-bdb2-418e-8674-546179c8fe74 req-c78a0ae7-6541-4a30-930f-eb7391f01389 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:58.103353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-25aa8b87-bdb2-418e-8674-546179c8fe74 req-c78a0ae7-6541-4a30-930f-eb7391f01389 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:58.166053 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-25aa8b87-bdb2-418e-8674-546179c8fe74 req-c78a0ae7-6541-4a30-930f-eb7391f01389 service nova] Creating event network-vif-deleted:91ca63ca-509b-4db2-8205-e89c4c1a4ff6 for instance 4d16bcba-8ad6-47eb-b715-130c8906d546 on n-h1-845781-6 Aug 09 17:15:58.179800 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-25aa8b87-bdb2-418e-8674-546179c8fe74 req-c78a0ae7-6541-4a30-930f-eb7391f01389 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191261 Aug 09 17:15:58.182944 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1033/1975] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:15:58.196918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5dfe5e2b-33df-4e35-a3f2-1974fc0e0908 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:58.198147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5dfe5e2b-33df-4e35-a3f2-1974fc0e0908 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:58.214401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dfe5e2b-33df-4e35-a3f2-1974fc0e0908 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:58.215243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dfe5e2b-33df-4e35-a3f2-1974fc0e0908 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:58.218423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dfe5e2b-33df-4e35-a3f2-1974fc0e0908 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:58.219515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dfe5e2b-33df-4e35-a3f2-1974fc0e0908 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:58.220344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dfe5e2b-33df-4e35-a3f2-1974fc0e0908 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:58.224724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dfe5e2b-33df-4e35-a3f2-1974fc0e0908 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:58.290645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5dfe5e2b-33df-4e35-a3f2-1974fc0e0908 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:15:58.471875 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5dfe5e2b-33df-4e35-a3f2-1974fc0e0908 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 204 len: 0 microversion: 2.1 time: 0.286829 Aug 09 17:15:58.478024 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1034/1976] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:15:58 2022] DELETE /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:15:58.483511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:58.486570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:58.506287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:58.507065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:58.509799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:58.509979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:58.511985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:58.513948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:58.556886 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 HTTP/1.1 Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '4d16bcba-8ad6-47eb-b715-130c8906d546'} Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:15:58.564237 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:15:58.570463 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:15:58.570463 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:15:58.570463 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:15:58.570463 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:15:58.570463 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:15:58.570463 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:15:58.570463 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:15:58.570463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:15:58.570463 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d0972ac0-2c1b-4c64-87d5-e2a82f7e490b tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 404 len: 111 microversion: 2.1 time: 0.091269 Aug 09 17:15:58.572993 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1035/1977] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:58 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:15:58.593823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-42768a7d-b610-4803-934f-abe42ca723c0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:58.600331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-42768a7d-b610-4803-934f-abe42ca723c0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:58.610872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42768a7d-b610-4803-934f-abe42ca723c0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:58.617151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42768a7d-b610-4803-934f-abe42ca723c0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:58.617911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42768a7d-b610-4803-934f-abe42ca723c0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:58.620777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42768a7d-b610-4803-934f-abe42ca723c0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:58.628012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42768a7d-b610-4803-934f-abe42ca723c0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:58.628838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42768a7d-b610-4803-934f-abe42ca723c0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:59.198863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-42768a7d-b610-4803-934f-abe42ca723c0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:15:59.229957 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-42768a7d-b610-4803-934f-abe42ca723c0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 200 len: 1508 microversion: 2.1 time: 0.651184 Aug 09 17:15:59.235771 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1036/1978] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:58 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 1508 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:15:59.253656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fbf9d215-987e-4a83-bfe6-ea872284f6d8 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbdc9ecb80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:59.887298 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0d792c7f-7b54-4258-9769-e000cb088737 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/6ac8caa4-fda6-4990-b305-eeea748fd928" status: 202 len: 0 microversion: 2.1 time: 2.218376 Aug 09 17:15:59.894954 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 943/1979] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:15:57 2022] DELETE /compute/v2.1/os-floating-ips/6ac8caa4-fda6-4990-b305-eeea748fd928 => generated 0 bytes in 2229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:15:59.911359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a34631a0-8a05-4823-abd4-6bfc8327dfc5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:15:59.912418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a34631a0-8a05-4823-abd4-6bfc8327dfc5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:15:59.925419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a34631a0-8a05-4823-abd4-6bfc8327dfc5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:59.926184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a34631a0-8a05-4823-abd4-6bfc8327dfc5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:59.928737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a34631a0-8a05-4823-abd4-6bfc8327dfc5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:15:59.929978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a34631a0-8a05-4823-abd4-6bfc8327dfc5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:15:59.931139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a34631a0-8a05-4823-abd4-6bfc8327dfc5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:15:59.932220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a34631a0-8a05-4823-abd4-6bfc8327dfc5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:00.219393 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fbf9d215-987e-4a83-bfe6-ea872284f6d8 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/1f717e42-e785-4345-8e13-e138b0196f20" status: 202 len: 0 microversion: 2.1 time: 0.981259 Aug 09 17:16:00.221950 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1037/1980] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:15:59 2022] DELETE /compute/v2.1/os-security-groups/1f717e42-e785-4345-8e13-e138b0196f20 => generated 0 bytes in 985 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:16:00.500752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a34631a0-8a05-4823-abd4-6bfc8327dfc5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:00.514515 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a34631a0-8a05-4823-abd4-6bfc8327dfc5 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 200 len: 1318 microversion: 2.1 time: 0.617571 Aug 09 17:16:00.515140 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 944/1981] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:15:59 2022] GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:00.533259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-205e61b9-29f4-4238-ab80-736d364a2807 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] Calling method '.version_select at 0x7fbbdca0be50>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:00.563938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1463376180", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:00.688170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:16:00.945459 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-205e61b9-29f4-4238-ab80-736d364a2807 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.425863 Aug 09 17:16:00.955459 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 945/1982] 10.222.0.93 () {58 vars in 1164 bytes} [Tue Aug 9 17:16:00 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:00.960702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a93a3667-abeb-4a4f-a3b3-f3961eb25d92 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:00.961260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a93a3667-abeb-4a4f-a3b3-f3961eb25d92 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:00.976901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93a3667-abeb-4a4f-a3b3-f3961eb25d92 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:00.977655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93a3667-abeb-4a4f-a3b3-f3961eb25d92 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:00.978269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93a3667-abeb-4a4f-a3b3-f3961eb25d92 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:00.979196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93a3667-abeb-4a4f-a3b3-f3961eb25d92 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:00.979865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93a3667-abeb-4a4f-a3b3-f3961eb25d92 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:00.980466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a93a3667-abeb-4a4f-a3b3-f3961eb25d92 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:01.028413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a93a3667-abeb-4a4f-a3b3-f3961eb25d92 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:16:01.177668 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a93a3667-abeb-4a4f-a3b3-f3961eb25d92 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 204 len: 0 microversion: 2.25 time: 0.221163 Aug 09 17:16:01.179186 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 946/1983] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:16:00 2022] DELETE /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:16:01.187823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6db2aeeb-8c80-4d49-8289-c1653b8cb0b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbdca0bf70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:01.200525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:16:01.201256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:16:01.202141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:16:01.203537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:16:01.206290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:16:01.236872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:01.240576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:01.241399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:01.242585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:01.243704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:01.244900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:01.283974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Getting quotas for project 6a92a0d7635044099c4c6a08a32d8cf5. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:01.295183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Getting quotas for user e89975c7af914cfb98b24f2b13253c83 and project 6a92a0d7635044099c4c6a08a32d8cf5. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:01.320860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:16:01.324221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:16:01.431515 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb3c9546-d55b-4b5d-998f-513cec593716 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.207935 Aug 09 17:16:01.432463 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1038/1984] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:16:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:16:01.439204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:01.441014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:01.450009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:01.450526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:01.450978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:01.452926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:01.453551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:01.454013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:01.460045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:01.509441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:01.510006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:01.510565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:01.511858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lazy-loading 'fault' on Instance uuid 330a79ba-42cf-4f1b-a572-c5143e3096cc {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:16:01.603974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:01.622615 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b3e953e9-abb6-4771-abb1-1ec902ef270d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 200 len: 1304 microversion: 2.1 time: 0.188861 Aug 09 17:16:01.623366 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1039/1985] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:01 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 1304 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:01.629072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5efd4ae3-3c3c-4d4a-aae7-aef89f0d7758 req-46ae719c-fdd5-4674-b5b6-856f9f0671b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6024eb-923e-4e73-9361-1f54a16a9760", "name": "network-vif-plugged", "status": "completed", "tag": "3cf8b2af-ab05-4485-b574-a07824bc13cd"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:01.646899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5efd4ae3-3c3c-4d4a-aae7-aef89f0d7758 req-46ae719c-fdd5-4674-b5b6-856f9f0671b2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:01.647560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5efd4ae3-3c3c-4d4a-aae7-aef89f0d7758 req-46ae719c-fdd5-4674-b5b6-856f9f0671b2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:01.648155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5efd4ae3-3c3c-4d4a-aae7-aef89f0d7758 req-46ae719c-fdd5-4674-b5b6-856f9f0671b2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:01.659083 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6db2aeeb-8c80-4d49-8289-c1653b8cb0b5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/cd57cec9-21d1-4bcc-9bf4-bbe4a299786f" status: 202 len: 0 microversion: 2.1 time: 0.478059 Aug 09 17:16:01.660018 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 947/1986] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:16:01 2022] DELETE /compute/v2.1/os-security-groups/cd57cec9-21d1-4bcc-9bf4-bbe4a299786f => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:16:01.678167 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5efd4ae3-3c3c-4d4a-aae7-aef89f0d7758 req-46ae719c-fdd5-4674-b5b6-856f9f0671b2 service nova] Creating event network-vif-plugged:3cf8b2af-ab05-4485-b574-a07824bc13cd for instance 6f6024eb-923e-4e73-9361-1f54a16a9760 on n-h2-845781-6 Aug 09 17:16:01.680100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-16c5c43f-eddc-445b-9b1c-6269f824cd5b tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] Calling method '.version_select at 0x7fbbcb43db80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:01.685559 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5efd4ae3-3c3c-4d4a-aae7-aef89f0d7758 req-46ae719c-fdd5-4674-b5b6-856f9f0671b2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059921 Aug 09 17:16:01.686818 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1040/1987] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:01.696228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:01.697120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:01.710046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:01.714963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:01.716899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:01.718963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:01.726572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:01.727573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:02.177517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:02.195301 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-16c5c43f-eddc-445b-9b1c-6269f824cd5b tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.528770 Aug 09 17:16:02.200559 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 948/1988] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:16:01 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:02.212291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5ce823f6-efb0-4a97-a756-85fba6691d6a req-19ec1b52-3de7-4b7e-b755-1b6916807926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330a79ba-42cf-4f1b-a572-c5143e3096cc", "name": "network-vif-deleted", "tag": "9df81729-97f0-409f-ade5-2051ca68ec21"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:02.215588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:02.217475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:02.218752 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c8dfa29-6075-42c4-ba4d-bd608e43fac0 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1732 microversion: 2.25 time: 0.530569 Aug 09 17:16:02.219701 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1041/1989] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:01 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1732 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:02.234832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-17a98e96-d1c4-4c4c-8422-8e0d3a66c6f7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:02.239578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5ce823f6-efb0-4a97-a756-85fba6691d6a req-19ec1b52-3de7-4b7e-b755-1b6916807926 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:02.240415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17a98e96-d1c4-4c4c-8422-8e0d3a66c6f7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:02.244885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5ce823f6-efb0-4a97-a756-85fba6691d6a req-19ec1b52-3de7-4b7e-b755-1b6916807926 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:02.246025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5ce823f6-efb0-4a97-a756-85fba6691d6a req-19ec1b52-3de7-4b7e-b755-1b6916807926 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:02.268964 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5ce823f6-efb0-4a97-a756-85fba6691d6a req-19ec1b52-3de7-4b7e-b755-1b6916807926 service nova] Creating event network-vif-deleted:9df81729-97f0-409f-ade5-2051ca68ec21 for instance 330a79ba-42cf-4f1b-a572-c5143e3096cc on n-h1-845781-6 Aug 09 17:16:02.276135 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5ce823f6-efb0-4a97-a756-85fba6691d6a req-19ec1b52-3de7-4b7e-b755-1b6916807926 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073783 Aug 09 17:16:02.277851 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 949/1990] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:02.285397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1fde069e-08d7-400f-ad52-332c66a7262b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:02.287452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1fde069e-08d7-400f-ad52-332c66a7262b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:02.294782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fde069e-08d7-400f-ad52-332c66a7262b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:02.295651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fde069e-08d7-400f-ad52-332c66a7262b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:02.296268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fde069e-08d7-400f-ad52-332c66a7262b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:02.297528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fde069e-08d7-400f-ad52-332c66a7262b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:02.298214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fde069e-08d7-400f-ad52-332c66a7262b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:02.298658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fde069e-08d7-400f-ad52-332c66a7262b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:02.408743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-17a98e96-d1c4-4c4c-8422-8e0d3a66c6f7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:02.438850 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-17a98e96-d1c4-4c4c-8422-8e0d3a66c6f7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1219 microversion: 2.1 time: 0.218264 Aug 09 17:16:02.439500 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1042/1991] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:02 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1219 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:02.457295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07cd8bd1-c32e-4630-bab8-b3ce1eaf8d4c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'create', calling method: .version_select at 0x7fbbdc9ec820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-995910586", "description": "tempest-description-1117850844"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:02.705679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1fde069e-08d7-400f-ad52-332c66a7262b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:02.731385 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1fde069e-08d7-400f-ad52-332c66a7262b tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 200 len: 1318 microversion: 2.1 time: 0.451321 Aug 09 17:16:02.733626 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 950/1992] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:02 2022] GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:02.768935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-20c66c31-750f-4dcf-aab0-e9679a8a4100 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] Calling method '.version_select at 0x7fbbcb942790>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:03.344065 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07cd8bd1-c32e-4630-bab8-b3ce1eaf8d4c tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.903355 Aug 09 17:16:03.344912 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1043/1993] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:16:02 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:03.350263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:03.350543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:03.372047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:03.373080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:03.374780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:03.375904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:03.376767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:03.377430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:03.409805 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc HTTP/1.1 Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '330a79ba-42cf-4f1b-a572-c5143e3096cc'} Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:03.412581 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:03.416564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:03.416564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:03.416564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:03.416564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:03.416564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:03.416564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:16:03.416564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:03.416564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:03.416564 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2bf9fa10-61b7-49bb-aa6f-7539a0da9353 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 404 len: 111 microversion: 2.1 time: 0.068680 Aug 09 17:16:03.416564 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1044/1994] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:03 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:03.433917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:03.434551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:03.445225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:03.448883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:03.449971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:03.451702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:03.452815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:03.453854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:04.180278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:04.204256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:04.213224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:04.217312 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0be3b222-04ae-4f07-ab5c-d28ff7488467 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 200 len: 1732 microversion: 2.25 time: 0.785969 Aug 09 17:16:04.219072 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1045/1995] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:03 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 1732 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:04.230151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-65747c83-4a50-48dd-92e0-c230d7c96f29 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Action: 'update', calling method: .version_select at 0x7fbbcbf04af0>, body: {"security_group": {"name": "tempest-sg-hth-1808450454", "description": "tempest-description-hth-2129951711"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:04.902804 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-20c66c31-750f-4dcf-aab0-e9679a8a4100 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/5e730d4e-fced-4049-bef2-5e6b55830424" status: 202 len: 0 microversion: 2.1 time: 2.164038 Aug 09 17:16:04.904130 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 951/1996] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:16:02 2022] DELETE /compute/v2.1/os-floating-ips/5e730d4e-fced-4049-bef2-5e6b55830424 => generated 0 bytes in 2167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:16:04.914090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a32624fd-42f9-4d44-9083-069cd3fe3517 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:04.915889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a32624fd-42f9-4d44-9083-069cd3fe3517 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:04.930026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a32624fd-42f9-4d44-9083-069cd3fe3517 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:04.931119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a32624fd-42f9-4d44-9083-069cd3fe3517 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:04.932340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a32624fd-42f9-4d44-9083-069cd3fe3517 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:04.934054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a32624fd-42f9-4d44-9083-069cd3fe3517 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:04.935495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a32624fd-42f9-4d44-9083-069cd3fe3517 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:04.936673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a32624fd-42f9-4d44-9083-069cd3fe3517 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:05.033711 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-65747c83-4a50-48dd-92e0-c230d7c96f29 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "PUT /compute/v2.1/os-security-groups/d3e5451b-f9cb-4710-bb61-1a6d3b4a31b8" status: 200 len: 218 microversion: 2.1 time: 0.812590 Aug 09 17:16:05.058191 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1046/1997] 10.222.0.93 () {60 vars in 1290 bytes} [Tue Aug 9 17:16:04 2022] PUT /compute/v2.1/os-security-groups/d3e5451b-f9cb-4710-bb61-1a6d3b4a31b8 => generated 218 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:05.068423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a32624fd-42f9-4d44-9083-069cd3fe3517 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:05.084785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1533664981", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ad48ae09-8243-461d-b010-943470de6d49"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:05.094386 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a32624fd-42f9-4d44-9083-069cd3fe3517 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1277 microversion: 2.1 time: 0.187190 Aug 09 17:16:05.110763 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 952/1998] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:04 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:05.124917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a57640fc-94f4-4cf6-b1cb-af1a267fc0a2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:05.126777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a57640fc-94f4-4cf6-b1cb-af1a267fc0a2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:05.142494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a57640fc-94f4-4cf6-b1cb-af1a267fc0a2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:05.144692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a57640fc-94f4-4cf6-b1cb-af1a267fc0a2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:05.147096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a57640fc-94f4-4cf6-b1cb-af1a267fc0a2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:05.148501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a57640fc-94f4-4cf6-b1cb-af1a267fc0a2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:05.152860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a57640fc-94f4-4cf6-b1cb-af1a267fc0a2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:05.153756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a57640fc-94f4-4cf6-b1cb-af1a267fc0a2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:05.265236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] validate_networks() for [('ad48ae09-8243-461d-b010-943470de6d49', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:16:05.488567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a57640fc-94f4-4cf6-b1cb-af1a267fc0a2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:05.519540 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a57640fc-94f4-4cf6-b1cb-af1a267fc0a2 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 200 len: 1508 microversion: 2.1 time: 0.405019 Aug 09 17:16:05.531657 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 953/1999] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:05 2022] GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 1508 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:05.542502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-7050c753-3bec-48ca-a65f-1efd54d68bf4 req-d907a99e-265d-4b8f-96fb-863b1b1346e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9bf5c5-13a8-4999-9fe7-e31ca09ad767", "name": "network-vif-deleted", "tag": "4e14d13a-f750-41b6-9e8f-9ebfa131fe82"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:05.558184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7050c753-3bec-48ca-a65f-1efd54d68bf4 req-d907a99e-265d-4b8f-96fb-863b1b1346e9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:05.559231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7050c753-3bec-48ca-a65f-1efd54d68bf4 req-d907a99e-265d-4b8f-96fb-863b1b1346e9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:05.563329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7050c753-3bec-48ca-a65f-1efd54d68bf4 req-d907a99e-265d-4b8f-96fb-863b1b1346e9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:05.590402 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-7050c753-3bec-48ca-a65f-1efd54d68bf4 req-d907a99e-265d-4b8f-96fb-863b1b1346e9 service nova] Creating event network-vif-deleted:4e14d13a-f750-41b6-9e8f-9ebfa131fe82 for instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 on n-h2-845781-6 Aug 09 17:16:05.602207 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-7050c753-3bec-48ca-a65f-1efd54d68bf4 req-d907a99e-265d-4b8f-96fb-863b1b1346e9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078262 Aug 09 17:16:05.603604 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 954/2000] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:05.618586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7f854c52-1b9d-471e-bb60-0790c5eab3f3 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] Calling method '.version_select at 0x7fbbcb6ec310>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:07.192025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:16:07.193446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:16:07.193978 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7f854c52-1b9d-471e-bb60-0790c5eab3f3 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/d10130e7-6dfb-430f-828b-627608263548" status: 202 len: 0 microversion: 2.1 time: 1.585948 Aug 09 17:16:07.196884 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 955/2001] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:16:05 2022] DELETE /compute/v2.1/os-floating-ips/d10130e7-6dfb-430f-828b-627608263548 => generated 0 bytes in 1593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:16:07.203075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:16:07.204020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:16:07.205084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:16:07.209295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e741b3a5-cd93-45ef-a037-c6390862cf9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb404670>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:07.245815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:07.246679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:07.247858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:07.249618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:07.250683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:07.253240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:07.329900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:07.358804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for user d8e1dc1f64fe429ea6a8c746b7c84ae6 and project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:07.374873 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e741b3a5-cd93-45ef-a037-c6390862cf9f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/d3e5451b-f9cb-4710-bb61-1a6d3b4a31b8" status: 200 len: 218 microversion: 2.1 time: 0.174630 Aug 09 17:16:07.376573 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 956/2002] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:16:07 2022] GET /compute/v2.1/os-security-groups/d3e5451b-f9cb-4710-bb61-1a6d3b4a31b8 => generated 218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:07.397323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:07.399122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:07.417895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:07.419191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:07.421300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:07.423770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:07.424747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:16:07.425248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:07.427854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:07.430366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:16:07.471890 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] HTTP exception thrown: Instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 could not be found. Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Request method failure captured: Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 HTTP/1.1 Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pP3wFuvmZ0bsdK9sIpnm7Ni_hUvZzwNrWwR2IIVmgfER-V8KL4xGoe9CLKL0FKr_BF11gKVIWanRtzypFIK2Or67fPmxb_31yG_yybIzD_mkoaOhqVu5jk4_n3KEU3j94KK4lU_fWQGMrwob3FU_vRzae3cG3JRu1BjJTxe3kfE78U Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.25 Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 47793440cab647cc943281e2bc566c7f Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_47793440cab647cc943281e2bc566c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47793440cab647cc943281e2bc566c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47793440cab647cc943281e2bc566c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/47793440cab647cc943281e2bc566c7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 47793440cab647cc943281e2bc566c7f Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-LiveAutoBlockMigrationV225Test-1470783713-project Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 27626b9d13c340cc9ec2fe564d1bab8d Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713-project Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 could not be found. Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '0b9bf5c5-13a8-4999-9fe7-e31ca09ad767'} Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 could not be found. Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 could not be found. Aug 09 17:16:07.481054 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:07.485314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:07.485314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:07.485314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:07.485314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:07.485314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:07.485314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:07.485314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:07.485314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 could not be found. Aug 09 17:16:07.485314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:07.489835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Returning 404 to user: Instance 0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:07.491902 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fdab0bb6-7198-495f-87aa-01739001e221 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767" status: 404 len: 111 microversion: 2.25 time: 0.112431 Aug 09 17:16:07.494835 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 957/2003] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:07 2022] GET /compute/v2.1/servers/0b9bf5c5-13a8-4999-9fe7-e31ca09ad767 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:16:07.516409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8de7aa41-99c1-43f8-9b88-9e3d620b6073 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:07.518158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8de7aa41-99c1-43f8-9b88-9e3d620b6073 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:07.543747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de7aa41-99c1-43f8-9b88-9e3d620b6073 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:07.546459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de7aa41-99c1-43f8-9b88-9e3d620b6073 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:07.547775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de7aa41-99c1-43f8-9b88-9e3d620b6073 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:07.551705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de7aa41-99c1-43f8-9b88-9e3d620b6073 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:07.561401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de7aa41-99c1-43f8-9b88-9e3d620b6073 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:07.563035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de7aa41-99c1-43f8-9b88-9e3d620b6073 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:07.583094 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-553d00b9-7632-45c8-8b9b-4b8f7e0f3203 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.522456 Aug 09 17:16:07.586505 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1047/2004] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:16:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:16:07.610967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-76b0b2a3-e67f-4c54-adf4-3d9bf0a1bf34 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] Calling method '.version_select at 0x7fbbcbf04e50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:08.138618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8de7aa41-99c1-43f8-9b88-9e3d620b6073 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:08.165983 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8de7aa41-99c1-43f8-9b88-9e3d620b6073 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1319 microversion: 2.1 time: 0.668293 Aug 09 17:16:08.167735 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 958/2005] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:07 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1319 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:08.192915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-85c0ebf1-0009-48a2-b6f0-9dc2a68ccbda tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbdca0be50>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:08.843515 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-85c0ebf1-0009-48a2-b6f0-9dc2a68ccbda tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/d3e5451b-f9cb-4710-bb61-1a6d3b4a31b8" status: 202 len: 0 microversion: 2.1 time: 0.662384 Aug 09 17:16:08.847389 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 959/2006] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:16:08 2022] DELETE /compute/v2.1/os-security-groups/d3e5451b-f9cb-4710-bb61-1a6d3b4a31b8 => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:16:08.870590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe95d683-e181-4593-9052-08bb4d12d859 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '.version_select at 0x7fbbcb9420d0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:08.944104 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fe95d683-e181-4593-9052-08bb4d12d859 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-343264877" status: 204 len: 0 microversion: 2.25 time: 0.087657 Aug 09 17:16:08.945460 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 960/2007] 10.222.0.93 () {60 vars in 1259 bytes} [Tue Aug 9 17:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-343264877 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:16:08.956676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-62b0f908-de35-49ba-bf1b-7b18db97c97b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:08.959420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-62b0f908-de35-49ba-bf1b-7b18db97c97b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:08.976680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62b0f908-de35-49ba-bf1b-7b18db97c97b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:08.977933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62b0f908-de35-49ba-bf1b-7b18db97c97b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:08.979064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62b0f908-de35-49ba-bf1b-7b18db97c97b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:08.980952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62b0f908-de35-49ba-bf1b-7b18db97c97b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:08.983211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62b0f908-de35-49ba-bf1b-7b18db97c97b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:08.984386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62b0f908-de35-49ba-bf1b-7b18db97c97b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:09.280873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-62b0f908-de35-49ba-bf1b-7b18db97c97b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:09.292514 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-62b0f908-de35-49ba-bf1b-7b18db97c97b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1267 microversion: 2.1 time: 0.345141 Aug 09 17:16:09.304628 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 961/2008] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:08 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1267 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:09.311468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "fe119786-957f-4ff7-960a-dc31cfd4a9a2"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:09.315276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:09.324161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:09.324921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:09.325542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:09.326516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:09.327145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:09.327766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:09.416863 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] HTTP exception thrown: Volume 5c4d807f-6960-43fc-9ac5-61ca2a2c023e could not be found. Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Request method failure captured: Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760/os-volume_attachments/5c4d807f-6960-43fc-9ac5-61ca2a2c023e HTTP/1.1 Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 74 Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pWu_WXFpYxGhQx82NrAeAR81zaoSZsLeV261bwD_Be6SrO0f8iEoeg9GLREG32Vucz9H5V9to5RDRTaUE7Q8Ii28kPZ_GOOqR_Vtich3rTj8l6TmA2jNElBeDWp3cW2FIVYiOmjiDBDAhBKXfFPuCdbgpxBQTb79K5bvja6Au46cbQ Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 67046aef914b4179b7bbb61b1501783a Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesAdminNegativeTest-351068267 Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_67046aef914b4179b7bbb61b1501783a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/67046aef914b4179b7bbb61b1501783a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/67046aef914b4179b7bbb61b1501783a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/67046aef914b4179b7bbb61b1501783a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesAdminNegativeTest-351068267 Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 67046aef914b4179b7bbb61b1501783a Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-351068267 Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesAdminNegativeTest-351068267-project-admin Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 9f33527c941e46dba7ba2ed26f316fa6 Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesAdminNegativeTest-351068267-project-admin Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: {"volumeAttachment": {"volumeId": "fe119786-957f-4ff7-960a-dc31cfd4a9a2"}} Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: exception: Volume 5c4d807f-6960-43fc-9ac5-61ca2a2c023e could not be found. Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'server_id': '6f6024eb-923e-4e73-9361-1f54a16a9760', 'id': '5c4d807f-6960-43fc-9ac5-61ca2a2c023e', 'body': {'volumeAttachment': {'volumeId': 'fe119786-957f-4ff7-960a-dc31cfd4a9a2'}}} Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c4d807f-6960-43fc-9ac5-61ca2a2c023e could not be found. (HTTP 404) (Request-ID: req-51ca9faf-d1b7-41a5-9ffe-a69cf36b2316) Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:16:09.420750 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c4d807f-6960-43fc-9ac5-61ca2a2c023e could not be found. Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c4d807f-6960-43fc-9ac5-61ca2a2c023e could not be found. Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c4d807f-6960-43fc-9ac5-61ca2a2c023e could not be found. Aug 09 17:16:09.424879 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.431219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] Returning 404 to user: Volume 5c4d807f-6960-43fc-9ac5-61ca2a2c023e could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:09.433462 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b18b47eb-38b7-4278-bd4b-cdcbe0d8f282 tempest-VolumesAdminNegativeTest-351068267 tempest-VolumesAdminNegativeTest-351068267-project-admin] 10.222.0.93 "PUT /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760/os-volume_attachments/5c4d807f-6960-43fc-9ac5-61ca2a2c023e" status: 404 len: 109 microversion: 2.1 time: 0.126381 Aug 09 17:16:09.434433 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 962/2009] 10.222.0.93 () {60 vars in 1433 bytes} [Tue Aug 9 17:16:09 2022] PUT /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760/os-volume_attachments/5c4d807f-6960-43fc-9ac5-61ca2a2c023e => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:09.452285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:09.456581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:09.474849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:09.476272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:09.477355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:09.478820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:09.480115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:09.481621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:09.516774 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 HTTP/1.1 Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '4d16bcba-8ad6-47eb-b715-130c8906d546'} Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:16:09.519700 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:16:09.525117 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:16:09.525117 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.525117 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:09.525117 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.525117 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:09.525117 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:09.525117 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:09.525117 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:09.525117 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:09.525117 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:16:09.525117 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:09.527063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:09.528836 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e8c47505-3777-4a10-9521-f1142b2bb4fa tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 404 len: 111 microversion: 2.1 time: 0.092585 Aug 09 17:16:09.533701 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 963/2010] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:16:09 2022] DELETE /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:09.542621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c4e7b100-d546-4273-a69e-0d22c1188180 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:09.546913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c4e7b100-d546-4273-a69e-0d22c1188180 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:09.560222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4e7b100-d546-4273-a69e-0d22c1188180 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:09.561070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4e7b100-d546-4273-a69e-0d22c1188180 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:09.561700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4e7b100-d546-4273-a69e-0d22c1188180 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:09.562928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4e7b100-d546-4273-a69e-0d22c1188180 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:09.564054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4e7b100-d546-4273-a69e-0d22c1188180 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:09.564930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4e7b100-d546-4273-a69e-0d22c1188180 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:09.955599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c4e7b100-d546-4273-a69e-0d22c1188180 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:09.968241 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c4e7b100-d546-4273-a69e-0d22c1188180 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1319 microversion: 2.1 time: 0.432252 Aug 09 17:16:09.969324 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 964/2011] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:09 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:09.975550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:09.976500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: 4d16bcba-8ad6-47eb-b715-130c8906d546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:09.984319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:09.985093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:09.985624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:09.986871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:09.988214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:09.988855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:09.993258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:10.013082 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 HTTP/1.1 Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '4d16bcba-8ad6-47eb-b715-130c8906d546'} Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.015195 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.022388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.022388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.022388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.022388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:10.022388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:10.022388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. Aug 09 17:16:10.022388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.022388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Instance 4d16bcba-8ad6-47eb-b715-130c8906d546 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:10.022388 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8ff3c149-70e8-4735-b301-44249a40f2e5 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546" status: 404 len: 111 microversion: 2.1 time: 0.046237 Aug 09 17:16:10.022388 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 965/2012] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:09 2022] GET /compute/v2.1/servers/4d16bcba-8ad6-47eb-b715-130c8906d546 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:10.027709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9133130-1bf3-4e25-af30-3291dc9f7bb3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcbaeaa60>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:10.078787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-d9133130-1bf3-4e25-af30-3291dc9f7bb3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f does not exist", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:16:10.079987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.security_group_api [None req-d9133130-1bf3-4e25-af30-3291dc9f7bb3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Neutron security group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f not found {{(pid=119432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:16:10.080965 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-d9133130-1bf3-4e25-af30-3291dc9f7bb3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f does not exist Aug 09 17:16:10.080965 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-0a2e4194-782d-425b-b4e5-7e5d26b23181'] Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9133130-1bf3-4e25-af30-3291dc9f7bb3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-security-groups/cd57cec9-21d1-4bcc-9bf4-bbe4a299786f HTTP/1.1 Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: exception: Security group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f does not exist Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-0a2e4194-782d-425b-b4e5-7e5d26b23181'] Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'cd57cec9-21d1-4bcc-9bf4-bbe4a299786f'} Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:16:10.085689 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f does not exist Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a2e4194-782d-425b-b4e5-7e5d26b23181'] Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f does not exist Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a2e4194-782d-425b-b4e5-7e5d26b23181'] Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f does not exist Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a2e4194-782d-425b-b4e5-7e5d26b23181'] Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f does not exist Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a2e4194-782d-425b-b4e5-7e5d26b23181'] Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9133130-1bf3-4e25-af30-3291dc9f7bb3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Security group cd57cec9-21d1-4bcc-9bf4-bbe4a299786f does not exist Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-0a2e4194-782d-425b-b4e5-7e5d26b23181'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9133130-1bf3-4e25-af30-3291dc9f7bb3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/cd57cec9-21d1-4bcc-9bf4-bbe4a299786f" status: 404 len: 194 microversion: 2.1 time: 0.064971 Aug 09 17:16:10.092348 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 966/2013] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:16:10 2022] DELETE /compute/v2.1/os-security-groups/cd57cec9-21d1-4bcc-9bf4-bbe4a299786f => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:10.112719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b4d86942-5bf7-4ebe-959b-0142b4557144 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb825a60>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:10.152018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-b4d86942-5bf7-4ebe-959b-0142b4557144 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1f717e42-e785-4345-8e13-e138b0196f20 does not exist", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:16:10.153502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.security_group_api [None req-b4d86942-5bf7-4ebe-959b-0142b4557144 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Neutron security group 1f717e42-e785-4345-8e13-e138b0196f20 not found {{(pid=119432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:16:10.154492 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b4d86942-5bf7-4ebe-959b-0142b4557144 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security group 1f717e42-e785-4345-8e13-e138b0196f20 does not exist Aug 09 17:16:10.154492 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-3f68a46b-2b15-4597-99e2-e40b6ef32f85'] Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b4d86942-5bf7-4ebe-959b-0142b4557144 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-security-groups/1f717e42-e785-4345-8e13-e138b0196f20 HTTP/1.1 Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: exception: Security group 1f717e42-e785-4345-8e13-e138b0196f20 does not exist Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-3f68a46b-2b15-4597-99e2-e40b6ef32f85'] Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '1f717e42-e785-4345-8e13-e138b0196f20'} Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:16:10.158918 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1f717e42-e785-4345-8e13-e138b0196f20 does not exist Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f68a46b-2b15-4597-99e2-e40b6ef32f85'] Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1f717e42-e785-4345-8e13-e138b0196f20 does not exist Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f68a46b-2b15-4597-99e2-e40b6ef32f85'] Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1f717e42-e785-4345-8e13-e138b0196f20 does not exist Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f68a46b-2b15-4597-99e2-e40b6ef32f85'] Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1f717e42-e785-4345-8e13-e138b0196f20 does not exist Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f68a46b-2b15-4597-99e2-e40b6ef32f85'] Aug 09 17:16:10.164674 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.173898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b4d86942-5bf7-4ebe-959b-0142b4557144 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Security group 1f717e42-e785-4345-8e13-e138b0196f20 does not exist Aug 09 17:16:10.173898 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-3f68a46b-2b15-4597-99e2-e40b6ef32f85'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:10.173898 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b4d86942-5bf7-4ebe-959b-0142b4557144 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/1f717e42-e785-4345-8e13-e138b0196f20" status: 404 len: 194 microversion: 2.1 time: 0.070438 Aug 09 17:16:10.180031 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 967/2014] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:16:10 2022] DELETE /compute/v2.1/os-security-groups/1f717e42-e785-4345-8e13-e138b0196f20 => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:10.190147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1f6880f8-975b-4614-bfd4-c2b215419d03 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb6a04c0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:10.242605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-1f6880f8-975b-4614-bfd4-c2b215419d03 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:16:10.243517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.security_group_api [None req-1f6880f8-975b-4614-bfd4-c2b215419d03 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Neutron security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e not found {{(pid=119432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:16:10.244459 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-1f6880f8-975b-4614-bfd4-c2b215419d03 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:16:10.244459 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-300b1cf0-7b20-4ac5-8ec6-c07ce268f85f'] Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1f6880f8-975b-4614-bfd4-c2b215419d03 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-security-groups/7f025f9b-b7e8-4df5-90f9-9ea14f16f99e HTTP/1.1 Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: exception: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-300b1cf0-7b20-4ac5-8ec6-c07ce268f85f'] Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '7f025f9b-b7e8-4df5-90f9-9ea14f16f99e'} Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:16:10.248341 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-300b1cf0-7b20-4ac5-8ec6-c07ce268f85f'] Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-300b1cf0-7b20-4ac5-8ec6-c07ce268f85f'] Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-300b1cf0-7b20-4ac5-8ec6-c07ce268f85f'] Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-300b1cf0-7b20-4ac5-8ec6-c07ce268f85f'] Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1f6880f8-975b-4614-bfd4-c2b215419d03 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Security group 7f025f9b-b7e8-4df5-90f9-9ea14f16f99e does not exist Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-300b1cf0-7b20-4ac5-8ec6-c07ce268f85f'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1f6880f8-975b-4614-bfd4-c2b215419d03 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/7f025f9b-b7e8-4df5-90f9-9ea14f16f99e" status: 404 len: 194 microversion: 2.1 time: 0.065990 Aug 09 17:16:10.269226 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 968/2015] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:16:10 2022] DELETE /compute/v2.1/os-security-groups/7f025f9b-b7e8-4df5-90f9-9ea14f16f99e => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:10.279839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-04ec1a41-a19e-4ae4-9489-4a5679548fa3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb8253a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:10.332837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-04ec1a41-a19e-4ae4-9489-4a5679548fa3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:16:10.338048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.security_group_api [None req-04ec1a41-a19e-4ae4-9489-4a5679548fa3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Neutron security group 9f897521-953a-4422-bc6b-6f678cde515e not found {{(pid=119432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:16:10.341315 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-04ec1a41-a19e-4ae4-9489-4a5679548fa3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:16:10.341315 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-b5cc7372-3700-40f2-a004-bb19357d2546'] Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-04ec1a41-a19e-4ae4-9489-4a5679548fa3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-security-groups/9f897521-953a-4422-bc6b-6f678cde515e HTTP/1.1 Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: exception: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-b5cc7372-3700-40f2-a004-bb19357d2546'] Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9f897521-953a-4422-bc6b-6f678cde515e'} Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:16:10.349963 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5cc7372-3700-40f2-a004-bb19357d2546'] Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5cc7372-3700-40f2-a004-bb19357d2546'] Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5cc7372-3700-40f2-a004-bb19357d2546'] Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5cc7372-3700-40f2-a004-bb19357d2546'] Aug 09 17:16:10.359694 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.389626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-04ec1a41-a19e-4ae4-9489-4a5679548fa3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Security group 9f897521-953a-4422-bc6b-6f678cde515e does not exist Aug 09 17:16:10.389626 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-b5cc7372-3700-40f2-a004-bb19357d2546'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:10.395919 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-04ec1a41-a19e-4ae4-9489-4a5679548fa3 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/9f897521-953a-4422-bc6b-6f678cde515e" status: 404 len: 194 microversion: 2.1 time: 0.129914 Aug 09 17:16:10.398457 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 969/2016] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:16:10 2022] DELETE /compute/v2.1/os-security-groups/9f897521-953a-4422-bc6b-6f678cde515e => generated 194 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:10.423252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1fb09e04-4d6d-4b23-b0bf-008e395b64dd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:10.429374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1fb09e04-4d6d-4b23-b0bf-008e395b64dd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:10.449755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fb09e04-4d6d-4b23-b0bf-008e395b64dd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:10.451595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fb09e04-4d6d-4b23-b0bf-008e395b64dd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:10.452788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fb09e04-4d6d-4b23-b0bf-008e395b64dd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:10.454863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fb09e04-4d6d-4b23-b0bf-008e395b64dd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:10.456247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fb09e04-4d6d-4b23-b0bf-008e395b64dd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:10.457518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fb09e04-4d6d-4b23-b0bf-008e395b64dd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:10.638502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1fb09e04-4d6d-4b23-b0bf-008e395b64dd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:10.651891 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1fb09e04-4d6d-4b23-b0bf-008e395b64dd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1273 microversion: 2.1 time: 0.250932 Aug 09 17:16:10.653598 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 970/2017] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:10 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1273 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:10.681790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d29ae0c-a47f-4f5a-a619-81cfe029415f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb404280>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:10.747101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-0d29ae0c-a47f-4f5a-a619-81cfe029415f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:16:10.748590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.security_group_api [None req-0d29ae0c-a47f-4f5a-a619-81cfe029415f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Neutron security group 506c5b74-35fc-4081-806e-58e9804548ca not found {{(pid=119432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:16:10.750775 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-0d29ae0c-a47f-4f5a-a619-81cfe029415f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:16:10.750775 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-e49599be-8778-4384-a1e2-b71d201cc259'] Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d29ae0c-a47f-4f5a-a619-81cfe029415f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-security-groups/506c5b74-35fc-4081-806e-58e9804548ca HTTP/1.1 Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: exception: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-e49599be-8778-4384-a1e2-b71d201cc259'] Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '506c5b74-35fc-4081-806e-58e9804548ca'} Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:16:10.753647 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e49599be-8778-4384-a1e2-b71d201cc259'] Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e49599be-8778-4384-a1e2-b71d201cc259'] Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e49599be-8778-4384-a1e2-b71d201cc259'] Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e49599be-8778-4384-a1e2-b71d201cc259'] Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d29ae0c-a47f-4f5a-a619-81cfe029415f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Security group 506c5b74-35fc-4081-806e-58e9804548ca does not exist Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-e49599be-8778-4384-a1e2-b71d201cc259'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:10.763181 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0d29ae0c-a47f-4f5a-a619-81cfe029415f tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/506c5b74-35fc-4081-806e-58e9804548ca" status: 404 len: 194 microversion: 2.1 time: 0.099980 Aug 09 17:16:10.775691 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 971/2018] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:16:10 2022] DELETE /compute/v2.1/os-security-groups/506c5b74-35fc-4081-806e-58e9804548ca => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:10.778034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c9d7731d-d963-46e5-87f8-b684765f6f49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbcb71b4c0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:10.829956 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-76b0b2a3-e67f-4c54-adf4-3d9bf0a1bf34 tempest-FloatingIPDetailsTestJSON-2065560892 tempest-FloatingIPDetailsTestJSON-2065560892-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/9ceb57a8-14c8-4069-8ef1-00ed345a4efe" status: 202 len: 0 microversion: 2.1 time: 3.240378 Aug 09 17:16:10.830943 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1048/2019] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:16:07 2022] DELETE /compute/v2.1/os-floating-ips/9ceb57a8-14c8-4069-8ef1-00ed345a4efe => generated 0 bytes in 3244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:16:10.856158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG neutronclient.v2_0.client [None req-c9d7731d-d963-46e5-87f8-b684765f6f49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist", "detail": ""}} {{(pid=119432) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:16:10.857780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c381e9cd-afd2-4258-9482-f3af3d304392 req-6cd28f0f-d578-4d6f-962f-5ce46bcedae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974eba3e-f255-482b-86c3-c76e7f0d994f", "tag": "95761b7b-443e-410d-a0af-09df4d2a4cd2"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:10.859080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.security_group_api [None req-c9d7731d-d963-46e5-87f8-b684765f6f49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Neutron security group 9537d57a-1547-4914-ade0-fb4450affa88 not found {{(pid=119432) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:16:10.860159 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-c9d7731d-d963-46e5-87f8-b684765f6f49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:16:10.860159 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-0ab538e6-f524-4adb-84ea-37aafff025fa'] Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c9d7731d-d963-46e5-87f8-b684765f6f49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-security-groups/9537d57a-1547-4914-ade0-fb4450affa88 HTTP/1.1 Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: exception: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-0ab538e6-f524-4adb-84ea-37aafff025fa'] Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9537d57a-1547-4914-ade0-fb4450affa88'} Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:16:10.865194 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ab538e6-f524-4adb-84ea-37aafff025fa'] Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ab538e6-f524-4adb-84ea-37aafff025fa'] Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ab538e6-f524-4adb-84ea-37aafff025fa'] Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ab538e6-f524-4adb-84ea-37aafff025fa'] Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c9d7731d-d963-46e5-87f8-b684765f6f49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Security group 9537d57a-1547-4914-ade0-fb4450affa88 does not exist Aug 09 17:16:10.873843 n-d-845781-6 devstack@n-api.service[119432]: Neutron server returns request_ids: ['req-0ab538e6-f524-4adb-84ea-37aafff025fa'] {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:10.893117 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c9d7731d-d963-46e5-87f8-b684765f6f49 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/9537d57a-1547-4914-ade0-fb4450affa88" status: 404 len: 194 microversion: 2.1 time: 0.099992 Aug 09 17:16:10.893117 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 972/2020] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:16:10 2022] DELETE /compute/v2.1/os-security-groups/9537d57a-1547-4914-ade0-fb4450affa88 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:10.894889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a355406e-4569-4e9a-b7bf-f9bf988e31f0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:10.895546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a355406e-4569-4e9a-b7bf-f9bf988e31f0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:10.913929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a355406e-4569-4e9a-b7bf-f9bf988e31f0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:10.916625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a355406e-4569-4e9a-b7bf-f9bf988e31f0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:10.917247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a355406e-4569-4e9a-b7bf-f9bf988e31f0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:10.918096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a355406e-4569-4e9a-b7bf-f9bf988e31f0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:10.918698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a355406e-4569-4e9a-b7bf-f9bf988e31f0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:10.919131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a355406e-4569-4e9a-b7bf-f9bf988e31f0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:10.949029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c381e9cd-afd2-4258-9482-f3af3d304392 req-6cd28f0f-d578-4d6f-962f-5ce46bcedae9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:10.955261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c381e9cd-afd2-4258-9482-f3af3d304392 req-6cd28f0f-d578-4d6f-962f-5ce46bcedae9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:10.956361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c381e9cd-afd2-4258-9482-f3af3d304392 req-6cd28f0f-d578-4d6f-962f-5ce46bcedae9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:11.008296 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c381e9cd-afd2-4258-9482-f3af3d304392 req-6cd28f0f-d578-4d6f-962f-5ce46bcedae9 service nova] Creating event network-changed:95761b7b-443e-410d-a0af-09df4d2a4cd2 for instance 974eba3e-f255-482b-86c3-c76e7f0d994f on n-h1-845781-6 Aug 09 17:16:11.013878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a355406e-4569-4e9a-b7bf-f9bf988e31f0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:16:11.019403 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c381e9cd-afd2-4258-9482-f3af3d304392 req-6cd28f0f-d578-4d6f-962f-5ce46bcedae9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183714 Aug 09 17:16:11.021584 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1049/2021] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:11.032294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c1df60b-4844-46e9-9951-39db4b4387e3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:11.034141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3c1df60b-4844-46e9-9951-39db4b4387e3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:11.064481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c1df60b-4844-46e9-9951-39db4b4387e3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:11.065868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c1df60b-4844-46e9-9951-39db4b4387e3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:11.067226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c1df60b-4844-46e9-9951-39db4b4387e3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:11.069293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c1df60b-4844-46e9-9951-39db4b4387e3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:11.071486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c1df60b-4844-46e9-9951-39db4b4387e3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:11.072936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c1df60b-4844-46e9-9951-39db4b4387e3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:11.218462 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a355406e-4569-4e9a-b7bf-f9bf988e31f0 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 204 len: 0 microversion: 2.1 time: 0.332605 Aug 09 17:16:11.219316 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 973/2022] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:16:10 2022] DELETE /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:16:11.242868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-46e4327d-2372-46d5-a0b3-86d575a40ee1 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:11.244962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-46e4327d-2372-46d5-a0b3-86d575a40ee1 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:11.263403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46e4327d-2372-46d5-a0b3-86d575a40ee1 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:11.264787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46e4327d-2372-46d5-a0b3-86d575a40ee1 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:11.265971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46e4327d-2372-46d5-a0b3-86d575a40ee1 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:11.269702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46e4327d-2372-46d5-a0b3-86d575a40ee1 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:11.271018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46e4327d-2372-46d5-a0b3-86d575a40ee1 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:11.272478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46e4327d-2372-46d5-a0b3-86d575a40ee1 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:11.751829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3c1df60b-4844-46e9-9951-39db4b4387e3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:11.798085 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3c1df60b-4844-46e9-9951-39db4b4387e3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1319 microversion: 2.1 time: 0.774165 Aug 09 17:16:11.812179 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1050/2023] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:11 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1319 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:11.836767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f4ef95d8-443e-4b35-810c-96608a9d094e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:11.839869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f4ef95d8-443e-4b35-810c-96608a9d094e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:11.851089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4ef95d8-443e-4b35-810c-96608a9d094e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:11.852869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4ef95d8-443e-4b35-810c-96608a9d094e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:11.853934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4ef95d8-443e-4b35-810c-96608a9d094e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:11.855611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4ef95d8-443e-4b35-810c-96608a9d094e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:11.856870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4ef95d8-443e-4b35-810c-96608a9d094e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:11.858045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4ef95d8-443e-4b35-810c-96608a9d094e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:11.904967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-46e4327d-2372-46d5-a0b3-86d575a40ee1 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:11.933334 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-46e4327d-2372-46d5-a0b3-86d575a40ee1 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1645 microversion: 2.1 time: 0.702983 Aug 09 17:16:11.935097 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 974/2024] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:11 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1645 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:12.479549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f4ef95d8-443e-4b35-810c-96608a9d094e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:12.511306 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f4ef95d8-443e-4b35-810c-96608a9d094e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1273 microversion: 2.1 time: 0.695600 Aug 09 17:16:12.513371 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1051/2025] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:11 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1273 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:12.841155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4d0051fb-d1d0-4981-bede-ad61db4690f3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:12.845525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4d0051fb-d1d0-4981-bede-ad61db4690f3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:12.872074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0051fb-d1d0-4981-bede-ad61db4690f3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:12.873386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0051fb-d1d0-4981-bede-ad61db4690f3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:12.874636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0051fb-d1d0-4981-bede-ad61db4690f3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:12.876143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0051fb-d1d0-4981-bede-ad61db4690f3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:12.879225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0051fb-d1d0-4981-bede-ad61db4690f3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:12.881733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0051fb-d1d0-4981-bede-ad61db4690f3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:12.970593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-325f2fa8-f194-4d2a-a644-428f6ea0c067 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:12.972697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-325f2fa8-f194-4d2a-a644-428f6ea0c067 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:13.003940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325f2fa8-f194-4d2a-a644-428f6ea0c067 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:13.005717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325f2fa8-f194-4d2a-a644-428f6ea0c067 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:13.006451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325f2fa8-f194-4d2a-a644-428f6ea0c067 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:13.008244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325f2fa8-f194-4d2a-a644-428f6ea0c067 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:13.009038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325f2fa8-f194-4d2a-a644-428f6ea0c067 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:13.009756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325f2fa8-f194-4d2a-a644-428f6ea0c067 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:13.639265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4d0051fb-d1d0-4981-bede-ad61db4690f3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:13.672041 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4d0051fb-d1d0-4981-bede-ad61db4690f3 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1319 microversion: 2.1 time: 0.825213 Aug 09 17:16:13.674165 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 975/2026] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:12 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1319 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:13.685692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3934899d-8419-4b8b-9a4c-f6af4c1a6bd6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:13.687927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3934899d-8419-4b8b-9a4c-f6af4c1a6bd6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:13.707976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:13.730564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3934899d-8419-4b8b-9a4c-f6af4c1a6bd6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:13.736523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3934899d-8419-4b8b-9a4c-f6af4c1a6bd6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:13.737521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3934899d-8419-4b8b-9a4c-f6af4c1a6bd6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:13.745338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3934899d-8419-4b8b-9a4c-f6af4c1a6bd6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:13.748073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3934899d-8419-4b8b-9a4c-f6af4c1a6bd6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:13.754891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3934899d-8419-4b8b-9a4c-f6af4c1a6bd6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:13.849589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3934899d-8419-4b8b-9a4c-f6af4c1a6bd6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:16:13.913775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-325f2fa8-f194-4d2a-a644-428f6ea0c067 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:13.939800 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-325f2fa8-f194-4d2a-a644-428f6ea0c067 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1645 microversion: 2.1 time: 0.976757 Aug 09 17:16:13.942180 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1052/2027] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:12 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1645 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:13.959571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-98be7844-c05f-46ae-b5cd-3063f32762be tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:13.961883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-98be7844-c05f-46ae-b5cd-3063f32762be tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:13.990037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98be7844-c05f-46ae-b5cd-3063f32762be tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:13.991839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98be7844-c05f-46ae-b5cd-3063f32762be tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:13.994489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98be7844-c05f-46ae-b5cd-3063f32762be tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:13.997920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98be7844-c05f-46ae-b5cd-3063f32762be tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:13.999161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98be7844-c05f-46ae-b5cd-3063f32762be tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:14.000850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98be7844-c05f-46ae-b5cd-3063f32762be tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:14.025710 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3934899d-8419-4b8b-9a4c-f6af4c1a6bd6 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 204 len: 0 microversion: 2.25 time: 0.348535 Aug 09 17:16:14.029438 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 976/2028] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:16:13 2022] DELETE /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:16:14.049014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:14.052831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:14.067562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:14.068413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:14.070824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:14.072991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:14.073735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:14.074366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:14.523538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-98be7844-c05f-46ae-b5cd-3063f32762be tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:14.541368 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-98be7844-c05f-46ae-b5cd-3063f32762be tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1315 microversion: 2.1 time: 0.595185 Aug 09 17:16:14.544065 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1053/2029] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:13 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:14.562821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7e0d9882-d745-4945-8c81-a708e004259c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:14.564007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7e0d9882-d745-4945-8c81-a708e004259c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:14.588216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e0d9882-d745-4945-8c81-a708e004259c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:14.594769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e0d9882-d745-4945-8c81-a708e004259c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:14.595596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e0d9882-d745-4945-8c81-a708e004259c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:14.596975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e0d9882-d745-4945-8c81-a708e004259c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:14.598435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e0d9882-d745-4945-8c81-a708e004259c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:14.599581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e0d9882-d745-4945-8c81-a708e004259c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:14.660665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7e0d9882-d745-4945-8c81-a708e004259c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:16:14.877347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:14.933872 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7e0d9882-d745-4945-8c81-a708e004259c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 204 len: 0 microversion: 2.1 time: 0.380971 Aug 09 17:16:14.949625 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1054/2030] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:16:14 2022] DELETE /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:16:14.981306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75ccbc76-870c-49b4-8853-d7733a66da09 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:14.982724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75ccbc76-870c-49b4-8853-d7733a66da09 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:15.025284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:15.041096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75ccbc76-870c-49b4-8853-d7733a66da09 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:15.041934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75ccbc76-870c-49b4-8853-d7733a66da09 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:15.049592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75ccbc76-870c-49b4-8853-d7733a66da09 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:15.052878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75ccbc76-870c-49b4-8853-d7733a66da09 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:15.054050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75ccbc76-870c-49b4-8853-d7733a66da09 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:15.056299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75ccbc76-870c-49b4-8853-d7733a66da09 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:15.059533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:15.079256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:15.086451 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2b21fb3e-ce1a-4e29-a9ab-60bb19814846 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1548 microversion: 2.25 time: 1.049261 Aug 09 17:16:15.105944 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 977/2031] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:14 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1548 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:15.161781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6247b01b-76cf-479d-94ea-8b852b2a1d7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:15.168610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6247b01b-76cf-479d-94ea-8b852b2a1d7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:15.227330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6247b01b-76cf-479d-94ea-8b852b2a1d7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:15.228299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6247b01b-76cf-479d-94ea-8b852b2a1d7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:15.229111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6247b01b-76cf-479d-94ea-8b852b2a1d7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:15.236196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6247b01b-76cf-479d-94ea-8b852b2a1d7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:15.241565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6247b01b-76cf-479d-94ea-8b852b2a1d7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:15.242556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6247b01b-76cf-479d-94ea-8b852b2a1d7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:15.669893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-75ccbc76-870c-49b4-8853-d7733a66da09 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:15.685003 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75ccbc76-870c-49b4-8853-d7733a66da09 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1319 microversion: 2.1 time: 0.729885 Aug 09 17:16:15.693756 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1055/2032] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:14 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1319 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:15.714207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-234cd34b-d1d0-4f15-9ea1-d2501fcd0952 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:15.714974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-234cd34b-d1d0-4f15-9ea1-d2501fcd0952 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:15.734029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234cd34b-d1d0-4f15-9ea1-d2501fcd0952 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:15.734593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234cd34b-d1d0-4f15-9ea1-d2501fcd0952 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:15.735379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234cd34b-d1d0-4f15-9ea1-d2501fcd0952 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:15.736871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234cd34b-d1d0-4f15-9ea1-d2501fcd0952 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:15.737692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234cd34b-d1d0-4f15-9ea1-d2501fcd0952 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:15.738463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234cd34b-d1d0-4f15-9ea1-d2501fcd0952 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:15.898135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6247b01b-76cf-479d-94ea-8b852b2a1d7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:15.922901 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6247b01b-76cf-479d-94ea-8b852b2a1d7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 200 len: 1514 microversion: 2.1 time: 0.814753 Aug 09 17:16:15.927843 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 978/2033] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:15 2022] GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 1514 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:15.938058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2ba39829-7677-470c-b293-ae3f173f0c05 req-07b2b6aa-9478-4602-9dd9-091113a63c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5", "name": "network-vif-deleted", "tag": "96686b6e-95b8-47d5-945e-72122d48ef23"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:15.971722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2ba39829-7677-470c-b293-ae3f173f0c05 req-07b2b6aa-9478-4602-9dd9-091113a63c64 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:15.973091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2ba39829-7677-470c-b293-ae3f173f0c05 req-07b2b6aa-9478-4602-9dd9-091113a63c64 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:15.977637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2ba39829-7677-470c-b293-ae3f173f0c05 req-07b2b6aa-9478-4602-9dd9-091113a63c64 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:16.025024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-234cd34b-d1d0-4f15-9ea1-d2501fcd0952 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fbccf8cda9b43fda5ec9ae0fc0be735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ff2acea44b4a108d6bd1083b255e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:16.041899 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-234cd34b-d1d0-4f15-9ea1-d2501fcd0952 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 200 len: 1467 microversion: 2.1 time: 0.342932 Aug 09 17:16:16.047294 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1056/2034] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:15 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 1467 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:16.067352 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2ba39829-7677-470c-b293-ae3f173f0c05 req-07b2b6aa-9478-4602-9dd9-091113a63c64 service nova] Creating event network-vif-deleted:96686b6e-95b8-47d5-945e-72122d48ef23 for instance dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 on n-h2-845781-6 Aug 09 17:16:16.091429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-73f06bcf-45a3-4eef-82b9-047c9661f66f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:16.096995 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-2ba39829-7677-470c-b293-ae3f173f0c05 req-07b2b6aa-9478-4602-9dd9-091113a63c64 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170692 Aug 09 17:16:16.097891 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 979/2035] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:16.098293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-73f06bcf-45a3-4eef-82b9-047c9661f66f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:16.151322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73f06bcf-45a3-4eef-82b9-047c9661f66f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:16.155017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:16.157796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73f06bcf-45a3-4eef-82b9-047c9661f66f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:16.158693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:16.163471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73f06bcf-45a3-4eef-82b9-047c9661f66f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:16.165626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73f06bcf-45a3-4eef-82b9-047c9661f66f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:16.171972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73f06bcf-45a3-4eef-82b9-047c9661f66f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:16.178679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73f06bcf-45a3-4eef-82b9-047c9661f66f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:16.205432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:16.221702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:16.222618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:16.232024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:16.238074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:16.239049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:16.711670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:16.743247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:16.774037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:16.777156 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-98f42df6-1719-411b-b4a7-2e6f6959e883 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 200 len: 1506 microversion: 2.25 time: 0.660173 Aug 09 17:16:16.779105 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 980/2036] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:16 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:16.803895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e9a9a99-9877-4ae8-ba1f-7356570c11a1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:16.805123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8e9a9a99-9877-4ae8-ba1f-7356570c11a1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:16.825207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e9a9a99-9877-4ae8-ba1f-7356570c11a1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:16.826808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e9a9a99-9877-4ae8-ba1f-7356570c11a1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:16.827920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e9a9a99-9877-4ae8-ba1f-7356570c11a1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:16.829495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e9a9a99-9877-4ae8-ba1f-7356570c11a1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:16.830623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e9a9a99-9877-4ae8-ba1f-7356570c11a1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:16.834492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e9a9a99-9877-4ae8-ba1f-7356570c11a1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:17.293976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:17.399612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=14 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:17.441555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-73f06bcf-45a3-4eef-82b9-047c9661f66f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:17.475504 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-73f06bcf-45a3-4eef-82b9-047c9661f66f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1315 microversion: 2.1 time: 1.425478 Aug 09 17:16:17.479984 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1057/2037] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:16 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1315 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:17.505947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1c4b41d9-1bef-4501-b9c4-0604e0825fc3 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:17.506938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1c4b41d9-1bef-4501-b9c4-0604e0825fc3 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:17.515544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4b41d9-1bef-4501-b9c4-0604e0825fc3 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:17.516637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4b41d9-1bef-4501-b9c4-0604e0825fc3 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:17.518446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4b41d9-1bef-4501-b9c4-0604e0825fc3 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:17.519704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4b41d9-1bef-4501-b9c4-0604e0825fc3 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:17.521364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4b41d9-1bef-4501-b9c4-0604e0825fc3 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:17.521987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c4b41d9-1bef-4501-b9c4-0604e0825fc3 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:17.629884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8e9a9a99-9877-4ae8-ba1f-7356570c11a1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:17.663072 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e9a9a99-9877-4ae8-ba1f-7356570c11a1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1319 microversion: 2.1 time: 0.870384 Aug 09 17:16:17.664505 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 981/2038] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:16 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1319 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:17.679148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-8741d573-b104-40a7-a5a5-59784a0cd5eb req-f862bf2c-5c93-4ca6-a8e5-dee064789d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c3e188-8990-4500-ab50-91d07d799686", "name": "network-vif-deleted", "tag": "09a3f3d2-7ab1-4737-95e8-c0be82cec011"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:17.709475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8741d573-b104-40a7-a5a5-59784a0cd5eb req-f862bf2c-5c93-4ca6-a8e5-dee064789d2f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:17.710162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8741d573-b104-40a7-a5a5-59784a0cd5eb req-f862bf2c-5c93-4ca6-a8e5-dee064789d2f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:17.710786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8741d573-b104-40a7-a5a5-59784a0cd5eb req-f862bf2c-5c93-4ca6-a8e5-dee064789d2f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:17.779802 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-8741d573-b104-40a7-a5a5-59784a0cd5eb req-f862bf2c-5c93-4ca6-a8e5-dee064789d2f service nova] Creating event network-vif-deleted:09a3f3d2-7ab1-4737-95e8-c0be82cec011 for instance e2c3e188-8990-4500-ab50-91d07d799686 on n-h2-845781-6 Aug 09 17:16:17.791893 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-8741d573-b104-40a7-a5a5-59784a0cd5eb req-f862bf2c-5c93-4ca6-a8e5-dee064789d2f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123895 Aug 09 17:16:17.793582 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 982/2039] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:17.803683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:17.804604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] [instance: dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:17.812811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:17.813315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:17.813819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:17.819536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:17.821269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:17.822575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:17.857717 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] HTTP exception thrown: Instance dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 could not be found. Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Request method failure captured: Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 HTTP/1.1 Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pXlkDrLZbWrqFnr0ANoRMQOeUa4Cm9AjO1kziJERFewU8Esgm3MTJ1LN1mKGtQfCZwdf9w6CccjscaSN7_zCpyP0TayQsME8jeRog6SQHhV---troRht8oz3IoSEhOuoGs9ULQnirQw6IB7j1EOsa5RL2OAMhoSWJvdG5otEsh5OIw Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8ff2acea44b4a108d6bd1083b255e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f8ff2acea44b4a108d6bd1083b255e72 Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1681036134 Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4fbccf8cda9b43fda5ec9ae0fc0be735 Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupsTestJSON-1681036134-project Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 could not be found. Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5'} Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 could not be found. Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 could not be found. Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:17.860895 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 could not be found. Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Returning 404 to user: Instance dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eaad6b56-b7f8-48d4-95b2-941944202810 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5" status: 404 len: 111 microversion: 2.1 time: 0.066900 Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 983/2040] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:17 2022] GET /compute/v2.1/servers/dd310e53-3a70-4afa-8f6a-1cfa7bc94aa5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:17.875419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: e2c3e188-8990-4500-ab50-91d07d799686] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:17.884213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:17.885175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:17.885884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:17.888110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:17.888384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:17.889198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:17.921642 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] HTTP exception thrown: Instance e2c3e188-8990-4500-ab50-91d07d799686 could not be found. Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Request method failure captured: Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 HTTP/1.1 Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pP3wFuvmZ0bsdK9sIpnm7Ni_hUvZzwNrWwR2IIVmgfER-V8KL4xGoe9CLKL0FKr_BF11gKVIWanRtzypFIK2Or67fPmxb_31yG_yybIzD_mkoaOhqVu5jk4_n3KEU3j94KK4lU_fWQGMrwob3FU_vRzae3cG3JRu1BjJTxe3kfE78U Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.25 Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 47793440cab647cc943281e2bc566c7f Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_47793440cab647cc943281e2bc566c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47793440cab647cc943281e2bc566c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47793440cab647cc943281e2bc566c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/47793440cab647cc943281e2bc566c7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 47793440cab647cc943281e2bc566c7f Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-LiveAutoBlockMigrationV225Test-1470783713-project Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 27626b9d13c340cc9ec2fe564d1bab8d Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713-project Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance e2c3e188-8990-4500-ab50-91d07d799686 could not be found. Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'e2c3e188-8990-4500-ab50-91d07d799686'} Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2c3e188-8990-4500-ab50-91d07d799686 could not be found. Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2c3e188-8990-4500-ab50-91d07d799686 could not be found. Aug 09 17:16:17.925807 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:17.930334 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:17.930334 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:17.930334 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:17.930334 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:17.930334 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:17.930334 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:17.930334 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:17.930334 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2c3e188-8990-4500-ab50-91d07d799686 could not be found. Aug 09 17:16:17.930334 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:17.932503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Returning 404 to user: Instance e2c3e188-8990-4500-ab50-91d07d799686 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:17.933705 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2c67ab24-76c8-4df1-b5e3-81dc14316069 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686" status: 404 len: 111 microversion: 2.25 time: 0.069233 Aug 09 17:16:17.934715 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 984/2041] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:17 2022] GET /compute/v2.1/servers/e2c3e188-8990-4500-ab50-91d07d799686 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:16:17.941940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d378d616-9cae-4546-8e73-e559179c7873 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbdc9c0f70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:18.441473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1c4b41d9-1bef-4501-b9c4-0604e0825fc3 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:18.459278 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1c4b41d9-1bef-4501-b9c4-0604e0825fc3 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 200 len: 1514 microversion: 2.1 time: 0.956782 Aug 09 17:16:18.462586 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1058/2042] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:17 2022] GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 1514 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:18.468040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-55bfd59d-d42c-47c9-bddd-92a6c752b5e7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:18.476973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-55bfd59d-d42c-47c9-bddd-92a6c752b5e7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:18.507137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55bfd59d-d42c-47c9-bddd-92a6c752b5e7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:18.511787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55bfd59d-d42c-47c9-bddd-92a6c752b5e7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:18.512481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55bfd59d-d42c-47c9-bddd-92a6c752b5e7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:18.513619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55bfd59d-d42c-47c9-bddd-92a6c752b5e7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:18.515261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55bfd59d-d42c-47c9-bddd-92a6c752b5e7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:18.516561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55bfd59d-d42c-47c9-bddd-92a6c752b5e7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:18.609875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-55bfd59d-d42c-47c9-bddd-92a6c752b5e7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:16:18.717896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:18.940408 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-55bfd59d-d42c-47c9-bddd-92a6c752b5e7 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 204 len: 0 microversion: 2.25 time: 0.475041 Aug 09 17:16:18.941524 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1059/2043] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:16:18 2022] DELETE /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:16:18.955449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0ae8bfca-ea08-4887-9161-e82ad12b0cf4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:18.958353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0ae8bfca-ea08-4887-9161-e82ad12b0cf4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:18.970615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ae8bfca-ea08-4887-9161-e82ad12b0cf4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:18.973285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ae8bfca-ea08-4887-9161-e82ad12b0cf4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:18.975657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ae8bfca-ea08-4887-9161-e82ad12b0cf4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:18.980826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ae8bfca-ea08-4887-9161-e82ad12b0cf4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:18.983112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ae8bfca-ea08-4887-9161-e82ad12b0cf4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:18.983918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ae8bfca-ea08-4887-9161-e82ad12b0cf4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:19.657421 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d378d616-9cae-4546-8e73-e559179c7873 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/5f8b9dce-6269-4be8-9ca7-4890f17332e9" status: 202 len: 0 microversion: 2.1 time: 1.721245 Aug 09 17:16:19.658234 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 985/2044] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:16:17 2022] DELETE /compute/v2.1/os-security-groups/5f8b9dce-6269-4be8-9ca7-4890f17332e9 => generated 0 bytes in 1723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:16:19.670350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-28f73823-d991-4d65-89d3-575e1e6edead tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:19.674057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-28f73823-d991-4d65-89d3-575e1e6edead tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:19.709243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28f73823-d991-4d65-89d3-575e1e6edead tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:19.710333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28f73823-d991-4d65-89d3-575e1e6edead tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:19.711065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28f73823-d991-4d65-89d3-575e1e6edead tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:19.712295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28f73823-d991-4d65-89d3-575e1e6edead tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:19.713075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28f73823-d991-4d65-89d3-575e1e6edead tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:19.713753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28f73823-d991-4d65-89d3-575e1e6edead tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:19.777768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0ae8bfca-ea08-4887-9161-e82ad12b0cf4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:19.841940 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0ae8bfca-ea08-4887-9161-e82ad12b0cf4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1315 microversion: 2.1 time: 0.892613 Aug 09 17:16:19.843793 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1060/2045] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:18 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:19.877761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:19.877761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:19.895275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:19.898925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:19.899438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:19.903134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:19.903895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:19.904503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:20.159803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-28f73823-d991-4d65-89d3-575e1e6edead tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:20.169615 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-28f73823-d991-4d65-89d3-575e1e6edead tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1319 microversion: 2.1 time: 0.509642 Aug 09 17:16:20.185089 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 986/2046] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:19 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:20.191610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-b349e3d2-9e1f-4011-b316-7bbfa8cd6c26 req-92061f23-fdfb-41f7-8219-c3f4421237ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6024eb-923e-4e73-9361-1f54a16a9760", "name": "network-vif-deleted", "tag": "3cf8b2af-ab05-4485-b574-a07824bc13cd"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:20.203856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b349e3d2-9e1f-4011-b316-7bbfa8cd6c26 req-92061f23-fdfb-41f7-8219-c3f4421237ce service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:20.205346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b349e3d2-9e1f-4011-b316-7bbfa8cd6c26 req-92061f23-fdfb-41f7-8219-c3f4421237ce service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:20.206194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b349e3d2-9e1f-4011-b316-7bbfa8cd6c26 req-92061f23-fdfb-41f7-8219-c3f4421237ce service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:20.221738 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-b349e3d2-9e1f-4011-b316-7bbfa8cd6c26 req-92061f23-fdfb-41f7-8219-c3f4421237ce service nova] Creating event network-vif-deleted:3cf8b2af-ab05-4485-b574-a07824bc13cd for instance 6f6024eb-923e-4e73-9361-1f54a16a9760 on n-h2-845781-6 Aug 09 17:16:20.229890 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-b349e3d2-9e1f-4011-b316-7bbfa8cd6c26 req-92061f23-fdfb-41f7-8219-c3f4421237ce service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042269 Aug 09 17:16:20.231447 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 987/2047] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:20.240600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:20.241605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 6f6024eb-923e-4e73-9361-1f54a16a9760] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:20.251804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:20.252602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:20.253313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:20.254263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:20.254989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:20.256584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:20.278726 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] HTTP exception thrown: Instance 6f6024eb-923e-4e73-9361-1f54a16a9760 could not be found. Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Request method failure captured: Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 HTTP/1.1 Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pWfyDr2COG-hq5b1ejBayqYfBMD4xhuXibC_VyRZ9vZJ5Olk-OkwiB1s04cU1mN1q81oGoMmJceSJHs4dfI3hvUhtwX0npcDBAg7sJlmYP9a8iydl8AV1-rHkgp2dqCYgtTw6jhSVZU6vpY7NFVbDs8DaSAj5Udd4dKtL7CoxI6Grw Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5458faa4b45e4eab8ec22d1d4a13f6c0 Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesAdminNegativeTest-1209285146 Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5458faa4b45e4eab8ec22d1d4a13f6c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5458faa4b45e4eab8ec22d1d4a13f6c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5458faa4b45e4eab8ec22d1d4a13f6c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5458faa4b45e4eab8ec22d1d4a13f6c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesAdminNegativeTest-1209285146 Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5458faa4b45e4eab8ec22d1d4a13f6c0 Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1209285146 Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesAdminNegativeTest-1209285146-project Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: db2a6f289c7e4b1abea4713412897236 Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesAdminNegativeTest-1209285146-project Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 6f6024eb-923e-4e73-9361-1f54a16a9760 could not be found. Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '6f6024eb-923e-4e73-9361-1f54a16a9760'} Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f6024eb-923e-4e73-9361-1f54a16a9760 could not be found. Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6024eb-923e-4e73-9361-1f54a16a9760 could not be found. Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:20.280749 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:20.295141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:20.295141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:20.295141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:20.295141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:20.295141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:20.295141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6024eb-923e-4e73-9361-1f54a16a9760 could not be found. Aug 09 17:16:20.295141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:20.295141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Returning 404 to user: Instance 6f6024eb-923e-4e73-9361-1f54a16a9760 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:20.295141 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4bcbc2df-8e4f-4efa-a6c6-a7cd8f8e136c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760" status: 404 len: 111 microversion: 2.1 time: 0.049344 Aug 09 17:16:20.295141 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 988/2048] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:20 2022] GET /compute/v2.1/servers/6f6024eb-923e-4e73-9361-1f54a16a9760 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:20.348284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f37131c3-d0b6-4f69-b04b-42ff43608a84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] Calling method '.version_select at 0x7fbbdca30f70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:20.418865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:20.441347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:20.444495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:20.449723 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-80dddde9-348d-4a16-8125-f1de79b15dda tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1563 microversion: 2.25 time: 0.604361 Aug 09 17:16:20.456305 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1061/2049] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:19 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1563 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:20.472359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6f233202-e927-4a9e-91f5-89dc6bd87626 req-d5286591-9b3b-4671-bd48-ffa9d44df653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fae1e73e-68f8-4664-81ae-b49d4de1ca63", "tag": "d5c5f582-77e1-4b17-8b94-6acbf6392e7c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:20.496337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6f233202-e927-4a9e-91f5-89dc6bd87626 req-d5286591-9b3b-4671-bd48-ffa9d44df653 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:20.509688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6f233202-e927-4a9e-91f5-89dc6bd87626 req-d5286591-9b3b-4671-bd48-ffa9d44df653 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:20.514500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6f233202-e927-4a9e-91f5-89dc6bd87626 req-d5286591-9b3b-4671-bd48-ffa9d44df653 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:20.553349 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6f233202-e927-4a9e-91f5-89dc6bd87626 req-d5286591-9b3b-4671-bd48-ffa9d44df653 service nova] Creating event network-changed:d5c5f582-77e1-4b17-8b94-6acbf6392e7c for instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 on n-h1-845781-6 Aug 09 17:16:20.562776 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6f233202-e927-4a9e-91f5-89dc6bd87626 req-d5286591-9b3b-4671-bd48-ffa9d44df653 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104808 Aug 09 17:16:20.563702 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1062/2050] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:20.571275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-33f5eec3-204f-42ad-a7ac-17139a54cdbf req-3022cfad-31a8-4f05-a440-d5afcf2f8c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974eba3e-f255-482b-86c3-c76e7f0d994f", "name": "network-vif-plugged", "status": "completed", "tag": "95761b7b-443e-410d-a0af-09df4d2a4cd2"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:20.594250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-33f5eec3-204f-42ad-a7ac-17139a54cdbf req-3022cfad-31a8-4f05-a440-d5afcf2f8c3d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:20.595528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-33f5eec3-204f-42ad-a7ac-17139a54cdbf req-3022cfad-31a8-4f05-a440-d5afcf2f8c3d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:20.596696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-33f5eec3-204f-42ad-a7ac-17139a54cdbf req-3022cfad-31a8-4f05-a440-d5afcf2f8c3d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:20.623160 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-33f5eec3-204f-42ad-a7ac-17139a54cdbf req-3022cfad-31a8-4f05-a440-d5afcf2f8c3d service nova] Creating event network-vif-plugged:95761b7b-443e-410d-a0af-09df4d2a4cd2 for instance 974eba3e-f255-482b-86c3-c76e7f0d994f on n-h1-845781-6 Aug 09 17:16:20.630388 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-33f5eec3-204f-42ad-a7ac-17139a54cdbf req-3022cfad-31a8-4f05-a440-d5afcf2f8c3d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064563 Aug 09 17:16:20.631919 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1063/2051] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:20.872449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a694af3c-a719-462d-8853-0b7caa11f2b9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:20.875076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a694af3c-a719-462d-8853-0b7caa11f2b9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:20.890519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a694af3c-a719-462d-8853-0b7caa11f2b9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:20.892148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a694af3c-a719-462d-8853-0b7caa11f2b9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:20.893179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a694af3c-a719-462d-8853-0b7caa11f2b9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:20.894771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a694af3c-a719-462d-8853-0b7caa11f2b9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:20.896548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a694af3c-a719-462d-8853-0b7caa11f2b9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:20.899401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a694af3c-a719-462d-8853-0b7caa11f2b9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:21.405708 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f37131c3-d0b6-4f69-b04b-42ff43608a84 tempest-SecurityGroupsTestJSON-1681036134 tempest-SecurityGroupsTestJSON-1681036134-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/2289a7af-41f4-45ce-991f-e3ca1c8e2a2f" status: 202 len: 0 microversion: 2.1 time: 1.100238 Aug 09 17:16:21.408582 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 989/2052] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:16:20 2022] DELETE /compute/v2.1/os-security-groups/2289a7af-41f4-45ce-991f-e3ca1c8e2a2f => generated 0 bytes in 1123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:16:21.416452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4c5ba9a6-6f88-446d-a241-62570e2cd0cf tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:21.417435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4c5ba9a6-6f88-446d-a241-62570e2cd0cf tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:21.429565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c5ba9a6-6f88-446d-a241-62570e2cd0cf tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:21.431458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c5ba9a6-6f88-446d-a241-62570e2cd0cf tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:21.432952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c5ba9a6-6f88-446d-a241-62570e2cd0cf tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:21.434677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c5ba9a6-6f88-446d-a241-62570e2cd0cf tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:21.435918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c5ba9a6-6f88-446d-a241-62570e2cd0cf tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:21.436569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c5ba9a6-6f88-446d-a241-62570e2cd0cf tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:21.983657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a694af3c-a719-462d-8853-0b7caa11f2b9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:21.997118 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a694af3c-a719-462d-8853-0b7caa11f2b9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1315 microversion: 2.1 time: 1.134417 Aug 09 17:16:22.011674 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1064/2053] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:20 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1315 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:22.610325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4c5ba9a6-6f88-446d-a241-62570e2cd0cf tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:22.626741 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4c5ba9a6-6f88-446d-a241-62570e2cd0cf tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1319 microversion: 2.1 time: 1.216433 Aug 09 17:16:22.628579 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 990/2054] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:21 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1319 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:22.637411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e2f71334-e2f2-4793-b94b-78f58fc08786 req-9277a99a-34c8-4650-ae54-c0afcaeec2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddc1848-1711-406c-947a-94149934b5d3", "name": "network-vif-deleted", "tag": "9f96bc34-0e5a-4ffb-909f-2a367ebfcc17"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:22.661235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e2f71334-e2f2-4793-b94b-78f58fc08786 req-9277a99a-34c8-4650-ae54-c0afcaeec2f5 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:22.662208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e2f71334-e2f2-4793-b94b-78f58fc08786 req-9277a99a-34c8-4650-ae54-c0afcaeec2f5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:22.663292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e2f71334-e2f2-4793-b94b-78f58fc08786 req-9277a99a-34c8-4650-ae54-c0afcaeec2f5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:22.671703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:22.690027 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e2f71334-e2f2-4793-b94b-78f58fc08786 req-9277a99a-34c8-4650-ae54-c0afcaeec2f5 service nova] Creating event network-vif-deleted:9f96bc34-0e5a-4ffb-909f-2a367ebfcc17 for instance 1ddc1848-1711-406c-947a-94149934b5d3 on n-h1-845781-6 Aug 09 17:16:22.701497 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e2f71334-e2f2-4793-b94b-78f58fc08786 req-9277a99a-34c8-4650-ae54-c0afcaeec2f5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071277 Aug 09 17:16:22.709815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:22.710987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:22.712230 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 991/2055] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:22.739716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:22.740917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:22.741687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:22.743043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:22.743922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:22.744791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:22.807865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:22.808440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:22.809529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:22.810392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lazy-loading 'fault' on Instance uuid 1ddc1848-1711-406c-947a-94149934b5d3 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:16:22.962155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:22.998744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:23.010273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '27626b9d13c340cc9ec2fe564d1bab8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47793440cab647cc943281e2bc566c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:23.016556 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c959271-6c3b-4fcb-835d-310b92f12453 tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 200 len: 1351 microversion: 2.25 time: 1.009566 Aug 09 17:16:23.034797 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1065/2056] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:22 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 1351 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:23.056577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3d1757ee-b14d-4c88-8e86-e10e35fe9225 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:23.058946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3d1757ee-b14d-4c88-8e86-e10e35fe9225 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:23.098822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1757ee-b14d-4c88-8e86-e10e35fe9225 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:23.100580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1757ee-b14d-4c88-8e86-e10e35fe9225 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:23.101093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1757ee-b14d-4c88-8e86-e10e35fe9225 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:23.102139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1757ee-b14d-4c88-8e86-e10e35fe9225 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:23.102927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1757ee-b14d-4c88-8e86-e10e35fe9225 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:23.103745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1757ee-b14d-4c88-8e86-e10e35fe9225 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:23.672277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4ae0f55-6d9d-4914-b740-94a8efc6236c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:23.676049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d4ae0f55-6d9d-4914-b740-94a8efc6236c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:23.726440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ae0f55-6d9d-4914-b740-94a8efc6236c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:23.727319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ae0f55-6d9d-4914-b740-94a8efc6236c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:23.728146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ae0f55-6d9d-4914-b740-94a8efc6236c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:23.744374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ae0f55-6d9d-4914-b740-94a8efc6236c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:23.745204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ae0f55-6d9d-4914-b740-94a8efc6236c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:23.778909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ae0f55-6d9d-4914-b740-94a8efc6236c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:24.380247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d4ae0f55-6d9d-4914-b740-94a8efc6236c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:24.406922 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d4ae0f55-6d9d-4914-b740-94a8efc6236c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1468 microversion: 2.1 time: 0.743037 Aug 09 17:16:24.412479 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1066/2057] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:23 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1468 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:24.459335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:24.463761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] [instance: 1ddc1848-1711-406c-947a-94149934b5d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:24.488489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:24.490009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:24.491182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:24.492880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:24.493698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:24.494468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:24.528550 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] HTTP exception thrown: Instance 1ddc1848-1711-406c-947a-94149934b5d3 could not be found. Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Request method failure captured: Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 HTTP/1.1 Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pP3wFuvmZ0bsdK9sIpnm7Ni_hUvZzwNrWwR2IIVmgfER-V8KL4xGoe9CLKL0FKr_BF11gKVIWanRtzypFIK2Or67fPmxb_31yG_yybIzD_mkoaOhqVu5jk4_n3KEU3j94KK4lU_fWQGMrwob3FU_vRzae3cG3JRu1BjJTxe3kfE78U Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.25 Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 47793440cab647cc943281e2bc566c7f Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_47793440cab647cc943281e2bc566c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47793440cab647cc943281e2bc566c7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47793440cab647cc943281e2bc566c7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/47793440cab647cc943281e2bc566c7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 47793440cab647cc943281e2bc566c7f Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713 Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-LiveAutoBlockMigrationV225Test-1470783713-project Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 27626b9d13c340cc9ec2fe564d1bab8d Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1470783713-project Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 1ddc1848-1711-406c-947a-94149934b5d3 could not be found. Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1ddc1848-1711-406c-947a-94149934b5d3'} Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddc1848-1711-406c-947a-94149934b5d3 could not be found. Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddc1848-1711-406c-947a-94149934b5d3 could not be found. Aug 09 17:16:24.533489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:24.541586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:24.541586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:24.541586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:24.541586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:24.541586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:24.541586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:24.541586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:24.541586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddc1848-1711-406c-947a-94149934b5d3 could not be found. Aug 09 17:16:24.541586 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:24.541586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] Returning 404 to user: Instance 1ddc1848-1711-406c-947a-94149934b5d3 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:24.541586 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-224bc7eb-d373-4d11-b036-3b7a01f84bdf tempest-LiveAutoBlockMigrationV225Test-1470783713 tempest-LiveAutoBlockMigrationV225Test-1470783713-project] 10.222.0.93 "GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3" status: 404 len: 111 microversion: 2.25 time: 0.100673 Aug 09 17:16:24.548173 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1067/2058] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:24 2022] GET /compute/v2.1/servers/1ddc1848-1711-406c-947a-94149934b5d3 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:16:24.601017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d1757ee-b14d-4c88-8e86-e10e35fe9225 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:24.627610 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3d1757ee-b14d-4c88-8e86-e10e35fe9225 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1315 microversion: 2.1 time: 1.588162 Aug 09 17:16:24.629091 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 992/2059] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:23 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1315 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:25.089216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-984912279", "block_migration": true, "disk_over_commit": false}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:25.092072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:25.118980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:25.121011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:25.122688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:25.123684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:25.128566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:25.131437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:25.226859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lazy-loading 'flavor' on Instance uuid 974eba3e-f255-482b-86c3-c76e7f0d994f {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:16:25.271395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Going to try to live migrate instance to tempest-host-984912279 {{(pid=119431) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 17:16:25.295287 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] HTTP exception thrown: Compute host tempest-host-984912279 could not be found. Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Request method failure captured: Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f/action HTTP/1.1 Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 106 Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pZP8Mkvq6dgHaj7xaKLpGJ7rHbQeDzQzJJGUshjYr5CqTZw42FkGyAVXq4E0c_InFkzIxmxzBskiXYkoVWo2JQk4F3Kf15Xbb_nqqShncDOh0AaFcNNz8zNmdbGV-vU2Ft8Dv3d3YyCzWqHGaQrH9S9gmH-XnJdJmaOrfXN4tvX8U0 Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: dadc5029f7a84bcfacf08e1800c40e07 Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-LiveMigrationNegativeTest-1623423924 Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_dadc5029f7a84bcfacf08e1800c40e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/dadc5029f7a84bcfacf08e1800c40e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/dadc5029f7a84bcfacf08e1800c40e07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/dadc5029f7a84bcfacf08e1800c40e07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-LiveMigrationNegativeTest-1623423924 Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: dadc5029f7a84bcfacf08e1800c40e07 Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1623423924 Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-LiveMigrationNegativeTest-1623423924-project-admin Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 47c60f9c17c3419ea66cfa46c831822d Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-LiveMigrationNegativeTest-1623423924-project-admin Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: {"os-migrateLive": {"host": "tempest-host-984912279", "block_migration": true, "disk_over_commit": false}} Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: exception: Compute host tempest-host-984912279 could not be found. Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '974eba3e-f255-482b-86c3-c76e7f0d994f', 'body': {'os-migrateLive': {'host': 'tempest-host-984912279', 'block_migration': True, 'disk_over_commit': False}}} Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5449, in live_migrate Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 09 17:16:25.318204 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-984912279 could not be found. Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-984912279 could not be found. Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-984912279 could not be found. Aug 09 17:16:25.321664 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:16:25.327484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Returning 400 to user: Compute host tempest-host-984912279 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:25.331474 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7b30bec-911d-4a33-90b1-d409b54d2b5d tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f/action" status: 400 len: 99 microversion: 2.1 time: 0.784171 Aug 09 17:16:25.332580 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1068/2060] 10.222.0.93 () {60 vars in 1279 bytes} [Tue Aug 9 17:16:24 2022] POST /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f/action => generated 99 bytes in 787 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:16:25.343292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-326b71b8-76da-4535-bcd2-3c303846db77 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:25.344437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-326b71b8-76da-4535-bcd2-3c303846db77 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:25.353941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326b71b8-76da-4535-bcd2-3c303846db77 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:25.354840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326b71b8-76da-4535-bcd2-3c303846db77 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:25.355677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326b71b8-76da-4535-bcd2-3c303846db77 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:25.356642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326b71b8-76da-4535-bcd2-3c303846db77 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:25.357403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326b71b8-76da-4535-bcd2-3c303846db77 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:25.358052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326b71b8-76da-4535-bcd2-3c303846db77 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:25.632720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-326b71b8-76da-4535-bcd2-3c303846db77 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:25.647234 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-326b71b8-76da-4535-bcd2-3c303846db77 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1468 microversion: 2.1 time: 0.307862 Aug 09 17:16:25.650161 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 993/2061] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:25 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1468 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:25.675993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-139d8170-5f20-4fe5-93ed-b97aa801e329 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:25.676615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-139d8170-5f20-4fe5-93ed-b97aa801e329 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:25.709925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139d8170-5f20-4fe5-93ed-b97aa801e329 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:25.710428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139d8170-5f20-4fe5-93ed-b97aa801e329 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:25.710966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139d8170-5f20-4fe5-93ed-b97aa801e329 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:25.711713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139d8170-5f20-4fe5-93ed-b97aa801e329 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:25.712072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139d8170-5f20-4fe5-93ed-b97aa801e329 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:25.712508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-139d8170-5f20-4fe5-93ed-b97aa801e329 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:25.968923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1979594498", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:26.108163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:16:26.414374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-139d8170-5f20-4fe5-93ed-b97aa801e329 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:26.438944 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-139d8170-5f20-4fe5-93ed-b97aa801e329 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1315 microversion: 2.1 time: 0.775541 Aug 09 17:16:26.441656 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1069/2062] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:25 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:27.148450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-01bbc066-4eb8-4ec7-8e8c-f0342916fed9 req-b391f67e-c958-4c43-955c-59d6b8f52fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae1e73e-68f8-4664-81ae-b49d4de1ca63", "name": "network-vif-plugged", "status": "completed", "tag": "d5c5f582-77e1-4b17-8b94-6acbf6392e7c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:27.205172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-01bbc066-4eb8-4ec7-8e8c-f0342916fed9 req-b391f67e-c958-4c43-955c-59d6b8f52fd2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:27.206091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-01bbc066-4eb8-4ec7-8e8c-f0342916fed9 req-b391f67e-c958-4c43-955c-59d6b8f52fd2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:27.206887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-01bbc066-4eb8-4ec7-8e8c-f0342916fed9 req-b391f67e-c958-4c43-955c-59d6b8f52fd2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:27.255732 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-01bbc066-4eb8-4ec7-8e8c-f0342916fed9 req-b391f67e-c958-4c43-955c-59d6b8f52fd2 service nova] Creating event network-vif-plugged:d5c5f582-77e1-4b17-8b94-6acbf6392e7c for instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 on n-h1-845781-6 Aug 09 17:16:27.279685 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-01bbc066-4eb8-4ec7-8e8c-f0342916fed9 req-b391f67e-c958-4c43-955c-59d6b8f52fd2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141513 Aug 09 17:16:27.299071 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1070/2063] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:27.451659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c90c13e3-e91f-46f5-b712-4986d6b6eecc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:27.456736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c90c13e3-e91f-46f5-b712-4986d6b6eecc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:27.478586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c13e3-e91f-46f5-b712-4986d6b6eecc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:27.480707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c13e3-e91f-46f5-b712-4986d6b6eecc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:27.483218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c13e3-e91f-46f5-b712-4986d6b6eecc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:27.485060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c13e3-e91f-46f5-b712-4986d6b6eecc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:27.486216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c13e3-e91f-46f5-b712-4986d6b6eecc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:27.487375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c13e3-e91f-46f5-b712-4986d6b6eecc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:27.566015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c90c13e3-e91f-46f5-b712-4986d6b6eecc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:16:27.749750 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c90c13e3-e91f-46f5-b712-4986d6b6eecc tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 204 len: 0 microversion: 2.1 time: 0.308901 Aug 09 17:16:27.753069 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1071/2064] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:16:27 2022] DELETE /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:16:27.782517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-802c3874-21d8-45f1-a5cf-c6402518cd31 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:27.784014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-802c3874-21d8-45f1-a5cf-c6402518cd31 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:27.792799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802c3874-21d8-45f1-a5cf-c6402518cd31 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:27.794352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802c3874-21d8-45f1-a5cf-c6402518cd31 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:27.795054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802c3874-21d8-45f1-a5cf-c6402518cd31 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:27.796065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802c3874-21d8-45f1-a5cf-c6402518cd31 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:27.796938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802c3874-21d8-45f1-a5cf-c6402518cd31 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:27.797594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802c3874-21d8-45f1-a5cf-c6402518cd31 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:28.046496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:16:28.047345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:16:28.048047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:16:28.048807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:16:28.049792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:16:28.100534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:28.101378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:28.102179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:28.103400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:28.104703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:28.110600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:28.151355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Getting quotas for project 6a92a0d7635044099c4c6a08a32d8cf5. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:28.163162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Getting quotas for user e89975c7af914cfb98b24f2b13253c83 and project 6a92a0d7635044099c4c6a08a32d8cf5. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:28.192582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:16:28.198162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:16:28.288928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-802c3874-21d8-45f1-a5cf-c6402518cd31 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:28.303470 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f2c45116-50d5-47bc-9d35-450f11c5c0c9 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.338088 Aug 09 17:16:28.318277 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 994/2065] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:16:28.325279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ca39d194-5899-486d-b7d2-455c2df1e25c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:28.326381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ca39d194-5899-486d-b7d2-455c2df1e25c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:28.329069 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-802c3874-21d8-45f1-a5cf-c6402518cd31 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1315 microversion: 2.1 time: 0.559630 Aug 09 17:16:28.330996 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1072/2066] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:27 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:28.356958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca39d194-5899-486d-b7d2-455c2df1e25c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:28.358510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca39d194-5899-486d-b7d2-455c2df1e25c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:28.359770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca39d194-5899-486d-b7d2-455c2df1e25c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:28.361416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca39d194-5899-486d-b7d2-455c2df1e25c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:28.362661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca39d194-5899-486d-b7d2-455c2df1e25c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:28.364896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca39d194-5899-486d-b7d2-455c2df1e25c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:29.029337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-faef2285-0fcc-4d05-afb6-856b04976f21 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:29.032859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-faef2285-0fcc-4d05-afb6-856b04976f21 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:29.065320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ca39d194-5899-486d-b7d2-455c2df1e25c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:29.076822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faef2285-0fcc-4d05-afb6-856b04976f21 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:29.078006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faef2285-0fcc-4d05-afb6-856b04976f21 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:29.078699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faef2285-0fcc-4d05-afb6-856b04976f21 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:29.080221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faef2285-0fcc-4d05-afb6-856b04976f21 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:29.080968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faef2285-0fcc-4d05-afb6-856b04976f21 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:29.081764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faef2285-0fcc-4d05-afb6-856b04976f21 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:29.115839 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ca39d194-5899-486d-b7d2-455c2df1e25c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1683 microversion: 2.1 time: 0.795221 Aug 09 17:16:29.117829 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 995/2067] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:28 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1683 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:29.152040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1f0725aa-36e4-48cf-8878-e0b8a91365e1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:29.153078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1f0725aa-36e4-48cf-8878-e0b8a91365e1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:29.291856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-faef2285-0fcc-4d05-afb6-856b04976f21 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:16:29.433372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1f0725aa-36e4-48cf-8878-e0b8a91365e1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:29.481515 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1f0725aa-36e4-48cf-8878-e0b8a91365e1 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1219 microversion: 2.1 time: 0.361824 Aug 09 17:16:29.504148 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 996/2068] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:29 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1219 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:29.531912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-147d39ec-ab35-4260-95c9-4cb6f39a248e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:29.538577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-147d39ec-ab35-4260-95c9-4cb6f39a248e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:29.582320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147d39ec-ab35-4260-95c9-4cb6f39a248e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:29.587062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147d39ec-ab35-4260-95c9-4cb6f39a248e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:29.590789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147d39ec-ab35-4260-95c9-4cb6f39a248e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:29.601124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147d39ec-ab35-4260-95c9-4cb6f39a248e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:29.602557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147d39ec-ab35-4260-95c9-4cb6f39a248e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:29.603929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147d39ec-ab35-4260-95c9-4cb6f39a248e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:29.841699 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-faef2285-0fcc-4d05-afb6-856b04976f21 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 204 len: 0 microversion: 2.42 time: 1.508038 Aug 09 17:16:29.859965 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1073/2069] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:16:28 2022] DELETE /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 0 bytes in 1523 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:16:29.904409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:29.913072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:29.979194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:29.986804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:29.990853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:29.995583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:29.996256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:30.001524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:30.136340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:30.935567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:30.937128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-147d39ec-ab35-4260-95c9-4cb6f39a248e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:30.964132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:30.971420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:30.975012 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fedff4b2-0144-4f8b-97d4-8ccd28653042 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2962 microversion: 2.42 time: 1.112737 Aug 09 17:16:30.976133 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-147d39ec-ab35-4260-95c9-4cb6f39a248e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1315 microversion: 2.1 time: 1.469825 Aug 09 17:16:30.987671 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 997/2070] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:29 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1315 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:30.990366 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1074/2071] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:29 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2962 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:31.011352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-011646be-be42-4541-a644-7370dde65280 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Calling method '.version_select at 0x7fbbdca0a790>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:31.034060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cf5d28f2-1f31-4c82-a820-f874dd93fff1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:31.035902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cf5d28f2-1f31-4c82-a820-f874dd93fff1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:31.058974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf5d28f2-1f31-4c82-a820-f874dd93fff1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:31.059862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf5d28f2-1f31-4c82-a820-f874dd93fff1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:31.060645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf5d28f2-1f31-4c82-a820-f874dd93fff1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:31.061886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf5d28f2-1f31-4c82-a820-f874dd93fff1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:31.062646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf5d28f2-1f31-4c82-a820-f874dd93fff1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:31.063382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf5d28f2-1f31-4c82-a820-f874dd93fff1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:31.131055 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-011646be-be42-4541-a644-7370dde65280 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13" status: 200 len: 636 microversion: 2.1 time: 0.144477 Aug 09 17:16:31.134335 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 998/2072] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:16:30 2022] GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13 => generated 636 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:31.148935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-102c46a2-8212-4878-a879-689c163c943b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:31.152194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-102c46a2-8212-4878-a879-689c163c943b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:31.175615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-102c46a2-8212-4878-a879-689c163c943b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:31.188486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-102c46a2-8212-4878-a879-689c163c943b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:31.189705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-102c46a2-8212-4878-a879-689c163c943b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:31.191073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-102c46a2-8212-4878-a879-689c163c943b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:31.192317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-102c46a2-8212-4878-a879-689c163c943b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:31.193163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-102c46a2-8212-4878-a879-689c163c943b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:31.421804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-102c46a2-8212-4878-a879-689c163c943b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:31.439604 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-102c46a2-8212-4878-a879-689c163c943b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1215 microversion: 2.1 time: 0.302466 Aug 09 17:16:31.464201 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 999/2073] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:31 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1215 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:31.477868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-914a6e7c-4cd8-4e54-8b30-7157fd02578b tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Action: 'update_all', calling method: .version_select at 0x7fbbcb6a0f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:31.610243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-914a6e7c-4cd8-4e54-8b30-7157fd02578b tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:31.626202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-914a6e7c-4cd8-4e54-8b30-7157fd02578b tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for user 030b7fae3ebb463cad91ec2787098380 and project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:31.631452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cf5d28f2-1f31-4c82-a820-f874dd93fff1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:31.650977 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cf5d28f2-1f31-4c82-a820-f874dd93fff1 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1683 microversion: 2.1 time: 0.637243 Aug 09 17:16:31.664586 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1075/2074] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:31 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1683 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:32.007502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e46c52f-4ede-4938-a61b-cb67ae2192e2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:32.008477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e46c52f-4ede-4938-a61b-cb67ae2192e2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:32.026731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e46c52f-4ede-4938-a61b-cb67ae2192e2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:32.027515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e46c52f-4ede-4938-a61b-cb67ae2192e2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:32.028146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e46c52f-4ede-4938-a61b-cb67ae2192e2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:32.029119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e46c52f-4ede-4938-a61b-cb67ae2192e2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:32.029774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e46c52f-4ede-4938-a61b-cb67ae2192e2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:32.033198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e46c52f-4ede-4938-a61b-cb67ae2192e2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:32.588804 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-914a6e7c-4cd8-4e54-8b30-7157fd02578b tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 61 microversion: 2.1 time: 1.122561 Aug 09 17:16:32.590666 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1000/2075] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:16:31 2022] PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 61 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:32.597198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:32.598289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:32.610565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:32.611450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:32.612130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:32.613047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:32.613683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:32.614278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:32.949211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4e46c52f-4ede-4938-a61b-cb67ae2192e2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:32.967410 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e46c52f-4ede-4938-a61b-cb67ae2192e2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1503 microversion: 2.1 time: 0.967876 Aug 09 17:16:32.981635 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1076/2076] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:31 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1503 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:16:32.981635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c06088a-5cfe-48e7-871d-17a11b6fe085 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:32.981635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c06088a-5cfe-48e7-871d-17a11b6fe085 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:32.989773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c06088a-5cfe-48e7-871d-17a11b6fe085 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:32.991940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c06088a-5cfe-48e7-871d-17a11b6fe085 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:32.993139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c06088a-5cfe-48e7-871d-17a11b6fe085 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:32.994312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c06088a-5cfe-48e7-871d-17a11b6fe085 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:32.995123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c06088a-5cfe-48e7-871d-17a11b6fe085 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:32.996535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c06088a-5cfe-48e7-871d-17a11b6fe085 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:33.223433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5c06088a-5cfe-48e7-871d-17a11b6fe085 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:33.237725 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c06088a-5cfe-48e7-871d-17a11b6fe085 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1279 microversion: 2.1 time: 0.267871 Aug 09 17:16:33.254134 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1077/2077] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:32 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1279 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:33.267419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0de1e489-11b4-4f44-972c-3b0ef10945e3 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Calling method '.version_select at 0x7fbbdc9ecc10>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:33.996966 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0de1e489-11b4-4f44-972c-3b0ef10945e3 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "DELETE /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.740695 Aug 09 17:16:33.997562 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1078/2078] 10.222.0.93 () {58 vars in 1296 bytes} [Tue Aug 9 17:16:33 2022] DELETE /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata/os_version => generated 0 bytes in 742 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:16:34.003149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a64666b-63d8-4eb4-81bc-5fdfbf5f7c7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:34.006120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a64666b-63d8-4eb4-81bc-5fdfbf5f7c7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:34.037454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a64666b-63d8-4eb4-81bc-5fdfbf5f7c7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:34.038324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a64666b-63d8-4eb4-81bc-5fdfbf5f7c7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:34.041392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a64666b-63d8-4eb4-81bc-5fdfbf5f7c7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:34.044744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a64666b-63d8-4eb4-81bc-5fdfbf5f7c7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:34.049387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a64666b-63d8-4eb4-81bc-5fdfbf5f7c7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:34.050788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a64666b-63d8-4eb4-81bc-5fdfbf5f7c7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:34.575484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a64666b-63d8-4eb4-81bc-5fdfbf5f7c7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db2a6f289c7e4b1abea4713412897236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5458faa4b45e4eab8ec22d1d4a13f6c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:34.606644 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a64666b-63d8-4eb4-81bc-5fdfbf5f7c7c tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 200 len: 1615 microversion: 2.1 time: 0.607525 Aug 09 17:16:34.611612 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1079/2079] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:33 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 1615 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:34.641041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87e0fbb6-d660-4e23-911c-083ff2797afd tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Calling method '.version_select at 0x7fbbdca34820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:34.746825 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87e0fbb6-d660-4e23-911c-083ff2797afd tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 37 microversion: 2.1 time: 0.128352 Aug 09 17:16:34.750038 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1080/2080] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 17:16:34 2022] GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 37 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:34.804560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3ba80962-e304-44a5-a0ec-e0a78abde67a req-3b4393a2-09b7-4cbe-90dc-a9dd179b6fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcdaafd-e14c-4307-aa16-fd4860b74633", "name": "network-vif-deleted", "tag": "46ee644e-0b30-4955-a95a-7804f485464b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:34.854816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ba80962-e304-44a5-a0ec-e0a78abde67a req-3b4393a2-09b7-4cbe-90dc-a9dd179b6fc9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:34.858092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ba80962-e304-44a5-a0ec-e0a78abde67a req-3b4393a2-09b7-4cbe-90dc-a9dd179b6fc9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:34.864443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ba80962-e304-44a5-a0ec-e0a78abde67a req-3b4393a2-09b7-4cbe-90dc-a9dd179b6fc9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:34.925625 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3ba80962-e304-44a5-a0ec-e0a78abde67a req-3b4393a2-09b7-4cbe-90dc-a9dd179b6fc9 service nova] Creating event network-vif-deleted:46ee644e-0b30-4955-a95a-7804f485464b for instance 0fcdaafd-e14c-4307-aa16-fd4860b74633 on n-h1-845781-6 Aug 09 17:16:34.963012 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3ba80962-e304-44a5-a0ec-e0a78abde67a req-3b4393a2-09b7-4cbe-90dc-a9dd179b6fc9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208296 Aug 09 17:16:34.974908 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1081/2081] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:35.008162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21bdfaa9-65e8-49af-98ce-17d7a5b17fc6 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:35.010014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-21bdfaa9-65e8-49af-98ce-17d7a5b17fc6 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:35.034130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21bdfaa9-65e8-49af-98ce-17d7a5b17fc6 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:35.041440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21bdfaa9-65e8-49af-98ce-17d7a5b17fc6 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:35.043534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21bdfaa9-65e8-49af-98ce-17d7a5b17fc6 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:35.044891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:35.048476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21bdfaa9-65e8-49af-98ce-17d7a5b17fc6 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:35.050095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21bdfaa9-65e8-49af-98ce-17d7a5b17fc6 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:35.055085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:35.056655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21bdfaa9-65e8-49af-98ce-17d7a5b17fc6 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:35.056826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:35.058064 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-45e86008-9517-4494-bfb5-6eeb0cbb3ebf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2962 microversion: 2.42 time: 2.465980 Aug 09 17:16:35.075925 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1001/2082] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:32 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2962 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:35.104101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-420316bb-4c64-414a-b8b7-a97d80013868 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Action: 'update_all', calling method: .version_select at 0x7fbbdc9c0940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:35.231104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-420316bb-4c64-414a-b8b7-a97d80013868 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:35.252221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-420316bb-4c64-414a-b8b7-a97d80013868 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for user 030b7fae3ebb463cad91ec2787098380 and project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:35.785363 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-420316bb-4c64-414a-b8b7-a97d80013868 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.710111 Aug 09 17:16:35.786308 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1002/2083] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:16:35 2022] PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 61 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:35.791750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:35.793051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] [instance: 0fcdaafd-e14c-4307-aa16-fd4860b74633] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:35.820434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:35.821512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:35.823374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:35.825392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:35.826419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:35.827349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:35.931254 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] HTTP exception thrown: Instance 0fcdaafd-e14c-4307-aa16-fd4860b74633 could not be found. Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Request method failure captured: Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 HTTP/1.1 Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pWfyDr2COG-hq5b1ejBayqYfBMD4xhuXibC_VyRZ9vZJ5Olk-OkwiB1s04cU1mN1q81oGoMmJceSJHs4dfI3hvUhtwX0npcDBAg7sJlmYP9a8iydl8AV1-rHkgp2dqCYgtTw6jhSVZU6vpY7NFVbDs8DaSAj5Udd4dKtL7CoxI6Grw Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5458faa4b45e4eab8ec22d1d4a13f6c0 Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesAdminNegativeTest-1209285146 Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5458faa4b45e4eab8ec22d1d4a13f6c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5458faa4b45e4eab8ec22d1d4a13f6c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5458faa4b45e4eab8ec22d1d4a13f6c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5458faa4b45e4eab8ec22d1d4a13f6c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesAdminNegativeTest-1209285146 Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5458faa4b45e4eab8ec22d1d4a13f6c0 Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1209285146 Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesAdminNegativeTest-1209285146-project Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: db2a6f289c7e4b1abea4713412897236 Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesAdminNegativeTest-1209285146-project Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 0fcdaafd-e14c-4307-aa16-fd4860b74633 could not be found. Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '0fcdaafd-e14c-4307-aa16-fd4860b74633'} Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fcdaafd-e14c-4307-aa16-fd4860b74633 could not be found. Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fcdaafd-e14c-4307-aa16-fd4860b74633 could not be found. Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:16:35.933304 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:35.936740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:16:35.936740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:16:35.936740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:16:35.936740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:16:35.936740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:16:35.936740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fcdaafd-e14c-4307-aa16-fd4860b74633 could not be found. Aug 09 17:16:35.936740 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:16:35.938334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Returning 404 to user: Instance 0fcdaafd-e14c-4307-aa16-fd4860b74633 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:16:35.941187 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-61583470-9edd-407d-b242-684f346244b8 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633" status: 404 len: 111 microversion: 2.1 time: 0.153341 Aug 09 17:16:35.945342 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1003/2084] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:35 2022] GET /compute/v2.1/servers/0fcdaafd-e14c-4307-aa16-fd4860b74633 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:16:35.956198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a582cdf9-4bc9-449f-a5db-5fd395609b70 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Calling method '.version_select at 0x7fbbdc9c0700>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:36.110171 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a582cdf9-4bc9-449f-a5db-5fd395609b70 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.156681 Aug 09 17:16:36.115318 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1004/2085] 10.222.0.93 () {58 vars in 1290 bytes} [Tue Aug 9 17:16:35 2022] GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata/os_distro => generated 33 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:36.143279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bb566b1d-639a-4505-80f5-2907f66c81e6 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] Calling method '.version_select at 0x7fbbd8c82b80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:36.260527 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bb566b1d-639a-4505-80f5-2907f66c81e6 tempest-VolumesAdminNegativeTest-1209285146 tempest-VolumesAdminNegativeTest-1209285146-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107143736" status: 202 len: 0 microversion: 2.1 time: 0.142692 Aug 09 17:16:36.265139 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1005/2086] 10.222.0.93 () {58 vars in 1221 bytes} [Tue Aug 9 17:16:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107143736 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:16:36.286068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:36.292189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:36.348525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:36.349642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:36.350445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:36.359973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:36.361980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:36.365789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:36.854130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-21bdfaa9-65e8-49af-98ce-17d7a5b17fc6 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:36.865189 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-21bdfaa9-65e8-49af-98ce-17d7a5b17fc6 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1319 microversion: 2.1 time: 1.886891 Aug 09 17:16:36.866533 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1082/2087] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:34 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1319 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:36.872625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a44b1858-6568-4a3d-b0e0-d4054e64be87 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Action: 'update_all', calling method: .version_select at 0x7fbbcaf618b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:36.971080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a44b1858-6568-4a3d-b0e0-d4054e64be87 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:36.992057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a44b1858-6568-4a3d-b0e0-d4054e64be87 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for user 030b7fae3ebb463cad91ec2787098380 and project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:37.113632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:37.145301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:37.152637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:37.158431 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fd8c40bf-f704-411c-9c67-e0e3de8f7b90 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2962 microversion: 2.42 time: 0.889694 Aug 09 17:16:37.162452 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1006/2088] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:36 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2962 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:37.184807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5be39da6-60ba-4b11-bac9-53f467bfce21 req-4ad25a72-9ed1-4f56-ae78-673e9e4d0a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-unplugged", "status": "completed", "tag": "1e899611-18b4-4b55-9bae-c961a398310b"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:37.229868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5be39da6-60ba-4b11-bac9-53f467bfce21 req-4ad25a72-9ed1-4f56-ae78-673e9e4d0a4c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:37.234346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5be39da6-60ba-4b11-bac9-53f467bfce21 req-4ad25a72-9ed1-4f56-ae78-673e9e4d0a4c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:37.241150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5be39da6-60ba-4b11-bac9-53f467bfce21 req-4ad25a72-9ed1-4f56-ae78-673e9e4d0a4c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:37.288983 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5be39da6-60ba-4b11-bac9-53f467bfce21 req-4ad25a72-9ed1-4f56-ae78-673e9e4d0a4c service nova] Creating event network-vif-unplugged:1e899611-18b4-4b55-9bae-c961a398310b for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:16:37.303312 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5be39da6-60ba-4b11-bac9-53f467bfce21 req-4ad25a72-9ed1-4f56-ae78-673e9e4d0a4c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136382 Aug 09 17:16:37.309314 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1007/2089] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:37.537678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6c134e32-7614-40dc-9afc-ee87e89fee89 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c959997a-a4ea-4a75-b7b5-f3646cef25bd"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:37.540434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6c134e32-7614-40dc-9afc-ee87e89fee89 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:37.556663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c134e32-7614-40dc-9afc-ee87e89fee89 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:37.560095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c134e32-7614-40dc-9afc-ee87e89fee89 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:37.560788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c134e32-7614-40dc-9afc-ee87e89fee89 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:37.562776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c134e32-7614-40dc-9afc-ee87e89fee89 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:37.563349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c134e32-7614-40dc-9afc-ee87e89fee89 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:37.571985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c134e32-7614-40dc-9afc-ee87e89fee89 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:37.596436 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a44b1858-6568-4a3d-b0e0-d4054e64be87 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.727468 Aug 09 17:16:37.599225 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1083/2090] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:16:36 2022] PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 61 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:37.620251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1c4e75ff-ef85-4d2c-9d64-e0a0b1366b4b tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Calling method '.version_select at 0x7fbbdc852820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:37.781303 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1c4e75ff-ef85-4d2c-9d64-e0a0b1366b4b tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.170554 Aug 09 17:16:37.783071 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1084/2091] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 17:16:37 2022] GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 61 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:37.808143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b0f34c0c-35a2-4f8d-be12-013388b92308 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Action: 'update_all', calling method: .version_select at 0x7fbbdc85caf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:37.928618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b0f34c0c-35a2-4f8d-be12-013388b92308 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:37.960562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b0f34c0c-35a2-4f8d-be12-013388b92308 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for user 030b7fae3ebb463cad91ec2787098380 and project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:38.135891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:38.214882 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6c134e32-7614-40dc-9afc-ee87e89fee89 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.682087 Aug 09 17:16:38.225311 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1008/2092] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:16:37 2022] POST /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:38.252121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bd6dbd5c-199b-40a8-ab9b-bd0ff390667b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:38.261011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bd6dbd5c-199b-40a8-ab9b-bd0ff390667b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:38.292984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd6dbd5c-199b-40a8-ab9b-bd0ff390667b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:38.295541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd6dbd5c-199b-40a8-ab9b-bd0ff390667b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:38.298109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd6dbd5c-199b-40a8-ab9b-bd0ff390667b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:38.299456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd6dbd5c-199b-40a8-ab9b-bd0ff390667b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:38.300383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd6dbd5c-199b-40a8-ab9b-bd0ff390667b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:38.308008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd6dbd5c-199b-40a8-ab9b-bd0ff390667b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:38.400825 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b0f34c0c-35a2-4f8d-be12-013388b92308 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.604658 Aug 09 17:16:38.402304 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1085/2093] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:16:37 2022] PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 61 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:16:38.408053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:38.409478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:38.419375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:38.420241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:38.421009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:38.422121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:38.422806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:38.423386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:39.319183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bd6dbd5c-199b-40a8-ab9b-bd0ff390667b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:39.329824 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bd6dbd5c-199b-40a8-ab9b-bd0ff390667b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1319 microversion: 2.1 time: 1.102641 Aug 09 17:16:39.338787 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1009/2094] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:38 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1319 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:39.344261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f29ad0cb-324c-48d1-a10d-077c6c37e140 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Action: 'update_all', calling method: .version_select at 0x7fbbdca283a0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:39.461336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f29ad0cb-324c-48d1-a10d-077c6c37e140 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:39.471201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f29ad0cb-324c-48d1-a10d-077c6c37e140 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for user 030b7fae3ebb463cad91ec2787098380 and project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:39.488266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:40.048641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:40.088151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:40.091663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:40.100084 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b0b873a7-726f-4a21-aadd-a6d143cd6047 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2941 microversion: 2.42 time: 1.695626 Aug 09 17:16:40.101356 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f29ad0cb-324c-48d1-a10d-077c6c37e140 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 64 microversion: 2.1 time: 0.760883 Aug 09 17:16:40.102094 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1010/2095] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:16:39 2022] PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 64 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:40.102535 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1086/2096] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:38 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2941 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:40.109987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-21bf8333-a0ae-48d3-a8c6-4dcadcaf70c3 req-25ff3c56-60d6-4ce0-acc2-b416d5c31049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-unplugged", "status": "completed", "tag": "1fe00816-1d9d-4c9b-8d71-db94ffc93bf9"}, {"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-unplugged", "status": "completed", "tag": "f19286e2-58f2-4f51-9878-ebb153c05f5f"}, {"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-unplugged", "status": "completed", "tag": "52bfc239-226f-4b52-bc62-3939a1c70d53"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:40.130695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-777646a5-0759-4213-9d52-1efa08b68ddc tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Calling method '.version_select at 0x7fbbcbe8ed30>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:40.139387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-21bf8333-a0ae-48d3-a8c6-4dcadcaf70c3 req-25ff3c56-60d6-4ce0-acc2-b416d5c31049 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:40.144543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-21bf8333-a0ae-48d3-a8c6-4dcadcaf70c3 req-25ff3c56-60d6-4ce0-acc2-b416d5c31049 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:40.145416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-21bf8333-a0ae-48d3-a8c6-4dcadcaf70c3 req-25ff3c56-60d6-4ce0-acc2-b416d5c31049 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:40.201727 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-21bf8333-a0ae-48d3-a8c6-4dcadcaf70c3 req-25ff3c56-60d6-4ce0-acc2-b416d5c31049 service nova] Creating event network-vif-unplugged:1fe00816-1d9d-4c9b-8d71-db94ffc93bf9 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:16:40.208409 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-21bf8333-a0ae-48d3-a8c6-4dcadcaf70c3 req-25ff3c56-60d6-4ce0-acc2-b416d5c31049 service nova] Creating event network-vif-unplugged:f19286e2-58f2-4f51-9878-ebb153c05f5f for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:16:40.210746 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-21bf8333-a0ae-48d3-a8c6-4dcadcaf70c3 req-25ff3c56-60d6-4ce0-acc2-b416d5c31049 service nova] Creating event network-vif-unplugged:52bfc239-226f-4b52-bc62-3939a1c70d53 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:16:40.226959 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-21bf8333-a0ae-48d3-a8c6-4dcadcaf70c3 req-25ff3c56-60d6-4ce0-acc2-b416d5c31049 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.121176 Aug 09 17:16:40.244194 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1011/2097] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:40.297115 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-777646a5-0759-4213-9d52-1efa08b68ddc tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 64 microversion: 2.1 time: 0.182644 Aug 09 17:16:40.298209 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1087/2098] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 17:16:40 2022] GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 64 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:16:40.351413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-20ef6510-04df-40f7-bf96-1abe3e82d6c3 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Action: 'update_all', calling method: .version_select at 0x7fbbdca30ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:40.380107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6402b86b-fceb-4e19-a53c-24e420aaa8b7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:40.381364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6402b86b-fceb-4e19-a53c-24e420aaa8b7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:40.422912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6402b86b-fceb-4e19-a53c-24e420aaa8b7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:40.429085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6402b86b-fceb-4e19-a53c-24e420aaa8b7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:40.431485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6402b86b-fceb-4e19-a53c-24e420aaa8b7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:40.432357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6402b86b-fceb-4e19-a53c-24e420aaa8b7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:40.433804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6402b86b-fceb-4e19-a53c-24e420aaa8b7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:40.434269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6402b86b-fceb-4e19-a53c-24e420aaa8b7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:40.525037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-20ef6510-04df-40f7-bf96-1abe3e82d6c3 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:40.551257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-20ef6510-04df-40f7-bf96-1abe3e82d6c3 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for user 030b7fae3ebb463cad91ec2787098380 and project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:41.282769 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-20ef6510-04df-40f7-bf96-1abe3e82d6c3 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.976108 Aug 09 17:16:41.283661 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1012/2099] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:16:40 2022] PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 61 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:41.293061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:41.300060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:41.322635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:41.323760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:41.324715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:41.326241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:41.327350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:41.328332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:41.847989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:41.872347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:41.876555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:41.879123 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72e36fa6-3f9f-45cf-9e11-40bec9bf2617 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2920 microversion: 2.42 time: 0.593457 Aug 09 17:16:41.881448 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1013/2100] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:41 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2920 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:41.891376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-715cd95e-e1f8-4f47-b441-59221b373764 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Action: 'update', calling method: .version_select at 0x7fbbdc9d2b80>, body: {"meta": {"os_version": "alt"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:42.040215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-715cd95e-e1f8-4f47-b441-59221b373764 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:42.062390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-715cd95e-e1f8-4f47-b441-59221b373764 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for user 030b7fae3ebb463cad91ec2787098380 and project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:42.146252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6402b86b-fceb-4e19-a53c-24e420aaa8b7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:42.162903 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6402b86b-fceb-4e19-a53c-24e420aaa8b7 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1319 microversion: 2.1 time: 1.804471 Aug 09 17:16:42.163998 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1088/2101] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:40 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1319 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:42.637158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-78dfebb0-36f0-4c9e-a557-1fd5d773f0b4 tempest-AZV2TestJSON-8228730 tempest-AZV2TestJSON-8228730-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:42.639001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78dfebb0-36f0-4c9e-a557-1fd5d773f0b4 tempest-AZV2TestJSON-8228730 tempest-AZV2TestJSON-8228730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:42.639611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78dfebb0-36f0-4c9e-a557-1fd5d773f0b4 tempest-AZV2TestJSON-8228730 tempest-AZV2TestJSON-8228730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:42.640198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78dfebb0-36f0-4c9e-a557-1fd5d773f0b4 tempest-AZV2TestJSON-8228730 tempest-AZV2TestJSON-8228730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:42.641374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78dfebb0-36f0-4c9e-a557-1fd5d773f0b4 tempest-AZV2TestJSON-8228730 tempest-AZV2TestJSON-8228730-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:42.644434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78dfebb0-36f0-4c9e-a557-1fd5d773f0b4 tempest-AZV2TestJSON-8228730 tempest-AZV2TestJSON-8228730-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:42.645068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78dfebb0-36f0-4c9e-a557-1fd5d773f0b4 tempest-AZV2TestJSON-8228730 tempest-AZV2TestJSON-8228730-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:42.681152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:42.694429 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-78dfebb0-36f0-4c9e-a557-1fd5d773f0b4 tempest-AZV2TestJSON-8228730 tempest-AZV2TestJSON-8228730-project] 10.222.0.93 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.528653 Aug 09 17:16:42.700801 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1089/2102] 10.222.0.93 () {58 vars in 1164 bytes} [Tue Aug 9 17:16:42 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:42.719282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-70e4c4cc-6d9d-4468-a19c-5671cfcce7bd req-22d96439-ab85-471e-bf83-4d39160a1abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-deleted", "tag": "1e899611-18b4-4b55-9bae-c961a398310b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:42.764523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-70e4c4cc-6d9d-4468-a19c-5671cfcce7bd req-22d96439-ab85-471e-bf83-4d39160a1abb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:42.770358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-70e4c4cc-6d9d-4468-a19c-5671cfcce7bd req-22d96439-ab85-471e-bf83-4d39160a1abb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:42.773899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-70e4c4cc-6d9d-4468-a19c-5671cfcce7bd req-22d96439-ab85-471e-bf83-4d39160a1abb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:42.810900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-70e4c4cc-6d9d-4468-a19c-5671cfcce7bd req-22d96439-ab85-471e-bf83-4d39160a1abb service nova] Creating event network-vif-deleted:1e899611-18b4-4b55-9bae-c961a398310b for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:16:42.823469 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-70e4c4cc-6d9d-4468-a19c-5671cfcce7bd req-22d96439-ab85-471e-bf83-4d39160a1abb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121078 Aug 09 17:16:42.840152 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1090/2103] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:42.851616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-20a1ccf3-6fd9-4fdd-8e02-a2663b06e964 req-ad956519-1632-4ac3-b3c6-20f2a24eb2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-unplugged", "status": "completed", "tag": "087d8ab6-d0b8-451a-a98f-0e8b6e72b4a6"}, {"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-unplugged", "status": "completed", "tag": "709f91d0-ee6e-4efa-ad7d-a941e3f4fefb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:42.886423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-20a1ccf3-6fd9-4fdd-8e02-a2663b06e964 req-ad956519-1632-4ac3-b3c6-20f2a24eb2e9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:42.887200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-20a1ccf3-6fd9-4fdd-8e02-a2663b06e964 req-ad956519-1632-4ac3-b3c6-20f2a24eb2e9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:42.889333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-20a1ccf3-6fd9-4fdd-8e02-a2663b06e964 req-ad956519-1632-4ac3-b3c6-20f2a24eb2e9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:42.931949 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-715cd95e-e1f8-4f47-b441-59221b373764 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 1.048268 Aug 09 17:16:42.934254 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1014/2104] 10.222.0.93 () {60 vars in 1313 bytes} [Tue Aug 9 17:16:41 2022] PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata/os_version => generated 31 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:42.939539 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-20a1ccf3-6fd9-4fdd-8e02-a2663b06e964 req-ad956519-1632-4ac3-b3c6-20f2a24eb2e9 service nova] Creating event network-vif-unplugged:087d8ab6-d0b8-451a-a98f-0e8b6e72b4a6 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:16:42.941124 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-20a1ccf3-6fd9-4fdd-8e02-a2663b06e964 req-ad956519-1632-4ac3-b3c6-20f2a24eb2e9 service nova] Creating event network-vif-unplugged:709f91d0-ee6e-4efa-ad7d-a941e3f4fefb for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:16:42.955786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:42.959795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:42.967529 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-20a1ccf3-6fd9-4fdd-8e02-a2663b06e964 req-ad956519-1632-4ac3-b3c6-20f2a24eb2e9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.121073 Aug 09 17:16:42.972095 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1091/2105] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:42.990529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c4c5712-804b-4afb-afbd-fc21bcbaca3e tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Calling method '.version_select at 0x7fbbdc9ec670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:42.993730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:42.994986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:42.995766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:42.997288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:42.998121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:42.999925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:43.140117 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3c4c5712-804b-4afb-afbd-fc21bcbaca3e tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 58 microversion: 2.1 time: 0.164018 Aug 09 17:16:43.143418 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1092/2106] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 17:16:42 2022] GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 58 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:43.167121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e0466843-2647-4c5f-a549-5e7a3cee9929 req-d52f2c23-a23e-461e-9618-e6b879826e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acbeac06-53d0-4056-b620-348d2313b6fd", "tag": "1c369903-1ade-4859-8a29-9908638f53bb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:43.206073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e0466843-2647-4c5f-a549-5e7a3cee9929 req-d52f2c23-a23e-461e-9618-e6b879826e34 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:43.208580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e0466843-2647-4c5f-a549-5e7a3cee9929 req-d52f2c23-a23e-461e-9618-e6b879826e34 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:43.210443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e0466843-2647-4c5f-a549-5e7a3cee9929 req-d52f2c23-a23e-461e-9618-e6b879826e34 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:43.243038 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e0466843-2647-4c5f-a549-5e7a3cee9929 req-d52f2c23-a23e-461e-9618-e6b879826e34 service nova] Creating event network-changed:1c369903-1ade-4859-8a29-9908638f53bb for instance acbeac06-53d0-4056-b620-348d2313b6fd on n-h2-845781-6 Aug 09 17:16:43.257494 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e0466843-2647-4c5f-a549-5e7a3cee9929 req-d52f2c23-a23e-461e-9618-e6b879826e34 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110894 Aug 09 17:16:43.259427 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1093/2107] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:43.273170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-54456d11-caa9-4774-a431-d0b1fb0cfd78 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Action: 'update_all', calling method: .version_select at 0x7fbbdc8c5160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:43.402226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-54456d11-caa9-4774-a431-d0b1fb0cfd78 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:43.421813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-54456d11-caa9-4774-a431-d0b1fb0cfd78 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for user 030b7fae3ebb463cad91ec2787098380 and project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:43.952681 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-54456d11-caa9-4774-a431-d0b1fb0cfd78 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 61 microversion: 2.1 time: 0.690702 Aug 09 17:16:43.953736 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1094/2108] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:16:43 2022] PUT /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 61 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:43.958996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11e0e663-b08b-44e1-bd77-0662566a3c65 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:43.962882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-11e0e663-b08b-44e1-bd77-0662566a3c65 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:43.973109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11e0e663-b08b-44e1-bd77-0662566a3c65 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:43.974110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11e0e663-b08b-44e1-bd77-0662566a3c65 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:43.974705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11e0e663-b08b-44e1-bd77-0662566a3c65 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:43.975570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11e0e663-b08b-44e1-bd77-0662566a3c65 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:43.976452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11e0e663-b08b-44e1-bd77-0662566a3c65 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:43.977003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11e0e663-b08b-44e1-bd77-0662566a3c65 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:44.142060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:44.167003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:44.170560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:44.180782 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-75c5a463-13d3-4b8b-a8c6-f836807b5ff7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2759 microversion: 2.42 time: 1.243020 Aug 09 17:16:44.203669 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1015/2109] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:42 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2759 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:44.210649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fc010fb0-9270-4133-948f-2e155e0724d4 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Action: 'create', calling method: .version_select at 0x7fbbdc9c7b80>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:44.321328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fc010fb0-9270-4133-948f-2e155e0724d4 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:16:44.328484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fc010fb0-9270-4133-948f-2e155e0724d4 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Getting quotas for user 030b7fae3ebb463cad91ec2787098380 and project 2e7b4bd5814a4009b640283a18fe740c. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:16:44.726575 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fc010fb0-9270-4133-948f-2e155e0724d4 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "POST /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 85 microversion: 2.1 time: 0.531351 Aug 09 17:16:44.734393 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1016/2110] 10.222.0.93 () {60 vars in 1281 bytes} [Tue Aug 9 17:16:44 2022] POST /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 85 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:44.746173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e36dd456-8e55-471b-8a98-95fe93f6d193 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] Calling method '.version_select at 0x7fbbdc9e6790>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:44.845053 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e36dd456-8e55-471b-8a98-95fe93f6d193 tempest-ImagesMetadataTestJSON-1063343034 tempest-ImagesMetadataTestJSON-1063343034-project] 10.222.0.93 "GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata" status: 200 len: 85 microversion: 2.1 time: 0.103962 Aug 09 17:16:44.846254 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1017/2111] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 17:16:44 2022] GET /compute/v2.1/images/e49a25ba-f7d0-41e8-a082-59b279386e13/metadata => generated 85 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:16:44.890191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d25c4044-4dde-45ef-99d5-0754b4bf70d0 req-af9b228e-8a94-4586-ad9e-7b5309e3203d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-deleted", "tag": "52bfc239-226f-4b52-bc62-3939a1c70d53"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:44.922046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d25c4044-4dde-45ef-99d5-0754b4bf70d0 req-af9b228e-8a94-4586-ad9e-7b5309e3203d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:44.922633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d25c4044-4dde-45ef-99d5-0754b4bf70d0 req-af9b228e-8a94-4586-ad9e-7b5309e3203d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:44.923213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d25c4044-4dde-45ef-99d5-0754b4bf70d0 req-af9b228e-8a94-4586-ad9e-7b5309e3203d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:44.960594 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d25c4044-4dde-45ef-99d5-0754b4bf70d0 req-af9b228e-8a94-4586-ad9e-7b5309e3203d service nova] Creating event network-vif-deleted:52bfc239-226f-4b52-bc62-3939a1c70d53 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:16:44.969887 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d25c4044-4dde-45ef-99d5-0754b4bf70d0 req-af9b228e-8a94-4586-ad9e-7b5309e3203d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093607 Aug 09 17:16:44.976370 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1018/2112] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:45.247975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:45.248801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:45.262425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:45.269248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:45.269248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:45.270017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:45.270574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:45.272170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:45.669455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-11e0e663-b08b-44e1-bd77-0662566a3c65 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:45.682927 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11e0e663-b08b-44e1-bd77-0662566a3c65 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1319 microversion: 2.1 time: 1.727937 Aug 09 17:16:45.683546 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1095/2113] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:43 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1319 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:45.916305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:45.935569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:45.937200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:45.938880 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4738f41d-3be2-40ff-bf6c-987ccbe44190 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2554 microversion: 2.42 time: 0.695601 Aug 09 17:16:45.944034 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1019/2114] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:45 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2554 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:46.706850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6cbed290-0bf6-4779-ad2e-e02fb3cd04fb tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:46.707485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6cbed290-0bf6-4779-ad2e-e02fb3cd04fb tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:46.721573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cbed290-0bf6-4779-ad2e-e02fb3cd04fb tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:46.722455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cbed290-0bf6-4779-ad2e-e02fb3cd04fb tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:46.728755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cbed290-0bf6-4779-ad2e-e02fb3cd04fb tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:46.729813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cbed290-0bf6-4779-ad2e-e02fb3cd04fb tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:46.730471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cbed290-0bf6-4779-ad2e-e02fb3cd04fb tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:46.731083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cbed290-0bf6-4779-ad2e-e02fb3cd04fb tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:46.991001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:46.994826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:47.019565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:47.020109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:47.020568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:47.021378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:47.021855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:47.022312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:47.716643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:47.748218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:47.753297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:47.760271 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-227cb9e0-dd79-4f5d-b939-f4547191bdef tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2507 microversion: 2.42 time: 0.771934 Aug 09 17:16:47.790587 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1020/2115] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:46 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2507 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:47.814924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-996e21b8-eda5-4e44-a98c-93f027d99ad4 req-baac87a8-0521-40eb-afc8-9eea094e4d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-deleted", "tag": "709f91d0-ee6e-4efa-ad7d-a941e3f4fefb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:47.848811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-996e21b8-eda5-4e44-a98c-93f027d99ad4 req-baac87a8-0521-40eb-afc8-9eea094e4d66 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:47.850252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-996e21b8-eda5-4e44-a98c-93f027d99ad4 req-baac87a8-0521-40eb-afc8-9eea094e4d66 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:47.851035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-996e21b8-eda5-4e44-a98c-93f027d99ad4 req-baac87a8-0521-40eb-afc8-9eea094e4d66 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:47.904153 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-996e21b8-eda5-4e44-a98c-93f027d99ad4 req-baac87a8-0521-40eb-afc8-9eea094e4d66 service nova] Creating event network-vif-deleted:709f91d0-ee6e-4efa-ad7d-a941e3f4fefb for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:16:47.922808 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-996e21b8-eda5-4e44-a98c-93f027d99ad4 req-baac87a8-0521-40eb-afc8-9eea094e4d66 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128943 Aug 09 17:16:47.928894 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1021/2116] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:48.096876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6cbed290-0bf6-4779-ad2e-e02fb3cd04fb tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:48.109375 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6cbed290-0bf6-4779-ad2e-e02fb3cd04fb tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1319 microversion: 2.1 time: 1.407015 Aug 09 17:16:48.113632 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1096/2117] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:46 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1319 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:48.805005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:48.806430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:48.850298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:48.852154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:48.857145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:48.858564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:48.859701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:48.865319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:48.885004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:49.149831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-82dd7370-2949-43b8-ba3b-85dd16029f98 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:49.154753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-82dd7370-2949-43b8-ba3b-85dd16029f98 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:49.184290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82dd7370-2949-43b8-ba3b-85dd16029f98 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:49.185777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82dd7370-2949-43b8-ba3b-85dd16029f98 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:49.190880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82dd7370-2949-43b8-ba3b-85dd16029f98 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:49.193484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82dd7370-2949-43b8-ba3b-85dd16029f98 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:49.207925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82dd7370-2949-43b8-ba3b-85dd16029f98 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:49.209448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82dd7370-2949-43b8-ba3b-85dd16029f98 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:49.539361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:49.570113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:49.576418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:49.580535 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-129f6aff-b6b5-43cb-9f83-55bc5111b96f tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2215 microversion: 2.42 time: 0.784383 Aug 09 17:16:49.592152 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1022/2118] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:48 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2215 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:49.979482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-4e73ac00-fec9-4fa8-8256-8c397821e6dd req-344bda3f-095e-4351-a462-d3a7dff31451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-deleted", "tag": "1fe00816-1d9d-4c9b-8d71-db94ffc93bf9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:50.036216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4e73ac00-fec9-4fa8-8256-8c397821e6dd req-344bda3f-095e-4351-a462-d3a7dff31451 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:50.046608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4e73ac00-fec9-4fa8-8256-8c397821e6dd req-344bda3f-095e-4351-a462-d3a7dff31451 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:50.047595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4e73ac00-fec9-4fa8-8256-8c397821e6dd req-344bda3f-095e-4351-a462-d3a7dff31451 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:50.112004 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-4e73ac00-fec9-4fa8-8256-8c397821e6dd req-344bda3f-095e-4351-a462-d3a7dff31451 service nova] Creating event network-vif-deleted:1fe00816-1d9d-4c9b-8d71-db94ffc93bf9 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:16:50.134444 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-4e73ac00-fec9-4fa8-8256-8c397821e6dd req-344bda3f-095e-4351-a462-d3a7dff31451 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162174 Aug 09 17:16:50.140466 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1023/2119] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:16:50.381663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-82dd7370-2949-43b8-ba3b-85dd16029f98 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:50.435349 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-82dd7370-2949-43b8-ba3b-85dd16029f98 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1319 microversion: 2.1 time: 1.283867 Aug 09 17:16:50.438128 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1097/2120] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:49 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1319 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:50.610344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:50.611068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:50.627527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:50.628053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:50.628501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:50.629240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:50.629701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:50.630127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:51.172842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-dd71e953-0d1d-43ea-ac05-01c468de47ad req-51fabac2-29c1-4925-a6be-d9ef0cbf1d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbeac06-53d0-4056-b620-348d2313b6fd", "name": "network-vif-plugged", "status": "completed", "tag": "1c369903-1ade-4859-8a29-9908638f53bb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:51.196658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dd71e953-0d1d-43ea-ac05-01c468de47ad req-51fabac2-29c1-4925-a6be-d9ef0cbf1d5f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:51.196933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dd71e953-0d1d-43ea-ac05-01c468de47ad req-51fabac2-29c1-4925-a6be-d9ef0cbf1d5f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:51.200466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dd71e953-0d1d-43ea-ac05-01c468de47ad req-51fabac2-29c1-4925-a6be-d9ef0cbf1d5f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:51.219696 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-dd71e953-0d1d-43ea-ac05-01c468de47ad req-51fabac2-29c1-4925-a6be-d9ef0cbf1d5f service nova] Creating event network-vif-plugged:1c369903-1ade-4859-8a29-9908638f53bb for instance acbeac06-53d0-4056-b620-348d2313b6fd on n-h2-845781-6 Aug 09 17:16:51.229404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-dd71e953-0d1d-43ea-ac05-01c468de47ad req-51fabac2-29c1-4925-a6be-d9ef0cbf1d5f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060474 Aug 09 17:16:51.230654 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1098/2121] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:16:51.534261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c90c8579-8a94-487b-8dbe-d28c28dc1ad2 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:51.536384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c90c8579-8a94-487b-8dbe-d28c28dc1ad2 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:51.546637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c8579-8a94-487b-8dbe-d28c28dc1ad2 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:51.547153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c8579-8a94-487b-8dbe-d28c28dc1ad2 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:51.547592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c8579-8a94-487b-8dbe-d28c28dc1ad2 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:51.553664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c8579-8a94-487b-8dbe-d28c28dc1ad2 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:51.556391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c8579-8a94-487b-8dbe-d28c28dc1ad2 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:51.556933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c90c8579-8a94-487b-8dbe-d28c28dc1ad2 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:51.682894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:51.695410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:51.697461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:51.699077 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e115adac-9173-45f4-ae87-ba50716ec3dc tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 2055 microversion: 2.42 time: 1.093140 Aug 09 17:16:51.716681 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1024/2122] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:50 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 2055 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:52.150804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c90c8579-8a94-487b-8dbe-d28c28dc1ad2 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:52.194543 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c90c8579-8a94-487b-8dbe-d28c28dc1ad2 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1319 microversion: 2.1 time: 0.664521 Aug 09 17:16:52.213572 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1099/2123] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:51 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1319 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:52.730308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:52.732224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:52.790224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:52.790794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:52.793415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:52.794582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:52.795068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:52.796227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:53.014706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d94e9e8d-506f-4219-81d0-99dfef03fc1b req-c7a975ad-9138-4acf-a475-a0d24828304b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1964d4-6f76-4c48-b05a-e123ce244faf", "name": "network-vif-deleted", "tag": "087d8ab6-d0b8-451a-a98f-0e8b6e72b4a6"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:53.033484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:53.039361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d94e9e8d-506f-4219-81d0-99dfef03fc1b req-c7a975ad-9138-4acf-a475-a0d24828304b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:53.054885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d94e9e8d-506f-4219-81d0-99dfef03fc1b req-c7a975ad-9138-4acf-a475-a0d24828304b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:53.058044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d94e9e8d-506f-4219-81d0-99dfef03fc1b req-c7a975ad-9138-4acf-a475-a0d24828304b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:53.125026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:53.135077 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d94e9e8d-506f-4219-81d0-99dfef03fc1b req-c7a975ad-9138-4acf-a475-a0d24828304b service nova] Creating event network-vif-deleted:087d8ab6-d0b8-451a-a98f-0e8b6e72b4a6 for instance bf1964d4-6f76-4c48-b05a-e123ce244faf on n-h2-845781-6 Aug 09 17:16:53.149493 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d94e9e8d-506f-4219-81d0-99dfef03fc1b req-c7a975ad-9138-4acf-a475-a0d24828304b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138798 Aug 09 17:16:53.152012 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1100/2124] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:16:53.167707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:53.180768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:53.183726 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b1fd27c7-79b2-427e-8be0-cc2238fefb0b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1987 microversion: 2.42 time: 0.461547 Aug 09 17:16:53.185740 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1025/2125] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:52 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1987 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:53.275192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6878564-bfb5-4691-bcea-4833ba256d4d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:53.278994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e6878564-bfb5-4691-bcea-4833ba256d4d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:53.316534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6878564-bfb5-4691-bcea-4833ba256d4d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:53.325390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6878564-bfb5-4691-bcea-4833ba256d4d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:53.327198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6878564-bfb5-4691-bcea-4833ba256d4d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:53.334898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6878564-bfb5-4691-bcea-4833ba256d4d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:53.352903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6878564-bfb5-4691-bcea-4833ba256d4d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:53.355418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6878564-bfb5-4691-bcea-4833ba256d4d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:53.482774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:54.204266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e6878564-bfb5-4691-bcea-4833ba256d4d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:54.216047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:54.218301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:54.222352 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e6878564-bfb5-4691-bcea-4833ba256d4d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1319 microversion: 2.1 time: 0.965580 Aug 09 17:16:54.235658 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1101/2126] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:53 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1319 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:16:54.258016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:54.258867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:54.260479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:54.262219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:54.263265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:54.265496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:54.347157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=32 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:54.501217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:54.536370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:54.544897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:54.546559 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f5219d47-9ca8-4734-b404-2a7a55c2a921 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.338175 Aug 09 17:16:54.547247 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1026/2127] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:54 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:55.255700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-457f9b72-b71c-48ff-8d3a-8789093645e0 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:55.256468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-457f9b72-b71c-48ff-8d3a-8789093645e0 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:55.323607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457f9b72-b71c-48ff-8d3a-8789093645e0 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:55.325192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457f9b72-b71c-48ff-8d3a-8789093645e0 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:55.333299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457f9b72-b71c-48ff-8d3a-8789093645e0 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:55.337597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457f9b72-b71c-48ff-8d3a-8789093645e0 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:55.341970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457f9b72-b71c-48ff-8d3a-8789093645e0 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:55.344086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457f9b72-b71c-48ff-8d3a-8789093645e0 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:55.607994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:55.609119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:55.640921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:55.647542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:55.648556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:55.650131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:55.651702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:55.655221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:55.980742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:56.012762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:56.020229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:56.022906 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-833475d2-6dda-4745-beb0-514980baa0cb tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.424456 Aug 09 17:16:56.044355 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1027/2128] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:55 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:56.085653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a3253779-89a2-46ad-83d9-6ccd3a320676 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:56.086554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a3253779-89a2-46ad-83d9-6ccd3a320676 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:56.097561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3253779-89a2-46ad-83d9-6ccd3a320676 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:56.098062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3253779-89a2-46ad-83d9-6ccd3a320676 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:56.098506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3253779-89a2-46ad-83d9-6ccd3a320676 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:56.099325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3253779-89a2-46ad-83d9-6ccd3a320676 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:56.099826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3253779-89a2-46ad-83d9-6ccd3a320676 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:56.100257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3253779-89a2-46ad-83d9-6ccd3a320676 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:56.178679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a3253779-89a2-46ad-83d9-6ccd3a320676 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:16:56.410505 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a3253779-89a2-46ad-83d9-6ccd3a320676 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 204 len: 0 microversion: 2.1 time: 0.355254 Aug 09 17:16:56.411315 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1028/2129] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:16:56 2022] DELETE /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:16:56.435589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6e9c8256-ce4f-420e-a11f-e7f4df4040e4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:56.439732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6e9c8256-ce4f-420e-a11f-e7f4df4040e4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:56.458148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e9c8256-ce4f-420e-a11f-e7f4df4040e4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:56.459232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e9c8256-ce4f-420e-a11f-e7f4df4040e4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:56.459715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e9c8256-ce4f-420e-a11f-e7f4df4040e4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:56.462878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e9c8256-ce4f-420e-a11f-e7f4df4040e4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:56.463414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e9c8256-ce4f-420e-a11f-e7f4df4040e4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:56.463902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e9c8256-ce4f-420e-a11f-e7f4df4040e4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:56.802946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-457f9b72-b71c-48ff-8d3a-8789093645e0 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:56.824612 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-457f9b72-b71c-48ff-8d3a-8789093645e0 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1469 microversion: 2.1 time: 1.573664 Aug 09 17:16:56.826734 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1102/2130] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:55 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1469 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:16:56.876922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-435875ec-1da9-4c4a-bb5f-d047964a2d5a tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:16:56.878122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-435875ec-1da9-4c4a-bb5f-d047964a2d5a tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:56.893041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-435875ec-1da9-4c4a-bb5f-d047964a2d5a tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:56.898173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-435875ec-1da9-4c4a-bb5f-d047964a2d5a tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:56.898942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-435875ec-1da9-4c4a-bb5f-d047964a2d5a tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:56.907736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-435875ec-1da9-4c4a-bb5f-d047964a2d5a tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:56.908969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-435875ec-1da9-4c4a-bb5f-d047964a2d5a tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:56.909629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-435875ec-1da9-4c4a-bb5f-d047964a2d5a tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:57.154846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6e9c8256-ce4f-420e-a11f-e7f4df4040e4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:57.167291 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6e9c8256-ce4f-420e-a11f-e7f4df4040e4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1555 microversion: 2.1 time: 0.747504 Aug 09 17:16:57.168265 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1029/2131] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:56 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1555 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:57.201868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:57.221632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:57.248537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:57.249348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:57.250009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:57.251114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:57.251858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:57.252520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:57.471543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:16:57.486848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-435875ec-1da9-4c4a-bb5f-d047964a2d5a tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lazy-loading 'flavor' on Instance uuid acbeac06-53d0-4056-b620-348d2313b6fd {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:16:57.643850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:57.717651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:57.746896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:57.748675 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6cce0485-2c12-4897-b9ce-ef8a1a510c08 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.551135 Aug 09 17:16:57.770627 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1030/2132] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:57 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:57.781432 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-435875ec-1da9-4c4a-bb5f-d047964a2d5a tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd/action" status: 202 len: 0 microversion: 2.1 time: 0.912260 Aug 09 17:16:57.782697 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1103/2133] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:16:56 2022] POST /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd/action => generated 0 bytes in 915 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:16:57.804207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b07ffdb9-630f-4118-b5e6-fc2b582cb8a4 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:57.805412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b07ffdb9-630f-4118-b5e6-fc2b582cb8a4 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:57.857720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b07ffdb9-630f-4118-b5e6-fc2b582cb8a4 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:57.858674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b07ffdb9-630f-4118-b5e6-fc2b582cb8a4 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:57.866617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b07ffdb9-630f-4118-b5e6-fc2b582cb8a4 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:57.877018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b07ffdb9-630f-4118-b5e6-fc2b582cb8a4 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:57.884576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b07ffdb9-630f-4118-b5e6-fc2b582cb8a4 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:57.887390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b07ffdb9-630f-4118-b5e6-fc2b582cb8a4 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:58.193559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-15b9b107-196d-4cef-afe8-80e8566df0c6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:58.195056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-15b9b107-196d-4cef-afe8-80e8566df0c6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:58.211257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15b9b107-196d-4cef-afe8-80e8566df0c6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:58.217169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15b9b107-196d-4cef-afe8-80e8566df0c6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:58.217831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15b9b107-196d-4cef-afe8-80e8566df0c6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:58.228936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15b9b107-196d-4cef-afe8-80e8566df0c6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:58.229933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15b9b107-196d-4cef-afe8-80e8566df0c6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:58.230544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15b9b107-196d-4cef-afe8-80e8566df0c6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:58.371675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b07ffdb9-630f-4118-b5e6-fc2b582cb8a4 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:58.406953 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b07ffdb9-630f-4118-b5e6-fc2b582cb8a4 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1477 microversion: 2.1 time: 0.616677 Aug 09 17:16:58.421575 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1031/2134] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:57 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1477 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:16:58.799698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:58.800485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:58.849340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:58.856213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:58.856785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:58.860641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:58.867611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:58.871038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:59.250592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:59.266646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:59.269743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:59.273145 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-80520f62-fbba-4441-9980-f19ba8880e7c tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.478402 Aug 09 17:16:59.295919 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1032/2135] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:16:58 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:16:59.437132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d3f48d3f-2a13-4293-804c-1b94dcbe4060 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:16:59.438231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d3f48d3f-2a13-4293-804c-1b94dcbe4060 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:16:59.467480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3f48d3f-2a13-4293-804c-1b94dcbe4060 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:59.472811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3f48d3f-2a13-4293-804c-1b94dcbe4060 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:59.474075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3f48d3f-2a13-4293-804c-1b94dcbe4060 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:59.480978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3f48d3f-2a13-4293-804c-1b94dcbe4060 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:16:59.482009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3f48d3f-2a13-4293-804c-1b94dcbe4060 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:16:59.482800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3f48d3f-2a13-4293-804c-1b94dcbe4060 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:16:59.866284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-15b9b107-196d-4cef-afe8-80e8566df0c6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:16:59.886600 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-15b9b107-196d-4cef-afe8-80e8566df0c6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1555 microversion: 2.1 time: 1.698501 Aug 09 17:16:59.887543 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1104/2136] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:58 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1555 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:00.316595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:00.329513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:00.391535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:00.397912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:00.402720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:00.404686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:00.406113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:00.410174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:00.900095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:00.937764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:00.943586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:00.954607 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bd00a97a-dac1-40ca-8e79-cf365d421654 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.648107 Aug 09 17:17:00.960415 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1105/2137] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:00 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:00.968965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d9e72893-a49d-459d-8096-2c79f2f90243 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:00.972417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d9e72893-a49d-459d-8096-2c79f2f90243 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:00.986755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e72893-a49d-459d-8096-2c79f2f90243 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:00.987264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e72893-a49d-459d-8096-2c79f2f90243 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:00.987808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e72893-a49d-459d-8096-2c79f2f90243 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:00.988709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e72893-a49d-459d-8096-2c79f2f90243 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:00.989185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e72893-a49d-459d-8096-2c79f2f90243 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:00.994384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e72893-a49d-459d-8096-2c79f2f90243 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:01.894692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d3f48d3f-2a13-4293-804c-1b94dcbe4060 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:01.937015 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d3f48d3f-2a13-4293-804c-1b94dcbe4060 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1460 microversion: 2.1 time: 2.508598 Aug 09 17:17:01.987179 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1033/2138] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:16:59 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1460 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:02.013468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d9e72893-a49d-459d-8096-2c79f2f90243 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:02.027792 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d9e72893-a49d-459d-8096-2c79f2f90243 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1513 microversion: 2.1 time: 1.061743 Aug 09 17:17:02.029726 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1106/2139] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:00 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1513 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:02.032683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-efe39b5c-f763-4f7e-857d-ad19a3930f88 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:02.038707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-efe39b5c-f763-4f7e-857d-ad19a3930f88 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:02.039911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:02.042882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:02.063721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe39b5c-f763-4f7e-857d-ad19a3930f88 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:02.064241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe39b5c-f763-4f7e-857d-ad19a3930f88 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:02.065861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe39b5c-f763-4f7e-857d-ad19a3930f88 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:02.067242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe39b5c-f763-4f7e-857d-ad19a3930f88 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:02.068690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe39b5c-f763-4f7e-857d-ad19a3930f88 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:02.070184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe39b5c-f763-4f7e-857d-ad19a3930f88 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:02.077040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:02.077548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:02.077996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:02.078736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:02.079205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:02.079660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:02.383082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:02.420895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:02.456514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:02.459590 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d6ffefe6-dd4d-4590-803d-fa7e860402ea tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.428118 Aug 09 17:17:02.462327 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1107/2140] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:02 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:02.505164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-56772b20-ad68-4f98-94fe-4e638f20a60c req-35c5bccd-390d-41d0-860c-acf7d1e2466d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae1e73e-68f8-4664-81ae-b49d4de1ca63", "name": "network-vif-deleted", "tag": "d5c5f582-77e1-4b17-8b94-6acbf6392e7c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:02.542430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-56772b20-ad68-4f98-94fe-4e638f20a60c req-35c5bccd-390d-41d0-860c-acf7d1e2466d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:02.549000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-56772b20-ad68-4f98-94fe-4e638f20a60c req-35c5bccd-390d-41d0-860c-acf7d1e2466d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:02.550957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-56772b20-ad68-4f98-94fe-4e638f20a60c req-35c5bccd-390d-41d0-860c-acf7d1e2466d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:02.604174 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-56772b20-ad68-4f98-94fe-4e638f20a60c req-35c5bccd-390d-41d0-860c-acf7d1e2466d service nova] Creating event network-vif-deleted:d5c5f582-77e1-4b17-8b94-6acbf6392e7c for instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 on n-h1-845781-6 Aug 09 17:17:02.622687 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-56772b20-ad68-4f98-94fe-4e638f20a60c req-35c5bccd-390d-41d0-860c-acf7d1e2466d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143761 Aug 09 17:17:02.626862 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1108/2141] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:03.030235 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-efe39b5c-f763-4f7e-857d-ad19a3930f88 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1611 microversion: 2.1 time: 1.035944 Aug 09 17:17:03.055506 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1034/2142] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:01 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1611 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:03.069204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-de4bb249-64b4-4be0-b0a3-62603352f7db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:03.070592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-de4bb249-64b4-4be0-b0a3-62603352f7db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:03.074374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8b18cabe-e9f5-4317-a880-3afc4c758de0 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:03.078811 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:17:03.078811 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:17:03.080977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b18cabe-e9f5-4317-a880-3afc4c758de0 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:03.082541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b18cabe-e9f5-4317-a880-3afc4c758de0 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:03.083937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b18cabe-e9f5-4317-a880-3afc4c758de0 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:03.085737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b18cabe-e9f5-4317-a880-3afc4c758de0 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:03.086954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b18cabe-e9f5-4317-a880-3afc4c758de0 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:03.088105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b18cabe-e9f5-4317-a880-3afc4c758de0 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:03.097577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de4bb249-64b4-4be0-b0a3-62603352f7db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:03.110332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de4bb249-64b4-4be0-b0a3-62603352f7db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:03.115365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de4bb249-64b4-4be0-b0a3-62603352f7db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:03.116305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de4bb249-64b4-4be0-b0a3-62603352f7db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:03.116806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de4bb249-64b4-4be0-b0a3-62603352f7db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:03.117261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de4bb249-64b4-4be0-b0a3-62603352f7db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:03.151047 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8b18cabe-e9f5-4317-a880-3afc4c758de0 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083600 Aug 09 17:17:03.170417 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1035/2143] 10.222.0.93 () {58 vars in 1176 bytes} [Tue Aug 9 17:17:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:03.181873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-845781-6", "block_migration": true, "disk_over_commit": false}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:03.186926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:03.201797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:03.203210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:03.204334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:03.206002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:03.207177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:03.208653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:03.285335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-de4bb249-64b4-4be0-b0a3-62603352f7db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:03.295318 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-de4bb249-64b4-4be0-b0a3-62603352f7db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1346 microversion: 2.1 time: 0.243712 Aug 09 17:17:03.299502 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1109/2144] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:03 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1346 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:17:03.508469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:03.509475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:03.518182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:03.519329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:03.520155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:03.522597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:03.523472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:03.524884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:03.551358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Lazy-loading 'flavor' on Instance uuid acbeac06-53d0-4056-b620-348d2313b6fd {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:17:03.633579 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance acbeac06-53d0-4056-b620-348d2313b6fd while it is in vm_state suspended Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Request method failure captured: Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd/action HTTP/1.1 Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 97 Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pZP8Mkvq6dgHaj7xaKLpGJ7rHbQeDzQzJJGUshjYr5CqTZw42FkGyAVXq4E0c_InFkzIxmxzBskiXYkoVWo2JQk4F3Kf15Xbb_nqqShncDOh0AaFcNNz8zNmdbGV-vU2Ft8Dv3d3YyCzWqHGaQrH9S9gmH-XnJdJmaOrfXN4tvX8U0 Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: dadc5029f7a84bcfacf08e1800c40e07 Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-LiveMigrationNegativeTest-1623423924 Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Role: admin,reader,member Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: admin,reader,member Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_dadc5029f7a84bcfacf08e1800c40e07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/dadc5029f7a84bcfacf08e1800c40e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/dadc5029f7a84bcfacf08e1800c40e07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/dadc5029f7a84bcfacf08e1800c40e07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-LiveMigrationNegativeTest-1623423924 Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: dadc5029f7a84bcfacf08e1800c40e07 Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1623423924 Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-LiveMigrationNegativeTest-1623423924-project-admin Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 47c60f9c17c3419ea66cfa46c831822d Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-LiveMigrationNegativeTest-1623423924-project-admin Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: {"os-migrateLive": {"host": "n-h1-845781-6", "block_migration": true, "disk_over_commit": false}} Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: exception: Cannot 'os-migrateLive' instance acbeac06-53d0-4056-b620-348d2313b6fd while it is in vm_state suspended Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'acbeac06-53d0-4056-b620-348d2313b6fd', 'body': {'os-migrateLive': {'host': 'n-h1-845781-6', 'block_migration': True, 'disk_over_commit': False}}} Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance acbeac06-53d0-4056-b620-348d2313b6fd in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:03.637451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance acbeac06-53d0-4056-b620-348d2313b6fd while it is in vm_state suspended Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance acbeac06-53d0-4056-b620-348d2313b6fd while it is in vm_state suspended Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance acbeac06-53d0-4056-b620-348d2313b6fd while it is in vm_state suspended {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b3bd3f3b-6955-4472-9db0-56b2d22000e4 tempest-LiveMigrationNegativeTest-1623423924 tempest-LiveMigrationNegativeTest-1623423924-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd/action" status: 409 len: 155 microversion: 2.1 time: 0.467320 Aug 09 17:17:03.646990 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1036/2145] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:17:03 2022] POST /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd/action => generated 155 bytes in 470 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:17:03.684852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9b8e821-1c8d-4432-9df2-9e7364727777 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:03.685715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9b8e821-1c8d-4432-9df2-9e7364727777 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:03.699256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9b8e821-1c8d-4432-9df2-9e7364727777 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:03.700180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9b8e821-1c8d-4432-9df2-9e7364727777 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:03.701641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9b8e821-1c8d-4432-9df2-9e7364727777 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:03.702623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9b8e821-1c8d-4432-9df2-9e7364727777 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:03.716861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9b8e821-1c8d-4432-9df2-9e7364727777 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:03.717626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9b8e821-1c8d-4432-9df2-9e7364727777 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:03.776533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:03.797335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:03.809742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:03.812966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9b8e821-1c8d-4432-9df2-9e7364727777 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:17:03.813647 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5d10ff4c-39c1-420e-b9a1-c6f9f82798f7 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.311255 Aug 09 17:17:03.835010 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1110/2146] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:03 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:03.908801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:04.123135 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9b8e821-1c8d-4432-9df2-9e7364727777 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "DELETE /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 204 len: 0 microversion: 2.1 time: 0.457190 Aug 09 17:17:04.132041 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1037/2147] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:17:03 2022] DELETE /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:17:04.140614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7edd401d-22cc-4d26-a650-68fab9599532 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:04.142071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7edd401d-22cc-4d26-a650-68fab9599532 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:04.185855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7edd401d-22cc-4d26-a650-68fab9599532 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:04.189972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7edd401d-22cc-4d26-a650-68fab9599532 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:04.194748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7edd401d-22cc-4d26-a650-68fab9599532 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:04.211187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7edd401d-22cc-4d26-a650-68fab9599532 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:04.215765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7edd401d-22cc-4d26-a650-68fab9599532 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:04.216518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7edd401d-22cc-4d26-a650-68fab9599532 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:04.344592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b720dfd6-7f2c-4bcd-b904-9dad764ddfe8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:04.346297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b720dfd6-7f2c-4bcd-b904-9dad764ddfe8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:04.378205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b720dfd6-7f2c-4bcd-b904-9dad764ddfe8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:04.379532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b720dfd6-7f2c-4bcd-b904-9dad764ddfe8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:04.382598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b720dfd6-7f2c-4bcd-b904-9dad764ddfe8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:04.384332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b720dfd6-7f2c-4bcd-b904-9dad764ddfe8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:04.386901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b720dfd6-7f2c-4bcd-b904-9dad764ddfe8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:04.390805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b720dfd6-7f2c-4bcd-b904-9dad764ddfe8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:04.812798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b720dfd6-7f2c-4bcd-b904-9dad764ddfe8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:04.837663 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b720dfd6-7f2c-4bcd-b904-9dad764ddfe8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1346 microversion: 2.1 time: 0.501389 Aug 09 17:17:04.876161 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1038/2148] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:04 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1346 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:17:04.885077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:04.886175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:04.895923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:04.897981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:04.899129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:04.900857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:04.902980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:04.904165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:05.148171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7edd401d-22cc-4d26-a650-68fab9599532 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:05.194159 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7edd401d-22cc-4d26-a650-68fab9599532 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1466 microversion: 2.1 time: 1.060393 Aug 09 17:17:05.206767 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1111/2149] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:04 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1466 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:05.273167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:05.313017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:05.318477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:05.324116 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-652e262b-ef66-4ea7-a7dc-8f7f598fe4ad tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.449412 Aug 09 17:17:05.326689 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1039/2150] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:04 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:05.868010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ea11d47-05b6-48df-add0-f67c09ef7957 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Calling method '.version_select at 0x7fbbcaf61160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:05.882359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-949a5c99-f2dd-4ddf-ae94-61b6cd046523 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:05.883582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-949a5c99-f2dd-4ddf-ae94-61b6cd046523 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:05.945068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-949a5c99-f2dd-4ddf-ae94-61b6cd046523 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:05.952092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-949a5c99-f2dd-4ddf-ae94-61b6cd046523 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:05.959162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-949a5c99-f2dd-4ddf-ae94-61b6cd046523 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:05.962555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-949a5c99-f2dd-4ddf-ae94-61b6cd046523 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:05.965352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-949a5c99-f2dd-4ddf-ae94-61b6cd046523 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:05.968053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-949a5c99-f2dd-4ddf-ae94-61b6cd046523 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:06.184867 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ea11d47-05b6-48df-add0-f67c09ef7957 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/9acb7326e1d14bcca1008ca0eadd32a3" status: 200 len: 371 microversion: 2.1 time: 0.561023 Aug 09 17:17:06.186465 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1112/2151] 10.222.0.93 () {58 vars in 1242 bytes} [Tue Aug 9 17:17:05 2022] GET /compute/v2.1/os-quota-sets/9acb7326e1d14bcca1008ca0eadd32a3 => generated 371 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:06.228785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3abb9999-0c9f-4bff-931c-bc74bc1ef2e2 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Action: 'update', calling method: .version_select at 0x7fbbdc85db80>, body: {"quota_set": {"ram": "5120"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:06.438104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abb9999-0c9f-4bff-931c-bc74bc1ef2e2 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:06.442871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abb9999-0c9f-4bff-931c-bc74bc1ef2e2 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:06.444040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abb9999-0c9f-4bff-931c-bc74bc1ef2e2 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:06.450278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abb9999-0c9f-4bff-931c-bc74bc1ef2e2 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:06.451338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abb9999-0c9f-4bff-931c-bc74bc1ef2e2 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:06.455431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abb9999-0c9f-4bff-931c-bc74bc1ef2e2 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:06.458025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-949a5c99-f2dd-4ddf-ae94-61b6cd046523 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:06.486937 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-949a5c99-f2dd-4ddf-ae94-61b6cd046523 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1346 microversion: 2.1 time: 0.613377 Aug 09 17:17:06.487751 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1040/2152] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:05 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1346 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:06.496898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-588beeef-547e-4e9d-86b3-fb5c8a331fc8 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:06.497541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-588beeef-547e-4e9d-86b3-fb5c8a331fc8 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:06.530335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-588beeef-547e-4e9d-86b3-fb5c8a331fc8 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:06.530855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-588beeef-547e-4e9d-86b3-fb5c8a331fc8 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:06.537854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-588beeef-547e-4e9d-86b3-fb5c8a331fc8 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:06.538746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-588beeef-547e-4e9d-86b3-fb5c8a331fc8 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:06.542024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-588beeef-547e-4e9d-86b3-fb5c8a331fc8 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:06.542383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-588beeef-547e-4e9d-86b3-fb5c8a331fc8 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:06.738385 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3abb9999-0c9f-4bff-931c-bc74bc1ef2e2 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/9acb7326e1d14bcca1008ca0eadd32a3" status: 200 len: 328 microversion: 2.1 time: 0.537188 Aug 09 17:17:06.751241 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1113/2153] 10.222.0.93 () {60 vars in 1262 bytes} [Tue Aug 9 17:17:06 2022] PUT /compute/v2.1/os-quota-sets/9acb7326e1d14bcca1008ca0eadd32a3 => generated 328 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:17:06.761251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:06.763013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:06.774761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:06.776365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:06.777830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:06.780154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:06.781192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:06.782136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:06.901267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:06.927145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:06.944259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:06.946615 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86d684e7-1927-4c0e-a9af-87193c1a34bf tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.193014 Aug 09 17:17:06.968085 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1114/2154] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:06 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:06.988674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-384d4c93-8783-45dc-b33a-6568e3261a9c tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:07.017691 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-384d4c93-8783-45dc-b33a-6568e3261a9c tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-quota-sets/9acb7326e1d14bcca1008ca0eadd32a3" status: 202 len: 0 microversion: 2.1 time: 0.047074 Aug 09 17:17:07.019115 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1115/2155] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:17:06 2022] DELETE /compute/v2.1/os-quota-sets/9acb7326e1d14bcca1008ca0eadd32a3 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:17:07.037687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b0ed54d-1b8e-42d6-a7e2-e9f91adeff23 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Calling method '.version_select at 0x7fbbdc85d280>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:07.211584 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b0ed54d-1b8e-42d6-a7e2-e9f91adeff23 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/9acb7326e1d14bcca1008ca0eadd32a3" status: 200 len: 371 microversion: 2.1 time: 0.184336 Aug 09 17:17:07.216422 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1116/2156] 10.222.0.93 () {58 vars in 1242 bytes} [Tue Aug 9 17:17:07 2022] GET /compute/v2.1/os-quota-sets/9acb7326e1d14bcca1008ca0eadd32a3 => generated 371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:07.515123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1c28180-9588-4f88-834c-01b187ef0942 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:07.523435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1c28180-9588-4f88-834c-01b187ef0942 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:07.573264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c28180-9588-4f88-834c-01b187ef0942 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:07.574683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c28180-9588-4f88-834c-01b187ef0942 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:07.575934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c28180-9588-4f88-834c-01b187ef0942 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:07.577720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c28180-9588-4f88-834c-01b187ef0942 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:07.584008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c28180-9588-4f88-834c-01b187ef0942 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:07.585725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c28180-9588-4f88-834c-01b187ef0942 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:07.853949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a1c28180-9588-4f88-834c-01b187ef0942 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:07.869171 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1c28180-9588-4f88-834c-01b187ef0942 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1346 microversion: 2.1 time: 0.362547 Aug 09 17:17:07.874099 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1117/2157] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:07 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1346 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:17:07.899534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fbb70a11-afaa-48a1-9acb-bd00c0734e63 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Calling method '.version_select at 0x7fbbdc85d5e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:08.904851 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fbb70a11-afaa-48a1-9acb-bd00c0734e63 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/6873c8b8f0cb4e678556e2208b7be3f8/defaults" status: 200 len: 371 microversion: 2.1 time: 1.025285 Aug 09 17:17:08.908687 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1118/2158] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:17:07 2022] GET /compute/v2.1/os-quota-sets/6873c8b8f0cb4e678556e2208b7be3f8/defaults => generated 371 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:08.930196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:08.931850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:08.948148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:08.953119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:08.958343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:08.962154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:08.969612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:08.971105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:09.294672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:09.312181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:09.321509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:09.327413 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-48110a4b-e0ce-411b-9b56-e12e6d650608 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.412468 Aug 09 17:17:09.351527 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1119/2159] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:08 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:09.384688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-256f1593-f2e5-4dc1-b037-3ad7da0988e9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:09.391122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-256f1593-f2e5-4dc1-b037-3ad7da0988e9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:09.438110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-256f1593-f2e5-4dc1-b037-3ad7da0988e9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:09.442028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-256f1593-f2e5-4dc1-b037-3ad7da0988e9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:09.445834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-256f1593-f2e5-4dc1-b037-3ad7da0988e9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:09.456440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-256f1593-f2e5-4dc1-b037-3ad7da0988e9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:09.457476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-256f1593-f2e5-4dc1-b037-3ad7da0988e9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:09.460509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-256f1593-f2e5-4dc1-b037-3ad7da0988e9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:09.704343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-256f1593-f2e5-4dc1-b037-3ad7da0988e9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:09.756483 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-256f1593-f2e5-4dc1-b037-3ad7da0988e9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1346 microversion: 2.1 time: 0.402077 Aug 09 17:17:09.766196 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1120/2160] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:09 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1346 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:10.793549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1786145626", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "a8fa3aa4-1be2-4e9f-958e-53fc196c24bf"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:10.941022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] validate_networks() for [('a8fa3aa4-1be2-4e9f-958e-53fc196c24bf', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:17:11.126565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-588beeef-547e-4e9d-86b3-fb5c8a331fc8 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:11.213637 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-588beeef-547e-4e9d-86b3-fb5c8a331fc8 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 200 len: 1466 microversion: 2.1 time: 4.713976 Aug 09 17:17:11.215128 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1041/2161] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:06 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 1466 bytes in 4727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:11.248821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d768794a-d8e9-4748-8fd0-3e5b715fc89f req-f9183a63-71a2-44f3-9ae1-2b02836f8548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbeac06-53d0-4056-b620-348d2313b6fd", "name": "network-vif-unplugged", "status": "completed", "tag": "1c369903-1ade-4859-8a29-9908638f53bb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:11.301102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:11.321700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d768794a-d8e9-4748-8fd0-3e5b715fc89f req-f9183a63-71a2-44f3-9ae1-2b02836f8548 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:11.323327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d768794a-d8e9-4748-8fd0-3e5b715fc89f req-f9183a63-71a2-44f3-9ae1-2b02836f8548 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:11.326518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d768794a-d8e9-4748-8fd0-3e5b715fc89f req-f9183a63-71a2-44f3-9ae1-2b02836f8548 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:11.368674 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d768794a-d8e9-4748-8fd0-3e5b715fc89f req-f9183a63-71a2-44f3-9ae1-2b02836f8548 service nova] Creating event network-vif-unplugged:1c369903-1ade-4859-8a29-9908638f53bb for instance acbeac06-53d0-4056-b620-348d2313b6fd on n-h2-845781-6 Aug 09 17:17:11.379221 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d768794a-d8e9-4748-8fd0-3e5b715fc89f req-f9183a63-71a2-44f3-9ae1-2b02836f8548 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156844 Aug 09 17:17:11.381851 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1042/2162] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:11.394940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c68630cf-9f6c-431a-adc4-6ad9870d1a6f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcb45c1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:11.675413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c68630cf-9f6c-431a-adc4-6ad9870d1a6f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:11.676914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c68630cf-9f6c-431a-adc4-6ad9870d1a6f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:11.680068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c68630cf-9f6c-431a-adc4-6ad9870d1a6f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:11.682094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c68630cf-9f6c-431a-adc4-6ad9870d1a6f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:11.683545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c68630cf-9f6c-431a-adc4-6ad9870d1a6f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:11.684684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c68630cf-9f6c-431a-adc4-6ad9870d1a6f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:11.904591 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c68630cf-9f6c-431a-adc4-6ad9870d1a6f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/e007f42eb3d44184b52b9d101b289429" status: 200 len: 328 microversion: 2.1 time: 0.516991 Aug 09 17:17:11.916290 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1043/2163] 10.222.0.93 () {60 vars in 1262 bytes} [Tue Aug 9 17:17:11 2022] PUT /compute/v2.1/os-quota-sets/e007f42eb3d44184b52b9d101b289429 => generated 328 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:11.916290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:11.917959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:11.944810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:11.946218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:11.947356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:11.949233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:11.950436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:11.951688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:12.401409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:12.444936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:12.446970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:12.450163 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5a665e83-e1bb-4059-a1ba-370d30c6e812 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.542050 Aug 09 17:17:12.464585 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1044/2164] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:11 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:12.481925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8b5d76aa-690f-47cc-a42d-dcbb6e5ddcc1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:12.483162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8b5d76aa-690f-47cc-a42d-dcbb6e5ddcc1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:12.487758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:17:12.490155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:17:12.491570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:17:12.500414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:17:12.508933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:17:12.512707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b5d76aa-690f-47cc-a42d-dcbb6e5ddcc1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:12.513482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b5d76aa-690f-47cc-a42d-dcbb6e5ddcc1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:12.515842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b5d76aa-690f-47cc-a42d-dcbb6e5ddcc1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:12.516778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b5d76aa-690f-47cc-a42d-dcbb6e5ddcc1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:12.527997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b5d76aa-690f-47cc-a42d-dcbb6e5ddcc1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:12.529117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b5d76aa-690f-47cc-a42d-dcbb6e5ddcc1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:12.609736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:12.616497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:12.622360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:12.627161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:12.634192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:12.634683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:12.684001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Getting quotas for project 7c7fc9e11a9a4343b3d9e5b66e7c18ef. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:17:12.691177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Getting quotas for user 690e63b241a741128f7c2d12f5cc3cef and project 7c7fc9e11a9a4343b3d9e5b66e7c18ef. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:17:12.710878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:17:12.713812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:17:12.753586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:12.795352 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0bbe24da-192f-4171-99cb-f05833c75d3b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.022410 Aug 09 17:17:12.807876 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1121/2165] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:17:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:17:12.828661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-69e2c2f3-6a9d-4eaf-9fc9-b203f5b1f973 req-7403d420-146d-4923-9870-3654e1eac687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acbeac06-53d0-4056-b620-348d2313b6fd", "name": "network-vif-deleted", "tag": "1c369903-1ade-4859-8a29-9908638f53bb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:12.851443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-69e2c2f3-6a9d-4eaf-9fc9-b203f5b1f973 req-7403d420-146d-4923-9870-3654e1eac687 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:12.852065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-69e2c2f3-6a9d-4eaf-9fc9-b203f5b1f973 req-7403d420-146d-4923-9870-3654e1eac687 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:12.852517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-69e2c2f3-6a9d-4eaf-9fc9-b203f5b1f973 req-7403d420-146d-4923-9870-3654e1eac687 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:12.875264 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-69e2c2f3-6a9d-4eaf-9fc9-b203f5b1f973 req-7403d420-146d-4923-9870-3654e1eac687 service nova] Creating event network-vif-deleted:1c369903-1ade-4859-8a29-9908638f53bb for instance acbeac06-53d0-4056-b620-348d2313b6fd on n-h2-845781-6 Aug 09 17:17:12.887733 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-69e2c2f3-6a9d-4eaf-9fc9-b203f5b1f973 req-7403d420-146d-4923-9870-3654e1eac687 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085239 Aug 09 17:17:12.888875 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1122/2166] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:12.895373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-854d4dfa-61fd-46d8-995f-5c38682fa2de tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Calling method '.version_select at 0x7fbbdc8bc550>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:13.093742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8b5d76aa-690f-47cc-a42d-dcbb6e5ddcc1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:13.102444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-854d4dfa-61fd-46d8-995f-5c38682fa2de tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:13.105953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-854d4dfa-61fd-46d8-995f-5c38682fa2de tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:13.106782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-854d4dfa-61fd-46d8-995f-5c38682fa2de tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:13.108291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-854d4dfa-61fd-46d8-995f-5c38682fa2de tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:13.129157 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8b5d76aa-690f-47cc-a42d-dcbb6e5ddcc1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1346 microversion: 2.1 time: 0.656989 Aug 09 17:17:13.132169 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1045/2167] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:12 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1346 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:13.137700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-854d4dfa-61fd-46d8-995f-5c38682fa2de tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:13.138608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-854d4dfa-61fd-46d8-995f-5c38682fa2de tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:13.159013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:13.162983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: acbeac06-53d0-4056-b620-348d2313b6fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:13.181289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:13.183596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:13.185115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:13.186799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:13.187813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:13.189237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:13.219960 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-854d4dfa-61fd-46d8-995f-5c38682fa2de tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/e007f42eb3d44184b52b9d101b289429/detail" status: 200 len: 916 microversion: 2.1 time: 0.329165 Aug 09 17:17:13.222033 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1123/2168] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:17:12 2022] GET /compute/v2.1/os-quota-sets/e007f42eb3d44184b52b9d101b289429/detail => generated 916 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:13.223686 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] HTTP exception thrown: Instance acbeac06-53d0-4056-b620-348d2313b6fd could not be found. Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Request method failure captured: Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd HTTP/1.1 Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pZOmz1GTesGC2IoIumG4Ql4OWLVqrGVAVrM33Mz9R1C_gh6qfDOzqZloR87Y6oUbnLk5ybqipXClpNawWJonaAuq29CNyVMp1orKdLHkxepmicSi729zkByyH4XBGt6Bh1eWUiVl5rQ4p16eIdg3nZ8kKzBCtfWlBQMRQ1U40uGlrw Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 6a92a0d7635044099c4c6a08a32d8cf5 Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-LiveMigrationNegativeTest-2037525572 Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6a92a0d7635044099c4c6a08a32d8cf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a92a0d7635044099c4c6a08a32d8cf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a92a0d7635044099c4c6a08a32d8cf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6a92a0d7635044099c4c6a08a32d8cf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-LiveMigrationNegativeTest-2037525572 Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 6a92a0d7635044099c4c6a08a32d8cf5 Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2037525572 Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-LiveMigrationNegativeTest-2037525572-project Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: e89975c7af914cfb98b24f2b13253c83 Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-LiveMigrationNegativeTest-2037525572-project Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance acbeac06-53d0-4056-b620-348d2313b6fd could not be found. Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'acbeac06-53d0-4056-b620-348d2313b6fd'} Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acbeac06-53d0-4056-b620-348d2313b6fd could not be found. Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acbeac06-53d0-4056-b620-348d2313b6fd could not be found. Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:13.227943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:13.231970 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:13.231970 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:13.231970 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:13.231970 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:13.231970 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:13.231970 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acbeac06-53d0-4056-b620-348d2313b6fd could not be found. Aug 09 17:17:13.231970 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:13.231970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Returning 404 to user: Instance acbeac06-53d0-4056-b620-348d2313b6fd could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:13.231970 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c5a5946e-5cbd-40c5-9e21-ca0848f6cd6c tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd" status: 404 len: 111 microversion: 2.1 time: 0.095928 Aug 09 17:17:13.236267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-876d0522-4914-4c0c-8ce9-b6c88ad77e49 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:13.237348 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1046/2169] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:13 2022] GET /compute/v2.1/servers/acbeac06-53d0-4056-b620-348d2313b6fd => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:17:13.238111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-876d0522-4914-4c0c-8ce9-b6c88ad77e49 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:13.249437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0a44ae51-8132-42d2-a2c8-4f3e15f64602 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:13.250463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0a44ae51-8132-42d2-a2c8-4f3e15f64602 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:13.267791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a44ae51-8132-42d2-a2c8-4f3e15f64602 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:13.269588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a44ae51-8132-42d2-a2c8-4f3e15f64602 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:13.273114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a44ae51-8132-42d2-a2c8-4f3e15f64602 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:13.276986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a44ae51-8132-42d2-a2c8-4f3e15f64602 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:13.280839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a44ae51-8132-42d2-a2c8-4f3e15f64602 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:13.282264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a44ae51-8132-42d2-a2c8-4f3e15f64602 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:13.343500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0a44ae51-8132-42d2-a2c8-4f3e15f64602 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:17:13.361208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-876d0522-4914-4c0c-8ce9-b6c88ad77e49 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:13.375546 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-876d0522-4914-4c0c-8ce9-b6c88ad77e49 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1217 microversion: 2.1 time: 0.151482 Aug 09 17:17:13.376935 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1124/2170] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:13 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:13.503070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:13.507894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:13.535164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:13.535980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:13.541490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:13.543148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:13.543831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:13.544427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:13.652631 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0a44ae51-8132-42d2-a2c8-4f3e15f64602 tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "DELETE /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 204 len: 0 microversion: 2.1 time: 0.413111 Aug 09 17:17:13.653243 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1047/2171] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:17:13 2022] DELETE /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:17:13.672807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a4021ed-782c-4545-8c4d-7b33ba8bc58d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:13.675334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9a4021ed-782c-4545-8c4d-7b33ba8bc58d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:13.698034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a4021ed-782c-4545-8c4d-7b33ba8bc58d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:13.699320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a4021ed-782c-4545-8c4d-7b33ba8bc58d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:13.700700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a4021ed-782c-4545-8c4d-7b33ba8bc58d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:13.703159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a4021ed-782c-4545-8c4d-7b33ba8bc58d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:13.705106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a4021ed-782c-4545-8c4d-7b33ba8bc58d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:13.706823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a4021ed-782c-4545-8c4d-7b33ba8bc58d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:13.794088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:13.826052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:13.831236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:13.836561 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-768a93a4-112f-45e3-a524-d0bd76165f77 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.341999 Aug 09 17:17:13.857781 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1125/2172] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:13 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:17:13.900235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Action: 'update', calling method: .version_select at 0x7fbbdc9f4af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:14.013344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:14.014268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:14.015175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:14.017088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:14.018150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:14.018882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:14.095120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:14.096784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:14.098777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:14.100913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:14.102481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:14.103997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:14.139953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:14.278875 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1d676c92-03dd-42d6-a9e8-37c2a18a805f tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/e007f42eb3d44184b52b9d101b289429?user_id=8828f3c1b86c4472a37c2cca037937cd" status: 200 len: 328 microversion: 2.1 time: 0.416585 Aug 09 17:17:14.295586 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1126/2173] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:17:13 2022] PUT /compute/v2.1/os-quota-sets/e007f42eb3d44184b52b9d101b289429?user_id=8828f3c1b86c4472a37c2cca037937cd => generated 328 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:14.297224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d4ac584-be5c-4652-995e-06a8891f0b97 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:14.298419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d4ac584-be5c-4652-995e-06a8891f0b97 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:14.318921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4ac584-be5c-4652-995e-06a8891f0b97 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:14.320844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4ac584-be5c-4652-995e-06a8891f0b97 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:14.321686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4ac584-be5c-4652-995e-06a8891f0b97 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:14.324772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4ac584-be5c-4652-995e-06a8891f0b97 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:14.325785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4ac584-be5c-4652-995e-06a8891f0b97 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:14.326639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4ac584-be5c-4652-995e-06a8891f0b97 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:14.427980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8d4ac584-be5c-4652-995e-06a8891f0b97 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:14.448070 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d4ac584-be5c-4652-995e-06a8891f0b97 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1346 microversion: 2.1 time: 0.161901 Aug 09 17:17:14.449535 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1127/2174] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:14 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1346 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:14.487121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5fe9901d-10a4-447d-83d5-408a5567ed85 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Calling method '.version_select at 0x7fbbdc992a60>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:14.837470 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5fe9901d-10a4-447d-83d5-408a5567ed85 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/e007f42eb3d44184b52b9d101b289429?user_id=8828f3c1b86c4472a37c2cca037937cd" status: 200 len: 370 microversion: 2.1 time: 0.366551 Aug 09 17:17:14.846519 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1128/2175] 10.222.0.93 () {58 vars in 1323 bytes} [Tue Aug 9 17:17:14 2022] GET /compute/v2.1/os-quota-sets/e007f42eb3d44184b52b9d101b289429?user_id=8828f3c1b86c4472a37c2cca037937cd => generated 370 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:14.877676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2c367e51-d57e-44d4-90d6-871fc72e1213 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:14.887585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2c367e51-d57e-44d4-90d6-871fc72e1213 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:14.923462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c367e51-d57e-44d4-90d6-871fc72e1213 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:14.924009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c367e51-d57e-44d4-90d6-871fc72e1213 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:14.924462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c367e51-d57e-44d4-90d6-871fc72e1213 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:14.928114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c367e51-d57e-44d4-90d6-871fc72e1213 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:14.928619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c367e51-d57e-44d4-90d6-871fc72e1213 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:14.931271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c367e51-d57e-44d4-90d6-871fc72e1213 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:15.357803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2c367e51-d57e-44d4-90d6-871fc72e1213 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:15.384485 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2c367e51-d57e-44d4-90d6-871fc72e1213 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1269 microversion: 2.1 time: 0.528205 Aug 09 17:17:15.388187 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1129/2176] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:14 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1269 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:15.448162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:15.451111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:15.481467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:15.482451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:15.502969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:15.509595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:15.513520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:15.514981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:15.552021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a4021ed-782c-4545-8c4d-7b33ba8bc58d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:15.594387 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a4021ed-782c-4545-8c4d-7b33ba8bc58d tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1474 microversion: 2.1 time: 1.924906 Aug 09 17:17:15.599851 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1048/2177] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:13 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1474 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:15.616854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1333977b-ae5a-4e03-a736-709d34e72b55 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:15.623169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1333977b-ae5a-4e03-a736-709d34e72b55 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:15.641609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1333977b-ae5a-4e03-a736-709d34e72b55 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:15.644764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1333977b-ae5a-4e03-a736-709d34e72b55 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:15.648435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1333977b-ae5a-4e03-a736-709d34e72b55 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:15.654338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1333977b-ae5a-4e03-a736-709d34e72b55 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:15.656917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1333977b-ae5a-4e03-a736-709d34e72b55 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:15.657860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1333977b-ae5a-4e03-a736-709d34e72b55 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:15.787561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:15.801708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:15.811824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:15.818576 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-810ac40f-620b-4b24-90ac-f4bdb4d5ffa8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.424741 Aug 09 17:17:15.824231 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1130/2178] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:15 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:15.869788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a6a102ca-42b0-4cac-a6f8-fdf2343716e4 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Calling method '.version_select at 0x7fbbdc9cee50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:16.052859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1333977b-ae5a-4e03-a736-709d34e72b55 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:16.075375 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1333977b-ae5a-4e03-a736-709d34e72b55 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1346 microversion: 2.1 time: 0.473108 Aug 09 17:17:16.077400 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1049/2179] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:15 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1346 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:16.433864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5e12820-3d9b-4860-a574-0e6687fe2bca tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:16.437274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5e12820-3d9b-4860-a574-0e6687fe2bca tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:16.478191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e12820-3d9b-4860-a574-0e6687fe2bca tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:16.481137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e12820-3d9b-4860-a574-0e6687fe2bca tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:16.483839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e12820-3d9b-4860-a574-0e6687fe2bca tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:16.486741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e12820-3d9b-4860-a574-0e6687fe2bca tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:16.492276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e12820-3d9b-4860-a574-0e6687fe2bca tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:16.496845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e12820-3d9b-4860-a574-0e6687fe2bca tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:16.744167 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a6a102ca-42b0-4cac-a6f8-fdf2343716e4 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/6873c8b8f0cb4e678556e2208b7be3f8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.880301 Aug 09 17:17:16.751846 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1131/2180] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:17:15 2022] GET /compute/v2.1/os-quota-sets/6873c8b8f0cb4e678556e2208b7be3f8/defaults => generated 371 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:16.755269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ae08c8d-5b59-49cd-ba27-20cd454c283e tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:16.757228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ae08c8d-5b59-49cd-ba27-20cd454c283e tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:16.768999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae08c8d-5b59-49cd-ba27-20cd454c283e tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:16.777238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae08c8d-5b59-49cd-ba27-20cd454c283e tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:16.778182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae08c8d-5b59-49cd-ba27-20cd454c283e tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:16.780169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae08c8d-5b59-49cd-ba27-20cd454c283e tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:16.781097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae08c8d-5b59-49cd-ba27-20cd454c283e tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:16.781885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae08c8d-5b59-49cd-ba27-20cd454c283e tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:17.140212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e5e12820-3d9b-4860-a574-0e6687fe2bca tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:17.161137 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5e12820-3d9b-4860-a574-0e6687fe2bca tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1275 microversion: 2.1 time: 0.736677 Aug 09 17:17:17.162880 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1050/2181] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:16 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1275 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:17.174104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-db794960-44ae-45e1-8e94-2aa95347bcff tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcbc69dc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:17.400852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db794960-44ae-45e1-8e94-2aa95347bcff tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:17.402040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db794960-44ae-45e1-8e94-2aa95347bcff tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:17.403005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db794960-44ae-45e1-8e94-2aa95347bcff tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:17.404734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db794960-44ae-45e1-8e94-2aa95347bcff tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:17.406072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db794960-44ae-45e1-8e94-2aa95347bcff tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:17.407463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db794960-44ae-45e1-8e94-2aa95347bcff tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:18.006913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5ae08c8d-5b59-49cd-ba27-20cd454c283e tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89975c7af914cfb98b24f2b13253c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a92a0d7635044099c4c6a08a32d8cf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:18.063107 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-db794960-44ae-45e1-8e94-2aa95347bcff tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/6873c8b8f0cb4e678556e2208b7be3f8" status: 200 len: 329 microversion: 2.1 time: 0.898546 Aug 09 17:17:18.065364 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1051/2182] 10.222.0.93 () {60 vars in 1263 bytes} [Tue Aug 9 17:17:17 2022] PUT /compute/v2.1/os-quota-sets/6873c8b8f0cb4e678556e2208b7be3f8 => generated 329 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:18.080030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:18.080571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:18.101847 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ae08c8d-5b59-49cd-ba27-20cd454c283e tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 200 len: 1474 microversion: 2.1 time: 1.353600 Aug 09 17:17:18.116771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:18.116771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:18.118918 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1132/2183] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:16 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 1474 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:18.119050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:18.119050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:18.119050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:18.119050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:18.163523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b45549a0-0911-4c30-a22a-c5b280a51a9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:18.164959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b45549a0-0911-4c30-a22a-c5b280a51a9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:18.177510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45549a0-0911-4c30-a22a-c5b280a51a9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:18.179109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45549a0-0911-4c30-a22a-c5b280a51a9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:18.180388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45549a0-0911-4c30-a22a-c5b280a51a9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:18.181813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45549a0-0911-4c30-a22a-c5b280a51a9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:18.184188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45549a0-0911-4c30-a22a-c5b280a51a9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:18.185219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45549a0-0911-4c30-a22a-c5b280a51a9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:18.478770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b45549a0-0911-4c30-a22a-c5b280a51a9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:18.557591 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b45549a0-0911-4c30-a22a-c5b280a51a9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 200 len: 1346 microversion: 2.1 time: 0.444755 Aug 09 17:17:18.558205 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1133/2184] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:18 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 1346 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:18.591764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a179f49-c933-4af5-812d-c0231475caa5 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcaf73c10>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:18.822295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:18.878962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a179f49-c933-4af5-812d-c0231475caa5 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:18.880169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a179f49-c933-4af5-812d-c0231475caa5 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:18.882620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a179f49-c933-4af5-812d-c0231475caa5 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:18.885640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a179f49-c933-4af5-812d-c0231475caa5 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:18.886495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a179f49-c933-4af5-812d-c0231475caa5 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:18.887338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a179f49-c933-4af5-812d-c0231475caa5 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:18.900409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:18.910983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:18.922971 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b60edaf6-da74-4c44-8973-d488b0301591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.841986 Aug 09 17:17:18.925295 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1052/2185] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:18 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:18.954955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f40dbfaf-7403-4a33-857d-2af54bbcf3fb tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:18.957862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f40dbfaf-7403-4a33-857d-2af54bbcf3fb tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:19.006414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f40dbfaf-7403-4a33-857d-2af54bbcf3fb tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:19.008104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f40dbfaf-7403-4a33-857d-2af54bbcf3fb tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:19.009209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f40dbfaf-7403-4a33-857d-2af54bbcf3fb tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:19.013304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f40dbfaf-7403-4a33-857d-2af54bbcf3fb tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:19.014120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f40dbfaf-7403-4a33-857d-2af54bbcf3fb tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:19.018517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f40dbfaf-7403-4a33-857d-2af54bbcf3fb tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:19.449069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:INSERT=13,nova_api:SELECT=79,nova_api:UPDATE=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:19.867680 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9a179f49-c933-4af5-812d-c0231475caa5 tempest-QuotasAdminTestJSON-1218047602 tempest-QuotasAdminTestJSON-1218047602-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/6873c8b8f0cb4e678556e2208b7be3f8" status: 200 len: 329 microversion: 2.1 time: 1.292072 Aug 09 17:17:19.868980 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1134/2186] 10.222.0.93 () {60 vars in 1263 bytes} [Tue Aug 9 17:17:18 2022] PUT /compute/v2.1/os-quota-sets/6873c8b8f0cb4e678556e2208b7be3f8 => generated 329 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:19.897728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6c6003b6-6b80-4ab6-8c1d-7450e7846179 req-eb8f2ecc-8095-46a0-912f-86b78af54d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974eba3e-f255-482b-86c3-c76e7f0d994f", "name": "network-vif-deleted", "tag": "95761b7b-443e-410d-a0af-09df4d2a4cd2"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:19.926170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6c6003b6-6b80-4ab6-8c1d-7450e7846179 req-eb8f2ecc-8095-46a0-912f-86b78af54d7d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:19.927070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6c6003b6-6b80-4ab6-8c1d-7450e7846179 req-eb8f2ecc-8095-46a0-912f-86b78af54d7d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:19.928607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6c6003b6-6b80-4ab6-8c1d-7450e7846179 req-eb8f2ecc-8095-46a0-912f-86b78af54d7d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:19.972661 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6c6003b6-6b80-4ab6-8c1d-7450e7846179 req-eb8f2ecc-8095-46a0-912f-86b78af54d7d service nova] Creating event network-vif-deleted:95761b7b-443e-410d-a0af-09df4d2a4cd2 for instance 974eba3e-f255-482b-86c3-c76e7f0d994f on n-h1-845781-6 Aug 09 17:17:19.998429 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6c6003b6-6b80-4ab6-8c1d-7450e7846179 req-eb8f2ecc-8095-46a0-912f-86b78af54d7d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111931 Aug 09 17:17:19.999242 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1135/2187] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:20.025774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:20.031498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] [instance: 974eba3e-f255-482b-86c3-c76e7f0d994f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:20.057688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:20.059455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:20.065980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:20.070448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:20.072475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:20.074223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:20.099270 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] HTTP exception thrown: Instance 974eba3e-f255-482b-86c3-c76e7f0d994f could not be found. Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Request method failure captured: Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f HTTP/1.1 Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pZOmz1GTesGC2IoIumG4Ql4OWLVqrGVAVrM33Mz9R1C_gh6qfDOzqZloR87Y6oUbnLk5ybqipXClpNawWJonaAuq29CNyVMp1orKdLHkxepmicSi729zkByyH4XBGt6Bh1eWUiVl5rQ4p16eIdg3nZ8kKzBCtfWlBQMRQ1U40uGlrw Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 6a92a0d7635044099c4c6a08a32d8cf5 Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-LiveMigrationNegativeTest-2037525572 Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6a92a0d7635044099c4c6a08a32d8cf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a92a0d7635044099c4c6a08a32d8cf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6a92a0d7635044099c4c6a08a32d8cf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6a92a0d7635044099c4c6a08a32d8cf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-LiveMigrationNegativeTest-2037525572 Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 6a92a0d7635044099c4c6a08a32d8cf5 Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2037525572 Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-LiveMigrationNegativeTest-2037525572-project Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e89975c7af914cfb98b24f2b13253c83 Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-LiveMigrationNegativeTest-2037525572-project Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 974eba3e-f255-482b-86c3-c76e7f0d994f could not be found. Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '974eba3e-f255-482b-86c3-c76e7f0d994f'} Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974eba3e-f255-482b-86c3-c76e7f0d994f could not be found. Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974eba3e-f255-482b-86c3-c76e7f0d994f could not be found. Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:20.102337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.106609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:20.106609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:20.106609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:20.106609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:20.106609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:20.106609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974eba3e-f255-482b-86c3-c76e7f0d994f could not be found. Aug 09 17:17:20.106609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.106609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] Returning 404 to user: Instance 974eba3e-f255-482b-86c3-c76e7f0d994f could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:20.106609 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-40898a7e-92c5-4744-af56-df92d15bab4b tempest-LiveMigrationNegativeTest-2037525572 tempest-LiveMigrationNegativeTest-2037525572-project] 10.222.0.93 "GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f" status: 404 len: 111 microversion: 2.1 time: 0.100805 Aug 09 17:17:20.106609 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1136/2188] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:19 2022] GET /compute/v2.1/servers/974eba3e-f255-482b-86c3-c76e7f0d994f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:17:20.120268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:20.121075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:20.142359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:20.145445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:20.148510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:20.150357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:20.151741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:20.152862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:20.199225 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 HTTP/1.1 Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'fae1e73e-68f8-4664-81ae-b49d4de1ca63'} Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:20.209738 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.213381 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:20.213381 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:20.213381 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:20.213381 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:20.213381 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:20.213381 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:17:20.213381 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.213381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:20.213913 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-05b36c81-b1ce-41b0-abe1-c0dc0b97f561 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 404 len: 111 microversion: 2.1 time: 0.107271 Aug 09 17:17:20.214790 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1137/2189] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:20 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:17:20.231724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:20.233545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:20.252639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:20.253153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:20.253611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:20.255877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:20.257187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:20.258043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:20.486886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:20.500940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:20.504262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:20.508809 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-823fe4ac-2299-429e-9699-d7a420f690f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.288709 Aug 09 17:17:20.510767 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1138/2190] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:20 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:20.616690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:20.619884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:20.638989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f40dbfaf-7403-4a33-857d-2af54bbcf3fb tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:20.643981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:20.645235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:20.648798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:20.656289 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f40dbfaf-7403-4a33-857d-2af54bbcf3fb tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1275 microversion: 2.1 time: 1.722174 Aug 09 17:17:20.658274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:20.660975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:20.661528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:20.668313 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1053/2191] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:18 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1275 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:20.723701 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63/os-volume_attachments HTTP/1.1 Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': 'fae1e73e-68f8-4664-81ae-b49d4de1ca63'} Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:17:20.734106 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-481145ae-520c-47aa-9470-25388e0e9deb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.132429 Aug 09 17:17:20.740500 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1139/2192] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:17:20 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63/os-volume_attachments => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:17:21.322861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-481229810", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ad48ae09-8243-461d-b010-943470de6d49"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:21.545112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] validate_networks() for [('ad48ae09-8243-461d-b010-943470de6d49', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:17:21.546332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:21.547279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:21.569860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:21.571000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:21.575134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:21.578387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:21.578925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:21.582553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:22.082561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:22.102200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:22.112634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:22.115131 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-84e5fe25-e997-4129-b762-a3e7fdacc392 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.580836 Aug 09 17:17:22.124220 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1140/2193] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:21 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:22.152371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f5ce2051-d2ec-4eef-946c-3a96be61ba52 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:22.153606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f5ce2051-d2ec-4eef-946c-3a96be61ba52 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:22.169173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5ce2051-d2ec-4eef-946c-3a96be61ba52 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:22.169682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5ce2051-d2ec-4eef-946c-3a96be61ba52 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:22.175491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5ce2051-d2ec-4eef-946c-3a96be61ba52 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:22.176822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5ce2051-d2ec-4eef-946c-3a96be61ba52 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:22.177350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5ce2051-d2ec-4eef-946c-3a96be61ba52 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:22.177868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5ce2051-d2ec-4eef-946c-3a96be61ba52 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:23.131849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f5ce2051-d2ec-4eef-946c-3a96be61ba52 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:23.141473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:17:23.143809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:17:23.147412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:17:23.151063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:17:23.155572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:17:23.209970 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f5ce2051-d2ec-4eef-946c-3a96be61ba52 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1317 microversion: 2.1 time: 1.073125 Aug 09 17:17:23.231119 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1141/2194] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:22 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1317 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:23.245632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:23.263104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:23.263701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:23.268665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:23.269539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:23.271925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:23.272394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:23.289701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:23.322806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:23.323340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:23.323834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:23.335135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:23.335676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:23.336144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:23.450835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:17:23.478346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for user d8e1dc1f64fe429ea6a8c746b7c84ae6 and project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:17:23.535313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:17:23.545887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 3b864073-4869-4153-9d23-ffebe17c00e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:17:23.589056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:23.607230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:23.619157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:23.622553 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c4796426-8697-4b11-a937-1d3f9e477808 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.387725 Aug 09 17:17:23.641265 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1142/2195] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:23 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:23.729168 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1f74b929-a5bc-4d05-80ed-cb941e2effbb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.409826 Aug 09 17:17:23.730337 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1054/2196] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:17:23.744413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4c6db696-ec70-407b-bcea-223e2779c9f1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:23.745123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4c6db696-ec70-407b-bcea-223e2779c9f1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 3b864073-4869-4153-9d23-ffebe17c00e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:23.944448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4c6db696-ec70-407b-bcea-223e2779c9f1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:23.962998 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4c6db696-ec70-407b-bcea-223e2779c9f1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0" status: 200 len: 1214 microversion: 2.1 time: 0.224037 Aug 09 17:17:23.963697 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1143/2197] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:23 2022] GET /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0 => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:23.997601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c77ba7b2-51f2-4394-87e8-6b098e7d9213 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:24.000227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c77ba7b2-51f2-4394-87e8-6b098e7d9213 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 3b864073-4869-4153-9d23-ffebe17c00e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:24.075703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c77ba7b2-51f2-4394-87e8-6b098e7d9213 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 3b864073-4869-4153-9d23-ffebe17c00e0] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:17:24.092311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=18,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:24.262301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d19a7b41-f746-4f3c-b943-b9619905fb31 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:24.265199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d19a7b41-f746-4f3c-b943-b9619905fb31 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:24.298016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d19a7b41-f746-4f3c-b943-b9619905fb31 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:24.298758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d19a7b41-f746-4f3c-b943-b9619905fb31 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:24.299471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d19a7b41-f746-4f3c-b943-b9619905fb31 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:24.300706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d19a7b41-f746-4f3c-b943-b9619905fb31 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:24.301215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d19a7b41-f746-4f3c-b943-b9619905fb31 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:24.301735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d19a7b41-f746-4f3c-b943-b9619905fb31 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:25.154226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d19a7b41-f746-4f3c-b943-b9619905fb31 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:25.202273 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d19a7b41-f746-4f3c-b943-b9619905fb31 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1317 microversion: 2.1 time: 0.942620 Aug 09 17:17:25.224886 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1144/2198] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:24 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1317 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:25.252309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:25.254359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:25.309281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:25.311162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:25.316397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:25.328057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:25.333553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:25.343232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:25.901895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:25.948351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:25.950794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:25.958464 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b60305b8-9d11-40f6-b3dd-f79fd111e8ab tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.731694 Aug 09 17:17:25.962092 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1145/2199] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:25 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:26.063785 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.compute.api [None req-c77ba7b2-51f2-4394-87e8-6b098e7d9213 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 3b864073-4869-4153-9d23-ffebe17c00e0] Instance Mapping does not exist while attempting local delete cleanup. Aug 09 17:17:26.072303 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c77ba7b2-51f2-4394-87e8-6b098e7d9213 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0" status: 204 len: 0 microversion: 2.1 time: 2.081876 Aug 09 17:17:26.079084 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1055/2200] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:17:23 2022] DELETE /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0 => generated 0 bytes in 2094 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:17:26.089179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ee4e015-dc8b-4232-8900-076f4242ff3f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:26.090102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ee4e015-dc8b-4232-8900-076f4242ff3f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 3b864073-4869-4153-9d23-ffebe17c00e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:26.098683 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-5ee4e015-dc8b-4232-8900-076f4242ff3f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ee4e015-dc8b-4232-8900-076f4242ff3f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0 HTTP/1.1 Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '3b864073-4869-4153-9d23-ffebe17c00e0'} Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:26.101289 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:26.105722 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:26.105722 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:26.105722 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:26.105722 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:17:26.105722 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:26.107263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ee4e015-dc8b-4232-8900-076f4242ff3f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:26.108451 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ee4e015-dc8b-4232-8900-076f4242ff3f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0" status: 404 len: 111 microversion: 2.1 time: 0.023471 Aug 09 17:17:26.109535 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1146/2201] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:26 2022] GET /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:17:26.250793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9ca5b73d-ac16-4f14-99ea-ea0ec3e6a066 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:26.251503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9ca5b73d-ac16-4f14-99ea-ea0ec3e6a066 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:26.277757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ca5b73d-ac16-4f14-99ea-ea0ec3e6a066 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:26.278307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ca5b73d-ac16-4f14-99ea-ea0ec3e6a066 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:26.278760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ca5b73d-ac16-4f14-99ea-ea0ec3e6a066 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:26.283960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ca5b73d-ac16-4f14-99ea-ea0ec3e6a066 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:26.284467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ca5b73d-ac16-4f14-99ea-ea0ec3e6a066 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:26.287588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ca5b73d-ac16-4f14-99ea-ea0ec3e6a066 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:26.391000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:26.453872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2138663929", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ad48ae09-8243-461d-b010-943470de6d49"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:26.655835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] validate_networks() for [('ad48ae09-8243-461d-b010-943470de6d49', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:17:27.970028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9ca5b73d-ac16-4f14-99ea-ea0ec3e6a066 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:27.989660 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9ca5b73d-ac16-4f14-99ea-ea0ec3e6a066 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1317 microversion: 2.1 time: 1.744171 Aug 09 17:17:28.007936 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1056/2202] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:26 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1317 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:28.017669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:28.019399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:28.045628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:28.050913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:28.056049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:28.057352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:28.058113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:28.060105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:28.347325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:28.370712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:28.376082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:28.383982 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-da0f684f-8055-4338-af32-6782151fc061 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.368181 Aug 09 17:17:28.388885 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1057/2203] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:28 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:28.407310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-cf3541ca-4424-4fd8-b327-38989b3508d2 req-a37b73c2-6cd4-4694-9fbe-0b778380633f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c55760e6-1d24-4302-96ce-cdbdcb9a2b5a", "tag": "aabe483a-b8ea-4c22-b6aa-1fdb011b1466"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:28.450748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cf3541ca-4424-4fd8-b327-38989b3508d2 req-a37b73c2-6cd4-4694-9fbe-0b778380633f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:28.451352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cf3541ca-4424-4fd8-b327-38989b3508d2 req-a37b73c2-6cd4-4694-9fbe-0b778380633f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:28.453490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cf3541ca-4424-4fd8-b327-38989b3508d2 req-a37b73c2-6cd4-4694-9fbe-0b778380633f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:28.497216 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-cf3541ca-4424-4fd8-b327-38989b3508d2 req-a37b73c2-6cd4-4694-9fbe-0b778380633f service nova] Creating event network-changed:aabe483a-b8ea-4c22-b6aa-1fdb011b1466 for instance c55760e6-1d24-4302-96ce-cdbdcb9a2b5a on n-h2-845781-6 Aug 09 17:17:28.520199 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-cf3541ca-4424-4fd8-b327-38989b3508d2 req-a37b73c2-6cd4-4694-9fbe-0b778380633f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125636 Aug 09 17:17:28.520883 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1058/2204] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:28.920591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=13 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:29.021438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eac676f5-3903-44e7-b595-33c3e521f9e1 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:29.022545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eac676f5-3903-44e7-b595-33c3e521f9e1 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:29.054518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eac676f5-3903-44e7-b595-33c3e521f9e1 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:29.055338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eac676f5-3903-44e7-b595-33c3e521f9e1 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:29.055894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eac676f5-3903-44e7-b595-33c3e521f9e1 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:29.056660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eac676f5-3903-44e7-b595-33c3e521f9e1 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:29.057130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eac676f5-3903-44e7-b595-33c3e521f9e1 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:29.057560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eac676f5-3903-44e7-b595-33c3e521f9e1 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:29.148173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:17:29.149088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:17:29.151492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:17:29.152261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:17:29.152999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:17:29.218321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:29.225463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:29.227613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:29.235473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:29.236406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:29.248831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:29.328899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:17:29.344033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for user d8e1dc1f64fe429ea6a8c746b7c84ae6 and project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:17:29.378774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:17:29.385493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:17:29.510756 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c16a952-cdf1-46da-9895-852feac3ac8a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.066282 Aug 09 17:17:29.514814 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1147/2205] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:17:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:17:29.531596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:29.537905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:29.565051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:29.571165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:29.574580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:29.582571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:29.584975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:29.590666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:30.069416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eac676f5-3903-44e7-b595-33c3e521f9e1 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:30.093433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:30.099127 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eac676f5-3903-44e7-b595-33c3e521f9e1 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1317 microversion: 2.1 time: 1.085768 Aug 09 17:17:30.104340 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1059/2206] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:29 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1317 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:30.114201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ce85750a-424b-47c0-ad09-3430fa389d06 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:30.117109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ce85750a-424b-47c0-ad09-3430fa389d06 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:30.133850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:30.136977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:30.153277 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e268a804-2eda-4574-b6ab-f9eb3a79d3d8 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.634361 Aug 09 17:17:30.160137 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1148/2207] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:29 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:30.646813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ce85750a-424b-47c0-ad09-3430fa389d06 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:30.687273 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ce85750a-424b-47c0-ad09-3430fa389d06 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1215 microversion: 2.1 time: 0.573412 Aug 09 17:17:30.688616 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1060/2208] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:30 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1215 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:31.130656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-77ca7c31-0d75-40b2-8b72-9bc7e471ebdc tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:31.132602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-77ca7c31-0d75-40b2-8b72-9bc7e471ebdc tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:31.150722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77ca7c31-0d75-40b2-8b72-9bc7e471ebdc tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:31.151548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77ca7c31-0d75-40b2-8b72-9bc7e471ebdc tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:31.152194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77ca7c31-0d75-40b2-8b72-9bc7e471ebdc tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:31.153134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77ca7c31-0d75-40b2-8b72-9bc7e471ebdc tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:31.153813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77ca7c31-0d75-40b2-8b72-9bc7e471ebdc tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:31.154421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77ca7c31-0d75-40b2-8b72-9bc7e471ebdc tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:31.213703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:31.215079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:31.249550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:31.257608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:31.258361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:31.270430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:31.271171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:31.273993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:31.765077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-77ca7c31-0d75-40b2-8b72-9bc7e471ebdc tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:31.788026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:31.816766 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-77ca7c31-0d75-40b2-8b72-9bc7e471ebdc tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1317 microversion: 2.1 time: 0.689644 Aug 09 17:17:31.821282 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1149/2209] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:31 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:31.840615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f50f80a7-cd4c-43dc-b86c-984e6394f181 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:31.846592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f50f80a7-cd4c-43dc-b86c-984e6394f181 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:31.860603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:31.871225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:31.876483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f50f80a7-cd4c-43dc-b86c-984e6394f181 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:31.876697 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-147f034f-5b14-450b-a7ad-0c994cef86b1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.673836 Aug 09 17:17:31.877499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f50f80a7-cd4c-43dc-b86c-984e6394f181 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:31.880100 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1061/2210] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:31 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:17:31.894849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f50f80a7-cd4c-43dc-b86c-984e6394f181 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:31.902884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f50f80a7-cd4c-43dc-b86c-984e6394f181 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:31.910035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f50f80a7-cd4c-43dc-b86c-984e6394f181 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:31.917317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f50f80a7-cd4c-43dc-b86c-984e6394f181 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:32.082437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-86702311", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "f34a1255-501b-49da-9ee0-31a4243ff3c9"}, {"uuid": "7054bb1f-7799-4491-9c5f-b533a0e43625"}, {"uuid": "f34a1255-501b-49da-9ee0-31a4243ff3c9"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:32.138546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f50f80a7-cd4c-43dc-b86c-984e6394f181 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:32.162746 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f50f80a7-cd4c-43dc-b86c-984e6394f181 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1267 microversion: 2.1 time: 0.339934 Aug 09 17:17:32.165862 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1150/2211] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:31 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1267 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:32.289098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] validate_networks() for [('f34a1255-501b-49da-9ee0-31a4243ff3c9', None, None, None, None, None), ('7054bb1f-7799-4491-9c5f-b533a0e43625', None, None, None, None, None), ('f34a1255-501b-49da-9ee0-31a4243ff3c9', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:17:32.854861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c20d55c-da45-418a-836b-63b6400b645d tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:32.857099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7c20d55c-da45-418a-836b-63b6400b645d tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:32.883768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c20d55c-da45-418a-836b-63b6400b645d tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:32.884941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c20d55c-da45-418a-836b-63b6400b645d tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:32.904047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c20d55c-da45-418a-836b-63b6400b645d tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:32.908172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c20d55c-da45-418a-836b-63b6400b645d tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:32.916082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c20d55c-da45-418a-836b-63b6400b645d tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:32.918926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c20d55c-da45-418a-836b-63b6400b645d tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:33.035460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:33.357251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:33.640478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7c20d55c-da45-418a-836b-63b6400b645d tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:33.681227 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7c20d55c-da45-418a-836b-63b6400b645d tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1317 microversion: 2.1 time: 0.831443 Aug 09 17:17:33.692477 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1151/2212] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:32 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1317 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:33.723576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:33.737435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:33.777283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:33.778193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:33.779002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:33.780238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:33.780900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:33.791611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:34.367901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:34.424205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:34.435113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:34.444561 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-515efaf7-7e10-414b-a09d-abb1c9ff36a1 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.743112 Aug 09 17:17:34.446012 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1152/2213] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:33 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:34.464074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1801fd92-55bc-457a-8356-c6feb1cb921d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:34.471698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1801fd92-55bc-457a-8356-c6feb1cb921d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:34.499583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1801fd92-55bc-457a-8356-c6feb1cb921d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:34.501004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1801fd92-55bc-457a-8356-c6feb1cb921d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:34.504064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1801fd92-55bc-457a-8356-c6feb1cb921d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:34.508384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1801fd92-55bc-457a-8356-c6feb1cb921d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:34.511344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1801fd92-55bc-457a-8356-c6feb1cb921d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:34.513654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1801fd92-55bc-457a-8356-c6feb1cb921d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:35.006620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1801fd92-55bc-457a-8356-c6feb1cb921d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:35.027019 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1801fd92-55bc-457a-8356-c6feb1cb921d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1273 microversion: 2.1 time: 0.575966 Aug 09 17:17:35.028375 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1153/2214] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:34 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1273 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:35.421866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-42a17d2a-587c-4bc6-a9f6-b7c23a5f6e4c tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcaf734c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:35.723937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=81 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:35.731141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42a17d2a-587c-4bc6-a9f6-b7c23a5f6e4c tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:35.735391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42a17d2a-587c-4bc6-a9f6-b7c23a5f6e4c tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:35.736065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42a17d2a-587c-4bc6-a9f6-b7c23a5f6e4c tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:35.737121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42a17d2a-587c-4bc6-a9f6-b7c23a5f6e4c tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:35.737701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42a17d2a-587c-4bc6-a9f6-b7c23a5f6e4c tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:35.738153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42a17d2a-587c-4bc6-a9f6-b7c23a5f6e4c tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:35.862470 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-42a17d2a-587c-4bc6-a9f6-b7c23a5f6e4c tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/70248ee3aa6a4a76bd990fc5bc9da17d" status: 200 len: 148 microversion: 2.57 time: 0.831295 Aug 09 17:17:35.864684 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1154/2215] 10.222.0.93 () {62 vars in 1303 bytes} [Tue Aug 9 17:17:35 2022] PUT /compute/v2.1/os-quota-sets/70248ee3aa6a4a76bd990fc5bc9da17d => generated 148 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:17:35.876391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-30937fc6-eef6-4f1a-9f6c-fdb41584359b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:35.879910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-30937fc6-eef6-4f1a-9f6c-fdb41584359b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:35.902216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30937fc6-eef6-4f1a-9f6c-fdb41584359b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:35.903464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30937fc6-eef6-4f1a-9f6c-fdb41584359b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:35.904168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30937fc6-eef6-4f1a-9f6c-fdb41584359b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:35.905430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30937fc6-eef6-4f1a-9f6c-fdb41584359b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:35.906084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30937fc6-eef6-4f1a-9f6c-fdb41584359b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:35.906684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30937fc6-eef6-4f1a-9f6c-fdb41584359b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:36.697854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-30937fc6-eef6-4f1a-9f6c-fdb41584359b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:36.729812 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-30937fc6-eef6-4f1a-9f6c-fdb41584359b tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1317 microversion: 2.1 time: 0.863124 Aug 09 17:17:36.731265 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1155/2216] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:35 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1317 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:37.350328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-7939254", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": "none"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:37.528249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:17:37.528733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:17:37.529179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:17:37.529604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:17:37.530027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:17:37.549676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=6,nova_api:INSERT=9 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:37.602360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:37.617639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:37.622107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:37.623941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:37.624652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:37.625275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:37.722224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Getting quotas for project 497c3ee8275f4e31bd3d0ceb6522a27d. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:17:37.760842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Getting quotas for user fc746a69826847258f3911c6bfd954bb and project 497c3ee8275f4e31bd3d0ceb6522a27d. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:17:37.792900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:17:37.796207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:17:37.937009 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f1a20732-57d1-4c9b-9fd2-f2032c601afb tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.202588 Aug 09 17:17:37.948886 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1156/2217] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:17:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:17:37.963745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:37.969291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:37.988349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:17:37.989225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:17:37.990405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:17:37.991668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:17:37.992373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:17:37.998988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:38.000167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:38.002508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:38.007763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:38.008944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:38.010805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:38.032139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=53 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:38.051075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:38.065937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:38.066808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:38.072517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:38.073411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:38.074183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:38.191689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Getting quotas for project c273ac15199f43b898faa91983629795. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:17:38.225217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Getting quotas for user d0cb6058852c4b59ae031509affffe65 and project c273ac15199f43b898faa91983629795. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:17:38.283795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:17:38.291058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:17:38.377064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:38.423194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:38.432213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:38.434633 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19e3df2a-ce26-4b47-87fe-ec0ad964af4a tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.487317 Aug 09 17:17:38.440199 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1157/2218] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:37 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:38.457557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4eaaed1e-25a7-4aea-97ad-d52e4a64cece tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Calling method '.version_select at 0x7fbbcbc2d670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:38.516435 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-048bf141-4655-42a4-87bd-ca0324991a64 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.438832 Aug 09 17:17:38.517655 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1062/2219] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:17:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 6442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:17:38.581153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e4cc0771-96ac-4d12-b0c5-b0afd573730a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:38.587920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e4cc0771-96ac-4d12-b0c5-b0afd573730a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:38.665509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cc0771-96ac-4d12-b0c5-b0afd573730a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:38.667479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cc0771-96ac-4d12-b0c5-b0afd573730a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:38.683598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cc0771-96ac-4d12-b0c5-b0afd573730a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:38.684267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cc0771-96ac-4d12-b0c5-b0afd573730a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:38.684881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cc0771-96ac-4d12-b0c5-b0afd573730a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:38.685321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cc0771-96ac-4d12-b0c5-b0afd573730a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:39.041638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e4cc0771-96ac-4d12-b0c5-b0afd573730a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:39.053740 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e4cc0771-96ac-4d12-b0c5-b0afd573730a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1315 microversion: 2.1 time: 0.534533 Aug 09 17:17:39.055459 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1063/2220] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:38 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:39.372246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc56885f-8291-436e-a1c3-2502847ecbfa tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:39.427488 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cc56885f-8291-436e-a1c3-2502847ecbfa tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.357039 Aug 09 17:17:39.429037 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1064/2221] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:17:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:39.464006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9385b8d9-dcda-4dd5-83cf-f1079c75b5aa tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:39.467890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9385b8d9-dcda-4dd5-83cf-f1079c75b5aa tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:39.516984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9385b8d9-dcda-4dd5-83cf-f1079c75b5aa tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:39.520970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9385b8d9-dcda-4dd5-83cf-f1079c75b5aa tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:39.525604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9385b8d9-dcda-4dd5-83cf-f1079c75b5aa tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:39.531210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9385b8d9-dcda-4dd5-83cf-f1079c75b5aa tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:39.539596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9385b8d9-dcda-4dd5-83cf-f1079c75b5aa tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:39.542777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9385b8d9-dcda-4dd5-83cf-f1079c75b5aa tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:39.569750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eaaed1e-25a7-4aea-97ad-d52e4a64cece tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:39.572067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eaaed1e-25a7-4aea-97ad-d52e4a64cece tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:39.572356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eaaed1e-25a7-4aea-97ad-d52e4a64cece tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:39.577718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eaaed1e-25a7-4aea-97ad-d52e4a64cece tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:39.577718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eaaed1e-25a7-4aea-97ad-d52e4a64cece tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:39.579875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eaaed1e-25a7-4aea-97ad-d52e4a64cece tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:39.804561 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4eaaed1e-25a7-4aea-97ad-d52e4a64cece tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/70248ee3aa6a4a76bd990fc5bc9da17d/detail" status: 200 len: 463 microversion: 2.57 time: 1.361732 Aug 09 17:17:39.806839 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1158/2222] 10.222.0.93 () {60 vars in 1304 bytes} [Tue Aug 9 17:17:38 2022] GET /compute/v2.1/os-quota-sets/70248ee3aa6a4a76bd990fc5bc9da17d/detail => generated 463 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:17:39.817929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:39.836486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:39.858625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:39.859815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:39.860839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:39.862376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:39.863667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:39.864869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:40.249219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9385b8d9-dcda-4dd5-83cf-f1079c75b5aa tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:40.347135 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9385b8d9-dcda-4dd5-83cf-f1079c75b5aa tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1317 microversion: 2.1 time: 0.907725 Aug 09 17:17:40.348733 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1065/2223] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:39 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1317 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:40.362404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e022dea-2f42-41de-8b0d-f8f7455f2a09 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:40.364148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2e022dea-2f42-41de-8b0d-f8f7455f2a09 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:40.380183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:40.402408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e022dea-2f42-41de-8b0d-f8f7455f2a09 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:40.405290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:40.407162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e022dea-2f42-41de-8b0d-f8f7455f2a09 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:40.412110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e022dea-2f42-41de-8b0d-f8f7455f2a09 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:40.413337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:40.426536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e022dea-2f42-41de-8b0d-f8f7455f2a09 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:40.428991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e022dea-2f42-41de-8b0d-f8f7455f2a09 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:40.440595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e022dea-2f42-41de-8b0d-f8f7455f2a09 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:40.449339 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-81202112-677d-42ce-8cbd-cc1164d71335 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "PUT /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1360 microversion: 2.75 time: 0.631971 Aug 09 17:17:40.453799 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1159/2224] 10.222.0.93 () {62 vars in 1297 bytes} [Tue Aug 9 17:17:39 2022] PUT /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1360 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:40.503861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-03d1307b-adc1-4993-ac1c-be20fb212a9e tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:40.549106 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-03d1307b-adc1-4993-ac1c-be20fb212a9e tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.079374 Aug 09 17:17:40.551440 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1160/2225] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:17:40 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:40.574737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:40.578454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:40.596740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:40.599129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:40.605575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:40.607034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:40.607803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:40.608584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:40.745520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2e022dea-2f42-41de-8b0d-f8f7455f2a09 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:40.755522 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2e022dea-2f42-41de-8b0d-f8f7455f2a09 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1215 microversion: 2.1 time: 0.404434 Aug 09 17:17:40.778669 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1066/2226] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:40 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1215 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:40.791547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-65738a99-8a09-42a9-ab19-4d13ef84eb6b req-0f88e705-6dc4-4c7d-b3b9-b92c30709776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a83e16f-e6c2-4c94-872d-0b6a08acfa76", "tag": "757c519b-6af4-4d37-9f4f-607454d88c5f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:40.863306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-65738a99-8a09-42a9-ab19-4d13ef84eb6b req-0f88e705-6dc4-4c7d-b3b9-b92c30709776 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:40.865783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-65738a99-8a09-42a9-ab19-4d13ef84eb6b req-0f88e705-6dc4-4c7d-b3b9-b92c30709776 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:40.866856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-65738a99-8a09-42a9-ab19-4d13ef84eb6b req-0f88e705-6dc4-4c7d-b3b9-b92c30709776 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:40.920694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:40.937022 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-65738a99-8a09-42a9-ab19-4d13ef84eb6b req-0f88e705-6dc4-4c7d-b3b9-b92c30709776 service nova] Creating event network-changed:757c519b-6af4-4d37-9f4f-607454d88c5f for instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 on n-h1-845781-6 Aug 09 17:17:40.946151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:40.952003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:40.953876 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5240f6a8-59ab-4f7b-bb53-cc3addcf23f4 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 0.399904 Aug 09 17:17:40.956547 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-65738a99-8a09-42a9-ab19-4d13ef84eb6b req-0f88e705-6dc4-4c7d-b3b9-b92c30709776 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175935 Aug 09 17:17:40.957484 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1161/2227] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:40 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:40.970100 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1067/2228] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:40.981848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ba2b9ae9-a210-45a6-b89f-b8222f9e98c9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:40.982796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba2b9ae9-a210-45a6-b89f-b8222f9e98c9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:41.000905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Action: 'update', calling method: .version_select at 0x7fbbdc8c4a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:41.004650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba2b9ae9-a210-45a6-b89f-b8222f9e98c9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:41.006782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba2b9ae9-a210-45a6-b89f-b8222f9e98c9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:41.008685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba2b9ae9-a210-45a6-b89f-b8222f9e98c9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:41.010974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba2b9ae9-a210-45a6-b89f-b8222f9e98c9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:41.016323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba2b9ae9-a210-45a6-b89f-b8222f9e98c9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:41.017168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba2b9ae9-a210-45a6-b89f-b8222f9e98c9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:41.263715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:41.264549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:41.265479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:41.273098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:41.277249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:41.278757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:41.428870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:41.438447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:41.441570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:41.445431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:41.447543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:41.448063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:41.627146 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cb8d4ac7-1f82-49d5-a237-bec0ed6d6ba2 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/70248ee3aa6a4a76bd990fc5bc9da17d?user_id=de31bf9d1acc465baf81b99fdb06f558" status: 200 len: 148 microversion: 2.57 time: 0.650287 Aug 09 17:17:41.636789 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1068/2229] 10.222.0.93 () {62 vars in 1384 bytes} [Tue Aug 9 17:17:40 2022] PUT /compute/v2.1/os-quota-sets/70248ee3aa6a4a76bd990fc5bc9da17d?user_id=de31bf9d1acc465baf81b99fdb06f558 => generated 148 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:17:41.636789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-8dab4d30-77b8-48db-90fc-2e9ed6b62c5f req-773e679b-a063-4bfd-8d4b-4a5f8f1d36a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c55760e6-1d24-4302-96ce-cdbdcb9a2b5a", "name": "network-vif-plugged", "status": "completed", "tag": "aabe483a-b8ea-4c22-b6aa-1fdb011b1466"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:41.651845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8dab4d30-77b8-48db-90fc-2e9ed6b62c5f req-773e679b-a063-4bfd-8d4b-4a5f8f1d36a4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:41.652346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8dab4d30-77b8-48db-90fc-2e9ed6b62c5f req-773e679b-a063-4bfd-8d4b-4a5f8f1d36a4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:41.652933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8dab4d30-77b8-48db-90fc-2e9ed6b62c5f req-773e679b-a063-4bfd-8d4b-4a5f8f1d36a4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:41.666936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ba2b9ae9-a210-45a6-b89f-b8222f9e98c9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:41.684093 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ba2b9ae9-a210-45a6-b89f-b8222f9e98c9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1315 microversion: 2.1 time: 0.720484 Aug 09 17:17:41.685761 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1162/2230] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:40 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:41.706311 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-8dab4d30-77b8-48db-90fc-2e9ed6b62c5f req-773e679b-a063-4bfd-8d4b-4a5f8f1d36a4 service nova] Creating event network-vif-plugged:aabe483a-b8ea-4c22-b6aa-1fdb011b1466 for instance c55760e6-1d24-4302-96ce-cdbdcb9a2b5a on n-h2-845781-6 Aug 09 17:17:41.717229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:41.718632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:41.743744 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-8dab4d30-77b8-48db-90fc-2e9ed6b62c5f req-773e679b-a063-4bfd-8d4b-4a5f8f1d36a4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097269 Aug 09 17:17:41.746213 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1069/2231] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:41.756644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:41.760558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:41.761092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:41.767975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:41.770786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:41.771573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-73fba5f1-d218-4452-bd11-21100e1c35f6 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:41.773240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:41.832367 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-73fba5f1-d218-4452-bd11-21100e1c35f6 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.072663 Aug 09 17:17:41.833019 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1070/2232] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:17:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:41.862233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c75333df-8325-434b-b5de-8dad9edd2a84 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:41.872012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c75333df-8325-434b-b5de-8dad9edd2a84 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:41.916816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c75333df-8325-434b-b5de-8dad9edd2a84 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:41.918097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c75333df-8325-434b-b5de-8dad9edd2a84 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:41.923077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c75333df-8325-434b-b5de-8dad9edd2a84 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:41.923902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c75333df-8325-434b-b5de-8dad9edd2a84 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:41.924393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c75333df-8325-434b-b5de-8dad9edd2a84 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:41.934028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c75333df-8325-434b-b5de-8dad9edd2a84 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:42.122463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:42.147578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:42.160544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:42.199812 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bcf04845-a4c4-4ae8-a5fe-7fde83a509ed tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1426 microversion: 2.75 time: 0.512427 Aug 09 17:17:42.224174 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1163/2233] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:41 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1426 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:42.257674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-40a07933-f1f0-4fe8-b51a-c403f6a83b59 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] Calling method '.version_select at 0x7fbbcb566b80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:42.490174 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-40a07933-f1f0-4fe8-b51a-c403f6a83b59 tempest-QuotasAdminTestV257-1724950377 tempest-QuotasAdminTestV257-1724950377-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/70248ee3aa6a4a76bd990fc5bc9da17d?user_id=de31bf9d1acc465baf81b99fdb06f558" status: 200 len: 190 microversion: 2.57 time: 0.246472 Aug 09 17:17:42.492447 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1164/2234] 10.222.0.93 () {60 vars in 1364 bytes} [Tue Aug 9 17:17:42 2022] GET /compute/v2.1/os-quota-sets/70248ee3aa6a4a76bd990fc5bc9da17d?user_id=de31bf9d1acc465baf81b99fdb06f558 => generated 190 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:17:42.509345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac5c593a-f5af-441e-bba4-86bda26c5d43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:42.511092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ac5c593a-f5af-441e-bba4-86bda26c5d43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:42.530907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac5c593a-f5af-441e-bba4-86bda26c5d43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:42.535758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac5c593a-f5af-441e-bba4-86bda26c5d43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:42.543766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac5c593a-f5af-441e-bba4-86bda26c5d43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:42.545290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac5c593a-f5af-441e-bba4-86bda26c5d43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:42.546158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac5c593a-f5af-441e-bba4-86bda26c5d43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:42.547016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac5c593a-f5af-441e-bba4-86bda26c5d43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:42.764457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ac5c593a-f5af-441e-bba4-86bda26c5d43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:42.782007 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ac5c593a-f5af-441e-bba4-86bda26c5d43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1271 microversion: 2.1 time: 0.286929 Aug 09 17:17:42.783290 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1165/2235] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:42 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:42.807417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74fc98e5-02ed-4ddb-965b-2a5622176734 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:42.826461 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-74fc98e5-02ed-4ddb-965b-2a5622176734 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037242 Aug 09 17:17:42.832656 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1166/2236] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:17:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:42.849146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:42.851094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:42.863015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:42.864208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:42.865147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:42.867721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:42.868874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:42.869947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:43.333455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c75333df-8325-434b-b5de-8dad9edd2a84 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:43.369969 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c75333df-8325-434b-b5de-8dad9edd2a84 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1317 microversion: 2.1 time: 1.534560 Aug 09 17:17:43.371417 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1071/2237] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:41 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1317 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:43.391558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-869dd827-65c6-4db8-b8da-92f4b625e8f9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:43.397954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-869dd827-65c6-4db8-b8da-92f4b625e8f9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:43.444124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869dd827-65c6-4db8-b8da-92f4b625e8f9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:43.446423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869dd827-65c6-4db8-b8da-92f4b625e8f9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:43.449603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869dd827-65c6-4db8-b8da-92f4b625e8f9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:43.456602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869dd827-65c6-4db8-b8da-92f4b625e8f9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:43.458372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869dd827-65c6-4db8-b8da-92f4b625e8f9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:43.459722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869dd827-65c6-4db8-b8da-92f4b625e8f9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:44.021827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:44.036152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:44.038222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:44.043183 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4072fc77-2c9f-401d-9501-9c5f346c43ed tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1604 microversion: 2.42 time: 1.205603 Aug 09 17:17:44.046994 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1167/2238] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:42 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1604 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:44.059738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b450eedb-0e71-4f1c-80cb-aefc6afea379 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:44.156789 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b450eedb-0e71-4f1c-80cb-aefc6afea379 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.105820 Aug 09 17:17:44.163522 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1168/2239] 10.222.0.93 () {58 vars in 1165 bytes} [Tue Aug 9 17:17:44 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:44.174527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:44.176407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:44.215321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:44.218683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:44.223473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:44.225900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:44.231279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:44.233947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:44.284171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-869dd827-65c6-4db8-b8da-92f4b625e8f9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:44.299177 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-869dd827-65c6-4db8-b8da-92f4b625e8f9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1315 microversion: 2.1 time: 0.919320 Aug 09 17:17:44.303800 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1072/2240] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:43 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:44.310089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dbdae91e-2c7b-47f6-84d0-8406d5853e0f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:44.311233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dbdae91e-2c7b-47f6-84d0-8406d5853e0f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:44.321749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dbdae91e-2c7b-47f6-84d0-8406d5853e0f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:44.323394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dbdae91e-2c7b-47f6-84d0-8406d5853e0f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:44.324056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dbdae91e-2c7b-47f6-84d0-8406d5853e0f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:44.324991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dbdae91e-2c7b-47f6-84d0-8406d5853e0f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:44.325781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dbdae91e-2c7b-47f6-84d0-8406d5853e0f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:44.326577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dbdae91e-2c7b-47f6-84d0-8406d5853e0f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:44.494580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:44.538567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:44.544421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:44.567936 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-36a1f3dd-5325-426d-8b6c-3795ec5e8ec0 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1414 microversion: 2.75 time: 0.401855 Aug 09 17:17:44.579727 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1169/2241] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:44 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1414 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:44.610534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f7dd03ce-ca7c-4753-b596-e53758b50b11 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:44.638224 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f7dd03ce-ca7c-4753-b596-e53758b50b11 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.047758 Aug 09 17:17:44.639463 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1170/2242] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:17:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:44.648580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-00c1605d-2815-4058-a338-cc20525b47f4 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:44.649921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-00c1605d-2815-4058-a338-cc20525b47f4 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:44.661638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c1605d-2815-4058-a338-cc20525b47f4 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:44.663284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c1605d-2815-4058-a338-cc20525b47f4 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:44.664300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c1605d-2815-4058-a338-cc20525b47f4 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:44.665790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c1605d-2815-4058-a338-cc20525b47f4 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:44.666743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c1605d-2815-4058-a338-cc20525b47f4 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:44.667684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c1605d-2815-4058-a338-cc20525b47f4 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:44.752245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dbdae91e-2c7b-47f6-84d0-8406d5853e0f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:44.765674 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dbdae91e-2c7b-47f6-84d0-8406d5853e0f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1269 microversion: 2.1 time: 0.460333 Aug 09 17:17:44.767129 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1073/2243] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:44 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1269 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:44.773772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3bcece0b-a433-4c90-a3c0-fb125a1f58d0 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:44.812881 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3bcece0b-a433-4c90-a3c0-fb125a1f58d0 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.044343 Aug 09 17:17:44.813887 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1074/2244] 10.222.0.93 () {58 vars in 1169 bytes} [Tue Aug 9 17:17:44 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:44.862887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a82e334b-8743-43fb-9d4e-9110068a2494 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:44.908461 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a82e334b-8743-43fb-9d4e-9110068a2494 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.063025 Aug 09 17:17:44.923707 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1075/2245] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:17:44 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:17:44.940424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b9553656-ddcc-4c9e-b91b-7dbcfefda539 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:44.960580 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b9553656-ddcc-4c9e-b91b-7dbcfefda539 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027421 Aug 09 17:17:44.974241 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1076/2246] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:17:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:44.996655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6925e5dd-d0af-4e53-b555-cf2d440831fd tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:45.020238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-00c1605d-2815-4058-a338-cc20525b47f4 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:45.052017 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-00c1605d-2815-4058-a338-cc20525b47f4 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1505 microversion: 2.1 time: 0.410588 Aug 09 17:17:45.052704 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1171/2247] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:44 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:45.091580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:45.092358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:45.102498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:45.106622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:45.107447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:45.108514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:45.117315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:45.118166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:45.118735 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6925e5dd-d0af-4e53-b555-cf2d440831fd tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.141500 Aug 09 17:17:45.133166 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1077/2248] 10.222.0.93 () {58 vars in 1167 bytes} [Tue Aug 9 17:17:44 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:45.160239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cefe5321-a170-4fef-9d97-17b29746d9ab tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:45.161135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cefe5321-a170-4fef-9d97-17b29746d9ab tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:45.172841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cefe5321-a170-4fef-9d97-17b29746d9ab tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:45.173954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cefe5321-a170-4fef-9d97-17b29746d9ab tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:45.175030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cefe5321-a170-4fef-9d97-17b29746d9ab tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:45.176371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cefe5321-a170-4fef-9d97-17b29746d9ab tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:45.177308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cefe5321-a170-4fef-9d97-17b29746d9ab tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:45.178147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cefe5321-a170-4fef-9d97-17b29746d9ab tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:45.192454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:45.193283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:45.194517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:45.195584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lazy-loading 'fault' on Instance uuid bf1964d4-6f76-4c48-b05a-e123ce244faf {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:17:45.247818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cefe5321-a170-4fef-9d97-17b29746d9ab tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:45.249700 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cefe5321-a170-4fef-9d97-17b29746d9ab tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a/os-instance-actions/req-0bbe24da-192f-4171-99cb-f05833c75d3b" status: 200 len: 313 microversion: 2.1 time: 0.114905 Aug 09 17:17:45.250959 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1078/2249] 10.222.0.93 () {58 vars in 1419 bytes} [Tue Aug 9 17:17:45 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a/os-instance-actions/req-0bbe24da-192f-4171-99cb-f05833c75d3b => generated 313 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:45.256640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e077d731-1058-406a-b2b3-ff69ab174f5f tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:45.269138 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e077d731-1058-406a-b2b3-ff69ab174f5f tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016335 Aug 09 17:17:45.272033 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1079/2250] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:17:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:45.277565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eebe7755-e7ea-40be-b8f8-7880f1d861ba tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:45.283925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eebe7755-e7ea-40be-b8f8-7880f1d861ba tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:45.296400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eebe7755-e7ea-40be-b8f8-7880f1d861ba tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:45.297544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eebe7755-e7ea-40be-b8f8-7880f1d861ba tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:45.298986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eebe7755-e7ea-40be-b8f8-7880f1d861ba tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:45.303855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eebe7755-e7ea-40be-b8f8-7880f1d861ba tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:45.304768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eebe7755-e7ea-40be-b8f8-7880f1d861ba tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:45.305804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eebe7755-e7ea-40be-b8f8-7880f1d861ba tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:45.366697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:45.407255 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eebe7755-e7ea-40be-b8f8-7880f1d861ba tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "POST /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a/action" status: 202 len: 0 microversion: 2.1 time: 0.133423 Aug 09 17:17:45.408520 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1080/2251] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:17:45 2022] POST /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:17:45.430730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e07e971d-7b9e-49b7-a541-0f6ddaa6643e tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:45.439919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:45.444937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3fea520df5014ddabc2f232cdaa8a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '314d59a0480e4be59dba88bc8810b146', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:45.447245 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-63768374-498a-42e5-a480-c792d447b3b3 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 200 len: 1609 microversion: 2.42 time: 0.359640 Aug 09 17:17:45.466644 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1172/2252] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:45 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 1609 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:17:45.503870 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e07e971d-7b9e-49b7-a541-0f6ddaa6643e tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.085431 Aug 09 17:17:45.508817 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1081/2253] 10.222.0.93 () {58 vars in 1144 bytes} [Tue Aug 9 17:17:45 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:45.509726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4c5c240-427b-4742-b9ae-d0bc35b15f05 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:45.511395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a4c5c240-427b-4742-b9ae-d0bc35b15f05 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:45.545243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4c5c240-427b-4742-b9ae-d0bc35b15f05 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:45.548752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4c5c240-427b-4742-b9ae-d0bc35b15f05 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:45.549928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b6037407-5d06-4610-84d4-e041ba77e487 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:45.552491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b6037407-5d06-4610-84d4-e041ba77e487 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:45.553490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4c5c240-427b-4742-b9ae-d0bc35b15f05 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:45.555196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4c5c240-427b-4742-b9ae-d0bc35b15f05 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:45.564234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4c5c240-427b-4742-b9ae-d0bc35b15f05 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:45.565278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4c5c240-427b-4742-b9ae-d0bc35b15f05 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:45.577567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6037407-5d06-4610-84d4-e041ba77e487 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:45.578670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6037407-5d06-4610-84d4-e041ba77e487 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:45.579736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6037407-5d06-4610-84d4-e041ba77e487 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:45.581298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6037407-5d06-4610-84d4-e041ba77e487 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:45.582866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6037407-5d06-4610-84d4-e041ba77e487 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:45.583808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6037407-5d06-4610-84d4-e041ba77e487 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:46.102853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a4c5c240-427b-4742-b9ae-d0bc35b15f05 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:46.118891 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4c5c240-427b-4742-b9ae-d0bc35b15f05 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1315 microversion: 2.1 time: 0.647657 Aug 09 17:17:46.123944 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1173/2254] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:45 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:46.127694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b6037407-5d06-4610-84d4-e041ba77e487 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:46.132025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-022fc370-76f6-4b2e-9cf4-db172ebf672d tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:46.144831 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b6037407-5d06-4610-84d4-e041ba77e487 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1507 microversion: 2.1 time: 0.615628 Aug 09 17:17:46.152553 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-022fc370-76f6-4b2e-9cf4-db172ebf672d tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030290 Aug 09 17:17:46.153119 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1082/2255] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:45 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1507 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:46.154016 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1174/2256] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:17:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:46.164538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6842b20-335a-4e30-a0a5-5a4995887f99 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:46.166202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b6842b20-335a-4e30-a0a5-5a4995887f99 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:46.182077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6842b20-335a-4e30-a0a5-5a4995887f99 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:46.182884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:46.184383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:46.185559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6842b20-335a-4e30-a0a5-5a4995887f99 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:46.187362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6842b20-335a-4e30-a0a5-5a4995887f99 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:46.188772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6842b20-335a-4e30-a0a5-5a4995887f99 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:46.190181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:46.191147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6842b20-335a-4e30-a0a5-5a4995887f99 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:46.192261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6842b20-335a-4e30-a0a5-5a4995887f99 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:46.200452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:46.201687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:46.202279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:46.203076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:46.203873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:46.204356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:46.359543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:46.404734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b6842b20-335a-4e30-a0a5-5a4995887f99 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:46.410691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:46.417467 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6842b20-335a-4e30-a0a5-5a4995887f99 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1269 microversion: 2.1 time: 0.261472 Aug 09 17:17:46.436460 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1175/2257] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:46 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1269 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:46.443178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-577a4c76-f431-47b7-bcb4-05c18e0372b3 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:46.478280 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-577a4c76-f431-47b7-bcb4-05c18e0372b3 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.040226 Aug 09 17:17:46.481515 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1176/2258] 10.222.0.93 () {58 vars in 1148 bytes} [Tue Aug 9 17:17:46 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:46.510790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c79b309-3ca6-4bf6-ab4b-16b17c5ec056 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:46.516516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:46.536040 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c79b309-3ca6-4bf6-ab4b-16b17c5ec056 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.035114 Aug 09 17:17:46.538428 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1177/2259] 10.222.0.93 () {58 vars in 1140 bytes} [Tue Aug 9 17:17:46 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:46.557580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:46.558711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:46.560122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:46.562402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:46.579408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:46.579953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:46.580410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:46.580824 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a01192a5-beda-439f-bcdd-7ac5a93114d5 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1435 microversion: 2.75 time: 0.424786 Aug 09 17:17:46.581275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:46.582018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:46.582697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:46.582842 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1083/2260] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:46 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1435 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:46.594582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7c1084e6-2054-47a8-a963-afeef8cdcb0b tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:46.612037 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] HTTP exception thrown: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Request method failure captured: Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf HTTP/1.1 Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pSttTG9Ny2XyWeRwNrwHteTKDv8483WIa3ukn52tDFODNnNSGJlHhBbv7BuFEy90xak9mV68c_Q_OLGXe8LtElzZrbTapd-GcLL0Sz6ZEbwBcXon2S0p-HAzDMzaPRsE70p4gwvTJfrIVAW1e1IoAzSfbZAbzRTshctHp9XodPxp6A Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.42 Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 314d59a0480e4be59dba88bc8810b146 Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1687902210 Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_314d59a0480e4be59dba88bc8810b146"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/314d59a0480e4be59dba88bc8810b146"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/314d59a0480e4be59dba88bc8810b146"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/314d59a0480e4be59dba88bc8810b146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1687902210 Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 314d59a0480e4be59dba88bc8810b146 Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1687902210 Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TaggedBootDevicesTest_v242-1687902210-project Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 3fea520df5014ddabc2f232cdaa8a53f Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1687902210-project Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'bf1964d4-6f76-4c48-b05a-e123ce244faf'} Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:46.613841 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:46.624899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:46.624899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:46.624899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:46.624899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:46.624899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:46.624899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:46.624899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:17:46.624899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:46.624899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Returning 404 to user: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:46.624899 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b9c784fe-500d-4e5d-a316-eaaa8c51e35b tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 404 len: 111 microversion: 2.42 time: 0.075510 Aug 09 17:17:46.633624 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1178/2261] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:46 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:17:46.633849 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7c1084e6-2054-47a8-a963-afeef8cdcb0b tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043078 Aug 09 17:17:46.633849 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1084/2262] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:17:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:46.647787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-61139c2b-85a4-4e83-8271-84d00c0630f0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '.version_select at 0x7fbbdc9ab1f0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:46.649500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:46.652412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:46.661179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:46.662058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:46.663255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:46.664296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:46.667855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:46.668670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:46.692146 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-61139c2b-85a4-4e83-8271-84d00c0630f0 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084048496" status: 204 len: 0 microversion: 2.42 time: 0.056870 Aug 09 17:17:46.693310 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1085/2263] 10.222.0.93 () {60 vars in 1262 bytes} [Tue Aug 9 17:17:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084048496 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:17:46.718443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-37a9ee2a-c385-4389-9e2a-ac29aaa939b5 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:46.795004 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-37a9ee2a-c385-4389-9e2a-ac29aaa939b5 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.098711 Aug 09 17:17:46.799331 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1086/2264] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:17:46 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:46.838360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-856beabc-7adf-45a2-9c59-31d03e44025d tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:46.893054 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-856beabc-7adf-45a2-9c59-31d03e44025d tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067765 Aug 09 17:17:46.894315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:17:46.894749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:17:46.895605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:17:46.896315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:17:46.897523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:17:46.908072 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1087/2265] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:17:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:17:46.928035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-31a88fd5-400b-455c-9d9a-6e7964bd7754 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:46.958089 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-31a88fd5-400b-455c-9d9a-6e7964bd7754 tempest-FlavorsV2TestJSON-1141339067 tempest-FlavorsV2TestJSON-1141339067-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034160 Aug 09 17:17:46.959574 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1088/2266] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:17:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:17:47.029364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:47.042073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:47.042746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:47.043309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:47.044226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:47.044816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:47.045364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:47.160316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-708cce90-4d1c-481b-b0fd-1a1cfb2735db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:47.161529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-708cce90-4d1c-481b-b0fd-1a1cfb2735db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:47.174879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-708cce90-4d1c-481b-b0fd-1a1cfb2735db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:47.175784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-708cce90-4d1c-481b-b0fd-1a1cfb2735db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:47.177169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-708cce90-4d1c-481b-b0fd-1a1cfb2735db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:47.179857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-708cce90-4d1c-481b-b0fd-1a1cfb2735db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:47.182483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-708cce90-4d1c-481b-b0fd-1a1cfb2735db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:47.184970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-708cce90-4d1c-481b-b0fd-1a1cfb2735db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:47.368720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:47.383432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:47.390104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:47.406422 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87574197-8da7-4b19-b65b-58c10b5116f3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "POST /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8/action" status: 202 len: 1492 microversion: 2.75 time: 0.777974 Aug 09 17:17:47.407252 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1179/2267] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:17:46 2022] POST /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8/action => generated 1492 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 09 17:17:47.414591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e326f2a-88ea-4374-a804-0d8d46ab48a3 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:47.423509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3e326f2a-88ea-4374-a804-0d8d46ab48a3 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:47.442352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e326f2a-88ea-4374-a804-0d8d46ab48a3 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:47.443260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e326f2a-88ea-4374-a804-0d8d46ab48a3 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:47.444095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e326f2a-88ea-4374-a804-0d8d46ab48a3 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:47.445085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e326f2a-88ea-4374-a804-0d8d46ab48a3 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:47.448409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e326f2a-88ea-4374-a804-0d8d46ab48a3 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:47.449231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e326f2a-88ea-4374-a804-0d8d46ab48a3 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:48.171681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3e326f2a-88ea-4374-a804-0d8d46ab48a3 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:48.188630 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e326f2a-88ea-4374-a804-0d8d46ab48a3 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1507 microversion: 2.1 time: 0.779462 Aug 09 17:17:48.190761 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1180/2268] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:47 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1507 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:48.200494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2f03a933-7dce-45a6-b546-1d9f89748726 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:48.202099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2f03a933-7dce-45a6-b546-1d9f89748726 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:48.225894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f03a933-7dce-45a6-b546-1d9f89748726 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:48.227214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f03a933-7dce-45a6-b546-1d9f89748726 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:48.228176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f03a933-7dce-45a6-b546-1d9f89748726 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:48.229442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f03a933-7dce-45a6-b546-1d9f89748726 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:48.230331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f03a933-7dce-45a6-b546-1d9f89748726 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:48.231125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f03a933-7dce-45a6-b546-1d9f89748726 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:48.389106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-708cce90-4d1c-481b-b0fd-1a1cfb2735db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:48.408911 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-708cce90-4d1c-481b-b0fd-1a1cfb2735db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1315 microversion: 2.1 time: 1.252694 Aug 09 17:17:48.410497 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1089/2269] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:47 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1315 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:17:48.431077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:48.432512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:48.446698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:48.448446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:48.449165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:48.450413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:48.451196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:48.452202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:48.637970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:48.659843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:48.661906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:48.669379 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-38895979-c936-40c4-a2a0-29ec861c4efa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.256810 Aug 09 17:17:48.670192 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1090/2270] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:48 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:48.679760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-c8d2c2a0-0cd2-4f7a-ab90-996c1573a4ae req-e7bee638-0a9c-40cb-a9f9-a0d2cd575390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a83e16f-e6c2-4c94-872d-0b6a08acfa76", "name": "network-vif-plugged", "status": "completed", "tag": "757c519b-6af4-4d37-9f4f-607454d88c5f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:48.707031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c8d2c2a0-0cd2-4f7a-ab90-996c1573a4ae req-e7bee638-0a9c-40cb-a9f9-a0d2cd575390 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:48.708653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c8d2c2a0-0cd2-4f7a-ab90-996c1573a4ae req-e7bee638-0a9c-40cb-a9f9-a0d2cd575390 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:48.709781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c8d2c2a0-0cd2-4f7a-ab90-996c1573a4ae req-e7bee638-0a9c-40cb-a9f9-a0d2cd575390 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:48.736436 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-c8d2c2a0-0cd2-4f7a-ab90-996c1573a4ae req-e7bee638-0a9c-40cb-a9f9-a0d2cd575390 service nova] Creating event network-vif-plugged:757c519b-6af4-4d37-9f4f-607454d88c5f for instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 on n-h1-845781-6 Aug 09 17:17:48.750511 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-c8d2c2a0-0cd2-4f7a-ab90-996c1573a4ae req-e7bee638-0a9c-40cb-a9f9-a0d2cd575390 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078470 Aug 09 17:17:48.752498 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1091/2271] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:48.797494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2f03a933-7dce-45a6-b546-1d9f89748726 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:48.819701 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2f03a933-7dce-45a6-b546-1d9f89748726 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1311 microversion: 2.1 time: 0.625455 Aug 09 17:17:48.821948 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1181/2272] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:48 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1311 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:49.257575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3748596f-aacb-4218-b8a2-082c273ad5a2 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:49.270813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3748596f-aacb-4218-b8a2-082c273ad5a2 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:49.335658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3748596f-aacb-4218-b8a2-082c273ad5a2 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:49.336743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3748596f-aacb-4218-b8a2-082c273ad5a2 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:49.336922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3748596f-aacb-4218-b8a2-082c273ad5a2 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:49.337609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3748596f-aacb-4218-b8a2-082c273ad5a2 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:49.338088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3748596f-aacb-4218-b8a2-082c273ad5a2 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:49.338558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3748596f-aacb-4218-b8a2-082c273ad5a2 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:49.440622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-991f4fb2-eaf5-45f2-a424-5271d730aff4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:49.444745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-991f4fb2-eaf5-45f2-a424-5271d730aff4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:49.465047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-991f4fb2-eaf5-45f2-a424-5271d730aff4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:49.466738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-991f4fb2-eaf5-45f2-a424-5271d730aff4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:49.468243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-991f4fb2-eaf5-45f2-a424-5271d730aff4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:49.469805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-991f4fb2-eaf5-45f2-a424-5271d730aff4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:49.470958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-991f4fb2-eaf5-45f2-a424-5271d730aff4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:49.472445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-991f4fb2-eaf5-45f2-a424-5271d730aff4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:49.623408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:49.909714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3748596f-aacb-4218-b8a2-082c273ad5a2 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:49.943159 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3748596f-aacb-4218-b8a2-082c273ad5a2 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1505 microversion: 2.1 time: 0.714739 Aug 09 17:17:49.959668 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1092/2273] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:49 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:49.959668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:49.960524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:50.007182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:50.011712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:50.013532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:50.017234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:50.020833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:50.022613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:50.053734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-991f4fb2-eaf5-45f2-a424-5271d730aff4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:50.072350 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-991f4fb2-eaf5-45f2-a424-5271d730aff4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1315 microversion: 2.1 time: 0.640946 Aug 09 17:17:50.074512 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1182/2274] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:49 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:50.094331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6cfd0aaf-7fae-4ee4-8283-4faaf319d5d6 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:50.094970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6cfd0aaf-7fae-4ee4-8283-4faaf319d5d6 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:50.113374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfd0aaf-7fae-4ee4-8283-4faaf319d5d6 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:50.113893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfd0aaf-7fae-4ee4-8283-4faaf319d5d6 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:50.114354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfd0aaf-7fae-4ee4-8283-4faaf319d5d6 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:50.115111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfd0aaf-7fae-4ee4-8283-4faaf319d5d6 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:50.115653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfd0aaf-7fae-4ee4-8283-4faaf319d5d6 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:50.116157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfd0aaf-7fae-4ee4-8283-4faaf319d5d6 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:50.643803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:50.683409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:50.708548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:50.734177 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-576af339-7144-46f8-a383-935691889034 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.785075 Aug 09 17:17:50.737404 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1093/2275] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:49 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:50.749037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e26d96f-97e8-4b20-9b95-fe41f77a5783 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '.version_select at 0x7fbbdc86c8b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:50.750688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2e26d96f-97e8-4b20-9b95-fe41f77a5783 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:50.769343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e26d96f-97e8-4b20-9b95-fe41f77a5783 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:50.770567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e26d96f-97e8-4b20-9b95-fe41f77a5783 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:50.771983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e26d96f-97e8-4b20-9b95-fe41f77a5783 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:50.773690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e26d96f-97e8-4b20-9b95-fe41f77a5783 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:50.774778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e26d96f-97e8-4b20-9b95-fe41f77a5783 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:50.776077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e26d96f-97e8-4b20-9b95-fe41f77a5783 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:50.794211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6cfd0aaf-7fae-4ee4-8283-4faaf319d5d6 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:50.829276 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6cfd0aaf-7fae-4ee4-8283-4faaf319d5d6 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1332 microversion: 2.1 time: 0.752926 Aug 09 17:17:50.837814 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1183/2276] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:50 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1332 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:50.887538 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2e26d96f-97e8-4b20-9b95-fe41f77a5783 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.146275 Aug 09 17:17:50.890246 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1094/2277] 10.222.0.93 () {58 vars in 1296 bytes} [Tue Aug 9 17:17:50 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a/os-instance-actions => generated 611 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:50.912289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0b71a07e-8019-4438-908e-5a8e03a07d4f tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:50.913115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0b71a07e-8019-4438-908e-5a8e03a07d4f tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:50.933347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b71a07e-8019-4438-908e-5a8e03a07d4f tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:50.934229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b71a07e-8019-4438-908e-5a8e03a07d4f tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:50.934981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b71a07e-8019-4438-908e-5a8e03a07d4f tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:50.938029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b71a07e-8019-4438-908e-5a8e03a07d4f tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:50.939957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b71a07e-8019-4438-908e-5a8e03a07d4f tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:50.942168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b71a07e-8019-4438-908e-5a8e03a07d4f tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:51.056027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0b71a07e-8019-4438-908e-5a8e03a07d4f tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:17:51.120530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-05f7e58e-d987-4342-9a2c-a2e67611f3d2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:51.121634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-05f7e58e-d987-4342-9a2c-a2e67611f3d2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:51.144316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05f7e58e-d987-4342-9a2c-a2e67611f3d2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:51.147519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05f7e58e-d987-4342-9a2c-a2e67611f3d2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:51.149199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05f7e58e-d987-4342-9a2c-a2e67611f3d2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:51.151643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05f7e58e-d987-4342-9a2c-a2e67611f3d2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:51.152909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05f7e58e-d987-4342-9a2c-a2e67611f3d2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:51.154205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05f7e58e-d987-4342-9a2c-a2e67611f3d2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:51.354000 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0b71a07e-8019-4438-908e-5a8e03a07d4f tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 204 len: 0 microversion: 2.1 time: 0.448678 Aug 09 17:17:51.355310 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1184/2278] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:17:50 2022] DELETE /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:17:51.366983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-705177ca-3bd5-4fd7-ad3d-6f443c6ea640 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:51.371580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-705177ca-3bd5-4fd7-ad3d-6f443c6ea640 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:51.387794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-705177ca-3bd5-4fd7-ad3d-6f443c6ea640 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:51.388310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-705177ca-3bd5-4fd7-ad3d-6f443c6ea640 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:51.388861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-705177ca-3bd5-4fd7-ad3d-6f443c6ea640 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:51.389491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-705177ca-3bd5-4fd7-ad3d-6f443c6ea640 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:51.400387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-705177ca-3bd5-4fd7-ad3d-6f443c6ea640 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:51.401270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-705177ca-3bd5-4fd7-ad3d-6f443c6ea640 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:51.496193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=7 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:51.614279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=17 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:51.664212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-05f7e58e-d987-4342-9a2c-a2e67611f3d2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:51.696525 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-05f7e58e-d987-4342-9a2c-a2e67611f3d2 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1503 microversion: 2.1 time: 0.584894 Aug 09 17:17:51.697680 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1095/2279] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:51 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1503 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:51.744644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ea8b52bd-602e-4744-a080-522a5e49cab6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:51.745601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ea8b52bd-602e-4744-a080-522a5e49cab6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:51.764674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8b52bd-602e-4744-a080-522a5e49cab6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:51.765868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8b52bd-602e-4744-a080-522a5e49cab6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:51.766890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8b52bd-602e-4744-a080-522a5e49cab6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:51.768745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8b52bd-602e-4744-a080-522a5e49cab6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:51.769953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8b52bd-602e-4744-a080-522a5e49cab6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:51.770914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8b52bd-602e-4744-a080-522a5e49cab6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:51.969646 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ea8b52bd-602e-4744-a080-522a5e49cab6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76/action" status: 202 len: 0 microversion: 2.1 time: 0.228827 Aug 09 17:17:51.976988 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1096/2280] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:17:51 2022] POST /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:17:52.010354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:52.016502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:52.039968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:52.042079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:52.044673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:52.049843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:52.051832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:52.052621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:52.111520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-705177ca-3bd5-4fd7-ad3d-6f443c6ea640 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:52.148765 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-705177ca-3bd5-4fd7-ad3d-6f443c6ea640 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1511 microversion: 2.1 time: 0.786198 Aug 09 17:17:52.153141 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1185/2281] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:51 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1511 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:17:52.176664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09e12edc-b397-4011-8e86-c8e57f164403 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:52.179441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09e12edc-b397-4011-8e86-c8e57f164403 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:52.187916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:52.192557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09e12edc-b397-4011-8e86-c8e57f164403 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:52.193520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09e12edc-b397-4011-8e86-c8e57f164403 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:52.194492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09e12edc-b397-4011-8e86-c8e57f164403 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:52.195597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09e12edc-b397-4011-8e86-c8e57f164403 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:52.196264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09e12edc-b397-4011-8e86-c8e57f164403 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:52.197016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09e12edc-b397-4011-8e86-c8e57f164403 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:52.468560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=19 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:52.559803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:52.581325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:52.582968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-09e12edc-b397-4011-8e86-c8e57f164403 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:52.585174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:52.595310 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-67601a0a-27ce-4867-96c9-4761bc1201ca tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.616622 Aug 09 17:17:52.598974 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09e12edc-b397-4011-8e86-c8e57f164403 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1332 microversion: 2.1 time: 0.438107 Aug 09 17:17:52.600414 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1186/2282] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:52 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1332 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:52.613101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd3049c0-40b8-4db5-a9bb-c260f0d7b871 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:52.614041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd3049c0-40b8-4db5-a9bb-c260f0d7b871 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:52.616095 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1097/2283] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:51 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:52.642579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd3049c0-40b8-4db5-a9bb-c260f0d7b871 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:52.644242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd3049c0-40b8-4db5-a9bb-c260f0d7b871 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:52.648567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd3049c0-40b8-4db5-a9bb-c260f0d7b871 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:52.650725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd3049c0-40b8-4db5-a9bb-c260f0d7b871 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:52.651489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd3049c0-40b8-4db5-a9bb-c260f0d7b871 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:52.652184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd3049c0-40b8-4db5-a9bb-c260f0d7b871 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:53.383854 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-07994e54-4376-479b-a7b1-c131cd41a7eb tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] 10.222.0.93 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.766303 Aug 09 17:17:53.384772 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1098/2284] 10.222.0.93 () {58 vars in 1128 bytes} [Tue Aug 9 17:17:52 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 768 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 17:17:53.389575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e1a58a6b-879f-4a75-a6d8-90e0a5bdab76 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:53.390526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e1a58a6b-879f-4a75-a6d8-90e0a5bdab76 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:53.407424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1a58a6b-879f-4a75-a6d8-90e0a5bdab76 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:53.408000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1a58a6b-879f-4a75-a6d8-90e0a5bdab76 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:53.408449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1a58a6b-879f-4a75-a6d8-90e0a5bdab76 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:53.409203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1a58a6b-879f-4a75-a6d8-90e0a5bdab76 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:53.409674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1a58a6b-879f-4a75-a6d8-90e0a5bdab76 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:53.410111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1a58a6b-879f-4a75-a6d8-90e0a5bdab76 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:53.778024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd3049c0-40b8-4db5-a9bb-c260f0d7b871 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:53.791143 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd3049c0-40b8-4db5-a9bb-c260f0d7b871 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1488 microversion: 2.1 time: 1.189107 Aug 09 17:17:53.793809 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1187/2285] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:52 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1488 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:53.806214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-456b0b91-e870-4ad0-b2fe-767bff80acb9 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Calling method '.version_select at 0x7fbbcbad3790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:53.855566 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-456b0b91-e870-4ad0-b2fe-767bff80acb9 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] HTTP exception thrown: Image not found. Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-456b0b91-e870-4ad0-b2fe-767bff80acb9 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Request method failure captured: Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pbAvVvt5VUi8I6glisfe2yiyf6XUyCkY4lxlpAlTIanhu9qNvQZHstqSpNWi3ptNerJjCTwXcpcoxtQ-nHmBqYbdhTfOYNZbMdvRZuoIFHiAPNinP7Hm8qkiOmmR3-5ZGWD7bZaEZrOW2LY4qurUUDuRFs3lVo64EqmBwZSvAxC7T8 Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fb47179014cd4421b6a737f405323294 Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb47179014cd4421b6a737f405323294"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb47179014cd4421b6a737f405323294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb47179014cd4421b6a737f405323294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb47179014cd4421b6a737f405323294"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fb47179014cd4421b6a737f405323294 Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesDeleteNegativeTestJSON-1336565423-project Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 8e7527cf5ca748b9b8b7a10885409af3 Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423-project Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '-1'} Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:53.857714 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-456b0b91-e870-4ad0-b2fe-767bff80acb9 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-456b0b91-e870-4ad0-b2fe-767bff80acb9 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] 10.222.0.93 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.063456 Aug 09 17:17:53.876374 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1188/2286] 10.222.0.93 () {58 vars in 1134 bytes} [Tue Aug 9 17:17:53 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:17:54.187583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-699201a0-03b3-4403-bb52-63d11e547398 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Calling method '.version_select at 0x7fbbcbad3670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:54.356237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e1a58a6b-879f-4a75-a6d8-90e0a5bdab76 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:54.357912 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-699201a0-03b3-4403-bb52-63d11e547398 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872" status: 200 len: 371 microversion: 2.1 time: 0.496032 Aug 09 17:17:54.366143 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1189/2287] 10.222.0.93 () {58 vars in 1242 bytes} [Tue Aug 9 17:17:53 2022] GET /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872 => generated 371 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:54.371153 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e1a58a6b-879f-4a75-a6d8-90e0a5bdab76 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1511 microversion: 2.1 time: 0.984931 Aug 09 17:17:54.378169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:54.379280 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1099/2288] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:53 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1511 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:54.379446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:54.390266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e1df02f-a8e9-40b0-a736-82f584b84bd3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:54.391510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:54.392588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:54.393212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8e1df02f-a8e9-40b0-a736-82f584b84bd3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:54.393675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:54.395850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:54.397468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:54.398661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:54.410087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1df02f-a8e9-40b0-a736-82f584b84bd3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:54.411419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1df02f-a8e9-40b0-a736-82f584b84bd3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:54.412885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1df02f-a8e9-40b0-a736-82f584b84bd3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:54.414658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1df02f-a8e9-40b0-a736-82f584b84bd3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:54.415469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1df02f-a8e9-40b0-a736-82f584b84bd3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:54.416266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e1df02f-a8e9-40b0-a736-82f584b84bd3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:54.509790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:54.527960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:54.531104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:54.541108 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-021c3d7d-cea7-42e5-ac09-84888b7a10d1 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.173324 Aug 09 17:17:54.542194 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1190/2289] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:54 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:54.550473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb03d65e-ab1c-492f-af34-0e6753fa2c28 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:54.551610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb03d65e-ab1c-492f-af34-0e6753fa2c28 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:54.563111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb03d65e-ab1c-492f-af34-0e6753fa2c28 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:54.564061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb03d65e-ab1c-492f-af34-0e6753fa2c28 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:54.565153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb03d65e-ab1c-492f-af34-0e6753fa2c28 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:54.566408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb03d65e-ab1c-492f-af34-0e6753fa2c28 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:54.567235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb03d65e-ab1c-492f-af34-0e6753fa2c28 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:54.568052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb03d65e-ab1c-492f-af34-0e6753fa2c28 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:54.623137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb03d65e-ab1c-492f-af34-0e6753fa2c28 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:17:54.741741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:17:54.822150 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb03d65e-ab1c-492f-af34-0e6753fa2c28 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 204 len: 0 microversion: 2.1 time: 0.276066 Aug 09 17:17:54.823270 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1191/2290] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:17:54 2022] DELETE /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:17:54.837343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-49fc6348-007b-48a6-b10e-2dddf3c78f91 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Calling method '.version_select at 0x7fbbcba3fc10>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:54.885995 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-49fc6348-007b-48a6-b10e-2dddf3c78f91 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] HTTP exception thrown: Image not found. Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-49fc6348-007b-48a6-b10e-2dddf3c78f91 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Request method failure captured: Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/images/27ac6943-e3da-46e5-a09f-1f203eb5a39j HTTP/1.1 Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pbAvVvt5VUi8I6glisfe2yiyf6XUyCkY4lxlpAlTIanhu9qNvQZHstqSpNWi3ptNerJjCTwXcpcoxtQ-nHmBqYbdhTfOYNZbMdvRZuoIFHiAPNinP7Hm8qkiOmmR3-5ZGWD7bZaEZrOW2LY4qurUUDuRFs3lVo64EqmBwZSvAxC7T8 Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fb47179014cd4421b6a737f405323294 Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb47179014cd4421b6a737f405323294"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb47179014cd4421b6a737f405323294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb47179014cd4421b6a737f405323294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb47179014cd4421b6a737f405323294"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fb47179014cd4421b6a737f405323294 Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesDeleteNegativeTestJSON-1336565423-project Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 8e7527cf5ca748b9b8b7a10885409af3 Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423-project Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '27ac6943-e3da-46e5-a09f-1f203eb5a39j'} Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 27ac6943-e3da-46e5-a09f-1f203eb5a39j to delete Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 27ac6943-e3da-46e5-a09f-1f203eb5a39j could not be found. Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:54.888321 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-49fc6348-007b-48a6-b10e-2dddf3c78f91 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-49fc6348-007b-48a6-b10e-2dddf3c78f91 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] 10.222.0.93 "DELETE /compute/v2.1/images/27ac6943-e3da-46e5-a09f-1f203eb5a39j" status: 404 len: 62 microversion: 2.1 time: 0.065391 Aug 09 17:17:54.897101 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1192/2291] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:54 2022] DELETE /compute/v2.1/images/27ac6943-e3da-46e5-a09f-1f203eb5a39j => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:17:54.907359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b06a65d-8df5-427a-b615-7a66be986512 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcbb13f70>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:55.029088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b06a65d-8df5-427a-b615-7a66be986512 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:55.030062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b06a65d-8df5-427a-b615-7a66be986512 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:55.030937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b06a65d-8df5-427a-b615-7a66be986512 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:55.031967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b06a65d-8df5-427a-b615-7a66be986512 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:55.033249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b06a65d-8df5-427a-b615-7a66be986512 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:55.033930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b06a65d-8df5-427a-b615-7a66be986512 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:55.107973 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b06a65d-8df5-427a-b615-7a66be986512 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872" status: 200 len: 328 microversion: 2.1 time: 0.214293 Aug 09 17:17:55.109224 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1193/2292] 10.222.0.93 () {60 vars in 1262 bytes} [Tue Aug 9 17:17:54 2022] PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872 => generated 328 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:55.115215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd6d1155-7641-4c9b-9a83-e3f35525aac1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:55.116670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd6d1155-7641-4c9b-9a83-e3f35525aac1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:55.123971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd6d1155-7641-4c9b-9a83-e3f35525aac1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:55.124666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd6d1155-7641-4c9b-9a83-e3f35525aac1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:55.125211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd6d1155-7641-4c9b-9a83-e3f35525aac1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:55.126080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd6d1155-7641-4c9b-9a83-e3f35525aac1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:55.126645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd6d1155-7641-4c9b-9a83-e3f35525aac1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:55.127212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd6d1155-7641-4c9b-9a83-e3f35525aac1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:55.330216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8e1df02f-a8e9-40b0-a736-82f584b84bd3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:55.347618 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e1df02f-a8e9-40b0-a736-82f584b84bd3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 0.965536 Aug 09 17:17:55.348918 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1100/2293] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:54 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:55.359105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-822e1dec-c7ef-4074-b933-d7aea370b656 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Calling method '.version_select at 0x7fbbdc99db80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:55.394625 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-822e1dec-c7ef-4074-b933-d7aea370b656 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] HTTP exception thrown: Image not found. Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-822e1dec-c7ef-4074-b933-d7aea370b656 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Request method failure captured: Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/images/b3e82ec9-11eb-45fe-a0ea-ab62c6c343d21 HTTP/1.1 Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pbAvVvt5VUi8I6glisfe2yiyf6XUyCkY4lxlpAlTIanhu9qNvQZHstqSpNWi3ptNerJjCTwXcpcoxtQ-nHmBqYbdhTfOYNZbMdvRZuoIFHiAPNinP7Hm8qkiOmmR3-5ZGWD7bZaEZrOW2LY4qurUUDuRFs3lVo64EqmBwZSvAxC7T8 Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fb47179014cd4421b6a737f405323294 Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb47179014cd4421b6a737f405323294"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb47179014cd4421b6a737f405323294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb47179014cd4421b6a737f405323294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb47179014cd4421b6a737f405323294"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fb47179014cd4421b6a737f405323294 Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesDeleteNegativeTestJSON-1336565423-project Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 8e7527cf5ca748b9b8b7a10885409af3 Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423-project Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: exception: Image not found. Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'b3e82ec9-11eb-45fe-a0ea-ab62c6c343d21'} Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b3e82ec9-11eb-45fe-a0ea-ab62c6c343d21 to delete Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3e82ec9-11eb-45fe-a0ea-ab62c6c343d21 could not be found. Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:55.396586 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-822e1dec-c7ef-4074-b933-d7aea370b656 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Returning 404 to user: Image not found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-822e1dec-c7ef-4074-b933-d7aea370b656 tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] 10.222.0.93 "DELETE /compute/v2.1/images/b3e82ec9-11eb-45fe-a0ea-ab62c6c343d21" status: 404 len: 62 microversion: 2.1 time: 0.048337 Aug 09 17:17:55.411060 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1101/2294] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:17:55 2022] DELETE /compute/v2.1/images/b3e82ec9-11eb-45fe-a0ea-ab62c6c343d21 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:17:55.482914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-231293233", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:55.585755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:17:55.717373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd6d1155-7641-4c9b-9a83-e3f35525aac1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:55.770559 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd6d1155-7641-4c9b-9a83-e3f35525aac1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1494 microversion: 2.1 time: 0.658260 Aug 09 17:17:55.775516 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1194/2295] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:55 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1494 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:55.801103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b6015f4-cec4-4ded-901c-fca13a1038fc tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Calling method '.version_select at 0x7fbbcb961a60>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:55.867660 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-1b6015f4-cec4-4ded-901c-fca13a1038fc tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] HTTP exception thrown: Image not found. Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b6015f4-cec4-4ded-901c-fca13a1038fc tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Request method failure captured: Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/images/tempest-invalid-732177483 HTTP/1.1 Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pbAvVvt5VUi8I6glisfe2yiyf6XUyCkY4lxlpAlTIanhu9qNvQZHstqSpNWi3ptNerJjCTwXcpcoxtQ-nHmBqYbdhTfOYNZbMdvRZuoIFHiAPNinP7Hm8qkiOmmR3-5ZGWD7bZaEZrOW2LY4qurUUDuRFs3lVo64EqmBwZSvAxC7T8 Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fb47179014cd4421b6a737f405323294 Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb47179014cd4421b6a737f405323294"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb47179014cd4421b6a737f405323294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb47179014cd4421b6a737f405323294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb47179014cd4421b6a737f405323294"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fb47179014cd4421b6a737f405323294 Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesDeleteNegativeTestJSON-1336565423-project Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 8e7527cf5ca748b9b8b7a10885409af3 Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423-project Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'tempest-invalid-732177483'} Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-732177483 to delete Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-732177483 could not be found. Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.871906 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:55.876028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b6015f4-cec4-4ded-901c-fca13a1038fc tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:55.877595 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b6015f4-cec4-4ded-901c-fca13a1038fc tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] 10.222.0.93 "DELETE /compute/v2.1/images/tempest-invalid-732177483" status: 404 len: 62 microversion: 2.1 time: 0.087525 Aug 09 17:17:55.881524 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1195/2296] 10.222.0.93 () {58 vars in 1203 bytes} [Tue Aug 9 17:17:55 2022] DELETE /compute/v2.1/images/tempest-invalid-732177483 => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:17:55.902441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2299ad39-1e81-473c-80ef-4a4e7d3d8383 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:55.903878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2299ad39-1e81-473c-80ef-4a4e7d3d8383 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:55.918574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2299ad39-1e81-473c-80ef-4a4e7d3d8383 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:55.919189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2299ad39-1e81-473c-80ef-4a4e7d3d8383 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:55.919776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2299ad39-1e81-473c-80ef-4a4e7d3d8383 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:55.921048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2299ad39-1e81-473c-80ef-4a4e7d3d8383 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:55.922440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2299ad39-1e81-473c-80ef-4a4e7d3d8383 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:55.923169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2299ad39-1e81-473c-80ef-4a4e7d3d8383 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:56.185351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2299ad39-1e81-473c-80ef-4a4e7d3d8383 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690e63b241a741128f7c2d12f5cc3cef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7fc9e11a9a4343b3d9e5b66e7c18ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:56.209150 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2299ad39-1e81-473c-80ef-4a4e7d3d8383 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 200 len: 1469 microversion: 2.1 time: 0.321708 Aug 09 17:17:56.210126 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1196/2297] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:55 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 1469 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:56.242364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:56.243388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:56.262933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:56.268014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:56.272903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:56.274712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:56.277151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:56.278681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:56.356090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:17:56.356770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:17:56.357752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:17:56.358364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:17:56.358900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:17:56.382816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:56.383759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:56.388158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:56.393080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:56.393971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:56.394759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:56.469270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Getting quotas for project 8cf34f25cb174f8d83f684fecaeed872. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:17:56.483390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Getting quotas for user 061d553c95dd49078ead7d849f95904b and project 8cf34f25cb174f8d83f684fecaeed872. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:17:56.517308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.utils [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] cores quota exceeded for 8cf34f25cb174f8d83f684fecaeed872, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119432) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 09 17:17:56.518253 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Request method failure captured: Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 144 Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pa_-80EcxQ1FiFoX_0etlwEp__Rfnpw6m1ipknK-O9LMx-LkQtQg91zAom-wBFyAMgvBarcL4o5YZ6Wk4lZGw_mhwUeeYy9w9MvcEK-5LRPbLuHc7ldRjQ2ZxqCvPxAjXKSatt3_pKYUlX80mUWYK1fTwqOLcJ3IzVSorzt3JO2HGA Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 8cf34f25cb174f8d83f684fecaeed872 Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 8cf34f25cb174f8d83f684fecaeed872 Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-QuotasAdminNegativeTest-1972196503-project Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 061d553c95dd49078ead7d849f95904b Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-QuotasAdminNegativeTest-1972196503-project Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-231293233", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-231293233', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452'}}} Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 17:17:56.550489 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1061116d-cd96-4480-babc-57eef1788d69 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.151289 Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1102/2298] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:17:55 2022] POST /compute/v2.1/servers => generated 111 bytes in 1153 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:17:56.563583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-12fb6db3-1631-4a49-9bb6-c118004b003e tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Calling method '.version_select at 0x7fbbdc86c430>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:56.606987 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-12fb6db3-1631-4a49-9bb6-c118004b003e tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] HTTP exception thrown: Image not found. Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-12fb6db3-1631-4a49-9bb6-c118004b003e tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Request method failure captured: Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/images/ad66c593-90a0-4eb8-9281-78af536588cc HTTP/1.1 Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pbAvVvt5VUi8I6glisfe2yiyf6XUyCkY4lxlpAlTIanhu9qNvQZHstqSpNWi3ptNerJjCTwXcpcoxtQ-nHmBqYbdhTfOYNZbMdvRZuoIFHiAPNinP7Hm8qkiOmmR3-5ZGWD7bZaEZrOW2LY4qurUUDuRFs3lVo64EqmBwZSvAxC7T8 Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fb47179014cd4421b6a737f405323294 Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb47179014cd4421b6a737f405323294"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb47179014cd4421b6a737f405323294"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb47179014cd4421b6a737f405323294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb47179014cd4421b6a737f405323294"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fb47179014cd4421b6a737f405323294 Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423 Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesDeleteNegativeTestJSON-1336565423-project Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 8e7527cf5ca748b9b8b7a10885409af3 Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1336565423-project Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: exception: Image not found. Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'ad66c593-90a0-4eb8-9281-78af536588cc'} Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ad66c593-90a0-4eb8-9281-78af536588cc to delete Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ad66c593-90a0-4eb8-9281-78af536588cc could not be found. Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:56.609351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-12fb6db3-1631-4a49-9bb6-c118004b003e tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] Returning 404 to user: Image not found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-12fb6db3-1631-4a49-9bb6-c118004b003e tempest-ImagesDeleteNegativeTestJSON-1336565423 tempest-ImagesDeleteNegativeTestJSON-1336565423-project] 10.222.0.93 "DELETE /compute/v2.1/images/ad66c593-90a0-4eb8-9281-78af536588cc" status: 404 len: 62 microversion: 2.1 time: 0.057693 Aug 09 17:17:56.618376 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1103/2299] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:56 2022] DELETE /compute/v2.1/images/ad66c593-90a0-4eb8-9281-78af536588cc => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:17:56.629346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-0e6e1795-54ed-4113-a546-a253584b9063 req-93cf2ea2-825b-4419-97f0-6ff7cf62a52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c55760e6-1d24-4302-96ce-cdbdcb9a2b5a", "name": "network-vif-deleted", "tag": "aabe483a-b8ea-4c22-b6aa-1fdb011b1466"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:56.652853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0e6e1795-54ed-4113-a546-a253584b9063 req-93cf2ea2-825b-4419-97f0-6ff7cf62a52a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:56.653357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0e6e1795-54ed-4113-a546-a253584b9063 req-93cf2ea2-825b-4419-97f0-6ff7cf62a52a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:56.654504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0e6e1795-54ed-4113-a546-a253584b9063 req-93cf2ea2-825b-4419-97f0-6ff7cf62a52a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:56.666547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:56.682116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:56.685241 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-0e6e1795-54ed-4113-a546-a253584b9063 req-93cf2ea2-825b-4419-97f0-6ff7cf62a52a service nova] Creating event network-vif-deleted:aabe483a-b8ea-4c22-b6aa-1fdb011b1466 for instance c55760e6-1d24-4302-96ce-cdbdcb9a2b5a on n-h2-845781-6 Aug 09 17:17:56.688158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:56.697800 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-0e6e1795-54ed-4113-a546-a253584b9063 req-93cf2ea2-825b-4419-97f0-6ff7cf62a52a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081877 Aug 09 17:17:56.702900 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1104/2300] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:56.705233 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b4f4bd7f-7085-42ae-aacc-67c0687fbc39 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.481261 Aug 09 17:17:56.711520 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1197/2301] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:56 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:56.718753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3678a34e-0e94-4c43-9ccf-5dc25aad33cd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:56.721178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21757d07-5d2a-4f24-adff-f2962dd65f75 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcbfbadc0>, body: {"quota_set": {"cores": 20}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:56.722523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3678a34e-0e94-4c43-9ccf-5dc25aad33cd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:56.739604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3678a34e-0e94-4c43-9ccf-5dc25aad33cd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:56.744717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3678a34e-0e94-4c43-9ccf-5dc25aad33cd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:56.745538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3678a34e-0e94-4c43-9ccf-5dc25aad33cd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:56.748086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3678a34e-0e94-4c43-9ccf-5dc25aad33cd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:56.748897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3678a34e-0e94-4c43-9ccf-5dc25aad33cd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:56.749515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3678a34e-0e94-4c43-9ccf-5dc25aad33cd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:56.920122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21757d07-5d2a-4f24-adff-f2962dd65f75 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:56.920980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21757d07-5d2a-4f24-adff-f2962dd65f75 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:56.921201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21757d07-5d2a-4f24-adff-f2962dd65f75 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:56.922671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21757d07-5d2a-4f24-adff-f2962dd65f75 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:56.923869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21757d07-5d2a-4f24-adff-f2962dd65f75 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:56.924738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21757d07-5d2a-4f24-adff-f2962dd65f75 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:57.036850 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-21757d07-5d2a-4f24-adff-f2962dd65f75 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872" status: 200 len: 329 microversion: 2.1 time: 0.323478 Aug 09 17:17:57.039136 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1198/2302] 10.222.0.93 () {60 vars in 1262 bytes} [Tue Aug 9 17:17:56 2022] PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872 => generated 329 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:57.051880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a98cad46-bd08-4ce5-895e-9b9905c884a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:57.053184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a98cad46-bd08-4ce5-895e-9b9905c884a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:57.070563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a98cad46-bd08-4ce5-895e-9b9905c884a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:57.071440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a98cad46-bd08-4ce5-895e-9b9905c884a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:57.072259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a98cad46-bd08-4ce5-895e-9b9905c884a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:57.081000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a98cad46-bd08-4ce5-895e-9b9905c884a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:57.081925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a98cad46-bd08-4ce5-895e-9b9905c884a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:57.082739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a98cad46-bd08-4ce5-895e-9b9905c884a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:57.355871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3678a34e-0e94-4c43-9ccf-5dc25aad33cd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:57.387715 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3678a34e-0e94-4c43-9ccf-5dc25aad33cd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 0.678307 Aug 09 17:17:57.392672 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1105/2303] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:56 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:57.409573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a0daa947-4184-4147-a411-53c72aef9a66 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Calling method '.version_select at 0x7fbbcaeede50>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:57.968760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a98cad46-bd08-4ce5-895e-9b9905c884a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:57.986999 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a98cad46-bd08-4ce5-895e-9b9905c884a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1494 microversion: 2.1 time: 0.945503 Aug 09 17:17:57.993797 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1199/2304] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:57 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1494 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:58.020496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:58.023380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] [instance: c55760e6-1d24-4302-96ce-cdbdcb9a2b5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:58.059459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:58.060831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:58.061779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:58.066107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:58.071192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:58.072103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:58.121585 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a0daa947-4184-4147-a411-53c72aef9a66 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872" status: 200 len: 371 microversion: 2.1 time: 0.726613 Aug 09 17:17:58.128699 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] HTTP exception thrown: Instance c55760e6-1d24-4302-96ce-cdbdcb9a2b5a could not be found. Aug 09 17:17:58.134779 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1106/2305] 10.222.0.93 () {58 vars in 1242 bytes} [Tue Aug 9 17:17:57 2022] GET /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872 => generated 371 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Request method failure captured: Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a HTTP/1.1 Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8paUt-f6Ap8vWjrTFKBW5fcoqvcx5vYgNz408agJOT3k1_QqJWw6in18pIVxMeFMkfFPjC52h1vM35hNwf4xyA_UGLoAlRJYwMAF5prynpm-Dw-h5vVrPA9kbDHWk2koYWaqGGZDiNySMDqEiWRtt1tv2RZ00UMf9oq1WW03f8Add6w Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 7c7fc9e11a9a4343b3d9e5b66e7c18ef Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-InstanceActionsTestJSON-631914324 Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7c7fc9e11a9a4343b3d9e5b66e7c18ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7c7fc9e11a9a4343b3d9e5b66e7c18ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7c7fc9e11a9a4343b3d9e5b66e7c18ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7c7fc9e11a9a4343b3d9e5b66e7c18ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-InstanceActionsTestJSON-631914324 Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 7c7fc9e11a9a4343b3d9e5b66e7c18ef Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-InstanceActionsTestJSON-631914324 Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-InstanceActionsTestJSON-631914324-project Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 690e63b241a741128f7c2d12f5cc3cef Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-InstanceActionsTestJSON-631914324-project Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance c55760e6-1d24-4302-96ce-cdbdcb9a2b5a could not be found. Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'c55760e6-1d24-4302-96ce-cdbdcb9a2b5a'} Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c55760e6-1d24-4302-96ce-cdbdcb9a2b5a could not be found. Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c55760e6-1d24-4302-96ce-cdbdcb9a2b5a could not be found. Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:17:58.138692 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:58.146229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:17:58.146229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:17:58.146229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:17:58.146229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:17:58.146229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:17:58.146229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c55760e6-1d24-4302-96ce-cdbdcb9a2b5a could not be found. Aug 09 17:17:58.146229 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:17:58.146229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] Returning 404 to user: Instance c55760e6-1d24-4302-96ce-cdbdcb9a2b5a could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:17:58.146229 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-29cd42fe-123b-4018-820f-debeb4422f96 tempest-InstanceActionsTestJSON-631914324 tempest-InstanceActionsTestJSON-631914324-project] 10.222.0.93 "GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a" status: 404 len: 111 microversion: 2.1 time: 0.150149 Aug 09 17:17:58.153690 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1200/2306] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:57 2022] GET /compute/v2.1/servers/c55760e6-1d24-4302-96ce-cdbdcb9a2b5a => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:17:58.155996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:58.157519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:58.164802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-876f35ab-f8d5-4f64-b0d6-fa53521736c3 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcb9d6550>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:58.173753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:58.180781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:58.185495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:58.195871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:58.197140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:58.200498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:58.336111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-876f35ab-f8d5-4f64-b0d6-fa53521736c3 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:58.336916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-876f35ab-f8d5-4f64-b0d6-fa53521736c3 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:58.337523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-876f35ab-f8d5-4f64-b0d6-fa53521736c3 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:58.339504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-876f35ab-f8d5-4f64-b0d6-fa53521736c3 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:58.340267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-876f35ab-f8d5-4f64-b0d6-fa53521736c3 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:58.340870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-876f35ab-f8d5-4f64-b0d6-fa53521736c3 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:58.508184 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-876f35ab-f8d5-4f64-b0d6-fa53521736c3 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872" status: 200 len: 328 microversion: 2.1 time: 0.348625 Aug 09 17:17:58.528767 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1201/2307] 10.222.0.93 () {60 vars in 1262 bytes} [Tue Aug 9 17:17:58 2022] PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872 => generated 328 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:58.546415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-30dd7533-69d0-4236-afa5-df93ebba8b06 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:58.547741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-30dd7533-69d0-4236-afa5-df93ebba8b06 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:58.582794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30dd7533-69d0-4236-afa5-df93ebba8b06 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:58.583950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30dd7533-69d0-4236-afa5-df93ebba8b06 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:58.584874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30dd7533-69d0-4236-afa5-df93ebba8b06 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:58.586281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30dd7533-69d0-4236-afa5-df93ebba8b06 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:58.587221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30dd7533-69d0-4236-afa5-df93ebba8b06 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:58.588122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30dd7533-69d0-4236-afa5-df93ebba8b06 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:58.624557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:58.646193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:58.651301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:58.662030 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a11ad770-17a9-4d8f-9c1b-c37dbcbd055a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.524877 Aug 09 17:17:58.666753 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1107/2308] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:58 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:17:58.782100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-605671868", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:58.897481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:17:59.306637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-30dd7533-69d0-4236-afa5-df93ebba8b06 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:59.315947 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-30dd7533-69d0-4236-afa5-df93ebba8b06 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 0.785029 Aug 09 17:17:59.316819 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1202/2309] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:58 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:59.323066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9436b946-6a94-437b-951a-5821ea5a0038 req-bf0ce0b2-cc0e-4059-86a3-a604b1d0388b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f", "tag": "93578644-2d98-4048-92dc-e475d94afcd5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:17:59.337387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9436b946-6a94-437b-951a-5821ea5a0038 req-bf0ce0b2-cc0e-4059-86a3-a604b1d0388b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:59.338295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9436b946-6a94-437b-951a-5821ea5a0038 req-bf0ce0b2-cc0e-4059-86a3-a604b1d0388b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:59.339072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9436b946-6a94-437b-951a-5821ea5a0038 req-bf0ce0b2-cc0e-4059-86a3-a604b1d0388b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:59.360077 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9436b946-6a94-437b-951a-5821ea5a0038 req-bf0ce0b2-cc0e-4059-86a3-a604b1d0388b service nova] Creating event network-changed:93578644-2d98-4048-92dc-e475d94afcd5 for instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f on n-h1-845781-6 Aug 09 17:17:59.369210 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9436b946-6a94-437b-951a-5821ea5a0038 req-bf0ce0b2-cc0e-4059-86a3-a604b1d0388b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050481 Aug 09 17:17:59.371796 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1203/2310] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:17:59.392600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f2ae3f0-02ad-4424-a9d9-d3c0a809613d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:59.393865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6f2ae3f0-02ad-4424-a9d9-d3c0a809613d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:59.402932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2ae3f0-02ad-4424-a9d9-d3c0a809613d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:59.406204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2ae3f0-02ad-4424-a9d9-d3c0a809613d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:59.407048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2ae3f0-02ad-4424-a9d9-d3c0a809613d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:59.408015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2ae3f0-02ad-4424-a9d9-d3c0a809613d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:59.408911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2ae3f0-02ad-4424-a9d9-d3c0a809613d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:59.409758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2ae3f0-02ad-4424-a9d9-d3c0a809613d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:59.622779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6f2ae3f0-02ad-4424-a9d9-d3c0a809613d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:17:59.632241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6f2ae3f0-02ad-4424-a9d9-d3c0a809613d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 200 len: 1452 microversion: 2.1 time: 0.258711 Aug 09 17:17:59.645089 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1204/2311] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:17:59 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 1452 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:17:59.699566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:17:59.700476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:17:59.728566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:59.729577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:59.730068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:17:59.731001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:17:59.732056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:17:59.732893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:00.208410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:00.225970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:00.230251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:00.242699 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e05a9e3e-8e44-4cbb-b975-6812e9f542ad tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.548874 Aug 09 17:18:00.244157 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1205/2312] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:17:59 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:18:00.262485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1b55db3b-3233-4f4c-b59b-07b276e34128 req-eba4779c-9c13-4e81-9594-e1d7664f739b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a83e16f-e6c2-4c94-872d-0b6a08acfa76", "name": "network-vif-deleted", "tag": "757c519b-6af4-4d37-9f4f-607454d88c5f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:00.286128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1b55db3b-3233-4f4c-b59b-07b276e34128 req-eba4779c-9c13-4e81-9594-e1d7664f739b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:00.287030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1b55db3b-3233-4f4c-b59b-07b276e34128 req-eba4779c-9c13-4e81-9594-e1d7664f739b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:00.288212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1b55db3b-3233-4f4c-b59b-07b276e34128 req-eba4779c-9c13-4e81-9594-e1d7664f739b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:00.315542 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1b55db3b-3233-4f4c-b59b-07b276e34128 req-eba4779c-9c13-4e81-9594-e1d7664f739b service nova] Creating event network-vif-deleted:757c519b-6af4-4d37-9f4f-607454d88c5f for instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 on n-h1-845781-6 Aug 09 17:18:00.326433 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1b55db3b-3233-4f4c-b59b-07b276e34128 req-eba4779c-9c13-4e81-9594-e1d7664f739b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074701 Aug 09 17:18:00.328654 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1206/2313] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:00.364791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f7ecb09-5a13-45a4-8d57-5e8a57b07fd8 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:00.368308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5f7ecb09-5a13-45a4-8d57-5e8a57b07fd8 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:00.382898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f7ecb09-5a13-45a4-8d57-5e8a57b07fd8 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:00.383705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f7ecb09-5a13-45a4-8d57-5e8a57b07fd8 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:00.384345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f7ecb09-5a13-45a4-8d57-5e8a57b07fd8 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:00.385344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f7ecb09-5a13-45a4-8d57-5e8a57b07fd8 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:00.386618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f7ecb09-5a13-45a4-8d57-5e8a57b07fd8 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:00.387470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f7ecb09-5a13-45a4-8d57-5e8a57b07fd8 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:00.664543 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:18:00.665255 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 17:18:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f (ip 10.222.0.93) !!! Aug 09 17:18:00.980660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:18:00.982730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:18:00.983811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:18:00.985335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:18:00.986497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:18:01.007887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:01.010007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:01.010819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:01.019587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:01.021152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:01.024805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:01.062156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Getting quotas for project 8cf34f25cb174f8d83f684fecaeed872. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:18:01.069565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Getting quotas for user 061d553c95dd49078ead7d849f95904b and project 8cf34f25cb174f8d83f684fecaeed872. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:18:01.093283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.utils [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] instances quota exceeded for 8cf34f25cb174f8d83f684fecaeed872, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119432) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 09 17:18:01.094677 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Request method failure captured: Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 144 Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pa_-80EcxQ1FiFoX_0etlwEp__Rfnpw6m1ipknK-O9LMx-LkQtQg91zAom-wBFyAMgvBarcL4o5YZ6Wk4lZGw_mhwUeeYy9w9MvcEK-5LRPbLuHc7ldRjQ2ZxqCvPxAjXKSatt3_pKYUlX80mUWYK1fTwqOLcJ3IzVSorzt3JO2HGA Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 8cf34f25cb174f8d83f684fecaeed872 Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 8cf34f25cb174f8d83f684fecaeed872 Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-QuotasAdminNegativeTest-1972196503-project Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 061d553c95dd49078ead7d849f95904b Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-QuotasAdminNegativeTest-1972196503-project Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-605671868", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-605671868', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452'}}} Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 17:18:01.097679 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.102217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:18:01.104741 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9b3070d7-52ca-4118-8ad7-5cc30ec711c3 tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 2.338887 Aug 09 17:18:01.106106 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1108/2314] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:17:58 2022] POST /compute/v2.1/servers => generated 119 bytes in 2342 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:18:01.151959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:01.156645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:01.177514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:01.180523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:01.182031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:01.185204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:01.187332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:01.190847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:01.249588 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 HTTP/1.1 Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9a83e16f-e6c2-4c94-872d-0b6a08acfa76'} Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:01.253767 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.265298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.265298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:01.265298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:01.265298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:18:01.265298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:18:01.265298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:18:01.265298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.269721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:18:01.272714 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d8843409-5a8a-4b24-8892-b1b1627091db tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 404 len: 111 microversion: 2.1 time: 0.158948 Aug 09 17:18:01.274396 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1109/2315] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:01 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:18:01.285998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:01.289601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:01.306527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f7ecb09-5a13-45a4-8d57-5e8a57b07fd8 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:01.308374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:01.309559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:01.310137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:01.311404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:01.313353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:01.317315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:01.341047 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f7ecb09-5a13-45a4-8d57-5e8a57b07fd8 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 0.989650 Aug 09 17:18:01.344474 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1207/2316] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:00 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:01.356188 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] HTTP exception thrown: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Request method failure captured: Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf HTTP/1.1 Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pSttTG9Ny2XyWeRwNrwHteTKDv8483WIa3ukn52tDFODNnNSGJlHhBbv7BuFEy90xak9mV68c_Q_OLGXe8LtElzZrbTapd-GcLL0Sz6ZEbwBcXon2S0p-HAzDMzaPRsE70p4gwvTJfrIVAW1e1IoAzSfbZAbzRTshctHp9XodPxp6A Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.42 Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 314d59a0480e4be59dba88bc8810b146 Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1687902210 Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_314d59a0480e4be59dba88bc8810b146"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/314d59a0480e4be59dba88bc8810b146"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/314d59a0480e4be59dba88bc8810b146"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/314d59a0480e4be59dba88bc8810b146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1687902210 Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 314d59a0480e4be59dba88bc8810b146 Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1687902210 Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TaggedBootDevicesTest_v242-1687902210-project Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 3fea520df5014ddabc2f232cdaa8a53f Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1687902210-project Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'bf1964d4-6f76-4c48-b05a-e123ce244faf'} Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:18:01.366286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:18:01.377319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:18:01.377319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.377319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:01.377319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.377319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.377319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:01.377319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:01.377319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:18:01.377319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:18:01.377319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:18:01.377319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.380944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Returning 404 to user: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:18:01.383062 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-526195a2-19e2-474c-a877-0aa306372966 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 404 len: 111 microversion: 2.42 time: 0.105597 Aug 09 17:18:01.386089 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1110/2317] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:18:01 2022] DELETE /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:18:01.389787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3cbdf8c1-8797-4f5b-b9f3-9b3c6147cef1 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcb9d64c0>, body: {"quota_set": {"instances": 10}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:01.411902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:01.413973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:01.445015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:01.452625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:01.456356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:01.458797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:01.461437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:01.466564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:01.648014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:01.681326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:01.691283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:01.718302 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a3c5b850-7d14-446f-8bc2-c160ee0f0b0b tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.329261 Aug 09 17:18:01.718954 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1111/2318] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:01 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:01.745563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:01.746194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] [instance: bf1964d4-6f76-4c48-b05a-e123ce244faf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:01.770423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:01.773007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:01.774543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:01.776317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:01.783664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:01.783664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:01.798259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:01.826652 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] HTTP exception thrown: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Request method failure captured: Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf HTTP/1.1 Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pSttTG9Ny2XyWeRwNrwHteTKDv8483WIa3ukn52tDFODNnNSGJlHhBbv7BuFEy90xak9mV68c_Q_OLGXe8LtElzZrbTapd-GcLL0Sz6ZEbwBcXon2S0p-HAzDMzaPRsE70p4gwvTJfrIVAW1e1IoAzSfbZAbzRTshctHp9XodPxp6A Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.42 Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 314d59a0480e4be59dba88bc8810b146 Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1687902210 Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_314d59a0480e4be59dba88bc8810b146"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/314d59a0480e4be59dba88bc8810b146"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/314d59a0480e4be59dba88bc8810b146"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/314d59a0480e4be59dba88bc8810b146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1687902210 Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 314d59a0480e4be59dba88bc8810b146 Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1687902210 Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TaggedBootDevicesTest_v242-1687902210-project Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 3fea520df5014ddabc2f232cdaa8a53f Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1687902210-project Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'bf1964d4-6f76-4c48-b05a-e123ce244faf'} Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.839095 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:01.854942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.854942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:01.854942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:01.854942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:01.854942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:18:01.854942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:18:01.854942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. Aug 09 17:18:01.854942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:01.854942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] Returning 404 to user: Instance bf1964d4-6f76-4c48-b05a-e123ce244faf could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:18:01.854942 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b2143325-f439-4f84-9897-75c13393e591 tempest-TaggedBootDevicesTest_v242-1687902210 tempest-TaggedBootDevicesTest_v242-1687902210-project] 10.222.0.93 "GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf" status: 404 len: 111 microversion: 2.42 time: 0.106750 Aug 09 17:18:01.854942 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1112/2319] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:01 2022] GET /compute/v2.1/servers/bf1964d4-6f76-4c48-b05a-e123ce244faf => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:18:01.860280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-9f288829-0b13-45a3-ba96-2abcc140b2da req-ad17ba83-aee9-4467-ab1e-f0ddbbb6b6fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f", "tag": "30a45131-bab2-4fd6-935a-6f588c37fcbb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:01.900862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9f288829-0b13-45a3-ba96-2abcc140b2da req-ad17ba83-aee9-4467-ab1e-f0ddbbb6b6fd service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:01.900862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9f288829-0b13-45a3-ba96-2abcc140b2da req-ad17ba83-aee9-4467-ab1e-f0ddbbb6b6fd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:01.900862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9f288829-0b13-45a3-ba96-2abcc140b2da req-ad17ba83-aee9-4467-ab1e-f0ddbbb6b6fd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:01.953073 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-9f288829-0b13-45a3-ba96-2abcc140b2da req-ad17ba83-aee9-4467-ab1e-f0ddbbb6b6fd service nova] Creating event network-changed:30a45131-bab2-4fd6-935a-6f588c37fcbb for instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f on n-h1-845781-6 Aug 09 17:18:01.974462 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-9f288829-0b13-45a3-ba96-2abcc140b2da req-ad17ba83-aee9-4467-ab1e-f0ddbbb6b6fd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130070 Aug 09 17:18:01.976153 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1113/2320] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:01.991436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-962067291", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ad48ae09-8243-461d-b010-943470de6d49"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:02.144681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] validate_networks() for [('ad48ae09-8243-461d-b010-943470de6d49', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:18:02.395954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cbdf8c1-8797-4f5b-b9f3-9b3c6147cef1 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:02.398617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cbdf8c1-8797-4f5b-b9f3-9b3c6147cef1 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:02.399967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cbdf8c1-8797-4f5b-b9f3-9b3c6147cef1 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:02.404971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cbdf8c1-8797-4f5b-b9f3-9b3c6147cef1 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:02.406484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cbdf8c1-8797-4f5b-b9f3-9b3c6147cef1 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:02.407599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3cbdf8c1-8797-4f5b-b9f3-9b3c6147cef1 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:02.518936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:02.611287 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3cbdf8c1-8797-4f5b-b9f3-9b3c6147cef1 tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872" status: 200 len: 329 microversion: 2.1 time: 1.264095 Aug 09 17:18:02.613255 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1208/2321] 10.222.0.93 () {60 vars in 1262 bytes} [Tue Aug 9 17:18:01 2022] PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872 => generated 329 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:02.621235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dca00e83-b2dd-480f-a771-f8bb737bbcff tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:02.622951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dca00e83-b2dd-480f-a771-f8bb737bbcff tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:02.635586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dca00e83-b2dd-480f-a771-f8bb737bbcff tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:02.636566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dca00e83-b2dd-480f-a771-f8bb737bbcff tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:02.637754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dca00e83-b2dd-480f-a771-f8bb737bbcff tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:02.640063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dca00e83-b2dd-480f-a771-f8bb737bbcff tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:02.643411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dca00e83-b2dd-480f-a771-f8bb737bbcff tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:02.644745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dca00e83-b2dd-480f-a771-f8bb737bbcff tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:03.133634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dca00e83-b2dd-480f-a771-f8bb737bbcff tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:03.154969 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dca00e83-b2dd-480f-a771-f8bb737bbcff tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 0.539536 Aug 09 17:18:03.155864 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1209/2322] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:02 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:03.216798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-216bac63-fe4d-44ac-bad5-ae8d16fdd3ae tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Calling method '.version_select at 0x7fbbd802f820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:03.826378 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-216bac63-fe4d-44ac-bad5-ae8d16fdd3ae tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872" status: 200 len: 371 microversion: 2.1 time: 0.668103 Aug 09 17:18:03.828043 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1210/2323] 10.222.0.93 () {58 vars in 1242 bytes} [Tue Aug 9 17:18:03 2022] GET /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872 => generated 371 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:03.840117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:03.841353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:03.859709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:03.861173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:03.861992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:03.863363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:03.864817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:03.866216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:04.109281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:18:04.110405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:18:04.111190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:18:04.111841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:18:04.112275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:18:04.132659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:04.133160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:04.133616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:04.134390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:04.134861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:04.135371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:04.185945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:18:04.198445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:04.213087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:04.221213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for user d8e1dc1f64fe429ea6a8c746b7c84ae6 and project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:18:04.238443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:04.241806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:18:04.243949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:04.245395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:18:04.262763 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ab45c5b0-210e-4a4f-a9ab-9a30ade43fee tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.433034 Aug 09 17:18:04.263984 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1211/2324] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:03 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:04.281975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-adac5a07-c07d-4a7a-90eb-1c3fa16a9dfb req-7c542350-9194-4c2e-ba64-9c3eab1b2b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f", "tag": "c5c67c56-698c-45f4-a7ee-43ab9ca133ae"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:04.302120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-adac5a07-c07d-4a7a-90eb-1c3fa16a9dfb req-7c542350-9194-4c2e-ba64-9c3eab1b2b7e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:04.302388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-adac5a07-c07d-4a7a-90eb-1c3fa16a9dfb req-7c542350-9194-4c2e-ba64-9c3eab1b2b7e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:04.302999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-adac5a07-c07d-4a7a-90eb-1c3fa16a9dfb req-7c542350-9194-4c2e-ba64-9c3eab1b2b7e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:04.324865 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-adac5a07-c07d-4a7a-90eb-1c3fa16a9dfb req-7c542350-9194-4c2e-ba64-9c3eab1b2b7e service nova] Creating event network-changed:c5c67c56-698c-45f4-a7ee-43ab9ca133ae for instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f on n-h1-845781-6 Aug 09 17:18:04.337770 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4ccd51fb-7aee-470a-ac28-7c572e03bfcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.359457 Aug 09 17:18:04.340238 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1114/2325] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:18:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:18:04.342715 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-adac5a07-c07d-4a7a-90eb-1c3fa16a9dfb req-7c542350-9194-4c2e-ba64-9c3eab1b2b7e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065753 Aug 09 17:18:04.346085 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1212/2326] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:04.351128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe5a558e-9cf2-4b08-b137-c25d0de7b26a tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcaeedb80>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:04.365690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f01f883a-955a-4e7f-a16a-9b744d6d12a9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:04.366695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f01f883a-955a-4e7f-a16a-9b744d6d12a9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:04.374342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f01f883a-955a-4e7f-a16a-9b744d6d12a9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:04.375721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f01f883a-955a-4e7f-a16a-9b744d6d12a9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:04.376324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f01f883a-955a-4e7f-a16a-9b744d6d12a9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:04.378850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f01f883a-955a-4e7f-a16a-9b744d6d12a9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:04.380166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f01f883a-955a-4e7f-a16a-9b744d6d12a9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:04.387056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f01f883a-955a-4e7f-a16a-9b744d6d12a9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:04.497579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe5a558e-9cf2-4b08-b137-c25d0de7b26a tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:04.498089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe5a558e-9cf2-4b08-b137-c25d0de7b26a tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:04.498594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe5a558e-9cf2-4b08-b137-c25d0de7b26a tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:04.499425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe5a558e-9cf2-4b08-b137-c25d0de7b26a tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:04.499889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe5a558e-9cf2-4b08-b137-c25d0de7b26a tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:04.500388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe5a558e-9cf2-4b08-b137-c25d0de7b26a tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:04.647814 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fe5a558e-9cf2-4b08-b137-c25d0de7b26a tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872" status: 200 len: 325 microversion: 2.1 time: 0.305440 Aug 09 17:18:04.654204 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1115/2327] 10.222.0.93 () {60 vars in 1262 bytes} [Tue Aug 9 17:18:04 2022] PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872 => generated 325 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:04.673086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-023f287e-9e63-4fc0-9833-ee2088c822f3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:04.680970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-023f287e-9e63-4fc0-9833-ee2088c822f3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:04.884230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-023f287e-9e63-4fc0-9833-ee2088c822f3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:04.936501 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-023f287e-9e63-4fc0-9833-ee2088c822f3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1214 microversion: 2.1 time: 0.280269 Aug 09 17:18:04.952691 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1116/2328] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:04 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1214 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:04.999393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1063277945", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:05.141133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:18:05.260669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f01f883a-955a-4e7f-a16a-9b744d6d12a9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:05.286693 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f01f883a-955a-4e7f-a16a-9b744d6d12a9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 0.937475 Aug 09 17:18:05.289340 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1213/2329] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:04 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:05.311341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:05.317776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:05.343166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:05.344002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:05.350090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:05.354719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:05.363285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:05.364582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:05.551280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:05.588604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:05.600421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:05.625106 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ce226ac-095a-46d1-95c4-15a990b14f1c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.327106 Aug 09 17:18:05.641379 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1214/2330] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:05 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:05.696985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f0175ac7-34e8-4dce-9ce6-30eef8dfc155 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb984ca0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:05.894089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f0175ac7-34e8-4dce-9ce6-30eef8dfc155 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/74dba511-e2c4-41ed-8480-4b9707eba5e8" status: 200 len: 661 microversion: 2.1 time: 0.207352 Aug 09 17:18:05.909260 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1215/2331] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:05 2022] GET /compute/v2.1/images/74dba511-e2c4-41ed-8480-4b9707eba5e8 => generated 661 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:05.925669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-945afe74-b098-4205-afa1-8b3aabaf0af1 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb968d30>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:06.022566 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-945afe74-b098-4205-afa1-8b3aabaf0af1 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/74dba511-e2c4-41ed-8480-4b9707eba5e8" status: 200 len: 661 microversion: 2.1 time: 0.106975 Aug 09 17:18:06.024300 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1216/2332] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:05 2022] GET /compute/v2.1/images/74dba511-e2c4-41ed-8480-4b9707eba5e8 => generated 661 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:18:06.079572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1350a1f-6d28-40a8-9736-d91cc66aba1c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:06.081772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e1350a1f-6d28-40a8-9736-d91cc66aba1c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:06.103807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1350a1f-6d28-40a8-9736-d91cc66aba1c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:06.105051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1350a1f-6d28-40a8-9736-d91cc66aba1c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:06.106132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1350a1f-6d28-40a8-9736-d91cc66aba1c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:06.108427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1350a1f-6d28-40a8-9736-d91cc66aba1c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:06.112133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1350a1f-6d28-40a8-9736-d91cc66aba1c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:06.115276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1350a1f-6d28-40a8-9736-d91cc66aba1c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:06.169466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:18:06.171232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:18:06.172422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:18:06.173387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:18:06.174343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:18:06.238676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:06.244179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:06.248356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:06.250292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:06.258240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:06.259567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:06.356229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Getting quotas for project 8cf34f25cb174f8d83f684fecaeed872. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:18:06.373044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Getting quotas for user 061d553c95dd49078ead7d849f95904b and project 8cf34f25cb174f8d83f684fecaeed872. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:18:06.414764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.utils [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] ram quota exceeded for 8cf34f25cb174f8d83f684fecaeed872, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119432) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 09 17:18:06.415335 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Request method failure captured: Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 145 Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pa_-80EcxQ1FiFoX_0etlwEp__Rfnpw6m1ipknK-O9LMx-LkQtQg91zAom-wBFyAMgvBarcL4o5YZ6Wk4lZGw_mhwUeeYy9w9MvcEK-5LRPbLuHc7ldRjQ2ZxqCvPxAjXKSatt3_pKYUlX80mUWYK1fTwqOLcJ3IzVSorzt3JO2HGA Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 8cf34f25cb174f8d83f684fecaeed872 Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 8cf34f25cb174f8d83f684fecaeed872 Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-QuotasAdminNegativeTest-1972196503-project Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 061d553c95dd49078ead7d849f95904b Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-QuotasAdminNegativeTest-1972196503-project Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1063277945", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1063277945', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452'}}} Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 17:18:06.418501 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ba372a7e-82bc-45eb-8d09-b6fb615894ee tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.429157 Aug 09 17:18:06.427007 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1117/2333] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:18:04 2022] POST /compute/v2.1/servers => generated 110 bytes in 1431 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:18:06.439542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-348e5900-1f5b-4077-b49c-d40454eb1735 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:06.439542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-348e5900-1f5b-4077-b49c-d40454eb1735 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:06.439542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-348e5900-1f5b-4077-b49c-d40454eb1735 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:06.439542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-348e5900-1f5b-4077-b49c-d40454eb1735 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:06.439542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-348e5900-1f5b-4077-b49c-d40454eb1735 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:06.439542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-348e5900-1f5b-4077-b49c-d40454eb1735 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:06.442014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-348e5900-1f5b-4077-b49c-d40454eb1735 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:06.452492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-348e5900-1f5b-4077-b49c-d40454eb1735 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:06.515512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e1350a1f-6d28-40a8-9736-d91cc66aba1c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:06.545281 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1350a1f-6d28-40a8-9736-d91cc66aba1c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1218 microversion: 2.1 time: 0.503613 Aug 09 17:18:06.546188 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1217/2334] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:06 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1218 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:06.569619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4c2279a-5d6f-4d66-9bf9-90c5e45733ae tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Action: 'update', calling method: .version_select at 0x7fbbcb566a60>, body: {"quota_set": {"ram": 51200}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:06.846493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-348e5900-1f5b-4077-b49c-d40454eb1735 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:06.857063 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-348e5900-1f5b-4077-b49c-d40454eb1735 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 0.433754 Aug 09 17:18:06.858573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c2279a-5d6f-4d66-9bf9-90c5e45733ae tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:06.859129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c2279a-5d6f-4d66-9bf9-90c5e45733ae tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:06.859591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c2279a-5d6f-4d66-9bf9-90c5e45733ae tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:06.862675 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1118/2335] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:06 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:06.880277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c2279a-5d6f-4d66-9bf9-90c5e45733ae tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:06.881884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:06.882266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c2279a-5d6f-4d66-9bf9-90c5e45733ae tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:06.882738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4c2279a-5d6f-4d66-9bf9-90c5e45733ae tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:06.883489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:06.894777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:06.895354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:06.896153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:06.896979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:06.903702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:06.904680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:07.059175 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c4c2279a-5d6f-4d66-9bf9-90c5e45733ae tempest-QuotasAdminNegativeTest-1790782207 tempest-QuotasAdminNegativeTest-1790782207-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872" status: 200 len: 329 microversion: 2.1 time: 0.510295 Aug 09 17:18:07.060570 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1218/2336] 10.222.0.93 () {60 vars in 1262 bytes} [Tue Aug 9 17:18:06 2022] PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872 => generated 329 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:07.082907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-125195f8-ed8d-43e0-a2a1-bee554f4075b tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Action: 'update', calling method: .version_select at 0x7fbbcb8f08b0>, body: {"quota_set": {"ram": 0}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:07.094538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-125195f8-ed8d-43e0-a2a1-bee554f4075b tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '061d553c95dd49078ead7d849f95904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf34f25cb174f8d83f684fecaeed872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-125195f8-ed8d-43e0-a2a1-bee554f4075b tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Request method failure captured: Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: request: PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872 HTTP/1.1 Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 25 Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pa_-80EcxQ1FiFoX_0etlwEp__Rfnpw6m1ipknK-O9LMx-LkQtQg91zAom-wBFyAMgvBarcL4o5YZ6Wk4lZGw_mhwUeeYy9w9MvcEK-5LRPbLuHc7ldRjQ2ZxqCvPxAjXKSatt3_pKYUlX80mUWYK1fTwqOLcJ3IzVSorzt3JO2HGA Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 8cf34f25cb174f8d83f684fecaeed872 Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8cf34f25cb174f8d83f684fecaeed872"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 8cf34f25cb174f8d83f684fecaeed872 Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1972196503 Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-QuotasAdminNegativeTest-1972196503-project Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 061d553c95dd49078ead7d849f95904b Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-QuotasAdminNegativeTest-1972196503-project Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: {"quota_set": {"ram": 0}} Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8cf34f25cb174f8d83f684fecaeed872', 'body': {'quota_set': {'ram': 0}}} Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 17:18:07.103645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-125195f8-ed8d-43e0-a2a1-bee554f4075b tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-125195f8-ed8d-43e0-a2a1-bee554f4075b tempest-QuotasAdminNegativeTest-1972196503 tempest-QuotasAdminNegativeTest-1972196503-project] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872" status: 403 len: 116 microversion: 2.1 time: 0.027896 Aug 09 17:18:07.108027 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1219/2337] 10.222.0.93 () {60 vars in 1262 bytes} [Tue Aug 9 17:18:07 2022] PUT /compute/v2.1/os-quota-sets/8cf34f25cb174f8d83f684fecaeed872 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:18:07.582621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d79cceee-d3e4-4655-9ffa-938bd21382aa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:07.594989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d79cceee-d3e4-4655-9ffa-938bd21382aa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:07.635595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d79cceee-d3e4-4655-9ffa-938bd21382aa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:07.636590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d79cceee-d3e4-4655-9ffa-938bd21382aa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:07.663761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d79cceee-d3e4-4655-9ffa-938bd21382aa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:07.665587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d79cceee-d3e4-4655-9ffa-938bd21382aa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:07.672468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d79cceee-d3e4-4655-9ffa-938bd21382aa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:07.675163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d79cceee-d3e4-4655-9ffa-938bd21382aa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:07.707301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:08.236683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d79cceee-d3e4-4655-9ffa-938bd21382aa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:08.283186 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d79cceee-d3e4-4655-9ffa-938bd21382aa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1272 microversion: 2.1 time: 0.716242 Aug 09 17:18:08.296617 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1220/2338] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:07 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1272 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:08.349308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-04c15fe2-6ded-45cc-9d7a-c231e591b5bd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:08.350836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-04c15fe2-6ded-45cc-9d7a-c231e591b5bd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:08.415974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04c15fe2-6ded-45cc-9d7a-c231e591b5bd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:08.416782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04c15fe2-6ded-45cc-9d7a-c231e591b5bd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:08.417436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04c15fe2-6ded-45cc-9d7a-c231e591b5bd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:08.418743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04c15fe2-6ded-45cc-9d7a-c231e591b5bd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:08.419601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04c15fe2-6ded-45cc-9d7a-c231e591b5bd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:08.433945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04c15fe2-6ded-45cc-9d7a-c231e591b5bd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:08.579184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:08.612045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:08.619260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:08.660980 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c4ce2063-1183-4553-9ed4-92d453d45ee3 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 1.795449 Aug 09 17:18:08.663544 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1119/2339] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:06 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:08.848527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c61510ac-a3a9-4832-8645-7f55e5b64506 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc86cf70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:08.959303 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c61510ac-a3a9-4832-8645-7f55e5b64506 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/947579f1-5b7c-41e3-8756-ecc0697a44f7" status: 200 len: 661 microversion: 2.1 time: 0.118529 Aug 09 17:18:08.969922 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1120/2340] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:08 2022] GET /compute/v2.1/images/947579f1-5b7c-41e3-8756-ecc0697a44f7 => generated 661 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:18:08.976780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d773cd66-0500-4271-8411-b873ccf7575b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcaebddc0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:09.075318 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d773cd66-0500-4271-8411-b873ccf7575b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/947579f1-5b7c-41e3-8756-ecc0697a44f7" status: 200 len: 661 microversion: 2.1 time: 0.103416 Aug 09 17:18:09.084094 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1121/2341] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:08 2022] GET /compute/v2.1/images/947579f1-5b7c-41e3-8756-ecc0697a44f7 => generated 661 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:09.331879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e78fbff0-facb-4e2f-917b-839482a0241e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:09.332523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e78fbff0-facb-4e2f-917b-839482a0241e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:09.364395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78fbff0-facb-4e2f-917b-839482a0241e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:09.367334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78fbff0-facb-4e2f-917b-839482a0241e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:09.367948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78fbff0-facb-4e2f-917b-839482a0241e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:09.374423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78fbff0-facb-4e2f-917b-839482a0241e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:09.378363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78fbff0-facb-4e2f-917b-839482a0241e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:09.379116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78fbff0-facb-4e2f-917b-839482a0241e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:09.861752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e78fbff0-facb-4e2f-917b-839482a0241e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:09.900587 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e78fbff0-facb-4e2f-917b-839482a0241e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1272 microversion: 2.1 time: 0.559803 Aug 09 17:18:09.902590 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1122/2342] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:09 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1272 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:09.925694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:09.927373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:09.955384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:09.961154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:09.962048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:09.963497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:09.966399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:09.973627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:10.260532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:10.300771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-04c15fe2-6ded-45cc-9d7a-c231e591b5bd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:10.312087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:10.318176 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-04c15fe2-6ded-45cc-9d7a-c231e591b5bd tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 2.014845 Aug 09 17:18:10.318833 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1221/2343] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:08 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:10.340821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:10.368062 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ceec84a6-52f2-4bfb-9470-ce3479ff0b8c tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.462313 Aug 09 17:18:10.375652 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1123/2344] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:09 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:10.951109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44ab788e-7f81-45f8-8bb0-2539476f030c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:10.954587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-44ab788e-7f81-45f8-8bb0-2539476f030c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:10.995305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44ab788e-7f81-45f8-8bb0-2539476f030c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:10.998726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44ab788e-7f81-45f8-8bb0-2539476f030c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:11.000443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44ab788e-7f81-45f8-8bb0-2539476f030c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:11.006090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44ab788e-7f81-45f8-8bb0-2539476f030c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:11.010528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44ab788e-7f81-45f8-8bb0-2539476f030c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:11.013070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44ab788e-7f81-45f8-8bb0-2539476f030c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:11.127357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-16f1123f-81c8-4cf0-9606-0de8d8b9971e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc8c4af0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:11.300846 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-16f1123f-81c8-4cf0-9606-0de8d8b9971e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/989d33c2-d2cf-4cde-b6c5-20156edaf9e2" status: 200 len: 661 microversion: 2.1 time: 0.179568 Aug 09 17:18:11.310868 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1124/2345] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:11 2022] GET /compute/v2.1/images/989d33c2-d2cf-4cde-b6c5-20156edaf9e2 => generated 661 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:18:11.312795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-44ab788e-7f81-45f8-8bb0-2539476f030c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:11.359689 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-44ab788e-7f81-45f8-8bb0-2539476f030c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1272 microversion: 2.1 time: 0.418269 Aug 09 17:18:11.365252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f2af778a-0638-43b8-8e8d-8d02352359ed tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcae43e50>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:11.373688 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1222/2346] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:10 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1272 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:11.399809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a87b92c8-ec96-4950-ad75-b687c8c419ab tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:11.400643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a87b92c8-ec96-4950-ad75-b687c8c419ab tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:11.426509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a87b92c8-ec96-4950-ad75-b687c8c419ab tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:11.430102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a87b92c8-ec96-4950-ad75-b687c8c419ab tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:11.453179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a87b92c8-ec96-4950-ad75-b687c8c419ab tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:11.457496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a87b92c8-ec96-4950-ad75-b687c8c419ab tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:11.463243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a87b92c8-ec96-4950-ad75-b687c8c419ab tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:11.464288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a87b92c8-ec96-4950-ad75-b687c8c419ab tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:11.469919 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f2af778a-0638-43b8-8e8d-8d02352359ed tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/989d33c2-d2cf-4cde-b6c5-20156edaf9e2" status: 200 len: 661 microversion: 2.1 time: 0.146769 Aug 09 17:18:11.479916 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1125/2347] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:11 2022] GET /compute/v2.1/images/989d33c2-d2cf-4cde-b6c5-20156edaf9e2 => generated 661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:11.502302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:11.507393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:11.532934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:11.535161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:11.537039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:11.550776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:11.557943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:11.559098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:12.063646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:12.097277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:12.104547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:12.142842 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2bd3fa7a-048c-4db4-ad0c-ee6c1a8ae18f tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.659565 Aug 09 17:18:12.144449 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1126/2348] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:11 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:12.155059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-530050075", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:12.364362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:18:12.564816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a87b92c8-ec96-4950-ad75-b687c8c419ab tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:12.580729 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a87b92c8-ec96-4950-ad75-b687c8c419ab tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 1.202682 Aug 09 17:18:12.581480 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1223/2349] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:11 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:12.588006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-89bfff3a-cd77-4e14-9cf1-495cbd7a3d09 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:12.595210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-89bfff3a-cd77-4e14-9cf1-495cbd7a3d09 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:12.615205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89bfff3a-cd77-4e14-9cf1-495cbd7a3d09 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:12.616032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89bfff3a-cd77-4e14-9cf1-495cbd7a3d09 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:12.616739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89bfff3a-cd77-4e14-9cf1-495cbd7a3d09 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:12.617492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89bfff3a-cd77-4e14-9cf1-495cbd7a3d09 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:12.617972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89bfff3a-cd77-4e14-9cf1-495cbd7a3d09 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:12.618520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89bfff3a-cd77-4e14-9cf1-495cbd7a3d09 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:13.348048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-89bfff3a-cd77-4e14-9cf1-495cbd7a3d09 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:13.360018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:18:13.360606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:18:13.360917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:18:13.361976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:18:13.362712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:18:13.367461 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-89bfff3a-cd77-4e14-9cf1-495cbd7a3d09 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1314 microversion: 2.1 time: 0.783385 Aug 09 17:18:13.378795 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1224/2350] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:12 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:13.383967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:13.384779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:13.385519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:13.386794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:13.388658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:13.391108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:13.394277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:13.395754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:13.410979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:13.414872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:13.418847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:13.422950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:13.427078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:13.429428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:13.457454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Getting quotas for project 1ed2afd5a7c94838bb9f74b8b71ad263. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:18:13.473690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Getting quotas for user 4ab47f4c2fa541a39b25856232720588 and project 1ed2afd5a7c94838bb9f74b8b71ad263. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:18:13.517319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:18:13.520671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:18:13.597693 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-55e41cab-76b4-40a2-8080-cc589d7aab8b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.451073 Aug 09 17:18:13.599033 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1127/2351] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:18:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:18:13.618355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5b93fb10-c975-4836-8824-d40b5cf19d15 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:13.619863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5b93fb10-c975-4836-8824-d40b5cf19d15 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:13.629180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93fb10-c975-4836-8824-d40b5cf19d15 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:13.630114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93fb10-c975-4836-8824-d40b5cf19d15 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:13.630961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93fb10-c975-4836-8824-d40b5cf19d15 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:13.631999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93fb10-c975-4836-8824-d40b5cf19d15 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:13.632900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93fb10-c975-4836-8824-d40b5cf19d15 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:13.633525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93fb10-c975-4836-8824-d40b5cf19d15 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:13.868535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:13.895948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:13.908924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:13.947673 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d3e04c01-7eeb-4958-ad99-bae55e730956 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.566739 Aug 09 17:18:13.955540 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1225/2352] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:13 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:14.118338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-636760726", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:14.275935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:18:14.516978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5b93fb10-c975-4836-8824-d40b5cf19d15 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:14.545309 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5b93fb10-c975-4836-8824-d40b5cf19d15 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 0.931049 Aug 09 17:18:14.580140 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1128/2353] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:13 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:18:14.591461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-81741f17-c13f-4c44-9792-effd15339faa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:14.593259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-81741f17-c13f-4c44-9792-effd15339faa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:14.607947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81741f17-c13f-4c44-9792-effd15339faa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:14.609391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81741f17-c13f-4c44-9792-effd15339faa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:14.610486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81741f17-c13f-4c44-9792-effd15339faa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:14.612464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81741f17-c13f-4c44-9792-effd15339faa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:14.613760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81741f17-c13f-4c44-9792-effd15339faa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:14.614929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81741f17-c13f-4c44-9792-effd15339faa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:15.112921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-81741f17-c13f-4c44-9792-effd15339faa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:15.141482 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-81741f17-c13f-4c44-9792-effd15339faa tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1314 microversion: 2.1 time: 0.558851 Aug 09 17:18:15.142443 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1129/2354] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:14 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:15.150631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:15.157200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:15.204656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:15.205469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:15.206188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:15.207557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:15.208269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:15.208944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:15.622081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:15.672421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:15.678528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:15.688400 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9cf587e-167e-4e63-901a-1b7c96adeb15 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 0.544328 Aug 09 17:18:15.690131 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1130/2355] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:15 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:15.700948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5ddc6bda-5a6b-4df3-aa2d-121eb5fee606 req-563c5cdb-2b2b-4560-95cb-9cd9a45e6fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32cf57c-7503-421c-a197-4a9f8cd925e0", "tag": "d201dfe6-dd68-4013-8808-ca52e463bec5"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:15.719207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5ddc6bda-5a6b-4df3-aa2d-121eb5fee606 req-563c5cdb-2b2b-4560-95cb-9cd9a45e6fb2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:15.720107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5ddc6bda-5a6b-4df3-aa2d-121eb5fee606 req-563c5cdb-2b2b-4560-95cb-9cd9a45e6fb2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:15.720840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5ddc6bda-5a6b-4df3-aa2d-121eb5fee606 req-563c5cdb-2b2b-4560-95cb-9cd9a45e6fb2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:15.748443 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5ddc6bda-5a6b-4df3-aa2d-121eb5fee606 req-563c5cdb-2b2b-4560-95cb-9cd9a45e6fb2 service nova] Creating event network-changed:d201dfe6-dd68-4013-8808-ca52e463bec5 for instance e32cf57c-7503-421c-a197-4a9f8cd925e0 on n-h2-845781-6 Aug 09 17:18:15.776412 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5ddc6bda-5a6b-4df3-aa2d-121eb5fee606 req-563c5cdb-2b2b-4560-95cb-9cd9a45e6fb2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083305 Aug 09 17:18:15.793301 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1131/2356] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:15.810001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b0d8e99a-431c-441c-bf20-0b3d910a6946 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:15.811403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b0d8e99a-431c-441c-bf20-0b3d910a6946 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:15.830151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0d8e99a-431c-441c-bf20-0b3d910a6946 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:15.830860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0d8e99a-431c-441c-bf20-0b3d910a6946 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:15.832574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0d8e99a-431c-441c-bf20-0b3d910a6946 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:15.834037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0d8e99a-431c-441c-bf20-0b3d910a6946 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:15.835342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0d8e99a-431c-441c-bf20-0b3d910a6946 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:15.836076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0d8e99a-431c-441c-bf20-0b3d910a6946 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:16.281965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:18:16.285177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:18:16.286150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:18:16.286893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:18:16.288090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:18:16.360596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:16.363735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:16.370239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:16.375511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:16.376319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:16.378528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:16.493320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Getting quotas for project 1ed2afd5a7c94838bb9f74b8b71ad263. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:18:16.517081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Getting quotas for user 4ab47f4c2fa541a39b25856232720588 and project 1ed2afd5a7c94838bb9f74b8b71ad263. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:18:16.555983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:18:16.565318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:18:16.665306 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-17fa4ac7-2a2e-4284-a324-786dbce2e2cf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.554163 Aug 09 17:18:16.666930 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1226/2357] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:18:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:18:16.674256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7e852192-edb5-4b62-9b60-5c608bf230d3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:16.675647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7e852192-edb5-4b62-9b60-5c608bf230d3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:16.686678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e852192-edb5-4b62-9b60-5c608bf230d3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:16.688149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e852192-edb5-4b62-9b60-5c608bf230d3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:16.689071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e852192-edb5-4b62-9b60-5c608bf230d3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:16.690288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e852192-edb5-4b62-9b60-5c608bf230d3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:16.691230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e852192-edb5-4b62-9b60-5c608bf230d3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:16.692174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e852192-edb5-4b62-9b60-5c608bf230d3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:16.928883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b0d8e99a-431c-441c-bf20-0b3d910a6946 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:16.947602 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b0d8e99a-431c-441c-bf20-0b3d910a6946 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 1.152564 Aug 09 17:18:16.948411 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1132/2358] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:15 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:16.972544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b39ba400-4d3e-447e-9476-3a7d62a17d88 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:16.973178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b39ba400-4d3e-447e-9476-3a7d62a17d88 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:17.183258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b39ba400-4d3e-447e-9476-3a7d62a17d88 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:17.200894 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b39ba400-4d3e-447e-9476-3a7d62a17d88 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1217 microversion: 2.1 time: 0.233948 Aug 09 17:18:17.202125 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1133/2359] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:16 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1217 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:17.207781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:17.208731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:17.241809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:17.242633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:17.243337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:17.245081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:17.245819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:17.246288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:17.730607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7e852192-edb5-4b62-9b60-5c608bf230d3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:17.758581 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7e852192-edb5-4b62-9b60-5c608bf230d3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1314 microversion: 2.1 time: 1.089212 Aug 09 17:18:17.772151 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1227/2360] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:16 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1314 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:17.972641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e865ceec-71d7-448d-b826-5674bf79af11 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:17.973282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e865ceec-71d7-448d-b826-5674bf79af11 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:17.987907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865ceec-71d7-448d-b826-5674bf79af11 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:17.988867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865ceec-71d7-448d-b826-5674bf79af11 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:17.989503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865ceec-71d7-448d-b826-5674bf79af11 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:17.991723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865ceec-71d7-448d-b826-5674bf79af11 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:17.997403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865ceec-71d7-448d-b826-5674bf79af11 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:17.998020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865ceec-71d7-448d-b826-5674bf79af11 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:18.259348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:18.278352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:18.292166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:18.298610 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-200ee9a9-cc99-46be-b442-f63dc916f851 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1444 microversion: 2.75 time: 1.095158 Aug 09 17:18:18.299488 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1134/2361] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:17 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1444 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:18.305570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-953c312d-c788-445d-a1b5-151559858b56 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:18.312700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-953c312d-c788-445d-a1b5-151559858b56 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:18.323337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-953c312d-c788-445d-a1b5-151559858b56 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:18.328461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-953c312d-c788-445d-a1b5-151559858b56 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:18.329156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-953c312d-c788-445d-a1b5-151559858b56 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:18.329965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-953c312d-c788-445d-a1b5-151559858b56 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:18.330527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-953c312d-c788-445d-a1b5-151559858b56 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:18.331044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-953c312d-c788-445d-a1b5-151559858b56 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:18.497675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-953c312d-c788-445d-a1b5-151559858b56 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:18.510866 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-953c312d-c788-445d-a1b5-151559858b56 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1221 microversion: 2.1 time: 0.209815 Aug 09 17:18:18.521262 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1135/2362] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:18 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1221 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:18.791528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-24dc5fcc-f610-4efc-a2ba-4ebcbd6937df tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:18.796665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-24dc5fcc-f610-4efc-a2ba-4ebcbd6937df tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:18.813575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24dc5fcc-f610-4efc-a2ba-4ebcbd6937df tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:18.814947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24dc5fcc-f610-4efc-a2ba-4ebcbd6937df tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:18.816749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24dc5fcc-f610-4efc-a2ba-4ebcbd6937df tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:18.822296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24dc5fcc-f610-4efc-a2ba-4ebcbd6937df tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:18.823610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24dc5fcc-f610-4efc-a2ba-4ebcbd6937df tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:18.835818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24dc5fcc-f610-4efc-a2ba-4ebcbd6937df tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:20.498334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e865ceec-71d7-448d-b826-5674bf79af11 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:20.511380 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e865ceec-71d7-448d-b826-5674bf79af11 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 2.542926 Aug 09 17:18:20.512441 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1228/2363] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:17 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 2545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:20.522888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:20.528978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:20.547119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:20.547682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:20.548115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:20.558121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:20.559034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:20.559878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:20.746344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:20.758584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:20.761898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:20.779801 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-93b7b3cd-4724-4a92-b914-8fb29f4c5afa tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1450 microversion: 2.75 time: 0.264419 Aug 09 17:18:20.780831 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1229/2364] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:20 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1450 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:20.797331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-58a38608-7084-4be2-b620-7a195508d2c9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:20.799279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-58a38608-7084-4be2-b620-7a195508d2c9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:20.823171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58a38608-7084-4be2-b620-7a195508d2c9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:20.824416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58a38608-7084-4be2-b620-7a195508d2c9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:20.826011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58a38608-7084-4be2-b620-7a195508d2c9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:20.833825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58a38608-7084-4be2-b620-7a195508d2c9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:20.838210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58a38608-7084-4be2-b620-7a195508d2c9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:20.839184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58a38608-7084-4be2-b620-7a195508d2c9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:21.005080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-58a38608-7084-4be2-b620-7a195508d2c9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:21.047403 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-58a38608-7084-4be2-b620-7a195508d2c9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1275 microversion: 2.1 time: 0.260761 Aug 09 17:18:21.048493 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1230/2365] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:20 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1275 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:21.164539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-24dc5fcc-f610-4efc-a2ba-4ebcbd6937df tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:21.195785 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-24dc5fcc-f610-4efc-a2ba-4ebcbd6937df tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1314 microversion: 2.1 time: 2.408332 Aug 09 17:18:21.219755 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1136/2366] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:18 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1314 bytes in 2431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:21.561842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-549abe41-6d04-4010-a89d-b5a6e406819d tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:21.564539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-549abe41-6d04-4010-a89d-b5a6e406819d tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:21.587082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-549abe41-6d04-4010-a89d-b5a6e406819d tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:21.589242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-549abe41-6d04-4010-a89d-b5a6e406819d tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:21.590652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-549abe41-6d04-4010-a89d-b5a6e406819d tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:21.593833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-549abe41-6d04-4010-a89d-b5a6e406819d tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:21.595009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-549abe41-6d04-4010-a89d-b5a6e406819d tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:21.596159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-549abe41-6d04-4010-a89d-b5a6e406819d tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:21.831712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:21.833348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:21.862381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:21.872613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:21.874352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:21.876321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:21.878397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:21.884680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:22.352314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:22.381079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:22.390253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:22.416672 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-138d62c4-3103-40ba-bd23-26c12b989d2a tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1450 microversion: 2.75 time: 0.595775 Aug 09 17:18:22.420705 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1137/2367] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:21 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1450 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:18:22.445583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-08c5c711-8229-4877-89c5-66bc9703f223 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:22.449262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-08c5c711-8229-4877-89c5-66bc9703f223 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:22.463442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-549abe41-6d04-4010-a89d-b5a6e406819d tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:22.466912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:22.481764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08c5c711-8229-4877-89c5-66bc9703f223 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:22.488752 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-549abe41-6d04-4010-a89d-b5a6e406819d tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 0.940507 Aug 09 17:18:22.496461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08c5c711-8229-4877-89c5-66bc9703f223 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:22.497634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08c5c711-8229-4877-89c5-66bc9703f223 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:22.498237 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1231/2368] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:21 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:22.504790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08c5c711-8229-4877-89c5-66bc9703f223 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:22.508203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08c5c711-8229-4877-89c5-66bc9703f223 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:22.511737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08c5c711-8229-4877-89c5-66bc9703f223 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:22.514664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9e12e141-8165-4d71-8158-3844eaea79eb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:22.520616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9e12e141-8165-4d71-8158-3844eaea79eb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:22.534557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e12e141-8165-4d71-8158-3844eaea79eb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:22.537097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e12e141-8165-4d71-8158-3844eaea79eb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:22.540894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e12e141-8165-4d71-8158-3844eaea79eb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:22.543924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e12e141-8165-4d71-8158-3844eaea79eb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:22.546087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e12e141-8165-4d71-8158-3844eaea79eb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:22.548468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e12e141-8165-4d71-8158-3844eaea79eb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:22.992967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-08c5c711-8229-4877-89c5-66bc9703f223 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:23.005917 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-08c5c711-8229-4877-89c5-66bc9703f223 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1275 microversion: 2.1 time: 0.582951 Aug 09 17:18:23.007901 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1138/2369] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:22 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1275 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:23.021382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-57e30371-8d04-45e5-81da-5957581d08ff req-2a4a7661-a893-4552-afc5-6f4b7f2343c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f", "name": "network-vif-plugged", "status": "completed", "tag": "c5c67c56-698c-45f4-a7ee-43ab9ca133ae"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:23.048885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-57e30371-8d04-45e5-81da-5957581d08ff req-2a4a7661-a893-4552-afc5-6f4b7f2343c4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:23.049885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-57e30371-8d04-45e5-81da-5957581d08ff req-2a4a7661-a893-4552-afc5-6f4b7f2343c4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:23.056479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-57e30371-8d04-45e5-81da-5957581d08ff req-2a4a7661-a893-4552-afc5-6f4b7f2343c4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:23.143115 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-57e30371-8d04-45e5-81da-5957581d08ff req-2a4a7661-a893-4552-afc5-6f4b7f2343c4 service nova] Creating event network-vif-plugged:c5c67c56-698c-45f4-a7ee-43ab9ca133ae for instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f on n-h1-845781-6 Aug 09 17:18:23.153517 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-57e30371-8d04-45e5-81da-5957581d08ff req-2a4a7661-a893-4552-afc5-6f4b7f2343c4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140193 Aug 09 17:18:23.154778 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1139/2370] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:23.356576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9e12e141-8165-4d71-8158-3844eaea79eb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:23.395329 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9e12e141-8165-4d71-8158-3844eaea79eb tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1314 microversion: 2.1 time: 0.887780 Aug 09 17:18:23.398077 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1232/2371] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:22 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:23.465728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:23.471407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:23.497126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=12 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:23.504461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:23.505346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:23.506146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:23.507617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:23.530502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c4a2e9b-3659-4184-9865-4470fdf0c11a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:23.531591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7c4a2e9b-3659-4184-9865-4470fdf0c11a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:23.534088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:23.535167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:23.576745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c4a2e9b-3659-4184-9865-4470fdf0c11a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:23.580430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c4a2e9b-3659-4184-9865-4470fdf0c11a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:23.581211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c4a2e9b-3659-4184-9865-4470fdf0c11a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:23.582505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c4a2e9b-3659-4184-9865-4470fdf0c11a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:23.583320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c4a2e9b-3659-4184-9865-4470fdf0c11a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:23.594789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c4a2e9b-3659-4184-9865-4470fdf0c11a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:23.698295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:24.034861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:24.078187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:24.083687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:24.113079 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a8708faf-598a-41a1-96af-deb09c1bf132 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1435 microversion: 2.75 time: 0.656629 Aug 09 17:18:24.120903 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1140/2372] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:23 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1435 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:24.135921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4bf0305a-2915-4323-b210-e0e1e40b88e2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:24.146025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4bf0305a-2915-4323-b210-e0e1e40b88e2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:24.174035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bf0305a-2915-4323-b210-e0e1e40b88e2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:24.179734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bf0305a-2915-4323-b210-e0e1e40b88e2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:24.182944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bf0305a-2915-4323-b210-e0e1e40b88e2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:24.184854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bf0305a-2915-4323-b210-e0e1e40b88e2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:24.190152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bf0305a-2915-4323-b210-e0e1e40b88e2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:24.191681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bf0305a-2915-4323-b210-e0e1e40b88e2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:24.838400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4bf0305a-2915-4323-b210-e0e1e40b88e2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:24.847436 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4bf0305a-2915-4323-b210-e0e1e40b88e2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1317 microversion: 2.1 time: 0.724436 Aug 09 17:18:24.848475 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1141/2373] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:24 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1317 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:25.071978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7c4a2e9b-3659-4184-9865-4470fdf0c11a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:25.087606 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7c4a2e9b-3659-4184-9865-4470fdf0c11a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 1.567759 Aug 09 17:18:25.098858 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1233/2374] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:23 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:18:25.122423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec45d016-e77f-4da0-bcb0-f61cd33b50f6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:25.127220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ec45d016-e77f-4da0-bcb0-f61cd33b50f6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:25.153407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec45d016-e77f-4da0-bcb0-f61cd33b50f6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:25.154218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec45d016-e77f-4da0-bcb0-f61cd33b50f6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:25.158469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec45d016-e77f-4da0-bcb0-f61cd33b50f6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:25.162082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec45d016-e77f-4da0-bcb0-f61cd33b50f6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:25.162594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec45d016-e77f-4da0-bcb0-f61cd33b50f6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:25.163164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec45d016-e77f-4da0-bcb0-f61cd33b50f6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:25.522218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:25.528970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:25.543205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:25.545782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:25.546600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:25.548096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:25.549899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:25.552242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:25.717373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:18:25.717903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:18:25.720234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:18:25.720807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:18:25.721400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:18:25.883768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:25.908902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:25.911223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:25.913653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:25.916266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:25.916677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ec45d016-e77f-4da0-bcb0-f61cd33b50f6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:25.917337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:25.919364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:25.936939 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ec45d016-e77f-4da0-bcb0-f61cd33b50f6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1314 microversion: 2.1 time: 0.836753 Aug 09 17:18:25.943065 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1234/2375] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:25 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1314 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:25.948411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-12405d63-c14b-446c-9441-6adac6405c21 req-b74c85b6-4409-442f-afad-195279cec44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f", "name": "network-vif-plugged", "status": "completed", "tag": "30a45131-bab2-4fd6-935a-6f588c37fcbb"}, {"server_uuid": "c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f", "name": "network-vif-plugged", "status": "completed", "tag": "93578644-2d98-4048-92dc-e475d94afcd5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:26.006366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-12405d63-c14b-446c-9441-6adac6405c21 req-b74c85b6-4409-442f-afad-195279cec44e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:26.007386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-12405d63-c14b-446c-9441-6adac6405c21 req-b74c85b6-4409-442f-afad-195279cec44e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:26.012183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-12405d63-c14b-446c-9441-6adac6405c21 req-b74c85b6-4409-442f-afad-195279cec44e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:26.073453 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-12405d63-c14b-446c-9441-6adac6405c21 req-b74c85b6-4409-442f-afad-195279cec44e service nova] Creating event network-vif-plugged:30a45131-bab2-4fd6-935a-6f588c37fcbb for instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f on n-h1-845781-6 Aug 09 17:18:26.074439 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-12405d63-c14b-446c-9441-6adac6405c21 req-b74c85b6-4409-442f-afad-195279cec44e service nova] Creating event network-vif-plugged:93578644-2d98-4048-92dc-e475d94afcd5 for instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f on n-h1-845781-6 Aug 09 17:18:26.098109 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-12405d63-c14b-446c-9441-6adac6405c21 req-b74c85b6-4409-442f-afad-195279cec44e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.153543 Aug 09 17:18:26.098727 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1235/2376] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:26.117135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec8c72df-2c93-424f-a5fa-67a0d43d1e65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:26.132486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ec8c72df-2c93-424f-a5fa-67a0d43d1e65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:26.148460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8c72df-2c93-424f-a5fa-67a0d43d1e65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:26.155272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8c72df-2c93-424f-a5fa-67a0d43d1e65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:26.156465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8c72df-2c93-424f-a5fa-67a0d43d1e65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:26.169520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8c72df-2c93-424f-a5fa-67a0d43d1e65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:26.170525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8c72df-2c93-424f-a5fa-67a0d43d1e65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:26.177094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec8c72df-2c93-424f-a5fa-67a0d43d1e65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:26.428553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:26.536572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=50 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:26.998015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ec8c72df-2c93-424f-a5fa-67a0d43d1e65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:27.017309 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ec8c72df-2c93-424f-a5fa-67a0d43d1e65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1317 microversion: 2.1 time: 0.916557 Aug 09 17:18:27.029244 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1236/2377] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:26 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1317 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:27.049614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c2b0374f-fab6-4094-a0b9-b204b1e39a06 req-0f90c306-c8c7-46bd-b87a-09982cee1702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce962b08-43de-4bff-a72a-1adcf330c991", "tag": "b046df32-8645-4449-b41d-a48fe4b7136e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:27.068076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c2b0374f-fab6-4094-a0b9-b204b1e39a06 req-0f90c306-c8c7-46bd-b87a-09982cee1702 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:27.069660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c2b0374f-fab6-4094-a0b9-b204b1e39a06 req-0f90c306-c8c7-46bd-b87a-09982cee1702 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:27.070492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c2b0374f-fab6-4094-a0b9-b204b1e39a06 req-0f90c306-c8c7-46bd-b87a-09982cee1702 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:27.107808 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c2b0374f-fab6-4094-a0b9-b204b1e39a06 req-0f90c306-c8c7-46bd-b87a-09982cee1702 service nova] Creating event network-changed:b046df32-8645-4449-b41d-a48fe4b7136e for instance ce962b08-43de-4bff-a72a-1adcf330c991 on n-h2-845781-6 Aug 09 17:18:27.124275 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c2b0374f-fab6-4094-a0b9-b204b1e39a06 req-0f90c306-c8c7-46bd-b87a-09982cee1702 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091482 Aug 09 17:18:27.126003 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1237/2378] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:27.139828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3801dcb7-0e7f-4147-bb44-f42b3aeb7d2b tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:27.141708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3801dcb7-0e7f-4147-bb44-f42b3aeb7d2b tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:27.159486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3801dcb7-0e7f-4147-bb44-f42b3aeb7d2b tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:27.160786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3801dcb7-0e7f-4147-bb44-f42b3aeb7d2b tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:27.161953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3801dcb7-0e7f-4147-bb44-f42b3aeb7d2b tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:27.164345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3801dcb7-0e7f-4147-bb44-f42b3aeb7d2b tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:27.166905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3801dcb7-0e7f-4147-bb44-f42b3aeb7d2b tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:27.168469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3801dcb7-0e7f-4147-bb44-f42b3aeb7d2b tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:27.187459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=44 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:27.315911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:27.378141 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ece1d14a-020c-45f7-974b-826bd3162d61 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8/action" status: 202 len: 1936 microversion: 2.75 time: 2.527843 Aug 09 17:18:27.385742 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1142/2379] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:18:24 2022] POST /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8/action => generated 1936 bytes in 2536 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 09 17:18:27.431989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1c8c75bc-73d0-4339-8a12-34509acfc997 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:27.434298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1c8c75bc-73d0-4339-8a12-34509acfc997 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:27.446204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c8c75bc-73d0-4339-8a12-34509acfc997 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:27.447591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c8c75bc-73d0-4339-8a12-34509acfc997 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:27.448767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c8c75bc-73d0-4339-8a12-34509acfc997 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:27.450450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c8c75bc-73d0-4339-8a12-34509acfc997 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:27.452042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c8c75bc-73d0-4339-8a12-34509acfc997 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:27.453207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c8c75bc-73d0-4339-8a12-34509acfc997 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:27.863999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3801dcb7-0e7f-4147-bb44-f42b3aeb7d2b tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:27.875933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:27.892306 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3801dcb7-0e7f-4147-bb44-f42b3aeb7d2b tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1353 microversion: 2.1 time: 0.763225 Aug 09 17:18:27.894146 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1238/2380] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:27 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1353 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:27.910777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-034280cf-c046-4f64-9b69-2661bdb3a3c3 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:27.912910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-034280cf-c046-4f64-9b69-2661bdb3a3c3 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:27.951241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-034280cf-c046-4f64-9b69-2661bdb3a3c3 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:27.953341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-034280cf-c046-4f64-9b69-2661bdb3a3c3 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:27.957413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-034280cf-c046-4f64-9b69-2661bdb3a3c3 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:27.963516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-034280cf-c046-4f64-9b69-2661bdb3a3c3 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:27.965089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-034280cf-c046-4f64-9b69-2661bdb3a3c3 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:27.966704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-034280cf-c046-4f64-9b69-2661bdb3a3c3 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:28.331208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-034280cf-c046-4f64-9b69-2661bdb3a3c3 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:28.430905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:28.443482 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-034280cf-c046-4f64-9b69-2661bdb3a3c3 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.546526 Aug 09 17:18:28.444384 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1239/2381] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:27 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:28.456753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-263adf70-5aff-4847-8d7d-295409cb7833 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:28.458117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-263adf70-5aff-4847-8d7d-295409cb7833 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:28.479922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-263adf70-5aff-4847-8d7d-295409cb7833 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:28.480846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-263adf70-5aff-4847-8d7d-295409cb7833 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:28.482538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-263adf70-5aff-4847-8d7d-295409cb7833 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:28.484440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-263adf70-5aff-4847-8d7d-295409cb7833 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:28.485361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-263adf70-5aff-4847-8d7d-295409cb7833 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:28.486124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-263adf70-5aff-4847-8d7d-295409cb7833 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:28.545585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1c8c75bc-73d0-4339-8a12-34509acfc997 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:28.619181 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1c8c75bc-73d0-4339-8a12-34509acfc997 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1314 microversion: 2.1 time: 1.216631 Aug 09 17:18:28.627750 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1143/2382] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:27 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1314 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:28.649466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a84caf46-26ab-48c1-9fc9-e973b07a2c24 req-566941ce-982a-4d83-8130-467c613e468b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32cf57c-7503-421c-a197-4a9f8cd925e0", "name": "network-vif-plugged", "status": "completed", "tag": "d201dfe6-dd68-4013-8808-ca52e463bec5"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:28.679245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a84caf46-26ab-48c1-9fc9-e973b07a2c24 req-566941ce-982a-4d83-8130-467c613e468b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:28.680734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a84caf46-26ab-48c1-9fc9-e973b07a2c24 req-566941ce-982a-4d83-8130-467c613e468b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:28.681818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a84caf46-26ab-48c1-9fc9-e973b07a2c24 req-566941ce-982a-4d83-8130-467c613e468b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:28.707147 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a84caf46-26ab-48c1-9fc9-e973b07a2c24 req-566941ce-982a-4d83-8130-467c613e468b service nova] Creating event network-vif-plugged:d201dfe6-dd68-4013-8808-ca52e463bec5 for instance e32cf57c-7503-421c-a197-4a9f8cd925e0 on n-h2-845781-6 Aug 09 17:18:28.718477 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a84caf46-26ab-48c1-9fc9-e973b07a2c24 req-566941ce-982a-4d83-8130-467c613e468b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090168 Aug 09 17:18:28.720309 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1144/2383] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:28.970287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bf43cf69-f99c-4e44-8858-73b64ec3b8a4 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:28.977495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bf43cf69-f99c-4e44-8858-73b64ec3b8a4 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:29.015302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf43cf69-f99c-4e44-8858-73b64ec3b8a4 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:29.016815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf43cf69-f99c-4e44-8858-73b64ec3b8a4 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:29.017939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf43cf69-f99c-4e44-8858-73b64ec3b8a4 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:29.019561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf43cf69-f99c-4e44-8858-73b64ec3b8a4 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:29.022119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf43cf69-f99c-4e44-8858-73b64ec3b8a4 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:29.024439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf43cf69-f99c-4e44-8858-73b64ec3b8a4 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:29.381597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-263adf70-5aff-4847-8d7d-295409cb7833 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:29.402124 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-263adf70-5aff-4847-8d7d-295409cb7833 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1317 microversion: 2.1 time: 0.956271 Aug 09 17:18:29.402713 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1240/2384] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:28 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1317 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:29.496239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f999ae48-b27a-4ec2-b8e7-97058b287bd9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:29.496884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f999ae48-b27a-4ec2-b8e7-97058b287bd9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:29.510291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f999ae48-b27a-4ec2-b8e7-97058b287bd9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:29.513134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f999ae48-b27a-4ec2-b8e7-97058b287bd9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:29.513961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f999ae48-b27a-4ec2-b8e7-97058b287bd9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:29.516761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f999ae48-b27a-4ec2-b8e7-97058b287bd9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:29.517791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f999ae48-b27a-4ec2-b8e7-97058b287bd9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:29.519266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f999ae48-b27a-4ec2-b8e7-97058b287bd9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:29.842398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-f999ae48-b27a-4ec2-b8e7-97058b287bd9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:29.913374 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f999ae48-b27a-4ec2-b8e7-97058b287bd9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.420862 Aug 09 17:18:29.914129 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1241/2385] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:29 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:18:29.919409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0fe4eb43-3ae9-4619-9ff1-d2f036ba98b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:29.930247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0fe4eb43-3ae9-4619-9ff1-d2f036ba98b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:29.971408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb43-3ae9-4619-9ff1-d2f036ba98b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:29.989144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb43-3ae9-4619-9ff1-d2f036ba98b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:29.993776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb43-3ae9-4619-9ff1-d2f036ba98b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:30.001417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb43-3ae9-4619-9ff1-d2f036ba98b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:30.005425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb43-3ae9-4619-9ff1-d2f036ba98b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:30.007134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe4eb43-3ae9-4619-9ff1-d2f036ba98b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:30.305178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bf43cf69-f99c-4e44-8858-73b64ec3b8a4 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:30.329734 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bf43cf69-f99c-4e44-8858-73b64ec3b8a4 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1803 microversion: 2.1 time: 1.398069 Aug 09 17:18:30.359783 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1145/2386] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:28 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1803 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:30.405891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d745e11a-b30a-4810-b55c-9428cadd3dcb tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:30.407182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d745e11a-b30a-4810-b55c-9428cadd3dcb tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:30.435674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d745e11a-b30a-4810-b55c-9428cadd3dcb tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:30.442290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d745e11a-b30a-4810-b55c-9428cadd3dcb tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:30.446101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d745e11a-b30a-4810-b55c-9428cadd3dcb tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:30.449208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d745e11a-b30a-4810-b55c-9428cadd3dcb tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:30.450781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d745e11a-b30a-4810-b55c-9428cadd3dcb tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:30.452585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d745e11a-b30a-4810-b55c-9428cadd3dcb tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:30.556797 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d745e11a-b30a-4810-b55c-9428cadd3dcb tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f/ips" status: 200 len: 218 microversion: 2.1 time: 0.161133 Aug 09 17:18:30.558792 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1146/2387] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:18:30 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f/ips => generated 218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:30.576665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4f801720-c5ad-4b91-a2e2-b3afe81dd843 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:30.578896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4f801720-c5ad-4b91-a2e2-b3afe81dd843 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:30.595270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f801720-c5ad-4b91-a2e2-b3afe81dd843 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:30.597227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f801720-c5ad-4b91-a2e2-b3afe81dd843 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:30.598453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f801720-c5ad-4b91-a2e2-b3afe81dd843 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:30.601037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f801720-c5ad-4b91-a2e2-b3afe81dd843 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:30.602398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f801720-c5ad-4b91-a2e2-b3afe81dd843 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:30.604427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f801720-c5ad-4b91-a2e2-b3afe81dd843 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:30.886775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0fe4eb43-3ae9-4619-9ff1-d2f036ba98b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:30.898143 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0fe4eb43-3ae9-4619-9ff1-d2f036ba98b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1314 microversion: 2.1 time: 0.981979 Aug 09 17:18:30.899702 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1242/2388] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:29 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1314 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:30.904813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-692e871f-e181-4dbc-840d-2718408a1767 req-84edf31f-7bd6-44c8-8a0a-00d48375530e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e3e8f0-9f58-47fd-8000-d875529d0b84", "tag": "404b76c0-d83e-4f41-a30d-e7d27789aede"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:30.954179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-692e871f-e181-4dbc-840d-2718408a1767 req-84edf31f-7bd6-44c8-8a0a-00d48375530e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:30.955245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-692e871f-e181-4dbc-840d-2718408a1767 req-84edf31f-7bd6-44c8-8a0a-00d48375530e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:30.956072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-692e871f-e181-4dbc-840d-2718408a1767 req-84edf31f-7bd6-44c8-8a0a-00d48375530e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:31.014295 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-692e871f-e181-4dbc-840d-2718408a1767 req-84edf31f-7bd6-44c8-8a0a-00d48375530e service nova] Creating event network-changed:404b76c0-d83e-4f41-a30d-e7d27789aede for instance f7e3e8f0-9f58-47fd-8000-d875529d0b84 on n-h2-845781-6 Aug 09 17:18:31.031812 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-692e871f-e181-4dbc-840d-2718408a1767 req-84edf31f-7bd6-44c8-8a0a-00d48375530e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129977 Aug 09 17:18:31.038628 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1243/2389] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:31.051798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6cf43988-117b-442d-b745-de4ab38f4a2a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:31.053114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6cf43988-117b-442d-b745-de4ab38f4a2a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:31.067396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cf43988-117b-442d-b745-de4ab38f4a2a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:31.072578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cf43988-117b-442d-b745-de4ab38f4a2a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:31.074126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cf43988-117b-442d-b745-de4ab38f4a2a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:31.075889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cf43988-117b-442d-b745-de4ab38f4a2a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:31.077062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cf43988-117b-442d-b745-de4ab38f4a2a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:31.079365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cf43988-117b-442d-b745-de4ab38f4a2a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:31.124834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6cf43988-117b-442d-b745-de4ab38f4a2a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:18:31.392666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f801720-c5ad-4b91-a2e2-b3afe81dd843 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:31.464230 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4f801720-c5ad-4b91-a2e2-b3afe81dd843 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1317 microversion: 2.1 time: 0.896788 Aug 09 17:18:31.468921 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1147/2390] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:30 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1317 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:31.472574 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6cf43988-117b-442d-b745-de4ab38f4a2a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 204 len: 0 microversion: 2.1 time: 0.423431 Aug 09 17:18:31.479485 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1244/2391] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:18:31 2022] DELETE /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:18:31.502416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-488d5695-dcda-4fbd-bcb4-63479370bd3f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:31.508614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-488d5695-dcda-4fbd-bcb4-63479370bd3f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:31.524160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-41f40492-c56a-4b88-8493-6ae885207756 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:31.529024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-41f40492-c56a-4b88-8493-6ae885207756 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:31.546273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-488d5695-dcda-4fbd-bcb4-63479370bd3f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:31.556377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-488d5695-dcda-4fbd-bcb4-63479370bd3f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:31.562132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41f40492-c56a-4b88-8493-6ae885207756 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:31.563094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41f40492-c56a-4b88-8493-6ae885207756 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:31.563860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-488d5695-dcda-4fbd-bcb4-63479370bd3f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:31.564049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41f40492-c56a-4b88-8493-6ae885207756 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:31.565284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41f40492-c56a-4b88-8493-6ae885207756 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:31.566234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41f40492-c56a-4b88-8493-6ae885207756 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:31.567040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41f40492-c56a-4b88-8493-6ae885207756 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:31.571837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-488d5695-dcda-4fbd-bcb4-63479370bd3f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:31.580595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-488d5695-dcda-4fbd-bcb4-63479370bd3f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:31.582274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-488d5695-dcda-4fbd-bcb4-63479370bd3f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:31.991297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-488d5695-dcda-4fbd-bcb4-63479370bd3f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:32.048542 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-488d5695-dcda-4fbd-bcb4-63479370bd3f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.571218 Aug 09 17:18:32.092622 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1148/2392] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:31 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:32.139593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a3c9ec32-ecb6-40b2-a0d0-0c297254f346 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:32.142009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a3c9ec32-ecb6-40b2-a0d0-0c297254f346 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:32.160059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c9ec32-ecb6-40b2-a0d0-0c297254f346 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:32.163444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c9ec32-ecb6-40b2-a0d0-0c297254f346 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:32.164640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c9ec32-ecb6-40b2-a0d0-0c297254f346 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:32.166209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c9ec32-ecb6-40b2-a0d0-0c297254f346 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:32.167297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c9ec32-ecb6-40b2-a0d0-0c297254f346 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:32.168104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3c9ec32-ecb6-40b2-a0d0-0c297254f346 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:32.545083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-41f40492-c56a-4b88-8493-6ae885207756 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:32.565461 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-41f40492-c56a-4b88-8493-6ae885207756 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1809 microversion: 2.1 time: 1.077837 Aug 09 17:18:32.584723 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1245/2393] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:31 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1809 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:18:32.610572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-feec18d4-efe0-4337-873e-1a7f16846a9d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:32.611854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-feec18d4-efe0-4337-873e-1a7f16846a9d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:32.647911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-feec18d4-efe0-4337-873e-1a7f16846a9d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:32.649120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-feec18d4-efe0-4337-873e-1a7f16846a9d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:32.649772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-feec18d4-efe0-4337-873e-1a7f16846a9d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:32.652071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-feec18d4-efe0-4337-873e-1a7f16846a9d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:32.653403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-feec18d4-efe0-4337-873e-1a7f16846a9d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:32.654522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-feec18d4-efe0-4337-873e-1a7f16846a9d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:33.097013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a3c9ec32-ecb6-40b2-a0d0-0c297254f346 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:33.115186 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a3c9ec32-ecb6-40b2-a0d0-0c297254f346 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1502 microversion: 2.1 time: 1.020855 Aug 09 17:18:33.115817 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1149/2394] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:32 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1502 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:33.135139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-39e0808c-b615-42f9-aa07-2a666c472390 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:33.137856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-39e0808c-b615-42f9-aa07-2a666c472390 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:33.155000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39e0808c-b615-42f9-aa07-2a666c472390 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:33.155968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39e0808c-b615-42f9-aa07-2a666c472390 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:33.161354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39e0808c-b615-42f9-aa07-2a666c472390 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:33.162407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39e0808c-b615-42f9-aa07-2a666c472390 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:33.163275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39e0808c-b615-42f9-aa07-2a666c472390 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:33.166289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39e0808c-b615-42f9-aa07-2a666c472390 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:33.421993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-39e0808c-b615-42f9-aa07-2a666c472390 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:33.462870 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-39e0808c-b615-42f9-aa07-2a666c472390 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.332066 Aug 09 17:18:33.463490 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1150/2395] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:33 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:18:33.488069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f875cc51-17bf-45d6-b660-4ab05e82b473 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:33.488871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f875cc51-17bf-45d6-b660-4ab05e82b473 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:33.503513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f875cc51-17bf-45d6-b660-4ab05e82b473 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:33.504480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f875cc51-17bf-45d6-b660-4ab05e82b473 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:33.505270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f875cc51-17bf-45d6-b660-4ab05e82b473 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:33.519240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f875cc51-17bf-45d6-b660-4ab05e82b473 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:33.520051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f875cc51-17bf-45d6-b660-4ab05e82b473 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:33.520885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f875cc51-17bf-45d6-b660-4ab05e82b473 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:33.562889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-feec18d4-efe0-4337-873e-1a7f16846a9d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:33.589019 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-feec18d4-efe0-4337-873e-1a7f16846a9d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1317 microversion: 2.1 time: 1.001490 Aug 09 17:18:33.590162 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1246/2396] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:32 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1317 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:33.622862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aec726e8-2c8c-4d09-88a1-8378ffb6c5c9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:33.623662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-f875cc51-17bf-45d6-b660-4ab05e82b473 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lazy-loading 'flavor' on Instance uuid e32cf57c-7503-421c-a197-4a9f8cd925e0 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:33.624748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aec726e8-2c8c-4d09-88a1-8378ffb6c5c9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:33.640241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec726e8-2c8c-4d09-88a1-8378ffb6c5c9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:33.642507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec726e8-2c8c-4d09-88a1-8378ffb6c5c9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:33.644110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec726e8-2c8c-4d09-88a1-8378ffb6c5c9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:33.648249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec726e8-2c8c-4d09-88a1-8378ffb6c5c9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:33.653568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec726e8-2c8c-4d09-88a1-8378ffb6c5c9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:33.655004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec726e8-2c8c-4d09-88a1-8378ffb6c5c9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:34.193722 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f875cc51-17bf-45d6-b660-4ab05e82b473 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0/action" status: 202 len: 0 microversion: 2.1 time: 0.709430 Aug 09 17:18:34.194427 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1151/2397] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:18:33 2022] POST /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:18:34.206157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6f6c70b8-3e57-497b-9a1f-326b0939bac7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:34.210848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6f6c70b8-3e57-497b-9a1f-326b0939bac7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:34.242159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f6c70b8-3e57-497b-9a1f-326b0939bac7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:34.243720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f6c70b8-3e57-497b-9a1f-326b0939bac7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:34.245650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f6c70b8-3e57-497b-9a1f-326b0939bac7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:34.247572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f6c70b8-3e57-497b-9a1f-326b0939bac7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:34.248925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f6c70b8-3e57-497b-9a1f-326b0939bac7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:34.250379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6f6c70b8-3e57-497b-9a1f-326b0939bac7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:34.375508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:34.671080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aec726e8-2c8c-4d09-88a1-8378ffb6c5c9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:34.700314 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aec726e8-2c8c-4d09-88a1-8378ffb6c5c9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1809 microversion: 2.1 time: 1.088880 Aug 09 17:18:34.701788 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1247/2398] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:33 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1809 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:34.738364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-928ab1b5-d1f4-4e50-847e-3888ab44d251 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:34.744778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-928ab1b5-d1f4-4e50-847e-3888ab44d251 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:34.789761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928ab1b5-d1f4-4e50-847e-3888ab44d251 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:34.798904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928ab1b5-d1f4-4e50-847e-3888ab44d251 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:34.800536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928ab1b5-d1f4-4e50-847e-3888ab44d251 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:34.805362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928ab1b5-d1f4-4e50-847e-3888ab44d251 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:34.809233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928ab1b5-d1f4-4e50-847e-3888ab44d251 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:34.813161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928ab1b5-d1f4-4e50-847e-3888ab44d251 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:35.100971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-928ab1b5-d1f4-4e50-847e-3888ab44d251 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:35.154336 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-928ab1b5-d1f4-4e50-847e-3888ab44d251 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.448205 Aug 09 17:18:35.156503 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1248/2399] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:34 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:35.168040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f9c32ebf-f8b4-46d0-85bb-04075a7f01ea tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:35.170187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f9c32ebf-f8b4-46d0-85bb-04075a7f01ea tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:35.183999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9c32ebf-f8b4-46d0-85bb-04075a7f01ea tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:35.185422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9c32ebf-f8b4-46d0-85bb-04075a7f01ea tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:35.186665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9c32ebf-f8b4-46d0-85bb-04075a7f01ea tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:35.188509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9c32ebf-f8b4-46d0-85bb-04075a7f01ea tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:35.189863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9c32ebf-f8b4-46d0-85bb-04075a7f01ea tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:35.191542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9c32ebf-f8b4-46d0-85bb-04075a7f01ea tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:35.272441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6f6c70b8-3e57-497b-9a1f-326b0939bac7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:35.285008 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6f6c70b8-3e57-497b-9a1f-326b0939bac7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 1.083458 Aug 09 17:18:35.292390 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1152/2400] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:34 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:35.655324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a235a78f-3a27-4508-a04e-c6b03602097c req-8237b6e6-b7db-43fc-a531-e91688902799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f", "name": "network-vif-deleted", "tag": "c5c67c56-698c-45f4-a7ee-43ab9ca133ae"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:35.710638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a235a78f-3a27-4508-a04e-c6b03602097c req-8237b6e6-b7db-43fc-a531-e91688902799 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:35.716366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a235a78f-3a27-4508-a04e-c6b03602097c req-8237b6e6-b7db-43fc-a531-e91688902799 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:35.717724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a235a78f-3a27-4508-a04e-c6b03602097c req-8237b6e6-b7db-43fc-a531-e91688902799 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:35.781236 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a235a78f-3a27-4508-a04e-c6b03602097c req-8237b6e6-b7db-43fc-a531-e91688902799 service nova] Creating event network-vif-deleted:c5c67c56-698c-45f4-a7ee-43ab9ca133ae for instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f on n-h1-845781-6 Aug 09 17:18:35.798636 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a235a78f-3a27-4508-a04e-c6b03602097c req-8237b6e6-b7db-43fc-a531-e91688902799 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153132 Aug 09 17:18:35.806323 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1153/2401] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:35.829039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3e782ce0-cdc1-4400-8c48-ea38bafedca0 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:35.830642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3e782ce0-cdc1-4400-8c48-ea38bafedca0 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:35.854531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e782ce0-cdc1-4400-8c48-ea38bafedca0 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:35.859452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e782ce0-cdc1-4400-8c48-ea38bafedca0 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:35.860666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e782ce0-cdc1-4400-8c48-ea38bafedca0 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:35.873216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e782ce0-cdc1-4400-8c48-ea38bafedca0 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:35.874395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e782ce0-cdc1-4400-8c48-ea38bafedca0 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:35.875447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e782ce0-cdc1-4400-8c48-ea38bafedca0 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:35.875660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f9c32ebf-f8b4-46d0-85bb-04075a7f01ea tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:35.904529 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f9c32ebf-f8b4-46d0-85bb-04075a7f01ea tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1317 microversion: 2.1 time: 0.745511 Aug 09 17:18:35.923664 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1249/2402] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:35 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:36.190520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b45608e-85a2-4382-b4af-c57a3931553d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:36.196449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b45608e-85a2-4382-b4af-c57a3931553d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:36.232043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b45608e-85a2-4382-b4af-c57a3931553d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:36.233303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b45608e-85a2-4382-b4af-c57a3931553d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:36.237076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b45608e-85a2-4382-b4af-c57a3931553d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:36.238754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b45608e-85a2-4382-b4af-c57a3931553d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:36.243551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b45608e-85a2-4382-b4af-c57a3931553d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:36.244801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b45608e-85a2-4382-b4af-c57a3931553d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:36.454934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-8b45608e-85a2-4382-b4af-c57a3931553d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:36.537941 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b45608e-85a2-4382-b4af-c57a3931553d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.353194 Aug 09 17:18:36.542754 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1250/2403] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:36 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:18:36.573981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b0f76c21-a5d6-4898-8c2d-15baabd35c3c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:36.577775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b0f76c21-a5d6-4898-8c2d-15baabd35c3c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:36.598784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0f76c21-a5d6-4898-8c2d-15baabd35c3c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:36.599712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0f76c21-a5d6-4898-8c2d-15baabd35c3c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:36.600642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0f76c21-a5d6-4898-8c2d-15baabd35c3c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:36.604073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0f76c21-a5d6-4898-8c2d-15baabd35c3c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:36.605201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0f76c21-a5d6-4898-8c2d-15baabd35c3c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:36.605966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0f76c21-a5d6-4898-8c2d-15baabd35c3c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:37.157365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b0f76c21-a5d6-4898-8c2d-15baabd35c3c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:37.176292 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b0f76c21-a5d6-4898-8c2d-15baabd35c3c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 0.627665 Aug 09 17:18:37.178147 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1251/2404] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:36 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:37.190424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3b9f53fb-3f10-44ba-949a-1e18b68600ed req-5af35181-faa0-4a30-aa7d-f3f64ade8032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce962b08-43de-4bff-a72a-1adcf330c991", "name": "network-vif-plugged", "status": "completed", "tag": "b046df32-8645-4449-b41d-a48fe4b7136e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:37.217710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3b9f53fb-3f10-44ba-949a-1e18b68600ed req-5af35181-faa0-4a30-aa7d-f3f64ade8032 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:37.219177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3b9f53fb-3f10-44ba-949a-1e18b68600ed req-5af35181-faa0-4a30-aa7d-f3f64ade8032 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:37.234043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3b9f53fb-3f10-44ba-949a-1e18b68600ed req-5af35181-faa0-4a30-aa7d-f3f64ade8032 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:37.262861 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3b9f53fb-3f10-44ba-949a-1e18b68600ed req-5af35181-faa0-4a30-aa7d-f3f64ade8032 service nova] Creating event network-vif-plugged:b046df32-8645-4449-b41d-a48fe4b7136e for instance ce962b08-43de-4bff-a72a-1adcf330c991 on n-h2-845781-6 Aug 09 17:18:37.281170 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3b9f53fb-3f10-44ba-949a-1e18b68600ed req-5af35181-faa0-4a30-aa7d-f3f64ade8032 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097995 Aug 09 17:18:37.282367 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1252/2405] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:37.297308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e3a8285-202e-4003-8b3d-f446983956d3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:37.301686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1e3a8285-202e-4003-8b3d-f446983956d3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:37.343821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e3a8285-202e-4003-8b3d-f446983956d3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:37.349328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e3a8285-202e-4003-8b3d-f446983956d3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:37.359410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e3a8285-202e-4003-8b3d-f446983956d3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:37.361276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e3a8285-202e-4003-8b3d-f446983956d3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:37.363458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e3a8285-202e-4003-8b3d-f446983956d3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:37.365043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e3a8285-202e-4003-8b3d-f446983956d3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:37.900268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3e782ce0-cdc1-4400-8c48-ea38bafedca0 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:37.943487 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3e782ce0-cdc1-4400-8c48-ea38bafedca0 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1673 microversion: 2.1 time: 2.130045 Aug 09 17:18:37.945349 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1154/2406] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:35 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1673 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:37.977821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-13923996-12d8-41de-8001-0f087ed9b47e tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:37.980770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-13923996-12d8-41de-8001-0f087ed9b47e tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:38.001978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13923996-12d8-41de-8001-0f087ed9b47e tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:38.003715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13923996-12d8-41de-8001-0f087ed9b47e tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:38.005224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13923996-12d8-41de-8001-0f087ed9b47e tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:38.007799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13923996-12d8-41de-8001-0f087ed9b47e tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:38.009272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13923996-12d8-41de-8001-0f087ed9b47e tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:38.010258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13923996-12d8-41de-8001-0f087ed9b47e tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:38.368292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1e3a8285-202e-4003-8b3d-f446983956d3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:38.372834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:38.378406 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e3a8285-202e-4003-8b3d-f446983956d3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1317 microversion: 2.1 time: 1.093578 Aug 09 17:18:38.394670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-13923996-12d8-41de-8001-0f087ed9b47e tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:38.400215 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1253/2407] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:37 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1317 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:38.408919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2a5005cc-c54b-4c9d-b3d0-c9b7e02f89e3 req-132a4e8b-0291-4234-8a9c-3d2ba55c0ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f", "name": "network-vif-deleted", "tag": "93578644-2d98-4048-92dc-e475d94afcd5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:38.432252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2a5005cc-c54b-4c9d-b3d0-c9b7e02f89e3 req-132a4e8b-0291-4234-8a9c-3d2ba55c0ab6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:38.433142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2a5005cc-c54b-4c9d-b3d0-c9b7e02f89e3 req-132a4e8b-0291-4234-8a9c-3d2ba55c0ab6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:38.433973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2a5005cc-c54b-4c9d-b3d0-c9b7e02f89e3 req-132a4e8b-0291-4234-8a9c-3d2ba55c0ab6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:38.449473 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-13923996-12d8-41de-8001-0f087ed9b47e tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.495636 Aug 09 17:18:38.451158 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1155/2408] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:37 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:38.466025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ac87ef7b-dde9-482f-9105-1cb160bfa462 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:38.467054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ac87ef7b-dde9-482f-9105-1cb160bfa462 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:38.482331 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2a5005cc-c54b-4c9d-b3d0-c9b7e02f89e3 req-132a4e8b-0291-4234-8a9c-3d2ba55c0ab6 service nova] Creating event network-vif-deleted:93578644-2d98-4048-92dc-e475d94afcd5 for instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f on n-h1-845781-6 Aug 09 17:18:38.486421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac87ef7b-dde9-482f-9105-1cb160bfa462 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:38.487095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac87ef7b-dde9-482f-9105-1cb160bfa462 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:38.487863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac87ef7b-dde9-482f-9105-1cb160bfa462 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:38.488880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac87ef7b-dde9-482f-9105-1cb160bfa462 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:38.489614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac87ef7b-dde9-482f-9105-1cb160bfa462 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:38.489734 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2a5005cc-c54b-4c9d-b3d0-c9b7e02f89e3 req-132a4e8b-0291-4234-8a9c-3d2ba55c0ab6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087800 Aug 09 17:18:38.490438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac87ef7b-dde9-482f-9105-1cb160bfa462 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:38.490584 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1254/2409] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:38.980381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e0e843d-4111-46b4-bac3-af6b6b58762f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:38.981322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3e0e843d-4111-46b4-bac3-af6b6b58762f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:38.993522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e0e843d-4111-46b4-bac3-af6b6b58762f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:38.996716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e0e843d-4111-46b4-bac3-af6b6b58762f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:39.000309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e0e843d-4111-46b4-bac3-af6b6b58762f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:39.002263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e0e843d-4111-46b4-bac3-af6b6b58762f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:39.003113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e0e843d-4111-46b4-bac3-af6b6b58762f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:39.007933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e0e843d-4111-46b4-bac3-af6b6b58762f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:39.177662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3e0e843d-4111-46b4-bac3-af6b6b58762f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:39.191363 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e0e843d-4111-46b4-bac3-af6b6b58762f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 200 len: 1452 microversion: 2.1 time: 0.217643 Aug 09 17:18:39.192624 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1255/2410] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:38 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 1452 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:39.353072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-947e7cd6-4a20-4399-9e18-e9c5e86f0b71 req-d95f6702-0b7e-4377-8e0a-b415e6e1e24d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f", "name": "network-vif-unplugged", "status": "completed", "tag": "30a45131-bab2-4fd6-935a-6f588c37fcbb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:39.372502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-947e7cd6-4a20-4399-9e18-e9c5e86f0b71 req-d95f6702-0b7e-4377-8e0a-b415e6e1e24d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:39.373669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-947e7cd6-4a20-4399-9e18-e9c5e86f0b71 req-d95f6702-0b7e-4377-8e0a-b415e6e1e24d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:39.374186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-947e7cd6-4a20-4399-9e18-e9c5e86f0b71 req-d95f6702-0b7e-4377-8e0a-b415e6e1e24d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:39.400293 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-947e7cd6-4a20-4399-9e18-e9c5e86f0b71 req-d95f6702-0b7e-4377-8e0a-b415e6e1e24d service nova] Creating event network-vif-unplugged:30a45131-bab2-4fd6-935a-6f588c37fcbb for instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f on n-h1-845781-6 Aug 09 17:18:39.409272 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-947e7cd6-4a20-4399-9e18-e9c5e86f0b71 req-d95f6702-0b7e-4377-8e0a-b415e6e1e24d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063360 Aug 09 17:18:39.410711 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1256/2411] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:39.420895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d93b63d9-ad60-40a1-b641-c05f29cd4b9e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:39.423259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d93b63d9-ad60-40a1-b641-c05f29cd4b9e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:39.434077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d93b63d9-ad60-40a1-b641-c05f29cd4b9e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:39.436547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d93b63d9-ad60-40a1-b641-c05f29cd4b9e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:39.437522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d93b63d9-ad60-40a1-b641-c05f29cd4b9e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:39.438932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d93b63d9-ad60-40a1-b641-c05f29cd4b9e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:39.441078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d93b63d9-ad60-40a1-b641-c05f29cd4b9e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:39.441778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d93b63d9-ad60-40a1-b641-c05f29cd4b9e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:40.016898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d93b63d9-ad60-40a1-b641-c05f29cd4b9e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:40.054938 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d93b63d9-ad60-40a1-b641-c05f29cd4b9e tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1317 microversion: 2.1 time: 0.639045 Aug 09 17:18:40.061387 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1257/2412] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:39 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:40.079962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-779776c9-9e22-4bfb-b3bd-4c8e8490466f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:40.083160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-779776c9-9e22-4bfb-b3bd-4c8e8490466f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:40.106757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779776c9-9e22-4bfb-b3bd-4c8e8490466f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:40.108188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779776c9-9e22-4bfb-b3bd-4c8e8490466f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:40.109242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779776c9-9e22-4bfb-b3bd-4c8e8490466f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:40.110926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779776c9-9e22-4bfb-b3bd-4c8e8490466f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:40.112854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779776c9-9e22-4bfb-b3bd-4c8e8490466f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:40.115565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779776c9-9e22-4bfb-b3bd-4c8e8490466f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:40.169480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ac87ef7b-dde9-482f-9105-1cb160bfa462 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:40.193474 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ac87ef7b-dde9-482f-9105-1cb160bfa462 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 1.740577 Aug 09 17:18:40.209469 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1156/2413] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:38 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:40.231943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:40.232738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:40.259688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:40.260453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:40.261383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:40.262511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:40.266531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:40.267279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:40.322421 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] HTTP exception thrown: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Request method failure captured: Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f HTTP/1.1 Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8paiksjBa4qx9EgOZhhnQ_onjfhZBInU48ofSQcYvFHNVyYuhzclTaVffDdLGVuELT6CBN4j9RxjVw17-_8XHLXtiX0yztCtzvoHmmNaZCpHV1uzCevjHn6mg9Q9Qvt8NLrEaCxdpzDUUfs6NkXnB-pgH6nyPDYhGEfcyiy54-AM0co Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: c273ac15199f43b898faa91983629795 Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c273ac15199f43b898faa91983629795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c273ac15199f43b898faa91983629795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestMultiNic-545157782 Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: c273ac15199f43b898faa91983629795 Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestMultiNic-545157782-project Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d0cb6058852c4b59ae031509affffe65 Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestMultiNic-545157782-project Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f'} Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:18:40.324699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:40.329903 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:18:40.329903 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:18:40.329903 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:18:40.329903 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:18:40.329903 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:18:40.329903 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:18:40.329903 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:18:40.332184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Returning 404 to user: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:18:40.333839 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b36494fe-83f9-4a78-82e0-46f036afeb58 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 404 len: 111 microversion: 2.1 time: 0.106710 Aug 09 17:18:40.335932 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1157/2414] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:40 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:18:40.557074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-f8e5ce28-70f9-4fee-8461-9717b4065a08 req-080ee05d-de3c-4274-980b-58749bb7bf6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f", "name": "network-vif-deleted", "tag": "30a45131-bab2-4fd6-935a-6f588c37fcbb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:40.561736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-779776c9-9e22-4bfb-b3bd-4c8e8490466f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:40.586591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f8e5ce28-70f9-4fee-8461-9717b4065a08 req-080ee05d-de3c-4274-980b-58749bb7bf6e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:40.587272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f8e5ce28-70f9-4fee-8461-9717b4065a08 req-080ee05d-de3c-4274-980b-58749bb7bf6e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:40.588082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f8e5ce28-70f9-4fee-8461-9717b4065a08 req-080ee05d-de3c-4274-980b-58749bb7bf6e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:40.622855 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-779776c9-9e22-4bfb-b3bd-4c8e8490466f tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.556538 Aug 09 17:18:40.624536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1258/2415] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:40 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:40.630064 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-f8e5ce28-70f9-4fee-8461-9717b4065a08 req-080ee05d-de3c-4274-980b-58749bb7bf6e service nova] Creating event network-vif-deleted:30a45131-bab2-4fd6-935a-6f588c37fcbb for instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f on n-h1-845781-6 Aug 09 17:18:40.649806 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-f8e5ce28-70f9-4fee-8461-9717b4065a08 req-080ee05d-de3c-4274-980b-58749bb7bf6e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099406 Aug 09 17:18:40.654336 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1158/2416] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:41.098799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38649112-db74-459d-9e69-fd1b70b04f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:41.100918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-38649112-db74-459d-9e69-fd1b70b04f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:41.131129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38649112-db74-459d-9e69-fd1b70b04f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:41.133251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38649112-db74-459d-9e69-fd1b70b04f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:41.135620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38649112-db74-459d-9e69-fd1b70b04f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:41.138070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38649112-db74-459d-9e69-fd1b70b04f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:41.139435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38649112-db74-459d-9e69-fd1b70b04f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:41.140722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38649112-db74-459d-9e69-fd1b70b04f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:41.236895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ed77459f-67b1-46ac-aa2f-1714d07b8663 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:41.252408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ed77459f-67b1-46ac-aa2f-1714d07b8663 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:41.285022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed77459f-67b1-46ac-aa2f-1714d07b8663 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:41.295718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed77459f-67b1-46ac-aa2f-1714d07b8663 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:41.296877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed77459f-67b1-46ac-aa2f-1714d07b8663 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:41.299906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed77459f-67b1-46ac-aa2f-1714d07b8663 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:41.299906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed77459f-67b1-46ac-aa2f-1714d07b8663 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:41.299906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed77459f-67b1-46ac-aa2f-1714d07b8663 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:41.777741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-38649112-db74-459d-9e69-fd1b70b04f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:41.805876 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-38649112-db74-459d-9e69-fd1b70b04f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1317 microversion: 2.1 time: 0.718909 Aug 09 17:18:41.807282 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1259/2417] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:41 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:41.834310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e8af15fc-70f2-4cc2-8ab8-f01d8ebdfad0 req-25ed8902-a5fc-41a9-99a3-254ddecaab72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e3e8f0-9f58-47fd-8000-d875529d0b84", "name": "network-vif-plugged", "status": "completed", "tag": "404b76c0-d83e-4f41-a30d-e7d27789aede"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:41.858903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e8af15fc-70f2-4cc2-8ab8-f01d8ebdfad0 req-25ed8902-a5fc-41a9-99a3-254ddecaab72 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:41.859441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e8af15fc-70f2-4cc2-8ab8-f01d8ebdfad0 req-25ed8902-a5fc-41a9-99a3-254ddecaab72 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:41.859901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e8af15fc-70f2-4cc2-8ab8-f01d8ebdfad0 req-25ed8902-a5fc-41a9-99a3-254ddecaab72 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:41.905858 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e8af15fc-70f2-4cc2-8ab8-f01d8ebdfad0 req-25ed8902-a5fc-41a9-99a3-254ddecaab72 service nova] Creating event network-vif-plugged:404b76c0-d83e-4f41-a30d-e7d27789aede for instance f7e3e8f0-9f58-47fd-8000-d875529d0b84 on n-h2-845781-6 Aug 09 17:18:41.921601 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e8af15fc-70f2-4cc2-8ab8-f01d8ebdfad0 req-25ed8902-a5fc-41a9-99a3-254ddecaab72 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112164 Aug 09 17:18:41.922942 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1260/2418] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:18:41.938341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b6a8acc-1aa4-4813-b6ae-d2ad929dc862 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:41.939041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1b6a8acc-1aa4-4813-b6ae-d2ad929dc862 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:41.963819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6a8acc-1aa4-4813-b6ae-d2ad929dc862 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:41.964394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6a8acc-1aa4-4813-b6ae-d2ad929dc862 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:41.964846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6a8acc-1aa4-4813-b6ae-d2ad929dc862 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:41.969793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6a8acc-1aa4-4813-b6ae-d2ad929dc862 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:41.970340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6a8acc-1aa4-4813-b6ae-d2ad929dc862 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:41.972799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6a8acc-1aa4-4813-b6ae-d2ad929dc862 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:42.177999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-1b6a8acc-1aa4-4813-b6ae-d2ad929dc862 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:42.221243 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b6a8acc-1aa4-4813-b6ae-d2ad929dc862 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.290051 Aug 09 17:18:42.224208 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1261/2419] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:41 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:42.485388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ed77459f-67b1-46ac-aa2f-1714d07b8663 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:42.525003 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ed77459f-67b1-46ac-aa2f-1714d07b8663 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 1.304024 Aug 09 17:18:42.536396 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1159/2420] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:41 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:42.860660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d48d2e65-ae9b-4337-8399-f6de1ec1c9da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:42.864539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d48d2e65-ae9b-4337-8399-f6de1ec1c9da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:42.894525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d48d2e65-ae9b-4337-8399-f6de1ec1c9da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:42.899296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d48d2e65-ae9b-4337-8399-f6de1ec1c9da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:42.902387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d48d2e65-ae9b-4337-8399-f6de1ec1c9da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:42.907894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d48d2e65-ae9b-4337-8399-f6de1ec1c9da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:42.908818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d48d2e65-ae9b-4337-8399-f6de1ec1c9da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:42.910087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d48d2e65-ae9b-4337-8399-f6de1ec1c9da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:43.263156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-38ac9257-d235-4891-9659-5bb7d1c5ad3c tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:43.267230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-38ac9257-d235-4891-9659-5bb7d1c5ad3c tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:43.302982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38ac9257-d235-4891-9659-5bb7d1c5ad3c tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:43.306094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38ac9257-d235-4891-9659-5bb7d1c5ad3c tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:43.306846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38ac9257-d235-4891-9659-5bb7d1c5ad3c tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:43.310794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38ac9257-d235-4891-9659-5bb7d1c5ad3c tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:43.312145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38ac9257-d235-4891-9659-5bb7d1c5ad3c tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:43.312981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38ac9257-d235-4891-9659-5bb7d1c5ad3c tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:43.489000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d48d2e65-ae9b-4337-8399-f6de1ec1c9da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:43.507411 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d48d2e65-ae9b-4337-8399-f6de1ec1c9da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1317 microversion: 2.1 time: 0.661670 Aug 09 17:18:43.523838 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1262/2421] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:42 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:43.568751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-38ac9257-d235-4891-9659-5bb7d1c5ad3c tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:43.576547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-76d87597-2439-49b7-887a-07b8f5c12e9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:43.577219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-76d87597-2439-49b7-887a-07b8f5c12e9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:43.591134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d87597-2439-49b7-887a-07b8f5c12e9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:43.592018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d87597-2439-49b7-887a-07b8f5c12e9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:43.592957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d87597-2439-49b7-887a-07b8f5c12e9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:43.595219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d87597-2439-49b7-887a-07b8f5c12e9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:43.596932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d87597-2439-49b7-887a-07b8f5c12e9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:43.597757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76d87597-2439-49b7-887a-07b8f5c12e9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:43.676223 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-38ac9257-d235-4891-9659-5bb7d1c5ad3c tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.425121 Aug 09 17:18:43.695206 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1160/2422] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:43 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:44.132792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-76d87597-2439-49b7-887a-07b8f5c12e9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:44.164682 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-76d87597-2439-49b7-887a-07b8f5c12e9b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 0.596178 Aug 09 17:18:44.172637 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1263/2423] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:43 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:18:44.531890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-27374dc0-e405-4c93-853b-f960b8058db5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:44.533273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-27374dc0-e405-4c93-853b-f960b8058db5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:44.559012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27374dc0-e405-4c93-853b-f960b8058db5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:44.560197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27374dc0-e405-4c93-853b-f960b8058db5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:44.560927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27374dc0-e405-4c93-853b-f960b8058db5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:44.563474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27374dc0-e405-4c93-853b-f960b8058db5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:44.568040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27374dc0-e405-4c93-853b-f960b8058db5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:44.569620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27374dc0-e405-4c93-853b-f960b8058db5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:44.713998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e49603d-727f-4572-a4bd-d0f5c791e9eb tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:44.715042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6e49603d-727f-4572-a4bd-d0f5c791e9eb tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:44.730173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e49603d-727f-4572-a4bd-d0f5c791e9eb tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:44.733685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e49603d-727f-4572-a4bd-d0f5c791e9eb tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:44.735030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e49603d-727f-4572-a4bd-d0f5c791e9eb tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:44.736452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e49603d-727f-4572-a4bd-d0f5c791e9eb tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:44.737322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e49603d-727f-4572-a4bd-d0f5c791e9eb tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:44.738814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e49603d-727f-4572-a4bd-d0f5c791e9eb tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:44.934962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-6e49603d-727f-4572-a4bd-d0f5c791e9eb tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:44.998992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e49603d-727f-4572-a4bd-d0f5c791e9eb tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.289443 Aug 09 17:18:45.000386 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1264/2424] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:44 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:45.202048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5bbb26b8-f344-4eca-ae9c-82ece6e21ebd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:45.205228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5bbb26b8-f344-4eca-ae9c-82ece6e21ebd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:45.264270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbb26b8-f344-4eca-ae9c-82ece6e21ebd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:45.269100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbb26b8-f344-4eca-ae9c-82ece6e21ebd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:45.279707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbb26b8-f344-4eca-ae9c-82ece6e21ebd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:45.281200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbb26b8-f344-4eca-ae9c-82ece6e21ebd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:45.281958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbb26b8-f344-4eca-ae9c-82ece6e21ebd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:45.287822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbb26b8-f344-4eca-ae9c-82ece6e21ebd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:45.845724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5bbb26b8-f344-4eca-ae9c-82ece6e21ebd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:45.869244 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5bbb26b8-f344-4eca-ae9c-82ece6e21ebd tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 0.677723 Aug 09 17:18:45.871166 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1265/2425] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:45 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:18:46.051314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c33e87cf-0d4a-4886-8bc1-8cc8a8784489 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:46.056683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c33e87cf-0d4a-4886-8bc1-8cc8a8784489 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:46.074085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33e87cf-0d4a-4886-8bc1-8cc8a8784489 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:46.074748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33e87cf-0d4a-4886-8bc1-8cc8a8784489 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:46.075996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33e87cf-0d4a-4886-8bc1-8cc8a8784489 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:46.078865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33e87cf-0d4a-4886-8bc1-8cc8a8784489 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:46.079695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33e87cf-0d4a-4886-8bc1-8cc8a8784489 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:46.080490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33e87cf-0d4a-4886-8bc1-8cc8a8784489 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:46.338191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-c33e87cf-0d4a-4886-8bc1-8cc8a8784489 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:46.401070 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c33e87cf-0d4a-4886-8bc1-8cc8a8784489 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.356834 Aug 09 17:18:46.403081 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1266/2426] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:46 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:18:46.464052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-27374dc0-e405-4c93-853b-f960b8058db5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:46.499093 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-27374dc0-e405-4c93-853b-f960b8058db5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1467 microversion: 2.1 time: 1.972765 Aug 09 17:18:46.524771 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1161/2427] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:44 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1467 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:46.563301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-42b75e48-d83b-49c0-be97-fc0849151e6a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:46.564743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-42b75e48-d83b-49c0-be97-fc0849151e6a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:46.585619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42b75e48-d83b-49c0-be97-fc0849151e6a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:46.586639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42b75e48-d83b-49c0-be97-fc0849151e6a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:46.587542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42b75e48-d83b-49c0-be97-fc0849151e6a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:46.589052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42b75e48-d83b-49c0-be97-fc0849151e6a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:46.590093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42b75e48-d83b-49c0-be97-fc0849151e6a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:46.591313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42b75e48-d83b-49c0-be97-fc0849151e6a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:46.937085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e1ea9a6a-cc5d-4960-8ede-959cb941d36e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:46.942726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e1ea9a6a-cc5d-4960-8ede-959cb941d36e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:47.004603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1ea9a6a-cc5d-4960-8ede-959cb941d36e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:47.020284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1ea9a6a-cc5d-4960-8ede-959cb941d36e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:47.024161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1ea9a6a-cc5d-4960-8ede-959cb941d36e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:47.027383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1ea9a6a-cc5d-4960-8ede-959cb941d36e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:47.029134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1ea9a6a-cc5d-4960-8ede-959cb941d36e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:47.030530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1ea9a6a-cc5d-4960-8ede-959cb941d36e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:47.516779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-42b75e48-d83b-49c0-be97-fc0849151e6a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:47.532756 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-42b75e48-d83b-49c0-be97-fc0849151e6a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991" status: 200 len: 1467 microversion: 2.1 time: 0.977295 Aug 09 17:18:47.534249 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1267/2428] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:46 2022] GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991 => generated 1467 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:47.541988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-452913ec-1051-4ac9-a2ce-6304b7c0042b tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:47.543449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-452913ec-1051-4ac9-a2ce-6304b7c0042b tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:47.560847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-452913ec-1051-4ac9-a2ce-6304b7c0042b tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:47.562542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-452913ec-1051-4ac9-a2ce-6304b7c0042b tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:47.563764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-452913ec-1051-4ac9-a2ce-6304b7c0042b tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:47.565743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-452913ec-1051-4ac9-a2ce-6304b7c0042b tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:47.566977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-452913ec-1051-4ac9-a2ce-6304b7c0042b tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:47.568096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-452913ec-1051-4ac9-a2ce-6304b7c0042b tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:47.801918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-452913ec-1051-4ac9-a2ce-6304b7c0042b tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:47.839897 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-452913ec-1051-4ac9-a2ce-6304b7c0042b tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.303707 Aug 09 17:18:47.850932 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1268/2429] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:47 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:47.863710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a2444c78-b88c-4c9d-aae5-92d144795068 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-118901511"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:47.868998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a2444c78-b88c-4c9d-aae5-92d144795068 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:47.882246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2444c78-b88c-4c9d-aae5-92d144795068 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:47.884198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2444c78-b88c-4c9d-aae5-92d144795068 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:47.885079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2444c78-b88c-4c9d-aae5-92d144795068 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:47.886402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2444c78-b88c-4c9d-aae5-92d144795068 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:47.887303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2444c78-b88c-4c9d-aae5-92d144795068 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:47.888537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2444c78-b88c-4c9d-aae5-92d144795068 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:48.318479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e1ea9a6a-cc5d-4960-8ede-959cb941d36e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:48.342476 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e1ea9a6a-cc5d-4960-8ede-959cb941d36e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 1.431825 Aug 09 17:18:48.344026 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1162/2430] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:46 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:48.364461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:48.454150 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a2444c78-b88c-4c9d-aae5-92d144795068 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "POST /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991/action" status: 202 len: 0 microversion: 2.1 time: 0.600120 Aug 09 17:18:48.455020 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1269/2431] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:18:47 2022] POST /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 17:18:48.471238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cf8073bb-ba07-4e4f-bfc5-5c0868c83819 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc8158b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:48.562213 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cf8073bb-ba07-4e4f-bfc5-5c0868c83819 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 200 len: 1454 microversion: 2.1 time: 0.093958 Aug 09 17:18:48.564311 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1163/2432] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:48 2022] GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:48.871299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06db01b4-813f-4f4d-8137-6c956279d672 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:48.872209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-06db01b4-813f-4f4d-8137-6c956279d672 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:48.895980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06db01b4-813f-4f4d-8137-6c956279d672 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:48.897232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06db01b4-813f-4f4d-8137-6c956279d672 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:48.898860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06db01b4-813f-4f4d-8137-6c956279d672 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:48.900604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06db01b4-813f-4f4d-8137-6c956279d672 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:48.901760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06db01b4-813f-4f4d-8137-6c956279d672 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:48.903100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06db01b4-813f-4f4d-8137-6c956279d672 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:49.217568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-06db01b4-813f-4f4d-8137-6c956279d672 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:49.292418 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-06db01b4-813f-4f4d-8137-6c956279d672 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.425711 Aug 09 17:18:49.296014 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1270/2433] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:48 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:49.382016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-65c86952-435c-477c-b2b9-b48bb642652e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:49.382908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-65c86952-435c-477c-b2b9-b48bb642652e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:49.402409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65c86952-435c-477c-b2b9-b48bb642652e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:49.403372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65c86952-435c-477c-b2b9-b48bb642652e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:49.403887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65c86952-435c-477c-b2b9-b48bb642652e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:49.405521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65c86952-435c-477c-b2b9-b48bb642652e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:49.406159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65c86952-435c-477c-b2b9-b48bb642652e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:49.406616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65c86952-435c-477c-b2b9-b48bb642652e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:49.600418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-028efc33-03a5-40da-a3be-51f8013b3a7a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcaf70820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:49.777254 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-028efc33-03a5-40da-a3be-51f8013b3a7a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 200 len: 1454 microversion: 2.1 time: 0.194156 Aug 09 17:18:49.792903 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1271/2434] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:49 2022] GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 1454 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:50.299439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1590317452", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "7a433422-1950-4c97-a7d7-e2c1728248b0"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:50.495334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] validate_networks() for [('7a433422-1950-4c97-a7d7-e2c1728248b0', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:18:50.831673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-65c86952-435c-477c-b2b9-b48bb642652e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:50.872177 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-65c86952-435c-477c-b2b9-b48bb642652e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 1.492433 Aug 09 17:18:50.874608 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1164/2435] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:49 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:18:50.904674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3b26289f-8c83-4873-9e7d-89484c8970c9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:50.912683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3b26289f-8c83-4873-9e7d-89484c8970c9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:50.930076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b26289f-8c83-4873-9e7d-89484c8970c9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:50.930875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b26289f-8c83-4873-9e7d-89484c8970c9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:50.931496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b26289f-8c83-4873-9e7d-89484c8970c9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:50.932463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b26289f-8c83-4873-9e7d-89484c8970c9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:50.934054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b26289f-8c83-4873-9e7d-89484c8970c9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:50.934726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b26289f-8c83-4873-9e7d-89484c8970c9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:51.089956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-3b26289f-8c83-4873-9e7d-89484c8970c9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:51.165713 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3b26289f-8c83-4873-9e7d-89484c8970c9 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 0.286589 Aug 09 17:18:51.167786 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1165/2436] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:50 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:51.200953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-be76ae9b-321b-4a15-a6e2-4a4e3c1efbaf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc8c4e50>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:51.292545 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-be76ae9b-321b-4a15-a6e2-4a4e3c1efbaf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 200 len: 1454 microversion: 2.1 time: 0.122738 Aug 09 17:18:51.293559 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1166/2437] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:51 2022] GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:51.909550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e3ccda9a-e3a7-405a-a5b4-d26100788f0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:51.911129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e3ccda9a-e3a7-405a-a5b4-d26100788f0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:51.924384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3ccda9a-e3a7-405a-a5b4-d26100788f0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:51.932102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3ccda9a-e3a7-405a-a5b4-d26100788f0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:51.933080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3ccda9a-e3a7-405a-a5b4-d26100788f0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:51.934344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3ccda9a-e3a7-405a-a5b4-d26100788f0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:51.946162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3ccda9a-e3a7-405a-a5b4-d26100788f0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:51.951462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3ccda9a-e3a7-405a-a5b4-d26100788f0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:52.916531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e3ccda9a-e3a7-405a-a5b4-d26100788f0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:52.953326 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e3ccda9a-e3a7-405a-a5b4-d26100788f0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 1.047524 Aug 09 17:18:52.955269 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1167/2438] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:51 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:52.978385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6d6cd954-dd8c-4f89-8900-0a2ceb74841d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:52.983795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6d6cd954-dd8c-4f89-8900-0a2ceb74841d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:52.988058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=73 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:52.998787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d6cd954-dd8c-4f89-8900-0a2ceb74841d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:52.999295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d6cd954-dd8c-4f89-8900-0a2ceb74841d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:52.999784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d6cd954-dd8c-4f89-8900-0a2ceb74841d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:53.000550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d6cd954-dd8c-4f89-8900-0a2ceb74841d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:53.001031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d6cd954-dd8c-4f89-8900-0a2ceb74841d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:53.001474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d6cd954-dd8c-4f89-8900-0a2ceb74841d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:54.104312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:18:54.105740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:18:54.106760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:18:54.107173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:18:54.107742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:18:54.127899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-6d6cd954-dd8c-4f89-8900-0a2ceb74841d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:54.142471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:54.157605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:54.164402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:54.167600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:54.169278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:54.170276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:54.184899 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6d6cd954-dd8c-4f89-8900-0a2ceb74841d tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1923 microversion: 2.75 time: 1.221897 Aug 09 17:18:54.188079 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1168/2439] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:52 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1923 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:54.204435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d518cf55-9cf3-41bf-a537-30f9a7b7d99f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc9d4280>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:54.270448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Getting quotas for project 09c53ff5b89f4495958c9319d750833c. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:18:54.302778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Getting quotas for user 4ab568d7612c4f849e842d478b67016d and project 09c53ff5b89f4495958c9319d750833c. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:18:54.365584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:18:54.368883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:18:54.378120 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d518cf55-9cf3-41bf-a537-30f9a7b7d99f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 200 len: 1454 microversion: 2.1 time: 0.187944 Aug 09 17:18:54.398154 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1169/2440] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:54 2022] GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 1454 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:54.440293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-54233e9d-16f4-40fd-826b-efd799ee8298 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:54.447682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-54233e9d-16f4-40fd-826b-efd799ee8298 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:54.471870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54233e9d-16f4-40fd-826b-efd799ee8298 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:54.473397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54233e9d-16f4-40fd-826b-efd799ee8298 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:54.474202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:18:54.474901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54233e9d-16f4-40fd-826b-efd799ee8298 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:54.477356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54233e9d-16f4-40fd-826b-efd799ee8298 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:54.478918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54233e9d-16f4-40fd-826b-efd799ee8298 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:54.481021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54233e9d-16f4-40fd-826b-efd799ee8298 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:54.508623 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-667cc57a-29bf-4727-b8b5-70d87909dac1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.643565 Aug 09 17:18:54.533114 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1272/2441] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:18:54.549247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-483cec17-2d22-42d1-bdb8-be3a3fd879c1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:54.553129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-483cec17-2d22-42d1-bdb8-be3a3fd879c1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:54.966648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-483cec17-2d22-42d1-bdb8-be3a3fd879c1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:54.984724 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-483cec17-2d22-42d1-bdb8-be3a3fd879c1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1225 microversion: 2.1 time: 0.449523 Aug 09 17:18:55.003026 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1273/2442] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:54 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1225 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:55.239135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f6a3dbd-9be4-43e1-bf78-a9a917047b46 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:55.240704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6f6a3dbd-9be4-43e1-bf78-a9a917047b46 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:55.268036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f6a3dbd-9be4-43e1-bf78-a9a917047b46 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:55.268965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f6a3dbd-9be4-43e1-bf78-a9a917047b46 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:55.269652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f6a3dbd-9be4-43e1-bf78-a9a917047b46 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:55.270629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f6a3dbd-9be4-43e1-bf78-a9a917047b46 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:55.271341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f6a3dbd-9be4-43e1-bf78-a9a917047b46 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:55.272087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f6a3dbd-9be4-43e1-bf78-a9a917047b46 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:56.340885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54233e9d-16f4-40fd-826b-efd799ee8298 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:56.382997 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-54233e9d-16f4-40fd-826b-efd799ee8298 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 1.982717 Aug 09 17:18:56.392119 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1170/2443] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:54 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:56.416029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6da97b4e-949d-4b15-a9e4-5fdb9685ddcd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc9abaf0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:56.449797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-6f6a3dbd-9be4-43e1-bf78-a9a917047b46 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:56.524613 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6f6a3dbd-9be4-43e1-bf78-a9a917047b46 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1929 microversion: 2.75 time: 1.289234 Aug 09 17:18:56.527486 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1274/2444] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:55 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1929 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:18:56.552868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4ec22d67-21d7-498f-81af-a6a9dc16eeec tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:56.561785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4ec22d67-21d7-498f-81af-a6a9dc16eeec tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:56.604020 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6da97b4e-949d-4b15-a9e4-5fdb9685ddcd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 200 len: 1454 microversion: 2.1 time: 0.209145 Aug 09 17:18:56.605567 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1171/2445] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:56 2022] GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 1454 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:56.891947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1126462724", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "40d7af60-c1b0-4997-900a-d86ff159d16e"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:18:56.954120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4ec22d67-21d7-498f-81af-a6a9dc16eeec tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:56.975473 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4ec22d67-21d7-498f-81af-a6a9dc16eeec tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1225 microversion: 2.1 time: 0.444843 Aug 09 17:18:56.997540 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1275/2446] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:56 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1225 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:57.052402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] validate_networks() for [('40d7af60-c1b0-4997-900a-d86ff159d16e', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:18:57.423792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4c99c5e-466a-4b37-81a8-fc6c2088fc01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:57.428736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d4c99c5e-466a-4b37-81a8-fc6c2088fc01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:57.456917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4c99c5e-466a-4b37-81a8-fc6c2088fc01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:57.461198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4c99c5e-466a-4b37-81a8-fc6c2088fc01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:57.462159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4c99c5e-466a-4b37-81a8-fc6c2088fc01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:57.463501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4c99c5e-466a-4b37-81a8-fc6c2088fc01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:57.464411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4c99c5e-466a-4b37-81a8-fc6c2088fc01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:57.471033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4c99c5e-466a-4b37-81a8-fc6c2088fc01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:58.374143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d4c99c5e-466a-4b37-81a8-fc6c2088fc01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:58.399888 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d4c99c5e-466a-4b37-81a8-fc6c2088fc01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 0.983436 Aug 09 17:18:58.403261 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1276/2447] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:57 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:18:58.422344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e4d06237-881c-436d-808c-26704fd60278 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:58.428152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e4d06237-881c-436d-808c-26704fd60278 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:58.459688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4d06237-881c-436d-808c-26704fd60278 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:58.461290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4d06237-881c-436d-808c-26704fd60278 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:58.461809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4d06237-881c-436d-808c-26704fd60278 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:58.470025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4d06237-881c-436d-808c-26704fd60278 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:58.474526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4d06237-881c-436d-808c-26704fd60278 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:58.478692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4d06237-881c-436d-808c-26704fd60278 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:59.020797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-e4d06237-881c-436d-808c-26704fd60278 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] Lazy-loading 'services' on Instance uuid a7c99f0c-b279-4102-b9c1-5e7966872fd8 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:18:59.099151 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e4d06237-881c-436d-808c-26704fd60278 tempest-ServersAdmin275Test-1489813501 tempest-ServersAdmin275Test-1489813501-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1914 microversion: 2.75 time: 0.693513 Aug 09 17:18:59.111035 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1277/2448] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:18:58 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1914 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:18:59.134105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-db8ed924-638b-404f-87b7-3c54c8c2c283 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb50a550>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:59.290423 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-db8ed924-638b-404f-87b7-3c54c8c2c283 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 200 len: 1454 microversion: 2.1 time: 0.176642 Aug 09 17:18:59.292353 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1278/2449] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:18:59 2022] GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 1454 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:59.301622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1bd2e3cb-3ad0-4ee0-91c1-2887dfb004ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:59.303019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1bd2e3cb-3ad0-4ee0-91c1-2887dfb004ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:59.320183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bd2e3cb-3ad0-4ee0-91c1-2887dfb004ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:59.321496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bd2e3cb-3ad0-4ee0-91c1-2887dfb004ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:59.322587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bd2e3cb-3ad0-4ee0-91c1-2887dfb004ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:59.324424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bd2e3cb-3ad0-4ee0-91c1-2887dfb004ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:59.325486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bd2e3cb-3ad0-4ee0-91c1-2887dfb004ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:59.326609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bd2e3cb-3ad0-4ee0-91c1-2887dfb004ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:59.559301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1bd2e3cb-3ad0-4ee0-91c1-2887dfb004ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:18:59.586161 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1bd2e3cb-3ad0-4ee0-91c1-2887dfb004ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1277 microversion: 2.1 time: 0.291214 Aug 09 17:18:59.588304 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1279/2450] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:59 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1277 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:18:59.609183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-933010d6-369c-4873-a8a5-937a2202b61e tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:18:59.612555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-933010d6-369c-4873-a8a5-937a2202b61e tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:18:59.642548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-933010d6-369c-4873-a8a5-937a2202b61e tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:59.643509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-933010d6-369c-4873-a8a5-937a2202b61e tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:59.644252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-933010d6-369c-4873-a8a5-937a2202b61e tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:59.645343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-933010d6-369c-4873-a8a5-937a2202b61e tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:18:59.646196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-933010d6-369c-4873-a8a5-937a2202b61e tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:18:59.652195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-933010d6-369c-4873-a8a5-937a2202b61e tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:18:59.702898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-933010d6-369c-4873-a8a5-937a2202b61e tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:18:59.996702 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-933010d6-369c-4873-a8a5-937a2202b61e tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 204 len: 0 microversion: 2.75 time: 0.406292 Aug 09 17:18:59.999222 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1280/2451] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:18:59 2022] DELETE /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:19:00.013725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-56832f08-f1d0-421c-a8fc-03ccd3a08172 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:00.017167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-56832f08-f1d0-421c-a8fc-03ccd3a08172 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:00.047689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56832f08-f1d0-421c-a8fc-03ccd3a08172 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:00.052522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56832f08-f1d0-421c-a8fc-03ccd3a08172 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:00.057297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56832f08-f1d0-421c-a8fc-03ccd3a08172 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:00.061919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56832f08-f1d0-421c-a8fc-03ccd3a08172 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:00.067585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56832f08-f1d0-421c-a8fc-03ccd3a08172 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:00.073445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56832f08-f1d0-421c-a8fc-03ccd3a08172 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:01.332439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:19:01.335022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:19:01.336813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:19:01.337955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:19:01.340302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:19:01.384931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:01.386188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:01.389764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:01.395683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:01.397034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:01.398830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:01.486761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Getting quotas for project 208b84af01f74102ace86c0501d7625d. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:19:01.514909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Getting quotas for user 9edfac84db3a4f748ac3aa28d35fa7b0 and project 208b84af01f74102ace86c0501d7625d. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:19:01.530426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:19:01.533358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:19:01.596864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-56832f08-f1d0-421c-a8fc-03ccd3a08172 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:01.620442 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-56832f08-f1d0-421c-a8fc-03ccd3a08172 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 1.618418 Aug 09 17:19:01.638275 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1281/2452] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:18:59 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:01.651535 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6848676d-ec6b-4f1c-b832-d17d8c2c2ec9 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.044443 Aug 09 17:19:01.659991 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1172/2453] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:18:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 5053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:19:01.667042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0696f80b-157c-4af4-b30e-2bc145e90413 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc9e6040>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:01.672549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:01.684592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:01.722021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:01.725267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:01.727530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:01.732484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:01.733430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:01.733761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:01.842564 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0696f80b-157c-4af4-b30e-2bc145e90413 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 200 len: 1454 microversion: 2.1 time: 0.179781 Aug 09 17:19:01.843662 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1173/2454] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:01 2022] GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:01.893502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-79d778f5-c256-45b1-befc-164e362f4f78 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:01.897381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-79d778f5-c256-45b1-befc-164e362f4f78 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:01.915589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79d778f5-c256-45b1-befc-164e362f4f78 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:01.917632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79d778f5-c256-45b1-befc-164e362f4f78 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:01.918859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79d778f5-c256-45b1-befc-164e362f4f78 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:01.921022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79d778f5-c256-45b1-befc-164e362f4f78 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:01.922125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79d778f5-c256-45b1-befc-164e362f4f78 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:01.923846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79d778f5-c256-45b1-befc-164e362f4f78 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:02.159823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:02.199335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:02.205984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:02.218704 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9bc33658-a006-4367-8b8e-383277f36bbd tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1441 microversion: 2.75 time: 0.578221 Aug 09 17:19:02.235147 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1282/2455] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:19:01 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1441 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:19:02.235147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-582f438d-30b7-4d53-9379-491fc1047019 req-9eb6efda-3f17-49c4-a40b-df8fabb01bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce962b08-43de-4bff-a72a-1adcf330c991", "name": "network-vif-plugged", "status": "completed", "tag": "b046df32-8645-4449-b41d-a48fe4b7136e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:02.263801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-582f438d-30b7-4d53-9379-491fc1047019 req-9eb6efda-3f17-49c4-a40b-df8fabb01bd8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:02.265246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-582f438d-30b7-4d53-9379-491fc1047019 req-9eb6efda-3f17-49c4-a40b-df8fabb01bd8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:02.269070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-582f438d-30b7-4d53-9379-491fc1047019 req-9eb6efda-3f17-49c4-a40b-df8fabb01bd8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:02.355142 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-582f438d-30b7-4d53-9379-491fc1047019 req-9eb6efda-3f17-49c4-a40b-df8fabb01bd8 service nova] Creating event network-vif-plugged:b046df32-8645-4449-b41d-a48fe4b7136e for instance ce962b08-43de-4bff-a72a-1adcf330c991 on n-h2-845781-6 Aug 09 17:19:02.383851 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-582f438d-30b7-4d53-9379-491fc1047019 req-9eb6efda-3f17-49c4-a40b-df8fabb01bd8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161055 Aug 09 17:19:02.388960 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1283/2456] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:02.427327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c1ff0577-aead-4c88-8252-2a48f6e93a11 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:02.432894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c1ff0577-aead-4c88-8252-2a48f6e93a11 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:02.527786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-79d778f5-c256-45b1-befc-164e362f4f78 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:02.566242 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-79d778f5-c256-45b1-befc-164e362f4f78 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1283 microversion: 2.1 time: 0.696948 Aug 09 17:19:02.569686 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1174/2457] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:01 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1283 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:02.651029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d0a4c80c-cb49-4fa0-8ded-5fbf3909603e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:02.654786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d0a4c80c-cb49-4fa0-8ded-5fbf3909603e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:02.675407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0a4c80c-cb49-4fa0-8ded-5fbf3909603e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:02.684955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0a4c80c-cb49-4fa0-8ded-5fbf3909603e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:02.687122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0a4c80c-cb49-4fa0-8ded-5fbf3909603e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:02.693874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0a4c80c-cb49-4fa0-8ded-5fbf3909603e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:02.695585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0a4c80c-cb49-4fa0-8ded-5fbf3909603e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:02.696451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0a4c80c-cb49-4fa0-8ded-5fbf3909603e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:02.869349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:03.359501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c1ff0577-aead-4c88-8252-2a48f6e93a11 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9edfac84db3a4f748ac3aa28d35fa7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208b84af01f74102ace86c0501d7625d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:03.417212 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c1ff0577-aead-4c88-8252-2a48f6e93a11 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 200 len: 1225 microversion: 2.1 time: 1.022710 Aug 09 17:19:03.435562 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1284/2458] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:02 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 1225 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:03.451551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-20b36fb4-477f-4cd8-b981-eae023567b71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb667160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:03.499875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d0a4c80c-cb49-4fa0-8ded-5fbf3909603e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:03.548666 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d0a4c80c-cb49-4fa0-8ded-5fbf3909603e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 0.905347 Aug 09 17:19:03.555181 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1175/2459] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:02 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:03.562576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:03.572032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:03.579882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:03.581173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:03.582354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:03.584164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:03.593898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:03.599287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:03.639704 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-20b36fb4-477f-4cd8-b981-eae023567b71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 200 len: 1454 microversion: 2.1 time: 0.188329 Aug 09 17:19:03.639704 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1285/2460] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:03 2022] GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 1454 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:03.681134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88fad265-3a49-4a32-a1e6-8614e3172079 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:03.684172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88fad265-3a49-4a32-a1e6-8614e3172079 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:03.734497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88fad265-3a49-4a32-a1e6-8614e3172079 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:03.746279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88fad265-3a49-4a32-a1e6-8614e3172079 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:03.757801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88fad265-3a49-4a32-a1e6-8614e3172079 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:03.759750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88fad265-3a49-4a32-a1e6-8614e3172079 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:03.760708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88fad265-3a49-4a32-a1e6-8614e3172079 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:03.790570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88fad265-3a49-4a32-a1e6-8614e3172079 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:04.204529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:04.235541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-88fad265-3a49-4a32-a1e6-8614e3172079 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:04.256155 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88fad265-3a49-4a32-a1e6-8614e3172079 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1283 microversion: 2.1 time: 0.616527 Aug 09 17:19:04.259550 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1286/2461] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:03 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1283 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:04.285756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1402115343", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "55151d79-243d-44fe-b0a9-c45de131bc01"}, {"uuid": "a4cd1ea8-208e-451e-99dc-48375541c69e"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:04.324833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:04.347019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:04.355110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc746a69826847258f3911c6bfd954bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497c3ee8275f4e31bd3d0ceb6522a27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:04.402944 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6e2ab251-59e4-4883-b206-0927ca2953f6 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 200 len: 1441 microversion: 2.75 time: 0.845918 Aug 09 17:19:04.424709 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1176/2462] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:19:03 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 1441 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:19:04.469480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-45e3b8f3-1a43-4c43-8247-9ee252b9181f tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:04.473461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-45e3b8f3-1a43-4c43-8247-9ee252b9181f tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:04.488757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] validate_networks() for [('55151d79-243d-44fe-b0a9-c45de131bc01', None, None, None, None, None), ('a4cd1ea8-208e-451e-99dc-48375541c69e', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:19:04.528658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e3b8f3-1a43-4c43-8247-9ee252b9181f tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:04.529561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e3b8f3-1a43-4c43-8247-9ee252b9181f tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:04.530229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e3b8f3-1a43-4c43-8247-9ee252b9181f tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:04.531216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e3b8f3-1a43-4c43-8247-9ee252b9181f tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:04.532072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e3b8f3-1a43-4c43-8247-9ee252b9181f tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:04.534319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e3b8f3-1a43-4c43-8247-9ee252b9181f tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:04.844225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45e3b8f3-1a43-4c43-8247-9ee252b9181f tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9edfac84db3a4f748ac3aa28d35fa7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208b84af01f74102ace86c0501d7625d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:04.856986 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-45e3b8f3-1a43-4c43-8247-9ee252b9181f tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 200 len: 1277 microversion: 2.1 time: 0.401547 Aug 09 17:19:04.879951 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1177/2463] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:04 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 1277 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:04.887770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-336c7ced-dca9-4b82-8e10-f3b7be6893a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:04.888502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-336c7ced-dca9-4b82-8e10-f3b7be6893a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:04.906638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-336c7ced-dca9-4b82-8e10-f3b7be6893a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:04.907143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-336c7ced-dca9-4b82-8e10-f3b7be6893a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:04.907598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-336c7ced-dca9-4b82-8e10-f3b7be6893a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:04.908398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-336c7ced-dca9-4b82-8e10-f3b7be6893a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:04.908870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-336c7ced-dca9-4b82-8e10-f3b7be6893a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:04.909304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-336c7ced-dca9-4b82-8e10-f3b7be6893a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:06.281438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-336c7ced-dca9-4b82-8e10-f3b7be6893a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:06.310208 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-336c7ced-dca9-4b82-8e10-f3b7be6893a9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1508 microversion: 2.1 time: 1.426059 Aug 09 17:19:06.325129 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1178/2464] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:04 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1508 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:06.358860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7c07c617-1bd9-468f-bb27-40dc9009f180 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb6a0670>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:06.635368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7c07c617-1bd9-468f-bb27-40dc9009f180 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 200 len: 1454 microversion: 2.1 time: 0.211876 Aug 09 17:19:06.636658 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1179/2465] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:06 2022] GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 1454 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:06.707755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b6ab4651-f90e-4038-ae8d-5d48cf6a9acd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:06.712111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b6ab4651-f90e-4038-ae8d-5d48cf6a9acd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:06.764094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ab4651-f90e-4038-ae8d-5d48cf6a9acd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:06.768747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ab4651-f90e-4038-ae8d-5d48cf6a9acd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:06.772598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ab4651-f90e-4038-ae8d-5d48cf6a9acd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:06.782483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ab4651-f90e-4038-ae8d-5d48cf6a9acd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:06.789999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ab4651-f90e-4038-ae8d-5d48cf6a9acd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:06.791422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ab4651-f90e-4038-ae8d-5d48cf6a9acd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:07.510209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b6ab4651-f90e-4038-ae8d-5d48cf6a9acd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:07.545877 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b6ab4651-f90e-4038-ae8d-5d48cf6a9acd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1283 microversion: 2.1 time: 0.900605 Aug 09 17:19:07.549797 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1180/2466] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:06 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1283 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:07.591377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:07.617863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] [instance: a7c99f0c-b279-4102-b9c1-5e7966872fd8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:07.657328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:07.659206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:07.663097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:07.665147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:07.666406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:07.667531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:07.735063 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] HTTP exception thrown: Instance a7c99f0c-b279-4102-b9c1-5e7966872fd8 could not be found. Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Request method failure captured: Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 HTTP/1.1 Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8parVEuj0_xPuqgrJ1diqKVedlJ0Tpgg-e_q8iwylU6cdBL_rOprJCkoRoZk3i0ZjqCx3mgkDq6MUXKOaBMWdEnllurNa0aMLXzl5swZOeXKsgBitSulIiddxY09XGI5t28PRcJXR60BPqh2DI0-NWaoTHfOoiWLkcqBk_6Ha9e1Gxg Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.75 Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 497c3ee8275f4e31bd3d0ceb6522a27d Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersAdmin275Test-405578475 Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_497c3ee8275f4e31bd3d0ceb6522a27d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/497c3ee8275f4e31bd3d0ceb6522a27d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/497c3ee8275f4e31bd3d0ceb6522a27d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/497c3ee8275f4e31bd3d0ceb6522a27d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersAdmin275Test-405578475 Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 497c3ee8275f4e31bd3d0ceb6522a27d Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersAdmin275Test-405578475 Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersAdmin275Test-405578475-project Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: fc746a69826847258f3911c6bfd954bb Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersAdmin275Test-405578475-project Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance a7c99f0c-b279-4102-b9c1-5e7966872fd8 could not be found. Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'a7c99f0c-b279-4102-b9c1-5e7966872fd8'} Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c99f0c-b279-4102-b9c1-5e7966872fd8 could not be found. Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c99f0c-b279-4102-b9c1-5e7966872fd8 could not be found. Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:07.739612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:07.752482 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:07.752482 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:07.752482 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:07.752482 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:19:07.752482 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:19:07.752482 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c99f0c-b279-4102-b9c1-5e7966872fd8 could not be found. Aug 09 17:19:07.752482 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:07.757795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] Returning 404 to user: Instance a7c99f0c-b279-4102-b9c1-5e7966872fd8 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:19:07.777306 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c43d7804-10d8-49fb-af4b-a86352278395 tempest-ServersAdmin275Test-405578475 tempest-ServersAdmin275Test-405578475-project] 10.222.0.93 "GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8" status: 404 len: 111 microversion: 2.75 time: 0.221306 Aug 09 17:19:07.784902 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1181/2467] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:19:07 2022] GET /compute/v2.1/servers/a7c99f0c-b279-4102-b9c1-5e7966872fd8 => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:19:07.802074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5cffeaf-9720-486c-b571-dc220bb6f62b tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:07.810591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5cffeaf-9720-486c-b571-dc220bb6f62b tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:07.834644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5cffeaf-9720-486c-b571-dc220bb6f62b tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:07.836654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5cffeaf-9720-486c-b571-dc220bb6f62b tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:07.867090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5cffeaf-9720-486c-b571-dc220bb6f62b tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:07.877579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5cffeaf-9720-486c-b571-dc220bb6f62b tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:07.882210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5cffeaf-9720-486c-b571-dc220bb6f62b tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:07.883424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5cffeaf-9720-486c-b571-dc220bb6f62b tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:08.866145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e5cffeaf-9720-486c-b571-dc220bb6f62b tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9edfac84db3a4f748ac3aa28d35fa7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208b84af01f74102ace86c0501d7625d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:08.880959 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5cffeaf-9720-486c-b571-dc220bb6f62b tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 200 len: 1325 microversion: 2.1 time: 1.092553 Aug 09 17:19:08.886522 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1182/2468] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:07 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 1325 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:08.904157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3fad6055-ee58-41d0-a167-6f723a3de509 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:08.911896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3fad6055-ee58-41d0-a167-6f723a3de509 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:08.937274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fad6055-ee58-41d0-a167-6f723a3de509 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:08.953538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fad6055-ee58-41d0-a167-6f723a3de509 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:08.966448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fad6055-ee58-41d0-a167-6f723a3de509 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:08.974773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fad6055-ee58-41d0-a167-6f723a3de509 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:08.990995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fad6055-ee58-41d0-a167-6f723a3de509 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:08.991926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fad6055-ee58-41d0-a167-6f723a3de509 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:11.260594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3fad6055-ee58-41d0-a167-6f723a3de509 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:11.301131 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3fad6055-ee58-41d0-a167-6f723a3de509 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1524 microversion: 2.1 time: 2.411094 Aug 09 17:19:11.328168 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1183/2469] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:08 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1524 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:11.342944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bfd1e446-8a36-4aa0-a711-617fd108f62d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc9d24c0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:11.435523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:19:11.436367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:19:11.437482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:19:11.438058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:19:11.438715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:19:11.441233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:11.466099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:11.478901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:11.479540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:11.480530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:11.481588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:11.502128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:11.525724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:11.620722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Getting quotas for project c273ac15199f43b898faa91983629795. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:19:11.651667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Getting quotas for user d0cb6058852c4b59ae031509affffe65 and project c273ac15199f43b898faa91983629795. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:19:11.743535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:19:11.767322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:19:11.984532 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6891c29a-eff6-44c7-a339-fa2d01c49da1 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.702019 Aug 09 17:19:11.986975 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1287/2470] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:19:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 7726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:19:12.007405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44450e6d-2410-4a78-aa88-571dd92297f0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:12.023325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-44450e6d-2410-4a78-aa88-571dd92297f0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:12.047064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44450e6d-2410-4a78-aa88-571dd92297f0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:12.047265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44450e6d-2410-4a78-aa88-571dd92297f0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:12.047817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44450e6d-2410-4a78-aa88-571dd92297f0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:12.048407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44450e6d-2410-4a78-aa88-571dd92297f0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:12.048867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44450e6d-2410-4a78-aa88-571dd92297f0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:12.049298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44450e6d-2410-4a78-aa88-571dd92297f0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:13.409902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-44450e6d-2410-4a78-aa88-571dd92297f0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:13.427949 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-44450e6d-2410-4a78-aa88-571dd92297f0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1325 microversion: 2.1 time: 1.435133 Aug 09 17:19:13.447865 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1288/2471] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:11 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1325 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:13.458235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e64ce5f5-9dac-48a4-afe6-cab904f3f68c tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:13.458650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e64ce5f5-9dac-48a4-afe6-cab904f3f68c tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:13.479665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e64ce5f5-9dac-48a4-afe6-cab904f3f68c tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:13.480354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e64ce5f5-9dac-48a4-afe6-cab904f3f68c tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:13.480997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e64ce5f5-9dac-48a4-afe6-cab904f3f68c tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:13.482098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e64ce5f5-9dac-48a4-afe6-cab904f3f68c tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:13.482736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e64ce5f5-9dac-48a4-afe6-cab904f3f68c tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:13.483338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e64ce5f5-9dac-48a4-afe6-cab904f3f68c tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:15.494822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e64ce5f5-9dac-48a4-afe6-cab904f3f68c tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9edfac84db3a4f748ac3aa28d35fa7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208b84af01f74102ace86c0501d7625d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:15.532037 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e64ce5f5-9dac-48a4-afe6-cab904f3f68c tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 200 len: 1325 microversion: 2.1 time: 2.078087 Aug 09 17:19:15.550740 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1289/2472] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:13 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 1325 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:15.581824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11ad740f-40a9-4ae5-94c8-20e64668c08a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:15.587782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-11ad740f-40a9-4ae5-94c8-20e64668c08a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:15.612534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ad740f-40a9-4ae5-94c8-20e64668c08a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:15.617851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ad740f-40a9-4ae5-94c8-20e64668c08a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:15.619494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ad740f-40a9-4ae5-94c8-20e64668c08a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:15.622363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ad740f-40a9-4ae5-94c8-20e64668c08a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:15.625548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ad740f-40a9-4ae5-94c8-20e64668c08a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:15.629287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ad740f-40a9-4ae5-94c8-20e64668c08a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:15.958229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-11ad740f-40a9-4ae5-94c8-20e64668c08a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:16.016922 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11ad740f-40a9-4ae5-94c8-20e64668c08a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1265 microversion: 2.1 time: 0.451405 Aug 09 17:19:16.018104 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1290/2473] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:15 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1265 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:16.054101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aeef0329-7049-496c-beeb-ed084877acfc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:16.063960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aeef0329-7049-496c-beeb-ed084877acfc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:16.108582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aeef0329-7049-496c-beeb-ed084877acfc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:16.114178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aeef0329-7049-496c-beeb-ed084877acfc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:16.116631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aeef0329-7049-496c-beeb-ed084877acfc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:16.122288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aeef0329-7049-496c-beeb-ed084877acfc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:16.123567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aeef0329-7049-496c-beeb-ed084877acfc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:16.126360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aeef0329-7049-496c-beeb-ed084877acfc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:16.257563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:17.828193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aeef0329-7049-496c-beeb-ed084877acfc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:17.886781 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aeef0329-7049-496c-beeb-ed084877acfc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1524 microversion: 2.1 time: 1.853398 Aug 09 17:19:17.937174 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1291/2474] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:16 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1524 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:18.937643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:19.037083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-023313e7-4204-4ae8-89a8-64f4ff9b415d req-a617ba68-c02e-4ad7-a5a9-ed57bb6597c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167ad713-e065-4761-8eea-f7b8d763c166", "tag": "b63dd528-bbfd-4f7d-95c8-ba7a7722e925"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:19.081778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-023313e7-4204-4ae8-89a8-64f4ff9b415d req-a617ba68-c02e-4ad7-a5a9-ed57bb6597c0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:19.083144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-023313e7-4204-4ae8-89a8-64f4ff9b415d req-a617ba68-c02e-4ad7-a5a9-ed57bb6597c0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:19.086502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-023313e7-4204-4ae8-89a8-64f4ff9b415d req-a617ba68-c02e-4ad7-a5a9-ed57bb6597c0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:19.139343 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-023313e7-4204-4ae8-89a8-64f4ff9b415d req-a617ba68-c02e-4ad7-a5a9-ed57bb6597c0 service nova] Creating event network-changed:b63dd528-bbfd-4f7d-95c8-ba7a7722e925 for instance 167ad713-e065-4761-8eea-f7b8d763c166 on n-h2-845781-6 Aug 09 17:19:19.154439 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-023313e7-4204-4ae8-89a8-64f4ff9b415d req-a617ba68-c02e-4ad7-a5a9-ed57bb6597c0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.215549 Aug 09 17:19:19.160181 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1292/2475] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:19.183530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d3dabdd8-7721-4cd3-955c-b9b27d62c5cc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:19.189555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d3dabdd8-7721-4cd3-955c-b9b27d62c5cc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:19.219430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3dabdd8-7721-4cd3-955c-b9b27d62c5cc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:19.219430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3dabdd8-7721-4cd3-955c-b9b27d62c5cc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:19.219430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3dabdd8-7721-4cd3-955c-b9b27d62c5cc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:19.219430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3dabdd8-7721-4cd3-955c-b9b27d62c5cc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:19.230881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3dabdd8-7721-4cd3-955c-b9b27d62c5cc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:19.231719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3dabdd8-7721-4cd3-955c-b9b27d62c5cc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:21.267661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=40 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:21.381995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3dabdd8-7721-4cd3-955c-b9b27d62c5cc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:21.417490 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d3dabdd8-7721-4cd3-955c-b9b27d62c5cc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1325 microversion: 2.1 time: 2.254440 Aug 09 17:19:21.420941 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1293/2476] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:19 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1325 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:21.469702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9e2d85c9-7486-42e0-a77f-0bd024cb1975 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:21.471691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9e2d85c9-7486-42e0-a77f-0bd024cb1975 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:21.483597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e2d85c9-7486-42e0-a77f-0bd024cb1975 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:21.484605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e2d85c9-7486-42e0-a77f-0bd024cb1975 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:21.485358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e2d85c9-7486-42e0-a77f-0bd024cb1975 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:21.486344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e2d85c9-7486-42e0-a77f-0bd024cb1975 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:21.487043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e2d85c9-7486-42e0-a77f-0bd024cb1975 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:21.487774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e2d85c9-7486-42e0-a77f-0bd024cb1975 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:21.573688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:21.714781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=18 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:23.337314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9e2d85c9-7486-42e0-a77f-0bd024cb1975 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9edfac84db3a4f748ac3aa28d35fa7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208b84af01f74102ace86c0501d7625d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:23.382195 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9e2d85c9-7486-42e0-a77f-0bd024cb1975 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 200 len: 1325 microversion: 2.1 time: 1.941657 Aug 09 17:19:23.388177 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1294/2477] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:21 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 1325 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:23.879359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-710e3ff1-165b-4089-b9e0-0b9862f2dcd8 req-f0286790-66ad-42a6-bda0-200f6eb1187c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32cf57c-7503-421c-a197-4a9f8cd925e0", "name": "network-vif-plugged", "status": "completed", "tag": "d201dfe6-dd68-4013-8808-ca52e463bec5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:23.939275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-710e3ff1-165b-4089-b9e0-0b9862f2dcd8 req-f0286790-66ad-42a6-bda0-200f6eb1187c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:23.941385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-710e3ff1-165b-4089-b9e0-0b9862f2dcd8 req-f0286790-66ad-42a6-bda0-200f6eb1187c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:23.942692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-710e3ff1-165b-4089-b9e0-0b9862f2dcd8 req-f0286790-66ad-42a6-bda0-200f6eb1187c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:24.026044 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-710e3ff1-165b-4089-b9e0-0b9862f2dcd8 req-f0286790-66ad-42a6-bda0-200f6eb1187c service nova] Creating event network-vif-plugged:d201dfe6-dd68-4013-8808-ca52e463bec5 for instance e32cf57c-7503-421c-a197-4a9f8cd925e0 on n-h2-845781-6 Aug 09 17:19:24.056711 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-710e3ff1-165b-4089-b9e0-0b9862f2dcd8 req-f0286790-66ad-42a6-bda0-200f6eb1187c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.661710 Aug 09 17:19:24.080103 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1295/2478] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:24.127078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-470d14e3-ce29-4c84-8044-221aefddd2fa tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:24.136870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-470d14e3-ce29-4c84-8044-221aefddd2fa tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:24.185246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-470d14e3-ce29-4c84-8044-221aefddd2fa tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:24.189716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-470d14e3-ce29-4c84-8044-221aefddd2fa tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:24.191590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-470d14e3-ce29-4c84-8044-221aefddd2fa tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:24.196441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-470d14e3-ce29-4c84-8044-221aefddd2fa tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:24.199991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-470d14e3-ce29-4c84-8044-221aefddd2fa tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:24.202363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-470d14e3-ce29-4c84-8044-221aefddd2fa tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:25.284811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-470d14e3-ce29-4c84-8044-221aefddd2fa tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:25.326258 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-470d14e3-ce29-4c84-8044-221aefddd2fa tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1313 microversion: 2.1 time: 1.238436 Aug 09 17:19:25.359080 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1296/2479] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:24 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1313 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:25.705180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9ec837b7-539a-473f-91dc-d9066173f327 req-c499c2ec-1119-4fa3-ab1f-2e763668396e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86a49e6-8b69-4653-be51-46f86d343173", "tag": "5c77d2c9-8b84-4357-a134-aa90a6550da8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:25.830359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:25.870791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9ec837b7-539a-473f-91dc-d9066173f327 req-c499c2ec-1119-4fa3-ab1f-2e763668396e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:25.881727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9ec837b7-539a-473f-91dc-d9066173f327 req-c499c2ec-1119-4fa3-ab1f-2e763668396e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:25.883060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9ec837b7-539a-473f-91dc-d9066173f327 req-c499c2ec-1119-4fa3-ab1f-2e763668396e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:25.936626 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9ec837b7-539a-473f-91dc-d9066173f327 req-c499c2ec-1119-4fa3-ab1f-2e763668396e service nova] Creating event network-changed:5c77d2c9-8b84-4357-a134-aa90a6550da8 for instance b86a49e6-8b69-4653-be51-46f86d343173 on n-h1-845781-6 Aug 09 17:19:25.953183 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9ec837b7-539a-473f-91dc-d9066173f327 req-c499c2ec-1119-4fa3-ab1f-2e763668396e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.588877 Aug 09 17:19:25.955424 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1297/2480] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:25.968008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-62b57304-684c-41bb-a6e5-e1e8c506071a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:25.978737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-62b57304-684c-41bb-a6e5-e1e8c506071a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:26.009580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b57304-684c-41bb-a6e5-e1e8c506071a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:26.011159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b57304-684c-41bb-a6e5-e1e8c506071a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:26.012380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b57304-684c-41bb-a6e5-e1e8c506071a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:26.015875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b57304-684c-41bb-a6e5-e1e8c506071a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:26.020107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b57304-684c-41bb-a6e5-e1e8c506071a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:26.021420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62b57304-684c-41bb-a6e5-e1e8c506071a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:27.284698 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bfd1e446-8a36-4aa0-a711-617fd108f62d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 200 len: 1463 microversion: 2.1 time: 15.954821 Aug 09 17:19:27.295606 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1184/2481] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:11 2022] GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 1463 bytes in 15967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:27.309935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7d25dd30-2b68-42cf-b2db-32fa4f95be7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:27.312953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7d25dd30-2b68-42cf-b2db-32fa4f95be7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:27.326549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d25dd30-2b68-42cf-b2db-32fa4f95be7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:27.328175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d25dd30-2b68-42cf-b2db-32fa4f95be7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:27.337960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d25dd30-2b68-42cf-b2db-32fa4f95be7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:27.339169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d25dd30-2b68-42cf-b2db-32fa4f95be7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:27.339991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d25dd30-2b68-42cf-b2db-32fa4f95be7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:27.340713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d25dd30-2b68-42cf-b2db-32fa4f95be7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:27.789654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-62b57304-684c-41bb-a6e5-e1e8c506071a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:27.809989 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-62b57304-684c-41bb-a6e5-e1e8c506071a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1524 microversion: 2.1 time: 1.851339 Aug 09 17:19:27.813747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7d25dd30-2b68-42cf-b2db-32fa4f95be7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:27.822156 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1298/2482] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:25 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1524 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:27.829447 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7d25dd30-2b68-42cf-b2db-32fa4f95be7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1325 microversion: 2.1 time: 0.528896 Aug 09 17:19:27.831356 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1185/2483] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:27 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1325 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:27.844323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cef2fb7c-313c-4cf3-84e7-ca6dbc7d2973 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:27.845287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cef2fb7c-313c-4cf3-84e7-ca6dbc7d2973 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:27.861660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cef2fb7c-313c-4cf3-84e7-ca6dbc7d2973 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:27.862546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cef2fb7c-313c-4cf3-84e7-ca6dbc7d2973 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:27.864119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cef2fb7c-313c-4cf3-84e7-ca6dbc7d2973 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:27.867645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cef2fb7c-313c-4cf3-84e7-ca6dbc7d2973 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:27.868436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cef2fb7c-313c-4cf3-84e7-ca6dbc7d2973 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:27.869037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cef2fb7c-313c-4cf3-84e7-ca6dbc7d2973 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:28.053648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1399747113", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:28.167559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:19:28.593542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cef2fb7c-313c-4cf3-84e7-ca6dbc7d2973 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9edfac84db3a4f748ac3aa28d35fa7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208b84af01f74102ace86c0501d7625d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:28.605699 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cef2fb7c-313c-4cf3-84e7-ca6dbc7d2973 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 200 len: 1325 microversion: 2.1 time: 0.771794 Aug 09 17:19:28.620364 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1186/2484] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:27 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 1325 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:28.626876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d78bc922-7e11-4f01-946d-8396cdaf94b1 req-c0bb770a-0b3f-4ee6-b652-1e3e1bc8070b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167ad713-e065-4761-8eea-f7b8d763c166", "name": "network-vif-plugged", "status": "completed", "tag": "b63dd528-bbfd-4f7d-95c8-ba7a7722e925"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:28.646077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d78bc922-7e11-4f01-946d-8396cdaf94b1 req-c0bb770a-0b3f-4ee6-b652-1e3e1bc8070b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:28.647167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d78bc922-7e11-4f01-946d-8396cdaf94b1 req-c0bb770a-0b3f-4ee6-b652-1e3e1bc8070b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:28.647894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d78bc922-7e11-4f01-946d-8396cdaf94b1 req-c0bb770a-0b3f-4ee6-b652-1e3e1bc8070b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:28.662557 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d78bc922-7e11-4f01-946d-8396cdaf94b1 req-c0bb770a-0b3f-4ee6-b652-1e3e1bc8070b service nova] Creating event network-vif-plugged:b63dd528-bbfd-4f7d-95c8-ba7a7722e925 for instance 167ad713-e065-4761-8eea-f7b8d763c166 on n-h2-845781-6 Aug 09 17:19:28.676626 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d78bc922-7e11-4f01-946d-8396cdaf94b1 req-c0bb770a-0b3f-4ee6-b652-1e3e1bc8070b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054239 Aug 09 17:19:28.678385 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1187/2485] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:28.695572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-02f4774a-c4ec-4aa6-b707-b3c000f12f83 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:28.696417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-02f4774a-c4ec-4aa6-b707-b3c000f12f83 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:28.704021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02f4774a-c4ec-4aa6-b707-b3c000f12f83 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:28.705740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02f4774a-c4ec-4aa6-b707-b3c000f12f83 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:28.712745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02f4774a-c4ec-4aa6-b707-b3c000f12f83 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:28.713862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02f4774a-c4ec-4aa6-b707-b3c000f12f83 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:28.714580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02f4774a-c4ec-4aa6-b707-b3c000f12f83 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:28.715027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02f4774a-c4ec-4aa6-b707-b3c000f12f83 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:29.686907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-02f4774a-c4ec-4aa6-b707-b3c000f12f83 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:29.722613 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-02f4774a-c4ec-4aa6-b707-b3c000f12f83 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1313 microversion: 2.1 time: 1.042650 Aug 09 17:19:29.725175 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1188/2486] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:28 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1313 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:29.739219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-768eefb0-10d5-4bc2-af5c-698ca055d307 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdca0aa60>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:29.874115 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-768eefb0-10d5-4bc2-af5c-698ca055d307 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 200 len: 1463 microversion: 2.1 time: 0.146627 Aug 09 17:19:29.883691 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1189/2487] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:29 2022] GET /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:29.894533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0b13e00a-2522-4772-856b-96555963abcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:29.898462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0b13e00a-2522-4772-856b-96555963abcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:29.918343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b13e00a-2522-4772-856b-96555963abcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:29.919791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b13e00a-2522-4772-856b-96555963abcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:29.920776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b13e00a-2522-4772-856b-96555963abcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:29.922268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b13e00a-2522-4772-856b-96555963abcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:29.923171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b13e00a-2522-4772-856b-96555963abcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:29.924936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b13e00a-2522-4772-856b-96555963abcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:30.214987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:19:30.215862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:19:30.216052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:19:30.216363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:19:30.216791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:19:30.250092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:30.251712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:30.252933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:30.254845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:30.257588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:30.258880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:30.316091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:19:30.330980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:19:30.386180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:19:30.394600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:19:30.566865 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-55d558e8-4c06-4cac-aa21-93117a4947c0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.741430 Aug 09 17:19:30.576325 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1299/2488] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:19:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:19:30.584608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3c77908-61a2-40bc-9441-892c85d0bf58 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:30.588814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c3c77908-61a2-40bc-9441-892c85d0bf58 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:30.604935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c77908-61a2-40bc-9441-892c85d0bf58 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:30.608070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c77908-61a2-40bc-9441-892c85d0bf58 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:30.608997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c77908-61a2-40bc-9441-892c85d0bf58 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:30.610338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c77908-61a2-40bc-9441-892c85d0bf58 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:30.611311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c77908-61a2-40bc-9441-892c85d0bf58 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:30.612444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3c77908-61a2-40bc-9441-892c85d0bf58 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:30.856272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0b13e00a-2522-4772-856b-96555963abcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:30.876443 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0b13e00a-2522-4772-856b-96555963abcc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1524 microversion: 2.1 time: 0.997514 Aug 09 17:19:30.879885 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1190/2489] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:29 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1524 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:30.889043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2ee73e17-018d-443d-add5-b19749177b51 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:30.889680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2ee73e17-018d-443d-add5-b19749177b51 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:30.918159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ee73e17-018d-443d-add5-b19749177b51 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:30.919989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ee73e17-018d-443d-add5-b19749177b51 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:30.922453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ee73e17-018d-443d-add5-b19749177b51 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:30.923309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ee73e17-018d-443d-add5-b19749177b51 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:30.927358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ee73e17-018d-443d-add5-b19749177b51 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:30.929287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ee73e17-018d-443d-add5-b19749177b51 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:31.764479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c3c77908-61a2-40bc-9441-892c85d0bf58 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:31.807258 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c3c77908-61a2-40bc-9441-892c85d0bf58 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1325 microversion: 2.1 time: 1.229194 Aug 09 17:19:31.814154 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1300/2490] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:30 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1325 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:31.837216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-db1a451f-7470-4ab6-af22-b0c164639ce8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:31.839334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-db1a451f-7470-4ab6-af22-b0c164639ce8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:31.876556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1a451f-7470-4ab6-af22-b0c164639ce8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:31.877042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1a451f-7470-4ab6-af22-b0c164639ce8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:31.877499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1a451f-7470-4ab6-af22-b0c164639ce8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:31.878529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1a451f-7470-4ab6-af22-b0c164639ce8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:31.891016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1a451f-7470-4ab6-af22-b0c164639ce8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:31.891778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db1a451f-7470-4ab6-af22-b0c164639ce8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:32.086777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2ee73e17-018d-443d-add5-b19749177b51 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9edfac84db3a4f748ac3aa28d35fa7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208b84af01f74102ace86c0501d7625d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:32.138876 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2ee73e17-018d-443d-add5-b19749177b51 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 200 len: 1325 microversion: 2.1 time: 1.257097 Aug 09 17:19:32.140803 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1191/2491] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:30 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 1325 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:32.165363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e39515e5-d016-419d-aeaa-b0933ddc9795 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:32.169443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e39515e5-d016-419d-aeaa-b0933ddc9795 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:32.197031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e39515e5-d016-419d-aeaa-b0933ddc9795 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:32.198898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e39515e5-d016-419d-aeaa-b0933ddc9795 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:32.199945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e39515e5-d016-419d-aeaa-b0933ddc9795 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:32.201362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e39515e5-d016-419d-aeaa-b0933ddc9795 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:32.202333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e39515e5-d016-419d-aeaa-b0933ddc9795 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:32.212819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e39515e5-d016-419d-aeaa-b0933ddc9795 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:32.501033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e39515e5-d016-419d-aeaa-b0933ddc9795 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:32.516359 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e39515e5-d016-419d-aeaa-b0933ddc9795 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1221 microversion: 2.1 time: 0.370845 Aug 09 17:19:32.517316 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1192/2492] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:32 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1221 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:32.541165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d055cbb-441a-45ad-992f-ec35076930df tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:32.544436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d055cbb-441a-45ad-992f-ec35076930df tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:32.558480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d055cbb-441a-45ad-992f-ec35076930df tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:32.562728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d055cbb-441a-45ad-992f-ec35076930df tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:32.565125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d055cbb-441a-45ad-992f-ec35076930df tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:32.567965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d055cbb-441a-45ad-992f-ec35076930df tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:32.570246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d055cbb-441a-45ad-992f-ec35076930df tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:32.572987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d055cbb-441a-45ad-992f-ec35076930df tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:33.042630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-db1a451f-7470-4ab6-af22-b0c164639ce8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:33.071915 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-db1a451f-7470-4ab6-af22-b0c164639ce8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991" status: 200 len: 1467 microversion: 2.1 time: 1.255755 Aug 09 17:19:33.073202 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1301/2493] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:31 2022] GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991 => generated 1467 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:33.078855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-17927319-3cc4-4c6d-a9c2-97f7c145ef54 req-79b7c80f-4292-49b6-b3aa-accfc6181fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86a49e6-8b69-4653-be51-46f86d343173", "name": "network-vif-plugged", "status": "completed", "tag": "5c77d2c9-8b84-4357-a134-aa90a6550da8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:33.103899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-17927319-3cc4-4c6d-a9c2-97f7c145ef54 req-79b7c80f-4292-49b6-b3aa-accfc6181fb9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:33.105823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-17927319-3cc4-4c6d-a9c2-97f7c145ef54 req-79b7c80f-4292-49b6-b3aa-accfc6181fb9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:33.112516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-17927319-3cc4-4c6d-a9c2-97f7c145ef54 req-79b7c80f-4292-49b6-b3aa-accfc6181fb9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:33.143897 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-17927319-3cc4-4c6d-a9c2-97f7c145ef54 req-79b7c80f-4292-49b6-b3aa-accfc6181fb9 service nova] Creating event network-vif-plugged:5c77d2c9-8b84-4357-a134-aa90a6550da8 for instance b86a49e6-8b69-4653-be51-46f86d343173 on n-h1-845781-6 Aug 09 17:19:33.151830 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-17927319-3cc4-4c6d-a9c2-97f7c145ef54 req-79b7c80f-4292-49b6-b3aa-accfc6181fb9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076719 Aug 09 17:19:33.152876 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1302/2494] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:33.168559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b913bc6b-436d-4205-817c-14d18429b558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:33.183353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b913bc6b-436d-4205-817c-14d18429b558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:33.205478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b913bc6b-436d-4205-817c-14d18429b558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:33.206587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b913bc6b-436d-4205-817c-14d18429b558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:33.207326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b913bc6b-436d-4205-817c-14d18429b558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:33.208429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b913bc6b-436d-4205-817c-14d18429b558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:33.209231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b913bc6b-436d-4205-817c-14d18429b558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:33.209921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b913bc6b-436d-4205-817c-14d18429b558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:33.519304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5d055cbb-441a-45ad-992f-ec35076930df tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:33.546423 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5d055cbb-441a-45ad-992f-ec35076930df tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1334 microversion: 2.1 time: 1.025601 Aug 09 17:19:33.547725 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1193/2495] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:32 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1334 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:33.557505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-76a3d03f-b438-49a1-825d-c5569e35504f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:33.558157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-76a3d03f-b438-49a1-825d-c5569e35504f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:33.578012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76a3d03f-b438-49a1-825d-c5569e35504f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:33.578693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76a3d03f-b438-49a1-825d-c5569e35504f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:33.579230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76a3d03f-b438-49a1-825d-c5569e35504f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:33.580086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76a3d03f-b438-49a1-825d-c5569e35504f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:33.580579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76a3d03f-b438-49a1-825d-c5569e35504f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:33.581026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76a3d03f-b438-49a1-825d-c5569e35504f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:34.141959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-76a3d03f-b438-49a1-825d-c5569e35504f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:34.169611 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-76a3d03f-b438-49a1-825d-c5569e35504f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1325 microversion: 2.1 time: 0.620312 Aug 09 17:19:34.170683 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1194/2496] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:33 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1325 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:34.189708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-353ea902-b116-4151-884f-dd5e9608ecdd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-365048154"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:34.194050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-353ea902-b116-4151-884f-dd5e9608ecdd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:34.221277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-353ea902-b116-4151-884f-dd5e9608ecdd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:34.223111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-353ea902-b116-4151-884f-dd5e9608ecdd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:34.224185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-353ea902-b116-4151-884f-dd5e9608ecdd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:34.226971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-353ea902-b116-4151-884f-dd5e9608ecdd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:34.227774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-353ea902-b116-4151-884f-dd5e9608ecdd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:34.228389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-353ea902-b116-4151-884f-dd5e9608ecdd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:34.358994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b913bc6b-436d-4205-817c-14d18429b558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:34.389797 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b913bc6b-436d-4205-817c-14d18429b558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1524 microversion: 2.1 time: 1.235301 Aug 09 17:19:34.391183 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1303/2497] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:33 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1524 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:34.396781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-402ca9fd-badd-4464-ae1c-06d4eb3f9dca tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:34.397843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-402ca9fd-badd-4464-ae1c-06d4eb3f9dca tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:34.426819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402ca9fd-badd-4464-ae1c-06d4eb3f9dca tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:34.428918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402ca9fd-badd-4464-ae1c-06d4eb3f9dca tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:34.432634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402ca9fd-badd-4464-ae1c-06d4eb3f9dca tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:34.434799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402ca9fd-badd-4464-ae1c-06d4eb3f9dca tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:34.439850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402ca9fd-badd-4464-ae1c-06d4eb3f9dca tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:34.441293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402ca9fd-badd-4464-ae1c-06d4eb3f9dca tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:34.885455 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-353ea902-b116-4151-884f-dd5e9608ecdd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "POST /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84/action" status: 202 len: 0 microversion: 2.1 time: 0.709152 Aug 09 17:19:34.888194 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1195/2498] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:19:34 2022] POST /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 17:19:34.900905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9cf0a2ff-62ec-49a0-8182-da17e3ff3a03 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:34.902613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9cf0a2ff-62ec-49a0-8182-da17e3ff3a03 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:34.921335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cf0a2ff-62ec-49a0-8182-da17e3ff3a03 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:34.922691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cf0a2ff-62ec-49a0-8182-da17e3ff3a03 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:34.926478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cf0a2ff-62ec-49a0-8182-da17e3ff3a03 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:34.934440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cf0a2ff-62ec-49a0-8182-da17e3ff3a03 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:34.937864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cf0a2ff-62ec-49a0-8182-da17e3ff3a03 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:34.939231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cf0a2ff-62ec-49a0-8182-da17e3ff3a03 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:35.010362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-402ca9fd-badd-4464-ae1c-06d4eb3f9dca tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9edfac84db3a4f748ac3aa28d35fa7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208b84af01f74102ace86c0501d7625d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:35.027346 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-402ca9fd-badd-4464-ae1c-06d4eb3f9dca tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 200 len: 1521 microversion: 2.1 time: 0.633732 Aug 09 17:19:35.028473 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1304/2499] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:34 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:35.046315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-90bf37c3-b4d3-488c-8b04-368d6fe00856 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:35.050379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-90bf37c3-b4d3-488c-8b04-368d6fe00856 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:35.067141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bf37c3-b4d3-488c-8b04-368d6fe00856 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:35.069440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bf37c3-b4d3-488c-8b04-368d6fe00856 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:35.070195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bf37c3-b4d3-488c-8b04-368d6fe00856 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:35.079746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bf37c3-b4d3-488c-8b04-368d6fe00856 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:35.080484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bf37c3-b4d3-488c-8b04-368d6fe00856 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:35.081601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bf37c3-b4d3-488c-8b04-368d6fe00856 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:35.450252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9cf0a2ff-62ec-49a0-8182-da17e3ff3a03 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:35.484840 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9cf0a2ff-62ec-49a0-8182-da17e3ff3a03 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1275 microversion: 2.1 time: 0.593052 Aug 09 17:19:35.486062 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1196/2500] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:34 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1275 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:35.527196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-c1e29e6b-0503-4439-a0a1-7fd2ba352422 req-a3bb1e2a-af05-447d-8514-f4e848e383dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aaa64ae-5ed0-4301-bee9-f70f7772e546", "tag": "f657f1de-3405-4d35-946d-8d8d4fc6c7f6"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:35.594889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c1e29e6b-0503-4439-a0a1-7fd2ba352422 req-a3bb1e2a-af05-447d-8514-f4e848e383dc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:35.595797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c1e29e6b-0503-4439-a0a1-7fd2ba352422 req-a3bb1e2a-af05-447d-8514-f4e848e383dc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:35.597240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c1e29e6b-0503-4439-a0a1-7fd2ba352422 req-a3bb1e2a-af05-447d-8514-f4e848e383dc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:35.618292 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-c1e29e6b-0503-4439-a0a1-7fd2ba352422 req-a3bb1e2a-af05-447d-8514-f4e848e383dc service nova] Creating event network-changed:f657f1de-3405-4d35-946d-8d8d4fc6c7f6 for instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 on n-h1-845781-6 Aug 09 17:19:35.641155 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-c1e29e6b-0503-4439-a0a1-7fd2ba352422 req-a3bb1e2a-af05-447d-8514-f4e848e383dc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147102 Aug 09 17:19:35.643551 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1197/2501] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:35.683756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-136304d5-1962-4785-8889-0db36ad5da42 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdca28940>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:35.840988 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-136304d5-1962-4785-8889-0db36ad5da42 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.193740 Aug 09 17:19:35.844527 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1198/2502] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:35 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:35.864389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:35.865928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:35.880351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:35.886316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:35.887358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:35.892079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:35.892991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:35.894812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:36.005414 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] HTTP exception thrown: Action 999 not found Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Request method failure captured: Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166/os-instance-actions/999 HTTP/1.1 Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pb_lmLWvIYHu-QKbpjiSYlnLO6mtZb-CX6bFz8rsGnjlRgrtzfWRrth74wzIE7bZdkv16m1xbbDqL4-X2vEZXA3FhyddkXxV2b8chGh5LO5rNLhsHqvUtH4hrdIFx124lNT2p40ZL0DD6yL3eFmuHZWpB5QJiVfodSLOEpboi4fcRw Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 208b84af01f74102ace86c0501d7625d Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-449802996 Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_208b84af01f74102ace86c0501d7625d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/208b84af01f74102ace86c0501d7625d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/208b84af01f74102ace86c0501d7625d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/208b84af01f74102ace86c0501d7625d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-449802996 Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 208b84af01f74102ace86c0501d7625d Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-449802996 Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-InstanceActionsNegativeTestJSON-449802996-project Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 9edfac84db3a4f748ac3aa28d35fa7b0 Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-449802996-project Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: exception: Action 999 not found Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'server_id': '167ad713-e065-4761-8eea-f7b8d763c166', 'id': '999'} Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 09 17:19:36.019672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:36.033219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Returning 404 to user: Action 999 not found {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:19:36.036129 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ee246b9e-92ec-43a2-8b83-1cd6a269efd1 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.186479 Aug 09 17:19:36.038159 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1199/2503] 10.222.0.93 () {58 vars in 1308 bytes} [Tue Aug 9 17:19:35 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166/os-instance-actions/999 => generated 66 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:19:36.053078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-63a15239-17e6-4828-a4e0-8f2dcf002917 req-507bf407-1604-49c1-82f5-b77c799c4220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce962b08-43de-4bff-a72a-1adcf330c991", "name": "network-vif-unplugged", "status": "completed", "tag": "b046df32-8645-4449-b41d-a48fe4b7136e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:36.075518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-63a15239-17e6-4828-a4e0-8f2dcf002917 req-507bf407-1604-49c1-82f5-b77c799c4220 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:36.077694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-63a15239-17e6-4828-a4e0-8f2dcf002917 req-507bf407-1604-49c1-82f5-b77c799c4220 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:36.080799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-63a15239-17e6-4828-a4e0-8f2dcf002917 req-507bf407-1604-49c1-82f5-b77c799c4220 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:36.108931 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-63a15239-17e6-4828-a4e0-8f2dcf002917 req-507bf407-1604-49c1-82f5-b77c799c4220 service nova] Creating event network-vif-unplugged:b046df32-8645-4449-b41d-a48fe4b7136e for instance ce962b08-43de-4bff-a72a-1adcf330c991 on n-h2-845781-6 Aug 09 17:19:36.124609 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-63a15239-17e6-4828-a4e0-8f2dcf002917 req-507bf407-1604-49c1-82f5-b77c799c4220 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083648 Aug 09 17:19:36.132194 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1200/2504] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:36.150331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d6f6c8d6-23ac-4799-b701-8abc51a7d8e5 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:36.156379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d6f6c8d6-23ac-4799-b701-8abc51a7d8e5 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:36.170618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6f6c8d6-23ac-4799-b701-8abc51a7d8e5 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:36.176122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6f6c8d6-23ac-4799-b701-8abc51a7d8e5 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:36.177052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6f6c8d6-23ac-4799-b701-8abc51a7d8e5 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:36.179132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6f6c8d6-23ac-4799-b701-8abc51a7d8e5 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:36.179924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6f6c8d6-23ac-4799-b701-8abc51a7d8e5 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:36.182642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6f6c8d6-23ac-4799-b701-8abc51a7d8e5 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:36.297691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-90bf37c3-b4d3-488c-8b04-368d6fe00856 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:36.370921 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-90bf37c3-b4d3-488c-8b04-368d6fe00856 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1334 microversion: 2.1 time: 1.332510 Aug 09 17:19:36.373244 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1305/2505] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:35 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1334 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:36.410841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a23f94aa-f916-4227-89d3-ea4ebdceb223 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:36.415786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a23f94aa-f916-4227-89d3-ea4ebdceb223 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:36.448940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a23f94aa-f916-4227-89d3-ea4ebdceb223 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:36.454547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a23f94aa-f916-4227-89d3-ea4ebdceb223 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:36.457133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a23f94aa-f916-4227-89d3-ea4ebdceb223 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:36.461504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a23f94aa-f916-4227-89d3-ea4ebdceb223 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:36.464808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a23f94aa-f916-4227-89d3-ea4ebdceb223 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:36.468075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a23f94aa-f916-4227-89d3-ea4ebdceb223 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:37.383606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a23f94aa-f916-4227-89d3-ea4ebdceb223 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:37.408001 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a23f94aa-f916-4227-89d3-ea4ebdceb223 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1524 microversion: 2.1 time: 1.031906 Aug 09 17:19:37.409948 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1306/2506] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:36 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1524 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:37.419050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4549483a-9ade-47a1-86b5-515c3b530159 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '.version_select at 0x7fbbcb5a99d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:37.420497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4549483a-9ade-47a1-86b5-515c3b530159 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 3eada652-ce41-41b5-9ad6-3f37574bbb1f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:37.431366 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-4549483a-9ade-47a1-86b5-515c3b530159 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] HTTP exception thrown: Instance 3eada652-ce41-41b5-9ad6-3f37574bbb1f could not be found. Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4549483a-9ade-47a1-86b5-515c3b530159 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Request method failure captured: Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/3eada652-ce41-41b5-9ad6-3f37574bbb1f/os-instance-actions HTTP/1.1 Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pb_lmLWvIYHu-QKbpjiSYlnLO6mtZb-CX6bFz8rsGnjlRgrtzfWRrth74wzIE7bZdkv16m1xbbDqL4-X2vEZXA3FhyddkXxV2b8chGh5LO5rNLhsHqvUtH4hrdIFx124lNT2p40ZL0DD6yL3eFmuHZWpB5QJiVfodSLOEpboi4fcRw Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 208b84af01f74102ace86c0501d7625d Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-449802996 Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_208b84af01f74102ace86c0501d7625d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/208b84af01f74102ace86c0501d7625d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/208b84af01f74102ace86c0501d7625d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/208b84af01f74102ace86c0501d7625d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-449802996 Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 208b84af01f74102ace86c0501d7625d Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-449802996 Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-InstanceActionsNegativeTestJSON-449802996-project Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9edfac84db3a4f748ac3aa28d35fa7b0 Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-449802996-project Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 3eada652-ce41-41b5-9ad6-3f37574bbb1f could not be found. Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': '3eada652-ce41-41b5-9ad6-3f37574bbb1f'} Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eada652-ce41-41b5-9ad6-3f37574bbb1f could not be found. Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:19:37.435589 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:19:37.441773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eada652-ce41-41b5-9ad6-3f37574bbb1f could not be found. Aug 09 17:19:37.441773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:37.441773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:37.441773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:37.441773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:37.441773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:37.441773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:37.441773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:19:37.441773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:19:37.441773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eada652-ce41-41b5-9ad6-3f37574bbb1f could not be found. Aug 09 17:19:37.441773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:37.446004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4549483a-9ade-47a1-86b5-515c3b530159 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Returning 404 to user: Instance 3eada652-ce41-41b5-9ad6-3f37574bbb1f could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:19:37.447826 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4549483a-9ade-47a1-86b5-515c3b530159 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/3eada652-ce41-41b5-9ad6-3f37574bbb1f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.035774 Aug 09 17:19:37.449556 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1307/2507] 10.222.0.93 () {58 vars in 1296 bytes} [Tue Aug 9 17:19:37 2022] GET /compute/v2.1/servers/3eada652-ce41-41b5-9ad6-3f37574bbb1f/os-instance-actions => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:19:37.459318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c9f54b32-b7d7-42e9-9d6c-ac92e38f4cd0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:37.461002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c9f54b32-b7d7-42e9-9d6c-ac92e38f4cd0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:37.473156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9f54b32-b7d7-42e9-9d6c-ac92e38f4cd0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:37.475076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9f54b32-b7d7-42e9-9d6c-ac92e38f4cd0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:37.476191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9f54b32-b7d7-42e9-9d6c-ac92e38f4cd0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:37.477765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9f54b32-b7d7-42e9-9d6c-ac92e38f4cd0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:37.478909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9f54b32-b7d7-42e9-9d6c-ac92e38f4cd0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:37.480177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9f54b32-b7d7-42e9-9d6c-ac92e38f4cd0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:38.120631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c9f54b32-b7d7-42e9-9d6c-ac92e38f4cd0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:38.132838 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c9f54b32-b7d7-42e9-9d6c-ac92e38f4cd0 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1317 microversion: 2.1 time: 0.680160 Aug 09 17:19:38.141464 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1308/2508] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:37 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1317 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:38.152989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-da1558e6-000d-433b-a06f-7f14830e8565 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb595940>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:38.300506 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-da1558e6-000d-433b-a06f-7f14830e8565 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.157158 Aug 09 17:19:38.301105 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1309/2509] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:38 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:38.336833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c7c0ed4-2eab-4463-9c4f-53e3c98f8b9a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:38.341044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c7c0ed4-2eab-4463-9c4f-53e3c98f8b9a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:38.354294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d6f6c8d6-23ac-4799-b701-8abc51a7d8e5 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:38.373260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c7c0ed4-2eab-4463-9c4f-53e3c98f8b9a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:38.374375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c7c0ed4-2eab-4463-9c4f-53e3c98f8b9a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:38.376211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c7c0ed4-2eab-4463-9c4f-53e3c98f8b9a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:38.376808 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d6f6c8d6-23ac-4799-b701-8abc51a7d8e5 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1522 microversion: 2.1 time: 2.239651 Aug 09 17:19:38.398047 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1201/2510] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:36 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1522 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:38.398475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c7c0ed4-2eab-4463-9c4f-53e3c98f8b9a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:38.403747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c7c0ed4-2eab-4463-9c4f-53e3c98f8b9a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:38.406202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c7c0ed4-2eab-4463-9c4f-53e3c98f8b9a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:38.414317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7d8fb143-58ec-46c1-8461-2130d68fbd6a tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:38.417117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7d8fb143-58ec-46c1-8461-2130d68fbd6a tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:38.435230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d8fb143-58ec-46c1-8461-2130d68fbd6a tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:38.438977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d8fb143-58ec-46c1-8461-2130d68fbd6a tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:38.440418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d8fb143-58ec-46c1-8461-2130d68fbd6a tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:38.446711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d8fb143-58ec-46c1-8461-2130d68fbd6a tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:38.447578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d8fb143-58ec-46c1-8461-2130d68fbd6a tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:38.448660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d8fb143-58ec-46c1-8461-2130d68fbd6a tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:38.503360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7d8fb143-58ec-46c1-8461-2130d68fbd6a tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:19:38.606534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:38.720912 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7d8fb143-58ec-46c1-8461-2130d68fbd6a tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "DELETE /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 204 len: 0 microversion: 2.1 time: 0.315476 Aug 09 17:19:38.733097 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1202/2511] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:19:38 2022] DELETE /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:19:38.744413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c4aeacb8-2f01-43e6-a02b-c86016308929 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:38.757503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c4aeacb8-2f01-43e6-a02b-c86016308929 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:38.777684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4aeacb8-2f01-43e6-a02b-c86016308929 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:38.779097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4aeacb8-2f01-43e6-a02b-c86016308929 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:38.780255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4aeacb8-2f01-43e6-a02b-c86016308929 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:38.781902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4aeacb8-2f01-43e6-a02b-c86016308929 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:38.792920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4aeacb8-2f01-43e6-a02b-c86016308929 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:38.794081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4aeacb8-2f01-43e6-a02b-c86016308929 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:39.714483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c7c0ed4-2eab-4463-9c4f-53e3c98f8b9a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:39.725341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c4aeacb8-2f01-43e6-a02b-c86016308929 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:39.735322 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c7c0ed4-2eab-4463-9c4f-53e3c98f8b9a tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1334 microversion: 2.1 time: 1.433027 Aug 09 17:19:39.735604 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c4aeacb8-2f01-43e6-a02b-c86016308929 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1522 microversion: 2.1 time: 1.000129 Aug 09 17:19:39.739365 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1310/2512] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:38 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1334 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:39.751000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5223db41-add4-4cbc-816f-4d3de256d558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:39.754557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5223db41-add4-4cbc-816f-4d3de256d558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:39.768914 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1203/2513] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:38 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1522 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:39.772047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5223db41-add4-4cbc-816f-4d3de256d558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:39.773271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5223db41-add4-4cbc-816f-4d3de256d558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:39.773981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5223db41-add4-4cbc-816f-4d3de256d558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:39.777999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5223db41-add4-4cbc-816f-4d3de256d558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:39.779883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5223db41-add4-4cbc-816f-4d3de256d558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:39.782192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5223db41-add4-4cbc-816f-4d3de256d558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:39.816656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b5c99333-de34-4616-a0ae-120f8b111c18 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:39.818553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b5c99333-de34-4616-a0ae-120f8b111c18 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:39.841674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c99333-de34-4616-a0ae-120f8b111c18 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:39.842593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c99333-de34-4616-a0ae-120f8b111c18 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:39.843794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c99333-de34-4616-a0ae-120f8b111c18 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:39.845399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c99333-de34-4616-a0ae-120f8b111c18 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:39.846842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c99333-de34-4616-a0ae-120f8b111c18 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:39.847915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5c99333-de34-4616-a0ae-120f8b111c18 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:40.290713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:40.323871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5223db41-add4-4cbc-816f-4d3de256d558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:40.336596 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5223db41-add4-4cbc-816f-4d3de256d558 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1524 microversion: 2.1 time: 0.594852 Aug 09 17:19:40.364334 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1311/2514] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:39 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1524 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:40.370024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fb72e5ab-d52a-4d23-b88f-15a588a6ae6d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:40.370246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fb72e5ab-d52a-4d23-b88f-15a588a6ae6d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:40.372145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:40.381660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb72e5ab-d52a-4d23-b88f-15a588a6ae6d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:40.382443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb72e5ab-d52a-4d23-b88f-15a588a6ae6d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:40.382896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb72e5ab-d52a-4d23-b88f-15a588a6ae6d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:40.383620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb72e5ab-d52a-4d23-b88f-15a588a6ae6d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:40.384113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb72e5ab-d52a-4d23-b88f-15a588a6ae6d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:40.384541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb72e5ab-d52a-4d23-b88f-15a588a6ae6d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:40.646655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b5c99333-de34-4616-a0ae-120f8b111c18 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9edfac84db3a4f748ac3aa28d35fa7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208b84af01f74102ace86c0501d7625d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:40.677454 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b5c99333-de34-4616-a0ae-120f8b111c18 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 200 len: 1527 microversion: 2.1 time: 0.873151 Aug 09 17:19:40.683042 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1204/2515] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:39 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 1527 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:40.709165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5adc4e5d-8811-4b7c-b12c-60d250f7b3c5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb6a0a60>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:40.856189 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5adc4e5d-8811-4b7c-b12c-60d250f7b3c5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.170216 Aug 09 17:19:40.883734 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1205/2516] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:40 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:40.912621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-191dc9d0-0ba4-4167-b703-8f6d6a6e9e51 req-7cf09430-6698-4f88-9725-13ab929b050d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e3e8f0-9f58-47fd-8000-d875529d0b84", "name": "network-vif-plugged", "status": "completed", "tag": "404b76c0-d83e-4f41-a30d-e7d27789aede"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:40.955595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-191dc9d0-0ba4-4167-b703-8f6d6a6e9e51 req-7cf09430-6698-4f88-9725-13ab929b050d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:40.956543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-191dc9d0-0ba4-4167-b703-8f6d6a6e9e51 req-7cf09430-6698-4f88-9725-13ab929b050d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:40.957342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-191dc9d0-0ba4-4167-b703-8f6d6a6e9e51 req-7cf09430-6698-4f88-9725-13ab929b050d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:41.011278 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-191dc9d0-0ba4-4167-b703-8f6d6a6e9e51 req-7cf09430-6698-4f88-9725-13ab929b050d service nova] Creating event network-vif-plugged:404b76c0-d83e-4f41-a30d-e7d27789aede for instance f7e3e8f0-9f58-47fd-8000-d875529d0b84 on n-h2-845781-6 Aug 09 17:19:41.030533 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-191dc9d0-0ba4-4167-b703-8f6d6a6e9e51 req-7cf09430-6698-4f88-9725-13ab929b050d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141644 Aug 09 17:19:41.042913 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1206/2517] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:41.068345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f9e279df-03fe-4038-9af8-8599d842ec63 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-934598573", "metadata": {"": ""}}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f9e279df-03fe-4038-9af8-8599d842ec63 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action HTTP/1.1 Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 106 Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-934598573", "metadata": {"": ""}}} Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'b86a49e6-8b69-4653-be51-46f86d343173', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-934598573', 'metadata': {'': ''}}}} Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'': ''} Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:19:41.078942 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:19:41.087952 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:41.094568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f9e279df-03fe-4038-9af8-8599d842ec63 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:19:41.094568 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f9e279df-03fe-4038-9af8-8599d842ec63 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action" status: 400 len: 170 microversion: 2.1 time: 0.043938 Aug 09 17:19:41.096299 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1207/2518] 10.222.0.93 () {60 vars in 1279 bytes} [Tue Aug 9 17:19:41 2022] POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action => generated 170 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:19:41.107213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c938a3e6-13cf-489a-84c8-67e1ddc79086 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:41.110682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c938a3e6-13cf-489a-84c8-67e1ddc79086 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:41.126752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c938a3e6-13cf-489a-84c8-67e1ddc79086 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:41.128915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c938a3e6-13cf-489a-84c8-67e1ddc79086 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:41.130666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c938a3e6-13cf-489a-84c8-67e1ddc79086 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:41.132325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c938a3e6-13cf-489a-84c8-67e1ddc79086 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:41.133435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c938a3e6-13cf-489a-84c8-67e1ddc79086 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:41.134492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c938a3e6-13cf-489a-84c8-67e1ddc79086 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:41.549505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fb72e5ab-d52a-4d23-b88f-15a588a6ae6d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:41.597014 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fb72e5ab-d52a-4d23-b88f-15a588a6ae6d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1317 microversion: 2.1 time: 1.231029 Aug 09 17:19:41.605302 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1312/2519] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:40 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1317 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:41.653217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-888e73f4-dccb-47c0-952a-86ba89a43dc4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:41.654381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-888e73f4-dccb-47c0-952a-86ba89a43dc4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:41.703842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888e73f4-dccb-47c0-952a-86ba89a43dc4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:41.705116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888e73f4-dccb-47c0-952a-86ba89a43dc4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:41.706329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888e73f4-dccb-47c0-952a-86ba89a43dc4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:41.707620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888e73f4-dccb-47c0-952a-86ba89a43dc4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:41.709302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888e73f4-dccb-47c0-952a-86ba89a43dc4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:41.709925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-888e73f4-dccb-47c0-952a-86ba89a43dc4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:41.779680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:42.236285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-888e73f4-dccb-47c0-952a-86ba89a43dc4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:42.269793 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-888e73f4-dccb-47c0-952a-86ba89a43dc4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1522 microversion: 2.1 time: 0.633350 Aug 09 17:19:42.280990 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1313/2520] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:41 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:42.300214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-126bd85b-0bcf-46f3-8c33-1f46fc8b5c0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:42.305105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-126bd85b-0bcf-46f3-8c33-1f46fc8b5c0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:42.328353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126bd85b-0bcf-46f3-8c33-1f46fc8b5c0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:42.330576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126bd85b-0bcf-46f3-8c33-1f46fc8b5c0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:42.331118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126bd85b-0bcf-46f3-8c33-1f46fc8b5c0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:42.334405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126bd85b-0bcf-46f3-8c33-1f46fc8b5c0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:42.336596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126bd85b-0bcf-46f3-8c33-1f46fc8b5c0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:42.336596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126bd85b-0bcf-46f3-8c33-1f46fc8b5c0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:42.559153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c938a3e6-13cf-489a-84c8-67e1ddc79086 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:42.569574 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c938a3e6-13cf-489a-84c8-67e1ddc79086 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1334 microversion: 2.1 time: 1.470587 Aug 09 17:19:42.570065 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1208/2521] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:41 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1334 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:42.618328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-40e789c2-e6cf-498a-884f-d3f838e1bc60 req-fde706b8-b2fd-43d8-b424-24cd23c4f9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aaa64ae-5ed0-4301-bee9-f70f7772e546", "tag": "87474140-ae76-4140-98d3-a76a90c5061d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:42.658440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-40e789c2-e6cf-498a-884f-d3f838e1bc60 req-fde706b8-b2fd-43d8-b424-24cd23c4f9b1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:42.659595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-40e789c2-e6cf-498a-884f-d3f838e1bc60 req-fde706b8-b2fd-43d8-b424-24cd23c4f9b1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:42.660253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-40e789c2-e6cf-498a-884f-d3f838e1bc60 req-fde706b8-b2fd-43d8-b424-24cd23c4f9b1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:42.675184 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-40e789c2-e6cf-498a-884f-d3f838e1bc60 req-fde706b8-b2fd-43d8-b424-24cd23c4f9b1 service nova] Creating event network-changed:87474140-ae76-4140-98d3-a76a90c5061d for instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 on n-h1-845781-6 Aug 09 17:19:42.683214 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-40e789c2-e6cf-498a-884f-d3f838e1bc60 req-fde706b8-b2fd-43d8-b424-24cd23c4f9b1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100966 Aug 09 17:19:42.697523 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1209/2522] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:42.725785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe94d0c1-ef30-40b0-ac68-15df220a58fe tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:42.732039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fe94d0c1-ef30-40b0-ac68-15df220a58fe tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:42.754712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe94d0c1-ef30-40b0-ac68-15df220a58fe tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:42.758432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe94d0c1-ef30-40b0-ac68-15df220a58fe tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:42.773936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe94d0c1-ef30-40b0-ac68-15df220a58fe tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:42.778618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe94d0c1-ef30-40b0-ac68-15df220a58fe tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:42.798257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe94d0c1-ef30-40b0-ac68-15df220a58fe tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:42.799775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe94d0c1-ef30-40b0-ac68-15df220a58fe tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:43.073807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-126bd85b-0bcf-46f3-8c33-1f46fc8b5c0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:43.106235 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-126bd85b-0bcf-46f3-8c33-1f46fc8b5c0b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1506 microversion: 2.1 time: 0.808319 Aug 09 17:19:43.107383 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1314/2523] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:42 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1506 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:43.128817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9222f960-9157-43d7-9ceb-2dc0ba0e428c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbd802f820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:43.329843 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9222f960-9157-43d7-9ceb-2dc0ba0e428c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.219984 Aug 09 17:19:43.344245 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1315/2524] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:43 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:43.357078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b792d83d-56ce-4002-b57d-7828b8ddff34 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:43.368192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b792d83d-56ce-4002-b57d-7828b8ddff34 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:43.382986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b792d83d-56ce-4002-b57d-7828b8ddff34 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:43.384274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b792d83d-56ce-4002-b57d-7828b8ddff34 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:43.385627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b792d83d-56ce-4002-b57d-7828b8ddff34 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:43.387297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b792d83d-56ce-4002-b57d-7828b8ddff34 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:43.388554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b792d83d-56ce-4002-b57d-7828b8ddff34 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:43.390391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b792d83d-56ce-4002-b57d-7828b8ddff34 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:43.447006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fe94d0c1-ef30-40b0-ac68-15df220a58fe tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9edfac84db3a4f748ac3aa28d35fa7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '208b84af01f74102ace86c0501d7625d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:43.469458 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fe94d0c1-ef30-40b0-ac68-15df220a58fe tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 200 len: 1485 microversion: 2.1 time: 0.770113 Aug 09 17:19:43.476124 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1210/2525] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:42 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 1485 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:43.524432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5a3f761c-16c4-48a3-b4cf-e95f1a16f04a req-995109fe-389e-491c-b3c4-f8a1ae980717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "904e2d62-61c5-4c4e-9acd-6948e6a21477", "tag": "aa19c029-4e59-4503-b436-ce642e4e3df4"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:43.584326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5a3f761c-16c4-48a3-b4cf-e95f1a16f04a req-995109fe-389e-491c-b3c4-f8a1ae980717 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:43.585390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5a3f761c-16c4-48a3-b4cf-e95f1a16f04a req-995109fe-389e-491c-b3c4-f8a1ae980717 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:43.585916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5a3f761c-16c4-48a3-b4cf-e95f1a16f04a req-995109fe-389e-491c-b3c4-f8a1ae980717 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:43.699306 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5a3f761c-16c4-48a3-b4cf-e95f1a16f04a req-995109fe-389e-491c-b3c4-f8a1ae980717 service nova] Creating event network-changed:aa19c029-4e59-4503-b436-ce642e4e3df4 for instance 904e2d62-61c5-4c4e-9acd-6948e6a21477 on n-h2-845781-6 Aug 09 17:19:43.763907 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5a3f761c-16c4-48a3-b4cf-e95f1a16f04a req-995109fe-389e-491c-b3c4-f8a1ae980717 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250606 Aug 09 17:19:43.765613 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1211/2526] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:43.790006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-54d1a54c-ba46-42be-af76-d2da1b6431d8 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:43.792217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-54d1a54c-ba46-42be-af76-d2da1b6431d8 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:43.829758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54d1a54c-ba46-42be-af76-d2da1b6431d8 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:43.839742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54d1a54c-ba46-42be-af76-d2da1b6431d8 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:43.841324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54d1a54c-ba46-42be-af76-d2da1b6431d8 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:43.843554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54d1a54c-ba46-42be-af76-d2da1b6431d8 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:43.850276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54d1a54c-ba46-42be-af76-d2da1b6431d8 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:43.851401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54d1a54c-ba46-42be-af76-d2da1b6431d8 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:44.505824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b792d83d-56ce-4002-b57d-7828b8ddff34 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:44.565830 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b792d83d-56ce-4002-b57d-7828b8ddff34 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1522 microversion: 2.1 time: 1.219593 Aug 09 17:19:44.571618 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1316/2527] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:43 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1522 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:44.582011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0f208f5e-c0e7-4629-9870-398204b877ce req-2c449a7b-3e6a-4a90-adb2-26528f08b72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32cf57c-7503-421c-a197-4a9f8cd925e0", "name": "network-vif-unplugged", "status": "completed", "tag": "d201dfe6-dd68-4013-8808-ca52e463bec5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:44.613442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f208f5e-c0e7-4629-9870-398204b877ce req-2c449a7b-3e6a-4a90-adb2-26528f08b72f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:44.615034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f208f5e-c0e7-4629-9870-398204b877ce req-2c449a7b-3e6a-4a90-adb2-26528f08b72f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:44.615676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f208f5e-c0e7-4629-9870-398204b877ce req-2c449a7b-3e6a-4a90-adb2-26528f08b72f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:44.654081 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0f208f5e-c0e7-4629-9870-398204b877ce req-2c449a7b-3e6a-4a90-adb2-26528f08b72f service nova] Creating event network-vif-unplugged:d201dfe6-dd68-4013-8808-ca52e463bec5 for instance e32cf57c-7503-421c-a197-4a9f8cd925e0 on n-h2-845781-6 Aug 09 17:19:44.672900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0f208f5e-c0e7-4629-9870-398204b877ce req-2c449a7b-3e6a-4a90-adb2-26528f08b72f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097724 Aug 09 17:19:44.675563 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1317/2528] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:44.688587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3a0ed40-bd01-4d6c-af7f-aad5ce2f7406 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:44.689579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3a0ed40-bd01-4d6c-af7f-aad5ce2f7406 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:44.716324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a0ed40-bd01-4d6c-af7f-aad5ce2f7406 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:44.720645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a0ed40-bd01-4d6c-af7f-aad5ce2f7406 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:44.721474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a0ed40-bd01-4d6c-af7f-aad5ce2f7406 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:44.723464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a0ed40-bd01-4d6c-af7f-aad5ce2f7406 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:44.729790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a0ed40-bd01-4d6c-af7f-aad5ce2f7406 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:44.730695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a0ed40-bd01-4d6c-af7f-aad5ce2f7406 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:44.912967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54d1a54c-ba46-42be-af76-d2da1b6431d8 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:44.950297 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-54d1a54c-ba46-42be-af76-d2da1b6431d8 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1317 microversion: 2.1 time: 1.179989 Aug 09 17:19:44.951534 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1212/2529] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:43 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1317 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:44.969871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-024ee087-8f69-4fda-ac5d-c643b91bfd49 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:44.971593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-024ee087-8f69-4fda-ac5d-c643b91bfd49 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:45.046524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-024ee087-8f69-4fda-ac5d-c643b91bfd49 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:45.049825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-024ee087-8f69-4fda-ac5d-c643b91bfd49 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:45.054841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-024ee087-8f69-4fda-ac5d-c643b91bfd49 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:45.061410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-024ee087-8f69-4fda-ac5d-c643b91bfd49 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:45.065112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-024ee087-8f69-4fda-ac5d-c643b91bfd49 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:45.074441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-024ee087-8f69-4fda-ac5d-c643b91bfd49 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:45.585914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-024ee087-8f69-4fda-ac5d-c643b91bfd49 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:45.620638 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-024ee087-8f69-4fda-ac5d-c643b91bfd49 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1506 microversion: 2.1 time: 0.666146 Aug 09 17:19:45.622329 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1213/2530] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:44 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1506 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:45.635931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fdd78bdb-faaa-4ce7-bd91-e8ce0fac6e72 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdca02700>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:45.700312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e3a0ed40-bd01-4d6c-af7f-aad5ce2f7406 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:45.715163 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3a0ed40-bd01-4d6c-af7f-aad5ce2f7406 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1334 microversion: 2.1 time: 1.038384 Aug 09 17:19:45.716627 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1318/2531] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:44 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1334 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:45.740830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:45.743573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] [instance: 167ad713-e065-4761-8eea-f7b8d763c166] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:45.767799 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fdd78bdb-faaa-4ce7-bd91-e8ce0fac6e72 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.143067 Aug 09 17:19:45.798897 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1214/2532] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:45 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:45.803456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:45.809541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:45.811071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-53d2e55d-ecd0-4b0d-99ce-392f7ab636a3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-89253800", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:45.813230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-53d2e55d-ecd0-4b0d-99ce-392f7ab636a3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action HTTP/1.1 Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 617 Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-89253800", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'b86a49e6-8b69-4653-be51-46f86d343173', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-89253800', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:19:45.819659 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:19:45.826010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.838045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-53d2e55d-ecd0-4b0d-99ce-392f7ab636a3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:19:45.838045 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-53d2e55d-ecd0-4b0d-99ce-392f7ab636a3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action" status: 400 len: 938 microversion: 2.1 time: 0.021493 Aug 09 17:19:45.838045 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1215/2533] 10.222.0.93 () {60 vars in 1279 bytes} [Tue Aug 9 17:19:45 2022] POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action => generated 938 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:19:45.838494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:45.838494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:45.840007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:45.842177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-030dddcb-2fe9-4d26-b12c-96cc061e29ca req-3c46b124-d28e-4ccb-bb11-d897d512c74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167ad713-e065-4761-8eea-f7b8d763c166", "name": "network-vif-deleted", "tag": "b63dd528-bbfd-4f7d-95c8-ba7a7722e925"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:45.866037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-030dddcb-2fe9-4d26-b12c-96cc061e29ca req-3c46b124-d28e-4ccb-bb11-d897d512c74b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:45.867177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-030dddcb-2fe9-4d26-b12c-96cc061e29ca req-3c46b124-d28e-4ccb-bb11-d897d512c74b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:45.868785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-030dddcb-2fe9-4d26-b12c-96cc061e29ca req-3c46b124-d28e-4ccb-bb11-d897d512c74b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:45.892086 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] HTTP exception thrown: Instance 167ad713-e065-4761-8eea-f7b8d763c166 could not be found. Aug 09 17:19:45.896547 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-030dddcb-2fe9-4d26-b12c-96cc061e29ca req-3c46b124-d28e-4ccb-bb11-d897d512c74b service nova] Creating event network-vif-deleted:b63dd528-bbfd-4f7d-95c8-ba7a7722e925 for instance 167ad713-e065-4761-8eea-f7b8d763c166 on n-h2-845781-6 Aug 09 17:19:45.905677 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-030dddcb-2fe9-4d26-b12c-96cc061e29ca req-3c46b124-d28e-4ccb-bb11-d897d512c74b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074610 Aug 09 17:19:45.907688 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1216/2534] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Request method failure captured: Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 HTTP/1.1 Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pb_lmLWvIYHu-QKbpjiSYlnLO6mtZb-CX6bFz8rsGnjlRgrtzfWRrth74wzIE7bZdkv16m1xbbDqL4-X2vEZXA3FhyddkXxV2b8chGh5LO5rNLhsHqvUtH4hrdIFx124lNT2p40ZL0DD6yL3eFmuHZWpB5QJiVfodSLOEpboi4fcRw Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 208b84af01f74102ace86c0501d7625d Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-449802996 Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_208b84af01f74102ace86c0501d7625d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/208b84af01f74102ace86c0501d7625d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/208b84af01f74102ace86c0501d7625d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/208b84af01f74102ace86c0501d7625d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-449802996 Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 208b84af01f74102ace86c0501d7625d Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-449802996 Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-InstanceActionsNegativeTestJSON-449802996-project Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9edfac84db3a4f748ac3aa28d35fa7b0 Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-449802996-project Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 167ad713-e065-4761-8eea-f7b8d763c166 could not be found. Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '167ad713-e065-4761-8eea-f7b8d763c166'} Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 167ad713-e065-4761-8eea-f7b8d763c166 could not be found. Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 167ad713-e065-4761-8eea-f7b8d763c166 could not be found. Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.910790 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:45.925630 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.925630 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:45.925630 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:45.925630 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:45.925630 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:19:45.925630 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:19:45.925630 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 167ad713-e065-4761-8eea-f7b8d763c166 could not be found. Aug 09 17:19:45.925630 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:45.927895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-96f45706-312e-4666-8b0b-75edb6713724 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:45.927895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-96f45706-312e-4666-8b0b-75edb6713724 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:45.928975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] Returning 404 to user: Instance 167ad713-e065-4761-8eea-f7b8d763c166 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:19:45.932099 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cc7a270d-9407-4ec1-863c-00d75852fe55 tempest-InstanceActionsNegativeTestJSON-449802996 tempest-InstanceActionsNegativeTestJSON-449802996-project] 10.222.0.93 "GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166" status: 404 len: 111 microversion: 2.1 time: 0.203432 Aug 09 17:19:45.933845 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1319/2535] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:45 2022] GET /compute/v2.1/servers/167ad713-e065-4761-8eea-f7b8d763c166 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:19:45.955242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96f45706-312e-4666-8b0b-75edb6713724 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:45.956424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96f45706-312e-4666-8b0b-75edb6713724 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:45.957235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96f45706-312e-4666-8b0b-75edb6713724 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:45.959103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96f45706-312e-4666-8b0b-75edb6713724 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:45.959972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96f45706-312e-4666-8b0b-75edb6713724 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:45.961681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96f45706-312e-4666-8b0b-75edb6713724 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:45.992054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ffaad4a0-cb33-4d34-b417-841c3e4b8950 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:46.000713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ffaad4a0-cb33-4d34-b417-841c3e4b8950 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:46.015834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffaad4a0-cb33-4d34-b417-841c3e4b8950 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:46.018887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffaad4a0-cb33-4d34-b417-841c3e4b8950 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:46.019564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffaad4a0-cb33-4d34-b417-841c3e4b8950 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:46.021276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffaad4a0-cb33-4d34-b417-841c3e4b8950 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:46.022018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffaad4a0-cb33-4d34-b417-841c3e4b8950 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:46.022625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffaad4a0-cb33-4d34-b417-841c3e4b8950 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:46.415617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ffaad4a0-cb33-4d34-b417-841c3e4b8950 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:46.428834 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ffaad4a0-cb33-4d34-b417-841c3e4b8950 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1317 microversion: 2.1 time: 0.445621 Aug 09 17:19:46.444566 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1320/2536] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:45 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:19:46.652876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3050bd6f-edc1-4ca1-870a-61dc8dd18fdf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:46.653786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3050bd6f-edc1-4ca1-870a-61dc8dd18fdf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:46.668635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3050bd6f-edc1-4ca1-870a-61dc8dd18fdf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:46.669642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3050bd6f-edc1-4ca1-870a-61dc8dd18fdf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:46.671470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3050bd6f-edc1-4ca1-870a-61dc8dd18fdf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:46.672570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3050bd6f-edc1-4ca1-870a-61dc8dd18fdf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:46.673225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3050bd6f-edc1-4ca1-870a-61dc8dd18fdf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:46.673821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3050bd6f-edc1-4ca1-870a-61dc8dd18fdf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:47.270484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3050bd6f-edc1-4ca1-870a-61dc8dd18fdf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:47.290147 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3050bd6f-edc1-4ca1-870a-61dc8dd18fdf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1506 microversion: 2.1 time: 0.641138 Aug 09 17:19:47.291580 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1321/2537] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:46 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:19:47.302518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a54c6956-aafc-48df-937c-2ad8c705dbbc tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:47.306131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a54c6956-aafc-48df-937c-2ad8c705dbbc tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:47.323536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54c6956-aafc-48df-937c-2ad8c705dbbc tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:47.324511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54c6956-aafc-48df-937c-2ad8c705dbbc tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:47.325193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54c6956-aafc-48df-937c-2ad8c705dbbc tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:47.326183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54c6956-aafc-48df-937c-2ad8c705dbbc tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:47.329257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54c6956-aafc-48df-937c-2ad8c705dbbc tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:47.331087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-96f45706-312e-4666-8b0b-75edb6713724 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:47.332481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54c6956-aafc-48df-937c-2ad8c705dbbc tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:47.365494 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-96f45706-312e-4666-8b0b-75edb6713724 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1522 microversion: 2.1 time: 1.454763 Aug 09 17:19:47.385456 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1217/2538] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:45 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1522 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:47.428728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8bd91851-3cd3-489e-8d7f-bdbf439e5d38 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb72a040>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:47.574728 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8bd91851-3cd3-489e-8d7f-bdbf439e5d38 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.186753 Aug 09 17:19:47.576371 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1218/2539] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:47 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:47.628797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7d6696b8-03fe-4e91-b510-60abcd395d1e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:47.633261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7d6696b8-03fe-4e91-b510-60abcd395d1e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:47.650181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d6696b8-03fe-4e91-b510-60abcd395d1e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:47.651870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d6696b8-03fe-4e91-b510-60abcd395d1e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:47.653130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d6696b8-03fe-4e91-b510-60abcd395d1e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:47.654844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d6696b8-03fe-4e91-b510-60abcd395d1e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:47.656157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d6696b8-03fe-4e91-b510-60abcd395d1e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:47.657283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d6696b8-03fe-4e91-b510-60abcd395d1e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:47.783974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a54c6956-aafc-48df-937c-2ad8c705dbbc tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:47.794905 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a54c6956-aafc-48df-937c-2ad8c705dbbc tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1334 microversion: 2.1 time: 0.501850 Aug 09 17:19:47.799495 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1322/2540] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:47 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1334 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:47.824084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-17a53239-2300-4a96-82ba-4c5ef53933f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:47.824984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17a53239-2300-4a96-82ba-4c5ef53933f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:47.840743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17a53239-2300-4a96-82ba-4c5ef53933f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:47.845505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17a53239-2300-4a96-82ba-4c5ef53933f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:47.846326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17a53239-2300-4a96-82ba-4c5ef53933f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:47.847265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17a53239-2300-4a96-82ba-4c5ef53933f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:47.847946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17a53239-2300-4a96-82ba-4c5ef53933f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:47.848550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17a53239-2300-4a96-82ba-4c5ef53933f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:48.502531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-17a53239-2300-4a96-82ba-4c5ef53933f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:48.538643 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-17a53239-2300-4a96-82ba-4c5ef53933f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1317 microversion: 2.1 time: 0.732056 Aug 09 17:19:48.540989 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1323/2541] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:47 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1317 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:48.678194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-297910474", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ef63e606-3da4-438b-bad5-b9eb71acc47a"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:48.792584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7d6696b8-03fe-4e91-b510-60abcd395d1e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:48.810648 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7d6696b8-03fe-4e91-b510-60abcd395d1e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1522 microversion: 2.1 time: 1.198149 Aug 09 17:19:48.811330 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1219/2542] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:47 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1522 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:48.832445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-be5579e9-f0ef-4e48-a355-511b6e20814a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:48.836372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-be5579e9-f0ef-4e48-a355-511b6e20814a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:48.868156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be5579e9-f0ef-4e48-a355-511b6e20814a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:48.872476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be5579e9-f0ef-4e48-a355-511b6e20814a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:48.878478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be5579e9-f0ef-4e48-a355-511b6e20814a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:48.885103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be5579e9-f0ef-4e48-a355-511b6e20814a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:48.888207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be5579e9-f0ef-4e48-a355-511b6e20814a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:48.889015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be5579e9-f0ef-4e48-a355-511b6e20814a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:48.936601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] validate_networks() for [('ef63e606-3da4-438b-bad5-b9eb71acc47a', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:19:49.438179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-be5579e9-f0ef-4e48-a355-511b6e20814a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:49.456237 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-be5579e9-f0ef-4e48-a355-511b6e20814a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 200 len: 1449 microversion: 2.1 time: 0.643612 Aug 09 17:19:49.478846 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1220/2543] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:48 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 1449 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:49.478846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad34c984-9ecd-4320-9f34-875d655761d6 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcbcca670>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:49.663296 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad34c984-9ecd-4320-9f34-875d655761d6 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.204309 Aug 09 17:19:49.683069 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1221/2544] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:49 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:49.696747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3adceda2-71c3-4e2f-97df-291cb5adaa2e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:49.698672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3adceda2-71c3-4e2f-97df-291cb5adaa2e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:49.710853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:49.714839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3adceda2-71c3-4e2f-97df-291cb5adaa2e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:49.716473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3adceda2-71c3-4e2f-97df-291cb5adaa2e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:49.717792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3adceda2-71c3-4e2f-97df-291cb5adaa2e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:49.720718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3adceda2-71c3-4e2f-97df-291cb5adaa2e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:49.722349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3adceda2-71c3-4e2f-97df-291cb5adaa2e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:49.723676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3adceda2-71c3-4e2f-97df-291cb5adaa2e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:50.053848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:19:50.054485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:19:50.055477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:19:50.056195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:19:50.056924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:19:50.088195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:50.089073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:50.089899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:50.091964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:50.093749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:50.094841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:50.136883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Getting quotas for project 6137919ddef74e62ab6b7d51fe88ffa3. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:19:50.154481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Getting quotas for user 91c9d7a5f9e244a5b9da869293512785 and project 6137919ddef74e62ab6b7d51fe88ffa3. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:19:50.193116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:19:50.199502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:19:50.343677 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b3bc99ad-6c9e-41cc-8572-0043479d2695 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.791260 Aug 09 17:19:50.346115 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1324/2545] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:19:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1804 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:19:50.368539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38ee76a0-e3eb-4251-91af-5c49a0e82d06 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38ee76a0-e3eb-4251-91af-5c49a0e82d06 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action HTTP/1.1 Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 285 Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b86a49e6-8b69-4653-be51-46f86d343173', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:50.382151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:19:50.388602 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:50.403747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38ee76a0-e3eb-4251-91af-5c49a0e82d06 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:19:50.405537 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-38ee76a0-e3eb-4251-91af-5c49a0e82d06 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action" status: 400 len: 619 microversion: 2.1 time: 0.057525 Aug 09 17:19:50.415927 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1325/2546] 10.222.0.93 () {60 vars in 1279 bytes} [Tue Aug 9 17:19:50 2022] POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action => generated 619 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:19:50.439899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:50.441273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:50.475155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:50.480257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:50.485482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:50.487173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:50.490170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:50.491067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:50.601822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:19:50.616783 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.compute.api [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Working on deleting snapshot 213f2ff3-83b5-4b7b-abbf-c01f869e588c from shelved instance... Aug 09 17:19:52.364515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Doing local delete in cell 64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) {{(pid=119431) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 09 17:19:52.367782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:52.372409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:52.375216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:52.376484 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.compute.api [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 09 17:19:52.402010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] deallocate_for_instance() {{(pid=119431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 09 17:19:52.454797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3adceda2-71c3-4e2f-97df-291cb5adaa2e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:52.500171 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3adceda2-71c3-4e2f-97df-291cb5adaa2e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1334 microversion: 2.1 time: 2.813008 Aug 09 17:19:52.505835 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1222/2547] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:49 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1334 bytes in 2821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:52.528918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-94c54293-cfe1-41b7-b6ea-57c0e8f8ef19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:52.534481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-94c54293-cfe1-41b7-b6ea-57c0e8f8ef19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:52.579456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94c54293-cfe1-41b7-b6ea-57c0e8f8ef19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:52.581788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94c54293-cfe1-41b7-b6ea-57c0e8f8ef19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:52.585093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94c54293-cfe1-41b7-b6ea-57c0e8f8ef19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:52.592045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94c54293-cfe1-41b7-b6ea-57c0e8f8ef19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:52.593916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94c54293-cfe1-41b7-b6ea-57c0e8f8ef19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:52.597666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94c54293-cfe1-41b7-b6ea-57c0e8f8ef19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:53.168490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-94c54293-cfe1-41b7-b6ea-57c0e8f8ef19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:53.192865 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-94c54293-cfe1-41b7-b6ea-57c0e8f8ef19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1317 microversion: 2.1 time: 0.682059 Aug 09 17:19:53.214699 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1223/2548] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:52 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1317 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:53.231891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:53.233851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:53.246594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:53.248221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:53.249400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:53.251285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:53.252550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:53.253671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:53.527096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:53.560629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:53.563865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:53.566661 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6967fd7d-b8fa-4a7d-9dee-520ba9dc2430 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1316 microversion: 2.21 time: 0.350714 Aug 09 17:19:53.594474 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1224/2549] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:19:53 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:19:53.609778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7c21879b-d10c-4795-acd2-751be2f79e29 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:53.611322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7c21879b-d10c-4795-acd2-751be2f79e29 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:53.625691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c21879b-d10c-4795-acd2-751be2f79e29 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:53.627192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c21879b-d10c-4795-acd2-751be2f79e29 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:53.628349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c21879b-d10c-4795-acd2-751be2f79e29 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:53.630078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c21879b-d10c-4795-acd2-751be2f79e29 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:53.631165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c21879b-d10c-4795-acd2-751be2f79e29 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:53.632219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c21879b-d10c-4795-acd2-751be2f79e29 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:54.464309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7c21879b-d10c-4795-acd2-751be2f79e29 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:54.517129 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7c21879b-d10c-4795-acd2-751be2f79e29 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1522 microversion: 2.1 time: 0.920347 Aug 09 17:19:54.573844 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1225/2550] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:53 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1522 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:54.603579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7aec177b-8f27-4973-99a4-c4edfeb19b85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc9e6a60>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:54.857663 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7aec177b-8f27-4973-99a4-c4edfeb19b85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.267583 Aug 09 17:19:54.886047 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1226/2551] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:54 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:54.913043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-17c54a51-8236-44e9-a46e-51b39cc7f5e9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:54.914865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-17c54a51-8236-44e9-a46e-51b39cc7f5e9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:54.936458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17c54a51-8236-44e9-a46e-51b39cc7f5e9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:54.938487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17c54a51-8236-44e9-a46e-51b39cc7f5e9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:54.940279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17c54a51-8236-44e9-a46e-51b39cc7f5e9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:54.942027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17c54a51-8236-44e9-a46e-51b39cc7f5e9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:54.943230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17c54a51-8236-44e9-a46e-51b39cc7f5e9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:54.944333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17c54a51-8236-44e9-a46e-51b39cc7f5e9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:54.989736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Updating instance_info_cache with network_info: [] {{(pid=119431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:19:55.841884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-17c54a51-8236-44e9-a46e-51b39cc7f5e9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:55.874449 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-17c54a51-8236-44e9-a46e-51b39cc7f5e9 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1334 microversion: 2.1 time: 0.985509 Aug 09 17:19:55.879595 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1227/2552] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:54 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1334 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:55.890734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e04d44a-c387-44f0-94bb-aba8035e8469 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:55.893059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2e04d44a-c387-44f0-94bb-aba8035e8469 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:55.932738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e04d44a-c387-44f0-94bb-aba8035e8469 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:55.944699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e04d44a-c387-44f0-94bb-aba8035e8469 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:55.945984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e04d44a-c387-44f0-94bb-aba8035e8469 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:55.948494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e04d44a-c387-44f0-94bb-aba8035e8469 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:55.950439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e04d44a-c387-44f0-94bb-aba8035e8469 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:55.951594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e04d44a-c387-44f0-94bb-aba8035e8469 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:56.325516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:56.927158 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7245eb8b-4401-478b-b5a3-a5f7da394973 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 204 len: 0 microversion: 2.1 time: 6.510264 Aug 09 17:19:56.932662 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1326/2553] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:19:50 2022] DELETE /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 0 bytes in 6520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:19:56.961516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6a7adb56-fb1a-4841-b572-f911a7447ddb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:56.962753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6a7adb56-fb1a-4841-b572-f911a7447ddb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:56.995678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a7adb56-fb1a-4841-b572-f911a7447ddb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:56.996562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a7adb56-fb1a-4841-b572-f911a7447ddb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:56.997295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a7adb56-fb1a-4841-b572-f911a7447ddb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:57.004950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a7adb56-fb1a-4841-b572-f911a7447ddb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:57.005809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a7adb56-fb1a-4841-b572-f911a7447ddb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:57.006604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a7adb56-fb1a-4841-b572-f911a7447ddb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:57.414547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6a7adb56-fb1a-4841-b572-f911a7447ddb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:57.424578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:57.444698 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6a7adb56-fb1a-4841-b572-f911a7447ddb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1522 microversion: 2.1 time: 0.506890 Aug 09 17:19:57.446684 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1327/2554] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:56 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:57.524180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:57.525234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:57.532799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2e04d44a-c387-44f0-94bb-aba8035e8469 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:57.539723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:19:57.581758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:57.590369 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2e04d44a-c387-44f0-94bb-aba8035e8469 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1317 microversion: 2.1 time: 1.703640 Aug 09 17:19:57.591601 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1228/2555] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:55 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1317 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:57.594084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:57.594932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:57.598517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:57.606490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:57.625482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:57.643022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-90735bed-06b6-447f-9b13-9f44b09c935a req-9c2658da-17eb-4dc5-84bf-0d33bc42bd63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaa64ae-5ed0-4301-bee9-f70f7772e546", "name": "network-vif-plugged", "status": "completed", "tag": "87474140-ae76-4140-98d3-a76a90c5061d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:57.733799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-90735bed-06b6-447f-9b13-9f44b09c935a req-9c2658da-17eb-4dc5-84bf-0d33bc42bd63 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:57.734415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-90735bed-06b6-447f-9b13-9f44b09c935a req-9c2658da-17eb-4dc5-84bf-0d33bc42bd63 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:57.736385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-90735bed-06b6-447f-9b13-9f44b09c935a req-9c2658da-17eb-4dc5-84bf-0d33bc42bd63 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:57.785119 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-90735bed-06b6-447f-9b13-9f44b09c935a req-9c2658da-17eb-4dc5-84bf-0d33bc42bd63 service nova] Creating event network-vif-plugged:87474140-ae76-4140-98d3-a76a90c5061d for instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 on n-h1-845781-6 Aug 09 17:19:57.820576 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-90735bed-06b6-447f-9b13-9f44b09c935a req-9c2658da-17eb-4dc5-84bf-0d33bc42bd63 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215639 Aug 09 17:19:57.824296 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1229/2556] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:19:57.836223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-4f2dfafe-411b-44fe-81c1-cbf902b22db7 req-dff5cb2c-309a-48de-9c44-c446170c9bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32cf57c-7503-421c-a197-4a9f8cd925e0", "name": "network-vif-deleted", "tag": "d201dfe6-dd68-4013-8808-ca52e463bec5"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:57.872971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4f2dfafe-411b-44fe-81c1-cbf902b22db7 req-dff5cb2c-309a-48de-9c44-c446170c9bd4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:57.875456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4f2dfafe-411b-44fe-81c1-cbf902b22db7 req-dff5cb2c-309a-48de-9c44-c446170c9bd4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:57.876270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4f2dfafe-411b-44fe-81c1-cbf902b22db7 req-dff5cb2c-309a-48de-9c44-c446170c9bd4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:57.918478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.compute.server_external_events [req-4f2dfafe-411b-44fe-81c1-cbf902b22db7 req-dff5cb2c-309a-48de-9c44-c446170c9bd4 service nova] Unable to find a host for instance e32cf57c-7503-421c-a197-4a9f8cd925e0. Dropping event network-vif-deleted {{(pid=119432) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 17:19:57.919428 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-4f2dfafe-411b-44fe-81c1-cbf902b22db7 req-dff5cb2c-309a-48de-9c44-c446170c9bd4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.093824 Aug 09 17:19:57.926685 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1230/2557] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 101 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 17:19:57.938587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ee70b86e-6bf1-437d-9cee-af6c5ffc123f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc9e6a60>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:58.168903 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ee70b86e-6bf1-437d-9cee-af6c5ffc123f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.239385 Aug 09 17:19:58.171312 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1231/2558] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:19:57 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:58.189115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-589882a5-02f3-4ca6-a68a-fa545b05cba7 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:58.191177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-589882a5-02f3-4ca6-a68a-fa545b05cba7 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:58.215191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-589882a5-02f3-4ca6-a68a-fa545b05cba7 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:58.216064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-589882a5-02f3-4ca6-a68a-fa545b05cba7 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:58.216712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-589882a5-02f3-4ca6-a68a-fa545b05cba7 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:58.217645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-589882a5-02f3-4ca6-a68a-fa545b05cba7 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:58.218313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-589882a5-02f3-4ca6-a68a-fa545b05cba7 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:58.218970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-589882a5-02f3-4ca6-a68a-fa545b05cba7 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:58.340372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:58.351264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:58.353453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:58.355339 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-395c3673-2b72-406d-a446-c38786bbff4a tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1358 microversion: 2.21 time: 0.872771 Aug 09 17:19:58.356505 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1328/2559] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:19:57 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1358 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:19:58.362816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:58.364736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:58.372109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:58.372895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:58.373767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:58.374639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:58.375251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:58.375893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:58.415709 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 HTTP/1.1 Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'e32cf57c-7503-421c-a197-4a9f8cd925e0'} Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:19:58.424412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:58.433462 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:19:58.433462 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:19:58.433462 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:19:58.433462 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:19:58.433462 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:19:58.433462 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:19:58.433462 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:19:58.436047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:19:58.442470 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3c0be810-ca1e-4cec-a6d5-6f219054ba0d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 404 len: 111 microversion: 2.1 time: 0.083937 Aug 09 17:19:58.443932 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1329/2560] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:58 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:19:58.502274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bb989a47-52ae-403b-884d-56bb141b24e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-187920991"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:58.512189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bb989a47-52ae-403b-884d-56bb141b24e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:58.536692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb989a47-52ae-403b-884d-56bb141b24e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:58.537958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb989a47-52ae-403b-884d-56bb141b24e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:58.545223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb989a47-52ae-403b-884d-56bb141b24e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:58.547109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb989a47-52ae-403b-884d-56bb141b24e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:58.548139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb989a47-52ae-403b-884d-56bb141b24e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:58.549040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb989a47-52ae-403b-884d-56bb141b24e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:59.272951 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bb989a47-52ae-403b-884d-56bb141b24e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action" status: 202 len: 0 microversion: 2.1 time: 0.806543 Aug 09 17:19:59.277488 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1330/2561] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:19:58 2022] POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action => generated 0 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 17:19:59.313301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-35c81741-cdcd-4f12-a5a6-b62e9f94526c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:19:59.318428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-35c81741-cdcd-4f12-a5a6-b62e9f94526c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:19:59.353002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c81741-cdcd-4f12-a5a6-b62e9f94526c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:59.356765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c81741-cdcd-4f12-a5a6-b62e9f94526c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:59.358506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c81741-cdcd-4f12-a5a6-b62e9f94526c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:59.360131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c81741-cdcd-4f12-a5a6-b62e9f94526c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:19:59.363220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c81741-cdcd-4f12-a5a6-b62e9f94526c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:19:59.366899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c81741-cdcd-4f12-a5a6-b62e9f94526c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:19:59.392838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-589882a5-02f3-4ca6-a68a-fa545b05cba7 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:19:59.440004 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-589882a5-02f3-4ca6-a68a-fa545b05cba7 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1334 microversion: 2.1 time: 1.266573 Aug 09 17:19:59.469369 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1232/2562] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:58 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1334 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:19:59.520437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1951752794", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ad48ae09-8243-461d-b010-943470de6d49"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:19:59.849979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] validate_networks() for [('ad48ae09-8243-461d-b010-943470de6d49', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:20:00.116430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:00.143887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-35c81741-cdcd-4f12-a5a6-b62e9f94526c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:00.175066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:00.194795 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-35c81741-cdcd-4f12-a5a6-b62e9f94526c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1317 microversion: 2.1 time: 0.909702 Aug 09 17:20:00.244498 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1331/2563] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:19:59 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1317 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:00.267530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8bf20b59-484b-4fd7-9c8b-599b9e174580 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb8bb160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:00.436913 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8bf20b59-484b-4fd7-9c8b-599b9e174580 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.190132 Aug 09 17:20:00.456200 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1332/2564] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:00 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:00.467906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-493255335"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:00.484754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:00.498605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:00.500113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:00.501161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:00.502380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:00.503928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:00.505695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:00.591420 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] HTTP exception thrown: Cannot 'createImage' instance b86a49e6-8b69-4653-be51-46f86d343173 while it is in task_state image_snapshot Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action HTTP/1.1 Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 84 Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-493255335"}} Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: exception: Cannot 'createImage' instance b86a49e6-8b69-4653-be51-46f86d343173 while it is in task_state image_snapshot Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b86a49e6-8b69-4653-be51-46f86d343173', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-493255335'}}} Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b86a49e6-8b69-4653-be51-46f86d343173 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:20:00.595956 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance b86a49e6-8b69-4653-be51-46f86d343173 while it is in task_state image_snapshot Aug 09 17:20:00.606201 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:00.606201 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:00.606201 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:00.606201 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:00.606201 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:00.606201 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:00.606201 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:20:00.606201 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:20:00.606201 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance b86a49e6-8b69-4653-be51-46f86d343173 while it is in task_state image_snapshot Aug 09 17:20:00.606201 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:00.612613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 409 to user: Cannot 'createImage' instance b86a49e6-8b69-4653-be51-46f86d343173 while it is in task_state image_snapshot {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:20:00.614898 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c84204ee-593c-421f-8feb-e3da03290374 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action" status: 409 len: 159 microversion: 2.1 time: 0.155548 Aug 09 17:20:00.622176 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1333/2565] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:20:00 2022] POST /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173/action => generated 159 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:20:00.632441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:00.634332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:00.648883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:00.650377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:00.651689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:00.654191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:00.655476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:00.656979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:01.063661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:01.073076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:01.075823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:01.079578 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51f5e48f-b58b-448f-9249-987470a650c6 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1358 microversion: 2.21 time: 0.455223 Aug 09 17:20:01.084864 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1334/2566] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:00 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1358 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:01.093921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6e744898-907d-4383-822c-4cb081d91ea4 req-f9466b9e-1ed1-4004-aa95-65f604f609de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904e2d62-61c5-4c4e-9acd-6948e6a21477", "name": "network-vif-plugged", "status": "completed", "tag": "aa19c029-4e59-4503-b436-ce642e4e3df4"}, {"server_uuid": "4aaa64ae-5ed0-4301-bee9-f70f7772e546", "name": "network-vif-plugged", "status": "completed", "tag": "f657f1de-3405-4d35-946d-8d8d4fc6c7f6"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:01.121846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6e744898-907d-4383-822c-4cb081d91ea4 req-f9466b9e-1ed1-4004-aa95-65f604f609de service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:01.122573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6e744898-907d-4383-822c-4cb081d91ea4 req-f9466b9e-1ed1-4004-aa95-65f604f609de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:01.122970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6e744898-907d-4383-822c-4cb081d91ea4 req-f9466b9e-1ed1-4004-aa95-65f604f609de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:01.144301 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6e744898-907d-4383-822c-4cb081d91ea4 req-f9466b9e-1ed1-4004-aa95-65f604f609de service nova] Creating event network-vif-plugged:aa19c029-4e59-4503-b436-ce642e4e3df4 for instance 904e2d62-61c5-4c4e-9acd-6948e6a21477 on n-h2-845781-6 Aug 09 17:20:01.145631 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6e744898-907d-4383-822c-4cb081d91ea4 req-f9466b9e-1ed1-4004-aa95-65f604f609de service nova] Creating event network-vif-plugged:f657f1de-3405-4d35-946d-8d8d4fc6c7f6 for instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 on n-h1-845781-6 Aug 09 17:20:01.179195 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6e744898-907d-4383-822c-4cb081d91ea4 req-f9466b9e-1ed1-4004-aa95-65f604f609de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092672 Aug 09 17:20:01.190933 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1335/2567] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:01.210120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1f9dcbb0-63a5-4710-aef7-3ff75de5f400 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:01.211196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1f9dcbb0-63a5-4710-aef7-3ff75de5f400 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:01.230114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbb0-63a5-4710-aef7-3ff75de5f400 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:01.232302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbb0-63a5-4710-aef7-3ff75de5f400 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:01.234523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbb0-63a5-4710-aef7-3ff75de5f400 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:01.239184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbb0-63a5-4710-aef7-3ff75de5f400 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:01.240362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbb0-63a5-4710-aef7-3ff75de5f400 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:01.244417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f9dcbb0-63a5-4710-aef7-3ff75de5f400 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:01.965702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1f9dcbb0-63a5-4710-aef7-3ff75de5f400 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:02.002971 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1f9dcbb0-63a5-4710-aef7-3ff75de5f400 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1334 microversion: 2.1 time: 0.804523 Aug 09 17:20:02.023517 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1336/2568] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:01 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1334 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:02.055560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b725d44-bf30-4323-bc8c-ab90c78ec612 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '.version_select at 0x7fbbcb667820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:02.465719 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b725d44-bf30-4323-bc8c-ab90c78ec612 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "DELETE /compute/v2.1/images/e0f272f1-f7b8-4b6e-894a-095e9fbddce7" status: 204 len: 0 microversion: 2.1 time: 0.420375 Aug 09 17:20:02.468838 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1337/2569] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:02 2022] DELETE /compute/v2.1/images/e0f272f1-f7b8-4b6e-894a-095e9fbddce7 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:20:02.490907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0506b96b-4a3e-4f0d-b153-0e6ae89023d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:02.492171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0506b96b-4a3e-4f0d-b153-0e6ae89023d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:02.517045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0506b96b-4a3e-4f0d-b153-0e6ae89023d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:02.523707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0506b96b-4a3e-4f0d-b153-0e6ae89023d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:02.525062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0506b96b-4a3e-4f0d-b153-0e6ae89023d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:02.526729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0506b96b-4a3e-4f0d-b153-0e6ae89023d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:02.527914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0506b96b-4a3e-4f0d-b153-0e6ae89023d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:02.529569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0506b96b-4a3e-4f0d-b153-0e6ae89023d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:02.592236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:20:02.593101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:20:02.593311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:20:02.593542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:20:02.594139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:20:02.618625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:02.619398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:02.620073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:02.621011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:02.621651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:02.622252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:02.663008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:02.681385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for user d8e1dc1f64fe429ea6a8c746b7c84ae6 and project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:02.742806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:20:02.749060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:20:02.881231 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad61ee1f-a2e6-46cb-956d-ef387b2938a4 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.408931 Aug 09 17:20:02.882978 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1233/2570] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:19:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:20:02.893007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ee69a84-76ab-480e-a992-47fc4296c622 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb609f70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:03.102351 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3ee69a84-76ab-480e-a992-47fc4296c622 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.216305 Aug 09 17:20:03.103553 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1234/2571] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:02 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:03.123592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:03.125621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:03.147052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:03.148222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:03.150709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:03.152109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:03.153254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:03.154010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:03.187151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0506b96b-4a3e-4f0d-b153-0e6ae89023d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:03.239558 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0506b96b-4a3e-4f0d-b153-0e6ae89023d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1317 microversion: 2.1 time: 0.759316 Aug 09 17:20:03.242363 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1338/2572] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:02 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:03.313445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dee09b1e-9762-4d38-a975-4ac4f1ae4bbd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:03.314812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dee09b1e-9762-4d38-a975-4ac4f1ae4bbd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:03.370194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee09b1e-9762-4d38-a975-4ac4f1ae4bbd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:03.371079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee09b1e-9762-4d38-a975-4ac4f1ae4bbd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:03.371886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee09b1e-9762-4d38-a975-4ac4f1ae4bbd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:03.373156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee09b1e-9762-4d38-a975-4ac4f1ae4bbd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:03.373996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee09b1e-9762-4d38-a975-4ac4f1ae4bbd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:03.375103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee09b1e-9762-4d38-a975-4ac4f1ae4bbd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:03.875426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dee09b1e-9762-4d38-a975-4ac4f1ae4bbd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:03.886496 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dee09b1e-9762-4d38-a975-4ac4f1ae4bbd tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1540 microversion: 2.1 time: 0.626538 Aug 09 17:20:03.910948 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1339/2573] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:03 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1540 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:03.917408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f4e82f5f-69ba-4447-b366-52bfaf7563b5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:03.931979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f4e82f5f-69ba-4447-b366-52bfaf7563b5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:04.136867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f4e82f5f-69ba-4447-b366-52bfaf7563b5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:04.162662 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f4e82f5f-69ba-4447-b366-52bfaf7563b5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1215 microversion: 2.1 time: 0.249891 Aug 09 17:20:04.176579 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1340/2574] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:03 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1215 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:04.195218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67f5032d-6183-4600-b964-d6c38331de5f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:04.196425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-67f5032d-6183-4600-b964-d6c38331de5f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:04.222297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f5032d-6183-4600-b964-d6c38331de5f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:04.223768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f5032d-6183-4600-b964-d6c38331de5f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:04.224567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f5032d-6183-4600-b964-d6c38331de5f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:04.225872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f5032d-6183-4600-b964-d6c38331de5f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:04.231456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f5032d-6183-4600-b964-d6c38331de5f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:04.237882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f5032d-6183-4600-b964-d6c38331de5f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:04.433359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:04.446186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:04.461696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:04.463550 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a5694b97-0613-4220-8006-3ad9d56146ef tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1358 microversion: 2.21 time: 1.355253 Aug 09 17:20:04.479456 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1235/2575] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:03 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1358 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:04.484839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-f3ad4cdf-86e0-4b48-b7d2-249ba2f5e380 req-e4b9709c-10fd-48da-9377-f804dcfa0985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2c581b0-1246-4911-8650-449bb2b20fcf", "tag": "0fc0fd65-e9ed-4af2-8304-75321477d374"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:04.510707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f3ad4cdf-86e0-4b48-b7d2-249ba2f5e380 req-e4b9709c-10fd-48da-9377-f804dcfa0985 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:04.511574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f3ad4cdf-86e0-4b48-b7d2-249ba2f5e380 req-e4b9709c-10fd-48da-9377-f804dcfa0985 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:04.512231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f3ad4cdf-86e0-4b48-b7d2-249ba2f5e380 req-e4b9709c-10fd-48da-9377-f804dcfa0985 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:04.535123 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-f3ad4cdf-86e0-4b48-b7d2-249ba2f5e380 req-e4b9709c-10fd-48da-9377-f804dcfa0985 service nova] Creating event network-changed:0fc0fd65-e9ed-4af2-8304-75321477d374 for instance c2c581b0-1246-4911-8650-449bb2b20fcf on n-h2-845781-6 Aug 09 17:20:04.552607 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-f3ad4cdf-86e0-4b48-b7d2-249ba2f5e380 req-e4b9709c-10fd-48da-9377-f804dcfa0985 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068388 Aug 09 17:20:04.555717 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1236/2576] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:04.568125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7317e95a-3777-4b38-a6ea-d6d4f47b7b9f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb6a0820>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:04.670026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-67f5032d-6183-4600-b964-d6c38331de5f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:04.689272 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-67f5032d-6183-4600-b964-d6c38331de5f tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1669 microversion: 2.1 time: 0.510615 Aug 09 17:20:04.705125 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1341/2577] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:04 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1669 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:04.739442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a18ae339-64bf-490b-83a1-662bee189fca tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:04.740975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a18ae339-64bf-490b-83a1-662bee189fca tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:04.754436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18ae339-64bf-490b-83a1-662bee189fca tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:04.756677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18ae339-64bf-490b-83a1-662bee189fca tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:04.758430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18ae339-64bf-490b-83a1-662bee189fca tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:04.760208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18ae339-64bf-490b-83a1-662bee189fca tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:04.762691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18ae339-64bf-490b-83a1-662bee189fca tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:04.763529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a18ae339-64bf-490b-83a1-662bee189fca tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:04.773138 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7317e95a-3777-4b38-a6ea-d6d4f47b7b9f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.215829 Aug 09 17:20:04.779087 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1237/2578] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:04 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:04.786349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d6403eec-c612-47f2-b550-c7adac793385 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:04.792733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d6403eec-c612-47f2-b550-c7adac793385 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:04.814827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6403eec-c612-47f2-b550-c7adac793385 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:04.815839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6403eec-c612-47f2-b550-c7adac793385 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:04.816571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6403eec-c612-47f2-b550-c7adac793385 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:04.817655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6403eec-c612-47f2-b550-c7adac793385 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:04.818374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6403eec-c612-47f2-b550-c7adac793385 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:04.819039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6403eec-c612-47f2-b550-c7adac793385 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:04.881499 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d6403eec-c612-47f2-b550-c7adac793385 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546/ips" status: 200 len: 179 microversion: 2.1 time: 0.100718 Aug 09 17:20:04.882911 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1238/2579] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:20:04 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546/ips => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:04.902760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ebfdb6bb-c0aa-4c0e-96c3-f2462978fa9e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:04.906448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ebfdb6bb-c0aa-4c0e-96c3-f2462978fa9e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:04.939707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebfdb6bb-c0aa-4c0e-96c3-f2462978fa9e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:04.942932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebfdb6bb-c0aa-4c0e-96c3-f2462978fa9e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:04.944173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebfdb6bb-c0aa-4c0e-96c3-f2462978fa9e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:04.945913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebfdb6bb-c0aa-4c0e-96c3-f2462978fa9e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:04.947143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebfdb6bb-c0aa-4c0e-96c3-f2462978fa9e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:04.948318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebfdb6bb-c0aa-4c0e-96c3-f2462978fa9e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:05.061461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ebfdb6bb-c0aa-4c0e-96c3-f2462978fa9e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:20:05.135693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a18ae339-64bf-490b-83a1-662bee189fca tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:05.149362 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a18ae339-64bf-490b-83a1-662bee189fca tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1466 microversion: 2.1 time: 0.442173 Aug 09 17:20:05.152531 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1342/2580] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:04 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1466 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:05.157827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-288dcd01-57cf-42c4-8469-0d01e0343066 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:05.159280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-288dcd01-57cf-42c4-8469-0d01e0343066 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:05.167559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288dcd01-57cf-42c4-8469-0d01e0343066 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:05.168114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288dcd01-57cf-42c4-8469-0d01e0343066 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:05.169459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288dcd01-57cf-42c4-8469-0d01e0343066 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:05.170073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288dcd01-57cf-42c4-8469-0d01e0343066 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:05.170840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288dcd01-57cf-42c4-8469-0d01e0343066 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:05.171344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288dcd01-57cf-42c4-8469-0d01e0343066 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:05.385341 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ebfdb6bb-c0aa-4c0e-96c3-f2462978fa9e tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 204 len: 0 microversion: 2.1 time: 0.489187 Aug 09 17:20:05.396868 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1239/2581] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:20:04 2022] DELETE /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:20:05.407374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4d6e7582-3ef0-4efe-b98d-b2098849fc25 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:05.417216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4d6e7582-3ef0-4efe-b98d-b2098849fc25 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:05.442240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d6e7582-3ef0-4efe-b98d-b2098849fc25 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:05.444757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d6e7582-3ef0-4efe-b98d-b2098849fc25 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:05.445938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d6e7582-3ef0-4efe-b98d-b2098849fc25 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:05.453644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d6e7582-3ef0-4efe-b98d-b2098849fc25 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:05.455027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d6e7582-3ef0-4efe-b98d-b2098849fc25 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:05.456251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d6e7582-3ef0-4efe-b98d-b2098849fc25 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:05.514949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-288dcd01-57cf-42c4-8469-0d01e0343066 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:05.527088 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-288dcd01-57cf-42c4-8469-0d01e0343066 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1522 microversion: 2.1 time: 0.373550 Aug 09 17:20:05.528422 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1343/2582] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:05 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:05.804949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4d6e7582-3ef0-4efe-b98d-b2098849fc25 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:05.816509 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4d6e7582-3ef0-4efe-b98d-b2098849fc25 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1267 microversion: 2.1 time: 0.414567 Aug 09 17:20:05.818015 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1240/2583] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:05 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1267 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:05.831920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e0c6377-109d-424c-94ed-0d8eba993618 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:05.833470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0e0c6377-109d-424c-94ed-0d8eba993618 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:05.851199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0c6377-109d-424c-94ed-0d8eba993618 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:05.852094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0c6377-109d-424c-94ed-0d8eba993618 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:05.852732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0c6377-109d-424c-94ed-0d8eba993618 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:05.853663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0c6377-109d-424c-94ed-0d8eba993618 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:05.854334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0c6377-109d-424c-94ed-0d8eba993618 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:05.857775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0c6377-109d-424c-94ed-0d8eba993618 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:05.949084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0ad29092-59b1-4ea2-a33a-68fc06d5161e tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:05.950659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0ad29092-59b1-4ea2-a33a-68fc06d5161e tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:05.975252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ad29092-59b1-4ea2-a33a-68fc06d5161e tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:05.978700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ad29092-59b1-4ea2-a33a-68fc06d5161e tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:05.979924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ad29092-59b1-4ea2-a33a-68fc06d5161e tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:05.982093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ad29092-59b1-4ea2-a33a-68fc06d5161e tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:05.985337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ad29092-59b1-4ea2-a33a-68fc06d5161e tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:05.986622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0ad29092-59b1-4ea2-a33a-68fc06d5161e tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:06.693216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0e0c6377-109d-424c-94ed-0d8eba993618 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:06.713266 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e0c6377-109d-424c-94ed-0d8eba993618 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1675 microversion: 2.1 time: 0.885054 Aug 09 17:20:06.738111 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1241/2584] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:05 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1675 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:06.758637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:06.762329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:06.789656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:06.809705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:06.811571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:06.813116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:06.814646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:06.815778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:07.314231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:07.342223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:07.350269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:07.361540 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4ef333c3-c721-46da-9464-6fef86f5147f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1358 microversion: 2.21 time: 0.616570 Aug 09 17:20:07.398043 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1242/2585] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:06 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1358 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:07.422932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e20bf382-db57-40af-bb74-ec589c5da9be tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:07.424401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e20bf382-db57-40af-bb74-ec589c5da9be tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:07.442061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e20bf382-db57-40af-bb74-ec589c5da9be tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:07.442948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e20bf382-db57-40af-bb74-ec589c5da9be tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:07.443864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e20bf382-db57-40af-bb74-ec589c5da9be tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:07.445718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e20bf382-db57-40af-bb74-ec589c5da9be tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:07.447651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e20bf382-db57-40af-bb74-ec589c5da9be tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:07.448703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e20bf382-db57-40af-bb74-ec589c5da9be tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:07.525576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e20bf382-db57-40af-bb74-ec589c5da9be tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:20:07.932151 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e20bf382-db57-40af-bb74-ec589c5da9be tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 204 len: 0 microversion: 2.1 time: 0.529204 Aug 09 17:20:07.937172 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1243/2586] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:20:07 2022] DELETE /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:20:07.960025 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0ad29092-59b1-4ea2-a33a-68fc06d5161e tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1617 microversion: 2.1 time: 2.429211 Aug 09 17:20:07.964433 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1344/2587] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:05 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1617 bytes in 2435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:07.968574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-63d6f545-08b5-4aae-a36b-0ff0e5485834 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc9abca0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:07.987939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d97a76ef-491a-4530-843c-65d165006007 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:07.991029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d97a76ef-491a-4530-843c-65d165006007 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:08.023705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d97a76ef-491a-4530-843c-65d165006007 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:08.024578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d97a76ef-491a-4530-843c-65d165006007 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:08.025370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d97a76ef-491a-4530-843c-65d165006007 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:08.026639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d97a76ef-491a-4530-843c-65d165006007 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:08.027466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d97a76ef-491a-4530-843c-65d165006007 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:08.036015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d97a76ef-491a-4530-843c-65d165006007 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:08.111295 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-63d6f545-08b5-4aae-a36b-0ff0e5485834 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.166947 Aug 09 17:20:08.125457 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1244/2588] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:07 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:08.136388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-cadaf448-ac63-498a-b16c-98be1d48efc9 req-66c9db34-b9f7-4b9f-91bc-5f42ee940b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86a49e6-8b69-4653-be51-46f86d343173", "name": "network-vif-plugged", "status": "completed", "tag": "5c77d2c9-8b84-4357-a134-aa90a6550da8"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:08.157312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cadaf448-ac63-498a-b16c-98be1d48efc9 req-66c9db34-b9f7-4b9f-91bc-5f42ee940b2d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:08.158183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cadaf448-ac63-498a-b16c-98be1d48efc9 req-66c9db34-b9f7-4b9f-91bc-5f42ee940b2d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:08.158981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cadaf448-ac63-498a-b16c-98be1d48efc9 req-66c9db34-b9f7-4b9f-91bc-5f42ee940b2d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:08.187739 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-cadaf448-ac63-498a-b16c-98be1d48efc9 req-66c9db34-b9f7-4b9f-91bc-5f42ee940b2d service nova] Creating event network-vif-plugged:5c77d2c9-8b84-4357-a134-aa90a6550da8 for instance b86a49e6-8b69-4653-be51-46f86d343173 on n-h1-845781-6 Aug 09 17:20:08.201601 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-cadaf448-ac63-498a-b16c-98be1d48efc9 req-66c9db34-b9f7-4b9f-91bc-5f42ee940b2d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073533 Aug 09 17:20:08.203763 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1245/2589] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:08.218613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b4e45f33-2fd1-4b94-adbc-893858cc0047 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:08.221667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b4e45f33-2fd1-4b94-adbc-893858cc0047 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:08.236271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e45f33-2fd1-4b94-adbc-893858cc0047 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:08.240646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e45f33-2fd1-4b94-adbc-893858cc0047 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:08.241598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e45f33-2fd1-4b94-adbc-893858cc0047 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:08.243083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e45f33-2fd1-4b94-adbc-893858cc0047 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:08.244194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e45f33-2fd1-4b94-adbc-893858cc0047 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:08.245295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e45f33-2fd1-4b94-adbc-893858cc0047 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:08.638690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d97a76ef-491a-4530-843c-65d165006007 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:08.675551 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d97a76ef-491a-4530-843c-65d165006007 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1273 microversion: 2.1 time: 0.704488 Aug 09 17:20:08.678722 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1345/2590] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:07 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1273 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:08.700431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-73a85ee9-f573-48e3-8567-8e29c182d7ed tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:08.705454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-73a85ee9-f573-48e3-8567-8e29c182d7ed tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:08.745914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73a85ee9-f573-48e3-8567-8e29c182d7ed tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:08.748720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73a85ee9-f573-48e3-8567-8e29c182d7ed tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:08.755031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73a85ee9-f573-48e3-8567-8e29c182d7ed tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:08.758073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73a85ee9-f573-48e3-8567-8e29c182d7ed tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:08.761267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73a85ee9-f573-48e3-8567-8e29c182d7ed tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:08.762793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73a85ee9-f573-48e3-8567-8e29c182d7ed tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:09.128481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b4e45f33-2fd1-4b94-adbc-893858cc0047 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:09.154629 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b4e45f33-2fd1-4b94-adbc-893858cc0047 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1675 microversion: 2.1 time: 0.947688 Aug 09 17:20:09.155998 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1246/2591] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:08 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1675 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:09.191944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ce451e54-7c04-4ae4-9c67-dc6d3d13d70b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Action: 'create', calling method: .version_select at 0x7fbbcb72aca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-39905153", "policies": ["affinity"]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:09.233848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ce451e54-7c04-4ae4-9c67-dc6d3d13d70b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:09.247505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ce451e54-7c04-4ae4-9c67-dc6d3d13d70b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:09.382174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ce451e54-7c04-4ae4-9c67-dc6d3d13d70b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:09.405800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ce451e54-7c04-4ae4-9c67-dc6d3d13d70b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:09.453070 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ce451e54-7c04-4ae4-9c67-dc6d3d13d70b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.274987 Aug 09 17:20:09.455849 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1247/2592] 10.222.0.93 () {60 vars in 1174 bytes} [Tue Aug 9 17:20:09 2022] POST /compute/v2.1/os-server-groups => generated 186 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:09.468353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:09.471235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:09.515296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:09.519235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:09.524440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:09.528021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:09.529592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:09.535310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:10.195305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-73a85ee9-f573-48e3-8567-8e29c182d7ed tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:10.217673 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-73a85ee9-f573-48e3-8567-8e29c182d7ed tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1528 microversion: 2.1 time: 1.536594 Aug 09 17:20:10.218681 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1346/2593] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:08 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1528 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:10.237011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8ee22ad0-ffad-4352-9b56-6cbeab600eb4 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcbae9430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:10.248611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:10.263301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:10.266596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:10.270441 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-79e179a2-1b24-4f9e-9ed7-fe90ef4754e1 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1358 microversion: 2.21 time: 0.812712 Aug 09 17:20:10.272914 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1248/2594] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:09 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1358 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:10.282238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4706d752-4856-4ead-9744-f2042fa98646 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:10.283219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4706d752-4856-4ead-9744-f2042fa98646 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:10.308269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4706d752-4856-4ead-9744-f2042fa98646 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:10.309069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4706d752-4856-4ead-9744-f2042fa98646 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:10.309726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4706d752-4856-4ead-9744-f2042fa98646 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:10.310708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4706d752-4856-4ead-9744-f2042fa98646 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:10.311380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4706d752-4856-4ead-9744-f2042fa98646 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:10.312018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4706d752-4856-4ead-9744-f2042fa98646 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:10.388201 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8ee22ad0-ffad-4352-9b56-6cbeab600eb4 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1454 microversion: 2.1 time: 0.158340 Aug 09 17:20:10.390034 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1347/2595] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:10 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:10.408363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-219037518", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f3a5d9e9-a7ab-40c2-bcbb-f0a61872b2ae"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:10.550561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4706d752-4856-4ead-9744-f2042fa98646 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:10.560592 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4706d752-4856-4ead-9744-f2042fa98646 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1273 microversion: 2.1 time: 0.286226 Aug 09 17:20:10.575407 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1249/2596] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:10 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:10.581380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-18dfa5b9-fe69-40be-a55f-ee2aa485f443 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:10.582869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-18dfa5b9-fe69-40be-a55f-ee2aa485f443 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:10.607726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:20:10.617612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18dfa5b9-fe69-40be-a55f-ee2aa485f443 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:10.619532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18dfa5b9-fe69-40be-a55f-ee2aa485f443 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:10.620286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18dfa5b9-fe69-40be-a55f-ee2aa485f443 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:10.621396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18dfa5b9-fe69-40be-a55f-ee2aa485f443 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:10.622176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18dfa5b9-fe69-40be-a55f-ee2aa485f443 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:10.622863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18dfa5b9-fe69-40be-a55f-ee2aa485f443 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:11.134331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-18dfa5b9-fe69-40be-a55f-ee2aa485f443 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:11.147597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:11.151554 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-18dfa5b9-fe69-40be-a55f-ee2aa485f443 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1675 microversion: 2.1 time: 0.574570 Aug 09 17:20:11.155560 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1250/2597] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:10 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1675 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:11.245681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3998d26f-a389-4219-a963-e8e821a3e8c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:11.247756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3998d26f-a389-4219-a963-e8e821a3e8c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:11.260809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:11.263356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3998d26f-a389-4219-a963-e8e821a3e8c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:11.274221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3998d26f-a389-4219-a963-e8e821a3e8c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:11.275067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3998d26f-a389-4219-a963-e8e821a3e8c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:11.276088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3998d26f-a389-4219-a963-e8e821a3e8c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:11.276771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3998d26f-a389-4219-a963-e8e821a3e8c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:11.277996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3998d26f-a389-4219-a963-e8e821a3e8c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:11.872642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3998d26f-a389-4219-a963-e8e821a3e8c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:11.893586 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3998d26f-a389-4219-a963-e8e821a3e8c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 200 len: 1528 microversion: 2.1 time: 0.651437 Aug 09 17:20:11.904908 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1251/2598] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:11 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 1528 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:20:11.932560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:11.935084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:11.949864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:11.951026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:11.952071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:11.953544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:11.964608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:11.965546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:12.316947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:20:12.318066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:20:12.318561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:20:12.318971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:20:12.319587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:20:12.351963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:12.352762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:12.353426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:12.354699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:12.355360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:12.355997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:12.381178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:12.393477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:12.418872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Going to run 2 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:20:12.423260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ec097021-2408-4328-b677-266d832bd565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:20:12.520379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119431) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 09 17:20:12.539429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:12.549657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:12.551432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:12.560909 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2fcaca88-21a8-48c6-9b7a-969d970d33bb tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1358 microversion: 2.21 time: 0.653244 Aug 09 17:20:12.561472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:12.577034 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1252/2599] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:11 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1358 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:12.577034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1d3b62cc-1054-483f-844f-cf9c316d0ad1 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc8c4c10>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:12.594412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:12.633287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:12.675191 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1d3b62cc-1054-483f-844f-cf9c316d0ad1 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1463 microversion: 2.1 time: 0.112520 Aug 09 17:20:12.680724 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1253/2600] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:12 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1463 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:12.691979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7f583a3e-459a-4dc7-8e03-523806bb2a01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:12.694914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7f583a3e-459a-4dc7-8e03-523806bb2a01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:12.707952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:12.716164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f583a3e-459a-4dc7-8e03-523806bb2a01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:12.716885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f583a3e-459a-4dc7-8e03-523806bb2a01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:12.719136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f583a3e-459a-4dc7-8e03-523806bb2a01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:12.721359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f583a3e-459a-4dc7-8e03-523806bb2a01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:12.723671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:12.724840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f583a3e-459a-4dc7-8e03-523806bb2a01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:12.725516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f583a3e-459a-4dc7-8e03-523806bb2a01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:12.772727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=ec097021-2408-4328-b677-266d832bd565,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:20:12.860775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:12.886466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:12.900846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:13.022911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:13.031725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:13.096211 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c2711b73-dc7c-4f74-a5e4-ef4c5117ec87 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.704316 Aug 09 17:20:13.098180 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1348/2601] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:20:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 2707 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 09 17:20:13.104920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-bb244735-3721-4f48-8c93-380be04b329a req-b425e29c-1867-4a17-bd78-b6457606e983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaa64ae-5ed0-4301-bee9-f70f7772e546", "name": "network-vif-deleted", "tag": "87474140-ae76-4140-98d3-a76a90c5061d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:13.121507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bb244735-3721-4f48-8c93-380be04b329a req-b425e29c-1867-4a17-bd78-b6457606e983 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:13.134370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bb244735-3721-4f48-8c93-380be04b329a req-b425e29c-1867-4a17-bd78-b6457606e983 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:13.135231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bb244735-3721-4f48-8c93-380be04b329a req-b425e29c-1867-4a17-bd78-b6457606e983 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:13.149261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:13.161102 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-bb244735-3721-4f48-8c93-380be04b329a req-b425e29c-1867-4a17-bd78-b6457606e983 service nova] Creating event network-vif-deleted:87474140-ae76-4140-98d3-a76a90c5061d for instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 on n-h1-845781-6 Aug 09 17:20:13.170437 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-bb244735-3721-4f48-8c93-380be04b329a req-b425e29c-1867-4a17-bd78-b6457606e983 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070357 Aug 09 17:20:13.172682 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1349/2602] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:13.183105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-679427d2-41f7-43fb-aa85-1d6af86c5cc5 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:13.184168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-679427d2-41f7-43fb-aa85-1d6af86c5cc5 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:13.192688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679427d2-41f7-43fb-aa85-1d6af86c5cc5 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:13.193747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679427d2-41f7-43fb-aa85-1d6af86c5cc5 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:13.194405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679427d2-41f7-43fb-aa85-1d6af86c5cc5 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:13.195795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679427d2-41f7-43fb-aa85-1d6af86c5cc5 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:13.196762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679427d2-41f7-43fb-aa85-1d6af86c5cc5 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:13.197379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679427d2-41f7-43fb-aa85-1d6af86c5cc5 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:13.452642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-679427d2-41f7-43fb-aa85-1d6af86c5cc5 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0cb6058852c4b59ae031509affffe65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c273ac15199f43b898faa91983629795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:13.468026 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-679427d2-41f7-43fb-aa85-1d6af86c5cc5 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 200 len: 1612 microversion: 2.1 time: 0.293164 Aug 09 17:20:13.487223 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1350/2603] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:13 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 1612 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:13.505089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8294d03c-3d92-402d-8929-52b81bfda2f1 req-f6f72b74-8ca4-40cf-8dbd-e67c0e19b12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86a49e6-8b69-4653-be51-46f86d343173", "name": "network-vif-deleted", "tag": "5c77d2c9-8b84-4357-a134-aa90a6550da8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:13.537539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8294d03c-3d92-402d-8929-52b81bfda2f1 req-f6f72b74-8ca4-40cf-8dbd-e67c0e19b12e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:13.538286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8294d03c-3d92-402d-8929-52b81bfda2f1 req-f6f72b74-8ca4-40cf-8dbd-e67c0e19b12e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:13.538886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8294d03c-3d92-402d-8929-52b81bfda2f1 req-f6f72b74-8ca4-40cf-8dbd-e67c0e19b12e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:13.561138 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8294d03c-3d92-402d-8929-52b81bfda2f1 req-f6f72b74-8ca4-40cf-8dbd-e67c0e19b12e service nova] Creating event network-vif-deleted:5c77d2c9-8b84-4357-a134-aa90a6550da8 for instance b86a49e6-8b69-4653-be51-46f86d343173 on n-h1-845781-6 Aug 09 17:20:13.568098 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8294d03c-3d92-402d-8929-52b81bfda2f1 req-f6f72b74-8ca4-40cf-8dbd-e67c0e19b12e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079064 Aug 09 17:20:13.569466 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1351/2604] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:13.576030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-de21689c-50be-465a-8cfc-9eda5044f183 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb6f5790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:13.654438 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-de21689c-50be-465a-8cfc-9eda5044f183 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 200 len: 1463 microversion: 2.1 time: 0.082818 Aug 09 17:20:13.656242 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1352/2605] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:13 2022] GET /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 1463 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:13.667481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c3b4d807-80ee-4cd8-9b31-19596d748430 req-d09ba7f8-853b-43fb-ad2d-b8321dedebcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaa64ae-5ed0-4301-bee9-f70f7772e546", "name": "network-vif-unplugged", "status": "completed", "tag": "f657f1de-3405-4d35-946d-8d8d4fc6c7f6"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:13.694771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c3b4d807-80ee-4cd8-9b31-19596d748430 req-d09ba7f8-853b-43fb-ad2d-b8321dedebcb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:13.696127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c3b4d807-80ee-4cd8-9b31-19596d748430 req-d09ba7f8-853b-43fb-ad2d-b8321dedebcb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:13.696836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c3b4d807-80ee-4cd8-9b31-19596d748430 req-d09ba7f8-853b-43fb-ad2d-b8321dedebcb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:13.740894 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c3b4d807-80ee-4cd8-9b31-19596d748430 req-d09ba7f8-853b-43fb-ad2d-b8321dedebcb service nova] Creating event network-vif-unplugged:f657f1de-3405-4d35-946d-8d8d4fc6c7f6 for instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 on n-h1-845781-6 Aug 09 17:20:13.753160 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c3b4d807-80ee-4cd8-9b31-19596d748430 req-d09ba7f8-853b-43fb-ad2d-b8321dedebcb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094542 Aug 09 17:20:13.755098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7f583a3e-459a-4dc7-8e03-523806bb2a01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:13.760849 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1353/2606] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:13.775874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:13.777515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:13.803600 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7f583a3e-459a-4dc7-8e03-523806bb2a01 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1315 microversion: 2.1 time: 1.106949 Aug 09 17:20:13.804167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:13.804825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:13.805290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:13.810500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:13.821802 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1254/2607] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:12 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1315 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:13.822125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:13.822125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:13.843839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9971dfad-30f5-46f8-bc74-d70c84f190c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:13.860329 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] HTTP exception thrown: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 HTTP/1.1 Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b86a49e6-8b69-4653-be51-46f86d343173'} Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:13.868353 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:13.872545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:13.872545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:13.872545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:13.872545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:13.872545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:20:13.872545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:20:13.872545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:20:13.872545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:13.874464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 404 to user: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:20:13.880156 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b150a499-5aab-49eb-9a32-ebb5e65cac1d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 404 len: 111 microversion: 2.1 time: 0.117393 Aug 09 17:20:13.881279 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1354/2608] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:13 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:20:13.899905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9971dfad-30f5-46f8-bc74-d70c84f190c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:13.906407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9971dfad-30f5-46f8-bc74-d70c84f190c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Searching by: {'deleted': False, 'project_id': '2b3f7d833b344b9cb579955d726a9e41'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:20:13.919028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:13.920772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:13.948004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:13.948753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:13.949516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:13.950483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:13.954150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:13.954690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:14.058968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9971dfad-30f5-46f8-bc74-d70c84f190c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:14.060308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9971dfad-30f5-46f8-bc74-d70c84f190c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:14.065944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9971dfad-30f5-46f8-bc74-d70c84f190c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:14.078341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9971dfad-30f5-46f8-bc74-d70c84f190c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:14.079619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9971dfad-30f5-46f8-bc74-d70c84f190c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:14.086539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9971dfad-30f5-46f8-bc74-d70c84f190c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:14.312717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-9971dfad-30f5-46f8-bc74-d70c84f190c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:20:14.478269 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9971dfad-30f5-46f8-bc74-d70c84f190c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.659833 Aug 09 17:20:14.479838 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1255/2609] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:20:13 2022] GET /compute/v2.1/servers => generated 1002 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:14.487837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8d5f8be3-ecd6-4192-b8b9-e1734c187da8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:14.489947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8d5f8be3-ecd6-4192-b8b9-e1734c187da8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:14.499888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d5f8be3-ecd6-4192-b8b9-e1734c187da8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:14.500863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d5f8be3-ecd6-4192-b8b9-e1734c187da8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:14.502013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d5f8be3-ecd6-4192-b8b9-e1734c187da8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:14.503148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d5f8be3-ecd6-4192-b8b9-e1734c187da8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:14.504223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d5f8be3-ecd6-4192-b8b9-e1734c187da8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:14.505133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d5f8be3-ecd6-4192-b8b9-e1734c187da8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:14.632377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:14.650701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:14.655066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:14.659521 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6d3c619b-43b5-4ac7-a2e4-092a685e5d39 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1358 microversion: 2.21 time: 0.773799 Aug 09 17:20:14.677642 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1355/2610] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:13 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1358 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:14.683613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8dd30976-109e-472a-b3ec-8aba15d55f7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Action: 'create', calling method: .version_select at 0x7fbbcb6f54c0>, body: {"keypair": {"name": "tempest-keypair-283539500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZiRLzVovQbvzShcZlyTCZwJ2w+tqVEmxdnx0ZZC5g8SaUiEw2E9E6uW+fg+l/nnrh6vCKl23vO3ZpU3kCJfhUXXVNrrAQYyGQJQRcQ7D8ebOYMppMP+VV2Z3WHdRlV2Q=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:14.710331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8dd30976-109e-472a-b3ec-8aba15d55f7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Getting quotas for project 09c53ff5b89f4495958c9319d750833c. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:14.718768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8dd30976-109e-472a-b3ec-8aba15d55f7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Getting quotas for user 4ab568d7612c4f849e842d478b67016d and project 09c53ff5b89f4495958c9319d750833c. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:14.763345 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8dd30976-109e-472a-b3ec-8aba15d55f7d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.084125 Aug 09 17:20:14.766146 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1356/2611] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:20:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:14.787840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:14.790556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:14.821596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:14.823688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:14.824159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:14.828947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:14.829829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:14.830758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:14.888318 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] HTTP exception thrown: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Request method failure captured: Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 HTTP/1.1 Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8paiksjBa4qx9EgOZhhnQ_onjfhZBInU48ofSQcYvFHNVyYuhzclTaVffDdLGVuELT6CBN4j9RxjVw17-_8XHLXtiX0yztCtzvoHmmNaZCpHV1uzCevjHn6mg9Q9Qvt8NLrEaCxdpzDUUfs6NkXnB-pgH6nyPDYhGEfcyiy54-AM0co Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: c273ac15199f43b898faa91983629795 Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c273ac15199f43b898faa91983629795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c273ac15199f43b898faa91983629795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: c273ac15199f43b898faa91983629795 Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestMultiNic-545157782-project Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d0cb6058852c4b59ae031509affffe65 Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestMultiNic-545157782-project Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '4aaa64ae-5ed0-4301-bee9-f70f7772e546'} Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:14.894800 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:14.909006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:14.909006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:14.909006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:14.909006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:20:14.909006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:20:14.909006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:14.909006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:14.909006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Returning 404 to user: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:20:14.909006 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8022f327-673e-4d16-bf09-36cad2f644a3 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 404 len: 111 microversion: 2.1 time: 0.131510 Aug 09 17:20:14.909006 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1357/2612] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:14 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:20:14.916188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cce3e729-1142-4247-869b-9a7508b00f7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:14.916820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cce3e729-1142-4247-869b-9a7508b00f7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:15.234792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cce3e729-1142-4247-869b-9a7508b00f7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:15.245870 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cce3e729-1142-4247-869b-9a7508b00f7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1218 microversion: 2.1 time: 0.339497 Aug 09 17:20:15.249549 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1358/2613] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:14 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1218 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:15.270244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fafacc86-5786-4eab-bbe4-c79fdc1650bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:15.271273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fafacc86-5786-4eab-bbe4-c79fdc1650bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:15.288893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafacc86-5786-4eab-bbe4-c79fdc1650bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:15.289430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafacc86-5786-4eab-bbe4-c79fdc1650bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:15.289888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafacc86-5786-4eab-bbe4-c79fdc1650bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:15.290676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafacc86-5786-4eab-bbe4-c79fdc1650bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:15.291291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafacc86-5786-4eab-bbe4-c79fdc1650bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:15.291761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafacc86-5786-4eab-bbe4-c79fdc1650bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:15.634512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8d5f8be3-ecd6-4192-b8b9-e1734c187da8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:15.662020 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8d5f8be3-ecd6-4192-b8b9-e1734c187da8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1467 microversion: 2.1 time: 1.178747 Aug 09 17:20:15.664613 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1256/2614] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:14 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1467 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:15.672215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-991167f4-2b38-4dba-ac5f-88e057ada2c9 req-0a258dfe-17d9-40c0-b785-69fdb26c414a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaa64ae-5ed0-4301-bee9-f70f7772e546", "name": "network-vif-deleted", "tag": "f657f1de-3405-4d35-946d-8d8d4fc6c7f6"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:15.691777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-991167f4-2b38-4dba-ac5f-88e057ada2c9 req-0a258dfe-17d9-40c0-b785-69fdb26c414a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:15.692693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-991167f4-2b38-4dba-ac5f-88e057ada2c9 req-0a258dfe-17d9-40c0-b785-69fdb26c414a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:15.693495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-991167f4-2b38-4dba-ac5f-88e057ada2c9 req-0a258dfe-17d9-40c0-b785-69fdb26c414a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:15.707815 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-991167f4-2b38-4dba-ac5f-88e057ada2c9 req-0a258dfe-17d9-40c0-b785-69fdb26c414a service nova] Creating event network-vif-deleted:f657f1de-3405-4d35-946d-8d8d4fc6c7f6 for instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 on n-h1-845781-6 Aug 09 17:20:15.713887 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-991167f4-2b38-4dba-ac5f-88e057ada2c9 req-0a258dfe-17d9-40c0-b785-69fdb26c414a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047214 Aug 09 17:20:15.715000 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1257/2615] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:15.721204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:15.722090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:15.730763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:15.732014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:15.732603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:15.734096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:15.734944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:15.735936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:15.854155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fafacc86-5786-4eab-bbe4-c79fdc1650bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:15.870646 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fafacc86-5786-4eab-bbe4-c79fdc1650bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1315 microversion: 2.1 time: 0.619672 Aug 09 17:20:15.872352 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1359/2616] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:15 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:15.884228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4ee4e680-3bf3-4c61-b01d-bbfe6bf023a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1824272661"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:15.888560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4ee4e680-3bf3-4c61-b01d-bbfe6bf023a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:15.933081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ee4e680-3bf3-4c61-b01d-bbfe6bf023a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:15.933706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ee4e680-3bf3-4c61-b01d-bbfe6bf023a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:15.938439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ee4e680-3bf3-4c61-b01d-bbfe6bf023a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:15.942926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ee4e680-3bf3-4c61-b01d-bbfe6bf023a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:15.950146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ee4e680-3bf3-4c61-b01d-bbfe6bf023a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:15.950709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ee4e680-3bf3-4c61-b01d-bbfe6bf023a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:16.179489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:16.191035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:16.204668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:16.207845 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bdf6f1d2-b5a5-4e5b-b9ec-1b766fccec89 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1358 microversion: 2.21 time: 0.490892 Aug 09 17:20:16.213837 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1258/2617] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:15 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1358 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:16.225254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-70f0d27d-1109-43cd-a16f-07ac1b65a750 req-eebf87ed-bdfa-424f-a709-a2d7528ed527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c581b0-1246-4911-8650-449bb2b20fcf", "name": "network-vif-plugged", "status": "completed", "tag": "0fc0fd65-e9ed-4af2-8304-75321477d374"}, {"server_uuid": "f7e3e8f0-9f58-47fd-8000-d875529d0b84", "name": "network-vif-unplugged", "status": "completed", "tag": "404b76c0-d83e-4f41-a30d-e7d27789aede"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:16.256870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-70f0d27d-1109-43cd-a16f-07ac1b65a750 req-eebf87ed-bdfa-424f-a709-a2d7528ed527 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:16.257716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-70f0d27d-1109-43cd-a16f-07ac1b65a750 req-eebf87ed-bdfa-424f-a709-a2d7528ed527 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:16.259685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-70f0d27d-1109-43cd-a16f-07ac1b65a750 req-eebf87ed-bdfa-424f-a709-a2d7528ed527 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:16.275421 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-70f0d27d-1109-43cd-a16f-07ac1b65a750 req-eebf87ed-bdfa-424f-a709-a2d7528ed527 service nova] Creating event network-vif-plugged:0fc0fd65-e9ed-4af2-8304-75321477d374 for instance c2c581b0-1246-4911-8650-449bb2b20fcf on n-h2-845781-6 Aug 09 17:20:16.276336 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-70f0d27d-1109-43cd-a16f-07ac1b65a750 req-eebf87ed-bdfa-424f-a709-a2d7528ed527 service nova] Creating event network-vif-unplugged:404b76c0-d83e-4f41-a30d-e7d27789aede for instance f7e3e8f0-9f58-47fd-8000-d875529d0b84 on n-h2-845781-6 Aug 09 17:20:16.284979 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-70f0d27d-1109-43cd-a16f-07ac1b65a750 req-eebf87ed-bdfa-424f-a709-a2d7528ed527 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.068362 Aug 09 17:20:16.285912 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1259/2618] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:16.292537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-97b7e318-f513-40ab-bc0b-b5e9f887c8d6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:16.293668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-97b7e318-f513-40ab-bc0b-b5e9f887c8d6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:16.305738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97b7e318-f513-40ab-bc0b-b5e9f887c8d6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:16.306679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97b7e318-f513-40ab-bc0b-b5e9f887c8d6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:16.307369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97b7e318-f513-40ab-bc0b-b5e9f887c8d6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:16.308684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97b7e318-f513-40ab-bc0b-b5e9f887c8d6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:16.309500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97b7e318-f513-40ab-bc0b-b5e9f887c8d6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:16.310375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-97b7e318-f513-40ab-bc0b-b5e9f887c8d6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:16.409954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-97b7e318-f513-40ab-bc0b-b5e9f887c8d6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:16.423973 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-97b7e318-f513-40ab-bc0b-b5e9f887c8d6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1270 microversion: 2.1 time: 0.136135 Aug 09 17:20:16.425387 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1260/2619] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:16 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:16.617615 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4ee4e680-3bf3-4c61-b01d-bbfe6bf023a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "POST /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991/action" status: 202 len: 0 microversion: 2.1 time: 0.741597 Aug 09 17:20:16.620776 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1360/2620] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:20:15 2022] POST /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 17:20:16.636160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3883b21a-8b6a-402f-9d57-cf03ce63c58b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc9e6670>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:16.783382 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3883b21a-8b6a-402f-9d57-cf03ce63c58b tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.155665 Aug 09 17:20:16.786507 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1261/2621] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:16 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:16.915146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3da71f7-8111-4d30-938d-14b21c4ae1c5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:16.917264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b3da71f7-8111-4d30-938d-14b21c4ae1c5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:16.927454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3da71f7-8111-4d30-938d-14b21c4ae1c5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:16.928756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3da71f7-8111-4d30-938d-14b21c4ae1c5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:16.929619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3da71f7-8111-4d30-938d-14b21c4ae1c5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:16.930675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3da71f7-8111-4d30-938d-14b21c4ae1c5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:16.931388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3da71f7-8111-4d30-938d-14b21c4ae1c5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:16.932125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3da71f7-8111-4d30-938d-14b21c4ae1c5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:17.247156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:17.248544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:17.266374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:17.267067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:17.267784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:17.268800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:17.269777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:17.271106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:17.448627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3da71f7-8111-4d30-938d-14b21c4ae1c5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:17.466992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b3da71f7-8111-4d30-938d-14b21c4ae1c5 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1315 microversion: 2.1 time: 0.559866 Aug 09 17:20:17.468269 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1361/2622] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:16 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:17.482362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26507a67-3392-4726-8cf5-0c575b402f11 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:17.483872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-26507a67-3392-4726-8cf5-0c575b402f11 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:17.499486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26507a67-3392-4726-8cf5-0c575b402f11 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:17.500773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26507a67-3392-4726-8cf5-0c575b402f11 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:17.501697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26507a67-3392-4726-8cf5-0c575b402f11 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:17.503498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26507a67-3392-4726-8cf5-0c575b402f11 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:17.504727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26507a67-3392-4726-8cf5-0c575b402f11 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:17.505786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26507a67-3392-4726-8cf5-0c575b402f11 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:17.647197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-26507a67-3392-4726-8cf5-0c575b402f11 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:17.686626 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-26507a67-3392-4726-8cf5-0c575b402f11 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1276 microversion: 2.1 time: 0.211487 Aug 09 17:20:17.689483 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1362/2623] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:17 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1276 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:17.772163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-401ea4b9-a342-462b-8362-d7439d041641 req-5026bb68-4691-4d9e-840c-f5802c9a0a8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a5402fb-8e2e-4145-a53b-ec8b72c12e30", "tag": "0bdc8283-4340-486a-8b50-d9217a6aa69a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:17.790717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-401ea4b9-a342-462b-8362-d7439d041641 req-5026bb68-4691-4d9e-840c-f5802c9a0a8d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:17.791325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-401ea4b9-a342-462b-8362-d7439d041641 req-5026bb68-4691-4d9e-840c-f5802c9a0a8d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:17.793522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-401ea4b9-a342-462b-8362-d7439d041641 req-5026bb68-4691-4d9e-840c-f5802c9a0a8d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:17.811033 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-401ea4b9-a342-462b-8362-d7439d041641 req-5026bb68-4691-4d9e-840c-f5802c9a0a8d service nova] Creating event network-changed:0bdc8283-4340-486a-8b50-d9217a6aa69a for instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 on n-h1-845781-6 Aug 09 17:20:17.817396 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-401ea4b9-a342-462b-8362-d7439d041641 req-5026bb68-4691-4d9e-840c-f5802c9a0a8d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055577 Aug 09 17:20:17.818506 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1363/2624] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:20:17.824277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-40b52288-37b1-4bc8-95a4-7d5e5dc6904f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb4fbf70>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:17.902581 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-40b52288-37b1-4bc8-95a4-7d5e5dc6904f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.082617 Aug 09 17:20:17.911403 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1364/2625] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:17 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:18.453711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:18.481846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:18.487982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:18.504495 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-93914844-5629-4ce8-80db-79d5d40b33ad tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1358 microversion: 2.21 time: 1.252573 Aug 09 17:20:18.512016 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1262/2626] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:17 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1358 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:20:18.561196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ef0f5cd4-1763-464b-8823-2499e64737b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:18.562718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ef0f5cd4-1763-464b-8823-2499e64737b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:18.605604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0f5cd4-1763-464b-8823-2499e64737b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:18.611251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0f5cd4-1763-464b-8823-2499e64737b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:18.612234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0f5cd4-1763-464b-8823-2499e64737b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:18.613655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0f5cd4-1763-464b-8823-2499e64737b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:18.624907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0f5cd4-1763-464b-8823-2499e64737b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:18.626401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0f5cd4-1763-464b-8823-2499e64737b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:18.738904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-30f8570d-6c1c-48c1-baac-0eafbadda017 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:18.741389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-30f8570d-6c1c-48c1-baac-0eafbadda017 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:18.756149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f8570d-6c1c-48c1-baac-0eafbadda017 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:18.758044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f8570d-6c1c-48c1-baac-0eafbadda017 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:18.759593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f8570d-6c1c-48c1-baac-0eafbadda017 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:18.761581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f8570d-6c1c-48c1-baac-0eafbadda017 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:18.763014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f8570d-6c1c-48c1-baac-0eafbadda017 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:18.764267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f8570d-6c1c-48c1-baac-0eafbadda017 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:18.940876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-30f8570d-6c1c-48c1-baac-0eafbadda017 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:18.952666 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-30f8570d-6c1c-48c1-baac-0eafbadda017 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1276 microversion: 2.1 time: 0.229445 Aug 09 17:20:18.955955 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1263/2627] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:18 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:20:18.961573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0bf0ee62-c68f-4d67-82c2-e9bade909885 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcbc69a60>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:19.018052 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0bf0ee62-c68f-4d67-82c2-e9bade909885 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.060415 Aug 09 17:20:19.027770 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1264/2628] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:18 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:19.556788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:19.558487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:19.566105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=14 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:19.574776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:19.578445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:19.578911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:19.579712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:19.580187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:19.582758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:19.913762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ef0f5cd4-1763-464b-8823-2499e64737b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:19.933780 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ef0f5cd4-1763-464b-8823-2499e64737b0 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1315 microversion: 2.1 time: 1.432960 Aug 09 17:20:19.935026 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1365/2629] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:18 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1315 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:20:19.990042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ef5e5ac1-43b4-4675-a88c-a10df3db05d5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:19.991855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ef5e5ac1-43b4-4675-a88c-a10df3db05d5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:20.007495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef5e5ac1-43b4-4675-a88c-a10df3db05d5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:20.008158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef5e5ac1-43b4-4675-a88c-a10df3db05d5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:20.009109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef5e5ac1-43b4-4675-a88c-a10df3db05d5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:20.012049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef5e5ac1-43b4-4675-a88c-a10df3db05d5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:20.013185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef5e5ac1-43b4-4675-a88c-a10df3db05d5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:20.013952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef5e5ac1-43b4-4675-a88c-a10df3db05d5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:20.226430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:20.237760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:20.240911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:20.245056 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2a5bde77-4a19-463d-a276-20e92b548b3c tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1551 microversion: 2.21 time: 0.694210 Aug 09 17:20:20.257381 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1265/2630] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:19 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1551 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:20:20.261868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ef5e5ac1-43b4-4675-a88c-a10df3db05d5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:20.291187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9540793c-8797-4fdc-8064-1b993e09aa74 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdca115e0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:20.291925 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ef5e5ac1-43b4-4675-a88c-a10df3db05d5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1276 microversion: 2.1 time: 0.310536 Aug 09 17:20:20.310127 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1366/2631] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:19 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1276 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:20:20.337093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-52779983-fe53-467e-822e-13fed91f724b tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:20.338288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-52779983-fe53-467e-822e-13fed91f724b tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:20.368610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52779983-fe53-467e-822e-13fed91f724b tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:20.370099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52779983-fe53-467e-822e-13fed91f724b tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:20.373833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52779983-fe53-467e-822e-13fed91f724b tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:20.379826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52779983-fe53-467e-822e-13fed91f724b tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:20.382877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52779983-fe53-467e-822e-13fed91f724b tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:20.384759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52779983-fe53-467e-822e-13fed91f724b tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:20.447551 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9540793c-8797-4fdc-8064-1b993e09aa74 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.169489 Aug 09 17:20:20.449743 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1266/2632] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:20 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:20.465176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-52779983-fe53-467e-822e-13fed91f724b tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:20:20.794258 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-52779983-fe53-467e-822e-13fed91f724b tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 204 len: 0 microversion: 2.21 time: 0.471652 Aug 09 17:20:20.808820 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1367/2633] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:20:20 2022] DELETE /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:20:20.830481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:20.836745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:20.851901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:20.853051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:20.854121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:20.856570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:20.858058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:20.859032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:20.974680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11aebee2-8326-4cd1-b142-4871edc1a39f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:20.977361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-11aebee2-8326-4cd1-b142-4871edc1a39f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:21.011039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11aebee2-8326-4cd1-b142-4871edc1a39f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:21.013969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11aebee2-8326-4cd1-b142-4871edc1a39f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:21.016227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11aebee2-8326-4cd1-b142-4871edc1a39f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:21.026046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11aebee2-8326-4cd1-b142-4871edc1a39f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:21.027113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11aebee2-8326-4cd1-b142-4871edc1a39f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:21.028808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11aebee2-8326-4cd1-b142-4871edc1a39f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:22.274004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:22.274881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-11aebee2-8326-4cd1-b142-4871edc1a39f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:22.298556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:22.303128 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11aebee2-8326-4cd1-b142-4871edc1a39f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1315 microversion: 2.1 time: 1.335192 Aug 09 17:20:22.304802 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1368/2634] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:20 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1315 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:20:22.305076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:22.312158 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a883bf9-ef83-4dec-a2d4-6c25d6e32644 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1557 microversion: 2.21 time: 1.487185 Aug 09 17:20:22.323258 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1267/2635] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:20 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1557 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:22.332379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9eb58c9b-4edf-4638-b1ce-ecf8416cef35 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:22.332379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9eb58c9b-4edf-4638-b1ce-ecf8416cef35 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:22.344689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e1506b30-093d-42e6-b145-2793d1f68047 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcbb7ad30>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:22.367752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9eb58c9b-4edf-4638-b1ce-ecf8416cef35 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:22.368583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9eb58c9b-4edf-4638-b1ce-ecf8416cef35 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:22.377252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9eb58c9b-4edf-4638-b1ce-ecf8416cef35 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:22.382667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9eb58c9b-4edf-4638-b1ce-ecf8416cef35 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:22.391656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9eb58c9b-4edf-4638-b1ce-ecf8416cef35 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:22.396271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9eb58c9b-4edf-4638-b1ce-ecf8416cef35 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:22.405704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:22.490991 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e1506b30-093d-42e6-b145-2793d1f68047 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.163645 Aug 09 17:20:22.499715 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1268/2636] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:22 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:23.356740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e48428d-345b-4030-8e16-15165b81d003 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:23.358140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8e48428d-345b-4030-8e16-15165b81d003 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:23.388135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e48428d-345b-4030-8e16-15165b81d003 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:23.389019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e48428d-345b-4030-8e16-15165b81d003 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:23.389808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e48428d-345b-4030-8e16-15165b81d003 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:23.398374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e48428d-345b-4030-8e16-15165b81d003 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:23.399362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e48428d-345b-4030-8e16-15165b81d003 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:23.408029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e48428d-345b-4030-8e16-15165b81d003 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:23.930024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9eb58c9b-4edf-4638-b1ce-ecf8416cef35 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:23.962045 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9eb58c9b-4edf-4638-b1ce-ecf8416cef35 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1318 microversion: 2.1 time: 1.650767 Aug 09 17:20:23.976180 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1369/2637] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:22 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1318 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:24.018657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:24.024861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:24.052691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:24.070975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:24.075985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:24.083252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:24.093471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:24.095408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:24.183883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:25.246000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=30 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:26.042803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8e48428d-345b-4030-8e16-15165b81d003 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:26.045826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:26.060017 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e48428d-345b-4030-8e16-15165b81d003 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1315 microversion: 2.1 time: 2.712652 Aug 09 17:20:26.079061 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1269/2638] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:23 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1315 bytes in 2734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:20:26.080830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:26.095251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-64ce8768-9156-4a2c-bae9-0b066b354e62 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb96c3a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:26.122836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:26.127678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:26.131488 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f86cc190-a2ae-4c9d-8de4-ed984ff4e872 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1557 microversion: 2.21 time: 2.153095 Aug 09 17:20:26.137041 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1370/2639] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:23 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1557 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:26.152077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-35c01d12-ccf7-47d8-baae-b0b898729767 req-e4767e45-c93e-4621-b4a3-246219b8d126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce962b08-43de-4bff-a72a-1adcf330c991", "name": "network-vif-plugged", "status": "completed", "tag": "b046df32-8645-4449-b41d-a48fe4b7136e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:26.195061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-35c01d12-ccf7-47d8-baae-b0b898729767 req-e4767e45-c93e-4621-b4a3-246219b8d126 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:26.197787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-35c01d12-ccf7-47d8-baae-b0b898729767 req-e4767e45-c93e-4621-b4a3-246219b8d126 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:26.199310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-35c01d12-ccf7-47d8-baae-b0b898729767 req-e4767e45-c93e-4621-b4a3-246219b8d126 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:26.213520 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-64ce8768-9156-4a2c-bae9-0b066b354e62 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.132408 Aug 09 17:20:26.228005 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1270/2640] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:26 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:26.236171 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-35c01d12-ccf7-47d8-baae-b0b898729767 req-e4767e45-c93e-4621-b4a3-246219b8d126 service nova] Creating event network-vif-plugged:b046df32-8645-4449-b41d-a48fe4b7136e for instance ce962b08-43de-4bff-a72a-1adcf330c991 on n-h2-845781-6 Aug 09 17:20:26.256080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-150bea9a-a637-4616-85e1-5451a481934a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:26.257243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-150bea9a-a637-4616-85e1-5451a481934a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:26.262770 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-35c01d12-ccf7-47d8-baae-b0b898729767 req-e4767e45-c93e-4621-b4a3-246219b8d126 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122978 Aug 09 17:20:26.266369 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1371/2641] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:26.274105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:26.275644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:26.282370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150bea9a-a637-4616-85e1-5451a481934a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:26.287696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150bea9a-a637-4616-85e1-5451a481934a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:26.287856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:26.288534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150bea9a-a637-4616-85e1-5451a481934a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:26.288975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:26.289728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:26.289874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150bea9a-a637-4616-85e1-5451a481934a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:26.290951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:26.291425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:26.292597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:26.296562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150bea9a-a637-4616-85e1-5451a481934a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:26.297317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150bea9a-a637-4616-85e1-5451a481934a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:26.323584 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] HTTP exception thrown: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Request method failure captured: Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 HTTP/1.1 Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8paiksjBa4qx9EgOZhhnQ_onjfhZBInU48ofSQcYvFHNVyYuhzclTaVffDdLGVuELT6CBN4j9RxjVw17-_8XHLXtiX0yztCtzvoHmmNaZCpHV1uzCevjHn6mg9Q9Qvt8NLrEaCxdpzDUUfs6NkXnB-pgH6nyPDYhGEfcyiy54-AM0co Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: c273ac15199f43b898faa91983629795 Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c273ac15199f43b898faa91983629795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c273ac15199f43b898faa91983629795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: c273ac15199f43b898faa91983629795 Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestMultiNic-545157782-project Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d0cb6058852c4b59ae031509affffe65 Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestMultiNic-545157782-project Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '4aaa64ae-5ed0-4301-bee9-f70f7772e546'} Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:20:26.326069 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:20:26.330008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:26.330008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.330008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:26.330008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.330008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.330008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:26.330008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:26.330008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:20:26.330008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:20:26.330008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:26.330008 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.334587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Returning 404 to user: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:20:26.335948 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-80ac93a9-ddfe-4915-9631-7acc06f18e43 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 404 len: 111 microversion: 2.1 time: 0.067136 Aug 09 17:20:26.336795 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1372/2642] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:20:26 2022] DELETE /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:20:26.347831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:26.348845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: 4aaa64ae-5ed0-4301-bee9-f70f7772e546] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:26.357779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:26.358835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:26.359709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:26.361096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:26.361827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:26.362607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:26.406593 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] HTTP exception thrown: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Request method failure captured: Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 HTTP/1.1 Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8paiksjBa4qx9EgOZhhnQ_onjfhZBInU48ofSQcYvFHNVyYuhzclTaVffDdLGVuELT6CBN4j9RxjVw17-_8XHLXtiX0yztCtzvoHmmNaZCpHV1uzCevjHn6mg9Q9Qvt8NLrEaCxdpzDUUfs6NkXnB-pgH6nyPDYhGEfcyiy54-AM0co Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: c273ac15199f43b898faa91983629795 Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c273ac15199f43b898faa91983629795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c273ac15199f43b898faa91983629795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: c273ac15199f43b898faa91983629795 Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestMultiNic-545157782-project Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d0cb6058852c4b59ae031509affffe65 Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestMultiNic-545157782-project Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '4aaa64ae-5ed0-4301-bee9-f70f7772e546'} Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:26.409009 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.414868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.414868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:26.414868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:26.414868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:20:26.414868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:20:26.414868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. Aug 09 17:20:26.414868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.418113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Returning 404 to user: Instance 4aaa64ae-5ed0-4301-bee9-f70f7772e546 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:20:26.419707 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f8e5cd5e-8cc2-4f88-a7ad-c1b16733c031 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546" status: 404 len: 111 microversion: 2.1 time: 0.076821 Aug 09 17:20:26.420884 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1373/2643] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:26 2022] GET /compute/v2.1/servers/4aaa64ae-5ed0-4301-bee9-f70f7772e546 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:20:26.442687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:26.446196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:26.508536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:26.511485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:26.515028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:26.525314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:26.544994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:26.548985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:26.619390 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] HTTP exception thrown: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Request method failure captured: Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f HTTP/1.1 Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8paiksjBa4qx9EgOZhhnQ_onjfhZBInU48ofSQcYvFHNVyYuhzclTaVffDdLGVuELT6CBN4j9RxjVw17-_8XHLXtiX0yztCtzvoHmmNaZCpHV1uzCevjHn6mg9Q9Qvt8NLrEaCxdpzDUUfs6NkXnB-pgH6nyPDYhGEfcyiy54-AM0co Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: c273ac15199f43b898faa91983629795 Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c273ac15199f43b898faa91983629795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c273ac15199f43b898faa91983629795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: c273ac15199f43b898faa91983629795 Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestMultiNic-545157782-project Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d0cb6058852c4b59ae031509affffe65 Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestMultiNic-545157782-project Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f'} Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:20:26.623076 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.635829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Returning 404 to user: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:20:26.640032 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b32006c1-b2a7-4a2a-bc1b-9ba499832d16 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 404 len: 111 microversion: 2.1 time: 0.207674 Aug 09 17:20:26.663273 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1374/2644] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:20:26 2022] DELETE /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:20:26.693460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:26.695765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] [instance: c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:26.718348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:26.720989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:26.722543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:26.725249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:26.726401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:26.727395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:26.848710 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] HTTP exception thrown: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Request method failure captured: Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f HTTP/1.1 Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8paiksjBa4qx9EgOZhhnQ_onjfhZBInU48ofSQcYvFHNVyYuhzclTaVffDdLGVuELT6CBN4j9RxjVw17-_8XHLXtiX0yztCtzvoHmmNaZCpHV1uzCevjHn6mg9Q9Qvt8NLrEaCxdpzDUUfs6NkXnB-pgH6nyPDYhGEfcyiy54-AM0co Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: c273ac15199f43b898faa91983629795 Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c273ac15199f43b898faa91983629795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c273ac15199f43b898faa91983629795"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c273ac15199f43b898faa91983629795"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: c273ac15199f43b898faa91983629795 Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestMultiNic-545157782 Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestMultiNic-545157782-project Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d0cb6058852c4b59ae031509affffe65 Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestMultiNic-545157782-project Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f'} Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:26.857899 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.867152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:26.867152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:26.867152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:26.867152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:20:26.867152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:20:26.867152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. Aug 09 17:20:26.867152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:26.873725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] Returning 404 to user: Instance c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:20:26.876348 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-019df7ef-9cd6-4ed3-889a-6f2b50b05365 tempest-ServersTestMultiNic-545157782 tempest-ServersTestMultiNic-545157782-project] 10.222.0.93 "GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f" status: 404 len: 111 microversion: 2.1 time: 0.210343 Aug 09 17:20:26.879581 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1375/2645] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:26 2022] GET /compute/v2.1/servers/c3d1bef2-0a79-4f2b-bde1-a75cfad72d5f => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:20:27.091160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1cefb14-73ce-48e7-9301-167d73710e6f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:27.092449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e1cefb14-73ce-48e7-9301-167d73710e6f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:27.150427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1cefb14-73ce-48e7-9301-167d73710e6f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:27.151484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1cefb14-73ce-48e7-9301-167d73710e6f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:27.160917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1cefb14-73ce-48e7-9301-167d73710e6f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:27.162316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1cefb14-73ce-48e7-9301-167d73710e6f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:27.163201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1cefb14-73ce-48e7-9301-167d73710e6f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:27.171593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1cefb14-73ce-48e7-9301-167d73710e6f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:27.658975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e1cefb14-73ce-48e7-9301-167d73710e6f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:27.709598 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1cefb14-73ce-48e7-9301-167d73710e6f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1315 microversion: 2.1 time: 0.627393 Aug 09 17:20:27.713332 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1376/2646] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:27 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:27.752952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:27.754936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:27.790396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:27.794475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:27.797089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:27.802819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:27.807461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:27.812731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:28.051361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:28.051879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:28.052514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:28.053149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lazy-loading 'fault' on Instance uuid c2c581b0-1246-4911-8650-449bb2b20fcf {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:20:28.142136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-150bea9a-a637-4616-85e1-5451a481934a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:28.176559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:28.180418 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-150bea9a-a637-4616-85e1-5451a481934a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1318 microversion: 2.1 time: 1.950140 Aug 09 17:20:28.181981 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1271/2647] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:26 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1318 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:28.186492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:28.192526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c9d7a5f9e244a5b9da869293512785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6137919ddef74e62ab6b7d51fe88ffa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:28.195279 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4fca31bc-5dae-4bba-b3cb-061376b41042 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 200 len: 1348 microversion: 2.21 time: 0.480244 Aug 09 17:20:28.202068 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1377/2648] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:27 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 1348 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:28.204310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e60562c7-2764-46db-843a-becc297a3ea3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb9423a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:28.211061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-7f5a9c85-1167-4d9e-85df-ddee4f249ae8 req-3a0d42ad-9b50-4c8f-986c-9fb8c22253d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c581b0-1246-4911-8650-449bb2b20fcf", "name": "network-vif-deleted", "tag": "0fc0fd65-e9ed-4af2-8304-75321477d374"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:28.233152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7f5a9c85-1167-4d9e-85df-ddee4f249ae8 req-3a0d42ad-9b50-4c8f-986c-9fb8c22253d5 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:28.244214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7f5a9c85-1167-4d9e-85df-ddee4f249ae8 req-3a0d42ad-9b50-4c8f-986c-9fb8c22253d5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:28.251808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7f5a9c85-1167-4d9e-85df-ddee4f249ae8 req-3a0d42ad-9b50-4c8f-986c-9fb8c22253d5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:28.289639 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-7f5a9c85-1167-4d9e-85df-ddee4f249ae8 req-3a0d42ad-9b50-4c8f-986c-9fb8c22253d5 service nova] Creating event network-vif-deleted:0fc0fd65-e9ed-4af2-8304-75321477d374 for instance c2c581b0-1246-4911-8650-449bb2b20fcf on n-h2-845781-6 Aug 09 17:20:28.316988 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-7f5a9c85-1167-4d9e-85df-ddee4f249ae8 req-3a0d42ad-9b50-4c8f-986c-9fb8c22253d5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112510 Aug 09 17:20:28.318183 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1378/2649] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:28.338452 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e60562c7-2764-46db-843a-becc297a3ea3 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.152699 Aug 09 17:20:28.342729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1583175644", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:28.345613 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1272/2650] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:28 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:28.379190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-f4dc50d4-00bc-4dba-a34d-44f340ddb2ae req-c5797c2a-abc6-4775-8a76-aa685b805a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2c581b0-1246-4911-8650-449bb2b20fcf", "name": "network-vif-unplugged", "status": "completed", "tag": "0fc0fd65-e9ed-4af2-8304-75321477d374"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:28.425937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f4dc50d4-00bc-4dba-a34d-44f340ddb2ae req-c5797c2a-abc6-4775-8a76-aa685b805a0e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:28.427367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f4dc50d4-00bc-4dba-a34d-44f340ddb2ae req-c5797c2a-abc6-4775-8a76-aa685b805a0e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:28.429583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f4dc50d4-00bc-4dba-a34d-44f340ddb2ae req-c5797c2a-abc6-4775-8a76-aa685b805a0e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:28.488411 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-f4dc50d4-00bc-4dba-a34d-44f340ddb2ae req-c5797c2a-abc6-4775-8a76-aa685b805a0e service nova] Creating event network-vif-unplugged:0fc0fd65-e9ed-4af2-8304-75321477d374 for instance c2c581b0-1246-4911-8650-449bb2b20fcf on n-h2-845781-6 Aug 09 17:20:28.504826 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-f4dc50d4-00bc-4dba-a34d-44f340ddb2ae req-c5797c2a-abc6-4775-8a76-aa685b805a0e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148237 Aug 09 17:20:28.507209 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1273/2651] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:28.517122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] validate_networks() for [('7a433422-1950-4c97-a7d7-e2c1728248b0', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:20:28.746111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7606961f-1292-4070-8cac-4bcc478033bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:28.755553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7606961f-1292-4070-8cac-4bcc478033bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:28.779306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7606961f-1292-4070-8cac-4bcc478033bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:28.785692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7606961f-1292-4070-8cac-4bcc478033bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:28.787052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7606961f-1292-4070-8cac-4bcc478033bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:28.789269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7606961f-1292-4070-8cac-4bcc478033bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:28.790477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7606961f-1292-4070-8cac-4bcc478033bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:28.796338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7606961f-1292-4070-8cac-4bcc478033bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:30.497936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7606961f-1292-4070-8cac-4bcc478033bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:30.535934 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7606961f-1292-4070-8cac-4bcc478033bc tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1315 microversion: 2.1 time: 1.803441 Aug 09 17:20:30.537502 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1274/2652] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:28 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1315 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:30.567585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-7950b9ca-2550-4cfb-8555-b62d75c8f190 req-c5844fde-a12e-4de6-8ede-f68882dde721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec097021-2408-4328-b677-266d832bd565", "tag": "0278004c-6d50-4881-b022-30f9a082b3c2"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:30.615529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7950b9ca-2550-4cfb-8555-b62d75c8f190 req-c5844fde-a12e-4de6-8ede-f68882dde721 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:30.619308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7950b9ca-2550-4cfb-8555-b62d75c8f190 req-c5844fde-a12e-4de6-8ede-f68882dde721 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:30.622389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7950b9ca-2550-4cfb-8555-b62d75c8f190 req-c5844fde-a12e-4de6-8ede-f68882dde721 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:30.649677 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-7950b9ca-2550-4cfb-8555-b62d75c8f190 req-c5844fde-a12e-4de6-8ede-f68882dde721 service nova] Creating event network-changed:0278004c-6d50-4881-b022-30f9a082b3c2 for instance ec097021-2408-4328-b677-266d832bd565 on n-h1-845781-6 Aug 09 17:20:30.663382 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-7950b9ca-2550-4cfb-8555-b62d75c8f190 req-c5844fde-a12e-4de6-8ede-f68882dde721 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117139 Aug 09 17:20:30.665651 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1275/2653] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:30.678796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fc740425-582a-4f78-ac9d-57d8baf8c260 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:30.682166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fc740425-582a-4f78-ac9d-57d8baf8c260 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:30.705613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc740425-582a-4f78-ac9d-57d8baf8c260 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:30.706745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc740425-582a-4f78-ac9d-57d8baf8c260 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:30.707836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc740425-582a-4f78-ac9d-57d8baf8c260 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:30.709708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc740425-582a-4f78-ac9d-57d8baf8c260 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:30.713735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc740425-582a-4f78-ac9d-57d8baf8c260 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:30.715054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc740425-582a-4f78-ac9d-57d8baf8c260 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:30.821648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:20:30.822521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:20:30.822521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:20:30.822944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:20:30.823535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:20:30.838435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:30.852464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:30.853197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:30.854224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:30.854862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:30.855464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:30.895284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Getting quotas for project 09c53ff5b89f4495958c9319d750833c. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:30.906938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Getting quotas for user 4ab568d7612c4f849e842d478b67016d and project 09c53ff5b89f4495958c9319d750833c. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:30.920929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:30.945365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:20:30.948337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:20:31.067118 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b79d70df-6bb3-4f1c-a75f-072055cb0766 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.743962 Aug 09 17:20:31.068758 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1379/2654] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:20:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:20:31.078404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:31.080028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:31.096535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:31.098612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:31.099911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:31.101581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:31.104807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:31.106158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:31.139762 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] HTTP exception thrown: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Request method failure captured: Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf HTTP/1.1 Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pczo4yn2csVvVGFAGqFEGz2DwF-au4PKSXIx0MUUhkP9PoB2rrpEPBQCijF6Ez4wPVfbdMocXc9Yt5Ek1sCMqgJcEBTtL1TB8J4WL-kWcx5XToJY4sbP6fy7Z0zYInriBBuI3TJBksq8krWwJPOEaP4IhhlJ-LuVHqjVE4h_BXitSE Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.21 Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 6137919ddef74e62ab6b7d51fe88ffa3 Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-InstanceActionsV221TestJSON-339397524 Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-InstanceActionsV221TestJSON-339397524 Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 6137919ddef74e62ab6b7d51fe88ffa3 Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-339397524 Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-InstanceActionsV221TestJSON-339397524-project Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 91c9d7a5f9e244a5b9da869293512785 Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-InstanceActionsV221TestJSON-339397524-project Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'c2c581b0-1246-4911-8650-449bb2b20fcf'} Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:31.144641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:31.152731 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:31.152731 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:31.152731 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:31.152731 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:31.152731 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:20:31.152731 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:20:31.152731 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:31.152731 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:20:31.156756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Returning 404 to user: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:20:31.160034 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e49c03c-cf37-4dd6-8a47-9c00dbc6625f tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 404 len: 111 microversion: 2.21 time: 0.088731 Aug 09 17:20:31.160711 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1380/2655] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:31 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:20:31.166206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-213822b8-d69a-4d91-aa68-c907c5e4eaf5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb5955e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:31.317168 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-213822b8-d69a-4d91-aa68-c907c5e4eaf5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.154702 Aug 09 17:20:31.326198 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1381/2656] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:31 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:31.349840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b63e11c9-5ecd-4f39-97fb-f96642c4eddb req-15a6bf1e-eabe-437e-8d67-6a7ca5a730a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5402fb-8e2e-4145-a53b-ec8b72c12e30", "name": "network-vif-plugged", "status": "completed", "tag": "0bdc8283-4340-486a-8b50-d9217a6aa69a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:31.419267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b63e11c9-5ecd-4f39-97fb-f96642c4eddb req-15a6bf1e-eabe-437e-8d67-6a7ca5a730a3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:31.422650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b63e11c9-5ecd-4f39-97fb-f96642c4eddb req-15a6bf1e-eabe-437e-8d67-6a7ca5a730a3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:31.428644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b63e11c9-5ecd-4f39-97fb-f96642c4eddb req-15a6bf1e-eabe-437e-8d67-6a7ca5a730a3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:31.480976 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b63e11c9-5ecd-4f39-97fb-f96642c4eddb req-15a6bf1e-eabe-437e-8d67-6a7ca5a730a3 service nova] Creating event network-vif-plugged:0bdc8283-4340-486a-8b50-d9217a6aa69a for instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 on n-h1-845781-6 Aug 09 17:20:31.492237 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b63e11c9-5ecd-4f39-97fb-f96642c4eddb req-15a6bf1e-eabe-437e-8d67-6a7ca5a730a3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162888 Aug 09 17:20:31.493878 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1382/2657] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:31.511017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-12580b2d-fdb8-41f9-ba29-896d1e9acf2c tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:31.512748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-12580b2d-fdb8-41f9-ba29-896d1e9acf2c tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:31.760609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fc740425-582a-4f78-ac9d-57d8baf8c260 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:31.770669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:31.777617 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fc740425-582a-4f78-ac9d-57d8baf8c260 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1318 microversion: 2.1 time: 1.109621 Aug 09 17:20:31.795214 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1276/2658] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:30 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1318 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:31.801520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a6530ca2-9044-4aa1-ba2e-d8044e777fca tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '.version_select at 0x7fbbcb94fc10>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:31.802444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a6530ca2-9044-4aa1-ba2e-d8044e777fca tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:31.811665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6530ca2-9044-4aa1-ba2e-d8044e777fca tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:31.812500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6530ca2-9044-4aa1-ba2e-d8044e777fca tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:31.813417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6530ca2-9044-4aa1-ba2e-d8044e777fca tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:31.814355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6530ca2-9044-4aa1-ba2e-d8044e777fca tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:31.815003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6530ca2-9044-4aa1-ba2e-d8044e777fca tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:31.816310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6530ca2-9044-4aa1-ba2e-d8044e777fca tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:31.896864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-12580b2d-fdb8-41f9-ba29-896d1e9acf2c tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:31.947204 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-12580b2d-fdb8-41f9-ba29-896d1e9acf2c tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1225 microversion: 2.1 time: 0.443779 Aug 09 17:20:31.964070 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1383/2659] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:31 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1225 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:32.025467 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a6530ca2-9044-4aa1-ba2e-d8044e777fca tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.226980 Aug 09 17:20:32.044515 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1277/2660] 10.222.0.93 () {60 vars in 1337 bytes} [Tue Aug 9 17:20:31 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf/os-instance-actions => generated 611 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:20:32.057374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d58b0cc0-55a6-4e0a-a898-09a02bab2d3d req-25091850-502b-490a-a3d3-6884f460d3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba0f579-8099-45bb-8e1d-a9e5b881587b", "tag": "6e9e7f82-272f-4a2c-bbb3-2d0634b38272"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:32.078057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d58b0cc0-55a6-4e0a-a898-09a02bab2d3d req-25091850-502b-490a-a3d3-6884f460d3b1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:32.080429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d58b0cc0-55a6-4e0a-a898-09a02bab2d3d req-25091850-502b-490a-a3d3-6884f460d3b1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:32.082209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d58b0cc0-55a6-4e0a-a898-09a02bab2d3d req-25091850-502b-490a-a3d3-6884f460d3b1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:32.108142 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d58b0cc0-55a6-4e0a-a898-09a02bab2d3d req-25091850-502b-490a-a3d3-6884f460d3b1 service nova] Creating event network-changed:6e9e7f82-272f-4a2c-bbb3-2d0634b38272 for instance 7ba0f579-8099-45bb-8e1d-a9e5b881587b on n-h1-845781-6 Aug 09 17:20:32.127411 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d58b0cc0-55a6-4e0a-a898-09a02bab2d3d req-25091850-502b-490a-a3d3-6884f460d3b1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077763 Aug 09 17:20:32.129334 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1278/2661] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:32.153594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:32.157208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:32.171806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:32.173250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:32.174404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:32.176165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:32.177687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:32.178860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:32.219406 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] HTTP exception thrown: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Request method failure captured: Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf HTTP/1.1 Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pczo4yn2csVvVGFAGqFEGz2DwF-au4PKSXIx0MUUhkP9PoB2rrpEPBQCijF6Ez4wPVfbdMocXc9Yt5Ek1sCMqgJcEBTtL1TB8J4WL-kWcx5XToJY4sbP6fy7Z0zYInriBBuI3TJBksq8krWwJPOEaP4IhhlJ-LuVHqjVE4h_BXitSE Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.21 Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 6137919ddef74e62ab6b7d51fe88ffa3 Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-InstanceActionsV221TestJSON-339397524 Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-InstanceActionsV221TestJSON-339397524 Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 6137919ddef74e62ab6b7d51fe88ffa3 Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-339397524 Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-InstanceActionsV221TestJSON-339397524-project Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 91c9d7a5f9e244a5b9da869293512785 Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-InstanceActionsV221TestJSON-339397524-project Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'c2c581b0-1246-4911-8650-449bb2b20fcf'} Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:20:32.224002 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:20:32.238362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:32.238362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:20:32.238362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:32.238362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:20:32.238362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:32.238362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:32.238362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:32.238362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:20:32.238362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:20:32.238362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:32.238362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:20:32.244922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Returning 404 to user: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:20:32.247591 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-650abacb-479d-4b70-bb0d-c71cd5be49de tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 404 len: 111 microversion: 2.21 time: 0.108017 Aug 09 17:20:32.249694 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1279/2662] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:20:32 2022] DELETE /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:20:32.271343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:32.272958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] [instance: c2c581b0-1246-4911-8650-449bb2b20fcf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:32.289107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:32.291676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:32.292947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:32.294820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:32.296457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:32.299827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:32.333402 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] HTTP exception thrown: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Request method failure captured: Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf HTTP/1.1 Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pczo4yn2csVvVGFAGqFEGz2DwF-au4PKSXIx0MUUhkP9PoB2rrpEPBQCijF6Ez4wPVfbdMocXc9Yt5Ek1sCMqgJcEBTtL1TB8J4WL-kWcx5XToJY4sbP6fy7Z0zYInriBBuI3TJBksq8krWwJPOEaP4IhhlJ-LuVHqjVE4h_BXitSE Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.21 Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 6137919ddef74e62ab6b7d51fe88ffa3 Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-InstanceActionsV221TestJSON-339397524 Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6137919ddef74e62ab6b7d51fe88ffa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-InstanceActionsV221TestJSON-339397524 Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 6137919ddef74e62ab6b7d51fe88ffa3 Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-339397524 Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-InstanceActionsV221TestJSON-339397524-project Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 91c9d7a5f9e244a5b9da869293512785 Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-InstanceActionsV221TestJSON-339397524-project Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'c2c581b0-1246-4911-8650-449bb2b20fcf'} Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:20:32.337166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:20:32.346242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:20:32.346242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:20:32.346242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:20:32.346242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:20:32.346242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:20:32.346242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:20:32.346242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. Aug 09 17:20:32.346242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:20:32.356159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] Returning 404 to user: Instance c2c581b0-1246-4911-8650-449bb2b20fcf could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:20:32.356159 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4acb96e2-c5c7-435c-a218-c3a496e55432 tempest-InstanceActionsV221TestJSON-339397524 tempest-InstanceActionsV221TestJSON-339397524-project] 10.222.0.93 "GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf" status: 404 len: 111 microversion: 2.21 time: 0.094987 Aug 09 17:20:32.365464 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1280/2663] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:32 2022] GET /compute/v2.1/servers/c2c581b0-1246-4911-8650-449bb2b20fcf => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:20:32.378548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c593c85d-bbab-4671-9f8a-76cda0aee7ec tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc9c7af0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:32.508935 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c593c85d-bbab-4671-9f8a-76cda0aee7ec tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.139794 Aug 09 17:20:32.511307 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1281/2664] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:32 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:32.576881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8bc59cea-44ba-432b-abe7-db174ee88a85 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:32.581679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8bc59cea-44ba-432b-abe7-db174ee88a85 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:32.601705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc59cea-44ba-432b-abe7-db174ee88a85 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:32.610968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc59cea-44ba-432b-abe7-db174ee88a85 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:32.611607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc59cea-44ba-432b-abe7-db174ee88a85 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:32.615302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc59cea-44ba-432b-abe7-db174ee88a85 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:32.619366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc59cea-44ba-432b-abe7-db174ee88a85 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:32.621126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc59cea-44ba-432b-abe7-db174ee88a85 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:32.806136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-da5fbcfb-8840-45c3-ae8b-f4e075cbf4e4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:32.807573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-da5fbcfb-8840-45c3-ae8b-f4e075cbf4e4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:32.820039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da5fbcfb-8840-45c3-ae8b-f4e075cbf4e4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:32.821211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da5fbcfb-8840-45c3-ae8b-f4e075cbf4e4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:32.821863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da5fbcfb-8840-45c3-ae8b-f4e075cbf4e4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:32.823063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da5fbcfb-8840-45c3-ae8b-f4e075cbf4e4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:32.823799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da5fbcfb-8840-45c3-ae8b-f4e075cbf4e4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:32.824454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da5fbcfb-8840-45c3-ae8b-f4e075cbf4e4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:33.533659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8bc59cea-44ba-432b-abe7-db174ee88a85 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:33.561405 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8bc59cea-44ba-432b-abe7-db174ee88a85 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1315 microversion: 2.1 time: 1.595728 Aug 09 17:20:33.573537 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1384/2665] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:31 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1315 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:33.616822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f67ced8-249d-41d1-91fc-cd0650b3ba67 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:33.623017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f67ced8-249d-41d1-91fc-cd0650b3ba67 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:33.673854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f67ced8-249d-41d1-91fc-cd0650b3ba67 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:33.679084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f67ced8-249d-41d1-91fc-cd0650b3ba67 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:33.686895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f67ced8-249d-41d1-91fc-cd0650b3ba67 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:33.694750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f67ced8-249d-41d1-91fc-cd0650b3ba67 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:33.704875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f67ced8-249d-41d1-91fc-cd0650b3ba67 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:33.710204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f67ced8-249d-41d1-91fc-cd0650b3ba67 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:34.065024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9f67ced8-249d-41d1-91fc-cd0650b3ba67 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:34.116314 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f67ced8-249d-41d1-91fc-cd0650b3ba67 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1295 microversion: 2.1 time: 0.525718 Aug 09 17:20:34.123393 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1385/2666] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:33 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1295 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:34.144811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-da5fbcfb-8840-45c3-ae8b-f4e075cbf4e4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:34.163957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-55cdb56c-328f-42ea-bc4f-f55709c374af tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb873a60>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:34.166451 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-da5fbcfb-8840-45c3-ae8b-f4e075cbf4e4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1318 microversion: 2.1 time: 1.366998 Aug 09 17:20:34.169058 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1282/2667] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:32 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1318 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:34.328499 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-55cdb56c-328f-42ea-bc4f-f55709c374af tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.188084 Aug 09 17:20:34.329213 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1386/2668] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:34 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:34.614653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-51f67608-a9c3-4db3-8984-3ee131dce231 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:34.620275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-51f67608-a9c3-4db3-8984-3ee131dce231 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:34.663588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51f67608-a9c3-4db3-8984-3ee131dce231 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:34.664706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51f67608-a9c3-4db3-8984-3ee131dce231 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:34.665527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51f67608-a9c3-4db3-8984-3ee131dce231 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:34.666884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51f67608-a9c3-4db3-8984-3ee131dce231 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:34.669214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51f67608-a9c3-4db3-8984-3ee131dce231 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:34.670023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51f67608-a9c3-4db3-8984-3ee131dce231 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:35.170620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d280f32-41df-444b-bc0e-dada217a90e6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:35.187697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9d280f32-41df-444b-bc0e-dada217a90e6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:35.233907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d280f32-41df-444b-bc0e-dada217a90e6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:35.245669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d280f32-41df-444b-bc0e-dada217a90e6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:35.256616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d280f32-41df-444b-bc0e-dada217a90e6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:35.257999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d280f32-41df-444b-bc0e-dada217a90e6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:35.258898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d280f32-41df-444b-bc0e-dada217a90e6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:35.259751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d280f32-41df-444b-bc0e-dada217a90e6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:35.504621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9d280f32-41df-444b-bc0e-dada217a90e6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:35.525883 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9d280f32-41df-444b-bc0e-dada217a90e6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1283 microversion: 2.1 time: 0.364660 Aug 09 17:20:35.541650 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1387/2669] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:35 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1283 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:35.553085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e08be5e2-ce78-4801-ae04-e787218a2480 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:35.553970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e08be5e2-ce78-4801-ae04-e787218a2480 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:35.565100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e08be5e2-ce78-4801-ae04-e787218a2480 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:35.566548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e08be5e2-ce78-4801-ae04-e787218a2480 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:35.567225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e08be5e2-ce78-4801-ae04-e787218a2480 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:35.569757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e08be5e2-ce78-4801-ae04-e787218a2480 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:35.571440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e08be5e2-ce78-4801-ae04-e787218a2480 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:35.572281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e08be5e2-ce78-4801-ae04-e787218a2480 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:36.763006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-51f67608-a9c3-4db3-8984-3ee131dce231 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:36.831977 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-51f67608-a9c3-4db3-8984-3ee131dce231 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1315 microversion: 2.1 time: 2.224444 Aug 09 17:20:36.845661 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1283/2670] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:34 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1315 bytes in 2241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:36.893773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-152a69ba-1994-4da3-adb8-49f017751911 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb63b700>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:36.913268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e08be5e2-ce78-4801-ae04-e787218a2480 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:36.958256 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e08be5e2-ce78-4801-ae04-e787218a2480 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1318 microversion: 2.1 time: 1.415340 Aug 09 17:20:36.958875 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1388/2671] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:35 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1318 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:36.995667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f96ca77-134c-49d8-8a26-7d6094a3ea31 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:36.999600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f96ca77-134c-49d8-8a26-7d6094a3ea31 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:37.021254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f96ca77-134c-49d8-8a26-7d6094a3ea31 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:37.021891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f96ca77-134c-49d8-8a26-7d6094a3ea31 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:37.022434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f96ca77-134c-49d8-8a26-7d6094a3ea31 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:37.023250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f96ca77-134c-49d8-8a26-7d6094a3ea31 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:37.023785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f96ca77-134c-49d8-8a26-7d6094a3ea31 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:37.034737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f96ca77-134c-49d8-8a26-7d6094a3ea31 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:37.058630 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-152a69ba-1994-4da3-adb8-49f017751911 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.195548 Aug 09 17:20:37.078622 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1284/2672] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:36 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:37.368885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f96ca77-134c-49d8-8a26-7d6094a3ea31 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:37.450071 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f96ca77-134c-49d8-8a26-7d6094a3ea31 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1283 microversion: 2.1 time: 0.457728 Aug 09 17:20:37.455183 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1389/2673] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:36 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1283 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:37.886017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3f375205-1733-44e4-88dd-2aad03f835f7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:37.891760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3f375205-1733-44e4-88dd-2aad03f835f7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:37.928411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f375205-1733-44e4-88dd-2aad03f835f7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:37.930753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f375205-1733-44e4-88dd-2aad03f835f7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:37.935910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f375205-1733-44e4-88dd-2aad03f835f7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:37.938209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f375205-1733-44e4-88dd-2aad03f835f7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:37.945772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f375205-1733-44e4-88dd-2aad03f835f7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:37.947354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f375205-1733-44e4-88dd-2aad03f835f7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:38.004909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-45dc5b80-8891-4271-b8c8-f19f2d7ecc19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:38.011364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-45dc5b80-8891-4271-b8c8-f19f2d7ecc19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:38.041920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45dc5b80-8891-4271-b8c8-f19f2d7ecc19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:38.044649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45dc5b80-8891-4271-b8c8-f19f2d7ecc19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:38.048716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45dc5b80-8891-4271-b8c8-f19f2d7ecc19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:38.059986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45dc5b80-8891-4271-b8c8-f19f2d7ecc19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:38.061359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45dc5b80-8891-4271-b8c8-f19f2d7ecc19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:38.062414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45dc5b80-8891-4271-b8c8-f19f2d7ecc19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:39.888968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3f375205-1733-44e4-88dd-2aad03f835f7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:39.983586 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3f375205-1733-44e4-88dd-2aad03f835f7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1503 microversion: 2.1 time: 2.107941 Aug 09 17:20:39.984724 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1285/2674] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:37 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1503 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:40.009188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-45dc5b80-8891-4271-b8c8-f19f2d7ecc19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:40.027715 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-45dc5b80-8891-4271-b8c8-f19f2d7ecc19 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1318 microversion: 2.1 time: 2.035498 Aug 09 17:20:40.029909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6ca403f0-f129-4c9e-babf-bc07e827cb24 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb95ddc0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:40.051825 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1390/2675] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:37 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1318 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:40.057841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bdd4413f-53d7-4334-90f4-69de3ee0fd03 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:40.062519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bdd4413f-53d7-4334-90f4-69de3ee0fd03 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:40.081953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdd4413f-53d7-4334-90f4-69de3ee0fd03 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:40.082793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdd4413f-53d7-4334-90f4-69de3ee0fd03 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:40.083429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdd4413f-53d7-4334-90f4-69de3ee0fd03 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:40.084413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdd4413f-53d7-4334-90f4-69de3ee0fd03 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:40.084890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdd4413f-53d7-4334-90f4-69de3ee0fd03 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:40.085332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdd4413f-53d7-4334-90f4-69de3ee0fd03 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:40.238277 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6ca403f0-f129-4c9e-babf-bc07e827cb24 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.230494 Aug 09 17:20:40.244142 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1286/2676] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:40 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:40.280009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bdd4413f-53d7-4334-90f4-69de3ee0fd03 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:40.295959 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bdd4413f-53d7-4334-90f4-69de3ee0fd03 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1283 microversion: 2.1 time: 0.241412 Aug 09 17:20:40.297933 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1391/2677] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:40 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1283 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:40.298315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fcc48247-3b5e-45d0-bc05-a0bdedbd2543 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:40.354886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fcc48247-3b5e-45d0-bc05-a0bdedbd2543 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:40.355851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fcc48247-3b5e-45d0-bc05-a0bdedbd2543 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:40.356719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fcc48247-3b5e-45d0-bc05-a0bdedbd2543 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:40.546462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fcc48247-3b5e-45d0-bc05-a0bdedbd2543 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Going to try to stop instance {{(pid=119432) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 17:20:40.831837 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fcc48247-3b5e-45d0-bc05-a0bdedbd2543 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30/action" status: 202 len: 0 microversion: 2.1 time: 0.562382 Aug 09 17:20:40.834892 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1287/2678] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:20:40 2022] POST /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:20:40.849220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ab2e3e8e-1752-486c-a41f-b69ef4cf1b2d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:40.856360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ab2e3e8e-1752-486c-a41f-b69ef4cf1b2d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:40.882331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:40.914019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e3e8e-1752-486c-a41f-b69ef4cf1b2d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:40.921073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e3e8e-1752-486c-a41f-b69ef4cf1b2d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:40.922457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e3e8e-1752-486c-a41f-b69ef4cf1b2d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:40.932346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e3e8e-1752-486c-a41f-b69ef4cf1b2d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:40.936861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e3e8e-1752-486c-a41f-b69ef4cf1b2d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:40.938009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e3e8e-1752-486c-a41f-b69ef4cf1b2d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:41.071328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5101281d-2cbf-4e94-85a7-4e690ee05c86 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:41.072735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5101281d-2cbf-4e94-85a7-4e690ee05c86 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:41.134721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5101281d-2cbf-4e94-85a7-4e690ee05c86 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:41.136873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5101281d-2cbf-4e94-85a7-4e690ee05c86 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:41.141009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5101281d-2cbf-4e94-85a7-4e690ee05c86 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:41.144709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5101281d-2cbf-4e94-85a7-4e690ee05c86 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:41.145962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5101281d-2cbf-4e94-85a7-4e690ee05c86 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:41.149665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5101281d-2cbf-4e94-85a7-4e690ee05c86 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:41.939025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:41.980220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ab2e3e8e-1752-486c-a41f-b69ef4cf1b2d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:42.005551 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ab2e3e8e-1752-486c-a41f-b69ef4cf1b2d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1513 microversion: 2.1 time: 1.162456 Aug 09 17:20:42.006566 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1392/2679] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:40 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1513 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:42.016618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b83d99fa-12ff-4dc2-9105-6bf15d323910 req-7487942c-d464-40e7-a4fc-241bde86d099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec097021-2408-4328-b677-266d832bd565", "name": "network-vif-plugged", "status": "completed", "tag": "0278004c-6d50-4881-b022-30f9a082b3c2"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:42.042390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b83d99fa-12ff-4dc2-9105-6bf15d323910 req-7487942c-d464-40e7-a4fc-241bde86d099 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:42.044335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b83d99fa-12ff-4dc2-9105-6bf15d323910 req-7487942c-d464-40e7-a4fc-241bde86d099 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:42.046847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b83d99fa-12ff-4dc2-9105-6bf15d323910 req-7487942c-d464-40e7-a4fc-241bde86d099 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:42.078474 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b83d99fa-12ff-4dc2-9105-6bf15d323910 req-7487942c-d464-40e7-a4fc-241bde86d099 service nova] Creating event network-vif-plugged:0278004c-6d50-4881-b022-30f9a082b3c2 for instance ec097021-2408-4328-b677-266d832bd565 on n-h1-845781-6 Aug 09 17:20:42.092251 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b83d99fa-12ff-4dc2-9105-6bf15d323910 req-7487942c-d464-40e7-a4fc-241bde86d099 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082986 Aug 09 17:20:42.093204 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1393/2680] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:42.119498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb469568-e1b1-4c2f-923a-0af6bc0f9b1d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb667820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:42.223336 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb469568-e1b1-4c2f-923a-0af6bc0f9b1d tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.125237 Aug 09 17:20:42.232399 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1394/2681] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:42 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:42.255081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6027718c-19dc-4d67-9072-6a0179a236ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:42.256863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6027718c-19dc-4d67-9072-6a0179a236ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:42.277773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6027718c-19dc-4d67-9072-6a0179a236ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:42.288924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6027718c-19dc-4d67-9072-6a0179a236ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:42.290248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6027718c-19dc-4d67-9072-6a0179a236ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:42.291480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6027718c-19dc-4d67-9072-6a0179a236ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:42.292392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6027718c-19dc-4d67-9072-6a0179a236ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:42.293254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6027718c-19dc-4d67-9072-6a0179a236ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:42.989044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5101281d-2cbf-4e94-85a7-4e690ee05c86 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:43.002325 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5101281d-2cbf-4e94-85a7-4e690ee05c86 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1318 microversion: 2.1 time: 1.950338 Aug 09 17:20:43.017396 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1288/2682] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:41 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1318 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:43.031308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e00cac77-bc9a-4e23-b2a7-8d888865f5ba tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:43.031991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e00cac77-bc9a-4e23-b2a7-8d888865f5ba tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:43.034865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=55 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:43.063611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e00cac77-bc9a-4e23-b2a7-8d888865f5ba tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:43.064488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e00cac77-bc9a-4e23-b2a7-8d888865f5ba tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:43.065200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e00cac77-bc9a-4e23-b2a7-8d888865f5ba tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:43.066911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e00cac77-bc9a-4e23-b2a7-8d888865f5ba tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:43.067821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e00cac77-bc9a-4e23-b2a7-8d888865f5ba tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:43.068764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e00cac77-bc9a-4e23-b2a7-8d888865f5ba tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:44.048421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e00cac77-bc9a-4e23-b2a7-8d888865f5ba tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:44.097485 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e00cac77-bc9a-4e23-b2a7-8d888865f5ba tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1513 microversion: 2.1 time: 1.068948 Aug 09 17:20:44.109673 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1289/2683] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:43 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1513 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:20:44.150177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aa96a3ad-61b8-4f90-8a00-9157f415cb2c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb673430>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:44.211871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6027718c-19dc-4d67-9072-6a0179a236ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:44.227145 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6027718c-19dc-4d67-9072-6a0179a236ad tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1325 microversion: 2.1 time: 1.987221 Aug 09 17:20:44.242034 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1395/2684] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:42 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1325 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:44.244799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8318b4a6-2181-49e2-9914-940417ac63d2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:44.245467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8318b4a6-2181-49e2-9914-940417ac63d2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:44.261650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8318b4a6-2181-49e2-9914-940417ac63d2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:44.262397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8318b4a6-2181-49e2-9914-940417ac63d2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:44.264080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8318b4a6-2181-49e2-9914-940417ac63d2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:44.265305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8318b4a6-2181-49e2-9914-940417ac63d2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:44.266060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8318b4a6-2181-49e2-9914-940417ac63d2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:44.266561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8318b4a6-2181-49e2-9914-940417ac63d2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:44.349526 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aa96a3ad-61b8-4f90-8a00-9157f415cb2c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.237958 Aug 09 17:20:44.355166 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1290/2685] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:44 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:44.934791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8318b4a6-2181-49e2-9914-940417ac63d2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:44.980588 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8318b4a6-2181-49e2-9914-940417ac63d2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1318 microversion: 2.1 time: 0.745643 Aug 09 17:20:44.990494 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1396/2686] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:44 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1318 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:45.122160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b945778c-cb58-48c2-ad46-1b2775fa6d6c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:45.123019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b945778c-cb58-48c2-ad46-1b2775fa6d6c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:45.146215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b945778c-cb58-48c2-ad46-1b2775fa6d6c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:45.154980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b945778c-cb58-48c2-ad46-1b2775fa6d6c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:45.155576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b945778c-cb58-48c2-ad46-1b2775fa6d6c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:45.156392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b945778c-cb58-48c2-ad46-1b2775fa6d6c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:45.156879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b945778c-cb58-48c2-ad46-1b2775fa6d6c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:45.157321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b945778c-cb58-48c2-ad46-1b2775fa6d6c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:45.251660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-675affe6-b089-4434-97b9-f34d4e2826bb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:45.253191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-675affe6-b089-4434-97b9-f34d4e2826bb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:45.266176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675affe6-b089-4434-97b9-f34d4e2826bb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:45.266629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675affe6-b089-4434-97b9-f34d4e2826bb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:45.267101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675affe6-b089-4434-97b9-f34d4e2826bb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:45.271016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675affe6-b089-4434-97b9-f34d4e2826bb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:45.274537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675affe6-b089-4434-97b9-f34d4e2826bb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:45.275284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675affe6-b089-4434-97b9-f34d4e2826bb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:46.601137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-675affe6-b089-4434-97b9-f34d4e2826bb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:46.634058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:46.647992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-675affe6-b089-4434-97b9-f34d4e2826bb tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1325 microversion: 2.1 time: 1.396463 Aug 09 17:20:46.660572 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1397/2687] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:45 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1325 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:20:46.686476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e06f3b3-0861-4ede-897a-c28d4fc99c65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcae029d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:46.867362 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e06f3b3-0861-4ede-897a-c28d4fc99c65 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.204310 Aug 09 17:20:46.876925 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1398/2688] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:46 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:46.934974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29dcb859-4361-46cb-b5a9-ba6755f6cd40 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:46.941683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-29dcb859-4361-46cb-b5a9-ba6755f6cd40 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:46.957697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b945778c-cb58-48c2-ad46-1b2775fa6d6c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:46.983130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29dcb859-4361-46cb-b5a9-ba6755f6cd40 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:46.984636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29dcb859-4361-46cb-b5a9-ba6755f6cd40 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:46.993770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29dcb859-4361-46cb-b5a9-ba6755f6cd40 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:46.997075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29dcb859-4361-46cb-b5a9-ba6755f6cd40 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:47.006384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29dcb859-4361-46cb-b5a9-ba6755f6cd40 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:47.009153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29dcb859-4361-46cb-b5a9-ba6755f6cd40 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:47.019134 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b945778c-cb58-48c2-ad46-1b2775fa6d6c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1513 microversion: 2.1 time: 1.883759 Aug 09 17:20:47.027582 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1291/2689] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:45 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1513 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:47.697192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-874dd101-6c35-4bfe-a615-7e2abe62832e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:47.703535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-874dd101-6c35-4bfe-a615-7e2abe62832e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:47.758556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-874dd101-6c35-4bfe-a615-7e2abe62832e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:47.759115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-874dd101-6c35-4bfe-a615-7e2abe62832e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:47.759580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-874dd101-6c35-4bfe-a615-7e2abe62832e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:47.768795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-874dd101-6c35-4bfe-a615-7e2abe62832e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:47.769480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-874dd101-6c35-4bfe-a615-7e2abe62832e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:47.777870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-874dd101-6c35-4bfe-a615-7e2abe62832e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:47.885095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-29dcb859-4361-46cb-b5a9-ba6755f6cd40 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:47.899084 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-29dcb859-4361-46cb-b5a9-ba6755f6cd40 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1318 microversion: 2.1 time: 1.003294 Aug 09 17:20:47.899714 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1399/2690] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:46 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1318 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:48.291616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1005541855", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8b88de5d-20c1-43f7-96af-6509f4aa64b2"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:48.547150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] validate_networks() for [('8b88de5d-20c1-43f7-96af-6509f4aa64b2', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:20:49.761534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:20:49.762785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:20:49.763459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:20:49.764245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:20:49.764870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:20:49.795805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:49.798340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:49.801394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:49.804728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:49.806307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:49.808048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:49.868552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Getting quotas for project c1f493e3c15a484c9734782994007480. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:49.887761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Getting quotas for user 9d9fad7bbf774879a55b6dc21e181eeb and project c1f493e3c15a484c9734782994007480. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:49.932707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:20:49.935738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:20:50.090839 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d2186a86-2b68-4918-a198-0da5e991d4cf tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.189921 Aug 09 17:20:50.091951 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1400/2691] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:20:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:20:50.097260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d70e6221-a694-4e2e-826b-54d5433f71f5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb4fb550>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:50.149604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-874dd101-6c35-4bfe-a615-7e2abe62832e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:50.223054 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-874dd101-6c35-4bfe-a615-7e2abe62832e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1325 microversion: 2.1 time: 2.535708 Aug 09 17:20:50.240257 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1292/2692] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:47 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1325 bytes in 2544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:50.280176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e4cf21bc-fad3-414e-86a2-046d143ee9e3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:50.292090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e4cf21bc-fad3-414e-86a2-046d143ee9e3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:50.344467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cf21bc-fad3-414e-86a2-046d143ee9e3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:50.346422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cf21bc-fad3-414e-86a2-046d143ee9e3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:50.348040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cf21bc-fad3-414e-86a2-046d143ee9e3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:50.352028 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d70e6221-a694-4e2e-826b-54d5433f71f5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.258603 Aug 09 17:20:50.352629 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1401/2693] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:50 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:50.354775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cf21bc-fad3-414e-86a2-046d143ee9e3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:50.356334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cf21bc-fad3-414e-86a2-046d143ee9e3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:50.368309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4cf21bc-fad3-414e-86a2-046d143ee9e3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:50.387900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5b3c3329-7421-4714-858d-b3b88743da62 req-1ddacedf-6dbb-46a4-9447-4d94a650a46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba0f579-8099-45bb-8e1d-a9e5b881587b", "name": "network-vif-plugged", "status": "completed", "tag": "6e9e7f82-272f-4a2c-bbb3-2d0634b38272"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:50.429487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b3c3329-7421-4714-858d-b3b88743da62 req-1ddacedf-6dbb-46a4-9447-4d94a650a46b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:50.429998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b3c3329-7421-4714-858d-b3b88743da62 req-1ddacedf-6dbb-46a4-9447-4d94a650a46b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:50.431748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5b3c3329-7421-4714-858d-b3b88743da62 req-1ddacedf-6dbb-46a4-9447-4d94a650a46b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:50.475936 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5b3c3329-7421-4714-858d-b3b88743da62 req-1ddacedf-6dbb-46a4-9447-4d94a650a46b service nova] Creating event network-vif-plugged:6e9e7f82-272f-4a2c-bbb3-2d0634b38272 for instance 7ba0f579-8099-45bb-8e1d-a9e5b881587b on n-h1-845781-6 Aug 09 17:20:50.494600 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5b3c3329-7421-4714-858d-b3b88743da62 req-1ddacedf-6dbb-46a4-9447-4d94a650a46b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136433 Aug 09 17:20:50.498285 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1402/2694] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:50.527062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8661a440-fb7e-4375-a852-af38048c0e77 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:50.532301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8661a440-fb7e-4375-a852-af38048c0e77 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:50.567395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8661a440-fb7e-4375-a852-af38048c0e77 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:50.568327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8661a440-fb7e-4375-a852-af38048c0e77 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:50.571336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8661a440-fb7e-4375-a852-af38048c0e77 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:50.579296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8661a440-fb7e-4375-a852-af38048c0e77 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:50.580139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8661a440-fb7e-4375-a852-af38048c0e77 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:50.581337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8661a440-fb7e-4375-a852-af38048c0e77 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:50.965427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8661a440-fb7e-4375-a852-af38048c0e77 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:50.979679 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8661a440-fb7e-4375-a852-af38048c0e77 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1318 microversion: 2.1 time: 0.479726 Aug 09 17:20:50.980296 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1403/2695] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:50 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:50.999964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-568e19f4-3482-4b95-9424-23088786661a req-f1ef0eca-530d-4117-b150-f0f39c37551c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29188f6a-3896-4045-9ad5-bbf0997ead47", "tag": "d69fd5a4-38f8-49e1-9d53-5bdd6b6bdb82"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:51.022124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-568e19f4-3482-4b95-9424-23088786661a req-f1ef0eca-530d-4117-b150-f0f39c37551c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:51.022638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-568e19f4-3482-4b95-9424-23088786661a req-f1ef0eca-530d-4117-b150-f0f39c37551c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:51.028094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-568e19f4-3482-4b95-9424-23088786661a req-f1ef0eca-530d-4117-b150-f0f39c37551c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:51.054791 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-568e19f4-3482-4b95-9424-23088786661a req-f1ef0eca-530d-4117-b150-f0f39c37551c service nova] Creating event network-changed:d69fd5a4-38f8-49e1-9d53-5bdd6b6bdb82 for instance 29188f6a-3896-4045-9ad5-bbf0997ead47 on n-h2-845781-6 Aug 09 17:20:51.060373 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-568e19f4-3482-4b95-9424-23088786661a req-f1ef0eca-530d-4117-b150-f0f39c37551c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078794 Aug 09 17:20:51.065128 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1404/2696] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:20:51.088212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-80264fde-312b-495a-ba35-18e2049a82b1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:51.089266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-80264fde-312b-495a-ba35-18e2049a82b1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:51.273856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-80264fde-312b-495a-ba35-18e2049a82b1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:51.317783 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-80264fde-312b-495a-ba35-18e2049a82b1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1224 microversion: 2.1 time: 0.248991 Aug 09 17:20:51.324336 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1405/2697] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:51 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1224 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:51.363281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-901a37f2-e1ba-4bf0-b9a7-b3451c9e1db4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:51.365414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-901a37f2-e1ba-4bf0-b9a7-b3451c9e1db4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:51.410298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901a37f2-e1ba-4bf0-b9a7-b3451c9e1db4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:51.416676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901a37f2-e1ba-4bf0-b9a7-b3451c9e1db4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:51.418122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901a37f2-e1ba-4bf0-b9a7-b3451c9e1db4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:51.425762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901a37f2-e1ba-4bf0-b9a7-b3451c9e1db4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:51.429697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901a37f2-e1ba-4bf0-b9a7-b3451c9e1db4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:51.432750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901a37f2-e1ba-4bf0-b9a7-b3451c9e1db4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:52.169215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-901a37f2-e1ba-4bf0-b9a7-b3451c9e1db4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:52.188899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e4cf21bc-fad3-414e-86a2-046d143ee9e3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:52.202432 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-901a37f2-e1ba-4bf0-b9a7-b3451c9e1db4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1325 microversion: 2.1 time: 0.875471 Aug 09 17:20:52.208156 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1406/2698] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:51 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1325 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:52.210701 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e4cf21bc-fad3-414e-86a2-046d143ee9e3 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1513 microversion: 2.1 time: 1.965059 Aug 09 17:20:52.220226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4f162c7-1079-4199-850d-c14e379d3a03 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcbb25820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:52.224174 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1293/2699] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:50 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1513 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:52.412444 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4f162c7-1079-4199-850d-c14e379d3a03 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.201994 Aug 09 17:20:52.413788 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1407/2700] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:52 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:52.454342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5caac928-7096-4165-9a23-1cc3140b5e9a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:52.456296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5caac928-7096-4165-9a23-1cc3140b5e9a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:52.496812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5caac928-7096-4165-9a23-1cc3140b5e9a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:52.498314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5caac928-7096-4165-9a23-1cc3140b5e9a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:52.499752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5caac928-7096-4165-9a23-1cc3140b5e9a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:52.501411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5caac928-7096-4165-9a23-1cc3140b5e9a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:52.502577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5caac928-7096-4165-9a23-1cc3140b5e9a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:52.506295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5caac928-7096-4165-9a23-1cc3140b5e9a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:52.798374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2134134766", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": "none"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:53.048388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:20:53.049704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:20:53.050417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:20:53.051760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:20:53.052417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:20:53.105411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:53.107507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:53.108000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:53.108810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:53.113080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:53.114636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:53.119921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5caac928-7096-4165-9a23-1cc3140b5e9a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:53.147340 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5caac928-7096-4165-9a23-1cc3140b5e9a tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1318 microversion: 2.1 time: 0.726408 Aug 09 17:20:53.172553 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1408/2701] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:52 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:53.181761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Getting quotas for project 8ac3646b00fa4b85b8c933faa44ec4f9. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:53.183496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21eee5b5-4034-4d52-af43-1bcb0ff785a0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:53.186104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-21eee5b5-4034-4d52-af43-1bcb0ff785a0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:53.200434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21eee5b5-4034-4d52-af43-1bcb0ff785a0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:53.210926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21eee5b5-4034-4d52-af43-1bcb0ff785a0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:53.211360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Getting quotas for user ef798302aba8493597e7297eaa238bbf and project 8ac3646b00fa4b85b8c933faa44ec4f9. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:53.213029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21eee5b5-4034-4d52-af43-1bcb0ff785a0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:53.214960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21eee5b5-4034-4d52-af43-1bcb0ff785a0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:53.223049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21eee5b5-4034-4d52-af43-1bcb0ff785a0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:53.224318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21eee5b5-4034-4d52-af43-1bcb0ff785a0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:53.276013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:20:53.291005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: da01d112-b232-474e-bb72-683e9772a01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:20:53.465487 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-22bb11c9-7da6-4b2f-b642-0f95eac2f22e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.238803 Aug 09 17:20:53.468252 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1294/2702] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:20:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:20:53.490206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-476f191e-3541-40b6-b9db-6f9dbecd5970 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:53.491361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-476f191e-3541-40b6-b9db-6f9dbecd5970 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:53.520879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-21eee5b5-4034-4d52-af43-1bcb0ff785a0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:53.521209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-476f191e-3541-40b6-b9db-6f9dbecd5970 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:53.521705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-476f191e-3541-40b6-b9db-6f9dbecd5970 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:53.522527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-476f191e-3541-40b6-b9db-6f9dbecd5970 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:53.532097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-476f191e-3541-40b6-b9db-6f9dbecd5970 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:53.532822 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-21eee5b5-4034-4d52-af43-1bcb0ff785a0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1220 microversion: 2.1 time: 0.367229 Aug 09 17:20:53.533025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-476f191e-3541-40b6-b9db-6f9dbecd5970 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:53.534119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-476f191e-3541-40b6-b9db-6f9dbecd5970 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:53.535481 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1409/2703] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:53 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1220 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:53.545991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-067facdc-2885-4054-9907-c4ba7bee95e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:53.551161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-067facdc-2885-4054-9907-c4ba7bee95e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:53.589155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-067facdc-2885-4054-9907-c4ba7bee95e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:53.591541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-067facdc-2885-4054-9907-c4ba7bee95e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:53.601072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-067facdc-2885-4054-9907-c4ba7bee95e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:53.609983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-067facdc-2885-4054-9907-c4ba7bee95e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:53.616930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-067facdc-2885-4054-9907-c4ba7bee95e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:53.621899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-067facdc-2885-4054-9907-c4ba7bee95e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:54.500382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-067facdc-2885-4054-9907-c4ba7bee95e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:54.552526 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-067facdc-2885-4054-9907-c4ba7bee95e4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1325 microversion: 2.1 time: 1.013702 Aug 09 17:20:54.569489 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1410/2704] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:53 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1325 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:54.596631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-750faf2f-46a2-4f3e-a3ba-7706fbf02521 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc8c8e50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:54.712894 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-750faf2f-46a2-4f3e-a3ba-7706fbf02521 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.140895 Aug 09 17:20:54.714249 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1411/2705] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:54 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:54.724525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-166a1b2d-9053-486d-bab2-77044b4a49a3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:54.726214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-166a1b2d-9053-486d-bab2-77044b4a49a3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: da01d112-b232-474e-bb72-683e9772a01e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:55.094871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-166a1b2d-9053-486d-bab2-77044b4a49a3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:55.122164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-166a1b2d-9053-486d-bab2-77044b4a49a3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:55.138988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-166a1b2d-9053-486d-bab2-77044b4a49a3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:55.140489 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-166a1b2d-9053-486d-bab2-77044b4a49a3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/da01d112-b232-474e-bb72-683e9772a01e" status: 200 len: 1278 microversion: 2.47 time: 0.423674 Aug 09 17:20:55.187327 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1412/2706] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:54 2022] GET /compute/v2.1/servers/da01d112-b232-474e-bb72-683e9772a01e => generated 1278 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:55.236230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-68b25f70-a132-43ab-a7bf-e320dff10c0b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:55.268991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-68b25f70-a132-43ab-a7bf-e320dff10c0b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:55.316426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68b25f70-a132-43ab-a7bf-e320dff10c0b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:55.333126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68b25f70-a132-43ab-a7bf-e320dff10c0b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:55.333408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68b25f70-a132-43ab-a7bf-e320dff10c0b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:55.334167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68b25f70-a132-43ab-a7bf-e320dff10c0b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:55.334647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68b25f70-a132-43ab-a7bf-e320dff10c0b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:55.335070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68b25f70-a132-43ab-a7bf-e320dff10c0b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:56.794799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-68b25f70-a132-43ab-a7bf-e320dff10c0b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:56.854209 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-68b25f70-a132-43ab-a7bf-e320dff10c0b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1467 microversion: 2.1 time: 1.642794 Aug 09 17:20:56.856606 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1413/2707] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:55 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1467 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:56.866594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e74c4d8a-5449-4954-a0ad-357003927dc1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:56.869697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e74c4d8a-5449-4954-a0ad-357003927dc1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:56.882463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e74c4d8a-5449-4954-a0ad-357003927dc1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:56.883774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e74c4d8a-5449-4954-a0ad-357003927dc1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:56.884941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e74c4d8a-5449-4954-a0ad-357003927dc1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:56.887489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e74c4d8a-5449-4954-a0ad-357003927dc1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:56.888694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e74c4d8a-5449-4954-a0ad-357003927dc1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:56.889803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e74c4d8a-5449-4954-a0ad-357003927dc1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:57.113983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e74c4d8a-5449-4954-a0ad-357003927dc1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:57.150747 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e74c4d8a-5449-4954-a0ad-357003927dc1 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1282 microversion: 2.1 time: 0.291698 Aug 09 17:20:57.164866 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1414/2708] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:56 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1282 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:57.192727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-804757679", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": "none"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:57.353765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:20:57.354549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:20:57.358733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:20:57.359607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:20:57.360432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:20:57.413692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:57.416099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:57.419010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:57.422596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:57.425653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:57.429898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:57.554552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-476f191e-3541-40b6-b9db-6f9dbecd5970 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:57.568219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Getting quotas for project 8ac3646b00fa4b85b8c933faa44ec4f9. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:20:57.578790 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-476f191e-3541-40b6-b9db-6f9dbecd5970 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1513 microversion: 2.1 time: 4.108558 Aug 09 17:20:57.582088 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1295/2709] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:53 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1513 bytes in 4113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:57.586467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Getting quotas for user ef798302aba8493597e7297eaa238bbf and project 8ac3646b00fa4b85b8c933faa44ec4f9. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:20:57.594184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d56cbe7a-3db1-4129-a77b-af5b6f1dddde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:57.596268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d56cbe7a-3db1-4129-a77b-af5b6f1dddde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:57.612514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d56cbe7a-3db1-4129-a77b-af5b6f1dddde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:57.613779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d56cbe7a-3db1-4129-a77b-af5b6f1dddde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:57.615848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d56cbe7a-3db1-4129-a77b-af5b6f1dddde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:57.617574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d56cbe7a-3db1-4129-a77b-af5b6f1dddde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:57.619301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d56cbe7a-3db1-4129-a77b-af5b6f1dddde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:57.620482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d56cbe7a-3db1-4129-a77b-af5b6f1dddde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:57.628684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:20:57.640805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:20:57.772996 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-830658ff-33ed-4098-96ec-f25e3327e87e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.605594 Aug 09 17:20:57.775000 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1415/2710] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:20:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:20:57.787468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1ec4311e-6a5a-40ff-9907-e50b955ecede tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb4fb430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:57.894666 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1ec4311e-6a5a-40ff-9907-e50b955ecede tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1455 microversion: 2.1 time: 0.114103 Aug 09 17:20:57.898693 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1416/2711] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:20:57 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:57.919055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bf48ac5d-51fb-4bc5-a5bd-be91200b6169 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:57.921042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bf48ac5d-51fb-4bc5-a5bd-be91200b6169 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ec097021-2408-4328-b677-266d832bd565] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:57.948758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:20:57.957896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf48ac5d-51fb-4bc5-a5bd-be91200b6169 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:57.958959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf48ac5d-51fb-4bc5-a5bd-be91200b6169 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:57.962483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf48ac5d-51fb-4bc5-a5bd-be91200b6169 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:57.966665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf48ac5d-51fb-4bc5-a5bd-be91200b6169 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:57.969650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf48ac5d-51fb-4bc5-a5bd-be91200b6169 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:57.970824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf48ac5d-51fb-4bc5-a5bd-be91200b6169 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:58.322976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d56cbe7a-3db1-4129-a77b-af5b6f1dddde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:58.340567 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d56cbe7a-3db1-4129-a77b-af5b6f1dddde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1325 microversion: 2.1 time: 0.756692 Aug 09 17:20:58.341385 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1296/2712] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:57 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1325 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:58.346989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-33aa3b57-3334-41f1-a37d-dd44884531e5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:20:58.349758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-33aa3b57-3334-41f1-a37d-dd44884531e5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:58.500675 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-33aa3b57-3334-41f1-a37d-dd44884531e5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "PUT /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 991 microversion: 2.47 time: 0.153187 Aug 09 17:20:58.503914 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1297/2713] 10.222.0.93 () {62 vars in 1297 bytes} [Tue Aug 9 17:20:58 2022] PUT /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 991 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:20:58.514463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4f7dd316-e20e-4962-9b5e-0325a0cb65fc tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:58.519003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4f7dd316-e20e-4962-9b5e-0325a0cb65fc tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:58.550100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7dd316-e20e-4962-9b5e-0325a0cb65fc tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:58.551118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7dd316-e20e-4962-9b5e-0325a0cb65fc tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:58.552290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7dd316-e20e-4962-9b5e-0325a0cb65fc tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:58.553871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7dd316-e20e-4962-9b5e-0325a0cb65fc tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:58.558935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7dd316-e20e-4962-9b5e-0325a0cb65fc tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:58.573862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7dd316-e20e-4962-9b5e-0325a0cb65fc tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:58.620068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bf48ac5d-51fb-4bc5-a5bd-be91200b6169 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:58.664120 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bf48ac5d-51fb-4bc5-a5bd-be91200b6169 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565" status: 200 len: 1468 microversion: 2.1 time: 0.763591 Aug 09 17:20:58.665024 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1417/2714] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:57 2022] GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565 => generated 1468 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:58.731392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dc1912ce-ef92-4106-a5a3-e94257f7986f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:58.732686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dc1912ce-ef92-4106-a5a3-e94257f7986f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:59.108222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dc1912ce-ef92-4106-a5a3-e94257f7986f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:59.146154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dc1912ce-ef92-4106-a5a3-e94257f7986f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:59.159747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dc1912ce-ef92-4106-a5a3-e94257f7986f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:59.170794 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dc1912ce-ef92-4106-a5a3-e94257f7986f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1277 microversion: 2.47 time: 0.471424 Aug 09 17:20:59.177699 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1418/2715] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:20:58 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1277 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:20:59.215962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9bd6ba8c-6668-4645-b76f-5b9b76d60a90 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:59.231041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9bd6ba8c-6668-4645-b76f-5b9b76d60a90 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:20:59.275999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd6ba8c-6668-4645-b76f-5b9b76d60a90 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:59.277106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd6ba8c-6668-4645-b76f-5b9b76d60a90 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:59.278102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd6ba8c-6668-4645-b76f-5b9b76d60a90 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:59.281406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd6ba8c-6668-4645-b76f-5b9b76d60a90 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:59.284916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd6ba8c-6668-4645-b76f-5b9b76d60a90 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:59.285906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd6ba8c-6668-4645-b76f-5b9b76d60a90 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:59.901089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f7dd316-e20e-4962-9b5e-0325a0cb65fc tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:59.931101 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4f7dd316-e20e-4962-9b5e-0325a0cb65fc tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1324 microversion: 2.1 time: 1.422529 Aug 09 17:20:59.934194 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1298/2716] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:58 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1324 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:20:59.946096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:20:59.961901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:20:59.964230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Searching by: {'reservation_id': 'r-b1ko9xk8', 'deleted': False, 'project_id': '2b3f7d833b344b9cb579955d726a9e41'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:20:59.985644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:59.987063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:59.988211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:20:59.992860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:20:59.994516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:20:59.995589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:00.359174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:21:00.572073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:00.711898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:00.739945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:00.745425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:00.745791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:01.023965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9bd6ba8c-6668-4645-b76f-5b9b76d60a90 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:01.051406 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9bd6ba8c-6668-4645-b76f-5b9b76d60a90 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1490 microversion: 2.1 time: 1.870860 Aug 09 17:21:01.063216 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1419/2717] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:20:59 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1490 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:01.082775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-afbbf18b-3fb1-48b6-9f10-14af0a6a1295 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc9bce50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:01.253320 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-afbbf18b-3fb1-48b6-9f10-14af0a6a1295 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1464 microversion: 2.1 time: 0.168737 Aug 09 17:21:01.254210 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1420/2718] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:21:01 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1464 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:01.261180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-82d53a62-f613-40d0-ad26-cffa0bcc67c0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:01.273287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-82d53a62-f613-40d0-ad26-cffa0bcc67c0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:01.307101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d53a62-f613-40d0-ad26-cffa0bcc67c0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:01.307976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d53a62-f613-40d0-ad26-cffa0bcc67c0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:01.308567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d53a62-f613-40d0-ad26-cffa0bcc67c0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:01.309338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d53a62-f613-40d0-ad26-cffa0bcc67c0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:01.322678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d53a62-f613-40d0-ad26-cffa0bcc67c0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:01.326010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d53a62-f613-40d0-ad26-cffa0bcc67c0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:01.571527 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-92d9e5d7-4201-4188-b508-af6e143d5963 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?reservation_id=r-b1ko9xk8" status: 200 len: 2928 microversion: 2.1 time: 1.634446 Aug 09 17:21:01.573171 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1299/2719] 10.222.0.93 () {58 vars in 1197 bytes} [Tue Aug 9 17:20:59 2022] GET /compute/v2.1/servers/detail?reservation_id=r-b1ko9xk8 => generated 2928 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:01.578636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:01.579619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:01.607449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:01.610200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:01.614124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:01.615118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:01.615762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:01.616286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:01.948814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:01.978109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:01.984205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:01.989192 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-13a5053a-56f2-4e4a-a98f-cbdd7523eeaf tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1347 microversion: 2.47 time: 0.414245 Aug 09 17:21:01.991396 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1300/2720] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:01 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1347 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:02.009633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-59a08c5b-d3dc-46cd-8153-91fe0936f5c2 req-f9acde06-4f6f-462f-8126-70d3495ca293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29188f6a-3896-4045-9ad5-bbf0997ead47", "name": "network-vif-plugged", "status": "completed", "tag": "d69fd5a4-38f8-49e1-9d53-5bdd6b6bdb82"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:02.033434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-59a08c5b-d3dc-46cd-8153-91fe0936f5c2 req-f9acde06-4f6f-462f-8126-70d3495ca293 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:02.034926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-59a08c5b-d3dc-46cd-8153-91fe0936f5c2 req-f9acde06-4f6f-462f-8126-70d3495ca293 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:02.036161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-59a08c5b-d3dc-46cd-8153-91fe0936f5c2 req-f9acde06-4f6f-462f-8126-70d3495ca293 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:02.070496 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-59a08c5b-d3dc-46cd-8153-91fe0936f5c2 req-f9acde06-4f6f-462f-8126-70d3495ca293 service nova] Creating event network-vif-plugged:d69fd5a4-38f8-49e1-9d53-5bdd6b6bdb82 for instance 29188f6a-3896-4045-9ad5-bbf0997ead47 on n-h2-845781-6 Aug 09 17:21:02.081112 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-59a08c5b-d3dc-46cd-8153-91fe0936f5c2 req-f9acde06-4f6f-462f-8126-70d3495ca293 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087206 Aug 09 17:21:02.082944 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1301/2721] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:02.095896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-35c8dcac-6037-4781-931d-c1529e6d2442 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:02.098011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-35c8dcac-6037-4781-931d-c1529e6d2442 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:02.112001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35c8dcac-6037-4781-931d-c1529e6d2442 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:02.113540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35c8dcac-6037-4781-931d-c1529e6d2442 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:02.114585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35c8dcac-6037-4781-931d-c1529e6d2442 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:02.116047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35c8dcac-6037-4781-931d-c1529e6d2442 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:02.117128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35c8dcac-6037-4781-931d-c1529e6d2442 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:02.118264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35c8dcac-6037-4781-931d-c1529e6d2442 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:02.269711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-82d53a62-f613-40d0-ad26-cffa0bcc67c0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:02.293286 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-82d53a62-f613-40d0-ad26-cffa0bcc67c0 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1325 microversion: 2.1 time: 1.036072 Aug 09 17:21:02.313273 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1421/2722] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:01 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1325 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:02.343466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c173474-3083-4483-a306-0fa483d9fb19 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:02.345207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c173474-3083-4483-a306-0fa483d9fb19 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:02.369557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c173474-3083-4483-a306-0fa483d9fb19 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:02.371726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c173474-3083-4483-a306-0fa483d9fb19 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:02.372232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c173474-3083-4483-a306-0fa483d9fb19 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:02.375380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c173474-3083-4483-a306-0fa483d9fb19 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:02.376229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c173474-3083-4483-a306-0fa483d9fb19 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:02.380640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c173474-3083-4483-a306-0fa483d9fb19 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:02.462642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c173474-3083-4483-a306-0fa483d9fb19 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:21:02.606602 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c173474-3083-4483-a306-0fa483d9fb19 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 204 len: 0 microversion: 2.1 time: 0.276468 Aug 09 17:21:02.611488 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1422/2723] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:21:02 2022] DELETE /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:02.624970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d9dac9c-4060-4474-a104-9cfa7992b8da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc8c8a60>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:02.732330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-35c8dcac-6037-4781-931d-c1529e6d2442 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:02.784945 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-35c8dcac-6037-4781-931d-c1529e6d2442 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1324 microversion: 2.1 time: 0.699188 Aug 09 17:21:02.795452 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5d9dac9c-4060-4474-a104-9cfa7992b8da tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 200 len: 1464 microversion: 2.1 time: 0.181470 Aug 09 17:21:02.797097 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1302/2724] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:02 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1324 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:02.801709 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1423/2725] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:21:02 2022] GET /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 1464 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:02.816826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c29ee3bc-9709-4566-8287-51ee72a02953 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:02.822956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c691a911-56e5-4333-b79f-53312fb2dfb4 req-01022d60-24cc-4fac-83fb-474c7d78aebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "488bf4e2-f491-4e78-b219-77d9c53d50ec", "tag": "e48bd9fb-7365-4224-86f8-e3a708d863cb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:02.849803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c691a911-56e5-4333-b79f-53312fb2dfb4 req-01022d60-24cc-4fac-83fb-474c7d78aebe service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:02.850439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c691a911-56e5-4333-b79f-53312fb2dfb4 req-01022d60-24cc-4fac-83fb-474c7d78aebe service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:02.851698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c691a911-56e5-4333-b79f-53312fb2dfb4 req-01022d60-24cc-4fac-83fb-474c7d78aebe service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:02.863875 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c691a911-56e5-4333-b79f-53312fb2dfb4 req-01022d60-24cc-4fac-83fb-474c7d78aebe service nova] Creating event network-changed:e48bd9fb-7365-4224-86f8-e3a708d863cb for instance 488bf4e2-f491-4e78-b219-77d9c53d50ec on n-h2-845781-6 Aug 09 17:21:02.869638 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c691a911-56e5-4333-b79f-53312fb2dfb4 req-01022d60-24cc-4fac-83fb-474c7d78aebe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065763 Aug 09 17:21:02.870478 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1424/2726] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:02.876492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f5bf6d3-8ffa-4131-a119-127b0183a10a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:02.877273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f5bf6d3-8ffa-4131-a119-127b0183a10a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:02.884262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.compute.server_groups [None req-c29ee3bc-9709-4566-8287-51ee72a02953 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Querying cell 64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) for 2 instances {{(pid=119432) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 09 17:21:02.884938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f5bf6d3-8ffa-4131-a119-127b0183a10a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:02.886744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f5bf6d3-8ffa-4131-a119-127b0183a10a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:02.886952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c29ee3bc-9709-4566-8287-51ee72a02953 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:02.887242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f5bf6d3-8ffa-4131-a119-127b0183a10a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:02.887883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c29ee3bc-9709-4566-8287-51ee72a02953 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:02.888170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f5bf6d3-8ffa-4131-a119-127b0183a10a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:02.888629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f5bf6d3-8ffa-4131-a119-127b0183a10a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:02.888948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c29ee3bc-9709-4566-8287-51ee72a02953 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:02.889082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f5bf6d3-8ffa-4131-a119-127b0183a10a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:02.987800 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c29ee3bc-9709-4566-8287-51ee72a02953 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/f3a5d9e9-a7ab-40c2-bcbb-f0a61872b2ae" status: 200 len: 264 microversion: 2.1 time: 0.187582 Aug 09 17:21:02.989803 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1303/2727] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:21:02 2022] GET /compute/v2.1/os-server-groups/f3a5d9e9-a7ab-40c2-bcbb-f0a61872b2ae => generated 264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:03.000462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cecfd3d1-f59c-430a-804f-c4c07b3eb9de tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:03.002703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cecfd3d1-f59c-430a-804f-c4c07b3eb9de tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:03.018716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cecfd3d1-f59c-430a-804f-c4c07b3eb9de tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:03.019608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cecfd3d1-f59c-430a-804f-c4c07b3eb9de tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:03.020588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cecfd3d1-f59c-430a-804f-c4c07b3eb9de tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:03.021727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cecfd3d1-f59c-430a-804f-c4c07b3eb9de tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:03.022573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cecfd3d1-f59c-430a-804f-c4c07b3eb9de tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:03.023364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cecfd3d1-f59c-430a-804f-c4c07b3eb9de tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:03.268813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9f5bf6d3-8ffa-4131-a119-127b0183a10a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:03.284180 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f5bf6d3-8ffa-4131-a119-127b0183a10a tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1496 microversion: 2.1 time: 0.409959 Aug 09 17:21:03.286843 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1425/2728] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:02 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1496 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:03.292334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-85ff8cd9-27d2-433b-80e5-ec1d956f66bf tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:03.293309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-85ff8cd9-27d2-433b-80e5-ec1d956f66bf tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:03.300057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ff8cd9-27d2-433b-80e5-ec1d956f66bf tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:03.300871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ff8cd9-27d2-433b-80e5-ec1d956f66bf tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:03.301487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ff8cd9-27d2-433b-80e5-ec1d956f66bf tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:03.302533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ff8cd9-27d2-433b-80e5-ec1d956f66bf tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:03.303205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ff8cd9-27d2-433b-80e5-ec1d956f66bf tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:03.303894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ff8cd9-27d2-433b-80e5-ec1d956f66bf tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:03.331608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:03.352963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cecfd3d1-f59c-430a-804f-c4c07b3eb9de tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:03.365732 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cecfd3d1-f59c-430a-804f-c4c07b3eb9de tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991" status: 200 len: 1467 microversion: 2.1 time: 0.374029 Aug 09 17:21:03.366822 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1304/2729] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:02 2022] GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991 => generated 1467 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:03.372144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:03.373104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:03.381150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:03.382185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:03.382843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:03.383693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:03.384698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:03.385202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:03.540362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:03.556416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:03.560979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:03.562992 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-66fddc66-c940-4af1-9057-dd2afefca690 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1335 microversion: 2.47 time: 0.194741 Aug 09 17:21:03.564834 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1305/2730] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:03 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1335 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:03.585238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0fd9dff2-62b7-4fc0-b81b-bdc505d0b228 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:03.587474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0fd9dff2-62b7-4fc0-b81b-bdc505d0b228 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:03.605939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0fd9dff2-62b7-4fc0-b81b-bdc505d0b228 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:03.607997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0fd9dff2-62b7-4fc0-b81b-bdc505d0b228 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:03.609047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0fd9dff2-62b7-4fc0-b81b-bdc505d0b228 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:03.610491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0fd9dff2-62b7-4fc0-b81b-bdc505d0b228 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:03.611933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0fd9dff2-62b7-4fc0-b81b-bdc505d0b228 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:03.612895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0fd9dff2-62b7-4fc0-b81b-bdc505d0b228 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:04.087607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0fd9dff2-62b7-4fc0-b81b-bdc505d0b228 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:04.108083 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0fd9dff2-62b7-4fc0-b81b-bdc505d0b228 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1325 microversion: 2.1 time: 0.540380 Aug 09 17:21:04.109899 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1306/2731] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:03 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1325 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:04.119266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cf94a855-7913-4085-bf6b-4e10e97d734a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcbab5940>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:04.185350 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-85ff8cd9-27d2-433b-80e5-ec1d956f66bf tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 200 len: 1618 microversion: 2.1 time: 0.896441 Aug 09 17:21:04.185956 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1426/2732] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:03 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 1618 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:04.204231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a167754a-de72-40a1-9f65-9f81aefdb1de tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:04.205393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a167754a-de72-40a1-9f65-9f81aefdb1de tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:04.216492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a167754a-de72-40a1-9f65-9f81aefdb1de tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:04.217073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a167754a-de72-40a1-9f65-9f81aefdb1de tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:04.217786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a167754a-de72-40a1-9f65-9f81aefdb1de tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:04.225524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a167754a-de72-40a1-9f65-9f81aefdb1de tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:04.226668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a167754a-de72-40a1-9f65-9f81aefdb1de tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:04.227332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a167754a-de72-40a1-9f65-9f81aefdb1de tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:04.413695 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cf94a855-7913-4085-bf6b-4e10e97d734a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images?changes-since=2022-08-09T17%3A18%3A09Z" status: 200 len: 2373 microversion: 2.1 time: 0.301572 Aug 09 17:21:04.414834 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1307/2733] 10.222.0.93 () {58 vars in 1199 bytes} [Tue Aug 9 17:21:04 2022] GET /compute/v2.1/images?changes-since=2022-08-09T17%3A18%3A09Z => generated 2373 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:04.420874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f69bbb89-3b0a-4285-843d-96e4d58adcf1 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:04.421520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f69bbb89-3b0a-4285-843d-96e4d58adcf1 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] [instance: ec097021-2408-4328-b677-266d832bd565] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:04.431868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69bbb89-3b0a-4285-843d-96e4d58adcf1 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:04.432960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69bbb89-3b0a-4285-843d-96e4d58adcf1 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:04.433472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69bbb89-3b0a-4285-843d-96e4d58adcf1 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:04.438286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69bbb89-3b0a-4285-843d-96e4d58adcf1 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:04.438951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69bbb89-3b0a-4285-843d-96e4d58adcf1 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:04.439448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69bbb89-3b0a-4285-843d-96e4d58adcf1 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:04.540015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a167754a-de72-40a1-9f65-9f81aefdb1de tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:04.555773 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a167754a-de72-40a1-9f65-9f81aefdb1de tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1324 microversion: 2.1 time: 0.368320 Aug 09 17:21:04.572772 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1427/2734] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:04 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:04.593790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c62d1375-2cb1-476d-95fd-6064c19cbf8d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:04.596265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c62d1375-2cb1-476d-95fd-6064c19cbf8d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:04.610111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62d1375-2cb1-476d-95fd-6064c19cbf8d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:04.611150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62d1375-2cb1-476d-95fd-6064c19cbf8d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:04.612018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62d1375-2cb1-476d-95fd-6064c19cbf8d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:04.613569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62d1375-2cb1-476d-95fd-6064c19cbf8d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:04.614777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62d1375-2cb1-476d-95fd-6064c19cbf8d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:04.615579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62d1375-2cb1-476d-95fd-6064c19cbf8d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:04.676123 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f69bbb89-3b0a-4285-843d-96e4d58adcf1 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565" status: 200 len: 1619 microversion: 2.1 time: 0.259960 Aug 09 17:21:04.677040 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1308/2735] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:04 2022] GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565 => generated 1619 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:04.707965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d393cd4e-ecb3-4750-9783-befa7d7aa4cd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb63bc10>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:04.882003 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d393cd4e-ecb3-4750-9783-befa7d7aa4cd tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-319510156" status: 200 len: 484 microversion: 2.1 time: 0.192074 Aug 09 17:21:04.883085 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1309/2736] 10.222.0.93 () {58 vars in 1229 bytes} [Tue Aug 9 17:21:04 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-319510156 => generated 484 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:04.889494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:04.891394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:04.900724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:04.901324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:04.901862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:04.902812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:04.903351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:04.904025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:05.073103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c62d1375-2cb1-476d-95fd-6064c19cbf8d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:05.103506 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c62d1375-2cb1-476d-95fd-6064c19cbf8d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1496 microversion: 2.1 time: 0.526492 Aug 09 17:21:05.130277 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1428/2737] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:04 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1496 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:05.149509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:05.162373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3dfebf3d-b7a2-417b-a0c9-c54850626774 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Action: 'create', calling method: .version_select at 0x7fbbcb74e430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2118667346", "policies": ["anti-affinity"]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:05.173369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:05.188805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:05.191451 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0b5ddfaa-a841-4d3e-9358-fbb1a1f7184a tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1335 microversion: 2.47 time: 0.306801 Aug 09 17:21:05.199681 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1310/2738] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:04 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1335 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:05.221937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-36640fc6-21f1-4ba1-80a0-2d062982dbe1 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb6739d0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:05.274568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-3dfebf3d-b7a2-417b-a0c9-c54850626774 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:05.333786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-3dfebf3d-b7a2-417b-a0c9-c54850626774 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:05.544861 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-36640fc6-21f1-4ba1-80a0-2d062982dbe1 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images?server=ce962b08-43de-4bff-a72a-1adcf330c991" status: 200 len: 957 microversion: 2.1 time: 0.347842 Aug 09 17:21:05.550403 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1311/2739] 10.222.0.93 () {58 vars in 1209 bytes} [Tue Aug 9 17:21:05 2022] GET /compute/v2.1/images?server=ce962b08-43de-4bff-a72a-1adcf330c991 => generated 957 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:05.559055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d3e131e-94b2-44f2-9d61-8f8e121db982 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:05.572017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0d3e131e-94b2-44f2-9d61-8f8e121db982 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:05.575769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-3dfebf3d-b7a2-417b-a0c9-c54850626774 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:05.589991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d3e131e-94b2-44f2-9d61-8f8e121db982 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:05.591196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d3e131e-94b2-44f2-9d61-8f8e121db982 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:05.596488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d3e131e-94b2-44f2-9d61-8f8e121db982 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:05.598123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d3e131e-94b2-44f2-9d61-8f8e121db982 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:05.600148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d3e131e-94b2-44f2-9d61-8f8e121db982 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:05.601073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d3e131e-94b2-44f2-9d61-8f8e121db982 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:05.617502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-3dfebf3d-b7a2-417b-a0c9-c54850626774 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:05.681644 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3dfebf3d-b7a2-417b-a0c9-c54850626774 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.539104 Aug 09 17:21:05.683146 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1429/2740] 10.222.0.93 () {60 vars in 1174 bytes} [Tue Aug 9 17:21:05 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:05.696606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d8229323-5a3c-4dcc-9af1-a69a8f221f11 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc8c8d30>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:05.878708 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d8229323-5a3c-4dcc-9af1-a69a8f221f11 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2Ff7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 484 microversion: 2.1 time: 0.183788 Aug 09 17:21:05.879878 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1430/2741] 10.222.0.93 () {58 vars in 1317 bytes} [Tue Aug 9 17:21:05 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2Ff7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 484 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:05.905788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cacd4960-f9bc-4a53-adfd-fa81684c3533 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:05.909721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cacd4960-f9bc-4a53-adfd-fa81684c3533 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:05.943681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cacd4960-f9bc-4a53-adfd-fa81684c3533 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:05.947939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cacd4960-f9bc-4a53-adfd-fa81684c3533 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:05.949469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cacd4960-f9bc-4a53-adfd-fa81684c3533 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:05.956836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cacd4960-f9bc-4a53-adfd-fa81684c3533 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:05.958148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cacd4960-f9bc-4a53-adfd-fa81684c3533 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:05.960474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cacd4960-f9bc-4a53-adfd-fa81684c3533 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:06.268402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0d3e131e-94b2-44f2-9d61-8f8e121db982 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:06.298604 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0d3e131e-94b2-44f2-9d61-8f8e121db982 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1522 microversion: 2.1 time: 0.744514 Aug 09 17:21:06.299564 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1312/2742] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:05 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1522 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:06.316064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b5235205-fa01-4a13-969f-7729a9ef0802 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb942ca0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:06.443814 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b5235205-fa01-4a13-969f-7729a9ef0802 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2Ff7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 484 microversion: 2.1 time: 0.139941 Aug 09 17:21:06.444934 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1313/2743] 10.222.0.93 () {58 vars in 1303 bytes} [Tue Aug 9 17:21:06 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2Ff7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 484 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:06.460250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1057560022", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "9078a8b8-4531-432b-bec7-506908d36c73"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:06.562240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:21:06.592260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cacd4960-f9bc-4a53-adfd-fa81684c3533 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:06.607806 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cacd4960-f9bc-4a53-adfd-fa81684c3533 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1324 microversion: 2.1 time: 0.718125 Aug 09 17:21:06.609230 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1431/2744] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:05 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1324 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:06.623079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-af5c968e-3d32-4ca5-b771-88a29b857031 req-e4cd64d6-8298-4d86-854a-97f6401d6aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce962b08-43de-4bff-a72a-1adcf330c991", "name": "network-vif-unplugged", "status": "completed", "tag": "b046df32-8645-4449-b41d-a48fe4b7136e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:06.656380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-af5c968e-3d32-4ca5-b771-88a29b857031 req-e4cd64d6-8298-4d86-854a-97f6401d6aac service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:06.657093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-af5c968e-3d32-4ca5-b771-88a29b857031 req-e4cd64d6-8298-4d86-854a-97f6401d6aac service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:06.658763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-af5c968e-3d32-4ca5-b771-88a29b857031 req-e4cd64d6-8298-4d86-854a-97f6401d6aac service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:06.685811 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-af5c968e-3d32-4ca5-b771-88a29b857031 req-e4cd64d6-8298-4d86-854a-97f6401d6aac service nova] Creating event network-vif-unplugged:b046df32-8645-4449-b41d-a48fe4b7136e for instance ce962b08-43de-4bff-a72a-1adcf330c991 on n-h2-845781-6 Aug 09 17:21:06.703818 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-af5c968e-3d32-4ca5-b771-88a29b857031 req-e4cd64d6-8298-4d86-854a-97f6401d6aac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089609 Aug 09 17:21:06.705140 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1432/2745] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:06.718868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dff50d8e-beef-4ae2-bb2c-807f8883c090 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:06.719950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dff50d8e-beef-4ae2-bb2c-807f8883c090 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:06.737825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff50d8e-beef-4ae2-bb2c-807f8883c090 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:06.739871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff50d8e-beef-4ae2-bb2c-807f8883c090 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:06.742228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff50d8e-beef-4ae2-bb2c-807f8883c090 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:06.743260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff50d8e-beef-4ae2-bb2c-807f8883c090 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:06.745048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff50d8e-beef-4ae2-bb2c-807f8883c090 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:06.746125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff50d8e-beef-4ae2-bb2c-807f8883c090 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:06.987460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dff50d8e-beef-4ae2-bb2c-807f8883c090 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:07.013069 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dff50d8e-beef-4ae2-bb2c-807f8883c090 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 200 len: 1454 microversion: 2.1 time: 0.305266 Aug 09 17:21:07.031160 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1433/2746] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:06 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 1454 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:07.051883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:07.053795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:07.091756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:07.094310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:07.096631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:07.098194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:07.102773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:07.105645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:07.471080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:07.480849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:07.529662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:07.536472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:07.542351 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-02cee640-c5a2-4f40-8c95-a29d5a09ebd2 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1356 microversion: 2.47 time: 0.503309 Aug 09 17:21:07.546066 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1434/2747] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:07 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1356 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:07.568786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:21:07.569747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:21:07.570596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:21:07.571365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:21:07.572164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:21:07.574884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3ce1931-489f-4cac-94fa-f8af9c959d8e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:07.577143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3ce1931-489f-4cac-94fa-f8af9c959d8e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:07.635388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3ce1931-489f-4cac-94fa-f8af9c959d8e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:07.638717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3ce1931-489f-4cac-94fa-f8af9c959d8e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:07.642108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3ce1931-489f-4cac-94fa-f8af9c959d8e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:07.648361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3ce1931-489f-4cac-94fa-f8af9c959d8e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:07.652795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3ce1931-489f-4cac-94fa-f8af9c959d8e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:07.656355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3ce1931-489f-4cac-94fa-f8af9c959d8e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:07.679268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:07.679776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:07.680148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:07.680956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:07.681429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:07.690260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:07.758944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:07.781511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:07.819570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Going to run 2 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:21:07.825441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:21:07.914205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119432) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 09 17:21:07.966767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:07.979063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:08.051810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f3ce1931-489f-4cac-94fa-f8af9c959d8e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:08.063359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:08.069780 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3ce1931-489f-4cac-94fa-f8af9c959d8e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1522 microversion: 2.1 time: 0.520580 Aug 09 17:21:08.070886 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1435/2748] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:07 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:08.082162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-92bb0b09-d341-41a1-ac04-67ba4c658650 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcade0940>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:08.082788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:08.108756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:08.146421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:21:08.364527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:08.387686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:08.518168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:08.539386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:08.571371 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-92bb0b09-d341-41a1-ac04-67ba4c658650 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.498619 Aug 09 17:21:08.588272 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1436/2749] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:21:08 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:08.604680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-988d3b8f-d748-4b18-8027-6e7c91da9af7 req-515c6e72-2b1f-4605-bc97-a050322678a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5402fb-8e2e-4145-a53b-ec8b72c12e30", "name": "network-vif-deleted", "tag": "0bdc8283-4340-486a-8b50-d9217a6aa69a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:08.653376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-988d3b8f-d748-4b18-8027-6e7c91da9af7 req-515c6e72-2b1f-4605-bc97-a050322678a2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:08.654444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-988d3b8f-d748-4b18-8027-6e7c91da9af7 req-515c6e72-2b1f-4605-bc97-a050322678a2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:08.658933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-988d3b8f-d748-4b18-8027-6e7c91da9af7 req-515c6e72-2b1f-4605-bc97-a050322678a2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:08.690667 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-988d3b8f-d748-4b18-8027-6e7c91da9af7 req-515c6e72-2b1f-4605-bc97-a050322678a2 service nova] Creating event network-vif-deleted:0bdc8283-4340-486a-8b50-d9217a6aa69a for instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 on n-h1-845781-6 Aug 09 17:21:08.704100 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-80323566-17bd-4376-8a9d-e262bec29927 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.252709 Aug 09 17:21:08.706145 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-988d3b8f-d748-4b18-8027-6e7c91da9af7 req-515c6e72-2b1f-4605-bc97-a050322678a2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113697 Aug 09 17:21:08.707353 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1314/2750] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:21:06 2022] POST /compute/v2.1/servers => generated 32 bytes in 2261 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 09 17:21:08.708888 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1437/2751] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:08.719687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-994621e1-7896-4563-a755-54777a884146 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:08.722639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-994621e1-7896-4563-a755-54777a884146 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:08.733549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:08.737484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-994621e1-7896-4563-a755-54777a884146 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:08.738769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-994621e1-7896-4563-a755-54777a884146 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:08.741229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-994621e1-7896-4563-a755-54777a884146 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:08.744043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-994621e1-7896-4563-a755-54777a884146 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:08.745361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-994621e1-7896-4563-a755-54777a884146 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:08.746431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-994621e1-7896-4563-a755-54777a884146 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:08.749273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:08.791270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:08.797138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:08.800186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:08.804405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:08.810516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:08.811713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:09.066408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:21:09.067018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:21:09.067917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:21:09.068671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:21:09.069514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:21:09.269852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:09.294770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:09.295522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:09.296210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:09.297126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:09.298015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:09.299169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:09.335388 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fdd89097-2f1c-439f-a207-1c43ef97ecba tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "POST /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487/action" status: 202 len: 1078 microversion: 2.47 time: 0.624789 Aug 09 17:21:09.336954 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1315/2752] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:21:08 2022] POST /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487/action => generated 1078 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 09 17:21:09.365856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:09.366602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:09.380099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:09.382146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:09.386122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:09.387258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:09.388009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:09.388995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:09.436292 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 HTTP/1.1 Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '5a5402fb-8e2e-4145-a53b-ec8b72c12e30'} Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:09.439839 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:09.444183 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:09.444183 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:09.444183 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:09.444183 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:09.444183 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:09.444183 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:09.444183 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:09.444183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:09.444183 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c951ef80-72df-4aca-b59a-cbfaa50c0541 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 404 len: 111 microversion: 2.1 time: 0.104782 Aug 09 17:21:09.444183 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1316/2753] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:09 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:09.519616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d5e378d-5811-4051-a943-ad513e33b022 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-602228797"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:09.533976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0d5e378d-5811-4051-a943-ad513e33b022 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:09.565300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d5e378d-5811-4051-a943-ad513e33b022 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:09.565952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d5e378d-5811-4051-a943-ad513e33b022 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:09.566298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d5e378d-5811-4051-a943-ad513e33b022 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:09.567036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d5e378d-5811-4051-a943-ad513e33b022 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:09.567604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d5e378d-5811-4051-a943-ad513e33b022 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:09.567940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d5e378d-5811-4051-a943-ad513e33b022 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:09.927005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-994621e1-7896-4563-a755-54777a884146 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:10.019990 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-994621e1-7896-4563-a755-54777a884146 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1324 microversion: 2.1 time: 1.301999 Aug 09 17:21:10.028842 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1438/2754] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:08 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1324 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:10.076959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d14fed8-ef8c-4654-9e29-abffcf4e97a9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb74e160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:10.569687 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0d14fed8-ef8c-4654-9e29-abffcf4e97a9 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.526601 Aug 09 17:21:10.574585 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1439/2755] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:21:10 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:10.645130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a2439a11-8bfa-48a2-8063-d853fae133f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:10.684438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a2439a11-8bfa-48a2-8063-d853fae133f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:10.694208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a2439a11-8bfa-48a2-8063-d853fae133f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Searching by: {'deleted': False, 'project_id': '2b3f7d833b344b9cb579955d726a9e41'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:21:10.730341 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0d5e378d-5811-4051-a943-ad513e33b022 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "POST /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47/action" status: 202 len: 0 microversion: 2.1 time: 1.256947 Aug 09 17:21:10.740172 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1317/2756] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:21:09 2022] POST /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47/action => generated 0 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 17:21:10.773037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:10.785314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:10.825381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2439a11-8bfa-48a2-8063-d853fae133f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:10.826514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2439a11-8bfa-48a2-8063-d853fae133f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:10.827459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2439a11-8bfa-48a2-8063-d853fae133f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:10.828483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:10.829254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2439a11-8bfa-48a2-8063-d853fae133f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:10.830538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:10.831684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:10.832706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2439a11-8bfa-48a2-8063-d853fae133f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:10.836600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:10.837924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:10.839008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:10.840784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2439a11-8bfa-48a2-8063-d853fae133f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:11.167003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:11.188517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:11.195955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:11.203570 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-80110087-9a57-4522-b43a-d73e0e86beb6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1365 microversion: 2.47 time: 0.453621 Aug 09 17:21:11.209367 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1318/2757] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:10 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1365 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:11.232108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-672878570", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ad48ae09-8243-461d-b010-943470de6d49"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:11.379534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-a2439a11-8bfa-48a2-8063-d853fae133f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:21:11.404838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] validate_networks() for [('ad48ae09-8243-461d-b010-943470de6d49', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:21:11.577802 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a2439a11-8bfa-48a2-8063-d853fae133f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 1.000061 Aug 09 17:21:11.580438 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1440/2758] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:21:10 2022] GET /compute/v2.1/servers => generated 1664 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:11.590110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9c4657f5-19a0-46fa-89b0-e531877fcb2b req-ecf583c9-b940-44e7-8fb1-12efa01d3855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488bf4e2-f491-4e78-b219-77d9c53d50ec", "name": "network-vif-plugged", "status": "completed", "tag": "e48bd9fb-7365-4224-86f8-e3a708d863cb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:11.612686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9c4657f5-19a0-46fa-89b0-e531877fcb2b req-ecf583c9-b940-44e7-8fb1-12efa01d3855 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:11.615479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9c4657f5-19a0-46fa-89b0-e531877fcb2b req-ecf583c9-b940-44e7-8fb1-12efa01d3855 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:11.616742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9c4657f5-19a0-46fa-89b0-e531877fcb2b req-ecf583c9-b940-44e7-8fb1-12efa01d3855 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:11.646213 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9c4657f5-19a0-46fa-89b0-e531877fcb2b req-ecf583c9-b940-44e7-8fb1-12efa01d3855 service nova] Creating event network-vif-plugged:e48bd9fb-7365-4224-86f8-e3a708d863cb for instance 488bf4e2-f491-4e78-b219-77d9c53d50ec on n-h2-845781-6 Aug 09 17:21:11.659458 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9c4657f5-19a0-46fa-89b0-e531877fcb2b req-ecf583c9-b940-44e7-8fb1-12efa01d3855 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076192 Aug 09 17:21:11.663119 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1441/2759] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:11.671940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e22c416f-a3e2-403c-8991-754a90ee2421 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbd8160040>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:11.787574 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e22c416f-a3e2-403c-8991-754a90ee2421 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.118387 Aug 09 17:21:11.788320 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1442/2760] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:21:11 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:11.804624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44c80238-6d39-48fa-bb0a-5e020b4a4acc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '.version_select at 0x7fbbcb968af0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:12.352158 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-44c80238-6d39-48fa-bb0a-5e020b4a4acc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "DELETE /compute/v2.1/images/494f86d3-cbf9-4228-a373-4c38df4615c7" status: 204 len: 0 microversion: 2.1 time: 0.561916 Aug 09 17:21:12.353238 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1443/2761] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:11 2022] DELETE /compute/v2.1/images/494f86d3-cbf9-4228-a373-4c38df4615c7 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:12.754821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-448118167", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "b2ce9140-b640-4166-a8ca-6f566766cd65"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:12.916374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:21:12.918558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:21:12.919649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:21:12.920667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:21:12.921656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:21:12.965532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:12.966743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:12.967808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:12.969375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:12.971219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:12.977887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:12.992851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] validate_networks() for [('b2ce9140-b640-4166-a8ca-6f566766cd65', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:21:13.030108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:13.067277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:13.088171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Getting quotas for user d8e1dc1f64fe429ea6a8c746b7c84ae6 and project ca2b4aad2192406d951cbdb3991c41fb. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:13.128643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:21:13.133361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:21:13.231158 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c03e31cd-6612-40c3-a8bf-d24f9a71d4c8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.016569 Aug 09 17:21:13.242522 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1319/2762] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:21:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:21:13.245189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-490645ff-b115-4943-a5a2-9e9679afbc3f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:13.246489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-490645ff-b115-4943-a5a2-9e9679afbc3f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:13.259809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-490645ff-b115-4943-a5a2-9e9679afbc3f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:13.260755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-490645ff-b115-4943-a5a2-9e9679afbc3f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:13.261584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-490645ff-b115-4943-a5a2-9e9679afbc3f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:13.262481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-490645ff-b115-4943-a5a2-9e9679afbc3f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:13.263204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-490645ff-b115-4943-a5a2-9e9679afbc3f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:13.263945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-490645ff-b115-4943-a5a2-9e9679afbc3f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:13.836582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-490645ff-b115-4943-a5a2-9e9679afbc3f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:13.855279 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-490645ff-b115-4943-a5a2-9e9679afbc3f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1324 microversion: 2.1 time: 0.620509 Aug 09 17:21:13.855923 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1320/2763] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:13 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1324 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:13.865459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ed480ded-f802-4e57-b6e4-78aadd52efe1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:13.866455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ed480ded-f802-4e57-b6e4-78aadd52efe1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:13.903728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed480ded-f802-4e57-b6e4-78aadd52efe1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:13.906920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed480ded-f802-4e57-b6e4-78aadd52efe1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:13.907502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed480ded-f802-4e57-b6e4-78aadd52efe1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:13.908545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed480ded-f802-4e57-b6e4-78aadd52efe1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:13.910941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed480ded-f802-4e57-b6e4-78aadd52efe1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:13.921502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed480ded-f802-4e57-b6e4-78aadd52efe1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:14.138836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ed480ded-f802-4e57-b6e4-78aadd52efe1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:14.178830 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ed480ded-f802-4e57-b6e4-78aadd52efe1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 200 len: 1289 microversion: 2.1 time: 0.318910 Aug 09 17:21:14.201299 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1321/2764] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:13 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 1289 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:14.222039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-136e3fc3-2588-43b1-91dc-cc5bd310edb6 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb8c74c0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:14.500476 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-136e3fc3-2588-43b1-91dc-cc5bd310edb6 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/detail?changes-since=2022-08-09T17%3A18%3A03Z" status: 200 len: 6331 microversion: 2.1 time: 0.296569 Aug 09 17:21:14.502383 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1322/2765] 10.222.0.93 () {58 vars in 1220 bytes} [Tue Aug 9 17:21:14 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-09T17%3A18%3A03Z => generated 6331 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:14.513384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:14.515255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:14.528359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:14.530099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:14.531330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:14.533708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:14.535059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:14.536252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:15.256138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:15.272599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:15.274869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:15.276405 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d6972daf-6664-4292-b9d0-95f8afb279d5 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1365 microversion: 2.47 time: 0.771567 Aug 09 17:21:15.277249 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1323/2766] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:14 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1365 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:15.283551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b32c64aa-afa4-4efa-9363-5bf83f28ce46 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '.version_select at 0x7fbbcb4b34c0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:15.308306 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b32c64aa-afa4-4efa-9363-5bf83f28ce46 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] HTTP exception thrown: Image not found. Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b32c64aa-afa4-4efa-9363-5bf83f28ce46 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/images/494f86d3-cbf9-4228-a373-4c38df4615c7 HTTP/1.1 Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: exception: Image not found. Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '494f86d3-cbf9-4228-a373-4c38df4615c7'} Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 494f86d3-cbf9-4228-a373-4c38df4615c7 Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 17:21:15.310737 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 494f86d3-cbf9-4228-a373-4c38df4615c7 could not be found. Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:21:15.315298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:15.322116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b32c64aa-afa4-4efa-9363-5bf83f28ce46 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 404 to user: Image not found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:15.322680 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b32c64aa-afa4-4efa-9363-5bf83f28ce46 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/images/494f86d3-cbf9-4228-a373-4c38df4615c7" status: 404 len: 62 microversion: 2.1 time: 0.043630 Aug 09 17:21:15.323841 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1324/2767] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:21:15 2022] GET /compute/v2.1/images/494f86d3-cbf9-4228-a373-4c38df4615c7 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:21:15.331142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b9ffa6ea-d411-44fc-8c1b-cdfe96dfce86 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:15.332272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b9ffa6ea-d411-44fc-8c1b-cdfe96dfce86 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:15.341305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9ffa6ea-d411-44fc-8c1b-cdfe96dfce86 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:15.342651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9ffa6ea-d411-44fc-8c1b-cdfe96dfce86 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:15.343418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9ffa6ea-d411-44fc-8c1b-cdfe96dfce86 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:15.345619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9ffa6ea-d411-44fc-8c1b-cdfe96dfce86 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:15.346451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9ffa6ea-d411-44fc-8c1b-cdfe96dfce86 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:15.347156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9ffa6ea-d411-44fc-8c1b-cdfe96dfce86 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:15.507090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b9ffa6ea-d411-44fc-8c1b-cdfe96dfce86 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:15.518685 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b9ffa6ea-d411-44fc-8c1b-cdfe96dfce86 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1266 microversion: 2.1 time: 0.193436 Aug 09 17:21:15.520045 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1325/2768] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:15 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:15.525902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bd1aa49a-859f-4c50-a7bb-d0ad215f1162 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb43dca0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:15.607863 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bd1aa49a-859f-4c50-a7bb-d0ad215f1162 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-319510156" status: 200 len: 664 microversion: 2.1 time: 0.083852 Aug 09 17:21:15.608988 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1326/2769] 10.222.0.93 () {58 vars in 1250 bytes} [Tue Aug 9 17:21:15 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-319510156 => generated 664 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:15.617939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c615d33c-0e30-4441-93a3-1fcceddcc56c tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:15.618592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c615d33c-0e30-4441-93a3-1fcceddcc56c tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:15.635509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:21:15.651163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c615d33c-0e30-4441-93a3-1fcceddcc56c tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:15.652006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c615d33c-0e30-4441-93a3-1fcceddcc56c tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:15.653911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c615d33c-0e30-4441-93a3-1fcceddcc56c tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:15.656380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c615d33c-0e30-4441-93a3-1fcceddcc56c tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:15.656880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:21:15.659228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c615d33c-0e30-4441-93a3-1fcceddcc56c tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:15.661035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c615d33c-0e30-4441-93a3-1fcceddcc56c tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:15.664037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:21:15.667208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:21:15.672091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:21:15.717301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=26 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:15.744081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:15.745413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:15.747173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:15.749310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:15.750953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:15.752238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:15.825387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Getting quotas for project a8fc22300e744d5e92d7cc5806f771c9. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:15.844381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Getting quotas for user e785c5c340fa4d5c9e21691459bd6cb9 and project a8fc22300e744d5e92d7cc5806f771c9. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:15.876910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:21:15.882096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:21:16.008163 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4eeb217b-b830-4c4f-af06-ce43eb4f2514 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.653067 Aug 09 17:21:16.009189 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1444/2770] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:21:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:21:16.020143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6ecbc109-6998-4bfa-b380-13ff98e2d2b2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:16.021554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6ecbc109-6998-4bfa-b380-13ff98e2d2b2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:16.036178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ecbc109-6998-4bfa-b380-13ff98e2d2b2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:16.037396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ecbc109-6998-4bfa-b380-13ff98e2d2b2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:16.037870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ecbc109-6998-4bfa-b380-13ff98e2d2b2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:16.039451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ecbc109-6998-4bfa-b380-13ff98e2d2b2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:16.040165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ecbc109-6998-4bfa-b380-13ff98e2d2b2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:16.040963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ecbc109-6998-4bfa-b380-13ff98e2d2b2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:16.347234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c615d33c-0e30-4441-93a3-1fcceddcc56c tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:16.350766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6ecbc109-6998-4bfa-b380-13ff98e2d2b2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:16.382844 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c615d33c-0e30-4441-93a3-1fcceddcc56c tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1520 microversion: 2.1 time: 0.768702 Aug 09 17:21:16.385950 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1327/2771] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:15 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1520 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:16.402853 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6ecbc109-6998-4bfa-b380-13ff98e2d2b2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 200 len: 1277 microversion: 2.1 time: 0.359662 Aug 09 17:21:16.410841 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1445/2772] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:16 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 1277 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:16.425649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d65ef935-ea18-40a1-a5e2-e6038d697dab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:16.426698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d58037b2-bb40-4305-ba6a-0b1af8572da0 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcadc9790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:16.433201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d65ef935-ea18-40a1-a5e2-e6038d697dab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:16.463746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65ef935-ea18-40a1-a5e2-e6038d697dab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:16.465150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65ef935-ea18-40a1-a5e2-e6038d697dab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:16.466627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65ef935-ea18-40a1-a5e2-e6038d697dab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:16.469189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65ef935-ea18-40a1-a5e2-e6038d697dab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:16.471087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65ef935-ea18-40a1-a5e2-e6038d697dab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:16.473355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d65ef935-ea18-40a1-a5e2-e6038d697dab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:16.568823 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d58037b2-bb40-4305-ba6a-0b1af8572da0 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2Ff7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1466 microversion: 2.1 time: 0.154161 Aug 09 17:21:16.583737 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1446/2773] 10.222.0.93 () {58 vars in 1338 bytes} [Tue Aug 9 17:21:16 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2Ff7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1466 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:16.606301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-382924863", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "b2ce9140-b640-4166-a8ca-6f566766cd65"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:16.789700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] validate_networks() for [('b2ce9140-b640-4166-a8ca-6f566766cd65', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:21:17.949955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d65ef935-ea18-40a1-a5e2-e6038d697dab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:17.988572 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d65ef935-ea18-40a1-a5e2-e6038d697dab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1522 microversion: 2.1 time: 1.594403 Aug 09 17:21:17.992361 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1328/2774] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:16 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1522 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:18.033688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:18.034667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:18.073885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:18.075132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:18.075989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:18.077570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:18.092367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:18.093227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:18.328184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:18.344646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:18.348700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:18.351066 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2af0bc1e-20d2-4efb-b7a9-a41f05af1152 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1365 microversion: 2.47 time: 0.356438 Aug 09 17:21:18.352669 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1329/2775] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:17 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:18.372834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4e63d8ff-07b7-4730-9521-e64cd36a4834 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:18.373924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4e63d8ff-07b7-4730-9521-e64cd36a4834 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:18.395027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e63d8ff-07b7-4730-9521-e64cd36a4834 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:18.395959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e63d8ff-07b7-4730-9521-e64cd36a4834 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:18.396777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e63d8ff-07b7-4730-9521-e64cd36a4834 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:18.399531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e63d8ff-07b7-4730-9521-e64cd36a4834 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:18.399531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e63d8ff-07b7-4730-9521-e64cd36a4834 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:18.400121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e63d8ff-07b7-4730-9521-e64cd36a4834 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:19.101381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4e63d8ff-07b7-4730-9521-e64cd36a4834 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:19.111956 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4e63d8ff-07b7-4730-9521-e64cd36a4834 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1314 microversion: 2.1 time: 0.757818 Aug 09 17:21:19.131756 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1330/2776] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:18 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:19.131756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a8061b4e-c997-4abf-8fd8-eb11489c416a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb5d3700>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:19.261887 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a8061b4e-c997-4abf-8fd8-eb11489c416a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2Ff7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1466 microversion: 2.1 time: 0.142892 Aug 09 17:21:19.269847 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1331/2777] 10.222.0.93 () {58 vars in 1324 bytes} [Tue Aug 9 17:21:19 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2Ff7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1466 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:19.300812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d991df1-249e-42bf-bfde-84e6e53834be tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-951350784", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8b88de5d-20c1-43f7-96af-6509f4aa64b2"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d991df1-249e-42bf-bfde-84e6e53834be tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Request method failure captured: Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 242 Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pdvj182bvivBGMJ1s_1P27R0vEGmpJf4kr7bqW8v38650m_kRqYwMayma5XXy9abU4DTdz2l7uRQC5hcUPRtyik1KQozuyIE6WcZpGD19SVfz9xrPj0EbrKdVhzN5-LptRdpEi6JSqkus9ApLN42xZzAEEwPwc3VmVhfeoTNmZLfQY Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c1f493e3c15a484c9734782994007480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c1f493e3c15a484c9734782994007480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 9d9fad7bbf774879a55b6dc21e181eeb Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-951350784", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8b88de5d-20c1-43f7-96af-6509f4aa64b2"}]}} Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-951350784', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8b88de5d-20c1-43f7-96af-6509f4aa64b2'}]}}} Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:19.321615 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:19.336364 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:19.354043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d991df1-249e-42bf-bfde-84e6e53834be tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:19.356944 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0d991df1-249e-42bf-bfde-84e6e53834be tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.084286 Aug 09 17:21:19.370727 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1332/2778] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:21:19 2022] POST /compute/v2.1/servers => generated 175 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:21:19.383375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ddc152d-8871-443d-ae9d-05dbf7af5ca2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:19.387160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3ddc152d-8871-443d-ae9d-05dbf7af5ca2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:19.413574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ddc152d-8871-443d-ae9d-05dbf7af5ca2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:19.415653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ddc152d-8871-443d-ae9d-05dbf7af5ca2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:19.416833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ddc152d-8871-443d-ae9d-05dbf7af5ca2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:19.418855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ddc152d-8871-443d-ae9d-05dbf7af5ca2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:19.420531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ddc152d-8871-443d-ae9d-05dbf7af5ca2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:19.431046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ddc152d-8871-443d-ae9d-05dbf7af5ca2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:19.849399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3ddc152d-8871-443d-ae9d-05dbf7af5ca2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:19.877924 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3ddc152d-8871-443d-ae9d-05dbf7af5ca2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 200 len: 1319 microversion: 2.1 time: 0.503713 Aug 09 17:21:19.894331 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1333/2779] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:19 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 1319 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:19.906505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-64205d51-8338-4fca-83e3-e34ba190933d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:19.908058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-64205d51-8338-4fca-83e3-e34ba190933d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:19.915983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64205d51-8338-4fca-83e3-e34ba190933d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:19.916787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64205d51-8338-4fca-83e3-e34ba190933d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:19.917418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64205d51-8338-4fca-83e3-e34ba190933d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:19.918368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64205d51-8338-4fca-83e3-e34ba190933d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:19.919016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64205d51-8338-4fca-83e3-e34ba190933d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:19.919823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64205d51-8338-4fca-83e3-e34ba190933d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:19.975014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-64205d51-8338-4fca-83e3-e34ba190933d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:21:20.064638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:21:20.065186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:21:20.065533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:21:20.066138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:21:20.066574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:21:20.085212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:20.097657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:20.100632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:20.102434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:20.103298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:20.105262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:20.139357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Getting quotas for project a8fc22300e744d5e92d7cc5806f771c9. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:20.150907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Getting quotas for user e785c5c340fa4d5c9e21691459bd6cb9 and project a8fc22300e744d5e92d7cc5806f771c9. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:20.155693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:20.180038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:21:20.187245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 74cc072b-21ba-4456-8e16-2390ad0b0c44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:21:20.189680 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-64205d51-8338-4fca-83e3-e34ba190933d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "DELETE /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 204 len: 0 microversion: 2.1 time: 0.293893 Aug 09 17:21:20.190617 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1334/2780] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:21:19 2022] DELETE /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:20.197931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-84e42e07-2355-4f14-9680-dfde7ba06e0a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcbb7aaf0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:20.304813 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-10a74245-1a9f-4412-9d5c-a8c0b51973ab tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.728081 Aug 09 17:21:20.310744 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1447/2781] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:21:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:21:20.320133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c8c2023-fac9-45f9-b61d-4bdcecd025f5 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:20.324817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7c8c2023-fac9-45f9-b61d-4bdcecd025f5 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 00f3ad64-e085-4b40-9c1d-b0e99c18cced] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:20.339309 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-7c8c2023-fac9-45f9-b61d-4bdcecd025f5 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] HTTP exception thrown: Instance 00f3ad64-e085-4b40-9c1d-b0e99c18cced could not be found. Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c8c2023-fac9-45f9-b61d-4bdcecd025f5 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Request method failure captured: Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/00f3ad64-e085-4b40-9c1d-b0e99c18cced/metadata HTTP/1.1 Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pdvj182bvivBGMJ1s_1P27R0vEGmpJf4kr7bqW8v38650m_kRqYwMayma5XXy9abU4DTdz2l7uRQC5hcUPRtyik1KQozuyIE6WcZpGD19SVfz9xrPj0EbrKdVhzN5-LptRdpEi6JSqkus9ApLN42xZzAEEwPwc3VmVhfeoTNmZLfQY Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c1f493e3c15a484c9734782994007480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c1f493e3c15a484c9734782994007480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9d9fad7bbf774879a55b6dc21e181eeb Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 00f3ad64-e085-4b40-9c1d-b0e99c18cced could not be found. Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': '00f3ad64-e085-4b40-9c1d-b0e99c18cced'} Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f3ad64-e085-4b40-9c1d-b0e99c18cced could not be found. Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f3ad64-e085-4b40-9c1d-b0e99c18cced could not be found. Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:20.348368 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:20.352681 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:20.352681 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:20.352681 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f3ad64-e085-4b40-9c1d-b0e99c18cced could not be found. Aug 09 17:21:20.352681 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:20.354827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c8c2023-fac9-45f9-b61d-4bdcecd025f5 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Returning 404 to user: Instance 00f3ad64-e085-4b40-9c1d-b0e99c18cced could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:20.356159 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7c8c2023-fac9-45f9-b61d-4bdcecd025f5 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/00f3ad64-e085-4b40-9c1d-b0e99c18cced/metadata" status: 404 len: 111 microversion: 2.1 time: 0.043959 Aug 09 17:21:20.358122 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1448/2782] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:21:20 2022] GET /compute/v2.1/servers/00f3ad64-e085-4b40-9c1d-b0e99c18cced/metadata => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:20.378582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:20.385413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:20.406949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:20.408764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:20.415519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:20.416895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:20.429822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:20.430833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:20.554598 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-84e42e07-2355-4f14-9680-dfde7ba06e0a tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7106 microversion: 2.1 time: 0.362629 Aug 09 17:21:20.571840 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1335/2783] 10.222.0.93 () {58 vars in 1170 bytes} [Tue Aug 9 17:21:20 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7106 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:20.582123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f16f5505-2990-4770-af73-4364058071ed tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:20.583110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f16f5505-2990-4770-af73-4364058071ed tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:20.598854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f16f5505-2990-4770-af73-4364058071ed tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:20.599366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f16f5505-2990-4770-af73-4364058071ed tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:20.610910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f16f5505-2990-4770-af73-4364058071ed tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:20.611780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f16f5505-2990-4770-af73-4364058071ed tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:20.612279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f16f5505-2990-4770-af73-4364058071ed tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:20.612718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f16f5505-2990-4770-af73-4364058071ed tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:21.227978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f16f5505-2990-4770-af73-4364058071ed tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:21.244748 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f16f5505-2990-4770-af73-4364058071ed tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1314 microversion: 2.1 time: 0.671526 Aug 09 17:21:21.245530 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1336/2784] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:20 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:21.256335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cad50bbc-0f3a-4239-8517-2d3442937359 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:21.256810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cad50bbc-0f3a-4239-8517-2d3442937359 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:21.273855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cad50bbc-0f3a-4239-8517-2d3442937359 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:21.276124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cad50bbc-0f3a-4239-8517-2d3442937359 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:21.280573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cad50bbc-0f3a-4239-8517-2d3442937359 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:21.281612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cad50bbc-0f3a-4239-8517-2d3442937359 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:21.283125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cad50bbc-0f3a-4239-8517-2d3442937359 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:21.284335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:21.286077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cad50bbc-0f3a-4239-8517-2d3442937359 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:21.295765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:21.298578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:21.302866 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94379662-4d07-4cf5-8506-52a2825d1063 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1365 microversion: 2.47 time: 0.940315 Aug 09 17:21:21.312807 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1449/2785] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:20 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1365 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:21.320875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6ec6a04-beda-41a2-add3-2d0b9aad6c8f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1038715747", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b88de5d-20c1-43f7-96af-6509f4aa64b2"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6ec6a04-beda-41a2-add3-2d0b9aad6c8f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Request method failure captured: Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 499 Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pdvj182bvivBGMJ1s_1P27R0vEGmpJf4kr7bqW8v38650m_kRqYwMayma5XXy9abU4DTdz2l7uRQC5hcUPRtyik1KQozuyIE6WcZpGD19SVfz9xrPj0EbrKdVhzN5-LptRdpEi6JSqkus9ApLN42xZzAEEwPwc3VmVhfeoTNmZLfQY Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c1f493e3c15a484c9734782994007480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c1f493e3c15a484c9734782994007480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9d9fad7bbf774879a55b6dc21e181eeb Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1038715747", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b88de5d-20c1-43f7-96af-6509f4aa64b2"}]}} Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1038715747', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8b88de5d-20c1-43f7-96af-6509f4aa64b2'}]}}} Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 17:21:21.334748 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6ec6a04-beda-41a2-add3-2d0b9aad6c8f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e6ec6a04-beda-41a2-add3-2d0b9aad6c8f tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.028648 Aug 09 17:21:21.357894 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1450/2786] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:21:21 2022] POST /compute/v2.1/servers => generated 687 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:21:21.369445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c78130d-cf6b-4710-b882-ee9e298fbfa8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcad27af0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:21.581965 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c78130d-cf6b-4710-b882-ee9e298fbfa8 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.237556 Aug 09 17:21:21.605697 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1451/2787] 10.222.0.93 () {58 vars in 1170 bytes} [Tue Aug 9 17:21:21 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:21.621012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2001489455", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "451", "networks": [{"uuid": "b2ce9140-b640-4166-a8ca-6f566766cd65"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:21.693479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cad50bbc-0f3a-4239-8517-2d3442937359 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:21.714851 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cad50bbc-0f3a-4239-8517-2d3442937359 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1528 microversion: 2.1 time: 0.468116 Aug 09 17:21:21.716128 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1337/2788] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:21 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1528 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:21.727990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d6f12154-d073-4ce8-81b5-95bfc6c86b86 req-9f0b0560-0398-4348-95fb-0d4f5431b85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880", "tag": "71fced49-3256-46cc-a608-d2c9fc8d8421"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:21.793306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d6f12154-d073-4ce8-81b5-95bfc6c86b86 req-9f0b0560-0398-4348-95fb-0d4f5431b85f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:21.800728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] validate_networks() for [('b2ce9140-b640-4166-a8ca-6f566766cd65', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:21:21.802403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d6f12154-d073-4ce8-81b5-95bfc6c86b86 req-9f0b0560-0398-4348-95fb-0d4f5431b85f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:21.803441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d6f12154-d073-4ce8-81b5-95bfc6c86b86 req-9f0b0560-0398-4348-95fb-0d4f5431b85f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:21.841178 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d6f12154-d073-4ce8-81b5-95bfc6c86b86 req-9f0b0560-0398-4348-95fb-0d4f5431b85f service nova] Creating event network-changed:71fced49-3256-46cc-a608-d2c9fc8d8421 for instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 on n-h1-845781-6 Aug 09 17:21:21.851749 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d6f12154-d073-4ce8-81b5-95bfc6c86b86 req-9f0b0560-0398-4348-95fb-0d4f5431b85f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128802 Aug 09 17:21:21.853315 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1338/2789] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:21.865871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3d7e37aa-a181-4caf-ab87-85d5f346fbc2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:21.868511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3d7e37aa-a181-4caf-ab87-85d5f346fbc2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:21.882988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d7e37aa-a181-4caf-ab87-85d5f346fbc2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:21.884112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d7e37aa-a181-4caf-ab87-85d5f346fbc2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:21.887275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d7e37aa-a181-4caf-ab87-85d5f346fbc2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:21.889264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d7e37aa-a181-4caf-ab87-85d5f346fbc2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:21.892149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d7e37aa-a181-4caf-ab87-85d5f346fbc2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:21.893460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d7e37aa-a181-4caf-ab87-85d5f346fbc2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:22.711934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d7e37aa-a181-4caf-ab87-85d5f346fbc2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:22.798417 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3d7e37aa-a181-4caf-ab87-85d5f346fbc2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 200 len: 1319 microversion: 2.1 time: 0.940190 Aug 09 17:21:22.821900 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1339/2790] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:21 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 1319 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:22.845283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4b84aaa5-c635-4870-9599-2f7201e8a1be tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1121684598", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b88de5d-20c1-43f7-96af-6509f4aa64b2"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4b84aaa5-c635-4870-9599-2f7201e8a1be tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Request method failure captured: Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 500 Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pdvj182bvivBGMJ1s_1P27R0vEGmpJf4kr7bqW8v38650m_kRqYwMayma5XXy9abU4DTdz2l7uRQC5hcUPRtyik1KQozuyIE6WcZpGD19SVfz9xrPj0EbrKdVhzN5-LptRdpEi6JSqkus9ApLN42xZzAEEwPwc3VmVhfeoTNmZLfQY Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c1f493e3c15a484c9734782994007480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c1f493e3c15a484c9734782994007480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 9d9fad7bbf774879a55b6dc21e181eeb Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1121684598", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b88de5d-20c1-43f7-96af-6509f4aa64b2"}]}} Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1121684598', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8b88de5d-20c1-43f7-96af-6509f4aa64b2'}]}}} Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 17:21:22.873983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:22.882999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4b84aaa5-c635-4870-9599-2f7201e8a1be tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:22.905074 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4b84aaa5-c635-4870-9599-2f7201e8a1be tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.053836 Aug 09 17:21:22.919760 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1340/2791] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:21:22 2022] POST /compute/v2.1/servers => generated 689 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:21:22.943123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-09167390-5fa4-470a-a35c-b3c42a2746bf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb8019d0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:23.036639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:23.084413 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-09167390-5fa4-470a-a35c-b3c42a2746bf tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/f484be58-00e8-4507-b378-ca7d3c0dd32d" status: 200 len: 784 microversion: 2.1 time: 0.170200 Aug 09 17:21:23.090671 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1341/2792] 10.222.0.93 () {58 vars in 1233 bytes} [Tue Aug 9 17:21:22 2022] GET /compute/v2.1/images/f484be58-00e8-4507-b378-ca7d3c0dd32d => generated 784 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:23.107152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-74909c38-433a-47ac-a75c-f2ab3270e0f3 req-fa8beb24-e602-437e-8167-536a5a2f1f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29188f6a-3896-4045-9ad5-bbf0997ead47", "name": "network-vif-plugged", "status": "completed", "tag": "d69fd5a4-38f8-49e1-9d53-5bdd6b6bdb82"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:23.128692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=36 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:23.154013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-74909c38-433a-47ac-a75c-f2ab3270e0f3 req-fa8beb24-e602-437e-8167-536a5a2f1f49 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:23.154622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-74909c38-433a-47ac-a75c-f2ab3270e0f3 req-fa8beb24-e602-437e-8167-536a5a2f1f49 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:23.155219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-74909c38-433a-47ac-a75c-f2ab3270e0f3 req-fa8beb24-e602-437e-8167-536a5a2f1f49 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:23.178583 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-74909c38-433a-47ac-a75c-f2ab3270e0f3 req-fa8beb24-e602-437e-8167-536a5a2f1f49 service nova] Creating event network-vif-plugged:d69fd5a4-38f8-49e1-9d53-5bdd6b6bdb82 for instance 29188f6a-3896-4045-9ad5-bbf0997ead47 on n-h2-845781-6 Aug 09 17:21:23.188067 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-74909c38-433a-47ac-a75c-f2ab3270e0f3 req-fa8beb24-e602-437e-8167-536a5a2f1f49 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095117 Aug 09 17:21:23.189590 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1342/2793] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:23.199684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-420ab242-66e0-44e3-9f2f-94a4d3687683 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:23.200899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-420ab242-66e0-44e3-9f2f-94a4d3687683 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:23.210486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:23.214315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-420ab242-66e0-44e3-9f2f-94a4d3687683 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:23.215197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-420ab242-66e0-44e3-9f2f-94a4d3687683 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:23.216069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-420ab242-66e0-44e3-9f2f-94a4d3687683 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:23.217393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-420ab242-66e0-44e3-9f2f-94a4d3687683 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:23.218234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-420ab242-66e0-44e3-9f2f-94a4d3687683 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:23.219289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-420ab242-66e0-44e3-9f2f-94a4d3687683 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:24.687565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-420ab242-66e0-44e3-9f2f-94a4d3687683 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:24.723816 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-420ab242-66e0-44e3-9f2f-94a4d3687683 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1314 microversion: 2.1 time: 1.531996 Aug 09 17:21:24.740786 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1343/2794] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:23 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1314 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:24.762434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:24.764329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:24.777527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:24.778798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:24.779895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:24.781477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:24.783086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:24.784114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:24.795932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:25.046250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:25.074851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:25.090624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:25.093106 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad91ee7a-4377-413a-b2fb-a9f4fdb68c2e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1365 microversion: 2.47 time: 0.349974 Aug 09 17:21:25.094187 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1344/2795] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:24 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:25.104062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-561b6d30-c25d-4f28-be8f-e5c60fb40281 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:25.105624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-561b6d30-c25d-4f28-be8f-e5c60fb40281 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:25.117675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-561b6d30-c25d-4f28-be8f-e5c60fb40281 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:25.128960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-561b6d30-c25d-4f28-be8f-e5c60fb40281 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:25.130146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-561b6d30-c25d-4f28-be8f-e5c60fb40281 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:25.131832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-561b6d30-c25d-4f28-be8f-e5c60fb40281 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:25.133046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-561b6d30-c25d-4f28-be8f-e5c60fb40281 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:25.133848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-561b6d30-c25d-4f28-be8f-e5c60fb40281 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:25.184558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:21:25.185322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:21:25.188931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:21:25.191515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:21:25.196681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:21:25.253462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:25.268438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:25.278457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:25.280889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:25.282675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:25.283928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:25.369663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Getting quotas for project a8fc22300e744d5e92d7cc5806f771c9. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:25.387826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Getting quotas for user e785c5c340fa4d5c9e21691459bd6cb9 and project a8fc22300e744d5e92d7cc5806f771c9. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:25.440133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:21:25.450114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:21:25.665172 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-da75e319-1ff7-47a5-8143-ffaeddb9b059 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.057451 Aug 09 17:21:25.668209 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1452/2796] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:21:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:21:25.699031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69cadb1d-2e42-4a73-830c-f794ad2c0afb tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcad331f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:25.896194 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69cadb1d-2e42-4a73-830c-f794ad2c0afb tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.217438 Aug 09 17:21:25.901463 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1453/2797] 10.222.0.93 () {58 vars in 1158 bytes} [Tue Aug 9 17:21:25 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:25.924989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d2588b9-2f9e-4a61-b994-ea0a2c047e02 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-850313189", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b88de5d-20c1-43f7-96af-6509f4aa64b2"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d2588b9-2f9e-4a61-b994-ea0a2c047e02 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Request method failure captured: Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 753 Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pdvj182bvivBGMJ1s_1P27R0vEGmpJf4kr7bqW8v38650m_kRqYwMayma5XXy9abU4DTdz2l7uRQC5hcUPRtyik1KQozuyIE6WcZpGD19SVfz9xrPj0EbrKdVhzN5-LptRdpEi6JSqkus9ApLN42xZzAEEwPwc3VmVhfeoTNmZLfQY Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c1f493e3c15a484c9734782994007480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c1f493e3c15a484c9734782994007480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9d9fad7bbf774879a55b6dc21e181eeb Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-850313189", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b88de5d-20c1-43f7-96af-6509f4aa64b2"}]}} Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-850313189', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8b88de5d-20c1-43f7-96af-6509f4aa64b2'}]}}} Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:21:25.942103 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:21:25.947729 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:21:25.952931 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:25.952931 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:25.952931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d2588b9-2f9e-4a61-b994-ea0a2c047e02 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:25.958061 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5d2588b9-2f9e-4a61-b994-ea0a2c047e02 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.054395 Aug 09 17:21:25.961050 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1454/2798] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:21:25 2022] POST /compute/v2.1/servers => generated 1197 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 09 17:21:26.016088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-28830072-347f-4882-99f5-9b40bde08c1e req-587629af-ef9b-4944-9e98-5c69c21047d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3", "tag": "fb66ba26-cadb-4e08-b9d8-d3ec7bd243c1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:26.054097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28830072-347f-4882-99f5-9b40bde08c1e req-587629af-ef9b-4944-9e98-5c69c21047d3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:26.060777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28830072-347f-4882-99f5-9b40bde08c1e req-587629af-ef9b-4944-9e98-5c69c21047d3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:26.063817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28830072-347f-4882-99f5-9b40bde08c1e req-587629af-ef9b-4944-9e98-5c69c21047d3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:26.128612 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-28830072-347f-4882-99f5-9b40bde08c1e req-587629af-ef9b-4944-9e98-5c69c21047d3 service nova] Creating event network-changed:fb66ba26-cadb-4e08-b9d8-d3ec7bd243c1 for instance 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 on n-h1-845781-6 Aug 09 17:21:26.141608 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-28830072-347f-4882-99f5-9b40bde08c1e req-587629af-ef9b-4944-9e98-5c69c21047d3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162354 Aug 09 17:21:26.144258 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1455/2799] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:26.156270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1455d109-6dd9-4c60-9590-65a57c598089 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:26.158654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1455d109-6dd9-4c60-9590-65a57c598089 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:26.173899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1455d109-6dd9-4c60-9590-65a57c598089 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:26.175243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1455d109-6dd9-4c60-9590-65a57c598089 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:26.176709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1455d109-6dd9-4c60-9590-65a57c598089 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:26.178359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1455d109-6dd9-4c60-9590-65a57c598089 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:26.179512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1455d109-6dd9-4c60-9590-65a57c598089 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:26.180661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1455d109-6dd9-4c60-9590-65a57c598089 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:26.224412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-561b6d30-c25d-4f28-be8f-e5c60fb40281 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:26.239284 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-561b6d30-c25d-4f28-be8f-e5c60fb40281 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 200 len: 1528 microversion: 2.1 time: 1.142646 Aug 09 17:21:26.240590 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1345/2800] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:25 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 1528 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:26.245929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-681a48ac-eb73-4d8e-9fbc-b084a16625d7 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:26.254116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-681a48ac-eb73-4d8e-9fbc-b084a16625d7 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:26.479414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-681a48ac-eb73-4d8e-9fbc-b084a16625d7 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:26.504172 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-681a48ac-eb73-4d8e-9fbc-b084a16625d7 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1221 microversion: 2.1 time: 0.261651 Aug 09 17:21:26.505220 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1346/2801] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:26 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1221 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:26.515502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c4c86d26-df95-4d85-b195-4454b54a0026 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:26.517011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c4c86d26-df95-4d85-b195-4454b54a0026 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:26.529221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4c86d26-df95-4d85-b195-4454b54a0026 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:26.530108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4c86d26-df95-4d85-b195-4454b54a0026 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:26.530914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4c86d26-df95-4d85-b195-4454b54a0026 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:26.532410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4c86d26-df95-4d85-b195-4454b54a0026 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:26.533561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4c86d26-df95-4d85-b195-4454b54a0026 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:26.534319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4c86d26-df95-4d85-b195-4454b54a0026 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:27.211947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1455d109-6dd9-4c60-9590-65a57c598089 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:27.242619 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1455d109-6dd9-4c60-9590-65a57c598089 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 200 len: 1319 microversion: 2.1 time: 1.094463 Aug 09 17:21:27.245995 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1456/2802] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:26 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 1319 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:27.270379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f443fdc9-a8e9-4ee0-8fdc-ecc3e8954308 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcad33430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:27.484038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c4c86d26-df95-4d85-b195-4454b54a0026 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:27.534128 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c4c86d26-df95-4d85-b195-4454b54a0026 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1314 microversion: 2.1 time: 1.023901 Aug 09 17:21:27.539202 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1347/2803] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:26 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1314 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:27.588870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-988be470-4756-457b-9a22-9169b5657497 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-458763162", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b88de5d-20c1-43f7-96af-6509f4aa64b2"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-988be470-4756-457b-9a22-9169b5657497 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Request method failure captured: Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 1265 Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pdvj182bvivBGMJ1s_1P27R0vEGmpJf4kr7bqW8v38650m_kRqYwMayma5XXy9abU4DTdz2l7uRQC5hcUPRtyik1KQozuyIE6WcZpGD19SVfz9xrPj0EbrKdVhzN5-LptRdpEi6JSqkus9ApLN42xZzAEEwPwc3VmVhfeoTNmZLfQY Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c1f493e3c15a484c9734782994007480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c1f493e3c15a484c9734782994007480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 9d9fad7bbf774879a55b6dc21e181eeb Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-458763162", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8b88de5d-20c1-43f7-96af-6509f4aa64b2"}]}} Aug 09 17:21:27.616582 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-458763162', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8b88de5d-20c1-43f7-96af-6509f4aa64b2'}]}}} Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:27.622034 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:21:27.626323 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:21:27.634033 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 17:21:27.634033 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:27.643935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-988be470-4756-457b-9a22-9169b5657497 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:27.651343 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-988be470-4756-457b-9a22-9169b5657497 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.104580 Aug 09 17:21:27.654119 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1348/2804] 10.222.0.93 () {60 vars in 1148 bytes} [Tue Aug 9 17:21:27 2022] POST /compute/v2.1/servers => generated 2221 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 09 17:21:27.671363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:27.673546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:27.718906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:27.725087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:27.726364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:27.727928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:27.730544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:27.737163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:28.127160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:28.168912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:28.177599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:28.180351 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fabc4e3b-224c-454a-a974-3825a0f2a261 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1365 microversion: 2.47 time: 0.523238 Aug 09 17:21:28.182388 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1349/2805] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:27 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1365 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:28.217584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a778722d-46f3-40cf-8e3c-3beda902b3d4 req-90d9e5a5-d0cf-4972-bcbd-a0a5e69a1bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29188f6a-3896-4045-9ad5-bbf0997ead47", "name": "network-vif-deleted", "tag": "d69fd5a4-38f8-49e1-9d53-5bdd6b6bdb82"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:28.243965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a778722d-46f3-40cf-8e3c-3beda902b3d4 req-90d9e5a5-d0cf-4972-bcbd-a0a5e69a1bcb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:28.246799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a778722d-46f3-40cf-8e3c-3beda902b3d4 req-90d9e5a5-d0cf-4972-bcbd-a0a5e69a1bcb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:28.248324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a778722d-46f3-40cf-8e3c-3beda902b3d4 req-90d9e5a5-d0cf-4972-bcbd-a0a5e69a1bcb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:28.285638 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a778722d-46f3-40cf-8e3c-3beda902b3d4 req-90d9e5a5-d0cf-4972-bcbd-a0a5e69a1bcb service nova] Creating event network-vif-deleted:d69fd5a4-38f8-49e1-9d53-5bdd6b6bdb82 for instance 29188f6a-3896-4045-9ad5-bbf0997ead47 on n-h2-845781-6 Aug 09 17:21:28.301014 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a778722d-46f3-40cf-8e3c-3beda902b3d4 req-90d9e5a5-d0cf-4972-bcbd-a0a5e69a1bcb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112460 Aug 09 17:21:28.303003 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1350/2806] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:28.317436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:28.319140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:28.332587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:28.333714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:28.335171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:28.337843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:28.339261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:28.341555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:28.376721 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] HTTP exception thrown: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 HTTP/1.1 Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '29188f6a-3896-4045-9ad5-bbf0997ead47'} Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:28.380704 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:28.385506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:28.385506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:28.385506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:28.385506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:28.385506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:28.385506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:28.385506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:21:28.385506 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:28.387534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 404 to user: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:28.389428 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-87113546-aea2-4db4-8ded-e8eda23e8804 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 404 len: 111 microversion: 2.1 time: 0.083924 Aug 09 17:21:28.405792 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1351/2807] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:28 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:28.417502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f402c8c5-a79e-427d-9f6b-d83304d1c554 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:28.421378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f402c8c5-a79e-427d-9f6b-d83304d1c554 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:28.447917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f402c8c5-a79e-427d-9f6b-d83304d1c554 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:28.448868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f402c8c5-a79e-427d-9f6b-d83304d1c554 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:28.449583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f402c8c5-a79e-427d-9f6b-d83304d1c554 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:28.450837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f402c8c5-a79e-427d-9f6b-d83304d1c554 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:28.451677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f402c8c5-a79e-427d-9f6b-d83304d1c554 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:28.452420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f402c8c5-a79e-427d-9f6b-d83304d1c554 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:29.028910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f402c8c5-a79e-427d-9f6b-d83304d1c554 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:29.059429 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f402c8c5-a79e-427d-9f6b-d83304d1c554 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1281 microversion: 2.1 time: 0.650059 Aug 09 17:21:29.061384 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1352/2808] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:28 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1281 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:29.085382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-73b45646-461e-4374-a3a5-6d1e3543a9a9 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:29.087369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-73b45646-461e-4374-a3a5-6d1e3543a9a9 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 2ca9b71e-6aed-4803-9b92-2f0fc2acffe5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:29.099854 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-73b45646-461e-4374-a3a5-6d1e3543a9a9 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] HTTP exception thrown: Instance 2ca9b71e-6aed-4803-9b92-2f0fc2acffe5 could not be found. Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-73b45646-461e-4374-a3a5-6d1e3543a9a9 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Request method failure captured: Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/2ca9b71e-6aed-4803-9b92-2f0fc2acffe5/metadata/test2 HTTP/1.1 Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pdvj182bvivBGMJ1s_1P27R0vEGmpJf4kr7bqW8v38650m_kRqYwMayma5XXy9abU4DTdz2l7uRQC5hcUPRtyik1KQozuyIE6WcZpGD19SVfz9xrPj0EbrKdVhzN5-LptRdpEi6JSqkus9ApLN42xZzAEEwPwc3VmVhfeoTNmZLfQY Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c1f493e3c15a484c9734782994007480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c1f493e3c15a484c9734782994007480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 9d9fad7bbf774879a55b6dc21e181eeb Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 2ca9b71e-6aed-4803-9b92-2f0fc2acffe5 could not be found. Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'server_id': '2ca9b71e-6aed-4803-9b92-2f0fc2acffe5', 'id': 'test2'} Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca9b71e-6aed-4803-9b92-2f0fc2acffe5 could not be found. Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca9b71e-6aed-4803-9b92-2f0fc2acffe5 could not be found. Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:29.110771 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:29.119931 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:29.119931 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:29.119931 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca9b71e-6aed-4803-9b92-2f0fc2acffe5 could not be found. Aug 09 17:21:29.119931 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:29.124082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-73b45646-461e-4374-a3a5-6d1e3543a9a9 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Returning 404 to user: Instance 2ca9b71e-6aed-4803-9b92-2f0fc2acffe5 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:29.127539 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-73b45646-461e-4374-a3a5-6d1e3543a9a9 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/2ca9b71e-6aed-4803-9b92-2f0fc2acffe5/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.063682 Aug 09 17:21:29.145008 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1353/2809] 10.222.0.93 () {58 vars in 1281 bytes} [Tue Aug 9 17:21:29 2022] GET /compute/v2.1/servers/2ca9b71e-6aed-4803-9b92-2f0fc2acffe5/metadata/test2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:29.163397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-32b88e8f-0949-435a-8627-527fb976a198 req-3e3e8921-e8b8-408c-9e4a-1dd6096e1b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5d08d66-4857-4a2a-b204-3cc8383900c1", "tag": "cf245f33-18a6-4e7c-9406-31ad5e519173"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:29.174392 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f443fdc9-a8e9-4ee0-8fdc-ecc3e8954308 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "DELETE /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389" status: 204 len: 0 microversion: 2.1 time: 1.920838 Aug 09 17:21:29.176623 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1457/2810] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:27 2022] DELETE /compute/v2.1/images/f22e3a20-4d64-45a2-9f63-b9079d9e5389 => generated 0 bytes in 1929 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:29.203722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-90a8f5e8-24a1-4572-b72d-8cc91937d0ea tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:29.207354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-90a8f5e8-24a1-4572-b72d-8cc91937d0ea tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:29.210037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-32b88e8f-0949-435a-8627-527fb976a198 req-3e3e8921-e8b8-408c-9e4a-1dd6096e1b8f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:29.210953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-32b88e8f-0949-435a-8627-527fb976a198 req-3e3e8921-e8b8-408c-9e4a-1dd6096e1b8f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:29.211857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-32b88e8f-0949-435a-8627-527fb976a198 req-3e3e8921-e8b8-408c-9e4a-1dd6096e1b8f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:29.221435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90a8f5e8-24a1-4572-b72d-8cc91937d0ea tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:29.222890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90a8f5e8-24a1-4572-b72d-8cc91937d0ea tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:29.225021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90a8f5e8-24a1-4572-b72d-8cc91937d0ea tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:29.227324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90a8f5e8-24a1-4572-b72d-8cc91937d0ea tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:29.228549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90a8f5e8-24a1-4572-b72d-8cc91937d0ea tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:29.229858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90a8f5e8-24a1-4572-b72d-8cc91937d0ea tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:29.247361 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-32b88e8f-0949-435a-8627-527fb976a198 req-3e3e8921-e8b8-408c-9e4a-1dd6096e1b8f service nova] Creating event network-changed:cf245f33-18a6-4e7c-9406-31ad5e519173 for instance c5d08d66-4857-4a2a-b204-3cc8383900c1 on n-h2-845781-6 Aug 09 17:21:29.265537 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-32b88e8f-0949-435a-8627-527fb976a198 req-3e3e8921-e8b8-408c-9e4a-1dd6096e1b8f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117808 Aug 09 17:21:29.280234 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1354/2811] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:29.291382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-26e6646e-9700-436a-8b4c-f3f0b8b86246 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:29.300831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-26e6646e-9700-436a-8b4c-f3f0b8b86246 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:29.331061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26e6646e-9700-436a-8b4c-f3f0b8b86246 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:29.332485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26e6646e-9700-436a-8b4c-f3f0b8b86246 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:29.333940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26e6646e-9700-436a-8b4c-f3f0b8b86246 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:29.336006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26e6646e-9700-436a-8b4c-f3f0b8b86246 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:29.337267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26e6646e-9700-436a-8b4c-f3f0b8b86246 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:29.338351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26e6646e-9700-436a-8b4c-f3f0b8b86246 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:29.975968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-90a8f5e8-24a1-4572-b72d-8cc91937d0ea tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:30.004289 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-90a8f5e8-24a1-4572-b72d-8cc91937d0ea tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 200 len: 1319 microversion: 2.1 time: 0.825615 Aug 09 17:21:30.017276 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1458/2812] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:29 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 1319 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:30.023010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-26e6646e-9700-436a-8b4c-f3f0b8b86246 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:30.023886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1496546156", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:30.075088 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-26e6646e-9700-436a-8b4c-f3f0b8b86246 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1314 microversion: 2.1 time: 0.792745 Aug 09 17:21:30.075909 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1355/2813] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:29 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:30.083474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dc3a9777-2e81-4618-84ac-35ed13aefffd tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:30.084329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dc3a9777-2e81-4618-84ac-35ed13aefffd tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:30.104656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc3a9777-2e81-4618-84ac-35ed13aefffd tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:30.106939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc3a9777-2e81-4618-84ac-35ed13aefffd tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:30.108356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc3a9777-2e81-4618-84ac-35ed13aefffd tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:30.112131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc3a9777-2e81-4618-84ac-35ed13aefffd tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:30.113840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc3a9777-2e81-4618-84ac-35ed13aefffd tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:30.115588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc3a9777-2e81-4618-84ac-35ed13aefffd tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:30.146335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] validate_networks() for [('7a433422-1950-4c97-a7d7-e2c1728248b0', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:21:30.187180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dc3a9777-2e81-4618-84ac-35ed13aefffd tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:21:30.347749 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dc3a9777-2e81-4618-84ac-35ed13aefffd tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "DELETE /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 204 len: 0 microversion: 2.1 time: 0.270136 Aug 09 17:21:30.349176 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1356/2814] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:21:30 2022] DELETE /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:30.359401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7b053b4b-19b5-422a-926a-edf21467e7bc tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcbc0e5e0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:31.340029 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7b053b4b-19b5-422a-926a-edf21467e7bc tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "DELETE /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca" status: 204 len: 0 microversion: 2.1 time: 0.986217 Aug 09 17:21:31.341653 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1357/2815] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:30 2022] DELETE /compute/v2.1/images/4b9fc0dd-255d-428f-b2ae-3be05fdaa4ca => generated 0 bytes in 992 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:31.369127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:31.372935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:31.393875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:31.395334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:31.396599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:31.398527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:31.399923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:31.401124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:31.653907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:31.669397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:21:31.670705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:21:31.670894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:21:31.671584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:21:31.673119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:21:31.689397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:31.695441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:31.700381 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9183e51-3cb2-4d45-80c3-d4f3985f5540 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1365 microversion: 2.47 time: 0.346466 Aug 09 17:21:31.702595 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1358/2816] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:31 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:31.716442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-c264e96d-2da5-4584-a8a1-1be0b47bd89a req-c79f2a72-2888-42f7-a872-03a439108bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880", "name": "network-vif-plugged", "status": "completed", "tag": "71fced49-3256-46cc-a608-d2c9fc8d8421"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:31.723811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:31.724736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:31.726163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:31.726927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:31.737804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:31.739442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:31.749999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c264e96d-2da5-4584-a8a1-1be0b47bd89a req-c79f2a72-2888-42f7-a872-03a439108bd6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:31.756060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c264e96d-2da5-4584-a8a1-1be0b47bd89a req-c79f2a72-2888-42f7-a872-03a439108bd6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:31.758922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c264e96d-2da5-4584-a8a1-1be0b47bd89a req-c79f2a72-2888-42f7-a872-03a439108bd6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:31.801407 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-c264e96d-2da5-4584-a8a1-1be0b47bd89a req-c79f2a72-2888-42f7-a872-03a439108bd6 service nova] Creating event network-vif-plugged:71fced49-3256-46cc-a608-d2c9fc8d8421 for instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 on n-h1-845781-6 Aug 09 17:21:31.814416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Getting quotas for project 09c53ff5b89f4495958c9319d750833c. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:31.822298 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-c264e96d-2da5-4584-a8a1-1be0b47bd89a req-c79f2a72-2888-42f7-a872-03a439108bd6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110902 Aug 09 17:21:31.823447 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1359/2817] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:31.830734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Getting quotas for user 4ab568d7612c4f849e842d478b67016d and project 09c53ff5b89f4495958c9319d750833c. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:31.850654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d9e67a8-dd25-4eb4-895d-12e57509c1c4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:31.852004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d9e67a8-dd25-4eb4-895d-12e57509c1c4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:31.874583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d9e67a8-dd25-4eb4-895d-12e57509c1c4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:31.874948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:21:31.876282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d9e67a8-dd25-4eb4-895d-12e57509c1c4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:31.877831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d9e67a8-dd25-4eb4-895d-12e57509c1c4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:31.879267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d9e67a8-dd25-4eb4-895d-12e57509c1c4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:31.880330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d9e67a8-dd25-4eb4-895d-12e57509c1c4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:31.881652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d9e67a8-dd25-4eb4-895d-12e57509c1c4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:31.882915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:21:32.041437 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bd1299c0-2018-4c02-a4e0-5a434b3677c7 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.021374 Aug 09 17:21:32.056787 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1459/2818] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:21:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:21:32.067658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8342d735-b5a3-4e37-8f74-4eec0ec00770 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:32.068968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8342d735-b5a3-4e37-8f74-4eec0ec00770 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:32.095080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8342d735-b5a3-4e37-8f74-4eec0ec00770 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:32.099526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8342d735-b5a3-4e37-8f74-4eec0ec00770 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:32.100592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8342d735-b5a3-4e37-8f74-4eec0ec00770 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:32.104831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8342d735-b5a3-4e37-8f74-4eec0ec00770 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:32.105785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8342d735-b5a3-4e37-8f74-4eec0ec00770 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:32.109698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8342d735-b5a3-4e37-8f74-4eec0ec00770 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:32.237212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5d9e67a8-dd25-4eb4-895d-12e57509c1c4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:32.263431 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5d9e67a8-dd25-4eb4-895d-12e57509c1c4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1279 microversion: 2.1 time: 0.433365 Aug 09 17:21:32.269945 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1360/2819] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:31 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1279 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:32.292743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8434255e-cf46-4fa3-8094-44b163e14372 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:32.294874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8434255e-cf46-4fa3-8094-44b163e14372 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:32.338020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8434255e-cf46-4fa3-8094-44b163e14372 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:32.338887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8434255e-cf46-4fa3-8094-44b163e14372 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:32.339680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8434255e-cf46-4fa3-8094-44b163e14372 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:32.340950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8434255e-cf46-4fa3-8094-44b163e14372 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:32.353069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8434255e-cf46-4fa3-8094-44b163e14372 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:32.354585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8434255e-cf46-4fa3-8094-44b163e14372 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:32.638350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8342d735-b5a3-4e37-8f74-4eec0ec00770 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:32.652825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:32.659279 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8342d735-b5a3-4e37-8f74-4eec0ec00770 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1526 microversion: 2.1 time: 0.600055 Aug 09 17:21:32.677237 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1460/2820] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:32 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1526 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:32.706286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c86c7433-927f-4ea6-b4b8-137359f9b2d9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:32.708629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c86c7433-927f-4ea6-b4b8-137359f9b2d9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:32.724728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c86c7433-927f-4ea6-b4b8-137359f9b2d9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:32.726097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c86c7433-927f-4ea6-b4b8-137359f9b2d9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:32.727143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c86c7433-927f-4ea6-b4b8-137359f9b2d9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:32.728736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c86c7433-927f-4ea6-b4b8-137359f9b2d9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:32.729831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c86c7433-927f-4ea6-b4b8-137359f9b2d9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:32.730882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c86c7433-927f-4ea6-b4b8-137359f9b2d9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:33.082600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c86c7433-927f-4ea6-b4b8-137359f9b2d9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:33.104151 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c86c7433-927f-4ea6-b4b8-137359f9b2d9 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1314 microversion: 2.1 time: 0.411521 Aug 09 17:21:33.119687 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1461/2821] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:32 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:33.124709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5e81ea53-60d8-42a6-ad2a-7e9ed84ed2d5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcad27790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:33.170733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8434255e-cf46-4fa3-8094-44b163e14372 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:33.191250 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8434255e-cf46-4fa3-8094-44b163e14372 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 200 len: 1319 microversion: 2.1 time: 0.918927 Aug 09 17:21:33.192172 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1361/2822] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:32 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 1319 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:33.198079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-61aaed10-9965-40ae-b256-bcfb6ed866aa req-831cf8c2-174c-4e8d-bb89-becd43023f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135a3475-d24e-4b79-abd0-bd99f5344195", "tag": "f2a9c808-4943-4a69-a090-18c6f4fb1bbf"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:33.208991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-61aaed10-9965-40ae-b256-bcfb6ed866aa req-831cf8c2-174c-4e8d-bb89-becd43023f38 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:33.209727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-61aaed10-9965-40ae-b256-bcfb6ed866aa req-831cf8c2-174c-4e8d-bb89-becd43023f38 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:33.210329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-61aaed10-9965-40ae-b256-bcfb6ed866aa req-831cf8c2-174c-4e8d-bb89-becd43023f38 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:33.227829 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-61aaed10-9965-40ae-b256-bcfb6ed866aa req-831cf8c2-174c-4e8d-bb89-becd43023f38 service nova] Creating event network-changed:f2a9c808-4943-4a69-a090-18c6f4fb1bbf for instance 135a3475-d24e-4b79-abd0-bd99f5344195 on n-h1-845781-6 Aug 09 17:21:33.238546 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-61aaed10-9965-40ae-b256-bcfb6ed866aa req-831cf8c2-174c-4e8d-bb89-becd43023f38 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044739 Aug 09 17:21:33.240354 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1362/2823] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:33.258748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-02b3fe26-089c-4150-adee-b5c06669a12d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:33.260057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-02b3fe26-089c-4150-adee-b5c06669a12d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:33.272900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02b3fe26-089c-4150-adee-b5c06669a12d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:33.274610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02b3fe26-089c-4150-adee-b5c06669a12d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:33.275617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02b3fe26-089c-4150-adee-b5c06669a12d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:33.277339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02b3fe26-089c-4150-adee-b5c06669a12d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:33.278492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02b3fe26-089c-4150-adee-b5c06669a12d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:33.279463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02b3fe26-089c-4150-adee-b5c06669a12d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:33.520068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-02b3fe26-089c-4150-adee-b5c06669a12d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:33.540309 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-02b3fe26-089c-4150-adee-b5c06669a12d tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1229 microversion: 2.1 time: 0.296596 Aug 09 17:21:33.541775 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1363/2824] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:33 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1229 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:33.574030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:33.576597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:33.601132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:33.603287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:33.604067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:33.609130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:33.610960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:33.612376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:34.051166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:34.075809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:34.079065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:34.082028 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-36948235-e671-40cb-b00c-e32ed5a29b32 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1365 microversion: 2.47 time: 0.537940 Aug 09 17:21:34.083837 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1364/2825] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:33 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1365 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:34.093058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6029cf7d-68bf-47ad-ad44-ee3dec691d8a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:34.109338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6029cf7d-68bf-47ad-ad44-ee3dec691d8a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:34.128946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6029cf7d-68bf-47ad-ad44-ee3dec691d8a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:34.131854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6029cf7d-68bf-47ad-ad44-ee3dec691d8a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:34.134855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6029cf7d-68bf-47ad-ad44-ee3dec691d8a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:34.139065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6029cf7d-68bf-47ad-ad44-ee3dec691d8a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:34.140028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6029cf7d-68bf-47ad-ad44-ee3dec691d8a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:34.141701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6029cf7d-68bf-47ad-ad44-ee3dec691d8a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:34.308903 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5e81ea53-60d8-42a6-ad2a-7e9ed84ed2d5 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "DELETE /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307" status: 204 len: 0 microversion: 2.1 time: 1.192673 Aug 09 17:21:34.311325 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1462/2826] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:33 2022] DELETE /compute/v2.1/images/717e48ab-3379-404f-8a8f-7221b9dfa307 => generated 0 bytes in 1196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:34.330842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e26d491c-0c18-47c3-a7ae-632762357dee req-710e98f4-1d00-463f-bdf0-3f266e7a9e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cc072b-21ba-4456-8e16-2390ad0b0c44", "tag": "d7835108-b545-4a3e-8fc8-112acbca6297"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:34.366863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e26d491c-0c18-47c3-a7ae-632762357dee req-710e98f4-1d00-463f-bdf0-3f266e7a9e62 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:34.378830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e26d491c-0c18-47c3-a7ae-632762357dee req-710e98f4-1d00-463f-bdf0-3f266e7a9e62 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:34.380268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e26d491c-0c18-47c3-a7ae-632762357dee req-710e98f4-1d00-463f-bdf0-3f266e7a9e62 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:34.413194 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e26d491c-0c18-47c3-a7ae-632762357dee req-710e98f4-1d00-463f-bdf0-3f266e7a9e62 service nova] Creating event network-changed:d7835108-b545-4a3e-8fc8-112acbca6297 for instance 74cc072b-21ba-4456-8e16-2390ad0b0c44 on n-h1-845781-6 Aug 09 17:21:34.429160 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e26d491c-0c18-47c3-a7ae-632762357dee req-710e98f4-1d00-463f-bdf0-3f266e7a9e62 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115279 Aug 09 17:21:34.430856 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1463/2827] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:34.460075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0dd621e7-655c-4ca3-b134-8e30d1c9e1d0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:34.461958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0dd621e7-655c-4ca3-b134-8e30d1c9e1d0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:34.482445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dd621e7-655c-4ca3-b134-8e30d1c9e1d0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:34.483395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dd621e7-655c-4ca3-b134-8e30d1c9e1d0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:34.485839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dd621e7-655c-4ca3-b134-8e30d1c9e1d0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:34.493446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dd621e7-655c-4ca3-b134-8e30d1c9e1d0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:34.494250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dd621e7-655c-4ca3-b134-8e30d1c9e1d0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:34.495123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dd621e7-655c-4ca3-b134-8e30d1c9e1d0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:35.357519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0dd621e7-655c-4ca3-b134-8e30d1c9e1d0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fad7bbf774879a55b6dc21e181eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f493e3c15a484c9734782994007480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:35.379830 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0dd621e7-655c-4ca3-b134-8e30d1c9e1d0 tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 200 len: 1526 microversion: 2.1 time: 0.939081 Aug 09 17:21:35.392494 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1464/2828] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:34 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 1526 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:35.404096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ecbaaafe-92a3-4467-b3c7-3d3b379c066d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:35.404096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ecbaaafe-92a3-4467-b3c7-3d3b379c066d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:35.415931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6029cf7d-68bf-47ad-ad44-ee3dec691d8a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:35.435093 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6029cf7d-68bf-47ad-ad44-ee3dec691d8a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1321 microversion: 2.1 time: 1.348379 Aug 09 17:21:35.436081 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1365/2829] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:34 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1321 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:35.437381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecbaaafe-92a3-4467-b3c7-3d3b379c066d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:35.438847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecbaaafe-92a3-4467-b3c7-3d3b379c066d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:35.439976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecbaaafe-92a3-4467-b3c7-3d3b379c066d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:35.441558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecbaaafe-92a3-4467-b3c7-3d3b379c066d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:35.452632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fae02906-0a5d-4605-8e37-d6fb497f88e3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:35.453281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fae02906-0a5d-4605-8e37-d6fb497f88e3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:35.454213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecbaaafe-92a3-4467-b3c7-3d3b379c066d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:35.455418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecbaaafe-92a3-4467-b3c7-3d3b379c066d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:35.469988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fae02906-0a5d-4605-8e37-d6fb497f88e3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:35.470507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fae02906-0a5d-4605-8e37-d6fb497f88e3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:35.470966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fae02906-0a5d-4605-8e37-d6fb497f88e3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:35.476241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fae02906-0a5d-4605-8e37-d6fb497f88e3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:35.476906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fae02906-0a5d-4605-8e37-d6fb497f88e3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:35.477377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fae02906-0a5d-4605-8e37-d6fb497f88e3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:35.532603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:36.198991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ecbaaafe-92a3-4467-b3c7-3d3b379c066d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:36.231602 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ecbaaafe-92a3-4467-b3c7-3d3b379c066d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1501 microversion: 2.1 time: 0.830616 Aug 09 17:21:36.234390 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1465/2830] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:35 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1501 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:36.289850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b4075d93-9b9a-47e1-a5b2-c724a18bea71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:36.290827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4075d93-9b9a-47e1-a5b2-c724a18bea71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:36.316514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4075d93-9b9a-47e1-a5b2-c724a18bea71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:36.317406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4075d93-9b9a-47e1-a5b2-c724a18bea71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:36.318179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4075d93-9b9a-47e1-a5b2-c724a18bea71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:36.320708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4075d93-9b9a-47e1-a5b2-c724a18bea71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:36.321902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4075d93-9b9a-47e1-a5b2-c724a18bea71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:36.322992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4075d93-9b9a-47e1-a5b2-c724a18bea71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:36.401702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4075d93-9b9a-47e1-a5b2-c724a18bea71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:21:36.496398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:36.596775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fae02906-0a5d-4605-8e37-d6fb497f88e3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:36.598635 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b4075d93-9b9a-47e1-a5b2-c724a18bea71 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 204 len: 0 microversion: 2.1 time: 0.340778 Aug 09 17:21:36.603926 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1466/2831] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:21:36 2022] DELETE /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:36.619944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-85fb3373-a7ce-48b3-b6d4-d199f3a18c14 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:36.620992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-85fb3373-a7ce-48b3-b6d4-d199f3a18c14 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:36.624019 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fae02906-0a5d-4605-8e37-d6fb497f88e3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 200 len: 1319 microversion: 2.1 time: 1.182077 Aug 09 17:21:36.625082 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1366/2832] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:35 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 1319 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:36.640697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85fb3373-a7ce-48b3-b6d4-d199f3a18c14 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:36.642352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85fb3373-a7ce-48b3-b6d4-d199f3a18c14 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:36.642876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-321662f6-e32b-4ed4-8528-a29d8913c8c0 req-983a8c95-caec-4467-900e-4c6723d84a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d08d66-4857-4a2a-b204-3cc8383900c1", "name": "network-vif-plugged", "status": "completed", "tag": "cf245f33-18a6-4e7c-9406-31ad5e519173"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:36.643863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85fb3373-a7ce-48b3-b6d4-d199f3a18c14 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:36.644995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85fb3373-a7ce-48b3-b6d4-d199f3a18c14 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:36.646619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85fb3373-a7ce-48b3-b6d4-d199f3a18c14 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:36.647740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85fb3373-a7ce-48b3-b6d4-d199f3a18c14 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:36.684874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-321662f6-e32b-4ed4-8528-a29d8913c8c0 req-983a8c95-caec-4467-900e-4c6723d84a0f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:36.686562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-321662f6-e32b-4ed4-8528-a29d8913c8c0 req-983a8c95-caec-4467-900e-4c6723d84a0f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:36.687441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-321662f6-e32b-4ed4-8528-a29d8913c8c0 req-983a8c95-caec-4467-900e-4c6723d84a0f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:36.739442 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-321662f6-e32b-4ed4-8528-a29d8913c8c0 req-983a8c95-caec-4467-900e-4c6723d84a0f service nova] Creating event network-vif-plugged:cf245f33-18a6-4e7c-9406-31ad5e519173 for instance c5d08d66-4857-4a2a-b204-3cc8383900c1 on n-h2-845781-6 Aug 09 17:21:36.825373 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-321662f6-e32b-4ed4-8528-a29d8913c8c0 req-983a8c95-caec-4467-900e-4c6723d84a0f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198068 Aug 09 17:21:36.837211 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1367/2833] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:36.874367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:36.877397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:36.898325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:36.899217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:36.900071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:36.901082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:36.902031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:36.902709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:36.904142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-85fb3373-a7ce-48b3-b6d4-d199f3a18c14 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:36.922684 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-85fb3373-a7ce-48b3-b6d4-d199f3a18c14 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1283 microversion: 2.1 time: 0.316744 Aug 09 17:21:36.924769 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1467/2834] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:36 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1283 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:36.941937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ef812a6b-5029-44b2-b70d-6f3e0635bfe1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:36.942524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ef812a6b-5029-44b2-b70d-6f3e0635bfe1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:36.973291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef812a6b-5029-44b2-b70d-6f3e0635bfe1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:36.973804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef812a6b-5029-44b2-b70d-6f3e0635bfe1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:36.974257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef812a6b-5029-44b2-b70d-6f3e0635bfe1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:36.974994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef812a6b-5029-44b2-b70d-6f3e0635bfe1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:36.975454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef812a6b-5029-44b2-b70d-6f3e0635bfe1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:36.976216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef812a6b-5029-44b2-b70d-6f3e0635bfe1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:37.043397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-ef812a6b-5029-44b2-b70d-6f3e0635bfe1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lazy-loading 'flavor' on Instance uuid 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:21:37.270678 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ef812a6b-5029-44b2-b70d-6f3e0635bfe1 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "POST /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880/action" status: 202 len: 0 microversion: 2.1 time: 0.343762 Aug 09 17:21:37.277043 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1468/2835] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:21:36 2022] POST /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:21:37.299031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:37.308196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] [instance: 488bf4e2-f491-4e78-b219-77d9c53d50ec] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:37.316703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:37.329422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:37.330340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:37.334256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:37.341243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:37.345633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:37.346421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:37.362552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:37.366760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:37.369394 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-95de7816-aa0d-46bc-b37d-a63b20d87643 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1365 microversion: 2.47 time: 0.527025 Aug 09 17:21:37.371662 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1368/2836] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:36 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1365 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:37.406395 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] HTTP exception thrown: Instance 488bf4e2-f491-4e78-b219-77d9c53d50ec could not be found. Aug 09 17:21:37.408722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-57c74777-49db-4348-bd37-940f2465cd87 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Request method failure captured: Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec HTTP/1.1 Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pdvj182bvivBGMJ1s_1P27R0vEGmpJf4kr7bqW8v38650m_kRqYwMayma5XXy9abU4DTdz2l7uRQC5hcUPRtyik1KQozuyIE6WcZpGD19SVfz9xrPj0EbrKdVhzN5-LptRdpEi6JSqkus9ApLN42xZzAEEwPwc3VmVhfeoTNmZLfQY Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c1f493e3c15a484c9734782994007480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c1f493e3c15a484c9734782994007480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c1f493e3c15a484c9734782994007480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: c1f493e3c15a484c9734782994007480 Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1413121618 Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9d9fad7bbf774879a55b6dc21e181eeb Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1413121618-project Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 488bf4e2-f491-4e78-b219-77d9c53d50ec could not be found. Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '488bf4e2-f491-4e78-b219-77d9c53d50ec'} Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 488bf4e2-f491-4e78-b219-77d9c53d50ec could not be found. Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 488bf4e2-f491-4e78-b219-77d9c53d50ec could not be found. Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:37.411765 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:37.418636 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:37.418636 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:37.418636 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:37.418636 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:37.418636 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:37.418636 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:37.418636 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 488bf4e2-f491-4e78-b219-77d9c53d50ec could not be found. Aug 09 17:21:37.418636 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:37.418636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] Returning 404 to user: Instance 488bf4e2-f491-4e78-b219-77d9c53d50ec could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:37.418636 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a453adf8-db37-4ad0-be2e-be0207fb3a4a tempest-ServerMetadataNegativeTestJSON-1413121618 tempest-ServerMetadataNegativeTestJSON-1413121618-project] 10.222.0.93 "GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec" status: 404 len: 111 microversion: 2.1 time: 0.128418 Aug 09 17:21:37.418636 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1469/2837] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:37 2022] GET /compute/v2.1/servers/488bf4e2-f491-4e78-b219-77d9c53d50ec => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:37.420036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-57c74777-49db-4348-bd37-940f2465cd87 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:37.420932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f6cdab43-a116-4e8a-85ae-d07e04b1a984 req-1caf8371-58a0-4b7d-a8fc-7011970ee9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "488bf4e2-f491-4e78-b219-77d9c53d50ec", "name": "network-vif-deleted", "tag": "e48bd9fb-7365-4224-86f8-e3a708d863cb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:37.443257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f6cdab43-a116-4e8a-85ae-d07e04b1a984 req-1caf8371-58a0-4b7d-a8fc-7011970ee9a7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:37.444415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f6cdab43-a116-4e8a-85ae-d07e04b1a984 req-1caf8371-58a0-4b7d-a8fc-7011970ee9a7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:37.444886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f6cdab43-a116-4e8a-85ae-d07e04b1a984 req-1caf8371-58a0-4b7d-a8fc-7011970ee9a7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:37.461724 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f6cdab43-a116-4e8a-85ae-d07e04b1a984 req-1caf8371-58a0-4b7d-a8fc-7011970ee9a7 service nova] Creating event network-vif-deleted:e48bd9fb-7365-4224-86f8-e3a708d863cb for instance 488bf4e2-f491-4e78-b219-77d9c53d50ec on n-h2-845781-6 Aug 09 17:21:37.466242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57c74777-49db-4348-bd37-940f2465cd87 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:37.467211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57c74777-49db-4348-bd37-940f2465cd87 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:37.468033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57c74777-49db-4348-bd37-940f2465cd87 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:37.469870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57c74777-49db-4348-bd37-940f2465cd87 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:37.470138 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f6cdab43-a116-4e8a-85ae-d07e04b1a984 req-1caf8371-58a0-4b7d-a8fc-7011970ee9a7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053308 Aug 09 17:21:37.471304 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1470/2838] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:37.473180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57c74777-49db-4348-bd37-940f2465cd87 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:37.478054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c53213c8-e636-45a7-81f4-929573beb1a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:37.479090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c53213c8-e636-45a7-81f4-929573beb1a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:37.480687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57c74777-49db-4348-bd37-940f2465cd87 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:37.487508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c53213c8-e636-45a7-81f4-929573beb1a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:37.488820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c53213c8-e636-45a7-81f4-929573beb1a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:37.489446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c53213c8-e636-45a7-81f4-929573beb1a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:37.490381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c53213c8-e636-45a7-81f4-929573beb1a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:37.491029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c53213c8-e636-45a7-81f4-929573beb1a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:37.491686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c53213c8-e636-45a7-81f4-929573beb1a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:38.473191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c53213c8-e636-45a7-81f4-929573beb1a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:38.497395 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c53213c8-e636-45a7-81f4-929573beb1a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1473 microversion: 2.1 time: 1.023974 Aug 09 17:21:38.518761 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1471/2839] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:37 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1473 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:38.542671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7af92c3f-1426-4457-a8f7-987b8ed6ba2f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:38.544674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7af92c3f-1426-4457-a8f7-987b8ed6ba2f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:38.560545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af92c3f-1426-4457-a8f7-987b8ed6ba2f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:38.563395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af92c3f-1426-4457-a8f7-987b8ed6ba2f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:38.565173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af92c3f-1426-4457-a8f7-987b8ed6ba2f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:38.569114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af92c3f-1426-4457-a8f7-987b8ed6ba2f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:38.570444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af92c3f-1426-4457-a8f7-987b8ed6ba2f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:38.571613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af92c3f-1426-4457-a8f7-987b8ed6ba2f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:39.110672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-57c74777-49db-4348-bd37-940f2465cd87 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:39.133531 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-57c74777-49db-4348-bd37-940f2465cd87 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1321 microversion: 2.1 time: 1.751312 Aug 09 17:21:39.135063 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1369/2840] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:37 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1321 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:39.142262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-73a7c4a0-6742-4e0e-831d-00291b131bee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:39.143296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-73a7c4a0-6742-4e0e-831d-00291b131bee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:39.152444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73a7c4a0-6742-4e0e-831d-00291b131bee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:39.153419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73a7c4a0-6742-4e0e-831d-00291b131bee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:39.154756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73a7c4a0-6742-4e0e-831d-00291b131bee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:39.156091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73a7c4a0-6742-4e0e-831d-00291b131bee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:39.156864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73a7c4a0-6742-4e0e-831d-00291b131bee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:39.157525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-73a7c4a0-6742-4e0e-831d-00291b131bee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:39.232940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7af92c3f-1426-4457-a8f7-987b8ed6ba2f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:39.251835 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7af92c3f-1426-4457-a8f7-987b8ed6ba2f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1509 microversion: 2.1 time: 0.729142 Aug 09 17:21:39.263669 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1472/2841] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:38 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1509 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:39.283879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4fdfc63a-df86-464b-b7d1-b3eb33c17937 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:39.283879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4fdfc63a-df86-464b-b7d1-b3eb33c17937 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:39.288324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fdfc63a-df86-464b-b7d1-b3eb33c17937 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:39.290147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fdfc63a-df86-464b-b7d1-b3eb33c17937 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:39.290925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fdfc63a-df86-464b-b7d1-b3eb33c17937 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:39.292231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fdfc63a-df86-464b-b7d1-b3eb33c17937 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:39.293039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fdfc63a-df86-464b-b7d1-b3eb33c17937 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:39.293956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fdfc63a-df86-464b-b7d1-b3eb33c17937 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:39.861643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-73a7c4a0-6742-4e0e-831d-00291b131bee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:39.896885 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-73a7c4a0-6742-4e0e-831d-00291b131bee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 200 len: 1319 microversion: 2.1 time: 0.757401 Aug 09 17:21:39.904725 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1370/2842] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:39 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 1319 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:39.926075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:39.929100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:39.965942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:39.966820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:39.967618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:39.969011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:39.976359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:39.977149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:40.140155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4fdfc63a-df86-464b-b7d1-b3eb33c17937 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:40.161293 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4fdfc63a-df86-464b-b7d1-b3eb33c17937 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1325 microversion: 2.1 time: 0.905614 Aug 09 17:21:40.177759 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1473/2843] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:39 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1325 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:40.200225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-05d1e140-957c-4c72-bc39-5c3b89d33964 req-c665938b-ba48-4da0-8bb4-f062a3ac8663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3", "name": "network-vif-plugged", "status": "completed", "tag": "fb66ba26-cadb-4e08-b9d8-d3ec7bd243c1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:40.240385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-05d1e140-957c-4c72-bc39-5c3b89d33964 req-c665938b-ba48-4da0-8bb4-f062a3ac8663 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:40.243279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-05d1e140-957c-4c72-bc39-5c3b89d33964 req-c665938b-ba48-4da0-8bb4-f062a3ac8663 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:40.244127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-05d1e140-957c-4c72-bc39-5c3b89d33964 req-c665938b-ba48-4da0-8bb4-f062a3ac8663 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:40.293866 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-05d1e140-957c-4c72-bc39-5c3b89d33964 req-c665938b-ba48-4da0-8bb4-f062a3ac8663 service nova] Creating event network-vif-plugged:fb66ba26-cadb-4e08-b9d8-d3ec7bd243c1 for instance 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 on n-h1-845781-6 Aug 09 17:21:40.317717 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-05d1e140-957c-4c72-bc39-5c3b89d33964 req-c665938b-ba48-4da0-8bb4-f062a3ac8663 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137159 Aug 09 17:21:40.320704 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1474/2844] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:40.340942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-35422842-e2c9-45f8-842b-e8dbf5ed3f06 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:40.341295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-35422842-e2c9-45f8-842b-e8dbf5ed3f06 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:40.354592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35422842-e2c9-45f8-842b-e8dbf5ed3f06 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:40.355497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35422842-e2c9-45f8-842b-e8dbf5ed3f06 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:40.356338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35422842-e2c9-45f8-842b-e8dbf5ed3f06 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:40.359833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35422842-e2c9-45f8-842b-e8dbf5ed3f06 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:40.360900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35422842-e2c9-45f8-842b-e8dbf5ed3f06 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:40.361718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35422842-e2c9-45f8-842b-e8dbf5ed3f06 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:40.616186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:40.645906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:40.650030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:40.653044 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bfd87738-8022-491d-a2b6-cd71a8d94e93 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1365 microversion: 2.47 time: 0.746296 Aug 09 17:21:40.668511 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1371/2845] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:39 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1365 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:40.703607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-451cb9cb-1209-4c6f-bf1d-a395c3afe19a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:40.705435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-451cb9cb-1209-4c6f-bf1d-a395c3afe19a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:40.718938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-451cb9cb-1209-4c6f-bf1d-a395c3afe19a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:40.720472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-451cb9cb-1209-4c6f-bf1d-a395c3afe19a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:40.721722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-451cb9cb-1209-4c6f-bf1d-a395c3afe19a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:40.724626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-451cb9cb-1209-4c6f-bf1d-a395c3afe19a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:40.726073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-451cb9cb-1209-4c6f-bf1d-a395c3afe19a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:40.727293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-451cb9cb-1209-4c6f-bf1d-a395c3afe19a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:41.113272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-35422842-e2c9-45f8-842b-e8dbf5ed3f06 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:41.155676 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-35422842-e2c9-45f8-842b-e8dbf5ed3f06 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 200 len: 1473 microversion: 2.1 time: 0.833624 Aug 09 17:21:41.160937 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1475/2846] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:40 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 1473 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:41.186525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d7515403-70f4-4ab9-acf4-89cd855cbd2c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:41.189186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d7515403-70f4-4ab9-acf4-89cd855cbd2c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:41.215314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7515403-70f4-4ab9-acf4-89cd855cbd2c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:41.216048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7515403-70f4-4ab9-acf4-89cd855cbd2c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:41.216818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7515403-70f4-4ab9-acf4-89cd855cbd2c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:41.217917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7515403-70f4-4ab9-acf4-89cd855cbd2c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:41.221039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7515403-70f4-4ab9-acf4-89cd855cbd2c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:41.222043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7515403-70f4-4ab9-acf4-89cd855cbd2c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:41.711826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-451cb9cb-1209-4c6f-bf1d-a395c3afe19a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:41.774271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:41.808199 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-451cb9cb-1209-4c6f-bf1d-a395c3afe19a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1321 microversion: 2.1 time: 1.135521 Aug 09 17:21:41.809886 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1372/2847] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:40 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1321 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:41.828985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-cacf9533-ac73-434e-8eb9-ee62e40c35af req-b859b855-49b1-415b-9e11-b4ebcfc349fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e2b0c9a-c146-45bc-9afc-133d574faf9d", "tag": "7f367fd1-9fb9-4ca6-aa5a-34fe505ffa73"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:41.835102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d7515403-70f4-4ab9-acf4-89cd855cbd2c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:41.854765 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d7515403-70f4-4ab9-acf4-89cd855cbd2c tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1492 microversion: 2.1 time: 0.688047 Aug 09 17:21:41.855408 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1476/2848] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:41 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1492 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:41.860975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6720c90-4682-4267-a2ff-a7bf9d3f6ab3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:41.861603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e6720c90-4682-4267-a2ff-a7bf9d3f6ab3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:41.863392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cacf9533-ac73-434e-8eb9-ee62e40c35af req-b859b855-49b1-415b-9e11-b4ebcfc349fc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:41.865253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cacf9533-ac73-434e-8eb9-ee62e40c35af req-b859b855-49b1-415b-9e11-b4ebcfc349fc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:41.866487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cacf9533-ac73-434e-8eb9-ee62e40c35af req-b859b855-49b1-415b-9e11-b4ebcfc349fc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:41.877684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=24 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:41.879307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6720c90-4682-4267-a2ff-a7bf9d3f6ab3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:41.879853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6720c90-4682-4267-a2ff-a7bf9d3f6ab3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:41.880332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6720c90-4682-4267-a2ff-a7bf9d3f6ab3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:41.881066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6720c90-4682-4267-a2ff-a7bf9d3f6ab3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:41.881529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6720c90-4682-4267-a2ff-a7bf9d3f6ab3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:41.882174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6720c90-4682-4267-a2ff-a7bf9d3f6ab3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:41.903272 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-cacf9533-ac73-434e-8eb9-ee62e40c35af req-b859b855-49b1-415b-9e11-b4ebcfc349fc service nova] Creating event network-changed:7f367fd1-9fb9-4ca6-aa5a-34fe505ffa73 for instance 0e2b0c9a-c146-45bc-9afc-133d574faf9d on n-h2-845781-6 Aug 09 17:21:41.916127 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-cacf9533-ac73-434e-8eb9-ee62e40c35af req-b859b855-49b1-415b-9e11-b4ebcfc349fc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096960 Aug 09 17:21:41.931928 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1373/2849] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:41.952747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-305ec9a3-9919-4dc3-a1ca-13e6125541d3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:41.954848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-305ec9a3-9919-4dc3-a1ca-13e6125541d3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:41.977242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-305ec9a3-9919-4dc3-a1ca-13e6125541d3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:41.985455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-305ec9a3-9919-4dc3-a1ca-13e6125541d3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:41.989312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-305ec9a3-9919-4dc3-a1ca-13e6125541d3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:41.991441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-305ec9a3-9919-4dc3-a1ca-13e6125541d3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:41.993787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-305ec9a3-9919-4dc3-a1ca-13e6125541d3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:41.995824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-305ec9a3-9919-4dc3-a1ca-13e6125541d3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:42.552786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e6720c90-4682-4267-a2ff-a7bf9d3f6ab3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:42.576732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:42.588865 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e6720c90-4682-4267-a2ff-a7bf9d3f6ab3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 200 len: 1468 microversion: 2.1 time: 0.731906 Aug 09 17:21:42.589978 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1477/2850] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:41 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 1468 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:42.603137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-39813f81-0cca-4737-b236-c838a6aee8fd req-4faf80f4-a7d9-4fd7-9804-76454a36ff33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28428f55-ba65-4ce3-b23a-5c7f94cab2d2", "tag": "6e6c78b4-aff3-460a-a11f-dfd02f73f73d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:42.651307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-39813f81-0cca-4737-b236-c838a6aee8fd req-4faf80f4-a7d9-4fd7-9804-76454a36ff33 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:42.652675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-39813f81-0cca-4737-b236-c838a6aee8fd req-4faf80f4-a7d9-4fd7-9804-76454a36ff33 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:42.653719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-39813f81-0cca-4737-b236-c838a6aee8fd req-4faf80f4-a7d9-4fd7-9804-76454a36ff33 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:42.687291 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-39813f81-0cca-4737-b236-c838a6aee8fd req-4faf80f4-a7d9-4fd7-9804-76454a36ff33 service nova] Creating event network-changed:6e6c78b4-aff3-460a-a11f-dfd02f73f73d for instance 28428f55-ba65-4ce3-b23a-5c7f94cab2d2 on n-h2-845781-6 Aug 09 17:21:42.701858 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-39813f81-0cca-4737-b236-c838a6aee8fd req-4faf80f4-a7d9-4fd7-9804-76454a36ff33 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109644 Aug 09 17:21:42.705835 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1478/2851] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:42.717760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:42.719988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:42.734000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:42.736008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:42.737543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:42.740305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:42.742324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:42.743958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:42.920878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:42.946276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:42.948174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:42.952958 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e08df25-97d2-443d-943a-fa33b31b28f8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1371 microversion: 2.47 time: 0.243799 Aug 09 17:21:42.959361 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1479/2852] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:42 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:42.967884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-047f8d03-c28e-47da-9594-9d5cf204fea7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:42.968561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-047f8d03-c28e-47da-9594-9d5cf204fea7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:42.983706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f8d03-c28e-47da-9594-9d5cf204fea7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:42.988077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f8d03-c28e-47da-9594-9d5cf204fea7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:42.989015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f8d03-c28e-47da-9594-9d5cf204fea7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:42.990063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f8d03-c28e-47da-9594-9d5cf204fea7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:42.991219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f8d03-c28e-47da-9594-9d5cf204fea7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:42.992010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f8d03-c28e-47da-9594-9d5cf204fea7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:43.038315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-047f8d03-c28e-47da-9594-9d5cf204fea7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:21:43.226076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:43.257432 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-047f8d03-c28e-47da-9594-9d5cf204fea7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 204 len: 0 microversion: 2.1 time: 0.291548 Aug 09 17:21:43.265003 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1480/2853] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:21:42 2022] DELETE /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:43.280384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:43.282972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: f7e3e8f0-9f58-47fd-8000-d875529d0b84] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:43.295588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:43.296971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:43.298698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:43.300307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:43.301701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:43.302804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:43.337964 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] HTTP exception thrown: Instance f7e3e8f0-9f58-47fd-8000-d875529d0b84 could not be found. Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Request method failure captured: Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 HTTP/1.1 Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pbKFJuUCAiJuaGIyQb6mDUjp_twin8F7JcgS0gPhEdOWNzwjCcXQriBDAHoaEY4H6RPf52smUaqCrk6ZXSPBM9gkHn-vnEuVBjW7JPwCXyn9efSaMuI4DmucZfydE0PE6nKA5Ic3tDRrMmbh2tqs2LPWhGkNJwlEFPlAxBbQ8TBthQ Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1ed2afd5a7c94838bb9f74b8b71ad263 Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ListImageFiltersTestJSON-1840563117 Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ed2afd5a7c94838bb9f74b8b71ad263"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ed2afd5a7c94838bb9f74b8b71ad263"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ed2afd5a7c94838bb9f74b8b71ad263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ed2afd5a7c94838bb9f74b8b71ad263"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ListImageFiltersTestJSON-1840563117 Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1ed2afd5a7c94838bb9f74b8b71ad263 Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1840563117 Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ListImageFiltersTestJSON-1840563117-project Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4ab47f4c2fa541a39b25856232720588 Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ListImageFiltersTestJSON-1840563117-project Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance f7e3e8f0-9f58-47fd-8000-d875529d0b84 could not be found. Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'f7e3e8f0-9f58-47fd-8000-d875529d0b84'} Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e3e8f0-9f58-47fd-8000-d875529d0b84 could not be found. Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e3e8f0-9f58-47fd-8000-d875529d0b84 could not be found. Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:43.341615 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:43.348805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:43.348805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:43.348805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:43.348805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:43.348805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:43.348805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e3e8f0-9f58-47fd-8000-d875529d0b84 could not be found. Aug 09 17:21:43.348805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:43.348805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Returning 404 to user: Instance f7e3e8f0-9f58-47fd-8000-d875529d0b84 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:43.351405 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e8d7f55-75b1-4c81-9606-a06dac96cdc2 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84" status: 404 len: 111 microversion: 2.1 time: 0.082651 Aug 09 17:21:43.357071 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1481/2854] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:43 2022] GET /compute/v2.1/servers/f7e3e8f0-9f58-47fd-8000-d875529d0b84 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:43.360291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-188aa08a-2aff-4058-8eca-5ec5ef4e5a0a req-4a91da3f-432c-431c-bdd3-f248ea33dd5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135a3475-d24e-4b79-abd0-bd99f5344195", "name": "network-vif-plugged", "status": "completed", "tag": "f2a9c808-4943-4a69-a090-18c6f4fb1bbf"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:43.372077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-188aa08a-2aff-4058-8eca-5ec5ef4e5a0a req-4a91da3f-432c-431c-bdd3-f248ea33dd5e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:43.372691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-188aa08a-2aff-4058-8eca-5ec5ef4e5a0a req-4a91da3f-432c-431c-bdd3-f248ea33dd5e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:43.373211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-188aa08a-2aff-4058-8eca-5ec5ef4e5a0a req-4a91da3f-432c-431c-bdd3-f248ea33dd5e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:43.403419 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-188aa08a-2aff-4058-8eca-5ec5ef4e5a0a req-4a91da3f-432c-431c-bdd3-f248ea33dd5e service nova] Creating event network-vif-plugged:f2a9c808-4943-4a69-a090-18c6f4fb1bbf for instance 135a3475-d24e-4b79-abd0-bd99f5344195 on n-h1-845781-6 Aug 09 17:21:43.409281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-305ec9a3-9919-4dc3-a1ca-13e6125541d3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:43.415854 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-188aa08a-2aff-4058-8eca-5ec5ef4e5a0a req-4a91da3f-432c-431c-bdd3-f248ea33dd5e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061501 Aug 09 17:21:43.417520 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1482/2855] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:43.430658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99a15fcc-9e2c-48bf-a3d2-04e85c00f5f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:43.432899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99a15fcc-9e2c-48bf-a3d2-04e85c00f5f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:43.447780 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-305ec9a3-9919-4dc3-a1ca-13e6125541d3 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1325 microversion: 2.1 time: 1.510658 Aug 09 17:21:43.450991 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1374/2856] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:41 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1325 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:43.456426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a15fcc-9e2c-48bf-a3d2-04e85c00f5f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:43.457764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a15fcc-9e2c-48bf-a3d2-04e85c00f5f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:43.459096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a15fcc-9e2c-48bf-a3d2-04e85c00f5f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:43.461507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a15fcc-9e2c-48bf-a3d2-04e85c00f5f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:43.464379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a15fcc-9e2c-48bf-a3d2-04e85c00f5f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:43.466981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a15fcc-9e2c-48bf-a3d2-04e85c00f5f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:43.471512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3d6c5480-352b-4ab4-b667-e48155409272 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:43.481383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3d6c5480-352b-4ab4-b667-e48155409272 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:43.502559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6c5480-352b-4ab4-b667-e48155409272 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:43.503456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6c5480-352b-4ab4-b667-e48155409272 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:43.506847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6c5480-352b-4ab4-b667-e48155409272 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:43.508180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6c5480-352b-4ab4-b667-e48155409272 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:43.508997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6c5480-352b-4ab4-b667-e48155409272 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:43.509735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6c5480-352b-4ab4-b667-e48155409272 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:44.111489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d6c5480-352b-4ab4-b667-e48155409272 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:44.128715 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3d6c5480-352b-4ab4-b667-e48155409272 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1321 microversion: 2.1 time: 0.676699 Aug 09 17:21:44.130513 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1375/2857] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:43 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1321 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:44.159573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c166e141-0443-4c98-927d-f3f26b81911e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:44.164242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c166e141-0443-4c98-927d-f3f26b81911e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:44.183505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c166e141-0443-4c98-927d-f3f26b81911e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:44.184619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c166e141-0443-4c98-927d-f3f26b81911e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:44.185484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c166e141-0443-4c98-927d-f3f26b81911e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:44.186948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c166e141-0443-4c98-927d-f3f26b81911e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:44.187909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c166e141-0443-4c98-927d-f3f26b81911e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:44.188806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c166e141-0443-4c98-927d-f3f26b81911e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:44.443190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99a15fcc-9e2c-48bf-a3d2-04e85c00f5f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:44.458102 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99a15fcc-9e2c-48bf-a3d2-04e85c00f5f1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3" status: 200 len: 1319 microversion: 2.1 time: 1.038131 Aug 09 17:21:44.459820 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1483/2858] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:43 2022] GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 => generated 1319 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:44.466033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a0281647-e004-463e-8d3d-4c6d7abd571c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:44.466961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a0281647-e004-463e-8d3d-4c6d7abd571c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:44.481493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0281647-e004-463e-8d3d-4c6d7abd571c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:44.482427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0281647-e004-463e-8d3d-4c6d7abd571c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:44.483271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0281647-e004-463e-8d3d-4c6d7abd571c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:44.484620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0281647-e004-463e-8d3d-4c6d7abd571c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:44.485531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0281647-e004-463e-8d3d-4c6d7abd571c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:44.486438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0281647-e004-463e-8d3d-4c6d7abd571c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:44.540606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a0281647-e004-463e-8d3d-4c6d7abd571c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:21:44.700521 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a0281647-e004-463e-8d3d-4c6d7abd571c tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991" status: 204 len: 0 microversion: 2.1 time: 0.238883 Aug 09 17:21:44.706209 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1484/2859] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:21:44 2022] DELETE /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:44.714175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b2d38f1b-2a41-48fe-b343-c13c00714511 req-f0230e9b-c5a7-4947-92a9-8830416226ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e3e8f0-9f58-47fd-8000-d875529d0b84", "name": "network-vif-deleted", "tag": "404b76c0-d83e-4f41-a30d-e7d27789aede"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:44.730318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b2d38f1b-2a41-48fe-b343-c13c00714511 req-f0230e9b-c5a7-4947-92a9-8830416226ad service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:44.732157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b2d38f1b-2a41-48fe-b343-c13c00714511 req-f0230e9b-c5a7-4947-92a9-8830416226ad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:44.732764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b2d38f1b-2a41-48fe-b343-c13c00714511 req-f0230e9b-c5a7-4947-92a9-8830416226ad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:44.748009 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b2d38f1b-2a41-48fe-b343-c13c00714511 req-f0230e9b-c5a7-4947-92a9-8830416226ad service nova] Creating event network-vif-deleted:404b76c0-d83e-4f41-a30d-e7d27789aede for instance f7e3e8f0-9f58-47fd-8000-d875529d0b84 on n-h2-845781-6 Aug 09 17:21:44.756192 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b2d38f1b-2a41-48fe-b343-c13c00714511 req-f0230e9b-c5a7-4947-92a9-8830416226ad service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052218 Aug 09 17:21:44.757220 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1485/2860] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:44.765904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:44.767034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:44.775007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:44.776083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:44.776721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:44.777671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:44.779659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:44.780485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:45.061051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:45.094599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:45.097185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:45.099372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c166e141-0443-4c98-927d-f3f26b81911e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:45.100287 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-44c81784-791e-4aa6-8782-358d571491b6 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1371 microversion: 2.47 time: 0.340793 Aug 09 17:21:45.102717 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1486/2861] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:44 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:45.112594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-37d42b25-167a-4d3d-8f54-362f038b5aff tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:45.113590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-37d42b25-167a-4d3d-8f54-362f038b5aff tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:45.122414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37d42b25-167a-4d3d-8f54-362f038b5aff tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:45.123230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37d42b25-167a-4d3d-8f54-362f038b5aff tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:45.123954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37d42b25-167a-4d3d-8f54-362f038b5aff tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:45.124994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37d42b25-167a-4d3d-8f54-362f038b5aff tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:45.125134 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c166e141-0443-4c98-927d-f3f26b81911e tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1498 microversion: 2.1 time: 0.992325 Aug 09 17:21:45.125730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37d42b25-167a-4d3d-8f54-362f038b5aff tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:45.126336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37d42b25-167a-4d3d-8f54-362f038b5aff tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:45.128781 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1376/2862] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:44 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1498 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:45.141572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6b679200-8504-40f9-9e64-155c27c44f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:45.146718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6b679200-8504-40f9-9e64-155c27c44f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:45.167720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b679200-8504-40f9-9e64-155c27c44f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:45.172837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b679200-8504-40f9-9e64-155c27c44f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:45.173918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b679200-8504-40f9-9e64-155c27c44f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:45.177559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b679200-8504-40f9-9e64-155c27c44f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:45.178716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b679200-8504-40f9-9e64-155c27c44f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:45.179979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b679200-8504-40f9-9e64-155c27c44f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:45.519590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-37d42b25-167a-4d3d-8f54-362f038b5aff tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:45.542348 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-37d42b25-167a-4d3d-8f54-362f038b5aff tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1325 microversion: 2.1 time: 0.438259 Aug 09 17:21:45.543216 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1487/2863] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:45 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1325 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:45.555097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-85ad964c-82df-435f-809d-0ed09ac795af tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:45.555766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-85ad964c-82df-435f-809d-0ed09ac795af tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:45.576028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ad964c-82df-435f-809d-0ed09ac795af tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:45.576530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ad964c-82df-435f-809d-0ed09ac795af tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:45.576977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ad964c-82df-435f-809d-0ed09ac795af tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:45.577878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ad964c-82df-435f-809d-0ed09ac795af tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:45.578942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ad964c-82df-435f-809d-0ed09ac795af tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:45.579383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85ad964c-82df-435f-809d-0ed09ac795af tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:45.908983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6b679200-8504-40f9-9e64-155c27c44f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:45.931197 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6b679200-8504-40f9-9e64-155c27c44f51 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991" status: 200 len: 1473 microversion: 2.1 time: 0.793098 Aug 09 17:21:45.957132 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1377/2864] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:45 2022] GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991 => generated 1473 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:45.986059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-42fa5978-aab7-421a-86ba-e68eeec89037 req-b2dcf444-1135-46a0-991d-5d643610807d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cc072b-21ba-4456-8e16-2390ad0b0c44", "name": "network-vif-plugged", "status": "completed", "tag": "d7835108-b545-4a3e-8fc8-112acbca6297"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:46.006640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-42fa5978-aab7-421a-86ba-e68eeec89037 req-b2dcf444-1135-46a0-991d-5d643610807d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:46.007752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-42fa5978-aab7-421a-86ba-e68eeec89037 req-b2dcf444-1135-46a0-991d-5d643610807d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:46.008429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-42fa5978-aab7-421a-86ba-e68eeec89037 req-b2dcf444-1135-46a0-991d-5d643610807d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:46.048348 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-42fa5978-aab7-421a-86ba-e68eeec89037 req-b2dcf444-1135-46a0-991d-5d643610807d service nova] Creating event network-vif-plugged:d7835108-b545-4a3e-8fc8-112acbca6297 for instance 74cc072b-21ba-4456-8e16-2390ad0b0c44 on n-h1-845781-6 Aug 09 17:21:46.061276 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-42fa5978-aab7-421a-86ba-e68eeec89037 req-b2dcf444-1135-46a0-991d-5d643610807d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090172 Aug 09 17:21:46.063686 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1378/2865] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:46.077351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b2e332b4-52da-4cf0-b5d6-c0aa8c17aec5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:46.078887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b2e332b4-52da-4cf0-b5d6-c0aa8c17aec5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:46.092659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e332b4-52da-4cf0-b5d6-c0aa8c17aec5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:46.093654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e332b4-52da-4cf0-b5d6-c0aa8c17aec5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:46.095735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e332b4-52da-4cf0-b5d6-c0aa8c17aec5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:46.097213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e332b4-52da-4cf0-b5d6-c0aa8c17aec5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:46.098062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e332b4-52da-4cf0-b5d6-c0aa8c17aec5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:46.100450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e332b4-52da-4cf0-b5d6-c0aa8c17aec5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:46.340210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-85ad964c-82df-435f-809d-0ed09ac795af tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:46.379656 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-85ad964c-82df-435f-809d-0ed09ac795af tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1321 microversion: 2.1 time: 0.834087 Aug 09 17:21:46.382743 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1488/2866] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:45 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1321 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:46.394095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:46.398187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:46.420248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b2e332b4-52da-4cf0-b5d6-c0aa8c17aec5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:46.420638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:46.422236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:46.422766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:46.426545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:46.427034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:46.429963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:46.436906 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b2e332b4-52da-4cf0-b5d6-c0aa8c17aec5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3" status: 200 len: 1469 microversion: 2.1 time: 0.370839 Aug 09 17:21:46.439248 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1379/2867] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:46 2022] GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 => generated 1469 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:46.452746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-27e1ac64-dd9d-4f59-87fb-755227f88baf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:46.455082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-27e1ac64-dd9d-4f59-87fb-755227f88baf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:46.467463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27e1ac64-dd9d-4f59-87fb-755227f88baf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:46.469424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27e1ac64-dd9d-4f59-87fb-755227f88baf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:46.470583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27e1ac64-dd9d-4f59-87fb-755227f88baf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:46.473736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27e1ac64-dd9d-4f59-87fb-755227f88baf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:46.475267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27e1ac64-dd9d-4f59-87fb-755227f88baf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:46.476550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27e1ac64-dd9d-4f59-87fb-755227f88baf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:46.751052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:46.759604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-27e1ac64-dd9d-4f59-87fb-755227f88baf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:46.776811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:46.781773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:46.785900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a43ec5b-74e5-4b7f-890f-a2c09ae2e9e8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1371 microversion: 2.47 time: 0.400933 Aug 09 17:21:46.793796 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-27e1ac64-dd9d-4f59-87fb-755227f88baf tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1498 microversion: 2.1 time: 0.351524 Aug 09 17:21:46.795222 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1380/2868] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:46 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1498 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:46.797536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1489/2869] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:46 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:46.815582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:46.825365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a5e40fc6-c7a9-4f0f-99f3-8c980bd43ecc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:46.832102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a5e40fc6-c7a9-4f0f-99f3-8c980bd43ecc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:46.840160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:46.846498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Searching by: {'reservation_id': 'r-ss223wow', 'deleted': False, 'project_id': '2b3f7d833b344b9cb579955d726a9e41'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:21:46.862969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5e40fc6-c7a9-4f0f-99f3-8c980bd43ecc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:46.868010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5e40fc6-c7a9-4f0f-99f3-8c980bd43ecc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:46.870978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5e40fc6-c7a9-4f0f-99f3-8c980bd43ecc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:46.872329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:46.873177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:46.873928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:46.874874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5e40fc6-c7a9-4f0f-99f3-8c980bd43ecc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:46.875217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:46.880755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:46.881512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:46.882400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5e40fc6-c7a9-4f0f-99f3-8c980bd43ecc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:46.883925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5e40fc6-c7a9-4f0f-99f3-8c980bd43ecc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:47.151683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:21:47.300836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:47.313537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:47.314383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:47.314871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:47.478756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a5e40fc6-c7a9-4f0f-99f3-8c980bd43ecc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:47.524467 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a5e40fc6-c7a9-4f0f-99f3-8c980bd43ecc tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1325 microversion: 2.1 time: 0.724507 Aug 09 17:21:47.536064 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1490/2870] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:46 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1325 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:47.561548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b66be9c3-3bc1-4222-86f3-4a394979ac85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:47.563536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b66be9c3-3bc1-4222-86f3-4a394979ac85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:47.595835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b66be9c3-3bc1-4222-86f3-4a394979ac85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:47.597839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b66be9c3-3bc1-4222-86f3-4a394979ac85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:47.598943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b66be9c3-3bc1-4222-86f3-4a394979ac85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:47.600336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b66be9c3-3bc1-4222-86f3-4a394979ac85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:47.601219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b66be9c3-3bc1-4222-86f3-4a394979ac85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:47.601981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b66be9c3-3bc1-4222-86f3-4a394979ac85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:47.661662 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-66f9fe6e-6ddc-4e6a-a9f7-333fe1d42df5 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?reservation_id=r-ss223wow" status: 200 len: 2930 microversion: 2.1 time: 0.864786 Aug 09 17:21:47.662282 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1381/2871] 10.222.0.93 () {58 vars in 1197 bytes} [Tue Aug 9 17:21:46 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ss223wow => generated 2930 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:47.668355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-906e242d-510d-41fc-bc58-3f69faab242b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:47.670690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-906e242d-510d-41fc-bc58-3f69faab242b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:47.689578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-906e242d-510d-41fc-bc58-3f69faab242b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:47.690327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-906e242d-510d-41fc-bc58-3f69faab242b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:47.690978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-906e242d-510d-41fc-bc58-3f69faab242b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:47.694338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-906e242d-510d-41fc-bc58-3f69faab242b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:47.696635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-906e242d-510d-41fc-bc58-3f69faab242b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:47.697383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-906e242d-510d-41fc-bc58-3f69faab242b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:48.708130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-906e242d-510d-41fc-bc58-3f69faab242b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:48.727276 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-906e242d-510d-41fc-bc58-3f69faab242b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1321 microversion: 2.1 time: 1.062646 Aug 09 17:21:48.729368 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1382/2872] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:47 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1321 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:48.740842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cfc1f989-0566-4334-853c-890e7dcb404b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:48.804382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.compute.server_groups [None req-cfc1f989-0566-4334-853c-890e7dcb404b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Querying cell 64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) for 2 instances {{(pid=119432) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 09 17:21:48.807184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfc1f989-0566-4334-853c-890e7dcb404b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:48.811269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfc1f989-0566-4334-853c-890e7dcb404b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:48.814587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfc1f989-0566-4334-853c-890e7dcb404b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:48.914104 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cfc1f989-0566-4334-853c-890e7dcb404b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/9078a8b8-4531-432b-bec7-506908d36c73" status: 200 len: 271 microversion: 2.1 time: 0.181282 Aug 09 17:21:48.915389 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1383/2873] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:21:48 2022] GET /compute/v2.1/os-server-groups/9078a8b8-4531-432b-bec7-506908d36c73 => generated 271 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:48.930692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:48.939809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:48.977496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:48.981720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:48.988643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:49.003861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:49.005654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:49.006801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:49.238769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:49.246889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:49.262409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:49.266083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:49.268871 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-68cd2e34-2534-4dd9-bab0-c4cc295d633b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1356 microversion: 2.47 time: 0.351488 Aug 09 17:21:49.280895 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1384/2874] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:48 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1356 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:49.311404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:49.313223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:49.326127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:49.327390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:49.328664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:49.330517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:49.331607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:49.332649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:49.401298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:49.401298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:49.402092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:49.402935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lazy-loading 'fault' on Instance uuid 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:21:49.417941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b66be9c3-3bc1-4222-86f3-4a394979ac85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:49.444773 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b66be9c3-3bc1-4222-86f3-4a394979ac85 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991" status: 200 len: 1473 microversion: 2.1 time: 1.900522 Aug 09 17:21:49.447165 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1491/2875] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:47 2022] GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991 => generated 1473 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:49.477271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1c44cabe-7c09-4890-b21f-1d8cb36bd022 req-43fa0e14-7f7d-4aec-a3b9-1ed75f3e4a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2b0c9a-c146-45bc-9afc-133d574faf9d", "name": "network-vif-plugged", "status": "completed", "tag": "7f367fd1-9fb9-4ca6-aa5a-34fe505ffa73"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:49.504976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1c44cabe-7c09-4890-b21f-1d8cb36bd022 req-43fa0e14-7f7d-4aec-a3b9-1ed75f3e4a24 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:49.508487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1c44cabe-7c09-4890-b21f-1d8cb36bd022 req-43fa0e14-7f7d-4aec-a3b9-1ed75f3e4a24 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:49.522161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1c44cabe-7c09-4890-b21f-1d8cb36bd022 req-43fa0e14-7f7d-4aec-a3b9-1ed75f3e4a24 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:49.548870 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1c44cabe-7c09-4890-b21f-1d8cb36bd022 req-43fa0e14-7f7d-4aec-a3b9-1ed75f3e4a24 service nova] Creating event network-vif-plugged:7f367fd1-9fb9-4ca6-aa5a-34fe505ffa73 for instance 0e2b0c9a-c146-45bc-9afc-133d574faf9d on n-h2-845781-6 Aug 09 17:21:49.563432 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1c44cabe-7c09-4890-b21f-1d8cb36bd022 req-43fa0e14-7f7d-4aec-a3b9-1ed75f3e4a24 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112912 Aug 09 17:21:49.565678 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1492/2876] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:49.607396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e91c6586-835d-4c9a-b1f3-38323e268e66 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:49.608787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e91c6586-835d-4c9a-b1f3-38323e268e66 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:49.614034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e1dc1f64fe429ea6a8c746b7c84ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2b4aad2192406d951cbdb3991c41fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:49.624524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e91c6586-835d-4c9a-b1f3-38323e268e66 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:49.626557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e91c6586-835d-4c9a-b1f3-38323e268e66 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:49.627461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e91c6586-835d-4c9a-b1f3-38323e268e66 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:49.629313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e91c6586-835d-4c9a-b1f3-38323e268e66 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:49.631474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e91c6586-835d-4c9a-b1f3-38323e268e66 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:49.633125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e91c6586-835d-4c9a-b1f3-38323e268e66 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:49.650473 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9370d6cf-1ce2-4ead-889d-0ceb4800f0ec tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 200 len: 1304 microversion: 2.1 time: 0.349111 Aug 09 17:21:49.654131 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1385/2877] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:49 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 1304 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:49.689229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-be97162b-c81d-4310-ba38-d7f70ecbd162 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:49.690560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-be97162b-c81d-4310-ba38-d7f70ecbd162 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:49.706870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be97162b-c81d-4310-ba38-d7f70ecbd162 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:49.707808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be97162b-c81d-4310-ba38-d7f70ecbd162 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:49.709200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be97162b-c81d-4310-ba38-d7f70ecbd162 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:49.711998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be97162b-c81d-4310-ba38-d7f70ecbd162 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:49.713152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be97162b-c81d-4310-ba38-d7f70ecbd162 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:49.714418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be97162b-c81d-4310-ba38-d7f70ecbd162 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:50.622915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e91c6586-835d-4c9a-b1f3-38323e268e66 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:50.651437 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e91c6586-835d-4c9a-b1f3-38323e268e66 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1325 microversion: 2.1 time: 1.076802 Aug 09 17:21:50.654473 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1493/2878] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:49 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1325 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:50.667061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ac80b986-cf40-405b-b017-e16f9d59e127 req-e1832b03-6d86-492e-b999-be5dcab9ac58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880", "name": "network-vif-deleted", "tag": "71fced49-3256-46cc-a608-d2c9fc8d8421"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:50.699301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ac80b986-cf40-405b-b017-e16f9d59e127 req-e1832b03-6d86-492e-b999-be5dcab9ac58 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:50.702318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ac80b986-cf40-405b-b017-e16f9d59e127 req-e1832b03-6d86-492e-b999-be5dcab9ac58 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:50.704048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ac80b986-cf40-405b-b017-e16f9d59e127 req-e1832b03-6d86-492e-b999-be5dcab9ac58 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:50.736240 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ac80b986-cf40-405b-b017-e16f9d59e127 req-e1832b03-6d86-492e-b999-be5dcab9ac58 service nova] Creating event network-vif-deleted:71fced49-3256-46cc-a608-d2c9fc8d8421 for instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 on n-h1-845781-6 Aug 09 17:21:50.756331 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ac80b986-cf40-405b-b017-e16f9d59e127 req-e1832b03-6d86-492e-b999-be5dcab9ac58 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098296 Aug 09 17:21:50.757429 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1494/2879] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:50.777770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:50.803409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:50.805108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Searching by: {'deleted': False, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:21:50.824379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:50.825639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:50.827186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:50.829195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:50.830467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:50.831674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:51.077451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:51.086751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:21:51.211601 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-be97162b-c81d-4310-ba38-d7f70ecbd162 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 200 len: 1619 microversion: 2.1 time: 1.544880 Aug 09 17:21:51.224142 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1386/2880] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:49 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 1619 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:51.233133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-00952e24-bbfa-48d5-a107-2e6eef3e56db tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:51.234844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-00952e24-bbfa-48d5-a107-2e6eef3e56db tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:51.266904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00952e24-bbfa-48d5-a107-2e6eef3e56db tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:51.268133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00952e24-bbfa-48d5-a107-2e6eef3e56db tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:51.269581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00952e24-bbfa-48d5-a107-2e6eef3e56db tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:51.271056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00952e24-bbfa-48d5-a107-2e6eef3e56db tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:51.272151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00952e24-bbfa-48d5-a107-2e6eef3e56db tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:51.273127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00952e24-bbfa-48d5-a107-2e6eef3e56db tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:51.304024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:51.342380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:51.343391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:51.344440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:51.389768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:51.392935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:51.603259 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f8de9f05-8a90-40b2-9660-3c9e7f54554f tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.843599 Aug 09 17:21:51.606106 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1495/2881] 10.222.0.93 () {60 vars in 1187 bytes} [Tue Aug 9 17:21:50 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:51.640091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2bd8d318-db22-4d74-b779-ad03b22304ff tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:51.644758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2bd8d318-db22-4d74-b779-ad03b22304ff tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:51.689482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd8d318-db22-4d74-b779-ad03b22304ff tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:51.690507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd8d318-db22-4d74-b779-ad03b22304ff tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:51.693261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd8d318-db22-4d74-b779-ad03b22304ff tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:51.696460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd8d318-db22-4d74-b779-ad03b22304ff tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:51.697383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd8d318-db22-4d74-b779-ad03b22304ff tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:51.698160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bd8d318-db22-4d74-b779-ad03b22304ff tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:52.153743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2bd8d318-db22-4d74-b779-ad03b22304ff tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:52.177160 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2bd8d318-db22-4d74-b779-ad03b22304ff tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991" status: 200 len: 1473 microversion: 2.1 time: 0.567727 Aug 09 17:21:52.193964 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1496/2882] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:51 2022] GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991 => generated 1473 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:52.193964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:52.193964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:52.211764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:52.211764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:52.211764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:52.212992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:52.212992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:52.213331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:52.255241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 HTTP/1.1 Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880'} Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:52.259489 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ec01b5db-3415-467c-96eb-bdedb12d50d6 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 404 len: 111 microversion: 2.1 time: 0.077867 Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1497/2883] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:52 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9e67e29a-780b-403f-b84c-99aa0342ea19 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:52.279910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9e67e29a-780b-403f-b84c-99aa0342ea19 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] [instance: 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:52.304459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e67e29a-780b-403f-b84c-99aa0342ea19 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:52.306182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e67e29a-780b-403f-b84c-99aa0342ea19 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:52.308021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e67e29a-780b-403f-b84c-99aa0342ea19 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:52.309597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e67e29a-780b-403f-b84c-99aa0342ea19 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:52.311943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e67e29a-780b-403f-b84c-99aa0342ea19 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:52.312897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e67e29a-780b-403f-b84c-99aa0342ea19 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:52.642936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-00952e24-bbfa-48d5-a107-2e6eef3e56db tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:52.660962 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-00952e24-bbfa-48d5-a107-2e6eef3e56db tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1321 microversion: 2.1 time: 1.433424 Aug 09 17:21:52.668039 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1387/2884] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:51 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1321 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:52.686334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cd1ad6a3-f368-4488-977f-751c080a2c64 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:52.691854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cd1ad6a3-f368-4488-977f-751c080a2c64 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:52.704046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:52.723598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd1ad6a3-f368-4488-977f-751c080a2c64 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:52.725114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd1ad6a3-f368-4488-977f-751c080a2c64 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:52.728303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd1ad6a3-f368-4488-977f-751c080a2c64 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:52.731409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd1ad6a3-f368-4488-977f-751c080a2c64 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:52.733407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd1ad6a3-f368-4488-977f-751c080a2c64 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:52.735386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd1ad6a3-f368-4488-977f-751c080a2c64 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:52.870731 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9e67e29a-780b-403f-b84c-99aa0342ea19 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3" status: 200 len: 1620 microversion: 2.1 time: 0.603328 Aug 09 17:21:52.877790 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1498/2885] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:52 2022] GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 => generated 1620 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:52.903320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cd1ad6a3-f368-4488-977f-751c080a2c64 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:21:52.932663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-538d5ac4-c43c-418a-90b2-e05e2422a372 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:52.939982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-538d5ac4-c43c-418a-90b2-e05e2422a372 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:52.985224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-538d5ac4-c43c-418a-90b2-e05e2422a372 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:52.986384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-538d5ac4-c43c-418a-90b2-e05e2422a372 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:52.987983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-538d5ac4-c43c-418a-90b2-e05e2422a372 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:52.994351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-538d5ac4-c43c-418a-90b2-e05e2422a372 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:52.998039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-538d5ac4-c43c-418a-90b2-e05e2422a372 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:52.998902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-538d5ac4-c43c-418a-90b2-e05e2422a372 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.198854 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cd1ad6a3-f368-4488-977f-751c080a2c64 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "DELETE /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 204 len: 0 microversion: 2.47 time: 0.528534 Aug 09 17:21:53.208958 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1388/2886] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:21:52 2022] DELETE /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:21:53.236434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:53.243836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:53.262805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.264080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.264812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.268420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.269208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.270135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.299769 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 HTTP/1.1 Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880'} Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:53.302483 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:53.310242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:53.315085 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-34088ff3-f5ff-4435-b0f5-496e2714a879 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 404 len: 111 microversion: 2.1 time: 0.101623 Aug 09 17:21:53.325126 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1389/2887] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:21:53 2022] DELETE /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:53.353304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-dc445b1f-c16f-4d1f-bd48-b289a8198794 req-eb895f48-d639-45a1-9471-70071ba9db1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce962b08-43de-4bff-a72a-1adcf330c991", "name": "network-vif-deleted", "tag": "b046df32-8645-4449-b41d-a48fe4b7136e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:53.429977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-dc445b1f-c16f-4d1f-bd48-b289a8198794 req-eb895f48-d639-45a1-9471-70071ba9db1e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.430705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-dc445b1f-c16f-4d1f-bd48-b289a8198794 req-eb895f48-d639-45a1-9471-70071ba9db1e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.431396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-dc445b1f-c16f-4d1f-bd48-b289a8198794 req-eb895f48-d639-45a1-9471-70071ba9db1e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.483753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-538d5ac4-c43c-418a-90b2-e05e2422a372 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:53.486935 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-dc445b1f-c16f-4d1f-bd48-b289a8198794 req-eb895f48-d639-45a1-9471-70071ba9db1e service nova] Creating event network-vif-deleted:b046df32-8645-4449-b41d-a48fe4b7136e for instance ce962b08-43de-4bff-a72a-1adcf330c991 on n-h2-845781-6 Aug 09 17:21:53.494970 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-538d5ac4-c43c-418a-90b2-e05e2422a372 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1325 microversion: 2.1 time: 0.612376 Aug 09 17:21:53.496002 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1499/2888] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:52 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1325 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:53.504184 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-dc445b1f-c16f-4d1f-bd48-b289a8198794 req-eb895f48-d639-45a1-9471-70071ba9db1e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174448 Aug 09 17:21:53.505244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:53.506071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:53.513004 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1390/2889] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:53.515188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.516639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.517338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.518313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.518962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.519617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.526804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:53.537499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:53.570393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.572764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.575883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.580841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.584839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.589544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.697626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.698733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.699945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.701791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lazy-loading 'fault' on Instance uuid ce962b08-43de-4bff-a72a-1adcf330c991 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:21:53.785044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:53.813992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:53.819680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:53.822223 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-45e8dbec-4e08-4e42-9d48-4f492e1c6fc0 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1362 microversion: 2.47 time: 0.324324 Aug 09 17:21:53.824035 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1500/2890] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:53 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:53.835970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-98227342", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "904e2d62-61c5-4c4e-9acd-6948e6a21477"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:53.893152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab47f4c2fa541a39b25856232720588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed2afd5a7c94838bb9f74b8b71ad263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:53.905279 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e70fec4-c65c-4dce-b1ad-a5c372cddf7f tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991" status: 200 len: 1307 microversion: 2.1 time: 0.389178 Aug 09 17:21:53.909355 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1391/2891] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:53 2022] GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991 => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:53.916403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:53.917351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:53.929121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.930263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.931015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.933914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.935329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.936524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.959265 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 HTTP/1.1 Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880'} Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:53.961022 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:53.970289 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:53.970289 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:53.970289 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:53.970289 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:53.970289 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:53.970289 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. Aug 09 17:21:53.970289 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:53.970289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:53.970289 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-65e45f01-6103-4057-9d85-59f5094d41d8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880" status: 404 len: 111 microversion: 2.1 time: 0.051910 Aug 09 17:21:53.970289 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1392/2892] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:53 2022] GET /compute/v2.1/servers/4c12f47e-2f3b-4ce8-9fdb-b9aeeb320880 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:53.972918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5fb45db4-b48c-440e-b2ca-0e24a774788b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:53.972918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5fb45db4-b48c-440e-b2ca-0e24a774788b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:53.978613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5fb45db4-b48c-440e-b2ca-0e24a774788b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.980101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5fb45db4-b48c-440e-b2ca-0e24a774788b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.980588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5fb45db4-b48c-440e-b2ca-0e24a774788b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:53.981759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5fb45db4-b48c-440e-b2ca-0e24a774788b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:53.982457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5fb45db4-b48c-440e-b2ca-0e24a774788b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:53.983000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5fb45db4-b48c-440e-b2ca-0e24a774788b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:54.005092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:21:54.521555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5fb45db4-b48c-440e-b2ca-0e24a774788b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:54.548166 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5fb45db4-b48c-440e-b2ca-0e24a774788b tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1512 microversion: 2.1 time: 0.582203 Aug 09 17:21:54.560728 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1393/2893] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:53 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1512 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:54.590619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:54.591473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:54.610549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:54.611746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:54.612553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:54.613705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:54.614468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:54.615318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:54.662942 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 HTTP/1.1 Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '5a5402fb-8e2e-4145-a53b-ec8b72c12e30'} Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:54.667027 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:54.672494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:54.673763 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-78cdf222-9c93-4a5b-8c9c-bd2d5055b1e7 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 404 len: 111 microversion: 2.1 time: 0.109553 Aug 09 17:21:54.688035 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1394/2894] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:21:54 2022] DELETE /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:54.704187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e7a590e3-df93-4209-a88b-ff01b305957b req-29b24fe4-24c1-45e2-9089-074770810394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28428f55-ba65-4ce3-b23a-5c7f94cab2d2", "name": "network-vif-plugged", "status": "completed", "tag": "6e6c78b4-aff3-460a-a11f-dfd02f73f73d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:21:54.730186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e7a590e3-df93-4209-a88b-ff01b305957b req-29b24fe4-24c1-45e2-9089-074770810394 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:54.732871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e7a590e3-df93-4209-a88b-ff01b305957b req-29b24fe4-24c1-45e2-9089-074770810394 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:54.734190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e7a590e3-df93-4209-a88b-ff01b305957b req-29b24fe4-24c1-45e2-9089-074770810394 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:54.782999 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e7a590e3-df93-4209-a88b-ff01b305957b req-29b24fe4-24c1-45e2-9089-074770810394 service nova] Creating event network-vif-plugged:6e6c78b4-aff3-460a-a11f-dfd02f73f73d for instance 28428f55-ba65-4ce3-b23a-5c7f94cab2d2 on n-h2-845781-6 Aug 09 17:21:54.798620 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e7a590e3-df93-4209-a88b-ff01b305957b req-29b24fe4-24c1-45e2-9089-074770810394 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107345 Aug 09 17:21:54.799997 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1395/2895] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:21:54.806347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:21:54.807367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:21:54.808331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:21:54.809105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:21:54.809856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:21:54.820067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5c220263-3067-498f-b289-f6c6b94ad6d2 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:54.821269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5c220263-3067-498f-b289-f6c6b94ad6d2 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:54.838285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c220263-3067-498f-b289-f6c6b94ad6d2 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:54.839835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c220263-3067-498f-b289-f6c6b94ad6d2 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:54.841791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c220263-3067-498f-b289-f6c6b94ad6d2 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:54.843434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:54.844535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c220263-3067-498f-b289-f6c6b94ad6d2 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:54.844839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:54.845652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:54.847246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c220263-3067-498f-b289-f6c6b94ad6d2 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:54.847717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:54.847899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c220263-3067-498f-b289-f6c6b94ad6d2 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:54.849037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:54.850162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:54.909873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:21:54.919274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:21:54.962097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:21:54.966865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:21:55.105627 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0fc327d6-7acb-485a-94d5-8ff0b66b6506 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278936 Aug 09 17:21:55.118757 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1501/2896] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:21:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:21:55.130917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7f8ac12-10e5-4af6-a078-d82584bc10dc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:55.132271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b7f8ac12-10e5-4af6-a078-d82584bc10dc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:55.145631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac12-10e5-4af6-a078-d82584bc10dc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:55.146658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac12-10e5-4af6-a078-d82584bc10dc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:55.148402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac12-10e5-4af6-a078-d82584bc10dc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:55.151116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac12-10e5-4af6-a078-d82584bc10dc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:55.151930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac12-10e5-4af6-a078-d82584bc10dc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:55.152860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7f8ac12-10e5-4af6-a078-d82584bc10dc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:55.253938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5c220263-3067-498f-b289-f6c6b94ad6d2 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:55.275803 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5c220263-3067-498f-b289-f6c6b94ad6d2 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1325 microversion: 2.1 time: 0.464521 Aug 09 17:21:55.277926 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1396/2897] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:54 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1325 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:55.291509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:55.295471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 5a5402fb-8e2e-4145-a53b-ec8b72c12e30] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:55.309525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:55.310430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:55.311267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:55.313319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:55.314347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:55.317645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:55.393814 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 HTTP/1.1 Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '5a5402fb-8e2e-4145-a53b-ec8b72c12e30'} Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:55.415199 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:55.425815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:55.425815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:55.425815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:55.425815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:55.425815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:55.425815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. Aug 09 17:21:55.425815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:55.429961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 5a5402fb-8e2e-4145-a53b-ec8b72c12e30 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:55.433776 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2e7cb9e5-664d-4091-bd4b-db3883b8b295 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30" status: 404 len: 111 microversion: 2.1 time: 0.151459 Aug 09 17:21:55.440552 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1397/2898] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:55 2022] GET /compute/v2.1/servers/5a5402fb-8e2e-4145-a53b-ec8b72c12e30 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:55.476712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:55.490371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:55.507165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:55.515956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:55.516809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:55.542330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:55.543549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:55.554568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:55.681196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b7f8ac12-10e5-4af6-a078-d82584bc10dc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:55.714569 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7f8ac12-10e5-4af6-a078-d82584bc10dc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1511 microversion: 2.1 time: 0.593210 Aug 09 17:21:55.737528 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1502/2899] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:55 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1511 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:55.747509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:55.773408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] [instance: ce962b08-43de-4bff-a72a-1adcf330c991] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:55.856545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:55.857999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:55.861069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:55.862354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:55.863202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:55.870871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:55.925204 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] HTTP exception thrown: Instance ce962b08-43de-4bff-a72a-1adcf330c991 could not be found. Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Request method failure captured: Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991 HTTP/1.1 Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pbKFJuUCAiJuaGIyQb6mDUjp_twin8F7JcgS0gPhEdOWNzwjCcXQriBDAHoaEY4H6RPf52smUaqCrk6ZXSPBM9gkHn-vnEuVBjW7JPwCXyn9efSaMuI4DmucZfydE0PE6nKA5Ic3tDRrMmbh2tqs2LPWhGkNJwlEFPlAxBbQ8TBthQ Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1ed2afd5a7c94838bb9f74b8b71ad263 Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ListImageFiltersTestJSON-1840563117 Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ed2afd5a7c94838bb9f74b8b71ad263"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ed2afd5a7c94838bb9f74b8b71ad263"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ed2afd5a7c94838bb9f74b8b71ad263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ed2afd5a7c94838bb9f74b8b71ad263"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ListImageFiltersTestJSON-1840563117 Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1ed2afd5a7c94838bb9f74b8b71ad263 Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1840563117 Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ListImageFiltersTestJSON-1840563117-project Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4ab47f4c2fa541a39b25856232720588 Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ListImageFiltersTestJSON-1840563117-project Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance ce962b08-43de-4bff-a72a-1adcf330c991 could not be found. Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'ce962b08-43de-4bff-a72a-1adcf330c991'} Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce962b08-43de-4bff-a72a-1adcf330c991 could not be found. Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce962b08-43de-4bff-a72a-1adcf330c991 could not be found. Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:55.933754 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:55.946380 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:55.946380 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:55.946380 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:55.946380 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:55.946380 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:55.946380 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce962b08-43de-4bff-a72a-1adcf330c991 could not be found. Aug 09 17:21:55.946380 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:55.947734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:55.948664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Returning 404 to user: Instance ce962b08-43de-4bff-a72a-1adcf330c991 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:55.952924 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0866e68a-f2da-4f57-963d-088bcbe3ce22 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991" status: 404 len: 111 microversion: 2.1 time: 0.212334 Aug 09 17:21:55.955222 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1503/2900] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:55 2022] GET /compute/v2.1/servers/ce962b08-43de-4bff-a72a-1adcf330c991 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:55.975312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51918db2-9842-4fbe-8497-b54736237caf tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:55.977505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-51918db2-9842-4fbe-8497-b54736237caf tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:56.018313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:56.029337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:56.032601 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3a2f4503-d98c-4961-8fe8-8f1a302dd625 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 200 len: 1362 microversion: 2.47 time: 0.589622 Aug 09 17:21:56.034782 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1398/2901] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:55 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 1362 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:21:56.049233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:56.050685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:56.065721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:56.067217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:56.068810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:56.071263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:56.072418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:56.073341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:56.154384 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 HTTP/1.1 Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'e32cf57c-7503-421c-a197-4a9f8cd925e0'} Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:56.163322 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:56.173660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:56.177950 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7f19d0c1-9da5-4a4b-b374-8080479e0a9f tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 404 len: 111 microversion: 2.1 time: 0.132172 Aug 09 17:21:56.179659 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1399/2902] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:21:56 2022] DELETE /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:56.213096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a10c39c-e1cb-4948-8add-88472a4c618d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:56.214241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9a10c39c-e1cb-4948-8add-88472a4c618d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 74cc072b-21ba-4456-8e16-2390ad0b0c44] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:56.240402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a10c39c-e1cb-4948-8add-88472a4c618d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:56.241399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a10c39c-e1cb-4948-8add-88472a4c618d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:56.242478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a10c39c-e1cb-4948-8add-88472a4c618d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:56.244064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a10c39c-e1cb-4948-8add-88472a4c618d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:56.245388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a10c39c-e1cb-4948-8add-88472a4c618d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:56.246431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a10c39c-e1cb-4948-8add-88472a4c618d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:56.330726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-51918db2-9842-4fbe-8497-b54736237caf tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:56.368321 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51918db2-9842-4fbe-8497-b54736237caf tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1215 microversion: 2.1 time: 0.406422 Aug 09 17:21:56.370110 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1504/2903] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:55 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1215 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:56.395146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2c47141f-1daa-437d-a46d-699f9145c5a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcbf043a0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:57.039971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:57.211584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a10c39c-e1cb-4948-8add-88472a4c618d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:57.241594 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a10c39c-e1cb-4948-8add-88472a4c618d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44" status: 200 len: 1512 microversion: 2.1 time: 1.060763 Aug 09 17:21:57.242666 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1400/2904] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:56 2022] GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44 => generated 1512 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:57.273393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:57.280360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: e32cf57c-7503-421c-a197-4a9f8cd925e0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:57.305716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:57.327914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:57.330823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:57.334741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:57.336651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:57.340011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:57.342792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:57.430278 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 HTTP/1.1 Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'e32cf57c-7503-421c-a197-4a9f8cd925e0'} Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:57.456249 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:57.465420 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:57.465420 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:57.465420 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:57.465420 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:57.465420 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:57.465420 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. Aug 09 17:21:57.465420 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:57.473454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance e32cf57c-7503-421c-a197-4a9f8cd925e0 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:57.479315 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-587c04f1-2b63-4f88-acc9-3929603fbb4d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0" status: 404 len: 111 microversion: 2.1 time: 0.224003 Aug 09 17:21:57.488065 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1401/2905] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:57 2022] GET /compute/v2.1/servers/e32cf57c-7503-421c-a197-4a9f8cd925e0 => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:57.528515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-01286386-18c1-4c3b-a43a-b232c04b3159 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:57.539275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-01286386-18c1-4c3b-a43a-b232c04b3159 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:57.571495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01286386-18c1-4c3b-a43a-b232c04b3159 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:57.573609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01286386-18c1-4c3b-a43a-b232c04b3159 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:57.574656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01286386-18c1-4c3b-a43a-b232c04b3159 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:57.576275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01286386-18c1-4c3b-a43a-b232c04b3159 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:57.578711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01286386-18c1-4c3b-a43a-b232c04b3159 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:57.579970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01286386-18c1-4c3b-a43a-b232c04b3159 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:57.840909 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2c47141f-1daa-437d-a46d-699f9145c5a7 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "DELETE /compute/v2.1/images/989d33c2-d2cf-4cde-b6c5-20156edaf9e2" status: 204 len: 0 microversion: 2.1 time: 1.468295 Aug 09 17:21:57.842614 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1505/2906] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:56 2022] DELETE /compute/v2.1/images/989d33c2-d2cf-4cde-b6c5-20156edaf9e2 => generated 0 bytes in 1471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:57.866423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:57.866423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: 617dbeab-1a29-4f7b-89d2-dd8964792487] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:57.886811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:57.889737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:57.892051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:57.894586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:57.896683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:57.897918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:57.940315 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] HTTP exception thrown: Instance 617dbeab-1a29-4f7b-89d2-dd8964792487 could not be found. Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Request method failure captured: Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 HTTP/1.1 Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pdz7C8amFXJw0LzCs71_c9w67guPk-d7Vci5ARJzL-25P2MVb0tE4bPmKdfVWpxtCxDGu_1ZfuR6YYYuXfNx9fTAEgiCjDLPe4JU8OhXRGHD3xstvDi5ZmZeTFhHqUQU2-as0nUBhURkIizwrX64aU80lj9GOP3LdhC_Xfl7BNT2GI Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.47 Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 8ac3646b00fa4b85b8c933faa44ec4f9 Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerShowV247Test-164206044 Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8ac3646b00fa4b85b8c933faa44ec4f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8ac3646b00fa4b85b8c933faa44ec4f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8ac3646b00fa4b85b8c933faa44ec4f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8ac3646b00fa4b85b8c933faa44ec4f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerShowV247Test-164206044 Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 8ac3646b00fa4b85b8c933faa44ec4f9 Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerShowV247Test-164206044 Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerShowV247Test-164206044-project Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ef798302aba8493597e7297eaa238bbf Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerShowV247Test-164206044-project Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 617dbeab-1a29-4f7b-89d2-dd8964792487 could not be found. Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '617dbeab-1a29-4f7b-89d2-dd8964792487'} Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 617dbeab-1a29-4f7b-89d2-dd8964792487 could not be found. Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 617dbeab-1a29-4f7b-89d2-dd8964792487 could not be found. Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:57.944111 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:57.960213 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:57.960213 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:57.960213 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:57.960213 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:57.960213 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:57.960213 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 617dbeab-1a29-4f7b-89d2-dd8964792487 could not be found. Aug 09 17:21:57.960213 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:57.960213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Returning 404 to user: Instance 617dbeab-1a29-4f7b-89d2-dd8964792487 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:57.962489 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-170b19f9-9907-4baa-a432-a4e7b580534b tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487" status: 404 len: 111 microversion: 2.47 time: 0.114334 Aug 09 17:21:57.963946 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1506/2907] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:21:57 2022] GET /compute/v2.1/servers/617dbeab-1a29-4f7b-89d2-dd8964792487 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:21:57.973839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:57.984665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:57.986877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:21:58.009635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:58.011177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:58.012425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:58.014208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:58.016207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:58.017340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:58.255097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-01286386-18c1-4c3b-a43a-b232c04b3159 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:58.281006 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-01286386-18c1-4c3b-a43a-b232c04b3159 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1521 microversion: 2.1 time: 0.789023 Aug 09 17:21:58.282357 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1402/2908] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:57 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1521 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:58.290481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bb632cdd-bae8-499c-8dfc-7bf68f862931 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:58.295987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bb632cdd-bae8-499c-8dfc-7bf68f862931 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:58.303992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:21:58.314364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb632cdd-bae8-499c-8dfc-7bf68f862931 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:58.316111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb632cdd-bae8-499c-8dfc-7bf68f862931 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:58.321924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb632cdd-bae8-499c-8dfc-7bf68f862931 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:58.326119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb632cdd-bae8-499c-8dfc-7bf68f862931 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:58.327023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb632cdd-bae8-499c-8dfc-7bf68f862931 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:58.328631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb632cdd-bae8-499c-8dfc-7bf68f862931 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:58.608178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bb632cdd-bae8-499c-8dfc-7bf68f862931 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:58.649297 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bb632cdd-bae8-499c-8dfc-7bf68f862931 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1267 microversion: 2.1 time: 0.365051 Aug 09 17:21:58.656642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:58.657486 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1403/2909] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:58 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1267 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:58.671869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:58.672818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:58.676384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:58.676970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:58.677431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:58.703763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:58.708579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:58.709542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:58.711040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:58.714768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:58.715773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:58.742171 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 HTTP/1.1 Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9a83e16f-e6c2-4c94-872d-0b6a08acfa76'} Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:58.743583 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ae228779-9a49-47e5-98aa-e2aacb758985 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 404 len: 111 microversion: 2.1 time: 0.086148 Aug 09 17:21:58.755979 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1404/2910] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:21:58 2022] DELETE /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:58.760291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dfa08f37-3f71-4e6c-8afb-d5ed25fc6b79 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbdc93cb80>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:59.176462 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1ac492d6-d091-4e8c-aed5-1e5b20f54da4 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.210457 Aug 09 17:21:59.195467 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1507/2911] 10.222.0.93 () {58 vars in 1167 bytes} [Tue Aug 9 17:21:57 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:21:59.221577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2c0811b-2c60-42ef-b88a-95272ba54e74 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:59.222697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2c0811b-2c60-42ef-b88a-95272ba54e74 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: da01d112-b232-474e-bb72-683e9772a01e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:59.240389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2c0811b-2c60-42ef-b88a-95272ba54e74 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:59.240896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2c0811b-2c60-42ef-b88a-95272ba54e74 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:59.241610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2c0811b-2c60-42ef-b88a-95272ba54e74 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:59.242512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2c0811b-2c60-42ef-b88a-95272ba54e74 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:59.242992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2c0811b-2c60-42ef-b88a-95272ba54e74 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:59.243431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2c0811b-2c60-42ef-b88a-95272ba54e74 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:59.314611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2c0811b-2c60-42ef-b88a-95272ba54e74 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: da01d112-b232-474e-bb72-683e9772a01e] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:21:59.421920 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dfa08f37-3f71-4e6c-8afb-d5ed25fc6b79 tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "DELETE /compute/v2.1/images/947579f1-5b7c-41e3-8756-ecc0697a44f7" status: 204 len: 0 microversion: 2.1 time: 0.669477 Aug 09 17:21:59.423436 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1405/2912] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:58 2022] DELETE /compute/v2.1/images/947579f1-5b7c-41e3-8756-ecc0697a44f7 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:59.428757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa559732-40ff-40ca-81ab-d18b524b32a6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:59.429265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fa559732-40ff-40ca-81ab-d18b524b32a6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:59.441177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa559732-40ff-40ca-81ab-d18b524b32a6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:59.442187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa559732-40ff-40ca-81ab-d18b524b32a6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:59.443206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa559732-40ff-40ca-81ab-d18b524b32a6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:59.444247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa559732-40ff-40ca-81ab-d18b524b32a6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:59.444944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa559732-40ff-40ca-81ab-d18b524b32a6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:59.445371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa559732-40ff-40ca-81ab-d18b524b32a6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:59.451942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:21:59.490875 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d2c0811b-2c60-42ef-b88a-95272ba54e74 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "DELETE /compute/v2.1/servers/da01d112-b232-474e-bb72-683e9772a01e" status: 204 len: 0 microversion: 2.47 time: 0.293614 Aug 09 17:21:59.493639 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1508/2913] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:21:59 2022] DELETE /compute/v2.1/servers/da01d112-b232-474e-bb72-683e9772a01e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:21:59.498397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fa559732-40ff-40ca-81ab-d18b524b32a6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:21:59.504363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:59.505161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 9a83e16f-e6c2-4c94-872d-0b6a08acfa76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:21:59.528255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:59.532220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:59.533215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:59.534216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:59.534761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:59.535352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:59.553611 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 HTTP/1.1 Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9a83e16f-e6c2-4c94-872d-0b6a08acfa76'} Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:21:59.554812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:59.567678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:21:59.567678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:21:59.567678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:21:59.567678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:21:59.567678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:21:59.567678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. Aug 09 17:21:59.567678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:21:59.567678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 9a83e16f-e6c2-4c94-872d-0b6a08acfa76 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:21:59.567678 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f784a5bf-3d84-48af-8c2f-ab42fd011cea tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76" status: 404 len: 111 microversion: 2.1 time: 0.063566 Aug 09 17:21:59.567678 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1509/2914] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:59 2022] GET /compute/v2.1/servers/9a83e16f-e6c2-4c94-872d-0b6a08acfa76 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:21:59.573036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:59.589251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:59.591689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-448118167', 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:21:59.600653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:59.602752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:59.603476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:59.604556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:59.605245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:59.606296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:21:59.747858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:21:59.757204 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fa559732-40ff-40ca-81ab-d18b524b32a6 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "DELETE /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 204 len: 0 microversion: 2.1 time: 0.330981 Aug 09 17:21:59.759490 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1406/2915] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:21:59 2022] DELETE /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:21:59.775609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-77ee703d-e0a1-40e5-88fa-aa6a22d2f6ab tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] Calling method '.version_select at 0x7fbbcb45cca0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:21:59.884362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:21:59.897979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:21:59.898511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:21:59.901639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:00.246297 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-77ee703d-e0a1-40e5-88fa-aa6a22d2f6ab tempest-ListImageFiltersTestJSON-1840563117 tempest-ListImageFiltersTestJSON-1840563117-project] 10.222.0.93 "DELETE /compute/v2.1/images/74dba511-e2c4-41ed-8480-4b9707eba5e8" status: 204 len: 0 microversion: 2.1 time: 0.483918 Aug 09 17:22:00.247341 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1407/2916] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:21:59 2022] DELETE /compute/v2.1/images/74dba511-e2c4-41ed-8480-4b9707eba5e8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:22:00.286612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:00.289576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: da01d112-b232-474e-bb72-683e9772a01e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:00.336083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:00.336708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:00.337178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:00.337940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:00.338765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:00.339390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:00.497259 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-15a3a676-138f-4e38-af2e-9d6003117c33 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-448118167" status: 200 len: 1514 microversion: 2.1 time: 0.936163 Aug 09 17:22:00.502841 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1510/2917] 10.222.0.93 () {58 vars in 1261 bytes} [Tue Aug 9 17:21:59 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-448118167 => generated 1514 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:00.513897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b36d081-762a-49ef-942d-9609c75de0f8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:00.516197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b36d081-762a-49ef-942d-9609c75de0f8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 3b864073-4869-4153-9d23-ffebe17c00e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:00.530645 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-8b36d081-762a-49ef-942d-9609c75de0f8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b36d081-762a-49ef-942d-9609c75de0f8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0 HTTP/1.1 Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '3b864073-4869-4153-9d23-ffebe17c00e0'} Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:00.536621 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:00.552138 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:00.552138 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:00.552138 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:00.552138 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:00.552138 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:00.552138 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:00.552138 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:22:00.552138 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:00.559829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b36d081-762a-49ef-942d-9609c75de0f8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:00.562782 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b36d081-762a-49ef-942d-9609c75de0f8 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0" status: 404 len: 111 microversion: 2.1 time: 0.056786 Aug 09 17:22:00.564789 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1511/2918] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:22:00 2022] DELETE /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:00.577180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29052e8d-9a12-4ae0-84c4-fe8af7cf6b1e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:00.579183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-29052e8d-9a12-4ae0-84c4-fe8af7cf6b1e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:00.592797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29052e8d-9a12-4ae0-84c4-fe8af7cf6b1e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:00.594206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29052e8d-9a12-4ae0-84c4-fe8af7cf6b1e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:00.595312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29052e8d-9a12-4ae0-84c4-fe8af7cf6b1e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:00.597257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29052e8d-9a12-4ae0-84c4-fe8af7cf6b1e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:00.599263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29052e8d-9a12-4ae0-84c4-fe8af7cf6b1e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:00.600644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29052e8d-9a12-4ae0-84c4-fe8af7cf6b1e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:00.615560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:00.663124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:00.691389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:00.707263 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8717303a-6d73-46e5-b59d-a91fd57f22c3 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/da01d112-b232-474e-bb72-683e9772a01e" status: 200 len: 1363 microversion: 2.47 time: 0.451710 Aug 09 17:22:00.716260 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1408/2919] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:22:00 2022] GET /compute/v2.1/servers/da01d112-b232-474e-bb72-683e9772a01e => generated 1363 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:22:00.745852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8bb50552-12b0-47e7-8a69-0fd33833cf38 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:00.751333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8bb50552-12b0-47e7-8a69-0fd33833cf38 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:00.780439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bb50552-12b0-47e7-8a69-0fd33833cf38 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:00.782236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bb50552-12b0-47e7-8a69-0fd33833cf38 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:00.784665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bb50552-12b0-47e7-8a69-0fd33833cf38 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:00.786613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bb50552-12b0-47e7-8a69-0fd33833cf38 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:00.790522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bb50552-12b0-47e7-8a69-0fd33833cf38 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:00.792331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8bb50552-12b0-47e7-8a69-0fd33833cf38 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:01.465713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8bb50552-12b0-47e7-8a69-0fd33833cf38 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:01.481889 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8bb50552-12b0-47e7-8a69-0fd33833cf38 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1527 microversion: 2.1 time: 0.761314 Aug 09 17:22:01.484759 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1409/2920] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:00 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1527 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:01.493871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:01.504978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:01.507185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:01.518668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:01.520039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:01.521092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:01.522797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:01.524139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:01.526103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:01.761624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:01.798183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-29052e8d-9a12-4ae0-84c4-fe8af7cf6b1e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:01.822939 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-29052e8d-9a12-4ae0-84c4-fe8af7cf6b1e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1315 microversion: 2.1 time: 1.255225 Aug 09 17:22:01.829243 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1512/2921] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:00 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1315 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:01.852293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d865b57-1d3d-4c74-83f1-1f6d517a3480 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:01.853976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0d865b57-1d3d-4c74-83f1-1f6d517a3480 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 3b864073-4869-4153-9d23-ffebe17c00e0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:01.865899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:01.885461 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0d865b57-1d3d-4c74-83f1-1f6d517a3480 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d865b57-1d3d-4c74-83f1-1f6d517a3480 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0 HTTP/1.1 Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '3b864073-4869-4153-9d23-ffebe17c00e0'} Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:01.893717 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:01.902319 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:01.902319 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:01.902319 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:01.902319 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. Aug 09 17:22:01.902319 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:01.904928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d865b57-1d3d-4c74-83f1-1f6d517a3480 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 3b864073-4869-4153-9d23-ffebe17c00e0 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:01.907934 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0d865b57-1d3d-4c74-83f1-1f6d517a3480 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0" status: 404 len: 111 microversion: 2.1 time: 0.070163 Aug 09 17:22:01.909331 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1513/2922] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:01 2022] GET /compute/v2.1/servers/3b864073-4869-4153-9d23-ffebe17c00e0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:01.920296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:01.921742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: da01d112-b232-474e-bb72-683e9772a01e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:01.937767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:01.939067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:01.940193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:01.941479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:01.942574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:01.943597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:01.965074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:02.003219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:02.008399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:02.009212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:02.191303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:02.235382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:02.244582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ef798302aba8493597e7297eaa238bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac3646b00fa4b85b8c933faa44ec4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:02.250371 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1cb77f58-2016-4cbe-a259-26d16bea238e tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/da01d112-b232-474e-bb72-683e9772a01e" status: 200 len: 1363 microversion: 2.47 time: 0.336395 Aug 09 17:22:02.265759 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1514/2923] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:22:01 2022] GET /compute/v2.1/servers/da01d112-b232-474e-bb72-683e9772a01e => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:22:02.530378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1c5a768-b890-46d1-a9d8-db73bb292bb4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:02.534877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1c5a768-b890-46d1-a9d8-db73bb292bb4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:02.567047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c5a768-b890-46d1-a9d8-db73bb292bb4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:02.570384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c5a768-b890-46d1-a9d8-db73bb292bb4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:02.571185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c5a768-b890-46d1-a9d8-db73bb292bb4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:02.578118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c5a768-b890-46d1-a9d8-db73bb292bb4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:02.582013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c5a768-b890-46d1-a9d8-db73bb292bb4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:02.582988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c5a768-b890-46d1-a9d8-db73bb292bb4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:02.643466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:03.010173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a1c5a768-b890-46d1-a9d8-db73bb292bb4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:03.050263 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1c5a768-b890-46d1-a9d8-db73bb292bb4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1527 microversion: 2.1 time: 0.522138 Aug 09 17:22:03.051355 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1515/2924] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:02 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1527 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:22:03.101963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a3134412-92e1-447e-9f84-b2698af1c538 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:03.103142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a3134412-92e1-447e-9f84-b2698af1c538 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:03.105576 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0ca6a010-77f5-4b64-ae3c-d0c9adbc4bb9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 1.618259 Aug 09 17:22:03.112078 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1410/2925] 10.222.0.93 () {58 vars in 1173 bytes} [Tue Aug 9 17:22:01 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:03.159963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:03.172096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:03.173564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.compute.servers [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Removing options 'limit' from query {{(pid=119432) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 09 17:22:03.176757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:03.183858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3134412-92e1-447e-9f84-b2698af1c538 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:03.189197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:03.190443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:03.191468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:03.192876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3134412-92e1-447e-9f84-b2698af1c538 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:03.193705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:03.194762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:03.195800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:03.196159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3134412-92e1-447e-9f84-b2698af1c538 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:03.216419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3134412-92e1-447e-9f84-b2698af1c538 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:03.220574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3134412-92e1-447e-9f84-b2698af1c538 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:03.223562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3134412-92e1-447e-9f84-b2698af1c538 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:03.455138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:03.487313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:03.487852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:03.488315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:03.915682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a3134412-92e1-447e-9f84-b2698af1c538 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:03.927225 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a3134412-92e1-447e-9f84-b2698af1c538 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1315 microversion: 2.1 time: 0.861797 Aug 09 17:22:03.940361 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1516/2926] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:03 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:03.950262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:03.951771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] [instance: da01d112-b232-474e-bb72-683e9772a01e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:03.964111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:03.965145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:03.965824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:03.966953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:03.967900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:03.969318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:03.995447 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] HTTP exception thrown: Instance da01d112-b232-474e-bb72-683e9772a01e could not be found. Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Request method failure captured: Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/da01d112-b232-474e-bb72-683e9772a01e HTTP/1.1 Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pdz7C8amFXJw0LzCs71_c9w67guPk-d7Vci5ARJzL-25P2MVb0tE4bPmKdfVWpxtCxDGu_1ZfuR6YYYuXfNx9fTAEgiCjDLPe4JU8OhXRGHD3xstvDi5ZmZeTFhHqUQU2-as0nUBhURkIizwrX64aU80lj9GOP3LdhC_Xfl7BNT2GI Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.47 Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 8ac3646b00fa4b85b8c933faa44ec4f9 Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerShowV247Test-164206044 Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8ac3646b00fa4b85b8c933faa44ec4f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8ac3646b00fa4b85b8c933faa44ec4f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8ac3646b00fa4b85b8c933faa44ec4f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8ac3646b00fa4b85b8c933faa44ec4f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerShowV247Test-164206044 Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 8ac3646b00fa4b85b8c933faa44ec4f9 Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerShowV247Test-164206044 Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerShowV247Test-164206044-project Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: ef798302aba8493597e7297eaa238bbf Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerShowV247Test-164206044-project Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance da01d112-b232-474e-bb72-683e9772a01e could not be found. Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'da01d112-b232-474e-bb72-683e9772a01e'} Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da01d112-b232-474e-bb72-683e9772a01e could not be found. Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da01d112-b232-474e-bb72-683e9772a01e could not be found. Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:03.997691 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:04.003231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:04.003231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:04.003231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:04.003231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:04.003231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:04.003231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da01d112-b232-474e-bb72-683e9772a01e could not be found. Aug 09 17:22:04.003231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:04.005380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] Returning 404 to user: Instance da01d112-b232-474e-bb72-683e9772a01e could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:04.006589 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-97393383-42d4-4155-bbb5-6351faeeedd8 tempest-ServerShowV247Test-164206044 tempest-ServerShowV247Test-164206044-project] 10.222.0.93 "GET /compute/v2.1/servers/da01d112-b232-474e-bb72-683e9772a01e" status: 404 len: 111 microversion: 2.47 time: 0.064792 Aug 09 17:22:04.007451 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1517/2927] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:22:03 2022] GET /compute/v2.1/servers/da01d112-b232-474e-bb72-683e9772a01e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:22:04.104464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9425a040-b184-4bb4-9efe-b500d92923e9 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:04.106129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9425a040-b184-4bb4-9efe-b500d92923e9 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:04.120890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9425a040-b184-4bb4-9efe-b500d92923e9 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:04.125135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9425a040-b184-4bb4-9efe-b500d92923e9 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:04.126381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9425a040-b184-4bb4-9efe-b500d92923e9 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:04.130448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9425a040-b184-4bb4-9efe-b500d92923e9 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:04.131715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9425a040-b184-4bb4-9efe-b500d92923e9 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:04.133324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9425a040-b184-4bb4-9efe-b500d92923e9 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:04.304586 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4f7b7462-e9d0-42ac-801b-815d53d4a68e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 1.151401 Aug 09 17:22:04.306064 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1411/2928] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 17:22:03 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:04.353454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ed8d7e85-9cd1-4783-86ab-d8f37d8e03fa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:04.392542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ed8d7e85-9cd1-4783-86ab-d8f37d8e03fa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:04.393676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ed8d7e85-9cd1-4783-86ab-d8f37d8e03fa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:04.404281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8d7e85-9cd1-4783-86ab-d8f37d8e03fa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:04.407995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8d7e85-9cd1-4783-86ab-d8f37d8e03fa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:04.412155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8d7e85-9cd1-4783-86ab-d8f37d8e03fa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:04.415534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8d7e85-9cd1-4783-86ab-d8f37d8e03fa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:04.416428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8d7e85-9cd1-4783-86ab-d8f37d8e03fa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:04.418420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8d7e85-9cd1-4783-86ab-d8f37d8e03fa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:04.710628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-ed8d7e85-9cd1-4783-86ab-d8f37d8e03fa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:04.882869 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ed8d7e85-9cd1-4783-86ab-d8f37d8e03fa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.552263 Aug 09 17:22:04.897231 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1412/2929] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:22:04 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:04.916290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:04.927507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:04.928371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.compute.servers [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Removing options 'limit' from query {{(pid=119432) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 09 17:22:04.929884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:04.937848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:04.939446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:04.940264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:04.941275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:04.941930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:04.942672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:04.971333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9425a040-b184-4bb4-9efe-b500d92923e9 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:04.981888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:04.986491 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9425a040-b184-4bb4-9efe-b500d92923e9 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1527 microversion: 2.1 time: 0.889972 Aug 09 17:22:05.006614 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1518/2930] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:04 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1527 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:05.030907 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-05dbdee9-1c29-4a8a-aa18-ff06b7f9b798 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.131666 Aug 09 17:22:05.031560 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1413/2931] 10.222.0.93 () {58 vars in 1150 bytes} [Tue Aug 9 17:22:04 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:05.053972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-37641f18-8dc9-4a76-8411-d086445d4ba4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:05.055438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-37641f18-8dc9-4a76-8411-d086445d4ba4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:05.076068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37641f18-8dc9-4a76-8411-d086445d4ba4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:05.076937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37641f18-8dc9-4a76-8411-d086445d4ba4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:05.077630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37641f18-8dc9-4a76-8411-d086445d4ba4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:05.079227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37641f18-8dc9-4a76-8411-d086445d4ba4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:05.083452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37641f18-8dc9-4a76-8411-d086445d4ba4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:05.084912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37641f18-8dc9-4a76-8411-d086445d4ba4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:05.652945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f761296f-35fb-459f-8278-daccc5c3708a tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Action: 'create', calling method: .version_select at 0x7fbbcb762c10>, body: {"keypair": {"name": "tempest-keypair-1793902601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBasbWLGQAp40nlOVDfLdX4tEMBueHyHSc5Ca5cAHEBKr09gZXhJW0JMrdbHrzINpWYfC4dyLzbRUlyi13AJ+mNnTfh8vB68uGepwWr4jf0OqstZeM20zWUTZQL2wViYg=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:05.751437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f761296f-35fb-459f-8278-daccc5c3708a tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:22:05.768063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f761296f-35fb-459f-8278-daccc5c3708a tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for user 7939eef7fbe0404db07ef56bab0bab06 and project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:22:05.839592 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f761296f-35fb-459f-8278-daccc5c3708a tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.828300 Aug 09 17:22:05.848271 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1519/2932] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:22:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:05.857793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c504498-297a-4e8e-94a7-a25d96d6b6dd tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:05.878755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c504498-297a-4e8e-94a7-a25d96d6b6dd tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:05.879581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c504498-297a-4e8e-94a7-a25d96d6b6dd tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:05.893594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c504498-297a-4e8e-94a7-a25d96d6b6dd tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:05.894145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c504498-297a-4e8e-94a7-a25d96d6b6dd tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:05.894586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c504498-297a-4e8e-94a7-a25d96d6b6dd tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:05.900127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c504498-297a-4e8e-94a7-a25d96d6b6dd tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:05.901150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c504498-297a-4e8e-94a7-a25d96d6b6dd tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:05.901784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c504498-297a-4e8e-94a7-a25d96d6b6dd tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:05.986549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-6c504498-297a-4e8e-94a7-a25d96d6b6dd tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:06.055863 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c504498-297a-4e8e-94a7-a25d96d6b6dd tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.206203 Aug 09 17:22:06.068457 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1520/2933] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:22:05 2022] GET /compute/v2.1/servers => generated 1010 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:06.074108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-cd27bd4a-7547-46b3-8828-8c6346ed3f87 req-cad578a3-80ba-44b1-83fa-10f2fc372a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad75e25e-2e56-44e4-9dff-202aac8cb52c", "tag": "b8d8a612-2537-479e-98f4-6b70094a8512"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:06.085776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cd27bd4a-7547-46b3-8828-8c6346ed3f87 req-cad578a3-80ba-44b1-83fa-10f2fc372a6d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:06.086528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cd27bd4a-7547-46b3-8828-8c6346ed3f87 req-cad578a3-80ba-44b1-83fa-10f2fc372a6d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:06.087135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cd27bd4a-7547-46b3-8828-8c6346ed3f87 req-cad578a3-80ba-44b1-83fa-10f2fc372a6d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:06.100845 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-cd27bd4a-7547-46b3-8828-8c6346ed3f87 req-cad578a3-80ba-44b1-83fa-10f2fc372a6d service nova] Creating event network-changed:b8d8a612-2537-479e-98f4-6b70094a8512 for instance ad75e25e-2e56-44e4-9dff-202aac8cb52c on n-h1-845781-6 Aug 09 17:22:06.107505 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-cd27bd4a-7547-46b3-8828-8c6346ed3f87 req-cad578a3-80ba-44b1-83fa-10f2fc372a6d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037216 Aug 09 17:22:06.109616 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1521/2934] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:06.116637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74c5869b-abd6-4cd4-adc3-cef067221093 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Calling method '.version_select at 0x7fbbcbe8e670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:06.132315 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-74c5869b-abd6-4cd4-adc3-cef067221093 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-1793902601" status: 200 len: 498 microversion: 2.1 time: 0.020811 Aug 09 17:22:06.139937 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1522/2935] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:22:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1793902601 => generated 498 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:06.146082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-725f4fa0-77ef-43f1-b177-266d3142c7f1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:06.147114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-725f4fa0-77ef-43f1-b177-266d3142c7f1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:06.155655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725f4fa0-77ef-43f1-b177-266d3142c7f1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:06.156437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725f4fa0-77ef-43f1-b177-266d3142c7f1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:06.157049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725f4fa0-77ef-43f1-b177-266d3142c7f1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:06.157960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725f4fa0-77ef-43f1-b177-266d3142c7f1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:06.158596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725f4fa0-77ef-43f1-b177-266d3142c7f1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:06.159198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725f4fa0-77ef-43f1-b177-266d3142c7f1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:06.353218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-725f4fa0-77ef-43f1-b177-266d3142c7f1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:06.406310 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-725f4fa0-77ef-43f1-b177-266d3142c7f1 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1485 microversion: 2.1 time: 0.257742 Aug 09 17:22:06.411269 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1523/2936] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:06 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1485 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:06.433301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4ced199-5225-463a-a7cb-a5d13f0f6215 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:06.446442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d4ced199-5225-463a-a7cb-a5d13f0f6215 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:06.449248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d4ced199-5225-463a-a7cb-a5d13f0f6215 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:06.498963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ced199-5225-463a-a7cb-a5d13f0f6215 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:06.502666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ced199-5225-463a-a7cb-a5d13f0f6215 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:06.505401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ced199-5225-463a-a7cb-a5d13f0f6215 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:06.506910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ced199-5225-463a-a7cb-a5d13f0f6215 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:06.507801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ced199-5225-463a-a7cb-a5d13f0f6215 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:06.516140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4ced199-5225-463a-a7cb-a5d13f0f6215 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:06.806401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-d4ced199-5225-463a-a7cb-a5d13f0f6215 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:06.971305 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d4ced199-5225-463a-a7cb-a5d13f0f6215 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.557702 Aug 09 17:22:06.980329 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1524/2937] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:22:06 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:06.986339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-33674fbc-1988-4808-bf1f-2de23c380fb4 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Calling method '.version_select at 0x7fbbcbae79d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:07.023785 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-33674fbc-1988-4808-bf1f-2de23c380fb4 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1793902601" status: 202 len: 0 microversion: 2.1 time: 0.041202 Aug 09 17:22:07.024749 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1525/2938] 10.222.0.93 () {58 vars in 1221 bytes} [Tue Aug 9 17:22:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1793902601 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:22:07.040671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fafbb148-8369-44d5-b108-411972db26fc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:07.052324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fafbb148-8369-44d5-b108-411972db26fc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:07.053295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.compute.servers [None req-fafbb148-8369-44d5-b108-411972db26fc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Removing options 'limit' from query {{(pid=119431) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 09 17:22:07.054240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fafbb148-8369-44d5-b108-411972db26fc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:07.062198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafbb148-8369-44d5-b108-411972db26fc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:07.064222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafbb148-8369-44d5-b108-411972db26fc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:07.065136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafbb148-8369-44d5-b108-411972db26fc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:07.066331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafbb148-8369-44d5-b108-411972db26fc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:07.067200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafbb148-8369-44d5-b108-411972db26fc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:07.067926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fafbb148-8369-44d5-b108-411972db26fc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:07.111179 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fafbb148-8369-44d5-b108-411972db26fc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.077419 Aug 09 17:22:07.123167 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1526/2939] 10.222.0.93 () {58 vars in 1140 bytes} [Tue Aug 9 17:22:07 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:07.139757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4b89126-7d5c-4dca-a292-f6b6f58b3c95 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Action: 'create', calling method: .version_select at 0x7fbbcb510b80>, body: {"keypair": {"name": "tempest-keypair-1021910971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwfi09wxpTkugAOLh5vGcbiqlJ5v07UYpuy/TiJwNaI6Pq1SVvHQLP3JGHXbynMYtafUcnjfEovsK9hPvrzrZj43YXYfSu5kxlU4ozaQL9I4Z4FhDZvwvO87muTz4OpUA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:07.188231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a4b89126-7d5c-4dca-a292-f6b6f58b3c95 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:22:07.195831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a4b89126-7d5c-4dca-a292-f6b6f58b3c95 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for user 7939eef7fbe0404db07ef56bab0bab06 and project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:22:07.239392 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4b89126-7d5c-4dca-a292-f6b6f58b3c95 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112516 Aug 09 17:22:07.240512 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1527/2940] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:22:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:07.247779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50fe30d9-309c-40cd-94d2-3f6106b80114 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:07.254198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-50fe30d9-309c-40cd-94d2-3f6106b80114 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:07.255453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-50fe30d9-309c-40cd-94d2-3f6106b80114 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-448118167', 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:07.263839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50fe30d9-309c-40cd-94d2-3f6106b80114 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:07.265439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50fe30d9-309c-40cd-94d2-3f6106b80114 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:07.266176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50fe30d9-309c-40cd-94d2-3f6106b80114 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:07.267261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50fe30d9-309c-40cd-94d2-3f6106b80114 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:07.268328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50fe30d9-309c-40cd-94d2-3f6106b80114 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:07.269007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50fe30d9-309c-40cd-94d2-3f6106b80114 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:07.399493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-50fe30d9-309c-40cd-94d2-3f6106b80114 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:07.492540 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-50fe30d9-309c-40cd-94d2-3f6106b80114 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-448118167" status: 200 len: 345 microversion: 2.1 time: 0.246053 Aug 09 17:22:07.502221 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1528/2941] 10.222.0.93 () {58 vars in 1240 bytes} [Tue Aug 9 17:22:07 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-448118167 => generated 345 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:07.507700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eab4b83c-6efa-4c20-b18a-8208c9dd8b67 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Calling method '.version_select at 0x7fbbcb642af0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:07.536968 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eab4b83c-6efa-4c20-b18a-8208c9dd8b67 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021910971" status: 202 len: 0 microversion: 2.1 time: 0.033391 Aug 09 17:22:07.538028 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1529/2942] 10.222.0.93 () {58 vars in 1221 bytes} [Tue Aug 9 17:22:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021910971 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:22:07.543066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c0c5f06-6f97-47fe-a19b-da5d49389bab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:07.545533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c0c5f06-6f97-47fe-a19b-da5d49389bab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:07.559422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c0c5f06-6f97-47fe-a19b-da5d49389bab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:07.560403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c0c5f06-6f97-47fe-a19b-da5d49389bab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:07.561135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c0c5f06-6f97-47fe-a19b-da5d49389bab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:07.562703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c0c5f06-6f97-47fe-a19b-da5d49389bab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:07.564259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c0c5f06-6f97-47fe-a19b-da5d49389bab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:07.570113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c0c5f06-6f97-47fe-a19b-da5d49389bab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:07.710181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c0c5f06-6f97-47fe-a19b-da5d49389bab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ab568d7612c4f849e842d478b67016d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c53ff5b89f4495958c9319d750833c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:07.721145 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c0c5f06-6f97-47fe-a19b-da5d49389bab tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 200 len: 1485 microversion: 2.1 time: 0.180547 Aug 09 17:22:07.748258 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1530/2943] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:07 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 1485 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:07.755567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ba92d5c7-6f04-4f9d-92dd-26651c6678aa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:07.793198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba92d5c7-6f04-4f9d-92dd-26651c6678aa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:07.793716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba92d5c7-6f04-4f9d-92dd-26651c6678aa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:07.794167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba92d5c7-6f04-4f9d-92dd-26651c6678aa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:07.991353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba92d5c7-6f04-4f9d-92dd-26651c6678aa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Going to try to stop instance {{(pid=119431) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 17:22:08.146697 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ba92d5c7-6f04-4f9d-92dd-26651c6678aa tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "POST /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195/action" status: 202 len: 0 microversion: 2.1 time: 0.396849 Aug 09 17:22:08.149540 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1531/2944] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:22:07 2022] POST /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:22:08.160011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b10a4218-6946-45e9-ab44-d5085d8494ba tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Action: 'create', calling method: .version_select at 0x7fbbcb5b7d30>, body: {"keypair": {"name": "tempest-keypair-1744727275", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:08.186992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b10a4218-6946-45e9-ab44-d5085d8494ba tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:22:08.198198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b10a4218-6946-45e9-ab44-d5085d8494ba tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for user 7939eef7fbe0404db07ef56bab0bab06 and project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:22:08.244723 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b10a4218-6946-45e9-ab44-d5085d8494ba tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.093112 Aug 09 17:22:08.252544 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1532/2945] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:22:08 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:08.258547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f7f3316d-7bb6-4ed2-a55d-4debde4cbb0b req-4e313050-b0ed-4bf5-af4a-b925d6699bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28428f55-ba65-4ce3-b23a-5c7f94cab2d2", "name": "network-vif-deleted", "tag": "6e6c78b4-aff3-460a-a11f-dfd02f73f73d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:08.273076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f7f3316d-7bb6-4ed2-a55d-4debde4cbb0b req-4e313050-b0ed-4bf5-af4a-b925d6699bdc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:08.273904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f7f3316d-7bb6-4ed2-a55d-4debde4cbb0b req-4e313050-b0ed-4bf5-af4a-b925d6699bdc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:08.274603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f7f3316d-7bb6-4ed2-a55d-4debde4cbb0b req-4e313050-b0ed-4bf5-af4a-b925d6699bdc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:08.290195 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f7f3316d-7bb6-4ed2-a55d-4debde4cbb0b req-4e313050-b0ed-4bf5-af4a-b925d6699bdc service nova] Creating event network-vif-deleted:6e6c78b4-aff3-460a-a11f-dfd02f73f73d for instance 28428f55-ba65-4ce3-b23a-5c7f94cab2d2 on n-h2-845781-6 Aug 09 17:22:08.299829 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f7f3316d-7bb6-4ed2-a55d-4debde4cbb0b req-4e313050-b0ed-4bf5-af4a-b925d6699bdc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045294 Aug 09 17:22:08.301035 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1533/2946] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:08.308841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d882727f-9dec-4e67-95e8-3d4b33ef023d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:08.310184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d882727f-9dec-4e67-95e8-3d4b33ef023d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:08.320288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d882727f-9dec-4e67-95e8-3d4b33ef023d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:08.321336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d882727f-9dec-4e67-95e8-3d4b33ef023d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:08.322116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d882727f-9dec-4e67-95e8-3d4b33ef023d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:08.323133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d882727f-9dec-4e67-95e8-3d4b33ef023d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:08.324328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d882727f-9dec-4e67-95e8-3d4b33ef023d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:08.325121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d882727f-9dec-4e67-95e8-3d4b33ef023d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:08.597734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-37641f18-8dc9-4a76-8411-d086445d4ba4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:08.621616 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-37641f18-8dc9-4a76-8411-d086445d4ba4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1315 microversion: 2.1 time: 3.580926 Aug 09 17:22:08.626509 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1414/2947] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:05 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1315 bytes in 3587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:08.651749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f44ec3fc-d545-4d7e-b316-926b1e807302 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Calling method '.version_select at 0x7fbbcaebb550>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:08.721796 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f44ec3fc-d545-4d7e-b316-926b1e807302 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744727275" status: 202 len: 0 microversion: 2.1 time: 0.093934 Aug 09 17:22:08.730669 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1415/2948] 10.222.0.93 () {58 vars in 1221 bytes} [Tue Aug 9 17:22:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744727275 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:22:08.768197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:08.769438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 28428f55-ba65-4ce3-b23a-5c7f94cab2d2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:08.786900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:08.787775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:08.788489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:08.793743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:08.796453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:08.800591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:08.835940 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] HTTP exception thrown: Instance 28428f55-ba65-4ce3-b23a-5c7f94cab2d2 could not be found. Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 HTTP/1.1 Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 28428f55-ba65-4ce3-b23a-5c7f94cab2d2 could not be found. Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '28428f55-ba65-4ce3-b23a-5c7f94cab2d2'} Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28428f55-ba65-4ce3-b23a-5c7f94cab2d2 could not be found. Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28428f55-ba65-4ce3-b23a-5c7f94cab2d2 could not be found. Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:08.838314 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:08.843250 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:08.843250 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:08.843250 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:08.843250 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:08.843250 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:08.843250 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:08.843250 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28428f55-ba65-4ce3-b23a-5c7f94cab2d2 could not be found. Aug 09 17:22:08.843250 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:08.848980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 404 to user: Instance 28428f55-ba65-4ce3-b23a-5c7f94cab2d2 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:08.855456 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dce8d23e-5587-4266-8e47-fd81418adbd4 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2" status: 404 len: 111 microversion: 2.1 time: 0.112262 Aug 09 17:22:08.857565 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1416/2949] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:08 2022] GET /compute/v2.1/servers/28428f55-ba65-4ce3-b23a-5c7f94cab2d2 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:08.863985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aef84796-8fc5-44d5-b04f-407df840621d tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Action: 'create', calling method: .version_select at 0x7fbbcaebb5e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-938901256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzDkV8lwxHzfVjxsxIilx6IWd990IiA4MJABekJOTCX5Q3heXuRFRsr6jpcKF0E8s275/Op5qZPBI3olEpbP7S8mqfQHBczzeUHgt8t/P2tIY6BKFoYR6cA+VIX78WXBw=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:08.921067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-aef84796-8fc5-44d5-b04f-407df840621d tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:22:08.938513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-aef84796-8fc5-44d5-b04f-407df840621d tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for user 7939eef7fbe0404db07ef56bab0bab06 and project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:22:09.019157 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aef84796-8fc5-44d5-b04f-407df840621d tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.159959 Aug 09 17:22:09.020820 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1417/2950] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:22:08 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:09.028768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bbc66053-86ce-4fbd-a228-82a1e41a1601 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '.version_select at 0x7fbbdc93c160>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:09.072435 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-bbc66053-86ce-4fbd-a228-82a1e41a1601 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] HTTP exception thrown: Image not found. Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bbc66053-86ce-4fbd-a228-82a1e41a1601 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/images/494f86d3-cbf9-4228-a373-4c38df4615c7 HTTP/1.1 Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: exception: Image not found. Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '494f86d3-cbf9-4228-a373-4c38df4615c7'} Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 494f86d3-cbf9-4228-a373-4c38df4615c7 to delete Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 494f86d3-cbf9-4228-a373-4c38df4615c7 could not be found. Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:09.076459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:22:09.083806 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.087738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bbc66053-86ce-4fbd-a228-82a1e41a1601 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 404 to user: Image not found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:09.090090 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bbc66053-86ce-4fbd-a228-82a1e41a1601 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "DELETE /compute/v2.1/images/494f86d3-cbf9-4228-a373-4c38df4615c7" status: 404 len: 62 microversion: 2.1 time: 0.066294 Aug 09 17:22:09.099271 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1418/2951] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:09 2022] DELETE /compute/v2.1/images/494f86d3-cbf9-4228-a373-4c38df4615c7 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:22:09.130387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c99763e5-a2e8-434c-8fd2-1a15b16767e0 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Action: 'create', calling method: .version_select at 0x7fbbdc9068b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-734502455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKngPTiFlQ7fD5WkvfFfSgPdXHdxWxdpW8do4pjromG3ghH5KUg4hRnixkeHHQuY1wrkKeoHjRlEm/XgzJ9690H7QViq6cizx2y+am8OaWvlsBMuL69hmcyiJ3s1Om7Cng=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:09.189899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-c99763e5-a2e8-434c-8fd2-1a15b16767e0 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:22:09.209295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-c99763e5-a2e8-434c-8fd2-1a15b16767e0 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for user 7939eef7fbe0404db07ef56bab0bab06 and project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:22:09.288446 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c99763e5-a2e8-434c-8fd2-1a15b16767e0 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.186078 Aug 09 17:22:09.289653 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1419/2952] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:22:09 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:09.299984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:09.300963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:09.318694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:09.322450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:09.323071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:09.324155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:09.326558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:09.327122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:09.380609 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] HTTP exception thrown: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 HTTP/1.1 Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '29188f6a-3896-4045-9ad5-bbf0997ead47'} Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:09.388905 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:09.394239 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:22:09.394239 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.394239 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:09.394239 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.394239 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:09.394239 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:09.394239 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:09.394239 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:09.394239 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:09.394239 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:22:09.394239 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.399039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 404 to user: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:09.401457 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cea13574-9c71-4fb0-a831-4c9e576abe2f tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "DELETE /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 404 len: 111 microversion: 2.1 time: 0.110649 Aug 09 17:22:09.408304 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1420/2953] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:22:09 2022] DELETE /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:09.423203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5c587d37-8a44-4dc6-bfbd-c66ccc1265b7 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Action: 'create', calling method: .version_select at 0x7fbbcaebbc10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1119837677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOeqh6Y5zXRAnUlw3mfVoN3ZbEsyFANtkHR0WDTQHRyasfbGJMc0HpeyCNI6frbPOJhX4hUR5ja0X/9xU+0s8pkX5kme4Xvxm076OosKYgnia4e+57voX/hzI90S7gNSA=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:09.442972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d882727f-9dec-4e67-95e8-3d4b33ef023d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:09.455733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:09.456704 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d882727f-9dec-4e67-95e8-3d4b33ef023d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1521 microversion: 2.1 time: 1.153621 Aug 09 17:22:09.457565 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1534/2954] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:08 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1521 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:09.480510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:09.481896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: 29188f6a-3896-4045-9ad5-bbf0997ead47] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:09.491171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:09.492062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:09.492712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:09.493677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:09.494309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:09.495111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:09.509443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-5c587d37-8a44-4dc6-bfbd-c66ccc1265b7 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:22:09.536837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-5c587d37-8a44-4dc6-bfbd-c66ccc1265b7 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Getting quotas for user 7939eef7fbe0404db07ef56bab0bab06 and project 0ee57e944ae14238ab6a30ce072d71ff. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:22:09.568523 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] HTTP exception thrown: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 HTTP/1.1 Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '29188f6a-3896-4045-9ad5-bbf0997ead47'} Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.574937 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:09.580720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.580720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:09.580720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:09.580720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:09.580720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:09.580720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:09.580720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. Aug 09 17:22:09.580720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:09.589098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 404 to user: Instance 29188f6a-3896-4045-9ad5-bbf0997ead47 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:09.594547 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-55f3844f-ca54-4d47-b291-c3f3efd3ab5e tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47" status: 404 len: 111 microversion: 2.1 time: 0.116556 Aug 09 17:22:09.595518 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1535/2955] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:09 2022] GET /compute/v2.1/servers/29188f6a-3896-4045-9ad5-bbf0997ead47 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:09.614404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-229a5930-74ef-4529-a02a-abb79f1f2567 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '.version_select at 0x7fbbcb48d1f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:09.620926 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5c587d37-8a44-4dc6-bfbd-c66ccc1265b7 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.207776 Aug 09 17:22:09.623481 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1421/2956] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:22:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:09.650413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49094f12-dc34-4ed0-8421-3c17ad7f615a tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Calling method '.version_select at 0x7fbbcb4368b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:09.666834 n-d-845781-6 devstack@n-api.service[119432]: WARNING oslo_db.sqlalchemy.utils [None req-49094f12-dc34-4ed0-8421-3c17ad7f615a tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 17:22:09.669546 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-229a5930-74ef-4529-a02a-abb79f1f2567 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283539500" status: 202 len: 0 microversion: 2.1 time: 0.067438 Aug 09 17:22:09.670178 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1536/2957] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:22:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283539500 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:22:09.679912 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-49094f12-dc34-4ed0-8421-3c17ad7f615a tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.037162 Aug 09 17:22:09.681330 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1422/2958] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:22:09 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:09.698138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bd3e41e1-641d-4e5c-9179-eb5ce1053a4f tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Calling method '.version_select at 0x7fbbdc906dc0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:09.698695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fce80dd4-0c23-4d3b-96a0-2e496cc1ffba tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:09.699434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fce80dd4-0c23-4d3b-96a0-2e496cc1ffba tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:09.720089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fce80dd4-0c23-4d3b-96a0-2e496cc1ffba tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:09.720590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fce80dd4-0c23-4d3b-96a0-2e496cc1ffba tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:09.721045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fce80dd4-0c23-4d3b-96a0-2e496cc1ffba tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:09.721811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fce80dd4-0c23-4d3b-96a0-2e496cc1ffba tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:09.722452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fce80dd4-0c23-4d3b-96a0-2e496cc1ffba tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:09.743908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fce80dd4-0c23-4d3b-96a0-2e496cc1ffba tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:09.755617 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bd3e41e1-641d-4e5c-9179-eb5ce1053a4f tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1119837677" status: 202 len: 0 microversion: 2.1 time: 0.059447 Aug 09 17:22:09.766366 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1423/2959] 10.222.0.93 () {58 vars in 1278 bytes} [Tue Aug 9 17:22:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1119837677 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:22:09.797914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-75ddc964-dc96-4178-bc07-f0185c64849e tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Calling method '.version_select at 0x7fbbcb4d5af0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:09.847350 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-75ddc964-dc96-4178-bc07-f0185c64849e tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-734502455" status: 202 len: 0 microversion: 2.1 time: 0.078347 Aug 09 17:22:09.851745 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1424/2960] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:22:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-734502455 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:22:09.895340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d43f822a-6c5e-4e02-bb49-84230b788c56 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] Calling method '.version_select at 0x7fbbd80da040>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:09.949351 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d43f822a-6c5e-4e02-bb49-84230b788c56 tempest-KeyPairsV2TestJSON-1151795295 tempest-KeyPairsV2TestJSON-1151795295-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-938901256" status: 202 len: 0 microversion: 2.1 time: 0.069184 Aug 09 17:22:09.951569 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1425/2961] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:22:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-938901256 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:22:10.493520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0c6acd19-80b6-47ea-8f02-3289ebd622cc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:10.500737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0c6acd19-80b6-47ea-8f02-3289ebd622cc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:10.538759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c6acd19-80b6-47ea-8f02-3289ebd622cc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:10.539596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c6acd19-80b6-47ea-8f02-3289ebd622cc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:10.546449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c6acd19-80b6-47ea-8f02-3289ebd622cc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:10.556776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c6acd19-80b6-47ea-8f02-3289ebd622cc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:10.558073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c6acd19-80b6-47ea-8f02-3289ebd622cc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:10.558867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c6acd19-80b6-47ea-8f02-3289ebd622cc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:10.713950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fce80dd4-0c23-4d3b-96a0-2e496cc1ffba tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:10.756672 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fce80dd4-0c23-4d3b-96a0-2e496cc1ffba tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1315 microversion: 2.1 time: 1.072999 Aug 09 17:22:10.766898 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1537/2962] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:09 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1315 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:10.785727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:10.787035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:10.808372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:10.812185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:10.814080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:10.821566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:10.821566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:10.821566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:10.910636 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 HTTP/1.1 Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'fae1e73e-68f8-4664-81ae-b49d4de1ca63'} Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:10.920126 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:10.932836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:22:10.932836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:10.932836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:10.932836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:10.932836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:10.932836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:10.932836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:10.932836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:10.932836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:10.932836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:22:10.932836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:10.938090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:10.943446 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6df8bf28-db29-4134-b0da-9559da834097 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 404 len: 111 microversion: 2.1 time: 0.169314 Aug 09 17:22:10.944487 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1538/2963] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:22:10 2022] DELETE /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:10.973586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:10.975323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: fae1e73e-68f8-4664-81ae-b49d4de1ca63] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:11.016172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:11.019926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:11.022131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:11.027393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:11.034870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:11.036107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:11.078083 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 HTTP/1.1 Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'fae1e73e-68f8-4664-81ae-b49d4de1ca63'} Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:11.082787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.090478 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:11.090478 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:11.090478 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:11.090478 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:11.090478 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:11.090478 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. Aug 09 17:22:11.090478 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.095177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance fae1e73e-68f8-4664-81ae-b49d4de1ca63 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:11.097686 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aa0727c3-e618-4c4b-935a-8c55ad72fb5b tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63" status: 404 len: 111 microversion: 2.1 time: 0.146061 Aug 09 17:22:11.100691 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1539/2964] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:10 2022] GET /compute/v2.1/servers/fae1e73e-68f8-4664-81ae-b49d4de1ca63 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:11.117806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:11.119218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:11.132891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:11.135168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:11.137148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:11.139089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:11.141217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:11.142349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:11.206635 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc HTTP/1.1 Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '330a79ba-42cf-4f1b-a572-c5143e3096cc'} Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:11.217302 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:11.227763 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:22:11.227763 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.227763 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:11.227763 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.227763 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:11.227763 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:11.227763 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:11.227763 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:11.227763 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:11.227763 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:22:11.227763 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.232431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:11.238637 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2351fe85-2a70-43f5-812b-ee3d8d76683d tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 404 len: 111 microversion: 2.1 time: 0.130146 Aug 09 17:22:11.244590 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1540/2965] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:22:11 2022] DELETE /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:11.277617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:11.279666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] [instance: 330a79ba-42cf-4f1b-a572-c5143e3096cc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:11.295194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:11.297276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:11.298370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:11.300365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:11.301440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:11.302597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:11.335491 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] HTTP exception thrown: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Request method failure captured: Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc HTTP/1.1 Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pYxlBK5O8_fNbDNf0bilnh-uOsDIh3EVT8dmbHhzsLpJs7xbkxap6hw34vkKy7t9m0xpGXy_rTlrzeHLxL7BpFM3Jafph2Rvt82l4QbK_Qg3CqGWqul5Kx9eH_eyTqRJ5X9xqUF2CncrB_FIAxP5M7XJBqChgaUrUzlSbSia0sjcyg Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca2b4aad2192406d951cbdb3991c41fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ca2b4aad2192406d951cbdb3991c41fb Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-1337231590 Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d8e1dc1f64fe429ea6a8c746b7c84ae6 Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-1337231590-project Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '330a79ba-42cf-4f1b-a572-c5143e3096cc'} Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:11.340518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.350814 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:11.350814 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:11.350814 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:11.350814 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:11.350814 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:11.350814 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. Aug 09 17:22:11.350814 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:11.350814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] Returning 404 to user: Instance 330a79ba-42cf-4f1b-a572-c5143e3096cc could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:11.350814 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-988353eb-0928-4a4c-8b41-0ca91b117391 tempest-DeleteServersTestJSON-1337231590 tempest-DeleteServersTestJSON-1337231590-project] 10.222.0.93 "GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc" status: 404 len: 111 microversion: 2.1 time: 0.094890 Aug 09 17:22:11.350814 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1541/2966] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:11 2022] GET /compute/v2.1/servers/330a79ba-42cf-4f1b-a572-c5143e3096cc => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:11.466032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0c6acd19-80b6-47ea-8f02-3289ebd622cc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:11.480260 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0c6acd19-80b6-47ea-8f02-3289ebd622cc tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1521 microversion: 2.1 time: 0.998660 Aug 09 17:22:11.496093 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1426/2967] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:10 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1521 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:22:11.782624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-780f0519-4557-4e6e-aa70-5b7f9410a117 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:11.786794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-780f0519-4557-4e6e-aa70-5b7f9410a117 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:11.818503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-780f0519-4557-4e6e-aa70-5b7f9410a117 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:11.819993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-780f0519-4557-4e6e-aa70-5b7f9410a117 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:11.821280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-780f0519-4557-4e6e-aa70-5b7f9410a117 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:11.823035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-780f0519-4557-4e6e-aa70-5b7f9410a117 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:11.824346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-780f0519-4557-4e6e-aa70-5b7f9410a117 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:11.829165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-780f0519-4557-4e6e-aa70-5b7f9410a117 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:12.511917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:12.513330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:12.527838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:12.528768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:12.529491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:12.531048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:12.536714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:12.537544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:13.238600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-780f0519-4557-4e6e-aa70-5b7f9410a117 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:13.261560 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-780f0519-4557-4e6e-aa70-5b7f9410a117 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1315 microversion: 2.1 time: 1.485967 Aug 09 17:22:13.269955 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1542/2968] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:11 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1315 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:13.430972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea82c3b5-df7b-418a-9c34-e4018cd3a962 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '.version_select at 0x7fbbcb578a60>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:13.520160 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-ea82c3b5-df7b-418a-9c34-e4018cd3a962 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] HTTP exception thrown: Image not found. Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea82c3b5-df7b-418a-9c34-e4018cd3a962 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/images/e0f272f1-f7b8-4b6e-894a-095e9fbddce7 HTTP/1.1 Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: exception: Image not found. Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'e0f272f1-f7b8-4b6e-894a-095e9fbddce7'} Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e0f272f1-f7b8-4b6e-894a-095e9fbddce7 to delete Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e0f272f1-f7b8-4b6e-894a-095e9fbddce7 could not be found. Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:13.525807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 17:22:13.533851 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.540827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea82c3b5-df7b-418a-9c34-e4018cd3a962 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 404 to user: Image not found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:13.541693 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ea82c3b5-df7b-418a-9c34-e4018cd3a962 tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "DELETE /compute/v2.1/images/e0f272f1-f7b8-4b6e-894a-095e9fbddce7" status: 404 len: 62 microversion: 2.1 time: 0.116292 Aug 09 17:22:13.548135 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1543/2969] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:13 2022] DELETE /compute/v2.1/images/e0f272f1-f7b8-4b6e-894a-095e9fbddce7 => generated 62 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 09 17:22:13.563017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:13.564412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:13.578676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:13.580099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:13.581754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:13.584352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:13.585703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:13.587257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:13.604520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:13.625901 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] HTTP exception thrown: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 HTTP/1.1 Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b86a49e6-8b69-4653-be51-46f86d343173'} Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:13.629720 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:13.641199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:22:13.641199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.641199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:13.641199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.641199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:13.641199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:13.641199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:13.641199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:13.641199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:13.641199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:22:13.641199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.652241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 404 to user: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:13.652241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6751fb3f-2378-483b-b9f1-3225ae473dde tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 404 len: 111 microversion: 2.1 time: 0.095154 Aug 09 17:22:13.652241 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1544/2970] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:22:13 2022] DELETE /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:13.663717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:13.665612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] [instance: b86a49e6-8b69-4653-be51-46f86d343173] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:13.676592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:13.679513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:13.680724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:13.681765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:13.683771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:13.684861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:13.685779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:13.722979 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] HTTP exception thrown: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Request method failure captured: Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 HTTP/1.1 Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pb5w4-9cIE-WiFviSOwGL1EKDhzhcdWwQjLn3oGrkIDG-7tynNoFwJvAqwTBU5zIRTbXcDVgifmyo_TxEc1_4CdiuaF0Iu72x4IDZTSCc60wdG2od6MwvsvIRgBBhwDb0SP2eZ38RpBMmo6tOspQBiNToUnpmzPAtI8AXW6rew3FSc Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c53ff5b89f4495958c9319d750833c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c53ff5b89f4495958c9319d750833c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 09c53ff5b89f4495958c9319d750833c Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-497193871 Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 4ab568d7612c4f849e842d478b67016d Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-497193871-project Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b86a49e6-8b69-4653-be51-46f86d343173'} Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.727087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:13.734948 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.734948 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:13.734948 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:13.734948 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:13.734948 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:13.734948 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:13.734948 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. Aug 09 17:22:13.734948 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:22:13.737603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:13.747776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Returning 404 to user: Instance b86a49e6-8b69-4653-be51-46f86d343173 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:13.747776 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173" status: 404 len: 111 microversion: 2.1 time: 0.086260 Aug 09 17:22:13.747776 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1545/2971] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:13 2022] GET /compute/v2.1/servers/b86a49e6-8b69-4653-be51-46f86d343173 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:13.763751 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1521 microversion: 2.1 time: 1.255566 Aug 09 17:22:13.794520 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1427/2972] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:12 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1521 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:22:14.227936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:14.230033 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002345 Aug 09 17:22:14.233001 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1546/2973] 10.222.0.93 () {56 vars in 886 bytes} [Tue Aug 9 17:22:14 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 09 17:22:14.248225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:14.252203 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004741 Aug 09 17:22:14.263750 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1428/2974] 10.222.0.93 () {54 vars in 1035 bytes} [Tue Aug 9 17:22:14 2022] GET /compute/v2/ => generated 379 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 09 17:22:14.267797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:14.270740 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1686192c-f80f-4883-ba23-5467d913d31a tempest-ImagesOneServerNegativeTestJSON-497193871 tempest-ImagesOneServerNegativeTestJSON-497193871-project] 10.222.0.93 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004406 Aug 09 17:22:14.271738 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1547/2975] 10.222.0.93 () {54 vars in 1041 bytes} [Tue Aug 9 17:22:14 2022] GET /compute/v2.1/ => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:22:14.287244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:14.288614 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3dfc0b00-807a-452c-bb25-85862718d0b3 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001871 Aug 09 17:22:14.289480 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1429/2976] 10.222.0.93 () {56 vars in 886 bytes} [Tue Aug 9 17:22:14 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 09 17:22:14.312376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c0c6a5fb-9c90-46ec-873e-1b70a0d9f1b9 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:14.312376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c0c6a5fb-9c90-46ec-873e-1b70a0d9f1b9 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:14.328865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0c6a5fb-9c90-46ec-873e-1b70a0d9f1b9 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:14.333724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0c6a5fb-9c90-46ec-873e-1b70a0d9f1b9 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:14.334482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0c6a5fb-9c90-46ec-873e-1b70a0d9f1b9 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:14.335536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0c6a5fb-9c90-46ec-873e-1b70a0d9f1b9 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:14.338135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0c6a5fb-9c90-46ec-873e-1b70a0d9f1b9 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:14.338908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0c6a5fb-9c90-46ec-873e-1b70a0d9f1b9 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:14.816058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5273a017-e937-4bf9-ac51-a4614c96ef31 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:14.817004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5273a017-e937-4bf9-ac51-a4614c96ef31 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:14.838777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5273a017-e937-4bf9-ac51-a4614c96ef31 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:14.843064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5273a017-e937-4bf9-ac51-a4614c96ef31 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:14.853216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5273a017-e937-4bf9-ac51-a4614c96ef31 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:14.854851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5273a017-e937-4bf9-ac51-a4614c96ef31 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:14.856001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5273a017-e937-4bf9-ac51-a4614c96ef31 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:14.856966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5273a017-e937-4bf9-ac51-a4614c96ef31 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:14.969154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:15.304822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c0c6a5fb-9c90-46ec-873e-1b70a0d9f1b9 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:15.340503 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c0c6a5fb-9c90-46ec-873e-1b70a0d9f1b9 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1315 microversion: 2.1 time: 1.036137 Aug 09 17:22:15.352678 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1548/2977] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:14 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:15.381019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-28eab05e-f202-4d23-8f9c-a163f300868c req-7209994f-d8a3-48d8-be8c-29cfe9d2d9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad75e25e-2e56-44e4-9dff-202aac8cb52c", "name": "network-vif-plugged", "status": "completed", "tag": "b8d8a612-2537-479e-98f4-6b70094a8512"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:15.412358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28eab05e-f202-4d23-8f9c-a163f300868c req-7209994f-d8a3-48d8-be8c-29cfe9d2d9a2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:15.413185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28eab05e-f202-4d23-8f9c-a163f300868c req-7209994f-d8a3-48d8-be8c-29cfe9d2d9a2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:15.414073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28eab05e-f202-4d23-8f9c-a163f300868c req-7209994f-d8a3-48d8-be8c-29cfe9d2d9a2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:15.441150 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-28eab05e-f202-4d23-8f9c-a163f300868c req-7209994f-d8a3-48d8-be8c-29cfe9d2d9a2 service nova] Creating event network-vif-plugged:b8d8a612-2537-479e-98f4-6b70094a8512 for instance ad75e25e-2e56-44e4-9dff-202aac8cb52c on n-h1-845781-6 Aug 09 17:22:15.452468 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-28eab05e-f202-4d23-8f9c-a163f300868c req-7209994f-d8a3-48d8-be8c-29cfe9d2d9a2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083147 Aug 09 17:22:15.454834 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1549/2978] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:16.192063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5273a017-e937-4bf9-ac51-a4614c96ef31 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:16.203155 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5273a017-e937-4bf9-ac51-a4614c96ef31 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1521 microversion: 2.1 time: 1.392615 Aug 09 17:22:16.206656 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1430/2979] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:14 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1521 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:16.387255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b1889bac-4aba-467d-8e1a-6f70c6005ed2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:16.393262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b1889bac-4aba-467d-8e1a-6f70c6005ed2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:16.418089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1889bac-4aba-467d-8e1a-6f70c6005ed2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:16.419527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1889bac-4aba-467d-8e1a-6f70c6005ed2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:16.420761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1889bac-4aba-467d-8e1a-6f70c6005ed2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:16.422528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1889bac-4aba-467d-8e1a-6f70c6005ed2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:16.423775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1889bac-4aba-467d-8e1a-6f70c6005ed2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:16.424868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1889bac-4aba-467d-8e1a-6f70c6005ed2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:17.080508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b1889bac-4aba-467d-8e1a-6f70c6005ed2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:17.120696 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b1889bac-4aba-467d-8e1a-6f70c6005ed2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1315 microversion: 2.1 time: 0.740240 Aug 09 17:22:17.154519 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1550/2980] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:16 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:17.250424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-82ee50ba-dc9b-4451-b285-15a8dff92311 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:17.251354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-82ee50ba-dc9b-4451-b285-15a8dff92311 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:17.267966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82ee50ba-dc9b-4451-b285-15a8dff92311 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:17.268761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82ee50ba-dc9b-4451-b285-15a8dff92311 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:17.269368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82ee50ba-dc9b-4451-b285-15a8dff92311 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:17.270301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82ee50ba-dc9b-4451-b285-15a8dff92311 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:17.270931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82ee50ba-dc9b-4451-b285-15a8dff92311 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:17.271527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82ee50ba-dc9b-4451-b285-15a8dff92311 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:18.164440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2fa73527-d16a-4a36-b204-f7fee7b1993e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:18.165599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2fa73527-d16a-4a36-b204-f7fee7b1993e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:18.187952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=16 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:18.225931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=26 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:18.231083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fa73527-d16a-4a36-b204-f7fee7b1993e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:18.232059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fa73527-d16a-4a36-b204-f7fee7b1993e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:18.233959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fa73527-d16a-4a36-b204-f7fee7b1993e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:18.239950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fa73527-d16a-4a36-b204-f7fee7b1993e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:18.244411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fa73527-d16a-4a36-b204-f7fee7b1993e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:18.248623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fa73527-d16a-4a36-b204-f7fee7b1993e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:19.190534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-82ee50ba-dc9b-4451-b285-15a8dff92311 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:19.239788 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-82ee50ba-dc9b-4451-b285-15a8dff92311 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1521 microversion: 2.1 time: 1.993435 Aug 09 17:22:19.241280 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1431/2981] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:17 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1521 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:19.542311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2fa73527-d16a-4a36-b204-f7fee7b1993e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:19.565350 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2fa73527-d16a-4a36-b204-f7fee7b1993e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1465 microversion: 2.1 time: 1.409593 Aug 09 17:22:19.567101 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1551/2982] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:18 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1465 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:19.617689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8611a833-4466-4eb3-8d84-2c6debb5bc0d tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:19.630860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8611a833-4466-4eb3-8d84-2c6debb5bc0d tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:19.670447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=16 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:19.676316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8611a833-4466-4eb3-8d84-2c6debb5bc0d tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:19.690040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8611a833-4466-4eb3-8d84-2c6debb5bc0d tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:19.690987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8611a833-4466-4eb3-8d84-2c6debb5bc0d tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:19.696093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8611a833-4466-4eb3-8d84-2c6debb5bc0d tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:19.697197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8611a833-4466-4eb3-8d84-2c6debb5bc0d tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:19.697197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8611a833-4466-4eb3-8d84-2c6debb5bc0d tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:20.284411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9bdb7b89-e978-4acf-897e-9e0c53dc2e10 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:20.285558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9bdb7b89-e978-4acf-897e-9e0c53dc2e10 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:20.326754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b89-e978-4acf-897e-9e0c53dc2e10 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:20.327809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b89-e978-4acf-897e-9e0c53dc2e10 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:20.328602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b89-e978-4acf-897e-9e0c53dc2e10 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:20.329952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b89-e978-4acf-897e-9e0c53dc2e10 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:20.338385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b89-e978-4acf-897e-9e0c53dc2e10 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:20.338706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bdb7b89-e978-4acf-897e-9e0c53dc2e10 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:21.006021 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8611a833-4466-4eb3-8d84-2c6debb5bc0d tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1616 microversion: 2.1 time: 1.417861 Aug 09 17:22:21.007502 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1432/2983] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:19 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1616 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:21.322664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2057890547", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["904e2d62-61c5-4c4e-9acd-6948e6a21477"]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:21.337216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9bdb7b89-e978-4acf-897e-9e0c53dc2e10 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:21.346070 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9bdb7b89-e978-4acf-897e-9e0c53dc2e10 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1498 microversion: 2.1 time: 1.071417 Aug 09 17:22:21.346702 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1552/2984] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:20 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1498 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:22:21.385531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-047f003b-878d-4811-8bfe-058af878f21d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:21.396186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-047f003b-878d-4811-8bfe-058af878f21d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:21.408437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-047f003b-878d-4811-8bfe-058af878f21d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:21.423954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f003b-878d-4811-8bfe-058af878f21d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:21.454036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:22:21.454282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f003b-878d-4811-8bfe-058af878f21d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:21.455075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f003b-878d-4811-8bfe-058af878f21d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:21.456145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f003b-878d-4811-8bfe-058af878f21d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:21.458536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f003b-878d-4811-8bfe-058af878f21d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:21.459291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047f003b-878d-4811-8bfe-058af878f21d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:21.517162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-047f003b-878d-4811-8bfe-058af878f21d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:21.589913 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-047f003b-878d-4811-8bfe-058af878f21d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.208219 Aug 09 17:22:21.591403 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1553/2985] 10.222.0.93 () {58 vars in 1154 bytes} [Tue Aug 9 17:22:21 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:21.612928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4228933f-ba7a-495a-afe8-af6bb1822612 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:21.620903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4228933f-ba7a-495a-afe8-af6bb1822612 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:21.621543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4228933f-ba7a-495a-afe8-af6bb1822612 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:21.622101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4228933f-ba7a-495a-afe8-af6bb1822612 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:21.665822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4228933f-ba7a-495a-afe8-af6bb1822612 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Going to try to start instance {{(pid=119431) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 17:22:21.739306 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4228933f-ba7a-495a-afe8-af6bb1822612 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "POST /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195/action" status: 202 len: 0 microversion: 2.1 time: 0.131435 Aug 09 17:22:21.741409 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1554/2986] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:22:21 2022] POST /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:22:21.771892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-899723f2-a575-4370-8fd5-56a3efe7ef0d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:21.775701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-899723f2-a575-4370-8fd5-56a3efe7ef0d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:21.802174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899723f2-a575-4370-8fd5-56a3efe7ef0d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:21.802680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899723f2-a575-4370-8fd5-56a3efe7ef0d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:21.808455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899723f2-a575-4370-8fd5-56a3efe7ef0d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:21.809877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899723f2-a575-4370-8fd5-56a3efe7ef0d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:21.810563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899723f2-a575-4370-8fd5-56a3efe7ef0d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:21.811975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899723f2-a575-4370-8fd5-56a3efe7ef0d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:22.842632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:22:22.843756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:22:22.844798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:22:22.846584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:22:22.847568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:22:22.891463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:22.892297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:22.894504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:22.902049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:22.902719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:22.903293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:22.942847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:22:22.960895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:22:23.002977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:22:23.007210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:22:23.113760 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a3046d7a-9a56-4329-9cb1-6f1689389938 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.799487 Aug 09 17:22:23.115198 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1433/2987] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:22:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:22:23.135511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e283f9ca-6904-4250-af6a-3f676e6203ee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:23.137264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e283f9ca-6904-4250-af6a-3f676e6203ee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:23.577976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e283f9ca-6904-4250-af6a-3f676e6203ee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:23.602932 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e283f9ca-6904-4250-af6a-3f676e6203ee tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1217 microversion: 2.1 time: 0.474544 Aug 09 17:22:23.612220 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1434/2988] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:23 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1217 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:23.799133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-899723f2-a575-4370-8fd5-56a3efe7ef0d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:23.843767 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-899723f2-a575-4370-8fd5-56a3efe7ef0d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1507 microversion: 2.1 time: 2.092116 Aug 09 17:22:23.848105 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1555/2989] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:21 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1507 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:24.674078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-41cdd6f7-6f3f-4323-b81b-90f7cf0aec8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:24.683276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-41cdd6f7-6f3f-4323-b81b-90f7cf0aec8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:24.742673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cdd6f7-6f3f-4323-b81b-90f7cf0aec8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:24.748715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cdd6f7-6f3f-4323-b81b-90f7cf0aec8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:24.749690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cdd6f7-6f3f-4323-b81b-90f7cf0aec8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:24.750639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cdd6f7-6f3f-4323-b81b-90f7cf0aec8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:24.752499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cdd6f7-6f3f-4323-b81b-90f7cf0aec8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:24.757569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41cdd6f7-6f3f-4323-b81b-90f7cf0aec8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:24.770450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:24.901048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8a8655e4-2100-4f3f-838b-87d7093418ad tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:24.907207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8a8655e4-2100-4f3f-838b-87d7093418ad tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:24.944834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a8655e4-2100-4f3f-838b-87d7093418ad tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:24.945643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a8655e4-2100-4f3f-838b-87d7093418ad tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:24.947850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a8655e4-2100-4f3f-838b-87d7093418ad tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:24.951352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a8655e4-2100-4f3f-838b-87d7093418ad tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:24.953356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a8655e4-2100-4f3f-838b-87d7093418ad tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:24.954582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a8655e4-2100-4f3f-838b-87d7093418ad tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:24.994742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-41cdd6f7-6f3f-4323-b81b-90f7cf0aec8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:25.037883 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-41cdd6f7-6f3f-4323-b81b-90f7cf0aec8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1221 microversion: 2.1 time: 0.396053 Aug 09 17:22:25.043161 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1435/2990] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:24 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1221 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:26.086443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c9cf13b5-debd-481f-bfdf-9ecffa7369a6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:26.087231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c9cf13b5-debd-481f-bfdf-9ecffa7369a6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:26.102993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9cf13b5-debd-481f-bfdf-9ecffa7369a6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:26.103671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9cf13b5-debd-481f-bfdf-9ecffa7369a6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:26.104191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9cf13b5-debd-481f-bfdf-9ecffa7369a6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:26.106421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9cf13b5-debd-481f-bfdf-9ecffa7369a6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:26.107247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9cf13b5-debd-481f-bfdf-9ecffa7369a6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:26.107910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9cf13b5-debd-481f-bfdf-9ecffa7369a6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:26.765586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c9cf13b5-debd-481f-bfdf-9ecffa7369a6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:26.797875 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c9cf13b5-debd-481f-bfdf-9ecffa7369a6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1277 microversion: 2.1 time: 0.717137 Aug 09 17:22:26.800145 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1436/2991] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:26 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1277 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:26.925503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8a8655e4-2100-4f3f-838b-87d7093418ad tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:26.954772 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8a8655e4-2100-4f3f-838b-87d7093418ad tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1507 microversion: 2.1 time: 2.065665 Aug 09 17:22:26.955933 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1556/2992] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:24 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1507 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:27.491291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1237616021", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:27.609986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] validate_networks() for [('f872dee3-4b84-411f-bcd4-a71f8b363ac6', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:22:27.840006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f11433a7-83e1-4b76-89d2-03e73cdaad59 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:27.840960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f11433a7-83e1-4b76-89d2-03e73cdaad59 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:27.848254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f11433a7-83e1-4b76-89d2-03e73cdaad59 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:27.849039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f11433a7-83e1-4b76-89d2-03e73cdaad59 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:27.849640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f11433a7-83e1-4b76-89d2-03e73cdaad59 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:27.850531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f11433a7-83e1-4b76-89d2-03e73cdaad59 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:27.851172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f11433a7-83e1-4b76-89d2-03e73cdaad59 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:27.851820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f11433a7-83e1-4b76-89d2-03e73cdaad59 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:28.389197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f11433a7-83e1-4b76-89d2-03e73cdaad59 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:28.422488 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f11433a7-83e1-4b76-89d2-03e73cdaad59 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1275 microversion: 2.1 time: 0.585244 Aug 09 17:22:28.434263 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1557/2993] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:27 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1275 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:28.463930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e85aa51-3cfb-4c38-9297-00664f7b8a6f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:28.466745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8e85aa51-3cfb-4c38-9297-00664f7b8a6f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:28.494166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e85aa51-3cfb-4c38-9297-00664f7b8a6f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:28.495411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e85aa51-3cfb-4c38-9297-00664f7b8a6f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:28.499857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e85aa51-3cfb-4c38-9297-00664f7b8a6f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:28.501860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e85aa51-3cfb-4c38-9297-00664f7b8a6f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:28.504450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e85aa51-3cfb-4c38-9297-00664f7b8a6f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:28.507081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e85aa51-3cfb-4c38-9297-00664f7b8a6f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:29.146290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8e85aa51-3cfb-4c38-9297-00664f7b8a6f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:29.166640 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e85aa51-3cfb-4c38-9297-00664f7b8a6f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1511 microversion: 2.1 time: 0.720056 Aug 09 17:22:29.168465 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1558/2994] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:28 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1511 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:29.214154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a3d3096c-c750-4214-9ec5-fd28ab01af13 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:29.230746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a3d3096c-c750-4214-9ec5-fd28ab01af13 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:29.237560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.compute.servers [None req-a3d3096c-c750-4214-9ec5-fd28ab01af13 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Removing options 'limit' from query {{(pid=119431) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 09 17:22:29.246302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a3d3096c-c750-4214-9ec5-fd28ab01af13 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:29.249753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3d3096c-c750-4214-9ec5-fd28ab01af13 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:29.250996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3d3096c-c750-4214-9ec5-fd28ab01af13 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:29.253393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3d3096c-c750-4214-9ec5-fd28ab01af13 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:29.254719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3d3096c-c750-4214-9ec5-fd28ab01af13 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:29.255521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3d3096c-c750-4214-9ec5-fd28ab01af13 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:29.256399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3d3096c-c750-4214-9ec5-fd28ab01af13 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:29.258836 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a3d3096c-c750-4214-9ec5-fd28ab01af13 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.054506 Aug 09 17:22:29.260212 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1559/2995] 10.222.0.93 () {58 vars in 1140 bytes} [Tue Aug 9 17:22:29 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:22:29.287018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-545b09c1-f698-4c9d-9bf6-7e8d3f0cdcc6 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:29.288414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-545b09c1-f698-4c9d-9bf6-7e8d3f0cdcc6 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:29.301896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-545b09c1-f698-4c9d-9bf6-7e8d3f0cdcc6 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:29.302787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-545b09c1-f698-4c9d-9bf6-7e8d3f0cdcc6 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:29.304589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-545b09c1-f698-4c9d-9bf6-7e8d3f0cdcc6 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:29.308023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-545b09c1-f698-4c9d-9bf6-7e8d3f0cdcc6 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:29.309344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-545b09c1-f698-4c9d-9bf6-7e8d3f0cdcc6 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:29.310178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-545b09c1-f698-4c9d-9bf6-7e8d3f0cdcc6 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:29.646621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:22:29.647377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:22:29.647690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:22:29.649924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:22:29.650722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:22:29.671369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:29.672145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:29.672678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:29.674714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:29.675213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:29.680810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:29.734105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Getting quotas for project 1d20bf24928749afb9b848946419f4f6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:22:29.752935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Getting quotas for user a34881c81ae2427fbf2cbb1cd8c4ef52 and project 1d20bf24928749afb9b848946419f4f6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:22:29.801798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:22:29.811026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:22:29.977547 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fbdf5d36-e3be-4585-8fe7-095004ba3850 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.678221 Aug 09 17:22:29.979999 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1437/2996] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:22:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:22:29.999060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8b621c32-d0b3-4da4-8c10-79abea222684 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:30.000887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8b621c32-d0b3-4da4-8c10-79abea222684 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:30.027311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b621c32-d0b3-4da4-8c10-79abea222684 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:30.031769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b621c32-d0b3-4da4-8c10-79abea222684 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:30.033482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b621c32-d0b3-4da4-8c10-79abea222684 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:30.037873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b621c32-d0b3-4da4-8c10-79abea222684 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:30.039395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b621c32-d0b3-4da4-8c10-79abea222684 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:30.040960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b621c32-d0b3-4da4-8c10-79abea222684 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:30.446791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8b621c32-d0b3-4da4-8c10-79abea222684 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:30.469535 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8b621c32-d0b3-4da4-8c10-79abea222684 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1275 microversion: 2.1 time: 0.478381 Aug 09 17:22:30.471819 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1438/2997] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:29 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1275 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:30.492755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fd3e42fc-33d1-49e1-a71e-bea389751022 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:30.493716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fd3e42fc-33d1-49e1-a71e-bea389751022 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:30.876545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fd3e42fc-33d1-49e1-a71e-bea389751022 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:30.910675 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fd3e42fc-33d1-49e1-a71e-bea389751022 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1222 microversion: 2.1 time: 0.430617 Aug 09 17:22:30.913624 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1439/2998] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:30 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1222 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:31.087057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1209430973", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:31.276568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] validate_networks() for [('f872dee3-4b84-411f-bcd4-a71f8b363ac6', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:22:31.479584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:31.649771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-545b09c1-f698-4c9d-9bf6-7e8d3f0cdcc6 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:31.690233 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-545b09c1-f698-4c9d-9bf6-7e8d3f0cdcc6 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1511 microversion: 2.1 time: 2.415818 Aug 09 17:22:31.691507 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1560/2999] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:29 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1511 bytes in 2419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:31.701370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5b69f39b-94fe-452a-a54e-11b00de7eeb3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:31.709332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5b69f39b-94fe-452a-a54e-11b00de7eeb3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:31.740793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b69f39b-94fe-452a-a54e-11b00de7eeb3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:31.742188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b69f39b-94fe-452a-a54e-11b00de7eeb3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:31.743321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b69f39b-94fe-452a-a54e-11b00de7eeb3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:31.747998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b69f39b-94fe-452a-a54e-11b00de7eeb3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:31.752202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b69f39b-94fe-452a-a54e-11b00de7eeb3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:31.753403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b69f39b-94fe-452a-a54e-11b00de7eeb3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:32.286647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5b69f39b-94fe-452a-a54e-11b00de7eeb3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:32.336377 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5b69f39b-94fe-452a-a54e-11b00de7eeb3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1275 microversion: 2.1 time: 0.641261 Aug 09 17:22:32.340454 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1561/3000] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:31 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1275 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:32.365028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e5d34a03-e14e-4f87-b5da-a614b470ef77 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:32.366247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e5d34a03-e14e-4f87-b5da-a614b470ef77 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 74cc072b-21ba-4456-8e16-2390ad0b0c44] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:32.405674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d34a03-e14e-4f87-b5da-a614b470ef77 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:32.406287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d34a03-e14e-4f87-b5da-a614b470ef77 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:32.408128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d34a03-e14e-4f87-b5da-a614b470ef77 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:32.409932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d34a03-e14e-4f87-b5da-a614b470ef77 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:32.411034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d34a03-e14e-4f87-b5da-a614b470ef77 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:32.411487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d34a03-e14e-4f87-b5da-a614b470ef77 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:33.066031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e5d34a03-e14e-4f87-b5da-a614b470ef77 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:33.076264 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e5d34a03-e14e-4f87-b5da-a614b470ef77 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44" status: 200 len: 1512 microversion: 2.1 time: 0.734222 Aug 09 17:22:33.088654 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1562/3001] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:32 2022] GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44 => generated 1512 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:33.128438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a84cc2df-e1b4-4e14-b1aa-a6ea547506cb tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:33.129360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a84cc2df-e1b4-4e14-b1aa-a6ea547506cb tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:33.140622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a84cc2df-e1b4-4e14-b1aa-a6ea547506cb tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:33.141604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a84cc2df-e1b4-4e14-b1aa-a6ea547506cb tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:33.149177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a84cc2df-e1b4-4e14-b1aa-a6ea547506cb tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:33.150866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a84cc2df-e1b4-4e14-b1aa-a6ea547506cb tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:33.152006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a84cc2df-e1b4-4e14-b1aa-a6ea547506cb tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:33.152917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a84cc2df-e1b4-4e14-b1aa-a6ea547506cb tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:33.901006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a84cc2df-e1b4-4e14-b1aa-a6ea547506cb tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:33.917487 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a84cc2df-e1b4-4e14-b1aa-a6ea547506cb tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1512 microversion: 2.1 time: 0.793161 Aug 09 17:22:33.935079 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1563/3002] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:33 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1512 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:33.962399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-53b03a8b-e12b-4789-acaf-c79649e36456 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:33.964460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-53b03a8b-e12b-4789-acaf-c79649e36456 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:33.980180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53b03a8b-e12b-4789-acaf-c79649e36456 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:33.981513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53b03a8b-e12b-4789-acaf-c79649e36456 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:33.982493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53b03a8b-e12b-4789-acaf-c79649e36456 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:33.985387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53b03a8b-e12b-4789-acaf-c79649e36456 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:33.986785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53b03a8b-e12b-4789-acaf-c79649e36456 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:33.988908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53b03a8b-e12b-4789-acaf-c79649e36456 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:34.044659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:34.774282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:22:34.774863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:22:34.775472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:22:34.776864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:22:34.777569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:22:34.792517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:34.793572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:34.794715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:34.804738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:34.806512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:34.807265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:34.847190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Getting quotas for project 1d20bf24928749afb9b848946419f4f6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:22:34.867352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Getting quotas for user a34881c81ae2427fbf2cbb1cd8c4ef52 and project 1d20bf24928749afb9b848946419f4f6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:22:34.942706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:22:34.953206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:22:35.093820 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-594dea60-9a4c-4d57-a79d-4495880a1ad1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.038192 Aug 09 17:22:35.095450 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1440/3003] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:22:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 4041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:22:35.116480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87d7320e-52de-4ee3-8674-25acf8c226d8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:35.131835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-87d7320e-52de-4ee3-8674-25acf8c226d8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:35.133022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-87d7320e-52de-4ee3-8674-25acf8c226d8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:35.678561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87d7320e-52de-4ee3-8674-25acf8c226d8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:35.680108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87d7320e-52de-4ee3-8674-25acf8c226d8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:35.681309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87d7320e-52de-4ee3-8674-25acf8c226d8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:35.683473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87d7320e-52de-4ee3-8674-25acf8c226d8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:35.684788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87d7320e-52de-4ee3-8674-25acf8c226d8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:35.686092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87d7320e-52de-4ee3-8674-25acf8c226d8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:36.194704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-87d7320e-52de-4ee3-8674-25acf8c226d8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:36.354785 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-87d7320e-52de-4ee3-8674-25acf8c226d8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 1.256160 Aug 09 17:22:36.356135 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1441/3004] 10.222.0.93 () {58 vars in 1154 bytes} [Tue Aug 9 17:22:35 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:36.363324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9cd8578b-ef57-4432-a0e0-a891afd1b583 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:36.364919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9cd8578b-ef57-4432-a0e0-a891afd1b583 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:36.388219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:36.595468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9cd8578b-ef57-4432-a0e0-a891afd1b583 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:36.599851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-53b03a8b-e12b-4789-acaf-c79649e36456 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:36.618630 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9cd8578b-ef57-4432-a0e0-a891afd1b583 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1222 microversion: 2.1 time: 0.260932 Aug 09 17:22:36.622307 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1442/3005] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:36 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1222 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:36.634992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-db07f4dc-514a-43ec-ab36-16d5f02d2c5e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:36.640331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-db07f4dc-514a-43ec-ab36-16d5f02d2c5e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:36.649482 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-53b03a8b-e12b-4789-acaf-c79649e36456 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1317 microversion: 2.1 time: 2.698944 Aug 09 17:22:36.653874 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1564/3006] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:33 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1317 bytes in 2718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:36.688016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db07f4dc-514a-43ec-ab36-16d5f02d2c5e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:36.688016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db07f4dc-514a-43ec-ab36-16d5f02d2c5e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:36.688016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db07f4dc-514a-43ec-ab36-16d5f02d2c5e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:36.688016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db07f4dc-514a-43ec-ab36-16d5f02d2c5e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:36.692160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db07f4dc-514a-43ec-ab36-16d5f02d2c5e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:36.693302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db07f4dc-514a-43ec-ab36-16d5f02d2c5e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:37.502303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d256054b-bb1c-4655-96eb-c32aa5a7212e tempest-AbsoluteLimitsTestJSON-668035494 tempest-AbsoluteLimitsTestJSON-668035494-project] Calling method '.version_select at 0x7fbbcb68ea60>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:37.522685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d256054b-bb1c-4655-96eb-c32aa5a7212e tempest-AbsoluteLimitsTestJSON-668035494 tempest-AbsoluteLimitsTestJSON-668035494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:37.523645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d256054b-bb1c-4655-96eb-c32aa5a7212e tempest-AbsoluteLimitsTestJSON-668035494 tempest-AbsoluteLimitsTestJSON-668035494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:37.524538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d256054b-bb1c-4655-96eb-c32aa5a7212e tempest-AbsoluteLimitsTestJSON-668035494 tempest-AbsoluteLimitsTestJSON-668035494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:37.525759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d256054b-bb1c-4655-96eb-c32aa5a7212e tempest-AbsoluteLimitsTestJSON-668035494 tempest-AbsoluteLimitsTestJSON-668035494-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:37.527189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d256054b-bb1c-4655-96eb-c32aa5a7212e tempest-AbsoluteLimitsTestJSON-668035494 tempest-AbsoluteLimitsTestJSON-668035494-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:37.528140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d256054b-bb1c-4655-96eb-c32aa5a7212e tempest-AbsoluteLimitsTestJSON-668035494 tempest-AbsoluteLimitsTestJSON-668035494-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:37.564560 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d256054b-bb1c-4655-96eb-c32aa5a7212e tempest-AbsoluteLimitsTestJSON-668035494 tempest-AbsoluteLimitsTestJSON-668035494-project] 10.222.0.93 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.457117 Aug 09 17:22:37.565997 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1565/3007] 10.222.0.93 () {58 vars in 1122 bytes} [Tue Aug 9 17:22:37 2022] GET /compute/v2.1/limits => generated 511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:37.650355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7a978488-aa64-4399-9bd7-6bbad433864d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:37.651395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7a978488-aa64-4399-9bd7-6bbad433864d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:37.663845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a978488-aa64-4399-9bd7-6bbad433864d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:37.670197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a978488-aa64-4399-9bd7-6bbad433864d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:37.670872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a978488-aa64-4399-9bd7-6bbad433864d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:37.672922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a978488-aa64-4399-9bd7-6bbad433864d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:37.675993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a978488-aa64-4399-9bd7-6bbad433864d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:37.676580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a978488-aa64-4399-9bd7-6bbad433864d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:37.824943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-db07f4dc-514a-43ec-ab36-16d5f02d2c5e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:37.836928 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-db07f4dc-514a-43ec-ab36-16d5f02d2c5e tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1511 microversion: 2.1 time: 1.210814 Aug 09 17:22:37.847677 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1443/3008] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:36 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1511 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:37.853993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0eb9a38c-7917-4bc5-9f0e-ffce931b6788 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:37.854970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0eb9a38c-7917-4bc5-9f0e-ffce931b6788 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:37.876638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0eb9a38c-7917-4bc5-9f0e-ffce931b6788 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:37.878617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0eb9a38c-7917-4bc5-9f0e-ffce931b6788 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:37.879313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0eb9a38c-7917-4bc5-9f0e-ffce931b6788 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:37.881027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0eb9a38c-7917-4bc5-9f0e-ffce931b6788 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:37.881783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0eb9a38c-7917-4bc5-9f0e-ffce931b6788 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:37.882441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0eb9a38c-7917-4bc5-9f0e-ffce931b6788 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:38.194749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7a978488-aa64-4399-9bd7-6bbad433864d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:38.216602 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7a978488-aa64-4399-9bd7-6bbad433864d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1282 microversion: 2.1 time: 0.568987 Aug 09 17:22:38.218112 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1566/3009] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:37 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1282 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:22:38.229518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e1c0603-c127-4154-8c8c-08b5f334dd88 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:38.246208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e1c0603-c127-4154-8c8c-08b5f334dd88 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 74cc072b-21ba-4456-8e16-2390ad0b0c44] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:38.269888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e1c0603-c127-4154-8c8c-08b5f334dd88 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:38.271460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e1c0603-c127-4154-8c8c-08b5f334dd88 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:38.279840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e1c0603-c127-4154-8c8c-08b5f334dd88 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:38.282956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e1c0603-c127-4154-8c8c-08b5f334dd88 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:38.283889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e1c0603-c127-4154-8c8c-08b5f334dd88 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:38.286426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e1c0603-c127-4154-8c8c-08b5f334dd88 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:39.130909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0eb9a38c-7917-4bc5-9f0e-ffce931b6788 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:39.147441 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0eb9a38c-7917-4bc5-9f0e-ffce931b6788 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1317 microversion: 2.1 time: 1.297657 Aug 09 17:22:39.160238 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1444/3010] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:37 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1317 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:39.265542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3b073ba1-04d8-4d85-96e1-fe5bf7f56ecd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:39.270220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3b073ba1-04d8-4d85-96e1-fe5bf7f56ecd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:39.287860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b073ba1-04d8-4d85-96e1-fe5bf7f56ecd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:39.290009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b073ba1-04d8-4d85-96e1-fe5bf7f56ecd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:39.298139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b073ba1-04d8-4d85-96e1-fe5bf7f56ecd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:39.299753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b073ba1-04d8-4d85-96e1-fe5bf7f56ecd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:39.300990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b073ba1-04d8-4d85-96e1-fe5bf7f56ecd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:39.301783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b073ba1-04d8-4d85-96e1-fe5bf7f56ecd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:39.428334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e1c0603-c127-4154-8c8c-08b5f334dd88 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:39.454175 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e1c0603-c127-4154-8c8c-08b5f334dd88 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44" status: 200 len: 1512 microversion: 2.1 time: 1.231623 Aug 09 17:22:39.456364 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1567/3011] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:38 2022] GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44 => generated 1512 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:39.496159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ba006120-9e46-4b6b-aba9-0ffbf6727c26 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:39.497855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba006120-9e46-4b6b-aba9-0ffbf6727c26 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:39.512284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba006120-9e46-4b6b-aba9-0ffbf6727c26 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:39.513677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba006120-9e46-4b6b-aba9-0ffbf6727c26 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:39.515783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba006120-9e46-4b6b-aba9-0ffbf6727c26 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:39.518376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba006120-9e46-4b6b-aba9-0ffbf6727c26 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:39.519945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba006120-9e46-4b6b-aba9-0ffbf6727c26 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:39.521741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba006120-9e46-4b6b-aba9-0ffbf6727c26 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:39.644095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3b073ba1-04d8-4d85-96e1-fe5bf7f56ecd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:39.660046 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3b073ba1-04d8-4d85-96e1-fe5bf7f56ecd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1280 microversion: 2.1 time: 0.403552 Aug 09 17:22:39.672408 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1445/3012] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:39 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1280 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:22:40.190184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7b8c8277-31b7-4c08-9a78-ea4a6004788e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:40.191547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7b8c8277-31b7-4c08-9a78-ea4a6004788e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:40.228378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b8c8277-31b7-4c08-9a78-ea4a6004788e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:40.231015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b8c8277-31b7-4c08-9a78-ea4a6004788e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:40.249777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b8c8277-31b7-4c08-9a78-ea4a6004788e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:40.251852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b8c8277-31b7-4c08-9a78-ea4a6004788e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:40.253568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b8c8277-31b7-4c08-9a78-ea4a6004788e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:40.257584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b8c8277-31b7-4c08-9a78-ea4a6004788e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:40.428161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ba006120-9e46-4b6b-aba9-0ffbf6727c26 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:40.445892 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ba006120-9e46-4b6b-aba9-0ffbf6727c26 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1512 microversion: 2.1 time: 0.957356 Aug 09 17:22:40.462837 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1568/3013] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:39 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1512 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:22:40.503140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:40.514195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:40.516810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:40.527793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:40.529781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:40.531451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:40.534372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:40.537284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:40.538641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:40.613773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:40.730170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:40.751037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:40.752858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:40.754315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:41.102346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7b8c8277-31b7-4c08-9a78-ea4a6004788e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:41.121625 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7b8c8277-31b7-4c08-9a78-ea4a6004788e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1317 microversion: 2.1 time: 0.942156 Aug 09 17:22:41.123470 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1446/3014] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:40 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1317 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:22:41.144041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f50937ef-7ffa-4d4d-8ac2-85b14427fe14 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:41.145176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f50937ef-7ffa-4d4d-8ac2-85b14427fe14 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:41.152504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f50937ef-7ffa-4d4d-8ac2-85b14427fe14 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:41.153653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f50937ef-7ffa-4d4d-8ac2-85b14427fe14 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:41.154543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f50937ef-7ffa-4d4d-8ac2-85b14427fe14 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:41.155739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f50937ef-7ffa-4d4d-8ac2-85b14427fe14 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:41.156522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f50937ef-7ffa-4d4d-8ac2-85b14427fe14 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:41.157182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f50937ef-7ffa-4d4d-8ac2-85b14427fe14 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:41.412436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f50937ef-7ffa-4d4d-8ac2-85b14427fe14 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:41.437312 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f50937ef-7ffa-4d4d-8ac2-85b14427fe14 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1280 microversion: 2.1 time: 0.298298 Aug 09 17:22:41.438580 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1447/3015] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:41 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1280 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:41.533708 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0a0b0036-d4ae-4f1b-b7e1-490b5cefe590 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 1.037884 Aug 09 17:22:41.535398 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1569/3016] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:22:40 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:22:41.594891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a45a437-77b8-4f30-a196-55562111ebb1 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:41.631831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a45a437-77b8-4f30-a196-55562111ebb1 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:41.635682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3a45a437-77b8-4f30-a196-55562111ebb1 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:41.983753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a45a437-77b8-4f30-a196-55562111ebb1 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:41.985343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a45a437-77b8-4f30-a196-55562111ebb1 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:41.987099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a45a437-77b8-4f30-a196-55562111ebb1 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:41.991371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a45a437-77b8-4f30-a196-55562111ebb1 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:41.992780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a45a437-77b8-4f30-a196-55562111ebb1 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:41.995761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a45a437-77b8-4f30-a196-55562111ebb1 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:42.170500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99380a90-868b-4504-aed9-7a71555075c4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:42.175004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99380a90-868b-4504-aed9-7a71555075c4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:42.219277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99380a90-868b-4504-aed9-7a71555075c4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:42.219952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-3a45a437-77b8-4f30-a196-55562111ebb1 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:42.223050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99380a90-868b-4504-aed9-7a71555075c4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:42.223935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99380a90-868b-4504-aed9-7a71555075c4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:42.225260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99380a90-868b-4504-aed9-7a71555075c4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:42.226077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99380a90-868b-4504-aed9-7a71555075c4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:42.234483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99380a90-868b-4504-aed9-7a71555075c4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:42.374879 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3a45a437-77b8-4f30-a196-55562111ebb1 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.805592 Aug 09 17:22:42.376491 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1448/3017] 10.222.0.93 () {58 vars in 1150 bytes} [Tue Aug 9 17:22:41 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:42.410843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4485fd0d-cf68-4a66-8989-dc90f4b336a2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:42.437576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4485fd0d-cf68-4a66-8989-dc90f4b336a2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:42.443232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4485fd0d-cf68-4a66-8989-dc90f4b336a2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:42.487401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4485fd0d-cf68-4a66-8989-dc90f4b336a2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:42.489135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4485fd0d-cf68-4a66-8989-dc90f4b336a2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:42.490415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4485fd0d-cf68-4a66-8989-dc90f4b336a2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:42.502643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4485fd0d-cf68-4a66-8989-dc90f4b336a2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:42.505416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4485fd0d-cf68-4a66-8989-dc90f4b336a2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:42.507104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4485fd0d-cf68-4a66-8989-dc90f4b336a2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:42.809635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-4485fd0d-cf68-4a66-8989-dc90f4b336a2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:42.960751 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4485fd0d-cf68-4a66-8989-dc90f4b336a2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.564615 Aug 09 17:22:42.963072 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1449/3018] 10.222.0.93 () {58 vars in 1212 bytes} [Tue Aug 9 17:22:42 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:42.969721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-837fd042-43cd-485f-adff-366f9ded4a73 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:42.970868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-837fd042-43cd-485f-adff-366f9ded4a73 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:42.981397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-837fd042-43cd-485f-adff-366f9ded4a73 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:42.983063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-837fd042-43cd-485f-adff-366f9ded4a73 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:42.983970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-837fd042-43cd-485f-adff-366f9ded4a73 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:42.986615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-837fd042-43cd-485f-adff-366f9ded4a73 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:42.987746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-837fd042-43cd-485f-adff-366f9ded4a73 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:42.988986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-837fd042-43cd-485f-adff-366f9ded4a73 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:43.437644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-837fd042-43cd-485f-adff-366f9ded4a73 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:43.489935 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-837fd042-43cd-485f-adff-366f9ded4a73 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1280 microversion: 2.1 time: 0.518476 Aug 09 17:22:43.495204 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1450/3019] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:42 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1280 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:43.536760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-9a4527f3-cdfe-40a0-8f01-5ac915d09e8e req-a3511729-ce7e-402f-85e9-d9372a509fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d3b3bf1-f13b-440c-9db0-14b0e7d57055", "tag": "45ae12ab-8288-46ce-825f-c64eab2678ae"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:43.562768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99380a90-868b-4504-aed9-7a71555075c4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:43.651184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9a4527f3-cdfe-40a0-8f01-5ac915d09e8e req-a3511729-ce7e-402f-85e9-d9372a509fd4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:43.652299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9a4527f3-cdfe-40a0-8f01-5ac915d09e8e req-a3511729-ce7e-402f-85e9-d9372a509fd4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:43.653124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9a4527f3-cdfe-40a0-8f01-5ac915d09e8e req-a3511729-ce7e-402f-85e9-d9372a509fd4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:43.655679 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99380a90-868b-4504-aed9-7a71555075c4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1317 microversion: 2.1 time: 1.507287 Aug 09 17:22:43.665168 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1570/3020] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:42 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1317 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:43.685287 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-9a4527f3-cdfe-40a0-8f01-5ac915d09e8e req-a3511729-ce7e-402f-85e9-d9372a509fd4 service nova] Creating event network-changed:45ae12ab-8288-46ce-825f-c64eab2678ae for instance 7d3b3bf1-f13b-440c-9db0-14b0e7d57055 on n-h1-845781-6 Aug 09 17:22:43.692647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-31ee678f-aa5a-4985-8fa7-3d25a8bef4d2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:43.693596 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-9a4527f3-cdfe-40a0-8f01-5ac915d09e8e req-a3511729-ce7e-402f-85e9-d9372a509fd4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188449 Aug 09 17:22:43.694567 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1451/3021] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:43.703240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-b279bb7a-b658-4fe4-b011-32387c807a25 req-8dd80514-8a67-46f3-ba6f-ff092b961045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d19cd5ee-f610-4a5a-9983-e233f32596f1", "tag": "e0c82029-fc49-4dc8-bc60-ce44cb5efe54"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:43.720497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b279bb7a-b658-4fe4-b011-32387c807a25 req-8dd80514-8a67-46f3-ba6f-ff092b961045 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:43.724694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b279bb7a-b658-4fe4-b011-32387c807a25 req-8dd80514-8a67-46f3-ba6f-ff092b961045 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:43.726338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b279bb7a-b658-4fe4-b011-32387c807a25 req-8dd80514-8a67-46f3-ba6f-ff092b961045 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:43.745533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-31ee678f-aa5a-4985-8fa7-3d25a8bef4d2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:43.747054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-31ee678f-aa5a-4985-8fa7-3d25a8bef4d2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:43.754506 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-b279bb7a-b658-4fe4-b011-32387c807a25 req-8dd80514-8a67-46f3-ba6f-ff092b961045 service nova] Creating event network-changed:e0c82029-fc49-4dc8-bc60-ce44cb5efe54 for instance d19cd5ee-f610-4a5a-9983-e233f32596f1 on n-h2-845781-6 Aug 09 17:22:43.770371 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-b279bb7a-b658-4fe4-b011-32387c807a25 req-8dd80514-8a67-46f3-ba6f-ff092b961045 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068902 Aug 09 17:22:43.771440 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1452/3022] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:43.796100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31ee678f-aa5a-4985-8fa7-3d25a8bef4d2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:43.803965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31ee678f-aa5a-4985-8fa7-3d25a8bef4d2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:43.806138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31ee678f-aa5a-4985-8fa7-3d25a8bef4d2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:43.814443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31ee678f-aa5a-4985-8fa7-3d25a8bef4d2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:43.817647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31ee678f-aa5a-4985-8fa7-3d25a8bef4d2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:43.818508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31ee678f-aa5a-4985-8fa7-3d25a8bef4d2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:44.054407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-31ee678f-aa5a-4985-8fa7-3d25a8bef4d2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:44.307933 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-31ee678f-aa5a-4985-8fa7-3d25a8bef4d2 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.632966 Aug 09 17:22:44.309944 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1571/3023] 10.222.0.93 () {58 vars in 1196 bytes} [Tue Aug 9 17:22:43 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:44.329508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-46172eed-7603-4ffd-9ca9-2b9ef6850ea5 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:44.357789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-46172eed-7603-4ffd-9ca9-2b9ef6850ea5 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:44.358651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-46172eed-7603-4ffd-9ca9-2b9ef6850ea5 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'name': '-448118167', 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:44.370737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46172eed-7603-4ffd-9ca9-2b9ef6850ea5 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:44.373947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46172eed-7603-4ffd-9ca9-2b9ef6850ea5 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:44.374428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46172eed-7603-4ffd-9ca9-2b9ef6850ea5 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:44.375951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46172eed-7603-4ffd-9ca9-2b9ef6850ea5 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:44.376777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46172eed-7603-4ffd-9ca9-2b9ef6850ea5 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:44.391938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46172eed-7603-4ffd-9ca9-2b9ef6850ea5 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:44.544333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c585f407-504a-4ab5-9db8-0dd32ede7006 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:44.545997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c585f407-504a-4ab5-9db8-0dd32ede7006 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:44.570029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=53 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:44.601420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c585f407-504a-4ab5-9db8-0dd32ede7006 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:44.616973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c585f407-504a-4ab5-9db8-0dd32ede7006 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:44.618557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c585f407-504a-4ab5-9db8-0dd32ede7006 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:44.623684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c585f407-504a-4ab5-9db8-0dd32ede7006 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:44.634191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c585f407-504a-4ab5-9db8-0dd32ede7006 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:44.638850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c585f407-504a-4ab5-9db8-0dd32ede7006 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:44.887382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-46172eed-7603-4ffd-9ca9-2b9ef6850ea5 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:45.132852 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-46172eed-7603-4ffd-9ca9-2b9ef6850ea5 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?name=-448118167" status: 200 len: 345 microversion: 2.1 time: 0.809332 Aug 09 17:22:45.144819 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1453/3024] 10.222.0.93 () {58 vars in 1156 bytes} [Tue Aug 9 17:22:44 2022] GET /compute/v2.1/servers?name=-448118167 => generated 345 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:45.162431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1b2c52d6-751b-4b2d-a8e3-2b89c7464ebb tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:45.165360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1b2c52d6-751b-4b2d-a8e3-2b89c7464ebb tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:45.183966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b2c52d6-751b-4b2d-a8e3-2b89c7464ebb tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:45.186354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b2c52d6-751b-4b2d-a8e3-2b89c7464ebb tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:45.187766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b2c52d6-751b-4b2d-a8e3-2b89c7464ebb tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:45.189627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b2c52d6-751b-4b2d-a8e3-2b89c7464ebb tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:45.190845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b2c52d6-751b-4b2d-a8e3-2b89c7464ebb tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:45.192861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b2c52d6-751b-4b2d-a8e3-2b89c7464ebb tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:45.934670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1b2c52d6-751b-4b2d-a8e3-2b89c7464ebb tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:45.944715 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1b2c52d6-751b-4b2d-a8e3-2b89c7464ebb tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1317 microversion: 2.1 time: 0.791222 Aug 09 17:22:45.948882 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1454/3025] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:45 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1317 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:46.391142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c177988a-3d87-4aab-a4a9-bda3213d92df tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Calling method '.version_select at 0x7fbbdc93c430>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:46.408127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c177988a-3d87-4aab-a4a9-bda3213d92df tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:46.409081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c177988a-3d87-4aab-a4a9-bda3213d92df tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:46.409751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c177988a-3d87-4aab-a4a9-bda3213d92df tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:46.412455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c177988a-3d87-4aab-a4a9-bda3213d92df tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:46.413348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c177988a-3d87-4aab-a4a9-bda3213d92df tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:46.414030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c177988a-3d87-4aab-a4a9-bda3213d92df tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:46.440334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=15 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:46.442304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:46.468305 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c177988a-3d87-4aab-a4a9-bda3213d92df tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] 10.222.0.93 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.517635 Aug 09 17:22:46.487990 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1455/3026] 10.222.0.93 () {58 vars in 1122 bytes} [Tue Aug 9 17:22:45 2022] GET /compute/v2.1/limits => generated 511 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:46.510983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a1db5c5-6dd8-49de-9713-801943b02b21 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:46.528031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a1db5c5-6dd8-49de-9713-801943b02b21 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:46.528765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9a1db5c5-6dd8-49de-9713-801943b02b21 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:46.552555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a1db5c5-6dd8-49de-9713-801943b02b21 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:46.553110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a1db5c5-6dd8-49de-9713-801943b02b21 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:46.553555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a1db5c5-6dd8-49de-9713-801943b02b21 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:46.554433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a1db5c5-6dd8-49de-9713-801943b02b21 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:46.558193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a1db5c5-6dd8-49de-9713-801943b02b21 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:46.559073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a1db5c5-6dd8-49de-9713-801943b02b21 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:46.770851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-9a1db5c5-6dd8-49de-9713-801943b02b21 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:46.912509 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a1db5c5-6dd8-49de-9713-801943b02b21 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.421673 Aug 09 17:22:46.924215 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1456/3027] 10.222.0.93 () {58 vars in 1154 bytes} [Tue Aug 9 17:22:46 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:46.938397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1107e23-e580-4c09-8af3-ea48c9e52f10 tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2970293", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:47.085854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-f1107e23-e580-4c09-8af3-ea48c9e52f10 tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:22:47.434907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c585f407-504a-4ab5-9db8-0dd32ede7006 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:47.451861 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c585f407-504a-4ab5-9db8-0dd32ede7006 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1322 microversion: 2.1 time: 2.921423 Aug 09 17:22:47.453562 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1572/3028] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:44 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1322 bytes in 2925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:47.469822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d7d64180-2e4c-4cba-825e-df1344effe04 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:47.481136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d7d64180-2e4c-4cba-825e-df1344effe04 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:47.481853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d7d64180-2e4c-4cba-825e-df1344effe04 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-44811816', 'deleted': False, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:22:47.514660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7d64180-2e4c-4cba-825e-df1344effe04 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:47.515446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7d64180-2e4c-4cba-825e-df1344effe04 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:47.516114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7d64180-2e4c-4cba-825e-df1344effe04 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:47.517034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7d64180-2e4c-4cba-825e-df1344effe04 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:47.517649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7d64180-2e4c-4cba-825e-df1344effe04 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:47.518219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7d64180-2e4c-4cba-825e-df1344effe04 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:47.772505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-d7d64180-2e4c-4cba-825e-df1344effe04 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:22:48.133457 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d7d64180-2e4c-4cba-825e-df1344effe04 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-44811816" status: 200 len: 345 microversion: 2.1 time: 0.678103 Aug 09 17:22:48.134419 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1573/3029] 10.222.0.93 () {58 vars in 1226 bytes} [Tue Aug 9 17:22:47 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-44811816 => generated 345 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:48.161108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-97a9d72d-4530-485a-a8bd-a20786627c29 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:48.162850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-97a9d72d-4530-485a-a8bd-a20786627c29 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:48.176266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a9d72d-4530-485a-a8bd-a20786627c29 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:48.177766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a9d72d-4530-485a-a8bd-a20786627c29 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:48.179132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a9d72d-4530-485a-a8bd-a20786627c29 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:48.181036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a9d72d-4530-485a-a8bd-a20786627c29 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:48.182369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a9d72d-4530-485a-a8bd-a20786627c29 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:48.183411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a9d72d-4530-485a-a8bd-a20786627c29 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:48.753884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-97a9d72d-4530-485a-a8bd-a20786627c29 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:48.788539 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-97a9d72d-4530-485a-a8bd-a20786627c29 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1317 microversion: 2.1 time: 0.633626 Aug 09 17:22:48.807262 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1574/3030] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:48 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:48.818246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-45055165-94ac-4e50-9fb2-e46aafd99c44 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:48.820690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-45055165-94ac-4e50-9fb2-e46aafd99c44 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:48.835044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45055165-94ac-4e50-9fb2-e46aafd99c44 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:48.835820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45055165-94ac-4e50-9fb2-e46aafd99c44 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:48.836462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45055165-94ac-4e50-9fb2-e46aafd99c44 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:48.837406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45055165-94ac-4e50-9fb2-e46aafd99c44 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:48.838326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45055165-94ac-4e50-9fb2-e46aafd99c44 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:48.840125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45055165-94ac-4e50-9fb2-e46aafd99c44 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:48.913433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f1107e23-e580-4c09-8af3-ea48c9e52f10 tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Getting quotas for project 55f189a41f3f4ce0aac18ba54a708c8e. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:22:48.923006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-45055165-94ac-4e50-9fb2-e46aafd99c44 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:22:48.928247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f1107e23-e580-4c09-8af3-ea48c9e52f10 tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Getting quotas for user 8c533c4df5154a96850da4b106d87bc2 and project 55f189a41f3f4ce0aac18ba54a708c8e. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:22:48.971447 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-f1107e23-e580-4c09-8af3-ea48c9e52f10 tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1107e23-e580-4c09-8af3-ea48c9e52f10 tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Request method failure captured: Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 1749 Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfkK0-G4GERQ-0rrThxp-oGb1SdVQ5Qbs9BOgpH8N5ucLL46Vp4jrgtudlQWNfUr_AEMb_BPpEA8tL2VpqPmf91gNhppSHQcoEJqqz79lJGHAey1CLFEJZJMNy53jFbzOaqM-Wfq07hmfV24pMQJVFSocbxjNX8vCBlZlniH_6bzUg Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 55f189a41f3f4ce0aac18ba54a708c8e Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-990790741 Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_55f189a41f3f4ce0aac18ba54a708c8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/55f189a41f3f4ce0aac18ba54a708c8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/55f189a41f3f4ce0aac18ba54a708c8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/55f189a41f3f4ce0aac18ba54a708c8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-990790741 Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 55f189a41f3f4ce0aac18ba54a708c8e Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-990790741 Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-990790741-project Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 8c533c4df5154a96850da4b106d87bc2 Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-990790741-project Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2970293", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:22:48.976091 n-d-845781-6 devstack@n-api.service[119432]: exception: Maximum number of metadata items exceeds 128 Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2970293', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:22:48.981214 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1107e23-e580-4c09-8af3-ea48c9e52f10 tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:48.992078 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f1107e23-e580-4c09-8af3-ea48c9e52f10 tempest-AbsoluteLimitsNegativeTestJSON-990790741 tempest-AbsoluteLimitsNegativeTestJSON-990790741-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 2.058761 Aug 09 17:22:48.999179 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1457/3031] 10.222.0.93 () {60 vars in 1148 bytes} [Tue Aug 9 17:22:46 2022] POST /compute/v2.1/servers => generated 87 bytes in 2078 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:22:49.021504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1c79aacb-c27e-438a-ba4e-8b7cbb88e487 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:49.023667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1c79aacb-c27e-438a-ba4e-8b7cbb88e487 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:49.058229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c79aacb-c27e-438a-ba4e-8b7cbb88e487 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:49.059256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c79aacb-c27e-438a-ba4e-8b7cbb88e487 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:49.072453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c79aacb-c27e-438a-ba4e-8b7cbb88e487 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:49.073993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c79aacb-c27e-438a-ba4e-8b7cbb88e487 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:49.074899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c79aacb-c27e-438a-ba4e-8b7cbb88e487 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:49.075759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c79aacb-c27e-438a-ba4e-8b7cbb88e487 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:49.347284 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-45055165-94ac-4e50-9fb2-e46aafd99c44 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 204 len: 0 microversion: 2.1 time: 0.537447 Aug 09 17:22:49.349588 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1575/3032] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:22:48 2022] DELETE /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:22:49.382469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a8b8e248-80f5-4e70-b8da-29847aea535a req-8dc77b6c-a327-432d-829b-f67035811bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750faee4-c702-4a68-b0ba-f57212ea276f", "tag": "a35c2ca0-d4b7-4330-8b26-aa287572ba0a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:49.439184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a8b8e248-80f5-4e70-b8da-29847aea535a req-8dc77b6c-a327-432d-829b-f67035811bac service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:49.439702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a8b8e248-80f5-4e70-b8da-29847aea535a req-8dc77b6c-a327-432d-829b-f67035811bac service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:49.440367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a8b8e248-80f5-4e70-b8da-29847aea535a req-8dc77b6c-a327-432d-829b-f67035811bac service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:49.470295 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a8b8e248-80f5-4e70-b8da-29847aea535a req-8dc77b6c-a327-432d-829b-f67035811bac service nova] Creating event network-changed:a35c2ca0-d4b7-4330-8b26-aa287572ba0a for instance 750faee4-c702-4a68-b0ba-f57212ea276f on n-h2-845781-6 Aug 09 17:22:49.476333 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a8b8e248-80f5-4e70-b8da-29847aea535a req-8dc77b6c-a327-432d-829b-f67035811bac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123945 Aug 09 17:22:49.477350 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1576/3033] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:49.486891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b8b82e5b-f998-4a19-b542-b7c8115069a9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:49.497041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b8b82e5b-f998-4a19-b542-b7c8115069a9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:49.511867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8b82e5b-f998-4a19-b542-b7c8115069a9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:49.512373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8b82e5b-f998-4a19-b542-b7c8115069a9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:49.513014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8b82e5b-f998-4a19-b542-b7c8115069a9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:49.513977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8b82e5b-f998-4a19-b542-b7c8115069a9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:49.514618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8b82e5b-f998-4a19-b542-b7c8115069a9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:49.515237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8b82e5b-f998-4a19-b542-b7c8115069a9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:49.996582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b8b82e5b-f998-4a19-b542-b7c8115069a9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:50.015770 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b8b82e5b-f998-4a19-b542-b7c8115069a9 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1518 microversion: 2.1 time: 0.536601 Aug 09 17:22:50.033199 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1577/3034] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:49 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1518 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:50.078764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-89aa7641-1c6e-463b-9dbf-001493eb1bed tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:50.085081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-89aa7641-1c6e-463b-9dbf-001493eb1bed tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:50.112824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89aa7641-1c6e-463b-9dbf-001493eb1bed tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:50.116054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89aa7641-1c6e-463b-9dbf-001493eb1bed tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:50.117669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89aa7641-1c6e-463b-9dbf-001493eb1bed tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:50.122212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89aa7641-1c6e-463b-9dbf-001493eb1bed tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:50.125178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89aa7641-1c6e-463b-9dbf-001493eb1bed tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:50.132915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89aa7641-1c6e-463b-9dbf-001493eb1bed tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:50.726700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:50.828225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1c79aacb-c27e-438a-ba4e-8b7cbb88e487 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:50.846881 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1c79aacb-c27e-438a-ba4e-8b7cbb88e487 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1322 microversion: 2.1 time: 1.840878 Aug 09 17:22:50.848622 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1458/3035] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:48 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1322 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:51.058880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1c644d59-b647-40e1-b0bf-37c6f2de392a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:51.059871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1c644d59-b647-40e1-b0bf-37c6f2de392a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:51.074907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c644d59-b647-40e1-b0bf-37c6f2de392a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:51.077255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c644d59-b647-40e1-b0bf-37c6f2de392a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:51.077932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c644d59-b647-40e1-b0bf-37c6f2de392a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:51.079052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c644d59-b647-40e1-b0bf-37c6f2de392a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:51.079736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c644d59-b647-40e1-b0bf-37c6f2de392a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:51.080478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c644d59-b647-40e1-b0bf-37c6f2de392a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:51.134041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-89aa7641-1c6e-463b-9dbf-001493eb1bed tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:51.156337 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-89aa7641-1c6e-463b-9dbf-001493eb1bed tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1317 microversion: 2.1 time: 1.120837 Aug 09 17:22:51.157342 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1578/3036] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:50 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1317 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:51.891759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e955dc12-f3ad-426a-af36-ca2db00b2bf1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:51.896153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e955dc12-f3ad-426a-af36-ca2db00b2bf1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:51.910464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e955dc12-f3ad-426a-af36-ca2db00b2bf1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:51.913311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e955dc12-f3ad-426a-af36-ca2db00b2bf1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:51.914528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e955dc12-f3ad-426a-af36-ca2db00b2bf1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:51.916227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e955dc12-f3ad-426a-af36-ca2db00b2bf1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:51.917117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e955dc12-f3ad-426a-af36-ca2db00b2bf1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:51.917925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e955dc12-f3ad-426a-af36-ca2db00b2bf1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:51.959334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:52.178365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1c644d59-b647-40e1-b0bf-37c6f2de392a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:52.217676 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1c644d59-b647-40e1-b0bf-37c6f2de392a tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1518 microversion: 2.1 time: 1.162749 Aug 09 17:22:52.242858 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1459/3037] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:51 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1518 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:52.256107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cf6ad105-5aef-4653-9b42-f808b0c0f3b1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:52.257462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cf6ad105-5aef-4653-9b42-f808b0c0f3b1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:52.280830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf6ad105-5aef-4653-9b42-f808b0c0f3b1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:52.293922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf6ad105-5aef-4653-9b42-f808b0c0f3b1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:52.298494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf6ad105-5aef-4653-9b42-f808b0c0f3b1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:52.306074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf6ad105-5aef-4653-9b42-f808b0c0f3b1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:52.308152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf6ad105-5aef-4653-9b42-f808b0c0f3b1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:52.313049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cf6ad105-5aef-4653-9b42-f808b0c0f3b1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:52.970248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e955dc12-f3ad-426a-af36-ca2db00b2bf1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:52.983309 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e955dc12-f3ad-426a-af36-ca2db00b2bf1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1322 microversion: 2.1 time: 1.100304 Aug 09 17:22:52.984959 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1579/3038] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:51 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1322 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:22:53.254180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f0d2cdc-e9c3-4f80-9993-64382709113d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:53.254805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5f0d2cdc-e9c3-4f80-9993-64382709113d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:53.263039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f0d2cdc-e9c3-4f80-9993-64382709113d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:53.265097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f0d2cdc-e9c3-4f80-9993-64382709113d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:53.266031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f0d2cdc-e9c3-4f80-9993-64382709113d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:53.268055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f0d2cdc-e9c3-4f80-9993-64382709113d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:53.268776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f0d2cdc-e9c3-4f80-9993-64382709113d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:53.269724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f0d2cdc-e9c3-4f80-9993-64382709113d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:53.491346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cf6ad105-5aef-4653-9b42-f808b0c0f3b1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:53.525506 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cf6ad105-5aef-4653-9b42-f808b0c0f3b1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1317 microversion: 2.1 time: 1.280210 Aug 09 17:22:53.526661 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1460/3039] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:52 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1317 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:53.807697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-77e91553-d106-42fe-bb39-8461df2de18d req-7d9a153f-3181-40c7-b65d-092d52d5efd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3b3bf1-f13b-440c-9db0-14b0e7d57055", "name": "network-vif-plugged", "status": "completed", "tag": "45ae12ab-8288-46ce-825f-c64eab2678ae"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:53.847382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-77e91553-d106-42fe-bb39-8461df2de18d req-7d9a153f-3181-40c7-b65d-092d52d5efd5 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:53.848190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-77e91553-d106-42fe-bb39-8461df2de18d req-7d9a153f-3181-40c7-b65d-092d52d5efd5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:53.848819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-77e91553-d106-42fe-bb39-8461df2de18d req-7d9a153f-3181-40c7-b65d-092d52d5efd5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:53.878956 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-77e91553-d106-42fe-bb39-8461df2de18d req-7d9a153f-3181-40c7-b65d-092d52d5efd5 service nova] Creating event network-vif-plugged:45ae12ab-8288-46ce-825f-c64eab2678ae for instance 7d3b3bf1-f13b-440c-9db0-14b0e7d57055 on n-h1-845781-6 Aug 09 17:22:53.893839 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-77e91553-d106-42fe-bb39-8461df2de18d req-7d9a153f-3181-40c7-b65d-092d52d5efd5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094051 Aug 09 17:22:53.894489 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1461/3040] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:54.010469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5dd1438f-edc9-48d6-86cb-59927e27ae4f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:54.011704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5dd1438f-edc9-48d6-86cb-59927e27ae4f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:54.024642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dd1438f-edc9-48d6-86cb-59927e27ae4f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:54.030425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dd1438f-edc9-48d6-86cb-59927e27ae4f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:54.031174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dd1438f-edc9-48d6-86cb-59927e27ae4f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:54.032188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dd1438f-edc9-48d6-86cb-59927e27ae4f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:54.032834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dd1438f-edc9-48d6-86cb-59927e27ae4f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:54.033479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5dd1438f-edc9-48d6-86cb-59927e27ae4f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:54.814126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5dd1438f-edc9-48d6-86cb-59927e27ae4f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:54.836439 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5dd1438f-edc9-48d6-86cb-59927e27ae4f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1322 microversion: 2.1 time: 0.828367 Aug 09 17:22:54.840366 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1462/3041] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:54 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1322 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:54.918863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f0d2cdc-e9c3-4f80-9993-64382709113d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:54.956337 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f0d2cdc-e9c3-4f80-9993-64382709113d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 200 len: 1518 microversion: 2.1 time: 1.705839 Aug 09 17:22:54.968132 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1580/3042] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:53 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 1518 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:22:54.981821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea6d70ba-c72a-4520-9114-867d4ebec19e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:54.999419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ea6d70ba-c72a-4520-9114-867d4ebec19e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:55.028736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea6d70ba-c72a-4520-9114-867d4ebec19e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:55.031114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea6d70ba-c72a-4520-9114-867d4ebec19e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:55.032379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea6d70ba-c72a-4520-9114-867d4ebec19e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:55.035876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea6d70ba-c72a-4520-9114-867d4ebec19e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:55.041588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea6d70ba-c72a-4520-9114-867d4ebec19e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:55.043467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea6d70ba-c72a-4520-9114-867d4ebec19e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:55.829448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-012dd183-f229-4db2-8e3a-fb5f820264fa tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbcb96cca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-351146881", "description": "tempest-description-41127305"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:55.922633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ea6d70ba-c72a-4520-9114-867d4ebec19e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:55.975439 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ea6d70ba-c72a-4520-9114-867d4ebec19e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1317 microversion: 2.1 time: 1.008936 Aug 09 17:22:55.976249 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1581/3043] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:54 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1317 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:55.996181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-546a7be4-d2e4-424a-ae46-8e633b516329 req-bfa6d6d7-a4cd-41df-a506-546655ebb735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2b0c9a-c146-45bc-9afc-133d574faf9d", "name": "network-vif-deleted", "tag": "7f367fd1-9fb9-4ca6-aa5a-34fe505ffa73"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:56.032357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-546a7be4-d2e4-424a-ae46-8e633b516329 req-bfa6d6d7-a4cd-41df-a506-546655ebb735 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:56.033202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-546a7be4-d2e4-424a-ae46-8e633b516329 req-bfa6d6d7-a4cd-41df-a506-546655ebb735 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:56.033842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-546a7be4-d2e4-424a-ae46-8e633b516329 req-bfa6d6d7-a4cd-41df-a506-546655ebb735 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:56.063949 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-546a7be4-d2e4-424a-ae46-8e633b516329 req-bfa6d6d7-a4cd-41df-a506-546655ebb735 service nova] Creating event network-vif-deleted:7f367fd1-9fb9-4ca6-aa5a-34fe505ffa73 for instance 0e2b0c9a-c146-45bc-9afc-133d574faf9d on n-h2-845781-6 Aug 09 17:22:56.071781 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-546a7be4-d2e4-424a-ae46-8e633b516329 req-bfa6d6d7-a4cd-41df-a506-546655ebb735 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094203 Aug 09 17:22:56.072849 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1582/3044] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:56.621086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:57.079784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-23808a3d-c3b3-4786-9016-29e666f1226c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: .version_select at 0x7fbbcb840940>, body: {"keypair": {"name": "tempest-keypair-605002989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiiOv4GUsxpgjW5If9Y5Bll1lopyvScWHjbdLM4vULOOGC+TbYC5W5SP4aU6Nb4rhwl6if3DB5wGhtyir3gWWJgza+fU0gOU7fcw2rZ0ocLhfsaXhZcVHTRdLdRt8KE9g=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:57.144295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-23808a3d-c3b3-4786-9016-29e666f1226c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:22:57.169228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-23808a3d-c3b3-4786-9016-29e666f1226c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for user be0fad88d219437eaed454ba916c86e3 and project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:22:57.254158 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-23808a3d-c3b3-4786-9016-29e666f1226c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.172601 Aug 09 17:22:57.255225 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1583/3045] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:22:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:57.260582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19f18ec8-f529-4451-8f86-4e5240c0b7f2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:57.265564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19f18ec8-f529-4451-8f86-4e5240c0b7f2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:57.301445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f18ec8-f529-4451-8f86-4e5240c0b7f2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:57.310384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f18ec8-f529-4451-8f86-4e5240c0b7f2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:57.311540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f18ec8-f529-4451-8f86-4e5240c0b7f2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:57.312914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f18ec8-f529-4451-8f86-4e5240c0b7f2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:57.313730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f18ec8-f529-4451-8f86-4e5240c0b7f2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:57.316750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f18ec8-f529-4451-8f86-4e5240c0b7f2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:57.624321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:58.060027 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-012dd183-f229-4db2-8e3a-fb5f820264fa tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 3.216560 Aug 09 17:22:58.077644 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1463/3046] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:22:54 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 3236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:58.087081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:58.088708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 0e2b0c9a-c146-45bc-9afc-133d574faf9d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:58.101512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:58.102881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:58.103960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:58.105486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:58.106586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:58.107972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:58.160715 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] HTTP exception thrown: Instance 0e2b0c9a-c146-45bc-9afc-133d574faf9d could not be found. Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Request method failure captured: Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d HTTP/1.1 Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8peGIw7oALHMJVppz1nnDDX2Nmokcs0zuOEWalgMfMkkTZEXZl4FrBZReUkpQFLLg-ih2wHIWypfKRDsIc1VDD8iJ9a1Mavy4-fRy_fQSavi3twRVW6Iag0pr18qdLxlGOHHJ-q-k-kMDKbLnMujzc2uKma0gdDMpx4UchtaPl2BZa4 Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a8fc22300e744d5e92d7cc5806f771c9 Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ListServerFiltersTestJSON-1689544664 Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ListServerFiltersTestJSON-1689544664 Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a8fc22300e744d5e92d7cc5806f771c9 Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1689544664 Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ListServerFiltersTestJSON-1689544664-project Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: e785c5c340fa4d5c9e21691459bd6cb9 Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ListServerFiltersTestJSON-1689544664-project Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 0e2b0c9a-c146-45bc-9afc-133d574faf9d could not be found. Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '0e2b0c9a-c146-45bc-9afc-133d574faf9d'} Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e2b0c9a-c146-45bc-9afc-133d574faf9d could not be found. Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e2b0c9a-c146-45bc-9afc-133d574faf9d could not be found. Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:22:58.163446 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:58.168654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:22:58.168654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:22:58.168654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:22:58.168654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:22:58.168654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:22:58.168654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e2b0c9a-c146-45bc-9afc-133d574faf9d could not be found. Aug 09 17:22:58.168654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:22:58.170243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Returning 404 to user: Instance 0e2b0c9a-c146-45bc-9afc-133d574faf9d could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:22:58.171718 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1766bf90-11b6-4b24-80d9-c3863ed0a244 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d" status: 404 len: 111 microversion: 2.1 time: 0.092054 Aug 09 17:22:58.178577 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1464/3047] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:58 2022] GET /compute/v2.1/servers/0e2b0c9a-c146-45bc-9afc-133d574faf9d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:22:58.185092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-fbb8dfb6-372b-4fe9-b1c8-02b4e9a849ed req-698f2355-b523-4e5d-8938-400d291bb355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19cd5ee-f610-4a5a-9983-e233f32596f1", "name": "network-vif-plugged", "status": "completed", "tag": "e0c82029-fc49-4dc8-bc60-ce44cb5efe54"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:58.214529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fbb8dfb6-372b-4fe9-b1c8-02b4e9a849ed req-698f2355-b523-4e5d-8938-400d291bb355 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:58.215314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fbb8dfb6-372b-4fe9-b1c8-02b4e9a849ed req-698f2355-b523-4e5d-8938-400d291bb355 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:58.215990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fbb8dfb6-372b-4fe9-b1c8-02b4e9a849ed req-698f2355-b523-4e5d-8938-400d291bb355 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:58.269426 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-fbb8dfb6-372b-4fe9-b1c8-02b4e9a849ed req-698f2355-b523-4e5d-8938-400d291bb355 service nova] Creating event network-vif-plugged:e0c82029-fc49-4dc8-bc60-ce44cb5efe54 for instance d19cd5ee-f610-4a5a-9983-e233f32596f1 on n-h2-845781-6 Aug 09 17:22:58.280443 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-fbb8dfb6-372b-4fe9-b1c8-02b4e9a849ed req-698f2355-b523-4e5d-8938-400d291bb355 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100143 Aug 09 17:22:58.296240 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1465/3048] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:22:58.328362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dd02c3b3-0b8c-4449-9eef-2360b8a09f33 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:58.350933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dd02c3b3-0b8c-4449-9eef-2360b8a09f33 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:58.382427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd02c3b3-0b8c-4449-9eef-2360b8a09f33 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:58.386954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd02c3b3-0b8c-4449-9eef-2360b8a09f33 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:58.390888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd02c3b3-0b8c-4449-9eef-2360b8a09f33 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:58.393267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd02c3b3-0b8c-4449-9eef-2360b8a09f33 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:58.394212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd02c3b3-0b8c-4449-9eef-2360b8a09f33 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:58.395144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd02c3b3-0b8c-4449-9eef-2360b8a09f33 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:58.818443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-19f18ec8-f529-4451-8f86-4e5240c0b7f2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:58.847060 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19f18ec8-f529-4451-8f86-4e5240c0b7f2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1322 microversion: 2.1 time: 1.590358 Aug 09 17:22:58.847681 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1584/3049] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:57 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1322 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:58.868203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0c5bc45d-9bae-44de-9082-920e4bb0720f tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbd8383d30>, body: {"security_group_rule": {"parent_group_id": "7b14dcb8-4b6f-4390-80f5-79103af4710a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:22:58.958678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=30 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:22:59.799281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dd02c3b3-0b8c-4449-9eef-2360b8a09f33 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:22:59.815844 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dd02c3b3-0b8c-4449-9eef-2360b8a09f33 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1466 microversion: 2.1 time: 1.512166 Aug 09 17:22:59.821524 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1466/3050] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:22:58 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1466 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:22:59.839387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-225ad512-49aa-4328-b622-58d5648dfc5d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:22:59.840804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-225ad512-49aa-4328-b622-58d5648dfc5d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 74cc072b-21ba-4456-8e16-2390ad0b0c44] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:22:59.879202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-225ad512-49aa-4328-b622-58d5648dfc5d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:59.880289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-225ad512-49aa-4328-b622-58d5648dfc5d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:59.881097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-225ad512-49aa-4328-b622-58d5648dfc5d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:59.882443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-225ad512-49aa-4328-b622-58d5648dfc5d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:22:59.883414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-225ad512-49aa-4328-b622-58d5648dfc5d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:22:59.884298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-225ad512-49aa-4328-b622-58d5648dfc5d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:22:59.966720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-225ad512-49aa-4328-b622-58d5648dfc5d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 74cc072b-21ba-4456-8e16-2390ad0b0c44] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:23:00.230804 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-225ad512-49aa-4328-b622-58d5648dfc5d tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44" status: 204 len: 0 microversion: 2.1 time: 0.407407 Aug 09 17:23:00.236933 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1467/3051] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:22:59 2022] DELETE /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:23:00.240816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6d430ba3-a344-4ddb-9e7f-543f619247ab tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:00.241550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6d430ba3-a344-4ddb-9e7f-543f619247ab tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:00.261271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d430ba3-a344-4ddb-9e7f-543f619247ab tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:00.261773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d430ba3-a344-4ddb-9e7f-543f619247ab tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:00.262207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d430ba3-a344-4ddb-9e7f-543f619247ab tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:00.262939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d430ba3-a344-4ddb-9e7f-543f619247ab tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:00.263439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d430ba3-a344-4ddb-9e7f-543f619247ab tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:00.263913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d430ba3-a344-4ddb-9e7f-543f619247ab tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:00.912850 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6d430ba3-a344-4ddb-9e7f-543f619247ab tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1617 microversion: 2.1 time: 0.678402 Aug 09 17:23:00.927771 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1468/3052] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:00 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1617 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:00.927771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6b433202-aa2f-4435-99fc-4256219abe36 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:00.927771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6b433202-aa2f-4435-99fc-4256219abe36 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:00.949114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b433202-aa2f-4435-99fc-4256219abe36 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:00.949661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b433202-aa2f-4435-99fc-4256219abe36 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:00.950116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b433202-aa2f-4435-99fc-4256219abe36 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:00.951386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b433202-aa2f-4435-99fc-4256219abe36 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:00.952120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b433202-aa2f-4435-99fc-4256219abe36 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:00.952576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b433202-aa2f-4435-99fc-4256219abe36 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:01.270550 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0c5bc45d-9bae-44de-9082-920e4bb0720f tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.414030 Aug 09 17:23:01.271718 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1585/3053] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:22:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:01.298261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c5abbd55-d809-453f-93eb-0ab136a67935 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:01.299760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c5abbd55-d809-453f-93eb-0ab136a67935 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 74cc072b-21ba-4456-8e16-2390ad0b0c44] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:01.342445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5abbd55-d809-453f-93eb-0ab136a67935 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:01.356828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5abbd55-d809-453f-93eb-0ab136a67935 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:01.357610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5abbd55-d809-453f-93eb-0ab136a67935 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:01.359432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5abbd55-d809-453f-93eb-0ab136a67935 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:01.360313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5abbd55-d809-453f-93eb-0ab136a67935 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:01.361104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5abbd55-d809-453f-93eb-0ab136a67935 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:01.489990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6b433202-aa2f-4435-99fc-4256219abe36 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:01.505083 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6b433202-aa2f-4435-99fc-4256219abe36 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1322 microversion: 2.1 time: 0.589473 Aug 09 17:23:01.505812 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1469/3054] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:00 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1322 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:01.512240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc364899-6ad0-4312-b692-97dc6f6f8306 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbcb938e50>, body: {"security_group_rule": {"parent_group_id": "7b14dcb8-4b6f-4390-80f5-79103af4710a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:01.815161 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-cc364899-6ad0-4312-b692-97dc6f6f8306 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] HTTP exception thrown: This rule already exists in group 7b14dcb8-4b6f-4390-80f5-79103af4710a Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc364899-6ad0-4312-b692-97dc6f6f8306 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Request method failure captured: Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 138 Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfuuNGTsF4G18FpBYpPO2-hnMwZn9JlpwO4NRPd_JGeTTqyYm9HbrItMOOXV8frGaghOxPfDCsCh-xyVbbg9IBSPDApUnr6gq-9ndd18xSfMlRd27B0UauMr2sygLVpoBDbm5Fo_HdMPeQLjAQQjjvpHdOR7EeZlL29bShxXfpt-yY Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 857e52de9ce84f369846ca639caa6999 Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: {"security_group_rule": {"parent_group_id": "7b14dcb8-4b6f-4390-80f5-79103af4710a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: exception: This rule already exists in group 7b14dcb8-4b6f-4390-80f5-79103af4710a Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7b14dcb8-4b6f-4390-80f5-79103af4710a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 7b14dcb8-4b6f-4390-80f5-79103af4710a Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 7b14dcb8-4b6f-4390-80f5-79103af4710a Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:01.821701 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:01.844232 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:01.844232 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:01.844232 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 7b14dcb8-4b6f-4390-80f5-79103af4710a Aug 09 17:23:01.844232 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:01.848747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc364899-6ad0-4312-b692-97dc6f6f8306 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Returning 400 to user: This rule already exists in group 7b14dcb8-4b6f-4390-80f5-79103af4710a {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:01.853166 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cc364899-6ad0-4312-b692-97dc6f6f8306 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.345536 Aug 09 17:23:01.855290 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1470/3055] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:23:01 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 349 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:23:01.874838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1418177740", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "904e2d62-61c5-4c4e-9acd-6948e6a21477"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:02.087548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c5abbd55-d809-453f-93eb-0ab136a67935 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:02.102462 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c5abbd55-d809-453f-93eb-0ab136a67935 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44" status: 200 len: 1518 microversion: 2.1 time: 0.825471 Aug 09 17:23:02.118328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] validate_networks() for None {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:23:02.121633 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1586/3056] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:01 2022] GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44 => generated 1518 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:02.129692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6659ead8-e27f-46d7-bccb-1e36eb275f35 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Calling method '.version_select at 0x7fbbd816b670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:03.125365 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6659ead8-e27f-46d7-bccb-1e36eb275f35 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-group-rules/a4f1dd29-c475-4f7f-a52d-cc72bce267c5" status: 202 len: 0 microversion: 2.1 time: 0.998108 Aug 09 17:23:03.130736 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1587/3057] 10.222.0.93 () {58 vars in 1287 bytes} [Tue Aug 9 17:23:02 2022] DELETE /compute/v2.1/os-security-group-rules/a4f1dd29-c475-4f7f-a52d-cc72bce267c5 => generated 0 bytes in 1004 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:23:03.159895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-610b859d-1925-4a36-a529-29b684fd1884 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:03.161824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-610b859d-1925-4a36-a529-29b684fd1884 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:03.177466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-610b859d-1925-4a36-a529-29b684fd1884 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:03.178612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-610b859d-1925-4a36-a529-29b684fd1884 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:03.179683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-610b859d-1925-4a36-a529-29b684fd1884 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:03.181521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-610b859d-1925-4a36-a529-29b684fd1884 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:03.183612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-610b859d-1925-4a36-a529-29b684fd1884 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:03.185284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-610b859d-1925-4a36-a529-29b684fd1884 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:04.154720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-610b859d-1925-4a36-a529-29b684fd1884 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:04.194295 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-610b859d-1925-4a36-a529-29b684fd1884 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1322 microversion: 2.1 time: 1.062107 Aug 09 17:23:04.208638 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1588/3058] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:03 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1322 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:04.236021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1a59371f-e76a-4dd2-a40d-5628f3073a54 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:04.237646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1a59371f-e76a-4dd2-a40d-5628f3073a54 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 74cc072b-21ba-4456-8e16-2390ad0b0c44] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:04.264530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a59371f-e76a-4dd2-a40d-5628f3073a54 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:04.265872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a59371f-e76a-4dd2-a40d-5628f3073a54 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:04.266894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a59371f-e76a-4dd2-a40d-5628f3073a54 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:04.268845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a59371f-e76a-4dd2-a40d-5628f3073a54 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:04.270053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a59371f-e76a-4dd2-a40d-5628f3073a54 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:04.271464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a59371f-e76a-4dd2-a40d-5628f3073a54 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:04.300551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:23:04.302771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:23:04.303762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:23:04.305903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:23:04.308909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:23:04.351753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:04.352889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:04.354013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:04.357433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:04.360028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:04.361216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:04.411264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:23:04.425554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Getting quotas for user fe6a633b90b949af91c0d2aa1d361fe5 and project 2b3f7d833b344b9cb579955d726a9e41. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:23:04.446193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:23:04.451530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:23:04.544060 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8901e5b6-2e01-4402-957a-00f270fa78af tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.686616 Aug 09 17:23:04.547870 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1471/3059] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:23:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:23:04.566388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c35842f5-b42c-4430-a9a6-958630698c9c tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbcb938700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1971519665", "description": "tempest-description-1102298990"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:05.294463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a59371f-e76a-4dd2-a40d-5628f3073a54 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:05.308207 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1a59371f-e76a-4dd2-a40d-5628f3073a54 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44" status: 200 len: 1518 microversion: 2.1 time: 1.089170 Aug 09 17:23:05.311141 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1589/3060] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:04 2022] GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44 => generated 1518 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:05.329952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-645272da-5b50-4f1a-9faa-594ca7512618 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:05.332478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-645272da-5b50-4f1a-9faa-594ca7512618 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:05.560573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-645272da-5b50-4f1a-9faa-594ca7512618 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:05.582303 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-645272da-5b50-4f1a-9faa-594ca7512618 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1217 microversion: 2.1 time: 0.268390 Aug 09 17:23:05.582957 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1590/3061] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:05 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1217 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:05.616918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-13096b40-2009-43bd-965c-8851a6af3bd5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:05.618639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-13096b40-2009-43bd-965c-8851a6af3bd5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:05.633093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13096b40-2009-43bd-965c-8851a6af3bd5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:05.640276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13096b40-2009-43bd-965c-8851a6af3bd5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:05.641137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13096b40-2009-43bd-965c-8851a6af3bd5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:05.642310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13096b40-2009-43bd-965c-8851a6af3bd5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:05.642838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13096b40-2009-43bd-965c-8851a6af3bd5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:05.643442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13096b40-2009-43bd-965c-8851a6af3bd5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:06.116740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13096b40-2009-43bd-965c-8851a6af3bd5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:06.128410 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-13096b40-2009-43bd-965c-8851a6af3bd5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1322 microversion: 2.1 time: 0.525265 Aug 09 17:23:06.129023 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1591/3062] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:05 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:06.351864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3a08adb-8b52-4e57-9a2a-f2c887b12de8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:06.355048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b3a08adb-8b52-4e57-9a2a-f2c887b12de8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 74cc072b-21ba-4456-8e16-2390ad0b0c44] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:06.370124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3a08adb-8b52-4e57-9a2a-f2c887b12de8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:06.374483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3a08adb-8b52-4e57-9a2a-f2c887b12de8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:06.375210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3a08adb-8b52-4e57-9a2a-f2c887b12de8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:06.376386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3a08adb-8b52-4e57-9a2a-f2c887b12de8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:06.377058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3a08adb-8b52-4e57-9a2a-f2c887b12de8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:06.380003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3a08adb-8b52-4e57-9a2a-f2c887b12de8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:06.559412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3a08adb-8b52-4e57-9a2a-f2c887b12de8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:06.588081 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b3a08adb-8b52-4e57-9a2a-f2c887b12de8 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44" status: 200 len: 1476 microversion: 2.1 time: 0.239757 Aug 09 17:23:06.603880 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1592/3063] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:06 2022] GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44 => generated 1476 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:23:06.635466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3c9aab4e-68ae-4b4a-aba6-3cd1ff4b49b0 req-e7f6abf4-5bdf-4d18-8045-3de304e19f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750faee4-c702-4a68-b0ba-f57212ea276f", "name": "network-vif-plugged", "status": "completed", "tag": "a35c2ca0-d4b7-4330-8b26-aa287572ba0a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:06.715159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3c9aab4e-68ae-4b4a-aba6-3cd1ff4b49b0 req-e7f6abf4-5bdf-4d18-8045-3de304e19f5c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:06.716975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3c9aab4e-68ae-4b4a-aba6-3cd1ff4b49b0 req-e7f6abf4-5bdf-4d18-8045-3de304e19f5c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:06.717496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3c9aab4e-68ae-4b4a-aba6-3cd1ff4b49b0 req-e7f6abf4-5bdf-4d18-8045-3de304e19f5c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:06.792419 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3c9aab4e-68ae-4b4a-aba6-3cd1ff4b49b0 req-e7f6abf4-5bdf-4d18-8045-3de304e19f5c service nova] Creating event network-vif-plugged:a35c2ca0-d4b7-4330-8b26-aa287572ba0a for instance 750faee4-c702-4a68-b0ba-f57212ea276f on n-h2-845781-6 Aug 09 17:23:06.812726 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3c9aab4e-68ae-4b4a-aba6-3cd1ff4b49b0 req-e7f6abf4-5bdf-4d18-8045-3de304e19f5c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220851 Aug 09 17:23:06.815660 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1593/3064] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:06.837837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-599423450", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34fc5f4c-78d4-4016-ba62-ad51259fd9d6"}], "security_groups": [{"name": "tempest-securitygroup--504169286"}], "key_name": "tempest-keypair-605002989", "user_data": "}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:06.872533 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c35842f5-b42c-4430-a9a6-958630698c9c tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.318260 Aug 09 17:23:06.873670 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1472/3065] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:23:04 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:06.893389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2ab4289a-ac4c-47c9-93bc-d3db0f7c44f4 req-41973318-0f56-4373-bca3-d986769ee2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cc072b-21ba-4456-8e16-2390ad0b0c44", "name": "network-vif-deleted", "tag": "d7835108-b545-4a3e-8fc8-112acbca6297"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:06.947774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:06.980710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2ab4289a-ac4c-47c9-93bc-d3db0f7c44f4 req-41973318-0f56-4373-bca3-d986769ee2c7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:06.995310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2ab4289a-ac4c-47c9-93bc-d3db0f7c44f4 req-41973318-0f56-4373-bca3-d986769ee2c7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:06.996603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2ab4289a-ac4c-47c9-93bc-d3db0f7c44f4 req-41973318-0f56-4373-bca3-d986769ee2c7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:07.079477 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2ab4289a-ac4c-47c9-93bc-d3db0f7c44f4 req-41973318-0f56-4373-bca3-d986769ee2c7 service nova] Creating event network-vif-deleted:d7835108-b545-4a3e-8fc8-112acbca6297 for instance 74cc072b-21ba-4456-8e16-2390ad0b0c44 on n-h1-845781-6 Aug 09 17:23:07.109665 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-2ab4289a-ac4c-47c9-93bc-d3db0f7c44f4 req-41973318-0f56-4373-bca3-d986769ee2c7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233652 Aug 09 17:23:07.117406 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1473/3066] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:07.157273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0dc41718-4e41-4ea2-99e4-810ff7f2716e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:07.169164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0dc41718-4e41-4ea2-99e4-810ff7f2716e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:07.188908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] validate_networks() for [('34fc5f4c-78d4-4016-ba62-ad51259fd9d6', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:23:07.206347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0dc41718-4e41-4ea2-99e4-810ff7f2716e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:07.206957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0dc41718-4e41-4ea2-99e4-810ff7f2716e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:07.207577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0dc41718-4e41-4ea2-99e4-810ff7f2716e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:07.208490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0dc41718-4e41-4ea2-99e4-810ff7f2716e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:07.213582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0dc41718-4e41-4ea2-99e4-810ff7f2716e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:07.214302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0dc41718-4e41-4ea2-99e4-810ff7f2716e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:07.780319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0dc41718-4e41-4ea2-99e4-810ff7f2716e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:07.793456 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0dc41718-4e41-4ea2-99e4-810ff7f2716e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1277 microversion: 2.1 time: 0.673777 Aug 09 17:23:07.794602 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1474/3067] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:07 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1277 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:07.808227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-52ba73da-1c0f-48f7-a106-7b55e96e0dc1 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbd81f0f70>, body: {"security_group_rule": {"parent_group_id": "03f92547-fd62-4b3e-8b06-04021897f52a", "ip_protocol": "tcp", "from_port": 24411193, "to_port": 22}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:08.549151 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-52ba73da-1c0f-48f7-a106-7b55e96e0dc1 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] HTTP exception thrown: Invalid port range 24411193:22. Former value cannot be greater than the later Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-52ba73da-1c0f-48f7-a106-7b55e96e0dc1 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Request method failure captured: Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 144 Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfuuNGTsF4G18FpBYpPO2-hnMwZn9JlpwO4NRPd_JGeTTqyYm9HbrItMOOXV8frGaghOxPfDCsCh-xyVbbg9IBSPDApUnr6gq-9ndd18xSfMlRd27B0UauMr2sygLVpoBDbm5Fo_HdMPeQLjAQQjjvpHdOR7EeZlL29bShxXfpt-yY Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 857e52de9ce84f369846ca639caa6999 Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: {"security_group_rule": {"parent_group_id": "03f92547-fd62-4b3e-8b06-04021897f52a", "ip_protocol": "tcp", "from_port": 24411193, "to_port": 22}} Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid port range 24411193:22. Former value cannot be greater than the later Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'security_group_rule': {'parent_group_id': '03f92547-fd62-4b3e-8b06-04021897f52a', 'ip_protocol': 'tcp', 'from_port': 24411193, 'to_port': 22}}} Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 24411193:22. Former value cannot be greater than the later Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 24411193:22. Former value cannot be greater than the later Aug 09 17:23:08.553575 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 24411193:22. Former value cannot be greater than the later Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-52ba73da-1c0f-48f7-a106-7b55e96e0dc1 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Returning 400 to user: Invalid port range 24411193:22. Former value cannot be greater than the later {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-52ba73da-1c0f-48f7-a106-7b55e96e0dc1 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 121 microversion: 2.1 time: 0.761232 Aug 09 17:23:08.576402 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1475/3068] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:23:07 2022] POST /compute/v2.1/os-security-group-rules => generated 121 bytes in 769 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:23:08.583914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-75745cc6-5ef8-4c5e-a630-146cf747a4b2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:08.589953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-75745cc6-5ef8-4c5e-a630-146cf747a4b2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:08.633974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75745cc6-5ef8-4c5e-a630-146cf747a4b2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:08.639033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75745cc6-5ef8-4c5e-a630-146cf747a4b2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:08.642473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75745cc6-5ef8-4c5e-a630-146cf747a4b2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:08.649288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75745cc6-5ef8-4c5e-a630-146cf747a4b2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:08.653083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75745cc6-5ef8-4c5e-a630-146cf747a4b2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:08.657521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75745cc6-5ef8-4c5e-a630-146cf747a4b2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:09.559493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:23:09.560893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:23:09.561864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:23:09.562998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:23:09.568257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:23:09.631923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:09.634565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:09.638794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:09.642653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:09.644562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:09.648183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:09.708700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:23:09.716106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for user be0fad88d219437eaed454ba916c86e3 and project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:23:09.773401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:23:09.778977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:23:09.879358 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a78d517d-8fda-4989-9ee4-9a0f48a44a30 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.062313 Aug 09 17:23:09.880685 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1594/3069] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:23:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 3064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:23:09.886381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:09.887607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 74cc072b-21ba-4456-8e16-2390ad0b0c44] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:09.897641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:09.898747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:09.899571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:09.900678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:09.901371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:09.902082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:09.922577 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] HTTP exception thrown: Instance 74cc072b-21ba-4456-8e16-2390ad0b0c44 could not be found. Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Request method failure captured: Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44 HTTP/1.1 Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8peGIw7oALHMJVppz1nnDDX2Nmokcs0zuOEWalgMfMkkTZEXZl4FrBZReUkpQFLLg-ih2wHIWypfKRDsIc1VDD8iJ9a1Mavy4-fRy_fQSavi3twRVW6Iag0pr18qdLxlGOHHJ-q-k-kMDKbLnMujzc2uKma0gdDMpx4UchtaPl2BZa4 Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8fc22300e744d5e92d7cc5806f771c9 Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ListServerFiltersTestJSON-1689544664 Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ListServerFiltersTestJSON-1689544664 Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8fc22300e744d5e92d7cc5806f771c9 Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1689544664 Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ListServerFiltersTestJSON-1689544664-project Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e785c5c340fa4d5c9e21691459bd6cb9 Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ListServerFiltersTestJSON-1689544664-project Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 74cc072b-21ba-4456-8e16-2390ad0b0c44 could not be found. Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '74cc072b-21ba-4456-8e16-2390ad0b0c44'} Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cc072b-21ba-4456-8e16-2390ad0b0c44 could not be found. Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cc072b-21ba-4456-8e16-2390ad0b0c44 could not be found. Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:09.924709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:09.929052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:09.929052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:09.929052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:09.929052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:09.929052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:09.929052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cc072b-21ba-4456-8e16-2390ad0b0c44 could not be found. Aug 09 17:23:09.929052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:09.933670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Returning 404 to user: Instance 74cc072b-21ba-4456-8e16-2390ad0b0c44 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:09.942362 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e058e1ab-74e8-4b04-b634-96a9be8eea40 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44" status: 404 len: 111 microversion: 2.1 time: 0.058589 Aug 09 17:23:09.944122 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1595/3070] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:09 2022] GET /compute/v2.1/servers/74cc072b-21ba-4456-8e16-2390ad0b0c44 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:23:09.960927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b07ab848-5ab5-421c-a26e-c05653e11882 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbcb6f5e50>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1026540093", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:09.966593 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b07ab848-5ab5-421c-a26e-c05653e11882 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] HTTP exception thrown: Security group id should be uuid Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b07ab848-5ab5-421c-a26e-c05653e11882 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Request method failure captured: Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 131 Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuuNGTsF4G18FpBYpPO2-hnMwZn9JlpwO4NRPd_JGeTTqyYm9HbrItMOOXV8frGaghOxPfDCsCh-xyVbbg9IBSPDApUnr6gq-9ndd18xSfMlRd27B0UauMr2sygLVpoBDbm5Fo_HdMPeQLjAQQjjvpHdOR7EeZlL29bShxXfpt-yY Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 857e52de9ce84f369846ca639caa6999 Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1026540093", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: exception: Security group id should be uuid Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1026540093', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:09.968792 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:09.973163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 09 17:23:09.973163 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:09.975027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b07ab848-5ab5-421c-a26e-c05653e11882 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Returning 400 to user: Security group id should be uuid {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:09.977008 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b07ab848-5ab5-421c-a26e-c05653e11882 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.030069 Aug 09 17:23:09.978255 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1596/3071] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:23:09 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:23:09.985371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ee0c06ee-7994-4807-a2e7-5950f086747c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:09.986354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ee0c06ee-7994-4807-a2e7-5950f086747c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:09.998549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee0c06ee-7994-4807-a2e7-5950f086747c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:09.999712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee0c06ee-7994-4807-a2e7-5950f086747c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:10.001501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee0c06ee-7994-4807-a2e7-5950f086747c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:10.002543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee0c06ee-7994-4807-a2e7-5950f086747c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:10.003231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee0c06ee-7994-4807-a2e7-5950f086747c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:10.003927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee0c06ee-7994-4807-a2e7-5950f086747c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:10.115388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ee0c06ee-7994-4807-a2e7-5950f086747c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:10.127016 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ee0c06ee-7994-4807-a2e7-5950f086747c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1275 microversion: 2.1 time: 0.147242 Aug 09 17:23:10.145180 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1597/3072] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:09 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:10.155742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-17d9308e-9a78-4450-9473-e84c507b221b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:10.156773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17d9308e-9a78-4450-9473-e84c507b221b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:10.177522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-75745cc6-5ef8-4c5e-a630-146cf747a4b2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:10.190841 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-75745cc6-5ef8-4c5e-a630-146cf747a4b2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1322 microversion: 2.1 time: 1.624098 Aug 09 17:23:10.192184 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1476/3073] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:08 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1322 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:10.219637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2ec78d55-dc14-4b21-ae42-60b3673fbbde tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:10.220509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2ec78d55-dc14-4b21-ae42-60b3673fbbde tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:10.232827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ec78d55-dc14-4b21-ae42-60b3673fbbde tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:10.233323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ec78d55-dc14-4b21-ae42-60b3673fbbde tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:10.233980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ec78d55-dc14-4b21-ae42-60b3673fbbde tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:10.234903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ec78d55-dc14-4b21-ae42-60b3673fbbde tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:10.237585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ec78d55-dc14-4b21-ae42-60b3673fbbde tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:10.238277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ec78d55-dc14-4b21-ae42-60b3673fbbde tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:10.275976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2ec78d55-dc14-4b21-ae42-60b3673fbbde tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:23:10.380400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:10.499910 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2ec78d55-dc14-4b21-ae42-60b3673fbbde tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "DELETE /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 204 len: 0 microversion: 2.1 time: 0.305831 Aug 09 17:23:10.501245 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1477/3074] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:23:10 2022] DELETE /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:23:10.512255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b1ef52e5-6d14-4204-8858-39774a34fb11 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbcb91edc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1531581940", "description": "tempest-description-1191970102"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:10.538209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-17d9308e-9a78-4450-9473-e84c507b221b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:10.552636 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-17d9308e-9a78-4450-9473-e84c507b221b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1240 microversion: 2.1 time: 0.402066 Aug 09 17:23:10.554803 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1598/3075] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:10 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1240 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:10.567659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f43d5a24-4c60-47cf-a7f5-00458f7f59da tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:10.574373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f43d5a24-4c60-47cf-a7f5-00458f7f59da tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:10.595239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f43d5a24-4c60-47cf-a7f5-00458f7f59da tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:10.608560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f43d5a24-4c60-47cf-a7f5-00458f7f59da tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:10.609187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f43d5a24-4c60-47cf-a7f5-00458f7f59da tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:10.609981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f43d5a24-4c60-47cf-a7f5-00458f7f59da tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:10.610466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f43d5a24-4c60-47cf-a7f5-00458f7f59da tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:10.610903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f43d5a24-4c60-47cf-a7f5-00458f7f59da tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:10.899218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f43d5a24-4c60-47cf-a7f5-00458f7f59da tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:10.927297 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f43d5a24-4c60-47cf-a7f5-00458f7f59da tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1517 microversion: 2.1 time: 0.360732 Aug 09 17:23:10.928305 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1599/3076] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:10 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1517 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:11.150578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1df15658-c8ba-4b47-b7e4-4c86ef33f048 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:11.151392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1df15658-c8ba-4b47-b7e4-4c86ef33f048 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:11.165123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1df15658-c8ba-4b47-b7e4-4c86ef33f048 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:11.165625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1df15658-c8ba-4b47-b7e4-4c86ef33f048 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:11.166361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1df15658-c8ba-4b47-b7e4-4c86ef33f048 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:11.170304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1df15658-c8ba-4b47-b7e4-4c86ef33f048 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:11.173585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1df15658-c8ba-4b47-b7e4-4c86ef33f048 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:11.174569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1df15658-c8ba-4b47-b7e4-4c86ef33f048 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:11.364022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1df15658-c8ba-4b47-b7e4-4c86ef33f048 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:11.384024 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1df15658-c8ba-4b47-b7e4-4c86ef33f048 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1275 microversion: 2.1 time: 0.237271 Aug 09 17:23:11.384633 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1600/3077] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:11 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:23:11.393102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c8e9ca5d-d580-4b6e-abf5-13529593655f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:11.405496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c8e9ca5d-d580-4b6e-abf5-13529593655f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:11.419513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ca5d-d580-4b6e-abf5-13529593655f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:11.426799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ca5d-d580-4b6e-abf5-13529593655f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:11.427757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ca5d-d580-4b6e-abf5-13529593655f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:11.428764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ca5d-d580-4b6e-abf5-13529593655f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:11.429521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ca5d-d580-4b6e-abf5-13529593655f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:11.430196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ca5d-d580-4b6e-abf5-13529593655f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:12.113649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c8e9ca5d-d580-4b6e-abf5-13529593655f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:12.167746 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c8e9ca5d-d580-4b6e-abf5-13529593655f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1517 microversion: 2.1 time: 0.776864 Aug 09 17:23:12.168364 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1601/3078] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:11 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1517 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:12.185473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-65a1ece6-7e00-445b-a39a-c4cbd415241d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:12.186455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-65a1ece6-7e00-445b-a39a-c4cbd415241d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:12.197145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65a1ece6-7e00-445b-a39a-c4cbd415241d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:12.203366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65a1ece6-7e00-445b-a39a-c4cbd415241d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:12.203863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65a1ece6-7e00-445b-a39a-c4cbd415241d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:12.204649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65a1ece6-7e00-445b-a39a-c4cbd415241d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:12.205246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65a1ece6-7e00-445b-a39a-c4cbd415241d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:12.205795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65a1ece6-7e00-445b-a39a-c4cbd415241d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:12.399299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-65a1ece6-7e00-445b-a39a-c4cbd415241d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:12.417710 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-65a1ece6-7e00-445b-a39a-c4cbd415241d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1236 microversion: 2.1 time: 0.247817 Aug 09 17:23:12.441216 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1602/3079] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:12 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1236 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:12.460272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51d1d500-8c8e-4582-b4c5-75bab29f417f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:12.461910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-51d1d500-8c8e-4582-b4c5-75bab29f417f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:12.482566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1d500-8c8e-4582-b4c5-75bab29f417f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:12.484248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1d500-8c8e-4582-b4c5-75bab29f417f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:12.486846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1d500-8c8e-4582-b4c5-75bab29f417f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:12.488529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1d500-8c8e-4582-b4c5-75bab29f417f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:12.489774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1d500-8c8e-4582-b4c5-75bab29f417f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:12.490926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1d500-8c8e-4582-b4c5-75bab29f417f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:12.884377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-51d1d500-8c8e-4582-b4c5-75bab29f417f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:12.905592 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51d1d500-8c8e-4582-b4c5-75bab29f417f tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1517 microversion: 2.1 time: 0.461928 Aug 09 17:23:12.906600 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1603/3080] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:12 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1517 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:12.919762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-471ab68f-2536-42af-8449-b1d27270aab6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:12.925573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-471ab68f-2536-42af-8449-b1d27270aab6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:12.942083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471ab68f-2536-42af-8449-b1d27270aab6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:12.942903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471ab68f-2536-42af-8449-b1d27270aab6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:12.943986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471ab68f-2536-42af-8449-b1d27270aab6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:12.946031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471ab68f-2536-42af-8449-b1d27270aab6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:12.946714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471ab68f-2536-42af-8449-b1d27270aab6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:12.947374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471ab68f-2536-42af-8449-b1d27270aab6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:13.040707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-471ab68f-2536-42af-8449-b1d27270aab6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lazy-loading 'flavor' on Instance uuid 750faee4-c702-4a68-b0ba-f57212ea276f {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:23:13.071530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:13.281859 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-471ab68f-2536-42af-8449-b1d27270aab6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f/action" status: 200 len: 32 microversion: 2.1 time: 0.372799 Aug 09 17:23:13.296770 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1604/3081] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:23:12 2022] POST /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f/action => generated 32 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:23:13.314632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-589f4d9f-fa1e-4d4c-9f66-a64b054b0c8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:13.334305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-589f4d9f-fa1e-4d4c-9f66-a64b054b0c8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:13.372757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589f4d9f-fa1e-4d4c-9f66-a64b054b0c8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:13.375525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589f4d9f-fa1e-4d4c-9f66-a64b054b0c8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:13.376846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589f4d9f-fa1e-4d4c-9f66-a64b054b0c8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:13.380995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589f4d9f-fa1e-4d4c-9f66-a64b054b0c8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:13.382404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589f4d9f-fa1e-4d4c-9f66-a64b054b0c8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:13.383535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-589f4d9f-fa1e-4d4c-9f66-a64b054b0c8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:13.822354 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b1ef52e5-6d14-4204-8858-39774a34fb11 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 3.317081 Aug 09 17:23:13.825890 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1478/3082] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:23:10 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 3323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:13.838393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dd118e9c-e8a2-440f-a9f0-c99309ae48ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:13.840598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dd118e9c-e8a2-440f-a9f0-c99309ae48ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:13.858649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd118e9c-e8a2-440f-a9f0-c99309ae48ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:13.860420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd118e9c-e8a2-440f-a9f0-c99309ae48ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:13.862660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd118e9c-e8a2-440f-a9f0-c99309ae48ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:13.866381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd118e9c-e8a2-440f-a9f0-c99309ae48ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:13.868983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd118e9c-e8a2-440f-a9f0-c99309ae48ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:13.870415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd118e9c-e8a2-440f-a9f0-c99309ae48ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:14.191676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-589f4d9f-fa1e-4d4c-9f66-a64b054b0c8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:14.232043 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-589f4d9f-fa1e-4d4c-9f66-a64b054b0c8e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1317 microversion: 2.1 time: 0.926361 Aug 09 17:23:14.238740 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1605/3083] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:13 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1317 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:14.314412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69fc7c27-f2b6-4dcc-9b4b-4367f525c5fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:14.317396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-69fc7c27-f2b6-4dcc-9b4b-4367f525c5fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:14.337602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69fc7c27-f2b6-4dcc-9b4b-4367f525c5fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:14.339978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69fc7c27-f2b6-4dcc-9b4b-4367f525c5fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:14.341452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69fc7c27-f2b6-4dcc-9b4b-4367f525c5fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:14.343226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69fc7c27-f2b6-4dcc-9b4b-4367f525c5fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:14.345525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69fc7c27-f2b6-4dcc-9b4b-4367f525c5fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:14.349428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69fc7c27-f2b6-4dcc-9b4b-4367f525c5fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:14.388729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:14.437065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:14.599834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-69fc7c27-f2b6-4dcc-9b4b-4367f525c5fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:14.626225 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69fc7c27-f2b6-4dcc-9b4b-4367f525c5fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1298 microversion: 2.1 time: 0.380640 Aug 09 17:23:14.639089 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1606/3084] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:14 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1298 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:14.664926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43a4dee3-ad5f-4c71-992f-3d9af53e1d4f tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbcb5e49d0>, body: {"security_group_rule": {"parent_group_id": "30e597f7-f036-43e5-bb25-a0c16214bd31", "ip_protocol": "tempest-999-517599232", "from_port": 22, "to_port": 22}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:14.937257 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-43a4dee3-ad5f-4c71-992f-3d9af53e1d4f tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] HTTP exception thrown: Invalid IP protocol tempest-999-517599232. Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43a4dee3-ad5f-4c71-992f-3d9af53e1d4f tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Request method failure captured: Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 156 Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuuNGTsF4G18FpBYpPO2-hnMwZn9JlpwO4NRPd_JGeTTqyYm9HbrItMOOXV8frGaghOxPfDCsCh-xyVbbg9IBSPDApUnr6gq-9ndd18xSfMlRd27B0UauMr2sygLVpoBDbm5Fo_HdMPeQLjAQQjjvpHdOR7EeZlL29bShxXfpt-yY Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 857e52de9ce84f369846ca639caa6999 Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: {"security_group_rule": {"parent_group_id": "30e597f7-f036-43e5-bb25-a0c16214bd31", "ip_protocol": "tempest-999-517599232", "from_port": 22, "to_port": 22}} Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid IP protocol tempest-999-517599232. Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'security_group_rule': {'parent_group_id': '30e597f7-f036-43e5-bb25-a0c16214bd31', 'ip_protocol': 'tempest-999-517599232', 'from_port': 22, 'to_port': 22}}} Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-517599232. Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-517599232. Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:14.941262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:14.954335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:14.954335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:14.954335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:14.954335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:14.954335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:14.954335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:14.954335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-517599232. Aug 09 17:23:14.954335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:14.954335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43a4dee3-ad5f-4c71-992f-3d9af53e1d4f tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Returning 400 to user: Invalid IP protocol tempest-999-517599232. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:14.954335 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43a4dee3-ad5f-4c71-992f-3d9af53e1d4f tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.302236 Aug 09 17:23:14.957957 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1607/3085] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:23:14 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 317 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:23:14.976772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9427e0d4-c194-467e-9cbe-efd4e5871123 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:14.986052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9427e0d4-c194-467e-9cbe-efd4e5871123 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:15.003424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:15.006473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9427e0d4-c194-467e-9cbe-efd4e5871123 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:15.007382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9427e0d4-c194-467e-9cbe-efd4e5871123 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:15.008218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9427e0d4-c194-467e-9cbe-efd4e5871123 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:15.009478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9427e0d4-c194-467e-9cbe-efd4e5871123 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:15.010309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9427e0d4-c194-467e-9cbe-efd4e5871123 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:15.011103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9427e0d4-c194-467e-9cbe-efd4e5871123 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:15.034682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dd118e9c-e8a2-440f-a9f0-c99309ae48ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:15.111412 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dd118e9c-e8a2-440f-a9f0-c99309ae48ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 1.280728 Aug 09 17:23:15.117699 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1479/3086] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:13 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:15.150137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-94234151-818d-44a7-99a1-c28422462465 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbcb5e33a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-571002217", "description": "tempest-description-2101656081"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:16.188553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9427e0d4-c194-467e-9cbe-efd4e5871123 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e785c5c340fa4d5c9e21691459bd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fc22300e744d5e92d7cc5806f771c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:16.211664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9427e0d4-c194-467e-9cbe-efd4e5871123 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 200 len: 1517 microversion: 2.1 time: 1.251956 Aug 09 17:23:16.212585 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1608/3087] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:14 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 1517 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:16.237656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-79b95c2c-2ecf-4b13-ad2a-71a2748af879 req-7bd0ddea-f9a4-4355-9e94-5101df6087ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135a3475-d24e-4b79-abd0-bd99f5344195", "name": "network-vif-unplugged", "status": "completed", "tag": "f2a9c808-4943-4a69-a090-18c6f4fb1bbf"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:16.283416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-79b95c2c-2ecf-4b13-ad2a-71a2748af879 req-7bd0ddea-f9a4-4355-9e94-5101df6087ee service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:16.285343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-79b95c2c-2ecf-4b13-ad2a-71a2748af879 req-7bd0ddea-f9a4-4355-9e94-5101df6087ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:16.286270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-79b95c2c-2ecf-4b13-ad2a-71a2748af879 req-7bd0ddea-f9a4-4355-9e94-5101df6087ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:16.327530 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-79b95c2c-2ecf-4b13-ad2a-71a2748af879 req-7bd0ddea-f9a4-4355-9e94-5101df6087ee service nova] Creating event network-vif-unplugged:f2a9c808-4943-4a69-a090-18c6f4fb1bbf for instance 135a3475-d24e-4b79-abd0-bd99f5344195 on n-h1-845781-6 Aug 09 17:23:16.339228 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-79b95c2c-2ecf-4b13-ad2a-71a2748af879 req-7bd0ddea-f9a4-4355-9e94-5101df6087ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123272 Aug 09 17:23:16.341274 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1609/3088] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:16.365866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c092e9e-b09a-44e0-ae7b-229561753e20 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:16.367492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c092e9e-b09a-44e0-ae7b-229561753e20 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:16.391513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c092e9e-b09a-44e0-ae7b-229561753e20 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:16.394190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c092e9e-b09a-44e0-ae7b-229561753e20 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:16.397523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c092e9e-b09a-44e0-ae7b-229561753e20 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:16.399699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c092e9e-b09a-44e0-ae7b-229561753e20 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:16.401197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c092e9e-b09a-44e0-ae7b-229561753e20 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:16.402358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c092e9e-b09a-44e0-ae7b-229561753e20 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:17.167122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c092e9e-b09a-44e0-ae7b-229561753e20 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:17.201956 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c092e9e-b09a-44e0-ae7b-229561753e20 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1317 microversion: 2.1 time: 0.857633 Aug 09 17:23:17.208846 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1610/3089] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:16 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:17.232882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5979ca66-e075-4dcc-abed-baa2caef85d6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:17.238150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5979ca66-e075-4dcc-abed-baa2caef85d6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:17.268170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5979ca66-e075-4dcc-abed-baa2caef85d6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:17.269458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5979ca66-e075-4dcc-abed-baa2caef85d6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:17.270534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5979ca66-e075-4dcc-abed-baa2caef85d6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:17.272498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5979ca66-e075-4dcc-abed-baa2caef85d6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:17.273911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5979ca66-e075-4dcc-abed-baa2caef85d6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:17.284949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5979ca66-e075-4dcc-abed-baa2caef85d6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:17.702262 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-94234151-818d-44a7-99a1-c28422462465 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.578613 Aug 09 17:23:17.707099 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1480/3090] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:23:15 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:17.733846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-34a85d6c-c285-4b0b-897e-b4ed8b2a4350 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:17.736612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-34a85d6c-c285-4b0b-897e-b4ed8b2a4350 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:17.753765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34a85d6c-c285-4b0b-897e-b4ed8b2a4350 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:17.755334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34a85d6c-c285-4b0b-897e-b4ed8b2a4350 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:17.756934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34a85d6c-c285-4b0b-897e-b4ed8b2a4350 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:17.761211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34a85d6c-c285-4b0b-897e-b4ed8b2a4350 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:17.762766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34a85d6c-c285-4b0b-897e-b4ed8b2a4350 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:17.764029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34a85d6c-c285-4b0b-897e-b4ed8b2a4350 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:18.015457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5979ca66-e075-4dcc-abed-baa2caef85d6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:18.049214 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5979ca66-e075-4dcc-abed-baa2caef85d6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1365 microversion: 2.1 time: 0.830150 Aug 09 17:23:18.073217 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1611/3091] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:17 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1365 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:18.096559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:18.098598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] [instance: 135a3475-d24e-4b79-abd0-bd99f5344195] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:18.112152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:18.113615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:18.114802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:18.116496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:18.117853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:18.119034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:18.176252 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] HTTP exception thrown: Instance 135a3475-d24e-4b79-abd0-bd99f5344195 could not be found. Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Request method failure captured: Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 HTTP/1.1 Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8peGIw7oALHMJVppz1nnDDX2Nmokcs0zuOEWalgMfMkkTZEXZl4FrBZReUkpQFLLg-ih2wHIWypfKRDsIc1VDD8iJ9a1Mavy4-fRy_fQSavi3twRVW6Iag0pr18qdLxlGOHHJ-q-k-kMDKbLnMujzc2uKma0gdDMpx4UchtaPl2BZa4 Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8fc22300e744d5e92d7cc5806f771c9 Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ListServerFiltersTestJSON-1689544664 Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8fc22300e744d5e92d7cc5806f771c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ListServerFiltersTestJSON-1689544664 Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8fc22300e744d5e92d7cc5806f771c9 Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1689544664 Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ListServerFiltersTestJSON-1689544664-project Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e785c5c340fa4d5c9e21691459bd6cb9 Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ListServerFiltersTestJSON-1689544664-project Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 135a3475-d24e-4b79-abd0-bd99f5344195 could not be found. Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '135a3475-d24e-4b79-abd0-bd99f5344195'} Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 135a3475-d24e-4b79-abd0-bd99f5344195 could not be found. Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 135a3475-d24e-4b79-abd0-bd99f5344195 could not be found. Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:18.181373 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:18.192994 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:18.192994 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:18.192994 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:18.192994 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:18.192994 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:18.192994 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 135a3475-d24e-4b79-abd0-bd99f5344195 could not be found. Aug 09 17:23:18.192994 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:18.219428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] Returning 404 to user: Instance 135a3475-d24e-4b79-abd0-bd99f5344195 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:18.221731 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b7b2cd0-2648-49eb-982a-70ea04908c19 tempest-ListServerFiltersTestJSON-1689544664 tempest-ListServerFiltersTestJSON-1689544664-project] 10.222.0.93 "GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195" status: 404 len: 111 microversion: 2.1 time: 0.146455 Aug 09 17:23:18.225749 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1612/3092] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:18 2022] GET /compute/v2.1/servers/135a3475-d24e-4b79-abd0-bd99f5344195 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:23:18.234247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-90e86c41-1ef4-4acf-8ba9-8bb6af491e66 req-c3d91e4e-4f6a-4e6e-8c7b-fe0e25d0cf02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135a3475-d24e-4b79-abd0-bd99f5344195", "name": "network-vif-deleted", "tag": "f2a9c808-4943-4a69-a090-18c6f4fb1bbf"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:18.245470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-90e86c41-1ef4-4acf-8ba9-8bb6af491e66 req-c3d91e4e-4f6a-4e6e-8c7b-fe0e25d0cf02 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:18.246305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-90e86c41-1ef4-4acf-8ba9-8bb6af491e66 req-c3d91e4e-4f6a-4e6e-8c7b-fe0e25d0cf02 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:18.247003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-90e86c41-1ef4-4acf-8ba9-8bb6af491e66 req-c3d91e4e-4f6a-4e6e-8c7b-fe0e25d0cf02 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:18.260428 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-90e86c41-1ef4-4acf-8ba9-8bb6af491e66 req-c3d91e4e-4f6a-4e6e-8c7b-fe0e25d0cf02 service nova] Creating event network-vif-deleted:f2a9c808-4943-4a69-a090-18c6f4fb1bbf for instance 135a3475-d24e-4b79-abd0-bd99f5344195 on n-h1-845781-6 Aug 09 17:23:18.283914 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-90e86c41-1ef4-4acf-8ba9-8bb6af491e66 req-c3d91e4e-4f6a-4e6e-8c7b-fe0e25d0cf02 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052755 Aug 09 17:23:18.285623 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1613/3093] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:18.291902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8fc04025-5295-4a80-99b7-63a892662bc4 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbcbcbf8b0>, body: {"security_group_rule": {"parent_group_id": "7ab682cd-cc17-47be-8f3c-5aa749eaa64d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:18.772303 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-8fc04025-5295-4a80-99b7-63a892662bc4 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8fc04025-5295-4a80-99b7-63a892662bc4 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Request method failure captured: Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 138 Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuuNGTsF4G18FpBYpPO2-hnMwZn9JlpwO4NRPd_JGeTTqyYm9HbrItMOOXV8frGaghOxPfDCsCh-xyVbbg9IBSPDApUnr6gq-9ndd18xSfMlRd27B0UauMr2sygLVpoBDbm5Fo_HdMPeQLjAQQjjvpHdOR7EeZlL29bShxXfpt-yY Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 857e52de9ce84f369846ca639caa6999 Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: {"security_group_rule": {"parent_group_id": "7ab682cd-cc17-47be-8f3c-5aa749eaa64d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7ab682cd-cc17-47be-8f3c-5aa749eaa64d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 09 17:23:18.775995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:18.785564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:18.785564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:18.785564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:18.785564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:18.785564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:18.785564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:18.785564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:18.785564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 09 17:23:18.785564 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:18.812100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8fc04025-5295-4a80-99b7-63a892662bc4 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:18.814737 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8fc04025-5295-4a80-99b7-63a892662bc4 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.527349 Aug 09 17:23:18.819870 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1614/3094] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:23:18 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 532 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:23:18.839086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87203d9b-b101-4bec-820e-947c791f0e49 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:18.841740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87203d9b-b101-4bec-820e-947c791f0e49 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:18.882299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87203d9b-b101-4bec-820e-947c791f0e49 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:18.886087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87203d9b-b101-4bec-820e-947c791f0e49 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:18.888054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87203d9b-b101-4bec-820e-947c791f0e49 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:18.898931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87203d9b-b101-4bec-820e-947c791f0e49 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:18.902993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87203d9b-b101-4bec-820e-947c791f0e49 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:18.904146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87203d9b-b101-4bec-820e-947c791f0e49 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:19.264116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-34a85d6c-c285-4b0b-897e-b4ed8b2a4350 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:19.315168 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-34a85d6c-c285-4b0b-897e-b4ed8b2a4350 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 1.600433 Aug 09 17:23:19.337366 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1481/3095] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:17 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:19.362511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2a4d34da-384b-4ad9-a197-a64e798c2bdd tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbcb577b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-538707686", "description": "tempest-description-759880841"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:19.538218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87203d9b-b101-4bec-820e-947c791f0e49 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:19.619781 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87203d9b-b101-4bec-820e-947c791f0e49 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1317 microversion: 2.1 time: 0.793495 Aug 09 17:23:19.622288 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1615/3096] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:18 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1317 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:19.673849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:19.790005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1724511416", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "055845a8-a394-4733-87e3-0b3f44e28918"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:20.238714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] validate_networks() for [('055845a8-a394-4733-87e3-0b3f44e28918', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:23:20.407066 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2a4d34da-384b-4ad9-a197-a64e798c2bdd tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.064503 Aug 09 17:23:20.408235 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1482/3097] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:23:19 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:20.429681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ffe98cea-d478-4340-989e-efc2e2440606 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:20.431311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ffe98cea-d478-4340-989e-efc2e2440606 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:20.465288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe98cea-d478-4340-989e-efc2e2440606 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:20.465876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe98cea-d478-4340-989e-efc2e2440606 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:20.468460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe98cea-d478-4340-989e-efc2e2440606 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:20.469892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe98cea-d478-4340-989e-efc2e2440606 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:20.471353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe98cea-d478-4340-989e-efc2e2440606 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:20.480090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe98cea-d478-4340-989e-efc2e2440606 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:20.546398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=14 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:21.466434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ffe98cea-d478-4340-989e-efc2e2440606 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:21.517375 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ffe98cea-d478-4340-989e-efc2e2440606 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1365 microversion: 2.1 time: 1.106504 Aug 09 17:23:21.518563 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1483/3098] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:20 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1365 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:21.547416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ad37ff1d-8790-4478-81a3-0adae6711c61 req-d176fe86-a467-477d-af66-7e56d1074137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9127e6b5-133b-4ddd-b1e3-74bbc628f235", "tag": "c8d3aa30-da38-4cd8-bcf1-e07ed775cc4d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:21.588664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ad37ff1d-8790-4478-81a3-0adae6711c61 req-d176fe86-a467-477d-af66-7e56d1074137 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:21.589419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ad37ff1d-8790-4478-81a3-0adae6711c61 req-d176fe86-a467-477d-af66-7e56d1074137 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:21.590196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ad37ff1d-8790-4478-81a3-0adae6711c61 req-d176fe86-a467-477d-af66-7e56d1074137 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:21.647246 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ad37ff1d-8790-4478-81a3-0adae6711c61 req-d176fe86-a467-477d-af66-7e56d1074137 service nova] Creating event network-changed:c8d3aa30-da38-4cd8-bcf1-e07ed775cc4d for instance 9127e6b5-133b-4ddd-b1e3-74bbc628f235 on n-h2-845781-6 Aug 09 17:23:21.662457 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ad37ff1d-8790-4478-81a3-0adae6711c61 req-d176fe86-a467-477d-af66-7e56d1074137 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141793 Aug 09 17:23:21.670819 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1484/3099] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:21.684342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0cbee800-9e57-48be-8993-b0c5b85cc09b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:21.685722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0cbee800-9e57-48be-8993-b0c5b85cc09b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:21.696675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbee800-9e57-48be-8993-b0c5b85cc09b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:21.702145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbee800-9e57-48be-8993-b0c5b85cc09b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:21.702955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbee800-9e57-48be-8993-b0c5b85cc09b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:21.704049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbee800-9e57-48be-8993-b0c5b85cc09b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:21.704855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbee800-9e57-48be-8993-b0c5b85cc09b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:21.705722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0cbee800-9e57-48be-8993-b0c5b85cc09b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:22.232005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0cbee800-9e57-48be-8993-b0c5b85cc09b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:22.249135 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0cbee800-9e57-48be-8993-b0c5b85cc09b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 0.574872 Aug 09 17:23:22.264339 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1485/3100] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:21 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:22.294514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d11a9f83-8fda-4235-ac5e-265d442c555e tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbdca11b80>, body: {"security_group_rule": {"parent_group_id": "11e545a8-290c-466d-a944-b8e533d661d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 1061193483}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:22.369652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:23:22.370418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:23:22.370594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:23:22.370929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:23:22.379372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:23:22.399175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:22.400103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:22.400740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:22.401719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:22.402357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:22.403495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:22.451366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Getting quotas for project 3d02fc56a4a14bb398febacd9f5d59b7. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:23:22.459208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Getting quotas for user 1ecbb00be7c34d3b930097d65e06ee21 and project 3d02fc56a4a14bb398febacd9f5d59b7. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:23:22.492776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:23:22.498299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:23:22.580779 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-d11a9f83-8fda-4235-ac5e-265d442c555e tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] HTTP exception thrown: Invalid port range 22:1061193483. Valid TCP ports should be between 1-65535 Aug 09 17:23:22.586977 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a5a21777-bc13-4e96-9550-77541d849012 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.958604 Aug 09 17:23:22.588080 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1616/3101] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:23:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d11a9f83-8fda-4235-ac5e-265d442c555e tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Request method failure captured: Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 146 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfuuNGTsF4G18FpBYpPO2-hnMwZn9JlpwO4NRPd_JGeTTqyYm9HbrItMOOXV8frGaghOxPfDCsCh-xyVbbg9IBSPDApUnr6gq-9ndd18xSfMlRd27B0UauMr2sygLVpoBDbm5Fo_HdMPeQLjAQQjjvpHdOR7EeZlL29bShxXfpt-yY Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 857e52de9ce84f369846ca639caa6999 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: {"security_group_rule": {"parent_group_id": "11e545a8-290c-466d-a944-b8e533d661d5", "ip_protocol": "tcp", "from_port": 22, "to_port": 1061193483}} Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid port range 22:1061193483. Valid TCP ports should be between 1-65535 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'security_group_rule': {'parent_group_id': '11e545a8-290c-466d-a944-b8e533d661d5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1061193483}}} Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1061193483. Valid TCP ports should be between 1-65535 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1061193483. Valid TCP ports should be between 1-65535 Aug 09 17:23:22.602869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:22.610394 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:22.610394 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:22.610394 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:22.610394 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:22.610394 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:22.610394 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:22.610394 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:22.610394 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1061193483. Valid TCP ports should be between 1-65535 Aug 09 17:23:22.610394 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:22.611430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-34b2e2ff-7252-4249-97a5-80f6ffc8620b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:22.611430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-34b2e2ff-7252-4249-97a5-80f6ffc8620b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:22.614888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d11a9f83-8fda-4235-ac5e-265d442c555e tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Returning 400 to user: Invalid port range 22:1061193483. Valid TCP ports should be between 1-65535 {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:22.618717 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d11a9f83-8fda-4235-ac5e-265d442c555e tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.343475 Aug 09 17:23:22.628898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b2e2ff-7252-4249-97a5-80f6ffc8620b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:22.629382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b2e2ff-7252-4249-97a5-80f6ffc8620b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:22.629822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b2e2ff-7252-4249-97a5-80f6ffc8620b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:22.630597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b2e2ff-7252-4249-97a5-80f6ffc8620b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:22.631054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b2e2ff-7252-4249-97a5-80f6ffc8620b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:22.631482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b2e2ff-7252-4249-97a5-80f6ffc8620b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:22.639288 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1486/3102] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:23:22 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 374 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:23:22.656386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-95ad136b-0fbb-4e4e-865d-25a4bef257f1 req-70dd345c-5dcf-4ee2-8a02-498eac332e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b120e8-277c-49bb-83e5-1de30e80fd50", "tag": "8c141125-13a2-4dc7-9c17-2908b01ba8da"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:22.758071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-95ad136b-0fbb-4e4e-865d-25a4bef257f1 req-70dd345c-5dcf-4ee2-8a02-498eac332e04 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:22.759096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-95ad136b-0fbb-4e4e-865d-25a4bef257f1 req-70dd345c-5dcf-4ee2-8a02-498eac332e04 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:22.766801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-95ad136b-0fbb-4e4e-865d-25a4bef257f1 req-70dd345c-5dcf-4ee2-8a02-498eac332e04 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:22.830499 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-95ad136b-0fbb-4e4e-865d-25a4bef257f1 req-70dd345c-5dcf-4ee2-8a02-498eac332e04 service nova] Creating event network-changed:8c141125-13a2-4dc7-9c17-2908b01ba8da for instance 55b120e8-277c-49bb-83e5-1de30e80fd50 on n-h1-845781-6 Aug 09 17:23:22.851225 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-95ad136b-0fbb-4e4e-865d-25a4bef257f1 req-70dd345c-5dcf-4ee2-8a02-498eac332e04 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203950 Aug 09 17:23:22.852316 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1487/3103] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:22.862886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bf326fc7-0843-49ba-8c75-203c385a069f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:22.866093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bf326fc7-0843-49ba-8c75-203c385a069f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:22.882768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf326fc7-0843-49ba-8c75-203c385a069f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:22.883686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf326fc7-0843-49ba-8c75-203c385a069f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:22.885002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf326fc7-0843-49ba-8c75-203c385a069f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:22.886313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf326fc7-0843-49ba-8c75-203c385a069f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:22.887161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf326fc7-0843-49ba-8c75-203c385a069f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:22.888359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf326fc7-0843-49ba-8c75-203c385a069f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:23.608305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bf326fc7-0843-49ba-8c75-203c385a069f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:23.625145 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bf326fc7-0843-49ba-8c75-203c385a069f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1365 microversion: 2.1 time: 0.770762 Aug 09 17:23:23.647031 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1488/3104] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:22 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1365 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:23.678817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6b672f49-c5a5-4048-8f4e-5afc2d8db33c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:23.681551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-34b2e2ff-7252-4249-97a5-80f6ffc8620b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:23.685601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6b672f49-c5a5-4048-8f4e-5afc2d8db33c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:23.719236 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-34b2e2ff-7252-4249-97a5-80f6ffc8620b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1317 microversion: 2.1 time: 1.129756 Aug 09 17:23:23.724587 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1617/3105] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:22 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1317 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:23.741593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb06b199-298f-4b2e-8f4c-f3afe87c3309 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Action: 'create', calling method: .version_select at 0x7fbbcb6f5f70>, body: {"security_group_rule": {"parent_group_id": "cfc0cea9-4cbb-4938-a605-b7a42fbeb383", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:23.842744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG neutronclient.v2_0.client [None req-eb06b199-298f-4b2e-8f4c-f3afe87c3309 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cfc0cea9-4cbb-4938-a605-b7a42fbeb383 does not exist", "detail": ""}} {{(pid=119431) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:23:23.844374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.security_group_api [None req-eb06b199-298f-4b2e-8f4c-f3afe87c3309 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Neutron security group cfc0cea9-4cbb-4938-a605-b7a42fbeb383 not found {{(pid=119431) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 17:23:23.845109 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-eb06b199-298f-4b2e-8f4c-f3afe87c3309 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] HTTP exception thrown: Security group cfc0cea9-4cbb-4938-a605-b7a42fbeb383 does not exist Aug 09 17:23:23.845109 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-f84d2b06-2bb2-404d-be01-0754bac56452'] Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb06b199-298f-4b2e-8f4c-f3afe87c3309 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Request method failure captured: Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 138 Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuuNGTsF4G18FpBYpPO2-hnMwZn9JlpwO4NRPd_JGeTTqyYm9HbrItMOOXV8frGaghOxPfDCsCh-xyVbbg9IBSPDApUnr6gq-9ndd18xSfMlRd27B0UauMr2sygLVpoBDbm5Fo_HdMPeQLjAQQjjvpHdOR7EeZlL29bShxXfpt-yY Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 857e52de9ce84f369846ca639caa6999 Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: {"security_group_rule": {"parent_group_id": "cfc0cea9-4cbb-4938-a605-b7a42fbeb383", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: exception: Security group cfc0cea9-4cbb-4938-a605-b7a42fbeb383 does not exist Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-f84d2b06-2bb2-404d-be01-0754bac56452'] Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cfc0cea9-4cbb-4938-a605-b7a42fbeb383', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:23:23.848281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cfc0cea9-4cbb-4938-a605-b7a42fbeb383 does not exist Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f84d2b06-2bb2-404d-be01-0754bac56452'] Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cfc0cea9-4cbb-4938-a605-b7a42fbeb383 does not exist Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f84d2b06-2bb2-404d-be01-0754bac56452'] Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cfc0cea9-4cbb-4938-a605-b7a42fbeb383 does not exist Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f84d2b06-2bb2-404d-be01-0754bac56452'] Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cfc0cea9-4cbb-4938-a605-b7a42fbeb383 does not exist Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f84d2b06-2bb2-404d-be01-0754bac56452'] Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb06b199-298f-4b2e-8f4c-f3afe87c3309 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Returning 404 to user: Security group cfc0cea9-4cbb-4938-a605-b7a42fbeb383 does not exist Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-f84d2b06-2bb2-404d-be01-0754bac56452'] {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:23.857945 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eb06b199-298f-4b2e-8f4c-f3afe87c3309 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.121994 Aug 09 17:23:23.867407 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1618/3106] 10.222.0.93 () {60 vars in 1195 bytes} [Tue Aug 9 17:23:23 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:23:23.878403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f55358a7-92eb-42fb-ba83-4c8e45527297 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:23.878987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f55358a7-92eb-42fb-ba83-4c8e45527297 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:23.897602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f55358a7-92eb-42fb-ba83-4c8e45527297 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:23.900871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f55358a7-92eb-42fb-ba83-4c8e45527297 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:23.905063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f55358a7-92eb-42fb-ba83-4c8e45527297 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:23.929201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f55358a7-92eb-42fb-ba83-4c8e45527297 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:23.930317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f55358a7-92eb-42fb-ba83-4c8e45527297 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:23.931017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f55358a7-92eb-42fb-ba83-4c8e45527297 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:24.718030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6b672f49-c5a5-4048-8f4e-5afc2d8db33c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:24.763038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f55358a7-92eb-42fb-ba83-4c8e45527297 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:24.795511 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6b672f49-c5a5-4048-8f4e-5afc2d8db33c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1218 microversion: 2.1 time: 1.139363 Aug 09 17:23:24.798434 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f55358a7-92eb-42fb-ba83-4c8e45527297 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 0.936747 Aug 09 17:23:24.799031 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1619/3107] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:23 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:24.802483 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1489/3108] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:23 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1218 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:24.811914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d435b80c-d545-46e4-86cb-846695483718 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Calling method '.version_select at 0x7fbbcb6f5f70>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:24.847210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fb8bf95d-4a6a-463d-b8c8-56802f9c2dcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:24.853085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fb8bf95d-4a6a-463d-b8c8-56802f9c2dcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:24.864850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb8bf95d-4a6a-463d-b8c8-56802f9c2dcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:24.866536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb8bf95d-4a6a-463d-b8c8-56802f9c2dcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:24.868781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb8bf95d-4a6a-463d-b8c8-56802f9c2dcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:24.871446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb8bf95d-4a6a-463d-b8c8-56802f9c2dcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:24.872322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb8bf95d-4a6a-463d-b8c8-56802f9c2dcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:24.872971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb8bf95d-4a6a-463d-b8c8-56802f9c2dcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:24.992387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG neutronclient.v2_0.client [None req-d435b80c-d545-46e4-86cb-846695483718 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 0a3ef52e-5caa-4f3c-98b9-60918a660880 does not exist", "detail": ""}} {{(pid=119431) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 17:23:24.994440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.security_group_api [None req-d435b80c-d545-46e4-86cb-846695483718 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Neutron security group rule 0a3ef52e-5caa-4f3c-98b9-60918a660880 not found {{(pid=119431) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 09 17:23:24.995412 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d435b80c-d545-46e4-86cb-846695483718 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] HTTP exception thrown: Security group rule 0a3ef52e-5caa-4f3c-98b9-60918a660880 does not exist Aug 09 17:23:24.995412 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-d2a693f5-fa35-43cc-a6f1-dfb195b31083'] Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d435b80c-d545-46e4-86cb-846695483718 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Request method failure captured: Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/os-security-group-rules/0a3ef52e-5caa-4f3c-98b9-60918a660880 HTTP/1.1 Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuuNGTsF4G18FpBYpPO2-hnMwZn9JlpwO4NRPd_JGeTTqyYm9HbrItMOOXV8frGaghOxPfDCsCh-xyVbbg9IBSPDApUnr6gq-9ndd18xSfMlRd27B0UauMr2sygLVpoBDbm5Fo_HdMPeQLjAQQjjvpHdOR7EeZlL29bShxXfpt-yY Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8578ec37c294e1dbac5d4f10a55fb34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8578ec37c294e1dbac5d4f10a55fb34 Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012 Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 857e52de9ce84f369846ca639caa6999 Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168238012-project Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: exception: Security group rule 0a3ef52e-5caa-4f3c-98b9-60918a660880 does not exist Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-d2a693f5-fa35-43cc-a6f1-dfb195b31083'] Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '0a3ef52e-5caa-4f3c-98b9-60918a660880'} Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 17:23:25.000448 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 0a3ef52e-5caa-4f3c-98b9-60918a660880 does not exist Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2a693f5-fa35-43cc-a6f1-dfb195b31083'] Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 0a3ef52e-5caa-4f3c-98b9-60918a660880 does not exist Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2a693f5-fa35-43cc-a6f1-dfb195b31083'] Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 0a3ef52e-5caa-4f3c-98b9-60918a660880 does not exist Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2a693f5-fa35-43cc-a6f1-dfb195b31083'] Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 0a3ef52e-5caa-4f3c-98b9-60918a660880 does not exist Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2a693f5-fa35-43cc-a6f1-dfb195b31083'] Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d435b80c-d545-46e4-86cb-846695483718 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Returning 404 to user: Security group rule 0a3ef52e-5caa-4f3c-98b9-60918a660880 does not exist Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: Neutron server returns request_ids: ['req-d2a693f5-fa35-43cc-a6f1-dfb195b31083'] {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d435b80c-d545-46e4-86cb-846695483718 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-group-rules/0a3ef52e-5caa-4f3c-98b9-60918a660880" status: 404 len: 199 microversion: 2.1 time: 0.206973 Aug 09 17:23:25.016596 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1620/3109] 10.222.0.93 () {58 vars in 1287 bytes} [Tue Aug 9 17:23:24 2022] DELETE /compute/v2.1/os-security-group-rules/0a3ef52e-5caa-4f3c-98b9-60918a660880 => generated 199 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:23:25.028895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75b2041f-6a0d-4fea-8e1c-7905027eb646 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:25.028895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75b2041f-6a0d-4fea-8e1c-7905027eb646 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:25.048549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b2041f-6a0d-4fea-8e1c-7905027eb646 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:25.049332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b2041f-6a0d-4fea-8e1c-7905027eb646 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:25.051122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b2041f-6a0d-4fea-8e1c-7905027eb646 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:25.052133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b2041f-6a0d-4fea-8e1c-7905027eb646 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:25.052828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b2041f-6a0d-4fea-8e1c-7905027eb646 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:25.053750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b2041f-6a0d-4fea-8e1c-7905027eb646 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:25.835365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-75b2041f-6a0d-4fea-8e1c-7905027eb646 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:25.867272 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75b2041f-6a0d-4fea-8e1c-7905027eb646 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1317 microversion: 2.1 time: 0.848184 Aug 09 17:23:25.870553 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1621/3110] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:25 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1317 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:25.886349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f9478a83-ac8f-4b46-b5e9-1235b466d248 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Calling method '.version_select at 0x7fbbcbe170d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:25.923502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fb8bf95d-4a6a-463d-b8c8-56802f9c2dcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:25.942989 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fb8bf95d-4a6a-463d-b8c8-56802f9c2dcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1365 microversion: 2.1 time: 1.124010 Aug 09 17:23:25.945349 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1490/3111] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:24 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1365 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:25.958159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ce9e46aa-5da3-4f5f-8077-53b62ad3d1ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:25.961081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ce9e46aa-5da3-4f5f-8077-53b62ad3d1ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:25.978852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce9e46aa-5da3-4f5f-8077-53b62ad3d1ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:25.980794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce9e46aa-5da3-4f5f-8077-53b62ad3d1ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:25.982695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce9e46aa-5da3-4f5f-8077-53b62ad3d1ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:25.984497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce9e46aa-5da3-4f5f-8077-53b62ad3d1ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:25.986794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce9e46aa-5da3-4f5f-8077-53b62ad3d1ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:25.989469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce9e46aa-5da3-4f5f-8077-53b62ad3d1ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:26.386522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ce9e46aa-5da3-4f5f-8077-53b62ad3d1ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:26.402844 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ce9e46aa-5da3-4f5f-8077-53b62ad3d1ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1276 microversion: 2.1 time: 0.454899 Aug 09 17:23:26.420212 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1491/3112] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:25 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1276 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:26.442302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-572e5ec9-8b17-4ade-95f0-eccba6158a23 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:26.444122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-572e5ec9-8b17-4ade-95f0-eccba6158a23 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:26.456097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-572e5ec9-8b17-4ade-95f0-eccba6158a23 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:26.457540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-572e5ec9-8b17-4ade-95f0-eccba6158a23 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:26.458772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-572e5ec9-8b17-4ade-95f0-eccba6158a23 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:26.460509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-572e5ec9-8b17-4ade-95f0-eccba6158a23 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:26.462194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-572e5ec9-8b17-4ade-95f0-eccba6158a23 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:26.463103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-572e5ec9-8b17-4ade-95f0-eccba6158a23 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:26.632608 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f9478a83-ac8f-4b46-b5e9-1235b466d248 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/11e545a8-290c-466d-a944-b8e533d661d5" status: 202 len: 0 microversion: 2.1 time: 0.754967 Aug 09 17:23:26.634258 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1622/3113] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:23:25 2022] DELETE /compute/v2.1/os-security-groups/11e545a8-290c-466d-a944-b8e533d661d5 => generated 0 bytes in 761 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:23:26.657699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b3600ab-0a7b-447d-851a-c55c4f13a18e tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Calling method '.version_select at 0x7fbbcbae9670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:27.243608 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b3600ab-0a7b-447d-851a-c55c4f13a18e tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/7ab682cd-cc17-47be-8f3c-5aa749eaa64d" status: 202 len: 0 microversion: 2.1 time: 0.602246 Aug 09 17:23:27.245077 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1623/3114] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:23:26 2022] DELETE /compute/v2.1/os-security-groups/7ab682cd-cc17-47be-8f3c-5aa749eaa64d => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:23:27.261549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-68e5a4a0-fe72-4281-a798-8f349cff3e3d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:27.262838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-68e5a4a0-fe72-4281-a798-8f349cff3e3d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:27.290512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68e5a4a0-fe72-4281-a798-8f349cff3e3d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:27.291413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68e5a4a0-fe72-4281-a798-8f349cff3e3d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:27.292253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68e5a4a0-fe72-4281-a798-8f349cff3e3d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:27.294078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68e5a4a0-fe72-4281-a798-8f349cff3e3d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:27.294928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68e5a4a0-fe72-4281-a798-8f349cff3e3d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:27.305038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68e5a4a0-fe72-4281-a798-8f349cff3e3d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:27.424371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-572e5ec9-8b17-4ade-95f0-eccba6158a23 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:27.480339 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-572e5ec9-8b17-4ade-95f0-eccba6158a23 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 1.055922 Aug 09 17:23:27.483969 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1492/3115] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:26 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:27.505294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2998c0f4-521e-49c5-946c-58edb3c8dcee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:27.510577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2998c0f4-521e-49c5-946c-58edb3c8dcee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:27.561033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2998c0f4-521e-49c5-946c-58edb3c8dcee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:27.562699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2998c0f4-521e-49c5-946c-58edb3c8dcee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:27.564750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2998c0f4-521e-49c5-946c-58edb3c8dcee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:27.567337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2998c0f4-521e-49c5-946c-58edb3c8dcee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:27.568530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2998c0f4-521e-49c5-946c-58edb3c8dcee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:27.569622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2998c0f4-521e-49c5-946c-58edb3c8dcee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:27.826563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-68e5a4a0-fe72-4281-a798-8f349cff3e3d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:27.845085 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-68e5a4a0-fe72-4281-a798-8f349cff3e3d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1317 microversion: 2.1 time: 0.597852 Aug 09 17:23:27.846091 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1624/3116] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:27 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:27.867619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-55b6d72e-e98a-47cd-81a9-54a4508ba9ad tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Calling method '.version_select at 0x7fbbcb8bbe50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:28.065763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2998c0f4-521e-49c5-946c-58edb3c8dcee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:28.082295 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2998c0f4-521e-49c5-946c-58edb3c8dcee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1365 microversion: 2.1 time: 0.592040 Aug 09 17:23:28.084194 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1493/3117] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:27 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1365 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:28.100453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6c313135-49f5-41e4-88da-dd4492890597 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:28.104318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6c313135-49f5-41e4-88da-dd4492890597 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:28.125384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c313135-49f5-41e4-88da-dd4492890597 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:28.127341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c313135-49f5-41e4-88da-dd4492890597 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:28.127848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c313135-49f5-41e4-88da-dd4492890597 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:28.128616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c313135-49f5-41e4-88da-dd4492890597 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:28.132717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c313135-49f5-41e4-88da-dd4492890597 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:28.133386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c313135-49f5-41e4-88da-dd4492890597 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:28.527268 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-55b6d72e-e98a-47cd-81a9-54a4508ba9ad tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/30e597f7-f036-43e5-bb25-a0c16214bd31" status: 202 len: 0 microversion: 2.1 time: 0.679515 Aug 09 17:23:28.533845 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1625/3118] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:23:27 2022] DELETE /compute/v2.1/os-security-groups/30e597f7-f036-43e5-bb25-a0c16214bd31 => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:23:28.613691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6c313135-49f5-41e4-88da-dd4492890597 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:28.626143 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6c313135-49f5-41e4-88da-dd4492890597 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1318 microversion: 2.1 time: 0.539380 Aug 09 17:23:28.632328 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1494/3119] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:28 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:28.644889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a1218a19-1e11-4611-a1e8-52e2ffa70d8f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:28.647864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a1218a19-1e11-4611-a1e8-52e2ffa70d8f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:28.683738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a1218a19-1e11-4611-a1e8-52e2ffa70d8f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:28.688469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a1218a19-1e11-4611-a1e8-52e2ffa70d8f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:28.692162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a1218a19-1e11-4611-a1e8-52e2ffa70d8f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:28.693025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a1218a19-1e11-4611-a1e8-52e2ffa70d8f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:28.693524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a1218a19-1e11-4611-a1e8-52e2ffa70d8f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:28.693971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a1218a19-1e11-4611-a1e8-52e2ffa70d8f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:29.213745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a37048c3-c962-4e45-ae6f-2eb0191bac09 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Action: 'create', calling method: .version_select at 0x7fbbcb6808b0>, body: {"keypair": {"name": "tempest-keypair-503018447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQte6zdJhpoTqzD1Y/vGMZEz2ji2hvkSR/Qz6XiDdJLzVMG8l9n9OHwwgrinrgJCp39BmDOUq04QGWwPyAab8XpuhWb5NJUNQoRyi+BI+n6jb2pAR6y0b1IEsq5CZXfEQ=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:29.286781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a37048c3-c962-4e45-ae6f-2eb0191bac09 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Getting quotas for project c281514960bd499d83a4f683bf269d9e. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:23:29.315551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a37048c3-c962-4e45-ae6f-2eb0191bac09 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Getting quotas for user c3910e7ce0b2488cadb01e3d6e617e94 and project c281514960bd499d83a4f683bf269d9e. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:23:29.363950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a1218a19-1e11-4611-a1e8-52e2ffa70d8f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:29.379906 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a37048c3-c962-4e45-ae6f-2eb0191bac09 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.844229 Aug 09 17:23:29.382516 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1626/3120] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:23:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:29.386908 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a1218a19-1e11-4611-a1e8-52e2ffa70d8f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 0.752478 Aug 09 17:23:29.395315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-73c6aeae-7b69-4ac3-9320-899dca06b2cd tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Calling method '.version_select at 0x7fbbcb680160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:29.401472 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1495/3121] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:28 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:29.422205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6b689403-3243-473d-a939-7f171a75d5ef tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:29.422852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6b689403-3243-473d-a939-7f171a75d5ef tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:29.438846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b689403-3243-473d-a939-7f171a75d5ef tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:29.439490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b689403-3243-473d-a939-7f171a75d5ef tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:29.439988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b689403-3243-473d-a939-7f171a75d5ef tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:29.440998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b689403-3243-473d-a939-7f171a75d5ef tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:29.441728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b689403-3243-473d-a939-7f171a75d5ef tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:29.442390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6b689403-3243-473d-a939-7f171a75d5ef tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:29.865840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6b689403-3243-473d-a939-7f171a75d5ef tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:29.876957 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6b689403-3243-473d-a939-7f171a75d5ef tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1317 microversion: 2.1 time: 0.474441 Aug 09 17:23:29.879097 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1496/3122] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:29 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:30.152305 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-73c6aeae-7b69-4ac3-9320-899dca06b2cd tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/03f92547-fd62-4b3e-8b06-04021897f52a" status: 202 len: 0 microversion: 2.1 time: 0.766840 Aug 09 17:23:30.161413 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1627/3123] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:23:29 2022] DELETE /compute/v2.1/os-security-groups/03f92547-fd62-4b3e-8b06-04021897f52a => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:23:30.214799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-98a8cc2e-e3fc-497f-896a-70e54eb51685 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:30.220901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-98a8cc2e-e3fc-497f-896a-70e54eb51685 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:30.260601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98a8cc2e-e3fc-497f-896a-70e54eb51685 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:30.265512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98a8cc2e-e3fc-497f-896a-70e54eb51685 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:30.269532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98a8cc2e-e3fc-497f-896a-70e54eb51685 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:30.272272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98a8cc2e-e3fc-497f-896a-70e54eb51685 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:30.278410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98a8cc2e-e3fc-497f-896a-70e54eb51685 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:30.282605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98a8cc2e-e3fc-497f-896a-70e54eb51685 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:30.690289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-98a8cc2e-e3fc-497f-896a-70e54eb51685 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:30.714814 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-98a8cc2e-e3fc-497f-896a-70e54eb51685 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1365 microversion: 2.1 time: 0.550409 Aug 09 17:23:30.728966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-534971396", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": "none"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:30.733229 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1628/3124] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:30 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1365 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:30.740105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6bf4c2ca-9c9d-401f-bc7a-fd1b3616c94b req-0636e4c2-69db-44c3-9f26-5c7f981a4880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9127e6b5-133b-4ddd-b1e3-74bbc628f235", "name": "network-vif-plugged", "status": "completed", "tag": "c8d3aa30-da38-4cd8-bcf1-e07ed775cc4d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:30.754710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6bf4c2ca-9c9d-401f-bc7a-fd1b3616c94b req-0636e4c2-69db-44c3-9f26-5c7f981a4880 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:30.755551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6bf4c2ca-9c9d-401f-bc7a-fd1b3616c94b req-0636e4c2-69db-44c3-9f26-5c7f981a4880 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:30.756388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6bf4c2ca-9c9d-401f-bc7a-fd1b3616c94b req-0636e4c2-69db-44c3-9f26-5c7f981a4880 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:30.807491 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6bf4c2ca-9c9d-401f-bc7a-fd1b3616c94b req-0636e4c2-69db-44c3-9f26-5c7f981a4880 service nova] Creating event network-vif-plugged:c8d3aa30-da38-4cd8-bcf1-e07ed775cc4d for instance 9127e6b5-133b-4ddd-b1e3-74bbc628f235 on n-h2-845781-6 Aug 09 17:23:30.830782 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6bf4c2ca-9c9d-401f-bc7a-fd1b3616c94b req-0636e4c2-69db-44c3-9f26-5c7f981a4880 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093117 Aug 09 17:23:30.832932 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1629/3125] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:30.847455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-006ad12a-06e6-4138-8bcf-12933580702c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:30.853210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-006ad12a-06e6-4138-8bcf-12933580702c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:30.867505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-006ad12a-06e6-4138-8bcf-12933580702c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:30.870569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-006ad12a-06e6-4138-8bcf-12933580702c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:30.871275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-006ad12a-06e6-4138-8bcf-12933580702c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:30.874316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-006ad12a-06e6-4138-8bcf-12933580702c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:30.875050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-006ad12a-06e6-4138-8bcf-12933580702c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:30.875722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-006ad12a-06e6-4138-8bcf-12933580702c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:30.946959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:23:30.947848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:23:30.948240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:23:30.948719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:23:30.949518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:23:30.984342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:30.999146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:31.000057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:31.001128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:31.001861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:31.002517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:31.035377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Getting quotas for project df2ee862ae5c47aab80e7582eb6ef8a0. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:23:31.042580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Getting quotas for user d540f70612584f938785be87eeb60b0a and project df2ee862ae5c47aab80e7582eb6ef8a0. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:23:31.058686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:23:31.062024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:23:31.172491 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e9343d17-7838-48cb-a1bd-2d1657953cf1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.291065 Aug 09 17:23:31.174979 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1497/3126] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:23:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:23:31.201600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-753f167b-65f4-4a89-8b31-e9886336d155 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] Calling method '.version_select at 0x7fbbcb72a4c0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:31.275471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-006ad12a-06e6-4138-8bcf-12933580702c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:31.302901 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-006ad12a-06e6-4138-8bcf-12933580702c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1318 microversion: 2.1 time: 0.467317 Aug 09 17:23:31.304014 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1630/3127] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:30 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:31.344309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a53c5464-b1d2-418e-907a-e998ec959427 req-d1fe12f4-8844-47df-85bb-6ec94919856c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6760ec-412a-42a8-968d-ce3ebf298c73", "tag": "7dab4def-547e-43a1-9b87-13b83eb68166"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:31.370701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a53c5464-b1d2-418e-907a-e998ec959427 req-d1fe12f4-8844-47df-85bb-6ec94919856c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:31.372932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a53c5464-b1d2-418e-907a-e998ec959427 req-d1fe12f4-8844-47df-85bb-6ec94919856c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:31.374669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a53c5464-b1d2-418e-907a-e998ec959427 req-d1fe12f4-8844-47df-85bb-6ec94919856c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:31.449488 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a53c5464-b1d2-418e-907a-e998ec959427 req-d1fe12f4-8844-47df-85bb-6ec94919856c service nova] Creating event network-changed:7dab4def-547e-43a1-9b87-13b83eb68166 for instance cd6760ec-412a-42a8-968d-ce3ebf298c73 on n-h1-845781-6 Aug 09 17:23:31.464104 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a53c5464-b1d2-418e-907a-e998ec959427 req-d1fe12f4-8844-47df-85bb-6ec94919856c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152326 Aug 09 17:23:31.465947 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1631/3128] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:31.494118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6cfe000c-ef0e-40b5-83ba-13c1e613e51f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:31.499132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6cfe000c-ef0e-40b5-83ba-13c1e613e51f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:31.541134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfe000c-ef0e-40b5-83ba-13c1e613e51f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:31.542392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfe000c-ef0e-40b5-83ba-13c1e613e51f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:31.543322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfe000c-ef0e-40b5-83ba-13c1e613e51f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:31.544977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfe000c-ef0e-40b5-83ba-13c1e613e51f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:31.546143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfe000c-ef0e-40b5-83ba-13c1e613e51f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:31.547172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cfe000c-ef0e-40b5-83ba-13c1e613e51f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:31.662177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:32.063596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6cfe000c-ef0e-40b5-83ba-13c1e613e51f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:32.105855 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6cfe000c-ef0e-40b5-83ba-13c1e613e51f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 0.629098 Aug 09 17:23:32.109120 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1632/3129] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:31 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:32.130436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b5b5b21e-d0a2-4064-a8f2-c96d57e8c15b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:32.131850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b5b5b21e-d0a2-4064-a8f2-c96d57e8c15b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:32.158718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5b5b21e-d0a2-4064-a8f2-c96d57e8c15b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:32.161004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5b5b21e-d0a2-4064-a8f2-c96d57e8c15b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:32.162594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5b5b21e-d0a2-4064-a8f2-c96d57e8c15b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:32.166232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5b5b21e-d0a2-4064-a8f2-c96d57e8c15b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:32.167530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5b5b21e-d0a2-4064-a8f2-c96d57e8c15b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:32.169262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5b5b21e-d0a2-4064-a8f2-c96d57e8c15b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:32.441947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:32.946006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b5b5b21e-d0a2-4064-a8f2-c96d57e8c15b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:32.968761 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b5b5b21e-d0a2-4064-a8f2-c96d57e8c15b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1317 microversion: 2.1 time: 0.858120 Aug 09 17:23:32.982533 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1633/3130] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:32 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1317 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:32.988034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:32.991463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:33.010548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:33.014298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:33.015173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:33.019915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:33.021658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:33.021658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:33.127297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:33.141655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:33.153278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:33.161705 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d0793bdf-3225-4fc8-97ad-19b08ee5e0ab tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5" status: 200 len: 1332 microversion: 2.47 time: 0.177141 Aug 09 17:23:33.167233 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1634/3131] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:23:32 2022] GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 => generated 1332 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:23:33.184383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-735eb7ad-179f-44b1-929e-7b8997b1b4d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:33.185513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-735eb7ad-179f-44b1-929e-7b8997b1b4d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:33.213929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-735eb7ad-179f-44b1-929e-7b8997b1b4d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:33.214790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-735eb7ad-179f-44b1-929e-7b8997b1b4d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:33.222805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-735eb7ad-179f-44b1-929e-7b8997b1b4d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:33.224198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-735eb7ad-179f-44b1-929e-7b8997b1b4d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:33.230563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-735eb7ad-179f-44b1-929e-7b8997b1b4d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:33.231099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-735eb7ad-179f-44b1-929e-7b8997b1b4d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:33.245155 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-753f167b-65f4-4a89-8b31-e9886336d155 tempest-SecurityGroupRulesNegativeTestJSON-168238012 tempest-SecurityGroupRulesNegativeTestJSON-168238012-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/7b14dcb8-4b6f-4390-80f5-79103af4710a" status: 202 len: 0 microversion: 2.1 time: 2.067046 Aug 09 17:23:33.249823 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1498/3132] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:23:31 2022] DELETE /compute/v2.1/os-security-groups/7b14dcb8-4b6f-4390-80f5-79103af4710a => generated 0 bytes in 2074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:23:33.264151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e2cb7eb7-0b99-4ef8-90b1-1423ee050288 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:33.265685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e2cb7eb7-0b99-4ef8-90b1-1423ee050288 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:33.286630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2cb7eb7-0b99-4ef8-90b1-1423ee050288 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:33.288210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2cb7eb7-0b99-4ef8-90b1-1423ee050288 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:33.298318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2cb7eb7-0b99-4ef8-90b1-1423ee050288 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:33.300658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2cb7eb7-0b99-4ef8-90b1-1423ee050288 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:33.301860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2cb7eb7-0b99-4ef8-90b1-1423ee050288 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:33.302881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2cb7eb7-0b99-4ef8-90b1-1423ee050288 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:33.578104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e2cb7eb7-0b99-4ef8-90b1-1423ee050288 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:33.592756 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e2cb7eb7-0b99-4ef8-90b1-1423ee050288 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1318 microversion: 2.1 time: 0.335808 Aug 09 17:23:33.595102 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1499/3133] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:33 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:33.605765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c8ea5e9d-7194-4dec-b3ff-3600ff503496 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:33.608267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c8ea5e9d-7194-4dec-b3ff-3600ff503496 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:33.648739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e9d-7194-4dec-b3ff-3600ff503496 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:33.650113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e9d-7194-4dec-b3ff-3600ff503496 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:33.651257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e9d-7194-4dec-b3ff-3600ff503496 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:33.655304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e9d-7194-4dec-b3ff-3600ff503496 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:33.656817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e9d-7194-4dec-b3ff-3600ff503496 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:33.657825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8ea5e9d-7194-4dec-b3ff-3600ff503496 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:34.020439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-735eb7ad-179f-44b1-929e-7b8997b1b4d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:34.048782 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-735eb7ad-179f-44b1-929e-7b8997b1b4d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1365 microversion: 2.1 time: 0.874841 Aug 09 17:23:34.052471 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1635/3134] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:33 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1365 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:34.065476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c8ea5e9d-7194-4dec-b3ff-3600ff503496 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:34.066219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fd91dbbf-a24c-4ede-8777-059f4b105a78 req-dc0b8fde-f7ae-44b9-b13a-b77e41fc646c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b120e8-277c-49bb-83e5-1de30e80fd50", "name": "network-vif-plugged", "status": "completed", "tag": "8c141125-13a2-4dc7-9c17-2908b01ba8da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:34.091852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fd91dbbf-a24c-4ede-8777-059f4b105a78 req-dc0b8fde-f7ae-44b9-b13a-b77e41fc646c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:34.092424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fd91dbbf-a24c-4ede-8777-059f4b105a78 req-dc0b8fde-f7ae-44b9-b13a-b77e41fc646c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:34.092811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fd91dbbf-a24c-4ede-8777-059f4b105a78 req-dc0b8fde-f7ae-44b9-b13a-b77e41fc646c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:34.106236 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c8ea5e9d-7194-4dec-b3ff-3600ff503496 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 0.509141 Aug 09 17:23:34.107346 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1500/3135] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:33 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:34.126069 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fd91dbbf-a24c-4ede-8777-059f4b105a78 req-dc0b8fde-f7ae-44b9-b13a-b77e41fc646c service nova] Creating event network-vif-plugged:8c141125-13a2-4dc7-9c17-2908b01ba8da for instance 55b120e8-277c-49bb-83e5-1de30e80fd50 on n-h1-845781-6 Aug 09 17:23:34.128945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-288167d0-f700-433a-95c2-35f3588530f6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:34.130076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-288167d0-f700-433a-95c2-35f3588530f6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:34.133320 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fd91dbbf-a24c-4ede-8777-059f4b105a78 req-dc0b8fde-f7ae-44b9-b13a-b77e41fc646c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077839 Aug 09 17:23:34.134319 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1636/3136] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:34.158639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288167d0-f700-433a-95c2-35f3588530f6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:34.159424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288167d0-f700-433a-95c2-35f3588530f6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:34.159928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288167d0-f700-433a-95c2-35f3588530f6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:34.160686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288167d0-f700-433a-95c2-35f3588530f6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:34.161167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288167d0-f700-433a-95c2-35f3588530f6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:34.161906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288167d0-f700-433a-95c2-35f3588530f6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:34.219801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:34.220644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:34.238471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:34.239067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:34.239524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:34.243802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:34.248038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:34.253111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:34.495180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:34.509013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:34.513001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:34.515055 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-259b85e3-f5e5-45eb-a655-f87e3ff60315 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5" status: 200 len: 1350 microversion: 2.47 time: 0.301025 Aug 09 17:23:34.516054 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1637/3137] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:23:34 2022] GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 => generated 1350 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:23:34.620036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-196828f8-a1e4-4c03-b0e0-d1521c0eb040 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:34.622544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-196828f8-a1e4-4c03-b0e0-d1521c0eb040 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:34.636404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-196828f8-a1e4-4c03-b0e0-d1521c0eb040 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:34.637985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-196828f8-a1e4-4c03-b0e0-d1521c0eb040 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:34.639413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-196828f8-a1e4-4c03-b0e0-d1521c0eb040 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:34.640745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-196828f8-a1e4-4c03-b0e0-d1521c0eb040 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:34.641531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-196828f8-a1e4-4c03-b0e0-d1521c0eb040 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:34.641950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-196828f8-a1e4-4c03-b0e0-d1521c0eb040 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:34.832979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-288167d0-f700-433a-95c2-35f3588530f6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:34.844286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:34.885341 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-288167d0-f700-433a-95c2-35f3588530f6 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1466 microversion: 2.1 time: 0.765125 Aug 09 17:23:34.887528 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1501/3138] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:34 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1466 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:34.935102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a24b8b44-9a97-4d5d-aeb7-1114fd748960 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:34.936829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a24b8b44-9a97-4d5d-aeb7-1114fd748960 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:34.953343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a24b8b44-9a97-4d5d-aeb7-1114fd748960 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:34.955382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a24b8b44-9a97-4d5d-aeb7-1114fd748960 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:34.956669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a24b8b44-9a97-4d5d-aeb7-1114fd748960 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:34.957655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a24b8b44-9a97-4d5d-aeb7-1114fd748960 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:34.958365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a24b8b44-9a97-4d5d-aeb7-1114fd748960 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:34.959018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a24b8b44-9a97-4d5d-aeb7-1114fd748960 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:35.156869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-196828f8-a1e4-4c03-b0e0-d1521c0eb040 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:35.168156 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-196828f8-a1e4-4c03-b0e0-d1521c0eb040 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1318 microversion: 2.1 time: 0.554741 Aug 09 17:23:35.170549 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1638/3139] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:34 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:23:35.192517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44d9fe11-1f05-4bca-9cfa-3dc94bf65110 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:35.194137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-44d9fe11-1f05-4bca-9cfa-3dc94bf65110 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:35.228272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44d9fe11-1f05-4bca-9cfa-3dc94bf65110 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:35.236755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44d9fe11-1f05-4bca-9cfa-3dc94bf65110 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:35.238487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44d9fe11-1f05-4bca-9cfa-3dc94bf65110 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:35.240474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44d9fe11-1f05-4bca-9cfa-3dc94bf65110 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:35.245122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44d9fe11-1f05-4bca-9cfa-3dc94bf65110 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:35.246172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44d9fe11-1f05-4bca-9cfa-3dc94bf65110 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:35.537732 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a24b8b44-9a97-4d5d-aeb7-1114fd748960 tempest-ServersOnMultiNodesTest-1676575106 tempest-ServersOnMultiNodesTest-1676575106-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1617 microversion: 2.1 time: 0.610392 Aug 09 17:23:35.539434 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1502/3140] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:34 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1617 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:35.554864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e56db6f-8323-4a9e-9dce-2c4436f2bc8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:35.557997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8e56db6f-8323-4a9e-9dce-2c4436f2bc8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:35.575621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e56db6f-8323-4a9e-9dce-2c4436f2bc8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:35.577451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e56db6f-8323-4a9e-9dce-2c4436f2bc8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:35.578617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e56db6f-8323-4a9e-9dce-2c4436f2bc8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:35.580659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e56db6f-8323-4a9e-9dce-2c4436f2bc8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:35.581827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e56db6f-8323-4a9e-9dce-2c4436f2bc8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:35.582697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e56db6f-8323-4a9e-9dce-2c4436f2bc8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:35.796300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-44d9fe11-1f05-4bca-9cfa-3dc94bf65110 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:35.837818 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-44d9fe11-1f05-4bca-9cfa-3dc94bf65110 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1365 microversion: 2.1 time: 0.662684 Aug 09 17:23:35.841879 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1639/3141] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:35 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1365 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:35.854493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:35.857776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:35.880397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:35.881884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:35.882966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:35.884820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:35.886149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:35.887817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:36.101343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:36.122804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:36.128343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:36.132557 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d36fb0c5-3d4e-436c-a224-54c020326f50 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5" status: 200 len: 1338 microversion: 2.47 time: 0.288362 Aug 09 17:23:36.143869 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1640/3142] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:23:35 2022] GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 => generated 1338 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:23:36.144374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8e56db6f-8323-4a9e-9dce-2c4436f2bc8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:36.154333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3f2b3516-3e93-4745-b008-06c5adf8f316 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:36.154333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3f2b3516-3e93-4745-b008-06c5adf8f316 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:36.157606 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e56db6f-8323-4a9e-9dce-2c4436f2bc8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 0.614588 Aug 09 17:23:36.159065 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1503/3143] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:35 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:36.172714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f2b3516-3e93-4745-b008-06c5adf8f316 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:36.173610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f2b3516-3e93-4745-b008-06c5adf8f316 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:36.174197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f2b3516-3e93-4745-b008-06c5adf8f316 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:36.177378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f2b3516-3e93-4745-b008-06c5adf8f316 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:36.178972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f2b3516-3e93-4745-b008-06c5adf8f316 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:36.179619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f2b3516-3e93-4745-b008-06c5adf8f316 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:36.208604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7346b569-0782-48be-9bad-c879c221db9f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:36.209369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7346b569-0782-48be-9bad-c879c221db9f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:36.221910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7346b569-0782-48be-9bad-c879c221db9f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:36.222422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7346b569-0782-48be-9bad-c879c221db9f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:36.227147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7346b569-0782-48be-9bad-c879c221db9f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:36.227956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7346b569-0782-48be-9bad-c879c221db9f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:36.228447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7346b569-0782-48be-9bad-c879c221db9f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:36.232923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7346b569-0782-48be-9bad-c879c221db9f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:36.250017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3f2b3516-3e93-4745-b008-06c5adf8f316 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:23:36.537113 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3f2b3516-3e93-4745-b008-06c5adf8f316 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 204 len: 0 microversion: 2.1 time: 0.391679 Aug 09 17:23:36.538679 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1641/3144] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:23:36 2022] DELETE /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:23:36.559428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fa5add60-daaf-4d72-9ad7-eeb9e7ad319d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:36.563829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fa5add60-daaf-4d72-9ad7-eeb9e7ad319d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:36.586454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa5add60-daaf-4d72-9ad7-eeb9e7ad319d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:36.587256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa5add60-daaf-4d72-9ad7-eeb9e7ad319d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:36.590688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa5add60-daaf-4d72-9ad7-eeb9e7ad319d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:36.591801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa5add60-daaf-4d72-9ad7-eeb9e7ad319d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:36.592182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa5add60-daaf-4d72-9ad7-eeb9e7ad319d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:36.592726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa5add60-daaf-4d72-9ad7-eeb9e7ad319d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:36.955511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7346b569-0782-48be-9bad-c879c221db9f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:36.971014 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7346b569-0782-48be-9bad-c879c221db9f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1318 microversion: 2.1 time: 0.768130 Aug 09 17:23:36.992391 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1504/3145] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:36 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1318 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:37.011066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-18f4565d-18b7-441c-9c9f-42367f5744d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:37.014542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-18f4565d-18b7-441c-9c9f-42367f5744d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:37.031699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f4565d-18b7-441c-9c9f-42367f5744d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:37.032308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f4565d-18b7-441c-9c9f-42367f5744d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:37.032978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f4565d-18b7-441c-9c9f-42367f5744d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:37.033963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f4565d-18b7-441c-9c9f-42367f5744d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:37.034802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f4565d-18b7-441c-9c9f-42367f5744d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:37.035450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f4565d-18b7-441c-9c9f-42367f5744d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:37.202203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fa5add60-daaf-4d72-9ad7-eeb9e7ad319d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:37.215948 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fa5add60-daaf-4d72-9ad7-eeb9e7ad319d tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1472 microversion: 2.1 time: 0.670201 Aug 09 17:23:37.219827 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1642/3146] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:36 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1472 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:37.246825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:37.249655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:37.266754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:37.275165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:37.276086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:37.277196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:37.280541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:37.281346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:37.484974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:37.513851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:37.553795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:37.564917 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f72de4dd-df8d-4d56-8fd0-c798eea4be5d tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5" status: 200 len: 1338 microversion: 2.47 time: 0.324115 Aug 09 17:23:37.566483 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1643/3147] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:23:37 2022] GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 => generated 1338 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:23:37.594536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c68c477-3c10-453f-9621-1e3aada2ba97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:37.596204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c68c477-3c10-453f-9621-1e3aada2ba97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:37.607930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c68c477-3c10-453f-9621-1e3aada2ba97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:37.609271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c68c477-3c10-453f-9621-1e3aada2ba97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:37.610325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c68c477-3c10-453f-9621-1e3aada2ba97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:37.611939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c68c477-3c10-453f-9621-1e3aada2ba97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:37.613061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c68c477-3c10-453f-9621-1e3aada2ba97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:37.614418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c68c477-3c10-453f-9621-1e3aada2ba97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:37.647850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-18f4565d-18b7-441c-9c9f-42367f5744d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:37.718664 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-18f4565d-18b7-441c-9c9f-42367f5744d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1556 microversion: 2.1 time: 0.718705 Aug 09 17:23:37.721033 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1505/3148] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:36 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1556 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:37.761240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-21d54474-8f98-43cc-9d00-8c26ad1552fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:37.762411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-21d54474-8f98-43cc-9d00-8c26ad1552fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:37.786845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:37.797907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21d54474-8f98-43cc-9d00-8c26ad1552fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:37.799619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21d54474-8f98-43cc-9d00-8c26ad1552fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:37.802260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21d54474-8f98-43cc-9d00-8c26ad1552fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:37.806202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21d54474-8f98-43cc-9d00-8c26ad1552fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:37.807437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21d54474-8f98-43cc-9d00-8c26ad1552fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:37.810257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21d54474-8f98-43cc-9d00-8c26ad1552fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:38.222972 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-21d54474-8f98-43cc-9d00-8c26ad1552fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.467119 Aug 09 17:23:38.224241 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1506/3149] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:23:37 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-interface => generated 285 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:23:38.232670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1718a170-de76-4ce9-b7ae-47afd45e7307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:38.234890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1718a170-de76-4ce9-b7ae-47afd45e7307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:38.261474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1718a170-de76-4ce9-b7ae-47afd45e7307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:38.262055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1718a170-de76-4ce9-b7ae-47afd45e7307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:38.262608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1718a170-de76-4ce9-b7ae-47afd45e7307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:38.263373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1718a170-de76-4ce9-b7ae-47afd45e7307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:38.263895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1718a170-de76-4ce9-b7ae-47afd45e7307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:38.264341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1718a170-de76-4ce9-b7ae-47afd45e7307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:39.134496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c68c477-3c10-453f-9621-1e3aada2ba97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:39.172118 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c68c477-3c10-453f-9621-1e3aada2ba97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 1.599038 Aug 09 17:23:39.204930 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1644/3150] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:37 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:39.222127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cff7ce2f-8ae8-4ca8-9383-b2d431322912 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:39.223703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cff7ce2f-8ae8-4ca8-9383-b2d431322912 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:39.242036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cff7ce2f-8ae8-4ca8-9383-b2d431322912 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:39.244487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cff7ce2f-8ae8-4ca8-9383-b2d431322912 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:39.247596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cff7ce2f-8ae8-4ca8-9383-b2d431322912 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:39.249691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cff7ce2f-8ae8-4ca8-9383-b2d431322912 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:39.251979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cff7ce2f-8ae8-4ca8-9383-b2d431322912 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:39.252945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cff7ce2f-8ae8-4ca8-9383-b2d431322912 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:39.353695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:39.472477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1718a170-de76-4ce9-b7ae-47afd45e7307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:39.507959 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1718a170-de76-4ce9-b7ae-47afd45e7307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1318 microversion: 2.1 time: 1.279284 Aug 09 17:23:39.528578 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1507/3151] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:38 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1318 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:39.538173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-8d658584-b318-4d7e-a2c0-80e4a358924e req-d3b8d78a-ff50-4972-a02b-e0b93c0a966d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6760ec-412a-42a8-968d-ce3ebf298c73", "name": "network-vif-plugged", "status": "completed", "tag": "7dab4def-547e-43a1-9b87-13b83eb68166"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:39.603951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8d658584-b318-4d7e-a2c0-80e4a358924e req-d3b8d78a-ff50-4972-a02b-e0b93c0a966d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:39.608133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8d658584-b318-4d7e-a2c0-80e4a358924e req-d3b8d78a-ff50-4972-a02b-e0b93c0a966d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:39.610996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8d658584-b318-4d7e-a2c0-80e4a358924e req-d3b8d78a-ff50-4972-a02b-e0b93c0a966d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:39.680057 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-8d658584-b318-4d7e-a2c0-80e4a358924e req-d3b8d78a-ff50-4972-a02b-e0b93c0a966d service nova] Creating event network-vif-plugged:7dab4def-547e-43a1-9b87-13b83eb68166 for instance cd6760ec-412a-42a8-968d-ce3ebf298c73 on n-h1-845781-6 Aug 09 17:23:39.703840 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-8d658584-b318-4d7e-a2c0-80e4a358924e req-d3b8d78a-ff50-4972-a02b-e0b93c0a966d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184798 Aug 09 17:23:39.710753 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1508/3152] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:39.734090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:39.740197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:39.788273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:39.789121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:39.794925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cff7ce2f-8ae8-4ca8-9383-b2d431322912 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:39.811590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:39.817015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:39.818755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:39.820943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:39.844263 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cff7ce2f-8ae8-4ca8-9383-b2d431322912 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1472 microversion: 2.1 time: 0.634796 Aug 09 17:23:39.847437 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1645/3153] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:39 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1472 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:40.195881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4853b9d-1faa-4a27-9575-05532197017e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:40.197001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a4853b9d-1faa-4a27-9575-05532197017e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:40.211370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4853b9d-1faa-4a27-9575-05532197017e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:40.211927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4853b9d-1faa-4a27-9575-05532197017e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:40.212621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4853b9d-1faa-4a27-9575-05532197017e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:40.221454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4853b9d-1faa-4a27-9575-05532197017e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:40.222330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4853b9d-1faa-4a27-9575-05532197017e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:40.223123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4853b9d-1faa-4a27-9575-05532197017e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:40.382723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:40.396819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:40.408805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:40.410102 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2184919d-12b8-4263-b5c5-4a96f795ad81 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5" status: 200 len: 1359 microversion: 2.47 time: 0.692291 Aug 09 17:23:40.423671 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1509/3154] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:23:39 2022] GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 => generated 1359 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:23:40.439836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a4853b9d-1faa-4a27-9575-05532197017e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:40.461257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d7eebd19-3aa1-42b1-8f83-39ef117954ad tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-855010764"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:40.465525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d7eebd19-3aa1-42b1-8f83-39ef117954ad tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:40.469067 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4853b9d-1faa-4a27-9575-05532197017e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 0.276509 Aug 09 17:23:40.478727 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1646/3155] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:40 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:40.489456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7eebd19-3aa1-42b1-8f83-39ef117954ad tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:40.490640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7eebd19-3aa1-42b1-8f83-39ef117954ad tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:40.491293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7eebd19-3aa1-42b1-8f83-39ef117954ad tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:40.492268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7eebd19-3aa1-42b1-8f83-39ef117954ad tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:40.492963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7eebd19-3aa1-42b1-8f83-39ef117954ad tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:40.493590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7eebd19-3aa1-42b1-8f83-39ef117954ad tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:40.560267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7db249a2-8002-476b-b835-ebec5ebdf39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:40.561277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7db249a2-8002-476b-b835-ebec5ebdf39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:40.569377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7db249a2-8002-476b-b835-ebec5ebdf39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:40.570628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7db249a2-8002-476b-b835-ebec5ebdf39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:40.571461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7db249a2-8002-476b-b835-ebec5ebdf39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:40.572754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7db249a2-8002-476b-b835-ebec5ebdf39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:40.575464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7db249a2-8002-476b-b835-ebec5ebdf39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:40.580929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7db249a2-8002-476b-b835-ebec5ebdf39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:41.019316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:41.190612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:41.246079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7db249a2-8002-476b-b835-ebec5ebdf39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:41.274374 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7db249a2-8002-476b-b835-ebec5ebdf39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1318 microversion: 2.1 time: 0.717874 Aug 09 17:23:41.286253 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1647/3156] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:40 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:23:41.312194 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d7eebd19-3aa1-42b1-8f83-39ef117954ad tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "POST /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5/action" status: 202 len: 52 microversion: 2.47 time: 0.828858 Aug 09 17:23:41.313388 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1510/3157] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:23:40 2022] POST /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5/action => generated 52 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Aug 09 17:23:41.319300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:41.323721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:41.348878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d5b866aa-8346-44c5-97d0-9e6713680ae4 req-028d4b39-d2b9-4bd6-8f68-723a5f5abe59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9127e6b5-133b-4ddd-b1e3-74bbc628f235", "name": "network-vif-deleted", "tag": "c8d3aa30-da38-4cd8-bcf1-e07ed775cc4d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:41.357421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:41.357945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:41.358399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:41.366788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d5b866aa-8346-44c5-97d0-9e6713680ae4 req-028d4b39-d2b9-4bd6-8f68-723a5f5abe59 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:41.367692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d5b866aa-8346-44c5-97d0-9e6713680ae4 req-028d4b39-d2b9-4bd6-8f68-723a5f5abe59 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:41.368376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d5b866aa-8346-44c5-97d0-9e6713680ae4 req-028d4b39-d2b9-4bd6-8f68-723a5f5abe59 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:41.369817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:41.370381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:41.370827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:41.397619 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d5b866aa-8346-44c5-97d0-9e6713680ae4 req-028d4b39-d2b9-4bd6-8f68-723a5f5abe59 service nova] Creating event network-vif-deleted:c8d3aa30-da38-4cd8-bcf1-e07ed775cc4d for instance 9127e6b5-133b-4ddd-b1e3-74bbc628f235 on n-h2-845781-6 Aug 09 17:23:41.406639 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d5b866aa-8346-44c5-97d0-9e6713680ae4 req-028d4b39-d2b9-4bd6-8f68-723a5f5abe59 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082430 Aug 09 17:23:41.408292 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1511/3158] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:41.416418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0bfbc1cf-62d7-493e-a99d-c49243697064 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:41.417462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0bfbc1cf-62d7-493e-a99d-c49243697064 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:41.426561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bfbc1cf-62d7-493e-a99d-c49243697064 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:41.427602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bfbc1cf-62d7-493e-a99d-c49243697064 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:41.428308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bfbc1cf-62d7-493e-a99d-c49243697064 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:41.429290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bfbc1cf-62d7-493e-a99d-c49243697064 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:41.429988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bfbc1cf-62d7-493e-a99d-c49243697064 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:41.430652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bfbc1cf-62d7-493e-a99d-c49243697064 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:41.477042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0bfbc1cf-62d7-493e-a99d-c49243697064 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:23:41.477294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:41.511021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:41.511524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:41.512542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:41.513026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lazy-loading 'fault' on Instance uuid 9127e6b5-133b-4ddd-b1e3-74bbc628f235 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:23:41.703267 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0bfbc1cf-62d7-493e-a99d-c49243697064 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5" status: 204 len: 0 microversion: 2.47 time: 0.291918 Aug 09 17:23:41.713501 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1512/3159] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:23:41 2022] DELETE /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:23:41.734079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a3fc1f5-c772-4dc2-bd01-34d850077c9a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:41.737059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9a3fc1f5-c772-4dc2-bd01-34d850077c9a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:41.754129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a3fc1f5-c772-4dc2-bd01-34d850077c9a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:41.755287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a3fc1f5-c772-4dc2-bd01-34d850077c9a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:41.760094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a3fc1f5-c772-4dc2-bd01-34d850077c9a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:41.762501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a3fc1f5-c772-4dc2-bd01-34d850077c9a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:41.768420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a3fc1f5-c772-4dc2-bd01-34d850077c9a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:41.770764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a3fc1f5-c772-4dc2-bd01-34d850077c9a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:41.842145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:41.872361 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c9c77023-f0b5-43b3-b69c-4fd5dd677b78 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 200 len: 1307 microversion: 2.1 time: 0.584646 Aug 09 17:23:41.879642 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1648/3160] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:41 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 1307 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:41.892512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:41.897303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:41.904411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:41.920975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:41.924514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:41.926133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:41.927224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:41.927980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:41.928607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:42.144842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:42.163802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:42.171301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:42.175803 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-170c1b43-a69b-4d8e-9396-29564f2e268b tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5" status: 200 len: 1365 microversion: 2.47 time: 0.290913 Aug 09 17:23:42.177942 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1649/3161] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:23:41 2022] GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:23:42.335344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b3f9224-a23f-4eda-81cc-10b0181f1644 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:42.336921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1b3f9224-a23f-4eda-81cc-10b0181f1644 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:42.350489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b3f9224-a23f-4eda-81cc-10b0181f1644 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:42.363692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b3f9224-a23f-4eda-81cc-10b0181f1644 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:42.364501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b3f9224-a23f-4eda-81cc-10b0181f1644 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:42.372813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b3f9224-a23f-4eda-81cc-10b0181f1644 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:42.374916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b3f9224-a23f-4eda-81cc-10b0181f1644 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:42.375743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b3f9224-a23f-4eda-81cc-10b0181f1644 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:43.017645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a3fc1f5-c772-4dc2-bd01-34d850077c9a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:43.030972 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a3fc1f5-c772-4dc2-bd01-34d850077c9a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 1.313701 Aug 09 17:23:43.033149 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1513/3162] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:41 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:43.045202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:43.045954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1b3f9224-a23f-4eda-81cc-10b0181f1644 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:43.048530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 9127e6b5-133b-4ddd-b1e3-74bbc628f235] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:43.075444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:43.076401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:43.077074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:43.078053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:43.078867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:43.079552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:43.080690 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b3f9224-a23f-4eda-81cc-10b0181f1644 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1509 microversion: 2.1 time: 0.749184 Aug 09 17:23:43.087410 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1650/3163] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:42 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1509 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:43.113135 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] HTTP exception thrown: Instance 9127e6b5-133b-4ddd-b1e3-74bbc628f235 could not be found. Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Request method failure captured: Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 HTTP/1.1 Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pcZIp_E-R9bnBJLqNKPw_oVcgO3I-b0ZlO7EWV6UcwHhog9OmjGLaAQGYnT1znB6odeojveKiOuTjWw9Kms9g89l7L_1xNmVO6QJrGD0tc4nB762QMeAiP8MXEm9gtOym3vyXvVAek0zjwNWfr9cMDdv_LbFUnVx2jVtN5fPWVxU7M Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: fe6a633b90b949af91c0d2aa1d361fe5 Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 9127e6b5-133b-4ddd-b1e3-74bbc628f235 could not be found. Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9127e6b5-133b-4ddd-b1e3-74bbc628f235'} Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9127e6b5-133b-4ddd-b1e3-74bbc628f235 could not be found. Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9127e6b5-133b-4ddd-b1e3-74bbc628f235 could not be found. Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:43.122472 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:43.133094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:43.133094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:43.133094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:43.133094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:43.133094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:43.133094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9127e6b5-133b-4ddd-b1e3-74bbc628f235 could not be found. Aug 09 17:23:43.133094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:43.133094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Returning 404 to user: Instance 9127e6b5-133b-4ddd-b1e3-74bbc628f235 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:43.133094 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ba9d6138-93d7-4e3d-92d8-1b0fb6923c70 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235" status: 404 len: 111 microversion: 2.1 time: 0.097470 Aug 09 17:23:43.137766 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1514/3164] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:43 2022] GET /compute/v2.1/servers/9127e6b5-133b-4ddd-b1e3-74bbc628f235 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:23:43.145202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6495f636-0c80-481c-8cd5-5a213bf39c85 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:43.145784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6495f636-0c80-481c-8cd5-5a213bf39c85 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:43.161012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6495f636-0c80-481c-8cd5-5a213bf39c85 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:43.161521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6495f636-0c80-481c-8cd5-5a213bf39c85 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:43.161979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6495f636-0c80-481c-8cd5-5a213bf39c85 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:43.166834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6495f636-0c80-481c-8cd5-5a213bf39c85 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:43.167466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6495f636-0c80-481c-8cd5-5a213bf39c85 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:43.169386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6495f636-0c80-481c-8cd5-5a213bf39c85 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:43.169942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75a27d8a-a2f9-425f-81c1-0412a09563d8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:43.171558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75a27d8a-a2f9-425f-81c1-0412a09563d8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:43.218413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75a27d8a-a2f9-425f-81c1-0412a09563d8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:43.219404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75a27d8a-a2f9-425f-81c1-0412a09563d8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:43.220457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75a27d8a-a2f9-425f-81c1-0412a09563d8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:43.222108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75a27d8a-a2f9-425f-81c1-0412a09563d8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:43.225829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75a27d8a-a2f9-425f-81c1-0412a09563d8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:43.228762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75a27d8a-a2f9-425f-81c1-0412a09563d8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:43.243112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6495f636-0c80-481c-8cd5-5a213bf39c85 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:23:43.493416 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6495f636-0c80-481c-8cd5-5a213bf39c85 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 204 len: 0 microversion: 2.1 time: 0.351465 Aug 09 17:23:43.496864 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1515/3165] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:23:43 2022] DELETE /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:23:43.513201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:43.515726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:43.541041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:43.542137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:43.542768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:43.545437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:43.546880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:43.552380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:43.556186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:43.836966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:43.868499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:43.882005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:43.894730 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-74114556-1a83-43f2-a33f-173bc1cbe7b3 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5" status: 200 len: 1365 microversion: 2.47 time: 0.392447 Aug 09 17:23:43.900294 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1516/3166] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:23:43 2022] GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 => generated 1365 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:23:43.913511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9b1e7048-adc1-4c7b-99eb-908894170ec1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:43.914740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9b1e7048-adc1-4c7b-99eb-908894170ec1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:43.931468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1e7048-adc1-4c7b-99eb-908894170ec1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:43.935386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1e7048-adc1-4c7b-99eb-908894170ec1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:43.936225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1e7048-adc1-4c7b-99eb-908894170ec1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:43.937257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1e7048-adc1-4c7b-99eb-908894170ec1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:43.937948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1e7048-adc1-4c7b-99eb-908894170ec1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:43.941766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1e7048-adc1-4c7b-99eb-908894170ec1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:44.136425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-75a27d8a-a2f9-425f-81c1-0412a09563d8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:44.175255 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75a27d8a-a2f9-425f-81c1-0412a09563d8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1509 microversion: 2.1 time: 1.037739 Aug 09 17:23:44.180314 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1651/3167] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:43 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1509 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:44.195340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-62605cab-dec6-4f97-81cd-9f938a0a86f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:44.197759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-62605cab-dec6-4f97-81cd-9f938a0a86f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:44.215466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62605cab-dec6-4f97-81cd-9f938a0a86f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:44.216189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62605cab-dec6-4f97-81cd-9f938a0a86f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:44.216845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62605cab-dec6-4f97-81cd-9f938a0a86f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:44.218981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62605cab-dec6-4f97-81cd-9f938a0a86f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:44.220047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62605cab-dec6-4f97-81cd-9f938a0a86f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:44.220909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62605cab-dec6-4f97-81cd-9f938a0a86f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:44.778220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-62605cab-dec6-4f97-81cd-9f938a0a86f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:44.802608 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-62605cab-dec6-4f97-81cd-9f938a0a86f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 0.615782 Aug 09 17:23:44.804397 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1652/3168] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:44 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:44.814535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:44.818101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:44.827105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:44.827901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:44.828537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:44.829621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:44.830718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:44.831809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:44.991610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9b1e7048-adc1-4c7b-99eb-908894170ec1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:45.000820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:23:45.004076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:23:45.004928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:23:45.005656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:23:45.006223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:23:45.017189 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9b1e7048-adc1-4c7b-99eb-908894170ec1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1472 microversion: 2.1 time: 1.113929 Aug 09 17:23:45.019587 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1517/3169] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:43 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1472 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:45.028171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:45.029293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:45.038961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:45.039967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:45.041133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:45.042191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:45.042955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:45.043834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:45.142415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:45.166392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:45.167264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:45.168826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:45.174923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:45.176053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:45.176816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:45.249180 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3526640-de98-4a60-aff9-8f90369f16df tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "POST /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73/action" status: 202 len: 1111 microversion: 2.1 time: 0.442534 Aug 09 17:23:45.260688 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1653/3170] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:23:44 2022] POST /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73/action => generated 1111 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 09 17:23:45.269257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bedfd28c-c2a3-4213-a8f2-8a1a60fe21d2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:45.269902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bedfd28c-c2a3-4213-a8f2-8a1a60fe21d2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:45.280669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bedfd28c-c2a3-4213-a8f2-8a1a60fe21d2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:45.280669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bedfd28c-c2a3-4213-a8f2-8a1a60fe21d2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:45.280669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bedfd28c-c2a3-4213-a8f2-8a1a60fe21d2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:45.280669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bedfd28c-c2a3-4213-a8f2-8a1a60fe21d2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:45.280669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bedfd28c-c2a3-4213-a8f2-8a1a60fe21d2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:45.281307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bedfd28c-c2a3-4213-a8f2-8a1a60fe21d2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:45.354283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:45.369881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:45.372156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:45.373942 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-673c4cea-ad7b-4441-8f28-24b9742a54c7 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5" status: 200 len: 1365 microversion: 2.47 time: 0.351522 Aug 09 17:23:45.374773 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1518/3171] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:23:45 2022] GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 => generated 1365 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:23:45.700303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bedfd28c-c2a3-4213-a8f2-8a1a60fe21d2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:45.715792 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bedfd28c-c2a3-4213-a8f2-8a1a60fe21d2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 0.450845 Aug 09 17:23:45.717716 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1654/3172] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:45 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:45.836843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a4c7b4c2-a342-470b-a569-2350b28f0ab7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:45.838692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a4c7b4c2-a342-470b-a569-2350b28f0ab7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:45.868359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4c7b4c2-a342-470b-a569-2350b28f0ab7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:45.869390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4c7b4c2-a342-470b-a569-2350b28f0ab7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:45.870035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4c7b4c2-a342-470b-a569-2350b28f0ab7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:45.871911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4c7b4c2-a342-470b-a569-2350b28f0ab7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:45.872635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4c7b4c2-a342-470b-a569-2350b28f0ab7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:45.873231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4c7b4c2-a342-470b-a569-2350b28f0ab7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:46.048838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-16886b7b-c23e-4b5f-947f-04c5a6e16250 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:46.050995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-16886b7b-c23e-4b5f-947f-04c5a6e16250 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:46.064363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16886b7b-c23e-4b5f-947f-04c5a6e16250 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:46.065545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16886b7b-c23e-4b5f-947f-04c5a6e16250 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:46.066507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16886b7b-c23e-4b5f-947f-04c5a6e16250 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:46.067735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16886b7b-c23e-4b5f-947f-04c5a6e16250 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:46.068768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16886b7b-c23e-4b5f-947f-04c5a6e16250 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:46.070271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16886b7b-c23e-4b5f-947f-04c5a6e16250 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:46.409159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16886b7b-c23e-4b5f-947f-04c5a6e16250 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:46.434764 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-16886b7b-c23e-4b5f-947f-04c5a6e16250 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1472 microversion: 2.1 time: 0.391602 Aug 09 17:23:46.436501 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1655/3173] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:46 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1472 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:23:46.443127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:46.443785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:46.452065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:46.452886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:46.453594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:46.454409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:46.454940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:46.455456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:46.548046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:46.573428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:46.581498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd540f70612584f938785be87eeb60b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df2ee862ae5c47aab80e7582eb6ef8a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:46.584013 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f74e086-da0d-41b1-9874-21c8829d48e1 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5" status: 200 len: 1365 microversion: 2.47 time: 0.146291 Aug 09 17:23:46.585684 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1656/3174] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:23:46 2022] GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:23:46.769803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-97a17764-c31f-4887-8690-ae36e2449624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:46.771692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-97a17764-c31f-4887-8690-ae36e2449624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:46.788486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a17764-c31f-4887-8690-ae36e2449624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:46.790324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a17764-c31f-4887-8690-ae36e2449624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:46.791463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a17764-c31f-4887-8690-ae36e2449624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:46.797908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a17764-c31f-4887-8690-ae36e2449624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:46.799880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a17764-c31f-4887-8690-ae36e2449624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:46.801755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97a17764-c31f-4887-8690-ae36e2449624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:47.005176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4c7b4c2-a342-470b-a569-2350b28f0ab7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:47.038613 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a4c7b4c2-a342-470b-a569-2350b28f0ab7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 1.213978 Aug 09 17:23:47.040041 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1519/3175] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:45 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:47.052775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-51be559c-7940-47c6-af4d-7cdc8b22a19d req-9b6e125d-75ff-41f3-a39f-cb5b3035715f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b120e8-277c-49bb-83e5-1de30e80fd50", "tag": "8c141125-13a2-4dc7-9c17-2908b01ba8da"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:47.123295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-51be559c-7940-47c6-af4d-7cdc8b22a19d req-9b6e125d-75ff-41f3-a39f-cb5b3035715f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:47.129997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-51be559c-7940-47c6-af4d-7cdc8b22a19d req-9b6e125d-75ff-41f3-a39f-cb5b3035715f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:47.131598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-51be559c-7940-47c6-af4d-7cdc8b22a19d req-9b6e125d-75ff-41f3-a39f-cb5b3035715f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:47.196163 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-51be559c-7940-47c6-af4d-7cdc8b22a19d req-9b6e125d-75ff-41f3-a39f-cb5b3035715f service nova] Creating event network-changed:8c141125-13a2-4dc7-9c17-2908b01ba8da for instance 55b120e8-277c-49bb-83e5-1de30e80fd50 on n-h1-845781-6 Aug 09 17:23:47.216362 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-51be559c-7940-47c6-af4d-7cdc8b22a19d req-9b6e125d-75ff-41f3-a39f-cb5b3035715f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170273 Aug 09 17:23:47.225787 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1520/3176] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:23:47.338273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-97a17764-c31f-4887-8690-ae36e2449624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:47.391224 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-97a17764-c31f-4887-8690-ae36e2449624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 0.629631 Aug 09 17:23:47.393498 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1657/3177] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:46 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:47.470730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c618c966-bfc1-44df-a9df-c3855ef64fa3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:47.477269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c618c966-bfc1-44df-a9df-c3855ef64fa3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:47.504919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c618c966-bfc1-44df-a9df-c3855ef64fa3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:47.518198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c618c966-bfc1-44df-a9df-c3855ef64fa3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:47.518977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c618c966-bfc1-44df-a9df-c3855ef64fa3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:47.520321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c618c966-bfc1-44df-a9df-c3855ef64fa3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:47.521155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c618c966-bfc1-44df-a9df-c3855ef64fa3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:47.521924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c618c966-bfc1-44df-a9df-c3855ef64fa3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:47.614530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:47.622103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] [instance: 8c92f871-249e-453c-8634-19b61ca97cb5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:47.666769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:47.667898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:47.669169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:47.670865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:47.671157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:47.692730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:47.743838 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] HTTP exception thrown: Instance 8c92f871-249e-453c-8634-19b61ca97cb5 could not be found. Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Request method failure captured: Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 HTTP/1.1 Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pgQtvQOh9I77QkC2YphGH_Qdd1q2dv1bumW-kmnghJ3b5ap7BNceJM_szRQdHvhBHUEifWBflGAbI2YWgNRAJAH03t81g4u9urOCtQKtToD_YzSOfdQO37Gw-52tpvkECzQbICaDvS4n1ofHSYzjLbz9SeNwYJG7SaX-6WnzZY8n6Y Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.47 Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: df2ee862ae5c47aab80e7582eb6ef8a0 Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersAaction247Test-1482075963 Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_df2ee862ae5c47aab80e7582eb6ef8a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df2ee862ae5c47aab80e7582eb6ef8a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df2ee862ae5c47aab80e7582eb6ef8a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/df2ee862ae5c47aab80e7582eb6ef8a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersAaction247Test-1482075963 Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: df2ee862ae5c47aab80e7582eb6ef8a0 Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersAaction247Test-1482075963 Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersAaction247Test-1482075963-project Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d540f70612584f938785be87eeb60b0a Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersAaction247Test-1482075963-project Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8c92f871-249e-453c-8634-19b61ca97cb5 could not be found. Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8c92f871-249e-453c-8634-19b61ca97cb5'} Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c92f871-249e-453c-8634-19b61ca97cb5 could not be found. Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c92f871-249e-453c-8634-19b61ca97cb5 could not be found. Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:47.758255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:47.768297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:47.768297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:47.768297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:47.768297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:47.768297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:47.768297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:47.768297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c92f871-249e-453c-8634-19b61ca97cb5 could not be found. Aug 09 17:23:47.768297 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:47.768297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] Returning 404 to user: Instance 8c92f871-249e-453c-8634-19b61ca97cb5 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:47.775180 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ff7494a1-7a93-4e08-83a3-ae373bfa9d91 tempest-ServersAaction247Test-1482075963 tempest-ServersAaction247Test-1482075963-project] 10.222.0.93 "GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5" status: 404 len: 111 microversion: 2.47 time: 0.167858 Aug 09 17:23:47.780927 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1658/3178] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:23:47 2022] GET /compute/v2.1/servers/8c92f871-249e-453c-8634-19b61ca97cb5 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:23:48.084296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7e91b107-3789-402d-a071-25adf5bfa37f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:48.085417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7e91b107-3789-402d-a071-25adf5bfa37f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:48.113335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e91b107-3789-402d-a071-25adf5bfa37f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:48.114203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e91b107-3789-402d-a071-25adf5bfa37f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:48.125017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e91b107-3789-402d-a071-25adf5bfa37f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:48.126838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e91b107-3789-402d-a071-25adf5bfa37f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:48.128943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e91b107-3789-402d-a071-25adf5bfa37f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:48.130174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e91b107-3789-402d-a071-25adf5bfa37f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:48.498543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c618c966-bfc1-44df-a9df-c3855ef64fa3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:48.522304 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c618c966-bfc1-44df-a9df-c3855ef64fa3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1472 microversion: 2.1 time: 1.063391 Aug 09 17:23:48.528714 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1521/3179] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:47 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1472 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:23:48.549896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0b57e6a9-fdbf-40f4-8f42-9b6f3528760c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:48.552370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0b57e6a9-fdbf-40f4-8f42-9b6f3528760c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:48.578643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b57e6a9-fdbf-40f4-8f42-9b6f3528760c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:48.579611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b57e6a9-fdbf-40f4-8f42-9b6f3528760c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:48.580389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b57e6a9-fdbf-40f4-8f42-9b6f3528760c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:48.581631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b57e6a9-fdbf-40f4-8f42-9b6f3528760c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:48.582432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b57e6a9-fdbf-40f4-8f42-9b6f3528760c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:48.588209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b57e6a9-fdbf-40f4-8f42-9b6f3528760c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:49.154630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0b57e6a9-fdbf-40f4-8f42-9b6f3528760c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:49.192297 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0b57e6a9-fdbf-40f4-8f42-9b6f3528760c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 0.650186 Aug 09 17:23:49.201882 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1522/3180] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:48 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:49.494453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5c5715ce-c035-4358-a40f-8ef7d7597b3d req-7e2d202a-01c1-407b-b2e2-0b47f17f74cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3b3bf1-f13b-440c-9db0-14b0e7d57055", "name": "network-vif-deleted", "tag": "45ae12ab-8288-46ce-825f-c64eab2678ae"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:49.549001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5c5715ce-c035-4358-a40f-8ef7d7597b3d req-7e2d202a-01c1-407b-b2e2-0b47f17f74cb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:49.553366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5c5715ce-c035-4358-a40f-8ef7d7597b3d req-7e2d202a-01c1-407b-b2e2-0b47f17f74cb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:49.555045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5c5715ce-c035-4358-a40f-8ef7d7597b3d req-7e2d202a-01c1-407b-b2e2-0b47f17f74cb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:49.654217 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5c5715ce-c035-4358-a40f-8ef7d7597b3d req-7e2d202a-01c1-407b-b2e2-0b47f17f74cb service nova] Creating event network-vif-deleted:45ae12ab-8288-46ce-825f-c64eab2678ae for instance 7d3b3bf1-f13b-440c-9db0-14b0e7d57055 on n-h1-845781-6 Aug 09 17:23:49.663720 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5c5715ce-c035-4358-a40f-8ef7d7597b3d req-7e2d202a-01c1-407b-b2e2-0b47f17f74cb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178285 Aug 09 17:23:49.673322 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1523/3181] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:23:49.695670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:49.696893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:49.732374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:49.741144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:49.743860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:49.750098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:49.752833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:49.778383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:50.010594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:50.012796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:50.017927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:50.019265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lazy-loading 'fault' on Instance uuid 7d3b3bf1-f13b-440c-9db0-14b0e7d57055 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:23:50.173941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7e91b107-3789-402d-a071-25adf5bfa37f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:50.200621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:50.210734 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-45e8b821-917a-4703-930c-b7571c003a7c tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 200 len: 1307 microversion: 2.1 time: 0.534172 Aug 09 17:23:50.212837 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7e91b107-3789-402d-a071-25adf5bfa37f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1523 microversion: 2.1 time: 2.132777 Aug 09 17:23:50.216103 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1659/3182] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:48 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1523 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:50.232748 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1524/3183] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:49 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 1307 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:50.258590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4cf53c64-53bc-4330-9ded-a89ec103ada5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:50.259835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4cf53c64-53bc-4330-9ded-a89ec103ada5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:50.279570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cf53c64-53bc-4330-9ded-a89ec103ada5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:50.280495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cf53c64-53bc-4330-9ded-a89ec103ada5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:50.281260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cf53c64-53bc-4330-9ded-a89ec103ada5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:50.282658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cf53c64-53bc-4330-9ded-a89ec103ada5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:50.283536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cf53c64-53bc-4330-9ded-a89ec103ada5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:50.305036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cf53c64-53bc-4330-9ded-a89ec103ada5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:51.242466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5b93a0da-b281-47f7-9a3d-1968799fcbf2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:51.244645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5b93a0da-b281-47f7-9a3d-1968799fcbf2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:51.261420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93a0da-b281-47f7-9a3d-1968799fcbf2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:51.263567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93a0da-b281-47f7-9a3d-1968799fcbf2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:51.264676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93a0da-b281-47f7-9a3d-1968799fcbf2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:51.266251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93a0da-b281-47f7-9a3d-1968799fcbf2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:51.267385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93a0da-b281-47f7-9a3d-1968799fcbf2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:51.268501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b93a0da-b281-47f7-9a3d-1968799fcbf2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:51.845747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4cf53c64-53bc-4330-9ded-a89ec103ada5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:51.893615 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4cf53c64-53bc-4330-9ded-a89ec103ada5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 1.658059 Aug 09 17:23:51.898213 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1660/3184] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:50 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:51.923852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:51.931171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7d3b3bf1-f13b-440c-9db0-14b0e7d57055] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:51.947445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:51.966176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:51.969793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:51.977991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:51.984124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:51.989902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:52.076377 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] HTTP exception thrown: Instance 7d3b3bf1-f13b-440c-9db0-14b0e7d57055 could not be found. Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Request method failure captured: Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 HTTP/1.1 Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pcZIp_E-R9bnBJLqNKPw_oVcgO3I-b0ZlO7EWV6UcwHhog9OmjGLaAQGYnT1znB6odeojveKiOuTjWw9Kms9g89l7L_1xNmVO6QJrGD0tc4nB762QMeAiP8MXEm9gtOym3vyXvVAek0zjwNWfr9cMDdv_LbFUnVx2jVtN5fPWVxU7M Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: fe6a633b90b949af91c0d2aa1d361fe5 Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 7d3b3bf1-f13b-440c-9db0-14b0e7d57055 could not be found. Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '7d3b3bf1-f13b-440c-9db0-14b0e7d57055'} Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3b3bf1-f13b-440c-9db0-14b0e7d57055 could not be found. Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3b3bf1-f13b-440c-9db0-14b0e7d57055 could not be found. Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:52.082952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:52.090739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:52.090739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:52.090739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:52.090739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:52.090739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:52.090739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3b3bf1-f13b-440c-9db0-14b0e7d57055 could not be found. Aug 09 17:23:52.090739 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:52.096501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Returning 404 to user: Instance 7d3b3bf1-f13b-440c-9db0-14b0e7d57055 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:52.102706 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cfd6e124-3910-4882-8d9c-ce64a12e3690 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055" status: 404 len: 111 microversion: 2.1 time: 0.201100 Aug 09 17:23:52.106105 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1661/3185] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:51 2022] GET /compute/v2.1/servers/7d3b3bf1-f13b-440c-9db0-14b0e7d57055 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:23:52.125921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df24756b-a71f-49c9-9e57-2ecd49324058 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:52.128318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df24756b-a71f-49c9-9e57-2ecd49324058 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:52.156776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df24756b-a71f-49c9-9e57-2ecd49324058 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:52.157496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df24756b-a71f-49c9-9e57-2ecd49324058 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:52.158822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df24756b-a71f-49c9-9e57-2ecd49324058 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:52.162048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df24756b-a71f-49c9-9e57-2ecd49324058 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:52.163339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df24756b-a71f-49c9-9e57-2ecd49324058 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:52.165103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df24756b-a71f-49c9-9e57-2ecd49324058 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:52.253545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5b93a0da-b281-47f7-9a3d-1968799fcbf2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:52.285879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df24756b-a71f-49c9-9e57-2ecd49324058 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:23:52.288801 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5b93a0da-b281-47f7-9a3d-1968799fcbf2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1503 microversion: 2.1 time: 1.053357 Aug 09 17:23:52.305342 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1525/3186] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:51 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1503 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:52.336227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-845a36fa-84c4-41c3-a9a5-65fa6209b2ac tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:52.337806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-845a36fa-84c4-41c3-a9a5-65fa6209b2ac tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:52.350166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-845a36fa-84c4-41c3-a9a5-65fa6209b2ac tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:52.351091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-845a36fa-84c4-41c3-a9a5-65fa6209b2ac tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:52.351934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-845a36fa-84c4-41c3-a9a5-65fa6209b2ac tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:52.353286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-845a36fa-84c4-41c3-a9a5-65fa6209b2ac tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:52.354156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-845a36fa-84c4-41c3-a9a5-65fa6209b2ac tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:52.354940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-845a36fa-84c4-41c3-a9a5-65fa6209b2ac tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:52.460357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:52.646607 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df24756b-a71f-49c9-9e57-2ecd49324058 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 204 len: 0 microversion: 2.1 time: 0.516618 Aug 09 17:23:52.646607 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1662/3187] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:23:52 2022] DELETE /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:23:52.666149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dcf4ebc2-419f-4260-8570-70fc632c89df tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:52.666149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dcf4ebc2-419f-4260-8570-70fc632c89df tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:52.711470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcf4ebc2-419f-4260-8570-70fc632c89df tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:52.713889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcf4ebc2-419f-4260-8570-70fc632c89df tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:52.715884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcf4ebc2-419f-4260-8570-70fc632c89df tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:52.717812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcf4ebc2-419f-4260-8570-70fc632c89df tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:52.719096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcf4ebc2-419f-4260-8570-70fc632c89df tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:52.725960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcf4ebc2-419f-4260-8570-70fc632c89df tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:53.168950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-845a36fa-84c4-41c3-a9a5-65fa6209b2ac tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:53.181628 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-845a36fa-84c4-41c3-a9a5-65fa6209b2ac tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1517 microversion: 2.1 time: 0.852126 Aug 09 17:23:53.184691 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1526/3188] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:52 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1517 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:23:53.191749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-40907645-5538-43da-8851-0d9f25a04517 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:53.192388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-40907645-5538-43da-8851-0d9f25a04517 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:53.202241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40907645-5538-43da-8851-0d9f25a04517 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:53.202755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40907645-5538-43da-8851-0d9f25a04517 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:53.203393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40907645-5538-43da-8851-0d9f25a04517 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:53.204341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40907645-5538-43da-8851-0d9f25a04517 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:53.204806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40907645-5538-43da-8851-0d9f25a04517 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:53.205588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40907645-5538-43da-8851-0d9f25a04517 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:53.429258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dcf4ebc2-419f-4260-8570-70fc632c89df tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:53.455150 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dcf4ebc2-419f-4260-8570-70fc632c89df tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1471 microversion: 2.1 time: 0.809253 Aug 09 17:23:53.456016 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1663/3189] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:52 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1471 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:53.466138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b17d79d-b464-454b-ae09-88d9e72f28fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:53.473522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7b17d79d-b464-454b-ae09-88d9e72f28fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 4b4cd129-4efd-401c-a32c-c6c339fe5cb7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:53.486957 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-7b17d79d-b464-454b-ae09-88d9e72f28fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] HTTP exception thrown: Instance 4b4cd129-4efd-401c-a32c-c6c339fe5cb7 could not be found. Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b17d79d-b464-454b-ae09-88d9e72f28fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Request method failure captured: Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/4b4cd129-4efd-401c-a32c-c6c339fe5cb7/action HTTP/1.1 Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 14 Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfTXHKJ-127xoXOxvirCkOJ5Ga7oI06dbW5eRmTw3VceZ3fIPtVcpBoJqCQEzgHg892I33A2CZbgdV9GneqCNx7frvCudUtWkW3U62800gIkrYotA0sMKiw2vzfbegwV0AsonNcEy5cWuu85myYoWYiVD7fe2x9mfaYw2xpqmhRsNo Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d20bf24928749afb9b848946419f4f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a34881c81ae2427fbf2cbb1cd8c4ef52 Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: {"rescue": {}} Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 4b4cd129-4efd-401c-a32c-c6c339fe5cb7 could not be found. Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '4b4cd129-4efd-401c-a32c-c6c339fe5cb7', 'body': {'rescue': {}}} Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b4cd129-4efd-401c-a32c-c6c339fe5cb7 could not be found. Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b4cd129-4efd-401c-a32c-c6c339fe5cb7 could not be found. Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:53.497221 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:53.510888 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:53.510888 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:53.510888 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:53.510888 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:53.510888 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b4cd129-4efd-401c-a32c-c6c339fe5cb7 could not be found. Aug 09 17:23:53.510888 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:53.514050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b17d79d-b464-454b-ae09-88d9e72f28fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Returning 404 to user: Instance 4b4cd129-4efd-401c-a32c-c6c339fe5cb7 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:53.515197 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b17d79d-b464-454b-ae09-88d9e72f28fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/4b4cd129-4efd-401c-a32c-c6c339fe5cb7/action" status: 404 len: 111 microversion: 2.1 time: 0.057129 Aug 09 17:23:53.517018 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1664/3190] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:23:53 2022] POST /compute/v2.1/servers/4b4cd129-4efd-401c-a32c-c6c339fe5cb7/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:23:53.539234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f5c04e2f-145f-4bf8-b536-d7402117a72e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:53.540688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-40907645-5538-43da-8851-0d9f25a04517 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:53.541752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f5c04e2f-145f-4bf8-b536-d7402117a72e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:53.554768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c04e2f-145f-4bf8-b536-d7402117a72e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:53.557316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c04e2f-145f-4bf8-b536-d7402117a72e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:53.559183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c04e2f-145f-4bf8-b536-d7402117a72e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:53.559514 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-40907645-5538-43da-8851-0d9f25a04517 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 0.372544 Aug 09 17:23:53.561608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c04e2f-145f-4bf8-b536-d7402117a72e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:53.562658 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1527/3191] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:53 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:53.563410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c04e2f-145f-4bf8-b536-d7402117a72e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:53.564702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5c04e2f-145f-4bf8-b536-d7402117a72e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:53.754515 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f5c04e2f-145f-4bf8-b536-d7402117a72e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/action" status: 202 len: 0 microversion: 2.1 time: 0.219404 Aug 09 17:23:53.757189 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1665/3192] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:23:53 2022] POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:23:53.772424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d29824f6-29b0-4a73-8275-4f3621a0785d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:53.773049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d29824f6-29b0-4a73-8275-4f3621a0785d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:53.807685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d29824f6-29b0-4a73-8275-4f3621a0785d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:53.807685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d29824f6-29b0-4a73-8275-4f3621a0785d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:53.807685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d29824f6-29b0-4a73-8275-4f3621a0785d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:53.807685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d29824f6-29b0-4a73-8275-4f3621a0785d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:53.820206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d29824f6-29b0-4a73-8275-4f3621a0785d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:53.820206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d29824f6-29b0-4a73-8275-4f3621a0785d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:54.495302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a7921c1b-6369-4f03-ad59-bef382497cbe tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:54.501130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a7921c1b-6369-4f03-ad59-bef382497cbe tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:54.534718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7921c1b-6369-4f03-ad59-bef382497cbe tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:54.535452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7921c1b-6369-4f03-ad59-bef382497cbe tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:54.536255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7921c1b-6369-4f03-ad59-bef382497cbe tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:54.541662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7921c1b-6369-4f03-ad59-bef382497cbe tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:54.547081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7921c1b-6369-4f03-ad59-bef382497cbe tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:54.550340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7921c1b-6369-4f03-ad59-bef382497cbe tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:54.628826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d29824f6-29b0-4a73-8275-4f3621a0785d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:54.657139 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d29824f6-29b0-4a73-8275-4f3621a0785d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1522 microversion: 2.1 time: 0.891122 Aug 09 17:23:54.687920 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1528/3193] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:53 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1522 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:54.708356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5f5c2af0-312d-4d3c-9ea2-036c53cb667b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:54.712339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5f5c2af0-312d-4d3c-9ea2-036c53cb667b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:54.748517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f5c2af0-312d-4d3c-9ea2-036c53cb667b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:54.748517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f5c2af0-312d-4d3c-9ea2-036c53cb667b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:54.748517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f5c2af0-312d-4d3c-9ea2-036c53cb667b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:54.748517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f5c2af0-312d-4d3c-9ea2-036c53cb667b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:54.748517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f5c2af0-312d-4d3c-9ea2-036c53cb667b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:54.748517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f5c2af0-312d-4d3c-9ea2-036c53cb667b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:55.161887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5f5c2af0-312d-4d3c-9ea2-036c53cb667b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:55.185060 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5f5c2af0-312d-4d3c-9ea2-036c53cb667b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 0.491909 Aug 09 17:23:55.187338 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1529/3194] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:54 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:55.303871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a7921c1b-6369-4f03-ad59-bef382497cbe tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:55.325202 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a7921c1b-6369-4f03-ad59-bef382497cbe tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1471 microversion: 2.1 time: 0.843552 Aug 09 17:23:55.336362 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1666/3195] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:54 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1471 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:23:55.709766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-145d32de-49c7-4382-a5a9-f07641e711d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:55.712187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-145d32de-49c7-4382-a5a9-f07641e711d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:55.736147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-145d32de-49c7-4382-a5a9-f07641e711d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:55.744495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-145d32de-49c7-4382-a5a9-f07641e711d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:55.752693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-145d32de-49c7-4382-a5a9-f07641e711d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:55.754721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-145d32de-49c7-4382-a5a9-f07641e711d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:55.770677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-145d32de-49c7-4382-a5a9-f07641e711d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:55.771556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-145d32de-49c7-4382-a5a9-f07641e711d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:56.188367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-364af3e9-9980-4567-8d70-0e039ca48b2e req-90a78559-1796-4956-bacf-91f01967b41a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad75e25e-2e56-44e4-9dff-202aac8cb52c", "name": "network-vif-deleted", "tag": "b8d8a612-2537-479e-98f4-6b70094a8512"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:56.218415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-364af3e9-9980-4567-8d70-0e039ca48b2e req-90a78559-1796-4956-bacf-91f01967b41a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:56.222249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-364af3e9-9980-4567-8d70-0e039ca48b2e req-90a78559-1796-4956-bacf-91f01967b41a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:56.225270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-364af3e9-9980-4567-8d70-0e039ca48b2e req-90a78559-1796-4956-bacf-91f01967b41a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:56.264676 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-364af3e9-9980-4567-8d70-0e039ca48b2e req-90a78559-1796-4956-bacf-91f01967b41a service nova] Creating event network-vif-deleted:b8d8a612-2537-479e-98f4-6b70094a8512 for instance ad75e25e-2e56-44e4-9dff-202aac8cb52c on n-h1-845781-6 Aug 09 17:23:56.273097 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-364af3e9-9980-4567-8d70-0e039ca48b2e req-90a78559-1796-4956-bacf-91f01967b41a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107531 Aug 09 17:23:56.274476 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1667/3196] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:23:56.285426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f277601b-4d39-47c0-a505-2ad854c822f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:56.288698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f277601b-4d39-47c0-a505-2ad854c822f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:56.309951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f277601b-4d39-47c0-a505-2ad854c822f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:56.318764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f277601b-4d39-47c0-a505-2ad854c822f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:56.319703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f277601b-4d39-47c0-a505-2ad854c822f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:56.324439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f277601b-4d39-47c0-a505-2ad854c822f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:56.326002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f277601b-4d39-47c0-a505-2ad854c822f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:56.329044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f277601b-4d39-47c0-a505-2ad854c822f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:57.075946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-145d32de-49c7-4382-a5a9-f07641e711d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:57.114152 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-145d32de-49c7-4382-a5a9-f07641e711d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1502 microversion: 2.1 time: 1.407516 Aug 09 17:23:57.141776 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1530/3197] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:55 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1502 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:57.151406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:57.152650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:57.164836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:57.166501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:57.167313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:57.168728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:57.169571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:57.170361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:57.350535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f277601b-4d39-47c0-a505-2ad854c822f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:57.380128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:57.380908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:57.389279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:57.390021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lazy-loading 'fault' on Instance uuid ad75e25e-2e56-44e4-9dff-202aac8cb52c {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:23:57.402609 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f277601b-4d39-47c0-a505-2ad854c822f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 1.125118 Aug 09 17:23:57.403763 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1668/3198] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:56 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:57.445645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:57.456808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:57.492325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:57.497562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:57.500582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:57.504060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:57.510649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:57.515481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:57.639533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lazy-loading 'flavor' on Instance uuid d19cd5ee-f610-4a5a-9983-e233f32596f1 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:23:57.732625 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] HTTP exception thrown: Cannot 'rescue' instance d19cd5ee-f610-4a5a-9983-e233f32596f1 while it is in vm_state paused Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Request method failure captured: Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/action HTTP/1.1 Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 14 Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfTXHKJ-127xoXOxvirCkOJ5Ga7oI06dbW5eRmTw3VceZ3fIPtVcpBoJqCQEzgHg892I33A2CZbgdV9GneqCNx7frvCudUtWkW3U62800gIkrYotA0sMKiw2vzfbegwV0AsonNcEy5cWuu85myYoWYiVD7fe2x9mfaYw2xpqmhRsNo Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d20bf24928749afb9b848946419f4f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a34881c81ae2427fbf2cbb1cd8c4ef52 Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: {"rescue": {}} Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: exception: Cannot 'rescue' instance d19cd5ee-f610-4a5a-9983-e233f32596f1 while it is in vm_state paused Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'd19cd5ee-f610-4a5a-9983-e233f32596f1', 'body': {'rescue': {}}} Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d19cd5ee-f610-4a5a-9983-e233f32596f1 in vm_state paused. Cannot rescue while the instance is in this state. Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance d19cd5ee-f610-4a5a-9983-e233f32596f1 while it is in vm_state paused Aug 09 17:23:57.750026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:57.787143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:57.787143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:57.787143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:57.787143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:57.787143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:57.787143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:57.787143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:57.787143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance d19cd5ee-f610-4a5a-9983-e233f32596f1 while it is in vm_state paused Aug 09 17:23:57.787143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:23:57.787143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Returning 409 to user: Cannot 'rescue' instance d19cd5ee-f610-4a5a-9983-e233f32596f1 while it is in vm_state paused {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:57.791096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:57.796039 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09f66875-e9d4-416b-98ab-944bdb1495fe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/action" status: 409 len: 144 microversion: 2.1 time: 0.367908 Aug 09 17:23:57.799767 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1669/3199] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:23:57 2022] POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/action => generated 144 bytes in 388 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:23:57.818618 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3756956b-1703-44c4-a989-6d09e64db73f tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 200 len: 1305 microversion: 2.1 time: 0.668185 Aug 09 17:23:57.831097 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1531/3200] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:57 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 1305 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:57.833604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-46f1e2f7-fe3b-442b-97ed-4eba51f99db9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:23:57.836752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-46f1e2f7-fe3b-442b-97ed-4eba51f99db9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:57.863906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46f1e2f7-fe3b-442b-97ed-4eba51f99db9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:57.868496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46f1e2f7-fe3b-442b-97ed-4eba51f99db9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:57.871565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46f1e2f7-fe3b-442b-97ed-4eba51f99db9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:57.879455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46f1e2f7-fe3b-442b-97ed-4eba51f99db9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:57.882519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46f1e2f7-fe3b-442b-97ed-4eba51f99db9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:57.898695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46f1e2f7-fe3b-442b-97ed-4eba51f99db9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:58.166748 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-46f1e2f7-fe3b-442b-97ed-4eba51f99db9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/action" status: 202 len: 0 microversion: 2.1 time: 0.357562 Aug 09 17:23:58.177631 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1670/3201] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:23:57 2022] POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:23:58.202657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-009931d7-aa9f-41a1-a6ff-cfedf21fce0d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:58.205951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-009931d7-aa9f-41a1-a6ff-cfedf21fce0d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:58.224370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-009931d7-aa9f-41a1-a6ff-cfedf21fce0d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:58.225927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-009931d7-aa9f-41a1-a6ff-cfedf21fce0d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:58.227135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-009931d7-aa9f-41a1-a6ff-cfedf21fce0d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:58.228917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-009931d7-aa9f-41a1-a6ff-cfedf21fce0d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:58.230757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-009931d7-aa9f-41a1-a6ff-cfedf21fce0d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:58.232165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-009931d7-aa9f-41a1-a6ff-cfedf21fce0d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:58.440370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-928b8b49-6808-482b-a0d8-ccc0dc34cd85 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:58.441336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-928b8b49-6808-482b-a0d8-ccc0dc34cd85 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:58.466815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928b8b49-6808-482b-a0d8-ccc0dc34cd85 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:58.471922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928b8b49-6808-482b-a0d8-ccc0dc34cd85 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:58.474710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928b8b49-6808-482b-a0d8-ccc0dc34cd85 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:58.476673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928b8b49-6808-482b-a0d8-ccc0dc34cd85 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:58.476673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928b8b49-6808-482b-a0d8-ccc0dc34cd85 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:58.483192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-928b8b49-6808-482b-a0d8-ccc0dc34cd85 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:58.869071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-009931d7-aa9f-41a1-a6ff-cfedf21fce0d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:58.896853 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-009931d7-aa9f-41a1-a6ff-cfedf21fce0d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1509 microversion: 2.1 time: 0.717839 Aug 09 17:23:58.899692 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1532/3202] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:58 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1509 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:23:58.914328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:58.919284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ad75e25e-2e56-44e4-9dff-202aac8cb52c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:58.935429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:58.937413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:58.939020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:58.941258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:58.942492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:58.943573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:58.981876 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] HTTP exception thrown: Instance ad75e25e-2e56-44e4-9dff-202aac8cb52c could not be found. Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Request method failure captured: Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c HTTP/1.1 Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pcZIp_E-R9bnBJLqNKPw_oVcgO3I-b0ZlO7EWV6UcwHhog9OmjGLaAQGYnT1znB6odeojveKiOuTjWw9Kms9g89l7L_1xNmVO6QJrGD0tc4nB762QMeAiP8MXEm9gtOym3vyXvVAek0zjwNWfr9cMDdv_LbFUnVx2jVtN5fPWVxU7M Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: fe6a633b90b949af91c0d2aa1d361fe5 Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance ad75e25e-2e56-44e4-9dff-202aac8cb52c could not be found. Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'ad75e25e-2e56-44e4-9dff-202aac8cb52c'} Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad75e25e-2e56-44e4-9dff-202aac8cb52c could not be found. Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad75e25e-2e56-44e4-9dff-202aac8cb52c could not be found. Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:23:58.987569 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:58.998110 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:23:58.998110 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:23:58.998110 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:23:58.998110 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:23:58.998110 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:23:58.998110 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad75e25e-2e56-44e4-9dff-202aac8cb52c could not be found. Aug 09 17:23:58.998110 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:23:59.001313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Returning 404 to user: Instance ad75e25e-2e56-44e4-9dff-202aac8cb52c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:23:59.003794 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dda07da2-2c05-4091-8ab4-7cbc786d1381 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c" status: 404 len: 111 microversion: 2.1 time: 0.101362 Aug 09 17:23:59.005919 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1533/3203] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:58 2022] GET /compute/v2.1/servers/ad75e25e-2e56-44e4-9dff-202aac8cb52c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:23:59.022199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1858e80-395b-4d57-a076-37ed3a7162a3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:59.025481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f1858e80-395b-4d57-a076-37ed3a7162a3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:59.039439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1858e80-395b-4d57-a076-37ed3a7162a3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:59.040766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1858e80-395b-4d57-a076-37ed3a7162a3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:59.042551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1858e80-395b-4d57-a076-37ed3a7162a3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:59.044269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1858e80-395b-4d57-a076-37ed3a7162a3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:59.045409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1858e80-395b-4d57-a076-37ed3a7162a3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:59.046473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1858e80-395b-4d57-a076-37ed3a7162a3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:59.096910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:23:59.115790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f1858e80-395b-4d57-a076-37ed3a7162a3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:23:59.237291 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f1858e80-395b-4d57-a076-37ed3a7162a3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3" status: 204 len: 0 microversion: 2.1 time: 0.222787 Aug 09 17:23:59.239192 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1534/3204] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:23:59 2022] DELETE /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:23:59.253140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-144bfd8e-11bd-4e98-8512-5f52b1153b69 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:59.254950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-144bfd8e-11bd-4e98-8512-5f52b1153b69 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:59.268625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-144bfd8e-11bd-4e98-8512-5f52b1153b69 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:59.269903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-144bfd8e-11bd-4e98-8512-5f52b1153b69 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:59.270612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-144bfd8e-11bd-4e98-8512-5f52b1153b69 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:59.271732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-144bfd8e-11bd-4e98-8512-5f52b1153b69 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:59.272449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-144bfd8e-11bd-4e98-8512-5f52b1153b69 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:59.273498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-144bfd8e-11bd-4e98-8512-5f52b1153b69 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:59.316293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-144bfd8e-11bd-4e98-8512-5f52b1153b69 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:23:59.613857 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-144bfd8e-11bd-4e98-8512-5f52b1153b69 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 204 len: 0 microversion: 2.1 time: 0.366858 Aug 09 17:23:59.619824 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1535/3205] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:23:59 2022] DELETE /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:23:59.664906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ec7882d7-80be-4b56-b8dc-334e32b0d637 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:23:59.669017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ec7882d7-80be-4b56-b8dc-334e32b0d637 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:23:59.707004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec7882d7-80be-4b56-b8dc-334e32b0d637 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:59.707947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec7882d7-80be-4b56-b8dc-334e32b0d637 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:59.708760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec7882d7-80be-4b56-b8dc-334e32b0d637 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:59.710477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec7882d7-80be-4b56-b8dc-334e32b0d637 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:23:59.711907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec7882d7-80be-4b56-b8dc-334e32b0d637 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:23:59.712799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec7882d7-80be-4b56-b8dc-334e32b0d637 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:23:59.963909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-928b8b49-6808-482b-a0d8-ccc0dc34cd85 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:23:59.992483 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-928b8b49-6808-482b-a0d8-ccc0dc34cd85 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 1.556873 Aug 09 17:24:00.007536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1671/3206] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:58 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:24:00.018157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0dad5d76-a40a-49ed-98bb-8ceb425a64c5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:00.021961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0dad5d76-a40a-49ed-98bb-8ceb425a64c5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:00.051293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dad5d76-a40a-49ed-98bb-8ceb425a64c5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:00.052683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dad5d76-a40a-49ed-98bb-8ceb425a64c5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:00.053776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dad5d76-a40a-49ed-98bb-8ceb425a64c5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:00.059955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dad5d76-a40a-49ed-98bb-8ceb425a64c5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:00.062794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dad5d76-a40a-49ed-98bb-8ceb425a64c5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:00.063945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dad5d76-a40a-49ed-98bb-8ceb425a64c5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:00.739619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ec7882d7-80be-4b56-b8dc-334e32b0d637 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:00.767079 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ec7882d7-80be-4b56-b8dc-334e32b0d637 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3" status: 200 len: 1475 microversion: 2.1 time: 1.135264 Aug 09 17:24:00.768054 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1536/3207] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:23:59 2022] GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 => generated 1475 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:00.954591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0dad5d76-a40a-49ed-98bb-8ceb425a64c5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:00.991711 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0dad5d76-a40a-49ed-98bb-8ceb425a64c5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1517 microversion: 2.1 time: 0.980132 Aug 09 17:24:00.999925 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1672/3208] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:00 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1517 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:01.059470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0554ae68-5c43-43b2-bc8f-3c5afb790aa1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:01.062134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0554ae68-5c43-43b2-bc8f-3c5afb790aa1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:01.078862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0554ae68-5c43-43b2-bc8f-3c5afb790aa1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:01.080420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0554ae68-5c43-43b2-bc8f-3c5afb790aa1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:01.081874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0554ae68-5c43-43b2-bc8f-3c5afb790aa1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:01.084080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0554ae68-5c43-43b2-bc8f-3c5afb790aa1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:01.085364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0554ae68-5c43-43b2-bc8f-3c5afb790aa1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:01.087319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0554ae68-5c43-43b2-bc8f-3c5afb790aa1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:01.809832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7a409594-191c-4800-b992-e9f35bf5faae tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:01.811027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7a409594-191c-4800-b992-e9f35bf5faae tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:01.826673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a409594-191c-4800-b992-e9f35bf5faae tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:01.828631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a409594-191c-4800-b992-e9f35bf5faae tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:01.832061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a409594-191c-4800-b992-e9f35bf5faae tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:01.833234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a409594-191c-4800-b992-e9f35bf5faae tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:01.833731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a409594-191c-4800-b992-e9f35bf5faae tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:01.834178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a409594-191c-4800-b992-e9f35bf5faae tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:02.654946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7a409594-191c-4800-b992-e9f35bf5faae tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:02.678261 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7a409594-191c-4800-b992-e9f35bf5faae tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3" status: 200 len: 1475 microversion: 2.1 time: 0.874306 Aug 09 17:24:02.696081 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1673/3209] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:01 2022] GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 => generated 1475 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:24:03.374005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0554ae68-5c43-43b2-bc8f-3c5afb790aa1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:03.424969 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0554ae68-5c43-43b2-bc8f-3c5afb790aa1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 2.376320 Aug 09 17:24:03.444449 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1537/3210] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:01 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:03.724336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50b23153-267e-4a55-8b75-95f06594438b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:03.728468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-50b23153-267e-4a55-8b75-95f06594438b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:03.765427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50b23153-267e-4a55-8b75-95f06594438b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:03.769940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50b23153-267e-4a55-8b75-95f06594438b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:03.773575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50b23153-267e-4a55-8b75-95f06594438b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:03.775062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50b23153-267e-4a55-8b75-95f06594438b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:03.781823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50b23153-267e-4a55-8b75-95f06594438b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:03.782625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50b23153-267e-4a55-8b75-95f06594438b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:04.471155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-50b23153-267e-4a55-8b75-95f06594438b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:04.484024 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-50b23153-267e-4a55-8b75-95f06594438b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3" status: 200 len: 1475 microversion: 2.1 time: 0.767033 Aug 09 17:24:04.485903 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1674/3211] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:03 2022] GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 => generated 1475 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:04.502064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a23d5c3d-dc05-4d55-b4b0-2ac467cb8d88 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:04.514459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a23d5c3d-dc05-4d55-b4b0-2ac467cb8d88 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:04.550640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a23d5c3d-dc05-4d55-b4b0-2ac467cb8d88 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:04.559467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a23d5c3d-dc05-4d55-b4b0-2ac467cb8d88 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:04.562649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a23d5c3d-dc05-4d55-b4b0-2ac467cb8d88 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:04.565994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a23d5c3d-dc05-4d55-b4b0-2ac467cb8d88 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:04.567010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a23d5c3d-dc05-4d55-b4b0-2ac467cb8d88 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:04.572883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a23d5c3d-dc05-4d55-b4b0-2ac467cb8d88 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:04.775912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4bfa4ab0-4975-465e-a829-e1ac2a06d6a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:04.781968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4bfa4ab0-4975-465e-a829-e1ac2a06d6a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:04.800669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bfa4ab0-4975-465e-a829-e1ac2a06d6a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:04.802082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bfa4ab0-4975-465e-a829-e1ac2a06d6a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:04.803413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bfa4ab0-4975-465e-a829-e1ac2a06d6a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:04.805027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bfa4ab0-4975-465e-a829-e1ac2a06d6a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:04.806468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bfa4ab0-4975-465e-a829-e1ac2a06d6a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:04.807952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bfa4ab0-4975-465e-a829-e1ac2a06d6a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:04.893422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-4bfa4ab0-4975-465e-a829-e1ac2a06d6a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lazy-loading 'flavor' on Instance uuid d19cd5ee-f610-4a5a-9983-e233f32596f1 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:24:05.227416 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4bfa4ab0-4975-465e-a829-e1ac2a06d6a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/action" status: 200 len: 32 microversion: 2.1 time: 0.457782 Aug 09 17:24:05.231232 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1675/3212] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:24:04 2022] POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/action => generated 32 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:24:05.249968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-366776fa-773e-43a4-b644-08c7464a664e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:05.250934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-366776fa-773e-43a4-b644-08c7464a664e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:05.273565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366776fa-773e-43a4-b644-08c7464a664e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:05.277842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366776fa-773e-43a4-b644-08c7464a664e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:05.280726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366776fa-773e-43a4-b644-08c7464a664e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:05.284633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366776fa-773e-43a4-b644-08c7464a664e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:05.287196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366776fa-773e-43a4-b644-08c7464a664e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:05.294226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366776fa-773e-43a4-b644-08c7464a664e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:05.418105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:06.116230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a23d5c3d-dc05-4d55-b4b0-2ac467cb8d88 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:06.170076 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a23d5c3d-dc05-4d55-b4b0-2ac467cb8d88 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 1.703048 Aug 09 17:24:06.171132 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1538/3213] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:04 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:06.209836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:06.218079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:06.251036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:06.254968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:06.258482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:06.261003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:06.273093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:06.290509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:06.477427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:06.478811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:06.486938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:06.488568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lazy-loading 'fault' on Instance uuid 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:24:07.055680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:07.086681 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69d9e023-d966-4ed9-a657-b470d6eaf46e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3" status: 200 len: 1309 microversion: 2.1 time: 0.911343 Aug 09 17:24:07.090745 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1539/3214] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:06 2022] GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 => generated 1309 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:07.113826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ffdf8a83-17d0-42ec-8c69-c437a1233e40 req-724d0a4e-5e80-4462-972b-f338764b2b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3", "name": "network-vif-deleted", "tag": "fb66ba26-cadb-4e08-b9d8-d3ec7bd243c1"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:07.163697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ffdf8a83-17d0-42ec-8c69-c437a1233e40 req-724d0a4e-5e80-4462-972b-f338764b2b9f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:07.164922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ffdf8a83-17d0-42ec-8c69-c437a1233e40 req-724d0a4e-5e80-4462-972b-f338764b2b9f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:07.167265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ffdf8a83-17d0-42ec-8c69-c437a1233e40 req-724d0a4e-5e80-4462-972b-f338764b2b9f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:07.261597 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ffdf8a83-17d0-42ec-8c69-c437a1233e40 req-724d0a4e-5e80-4462-972b-f338764b2b9f service nova] Creating event network-vif-deleted:fb66ba26-cadb-4e08-b9d8-d3ec7bd243c1 for instance 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 on n-h1-845781-6 Aug 09 17:24:07.285825 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ffdf8a83-17d0-42ec-8c69-c437a1233e40 req-724d0a4e-5e80-4462-972b-f338764b2b9f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184269 Aug 09 17:24:07.287973 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1540/3215] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:07.309560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3bb09e4c-7824-4d60-96fd-329c5aa2c3c5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:07.316728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3bb09e4c-7824-4d60-96fd-329c5aa2c3c5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:07.320507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:07.350643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bb09e4c-7824-4d60-96fd-329c5aa2c3c5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:07.351534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bb09e4c-7824-4d60-96fd-329c5aa2c3c5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:07.352502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bb09e4c-7824-4d60-96fd-329c5aa2c3c5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:07.353801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bb09e4c-7824-4d60-96fd-329c5aa2c3c5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:07.372966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bb09e4c-7824-4d60-96fd-329c5aa2c3c5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:07.375282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bb09e4c-7824-4d60-96fd-329c5aa2c3c5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:08.091024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-366776fa-773e-43a4-b644-08c7464a664e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:08.122744 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-366776fa-773e-43a4-b644-08c7464a664e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 2.877709 Aug 09 17:24:08.126745 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1676/3216] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:05 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 2884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:24:08.176256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:08.177920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:08.193311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:08.194553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:08.195572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:08.197098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:08.198131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:08.199205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:08.255328 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] HTTP exception thrown: Instance 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 could not be found. Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Request method failure captured: Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 HTTP/1.1 Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pcZIp_E-R9bnBJLqNKPw_oVcgO3I-b0ZlO7EWV6UcwHhog9OmjGLaAQGYnT1znB6odeojveKiOuTjWw9Kms9g89l7L_1xNmVO6QJrGD0tc4nB762QMeAiP8MXEm9gtOym3vyXvVAek0zjwNWfr9cMDdv_LbFUnVx2jVtN5fPWVxU7M Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: fe6a633b90b949af91c0d2aa1d361fe5 Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 could not be found. Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3'} Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 could not be found. Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 could not be found. Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:08.265933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:08.277220 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:08.277220 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:08.277220 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:08.277220 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:24:08.277220 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:24:08.277220 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 could not be found. Aug 09 17:24:08.277220 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:08.282268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Returning 404 to user: Instance 7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:24:08.289636 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0efdb909-4689-4058-a78e-93ef33a7cdf2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3" status: 404 len: 111 microversion: 2.1 time: 0.120866 Aug 09 17:24:08.291144 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1677/3217] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:08 2022] GET /compute/v2.1/servers/7a9c00e2-1ae9-478b-875b-e2dfa4bf43e3 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:24:08.311178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:08.312816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: c5d08d66-4857-4a2a-b204-3cc8383900c1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:08.318189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3bb09e4c-7824-4d60-96fd-329c5aa2c3c5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:08.328194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:08.330178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:08.331684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:08.335156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:08.336403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:08.337578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:08.342645 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3bb09e4c-7824-4d60-96fd-329c5aa2c3c5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 1.051979 Aug 09 17:24:08.343834 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1541/3218] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:07 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:08.400725 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] HTTP exception thrown: Instance c5d08d66-4857-4a2a-b204-3cc8383900c1 could not be found. Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Request method failure captured: Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 HTTP/1.1 Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pcZIp_E-R9bnBJLqNKPw_oVcgO3I-b0ZlO7EWV6UcwHhog9OmjGLaAQGYnT1znB6odeojveKiOuTjWw9Kms9g89l7L_1xNmVO6QJrGD0tc4nB762QMeAiP8MXEm9gtOym3vyXvVAek0zjwNWfr9cMDdv_LbFUnVx2jVtN5fPWVxU7M Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: fe6a633b90b949af91c0d2aa1d361fe5 Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance c5d08d66-4857-4a2a-b204-3cc8383900c1 could not be found. Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'c5d08d66-4857-4a2a-b204-3cc8383900c1'} Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d08d66-4857-4a2a-b204-3cc8383900c1 could not be found. Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d08d66-4857-4a2a-b204-3cc8383900c1 could not be found. Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:08.406855 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:08.416753 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:08.416753 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:08.416753 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:08.416753 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:24:08.416753 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:24:08.416753 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d08d66-4857-4a2a-b204-3cc8383900c1 could not be found. Aug 09 17:24:08.416753 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:08.423510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Returning 404 to user: Instance c5d08d66-4857-4a2a-b204-3cc8383900c1 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:24:08.426804 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ecb7c2d-96c4-4a6f-b146-2e6f0f603171 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1" status: 404 len: 111 microversion: 2.1 time: 0.124964 Aug 09 17:24:08.428647 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1678/3219] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:08 2022] GET /compute/v2.1/servers/c5d08d66-4857-4a2a-b204-3cc8383900c1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:24:08.452802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a4f41a2e-bc01-4a0f-8da6-73cab26c78f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:08.621686 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a4f41a2e-bc01-4a0f-8da6-73cab26c78f3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/9078a8b8-4531-432b-bec7-506908d36c73" status: 204 len: 0 microversion: 2.1 time: 0.187202 Aug 09 17:24:08.623116 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1542/3220] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:24:08 2022] DELETE /compute/v2.1/os-server-groups/9078a8b8-4531-432b-bec7-506908d36c73 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:08.640008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aac4bc56-d8ad-495b-95cd-6dd3ec1f2a57 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:08.641611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aac4bc56-d8ad-495b-95cd-6dd3ec1f2a57 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ec097021-2408-4328-b677-266d832bd565] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:08.665822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aac4bc56-d8ad-495b-95cd-6dd3ec1f2a57 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:08.671355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aac4bc56-d8ad-495b-95cd-6dd3ec1f2a57 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:08.674523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aac4bc56-d8ad-495b-95cd-6dd3ec1f2a57 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:08.678970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aac4bc56-d8ad-495b-95cd-6dd3ec1f2a57 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:08.681741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aac4bc56-d8ad-495b-95cd-6dd3ec1f2a57 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:08.684107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aac4bc56-d8ad-495b-95cd-6dd3ec1f2a57 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:08.805072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aac4bc56-d8ad-495b-95cd-6dd3ec1f2a57 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ec097021-2408-4328-b677-266d832bd565] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:24:09.151109 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aac4bc56-d8ad-495b-95cd-6dd3ec1f2a57 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565" status: 204 len: 0 microversion: 2.1 time: 0.521258 Aug 09 17:24:09.164062 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1679/3221] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:24:08 2022] DELETE /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:24:09.172976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8c3debdb-910e-42a7-85b1-2a7ee629c2cd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:09.174080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8c3debdb-910e-42a7-85b1-2a7ee629c2cd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:09.196001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-884493e2-2f63-466e-ac53-d5ac08410a9e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:09.197072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-884493e2-2f63-466e-ac53-d5ac08410a9e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:09.207120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c3debdb-910e-42a7-85b1-2a7ee629c2cd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:09.209270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c3debdb-910e-42a7-85b1-2a7ee629c2cd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:09.210777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c3debdb-910e-42a7-85b1-2a7ee629c2cd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:09.212427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c3debdb-910e-42a7-85b1-2a7ee629c2cd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:09.221388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c3debdb-910e-42a7-85b1-2a7ee629c2cd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:09.222587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c3debdb-910e-42a7-85b1-2a7ee629c2cd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:09.237398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884493e2-2f63-466e-ac53-d5ac08410a9e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:09.242571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884493e2-2f63-466e-ac53-d5ac08410a9e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:09.245337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884493e2-2f63-466e-ac53-d5ac08410a9e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:09.251661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884493e2-2f63-466e-ac53-d5ac08410a9e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:09.252883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884493e2-2f63-466e-ac53-d5ac08410a9e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:09.256646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-884493e2-2f63-466e-ac53-d5ac08410a9e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:09.403949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-884493e2-2f63-466e-ac53-d5ac08410a9e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:24:09.752690 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-884493e2-2f63-466e-ac53-d5ac08410a9e tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 204 len: 0 microversion: 2.1 time: 0.575962 Aug 09 17:24:09.753333 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1680/3222] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:24:09 2022] DELETE /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:09.777989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e24fec3-8923-40d0-abea-976e13fd1f65 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:09.781386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e24fec3-8923-40d0-abea-976e13fd1f65 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:09.808236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e24fec3-8923-40d0-abea-976e13fd1f65 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:09.816960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e24fec3-8923-40d0-abea-976e13fd1f65 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:09.819116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e24fec3-8923-40d0-abea-976e13fd1f65 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:09.820931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e24fec3-8923-40d0-abea-976e13fd1f65 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:09.822309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e24fec3-8923-40d0-abea-976e13fd1f65 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:09.825578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e24fec3-8923-40d0-abea-976e13fd1f65 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:10.382591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8c3debdb-910e-42a7-85b1-2a7ee629c2cd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:10.409244 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8c3debdb-910e-42a7-85b1-2a7ee629c2cd tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 1.244936 Aug 09 17:24:10.429991 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1543/3223] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:09 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:10.468186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e96614d5-6efb-472b-96ae-1b87d21d8d15 req-59eacd10-c12d-40fb-b054-c95858fdc1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d08d66-4857-4a2a-b204-3cc8383900c1", "name": "network-vif-deleted", "tag": "cf245f33-18a6-4e7c-9406-31ad5e519173"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:10.525202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e96614d5-6efb-472b-96ae-1b87d21d8d15 req-59eacd10-c12d-40fb-b054-c95858fdc1e4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:10.528817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e96614d5-6efb-472b-96ae-1b87d21d8d15 req-59eacd10-c12d-40fb-b054-c95858fdc1e4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:10.531583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e96614d5-6efb-472b-96ae-1b87d21d8d15 req-59eacd10-c12d-40fb-b054-c95858fdc1e4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:10.633885 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e96614d5-6efb-472b-96ae-1b87d21d8d15 req-59eacd10-c12d-40fb-b054-c95858fdc1e4 service nova] Creating event network-vif-deleted:cf245f33-18a6-4e7c-9406-31ad5e519173 for instance c5d08d66-4857-4a2a-b204-3cc8383900c1 on n-h2-845781-6 Aug 09 17:24:10.657520 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e96614d5-6efb-472b-96ae-1b87d21d8d15 req-59eacd10-c12d-40fb-b054-c95858fdc1e4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224919 Aug 09 17:24:10.661816 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1544/3224] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:10.680076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6fbc8374-a62d-481f-85e6-5a113dd054c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:10.683702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6fbc8374-a62d-481f-85e6-5a113dd054c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ec097021-2408-4328-b677-266d832bd565] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:10.713594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fbc8374-a62d-481f-85e6-5a113dd054c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:10.718319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fbc8374-a62d-481f-85e6-5a113dd054c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:10.720050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fbc8374-a62d-481f-85e6-5a113dd054c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:10.724036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fbc8374-a62d-481f-85e6-5a113dd054c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:10.734901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fbc8374-a62d-481f-85e6-5a113dd054c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:10.737592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fbc8374-a62d-481f-85e6-5a113dd054c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:11.773869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6fbc8374-a62d-481f-85e6-5a113dd054c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:11.796016 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6fbc8374-a62d-481f-85e6-5a113dd054c1 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565" status: 200 len: 1474 microversion: 2.1 time: 1.123889 Aug 09 17:24:11.797001 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1545/3225] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:10 2022] GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565 => generated 1474 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:11.830902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-52cd3cd4-c54d-40a1-8e3e-3ca73fc5cd69 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:11.832036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-52cd3cd4-c54d-40a1-8e3e-3ca73fc5cd69 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:11.847078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52cd3cd4-c54d-40a1-8e3e-3ca73fc5cd69 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:11.852204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52cd3cd4-c54d-40a1-8e3e-3ca73fc5cd69 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:11.854739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52cd3cd4-c54d-40a1-8e3e-3ca73fc5cd69 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:11.859988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52cd3cd4-c54d-40a1-8e3e-3ca73fc5cd69 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:11.860727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52cd3cd4-c54d-40a1-8e3e-3ca73fc5cd69 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:11.864811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52cd3cd4-c54d-40a1-8e3e-3ca73fc5cd69 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:12.072307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4e24fec3-8923-40d0-abea-976e13fd1f65 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:12.102398 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e24fec3-8923-40d0-abea-976e13fd1f65 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 2.346993 Aug 09 17:24:12.103511 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1681/3226] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:09 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:12.831229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5b86e438-7937-4fbe-8e41-61fad8fcf9de tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:12.836854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5b86e438-7937-4fbe-8e41-61fad8fcf9de tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ec097021-2408-4328-b677-266d832bd565] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:12.869209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:12.886683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b86e438-7937-4fbe-8e41-61fad8fcf9de tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:12.890931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b86e438-7937-4fbe-8e41-61fad8fcf9de tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:12.893223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b86e438-7937-4fbe-8e41-61fad8fcf9de tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:12.905711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b86e438-7937-4fbe-8e41-61fad8fcf9de tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:12.907048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b86e438-7937-4fbe-8e41-61fad8fcf9de tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:12.913237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b86e438-7937-4fbe-8e41-61fad8fcf9de tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:13.049124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-52cd3cd4-c54d-40a1-8e3e-3ca73fc5cd69 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:13.081457 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-52cd3cd4-c54d-40a1-8e3e-3ca73fc5cd69 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 1.261591 Aug 09 17:24:13.088965 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1546/3227] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:11 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:13.163597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-af90656c-6815-46c5-808d-cfd089eebb10 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:13.165092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-af90656c-6815-46c5-808d-cfd089eebb10 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:13.189701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af90656c-6815-46c5-808d-cfd089eebb10 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:13.190582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af90656c-6815-46c5-808d-cfd089eebb10 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:13.191346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af90656c-6815-46c5-808d-cfd089eebb10 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:13.192796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af90656c-6815-46c5-808d-cfd089eebb10 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:13.206140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af90656c-6815-46c5-808d-cfd089eebb10 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:13.207435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af90656c-6815-46c5-808d-cfd089eebb10 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:13.795326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-af90656c-6815-46c5-808d-cfd089eebb10 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:13.809592 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-af90656c-6815-46c5-808d-cfd089eebb10 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 0.663922 Aug 09 17:24:13.834446 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1547/3228] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:13 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:14.116145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5c694f29-bed8-4075-9ef8-a94c15cbc160 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:14.117891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5c694f29-bed8-4075-9ef8-a94c15cbc160 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:14.130689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c694f29-bed8-4075-9ef8-a94c15cbc160 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:14.131735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c694f29-bed8-4075-9ef8-a94c15cbc160 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:14.133503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c694f29-bed8-4075-9ef8-a94c15cbc160 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:14.146006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c694f29-bed8-4075-9ef8-a94c15cbc160 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:14.147856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c694f29-bed8-4075-9ef8-a94c15cbc160 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:14.153436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c694f29-bed8-4075-9ef8-a94c15cbc160 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:14.555452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5b86e438-7937-4fbe-8e41-61fad8fcf9de tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:14.588669 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5b86e438-7937-4fbe-8e41-61fad8fcf9de tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565" status: 200 len: 1474 microversion: 2.1 time: 1.772133 Aug 09 17:24:14.595471 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1682/3229] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:12 2022] GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565 => generated 1474 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:14.648588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-aec21756-b921-47e5-8384-4b57d6b70c9b req-983a10ae-b423-47f5-8bc9-c84bc9ec5187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba0f579-8099-45bb-8e1d-a9e5b881587b", "name": "network-vif-deleted", "tag": "6e9e7f82-272f-4a2c-bbb3-2d0634b38272"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:14.738139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aec21756-b921-47e5-8384-4b57d6b70c9b req-983a10ae-b423-47f5-8bc9-c84bc9ec5187 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:14.741175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aec21756-b921-47e5-8384-4b57d6b70c9b req-983a10ae-b423-47f5-8bc9-c84bc9ec5187 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:14.742476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aec21756-b921-47e5-8384-4b57d6b70c9b req-983a10ae-b423-47f5-8bc9-c84bc9ec5187 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:14.799252 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-aec21756-b921-47e5-8384-4b57d6b70c9b req-983a10ae-b423-47f5-8bc9-c84bc9ec5187 service nova] Creating event network-vif-deleted:6e9e7f82-272f-4a2c-bbb3-2d0634b38272 for instance 7ba0f579-8099-45bb-8e1d-a9e5b881587b on n-h1-845781-6 Aug 09 17:24:14.817863 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-aec21756-b921-47e5-8384-4b57d6b70c9b req-983a10ae-b423-47f5-8bc9-c84bc9ec5187 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218379 Aug 09 17:24:14.824487 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1683/3230] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:14.867125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aba40fc5-d2eb-4521-adc0-4b096c775089 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:14.870740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aba40fc5-d2eb-4521-adc0-4b096c775089 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:14.907111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aba40fc5-d2eb-4521-adc0-4b096c775089 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:14.910225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aba40fc5-d2eb-4521-adc0-4b096c775089 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:14.911866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aba40fc5-d2eb-4521-adc0-4b096c775089 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:14.913619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aba40fc5-d2eb-4521-adc0-4b096c775089 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:14.914882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aba40fc5-d2eb-4521-adc0-4b096c775089 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:14.916118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aba40fc5-d2eb-4521-adc0-4b096c775089 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:15.537183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aba40fc5-d2eb-4521-adc0-4b096c775089 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:15.581446 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aba40fc5-d2eb-4521-adc0-4b096c775089 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 0.739672 Aug 09 17:24:15.586178 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1684/3231] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:14 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:15.658213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d99e870-c2e6-4209-aa81-460cccc97906 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:15.659915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d99e870-c2e6-4209-aa81-460cccc97906 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ec097021-2408-4328-b677-266d832bd565] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:15.705996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d99e870-c2e6-4209-aa81-460cccc97906 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:15.712932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d99e870-c2e6-4209-aa81-460cccc97906 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:15.717579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d99e870-c2e6-4209-aa81-460cccc97906 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:15.727890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d99e870-c2e6-4209-aa81-460cccc97906 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:15.736270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d99e870-c2e6-4209-aa81-460cccc97906 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:15.747863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d99e870-c2e6-4209-aa81-460cccc97906 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:17.042600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5c694f29-bed8-4075-9ef8-a94c15cbc160 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:17.069312 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5c694f29-bed8-4075-9ef8-a94c15cbc160 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 2.959719 Aug 09 17:24:17.075470 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1548/3232] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:14 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 2968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:17.104761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-288c3633-75a9-4d7b-a969-d389892a41da tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:17.111462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-288c3633-75a9-4d7b-a969-d389892a41da tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:17.131561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8d99e870-c2e6-4209-aa81-460cccc97906 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:17.133595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288c3633-75a9-4d7b-a969-d389892a41da tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:17.135201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288c3633-75a9-4d7b-a969-d389892a41da tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:17.138415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288c3633-75a9-4d7b-a969-d389892a41da tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:17.140142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288c3633-75a9-4d7b-a969-d389892a41da tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:17.141532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288c3633-75a9-4d7b-a969-d389892a41da tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:17.142829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-288c3633-75a9-4d7b-a969-d389892a41da tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:17.145508 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d99e870-c2e6-4209-aa81-460cccc97906 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565" status: 200 len: 1474 microversion: 2.1 time: 1.511229 Aug 09 17:24:17.147420 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1685/3233] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:15 2022] GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565 => generated 1474 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:17.220401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:17.552376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-760832399", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:17.775267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] validate_networks() for [('06107dcb-e281-407c-b425-37660f776641', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:24:17.863848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-288c3633-75a9-4d7b-a969-d389892a41da tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:17.900714 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-288c3633-75a9-4d7b-a969-d389892a41da tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1516 microversion: 2.1 time: 0.821937 Aug 09 17:24:17.906905 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1549/3234] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:17 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1516 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:17.920014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-79a73a50-4fa9-455e-9058-6092ec8f7809 req-584f37c9-1420-462b-a97a-1e48e3fc4061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec097021-2408-4328-b677-266d832bd565", "name": "network-vif-deleted", "tag": "0278004c-6d50-4881-b022-30f9a082b3c2"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:18.009438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-79a73a50-4fa9-455e-9058-6092ec8f7809 req-584f37c9-1420-462b-a97a-1e48e3fc4061 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:18.010568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-79a73a50-4fa9-455e-9058-6092ec8f7809 req-584f37c9-1420-462b-a97a-1e48e3fc4061 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:18.012316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-79a73a50-4fa9-455e-9058-6092ec8f7809 req-584f37c9-1420-462b-a97a-1e48e3fc4061 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:18.063748 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-79a73a50-4fa9-455e-9058-6092ec8f7809 req-584f37c9-1420-462b-a97a-1e48e3fc4061 service nova] Creating event network-vif-deleted:0278004c-6d50-4881-b022-30f9a082b3c2 for instance ec097021-2408-4328-b677-266d832bd565 on n-h1-845781-6 Aug 09 17:24:18.082515 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-79a73a50-4fa9-455e-9058-6092ec8f7809 req-584f37c9-1420-462b-a97a-1e48e3fc4061 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173078 Aug 09 17:24:18.091839 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1550/3235] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:18.117358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-80ae2862-baa1-44f3-87a3-595b82901fb3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:18.118830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-80ae2862-baa1-44f3-87a3-595b82901fb3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:18.143370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80ae2862-baa1-44f3-87a3-595b82901fb3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:18.150940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80ae2862-baa1-44f3-87a3-595b82901fb3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:18.153131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80ae2862-baa1-44f3-87a3-595b82901fb3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:18.154756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80ae2862-baa1-44f3-87a3-595b82901fb3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:18.158417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80ae2862-baa1-44f3-87a3-595b82901fb3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:18.161003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80ae2862-baa1-44f3-87a3-595b82901fb3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:18.271556 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-80ae2862-baa1-44f3-87a3-595b82901fb3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/ips" status: 200 len: 151 microversion: 2.1 time: 0.172212 Aug 09 17:24:18.277344 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1551/3236] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:24:18 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/ips => generated 151 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:18.298610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c082fb19-fa4e-47ab-a676-bffae130993c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:18.302895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c082fb19-fa4e-47ab-a676-bffae130993c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:18.330061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c082fb19-fa4e-47ab-a676-bffae130993c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:18.340938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c082fb19-fa4e-47ab-a676-bffae130993c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:18.342228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c082fb19-fa4e-47ab-a676-bffae130993c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:18.345900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c082fb19-fa4e-47ab-a676-bffae130993c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:18.349615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c082fb19-fa4e-47ab-a676-bffae130993c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:18.350874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c082fb19-fa4e-47ab-a676-bffae130993c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:18.794443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c082fb19-fa4e-47ab-a676-bffae130993c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:18.825018 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c082fb19-fa4e-47ab-a676-bffae130993c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 0.545531 Aug 09 17:24:18.826468 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1552/3237] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:18 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:18.848171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:18.849509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ec097021-2408-4328-b677-266d832bd565] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:18.869557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:18.872310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:18.874202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:18.875431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:18.876251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:18.876978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:18.983338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:18.987582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:18.990897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:18.993983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lazy-loading 'fault' on Instance uuid ec097021-2408-4328-b677-266d832bd565 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:24:19.192664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:19.226201 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9cbfdc58-25ec-42a4-b5e6-6856b4b95ad2 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565" status: 200 len: 1308 microversion: 2.1 time: 0.381651 Aug 09 17:24:19.229296 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1553/3238] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:18 2022] GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565 => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:19.237695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0f234985-8863-45c2-9c3b-e3ee44b45d71 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:19.238986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0f234985-8863-45c2-9c3b-e3ee44b45d71 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:19.265516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f234985-8863-45c2-9c3b-e3ee44b45d71 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:19.267275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f234985-8863-45c2-9c3b-e3ee44b45d71 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:19.269267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f234985-8863-45c2-9c3b-e3ee44b45d71 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:19.271017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f234985-8863-45c2-9c3b-e3ee44b45d71 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:19.276966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f234985-8863-45c2-9c3b-e3ee44b45d71 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:19.277826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f234985-8863-45c2-9c3b-e3ee44b45d71 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:19.722079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0f234985-8863-45c2-9c3b-e3ee44b45d71 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:19.759598 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0f234985-8863-45c2-9c3b-e3ee44b45d71 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1522 microversion: 2.1 time: 0.526010 Aug 09 17:24:19.766588 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1554/3239] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:19 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:19.878696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3744ec65-f2e1-40b8-885c-aa586b95c49a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:19.880716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3744ec65-f2e1-40b8-885c-aa586b95c49a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:19.898748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:24:19.900466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:24:19.901796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:24:19.902749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:24:19.903773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:24:19.954215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3744ec65-f2e1-40b8-885c-aa586b95c49a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:19.955119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3744ec65-f2e1-40b8-885c-aa586b95c49a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:19.968254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:19.978703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3744ec65-f2e1-40b8-885c-aa586b95c49a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:19.979376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:19.982655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:19.983320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3744ec65-f2e1-40b8-885c-aa586b95c49a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:19.985997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:19.987442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3744ec65-f2e1-40b8-885c-aa586b95c49a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:19.988520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3744ec65-f2e1-40b8-885c-aa586b95c49a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:19.989366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:19.993391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:20.082651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Getting quotas for project 5ca6dd79a86743838bd94d3dfe74ef80. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:20.111026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Getting quotas for user 2c49c4b6c28441b3aec0f642e889b9f4 and project 5ca6dd79a86743838bd94d3dfe74ef80. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:20.161918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:24:20.168810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:24:20.314841 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09d24d9b-9813-45b8-a38c-2054a2b35174 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.161705 Aug 09 17:24:20.316062 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1686/3240] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:24:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:24:20.321882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:20.322510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: ec097021-2408-4328-b677-266d832bd565] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:20.339062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:20.340803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:20.341306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:20.346551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:20.348682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:20.349722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:20.415962 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] HTTP exception thrown: Instance ec097021-2408-4328-b677-266d832bd565 could not be found. Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Request method failure captured: Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565 HTTP/1.1 Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pcZIp_E-R9bnBJLqNKPw_oVcgO3I-b0ZlO7EWV6UcwHhog9OmjGLaAQGYnT1znB6odeojveKiOuTjWw9Kms9g89l7L_1xNmVO6QJrGD0tc4nB762QMeAiP8MXEm9gtOym3vyXvVAek0zjwNWfr9cMDdv_LbFUnVx2jVtN5fPWVxU7M Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: fe6a633b90b949af91c0d2aa1d361fe5 Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance ec097021-2408-4328-b677-266d832bd565 could not be found. Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'ec097021-2408-4328-b677-266d832bd565'} Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec097021-2408-4328-b677-266d832bd565 could not be found. Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec097021-2408-4328-b677-266d832bd565 could not be found. Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:20.421650 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:20.429099 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:20.429099 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:20.429099 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:20.429099 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:24:20.429099 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:24:20.429099 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec097021-2408-4328-b677-266d832bd565 could not be found. Aug 09 17:24:20.429099 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:20.429099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Returning 404 to user: Instance ec097021-2408-4328-b677-266d832bd565 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:24:20.429099 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6d3e3f9-f498-40cf-969d-f2c8e85cb9d3 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565" status: 404 len: 111 microversion: 2.1 time: 0.109111 Aug 09 17:24:20.429099 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1687/3241] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:20 2022] GET /compute/v2.1/servers/ec097021-2408-4328-b677-266d832bd565 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:24:20.445503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69c90017-902f-4d98-b35f-00796afaae27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:20.448889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-69c90017-902f-4d98-b35f-00796afaae27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:20.615359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3744ec65-f2e1-40b8-885c-aa586b95c49a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:20.668842 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3744ec65-f2e1-40b8-885c-aa586b95c49a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 0.779620 Aug 09 17:24:20.676233 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1555/3242] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:19 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:24:20.710011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:20.723127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-69c90017-902f-4d98-b35f-00796afaae27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:20.725918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 7ba0f579-8099-45bb-8e1d-a9e5b881587b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:20.769807 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69c90017-902f-4d98-b35f-00796afaae27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1216 microversion: 2.1 time: 0.337048 Aug 09 17:24:20.770405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:20.773174 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1688/3243] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:20 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1216 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:20.775609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:20.778069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:20.781296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:20.792769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:20.796893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:20.799528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dead534d-0204-492f-971a-95be2a7ed0f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:20.808100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dead534d-0204-492f-971a-95be2a7ed0f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:20.903818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dead534d-0204-492f-971a-95be2a7ed0f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:20.904818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dead534d-0204-492f-971a-95be2a7ed0f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:20.904818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dead534d-0204-492f-971a-95be2a7ed0f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:20.905439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dead534d-0204-492f-971a-95be2a7ed0f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:20.921365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dead534d-0204-492f-971a-95be2a7ed0f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:20.922374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dead534d-0204-492f-971a-95be2a7ed0f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:20.960194 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] HTTP exception thrown: Instance 7ba0f579-8099-45bb-8e1d-a9e5b881587b could not be found. Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Request method failure captured: Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b HTTP/1.1 Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pcZIp_E-R9bnBJLqNKPw_oVcgO3I-b0ZlO7EWV6UcwHhog9OmjGLaAQGYnT1znB6odeojveKiOuTjWw9Kms9g89l7L_1xNmVO6QJrGD0tc4nB762QMeAiP8MXEm9gtOym3vyXvVAek0zjwNWfr9cMDdv_LbFUnVx2jVtN5fPWVxU7M Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: fe6a633b90b949af91c0d2aa1d361fe5 Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 7ba0f579-8099-45bb-8e1d-a9e5b881587b could not be found. Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '7ba0f579-8099-45bb-8e1d-a9e5b881587b'} Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba0f579-8099-45bb-8e1d-a9e5b881587b could not be found. Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba0f579-8099-45bb-8e1d-a9e5b881587b could not be found. Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:20.966966 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:24:20.976131 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:20.976131 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:20.976131 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:20.976131 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:24:20.976131 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:24:20.976131 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba0f579-8099-45bb-8e1d-a9e5b881587b could not be found. Aug 09 17:24:20.976131 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:24:20.976131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Returning 404 to user: Instance 7ba0f579-8099-45bb-8e1d-a9e5b881587b could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:24:20.977897 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8a29f848-6cb5-4139-a5bf-9eaf336f6d55 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b" status: 404 len: 111 microversion: 2.1 time: 0.298418 Aug 09 17:24:20.980254 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1556/3244] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:20 2022] GET /compute/v2.1/servers/7ba0f579-8099-45bb-8e1d-a9e5b881587b => generated 111 bytes in 303 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:24:20.990338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-67505eae-da37-488e-b6d4-f321d57604bd tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:21.119498 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-67505eae-da37-488e-b6d4-f321d57604bd tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/f3a5d9e9-a7ab-40c2-bcbb-f0a61872b2ae" status: 204 len: 0 microversion: 2.1 time: 0.130674 Aug 09 17:24:21.120188 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1557/3245] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:24:20 2022] DELETE /compute/v2.1/os-server-groups/f3a5d9e9-a7ab-40c2-bcbb-f0a61872b2ae => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:21.150632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-37fefd01-1176-431f-bf72-cb4a604af947 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:21.172256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-37fefd01-1176-431f-bf72-cb4a604af947 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:21.213672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37fefd01-1176-431f-bf72-cb4a604af947 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:21.215216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37fefd01-1176-431f-bf72-cb4a604af947 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:21.218927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37fefd01-1176-431f-bf72-cb4a604af947 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:21.223555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37fefd01-1176-431f-bf72-cb4a604af947 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:21.225157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37fefd01-1176-431f-bf72-cb4a604af947 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:21.230963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37fefd01-1176-431f-bf72-cb4a604af947 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:21.441142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-37fefd01-1176-431f-bf72-cb4a604af947 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:24:21.799507 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-37fefd01-1176-431f-bf72-cb4a604af947 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "DELETE /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 204 len: 0 microversion: 2.1 time: 0.669306 Aug 09 17:24:21.812766 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1558/3246] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:24:21 2022] DELETE /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:21.833235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-191c3792-08fd-46f0-9926-4844458653dc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:21.837896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-191c3792-08fd-46f0-9926-4844458653dc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:21.853725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191c3792-08fd-46f0-9926-4844458653dc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:21.854243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191c3792-08fd-46f0-9926-4844458653dc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:21.854810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191c3792-08fd-46f0-9926-4844458653dc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:21.855868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191c3792-08fd-46f0-9926-4844458653dc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:21.856479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191c3792-08fd-46f0-9926-4844458653dc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:21.856935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191c3792-08fd-46f0-9926-4844458653dc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:22.314295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-191c3792-08fd-46f0-9926-4844458653dc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:22.327352 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-191c3792-08fd-46f0-9926-4844458653dc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 0.512641 Aug 09 17:24:22.328812 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1559/3247] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:21 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:22.356744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ea57f47b-8d1a-403a-8a8e-876a691579dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:22.357559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ea57f47b-8d1a-403a-8a8e-876a691579dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:22.538607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ea57f47b-8d1a-403a-8a8e-876a691579dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:22.577366 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ea57f47b-8d1a-403a-8a8e-876a691579dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1216 microversion: 2.1 time: 0.246782 Aug 09 17:24:22.584748 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1560/3248] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:22 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1216 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:22.594686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-db4b7462-e216-48da-9123-a29a62e1a46b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:22.606105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-db4b7462-e216-48da-9123-a29a62e1a46b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:22.618653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dead534d-0204-492f-971a-95be2a7ed0f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:22.633416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db4b7462-e216-48da-9123-a29a62e1a46b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:22.633935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db4b7462-e216-48da-9123-a29a62e1a46b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:22.634392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db4b7462-e216-48da-9123-a29a62e1a46b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:22.635131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db4b7462-e216-48da-9123-a29a62e1a46b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:22.635601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db4b7462-e216-48da-9123-a29a62e1a46b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:22.636119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db4b7462-e216-48da-9123-a29a62e1a46b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:22.639549 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dead534d-0204-492f-971a-95be2a7ed0f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1522 microversion: 2.1 time: 1.855586 Aug 09 17:24:22.660376 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1689/3249] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:20 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1522 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:24:22.674590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c71dcb65-307d-42a9-8561-cfef3a1b6a97 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e5b64f0-1b05-42b9-957b-3298d9b70c4d"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:22.677210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c71dcb65-307d-42a9-8561-cfef3a1b6a97 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:22.694400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71dcb65-307d-42a9-8561-cfef3a1b6a97 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:22.697596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71dcb65-307d-42a9-8561-cfef3a1b6a97 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:22.700481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71dcb65-307d-42a9-8561-cfef3a1b6a97 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:22.701993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71dcb65-307d-42a9-8561-cfef3a1b6a97 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:22.705935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71dcb65-307d-42a9-8561-cfef3a1b6a97 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:22.706953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71dcb65-307d-42a9-8561-cfef3a1b6a97 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:23.056720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-db4b7462-e216-48da-9123-a29a62e1a46b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:23.083263 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-db4b7462-e216-48da-9123-a29a62e1a46b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1472 microversion: 2.1 time: 0.493147 Aug 09 17:24:23.100494 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1561/3250] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:22 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1472 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:23.360579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7a95533a-c406-41c0-99de-ad0e7f199dbc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:23.362835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7a95533a-c406-41c0-99de-ad0e7f199dbc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:23.385217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a95533a-c406-41c0-99de-ad0e7f199dbc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:23.389106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a95533a-c406-41c0-99de-ad0e7f199dbc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:23.394534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a95533a-c406-41c0-99de-ad0e7f199dbc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:23.396570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a95533a-c406-41c0-99de-ad0e7f199dbc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:23.401015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a95533a-c406-41c0-99de-ad0e7f199dbc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:23.404667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a95533a-c406-41c0-99de-ad0e7f199dbc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:23.442876 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c71dcb65-307d-42a9-8561-cfef3a1b6a97 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780638 Aug 09 17:24:23.452995 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1690/3251] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:24:22 2022] POST /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments => generated 194 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:23.607256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bbb7674c-1b40-4b9b-8fbb-321b36860080 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:23.614018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bbb7674c-1b40-4b9b-8fbb-321b36860080 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:23.662611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbb7674c-1b40-4b9b-8fbb-321b36860080 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:23.663674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbb7674c-1b40-4b9b-8fbb-321b36860080 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:23.664253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbb7674c-1b40-4b9b-8fbb-321b36860080 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:23.692068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbb7674c-1b40-4b9b-8fbb-321b36860080 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:23.693077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbb7674c-1b40-4b9b-8fbb-321b36860080 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:23.693858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbb7674c-1b40-4b9b-8fbb-321b36860080 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:23.876767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7a95533a-c406-41c0-99de-ad0e7f199dbc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:23.892802 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7a95533a-c406-41c0-99de-ad0e7f199dbc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 0.544768 Aug 09 17:24:23.894042 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1562/3252] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:23 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:24:23.915968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d678d699-fe29-4118-b0f4-8bba1a7ff158 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:23.917399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d678d699-fe29-4118-b0f4-8bba1a7ff158 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:23.939584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d678d699-fe29-4118-b0f4-8bba1a7ff158 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:23.944135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d678d699-fe29-4118-b0f4-8bba1a7ff158 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:23.944927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d678d699-fe29-4118-b0f4-8bba1a7ff158 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:23.947205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d678d699-fe29-4118-b0f4-8bba1a7ff158 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:23.949377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d678d699-fe29-4118-b0f4-8bba1a7ff158 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:23.950048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d678d699-fe29-4118-b0f4-8bba1a7ff158 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:24.278095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bbb7674c-1b40-4b9b-8fbb-321b36860080 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:24.395729 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bbb7674c-1b40-4b9b-8fbb-321b36860080 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1268 microversion: 2.1 time: 0.795015 Aug 09 17:24:24.410785 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1691/3253] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:23 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1268 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:24:24.440750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0b19c03c-5ebc-4df0-b2a7-c00315d62e2b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:24.443816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0b19c03c-5ebc-4df0-b2a7-c00315d62e2b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:24.519689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b19c03c-5ebc-4df0-b2a7-c00315d62e2b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:24.523768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b19c03c-5ebc-4df0-b2a7-c00315d62e2b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:24.529574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b19c03c-5ebc-4df0-b2a7-c00315d62e2b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:24.532351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b19c03c-5ebc-4df0-b2a7-c00315d62e2b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:24.553024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b19c03c-5ebc-4df0-b2a7-c00315d62e2b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:24.570532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b19c03c-5ebc-4df0-b2a7-c00315d62e2b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:24.866220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d678d699-fe29-4118-b0f4-8bba1a7ff158 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:24.885423 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d678d699-fe29-4118-b0f4-8bba1a7ff158 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1522 microversion: 2.1 time: 0.974059 Aug 09 17:24:24.890003 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1563/3254] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:23 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1522 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:24.926549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dfa365bc-49e5-4c91-b01f-9d51e0b73de9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:24.929184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dfa365bc-49e5-4c91-b01f-9d51e0b73de9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:24.954987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa365bc-49e5-4c91-b01f-9d51e0b73de9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:24.957754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa365bc-49e5-4c91-b01f-9d51e0b73de9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:24.960787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa365bc-49e5-4c91-b01f-9d51e0b73de9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:24.965556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa365bc-49e5-4c91-b01f-9d51e0b73de9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:24.974389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa365bc-49e5-4c91-b01f-9d51e0b73de9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:24.976053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dfa365bc-49e5-4c91-b01f-9d51e0b73de9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:25.409676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0b19c03c-5ebc-4df0-b2a7-c00315d62e2b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:25.414078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:25.443417 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0b19c03c-5ebc-4df0-b2a7-c00315d62e2b tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1472 microversion: 2.1 time: 1.027996 Aug 09 17:24:25.453547 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1692/3255] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:24 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1472 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:25.462297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-63af45c6-3187-4ead-a2d0-94546e703ade tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:25.484385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-63af45c6-3187-4ead-a2d0-94546e703ade tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:25.493385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63af45c6-3187-4ead-a2d0-94546e703ade tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:25.494169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63af45c6-3187-4ead-a2d0-94546e703ade tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:25.494782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63af45c6-3187-4ead-a2d0-94546e703ade tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:25.498940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63af45c6-3187-4ead-a2d0-94546e703ade tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:25.500035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63af45c6-3187-4ead-a2d0-94546e703ade tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:25.505335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63af45c6-3187-4ead-a2d0-94546e703ade tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:25.554374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dfa365bc-49e5-4c91-b01f-9d51e0b73de9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:25.571731 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dfa365bc-49e5-4c91-b01f-9d51e0b73de9 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 0.655607 Aug 09 17:24:25.573840 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1564/3256] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:24 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:25.913585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8b83a13d-ea1d-49d6-93ea-fcfccd476401 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:25.914752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8b83a13d-ea1d-49d6-93ea-fcfccd476401 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:25.920862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-63af45c6-3187-4ead-a2d0-94546e703ade tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:25.940861 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-63af45c6-3187-4ead-a2d0-94546e703ade tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1274 microversion: 2.1 time: 0.483163 Aug 09 17:24:25.943948 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1693/3257] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:25 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1274 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:25.947270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b83a13d-ea1d-49d6-93ea-fcfccd476401 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:25.947908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b83a13d-ea1d-49d6-93ea-fcfccd476401 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:25.951112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b83a13d-ea1d-49d6-93ea-fcfccd476401 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:25.952149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b83a13d-ea1d-49d6-93ea-fcfccd476401 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:25.952824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b83a13d-ea1d-49d6-93ea-fcfccd476401 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:25.953618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b83a13d-ea1d-49d6-93ea-fcfccd476401 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:26.363025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8b83a13d-ea1d-49d6-93ea-fcfccd476401 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:26.389436 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8b83a13d-ea1d-49d6-93ea-fcfccd476401 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1522 microversion: 2.1 time: 0.484061 Aug 09 17:24:26.439617 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1565/3258] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:25 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:24:26.491962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b53bfbba-95ac-4374-ad0d-9a94f4a9cde4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:26.493052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b53bfbba-95ac-4374-ad0d-9a94f4a9cde4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:26.511669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b53bfbba-95ac-4374-ad0d-9a94f4a9cde4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:26.519160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b53bfbba-95ac-4374-ad0d-9a94f4a9cde4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:26.522008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b53bfbba-95ac-4374-ad0d-9a94f4a9cde4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:26.522898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b53bfbba-95ac-4374-ad0d-9a94f4a9cde4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:26.527543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b53bfbba-95ac-4374-ad0d-9a94f4a9cde4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:26.528179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b53bfbba-95ac-4374-ad0d-9a94f4a9cde4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:26.866282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b53bfbba-95ac-4374-ad0d-9a94f4a9cde4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe6a633b90b949af91c0d2aa1d361fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3f7d833b344b9cb579955d726a9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:26.904072 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b53bfbba-95ac-4374-ad0d-9a94f4a9cde4 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 200 len: 1430 microversion: 2.1 time: 0.406275 Aug 09 17:24:26.910424 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1566/3259] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:26 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 1430 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:26.934166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6a3755a0-1995-4eea-95df-f6fbaf401f7b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:26.935199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6a3755a0-1995-4eea-95df-f6fbaf401f7b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:26.982579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3755a0-1995-4eea-95df-f6fbaf401f7b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:26.989905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3755a0-1995-4eea-95df-f6fbaf401f7b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:26.991504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3755a0-1995-4eea-95df-f6fbaf401f7b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:26.994252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3755a0-1995-4eea-95df-f6fbaf401f7b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:26.995478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3755a0-1995-4eea-95df-f6fbaf401f7b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:26.997428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a3755a0-1995-4eea-95df-f6fbaf401f7b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:27.326535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2c089ccb-8447-40aa-8cb8-e88cdf37a23c tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Action: 'create', calling method: .version_select at 0x7fbbcaf619d0>, body: {"keypair": {"name": "tempest-keypair-636248063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3DYP9EoJD6uuQ8CcS8IDoILvXnyR+KHzz8loVu3sTMzzJpMgweTCuOM3aq5x/OcWUwiEqLwtY+bmsJG1MRPJhNEmw55PQ0w6yl6juLi3AWMcw3o3A96VcWLyc4rd8ceA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:27.363593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2c089ccb-8447-40aa-8cb8-e88cdf37a23c tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Getting quotas for project 244304db496b4d36bd1b7bb9329c5ccd. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:27.376131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2c089ccb-8447-40aa-8cb8-e88cdf37a23c tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Getting quotas for user 2507f894c94f49ea8eaeea81a1c51cbe and project 244304db496b4d36bd1b7bb9329c5ccd. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:27.430506 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2c089ccb-8447-40aa-8cb8-e88cdf37a23c tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.994176 Aug 09 17:24:27.435588 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1694/3260] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:24:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:24:27.727591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2cffe5bb-6a84-4746-994d-47651971f7fd req-a32ee581-d8ef-45a0-b077-06282a10860f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904e2d62-61c5-4c4e-9acd-6948e6a21477", "name": "network-vif-deleted", "tag": "aa19c029-4e59-4503-b436-ce642e4e3df4"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:27.800160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2cffe5bb-6a84-4746-994d-47651971f7fd req-a32ee581-d8ef-45a0-b077-06282a10860f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:27.800654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2cffe5bb-6a84-4746-994d-47651971f7fd req-a32ee581-d8ef-45a0-b077-06282a10860f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:27.801115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2cffe5bb-6a84-4746-994d-47651971f7fd req-a32ee581-d8ef-45a0-b077-06282a10860f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:27.833493 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2cffe5bb-6a84-4746-994d-47651971f7fd req-a32ee581-d8ef-45a0-b077-06282a10860f service nova] Creating event network-vif-deleted:aa19c029-4e59-4503-b436-ce642e4e3df4 for instance 904e2d62-61c5-4c4e-9acd-6948e6a21477 on n-h2-845781-6 Aug 09 17:24:27.853677 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2cffe5bb-6a84-4746-994d-47651971f7fd req-a32ee581-d8ef-45a0-b077-06282a10860f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.415776 Aug 09 17:24:27.855383 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1695/3261] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:27.880733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-901c7f53-a5ad-4bf7-8e67-96d7bd5ec053 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:27.883093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-901c7f53-a5ad-4bf7-8e67-96d7bd5ec053 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:27.898107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901c7f53-a5ad-4bf7-8e67-96d7bd5ec053 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:27.899562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901c7f53-a5ad-4bf7-8e67-96d7bd5ec053 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:27.900965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901c7f53-a5ad-4bf7-8e67-96d7bd5ec053 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:27.905376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901c7f53-a5ad-4bf7-8e67-96d7bd5ec053 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:27.906973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901c7f53-a5ad-4bf7-8e67-96d7bd5ec053 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:27.908180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-901c7f53-a5ad-4bf7-8e67-96d7bd5ec053 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:27.961653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6a3755a0-1995-4eea-95df-f6fbaf401f7b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:27.970459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:28.048726 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6a3755a0-1995-4eea-95df-f6fbaf401f7b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 1.126798 Aug 09 17:24:28.060140 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1567/3262] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:26 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:28.087065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-892336017", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8ba0b5aa-1c10-46a8-bd36-57fb8038f87a"}], "security_groups": [{"name": "tempest-securitygroup--801199716"}], "key_name": "tempest-keypair-503018447", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ca4dbce3-ee67-4aad-9eda-7666cae6fc6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:28.452545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-901c7f53-a5ad-4bf7-8e67-96d7bd5ec053 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:28.488339 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-901c7f53-a5ad-4bf7-8e67-96d7bd5ec053 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1316 microversion: 2.1 time: 0.621517 Aug 09 17:24:28.503868 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1696/3263] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:27 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:28.533208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fe5aff3a-e502-42f0-a97b-272d4ace58f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:28.550182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fe5aff3a-e502-42f0-a97b-272d4ace58f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:28.572413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe5aff3a-e502-42f0-a97b-272d4ace58f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:28.572938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe5aff3a-e502-42f0-a97b-272d4ace58f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:28.573933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe5aff3a-e502-42f0-a97b-272d4ace58f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:28.574863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe5aff3a-e502-42f0-a97b-272d4ace58f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:28.575439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe5aff3a-e502-42f0-a97b-272d4ace58f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:28.575948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe5aff3a-e502-42f0-a97b-272d4ace58f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:29.369749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] validate_networks() for [('8ba0b5aa-1c10-46a8-bd36-57fb8038f87a', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:24:29.456975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fe5aff3a-e502-42f0-a97b-272d4ace58f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:29.481128 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fe5aff3a-e502-42f0-a97b-272d4ace58f2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1522 microversion: 2.1 time: 0.974958 Aug 09 17:24:29.494689 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1697/3264] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:28 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1522 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:29.872831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:29.877543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] [instance: 904e2d62-61c5-4c4e-9acd-6948e6a21477] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:29.913498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:29.916785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:29.931778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:29.940589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:29.947578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:29.952151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:30.019890 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] HTTP exception thrown: Instance 904e2d62-61c5-4c4e-9acd-6948e6a21477 could not be found. Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Request method failure captured: Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 HTTP/1.1 Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pcZIp_E-R9bnBJLqNKPw_oVcgO3I-b0ZlO7EWV6UcwHhog9OmjGLaAQGYnT1znB6odeojveKiOuTjWw9Kms9g89l7L_1xNmVO6QJrGD0tc4nB762QMeAiP8MXEm9gtOym3vyXvVAek0zjwNWfr9cMDdv_LbFUnVx2jVtN5fPWVxU7M Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2b3f7d833b344b9cb579955d726a9e41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 2b3f7d833b344b9cb579955d726a9e41 Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-853531887 Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: fe6a633b90b949af91c0d2aa1d361fe5 Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersOnMultiNodesTest-853531887-project Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 904e2d62-61c5-4c4e-9acd-6948e6a21477 could not be found. Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '904e2d62-61c5-4c4e-9acd-6948e6a21477'} Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904e2d62-61c5-4c4e-9acd-6948e6a21477 could not be found. Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904e2d62-61c5-4c4e-9acd-6948e6a21477 could not be found. Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:30.021649 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:30.026151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:30.026151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:30.026151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:30.026151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:24:30.026151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:24:30.026151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904e2d62-61c5-4c4e-9acd-6948e6a21477 could not be found. Aug 09 17:24:30.026151 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:24:30.035491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] Returning 404 to user: Instance 904e2d62-61c5-4c4e-9acd-6948e6a21477 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:24:30.036807 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb02024b-8abc-40c0-9356-60e34d4bfb47 tempest-ServersOnMultiNodesTest-853531887 tempest-ServersOnMultiNodesTest-853531887-project] 10.222.0.93 "GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477" status: 404 len: 111 microversion: 2.1 time: 0.540107 Aug 09 17:24:30.046085 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1698/3265] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:29 2022] GET /compute/v2.1/servers/904e2d62-61c5-4c4e-9acd-6948e6a21477 => generated 111 bytes in 550 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:24:30.070950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e7a1180-9103-45cd-9ddf-c3ca84701848 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:30.071590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1e7a1180-9103-45cd-9ddf-c3ca84701848 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:30.085189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:30.099736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7a1180-9103-45cd-9ddf-c3ca84701848 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:30.100535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7a1180-9103-45cd-9ddf-c3ca84701848 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:30.101149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7a1180-9103-45cd-9ddf-c3ca84701848 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:30.102246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7a1180-9103-45cd-9ddf-c3ca84701848 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:30.102952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7a1180-9103-45cd-9ddf-c3ca84701848 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:30.103664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7a1180-9103-45cd-9ddf-c3ca84701848 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:31.298269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1e7a1180-9103-45cd-9ddf-c3ca84701848 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:31.312552 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e7a1180-9103-45cd-9ddf-c3ca84701848 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 1.264515 Aug 09 17:24:31.313666 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1699/3266] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:30 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:31.330349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fae166ee-a377-4347-a6ac-a0c8040787f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:31.337083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fae166ee-a377-4347-a6ac-a0c8040787f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:31.386187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fae166ee-a377-4347-a6ac-a0c8040787f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:31.387266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fae166ee-a377-4347-a6ac-a0c8040787f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:31.389339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fae166ee-a377-4347-a6ac-a0c8040787f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:31.392406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fae166ee-a377-4347-a6ac-a0c8040787f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:31.393340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fae166ee-a377-4347-a6ac-a0c8040787f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:31.398252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fae166ee-a377-4347-a6ac-a0c8040787f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:31.541054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Getting quotas for project c281514960bd499d83a4f683bf269d9e. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:31.561243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Getting quotas for user c3910e7ce0b2488cadb01e3d6e617e94 and project c281514960bd499d83a4f683bf269d9e. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:31.620940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:24:31.622017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:24:31.626013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:24:31.628765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:24:31.629892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:24:31.663270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:31.668223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:31.668972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:31.669990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:31.670666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:31.671310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:31.718540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Getting quotas for project c281514960bd499d83a4f683bf269d9e. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:31.728146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Getting quotas for user c3910e7ce0b2488cadb01e3d6e617e94 and project c281514960bd499d83a4f683bf269d9e. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:32.075796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:24:32.079372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca4dbce3-ee67-4aad-9eda-7666cae6fc6d',volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:24:32.398767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:32.508390 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aa6c7cfc-41f8-4172-9c37-819a45652eab tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.446188 Aug 09 17:24:32.511015 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1568/3267] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:24:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 4449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:24:32.928765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ef8cddf9-0f91-406f-ab97-b10aedb9a00b req-fe085045-d7b6-474e-8d97-ec2ca67d43bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6760ec-412a-42a8-968d-ce3ebf298c73", "name": "network-vif-plugged", "status": "completed", "tag": "7dab4def-547e-43a1-9b87-13b83eb68166"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:32.968720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ef8cddf9-0f91-406f-ab97-b10aedb9a00b req-fe085045-d7b6-474e-8d97-ec2ca67d43bd service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:32.969622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ef8cddf9-0f91-406f-ab97-b10aedb9a00b req-fe085045-d7b6-474e-8d97-ec2ca67d43bd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:32.972943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ef8cddf9-0f91-406f-ab97-b10aedb9a00b req-fe085045-d7b6-474e-8d97-ec2ca67d43bd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:33.005439 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ef8cddf9-0f91-406f-ab97-b10aedb9a00b req-fe085045-d7b6-474e-8d97-ec2ca67d43bd service nova] Creating event network-vif-plugged:7dab4def-547e-43a1-9b87-13b83eb68166 for instance cd6760ec-412a-42a8-968d-ce3ebf298c73 on n-h1-845781-6 Aug 09 17:24:33.021792 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ef8cddf9-0f91-406f-ab97-b10aedb9a00b req-fe085045-d7b6-474e-8d97-ec2ca67d43bd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.508490 Aug 09 17:24:33.025835 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1569/3268] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:33.044858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c9bb0829-e3b0-4d85-9171-c26e160721c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:33.045684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c9bb0829-e3b0-4d85-9171-c26e160721c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:33.067155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9bb0829-e3b0-4d85-9171-c26e160721c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:33.068052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9bb0829-e3b0-4d85-9171-c26e160721c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:33.068517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9bb0829-e3b0-4d85-9171-c26e160721c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:33.069271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9bb0829-e3b0-4d85-9171-c26e160721c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:33.069746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9bb0829-e3b0-4d85-9171-c26e160721c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:33.070327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9bb0829-e3b0-4d85-9171-c26e160721c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:33.343357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fae166ee-a377-4347-a6ac-a0c8040787f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:33.374946 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fae166ee-a377-4347-a6ac-a0c8040787f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1316 microversion: 2.1 time: 2.059600 Aug 09 17:24:33.419133 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1700/3269] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:31 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1316 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:33.477149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c9bb0829-e3b0-4d85-9171-c26e160721c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:33.513462 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c9bb0829-e3b0-4d85-9171-c26e160721c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1522 microversion: 2.1 time: 0.479851 Aug 09 17:24:33.515299 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1570/3270] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:33 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:33.541376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-efe4bc77-5f58-4dba-956d-bcc633bc6ded tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:33.550838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-efe4bc77-5f58-4dba-956d-bcc633bc6ded tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:33.610975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe4bc77-5f58-4dba-956d-bcc633bc6ded tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:33.615793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe4bc77-5f58-4dba-956d-bcc633bc6ded tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:33.619413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe4bc77-5f58-4dba-956d-bcc633bc6ded tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:33.623929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe4bc77-5f58-4dba-956d-bcc633bc6ded tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:33.632998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe4bc77-5f58-4dba-956d-bcc633bc6ded tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:33.633975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efe4bc77-5f58-4dba-956d-bcc633bc6ded tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:34.254046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-59ee840c-218e-43ca-af72-20ef7e3c1716 req-9dc29a09-1bd5-428f-b022-09fb0bd2aa0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af26977-0da1-475d-b754-4460e79e4fc3", "tag": "81270b4a-19dd-474c-8c8e-456472b48c81"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:34.293052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-59ee840c-218e-43ca-af72-20ef7e3c1716 req-9dc29a09-1bd5-428f-b022-09fb0bd2aa0d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:34.297664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-59ee840c-218e-43ca-af72-20ef7e3c1716 req-9dc29a09-1bd5-428f-b022-09fb0bd2aa0d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:34.299003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-59ee840c-218e-43ca-af72-20ef7e3c1716 req-9dc29a09-1bd5-428f-b022-09fb0bd2aa0d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:34.302502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-efe4bc77-5f58-4dba-956d-bcc633bc6ded tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:34.325756 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-59ee840c-218e-43ca-af72-20ef7e3c1716 req-9dc29a09-1bd5-428f-b022-09fb0bd2aa0d service nova] Creating event network-changed:81270b4a-19dd-474c-8c8e-456472b48c81 for instance 9af26977-0da1-475d-b754-4460e79e4fc3 on n-h2-845781-6 Aug 09 17:24:34.339387 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-efe4bc77-5f58-4dba-956d-bcc633bc6ded tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 0.814620 Aug 09 17:24:34.342887 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-59ee840c-218e-43ca-af72-20ef7e3c1716 req-9dc29a09-1bd5-428f-b022-09fb0bd2aa0d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.921111 Aug 09 17:24:34.345735 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1701/3271] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:34.363399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-870a11b7-2ab8-4ec3-b6ed-ad26300f94b6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:34.366530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-870a11b7-2ab8-4ec3-b6ed-ad26300f94b6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:34.387040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870a11b7-2ab8-4ec3-b6ed-ad26300f94b6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:34.388047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870a11b7-2ab8-4ec3-b6ed-ad26300f94b6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:34.389412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870a11b7-2ab8-4ec3-b6ed-ad26300f94b6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:34.392039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870a11b7-2ab8-4ec3-b6ed-ad26300f94b6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:34.394164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870a11b7-2ab8-4ec3-b6ed-ad26300f94b6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:34.394954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-870a11b7-2ab8-4ec3-b6ed-ad26300f94b6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:34.403299 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1571/3272] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:33 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:34.425250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3b7a5478-833d-46fc-9bf1-b5cbcc217ada tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:34.426310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3b7a5478-833d-46fc-9bf1-b5cbcc217ada tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:34.440142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b7a5478-833d-46fc-9bf1-b5cbcc217ada tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:34.441792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b7a5478-833d-46fc-9bf1-b5cbcc217ada tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:34.444229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b7a5478-833d-46fc-9bf1-b5cbcc217ada tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:34.447057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b7a5478-833d-46fc-9bf1-b5cbcc217ada tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:34.448531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b7a5478-833d-46fc-9bf1-b5cbcc217ada tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:34.449994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b7a5478-833d-46fc-9bf1-b5cbcc217ada tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:34.892968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-870a11b7-2ab8-4ec3-b6ed-ad26300f94b6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:34.930208 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-870a11b7-2ab8-4ec3-b6ed-ad26300f94b6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1170 microversion: 2.1 time: 0.579911 Aug 09 17:24:34.936442 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1702/3273] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:34 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1170 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:34.957585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8886bb9b-c0b0-44eb-a575-b98575759993 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:34.969065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8886bb9b-c0b0-44eb-a575-b98575759993 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:35.001454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8886bb9b-c0b0-44eb-a575-b98575759993 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:35.002260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8886bb9b-c0b0-44eb-a575-b98575759993 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:35.004273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8886bb9b-c0b0-44eb-a575-b98575759993 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:35.005355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8886bb9b-c0b0-44eb-a575-b98575759993 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:35.006690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8886bb9b-c0b0-44eb-a575-b98575759993 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:35.008510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8886bb9b-c0b0-44eb-a575-b98575759993 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:35.563690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3b7a5478-833d-46fc-9bf1-b5cbcc217ada tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:35.576667 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3b7a5478-833d-46fc-9bf1-b5cbcc217ada tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1316 microversion: 2.1 time: 1.156499 Aug 09 17:24:35.592208 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1572/3274] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:34 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1316 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:35.592208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-767827604", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ab144782-719f-409c-8f1a-758fce928ae0"}], "security_groups": [{"name": "tempest-securitygroup--179137053"}], "key_name": "tempest-keypair-636248063", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:35.700624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8886bb9b-c0b0-44eb-a575-b98575759993 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:35.714961 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8886bb9b-c0b0-44eb-a575-b98575759993 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1507 microversion: 2.1 time: 0.776407 Aug 09 17:24:35.718138 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1703/3275] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:34 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1507 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:35.750064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1f681f77-8dc9-49c4-852c-d76e3a857336 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:35.750666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1f681f77-8dc9-49c4-852c-d76e3a857336 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:35.771592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f681f77-8dc9-49c4-852c-d76e3a857336 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:35.772411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f681f77-8dc9-49c4-852c-d76e3a857336 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:35.773097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f681f77-8dc9-49c4-852c-d76e3a857336 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:35.774109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f681f77-8dc9-49c4-852c-d76e3a857336 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:35.774785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f681f77-8dc9-49c4-852c-d76e3a857336 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:35.775383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f681f77-8dc9-49c4-852c-d76e3a857336 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:36.202687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1f681f77-8dc9-49c4-852c-d76e3a857336 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:36.219190 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1f681f77-8dc9-49c4-852c-d76e3a857336 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 0.499019 Aug 09 17:24:36.225969 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1704/3276] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:35 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:36.243940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c699fa0a-e010-480c-89d9-c3f80ab5f677 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:36.248190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c699fa0a-e010-480c-89d9-c3f80ab5f677 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:36.271862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c699fa0a-e010-480c-89d9-c3f80ab5f677 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:36.272736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c699fa0a-e010-480c-89d9-c3f80ab5f677 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:36.273550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c699fa0a-e010-480c-89d9-c3f80ab5f677 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:36.274759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c699fa0a-e010-480c-89d9-c3f80ab5f677 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:36.283977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c699fa0a-e010-480c-89d9-c3f80ab5f677 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:36.284992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c699fa0a-e010-480c-89d9-c3f80ab5f677 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:36.506175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] validate_networks() for [('ab144782-719f-409c-8f1a-758fce928ae0', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:24:36.853401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c699fa0a-e010-480c-89d9-c3f80ab5f677 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:36.866731 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c699fa0a-e010-480c-89d9-c3f80ab5f677 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 200 len: 1507 microversion: 2.1 time: 0.637635 Aug 09 17:24:36.875677 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1705/3277] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:36 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 1507 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:36.875677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f798b687-facd-47c8-9baa-2d7195ce555c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:36.875677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f798b687-facd-47c8-9baa-2d7195ce555c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:36.884071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f798b687-facd-47c8-9baa-2d7195ce555c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:36.884071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f798b687-facd-47c8-9baa-2d7195ce555c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:36.884071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f798b687-facd-47c8-9baa-2d7195ce555c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:36.884071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f798b687-facd-47c8-9baa-2d7195ce555c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:36.884071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f798b687-facd-47c8-9baa-2d7195ce555c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:36.884071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f798b687-facd-47c8-9baa-2d7195ce555c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:37.001145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f798b687-facd-47c8-9baa-2d7195ce555c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:37.015033 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f798b687-facd-47c8-9baa-2d7195ce555c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1236 microversion: 2.1 time: 0.145922 Aug 09 17:24:37.015996 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1706/3278] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:36 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1236 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:37.033504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-070744ae-9d05-4286-afc4-a0d3d26fac4a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:37.034032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-070744ae-9d05-4286-afc4-a0d3d26fac4a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:37.042952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-070744ae-9d05-4286-afc4-a0d3d26fac4a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:37.043441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-070744ae-9d05-4286-afc4-a0d3d26fac4a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:37.044146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-070744ae-9d05-4286-afc4-a0d3d26fac4a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:37.045057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-070744ae-9d05-4286-afc4-a0d3d26fac4a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:37.045738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-070744ae-9d05-4286-afc4-a0d3d26fac4a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:37.046336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-070744ae-9d05-4286-afc4-a0d3d26fac4a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:37.396577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:37.645462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-070744ae-9d05-4286-afc4-a0d3d26fac4a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:37.662668 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-070744ae-9d05-4286-afc4-a0d3d26fac4a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1316 microversion: 2.1 time: 0.631246 Aug 09 17:24:37.666185 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1707/3279] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:37 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1316 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:37.680788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb4f22e3-0cc4-4efe-a171-559cb7206129 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:37.681741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eb4f22e3-0cc4-4efe-a171-559cb7206129 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:37.711783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb4f22e3-0cc4-4efe-a171-559cb7206129 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:37.712870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb4f22e3-0cc4-4efe-a171-559cb7206129 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:37.716000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb4f22e3-0cc4-4efe-a171-559cb7206129 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:37.722617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb4f22e3-0cc4-4efe-a171-559cb7206129 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:37.723492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb4f22e3-0cc4-4efe-a171-559cb7206129 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:37.724189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb4f22e3-0cc4-4efe-a171-559cb7206129 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:37.778262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eb4f22e3-0cc4-4efe-a171-559cb7206129 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:24:38.074574 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eb4f22e3-0cc4-4efe-a171-559cb7206129 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 204 len: 0 microversion: 2.1 time: 0.401208 Aug 09 17:24:38.076027 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1708/3280] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:24:37 2022] DELETE /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:38.089532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb371b42-31a1-4a11-9eb9-e4dd2597a479 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:38.093780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eb371b42-31a1-4a11-9eb9-e4dd2597a479 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:38.135082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb371b42-31a1-4a11-9eb9-e4dd2597a479 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:38.136816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb371b42-31a1-4a11-9eb9-e4dd2597a479 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:38.137451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb371b42-31a1-4a11-9eb9-e4dd2597a479 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:38.138374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb371b42-31a1-4a11-9eb9-e4dd2597a479 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:38.139050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb371b42-31a1-4a11-9eb9-e4dd2597a479 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:38.139765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb371b42-31a1-4a11-9eb9-e4dd2597a479 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:38.557824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eb371b42-31a1-4a11-9eb9-e4dd2597a479 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:38.574935 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eb371b42-31a1-4a11-9eb9-e4dd2597a479 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1503 microversion: 2.1 time: 0.495610 Aug 09 17:24:38.576359 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1709/3281] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:38 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1503 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:38.595504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-209a2e19-59ca-4dc4-98d6-bd4dda0414a1 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:38.595504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-209a2e19-59ca-4dc4-98d6-bd4dda0414a1 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:38.605430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209a2e19-59ca-4dc4-98d6-bd4dda0414a1 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:38.606267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209a2e19-59ca-4dc4-98d6-bd4dda0414a1 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:38.607177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209a2e19-59ca-4dc4-98d6-bd4dda0414a1 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:38.608221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209a2e19-59ca-4dc4-98d6-bd4dda0414a1 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:38.608817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209a2e19-59ca-4dc4-98d6-bd4dda0414a1 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:38.609385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209a2e19-59ca-4dc4-98d6-bd4dda0414a1 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:38.745841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-209a2e19-59ca-4dc4-98d6-bd4dda0414a1 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:38.750777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:38.768693 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-209a2e19-59ca-4dc4-98d6-bd4dda0414a1 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1236 microversion: 2.1 time: 0.190581 Aug 09 17:24:38.770197 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1710/3282] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:38 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1236 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:38.782351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9885d86c-9fe7-4074-98d4-2bbfc5094af9 req-893aeb53-9bd4-4051-8483-c17b7dc6c99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af26977-0da1-475d-b754-4460e79e4fc3", "name": "network-vif-plugged", "status": "completed", "tag": "81270b4a-19dd-474c-8c8e-456472b48c81"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:38.804493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9885d86c-9fe7-4074-98d4-2bbfc5094af9 req-893aeb53-9bd4-4051-8483-c17b7dc6c99d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:38.805866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9885d86c-9fe7-4074-98d4-2bbfc5094af9 req-893aeb53-9bd4-4051-8483-c17b7dc6c99d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:38.807505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9885d86c-9fe7-4074-98d4-2bbfc5094af9 req-893aeb53-9bd4-4051-8483-c17b7dc6c99d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:38.837284 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9885d86c-9fe7-4074-98d4-2bbfc5094af9 req-893aeb53-9bd4-4051-8483-c17b7dc6c99d service nova] Creating event network-vif-plugged:81270b4a-19dd-474c-8c8e-456472b48c81 for instance 9af26977-0da1-475d-b754-4460e79e4fc3 on n-h2-845781-6 Aug 09 17:24:38.861800 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9885d86c-9fe7-4074-98d4-2bbfc5094af9 req-893aeb53-9bd4-4051-8483-c17b7dc6c99d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088515 Aug 09 17:24:38.863554 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1711/3283] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:38.876723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-135436215", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "055845a8-a394-4733-87e3-0b3f44e28918"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:38.992601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] validate_networks() for [('055845a8-a394-4733-87e3-0b3f44e28918', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:24:39.209309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Getting quotas for project 244304db496b4d36bd1b7bb9329c5ccd. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:39.234072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Getting quotas for user 2507f894c94f49ea8eaeea81a1c51cbe and project 244304db496b4d36bd1b7bb9329c5ccd. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:39.282463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:24:39.283234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:24:39.284129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:24:39.284808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:24:39.285545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:24:39.302978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:39.303810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:39.305165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:39.306977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:39.308613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:39.309732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:39.352499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Getting quotas for project 244304db496b4d36bd1b7bb9329c5ccd. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:39.365466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Getting quotas for user 2507f894c94f49ea8eaeea81a1c51cbe and project 244304db496b4d36bd1b7bb9329c5ccd. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:39.392915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:24:39.399906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:24:39.497183 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6d0002ff-42c7-4a39-9f85-26498ad6ab13 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.909109 Aug 09 17:24:39.499144 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1573/3284] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:24:35 2022] POST /compute/v2.1/servers => generated 408 bytes in 3914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:24:39.508850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed08d299-8532-472a-998f-24ae6e13ad46"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:39.512520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:39.522860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:39.523871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:39.524524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:39.525739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:39.526986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:39.527689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:39.569829 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] HTTP exception thrown: Cannot 'attach_volume' instance d19cd5ee-f610-4a5a-9983-e233f32596f1 while it is in vm_state rescued Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Request method failure captured: Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/os-volume_attachments HTTP/1.1 Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 74 Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfTXHKJ-127xoXOxvirCkOJ5Ga7oI06dbW5eRmTw3VceZ3fIPtVcpBoJqCQEzgHg892I33A2CZbgdV9GneqCNx7frvCudUtWkW3U62800gIkrYotA0sMKiw2vzfbegwV0AsonNcEy5cWuu85myYoWYiVD7fe2x9mfaYw2xpqmhRsNo Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d20bf24928749afb9b848946419f4f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: a34881c81ae2427fbf2cbb1cd8c4ef52 Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: {"volumeAttachment": {"volumeId": "ed08d299-8532-472a-998f-24ae6e13ad46"}} Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: exception: Cannot 'attach_volume' instance d19cd5ee-f610-4a5a-9983-e233f32596f1 while it is in vm_state rescued Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'server_id': 'd19cd5ee-f610-4a5a-9983-e233f32596f1', 'body': {'volumeAttachment': {'volumeId': 'ed08d299-8532-472a-998f-24ae6e13ad46'}}} Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d19cd5ee-f610-4a5a-9983-e233f32596f1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 17:24:39.574388 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d19cd5ee-f610-4a5a-9983-e233f32596f1 while it is in vm_state rescued Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d19cd5ee-f610-4a5a-9983-e233f32596f1 while it is in vm_state rescued Aug 09 17:24:39.579948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:24:39.582417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Returning 409 to user: Cannot 'attach_volume' instance d19cd5ee-f610-4a5a-9983-e233f32596f1 while it is in vm_state rescued {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:24:39.583538 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f8402461-c6ab-4bac-b1b3-2439939c0be8 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.080998 Aug 09 17:24:39.584487 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1574/3285] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:24:39 2022] POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/os-volume_attachments => generated 152 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:24:39.590534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-981d75e3-0aef-4f58-9c99-00bc3a5f3598 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:39.591258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-981d75e3-0aef-4f58-9c99-00bc3a5f3598 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:39.600988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-981d75e3-0aef-4f58-9c99-00bc3a5f3598 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:39.601601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-981d75e3-0aef-4f58-9c99-00bc3a5f3598 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:39.602387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-981d75e3-0aef-4f58-9c99-00bc3a5f3598 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:39.603143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-981d75e3-0aef-4f58-9c99-00bc3a5f3598 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:39.603780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-981d75e3-0aef-4f58-9c99-00bc3a5f3598 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:39.604653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-981d75e3-0aef-4f58-9c99-00bc3a5f3598 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:40.251002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:24:40.252233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:24:40.253068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:24:40.253768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:24:40.254633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:24:40.306518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:40.313680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:40.316538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:40.318136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:40.318966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:40.319774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:40.402955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Getting quotas for project 3d02fc56a4a14bb398febacd9f5d59b7. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:40.417777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Getting quotas for user 1ecbb00be7c34d3b930097d65e06ee21 and project 3d02fc56a4a14bb398febacd9f5d59b7. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:40.423836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:40.456091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:24:40.462232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:24:40.671138 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7da95f5e-6a5d-444b-bfe7-c3a592ee73e0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.801818 Aug 09 17:24:40.675940 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1712/3286] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:24:40.737359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-981d75e3-0aef-4f58-9c99-00bc3a5f3598 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:40.797718 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-981d75e3-0aef-4f58-9c99-00bc3a5f3598 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1316 microversion: 2.1 time: 1.211433 Aug 09 17:24:40.812017 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1575/3287] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:39 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1316 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:40.845011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-26155ac0-194a-462a-b442-02491b983b14 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:40.850403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-26155ac0-194a-462a-b442-02491b983b14 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:40.897351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26155ac0-194a-462a-b442-02491b983b14 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:40.900695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26155ac0-194a-462a-b442-02491b983b14 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:40.901649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26155ac0-194a-462a-b442-02491b983b14 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:40.907355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26155ac0-194a-462a-b442-02491b983b14 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:40.913748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26155ac0-194a-462a-b442-02491b983b14 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:40.916441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-26155ac0-194a-462a-b442-02491b983b14 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:41.176681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f24385fc-fc5e-4755-b90a-5eddd8789f4b tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Action: 'create', calling method: .version_select at 0x7fbbcb78a8b0>, body: {"keypair": {"name": "tempest-keypair-1452146525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDq6qP1+94vUSxsyL9clP7y49HRtslxzqBP9ItPbtMiDmryCCh0/VmmOyuw/Z6u3wwbAnsyq57efG/9OoTRLi+NsXsERFlCt8W6BcFFS9dFFMzZFlcxpUxya3ntOFA7qAA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:41.185028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-26155ac0-194a-462a-b442-02491b983b14 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:41.223829 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-26155ac0-194a-462a-b442-02491b983b14 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1272 microversion: 2.1 time: 0.409431 Aug 09 17:24:41.230337 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1576/3288] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:40 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1272 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:41.244520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f8c0766-bc82-46c6-bcf3-481137c9afea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:41.246091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8f8c0766-bc82-46c6-bcf3-481137c9afea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:41.266429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f8c0766-bc82-46c6-bcf3-481137c9afea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:41.267021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f8c0766-bc82-46c6-bcf3-481137c9afea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:41.268552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f8c0766-bc82-46c6-bcf3-481137c9afea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:41.272600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f8c0766-bc82-46c6-bcf3-481137c9afea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:41.273349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f8c0766-bc82-46c6-bcf3-481137c9afea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:41.275085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f8c0766-bc82-46c6-bcf3-481137c9afea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:41.327533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f24385fc-fc5e-4755-b90a-5eddd8789f4b tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:41.365198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f24385fc-fc5e-4755-b90a-5eddd8789f4b tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for user 28c1ebf759204de9b43be0fe5f44bbfc and project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:41.513100 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8f8c0766-bc82-46c6-bcf3-481137c9afea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/action" status: 202 len: 0 microversion: 2.1 time: 0.280766 Aug 09 17:24:41.521603 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1577/3289] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:24:41 2022] POST /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:24:41.536891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c7ab1c00-2bf9-4162-a74f-6902fc55f03f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:41.538701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c7ab1c00-2bf9-4162-a74f-6902fc55f03f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:41.547215 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f24385fc-fc5e-4755-b90a-5eddd8789f4b tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.867455 Aug 09 17:24:41.553733 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1713/3290] 10.222.0.93 () {62 vars in 1199 bytes} [Tue Aug 9 17:24:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 872 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 17:24:41.562417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ab1c00-2bf9-4162-a74f-6902fc55f03f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:41.566895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ab1c00-2bf9-4162-a74f-6902fc55f03f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:41.568051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ab1c00-2bf9-4162-a74f-6902fc55f03f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:41.571080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ab1c00-2bf9-4162-a74f-6902fc55f03f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:41.572451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ab1c00-2bf9-4162-a74f-6902fc55f03f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:41.575499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7ab1c00-2bf9-4162-a74f-6902fc55f03f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:41.578241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c7f5760d-92d4-4d84-a1b6-85033f514b20 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:41.581781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c7f5760d-92d4-4d84-a1b6-85033f514b20 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:41.950967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c7f5760d-92d4-4d84-a1b6-85033f514b20 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:42.004736 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c7f5760d-92d4-4d84-a1b6-85033f514b20 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1217 microversion: 2.1 time: 0.442514 Aug 09 17:24:42.016584 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1714/3291] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:41 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1217 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:42.043736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-bdf43b97-0ddf-43da-97a9-a11d1ea192c5 req-da2bb915-0dee-4846-834c-7fd54a6c43ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6760ec-412a-42a8-968d-ce3ebf298c73", "name": "network-vif-deleted", "tag": "7dab4def-547e-43a1-9b87-13b83eb68166"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:42.067143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bdf43b97-0ddf-43da-97a9-a11d1ea192c5 req-da2bb915-0dee-4846-834c-7fd54a6c43ed service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:42.068168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bdf43b97-0ddf-43da-97a9-a11d1ea192c5 req-da2bb915-0dee-4846-834c-7fd54a6c43ed service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:42.069290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bdf43b97-0ddf-43da-97a9-a11d1ea192c5 req-da2bb915-0dee-4846-834c-7fd54a6c43ed service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:42.094055 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-bdf43b97-0ddf-43da-97a9-a11d1ea192c5 req-da2bb915-0dee-4846-834c-7fd54a6c43ed service nova] Creating event network-vif-deleted:7dab4def-547e-43a1-9b87-13b83eb68166 for instance cd6760ec-412a-42a8-968d-ce3ebf298c73 on n-h1-845781-6 Aug 09 17:24:42.106746 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-bdf43b97-0ddf-43da-97a9-a11d1ea192c5 req-da2bb915-0dee-4846-834c-7fd54a6c43ed service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076329 Aug 09 17:24:42.108969 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1715/3292] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:42.125244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eaae1167-035c-4617-8356-e58cf4124c4c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:42.127504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eaae1167-035c-4617-8356-e58cf4124c4c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:42.167867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaae1167-035c-4617-8356-e58cf4124c4c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:42.175231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaae1167-035c-4617-8356-e58cf4124c4c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:42.176294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaae1167-035c-4617-8356-e58cf4124c4c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:42.177664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaae1167-035c-4617-8356-e58cf4124c4c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:42.183113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaae1167-035c-4617-8356-e58cf4124c4c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:42.184200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaae1167-035c-4617-8356-e58cf4124c4c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:42.590340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eaae1167-035c-4617-8356-e58cf4124c4c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:42.602647 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eaae1167-035c-4617-8356-e58cf4124c4c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1511 microversion: 2.1 time: 0.491374 Aug 09 17:24:42.619754 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1716/3293] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:42 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:42.629615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0a7eefdc-198c-4778-a0f2-f01680801e1d tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbcb566e50>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:42.648692 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0a7eefdc-198c-4778-a0f2-f01680801e1d tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-1452146525" status: 200 len: 513 microversion: 2.2 time: 0.025766 Aug 09 17:24:42.651453 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1717/3294] 10.222.0.93 () {60 vars in 1258 bytes} [Tue Aug 9 17:24:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1452146525 => generated 513 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:42.662828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c1715f3-c950-4390-9a81-f1e348ad3847 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:42.665171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c1715f3-c950-4390-9a81-f1e348ad3847 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:42.680527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1715f3-c950-4390-9a81-f1e348ad3847 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:42.682682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1715f3-c950-4390-9a81-f1e348ad3847 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:42.686043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1715f3-c950-4390-9a81-f1e348ad3847 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:42.687610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1715f3-c950-4390-9a81-f1e348ad3847 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:42.688635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1715f3-c950-4390-9a81-f1e348ad3847 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:42.689560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c1715f3-c950-4390-9a81-f1e348ad3847 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:42.866394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c7ab1c00-2bf9-4162-a74f-6902fc55f03f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:42.892506 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c7ab1c00-2bf9-4162-a74f-6902fc55f03f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1303 microversion: 2.1 time: 1.363944 Aug 09 17:24:42.892506 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1578/3295] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:41 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1303 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:42.925670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a45e1403-b2be-4998-98e4-effdef9c9665 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:42.927670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a45e1403-b2be-4998-98e4-effdef9c9665 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:42.936444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45e1403-b2be-4998-98e4-effdef9c9665 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:42.938160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45e1403-b2be-4998-98e4-effdef9c9665 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:42.938316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45e1403-b2be-4998-98e4-effdef9c9665 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:42.939123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45e1403-b2be-4998-98e4-effdef9c9665 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:42.939773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45e1403-b2be-4998-98e4-effdef9c9665 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:42.948851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45e1403-b2be-4998-98e4-effdef9c9665 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:43.081759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c1715f3-c950-4390-9a81-f1e348ad3847 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:43.096917 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c1715f3-c950-4390-9a81-f1e348ad3847 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.443102 Aug 09 17:24:43.100580 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1718/3296] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:42 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:43.118406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a45e1403-b2be-4998-98e4-effdef9c9665 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:43.130936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e567ab1-3ed3-4da9-ad67-f8b0baae594b tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbcb78a310>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:43.154711 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a45e1403-b2be-4998-98e4-effdef9c9665 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1334 microversion: 2.1 time: 0.226872 Aug 09 17:24:43.161040 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1579/3297] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:42 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1334 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:43.177862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4679dcce-839a-4098-b272-8db0769659b5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:43.186452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4679dcce-839a-4098-b272-8db0769659b5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:43.207597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4679dcce-839a-4098-b272-8db0769659b5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:43.214492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4679dcce-839a-4098-b272-8db0769659b5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:43.222041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4679dcce-839a-4098-b272-8db0769659b5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:43.226290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4679dcce-839a-4098-b272-8db0769659b5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:43.227472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4679dcce-839a-4098-b272-8db0769659b5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:43.232207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4679dcce-839a-4098-b272-8db0769659b5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:43.249281 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e567ab1-3ed3-4da9-ad67-f8b0baae594b tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452146525" status: 204 len: 0 microversion: 2.2 time: 0.130200 Aug 09 17:24:43.255550 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1719/3298] 10.222.0.93 () {60 vars in 1261 bytes} [Tue Aug 9 17:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452146525 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:43.287964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-97b30509-0d41-4f6f-ba3d-8376b7ad99d0 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Action: 'create', calling method: .version_select at 0x7fbbd806c430>, body: {"keypair": {"name": "tempest-keypair-1718089705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJP4aK1kVq9Y2oGi4LNbqSGoqnLVkhxz38DrJOIu+cgGJMBHa9VwxIKLj44UUSA5EGW2HbdYJPvjckqS18ivoDtxz2aj4j5w1XhFWF0UzHrifpIEZ0hwmEJMxO/pyuPrCg=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:43.395554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-97b30509-0d41-4f6f-ba3d-8376b7ad99d0 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:43.424564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-97b30509-0d41-4f6f-ba3d-8376b7ad99d0 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for user 28c1ebf759204de9b43be0fe5f44bbfc and project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:43.466988 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-97b30509-0d41-4f6f-ba3d-8376b7ad99d0 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.201764 Aug 09 17:24:43.478321 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1720/3299] 10.222.0.93 () {62 vars in 1199 bytes} [Tue Aug 9 17:24:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 214 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 17:24:43.492565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b2f38c7f-e29e-48b0-a728-1600005d24ba tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbdc9ec550>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:43.551486 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b2f38c7f-e29e-48b0-a728-1600005d24ba tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718089705" status: 204 len: 0 microversion: 2.2 time: 0.070329 Aug 09 17:24:43.553094 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1721/3300] 10.222.0.93 () {60 vars in 1261 bytes} [Tue Aug 9 17:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718089705 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:43.565245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1716976345", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:43.714507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] validate_networks() for [('06107dcb-e281-407c-b425-37660f776641', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:24:43.730074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4679dcce-839a-4098-b272-8db0769659b5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:43.754856 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4679dcce-839a-4098-b272-8db0769659b5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1269 microversion: 2.1 time: 0.591271 Aug 09 17:24:43.760993 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1580/3301] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:43 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1269 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:43.782217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a53eb533-49cb-4b0f-be23-16f6759664b2 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Action: 'create', calling method: .version_select at 0x7fbbcb96caf0>, body: {"keypair": {"name": "tempest-keypair-798031921", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:43.862674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a53eb533-49cb-4b0f-be23-16f6759664b2 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:43.881970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a53eb533-49cb-4b0f-be23-16f6759664b2 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for user 28c1ebf759204de9b43be0fe5f44bbfc and project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:43.974066 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a53eb533-49cb-4b0f-be23-16f6759664b2 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.210335 Aug 09 17:24:43.975869 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1581/3302] 10.222.0.93 () {62 vars in 1199 bytes} [Tue Aug 9 17:24:43 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 214 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 17:24:43.988328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5dbde06-da23-49d2-948f-11e93c1deabf tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:43.989410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5dbde06-da23-49d2-948f-11e93c1deabf tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:44.005867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5dbde06-da23-49d2-948f-11e93c1deabf tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:44.007307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5dbde06-da23-49d2-948f-11e93c1deabf tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:44.008731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5dbde06-da23-49d2-948f-11e93c1deabf tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:44.009782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5dbde06-da23-49d2-948f-11e93c1deabf tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:44.011562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5dbde06-da23-49d2-948f-11e93c1deabf tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:44.012651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5dbde06-da23-49d2-948f-11e93c1deabf tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:44.722299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:24:44.723226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:24:44.724293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:24:44.725050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:24:44.725848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:24:44.745081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:44.745704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:44.746384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:44.747683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:44.748465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:44.749239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:44.788292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Getting quotas for project 5ca6dd79a86743838bd94d3dfe74ef80. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:44.803518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Getting quotas for user 2c49c4b6c28441b3aec0f642e889b9f4 and project 5ca6dd79a86743838bd94d3dfe74ef80. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:44.833187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:24:44.836659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e5dbde06-da23-49d2-948f-11e93c1deabf tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:44.839418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:24:44.863764 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5dbde06-da23-49d2-948f-11e93c1deabf tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1511 microversion: 2.1 time: 0.885032 Aug 09 17:24:44.864560 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1582/3303] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:43 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1511 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:44.876048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ec5b579b-80a8-4b89-8020-c5324adfe0bf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:44.884469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ec5b579b-80a8-4b89-8020-c5324adfe0bf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:44.904231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec5b579b-80a8-4b89-8020-c5324adfe0bf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:44.905119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec5b579b-80a8-4b89-8020-c5324adfe0bf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:44.905985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec5b579b-80a8-4b89-8020-c5324adfe0bf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:44.907267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec5b579b-80a8-4b89-8020-c5324adfe0bf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:44.908241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec5b579b-80a8-4b89-8020-c5324adfe0bf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:44.909294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec5b579b-80a8-4b89-8020-c5324adfe0bf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:44.965397 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d70fad26-4741-4317-8024-5fe2d4d7c5be tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.407542 Aug 09 17:24:44.969111 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1722/3304] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:24:44.991966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a3d75fe-53f4-4c98-8b3f-cf1293c80251 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbcb78aca0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:45.045599 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9a3d75fe-53f4-4c98-8b3f-cf1293c80251 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-798031921" status: 204 len: 0 microversion: 2.2 time: 0.072623 Aug 09 17:24:45.049557 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1723/3305] 10.222.0.93 () {60 vars in 1258 bytes} [Tue Aug 9 17:24:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-798031921 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:45.081165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93c1f207-671a-49ce-bd7b-07e596fef8bc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:45.081165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-93c1f207-671a-49ce-bd7b-07e596fef8bc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:45.126234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93c1f207-671a-49ce-bd7b-07e596fef8bc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:45.127507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93c1f207-671a-49ce-bd7b-07e596fef8bc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:45.141588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93c1f207-671a-49ce-bd7b-07e596fef8bc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:45.142604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93c1f207-671a-49ce-bd7b-07e596fef8bc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:45.143175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93c1f207-671a-49ce-bd7b-07e596fef8bc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:45.145326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93c1f207-671a-49ce-bd7b-07e596fef8bc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:45.310100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-93c1f207-671a-49ce-bd7b-07e596fef8bc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:45.333105 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-93c1f207-671a-49ce-bd7b-07e596fef8bc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1334 microversion: 2.1 time: 0.267572 Aug 09 17:24:45.335073 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1724/3306] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:45 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1334 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:45.372236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4d5bcc3c-ac01-48f3-8494-42a701ed7982 req-6c09833b-4cbc-4e44-a21b-1d28b6189cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "386101c4-2bef-4f17-86d6-e70ca4d09f4c", "tag": "2d1a3f9a-b942-4480-8909-0e4cbb3f802f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:45.395261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4d5bcc3c-ac01-48f3-8494-42a701ed7982 req-6c09833b-4cbc-4e44-a21b-1d28b6189cc9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:45.396864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4d5bcc3c-ac01-48f3-8494-42a701ed7982 req-6c09833b-4cbc-4e44-a21b-1d28b6189cc9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:45.399022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4d5bcc3c-ac01-48f3-8494-42a701ed7982 req-6c09833b-4cbc-4e44-a21b-1d28b6189cc9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:45.427208 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4d5bcc3c-ac01-48f3-8494-42a701ed7982 req-6c09833b-4cbc-4e44-a21b-1d28b6189cc9 service nova] Creating event network-changed:2d1a3f9a-b942-4480-8909-0e4cbb3f802f for instance 386101c4-2bef-4f17-86d6-e70ca4d09f4c on n-h1-845781-6 Aug 09 17:24:45.439047 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4d5bcc3c-ac01-48f3-8494-42a701ed7982 req-6c09833b-4cbc-4e44-a21b-1d28b6189cc9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082966 Aug 09 17:24:45.441072 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1725/3307] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:45.464912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cf73a006-5487-49ca-8079-908b74b8136a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:45.467012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cf73a006-5487-49ca-8079-908b74b8136a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:45.484939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf73a006-5487-49ca-8079-908b74b8136a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:45.485959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf73a006-5487-49ca-8079-908b74b8136a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:45.489321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf73a006-5487-49ca-8079-908b74b8136a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:45.491928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf73a006-5487-49ca-8079-908b74b8136a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:45.493562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf73a006-5487-49ca-8079-908b74b8136a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:45.495802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf73a006-5487-49ca-8079-908b74b8136a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:45.944061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ec5b579b-80a8-4b89-8020-c5324adfe0bf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:45.964683 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ec5b579b-80a8-4b89-8020-c5324adfe0bf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1303 microversion: 2.1 time: 1.093639 Aug 09 17:24:45.965724 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1583/3308] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:44 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1303 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:45.979991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d760833c-a9d4-4fb1-8d9c-b6aa0ce2909b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:45.981205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d760833c-a9d4-4fb1-8d9c-b6aa0ce2909b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:46.265902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cf73a006-5487-49ca-8079-908b74b8136a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:46.305818 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cf73a006-5487-49ca-8079-908b74b8136a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1317 microversion: 2.1 time: 0.850312 Aug 09 17:24:46.307474 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1726/3309] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:45 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1317 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:46.332436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc276be2-724b-4272-ac54-0f74f8c8309f tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Action: 'create', calling method: .version_select at 0x7fbbcbb7a550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-852025306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxZvwlrbH2CHrGh8V1SA46RZSxtgeGNFllttoXx98a0oQRSDubFPtVaQ0cWLupvwf1r9sOCNvkQPLz5+jWTbQA/s6iSRbJBWavodIwpgrFUI1+wZ2D1tC/48AVAinGKRA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:46.404739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-bc276be2-724b-4272-ac54-0f74f8c8309f tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:46.425211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-bc276be2-724b-4272-ac54-0f74f8c8309f tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for user 28c1ebf759204de9b43be0fe5f44bbfc and project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:46.494684 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bc276be2-724b-4272-ac54-0f74f8c8309f tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.185051 Aug 09 17:24:46.497169 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1727/3310] 10.222.0.93 () {62 vars in 1199 bytes} [Tue Aug 9 17:24:46 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 17:24:46.503963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d483dc27-df74-40f8-864d-045438b396ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:46.505764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d483dc27-df74-40f8-864d-045438b396ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:46.523117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d483dc27-df74-40f8-864d-045438b396ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:46.523696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d483dc27-df74-40f8-864d-045438b396ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:46.524404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d483dc27-df74-40f8-864d-045438b396ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:46.528212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d483dc27-df74-40f8-864d-045438b396ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:46.531908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d483dc27-df74-40f8-864d-045438b396ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:46.534008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d483dc27-df74-40f8-864d-045438b396ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:46.539447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d760833c-a9d4-4fb1-8d9c-b6aa0ce2909b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:46.569731 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d760833c-a9d4-4fb1-8d9c-b6aa0ce2909b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1217 microversion: 2.1 time: 0.596541 Aug 09 17:24:46.571652 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1584/3311] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:45 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1217 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:46.599522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-16eb340c-9794-4eb6-a2f1-b59bbe4d5ce8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:46.606677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-16eb340c-9794-4eb6-a2f1-b59bbe4d5ce8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:46.637497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16eb340c-9794-4eb6-a2f1-b59bbe4d5ce8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:46.640630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16eb340c-9794-4eb6-a2f1-b59bbe4d5ce8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:46.641941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16eb340c-9794-4eb6-a2f1-b59bbe4d5ce8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:46.644357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16eb340c-9794-4eb6-a2f1-b59bbe4d5ce8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:46.667683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16eb340c-9794-4eb6-a2f1-b59bbe4d5ce8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:46.670196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16eb340c-9794-4eb6-a2f1-b59bbe4d5ce8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:46.957818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d483dc27-df74-40f8-864d-045438b396ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:46.974404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d483dc27-df74-40f8-864d-045438b396ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1517 microversion: 2.1 time: 0.474784 Aug 09 17:24:46.982817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-16eb340c-9794-4eb6-a2f1-b59bbe4d5ce8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:46.988218 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1728/3312] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:46 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1517 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:47.012740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be561b71-2175-45c9-9489-cc2a4baaaede tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Action: 'create', calling method: .version_select at 0x7fbbcbcf0550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-957215665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtrKcMFlbwO+KrTCc8viNtvXf8UvFGKEUJtVOt+taURyGj8uflx+7i3lJy9iXOXaXUk/BoK3pJ0l2JtK84urU2cYutQPz3uBJZ0IVrdRwRYzSP8J7gWCMOzRd9vkrM+qg=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:47.022861 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-16eb340c-9794-4eb6-a2f1-b59bbe4d5ce8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1334 microversion: 2.1 time: 0.445208 Aug 09 17:24:47.024114 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1585/3313] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:46 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1334 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:47.044467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-26c8249d-c947-42fd-b897-c8edbda9d9fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: .version_select at 0x7fbbcb6ec310>, body: {"keypair": {"name": "tempest-keypair-1230050539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDi1LFLu9EtKj5Yo0pCrtPuIgvkFzFzvSrAid68rQdy2FR6y4PnwwL1QZKGZ3mhwxl7vvj4tKhLn8hid8nh43v6pdjjdOHiBMHe2bsquMW1oLm/r55SivYtReBllh67dlA=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:47.095253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-be561b71-2175-45c9-9489-cc2a4baaaede tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:47.128066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-26c8249d-c947-42fd-b897-c8edbda9d9fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:47.131570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-be561b71-2175-45c9-9489-cc2a4baaaede tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for user 28c1ebf759204de9b43be0fe5f44bbfc and project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:47.168381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-26c8249d-c947-42fd-b897-c8edbda9d9fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for user be0fad88d219437eaed454ba916c86e3 and project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:47.207332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:47.315395 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-be561b71-2175-45c9-9489-cc2a4baaaede tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.318677 Aug 09 17:24:47.316870 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1729/3314] 10.222.0.93 () {62 vars in 1199 bytes} [Tue Aug 9 17:24:46 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 326 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 17:24:47.338065 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-26c8249d-c947-42fd-b897-c8edbda9d9fb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.306596 Aug 09 17:24:47.347245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-00ece814-17f1-4e2b-89b1-4e9c5a332543 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:47.349610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-00ece814-17f1-4e2b-89b1-4e9c5a332543 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:47.353049 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1586/3315] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:24:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:47.365476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ece814-17f1-4e2b-89b1-4e9c5a332543 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:47.376658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bfe44cae-1151-448f-a3b1-1a561e60a683 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Action: 'create', calling method: .version_select at 0x7fbbdc9d2160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1577881173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzfBmLL77ld5CKpa1fs7S+AGWFGGB7NS3lXqrkXjOuCif9e/3a+jqmAxJdVFwIqV/EooCbvFiukbNWRH9o4H0PzxZeY4a6B178McaerHpil4/y2mc2a8KNQDlAwjCj96w=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:47.380727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ece814-17f1-4e2b-89b1-4e9c5a332543 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:47.381497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ece814-17f1-4e2b-89b1-4e9c5a332543 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:47.382838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ece814-17f1-4e2b-89b1-4e9c5a332543 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:47.383741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ece814-17f1-4e2b-89b1-4e9c5a332543 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:47.384471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ece814-17f1-4e2b-89b1-4e9c5a332543 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:47.458385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-bfe44cae-1151-448f-a3b1-1a561e60a683 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:47.489438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-bfe44cae-1151-448f-a3b1-1a561e60a683 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for user 28c1ebf759204de9b43be0fe5f44bbfc and project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:47.623736 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bfe44cae-1151-448f-a3b1-1a561e60a683 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.266650 Aug 09 17:24:47.628100 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1587/3316] 10.222.0.93 () {62 vars in 1199 bytes} [Tue Aug 9 17:24:47 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 274 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 17:24:47.646750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ca5e12ee-b7e3-465b-91e8-b3454ae355fd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:47.649019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ca5e12ee-b7e3-465b-91e8-b3454ae355fd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:47.686711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5e12ee-b7e3-465b-91e8-b3454ae355fd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:47.688265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5e12ee-b7e3-465b-91e8-b3454ae355fd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:47.689579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5e12ee-b7e3-465b-91e8-b3454ae355fd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:47.692204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5e12ee-b7e3-465b-91e8-b3454ae355fd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:47.694997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5e12ee-b7e3-465b-91e8-b3454ae355fd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:47.696303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5e12ee-b7e3-465b-91e8-b3454ae355fd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:48.193486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ca5e12ee-b7e3-465b-91e8-b3454ae355fd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:48.233516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-00ece814-17f1-4e2b-89b1-4e9c5a332543 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:48.235136 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ca5e12ee-b7e3-465b-91e8-b3454ae355fd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1317 microversion: 2.1 time: 0.601660 Aug 09 17:24:48.236394 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1588/3317] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:47 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1317 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:48.243489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5ff25a7f-1c5f-41be-a016-ec584bd3667a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:48.244532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5ff25a7f-1c5f-41be-a016-ec584bd3667a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:48.268460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ff25a7f-1c5f-41be-a016-ec584bd3667a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:48.268962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ff25a7f-1c5f-41be-a016-ec584bd3667a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:48.269179 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-00ece814-17f1-4e2b-89b1-4e9c5a332543 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1303 microversion: 2.1 time: 0.939381 Aug 09 17:24:48.269505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ff25a7f-1c5f-41be-a016-ec584bd3667a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:48.270852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ff25a7f-1c5f-41be-a016-ec584bd3667a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:48.271372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ff25a7f-1c5f-41be-a016-ec584bd3667a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:48.271864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ff25a7f-1c5f-41be-a016-ec584bd3667a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:48.273147 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1730/3318] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:47 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1303 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:48.291986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6cdb9ed1-33c0-4ef2-aeda-4bb7d38989aa tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbda9720d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:48.316179 n-d-845781-6 devstack@n-api.service[119431]: WARNING oslo_db.sqlalchemy.utils [None req-6cdb9ed1-33c0-4ef2-aeda-4bb7d38989aa tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 17:24:48.341017 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6cdb9ed1-33c0-4ef2-aeda-4bb7d38989aa tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.063294 Aug 09 17:24:48.346222 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1731/3319] 10.222.0.93 () {60 vars in 1177 bytes} [Tue Aug 9 17:24:48 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:48.368478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aed90108-ef36-420a-9a68-a8899761ee9e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:48.375393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aed90108-ef36-420a-9a68-a8899761ee9e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:48.403886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed90108-ef36-420a-9a68-a8899761ee9e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:48.408805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed90108-ef36-420a-9a68-a8899761ee9e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:48.415884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed90108-ef36-420a-9a68-a8899761ee9e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:48.418663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed90108-ef36-420a-9a68-a8899761ee9e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:48.419972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed90108-ef36-420a-9a68-a8899761ee9e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:48.423829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed90108-ef36-420a-9a68-a8899761ee9e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:48.743154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5ff25a7f-1c5f-41be-a016-ec584bd3667a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:48.746580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:48.771847 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5ff25a7f-1c5f-41be-a016-ec584bd3667a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1275 microversion: 2.1 time: 0.528602 Aug 09 17:24:48.773005 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1589/3320] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:48 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1275 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:48.788360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-32b9407a-ac66-4646-9179-3ae988ada709 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbdca0a0d0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:48.806770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:48.871697 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-32b9407a-ac66-4646-9179-3ae988ada709 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1577881173" status: 204 len: 0 microversion: 2.2 time: 0.095570 Aug 09 17:24:48.872961 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1590/3321] 10.222.0.93 () {60 vars in 1321 bytes} [Tue Aug 9 17:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1577881173 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:48.886755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4fec4482-f508-4838-bb33-af1fee951b11 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbdc9abd30>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:48.949498 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4fec4482-f508-4838-bb33-af1fee951b11 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-957215665" status: 204 len: 0 microversion: 2.2 time: 0.070332 Aug 09 17:24:48.956109 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1591/3322] 10.222.0.93 () {60 vars in 1318 bytes} [Tue Aug 9 17:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-957215665 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:24:48.980744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e313a6ab-fbb9-447f-aebf-5a34684ba779 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbcb9453a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:49.075467 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e313a6ab-fbb9-447f-aebf-5a34684ba779 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-852025306" status: 204 len: 0 microversion: 2.2 time: 0.112409 Aug 09 17:24:49.082975 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1592/3323] 10.222.0.93 () {60 vars in 1318 bytes} [Tue Aug 9 17:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-852025306 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:49.089835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab501f3c-524a-4c48-b2b4-ad7b87d99951 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Action: 'create', calling method: .version_select at 0x7fbbdc82e940>, body: {"keypair": {"name": "tempest-keypair-596108130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+M3WlOpRnVpjIHW8j88C4e076YY8NeDleDtOJTkW0X1JzvuhvmgD2EKV0I7BRrFGrrmfGXQLuDkW4zoOvFKydQrWfBPERIJdHb+wYYBZbcK6RrHouvHUk/4Q3JXSUavg=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:49.101566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aed90108-ef36-420a-9a68-a8899761ee9e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:49.116512 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aed90108-ef36-420a-9a68-a8899761ee9e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1401 microversion: 2.1 time: 0.767795 Aug 09 17:24:49.120399 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1732/3324] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:48 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1401 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:49.152010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ab501f3c-524a-4c48-b2b4-ad7b87d99951 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:49.182778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ab501f3c-524a-4c48-b2b4-ad7b87d99951 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for user 28c1ebf759204de9b43be0fe5f44bbfc and project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:49.245387 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ab501f3c-524a-4c48-b2b4-ad7b87d99951 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.160100 Aug 09 17:24:49.251877 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1593/3325] 10.222.0.93 () {62 vars in 1199 bytes} [Tue Aug 9 17:24:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 162 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 17:24:49.263579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cc86a879-4083-410f-ac20-ce2c9dfb18b8 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbdc992f70>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:49.273454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eb78d1a0-2907-4d2f-8d84-7af6a28d375e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:49.274096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eb78d1a0-2907-4d2f-8d84-7af6a28d375e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:49.283455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb78d1a0-2907-4d2f-8d84-7af6a28d375e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:49.287017 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cc86a879-4083-410f-ac20-ce2c9dfb18b8 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-596108130" status: 200 len: 512 microversion: 2.2 time: 0.032688 Aug 09 17:24:49.287867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb78d1a0-2907-4d2f-8d84-7af6a28d375e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:49.291358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb78d1a0-2907-4d2f-8d84-7af6a28d375e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:49.295081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb78d1a0-2907-4d2f-8d84-7af6a28d375e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:49.295595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb78d1a0-2907-4d2f-8d84-7af6a28d375e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:49.297725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb78d1a0-2907-4d2f-8d84-7af6a28d375e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:49.308825 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1733/3326] 10.222.0.93 () {60 vars in 1255 bytes} [Tue Aug 9 17:24:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-596108130 => generated 512 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:49.333056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-173da7e8-373d-4e8f-ab13-d47a5eb68c18 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:49.335121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-173da7e8-373d-4e8f-ab13-d47a5eb68c18 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:49.346026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:49.357705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-173da7e8-373d-4e8f-ab13-d47a5eb68c18 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:49.358683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-173da7e8-373d-4e8f-ab13-d47a5eb68c18 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:49.359472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-173da7e8-373d-4e8f-ab13-d47a5eb68c18 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:49.360928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-173da7e8-373d-4e8f-ab13-d47a5eb68c18 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:49.361785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-173da7e8-373d-4e8f-ab13-d47a5eb68c18 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:49.362543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-173da7e8-373d-4e8f-ab13-d47a5eb68c18 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:50.185915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-173da7e8-373d-4e8f-ab13-d47a5eb68c18 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:50.197205 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-173da7e8-373d-4e8f-ab13-d47a5eb68c18 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1303 microversion: 2.1 time: 0.892476 Aug 09 17:24:50.198398 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1734/3327] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:49 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1303 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:50.209222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66e2a487-01c6-495c-9b03-4a97e17fc0f6 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbcb9f20d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:50.224192 n-d-845781-6 devstack@n-api.service[119431]: WARNING oslo_db.sqlalchemy.utils [None req-66e2a487-01c6-495c-9b03-4a97e17fc0f6 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 17:24:50.238696 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66e2a487-01c6-495c-9b03-4a97e17fc0f6 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.036465 Aug 09 17:24:50.242796 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1735/3328] 10.222.0.93 () {60 vars in 1177 bytes} [Tue Aug 9 17:24:50 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:50.252985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3640fa7b-4fca-4f21-895d-f3ea7377bb1e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:50.256153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3640fa7b-4fca-4f21-895d-f3ea7377bb1e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:50.275061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3640fa7b-4fca-4f21-895d-f3ea7377bb1e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:50.276552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3640fa7b-4fca-4f21-895d-f3ea7377bb1e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:50.277873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3640fa7b-4fca-4f21-895d-f3ea7377bb1e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:50.282437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3640fa7b-4fca-4f21-895d-f3ea7377bb1e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:50.283393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3640fa7b-4fca-4f21-895d-f3ea7377bb1e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:50.284059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3640fa7b-4fca-4f21-895d-f3ea7377bb1e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:50.443451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3640fa7b-4fca-4f21-895d-f3ea7377bb1e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:50.462599 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3640fa7b-4fca-4f21-895d-f3ea7377bb1e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1275 microversion: 2.1 time: 0.217640 Aug 09 17:24:50.464379 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1736/3329] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:50 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:50.505585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec12a4e6-e981-46f8-8a57-ae31498a511f tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:50.507160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ec12a4e6-e981-46f8-8a57-ae31498a511f tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:50.527805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec12a4e6-e981-46f8-8a57-ae31498a511f tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:50.529192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec12a4e6-e981-46f8-8a57-ae31498a511f tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:50.530252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec12a4e6-e981-46f8-8a57-ae31498a511f tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:50.535274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec12a4e6-e981-46f8-8a57-ae31498a511f tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:50.536444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec12a4e6-e981-46f8-8a57-ae31498a511f tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:50.546285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec12a4e6-e981-46f8-8a57-ae31498a511f tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:51.001926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eb78d1a0-2907-4d2f-8d84-7af6a28d375e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:51.014659 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eb78d1a0-2907-4d2f-8d84-7af6a28d375e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1317 microversion: 2.1 time: 1.745505 Aug 09 17:24:51.015272 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1594/3330] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:49 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1317 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:51.029479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-551f2c54-46ad-4be3-86bb-2b1e509ae3e9 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbcb6ecca0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:51.086793 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-551f2c54-46ad-4be3-86bb-2b1e509ae3e9 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-596108130" status: 204 len: 0 microversion: 2.2 time: 0.070356 Aug 09 17:24:51.087750 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1595/3331] 10.222.0.93 () {60 vars in 1258 bytes} [Tue Aug 9 17:24:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-596108130 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:51.094762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-6b97b673-2d8b-4c5b-907f-a18cc9e42ba5 req-0024fc2d-78f4-42f5-a497-ce44ae615167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77084f1c-828b-45e4-accc-a1ba292b1498", "tag": "988208c6-a8e8-4757-864d-e9f90c5f0246"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:51.138695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6b97b673-2d8b-4c5b-907f-a18cc9e42ba5 req-0024fc2d-78f4-42f5-a497-ce44ae615167 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:51.141857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6b97b673-2d8b-4c5b-907f-a18cc9e42ba5 req-0024fc2d-78f4-42f5-a497-ce44ae615167 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:51.143578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6b97b673-2d8b-4c5b-907f-a18cc9e42ba5 req-0024fc2d-78f4-42f5-a497-ce44ae615167 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:51.220397 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-6b97b673-2d8b-4c5b-907f-a18cc9e42ba5 req-0024fc2d-78f4-42f5-a497-ce44ae615167 service nova] Creating event network-changed:988208c6-a8e8-4757-864d-e9f90c5f0246 for instance 77084f1c-828b-45e4-accc-a1ba292b1498 on n-h2-845781-6 Aug 09 17:24:51.238751 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-6b97b673-2d8b-4c5b-907f-a18cc9e42ba5 req-0024fc2d-78f4-42f5-a497-ce44ae615167 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148987 Aug 09 17:24:51.244023 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1596/3332] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:51.254722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f3979b4f-62a8-4086-bd2f-509701fc2756 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'create', calling method: .version_select at 0x7fbbdca0a3a0>, body: {"keypair": {"name": "tempest-keypair-1040796941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLnbNy9ddve3Pzivmp+CzyCbgXnVPzi7TMD4LBWkklVZxozBKjWQX1IeFuCQXFxTDgQbJALeCVohBht8mPLAYJrAq+2S6xAppA2sCYljsCTPe6trYbFw8TRE61fOYfv4A=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:51.286969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f3979b4f-62a8-4086-bd2f-509701fc2756 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Getting quotas for project 1d20bf24928749afb9b848946419f4f6. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:51.297836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f3979b4f-62a8-4086-bd2f-509701fc2756 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Getting quotas for user a34881c81ae2427fbf2cbb1cd8c4ef52 and project 1d20bf24928749afb9b848946419f4f6. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:51.315252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ec12a4e6-e981-46f8-8a57-ae31498a511f tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:51.342706 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ec12a4e6-e981-46f8-8a57-ae31498a511f tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1401 microversion: 2.1 time: 0.853171 Aug 09 17:24:51.344266 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1737/3333] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:50 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1401 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:51.363827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8076cd06-3a82-4643-b6ef-dd156acc3928 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Action: 'create', calling method: .version_select at 0x7fbbdc9ce820>, body: {"keypair": {"name": "tempest-keypair-1386808156", "type": "x509"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:51.394730 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f3979b4f-62a8-4086-bd2f-509701fc2756 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147828 Aug 09 17:24:51.403083 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1597/3334] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:24:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:51.406126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-129d7e90-6832-444e-b406-c371328792bb tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:51.407536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-129d7e90-6832-444e-b406-c371328792bb tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:51.427128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8076cd06-3a82-4643-b6ef-dd156acc3928 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:51.438905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129d7e90-6832-444e-b406-c371328792bb tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:51.439844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129d7e90-6832-444e-b406-c371328792bb tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:51.440955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129d7e90-6832-444e-b406-c371328792bb tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:51.442556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129d7e90-6832-444e-b406-c371328792bb tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:51.443965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129d7e90-6832-444e-b406-c371328792bb tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:51.444996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129d7e90-6832-444e-b406-c371328792bb tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:51.448500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8076cd06-3a82-4643-b6ef-dd156acc3928 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for user 28c1ebf759204de9b43be0fe5f44bbfc and project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:51.493858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.processutils [None req-8076cd06-3a82-4643-b6ef-dd156acc3928 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp4h34wu75/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4h34wu75/temp.key -subj /CN=28c1ebf759204de9b43be0fe5f44bbfc -extensions v3_req_client {{(pid=119431) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 09 17:24:51.684797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.processutils [None req-8076cd06-3a82-4643-b6ef-dd156acc3928 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp4h34wu75/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4h34wu75/temp.key -subj /CN=28c1ebf759204de9b43be0fe5f44bbfc -extensions v3_req_client" returned: 0 in 0.189s {{(pid=119431) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 09 17:24:51.689404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.processutils [None req-8076cd06-3a82-4643-b6ef-dd156acc3928 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp4h34wu75/temp.key -password pass: {{(pid=119431) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 09 17:24:51.779111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.processutils [None req-8076cd06-3a82-4643-b6ef-dd156acc3928 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp4h34wu75/temp.key -password pass:" returned: 0 in 0.089s {{(pid=119431) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 09 17:24:51.889324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8076cd06-3a82-4643-b6ef-dd156acc3928 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:24:51.900184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8076cd06-3a82-4643-b6ef-dd156acc3928 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Getting quotas for user 28c1ebf759204de9b43be0fe5f44bbfc and project 04c1cee8ef624950ba1fc78fbe7a38a0. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:24:51.936099 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8076cd06-3a82-4643-b6ef-dd156acc3928 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.588135 Aug 09 17:24:51.939694 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1738/3335] 10.222.0.93 () {62 vars in 1198 bytes} [Tue Aug 9 17:24:51 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 591 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:51.951100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f279cd79-75b2-4bd4-a6d0-2afe2d102bea tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:51.952169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f279cd79-75b2-4bd4-a6d0-2afe2d102bea tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:51.961005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f279cd79-75b2-4bd4-a6d0-2afe2d102bea tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:51.961945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f279cd79-75b2-4bd4-a6d0-2afe2d102bea tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:51.962697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f279cd79-75b2-4bd4-a6d0-2afe2d102bea tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:51.964492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f279cd79-75b2-4bd4-a6d0-2afe2d102bea tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:51.965160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f279cd79-75b2-4bd4-a6d0-2afe2d102bea tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:51.965818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f279cd79-75b2-4bd4-a6d0-2afe2d102bea tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:52.028249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-129d7e90-6832-444e-b406-c371328792bb tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:52.082371 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-129d7e90-6832-444e-b406-c371328792bb tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1303 microversion: 2.1 time: 0.683663 Aug 09 17:24:52.084257 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1598/3336] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:51 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1303 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:52.100610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-473a8a5a-1035-4578-a46e-5d28ee7da864 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbcb6a0e50>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:52.127568 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-473a8a5a-1035-4578-a46e-5d28ee7da864 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-1386808156" status: 200 len: 1534 microversion: 2.2 time: 0.039714 Aug 09 17:24:52.138220 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1599/3337] 10.222.0.93 () {60 vars in 1258 bytes} [Tue Aug 9 17:24:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1386808156 => generated 1534 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:52.139045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0a58bebc-b0e4-4c21-a22a-582eba5ea9f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:52.140266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0a58bebc-b0e4-4c21-a22a-582eba5ea9f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:52.151997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a58bebc-b0e4-4c21-a22a-582eba5ea9f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:52.152913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a58bebc-b0e4-4c21-a22a-582eba5ea9f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:52.154761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a58bebc-b0e4-4c21-a22a-582eba5ea9f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:52.156156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a58bebc-b0e4-4c21-a22a-582eba5ea9f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:52.157615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a58bebc-b0e4-4c21-a22a-582eba5ea9f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:52.157771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a58bebc-b0e4-4c21-a22a-582eba5ea9f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:52.516360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f279cd79-75b2-4bd4-a6d0-2afe2d102bea tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:52.553446 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f279cd79-75b2-4bd4-a6d0-2afe2d102bea tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1317 microversion: 2.1 time: 0.611567 Aug 09 17:24:52.570891 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1739/3338] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:51 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1317 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:52.635680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-da8da9f8-5b83-4a73-ae2c-1f9b3991d6f9 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbdc9ceaf0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:52.659875 n-d-845781-6 devstack@n-api.service[119431]: WARNING oslo_db.sqlalchemy.utils [None req-da8da9f8-5b83-4a73-ae2c-1f9b3991d6f9 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 17:24:52.674182 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-da8da9f8-5b83-4a73-ae2c-1f9b3991d6f9 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.078669 Aug 09 17:24:52.676574 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1740/3339] 10.222.0.93 () {60 vars in 1177 bytes} [Tue Aug 9 17:24:52 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:52.694569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7af9fd49-dd81-46ae-81af-6f06c3056cdd tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:52.697402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7af9fd49-dd81-46ae-81af-6f06c3056cdd tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:52.717716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af9fd49-dd81-46ae-81af-6f06c3056cdd tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:52.719375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af9fd49-dd81-46ae-81af-6f06c3056cdd tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:52.720717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af9fd49-dd81-46ae-81af-6f06c3056cdd tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:52.723710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af9fd49-dd81-46ae-81af-6f06c3056cdd tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:52.725388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af9fd49-dd81-46ae-81af-6f06c3056cdd tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:52.726677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7af9fd49-dd81-46ae-81af-6f06c3056cdd tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:53.165766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0a58bebc-b0e4-4c21-a22a-582eba5ea9f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:53.201414 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0a58bebc-b0e4-4c21-a22a-582eba5ea9f6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1317 microversion: 2.1 time: 1.070691 Aug 09 17:24:53.204908 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1600/3340] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:52 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1317 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:53.242010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2be981c0-08ef-4a68-882b-0b39bfc03b26 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] Calling method '.version_select at 0x7fbbcb945d30>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:53.273687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7af9fd49-dd81-46ae-81af-6f06c3056cdd tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:53.282425 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7af9fd49-dd81-46ae-81af-6f06c3056cdd tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1401 microversion: 2.1 time: 0.603352 Aug 09 17:24:53.296247 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1741/3341] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:52 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1401 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:53.301864 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2be981c0-08ef-4a68-882b-0b39bfc03b26 tempest-KeyPairsV22TestJSON-1051571917 tempest-KeyPairsV22TestJSON-1051571917-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386808156" status: 204 len: 0 microversion: 2.2 time: 0.083807 Aug 09 17:24:53.302383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-20a7d4fd-ffc0-4a9c-bd96-d552b4790c70 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:53.303179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-20a7d4fd-ffc0-4a9c-bd96-d552b4790c70 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:53.314393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a7d4fd-ffc0-4a9c-bd96-d552b4790c70 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:53.314393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a7d4fd-ffc0-4a9c-bd96-d552b4790c70 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:53.314393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a7d4fd-ffc0-4a9c-bd96-d552b4790c70 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:53.314393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a7d4fd-ffc0-4a9c-bd96-d552b4790c70 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:53.314393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a7d4fd-ffc0-4a9c-bd96-d552b4790c70 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:53.314393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a7d4fd-ffc0-4a9c-bd96-d552b4790c70 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:53.319121 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1601/3342] 10.222.0.93 () {60 vars in 1261 bytes} [Tue Aug 9 17:24:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386808156 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:24:53.388576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-6ba786e0-d5f2-409f-b9b8-250df8292b7a req-b5bb8e86-56cb-41ba-86c3-33c6327c7d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6836a3c0-24e0-4afb-ba44-bcbdf81c4f11", "tag": "0430a967-0c56-4428-9296-a392bcbd950f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:53.421860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6ba786e0-d5f2-409f-b9b8-250df8292b7a req-b5bb8e86-56cb-41ba-86c3-33c6327c7d2a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:53.425635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6ba786e0-d5f2-409f-b9b8-250df8292b7a req-b5bb8e86-56cb-41ba-86c3-33c6327c7d2a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:53.426540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6ba786e0-d5f2-409f-b9b8-250df8292b7a req-b5bb8e86-56cb-41ba-86c3-33c6327c7d2a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:53.465901 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-6ba786e0-d5f2-409f-b9b8-250df8292b7a req-b5bb8e86-56cb-41ba-86c3-33c6327c7d2a service nova] Creating event network-changed:0430a967-0c56-4428-9296-a392bcbd950f for instance 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 on n-h2-845781-6 Aug 09 17:24:53.478228 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-6ba786e0-d5f2-409f-b9b8-250df8292b7a req-b5bb8e86-56cb-41ba-86c3-33c6327c7d2a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103179 Aug 09 17:24:53.485969 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1602/3343] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:24:53.605120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3e1bc152-1ef1-41b8-a3c9-f9d53eb1bc0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:53.606732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3e1bc152-1ef1-41b8-a3c9-f9d53eb1bc0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:53.625229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1bc152-1ef1-41b8-a3c9-f9d53eb1bc0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:53.628767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1bc152-1ef1-41b8-a3c9-f9d53eb1bc0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:53.629223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1bc152-1ef1-41b8-a3c9-f9d53eb1bc0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:53.631055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1bc152-1ef1-41b8-a3c9-f9d53eb1bc0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:53.631550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1bc152-1ef1-41b8-a3c9-f9d53eb1bc0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:53.632111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1bc152-1ef1-41b8-a3c9-f9d53eb1bc0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:54.052290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3e1bc152-1ef1-41b8-a3c9-f9d53eb1bc0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:54.088124 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3e1bc152-1ef1-41b8-a3c9-f9d53eb1bc0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1317 microversion: 2.1 time: 0.488859 Aug 09 17:24:54.098229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-20a7d4fd-ffc0-4a9c-bd96-d552b4790c70 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:54.104256 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1603/3344] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:53 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:24:54.108302 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-20a7d4fd-ffc0-4a9c-bd96-d552b4790c70 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1291 microversion: 2.1 time: 0.810948 Aug 09 17:24:54.121038 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1742/3345] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:53 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1291 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:54.249433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-18f7b3c6-8a31-406e-b4fb-98529daaf393 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:54.253286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-18f7b3c6-8a31-406e-b4fb-98529daaf393 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:54.284616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f7b3c6-8a31-406e-b4fb-98529daaf393 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:54.288223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f7b3c6-8a31-406e-b4fb-98529daaf393 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:54.290287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f7b3c6-8a31-406e-b4fb-98529daaf393 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:54.292818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f7b3c6-8a31-406e-b4fb-98529daaf393 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:54.294690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f7b3c6-8a31-406e-b4fb-98529daaf393 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:54.295586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18f7b3c6-8a31-406e-b4fb-98529daaf393 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:54.316266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e12992b9-0c75-44c1-aee9-f1e450bf9c76 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:54.317874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e12992b9-0c75-44c1-aee9-f1e450bf9c76 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:54.332553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e12992b9-0c75-44c1-aee9-f1e450bf9c76 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:54.334130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e12992b9-0c75-44c1-aee9-f1e450bf9c76 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:54.335764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e12992b9-0c75-44c1-aee9-f1e450bf9c76 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:54.340219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e12992b9-0c75-44c1-aee9-f1e450bf9c76 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:54.341889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e12992b9-0c75-44c1-aee9-f1e450bf9c76 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:54.343467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e12992b9-0c75-44c1-aee9-f1e450bf9c76 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:54.769740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:55.539041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e12992b9-0c75-44c1-aee9-f1e450bf9c76 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:55.563257 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e12992b9-0c75-44c1-aee9-f1e450bf9c76 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1401 microversion: 2.1 time: 1.257811 Aug 09 17:24:55.565464 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1743/3346] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:54 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1401 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:55.574547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-05c0f78a-13f3-4915-a38b-e1b640739353 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:55.586592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-05c0f78a-13f3-4915-a38b-e1b640739353 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:55.605010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05c0f78a-13f3-4915-a38b-e1b640739353 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:55.607514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05c0f78a-13f3-4915-a38b-e1b640739353 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:55.612750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05c0f78a-13f3-4915-a38b-e1b640739353 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:55.613970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05c0f78a-13f3-4915-a38b-e1b640739353 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:55.614752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05c0f78a-13f3-4915-a38b-e1b640739353 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:55.615451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05c0f78a-13f3-4915-a38b-e1b640739353 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:56.035926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-18f7b3c6-8a31-406e-b4fb-98529daaf393 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:56.052944 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-18f7b3c6-8a31-406e-b4fb-98529daaf393 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1317 microversion: 2.1 time: 1.812512 Aug 09 17:24:56.054061 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1604/3347] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:54 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1317 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:56.064865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-85703256-cd32-410e-932a-dad380ac3c43 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:56.066510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-85703256-cd32-410e-932a-dad380ac3c43 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:56.086508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85703256-cd32-410e-932a-dad380ac3c43 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:56.088916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85703256-cd32-410e-932a-dad380ac3c43 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:56.091438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85703256-cd32-410e-932a-dad380ac3c43 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:56.093568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85703256-cd32-410e-932a-dad380ac3c43 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:56.095128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85703256-cd32-410e-932a-dad380ac3c43 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:56.096415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85703256-cd32-410e-932a-dad380ac3c43 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:56.533470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-05c0f78a-13f3-4915-a38b-e1b640739353 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:56.537962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:24:56.548950 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-05c0f78a-13f3-4915-a38b-e1b640739353 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1317 microversion: 2.1 time: 0.981838 Aug 09 17:24:56.550934 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1744/3348] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:55 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1317 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:56.606319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a2811191-ed9a-4aa0-bdb4-503cfc1a4d7e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:56.607359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a2811191-ed9a-4aa0-bdb4-503cfc1a4d7e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:56.615289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2811191-ed9a-4aa0-bdb4-503cfc1a4d7e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:56.616869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2811191-ed9a-4aa0-bdb4-503cfc1a4d7e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:56.617652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2811191-ed9a-4aa0-bdb4-503cfc1a4d7e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:56.618745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2811191-ed9a-4aa0-bdb4-503cfc1a4d7e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:56.619500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2811191-ed9a-4aa0-bdb4-503cfc1a4d7e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:56.620638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2811191-ed9a-4aa0-bdb4-503cfc1a4d7e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:56.830787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-85703256-cd32-410e-932a-dad380ac3c43 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:56.859368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-85703256-cd32-410e-932a-dad380ac3c43 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1291 microversion: 2.1 time: 0.802983 Aug 09 17:24:56.860518 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1605/3349] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:56 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1291 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:57.067092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-4d52d0b0-0800-439d-9a65-96a9a9719730 req-bbae8151-4a66-4ff1-a4a0-9c10df6f3416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c06398-1bb3-44b1-bc17-4db4dfd8294c", "tag": "865d93b0-2885-4c2c-897e-3f6c724b9391"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:57.113479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4d52d0b0-0800-439d-9a65-96a9a9719730 req-bbae8151-4a66-4ff1-a4a0-9c10df6f3416 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:57.114996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4d52d0b0-0800-439d-9a65-96a9a9719730 req-bbae8151-4a66-4ff1-a4a0-9c10df6f3416 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:57.116241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4d52d0b0-0800-439d-9a65-96a9a9719730 req-bbae8151-4a66-4ff1-a4a0-9c10df6f3416 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:57.145084 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-4d52d0b0-0800-439d-9a65-96a9a9719730 req-bbae8151-4a66-4ff1-a4a0-9c10df6f3416 service nova] Creating event network-changed:865d93b0-2885-4c2c-897e-3f6c724b9391 for instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c on n-h1-845781-6 Aug 09 17:24:57.172127 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-4d52d0b0-0800-439d-9a65-96a9a9719730 req-bbae8151-4a66-4ff1-a4a0-9c10df6f3416 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115960 Aug 09 17:24:57.174220 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1606/3350] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:57.188139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b689fbf6-a8d6-42e9-985d-a442b6dde845 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:57.190364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b689fbf6-a8d6-42e9-985d-a442b6dde845 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:57.205754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b689fbf6-a8d6-42e9-985d-a442b6dde845 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:57.207396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b689fbf6-a8d6-42e9-985d-a442b6dde845 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:57.210189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b689fbf6-a8d6-42e9-985d-a442b6dde845 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:57.212722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b689fbf6-a8d6-42e9-985d-a442b6dde845 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:57.214783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b689fbf6-a8d6-42e9-985d-a442b6dde845 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:57.216539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b689fbf6-a8d6-42e9-985d-a442b6dde845 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:57.836641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a2811191-ed9a-4aa0-bdb4-503cfc1a4d7e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:57.863278 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a2811191-ed9a-4aa0-bdb4-503cfc1a4d7e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1401 microversion: 2.1 time: 1.261160 Aug 09 17:24:57.868415 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1745/3351] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:56 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1401 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:57.901749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efb4b57c-1203-4cad-b653-4a3b862876e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:57.903396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-efb4b57c-1203-4cad-b653-4a3b862876e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:57.924855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb4b57c-1203-4cad-b653-4a3b862876e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:57.937554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb4b57c-1203-4cad-b653-4a3b862876e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:57.940031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb4b57c-1203-4cad-b653-4a3b862876e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:57.942191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb4b57c-1203-4cad-b653-4a3b862876e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:57.943603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb4b57c-1203-4cad-b653-4a3b862876e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:57.944861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efb4b57c-1203-4cad-b653-4a3b862876e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:58.190922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b689fbf6-a8d6-42e9-985d-a442b6dde845 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:58.218408 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b689fbf6-a8d6-42e9-985d-a442b6dde845 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1317 microversion: 2.1 time: 1.040636 Aug 09 17:24:58.224128 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1607/3352] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:57 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1317 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:58.246800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-4fbcaf33-7ff0-4fc7-83d2-337678156be4 req-f61affd9-3519-44e3-beaa-74ed0467aa20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77084f1c-828b-45e4-accc-a1ba292b1498", "name": "network-vif-plugged", "status": "completed", "tag": "988208c6-a8e8-4757-864d-e9f90c5f0246"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:58.287427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4fbcaf33-7ff0-4fc7-83d2-337678156be4 req-f61affd9-3519-44e3-beaa-74ed0467aa20 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:58.290632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4fbcaf33-7ff0-4fc7-83d2-337678156be4 req-f61affd9-3519-44e3-beaa-74ed0467aa20 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:58.291507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4fbcaf33-7ff0-4fc7-83d2-337678156be4 req-f61affd9-3519-44e3-beaa-74ed0467aa20 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:58.358271 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-4fbcaf33-7ff0-4fc7-83d2-337678156be4 req-f61affd9-3519-44e3-beaa-74ed0467aa20 service nova] Creating event network-vif-plugged:988208c6-a8e8-4757-864d-e9f90c5f0246 for instance 77084f1c-828b-45e4-accc-a1ba292b1498 on n-h2-845781-6 Aug 09 17:24:58.373036 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-4fbcaf33-7ff0-4fc7-83d2-337678156be4 req-f61affd9-3519-44e3-beaa-74ed0467aa20 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145126 Aug 09 17:24:58.379206 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1608/3353] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:24:58.412765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-368c86b4-09a5-46c5-99b3-9b88906869ae tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:58.413062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-368c86b4-09a5-46c5-99b3-9b88906869ae tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:58.425622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-368c86b4-09a5-46c5-99b3-9b88906869ae tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:58.425964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-368c86b4-09a5-46c5-99b3-9b88906869ae tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:58.430366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-368c86b4-09a5-46c5-99b3-9b88906869ae tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:58.433200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-368c86b4-09a5-46c5-99b3-9b88906869ae tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:58.434198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-368c86b4-09a5-46c5-99b3-9b88906869ae tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:58.435019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-368c86b4-09a5-46c5-99b3-9b88906869ae tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:59.176561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-efb4b57c-1203-4cad-b653-4a3b862876e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:59.241635 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-efb4b57c-1203-4cad-b653-4a3b862876e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1317 microversion: 2.1 time: 1.365287 Aug 09 17:24:59.245133 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1746/3354] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:57 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1317 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:59.267846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e2810d16-136f-41ae-929a-30767ad746a9 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:59.269720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-368c86b4-09a5-46c5-99b3-9b88906869ae tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:59.270718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e2810d16-136f-41ae-929a-30767ad746a9 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:59.296410 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-368c86b4-09a5-46c5-99b3-9b88906869ae tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1291 microversion: 2.1 time: 0.903286 Aug 09 17:24:59.297250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2810d16-136f-41ae-929a-30767ad746a9 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:59.298158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2810d16-136f-41ae-929a-30767ad746a9 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:59.299077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2810d16-136f-41ae-929a-30767ad746a9 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:59.306087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2810d16-136f-41ae-929a-30767ad746a9 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:59.312852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2810d16-136f-41ae-929a-30767ad746a9 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:59.313937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2810d16-136f-41ae-929a-30767ad746a9 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:59.315055 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1609/3355] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:58 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1291 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:59.345377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-945047235", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34fc5f4c-78d4-4016-ba62-ad51259fd9d6"}], "security_groups": [{"name": "tempest-securitygroup--1830352827"}], "key_name": "tempest-keypair-1230050539", "user_data": "}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:24:59.783847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] validate_networks() for [('34fc5f4c-78d4-4016-ba62-ad51259fd9d6', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:24:59.806043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e2810d16-136f-41ae-929a-30767ad746a9 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:24:59.826881 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e2810d16-136f-41ae-929a-30767ad746a9 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1401 microversion: 2.1 time: 0.579107 Aug 09 17:24:59.827721 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1747/3356] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:59 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1401 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:24:59.833187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-083988d6-74b6-4632-a050-1b4fb41e7a95 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:24:59.834589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-083988d6-74b6-4632-a050-1b4fb41e7a95 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:24:59.842346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083988d6-74b6-4632-a050-1b4fb41e7a95 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:59.843208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083988d6-74b6-4632-a050-1b4fb41e7a95 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:59.843811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083988d6-74b6-4632-a050-1b4fb41e7a95 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:24:59.844677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083988d6-74b6-4632-a050-1b4fb41e7a95 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:24:59.845267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083988d6-74b6-4632-a050-1b4fb41e7a95 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:24:59.845817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083988d6-74b6-4632-a050-1b4fb41e7a95 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:00.197948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-083988d6-74b6-4632-a050-1b4fb41e7a95 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:00.220955 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-083988d6-74b6-4632-a050-1b4fb41e7a95 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1317 microversion: 2.1 time: 0.391447 Aug 09 17:25:00.223208 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1748/3357] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:24:59 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:00.240149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1870739505", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f872dee3-4b84-411f-bcd4-a71f8b363ac6"}], "security_groups": [{"name": "tempest-securitygroup--1663433937"}], "key_name": "tempest-keypair-1040796941", "user_data": "}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:00.507029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] validate_networks() for [('f872dee3-4b84-411f-bcd4-a71f8b363ac6', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:25:00.873496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:25:00.875219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:25:00.876423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:25:00.878588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:25:00.879726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:25:00.913524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=45 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:00.924092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:00.927907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:00.930893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:00.939432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:00.940976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:00.942344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:01.047152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:25:01.078023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for user be0fad88d219437eaed454ba916c86e3 and project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:25:01.156983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:25:01.182594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:25:01.486696 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ba7949ce-81ed-45df-a735-e7e5a928b626 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.167643 Aug 09 17:25:01.490232 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1610/3358] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:24:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 2174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:25:01.510625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d6b7dd27-f44a-4edc-83b6-ad177150e5df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:01.511310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d6b7dd27-f44a-4edc-83b6-ad177150e5df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:01.520366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6b7dd27-f44a-4edc-83b6-ad177150e5df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:01.521277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6b7dd27-f44a-4edc-83b6-ad177150e5df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:01.521741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6b7dd27-f44a-4edc-83b6-ad177150e5df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:01.522492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6b7dd27-f44a-4edc-83b6-ad177150e5df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:01.523704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6b7dd27-f44a-4edc-83b6-ad177150e5df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:01.524149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6b7dd27-f44a-4edc-83b6-ad177150e5df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:01.917405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=38 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:02.573070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d6b7dd27-f44a-4edc-83b6-ad177150e5df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:02.588609 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d6b7dd27-f44a-4edc-83b6-ad177150e5df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1317 microversion: 2.1 time: 1.092067 Aug 09 17:25:02.592725 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1611/3359] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:01 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1317 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:02.602177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4154d6f5-59d4-4062-87f5-0e3543c71b8f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:02.604692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4154d6f5-59d4-4062-87f5-0e3543c71b8f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:02.612448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4154d6f5-59d4-4062-87f5-0e3543c71b8f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:02.613688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4154d6f5-59d4-4062-87f5-0e3543c71b8f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:02.614656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4154d6f5-59d4-4062-87f5-0e3543c71b8f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:02.615712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4154d6f5-59d4-4062-87f5-0e3543c71b8f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:02.620363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4154d6f5-59d4-4062-87f5-0e3543c71b8f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:02.630578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4154d6f5-59d4-4062-87f5-0e3543c71b8f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:03.155468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:25:03.156454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:25:03.157069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:25:03.158879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:25:03.159668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:25:03.221705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:03.224374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:03.225260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:03.226742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:03.227659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:03.237446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:03.321759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Getting quotas for project 1d20bf24928749afb9b848946419f4f6. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:25:03.353369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Getting quotas for user a34881c81ae2427fbf2cbb1cd8c4ef52 and project 1d20bf24928749afb9b848946419f4f6. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:25:03.427098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4154d6f5-59d4-4062-87f5-0e3543c71b8f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:03.434846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:25:03.451316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:25:03.457299 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4154d6f5-59d4-4062-87f5-0e3543c71b8f tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1291 microversion: 2.1 time: 0.862404 Aug 09 17:25:03.460105 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1612/3360] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:02 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1291 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:03.483159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-78cd8a88-4be3-46ce-9aa9-46cd839ce96e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:03.484960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-78cd8a88-4be3-46ce-9aa9-46cd839ce96e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:03.509486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cd8a88-4be3-46ce-9aa9-46cd839ce96e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:03.510604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cd8a88-4be3-46ce-9aa9-46cd839ce96e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:03.511548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cd8a88-4be3-46ce-9aa9-46cd839ce96e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:03.512947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cd8a88-4be3-46ce-9aa9-46cd839ce96e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:03.513901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cd8a88-4be3-46ce-9aa9-46cd839ce96e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:03.514768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78cd8a88-4be3-46ce-9aa9-46cd839ce96e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:03.619951 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e5ea8e23-341c-4714-9d78-4d9072259342 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.393767 Aug 09 17:25:03.621085 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1749/3361] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 3397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:25:03.627952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-140a727b-028d-4eaf-bc63-a67c491addbc tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:03.629714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-140a727b-028d-4eaf-bc63-a67c491addbc tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:03.638696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-140a727b-028d-4eaf-bc63-a67c491addbc tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:03.639769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-140a727b-028d-4eaf-bc63-a67c491addbc tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:03.640498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-140a727b-028d-4eaf-bc63-a67c491addbc tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:03.643541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-140a727b-028d-4eaf-bc63-a67c491addbc tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:03.644614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-140a727b-028d-4eaf-bc63-a67c491addbc tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:03.645518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-140a727b-028d-4eaf-bc63-a67c491addbc tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:04.001529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-140a727b-028d-4eaf-bc63-a67c491addbc tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:04.021649 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-140a727b-028d-4eaf-bc63-a67c491addbc tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1507 microversion: 2.1 time: 0.397896 Aug 09 17:25:04.023199 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1750/3362] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:03 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:04.033149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3258cd7-f0f3-4862-af62-c9b3230a92c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:04.034400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3258cd7-f0f3-4862-af62-c9b3230a92c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:04.059048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3258cd7-f0f3-4862-af62-c9b3230a92c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:04.059701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3258cd7-f0f3-4862-af62-c9b3230a92c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:04.062190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3258cd7-f0f3-4862-af62-c9b3230a92c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:04.062190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3258cd7-f0f3-4862-af62-c9b3230a92c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:04.062190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3258cd7-f0f3-4862-af62-c9b3230a92c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:04.062190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3258cd7-f0f3-4862-af62-c9b3230a92c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:04.204379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f3258cd7-f0f3-4862-af62-c9b3230a92c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:04.222176 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3258cd7-f0f3-4862-af62-c9b3230a92c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1293 microversion: 2.1 time: 0.196986 Aug 09 17:25:04.246676 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1751/3363] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:04 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1293 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:04.257038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d20dc53a-e8b9-4c57-bc02-c7556cde4fb4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:04.258259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d20dc53a-e8b9-4c57-bc02-c7556cde4fb4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:04.274477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d20dc53a-e8b9-4c57-bc02-c7556cde4fb4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:04.279366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d20dc53a-e8b9-4c57-bc02-c7556cde4fb4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:04.280137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d20dc53a-e8b9-4c57-bc02-c7556cde4fb4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:04.281133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d20dc53a-e8b9-4c57-bc02-c7556cde4fb4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:04.283321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d20dc53a-e8b9-4c57-bc02-c7556cde4fb4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:04.284828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d20dc53a-e8b9-4c57-bc02-c7556cde4fb4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:04.510402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-78cd8a88-4be3-46ce-9aa9-46cd839ce96e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:04.534927 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-78cd8a88-4be3-46ce-9aa9-46cd839ce96e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1401 microversion: 2.1 time: 1.072429 Aug 09 17:25:04.542229 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1613/3364] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:03 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1401 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:04.568686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b6af89e7-0447-4b9b-810e-25ea8f2c56cc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:04.576830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b6af89e7-0447-4b9b-810e-25ea8f2c56cc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:04.805090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b6af89e7-0447-4b9b-810e-25ea8f2c56cc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:04.835102 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b6af89e7-0447-4b9b-810e-25ea8f2c56cc tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1246 microversion: 2.1 time: 0.285789 Aug 09 17:25:04.836273 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1614/3365] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:04 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1246 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:04.898913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-10ccee2a-2676-4219-a1f0-dce176246c5c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:04.901786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-10ccee2a-2676-4219-a1f0-dce176246c5c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:04.943165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-10ccee2a-2676-4219-a1f0-dce176246c5c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:04.946892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-10ccee2a-2676-4219-a1f0-dce176246c5c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:04.952706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-10ccee2a-2676-4219-a1f0-dce176246c5c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:04.955955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-10ccee2a-2676-4219-a1f0-dce176246c5c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:04.957645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-10ccee2a-2676-4219-a1f0-dce176246c5c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:04.958720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-10ccee2a-2676-4219-a1f0-dce176246c5c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:05.035955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d20dc53a-e8b9-4c57-bc02-c7556cde4fb4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:05.063997 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d20dc53a-e8b9-4c57-bc02-c7556cde4fb4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1317 microversion: 2.1 time: 0.831616 Aug 09 17:25:05.065427 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1752/3366] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:04 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1317 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:05.103003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-01634f87-bc54-4efd-8165-f90f40710401 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:05.118043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-01634f87-bc54-4efd-8165-f90f40710401 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:05.160409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01634f87-bc54-4efd-8165-f90f40710401 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:05.161449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01634f87-bc54-4efd-8165-f90f40710401 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:05.162327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01634f87-bc54-4efd-8165-f90f40710401 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:05.164158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01634f87-bc54-4efd-8165-f90f40710401 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:05.165205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01634f87-bc54-4efd-8165-f90f40710401 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:05.166657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01634f87-bc54-4efd-8165-f90f40710401 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:05.480870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-10ccee2a-2676-4219-a1f0-dce176246c5c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:05.504545 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-10ccee2a-2676-4219-a1f0-dce176246c5c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1507 microversion: 2.1 time: 0.625754 Aug 09 17:25:05.543591 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1615/3367] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:04 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1507 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:05.554012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-81db4932-cac6-4d12-be4a-1018faf4916d req-b0a17bf8-9128-4773-bc54-bd4496da3f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386101c4-2bef-4f17-86d6-e70ca4d09f4c", "name": "network-vif-plugged", "status": "completed", "tag": "2d1a3f9a-b942-4480-8909-0e4cbb3f802f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:05.573554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:05.577146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-81db4932-cac6-4d12-be4a-1018faf4916d req-b0a17bf8-9128-4773-bc54-bd4496da3f69 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:05.578035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-81db4932-cac6-4d12-be4a-1018faf4916d req-b0a17bf8-9128-4773-bc54-bd4496da3f69 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:05.578834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-81db4932-cac6-4d12-be4a-1018faf4916d req-b0a17bf8-9128-4773-bc54-bd4496da3f69 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:05.607114 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-81db4932-cac6-4d12-be4a-1018faf4916d req-b0a17bf8-9128-4773-bc54-bd4496da3f69 service nova] Creating event network-vif-plugged:2d1a3f9a-b942-4480-8909-0e4cbb3f802f for instance 386101c4-2bef-4f17-86d6-e70ca4d09f4c on n-h1-845781-6 Aug 09 17:25:05.616542 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-81db4932-cac6-4d12-be4a-1018faf4916d req-b0a17bf8-9128-4773-bc54-bd4496da3f69 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070311 Aug 09 17:25:05.618225 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1616/3368] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:05.631918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69f44ae8-a9ed-44bd-a88b-440d6285b293 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:05.633768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-69f44ae8-a9ed-44bd-a88b-440d6285b293 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:05.647836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f44ae8-a9ed-44bd-a88b-440d6285b293 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:05.649237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f44ae8-a9ed-44bd-a88b-440d6285b293 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:05.650477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f44ae8-a9ed-44bd-a88b-440d6285b293 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:05.652929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f44ae8-a9ed-44bd-a88b-440d6285b293 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:05.654330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f44ae8-a9ed-44bd-a88b-440d6285b293 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:05.655423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f44ae8-a9ed-44bd-a88b-440d6285b293 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:05.747575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-01634f87-bc54-4efd-8165-f90f40710401 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:05.774588 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-01634f87-bc54-4efd-8165-f90f40710401 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1291 microversion: 2.1 time: 0.705819 Aug 09 17:25:05.776223 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1753/3369] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:05 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1291 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:05.802725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9e0b4a2c-7e29-4c37-8709-d5657c7d349f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:05.805570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9e0b4a2c-7e29-4c37-8709-d5657c7d349f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:05.834324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0b4a2c-7e29-4c37-8709-d5657c7d349f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:05.835216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0b4a2c-7e29-4c37-8709-d5657c7d349f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:05.836341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0b4a2c-7e29-4c37-8709-d5657c7d349f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:05.841337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0b4a2c-7e29-4c37-8709-d5657c7d349f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:05.842202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0b4a2c-7e29-4c37-8709-d5657c7d349f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:05.843272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e0b4a2c-7e29-4c37-8709-d5657c7d349f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:05.955841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69f44ae8-a9ed-44bd-a88b-440d6285b293 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:05.976155 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69f44ae8-a9ed-44bd-a88b-440d6285b293 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1299 microversion: 2.1 time: 0.353365 Aug 09 17:25:05.981139 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1617/3370] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:05 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1299 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:05.996394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7f38a8c-046b-4872-b29b-f8d7c9df8dfe tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:05.997453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f7f38a8c-046b-4872-b29b-f8d7c9df8dfe tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:06.014763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7f38a8c-046b-4872-b29b-f8d7c9df8dfe tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:06.016108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7f38a8c-046b-4872-b29b-f8d7c9df8dfe tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:06.017418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7f38a8c-046b-4872-b29b-f8d7c9df8dfe tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:06.019211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7f38a8c-046b-4872-b29b-f8d7c9df8dfe tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:06.020128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7f38a8c-046b-4872-b29b-f8d7c9df8dfe tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:06.020749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7f38a8c-046b-4872-b29b-f8d7c9df8dfe tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:06.110208 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9e0b4a2c-7e29-4c37-8709-d5657c7d349f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "PUT /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1079 microversion: 2.1 time: 0.324408 Aug 09 17:25:06.123806 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1754/3371] 10.222.0.93 () {60 vars in 1256 bytes} [Tue Aug 9 17:25:05 2022] PUT /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1079 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:06.140146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-426751d5-f631-4a54-a14c-59559f076f77 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:06.141319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-426751d5-f631-4a54-a14c-59559f076f77 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:06.164114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-426751d5-f631-4a54-a14c-59559f076f77 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:06.165005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-426751d5-f631-4a54-a14c-59559f076f77 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:06.165798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-426751d5-f631-4a54-a14c-59559f076f77 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:06.168827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-426751d5-f631-4a54-a14c-59559f076f77 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:06.177890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-426751d5-f631-4a54-a14c-59559f076f77 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:06.178644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-426751d5-f631-4a54-a14c-59559f076f77 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:06.436882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-426751d5-f631-4a54-a14c-59559f076f77 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:06.456336 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-426751d5-f631-4a54-a14c-59559f076f77 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1316 microversion: 2.1 time: 0.330322 Aug 09 17:25:06.458605 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1755/3372] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:06 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:06.470089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-13532416-7099-4d51-b56f-79e2ce6b53c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:06.471660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-13532416-7099-4d51-b56f-79e2ce6b53c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:06.483693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13532416-7099-4d51-b56f-79e2ce6b53c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:06.484954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13532416-7099-4d51-b56f-79e2ce6b53c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:06.486073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13532416-7099-4d51-b56f-79e2ce6b53c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:06.487770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13532416-7099-4d51-b56f-79e2ce6b53c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:06.488933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13532416-7099-4d51-b56f-79e2ce6b53c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:06.490002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13532416-7099-4d51-b56f-79e2ce6b53c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:06.973897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13532416-7099-4d51-b56f-79e2ce6b53c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:06.990930 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-13532416-7099-4d51-b56f-79e2ce6b53c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1317 microversion: 2.1 time: 0.530046 Aug 09 17:25:06.992074 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1756/3373] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:06 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:07.013816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07e4bb79-3672-4332-ac4c-64f7b1e6b9bb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:07.014474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07e4bb79-3672-4332-ac4c-64f7b1e6b9bb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:07.026662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e4bb79-3672-4332-ac4c-64f7b1e6b9bb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:07.033416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e4bb79-3672-4332-ac4c-64f7b1e6b9bb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:07.034285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e4bb79-3672-4332-ac4c-64f7b1e6b9bb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:07.037012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e4bb79-3672-4332-ac4c-64f7b1e6b9bb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:07.039258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e4bb79-3672-4332-ac4c-64f7b1e6b9bb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:07.042345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e4bb79-3672-4332-ac4c-64f7b1e6b9bb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:07.169296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f7f38a8c-046b-4872-b29b-f8d7c9df8dfe tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:07.191607 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f7f38a8c-046b-4872-b29b-f8d7c9df8dfe tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1401 microversion: 2.1 time: 1.208809 Aug 09 17:25:07.196241 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1618/3374] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:05 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1401 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:07.227962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7946d4e4-7c45-4959-97c2-567942f83b76 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:07.229758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7946d4e4-7c45-4959-97c2-567942f83b76 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:07.257530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7946d4e4-7c45-4959-97c2-567942f83b76 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:07.258673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7946d4e4-7c45-4959-97c2-567942f83b76 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:07.259397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7946d4e4-7c45-4959-97c2-567942f83b76 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:07.262631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7946d4e4-7c45-4959-97c2-567942f83b76 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:07.264855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7946d4e4-7c45-4959-97c2-567942f83b76 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:07.265508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7946d4e4-7c45-4959-97c2-567942f83b76 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:07.311239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:07.844518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-07e4bb79-3672-4332-ac4c-64f7b1e6b9bb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:07.879832 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07e4bb79-3672-4332-ac4c-64f7b1e6b9bb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1505 microversion: 2.1 time: 0.882538 Aug 09 17:25:07.898509 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1757/3375] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:06 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1505 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:07.914366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c573de1a-ef02-44d1-a948-33fab7b7c22d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:07.914735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c573de1a-ef02-44d1-a948-33fab7b7c22d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:07.923056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c573de1a-ef02-44d1-a948-33fab7b7c22d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:07.923889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c573de1a-ef02-44d1-a948-33fab7b7c22d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:07.924689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c573de1a-ef02-44d1-a948-33fab7b7c22d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:07.925788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c573de1a-ef02-44d1-a948-33fab7b7c22d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:07.926458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c573de1a-ef02-44d1-a948-33fab7b7c22d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:07.927122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c573de1a-ef02-44d1-a948-33fab7b7c22d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:07.947407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7946d4e4-7c45-4959-97c2-567942f83b76 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:07.956010 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7946d4e4-7c45-4959-97c2-567942f83b76 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1291 microversion: 2.1 time: 0.757704 Aug 09 17:25:07.956626 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1619/3376] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:07 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1291 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:07.981674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d7e15ee6-d863-4f43-bb8a-9cfb3dd3c815 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:08.012182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d7e15ee6-d863-4f43-bb8a-9cfb3dd3c815 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:08.078824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7e15ee6-d863-4f43-bb8a-9cfb3dd3c815 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:08.084825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7e15ee6-d863-4f43-bb8a-9cfb3dd3c815 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:08.091866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7e15ee6-d863-4f43-bb8a-9cfb3dd3c815 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:08.095397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7e15ee6-d863-4f43-bb8a-9cfb3dd3c815 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:08.107889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7e15ee6-d863-4f43-bb8a-9cfb3dd3c815 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:08.110680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7e15ee6-d863-4f43-bb8a-9cfb3dd3c815 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:08.316602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d7e15ee6-d863-4f43-bb8a-9cfb3dd3c815 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:08.335667 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d7e15ee6-d863-4f43-bb8a-9cfb3dd3c815 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1304 microversion: 2.1 time: 0.357048 Aug 09 17:25:08.337481 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1620/3377] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:07 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1304 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:08.355051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-0cb3b6e6-173d-41bd-8ad2-07bdefea146b req-2faf78db-a2e7-48f3-9b40-59fc52e3712e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6836a3c0-24e0-4afb-ba44-bcbdf81c4f11", "name": "network-vif-plugged", "status": "completed", "tag": "0430a967-0c56-4428-9296-a392bcbd950f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:08.378404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0cb3b6e6-173d-41bd-8ad2-07bdefea146b req-2faf78db-a2e7-48f3-9b40-59fc52e3712e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:08.379457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0cb3b6e6-173d-41bd-8ad2-07bdefea146b req-2faf78db-a2e7-48f3-9b40-59fc52e3712e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:08.380129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0cb3b6e6-173d-41bd-8ad2-07bdefea146b req-2faf78db-a2e7-48f3-9b40-59fc52e3712e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:08.403587 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-0cb3b6e6-173d-41bd-8ad2-07bdefea146b req-2faf78db-a2e7-48f3-9b40-59fc52e3712e service nova] Creating event network-vif-plugged:0430a967-0c56-4428-9296-a392bcbd950f for instance 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 on n-h2-845781-6 Aug 09 17:25:08.422196 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-0cb3b6e6-173d-41bd-8ad2-07bdefea146b req-2faf78db-a2e7-48f3-9b40-59fc52e3712e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080858 Aug 09 17:25:08.426184 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1621/3378] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:08.468230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-05719ac7-a694-40c7-bf7b-f994f2b1ad26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:08.475097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-05719ac7-a694-40c7-bf7b-f994f2b1ad26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:08.496084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05719ac7-a694-40c7-bf7b-f994f2b1ad26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:08.497463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05719ac7-a694-40c7-bf7b-f994f2b1ad26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:08.498210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05719ac7-a694-40c7-bf7b-f994f2b1ad26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:08.499216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05719ac7-a694-40c7-bf7b-f994f2b1ad26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:08.499984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05719ac7-a694-40c7-bf7b-f994f2b1ad26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:08.500655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05719ac7-a694-40c7-bf7b-f994f2b1ad26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:09.031570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c573de1a-ef02-44d1-a948-33fab7b7c22d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:09.047860 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c573de1a-ef02-44d1-a948-33fab7b7c22d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1367 microversion: 2.1 time: 1.147835 Aug 09 17:25:09.064007 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1758/3379] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:07 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1367 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:09.064007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a11d869b-7ed3-420b-a1ca-5dfb290bb35d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:09.064007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a11d869b-7ed3-420b-a1ca-5dfb290bb35d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:09.075244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11d869b-7ed3-420b-a1ca-5dfb290bb35d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:09.076194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11d869b-7ed3-420b-a1ca-5dfb290bb35d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:09.076861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11d869b-7ed3-420b-a1ca-5dfb290bb35d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:09.077862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11d869b-7ed3-420b-a1ca-5dfb290bb35d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:09.080396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11d869b-7ed3-420b-a1ca-5dfb290bb35d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:09.081194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a11d869b-7ed3-420b-a1ca-5dfb290bb35d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:09.269336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-05719ac7-a694-40c7-bf7b-f994f2b1ad26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:09.287479 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-05719ac7-a694-40c7-bf7b-f994f2b1ad26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1505 microversion: 2.1 time: 0.842886 Aug 09 17:25:09.292056 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1622/3380] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:08 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1505 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:09.345733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-52a25282-38ce-4dee-a63d-ca970fd39389 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:09.358306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-52a25282-38ce-4dee-a63d-ca970fd39389 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:09.392479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52a25282-38ce-4dee-a63d-ca970fd39389 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:09.395321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52a25282-38ce-4dee-a63d-ca970fd39389 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:09.398520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52a25282-38ce-4dee-a63d-ca970fd39389 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:09.422988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52a25282-38ce-4dee-a63d-ca970fd39389 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:09.429597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52a25282-38ce-4dee-a63d-ca970fd39389 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:09.436414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52a25282-38ce-4dee-a63d-ca970fd39389 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:09.890422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a11d869b-7ed3-420b-a1ca-5dfb290bb35d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:09.902816 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a11d869b-7ed3-420b-a1ca-5dfb290bb35d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1317 microversion: 2.1 time: 0.852790 Aug 09 17:25:09.903820 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1759/3381] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:09 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:09.919872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29ff70d8-862d-4623-b6b3-1df1ffe7a16d tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:09.920515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-29ff70d8-862d-4623-b6b3-1df1ffe7a16d tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:09.950681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:09.960696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29ff70d8-862d-4623-b6b3-1df1ffe7a16d tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:09.961623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29ff70d8-862d-4623-b6b3-1df1ffe7a16d tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:09.962430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29ff70d8-862d-4623-b6b3-1df1ffe7a16d tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:09.964158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29ff70d8-862d-4623-b6b3-1df1ffe7a16d tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:09.965015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29ff70d8-862d-4623-b6b3-1df1ffe7a16d tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:09.965684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29ff70d8-862d-4623-b6b3-1df1ffe7a16d tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:10.314762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-52a25282-38ce-4dee-a63d-ca970fd39389 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:10.333506 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-52a25282-38ce-4dee-a63d-ca970fd39389 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1401 microversion: 2.1 time: 1.023540 Aug 09 17:25:10.353094 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1623/3382] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:09 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1401 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:10.358902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:10.362174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:10.387805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:10.388321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:10.388776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:10.389527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:10.390166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:10.390513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:10.527886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-29ff70d8-862d-4623-b6b3-1df1ffe7a16d tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:10.585943 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-29ff70d8-862d-4623-b6b3-1df1ffe7a16d tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1483 microversion: 2.1 time: 0.662545 Aug 09 17:25:10.587120 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1760/3383] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:09 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1483 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:10.606726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0829fea0-c7e9-4f71-9013-32630444d8c3 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:10.610525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0829fea0-c7e9-4f71-9013-32630444d8c3 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:10.629908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0829fea0-c7e9-4f71-9013-32630444d8c3 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:10.630447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0829fea0-c7e9-4f71-9013-32630444d8c3 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:10.631168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0829fea0-c7e9-4f71-9013-32630444d8c3 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:10.631961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0829fea0-c7e9-4f71-9013-32630444d8c3 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:10.632616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0829fea0-c7e9-4f71-9013-32630444d8c3 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:10.633066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0829fea0-c7e9-4f71-9013-32630444d8c3 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:10.687731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:25:10.688844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:25:10.690056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:25:10.691671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:25:10.705342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:25:10.995510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:11.016397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:11.053528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:11.065028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:11.066209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:11.083590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:11.085009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:11.086105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:11.351301 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5157a7d9-27bd-472f-a558-f124de615dbb tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "POST /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498/action" status: 202 len: 1111 microversion: 2.1 time: 0.995425 Aug 09 17:25:11.383058 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1624/3384] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:25:10 2022] POST /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498/action => generated 1111 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 09 17:25:11.424140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-530d767e-6ee3-4058-a24b-b1e71d69034f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:11.427325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-530d767e-6ee3-4058-a24b-b1e71d69034f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:11.478602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-530d767e-6ee3-4058-a24b-b1e71d69034f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:11.480063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-530d767e-6ee3-4058-a24b-b1e71d69034f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:11.486177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-530d767e-6ee3-4058-a24b-b1e71d69034f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:11.490549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-530d767e-6ee3-4058-a24b-b1e71d69034f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:11.495375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-530d767e-6ee3-4058-a24b-b1e71d69034f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:11.496587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-530d767e-6ee3-4058-a24b-b1e71d69034f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:11.779423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:12.297443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0829fea0-c7e9-4f71-9013-32630444d8c3 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:12.327678 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0829fea0-c7e9-4f71-9013-32630444d8c3 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1372 microversion: 2.1 time: 1.735074 Aug 09 17:25:12.331313 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1761/3385] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:10 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1372 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:12.357871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-174f27e5-aef2-4859-8381-18b08a393291 req-a2401a18-0060-41d2-b4ad-d3410f0740cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c06398-1bb3-44b1-bc17-4db4dfd8294c", "name": "network-vif-plugged", "status": "completed", "tag": "865d93b0-2885-4c2c-897e-3f6c724b9391"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:12.405086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-174f27e5-aef2-4859-8381-18b08a393291 req-a2401a18-0060-41d2-b4ad-d3410f0740cf service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:12.405970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-174f27e5-aef2-4859-8381-18b08a393291 req-a2401a18-0060-41d2-b4ad-d3410f0740cf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:12.408113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-174f27e5-aef2-4859-8381-18b08a393291 req-a2401a18-0060-41d2-b4ad-d3410f0740cf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:12.444869 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-174f27e5-aef2-4859-8381-18b08a393291 req-a2401a18-0060-41d2-b4ad-d3410f0740cf service nova] Creating event network-vif-plugged:865d93b0-2885-4c2c-897e-3f6c724b9391 for instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c on n-h1-845781-6 Aug 09 17:25:12.459038 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-174f27e5-aef2-4859-8381-18b08a393291 req-a2401a18-0060-41d2-b4ad-d3410f0740cf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124709 Aug 09 17:25:12.461200 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1762/3386] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:12.516939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ff870c45-c6e3-4778-8e70-f6b8dfec1afd tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:12.522790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ff870c45-c6e3-4778-8e70-f6b8dfec1afd tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:12.544097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff870c45-c6e3-4778-8e70-f6b8dfec1afd tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:12.545559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff870c45-c6e3-4778-8e70-f6b8dfec1afd tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:12.546891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff870c45-c6e3-4778-8e70-f6b8dfec1afd tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:12.548635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff870c45-c6e3-4778-8e70-f6b8dfec1afd tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:12.549845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff870c45-c6e3-4778-8e70-f6b8dfec1afd tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:12.551059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff870c45-c6e3-4778-8e70-f6b8dfec1afd tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:12.708427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-530d767e-6ee3-4058-a24b-b1e71d69034f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:12.732628 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-530d767e-6ee3-4058-a24b-b1e71d69034f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1367 microversion: 2.1 time: 1.341450 Aug 09 17:25:12.748155 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1625/3387] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:11 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1367 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:12.771425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-852b42a3-edf5-4ee4-94f0-c1faa5c4e5a6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:12.773209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-852b42a3-edf5-4ee4-94f0-c1faa5c4e5a6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:12.799187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852b42a3-edf5-4ee4-94f0-c1faa5c4e5a6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:12.800125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852b42a3-edf5-4ee4-94f0-c1faa5c4e5a6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:12.806222 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ff870c45-c6e3-4778-8e70-f6b8dfec1afd tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.342907 Aug 09 17:25:12.808478 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1763/3388] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:25:12 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c/os-interface => generated 285 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:12.811894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852b42a3-edf5-4ee4-94f0-c1faa5c4e5a6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:12.813443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852b42a3-edf5-4ee4-94f0-c1faa5c4e5a6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:12.814343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852b42a3-edf5-4ee4-94f0-c1faa5c4e5a6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:12.815097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852b42a3-edf5-4ee4-94f0-c1faa5c4e5a6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:12.818485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c2f1a275-39f8-4d43-b159-f7f260ae2817 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:12.819838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c2f1a275-39f8-4d43-b159-f7f260ae2817 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:12.851257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2f1a275-39f8-4d43-b159-f7f260ae2817 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:12.852218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2f1a275-39f8-4d43-b159-f7f260ae2817 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:12.853009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2f1a275-39f8-4d43-b159-f7f260ae2817 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:12.854832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2f1a275-39f8-4d43-b159-f7f260ae2817 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:12.855734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2f1a275-39f8-4d43-b159-f7f260ae2817 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:12.856477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2f1a275-39f8-4d43-b159-f7f260ae2817 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:13.249942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c2f1a275-39f8-4d43-b159-f7f260ae2817 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:13.265738 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c2f1a275-39f8-4d43-b159-f7f260ae2817 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1589 microversion: 2.1 time: 0.455120 Aug 09 17:25:13.267049 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1764/3389] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:12 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1589 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:13.301153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aed67748-abe2-492a-bc5d-a108510208c8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:13.303536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aed67748-abe2-492a-bc5d-a108510208c8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:13.305628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:13.316402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed67748-abe2-492a-bc5d-a108510208c8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:13.317681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed67748-abe2-492a-bc5d-a108510208c8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:13.318419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed67748-abe2-492a-bc5d-a108510208c8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:13.319725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed67748-abe2-492a-bc5d-a108510208c8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:13.320834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed67748-abe2-492a-bc5d-a108510208c8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:13.321895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aed67748-abe2-492a-bc5d-a108510208c8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:13.401958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:13.592657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aed67748-abe2-492a-bc5d-a108510208c8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:13.612609 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aed67748-abe2-492a-bc5d-a108510208c8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 0.325898 Aug 09 17:25:13.614800 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1765/3390] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:13 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:13.635660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-97f8baa2-1dce-468a-8e5f-16bec4f3427d req-679a9a6d-5cbb-467f-80b3-08dd464a4241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d735cc-f758-4a9a-aff1-4831ccbeaf3e", "tag": "6d37a94b-6553-49ea-a0dc-ea5d53ef5fa5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:13.649077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97f8baa2-1dce-468a-8e5f-16bec4f3427d req-679a9a6d-5cbb-467f-80b3-08dd464a4241 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:13.649946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97f8baa2-1dce-468a-8e5f-16bec4f3427d req-679a9a6d-5cbb-467f-80b3-08dd464a4241 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:13.650756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97f8baa2-1dce-468a-8e5f-16bec4f3427d req-679a9a6d-5cbb-467f-80b3-08dd464a4241 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:13.672445 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-97f8baa2-1dce-468a-8e5f-16bec4f3427d req-679a9a6d-5cbb-467f-80b3-08dd464a4241 service nova] Creating event network-changed:6d37a94b-6553-49ea-a0dc-ea5d53ef5fa5 for instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e on n-h1-845781-6 Aug 09 17:25:13.680315 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-97f8baa2-1dce-468a-8e5f-16bec4f3427d req-679a9a6d-5cbb-467f-80b3-08dd464a4241 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063349 Aug 09 17:25:13.686486 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1766/3391] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:13.696311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ab3685b8-45d1-4c95-8e06-16e98370138b tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:13.697371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ab3685b8-45d1-4c95-8e06-16e98370138b tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:13.709029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab3685b8-45d1-4c95-8e06-16e98370138b tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:13.709881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab3685b8-45d1-4c95-8e06-16e98370138b tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:13.710658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab3685b8-45d1-4c95-8e06-16e98370138b tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:13.711977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab3685b8-45d1-4c95-8e06-16e98370138b tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:13.712846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab3685b8-45d1-4c95-8e06-16e98370138b tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:13.713607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab3685b8-45d1-4c95-8e06-16e98370138b tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:13.853599 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ab3685b8-45d1-4c95-8e06-16e98370138b tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165088 Aug 09 17:25:13.862395 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1767/3392] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:25:13 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11/os-interface => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:13.880805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-344c2229-4792-49cc-9582-e18f20172b97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:13.882053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-344c2229-4792-49cc-9582-e18f20172b97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:13.893092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-344c2229-4792-49cc-9582-e18f20172b97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:13.894027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-344c2229-4792-49cc-9582-e18f20172b97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:13.894780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-344c2229-4792-49cc-9582-e18f20172b97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:13.896674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-344c2229-4792-49cc-9582-e18f20172b97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:13.897771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-344c2229-4792-49cc-9582-e18f20172b97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:13.898709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-344c2229-4792-49cc-9582-e18f20172b97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:14.228418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-852b42a3-edf5-4ee4-94f0-c1faa5c4e5a6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:14.263515 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-852b42a3-edf5-4ee4-94f0-c1faa5c4e5a6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1317 microversion: 2.1 time: 1.513077 Aug 09 17:25:14.265729 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1626/3393] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:12 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1317 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:14.283219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2b6a748a-f4e5-41a4-9429-701969692fc5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:14.284724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2b6a748a-f4e5-41a4-9429-701969692fc5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:14.309364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b6a748a-f4e5-41a4-9429-701969692fc5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:14.311718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b6a748a-f4e5-41a4-9429-701969692fc5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:14.313279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b6a748a-f4e5-41a4-9429-701969692fc5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:14.318470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b6a748a-f4e5-41a4-9429-701969692fc5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:14.321512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b6a748a-f4e5-41a4-9429-701969692fc5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:14.322931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b6a748a-f4e5-41a4-9429-701969692fc5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:14.438083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-344c2229-4792-49cc-9582-e18f20172b97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:14.458486 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-344c2229-4792-49cc-9582-e18f20172b97 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1372 microversion: 2.1 time: 0.592938 Aug 09 17:25:14.488019 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1768/3394] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:13 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1372 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:14.657979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-54dc2647-3b1a-4aed-833b-35d3abbc39c3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:14.658401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-54dc2647-3b1a-4aed-833b-35d3abbc39c3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:14.692788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54dc2647-3b1a-4aed-833b-35d3abbc39c3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:14.693716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54dc2647-3b1a-4aed-833b-35d3abbc39c3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:14.694501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54dc2647-3b1a-4aed-833b-35d3abbc39c3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:14.695823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54dc2647-3b1a-4aed-833b-35d3abbc39c3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:14.697444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54dc2647-3b1a-4aed-833b-35d3abbc39c3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:14.699482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54dc2647-3b1a-4aed-833b-35d3abbc39c3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:14.817067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=7 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:15.333480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-54dc2647-3b1a-4aed-833b-35d3abbc39c3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:15.357405 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-54dc2647-3b1a-4aed-833b-35d3abbc39c3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 0.706858 Aug 09 17:25:15.361102 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1769/3395] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:14 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:15.373967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b6a748a-f4e5-41a4-9429-701969692fc5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:15.383548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07eddfd2-c208-496a-bd67-e5f1acf26868 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:15.384400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07eddfd2-c208-496a-bd67-e5f1acf26868 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:15.393953 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2b6a748a-f4e5-41a4-9429-701969692fc5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1367 microversion: 2.1 time: 1.125312 Aug 09 17:25:15.396117 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1627/3396] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:14 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1367 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:15.414285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07eddfd2-c208-496a-bd67-e5f1acf26868 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:15.415129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07eddfd2-c208-496a-bd67-e5f1acf26868 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:15.416348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07eddfd2-c208-496a-bd67-e5f1acf26868 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:15.422159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07eddfd2-c208-496a-bd67-e5f1acf26868 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:15.423182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07eddfd2-c208-496a-bd67-e5f1acf26868 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:15.423872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07eddfd2-c208-496a-bd67-e5f1acf26868 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:15.504673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-302eafce-182a-461d-8b68-95ae1914b151 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:15.509020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-302eafce-182a-461d-8b68-95ae1914b151 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:15.547256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-302eafce-182a-461d-8b68-95ae1914b151 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:15.548805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-302eafce-182a-461d-8b68-95ae1914b151 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:15.550046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-302eafce-182a-461d-8b68-95ae1914b151 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:15.551850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-302eafce-182a-461d-8b68-95ae1914b151 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:15.553805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-302eafce-182a-461d-8b68-95ae1914b151 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:15.555072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-302eafce-182a-461d-8b68-95ae1914b151 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:15.788027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-07eddfd2-c208-496a-bd67-e5f1acf26868 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:15.798476 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07eddfd2-c208-496a-bd67-e5f1acf26868 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1317 microversion: 2.1 time: 0.436058 Aug 09 17:25:15.813809 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1770/3397] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:15 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:15.819758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-88f2c53c-95f1-4ddf-a37f-eac8c0453412 req-56a45bd2-9ba4-4c9c-b530-cd704e3e1934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b4377c-cf52-4f83-8923-b86f8bdfff08", "tag": "a797759a-bc26-46ce-954a-7c9861e667d9"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:15.832283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-88f2c53c-95f1-4ddf-a37f-eac8c0453412 req-56a45bd2-9ba4-4c9c-b530-cd704e3e1934 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:15.833273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-88f2c53c-95f1-4ddf-a37f-eac8c0453412 req-56a45bd2-9ba4-4c9c-b530-cd704e3e1934 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:15.835048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-88f2c53c-95f1-4ddf-a37f-eac8c0453412 req-56a45bd2-9ba4-4c9c-b530-cd704e3e1934 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:15.850077 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-88f2c53c-95f1-4ddf-a37f-eac8c0453412 req-56a45bd2-9ba4-4c9c-b530-cd704e3e1934 service nova] Creating event network-changed:a797759a-bc26-46ce-954a-7c9861e667d9 for instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 on n-h2-845781-6 Aug 09 17:25:15.860431 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-88f2c53c-95f1-4ddf-a37f-eac8c0453412 req-56a45bd2-9ba4-4c9c-b530-cd704e3e1934 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041957 Aug 09 17:25:15.863205 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1771/3398] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:16.279740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-302eafce-182a-461d-8b68-95ae1914b151 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:16.297231 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-302eafce-182a-461d-8b68-95ae1914b151 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1372 microversion: 2.1 time: 0.802812 Aug 09 17:25:16.303102 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1628/3399] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:15 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1372 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:16.413059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-16e0719b-2a26-4aa6-8349-9e15abc4a3b2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:16.417674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-16e0719b-2a26-4aa6-8349-9e15abc4a3b2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:16.422047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fad21e3e-d82e-45e3-a345-009b4cdd1426 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:16.427453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fad21e3e-d82e-45e3-a345-009b4cdd1426 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:16.445161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16e0719b-2a26-4aa6-8349-9e15abc4a3b2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:16.446127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16e0719b-2a26-4aa6-8349-9e15abc4a3b2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:16.448180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16e0719b-2a26-4aa6-8349-9e15abc4a3b2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:16.449958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16e0719b-2a26-4aa6-8349-9e15abc4a3b2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:16.451390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16e0719b-2a26-4aa6-8349-9e15abc4a3b2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:16.453544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16e0719b-2a26-4aa6-8349-9e15abc4a3b2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:16.454468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fad21e3e-d82e-45e3-a345-009b4cdd1426 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:16.459131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fad21e3e-d82e-45e3-a345-009b4cdd1426 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:16.460591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fad21e3e-d82e-45e3-a345-009b4cdd1426 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:16.464063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fad21e3e-d82e-45e3-a345-009b4cdd1426 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:16.470270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fad21e3e-d82e-45e3-a345-009b4cdd1426 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:16.471580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fad21e3e-d82e-45e3-a345-009b4cdd1426 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:17.397231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16e0719b-2a26-4aa6-8349-9e15abc4a3b2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:17.431877 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-16e0719b-2a26-4aa6-8349-9e15abc4a3b2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 1.034088 Aug 09 17:25:17.433239 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1772/3400] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:16 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:17.472016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3006a251-ce89-4b0e-b8ec-2e97e3c90a27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:17.473607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3006a251-ce89-4b0e-b8ec-2e97e3c90a27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:17.490471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3006a251-ce89-4b0e-b8ec-2e97e3c90a27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:17.491906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3006a251-ce89-4b0e-b8ec-2e97e3c90a27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:17.493164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3006a251-ce89-4b0e-b8ec-2e97e3c90a27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:17.496720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3006a251-ce89-4b0e-b8ec-2e97e3c90a27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:17.498148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3006a251-ce89-4b0e-b8ec-2e97e3c90a27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:17.509161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3006a251-ce89-4b0e-b8ec-2e97e3c90a27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:17.707900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fad21e3e-d82e-45e3-a345-009b4cdd1426 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:17.744603 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fad21e3e-d82e-45e3-a345-009b4cdd1426 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1367 microversion: 2.1 time: 1.327795 Aug 09 17:25:17.749342 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1629/3401] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:16 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1367 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:17.773705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9f8047d-3572-407a-bb01-ad1a2ad2e0f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:17.774902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9f8047d-3572-407a-bb01-ad1a2ad2e0f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:17.785088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9f8047d-3572-407a-bb01-ad1a2ad2e0f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:17.787087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9f8047d-3572-407a-bb01-ad1a2ad2e0f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:17.787087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9f8047d-3572-407a-bb01-ad1a2ad2e0f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:17.788466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9f8047d-3572-407a-bb01-ad1a2ad2e0f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:17.789582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9f8047d-3572-407a-bb01-ad1a2ad2e0f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:17.791398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9f8047d-3572-407a-bb01-ad1a2ad2e0f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:18.074204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3006a251-ce89-4b0e-b8ec-2e97e3c90a27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:18.096274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3006a251-ce89-4b0e-b8ec-2e97e3c90a27 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1506 microversion: 2.1 time: 0.643405 Aug 09 17:25:18.107887 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1773/3402] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:17 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1506 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:18.142030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-077f536d-7943-49eb-a83b-f71d89f82ce3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:18.142861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-077f536d-7943-49eb-a83b-f71d89f82ce3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:18.185391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-077f536d-7943-49eb-a83b-f71d89f82ce3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:18.186308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-077f536d-7943-49eb-a83b-f71d89f82ce3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:18.189433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-077f536d-7943-49eb-a83b-f71d89f82ce3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:18.192153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-077f536d-7943-49eb-a83b-f71d89f82ce3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:18.193037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-077f536d-7943-49eb-a83b-f71d89f82ce3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:18.193795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-077f536d-7943-49eb-a83b-f71d89f82ce3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:18.310997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-077f536d-7943-49eb-a83b-f71d89f82ce3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:25:18.597535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d9f8047d-3572-407a-bb01-ad1a2ad2e0f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:18.626819 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9f8047d-3572-407a-bb01-ad1a2ad2e0f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1372 microversion: 2.1 time: 0.871377 Aug 09 17:25:18.627782 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1630/3403] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:17 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1372 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:18.654032 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-077f536d-7943-49eb-a83b-f71d89f82ce3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "DELETE /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 204 len: 0 microversion: 2.1 time: 0.521148 Aug 09 17:25:18.658603 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1774/3404] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:25:18 2022] DELETE /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:25:18.674923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc1b092e-77ac-4fee-9837-4bc060ea487d tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:18.676800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cc1b092e-77ac-4fee-9837-4bc060ea487d tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:18.680231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5c74a919-9426-4c30-97eb-c28ad6577fcb req-2627c682-8250-4026-832d-b80a36908167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6836a3c0-24e0-4afb-ba44-bcbdf81c4f11", "tag": "0430a967-0c56-4428-9296-a392bcbd950f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:18.714133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc1b092e-77ac-4fee-9837-4bc060ea487d tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:18.715040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5c74a919-9426-4c30-97eb-c28ad6577fcb req-2627c682-8250-4026-832d-b80a36908167 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:18.715404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5c74a919-9426-4c30-97eb-c28ad6577fcb req-2627c682-8250-4026-832d-b80a36908167 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:18.716540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5c74a919-9426-4c30-97eb-c28ad6577fcb req-2627c682-8250-4026-832d-b80a36908167 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:18.727260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc1b092e-77ac-4fee-9837-4bc060ea487d tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:18.728337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc1b092e-77ac-4fee-9837-4bc060ea487d tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:18.729683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc1b092e-77ac-4fee-9837-4bc060ea487d tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:18.730559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc1b092e-77ac-4fee-9837-4bc060ea487d tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:18.731351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc1b092e-77ac-4fee-9837-4bc060ea487d tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:18.741342 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5c74a919-9426-4c30-97eb-c28ad6577fcb req-2627c682-8250-4026-832d-b80a36908167 service nova] Creating event network-changed:0430a967-0c56-4428-9296-a392bcbd950f for instance 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 on n-h2-845781-6 Aug 09 17:25:18.752145 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5c74a919-9426-4c30-97eb-c28ad6577fcb req-2627c682-8250-4026-832d-b80a36908167 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090753 Aug 09 17:25:18.758012 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1775/3405] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:18.781600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-278f7bd6-9e51-4db5-9a5c-c083fb686cd0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:18.783276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-278f7bd6-9e51-4db5-9a5c-c083fb686cd0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:18.812061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-278f7bd6-9e51-4db5-9a5c-c083fb686cd0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:18.813370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-278f7bd6-9e51-4db5-9a5c-c083fb686cd0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:18.814425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-278f7bd6-9e51-4db5-9a5c-c083fb686cd0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:18.815982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-278f7bd6-9e51-4db5-9a5c-c083fb686cd0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:18.817145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-278f7bd6-9e51-4db5-9a5c-c083fb686cd0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:18.818208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-278f7bd6-9e51-4db5-9a5c-c083fb686cd0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:19.793296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-278f7bd6-9e51-4db5-9a5c-c083fb686cd0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:19.814128 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-278f7bd6-9e51-4db5-9a5c-c083fb686cd0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1483 microversion: 2.1 time: 1.054047 Aug 09 17:25:19.816368 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1776/3406] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:18 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1483 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:19.823370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b31d8dc-b5b7-4788-962c-e9890c309290 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:19.824640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b31d8dc-b5b7-4788-962c-e9890c309290 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:19.833720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b31d8dc-b5b7-4788-962c-e9890c309290 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:19.838701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b31d8dc-b5b7-4788-962c-e9890c309290 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:19.840542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b31d8dc-b5b7-4788-962c-e9890c309290 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:19.842763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b31d8dc-b5b7-4788-962c-e9890c309290 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:19.844893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b31d8dc-b5b7-4788-962c-e9890c309290 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:19.849534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b31d8dc-b5b7-4788-962c-e9890c309290 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:19.946704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cc1b092e-77ac-4fee-9837-4bc060ea487d tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:19.994630 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cc1b092e-77ac-4fee-9837-4bc060ea487d tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1589 microversion: 2.1 time: 1.335878 Aug 09 17:25:19.996265 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1631/3407] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:18 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1589 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:20.021687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-b5aecedf-15a2-4765-acb2-583dc474ee3b req-8ce89925-6e73-4143-a639-a31cce6e6ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "386101c4-2bef-4f17-86d6-e70ca4d09f4c", "tag": "2d1a3f9a-b942-4480-8909-0e4cbb3f802f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:20.077473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b5aecedf-15a2-4765-acb2-583dc474ee3b req-8ce89925-6e73-4143-a639-a31cce6e6ac6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:20.090246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b5aecedf-15a2-4765-acb2-583dc474ee3b req-8ce89925-6e73-4143-a639-a31cce6e6ac6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:20.091522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b5aecedf-15a2-4765-acb2-583dc474ee3b req-8ce89925-6e73-4143-a639-a31cce6e6ac6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:20.135821 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-b5aecedf-15a2-4765-acb2-583dc474ee3b req-8ce89925-6e73-4143-a639-a31cce6e6ac6 service nova] Creating event network-changed:2d1a3f9a-b942-4480-8909-0e4cbb3f802f for instance 386101c4-2bef-4f17-86d6-e70ca4d09f4c on n-h1-845781-6 Aug 09 17:25:20.156942 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-b5aecedf-15a2-4765-acb2-583dc474ee3b req-8ce89925-6e73-4143-a639-a31cce6e6ac6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149841 Aug 09 17:25:20.158405 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1632/3408] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:20.205116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8591b389-aef4-48cf-8829-77fb2fb589a3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:20.214783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8591b389-aef4-48cf-8829-77fb2fb589a3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:20.247202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8591b389-aef4-48cf-8829-77fb2fb589a3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:20.257386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8591b389-aef4-48cf-8829-77fb2fb589a3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:20.259221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8591b389-aef4-48cf-8829-77fb2fb589a3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:20.265478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8591b389-aef4-48cf-8829-77fb2fb589a3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:20.267579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8591b389-aef4-48cf-8829-77fb2fb589a3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:20.273918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8591b389-aef4-48cf-8829-77fb2fb589a3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:21.574262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8b31d8dc-b5b7-4788-962c-e9890c309290 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:21.616508 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b31d8dc-b5b7-4788-962c-e9890c309290 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 1.796903 Aug 09 17:25:21.642131 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1777/3409] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:19 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:21.654320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8591b389-aef4-48cf-8829-77fb2fb589a3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:21.669464 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8591b389-aef4-48cf-8829-77fb2fb589a3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 200 len: 1512 microversion: 2.1 time: 1.508954 Aug 09 17:25:21.675121 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1633/3410] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:20 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 1512 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:21.678245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-adda3b9f-7379-4bb0-a158-49a514ba3190 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:21.679851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-adda3b9f-7379-4bb0-a158-49a514ba3190 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:21.700799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-09290162-afb9-4a64-a9f3-c2aaa8bb095d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:21.701964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-09290162-afb9-4a64-a9f3-c2aaa8bb095d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:21.711076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adda3b9f-7379-4bb0-a158-49a514ba3190 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:21.711947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adda3b9f-7379-4bb0-a158-49a514ba3190 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:21.713296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adda3b9f-7379-4bb0-a158-49a514ba3190 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:21.714625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adda3b9f-7379-4bb0-a158-49a514ba3190 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:21.715486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adda3b9f-7379-4bb0-a158-49a514ba3190 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:21.725118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09290162-afb9-4a64-a9f3-c2aaa8bb095d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:21.725999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09290162-afb9-4a64-a9f3-c2aaa8bb095d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:21.726655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09290162-afb9-4a64-a9f3-c2aaa8bb095d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:21.728121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09290162-afb9-4a64-a9f3-c2aaa8bb095d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:21.729275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09290162-afb9-4a64-a9f3-c2aaa8bb095d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:21.729885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09290162-afb9-4a64-a9f3-c2aaa8bb095d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:21.736491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adda3b9f-7379-4bb0-a158-49a514ba3190 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:22.808731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-09290162-afb9-4a64-a9f3-c2aaa8bb095d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:22.825398 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-09290162-afb9-4a64-a9f3-c2aaa8bb095d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1372 microversion: 2.1 time: 1.144233 Aug 09 17:25:22.857311 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1634/3411] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:21 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1372 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:22.898957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69d43ae0-468e-45ad-9fef-a8f1c94818f0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:22.901006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-69d43ae0-468e-45ad-9fef-a8f1c94818f0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:22.947433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d43ae0-468e-45ad-9fef-a8f1c94818f0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:22.949081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d43ae0-468e-45ad-9fef-a8f1c94818f0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:22.951588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d43ae0-468e-45ad-9fef-a8f1c94818f0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:22.955007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d43ae0-468e-45ad-9fef-a8f1c94818f0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:22.956715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d43ae0-468e-45ad-9fef-a8f1c94818f0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:22.967727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69d43ae0-468e-45ad-9fef-a8f1c94818f0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:23.076033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:23.498270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-adda3b9f-7379-4bb0-a158-49a514ba3190 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:23.532643 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-adda3b9f-7379-4bb0-a158-49a514ba3190 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1367 microversion: 2.1 time: 1.888828 Aug 09 17:25:23.538484 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1778/3412] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:21 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1367 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:23.571143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d6085586-b430-4748-95f4-14a177c96045 req-bc53961e-4248-455a-a11e-67462b5ff8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c06398-1bb3-44b1-bc17-4db4dfd8294c", "name": "network-vif-deleted", "tag": "865d93b0-2885-4c2c-897e-3f6c724b9391"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:23.618468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d6085586-b430-4748-95f4-14a177c96045 req-bc53961e-4248-455a-a11e-67462b5ff8df service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:23.628290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d6085586-b430-4748-95f4-14a177c96045 req-bc53961e-4248-455a-a11e-67462b5ff8df service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:23.646419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d6085586-b430-4748-95f4-14a177c96045 req-bc53961e-4248-455a-a11e-67462b5ff8df service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:23.658870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69d43ae0-468e-45ad-9fef-a8f1c94818f0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:23.675324 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69d43ae0-468e-45ad-9fef-a8f1c94818f0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 0.812404 Aug 09 17:25:23.676818 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1635/3413] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:22 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:23.685776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:23.686723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:23.705119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:23.710309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:23.711071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:23.712042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:23.713267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:23.716442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:23.723179 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d6085586-b430-4748-95f4-14a177c96045 req-bc53961e-4248-455a-a11e-67462b5ff8df service nova] Creating event network-vif-deleted:865d93b0-2885-4c2c-897e-3f6c724b9391 for instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c on n-h1-845781-6 Aug 09 17:25:23.738885 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d6085586-b430-4748-95f4-14a177c96045 req-bc53961e-4248-455a-a11e-67462b5ff8df service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193728 Aug 09 17:25:23.742865 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1779/3414] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:23.750192 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c HTTP/1.1 Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '77c06398-1bb3-44b1-bc17-4db4dfd8294c'} Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:23.752292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:23.757223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:23.757223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:23.757223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:23.757223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:23.757223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:23.757223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:25:23.757223 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:23.757761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1f71ce2e-0968-433a-89c3-ef01123a8e04 req-617a0e96-8ebf-4b24-8af7-29ca5dd9e6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d735cc-f758-4a9a-aff1-4831ccbeaf3e", "name": "network-vif-plugged", "status": "completed", "tag": "6d37a94b-6553-49ea-a0dc-ea5d53ef5fa5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:23.770280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:23.774040 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d278ce00-45eb-4370-bd35-12a5423e5e7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 404 len: 111 microversion: 2.1 time: 0.095859 Aug 09 17:25:23.785530 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1636/3415] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:23 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:25:23.788123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1f71ce2e-0968-433a-89c3-ef01123a8e04 req-617a0e96-8ebf-4b24-8af7-29ca5dd9e6a9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:23.792931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6a2c64c0-9edb-4d7a-90c3-369085e1ca34 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:23.793831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1f71ce2e-0968-433a-89c3-ef01123a8e04 req-617a0e96-8ebf-4b24-8af7-29ca5dd9e6a9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:23.794419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1f71ce2e-0968-433a-89c3-ef01123a8e04 req-617a0e96-8ebf-4b24-8af7-29ca5dd9e6a9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:23.797747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6a2c64c0-9edb-4d7a-90c3-369085e1ca34 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:23.817302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a2c64c0-9edb-4d7a-90c3-369085e1ca34 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:23.819456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a2c64c0-9edb-4d7a-90c3-369085e1ca34 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:23.819720 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1f71ce2e-0968-433a-89c3-ef01123a8e04 req-617a0e96-8ebf-4b24-8af7-29ca5dd9e6a9 service nova] Creating event network-vif-plugged:6d37a94b-6553-49ea-a0dc-ea5d53ef5fa5 for instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e on n-h1-845781-6 Aug 09 17:25:23.823591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a2c64c0-9edb-4d7a-90c3-369085e1ca34 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:23.826293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a2c64c0-9edb-4d7a-90c3-369085e1ca34 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:23.827172 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1f71ce2e-0968-433a-89c3-ef01123a8e04 req-617a0e96-8ebf-4b24-8af7-29ca5dd9e6a9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082129 Aug 09 17:25:23.828242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a2c64c0-9edb-4d7a-90c3-369085e1ca34 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:23.828920 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1780/3416] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:23.829061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a2c64c0-9edb-4d7a-90c3-369085e1ca34 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:23.854743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-61f0aee4-8a5b-4d80-96ff-2b1a8ea84843 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:23.856056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61f0aee4-8a5b-4d80-96ff-2b1a8ea84843 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:23.870534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f0aee4-8a5b-4d80-96ff-2b1a8ea84843 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:23.872573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f0aee4-8a5b-4d80-96ff-2b1a8ea84843 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:23.873258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f0aee4-8a5b-4d80-96ff-2b1a8ea84843 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:23.877586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f0aee4-8a5b-4d80-96ff-2b1a8ea84843 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:23.878484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f0aee4-8a5b-4d80-96ff-2b1a8ea84843 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:23.880585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f0aee4-8a5b-4d80-96ff-2b1a8ea84843 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:23.888572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:24.390732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6a2c64c0-9edb-4d7a-90c3-369085e1ca34 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:24.409124 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6a2c64c0-9edb-4d7a-90c3-369085e1ca34 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.621632 Aug 09 17:25:24.427029 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1637/3417] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:23 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:24.580209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ea111204-c03d-4de3-ac84-f192dcf0cb07 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:24.581317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ea111204-c03d-4de3-ac84-f192dcf0cb07 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:24.595709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea111204-c03d-4de3-ac84-f192dcf0cb07 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:24.597087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea111204-c03d-4de3-ac84-f192dcf0cb07 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:24.597757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea111204-c03d-4de3-ac84-f192dcf0cb07 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:24.598696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea111204-c03d-4de3-ac84-f192dcf0cb07 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:24.602890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea111204-c03d-4de3-ac84-f192dcf0cb07 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:24.603707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea111204-c03d-4de3-ac84-f192dcf0cb07 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:24.903879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ea111204-c03d-4de3-ac84-f192dcf0cb07 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:24.927453 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ea111204-c03d-4de3-ac84-f192dcf0cb07 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1367 microversion: 2.1 time: 0.354628 Aug 09 17:25:24.928259 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1638/3418] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:24 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:24.942417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d065d386-11ee-4c78-bffb-89bc18488714 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:24.948093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d065d386-11ee-4c78-bffb-89bc18488714 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:24.966661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d065d386-11ee-4c78-bffb-89bc18488714 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:24.972275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d065d386-11ee-4c78-bffb-89bc18488714 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:24.973141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d065d386-11ee-4c78-bffb-89bc18488714 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:24.979585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d065d386-11ee-4c78-bffb-89bc18488714 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:24.980753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d065d386-11ee-4c78-bffb-89bc18488714 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:24.981393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d065d386-11ee-4c78-bffb-89bc18488714 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:25.139893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-61f0aee4-8a5b-4d80-96ff-2b1a8ea84843 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:25.157933 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-61f0aee4-8a5b-4d80-96ff-2b1a8ea84843 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1372 microversion: 2.1 time: 1.310453 Aug 09 17:25:25.164557 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1781/3419] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:23 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1372 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:25.180641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b9c5484-c418-4905-84fa-234d39404212 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b9c5484-c418-4905-84fa-234d39404212 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 163 Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": 12345, "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 12345 Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:25:25.198016 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 09 17:25:25.203188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:25.206034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b9c5484-c418-4905-84fa-234d39404212 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:25.208307 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b9c5484-c418-4905-84fa-234d39404212 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.041013 Aug 09 17:25:25.212250 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1782/3420] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:25 2022] POST /compute/v2.1/servers => generated 127 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:25:25.223195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f254ea1a-b436-41a6-91bb-b719a6d848e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:25.225355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f254ea1a-b436-41a6-91bb-b719a6d848e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:25.246909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f254ea1a-b436-41a6-91bb-b719a6d848e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:25.248059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f254ea1a-b436-41a6-91bb-b719a6d848e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:25.248742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f254ea1a-b436-41a6-91bb-b719a6d848e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:25.249538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f254ea1a-b436-41a6-91bb-b719a6d848e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:25.250022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f254ea1a-b436-41a6-91bb-b719a6d848e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:25.250468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f254ea1a-b436-41a6-91bb-b719a6d848e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:25.619959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d065d386-11ee-4c78-bffb-89bc18488714 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:25.647809 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d065d386-11ee-4c78-bffb-89bc18488714 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 0.709649 Aug 09 17:25:25.650790 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1639/3421] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:24 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:25.827914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f254ea1a-b436-41a6-91bb-b719a6d848e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:25.877112 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f254ea1a-b436-41a6-91bb-b719a6d848e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.657320 Aug 09 17:25:25.878201 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1783/3422] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:25 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:25.923557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8eeab7e1-2226-4412-97e5-d53229c5a162 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:25.926016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8eeab7e1-2226-4412-97e5-d53229c5a162 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:25.938436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eeab7e1-2226-4412-97e5-d53229c5a162 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:25.939832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eeab7e1-2226-4412-97e5-d53229c5a162 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:25.941164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eeab7e1-2226-4412-97e5-d53229c5a162 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:25.945246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eeab7e1-2226-4412-97e5-d53229c5a162 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:25.946565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eeab7e1-2226-4412-97e5-d53229c5a162 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:25.948371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eeab7e1-2226-4412-97e5-d53229c5a162 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:25.955721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e8d144e9-b5e8-4bbe-90ba-141fe9592ed3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:25.956910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e8d144e9-b5e8-4bbe-90ba-141fe9592ed3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:25.994255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8d144e9-b5e8-4bbe-90ba-141fe9592ed3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:25.995138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8d144e9-b5e8-4bbe-90ba-141fe9592ed3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:25.995985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8d144e9-b5e8-4bbe-90ba-141fe9592ed3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:25.997315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8d144e9-b5e8-4bbe-90ba-141fe9592ed3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:25.998165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8d144e9-b5e8-4bbe-90ba-141fe9592ed3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:25.998955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8d144e9-b5e8-4bbe-90ba-141fe9592ed3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:26.417381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8eeab7e1-2226-4412-97e5-d53229c5a162 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:26.449655 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8eeab7e1-2226-4412-97e5-d53229c5a162 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.534937 Aug 09 17:25:26.450693 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1640/3423] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:25 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:26.463966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-072eb48d-995d-41cb-b4c9-7e6bae35233e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:26.463966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-072eb48d-995d-41cb-b4c9-7e6bae35233e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:26.475099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-072eb48d-995d-41cb-b4c9-7e6bae35233e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:26.476476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-072eb48d-995d-41cb-b4c9-7e6bae35233e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:26.477599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-072eb48d-995d-41cb-b4c9-7e6bae35233e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:26.480844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-072eb48d-995d-41cb-b4c9-7e6bae35233e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:26.482199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-072eb48d-995d-41cb-b4c9-7e6bae35233e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:26.497630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-072eb48d-995d-41cb-b4c9-7e6bae35233e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:26.541421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e8d144e9-b5e8-4bbe-90ba-141fe9592ed3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:26.580508 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e8d144e9-b5e8-4bbe-90ba-141fe9592ed3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1557 microversion: 2.1 time: 0.632924 Aug 09 17:25:26.588981 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1784/3424] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:25 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1557 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:26.623316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a932163-c61c-4034-ac5d-45dd987345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:26.624078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a932163-c61c-4034-ac5d-45dd987345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:26.632036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a932163-c61c-4034-ac5d-45dd987345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:26.633057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a932163-c61c-4034-ac5d-45dd987345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:26.633588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a932163-c61c-4034-ac5d-45dd987345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:26.634573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a932163-c61c-4034-ac5d-45dd987345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:26.635336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a932163-c61c-4034-ac5d-45dd987345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:26.635984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a932163-c61c-4034-ac5d-45dd987345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:26.829964 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a932163-c61c-4034-ac5d-45dd987345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211811 Aug 09 17:25:26.830579 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1785/3425] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:25:26 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:25:26.836197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c23d568-31c4-473b-908c-f4a7dc64f624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:26.836834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c23d568-31c4-473b-908c-f4a7dc64f624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:26.854594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c23d568-31c4-473b-908c-f4a7dc64f624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:26.855384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c23d568-31c4-473b-908c-f4a7dc64f624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:26.856388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c23d568-31c4-473b-908c-f4a7dc64f624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:26.863402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c23d568-31c4-473b-908c-f4a7dc64f624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:26.864383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c23d568-31c4-473b-908c-f4a7dc64f624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:26.865065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c23d568-31c4-473b-908c-f4a7dc64f624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:26.892354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-072eb48d-995d-41cb-b4c9-7e6bae35233e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:26.913829 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-072eb48d-995d-41cb-b4c9-7e6bae35233e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1372 microversion: 2.1 time: 0.458680 Aug 09 17:25:26.917324 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1641/3426] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:26 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1372 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:27.601697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5c23d568-31c4-473b-908c-f4a7dc64f624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:27.612055 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c23d568-31c4-473b-908c-f4a7dc64f624 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 0.780320 Aug 09 17:25:27.612657 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1786/3427] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:26 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:27.698115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1099255583", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "27e79d4c-d76c-4a49-881b-fcf6d8e5006e"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:27.812729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] validate_networks() for [('27e79d4c-d76c-4a49-881b-fcf6d8e5006e', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:25:27.954090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21986020-ce97-4d7f-a687-a242b68b32c2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:27.954810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-21986020-ce97-4d7f-a687-a242b68b32c2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:27.964190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21986020-ce97-4d7f-a687-a242b68b32c2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:27.978925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21986020-ce97-4d7f-a687-a242b68b32c2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:27.979754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21986020-ce97-4d7f-a687-a242b68b32c2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:27.981214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21986020-ce97-4d7f-a687-a242b68b32c2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:27.981913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21986020-ce97-4d7f-a687-a242b68b32c2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:27.982925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21986020-ce97-4d7f-a687-a242b68b32c2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:28.706565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-21986020-ce97-4d7f-a687-a242b68b32c2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:28.736684 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-21986020-ce97-4d7f-a687-a242b68b32c2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1372 microversion: 2.1 time: 0.786220 Aug 09 17:25:28.738423 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1787/3428] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:27 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1372 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:28.751710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-08049cae-1c06-4bd7-98cd-4bb503597f83 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:28.753106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-08049cae-1c06-4bd7-98cd-4bb503597f83 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:28.774581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08049cae-1c06-4bd7-98cd-4bb503597f83 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:28.775238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08049cae-1c06-4bd7-98cd-4bb503597f83 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:28.775821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08049cae-1c06-4bd7-98cd-4bb503597f83 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:28.776673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08049cae-1c06-4bd7-98cd-4bb503597f83 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:28.777216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08049cae-1c06-4bd7-98cd-4bb503597f83 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:28.777768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08049cae-1c06-4bd7-98cd-4bb503597f83 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:29.032371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:25:29.033188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:25:29.034460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:25:29.034460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:25:29.034460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:25:29.063445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:29.064114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:29.064597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:29.066194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:29.066685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:29.067118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:29.131339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Getting quotas for project 0618f7424f8041c4b49eda56fcee9bb0. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:25:29.145938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Getting quotas for user c5f08f55c76e4eedba90dd9877c4b9fb and project 0618f7424f8041c4b49eda56fcee9bb0. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:25:29.185075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Going to run 3 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:25:29.194163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: a3849289-6789-43f2-a9d8-a9ad534af137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:25:29.318089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=a3849289-6789-43f2-a9d8-a9ad534af137,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:25:29.390917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=4e4cb954-9e9a-40fa-aae8-792d85c3ec8c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:25:29.552516 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8fa4b019-52ce-497f-87d5-3284453261cb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.627831 Aug 09 17:25:29.561367 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1642/3429] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:25:29.579460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-93afe709-6c80-417b-b0f3-2b958901a886 req-45a73638-6e24-4753-8cb2-cd33c6483026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b4377c-cf52-4f83-8923-b86f8bdfff08", "name": "network-vif-plugged", "status": "completed", "tag": "a797759a-bc26-46ce-954a-7c9861e667d9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:29.600933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-93afe709-6c80-417b-b0f3-2b958901a886 req-45a73638-6e24-4753-8cb2-cd33c6483026 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:29.602222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-93afe709-6c80-417b-b0f3-2b958901a886 req-45a73638-6e24-4753-8cb2-cd33c6483026 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:29.613218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-93afe709-6c80-417b-b0f3-2b958901a886 req-45a73638-6e24-4753-8cb2-cd33c6483026 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:29.638000 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-93afe709-6c80-417b-b0f3-2b958901a886 req-45a73638-6e24-4753-8cb2-cd33c6483026 service nova] Creating event network-vif-plugged:a797759a-bc26-46ce-954a-7c9861e667d9 for instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 on n-h2-845781-6 Aug 09 17:25:29.668128 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-93afe709-6c80-417b-b0f3-2b958901a886 req-45a73638-6e24-4753-8cb2-cd33c6483026 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100914 Aug 09 17:25:29.677246 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1643/3430] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:29.728546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d4fc7583-052f-42ba-8d1b-c1a620a0b4bf tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:29.740558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d4fc7583-052f-42ba-8d1b-c1a620a0b4bf tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:29.744969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d4fc7583-052f-42ba-8d1b-c1a620a0b4bf tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Searching by: {'deleted': False, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:25:29.879146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4fc7583-052f-42ba-8d1b-c1a620a0b4bf tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:29.880110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4fc7583-052f-42ba-8d1b-c1a620a0b4bf tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:29.881039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4fc7583-052f-42ba-8d1b-c1a620a0b4bf tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:29.883570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4fc7583-052f-42ba-8d1b-c1a620a0b4bf tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:29.885422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4fc7583-052f-42ba-8d1b-c1a620a0b4bf tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:29.886756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4fc7583-052f-42ba-8d1b-c1a620a0b4bf tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:29.920191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-08049cae-1c06-4bd7-98cd-4bb503597f83 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:29.942044 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-08049cae-1c06-4bd7-98cd-4bb503597f83 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 1.198713 Aug 09 17:25:29.943569 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1788/3431] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:28 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:29.993363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9249abf9-c454-45ef-8095-6860cd742b8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:29.996136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9249abf9-c454-45ef-8095-6860cd742b8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:30.010172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9249abf9-c454-45ef-8095-6860cd742b8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:30.011893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9249abf9-c454-45ef-8095-6860cd742b8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:30.013737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9249abf9-c454-45ef-8095-6860cd742b8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:30.017304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9249abf9-c454-45ef-8095-6860cd742b8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:30.020017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9249abf9-c454-45ef-8095-6860cd742b8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:30.024074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9249abf9-c454-45ef-8095-6860cd742b8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:30.034855 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d4fc7583-052f-42ba-8d1b-c1a620a0b4bf tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.351721 Aug 09 17:25:30.037609 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1644/3432] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:25:29 2022] GET /compute/v2.1/servers => generated 1018 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:30.067486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0fdc7012-707f-4e19-a96e-75872d771889 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:30.069670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0fdc7012-707f-4e19-a96e-75872d771889 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:30.302194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0fdc7012-707f-4e19-a96e-75872d771889 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:30.320831 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0fdc7012-707f-4e19-a96e-75872d771889 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1223 microversion: 2.1 time: 0.261826 Aug 09 17:25:30.322668 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1645/3433] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:30 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1223 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:30.560849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-255aa3be-340f-4816-819d-4148d26d4d78 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-227172352", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ca5f3d92-23f0-4f0c-9ebc-3b32734b4200", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:30.612692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9249abf9-c454-45ef-8095-6860cd742b8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:30.630113 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9249abf9-c454-45ef-8095-6860cd742b8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1372 microversion: 2.1 time: 0.676356 Aug 09 17:25:30.632524 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1789/3434] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:29 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1372 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:30.782376 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-255aa3be-340f-4816-819d-4148d26d4d78 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Block Device ca5f3d92-23f0-4f0c-9ebc-3b32734b4200 is not bootable. Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-255aa3be-340f-4816-819d-4148d26d4d78 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 357 Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-227172352", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ca5f3d92-23f0-4f0c-9ebc-3b32734b4200", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: exception: Block Device ca5f3d92-23f0-4f0c-9ebc-3b32734b4200 is not bootable. Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-227172352', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'ca5f3d92-23f0-4f0c-9ebc-3b32734b4200'}], 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device ca5f3d92-23f0-4f0c-9ebc-3b32734b4200 is not bootable. Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:30.794804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device ca5f3d92-23f0-4f0c-9ebc-3b32734b4200 is not bootable. Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device ca5f3d92-23f0-4f0c-9ebc-3b32734b4200 is not bootable. Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-255aa3be-340f-4816-819d-4148d26d4d78 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Block Device ca5f3d92-23f0-4f0c-9ebc-3b32734b4200 is not bootable. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-255aa3be-340f-4816-819d-4148d26d4d78 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.249794 Aug 09 17:25:30.818897 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1646/3435] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:30 2022] POST /compute/v2.1/servers => generated 110 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:25:30.830361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1f19c596-3960-483b-81e9-4a568645e3f2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:30.834865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1f19c596-3960-483b-81e9-4a568645e3f2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:30.848637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f19c596-3960-483b-81e9-4a568645e3f2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:30.849549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f19c596-3960-483b-81e9-4a568645e3f2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:30.850331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f19c596-3960-483b-81e9-4a568645e3f2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:30.851617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f19c596-3960-483b-81e9-4a568645e3f2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:30.852353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f19c596-3960-483b-81e9-4a568645e3f2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:30.853523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f19c596-3960-483b-81e9-4a568645e3f2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:30.991414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-88de589c-2583-44f2-8f8e-578be770f9c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:30.992530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-88de589c-2583-44f2-8f8e-578be770f9c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:31.017130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88de589c-2583-44f2-8f8e-578be770f9c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:31.018075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88de589c-2583-44f2-8f8e-578be770f9c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:31.018873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88de589c-2583-44f2-8f8e-578be770f9c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:31.020674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88de589c-2583-44f2-8f8e-578be770f9c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:31.022495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88de589c-2583-44f2-8f8e-578be770f9c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:31.023299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88de589c-2583-44f2-8f8e-578be770f9c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:31.360873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-88de589c-2583-44f2-8f8e-578be770f9c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:31.381523 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-88de589c-2583-44f2-8f8e-578be770f9c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 0.399902 Aug 09 17:25:31.384927 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1647/3436] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:30 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:31.413518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5abf771f-ee3c-4e47-a8f6-39b7ef58a69a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:31.417401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5abf771f-ee3c-4e47-a8f6-39b7ef58a69a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:31.564821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1f19c596-3960-483b-81e9-4a568645e3f2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:31.593002 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1f19c596-3960-483b-81e9-4a568645e3f2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.777470 Aug 09 17:25:31.615149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5abf771f-ee3c-4e47-a8f6-39b7ef58a69a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:31.620243 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1790/3437] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:30 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:31.654343 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5abf771f-ee3c-4e47-a8f6-39b7ef58a69a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1223 microversion: 2.1 time: 0.263833 Aug 09 17:25:31.655566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0c02d409-6d24-40dc-953b-7e445ec930d8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:31.660648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0c02d409-6d24-40dc-953b-7e445ec930d8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:31.666340 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1648/3438] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:31 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1223 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:31.700421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c02d409-6d24-40dc-953b-7e445ec930d8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:31.701591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c02d409-6d24-40dc-953b-7e445ec930d8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:31.702758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c02d409-6d24-40dc-953b-7e445ec930d8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:31.704493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c02d409-6d24-40dc-953b-7e445ec930d8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:31.705589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c02d409-6d24-40dc-953b-7e445ec930d8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:31.706646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c02d409-6d24-40dc-953b-7e445ec930d8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:31.706928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bcedd21c-70b1-4faf-84d5-82a00bee4e7a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:31.710124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bcedd21c-70b1-4faf-84d5-82a00bee4e7a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:31.753631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcedd21c-70b1-4faf-84d5-82a00bee4e7a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:31.755062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcedd21c-70b1-4faf-84d5-82a00bee4e7a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:31.756182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcedd21c-70b1-4faf-84d5-82a00bee4e7a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:31.758092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcedd21c-70b1-4faf-84d5-82a00bee4e7a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:31.759382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcedd21c-70b1-4faf-84d5-82a00bee4e7a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:31.765368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcedd21c-70b1-4faf-84d5-82a00bee4e7a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:32.343943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bcedd21c-70b1-4faf-84d5-82a00bee4e7a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:32.359766 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bcedd21c-70b1-4faf-84d5-82a00bee4e7a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1372 microversion: 2.1 time: 0.691195 Aug 09 17:25:32.361366 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1649/3439] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:31 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1372 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:32.418290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-8390c3c3-5f94-401a-8c74-5411cf20f151 req-ddfe982e-6159-430e-83b9-977d9aedb411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d735cc-f758-4a9a-aff1-4831ccbeaf3e", "tag": "6d37a94b-6553-49ea-a0dc-ea5d53ef5fa5"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:32.474841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8390c3c3-5f94-401a-8c74-5411cf20f151 req-ddfe982e-6159-430e-83b9-977d9aedb411 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:32.475963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8390c3c3-5f94-401a-8c74-5411cf20f151 req-ddfe982e-6159-430e-83b9-977d9aedb411 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:32.476782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8390c3c3-5f94-401a-8c74-5411cf20f151 req-ddfe982e-6159-430e-83b9-977d9aedb411 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:32.511910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0c02d409-6d24-40dc-953b-7e445ec930d8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:32.527291 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-8390c3c3-5f94-401a-8c74-5411cf20f151 req-ddfe982e-6159-430e-83b9-977d9aedb411 service nova] Creating event network-changed:6d37a94b-6553-49ea-a0dc-ea5d53ef5fa5 for instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e on n-h1-845781-6 Aug 09 17:25:32.547573 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-8390c3c3-5f94-401a-8c74-5411cf20f151 req-ddfe982e-6159-430e-83b9-977d9aedb411 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130504 Aug 09 17:25:32.554643 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1650/3440] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:25:32.579050 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0c02d409-6d24-40dc-953b-7e445ec930d8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.923905 Aug 09 17:25:32.587583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0db348a6-8a2d-4c0b-8b1e-c6c0e7af16c2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:32.588390 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1791/3441] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:31 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:32.592650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0db348a6-8a2d-4c0b-8b1e-c6c0e7af16c2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:32.598742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:32.615039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0db348a6-8a2d-4c0b-8b1e-c6c0e7af16c2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:32.615996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0db348a6-8a2d-4c0b-8b1e-c6c0e7af16c2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:32.620134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0db348a6-8a2d-4c0b-8b1e-c6c0e7af16c2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:32.623249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0db348a6-8a2d-4c0b-8b1e-c6c0e7af16c2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:32.624202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0db348a6-8a2d-4c0b-8b1e-c6c0e7af16c2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:32.628057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0db348a6-8a2d-4c0b-8b1e-c6c0e7af16c2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:32.713158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22215dfe-226b-4069-af59-430b34170211 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:32.717449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-22215dfe-226b-4069-af59-430b34170211 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:32.762155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22215dfe-226b-4069-af59-430b34170211 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:32.763935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22215dfe-226b-4069-af59-430b34170211 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:32.765549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22215dfe-226b-4069-af59-430b34170211 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:32.769567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22215dfe-226b-4069-af59-430b34170211 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:32.773135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22215dfe-226b-4069-af59-430b34170211 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:32.774076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22215dfe-226b-4069-af59-430b34170211 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:33.231337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-22215dfe-226b-4069-af59-430b34170211 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:33.258012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0db348a6-8a2d-4c0b-8b1e-c6c0e7af16c2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:33.310053 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-22215dfe-226b-4069-af59-430b34170211 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1227 microversion: 2.1 time: 0.609787 Aug 09 17:25:33.312889 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1792/3442] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:32 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1227 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:33.313997 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0db348a6-8a2d-4c0b-8b1e-c6c0e7af16c2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 0.748690 Aug 09 17:25:33.315301 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1651/3443] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:32 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:33.419611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e9a40fb3-f830-4077-937d-eccf34561367 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:33.424662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e9a40fb3-f830-4077-937d-eccf34561367 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:33.469963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a40fb3-f830-4077-937d-eccf34561367 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:33.475671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a40fb3-f830-4077-937d-eccf34561367 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:33.480420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a40fb3-f830-4077-937d-eccf34561367 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:33.482855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a40fb3-f830-4077-937d-eccf34561367 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:33.486239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a40fb3-f830-4077-937d-eccf34561367 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:33.488128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a40fb3-f830-4077-937d-eccf34561367 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:34.354947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7982596-1d45-428d-9c39-716e6cbf384a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:34.355773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f7982596-1d45-428d-9c39-716e6cbf384a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:34.382954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7982596-1d45-428d-9c39-716e6cbf384a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:34.383694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7982596-1d45-428d-9c39-716e6cbf384a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:34.386476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7982596-1d45-428d-9c39-716e6cbf384a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:34.392673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7982596-1d45-428d-9c39-716e6cbf384a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:34.393227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7982596-1d45-428d-9c39-716e6cbf384a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:34.396982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7982596-1d45-428d-9c39-716e6cbf384a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:34.691915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e9a40fb3-f830-4077-937d-eccf34561367 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:34.738583 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e9a40fb3-f830-4077-937d-eccf34561367 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1566 microversion: 2.1 time: 1.333414 Aug 09 17:25:34.743242 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1793/3444] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:33 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1566 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:34.764686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fba87436-fbb4-47fc-8db5-1459608ea181 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:34.772748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fba87436-fbb4-47fc-8db5-1459608ea181 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:34.832473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fba87436-fbb4-47fc-8db5-1459608ea181 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:34.840240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fba87436-fbb4-47fc-8db5-1459608ea181 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:34.841486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fba87436-fbb4-47fc-8db5-1459608ea181 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:34.847390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fba87436-fbb4-47fc-8db5-1459608ea181 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:34.850196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fba87436-fbb4-47fc-8db5-1459608ea181 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:34.858195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fba87436-fbb4-47fc-8db5-1459608ea181 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:34.872641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f7982596-1d45-428d-9c39-716e6cbf384a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:34.937260 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f7982596-1d45-428d-9c39-716e6cbf384a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1283 microversion: 2.1 time: 0.586720 Aug 09 17:25:34.941385 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1652/3445] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:34 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1283 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:34.970760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-586f9ad0-fdb0-42b8-bd48-99f08acdb450 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:34.980500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-586f9ad0-fdb0-42b8-bd48-99f08acdb450 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:35.007701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-586f9ad0-fdb0-42b8-bd48-99f08acdb450 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:35.012402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-586f9ad0-fdb0-42b8-bd48-99f08acdb450 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:35.013782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-586f9ad0-fdb0-42b8-bd48-99f08acdb450 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:35.017713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-586f9ad0-fdb0-42b8-bd48-99f08acdb450 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:35.019054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-586f9ad0-fdb0-42b8-bd48-99f08acdb450 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:35.021587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-586f9ad0-fdb0-42b8-bd48-99f08acdb450 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:35.468263 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-586f9ad0-fdb0-42b8-bd48-99f08acdb450 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.524537 Aug 09 17:25:35.470205 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1653/3446] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:25:34 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-interface => generated 284 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:35.804230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fba87436-fbb4-47fc-8db5-1459608ea181 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:35.841414 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fba87436-fbb4-47fc-8db5-1459608ea181 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 1.090543 Aug 09 17:25:35.844706 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1794/3447] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:34 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:35.988230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bcdecb99-0ae3-4abf-a1bb-00f4ae9046e8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:35.992326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bcdecb99-0ae3-4abf-a1bb-00f4ae9046e8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:36.034639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcdecb99-0ae3-4abf-a1bb-00f4ae9046e8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:36.037656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcdecb99-0ae3-4abf-a1bb-00f4ae9046e8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:36.046289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcdecb99-0ae3-4abf-a1bb-00f4ae9046e8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:36.052794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcdecb99-0ae3-4abf-a1bb-00f4ae9046e8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:36.053392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcdecb99-0ae3-4abf-a1bb-00f4ae9046e8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:36.054178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bcdecb99-0ae3-4abf-a1bb-00f4ae9046e8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:36.471748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bcdecb99-0ae3-4abf-a1bb-00f4ae9046e8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:36.496276 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bcdecb99-0ae3-4abf-a1bb-00f4ae9046e8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1281 microversion: 2.1 time: 0.524456 Aug 09 17:25:36.505511 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1654/3448] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:35 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1281 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:36.891930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-48df5306-ef34-4251-b27d-6781db46fb26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:36.895064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-48df5306-ef34-4251-b27d-6781db46fb26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:36.910575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48df5306-ef34-4251-b27d-6781db46fb26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:36.912010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48df5306-ef34-4251-b27d-6781db46fb26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:36.913292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48df5306-ef34-4251-b27d-6781db46fb26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:36.915928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48df5306-ef34-4251-b27d-6781db46fb26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:36.917560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48df5306-ef34-4251-b27d-6781db46fb26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:36.919483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48df5306-ef34-4251-b27d-6781db46fb26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:37.514887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-48df5306-ef34-4251-b27d-6781db46fb26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:37.559726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c5c44359-877e-4d82-abb1-2a716bf94d8d tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:37.562434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c5c44359-877e-4d82-abb1-2a716bf94d8d tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:37.562876 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-48df5306-ef34-4251-b27d-6781db46fb26 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 0.680130 Aug 09 17:25:37.593184 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1795/3449] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:36 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:37.605877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5c44359-877e-4d82-abb1-2a716bf94d8d tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:37.606595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5c44359-877e-4d82-abb1-2a716bf94d8d tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:37.607454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5c44359-877e-4d82-abb1-2a716bf94d8d tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:37.610120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5c44359-877e-4d82-abb1-2a716bf94d8d tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:37.612303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5c44359-877e-4d82-abb1-2a716bf94d8d tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:37.614675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5c44359-877e-4d82-abb1-2a716bf94d8d tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:37.713140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7b627d2-372b-4646-82b3-6bbfe89ce4f7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1501006418", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "destination_type": "local"}, {"source_type": "volume", "uuid": "b2b15a52-1397-4433-b30d-e494786d8639", "destination_type": "invalid"}], "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7b627d2-372b-4646-82b3-6bbfe89ce4f7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 495 Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1501006418", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "destination_type": "local"}, {"source_type": "volume", "uuid": "b2b15a52-1397-4433-b30d-e494786d8639", "destination_type": "invalid"}], "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1501006418', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'b2b15a52-1397-4433-b30d-e494786d8639', 'destination_type': 'invalid'}], 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'invalid' Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:37.718933 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 09 17:25:37.723311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:37.727168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7b627d2-372b-4646-82b3-6bbfe89ce4f7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:37.728982 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7b627d2-372b-4646-82b3-6bbfe89ce4f7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020666 Aug 09 17:25:37.735170 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1796/3450] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:37 2022] POST /compute/v2.1/servers => generated 155 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 17:25:37.757190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-31347e92-3425-44f0-8cd2-bc2c69e9148b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:37.759570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-31347e92-3425-44f0-8cd2-bc2c69e9148b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:37.780334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31347e92-3425-44f0-8cd2-bc2c69e9148b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:37.782785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31347e92-3425-44f0-8cd2-bc2c69e9148b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:37.783815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31347e92-3425-44f0-8cd2-bc2c69e9148b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:37.784884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31347e92-3425-44f0-8cd2-bc2c69e9148b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:37.788430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31347e92-3425-44f0-8cd2-bc2c69e9148b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:37.789329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31347e92-3425-44f0-8cd2-bc2c69e9148b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:37.985995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c5c44359-877e-4d82-abb1-2a716bf94d8d tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:37.997006 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c5c44359-877e-4d82-abb1-2a716bf94d8d tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1281 microversion: 2.1 time: 0.451105 Aug 09 17:25:38.000657 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1655/3451] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:37 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1281 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:38.217925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-31347e92-3425-44f0-8cd2-bc2c69e9148b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:38.235089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-31347e92-3425-44f0-8cd2-bc2c69e9148b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.497547 Aug 09 17:25:38.236211 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1797/3452] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:37 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:38.266739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5121735b-44fa-4209-97f7-1a4a76a9e9de tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:38.267497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5121735b-44fa-4209-97f7-1a4a76a9e9de tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:38.277400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5121735b-44fa-4209-97f7-1a4a76a9e9de tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:38.278571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5121735b-44fa-4209-97f7-1a4a76a9e9de tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:38.279547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5121735b-44fa-4209-97f7-1a4a76a9e9de tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:38.280860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5121735b-44fa-4209-97f7-1a4a76a9e9de tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:38.281881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5121735b-44fa-4209-97f7-1a4a76a9e9de tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:38.282770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5121735b-44fa-4209-97f7-1a4a76a9e9de tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:38.643032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b578cc1-95c6-4fb3-b125-ffd073b0cf0b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:38.644319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b578cc1-95c6-4fb3-b125-ffd073b0cf0b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:38.655450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b578cc1-95c6-4fb3-b125-ffd073b0cf0b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:38.658493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b578cc1-95c6-4fb3-b125-ffd073b0cf0b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:38.659814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b578cc1-95c6-4fb3-b125-ffd073b0cf0b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:38.661514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b578cc1-95c6-4fb3-b125-ffd073b0cf0b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:38.662627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b578cc1-95c6-4fb3-b125-ffd073b0cf0b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:38.663530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b578cc1-95c6-4fb3-b125-ffd073b0cf0b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:38.911359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8b578cc1-95c6-4fb3-b125-ffd073b0cf0b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:38.925015 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b578cc1-95c6-4fb3-b125-ffd073b0cf0b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 0.291452 Aug 09 17:25:38.925783 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1798/3453] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:38 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:39.032232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7cdd4970-963b-4dc3-b311-030ca24ee678 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:39.033713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7cdd4970-963b-4dc3-b311-030ca24ee678 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:39.046494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdd4970-963b-4dc3-b311-030ca24ee678 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:39.047467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdd4970-963b-4dc3-b311-030ca24ee678 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:39.048121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdd4970-963b-4dc3-b311-030ca24ee678 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:39.049580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdd4970-963b-4dc3-b311-030ca24ee678 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:39.050470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdd4970-963b-4dc3-b311-030ca24ee678 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:39.051106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdd4970-963b-4dc3-b311-030ca24ee678 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:39.397445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7cdd4970-963b-4dc3-b311-030ca24ee678 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:39.418128 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7cdd4970-963b-4dc3-b311-030ca24ee678 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1323 microversion: 2.1 time: 0.393424 Aug 09 17:25:39.420301 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1799/3454] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:39 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1323 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:39.637156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5121735b-44fa-4209-97f7-1a4a76a9e9de tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:39.660309 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5121735b-44fa-4209-97f7-1a4a76a9e9de tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.397443 Aug 09 17:25:39.672463 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1656/3455] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:38 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:39.833485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21138c09-3a93-4580-b892-0c3b93c727c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1261435368", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21138c09-3a93-4580-b892-0c3b93c727c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 492 Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1261435368", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1261435368', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:39.843360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21138c09-3a93-4580-b892-0c3b93c727c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-21138c09-3a93-4580-b892-0c3b93c727c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.020857 Aug 09 17:25:39.855256 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1800/3456] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:39 2022] POST /compute/v2.1/servers => generated 624 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 17:25:39.870292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ac1f4872-4b73-4a26-8bff-e34d2d2e4c5a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:39.872603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ac1f4872-4b73-4a26-8bff-e34d2d2e4c5a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:39.886769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac1f4872-4b73-4a26-8bff-e34d2d2e4c5a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:39.888426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac1f4872-4b73-4a26-8bff-e34d2d2e4c5a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:39.889634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac1f4872-4b73-4a26-8bff-e34d2d2e4c5a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:39.891381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac1f4872-4b73-4a26-8bff-e34d2d2e4c5a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:39.892545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac1f4872-4b73-4a26-8bff-e34d2d2e4c5a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:39.893521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac1f4872-4b73-4a26-8bff-e34d2d2e4c5a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:39.968296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e4e92bd4-96e5-44b2-81b5-db3ca3e1cdec tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:39.968662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:39.970302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e4e92bd4-96e5-44b2-81b5-db3ca3e1cdec tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:39.990062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e92bd4-96e5-44b2-81b5-db3ca3e1cdec tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:39.991834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e92bd4-96e5-44b2-81b5-db3ca3e1cdec tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:39.993068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e92bd4-96e5-44b2-81b5-db3ca3e1cdec tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:39.996175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e92bd4-96e5-44b2-81b5-db3ca3e1cdec tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:39.997979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e92bd4-96e5-44b2-81b5-db3ca3e1cdec tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:39.999324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4e92bd4-96e5-44b2-81b5-db3ca3e1cdec tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:40.008859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:40.292583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4e92bd4-96e5-44b2-81b5-db3ca3e1cdec tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:40.314175 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e4e92bd4-96e5-44b2-81b5-db3ca3e1cdec tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 0.353860 Aug 09 17:25:40.315758 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1801/3457] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:39 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:40.475214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-936ae74e-cc2f-40f6-b08f-e717f38ffdf9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:40.482475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-936ae74e-cc2f-40f6-b08f-e717f38ffdf9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:40.511433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:40.522262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-936ae74e-cc2f-40f6-b08f-e717f38ffdf9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:40.523558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-936ae74e-cc2f-40f6-b08f-e717f38ffdf9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:40.525468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-936ae74e-cc2f-40f6-b08f-e717f38ffdf9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:40.531017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-936ae74e-cc2f-40f6-b08f-e717f38ffdf9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:40.532882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-936ae74e-cc2f-40f6-b08f-e717f38ffdf9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:40.535268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-936ae74e-cc2f-40f6-b08f-e717f38ffdf9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:40.951249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ac1f4872-4b73-4a26-8bff-e34d2d2e4c5a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:40.998663 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ac1f4872-4b73-4a26-8bff-e34d2d2e4c5a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.140468 Aug 09 17:25:40.999720 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1657/3458] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:39 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:41.027811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-0b48c840-9771-4d8e-b270-58953690efce req-392367f2-a9fe-4bbd-a3c3-dde6745edb36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b4377c-cf52-4f83-8923-b86f8bdfff08", "tag": "a797759a-bc26-46ce-954a-7c9861e667d9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:41.092163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0b48c840-9771-4d8e-b270-58953690efce req-392367f2-a9fe-4bbd-a3c3-dde6745edb36 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:41.096717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0b48c840-9771-4d8e-b270-58953690efce req-392367f2-a9fe-4bbd-a3c3-dde6745edb36 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:41.100065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0b48c840-9771-4d8e-b270-58953690efce req-392367f2-a9fe-4bbd-a3c3-dde6745edb36 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:41.162400 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-0b48c840-9771-4d8e-b270-58953690efce req-392367f2-a9fe-4bbd-a3c3-dde6745edb36 service nova] Creating event network-changed:a797759a-bc26-46ce-954a-7c9861e667d9 for instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 on n-h2-845781-6 Aug 09 17:25:41.183414 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-0b48c840-9771-4d8e-b270-58953690efce req-392367f2-a9fe-4bbd-a3c3-dde6745edb36 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181626 Aug 09 17:25:41.190189 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1658/3459] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:41.209537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-852ed575-937e-4ca3-bc54-fd55a1db550b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:41.219082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-852ed575-937e-4ca3-bc54-fd55a1db550b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:41.238458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852ed575-937e-4ca3-bc54-fd55a1db550b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:41.239321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852ed575-937e-4ca3-bc54-fd55a1db550b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:41.240063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852ed575-937e-4ca3-bc54-fd55a1db550b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:41.241727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852ed575-937e-4ca3-bc54-fd55a1db550b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:41.242436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852ed575-937e-4ca3-bc54-fd55a1db550b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:41.243092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-852ed575-937e-4ca3-bc54-fd55a1db550b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:41.318807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:41.552747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-936ae74e-cc2f-40f6-b08f-e717f38ffdf9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:41.593503 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-936ae74e-cc2f-40f6-b08f-e717f38ffdf9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1323 microversion: 2.1 time: 1.127862 Aug 09 17:25:41.602042 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1802/3460] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:40 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1323 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:41.630021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3628074-2e3b-4ba7-b6ed-cc16fba7417f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:41.630723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3628074-2e3b-4ba7-b6ed-cc16fba7417f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:41.653632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=10 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:41.660770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3628074-2e3b-4ba7-b6ed-cc16fba7417f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:41.661282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3628074-2e3b-4ba7-b6ed-cc16fba7417f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:41.668767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3628074-2e3b-4ba7-b6ed-cc16fba7417f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:41.669549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3628074-2e3b-4ba7-b6ed-cc16fba7417f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:41.670035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3628074-2e3b-4ba7-b6ed-cc16fba7417f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:41.670479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3628074-2e3b-4ba7-b6ed-cc16fba7417f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:42.389556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f3628074-2e3b-4ba7-b6ed-cc16fba7417f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:42.429807 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3628074-2e3b-4ba7-b6ed-cc16fba7417f tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 0.802338 Aug 09 17:25:42.449572 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1803/3461] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:41 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:42.477977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3c578dae-fa21-4113-89bb-983436fe44e5 req-9a8a4478-db06-4589-99f3-95c5507a6f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4cb954-9e9a-40fa-aae8-792d85c3ec8c", "tag": "4d5e03c1-26f8-4526-ad81-4866e4f3a062"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:42.526277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3c578dae-fa21-4113-89bb-983436fe44e5 req-9a8a4478-db06-4589-99f3-95c5507a6f33 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:42.529861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3c578dae-fa21-4113-89bb-983436fe44e5 req-9a8a4478-db06-4589-99f3-95c5507a6f33 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:42.531914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3c578dae-fa21-4113-89bb-983436fe44e5 req-9a8a4478-db06-4589-99f3-95c5507a6f33 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:42.582910 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3c578dae-fa21-4113-89bb-983436fe44e5 req-9a8a4478-db06-4589-99f3-95c5507a6f33 service nova] Creating event network-changed:4d5e03c1-26f8-4526-ad81-4866e4f3a062 for instance 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c on n-h2-845781-6 Aug 09 17:25:42.611896 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3c578dae-fa21-4113-89bb-983436fe44e5 req-9a8a4478-db06-4589-99f3-95c5507a6f33 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159645 Aug 09 17:25:42.613606 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1804/3462] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:42.653024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-086ea5b9-1149-4303-b7a1-0e4bc86daf16 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:42.658182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-086ea5b9-1149-4303-b7a1-0e4bc86daf16 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:42.678976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-086ea5b9-1149-4303-b7a1-0e4bc86daf16 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:42.686405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-086ea5b9-1149-4303-b7a1-0e4bc86daf16 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:42.697280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-086ea5b9-1149-4303-b7a1-0e4bc86daf16 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:42.699263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-086ea5b9-1149-4303-b7a1-0e4bc86daf16 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:42.700446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-086ea5b9-1149-4303-b7a1-0e4bc86daf16 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:42.701519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-086ea5b9-1149-4303-b7a1-0e4bc86daf16 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:42.998660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-852ed575-937e-4ca3-bc54-fd55a1db550b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:43.045786 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-852ed575-937e-4ca3-bc54-fd55a1db550b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.852468 Aug 09 17:25:43.047509 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1659/3463] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:41 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:43.067018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-086ea5b9-1149-4303-b7a1-0e4bc86daf16 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:43.086124 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-086ea5b9-1149-4303-b7a1-0e4bc86daf16 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1323 microversion: 2.1 time: 0.439454 Aug 09 17:25:43.089241 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1805/3464] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:42 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1323 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:43.184454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-577475d0-b292-47f9-90eb-d78fab62165c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-577475d0-b292-47f9-90eb-d78fab62165c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 416 Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:43.191683 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:25:43.197179 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:43.208188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-577475d0-b292-47f9-90eb-d78fab62165c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:43.211802 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-577475d0-b292-47f9-90eb-d78fab62165c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.032142 Aug 09 17:25:43.214072 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1660/3465] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:43 2022] POST /compute/v2.1/servers => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:25:43.226916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1bcfd29b-1756-40f7-befd-f7a907e96f72 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:43.228893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1bcfd29b-1756-40f7-befd-f7a907e96f72 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:43.240056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcfd29b-1756-40f7-befd-f7a907e96f72 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:43.244001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcfd29b-1756-40f7-befd-f7a907e96f72 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:43.246743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcfd29b-1756-40f7-befd-f7a907e96f72 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:43.248416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcfd29b-1756-40f7-befd-f7a907e96f72 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:43.250105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcfd29b-1756-40f7-befd-f7a907e96f72 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:43.251897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcfd29b-1756-40f7-befd-f7a907e96f72 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:43.476310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5bf3c97c-7411-4859-b639-145ad44c738e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:43.477885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5bf3c97c-7411-4859-b639-145ad44c738e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:43.499574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bf3c97c-7411-4859-b639-145ad44c738e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:43.503421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bf3c97c-7411-4859-b639-145ad44c738e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:43.504462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bf3c97c-7411-4859-b639-145ad44c738e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:43.507014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bf3c97c-7411-4859-b639-145ad44c738e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:43.508622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bf3c97c-7411-4859-b639-145ad44c738e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:43.512492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bf3c97c-7411-4859-b639-145ad44c738e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:43.537163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1bcfd29b-1756-40f7-befd-f7a907e96f72 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:43.560392 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1bcfd29b-1756-40f7-befd-f7a907e96f72 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.340825 Aug 09 17:25:43.562455 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1806/3466] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:43 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:43.619513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac05b979-7fa0-4df6-bb79-2365071cee09 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:43.621823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ac05b979-7fa0-4df6-bb79-2365071cee09 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:43.638622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac05b979-7fa0-4df6-bb79-2365071cee09 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:43.640663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac05b979-7fa0-4df6-bb79-2365071cee09 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:43.642958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac05b979-7fa0-4df6-bb79-2365071cee09 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:43.646651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac05b979-7fa0-4df6-bb79-2365071cee09 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:43.649611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac05b979-7fa0-4df6-bb79-2365071cee09 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:43.652487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac05b979-7fa0-4df6-bb79-2365071cee09 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:44.092340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ac05b979-7fa0-4df6-bb79-2365071cee09 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:44.115603 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ac05b979-7fa0-4df6-bb79-2365071cee09 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.519304 Aug 09 17:25:44.131691 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1807/3467] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:43 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:44.170954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f0d3fff9-e48e-4237-a585-ec959296d305 req-72a4a9dd-b62e-4840-9585-2f89888fc845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b045cc1-1ff2-49bc-b642-a2d09afba754", "tag": "2038b9f0-b2ff-4e5a-ad6e-c655c866443a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:44.216251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f0d3fff9-e48e-4237-a585-ec959296d305 req-72a4a9dd-b62e-4840-9585-2f89888fc845 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:44.220185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f0d3fff9-e48e-4237-a585-ec959296d305 req-72a4a9dd-b62e-4840-9585-2f89888fc845 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:44.221123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f0d3fff9-e48e-4237-a585-ec959296d305 req-72a4a9dd-b62e-4840-9585-2f89888fc845 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:44.271266 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f0d3fff9-e48e-4237-a585-ec959296d305 req-72a4a9dd-b62e-4840-9585-2f89888fc845 service nova] Creating event network-changed:2038b9f0-b2ff-4e5a-ad6e-c655c866443a for instance 1b045cc1-1ff2-49bc-b642-a2d09afba754 on n-h1-845781-6 Aug 09 17:25:44.286164 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f0d3fff9-e48e-4237-a585-ec959296d305 req-72a4a9dd-b62e-4840-9585-2f89888fc845 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148906 Aug 09 17:25:44.292129 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1808/3468] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:44.318348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ce60fc1-64d5-4603-a0f3-699f1f303699 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:44.330020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ce60fc1-64d5-4603-a0f3-699f1f303699 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:44.350465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ce60fc1-64d5-4603-a0f3-699f1f303699 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:44.355192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ce60fc1-64d5-4603-a0f3-699f1f303699 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:44.356463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ce60fc1-64d5-4603-a0f3-699f1f303699 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:44.361201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ce60fc1-64d5-4603-a0f3-699f1f303699 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:44.362870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ce60fc1-64d5-4603-a0f3-699f1f303699 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:44.366690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ce60fc1-64d5-4603-a0f3-699f1f303699 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:44.750036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5bf3c97c-7411-4859-b639-145ad44c738e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:44.815256 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5bf3c97c-7411-4859-b639-145ad44c738e tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1516 microversion: 2.1 time: 1.343530 Aug 09 17:25:44.817281 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1661/3469] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:43 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1516 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:44.835085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0643e129-d4d8-4ef2-a98b-fae09d37acef tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-874424421", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": -1, "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:44.881742 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-0643e129-d4d8-4ef2-a98b-fae09d37acef tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Flavor -1 could not be found. Aug 09 17:25:44.882616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5ce60fc1-64d5-4603-a0f3-699f1f303699 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0643e129-d4d8-4ef2-a98b-fae09d37acef tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 205 Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-874424421", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": -1, "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: exception: Flavor -1 could not be found. Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-874424421', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': -1, 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:44.885874 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0643e129-d4d8-4ef2-a98b-fae09d37acef tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0643e129-d4d8-4ef2-a98b-fae09d37acef tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.067423 Aug 09 17:25:44.899024 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1662/3470] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:44 2022] POST /compute/v2.1/servers => generated 73 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:25:44.904265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-276fe7f8-dacf-4980-963e-4697ed2e987f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:44.905344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-276fe7f8-dacf-4980-963e-4697ed2e987f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:44.916147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-276fe7f8-dacf-4980-963e-4697ed2e987f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:44.916718 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ce60fc1-64d5-4603-a0f3-699f1f303699 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1323 microversion: 2.1 time: 0.621201 Aug 09 17:25:44.917054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-276fe7f8-dacf-4980-963e-4697ed2e987f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:44.917851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-276fe7f8-dacf-4980-963e-4697ed2e987f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:44.919150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-276fe7f8-dacf-4980-963e-4697ed2e987f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:44.919831 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1809/3471] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:44 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1323 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:44.920134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-276fe7f8-dacf-4980-963e-4697ed2e987f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:44.920775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-276fe7f8-dacf-4980-963e-4697ed2e987f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:45.433213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-276fe7f8-dacf-4980-963e-4697ed2e987f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:45.445062 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-276fe7f8-dacf-4980-963e-4697ed2e987f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.547865 Aug 09 17:25:45.457505 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1663/3472] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:44 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:45.472839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c84cafcb-98d1-4442-b558-10ccd7f5aa7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:45.473746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c84cafcb-98d1-4442-b558-10ccd7f5aa7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:45.482575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84cafcb-98d1-4442-b558-10ccd7f5aa7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:45.483105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84cafcb-98d1-4442-b558-10ccd7f5aa7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:45.483606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84cafcb-98d1-4442-b558-10ccd7f5aa7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:45.484406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84cafcb-98d1-4442-b558-10ccd7f5aa7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:45.485106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84cafcb-98d1-4442-b558-10ccd7f5aa7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:45.485570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c84cafcb-98d1-4442-b558-10ccd7f5aa7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:45.815832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c84cafcb-98d1-4442-b558-10ccd7f5aa7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:45.830383 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c84cafcb-98d1-4442-b558-10ccd7f5aa7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.361141 Aug 09 17:25:45.831599 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1810/3473] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:45 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:45.854043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3af26a57-453c-48fb-a373-5eff27b19cc5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:45.861225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3af26a57-453c-48fb-a373-5eff27b19cc5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:45.878105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3af26a57-453c-48fb-a373-5eff27b19cc5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:45.879474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3af26a57-453c-48fb-a373-5eff27b19cc5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:45.880653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3af26a57-453c-48fb-a373-5eff27b19cc5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:45.883014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3af26a57-453c-48fb-a373-5eff27b19cc5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:45.884671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3af26a57-453c-48fb-a373-5eff27b19cc5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:45.885235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3af26a57-453c-48fb-a373-5eff27b19cc5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:45.931839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22162fc5-54df-4f69-b654-a314e99b1bd8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2132414687", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22162fc5-54df-4f69-b654-a314e99b1bd8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 173 Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2132414687", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2132414687', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi -1 Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:25:45.939454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 09 17:25:45.952628 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:45.956036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22162fc5-54df-4f69-b654-a314e99b1bd8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:45.958019 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-22162fc5-54df-4f69-b654-a314e99b1bd8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.031580 Aug 09 17:25:45.959694 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1811/3474] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:45 2022] POST /compute/v2.1/servers => generated 145 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 17:25:45.969014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-674313b5-09dd-4961-8efa-3df2b07066dd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:45.970373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-674313b5-09dd-4961-8efa-3df2b07066dd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:45.985422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-674313b5-09dd-4961-8efa-3df2b07066dd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:45.986938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-674313b5-09dd-4961-8efa-3df2b07066dd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:45.987857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-674313b5-09dd-4961-8efa-3df2b07066dd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:45.989426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-674313b5-09dd-4961-8efa-3df2b07066dd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:45.990724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-674313b5-09dd-4961-8efa-3df2b07066dd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:45.991256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-674313b5-09dd-4961-8efa-3df2b07066dd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:46.152577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3af26a57-453c-48fb-a373-5eff27b19cc5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:46.172236 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3af26a57-453c-48fb-a373-5eff27b19cc5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1522 microversion: 2.1 time: 0.326174 Aug 09 17:25:46.180212 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1664/3475] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:45 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:46.184402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c0b4ea2d-7c60-4c37-a2e2-61b32d5e5895 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:46.186805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c0b4ea2d-7c60-4c37-a2e2-61b32d5e5895 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:46.203069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0b4ea2d-7c60-4c37-a2e2-61b32d5e5895 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:46.204521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0b4ea2d-7c60-4c37-a2e2-61b32d5e5895 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:46.205855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0b4ea2d-7c60-4c37-a2e2-61b32d5e5895 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:46.207321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0b4ea2d-7c60-4c37-a2e2-61b32d5e5895 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:46.208440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0b4ea2d-7c60-4c37-a2e2-61b32d5e5895 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:46.209317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0b4ea2d-7c60-4c37-a2e2-61b32d5e5895 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:46.275300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-674313b5-09dd-4961-8efa-3df2b07066dd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:46.291407 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-674313b5-09dd-4961-8efa-3df2b07066dd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1323 microversion: 2.1 time: 0.329654 Aug 09 17:25:46.301975 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1812/3476] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:45 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:46.358382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3a775b28-9395-4183-9f98-386f04377c7a req-868a0857-9e14-4fb5-9351-08cb5eb10b25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3849289-6789-43f2-a9d8-a9ad534af137", "tag": "b05aa514-314d-40fa-b1e3-1cf724fba850"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:46.373591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3a775b28-9395-4183-9f98-386f04377c7a req-868a0857-9e14-4fb5-9351-08cb5eb10b25 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:46.374406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3a775b28-9395-4183-9f98-386f04377c7a req-868a0857-9e14-4fb5-9351-08cb5eb10b25 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:46.374852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3a775b28-9395-4183-9f98-386f04377c7a req-868a0857-9e14-4fb5-9351-08cb5eb10b25 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:46.389507 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3a775b28-9395-4183-9f98-386f04377c7a req-868a0857-9e14-4fb5-9351-08cb5eb10b25 service nova] Creating event network-changed:b05aa514-314d-40fa-b1e3-1cf724fba850 for instance a3849289-6789-43f2-a9d8-a9ad534af137 on n-h1-845781-6 Aug 09 17:25:46.395361 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3a775b28-9395-4183-9f98-386f04377c7a req-868a0857-9e14-4fb5-9351-08cb5eb10b25 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045729 Aug 09 17:25:46.396490 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1813/3477] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:46.494272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c0b4ea2d-7c60-4c37-a2e2-61b32d5e5895 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:46.509742 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c0b4ea2d-7c60-4c37-a2e2-61b32d5e5895 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.333535 Aug 09 17:25:46.511120 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1665/3478] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:46 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:46.534397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5575b327-d8cd-4114-996b-4668c5590af8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:46.535138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5575b327-d8cd-4114-996b-4668c5590af8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:46.544026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5575b327-d8cd-4114-996b-4668c5590af8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:46.544538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5575b327-d8cd-4114-996b-4668c5590af8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:46.546469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5575b327-d8cd-4114-996b-4668c5590af8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:46.547277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5575b327-d8cd-4114-996b-4668c5590af8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:46.548163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5575b327-d8cd-4114-996b-4668c5590af8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:46.548816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5575b327-d8cd-4114-996b-4668c5590af8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:47.062911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5575b327-d8cd-4114-996b-4668c5590af8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:47.081934 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5575b327-d8cd-4114-996b-4668c5590af8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.551625 Aug 09 17:25:47.083494 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1814/3479] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:46 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:47.211158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-660ef794-e273-4a3d-a648-1d552a8ad7cb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1701471540", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:47.219419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd6289a3-ed92-473a-b3a1-5d98b191ef60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:47.221196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bd6289a3-ed92-473a-b3a1-5d98b191ef60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:47.229461 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-660ef794-e273-4a3d-a648-1d552a8ad7cb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-660ef794-e273-4a3d-a648-1d552a8ad7cb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 216 Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1701471540", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1701471540', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:47.235303 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:47.246414 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:47.246414 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:47.246414 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:47.246414 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:47.246414 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:47.246414 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:47.246414 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 09 17:25:47.246414 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:47.246414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-660ef794-e273-4a3d-a648-1d552a8ad7cb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:47.249771 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-660ef794-e273-4a3d-a648-1d552a8ad7cb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.041733 Aug 09 17:25:47.263336 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1666/3480] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:47 2022] POST /compute/v2.1/servers => generated 123 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:25:47.268885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd6289a3-ed92-473a-b3a1-5d98b191ef60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:47.270468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd6289a3-ed92-473a-b3a1-5d98b191ef60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:47.272675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd6289a3-ed92-473a-b3a1-5d98b191ef60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:47.275606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd6289a3-ed92-473a-b3a1-5d98b191ef60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:47.276087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9965dde-8ff5-4c7b-ad64-83528a73b7c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:47.277779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9965dde-8ff5-4c7b-ad64-83528a73b7c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:47.279213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd6289a3-ed92-473a-b3a1-5d98b191ef60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:47.280264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd6289a3-ed92-473a-b3a1-5d98b191ef60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:47.297514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9965dde-8ff5-4c7b-ad64-83528a73b7c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:47.308698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9965dde-8ff5-4c7b-ad64-83528a73b7c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:47.309815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9965dde-8ff5-4c7b-ad64-83528a73b7c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:47.311306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9965dde-8ff5-4c7b-ad64-83528a73b7c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:47.312318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9965dde-8ff5-4c7b-ad64-83528a73b7c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:47.313660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9965dde-8ff5-4c7b-ad64-83528a73b7c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:47.909768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d9965dde-8ff5-4c7b-ad64-83528a73b7c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:47.922757 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9965dde-8ff5-4c7b-ad64-83528a73b7c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.657121 Aug 09 17:25:47.924191 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1667/3481] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:47 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:47.931413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5bbb09c1-0223-4bd7-a4b3-473649af8045 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:47.932420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5bbb09c1-0223-4bd7-a4b3-473649af8045 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:47.940696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bbb09c1-0223-4bd7-a4b3-473649af8045 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:47.942167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bbb09c1-0223-4bd7-a4b3-473649af8045 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:47.943496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bbb09c1-0223-4bd7-a4b3-473649af8045 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:47.945261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bbb09c1-0223-4bd7-a4b3-473649af8045 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:47.946677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bbb09c1-0223-4bd7-a4b3-473649af8045 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:47.947364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bbb09c1-0223-4bd7-a4b3-473649af8045 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:47.987735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bd6289a3-ed92-473a-b3a1-5d98b191ef60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:47.997524 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bd6289a3-ed92-473a-b3a1-5d98b191ef60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1522 microversion: 2.1 time: 0.789026 Aug 09 17:25:47.998044 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1815/3482] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:47 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1522 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:48.030836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-01554568-afbe-41b8-b46d-7715e4daefc9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:48.031570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-01554568-afbe-41b8-b46d-7715e4daefc9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:48.047892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01554568-afbe-41b8-b46d-7715e4daefc9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:48.048402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01554568-afbe-41b8-b46d-7715e4daefc9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:48.048996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01554568-afbe-41b8-b46d-7715e4daefc9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:48.049758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01554568-afbe-41b8-b46d-7715e4daefc9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:48.050227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01554568-afbe-41b8-b46d-7715e4daefc9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:48.050667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01554568-afbe-41b8-b46d-7715e4daefc9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:48.391105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-01554568-afbe-41b8-b46d-7715e4daefc9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:48.408256 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-01554568-afbe-41b8-b46d-7715e4daefc9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.407287 Aug 09 17:25:48.410771 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1816/3483] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:47 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:48.502628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5bbb09c1-0223-4bd7-a4b3-473649af8045 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:48.521305 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5bbb09c1-0223-4bd7-a4b3-473649af8045 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1323 microversion: 2.1 time: 0.594077 Aug 09 17:25:48.523243 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1668/3484] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:47 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1323 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:48.587881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac88f450-1f6e-4331-8a50-b977c792938d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-556626718", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "key_name": "tempest-key-277762687", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:48.742223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-ac88f450-1f6e-4331-8a50-b977c792938d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] validate_networks() for [('06107dcb-e281-407c-b425-37660f776641', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:25:48.756530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-181db1f8-f29a-493c-92c3-e57ef18fa513 req-d34473df-fbd7-4c5b-bbb4-82fcaac4e004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77084f1c-828b-45e4-accc-a1ba292b1498", "name": "network-vif-unplugged", "status": "completed", "tag": "988208c6-a8e8-4757-864d-e9f90c5f0246"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:48.809463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-181db1f8-f29a-493c-92c3-e57ef18fa513 req-d34473df-fbd7-4c5b-bbb4-82fcaac4e004 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:48.811870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-181db1f8-f29a-493c-92c3-e57ef18fa513 req-d34473df-fbd7-4c5b-bbb4-82fcaac4e004 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:48.812756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-181db1f8-f29a-493c-92c3-e57ef18fa513 req-d34473df-fbd7-4c5b-bbb4-82fcaac4e004 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:48.850451 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-181db1f8-f29a-493c-92c3-e57ef18fa513 req-d34473df-fbd7-4c5b-bbb4-82fcaac4e004 service nova] Creating event network-vif-unplugged:988208c6-a8e8-4757-864d-e9f90c5f0246 for instance 77084f1c-828b-45e4-accc-a1ba292b1498 on n-h2-845781-6 Aug 09 17:25:48.857318 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-181db1f8-f29a-493c-92c3-e57ef18fa513 req-d34473df-fbd7-4c5b-bbb4-82fcaac4e004 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109682 Aug 09 17:25:48.858355 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1669/3485] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:49.034574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f17bdd33-be39-4a55-b5e9-e1c5143b27bd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:49.035676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f17bdd33-be39-4a55-b5e9-e1c5143b27bd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:49.044197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f17bdd33-be39-4a55-b5e9-e1c5143b27bd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:49.045098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f17bdd33-be39-4a55-b5e9-e1c5143b27bd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:49.045849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f17bdd33-be39-4a55-b5e9-e1c5143b27bd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:49.047056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f17bdd33-be39-4a55-b5e9-e1c5143b27bd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:49.047541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f17bdd33-be39-4a55-b5e9-e1c5143b27bd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:49.048136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f17bdd33-be39-4a55-b5e9-e1c5143b27bd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:49.186929 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-ac88f450-1f6e-4331-8a50-b977c792938d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Invalid key_name provided. Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac88f450-1f6e-4331-8a50-b977c792938d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 245 Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-556626718", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "key_name": "tempest-key-277762687", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid key_name provided. Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-556626718', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'key_name': 'tempest-key-277762687', 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-277762687 not found for user 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:49.195469 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 09 17:25:49.210219 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:49.223905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac88f450-1f6e-4331-8a50-b977c792938d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Invalid key_name provided. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:49.225648 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ac88f450-1f6e-4331-8a50-b977c792938d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.640668 Aug 09 17:25:49.230493 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1817/3486] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 649 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 09 17:25:49.252138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-639bdd45-5bfa-4410-96be-c9ecf747cc7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:49.253328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-639bdd45-5bfa-4410-96be-c9ecf747cc7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:49.272303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-639bdd45-5bfa-4410-96be-c9ecf747cc7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:49.273713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-639bdd45-5bfa-4410-96be-c9ecf747cc7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:49.275099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-639bdd45-5bfa-4410-96be-c9ecf747cc7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:49.276735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-639bdd45-5bfa-4410-96be-c9ecf747cc7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:49.277734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-639bdd45-5bfa-4410-96be-c9ecf747cc7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:49.278576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-639bdd45-5bfa-4410-96be-c9ecf747cc7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:49.298828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f17bdd33-be39-4a55-b5e9-e1c5143b27bd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:49.317081 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f17bdd33-be39-4a55-b5e9-e1c5143b27bd tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1522 microversion: 2.1 time: 0.287539 Aug 09 17:25:49.319600 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1670/3487] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:49 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:49.570017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7455014a-eca3-4a19-9657-70a59c6737e7 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:49.571738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7455014a-eca3-4a19-9657-70a59c6737e7 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:49.612037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7455014a-eca3-4a19-9657-70a59c6737e7 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:49.612551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7455014a-eca3-4a19-9657-70a59c6737e7 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:49.614074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7455014a-eca3-4a19-9657-70a59c6737e7 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:49.618979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7455014a-eca3-4a19-9657-70a59c6737e7 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:49.619800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7455014a-eca3-4a19-9657-70a59c6737e7 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:49.621938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7455014a-eca3-4a19-9657-70a59c6737e7 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:49.686722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-639bdd45-5bfa-4410-96be-c9ecf747cc7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:49.744634 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-639bdd45-5bfa-4410-96be-c9ecf747cc7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.509173 Aug 09 17:25:49.762810 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1818/3488] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:49 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:49.817751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c599e010-3813-41a1-8cb9-3f4648c96f0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:49.819166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c599e010-3813-41a1-8cb9-3f4648c96f0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:49.834968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c599e010-3813-41a1-8cb9-3f4648c96f0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:49.836137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c599e010-3813-41a1-8cb9-3f4648c96f0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:49.839372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c599e010-3813-41a1-8cb9-3f4648c96f0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:49.843526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c599e010-3813-41a1-8cb9-3f4648c96f0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:49.845771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c599e010-3813-41a1-8cb9-3f4648c96f0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:49.847111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c599e010-3813-41a1-8cb9-3f4648c96f0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:50.210689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7455014a-eca3-4a19-9657-70a59c6737e7 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:50.224847 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7455014a-eca3-4a19-9657-70a59c6737e7 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1323 microversion: 2.1 time: 0.664093 Aug 09 17:25:50.225458 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1671/3489] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:49 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1323 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:50.348034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c599e010-3813-41a1-8cb9-3f4648c96f0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:50.354542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1a377a71-d925-43f7-bb5f-e79f523d39d5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:50.355530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1a377a71-d925-43f7-bb5f-e79f523d39d5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:50.374932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a377a71-d925-43f7-bb5f-e79f523d39d5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:50.376419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a377a71-d925-43f7-bb5f-e79f523d39d5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:50.377859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a377a71-d925-43f7-bb5f-e79f523d39d5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:50.380795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a377a71-d925-43f7-bb5f-e79f523d39d5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:50.382239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a377a71-d925-43f7-bb5f-e79f523d39d5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:50.383728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a377a71-d925-43f7-bb5f-e79f523d39d5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:50.386508 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c599e010-3813-41a1-8cb9-3f4648c96f0a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.581208 Aug 09 17:25:50.404000 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1819/3490] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:49 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:50.630519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f749917-1b80-42d5-9982-aa04bb483686 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-150933014", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:50.734816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1a377a71-d925-43f7-bb5f-e79f523d39d5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:50.745456 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1a377a71-d925-43f7-bb5f-e79f523d39d5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1522 microversion: 2.1 time: 0.402040 Aug 09 17:25:50.763733 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1672/3491] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:50 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:50.820706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.security_group_api [None req-6f749917-1b80-42d5-9982-aa04bb483686 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Neutron security group does_not_exist not found {{(pid=119431) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 09 17:25:50.821578 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-6f749917-1b80-42d5-9982-aa04bb483686 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f749917-1b80-42d5-9982-aa04bb483686 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 257 Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-150933014", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-150933014', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 09 17:25:50.833403 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:50.851109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f749917-1b80-42d5-9982-aa04bb483686 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:50.861607 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6f749917-1b80-42d5-9982-aa04bb483686 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.214535 Aug 09 17:25:50.861607 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1820/3492] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:25:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:25:50.863998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9252707-f79c-44d6-bfb3-daf0fe32487d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:50.863998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9252707-f79c-44d6-bfb3-daf0fe32487d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:50.872764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9252707-f79c-44d6-bfb3-daf0fe32487d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:50.873674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9252707-f79c-44d6-bfb3-daf0fe32487d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:50.874619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9252707-f79c-44d6-bfb3-daf0fe32487d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:50.876625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9252707-f79c-44d6-bfb3-daf0fe32487d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:50.877488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9252707-f79c-44d6-bfb3-daf0fe32487d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:50.878468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9252707-f79c-44d6-bfb3-daf0fe32487d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:51.138094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d9252707-f79c-44d6-bfb3-daf0fe32487d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:51.166243 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9252707-f79c-44d6-bfb3-daf0fe32487d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.318546 Aug 09 17:25:51.168504 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1673/3493] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:50 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:51.213526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d3423768-04ed-40d1-b0ec-fc2e84dccffb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:51.215174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d3423768-04ed-40d1-b0ec-fc2e84dccffb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:51.229030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3423768-04ed-40d1-b0ec-fc2e84dccffb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:51.230285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3423768-04ed-40d1-b0ec-fc2e84dccffb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:51.230984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3423768-04ed-40d1-b0ec-fc2e84dccffb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:51.232436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3423768-04ed-40d1-b0ec-fc2e84dccffb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:51.233574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3423768-04ed-40d1-b0ec-fc2e84dccffb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:51.234744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3423768-04ed-40d1-b0ec-fc2e84dccffb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:51.261789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2a24ea70-8dda-495e-aaff-f4e0797206b9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:51.262788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2a24ea70-8dda-495e-aaff-f4e0797206b9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:51.275163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a24ea70-8dda-495e-aaff-f4e0797206b9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:51.279127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a24ea70-8dda-495e-aaff-f4e0797206b9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:51.280484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a24ea70-8dda-495e-aaff-f4e0797206b9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:51.283429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a24ea70-8dda-495e-aaff-f4e0797206b9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:51.284172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a24ea70-8dda-495e-aaff-f4e0797206b9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:51.284914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a24ea70-8dda-495e-aaff-f4e0797206b9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:51.608097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2a24ea70-8dda-495e-aaff-f4e0797206b9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:51.625164 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2a24ea70-8dda-495e-aaff-f4e0797206b9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1323 microversion: 2.1 time: 0.370011 Aug 09 17:25:51.641454 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1674/3494] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:51 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1323 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:51.792545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eb6252b4-8cb8-4d14-8125-b1e56c1aa932 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:51.793490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eb6252b4-8cb8-4d14-8125-b1e56c1aa932 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:51.801355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb6252b4-8cb8-4d14-8125-b1e56c1aa932 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:51.801968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb6252b4-8cb8-4d14-8125-b1e56c1aa932 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:51.802427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb6252b4-8cb8-4d14-8125-b1e56c1aa932 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:51.803180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb6252b4-8cb8-4d14-8125-b1e56c1aa932 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:51.803767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb6252b4-8cb8-4d14-8125-b1e56c1aa932 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:51.804210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb6252b4-8cb8-4d14-8125-b1e56c1aa932 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:52.082304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eb6252b4-8cb8-4d14-8125-b1e56c1aa932 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:52.104273 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eb6252b4-8cb8-4d14-8125-b1e56c1aa932 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1522 microversion: 2.1 time: 0.315766 Aug 09 17:25:52.106027 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1675/3495] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:51 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:52.116564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e2b43827-113a-4441-abac-3b43a2320ce6 req-45f0516c-f794-42f2-94a1-2b2cee6efdbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b045cc1-1ff2-49bc-b642-a2d09afba754", "name": "network-vif-plugged", "status": "completed", "tag": "2038b9f0-b2ff-4e5a-ad6e-c655c866443a"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:52.138165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3423768-04ed-40d1-b0ec-fc2e84dccffb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:52.149350 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d3423768-04ed-40d1-b0ec-fc2e84dccffb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.944297 Aug 09 17:25:52.151240 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1821/3496] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:51 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:52.153757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e2b43827-113a-4441-abac-3b43a2320ce6 req-45f0516c-f794-42f2-94a1-2b2cee6efdbf service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:52.154255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e2b43827-113a-4441-abac-3b43a2320ce6 req-45f0516c-f794-42f2-94a1-2b2cee6efdbf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:52.154695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e2b43827-113a-4441-abac-3b43a2320ce6 req-45f0516c-f794-42f2-94a1-2b2cee6efdbf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:52.173586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1819f503-4a0c-41a6-8357-7210c29592c7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:52.174624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1819f503-4a0c-41a6-8357-7210c29592c7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9a651105-642f-415b-bd5d-c950147206c1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:52.189948 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-1819f503-4a0c-41a6-8357-7210c29592c7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 9a651105-642f-415b-bd5d-c950147206c1 could not be found. Aug 09 17:25:52.193156 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e2b43827-113a-4441-abac-3b43a2320ce6 req-45f0516c-f794-42f2-94a1-2b2cee6efdbf service nova] Creating event network-vif-plugged:2038b9f0-b2ff-4e5a-ad6e-c655c866443a for instance 1b045cc1-1ff2-49bc-b642-a2d09afba754 on n-h1-845781-6 Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1819f503-4a0c-41a6-8357-7210c29592c7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/9a651105-642f-415b-bd5d-c950147206c1 HTTP/1.1 Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 9a651105-642f-415b-bd5d-c950147206c1 could not be found. Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9a651105-642f-415b-bd5d-c950147206c1'} Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a651105-642f-415b-bd5d-c950147206c1 could not be found. Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a651105-642f-415b-bd5d-c950147206c1 could not be found. Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:52.197757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:52.208547 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:52.208547 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:52.208547 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:52.208547 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:52.208547 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:52.208547 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:52.208547 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a651105-642f-415b-bd5d-c950147206c1 could not be found. Aug 09 17:25:52.208547 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:52.208547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1819f503-4a0c-41a6-8357-7210c29592c7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 9a651105-642f-415b-bd5d-c950147206c1 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:52.208547 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1819f503-4a0c-41a6-8357-7210c29592c7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9a651105-642f-415b-bd5d-c950147206c1" status: 404 len: 111 microversion: 2.1 time: 0.032403 Aug 09 17:25:52.208547 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1822/3497] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:25:52 2022] DELETE /compute/v2.1/servers/9a651105-642f-415b-bd5d-c950147206c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:25:52.213827 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e2b43827-113a-4441-abac-3b43a2320ce6 req-45f0516c-f794-42f2-94a1-2b2cee6efdbf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103996 Aug 09 17:25:52.216010 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1676/3498] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:52.217846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-46127f65-7582-4af0-8db8-079233883e05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:52.218496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-46127f65-7582-4af0-8db8-079233883e05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:52.227066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46127f65-7582-4af0-8db8-079233883e05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:52.229831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46127f65-7582-4af0-8db8-079233883e05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:52.229831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46127f65-7582-4af0-8db8-079233883e05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:52.231067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46127f65-7582-4af0-8db8-079233883e05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:52.233285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46127f65-7582-4af0-8db8-079233883e05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:52.250366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46127f65-7582-4af0-8db8-079233883e05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:52.280335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-560d0e01-b3f1-4a23-b983-82f7205914c7 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:52.286502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-560d0e01-b3f1-4a23-b983-82f7205914c7 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:52.289764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-560d0e01-b3f1-4a23-b983-82f7205914c7 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Searching by: {'deleted': False, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:25:52.297796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560d0e01-b3f1-4a23-b983-82f7205914c7 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:52.298455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560d0e01-b3f1-4a23-b983-82f7205914c7 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:52.299014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560d0e01-b3f1-4a23-b983-82f7205914c7 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:52.299937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560d0e01-b3f1-4a23-b983-82f7205914c7 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:52.300541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560d0e01-b3f1-4a23-b983-82f7205914c7 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:52.301087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560d0e01-b3f1-4a23-b983-82f7205914c7 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:52.334417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-560d0e01-b3f1-4a23-b983-82f7205914c7 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:25:52.405281 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-560d0e01-b3f1-4a23-b983-82f7205914c7 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.128042 Aug 09 17:25:52.406829 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1677/3499] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:25:52 2022] GET /compute/v2.1/servers => generated 339 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:52.433197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:52.456436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:52.457546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Searching by: {'deleted': False, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:25:52.471050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:52.477093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:52.478562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:52.480352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:52.481116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:52.482252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:52.530253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:25:52.692493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:52.700515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:52.701164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:52.702122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:52.732148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-46127f65-7582-4af0-8db8-079233883e05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:52.747448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:52.764352 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-46127f65-7582-4af0-8db8-079233883e05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.556345 Aug 09 17:25:52.788084 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1823/3500] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:52 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:52.823417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-33d819ae-15da-4907-9f24-085599fe0904 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:52.825208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-33d819ae-15da-4907-9f24-085599fe0904 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:52.839434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d819ae-15da-4907-9f24-085599fe0904 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:52.840389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d819ae-15da-4907-9f24-085599fe0904 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:52.841199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d819ae-15da-4907-9f24-085599fe0904 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:52.842850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d819ae-15da-4907-9f24-085599fe0904 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:52.844234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d819ae-15da-4907-9f24-085599fe0904 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:52.845407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d819ae-15da-4907-9f24-085599fe0904 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:52.971424 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2b258158-6e3b-4e46-81f6-f64f1930aefc tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.551452 Aug 09 17:25:52.974111 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1678/3501] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:25:52 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:52.984640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e594a89-24ff-452b-b9ab-e4cd8baf7b97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:53.001872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0e594a89-24ff-452b-b9ab-e4cd8baf7b97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:53.022553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e594a89-24ff-452b-b9ab-e4cd8baf7b97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.023535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e594a89-24ff-452b-b9ab-e4cd8baf7b97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.024914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e594a89-24ff-452b-b9ab-e4cd8baf7b97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:53.026229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e594a89-24ff-452b-b9ab-e4cd8baf7b97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.027061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e594a89-24ff-452b-b9ab-e4cd8baf7b97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.027863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e594a89-24ff-452b-b9ab-e4cd8baf7b97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:53.068518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:53.197647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-33d819ae-15da-4907-9f24-085599fe0904 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:53.223438 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-33d819ae-15da-4907-9f24-085599fe0904 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1323 microversion: 2.1 time: 0.432630 Aug 09 17:25:53.225119 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1824/3502] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:52 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1323 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:53.245434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-20d35c75-6ec6-4641-bfd1-aea2bce2d4c8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:53.271148 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-20d35c75-6ec6-4641-bfd1-aea2bce2d4c8 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043367 Aug 09 17:25:53.273204 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1825/3503] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:25:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:53.288058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0e594a89-24ff-452b-b9ab-e4cd8baf7b97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:53.294764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f6d00eb-bd14-4526-9553-a50978a86e84 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:53.297440 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e594a89-24ff-452b-b9ab-e4cd8baf7b97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.321158 Aug 09 17:25:53.298903 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1679/3504] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:52 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:53.303293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f6d00eb-bd14-4526-9553-a50978a86e84 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:53.323174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a94a774-38ef-4683-896c-e27b22c54584 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:53.324329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3a94a774-38ef-4683-896c-e27b22c54584 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 17:25:53.325158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f6d00eb-bd14-4526-9553-a50978a86e84 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.325911 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-3a94a774-38ef-4683-896c-e27b22c54584 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 09 17:25:53.327231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f6d00eb-bd14-4526-9553-a50978a86e84 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.328520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f6d00eb-bd14-4526-9553-a50978a86e84 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:53.329866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f6d00eb-bd14-4526-9553-a50978a86e84 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.330748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f6d00eb-bd14-4526-9553-a50978a86e84 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a94a774-38ef-4683-896c-e27b22c54584 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 9223372036854775808 could not be found. Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9223372036854775808'} Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:53.331208 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:53.343241 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:53.343241 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:53.343241 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:53.343241 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 09 17:25:53.343241 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:53.344260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f6d00eb-bd14-4526-9553-a50978a86e84 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:53.347577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a94a774-38ef-4683-896c-e27b22c54584 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:53.349346 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3a94a774-38ef-4683-896c-e27b22c54584 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.031436 Aug 09 17:25:53.357761 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1680/3505] 10.222.0.93 () {58 vars in 1188 bytes} [Tue Aug 9 17:25:53 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:25:53.371564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-07fac1df-49e2-4a44-8159-14177855aa04 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:53.372422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-07fac1df-49e2-4a44-8159-14177855aa04 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:53.383181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-07fac1df-49e2-4a44-8159-14177855aa04 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.385026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-07fac1df-49e2-4a44-8159-14177855aa04 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.385964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-07fac1df-49e2-4a44-8159-14177855aa04 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:53.386840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-07fac1df-49e2-4a44-8159-14177855aa04 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.387430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-07fac1df-49e2-4a44-8159-14177855aa04 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.388001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-07fac1df-49e2-4a44-8159-14177855aa04 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:53.657259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-07fac1df-49e2-4a44-8159-14177855aa04 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:53.676361 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-07fac1df-49e2-4a44-8159-14177855aa04 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.311725 Aug 09 17:25:53.677169 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1681/3506] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:53 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:53.694104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b617bc1a-7e63-40fa-9312-f01d3a11fa36 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:53.704951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b617bc1a-7e63-40fa-9312-f01d3a11fa36 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:53.709918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b617bc1a-7e63-40fa-9312-f01d3a11fa36 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Searching by: {'deleted': False, 'project_id': 'c281514960bd499d83a4f683bf269d9e'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:25:53.718087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b617bc1a-7e63-40fa-9312-f01d3a11fa36 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.719106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b617bc1a-7e63-40fa-9312-f01d3a11fa36 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.719801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b617bc1a-7e63-40fa-9312-f01d3a11fa36 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:53.721183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b617bc1a-7e63-40fa-9312-f01d3a11fa36 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.721777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b617bc1a-7e63-40fa-9312-f01d3a11fa36 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.722310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b617bc1a-7e63-40fa-9312-f01d3a11fa36 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:53.766915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f6d00eb-bd14-4526-9553-a50978a86e84 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:53.775928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-b617bc1a-7e63-40fa-9312-f01d3a11fa36 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:25:53.804241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f6d00eb-bd14-4526-9553-a50978a86e84 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1522 microversion: 2.1 time: 0.528568 Aug 09 17:25:53.807112 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1826/3507] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:53 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:53.826351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-17937c04-f9d5-4fc9-ac47-e21d13d301a3 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:53.826866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17937c04-f9d5-4fc9-ac47-e21d13d301a3 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:53.844525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17937c04-f9d5-4fc9-ac47-e21d13d301a3 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.845453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17937c04-f9d5-4fc9-ac47-e21d13d301a3 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.846093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17937c04-f9d5-4fc9-ac47-e21d13d301a3 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:53.847037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17937c04-f9d5-4fc9-ac47-e21d13d301a3 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.850323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17937c04-f9d5-4fc9-ac47-e21d13d301a3 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.851619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17937c04-f9d5-4fc9-ac47-e21d13d301a3 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:53.871263 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b617bc1a-7e63-40fa-9312-f01d3a11fa36 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.192096 Aug 09 17:25:53.872939 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1682/3508] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:25:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:53.883508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-351ec71d-f11d-456f-a2c7-b6d67d08626a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:53.886370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-351ec71d-f11d-456f-a2c7-b6d67d08626a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:53.900480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-351ec71d-f11d-456f-a2c7-b6d67d08626a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.901456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17937c04-f9d5-4fc9-ac47-e21d13d301a3 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:25:53.903352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-351ec71d-f11d-456f-a2c7-b6d67d08626a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.904519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-351ec71d-f11d-456f-a2c7-b6d67d08626a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:53.906139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-351ec71d-f11d-456f-a2c7-b6d67d08626a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:53.907149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-351ec71d-f11d-456f-a2c7-b6d67d08626a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:53.907898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-351ec71d-f11d-456f-a2c7-b6d67d08626a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.026456 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-17937c04-f9d5-4fc9-ac47-e21d13d301a3 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 204 len: 0 microversion: 2.1 time: 0.216182 Aug 09 17:25:54.027451 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1827/3509] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:25:53 2022] DELETE /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:25:54.034450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:54.039582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:54.040713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Searching by: {'deleted': False, 'project_id': 'c281514960bd499d83a4f683bf269d9e'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:25:54.047351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.047887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.048331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.049111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.049573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.049997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.084141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:25:54.155688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:54.168162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.169115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.169955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.225347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-351ec71d-f11d-456f-a2c7-b6d67d08626a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:54.242460 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-351ec71d-f11d-456f-a2c7-b6d67d08626a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.367053 Aug 09 17:25:54.252684 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1683/3510] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:53 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:54.262175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4965b66d-325a-447c-85db-2c3f13f6d156 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:54.262885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4965b66d-325a-447c-85db-2c3f13f6d156 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:54.269556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4965b66d-325a-447c-85db-2c3f13f6d156 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.270168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4965b66d-325a-447c-85db-2c3f13f6d156 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.270624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4965b66d-325a-447c-85db-2c3f13f6d156 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.271499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4965b66d-325a-447c-85db-2c3f13f6d156 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.272123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4965b66d-325a-447c-85db-2c3f13f6d156 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.272566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4965b66d-325a-447c-85db-2c3f13f6d156 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.448900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3c35aca7-bf68-46db-80ac-d15d1950459a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.419830 Aug 09 17:25:54.449498 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1828/3511] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:25:54 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:54.454600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-39697303-33b7-441f-a074-2b05602fae29 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:54.455358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-39697303-33b7-441f-a074-2b05602fae29 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:54.476357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39697303-33b7-441f-a074-2b05602fae29 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.476357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39697303-33b7-441f-a074-2b05602fae29 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.476357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39697303-33b7-441f-a074-2b05602fae29 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.476357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39697303-33b7-441f-a074-2b05602fae29 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.476357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39697303-33b7-441f-a074-2b05602fae29 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.477199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39697303-33b7-441f-a074-2b05602fae29 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.510302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4965b66d-325a-447c-85db-2c3f13f6d156 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:54.530212 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4965b66d-325a-447c-85db-2c3f13f6d156 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1714 microversion: 2.1 time: 0.275449 Aug 09 17:25:54.544505 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1684/3512] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:54 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1714 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:54.561583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2d5e1aac-dfe8-43c5-aeda-121e38fdba6d req-49d69987-c9a0-443e-b7c8-10a0dc3e70c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4cb954-9e9a-40fa-aae8-792d85c3ec8c", "name": "network-vif-plugged", "status": "completed", "tag": "4d5e03c1-26f8-4526-ad81-4866e4f3a062"}, {"server_uuid": "77084f1c-828b-45e4-accc-a1ba292b1498", "name": "network-vif-plugged", "status": "completed", "tag": "988208c6-a8e8-4757-864d-e9f90c5f0246"}, {"server_uuid": "a3849289-6789-43f2-a9d8-a9ad534af137", "name": "network-vif-plugged", "status": "completed", "tag": "b05aa514-314d-40fa-b1e3-1cf724fba850"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:54.575705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2d5e1aac-dfe8-43c5-aeda-121e38fdba6d req-49d69987-c9a0-443e-b7c8-10a0dc3e70c8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.576412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2d5e1aac-dfe8-43c5-aeda-121e38fdba6d req-49d69987-c9a0-443e-b7c8-10a0dc3e70c8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.577061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2d5e1aac-dfe8-43c5-aeda-121e38fdba6d req-49d69987-c9a0-443e-b7c8-10a0dc3e70c8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.594848 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2d5e1aac-dfe8-43c5-aeda-121e38fdba6d req-49d69987-c9a0-443e-b7c8-10a0dc3e70c8 service nova] Creating event network-vif-plugged:4d5e03c1-26f8-4526-ad81-4866e4f3a062 for instance 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c on n-h2-845781-6 Aug 09 17:25:54.595368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2d5e1aac-dfe8-43c5-aeda-121e38fdba6d req-49d69987-c9a0-443e-b7c8-10a0dc3e70c8 service nova] Creating event network-vif-plugged:988208c6-a8e8-4757-864d-e9f90c5f0246 for instance 77084f1c-828b-45e4-accc-a1ba292b1498 on n-h2-845781-6 Aug 09 17:25:54.596093 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2d5e1aac-dfe8-43c5-aeda-121e38fdba6d req-49d69987-c9a0-443e-b7c8-10a0dc3e70c8 service nova] Creating event network-vif-plugged:b05aa514-314d-40fa-b1e3-1cf724fba850 for instance a3849289-6789-43f2-a9d8-a9ad534af137 on n-h1-845781-6 Aug 09 17:25:54.610844 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-2d5e1aac-dfe8-43c5-aeda-121e38fdba6d req-49d69987-c9a0-443e-b7c8-10a0dc3e70c8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.062698 Aug 09 17:25:54.612639 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1685/3513] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:54.628737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-93d8beee-b9d8-4ee7-bbc8-b5317394eda9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:54.629617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-93d8beee-b9d8-4ee7-bbc8-b5317394eda9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Failed to fetch instance by id -1 {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 17:25:54.632036 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-93d8beee-b9d8-4ee7-bbc8-b5317394eda9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance -1 could not be found. Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-93d8beee-b9d8-4ee7-bbc8-b5317394eda9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance -1 could not be found. Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '-1'} Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:54.635616 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:54.642287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:54.642287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:54.642287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 09 17:25:54.642287 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:54.642287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-93d8beee-b9d8-4ee7-bbc8-b5317394eda9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:54.642287 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-93d8beee-b9d8-4ee7-bbc8-b5317394eda9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.022941 Aug 09 17:25:54.648297 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1686/3514] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:25:54 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:25:54.662686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-35a25986-5cc7-4f32-b5b1-473817ca5577 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:54.680251 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-35a25986-5cc7-4f32-b5b1-473817ca5577 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025719 Aug 09 17:25:54.693604 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1687/3515] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:25:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:54.693604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c569cb9e-2097-48a6-b716-6b7c96ee6701 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:54.693604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c569cb9e-2097-48a6-b716-6b7c96ee6701 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:54.696490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c569cb9e-2097-48a6-b716-6b7c96ee6701 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.697428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c569cb9e-2097-48a6-b716-6b7c96ee6701 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.697962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c569cb9e-2097-48a6-b716-6b7c96ee6701 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.699358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c569cb9e-2097-48a6-b716-6b7c96ee6701 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.700990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c569cb9e-2097-48a6-b716-6b7c96ee6701 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.701688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c569cb9e-2097-48a6-b716-6b7c96ee6701 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.792819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-39697303-33b7-441f-a074-2b05602fae29 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:54.802556 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-39697303-33b7-441f-a074-2b05602fae29 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1515 microversion: 2.1 time: 0.351738 Aug 09 17:25:54.811940 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1829/3516] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:54 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1515 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:54.834447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e38804d3-4190-4199-8e81-7e9743d155db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:54.835933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e38804d3-4190-4199-8e81-7e9743d155db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:54.842915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e38804d3-4190-4199-8e81-7e9743d155db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.844045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e38804d3-4190-4199-8e81-7e9743d155db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.844045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e38804d3-4190-4199-8e81-7e9743d155db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.844768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e38804d3-4190-4199-8e81-7e9743d155db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.845306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e38804d3-4190-4199-8e81-7e9743d155db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.845905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e38804d3-4190-4199-8e81-7e9743d155db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.953436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c569cb9e-2097-48a6-b716-6b7c96ee6701 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:54.964171 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c569cb9e-2097-48a6-b716-6b7c96ee6701 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.281687 Aug 09 17:25:54.964985 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1688/3517] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:54 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:54.980710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0ff7b800-3f00-4702-bbc6-a46c76f8c3f1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:54.981337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0ff7b800-3f00-4702-bbc6-a46c76f8c3f1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:54.989002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff7b800-3f00-4702-bbc6-a46c76f8c3f1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.989503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff7b800-3f00-4702-bbc6-a46c76f8c3f1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.990678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff7b800-3f00-4702-bbc6-a46c76f8c3f1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:54.991950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff7b800-3f00-4702-bbc6-a46c76f8c3f1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:54.992651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff7b800-3f00-4702-bbc6-a46c76f8c3f1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:54.993986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff7b800-3f00-4702-bbc6-a46c76f8c3f1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:55.123381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e38804d3-4190-4199-8e81-7e9743d155db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:55.140754 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e38804d3-4190-4199-8e81-7e9743d155db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c" status: 200 len: 1323 microversion: 2.1 time: 0.312086 Aug 09 17:25:55.142124 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1830/3518] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:54 2022] GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c => generated 1323 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:25:55.151820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c044608b-d157-4702-ad59-e62f67f98db7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:55.153014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c044608b-d157-4702-ad59-e62f67f98db7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:55.164965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c044608b-d157-4702-ad59-e62f67f98db7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:55.166225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c044608b-d157-4702-ad59-e62f67f98db7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:55.166941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c044608b-d157-4702-ad59-e62f67f98db7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:55.168601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c044608b-d157-4702-ad59-e62f67f98db7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:55.169407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c044608b-d157-4702-ad59-e62f67f98db7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:55.170217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c044608b-d157-4702-ad59-e62f67f98db7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:55.236400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0ff7b800-3f00-4702-bbc6-a46c76f8c3f1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:55.259530 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0ff7b800-3f00-4702-bbc6-a46c76f8c3f1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1522 microversion: 2.1 time: 0.291362 Aug 09 17:25:55.276396 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1689/3519] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:54 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:55.468824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c044608b-d157-4702-ad59-e62f67f98db7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:55.488091 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c044608b-d157-4702-ad59-e62f67f98db7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.343994 Aug 09 17:25:55.489248 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1831/3520] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:55 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:55.510974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1d6a1955-da3c-41f6-afe4-bdfe833d106a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:55.511926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1d6a1955-da3c-41f6-afe4-bdfe833d106a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 76aeecfe-302e-4e36-8b0c-bcd48835d520] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:55.520870 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-1d6a1955-da3c-41f6-afe4-bdfe833d106a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 76aeecfe-302e-4e36-8b0c-bcd48835d520 could not be found. Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1d6a1955-da3c-41f6-afe4-bdfe833d106a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/76aeecfe-302e-4e36-8b0c-bcd48835d520/action HTTP/1.1 Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 19 Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: {"forceDelete": {}} Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 76aeecfe-302e-4e36-8b0c-bcd48835d520 could not be found. Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '76aeecfe-302e-4e36-8b0c-bcd48835d520', 'body': {'forceDelete': {}}} Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76aeecfe-302e-4e36-8b0c-bcd48835d520 could not be found. Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76aeecfe-302e-4e36-8b0c-bcd48835d520 could not be found. Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:55.525703 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:55.538206 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:55.538206 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:55.538206 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76aeecfe-302e-4e36-8b0c-bcd48835d520 could not be found. Aug 09 17:25:55.538206 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:55.538206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1d6a1955-da3c-41f6-afe4-bdfe833d106a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 76aeecfe-302e-4e36-8b0c-bcd48835d520 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:55.538206 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1d6a1955-da3c-41f6-afe4-bdfe833d106a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/76aeecfe-302e-4e36-8b0c-bcd48835d520/action" status: 404 len: 111 microversion: 2.1 time: 0.021325 Aug 09 17:25:55.538206 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1690/3521] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:25:55 2022] POST /compute/v2.1/servers/76aeecfe-302e-4e36-8b0c-bcd48835d520/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:25:55.544585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-056833cc-fa33-4f9c-ba0d-eb003f62da33 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:55.545936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-056833cc-fa33-4f9c-ba0d-eb003f62da33 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:55.566270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8820b602-a697-42e5-acac-9441b561eb55 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:55.567255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8820b602-a697-42e5-acac-9441b561eb55 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:55.569942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-056833cc-fa33-4f9c-ba0d-eb003f62da33 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:55.571019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-056833cc-fa33-4f9c-ba0d-eb003f62da33 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:55.572888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-056833cc-fa33-4f9c-ba0d-eb003f62da33 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:55.574178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-056833cc-fa33-4f9c-ba0d-eb003f62da33 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:55.574978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-056833cc-fa33-4f9c-ba0d-eb003f62da33 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:55.575741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-056833cc-fa33-4f9c-ba0d-eb003f62da33 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:55.581791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8820b602-a697-42e5-acac-9441b561eb55 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:55.582676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8820b602-a697-42e5-acac-9441b561eb55 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:55.583418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8820b602-a697-42e5-acac-9441b561eb55 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:55.584681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8820b602-a697-42e5-acac-9441b561eb55 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:55.585532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8820b602-a697-42e5-acac-9441b561eb55 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:55.586225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8820b602-a697-42e5-acac-9441b561eb55 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:55.639658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8820b602-a697-42e5-acac-9441b561eb55 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:25:55.875143 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8820b602-a697-42e5-acac-9441b561eb55 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "DELETE /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 204 len: 0 microversion: 2.1 time: 0.314264 Aug 09 17:25:55.883159 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1691/3522] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:25:55 2022] DELETE /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:25:55.897584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fd3c95c7-8a54-4031-a972-583094c1fc36 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:55.900556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fd3c95c7-8a54-4031-a972-583094c1fc36 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:55.914085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd3c95c7-8a54-4031-a972-583094c1fc36 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:55.918175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd3c95c7-8a54-4031-a972-583094c1fc36 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:55.919933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd3c95c7-8a54-4031-a972-583094c1fc36 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:55.921651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd3c95c7-8a54-4031-a972-583094c1fc36 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:55.923167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd3c95c7-8a54-4031-a972-583094c1fc36 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:55.924428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fd3c95c7-8a54-4031-a972-583094c1fc36 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:55.939813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-056833cc-fa33-4f9c-ba0d-eb003f62da33 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:55.959168 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-056833cc-fa33-4f9c-ba0d-eb003f62da33 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.421726 Aug 09 17:25:55.971434 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1832/3523] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:55 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:56.003032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-68a082b1-02c2-4105-9c32-1a9798c139c7 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:56.004448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-68a082b1-02c2-4105-9c32-1a9798c139c7 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:56.019211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68a082b1-02c2-4105-9c32-1a9798c139c7 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:56.020288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68a082b1-02c2-4105-9c32-1a9798c139c7 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:56.021221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68a082b1-02c2-4105-9c32-1a9798c139c7 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:56.022658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68a082b1-02c2-4105-9c32-1a9798c139c7 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:56.023607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68a082b1-02c2-4105-9c32-1a9798c139c7 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:56.024603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68a082b1-02c2-4105-9c32-1a9798c139c7 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:56.309720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-68a082b1-02c2-4105-9c32-1a9798c139c7 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:56.327425 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-68a082b1-02c2-4105-9c32-1a9798c139c7 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1607 microversion: 2.1 time: 0.347549 Aug 09 17:25:56.329081 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1833/3524] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:55 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1607 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:56.344934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fd3c95c7-8a54-4031-a972-583094c1fc36 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:56.371497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b1a33dcd-a858-4dcb-a11a-aef0b1a8b21a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:56.373576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b1a33dcd-a858-4dcb-a11a-aef0b1a8b21a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:56.382280 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fd3c95c7-8a54-4031-a972-583094c1fc36 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1714 microversion: 2.1 time: 0.494993 Aug 09 17:25:56.395841 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1692/3525] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:55 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1714 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:56.395841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-02e7e766-864f-4947-8d53-1a3370931a8c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:56.395841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-02e7e766-864f-4947-8d53-1a3370931a8c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:56.401229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1a33dcd-a858-4dcb-a11a-aef0b1a8b21a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:56.401781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1a33dcd-a858-4dcb-a11a-aef0b1a8b21a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:56.404895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1a33dcd-a858-4dcb-a11a-aef0b1a8b21a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:56.404895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1a33dcd-a858-4dcb-a11a-aef0b1a8b21a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:56.404895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1a33dcd-a858-4dcb-a11a-aef0b1a8b21a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:56.405950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1a33dcd-a858-4dcb-a11a-aef0b1a8b21a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:56.422137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02e7e766-864f-4947-8d53-1a3370931a8c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:56.426348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02e7e766-864f-4947-8d53-1a3370931a8c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:56.427319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02e7e766-864f-4947-8d53-1a3370931a8c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:56.431681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02e7e766-864f-4947-8d53-1a3370931a8c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:56.432676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02e7e766-864f-4947-8d53-1a3370931a8c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:56.436482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-02e7e766-864f-4947-8d53-1a3370931a8c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:56.732569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b1a33dcd-a858-4dcb-a11a-aef0b1a8b21a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:56.751813 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b1a33dcd-a858-4dcb-a11a-aef0b1a8b21a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.407813 Aug 09 17:25:56.753341 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1834/3526] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:56 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:56.786853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f388948e-e170-47f9-bead-fb6efdff6901 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:56.792269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f388948e-e170-47f9-bead-fb6efdff6901 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:56.807473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388948e-e170-47f9-bead-fb6efdff6901 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:56.809666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388948e-e170-47f9-bead-fb6efdff6901 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:56.810562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388948e-e170-47f9-bead-fb6efdff6901 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:56.812002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388948e-e170-47f9-bead-fb6efdff6901 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:56.813190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388948e-e170-47f9-bead-fb6efdff6901 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:56.814720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f388948e-e170-47f9-bead-fb6efdff6901 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:56.818659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-02e7e766-864f-4947-8d53-1a3370931a8c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:56.827177 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-02e7e766-864f-4947-8d53-1a3370931a8c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c" status: 200 len: 1323 microversion: 2.1 time: 0.440909 Aug 09 17:25:56.828134 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1693/3527] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:56 2022] GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c => generated 1323 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:56.835563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-18f92faa-1bf5-4427-ae29-118509457b46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:56.840200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-18f92faa-1bf5-4427-ae29-118509457b46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 4b4ae7cc-b8bd-40ee-b677-3a5b0361986c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:56.854264 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-18f92faa-1bf5-4427-ae29-118509457b46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 4b4ae7cc-b8bd-40ee-b677-3a5b0361986c could not be found. Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-18f92faa-1bf5-4427-ae29-118509457b46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/4b4ae7cc-b8bd-40ee-b677-3a5b0361986c/action HTTP/1.1 Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 39 Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: {"os-getConsoleOutput": {"length": 10}} Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 4b4ae7cc-b8bd-40ee-b677-3a5b0361986c could not be found. Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '4b4ae7cc-b8bd-40ee-b677-3a5b0361986c', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b4ae7cc-b8bd-40ee-b677-3a5b0361986c could not be found. Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b4ae7cc-b8bd-40ee-b677-3a5b0361986c could not be found. Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:56.864350 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:56.872808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:56.872808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:56.872808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:56.872808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:56.872808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b4ae7cc-b8bd-40ee-b677-3a5b0361986c could not be found. Aug 09 17:25:56.872808 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:25:56.874984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-18f92faa-1bf5-4427-ae29-118509457b46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 4b4ae7cc-b8bd-40ee-b677-3a5b0361986c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:56.877280 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-18f92faa-1bf5-4427-ae29-118509457b46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/4b4ae7cc-b8bd-40ee-b677-3a5b0361986c/action" status: 404 len: 111 microversion: 2.1 time: 0.047326 Aug 09 17:25:56.878690 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1694/3528] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:25:56 2022] POST /compute/v2.1/servers/4b4ae7cc-b8bd-40ee-b677-3a5b0361986c/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:25:56.903016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dab09c9b-4d49-45a6-bd28-2534a05fd674 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:56.904181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dab09c9b-4d49-45a6-bd28-2534a05fd674 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:56.918153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab09c9b-4d49-45a6-bd28-2534a05fd674 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:56.920444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab09c9b-4d49-45a6-bd28-2534a05fd674 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:56.921067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab09c9b-4d49-45a6-bd28-2534a05fd674 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:56.921976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab09c9b-4d49-45a6-bd28-2534a05fd674 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:56.922546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab09c9b-4d49-45a6-bd28-2534a05fd674 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:56.923216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab09c9b-4d49-45a6-bd28-2534a05fd674 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:57.011953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f388948e-e170-47f9-bead-fb6efdff6901 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:57.026010 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f388948e-e170-47f9-bead-fb6efdff6901 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1522 microversion: 2.1 time: 0.270480 Aug 09 17:25:57.027535 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1835/3529] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:56 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:57.278795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dab09c9b-4d49-45a6-bd28-2534a05fd674 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:57.288662 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dab09c9b-4d49-45a6-bd28-2534a05fd674 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.402531 Aug 09 17:25:57.289959 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1695/3530] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:56 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:57.333531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7e68199a-ee88-4345-8ed5-68aec62d1721 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:57.334853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7e68199a-ee88-4345-8ed5-68aec62d1721 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:57.351032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e68199a-ee88-4345-8ed5-68aec62d1721 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:57.352025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e68199a-ee88-4345-8ed5-68aec62d1721 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:57.352862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e68199a-ee88-4345-8ed5-68aec62d1721 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:57.354250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e68199a-ee88-4345-8ed5-68aec62d1721 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:57.355466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e68199a-ee88-4345-8ed5-68aec62d1721 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:57.356673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e68199a-ee88-4345-8ed5-68aec62d1721 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:57.379677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-36cc2021-a041-4a03-b910-ce9347216546 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:57.384244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-36cc2021-a041-4a03-b910-ce9347216546 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:57.395015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36cc2021-a041-4a03-b910-ce9347216546 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:57.395855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36cc2021-a041-4a03-b910-ce9347216546 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:57.396638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36cc2021-a041-4a03-b910-ce9347216546 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:57.397541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36cc2021-a041-4a03-b910-ce9347216546 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:57.398151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36cc2021-a041-4a03-b910-ce9347216546 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:57.398747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36cc2021-a041-4a03-b910-ce9347216546 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:57.764941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7e68199a-ee88-4345-8ed5-68aec62d1721 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:57.787996 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7e68199a-ee88-4345-8ed5-68aec62d1721 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.464057 Aug 09 17:25:57.791518 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1836/3531] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:57 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:57.804637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ed483ac6-5c27-4bf2-806a-a084d9010863 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:57.807208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ed483ac6-5c27-4bf2-806a-a084d9010863 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:57.825806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed483ac6-5c27-4bf2-806a-a084d9010863 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:57.827249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed483ac6-5c27-4bf2-806a-a084d9010863 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:57.829199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed483ac6-5c27-4bf2-806a-a084d9010863 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:57.831117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed483ac6-5c27-4bf2-806a-a084d9010863 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:57.832570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed483ac6-5c27-4bf2-806a-a084d9010863 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:57.835912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed483ac6-5c27-4bf2-806a-a084d9010863 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:57.991245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ed483ac6-5c27-4bf2-806a-a084d9010863 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:58.007418 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ed483ac6-5c27-4bf2-806a-a084d9010863 tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1647 microversion: 2.1 time: 0.211996 Aug 09 17:25:58.021920 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1837/3532] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:57 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1647 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:58.033302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-36cc2021-a041-4a03-b910-ce9347216546 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:58.049160 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-36cc2021-a041-4a03-b910-ce9347216546 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1607 microversion: 2.1 time: 0.677093 Aug 09 17:25:58.050899 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1696/3533] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:57 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1607 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:58.052104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66146b8f-7009-46a6-8ab9-18ce65e24066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:58.056873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-66146b8f-7009-46a6-8ab9-18ce65e24066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 2532b150-3fdb-4569-9971-41e2e3431fc8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:58.061440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-65d86ca8-94c8-48e8-9146-0f09e539b762 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:58.064727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-65d86ca8-94c8-48e8-9146-0f09e539b762 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:58.069953 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-66146b8f-7009-46a6-8ab9-18ce65e24066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 2532b150-3fdb-4569-9971-41e2e3431fc8 could not be found. Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66146b8f-7009-46a6-8ab9-18ce65e24066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/2532b150-3fdb-4569-9971-41e2e3431fc8 HTTP/1.1 Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 2532b150-3fdb-4569-9971-41e2e3431fc8 could not be found. Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '2532b150-3fdb-4569-9971-41e2e3431fc8'} Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2532b150-3fdb-4569-9971-41e2e3431fc8 could not be found. Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2532b150-3fdb-4569-9971-41e2e3431fc8 could not be found. Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:25:58.073762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:25:58.078812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:25:58.078812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:25:58.078812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:25:58.078812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2532b150-3fdb-4569-9971-41e2e3431fc8 could not be found. Aug 09 17:25:58.078812 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:25:58.078812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66146b8f-7009-46a6-8ab9-18ce65e24066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 2532b150-3fdb-4569-9971-41e2e3431fc8 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:25:58.078812 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66146b8f-7009-46a6-8ab9-18ce65e24066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/2532b150-3fdb-4569-9971-41e2e3431fc8" status: 404 len: 111 microversion: 2.1 time: 0.052751 Aug 09 17:25:58.080073 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1838/3534] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:58 2022] GET /compute/v2.1/servers/2532b150-3fdb-4569-9971-41e2e3431fc8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:25:58.086588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65d86ca8-94c8-48e8-9146-0f09e539b762 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:58.087522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65d86ca8-94c8-48e8-9146-0f09e539b762 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:58.088187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65d86ca8-94c8-48e8-9146-0f09e539b762 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:58.089131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65d86ca8-94c8-48e8-9146-0f09e539b762 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:58.090108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65d86ca8-94c8-48e8-9146-0f09e539b762 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:58.090836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65d86ca8-94c8-48e8-9146-0f09e539b762 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:58.095314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2ab8e9f5-492a-452c-9ea8-78c1532e9a7b req-fb123218-c0dd-43df-b2e5-1abcccd3e11f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6836a3c0-24e0-4afb-ba44-bcbdf81c4f11", "name": "network-vif-deleted", "tag": "0430a967-0c56-4428-9296-a392bcbd950f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:25:58.134237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2ab8e9f5-492a-452c-9ea8-78c1532e9a7b req-fb123218-c0dd-43df-b2e5-1abcccd3e11f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:58.135150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2ab8e9f5-492a-452c-9ea8-78c1532e9a7b req-fb123218-c0dd-43df-b2e5-1abcccd3e11f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:58.135914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2ab8e9f5-492a-452c-9ea8-78c1532e9a7b req-fb123218-c0dd-43df-b2e5-1abcccd3e11f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:58.159778 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2ab8e9f5-492a-452c-9ea8-78c1532e9a7b req-fb123218-c0dd-43df-b2e5-1abcccd3e11f service nova] Creating event network-vif-deleted:0430a967-0c56-4428-9296-a392bcbd950f for instance 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 on n-h2-845781-6 Aug 09 17:25:58.172172 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2ab8e9f5-492a-452c-9ea8-78c1532e9a7b req-fb123218-c0dd-43df-b2e5-1abcccd3e11f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089118 Aug 09 17:25:58.173050 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1839/3535] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:25:58.187915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86b939c4-ecc2-4a2c-8ace-1cf54384d4ee tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:58.189219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-86b939c4-ecc2-4a2c-8ace-1cf54384d4ee tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:58.202888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86b939c4-ecc2-4a2c-8ace-1cf54384d4ee tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:58.204184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86b939c4-ecc2-4a2c-8ace-1cf54384d4ee tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:58.205563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86b939c4-ecc2-4a2c-8ace-1cf54384d4ee tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:58.212868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86b939c4-ecc2-4a2c-8ace-1cf54384d4ee tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:58.213822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86b939c4-ecc2-4a2c-8ace-1cf54384d4ee tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:58.214580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86b939c4-ecc2-4a2c-8ace-1cf54384d4ee tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:58.514092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86b939c4-ecc2-4a2c-8ace-1cf54384d4ee tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:58.517029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:25:58.528986 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86b939c4-ecc2-4a2c-8ace-1cf54384d4ee tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1507 microversion: 2.1 time: 0.354050 Aug 09 17:25:58.530675 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1840/3536] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:58 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:58.536494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-89e34797-d2ac-473f-aac9-4f4be01bf483 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:58.537590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-89e34797-d2ac-473f-aac9-4f4be01bf483 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:58.561312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89e34797-d2ac-473f-aac9-4f4be01bf483 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:58.564231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89e34797-d2ac-473f-aac9-4f4be01bf483 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:58.566025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89e34797-d2ac-473f-aac9-4f4be01bf483 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:58.567337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89e34797-d2ac-473f-aac9-4f4be01bf483 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:58.570378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89e34797-d2ac-473f-aac9-4f4be01bf483 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:58.574058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89e34797-d2ac-473f-aac9-4f4be01bf483 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:59.175017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-89e34797-d2ac-473f-aac9-4f4be01bf483 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:59.209513 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-89e34797-d2ac-473f-aac9-4f4be01bf483 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.677076 Aug 09 17:25:59.212437 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1841/3537] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:58 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:59.228460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-377e3637-64ad-479a-a574-55921473ed19 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:59.229516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-377e3637-64ad-479a-a574-55921473ed19 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:59.257170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-377e3637-64ad-479a-a574-55921473ed19 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:59.258012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-377e3637-64ad-479a-a574-55921473ed19 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:59.259353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-377e3637-64ad-479a-a574-55921473ed19 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:59.260694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-377e3637-64ad-479a-a574-55921473ed19 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:59.261525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-377e3637-64ad-479a-a574-55921473ed19 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:59.262297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-377e3637-64ad-479a-a574-55921473ed19 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:59.306061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-65d86ca8-94c8-48e8-9146-0f09e539b762 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:59.334088 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-65d86ca8-94c8-48e8-9146-0f09e539b762 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c" status: 200 len: 1516 microversion: 2.1 time: 1.281441 Aug 09 17:25:59.335186 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1697/3538] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:58 2022] GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c => generated 1516 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:59.380744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:59.381932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:59.394189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:59.403936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:59.403936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:59.403936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:59.403936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:59.403936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:59.560741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:59.563752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:59.565711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:59.568400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lazy-loading 'fault' on Instance uuid 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:25:59.658344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-377e3637-64ad-479a-a574-55921473ed19 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:59.696028 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-377e3637-64ad-479a-a574-55921473ed19 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 200 len: 1507 microversion: 2.1 time: 0.480253 Aug 09 17:25:59.697786 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1842/3539] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:59 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:59.715142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bbf846bb-b7e9-4ec2-b186-e62207bff553 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:59.720998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bbf846bb-b7e9-4ec2-b186-e62207bff553 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:59.740441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbf846bb-b7e9-4ec2-b186-e62207bff553 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:59.741286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbf846bb-b7e9-4ec2-b186-e62207bff553 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:59.741800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2507f894c94f49ea8eaeea81a1c51cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244304db496b4d36bd1b7bb9329c5ccd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:25:59.742386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbf846bb-b7e9-4ec2-b186-e62207bff553 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:59.743939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbf846bb-b7e9-4ec2-b186-e62207bff553 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:59.744995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbf846bb-b7e9-4ec2-b186-e62207bff553 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:59.745712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbf846bb-b7e9-4ec2-b186-e62207bff553 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:59.763505 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-166100b1-d976-4a3b-b2d5-b2d279ee822e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 200 len: 1366 microversion: 2.1 time: 0.413134 Aug 09 17:25:59.764164 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1698/3540] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:59 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:25:59.802676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-05fef05d-93f0-4daa-aea3-f00278bb6223 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:25:59.804035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-05fef05d-93f0-4daa-aea3-f00278bb6223 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:25:59.818864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05fef05d-93f0-4daa-aea3-f00278bb6223 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:59.820117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05fef05d-93f0-4daa-aea3-f00278bb6223 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:59.821372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05fef05d-93f0-4daa-aea3-f00278bb6223 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:59.823193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05fef05d-93f0-4daa-aea3-f00278bb6223 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:25:59.824281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05fef05d-93f0-4daa-aea3-f00278bb6223 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:25:59.825113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05fef05d-93f0-4daa-aea3-f00278bb6223 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:25:59.877531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:00.077615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bbf846bb-b7e9-4ec2-b186-e62207bff553 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:00.087832 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bbf846bb-b7e9-4ec2-b186-e62207bff553 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1607 microversion: 2.1 time: 0.387823 Aug 09 17:26:00.088786 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1843/3541] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:59 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1607 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:00.096226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fc1bd22d-a17c-4a51-a6c1-44e35c134520 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:00.097627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fc1bd22d-a17c-4a51-a6c1-44e35c134520 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: a3849289-6789-43f2-a9d8-a9ad534af137] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:00.106957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc1bd22d-a17c-4a51-a6c1-44e35c134520 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:00.107926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc1bd22d-a17c-4a51-a6c1-44e35c134520 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:00.108643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc1bd22d-a17c-4a51-a6c1-44e35c134520 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:00.109723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc1bd22d-a17c-4a51-a6c1-44e35c134520 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:00.110468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc1bd22d-a17c-4a51-a6c1-44e35c134520 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:00.111153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc1bd22d-a17c-4a51-a6c1-44e35c134520 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:00.382768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fc1bd22d-a17c-4a51-a6c1-44e35c134520 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:00.408372 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fc1bd22d-a17c-4a51-a6c1-44e35c134520 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137" status: 200 len: 1515 microversion: 2.1 time: 0.317429 Aug 09 17:26:00.410636 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1844/3542] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:00 2022] GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 => generated 1515 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:00.426702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8cc9c306-ea88-4cfa-905a-6d1cb64db241 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:00.428118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8cc9c306-ea88-4cfa-905a-6d1cb64db241 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:00.469635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-05fef05d-93f0-4daa-aea3-f00278bb6223 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:00.486886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cc9c306-ea88-4cfa-905a-6d1cb64db241 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:00.489693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cc9c306-ea88-4cfa-905a-6d1cb64db241 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:00.493956 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-05fef05d-93f0-4daa-aea3-f00278bb6223 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.699594 Aug 09 17:26:00.495346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cc9c306-ea88-4cfa-905a-6d1cb64db241 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:00.500681 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1699/3543] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:25:59 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:00.502370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cc9c306-ea88-4cfa-905a-6d1cb64db241 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:00.504688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cc9c306-ea88-4cfa-905a-6d1cb64db241 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:00.507005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cc9c306-ea88-4cfa-905a-6d1cb64db241 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:00.523208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8de5feb0-a410-445a-9a7a-7bd86be764a6 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:00.526230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8de5feb0-a410-445a-9a7a-7bd86be764a6 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: a3849289-6789-43f2-a9d8-a9ad534af137] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:00.538733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:00.542999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de5feb0-a410-445a-9a7a-7bd86be764a6 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:00.544271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de5feb0-a410-445a-9a7a-7bd86be764a6 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:00.545551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de5feb0-a410-445a-9a7a-7bd86be764a6 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:00.548413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de5feb0-a410-445a-9a7a-7bd86be764a6 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:00.550108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de5feb0-a410-445a-9a7a-7bd86be764a6 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:00.551501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8de5feb0-a410-445a-9a7a-7bd86be764a6 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:00.659914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8cc9c306-ea88-4cfa-905a-6d1cb64db241 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:26:00.709624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8de5feb0-a410-445a-9a7a-7bd86be764a6 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: a3849289-6789-43f2-a9d8-a9ad534af137] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:26:00.935594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:00.963763 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8cc9c306-ea88-4cfa-905a-6d1cb64db241 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "DELETE /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 204 len: 0 microversion: 2.1 time: 0.549731 Aug 09 17:26:00.964870 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1845/3544] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:26:00 2022] DELETE /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:26:00.987821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:00.999323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] [instance: 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:01.039870 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8de5feb0-a410-445a-9a7a-7bd86be764a6 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137" status: 204 len: 0 microversion: 2.1 time: 0.536010 Aug 09 17:26:01.041520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:01.043144 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1700/3545] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:26:00 2022] DELETE /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:26:01.044903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:01.045832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:01.048684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:01.049643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:01.050467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:01.080053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ea76ffb8-b55a-425b-b8d9-78c547e3b2db tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-523849885", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:01.116552 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] HTTP exception thrown: Instance 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 could not be found. Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ea76ffb8-b55a-425b-b8d9-78c547e3b2db tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 237 Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-523849885", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-523849885', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.121415 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ea76ffb8-b55a-425b-b8d9-78c547e3b2db tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:01.139156 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ea76ffb8-b55a-425b-b8d9-78c547e3b2db tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.075980 Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Request method failure captured: Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 HTTP/1.1 Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phK9iLpRtjckJpmw1Ts1n_zk_yxyxTIkqWRIMKPL0l4oD_PJo6Axxu1Sa8fwy9T_K7dyRJ4lyhSoiwIdr4Y2U6MwPTHYMLklhKWj7_F-KP_6nEIW0uDiWizeC743ctzim5r0JFTfh0qZ9Mn6B-KfjvTYfGex3l5w0tK_24-FjHJmsg Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 244304db496b4d36bd1b7bb9329c5ccd Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestManualDisk-1671799457 Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_244304db496b4d36bd1b7bb9329c5ccd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/244304db496b4d36bd1b7bb9329c5ccd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/244304db496b4d36bd1b7bb9329c5ccd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/244304db496b4d36bd1b7bb9329c5ccd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestManualDisk-1671799457 Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 244304db496b4d36bd1b7bb9329c5ccd Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestManualDisk-1671799457 Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestManualDisk-1671799457-project Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2507f894c94f49ea8eaeea81a1c51cbe Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestManualDisk-1671799457-project Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 could not be found. Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '6836a3c0-24e0-4afb-ba44-bcbdf81c4f11'} Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 could not be found. Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 could not be found. Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:01.144742 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.155054 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:01.155054 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:01.155054 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:01.155054 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:01.155054 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:01.155054 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 could not be found. Aug 09 17:26:01.155054 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:01.156031 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1701/3546] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:26:01 2022] POST /compute/v2.1/servers => generated 139 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:26:01.156217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Returning 404 to user: Instance 6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:01.156217 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f397ad4a-e8a6-46f4-9cbe-7f70194cad4a tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11" status: 404 len: 111 microversion: 2.1 time: 0.163829 Aug 09 17:26:01.156217 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1846/3547] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:00 2022] GET /compute/v2.1/servers/6836a3c0-24e0-4afb-ba44-bcbdf81c4f11 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:01.157923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-56889d5c-87ca-4789-bb2a-501ff3fbc9d8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:01.163715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-56889d5c-87ca-4789-bb2a-501ff3fbc9d8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: a3849289-6789-43f2-a9d8-a9ad534af137] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:01.170322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6ff01ad7-7804-40e7-a46b-a98086636503 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:01.171603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6ff01ad7-7804-40e7-a46b-a98086636503 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:01.189137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56889d5c-87ca-4789-bb2a-501ff3fbc9d8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:01.193430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56889d5c-87ca-4789-bb2a-501ff3fbc9d8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:01.194176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56889d5c-87ca-4789-bb2a-501ff3fbc9d8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:01.196991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ff01ad7-7804-40e7-a46b-a98086636503 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:01.197872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56889d5c-87ca-4789-bb2a-501ff3fbc9d8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:01.198795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56889d5c-87ca-4789-bb2a-501ff3fbc9d8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:01.200403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ff01ad7-7804-40e7-a46b-a98086636503 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:01.201857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ff01ad7-7804-40e7-a46b-a98086636503 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:01.202527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ff01ad7-7804-40e7-a46b-a98086636503 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:01.203375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ff01ad7-7804-40e7-a46b-a98086636503 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:01.204127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56889d5c-87ca-4789-bb2a-501ff3fbc9d8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:01.208386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ff01ad7-7804-40e7-a46b-a98086636503 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:01.401316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6ff01ad7-7804-40e7-a46b-a98086636503 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:01.433539 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6ff01ad7-7804-40e7-a46b-a98086636503 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1540 microversion: 2.1 time: 0.280896 Aug 09 17:26:01.437831 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1847/3548] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:01 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1540 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:01.468712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f9ee5861-fd3c-4217-bf14-beb0f0550505 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:01.470008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f9ee5861-fd3c-4217-bf14-beb0f0550505 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:01.483910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9ee5861-fd3c-4217-bf14-beb0f0550505 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:01.484790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9ee5861-fd3c-4217-bf14-beb0f0550505 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:01.485586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9ee5861-fd3c-4217-bf14-beb0f0550505 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:01.486997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9ee5861-fd3c-4217-bf14-beb0f0550505 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:01.488299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9ee5861-fd3c-4217-bf14-beb0f0550505 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:01.489398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9ee5861-fd3c-4217-bf14-beb0f0550505 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:01.743293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-56889d5c-87ca-4789-bb2a-501ff3fbc9d8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:01.762614 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-56889d5c-87ca-4789-bb2a-501ff3fbc9d8 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137" status: 200 len: 1521 microversion: 2.1 time: 0.627512 Aug 09 17:26:01.767096 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1702/3549] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:01 2022] GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 => generated 1521 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:01.784025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7a901c90-2189-4f57-9deb-78f6f7728b6e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] Calling method '.version_select at 0x7fbbca54e4c0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:01.842472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f9ee5861-fd3c-4217-bf14-beb0f0550505 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:01.843775 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7a901c90-2189-4f57-9deb-78f6f7728b6e tempest-ServersTestManualDisk-1671799457 tempest-ServersTestManualDisk-1671799457-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-636248063" status: 202 len: 0 microversion: 2.1 time: 0.073911 Aug 09 17:26:01.848273 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1703/3550] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-636248063 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:26:01.865342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-799176921", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "055845a8-a394-4733-87e3-0b3f44e28918"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:01.872944 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f9ee5861-fd3c-4217-bf14-beb0f0550505 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.430635 Aug 09 17:26:01.874061 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1848/3551] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:01 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:01.902855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6a74a07f-074a-4cac-af68-e5612ae237ea req-341eaa42-4a1d-4040-8e22-1c664f222a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "386101c4-2bef-4f17-86d6-e70ca4d09f4c", "name": "network-vif-deleted", "tag": "2d1a3f9a-b942-4480-8909-0e4cbb3f802f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:01.947543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6a74a07f-074a-4cac-af68-e5612ae237ea req-341eaa42-4a1d-4040-8e22-1c664f222a02 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:01.952245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6a74a07f-074a-4cac-af68-e5612ae237ea req-341eaa42-4a1d-4040-8e22-1c664f222a02 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:01.953458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6a74a07f-074a-4cac-af68-e5612ae237ea req-341eaa42-4a1d-4040-8e22-1c664f222a02 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:02.002924 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6a74a07f-074a-4cac-af68-e5612ae237ea req-341eaa42-4a1d-4040-8e22-1c664f222a02 service nova] Creating event network-vif-deleted:2d1a3f9a-b942-4480-8909-0e4cbb3f802f for instance 386101c4-2bef-4f17-86d6-e70ca4d09f4c on n-h1-845781-6 Aug 09 17:26:02.014702 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6a74a07f-074a-4cac-af68-e5612ae237ea req-341eaa42-4a1d-4040-8e22-1c664f222a02 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137521 Aug 09 17:26:02.017187 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1849/3552] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:02.028354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c3505b1-3e2d-4520-884a-ff069bf08b00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:02.028993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7c3505b1-3e2d-4520-884a-ff069bf08b00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:02.076792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] validate_networks() for [('055845a8-a394-4733-87e3-0b3f44e28918', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:26:02.083081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3505b1-3e2d-4520-884a-ff069bf08b00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:02.083722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3505b1-3e2d-4520-884a-ff069bf08b00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:02.087455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3505b1-3e2d-4520-884a-ff069bf08b00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:02.094094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3505b1-3e2d-4520-884a-ff069bf08b00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:02.094594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3505b1-3e2d-4520-884a-ff069bf08b00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:02.095064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3505b1-3e2d-4520-884a-ff069bf08b00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:02.476859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7c3505b1-3e2d-4520-884a-ff069bf08b00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:02.494286 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7c3505b1-3e2d-4520-884a-ff069bf08b00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.474924 Aug 09 17:26:02.497268 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1850/3553] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:02 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:02.526454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-40829168-aa84-4802-832b-91d01d989b7a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:02.532521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-40829168-aa84-4802-832b-91d01d989b7a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:02.577756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40829168-aa84-4802-832b-91d01d989b7a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:02.578731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40829168-aa84-4802-832b-91d01d989b7a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:02.579495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40829168-aa84-4802-832b-91d01d989b7a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:02.587474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40829168-aa84-4802-832b-91d01d989b7a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:02.604253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40829168-aa84-4802-832b-91d01d989b7a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:02.608356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40829168-aa84-4802-832b-91d01d989b7a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:02.688764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:02.945566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-40829168-aa84-4802-832b-91d01d989b7a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:02.985477 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-40829168-aa84-4802-832b-91d01d989b7a tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1251 microversion: 2.1 time: 0.481481 Aug 09 17:26:02.990131 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1851/3554] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:02 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1251 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:03.023274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74943447-5fc9-4f81-8564-f90a65f3f7d6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-719263586", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74943447-5fc9-4f81-8564-f90a65f3f7d6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 234 Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-719263586", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-719263586', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:03.037428 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:03.051284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74943447-5fc9-4f81-8564-f90a65f3f7d6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:03.061484 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-74943447-5fc9-4f81-8564-f90a65f3f7d6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.067843 Aug 09 17:26:03.063446 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1852/3555] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:26:02 2022] POST /compute/v2.1/servers => generated 133 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:26:03.080915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-966a3169-be37-4425-acd9-4922614b6a62 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:03.082537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-966a3169-be37-4425-acd9-4922614b6a62 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: a3849289-6789-43f2-a9d8-a9ad534af137] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:03.097670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966a3169-be37-4425-acd9-4922614b6a62 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:03.099063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966a3169-be37-4425-acd9-4922614b6a62 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:03.100937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966a3169-be37-4425-acd9-4922614b6a62 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:03.103871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966a3169-be37-4425-acd9-4922614b6a62 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:03.105065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966a3169-be37-4425-acd9-4922614b6a62 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:03.106209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966a3169-be37-4425-acd9-4922614b6a62 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:03.307880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-966a3169-be37-4425-acd9-4922614b6a62 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:03.317378 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-966a3169-be37-4425-acd9-4922614b6a62 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137" status: 200 len: 1521 microversion: 2.1 time: 0.244904 Aug 09 17:26:03.318009 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1853/3556] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:03 2022] GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:03.344494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8bb99ec3-4e99-4caa-b9d0-1cd286b6d725 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:03.345129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8bb99ec3-4e99-4caa-b9d0-1cd286b6d725 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:03.358220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb99ec3-4e99-4caa-b9d0-1cd286b6d725 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:03.359251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb99ec3-4e99-4caa-b9d0-1cd286b6d725 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:03.359942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb99ec3-4e99-4caa-b9d0-1cd286b6d725 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:03.360941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb99ec3-4e99-4caa-b9d0-1cd286b6d725 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:03.361439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb99ec3-4e99-4caa-b9d0-1cd286b6d725 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:03.362000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb99ec3-4e99-4caa-b9d0-1cd286b6d725 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:03.667859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8bb99ec3-4e99-4caa-b9d0-1cd286b6d725 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:03.677081 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8bb99ec3-4e99-4caa-b9d0-1cd286b6d725 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.336452 Aug 09 17:26:03.677702 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1854/3557] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:03 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:03.701177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3abe7bca-d6f4-40a7-a377-ae7b7d565b8f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:03.702125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3abe7bca-d6f4-40a7-a377-ae7b7d565b8f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:03.710792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abe7bca-d6f4-40a7-a377-ae7b7d565b8f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:03.712106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abe7bca-d6f4-40a7-a377-ae7b7d565b8f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:03.712762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abe7bca-d6f4-40a7-a377-ae7b7d565b8f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:03.713850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abe7bca-d6f4-40a7-a377-ae7b7d565b8f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:03.714514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abe7bca-d6f4-40a7-a377-ae7b7d565b8f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:03.715157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3abe7bca-d6f4-40a7-a377-ae7b7d565b8f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:03.742178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:04.052089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3abe7bca-d6f4-40a7-a377-ae7b7d565b8f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:04.064110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:04.077147 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3abe7bca-d6f4-40a7-a377-ae7b7d565b8f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.380591 Aug 09 17:26:04.097608 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1855/3558] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:03 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:04.117572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8df78435-a084-4f93-a7c8-fd29e2c61ee9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:04.119199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8df78435-a084-4f93-a7c8-fd29e2c61ee9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:04.133321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8df78435-a084-4f93-a7c8-fd29e2c61ee9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:04.135725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8df78435-a084-4f93-a7c8-fd29e2c61ee9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:04.137586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8df78435-a084-4f93-a7c8-fd29e2c61ee9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:04.139227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8df78435-a084-4f93-a7c8-fd29e2c61ee9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:04.140528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8df78435-a084-4f93-a7c8-fd29e2c61ee9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:04.141726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8df78435-a084-4f93-a7c8-fd29e2c61ee9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:04.224256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:04.318871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8df78435-a084-4f93-a7c8-fd29e2c61ee9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:04.338045 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8df78435-a084-4f93-a7c8-fd29e2c61ee9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1251 microversion: 2.1 time: 0.226730 Aug 09 17:26:04.339431 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1856/3559] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:04 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1251 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:04.373996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:26:04.377089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:26:04.381786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1a65e6c-ee25-4921-9c9f-99333d6850fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:04.382742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1a65e6c-ee25-4921-9c9f-99333d6850fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 8e1794ad-efcf-4bdd-9001-b349ee78f02e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:04.385207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:26:04.386331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:26:04.387614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:26:04.396440 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-a1a65e6c-ee25-4921-9c9f-99333d6850fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 8e1794ad-efcf-4bdd-9001-b349ee78f02e could not be found. Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1a65e6c-ee25-4921-9c9f-99333d6850fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/8e1794ad-efcf-4bdd-9001-b349ee78f02e/action HTTP/1.1 Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 13 Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: {"pause": {}} Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8e1794ad-efcf-4bdd-9001-b349ee78f02e could not be found. Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8e1794ad-efcf-4bdd-9001-b349ee78f02e', 'body': {'pause': {}}} Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1794ad-efcf-4bdd-9001-b349ee78f02e could not be found. Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1794ad-efcf-4bdd-9001-b349ee78f02e could not be found. Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:04.407531 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:04.417250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:04.417250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:04.417250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1794ad-efcf-4bdd-9001-b349ee78f02e could not be found. Aug 09 17:26:04.417250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:04.417250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1a65e6c-ee25-4921-9c9f-99333d6850fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 8e1794ad-efcf-4bdd-9001-b349ee78f02e could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:04.424037 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1a65e6c-ee25-4921-9c9f-99333d6850fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/8e1794ad-efcf-4bdd-9001-b349ee78f02e/action" status: 404 len: 111 microversion: 2.1 time: 0.057582 Aug 09 17:26:04.424037 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1857/3560] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:04 2022] POST /compute/v2.1/servers/8e1794ad-efcf-4bdd-9001-b349ee78f02e/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:04.449644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f52064a4-9587-4bfe-b234-00ba25a5a75f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:04.454494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f52064a4-9587-4bfe-b234-00ba25a5a75f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: a3849289-6789-43f2-a9d8-a9ad534af137] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:04.472189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:04.473579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:04.474542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:04.477742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:04.478785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:04.482760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:04.505857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52064a4-9587-4bfe-b234-00ba25a5a75f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:04.510320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52064a4-9587-4bfe-b234-00ba25a5a75f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:04.510660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52064a4-9587-4bfe-b234-00ba25a5a75f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:04.512202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52064a4-9587-4bfe-b234-00ba25a5a75f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:04.513841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52064a4-9587-4bfe-b234-00ba25a5a75f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:04.524436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52064a4-9587-4bfe-b234-00ba25a5a75f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:04.575346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Getting quotas for project 3d02fc56a4a14bb398febacd9f5d59b7. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:26:04.608550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Getting quotas for user 1ecbb00be7c34d3b930097d65e06ee21 and project 3d02fc56a4a14bb398febacd9f5d59b7. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:26:04.693089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:26:04.703352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:26:04.894458 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-697cd408-a5ff-4f0c-9e0b-165a691afec7 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.043492 Aug 09 17:26:04.896395 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1704/3561] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:26:04.929868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-257ac0e1-5f84-4a07-aed0-5dd4aa7efde7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:04.932928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-257ac0e1-5f84-4a07-aed0-5dd4aa7efde7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:04.982424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257ac0e1-5f84-4a07-aed0-5dd4aa7efde7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:04.983238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257ac0e1-5f84-4a07-aed0-5dd4aa7efde7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:04.984103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257ac0e1-5f84-4a07-aed0-5dd4aa7efde7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:04.991819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257ac0e1-5f84-4a07-aed0-5dd4aa7efde7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:04.993083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257ac0e1-5f84-4a07-aed0-5dd4aa7efde7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:04.994011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-257ac0e1-5f84-4a07-aed0-5dd4aa7efde7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:05.163074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f52064a4-9587-4bfe-b234-00ba25a5a75f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:05.180987 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f52064a4-9587-4bfe-b234-00ba25a5a75f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137" status: 200 len: 1521 microversion: 2.1 time: 0.751704 Aug 09 17:26:05.182484 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1858/3562] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:04 2022] GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 => generated 1521 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:05.206223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1156b4f-9f08-46b3-8150-428e34743685 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:05.211244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d1156b4f-9f08-46b3-8150-428e34743685 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:05.408961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d1156b4f-9f08-46b3-8150-428e34743685 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:05.436518 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1156b4f-9f08-46b3-8150-428e34743685 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1217 microversion: 2.1 time: 0.251658 Aug 09 17:26:05.437695 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1859/3563] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:05 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1217 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:05.458758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51d1ed33-07d0-4fa8-87b8-2ffa3956ddba tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:05.460111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-51d1ed33-07d0-4fa8-87b8-2ffa3956ddba tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:05.482087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1ed33-07d0-4fa8-87b8-2ffa3956ddba tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:05.482995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1ed33-07d0-4fa8-87b8-2ffa3956ddba tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:05.483839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1ed33-07d0-4fa8-87b8-2ffa3956ddba tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:05.500176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1ed33-07d0-4fa8-87b8-2ffa3956ddba tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:05.501792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1ed33-07d0-4fa8-87b8-2ffa3956ddba tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:05.502816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51d1ed33-07d0-4fa8-87b8-2ffa3956ddba tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:05.540806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:05.685632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-51d1ed33-07d0-4fa8-87b8-2ffa3956ddba tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:05.718554 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51d1ed33-07d0-4fa8-87b8-2ffa3956ddba tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1251 microversion: 2.1 time: 0.278588 Aug 09 17:26:05.720265 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1860/3564] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:05 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1251 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:05.738770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5e57e188-10a2-4b3d-881e-6ae6fa9469d8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:05.750779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5e57e188-10a2-4b3d-881e-6ae6fa9469d8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:05.781287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e57e188-10a2-4b3d-881e-6ae6fa9469d8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:05.782515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e57e188-10a2-4b3d-881e-6ae6fa9469d8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:05.787478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e57e188-10a2-4b3d-881e-6ae6fa9469d8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:05.789774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e57e188-10a2-4b3d-881e-6ae6fa9469d8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:05.798653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e57e188-10a2-4b3d-881e-6ae6fa9469d8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:05.799882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e57e188-10a2-4b3d-881e-6ae6fa9469d8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:05.942920 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5e57e188-10a2-4b3d-881e-6ae6fa9469d8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e/ips" status: 200 len: 150 microversion: 2.1 time: 0.220522 Aug 09 17:26:05.956522 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1861/3565] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:26:05 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e/ips => generated 150 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:05.990248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e5b64f0-1b05-42b9-957b-3298d9b70c4d"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:06.004484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:06.051663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:06.054324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:06.058528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:06.063420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:06.068322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:06.069454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:06.301960 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Invalid volume: volume 7e5b64f0-1b05-42b9-957b-3298d9b70c4d is already attached to instances: 55b120e8-277c-49bb-83e5-1de30e80fd50 Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e/os-volume_attachments HTTP/1.1 Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 74 Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: {"volumeAttachment": {"volumeId": "7e5b64f0-1b05-42b9-957b-3298d9b70c4d"}} Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid volume: volume 7e5b64f0-1b05-42b9-957b-3298d9b70c4d is already attached to instances: 55b120e8-277c-49bb-83e5-1de30e80fd50 Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': '68d735cc-f758-4a9a-aff1-4831ccbeaf3e', 'body': {'volumeAttachment': {'volumeId': '7e5b64f0-1b05-42b9-957b-3298d9b70c4d'}}} Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7e5b64f0-1b05-42b9-957b-3298d9b70c4d is already attached to instances: 55b120e8-277c-49bb-83e5-1de30e80fd50 Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:06.303679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7e5b64f0-1b05-42b9-957b-3298d9b70c4d is already attached to instances: 55b120e8-277c-49bb-83e5-1de30e80fd50 Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7e5b64f0-1b05-42b9-957b-3298d9b70c4d is already attached to instances: 55b120e8-277c-49bb-83e5-1de30e80fd50 Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 400 to user: Invalid volume: volume 7e5b64f0-1b05-42b9-957b-3298d9b70c4d is already attached to instances: 55b120e8-277c-49bb-83e5-1de30e80fd50 {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:06.317686 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d6b7eb02-4cc0-444c-896e-85758ce6e725 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.333111 Aug 09 17:26:06.327486 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1862/3566] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:26:05 2022] POST /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e/os-volume_attachments => generated 174 bytes in 357 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:26:06.332812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:06.333590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: a3849289-6789-43f2-a9d8-a9ad534af137] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:06.376126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:06.376643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:06.377106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:06.377859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:06.378338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:06.378794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:06.472178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-257ac0e1-5f84-4a07-aed0-5dd4aa7efde7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:06.501626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:06.502430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:06.503068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:06.505940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lazy-loading 'fault' on Instance uuid a3849289-6789-43f2-a9d8-a9ad534af137 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:26:06.532412 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-257ac0e1-5f84-4a07-aed0-5dd4aa7efde7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.629860 Aug 09 17:26:06.549457 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1705/3567] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:04 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:06.586270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-050a56c1-7c25-4c6b-bc44-96bce02c57e0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:06.594510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-050a56c1-7c25-4c6b-bc44-96bce02c57e0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:06.627029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-050a56c1-7c25-4c6b-bc44-96bce02c57e0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:06.628262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-050a56c1-7c25-4c6b-bc44-96bce02c57e0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:06.629884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-050a56c1-7c25-4c6b-bc44-96bce02c57e0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:06.631844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-050a56c1-7c25-4c6b-bc44-96bce02c57e0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:06.632846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-050a56c1-7c25-4c6b-bc44-96bce02c57e0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:06.633666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-050a56c1-7c25-4c6b-bc44-96bce02c57e0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:06.735044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-050a56c1-7c25-4c6b-bc44-96bce02c57e0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:26:06.817470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:06.830866 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dbac80ab-1546-42a3-9f71-4aae8d5513a9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137" status: 200 len: 1313 microversion: 2.1 time: 0.502077 Aug 09 17:26:06.835807 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1863/3568] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:06 2022] GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:06.859822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-49839b35-d920-414e-acf6-82905c557008 req-3d7ae988-ca61-4e51-9dce-d8107186d78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3849289-6789-43f2-a9d8-a9ad534af137", "name": "network-vif-deleted", "tag": "b05aa514-314d-40fa-b1e3-1cf724fba850"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:06.905174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-49839b35-d920-414e-acf6-82905c557008 req-3d7ae988-ca61-4e51-9dce-d8107186d78d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:06.905409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-49839b35-d920-414e-acf6-82905c557008 req-3d7ae988-ca61-4e51-9dce-d8107186d78d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:06.905875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-49839b35-d920-414e-acf6-82905c557008 req-3d7ae988-ca61-4e51-9dce-d8107186d78d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:06.993921 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-49839b35-d920-414e-acf6-82905c557008 req-3d7ae988-ca61-4e51-9dce-d8107186d78d service nova] Creating event network-vif-deleted:b05aa514-314d-40fa-b1e3-1cf724fba850 for instance a3849289-6789-43f2-a9d8-a9ad534af137 on n-h1-845781-6 Aug 09 17:26:07.006333 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-49839b35-d920-414e-acf6-82905c557008 req-3d7ae988-ca61-4e51-9dce-d8107186d78d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168789 Aug 09 17:26:07.013055 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1864/3569] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:07.026128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-81d2ecef-9f91-4760-97f7-dd7a3ecbda09 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:07.034483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-81d2ecef-9f91-4760-97f7-dd7a3ecbda09 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:07.053709 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-050a56c1-7c25-4c6b-bc44-96bce02c57e0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 204 len: 0 microversion: 2.1 time: 0.501778 Aug 09 17:26:07.055080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81d2ecef-9f91-4760-97f7-dd7a3ecbda09 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:07.060052 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1706/3570] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:26:06 2022] DELETE /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:26:07.060589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81d2ecef-9f91-4760-97f7-dd7a3ecbda09 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:07.061363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81d2ecef-9f91-4760-97f7-dd7a3ecbda09 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:07.063108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81d2ecef-9f91-4760-97f7-dd7a3ecbda09 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:07.064121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81d2ecef-9f91-4760-97f7-dd7a3ecbda09 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:07.066090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81d2ecef-9f91-4760-97f7-dd7a3ecbda09 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:07.087114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d0429c6d-22e8-473e-926d-46ca8dd237c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:07.091178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d0429c6d-22e8-473e-926d-46ca8dd237c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:07.130493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0429c6d-22e8-473e-926d-46ca8dd237c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:07.132277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0429c6d-22e8-473e-926d-46ca8dd237c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:07.133921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0429c6d-22e8-473e-926d-46ca8dd237c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:07.146508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0429c6d-22e8-473e-926d-46ca8dd237c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:07.149716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0429c6d-22e8-473e-926d-46ca8dd237c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:07.152719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0429c6d-22e8-473e-926d-46ca8dd237c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:07.452444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81d2ecef-9f91-4760-97f7-dd7a3ecbda09 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:07.506936 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-81d2ecef-9f91-4760-97f7-dd7a3ecbda09 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1221 microversion: 2.1 time: 0.491666 Aug 09 17:26:07.512818 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1865/3571] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:07 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1221 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:07.538507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b6ca141-2ebe-411c-87e5-48140845f6f9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:07.542078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7b6ca141-2ebe-411c-87e5-48140845f6f9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:07.574776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6ca141-2ebe-411c-87e5-48140845f6f9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:07.575654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6ca141-2ebe-411c-87e5-48140845f6f9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:07.576419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6ca141-2ebe-411c-87e5-48140845f6f9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:07.577731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6ca141-2ebe-411c-87e5-48140845f6f9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:07.578775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6ca141-2ebe-411c-87e5-48140845f6f9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:07.579807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6ca141-2ebe-411c-87e5-48140845f6f9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:07.621611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d0429c6d-22e8-473e-926d-46ca8dd237c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:07.646839 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d0429c6d-22e8-473e-926d-46ca8dd237c2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.583376 Aug 09 17:26:07.647964 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1707/3572] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:07 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:07.671549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f9f7d232-ce4d-401b-a95f-fc7ed8b38fe9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:07.673540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f9f7d232-ce4d-401b-a95f-fc7ed8b38fe9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:07.708614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9f7d232-ce4d-401b-a95f-fc7ed8b38fe9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:07.710181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9f7d232-ce4d-401b-a95f-fc7ed8b38fe9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:07.711394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9f7d232-ce4d-401b-a95f-fc7ed8b38fe9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:07.713320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9f7d232-ce4d-401b-a95f-fc7ed8b38fe9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:07.714613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9f7d232-ce4d-401b-a95f-fc7ed8b38fe9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:07.717316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9f7d232-ce4d-401b-a95f-fc7ed8b38fe9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:07.942504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7b6ca141-2ebe-411c-87e5-48140845f6f9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:07.980902 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b6ca141-2ebe-411c-87e5-48140845f6f9 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1251 microversion: 2.1 time: 0.465385 Aug 09 17:26:07.982395 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1866/3573] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:07 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1251 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:08.023329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3af682ff-2f30-4012-97a8-55ea70f123c4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:08.028181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3af682ff-2f30-4012-97a8-55ea70f123c4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:08.061121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3af682ff-2f30-4012-97a8-55ea70f123c4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.065352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3af682ff-2f30-4012-97a8-55ea70f123c4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.066803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3af682ff-2f30-4012-97a8-55ea70f123c4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.084866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3af682ff-2f30-4012-97a8-55ea70f123c4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.088967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3af682ff-2f30-4012-97a8-55ea70f123c4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.090201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3af682ff-2f30-4012-97a8-55ea70f123c4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.163425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f9f7d232-ce4d-401b-a95f-fc7ed8b38fe9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:08.182664 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f9f7d232-ce4d-401b-a95f-fc7ed8b38fe9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1682 microversion: 2.1 time: 0.532815 Aug 09 17:26:08.184876 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1708/3574] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:07 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1682 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:08.196024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:08.197486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: a3849289-6789-43f2-a9d8-a9ad534af137] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:08.209130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.210534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.212669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.214637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.215930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.216942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.251759 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] HTTP exception thrown: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Request method failure captured: Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 HTTP/1.1 Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8piGO8VRgKg21tVdPdzsZc6KZqRfwYkHVC6H27Q_N2zGmGL3SQdNk7T1cmGAs1ERFC5EhLRzvewWux3hMyMDxZMRkBSF-BliO9n2qAQurEQtL-6v0g4xx8lAMv7qMhB4GxDwr5BOGcVDUOp9YVvqEfS5EeibdjWenJ486MlmEgrfIws Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: c5f08f55c76e4eedba90dd9877c4b9fb Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'a3849289-6789-43f2-a9d8-a9ad534af137'} Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.255485 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:08.265605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.265605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:08.265605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:08.265605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:08.265605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:08.265605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:08.265605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:08.265605 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.265605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Returning 404 to user: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:08.265605 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d4ef551e-2e9a-42ff-a203-4004e2acbc59 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137" status: 404 len: 111 microversion: 2.1 time: 0.076290 Aug 09 17:26:08.265605 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1709/3575] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:08 2022] GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:08.290662 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3af682ff-2f30-4012-97a8-55ea70f123c4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 202 len: 0 microversion: 2.1 time: 0.296742 Aug 09 17:26:08.293507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3d8c69f8-c1bf-4442-a877-091cb0a410e5 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:08.296693 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1867/3576] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:07 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:26:08.315908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-468b7307-2bab-4042-a945-262d696fb945 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:08.317214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-468b7307-2bab-4042-a945-262d696fb945 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:08.321617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d8c69f8-c1bf-4442-a877-091cb0a410e5 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:08.323331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3d8c69f8-c1bf-4442-a877-091cb0a410e5 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '0618f7424f8041c4b49eda56fcee9bb0'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:26:08.345466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-468b7307-2bab-4042-a945-262d696fb945 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.350298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8c69f8-c1bf-4442-a877-091cb0a410e5 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.351167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8c69f8-c1bf-4442-a877-091cb0a410e5 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.351991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8c69f8-c1bf-4442-a877-091cb0a410e5 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.353908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8c69f8-c1bf-4442-a877-091cb0a410e5 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.354706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8c69f8-c1bf-4442-a877-091cb0a410e5 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.355416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-468b7307-2bab-4042-a945-262d696fb945 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.356575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-468b7307-2bab-4042-a945-262d696fb945 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.358192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-468b7307-2bab-4042-a945-262d696fb945 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.359759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-468b7307-2bab-4042-a945-262d696fb945 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.361045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8c69f8-c1bf-4442-a877-091cb0a410e5 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.362211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-468b7307-2bab-4042-a945-262d696fb945 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.558716 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3d8c69f8-c1bf-4442-a877-091cb0a410e5 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.285444 Aug 09 17:26:08.560705 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1710/3577] 10.222.0.93 () {58 vars in 1230 bytes} [Tue Aug 9 17:26:08 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:26:08.574822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f69c95dc-a960-4c0e-8a22-beb1c81d4b94 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:08.591833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f69c95dc-a960-4c0e-8a22-beb1c81d4b94 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:08.616606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69c95dc-a960-4c0e-8a22-beb1c81d4b94 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.620674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69c95dc-a960-4c0e-8a22-beb1c81d4b94 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.622123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69c95dc-a960-4c0e-8a22-beb1c81d4b94 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.629073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69c95dc-a960-4c0e-8a22-beb1c81d4b94 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.629967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69c95dc-a960-4c0e-8a22-beb1c81d4b94 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.631308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f69c95dc-a960-4c0e-8a22-beb1c81d4b94 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.763421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f69c95dc-a960-4c0e-8a22-beb1c81d4b94 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:08.797841 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f69c95dc-a960-4c0e-8a22-beb1c81d4b94 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1213 microversion: 2.1 time: 0.232018 Aug 09 17:26:08.800065 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1711/3578] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:08 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1213 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:08.820520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-28029faf-92c8-4939-a5aa-a5e11494ff67 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-28029faf-92c8-4939-a5aa-a5e11494ff67 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Request method failure captured: Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8piGO8VRgKg21tVdPdzsZc6KZqRfwYkHVC6H27Q_N2zGmGL3SQdNk7T1cmGAs1ERFC5EhLRzvewWux3hMyMDxZMRkBSF-BliO9n2qAQurEQtL-6v0g4xx8lAMv7qMhB4GxDwr5BOGcVDUOp9YVvqEfS5EeibdjWenJ486MlmEgrfIws Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: c5f08f55c76e4eedba90dd9877c4b9fb Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: action_args: {} Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 09 17:26:08.835109 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 09 17:26:08.841319 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:08.844009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-28029faf-92c8-4939-a5aa-a5e11494ff67 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:08.847897 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-28029faf-92c8-4939-a5aa-a5e11494ff67 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.043740 Aug 09 17:26:08.847897 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1712/3579] 10.222.0.93 () {58 vars in 1182 bytes} [Tue Aug 9 17:26:08 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:26:08.874295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c205c09e-b282-4755-a3e9-024369face6b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:08.885667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c205c09e-b282-4755-a3e9-024369face6b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:08.887283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c205c09e-b282-4755-a3e9-024369face6b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Searching by: {'deleted': False, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:26:08.900864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c205c09e-b282-4755-a3e9-024369face6b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.901970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c205c09e-b282-4755-a3e9-024369face6b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.903029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c205c09e-b282-4755-a3e9-024369face6b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.904906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c205c09e-b282-4755-a3e9-024369face6b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:08.906341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c205c09e-b282-4755-a3e9-024369face6b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:08.907359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c205c09e-b282-4755-a3e9-024369face6b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:08.974611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-c205c09e-b282-4755-a3e9-024369face6b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:26:08.993667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-468b7307-2bab-4042-a945-262d696fb945 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:09.003674 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-468b7307-2bab-4042-a945-262d696fb945 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1509 microversion: 2.1 time: 0.700181 Aug 09 17:26:09.008195 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1868/3580] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:08 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1509 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:09.026585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0cccc5a7-4c6a-472d-8637-40da73f353e5 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:09.027227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0cccc5a7-4c6a-472d-8637-40da73f353e5 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:09.053032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cccc5a7-4c6a-472d-8637-40da73f353e5 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:09.053555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cccc5a7-4c6a-472d-8637-40da73f353e5 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:09.055905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cccc5a7-4c6a-472d-8637-40da73f353e5 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:09.059123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cccc5a7-4c6a-472d-8637-40da73f353e5 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:09.060746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cccc5a7-4c6a-472d-8637-40da73f353e5 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:09.061392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cccc5a7-4c6a-472d-8637-40da73f353e5 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:09.087598 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c205c09e-b282-4755-a3e9-024369face6b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.226175 Aug 09 17:26:09.103555 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1713/3581] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:26:08 2022] GET /compute/v2.1/servers => generated 683 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:09.113865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-acddb314-f958-495c-90f1-6ede145b8fda req-8bd48bf1-1c6f-4bd4-817f-a5c6bb7fdd2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77084f1c-828b-45e4-accc-a1ba292b1498", "name": "network-vif-deleted", "tag": "988208c6-a8e8-4757-864d-e9f90c5f0246"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:09.162360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-acddb314-f958-495c-90f1-6ede145b8fda req-8bd48bf1-1c6f-4bd4-817f-a5c6bb7fdd2f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:09.163710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-acddb314-f958-495c-90f1-6ede145b8fda req-8bd48bf1-1c6f-4bd4-817f-a5c6bb7fdd2f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:09.167924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-acddb314-f958-495c-90f1-6ede145b8fda req-8bd48bf1-1c6f-4bd4-817f-a5c6bb7fdd2f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:09.198402 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-acddb314-f958-495c-90f1-6ede145b8fda req-8bd48bf1-1c6f-4bd4-817f-a5c6bb7fdd2f service nova] Creating event network-vif-deleted:988208c6-a8e8-4757-864d-e9f90c5f0246 for instance 77084f1c-828b-45e4-accc-a1ba292b1498 on n-h2-845781-6 Aug 09 17:26:09.217721 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-acddb314-f958-495c-90f1-6ede145b8fda req-8bd48bf1-1c6f-4bd4-817f-a5c6bb7fdd2f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109288 Aug 09 17:26:09.220416 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1714/3582] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:09.234706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:09.246637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:09.247993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.compute.servers [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Removing options 'limit' from query {{(pid=119432) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 09 17:26:09.251495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Searching by: {'deleted': False, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:26:09.263335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:09.264643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:09.265757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:09.269207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:09.269934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:09.271246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:09.282167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0cccc5a7-4c6a-472d-8637-40da73f353e5 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:09.317307 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0cccc5a7-4c6a-472d-8637-40da73f353e5 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1251 microversion: 2.1 time: 0.294506 Aug 09 17:26:09.320461 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1869/3583] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:09 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1251 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:09.340131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af4fb053-3d7a-4bff-bf6f-ae4f99c9a8c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:09.343674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-af4fb053-3d7a-4bff-bf6f-ae4f99c9a8c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:09.368975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af4fb053-3d7a-4bff-bf6f-ae4f99c9a8c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:09.373538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af4fb053-3d7a-4bff-bf6f-ae4f99c9a8c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:09.377774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af4fb053-3d7a-4bff-bf6f-ae4f99c9a8c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:09.381177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af4fb053-3d7a-4bff-bf6f-ae4f99c9a8c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:09.384407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af4fb053-3d7a-4bff-bf6f-ae4f99c9a8c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:09.388282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af4fb053-3d7a-4bff-bf6f-ae4f99c9a8c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:09.404114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:26:09.494237 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4ba69e65-5fc1-4d49-abd8-5f6d402b04cd tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.266079 Aug 09 17:26:09.551894 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1715/3584] 10.222.0.93 () {58 vars in 1144 bytes} [Tue Aug 9 17:26:09 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:09.558727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72975174-1493-4e8a-934f-70bfc1832955 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72975174-1493-4e8a-934f-70bfc1832955 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Request method failure captured: Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8piGO8VRgKg21tVdPdzsZc6KZqRfwYkHVC6H27Q_N2zGmGL3SQdNk7T1cmGAs1ERFC5EhLRzvewWux3hMyMDxZMRkBSF-BliO9n2qAQurEQtL-6v0g4xx8lAMv7qMhB4GxDwr5BOGcVDUOp9YVvqEfS5EeibdjWenJ486MlmEgrfIws Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: c5f08f55c76e4eedba90dd9877c4b9fb Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: action_args: {} Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi '-1' Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 09 17:26:09.614108 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.628382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72975174-1493-4e8a-934f-70bfc1832955 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:09.633006 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72975174-1493-4e8a-934f-70bfc1832955 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.074736 Aug 09 17:26:09.636581 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1716/3585] 10.222.0.93 () {58 vars in 1142 bytes} [Tue Aug 9 17:26:09 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:26:09.652794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-219cf521-2773-49ab-a8a6-1cd331cbb99c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-219cf521-2773-49ab-a8a6-1cd331cbb99c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Request method failure captured: Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8piGO8VRgKg21tVdPdzsZc6KZqRfwYkHVC6H27Q_N2zGmGL3SQdNk7T1cmGAs1ERFC5EhLRzvewWux3hMyMDxZMRkBSF-BliO9n2qAQurEQtL-6v0g4xx8lAMv7qMhB4GxDwr5BOGcVDUOp9YVvqEfS5EeibdjWenJ486MlmEgrfIws Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: c5f08f55c76e4eedba90dd9877c4b9fb Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: action_args: {} Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'testing' Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 09 17:26:09.669228 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-219cf521-2773-49ab-a8a6-1cd331cbb99c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:09.675451 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-219cf521-2773-49ab-a8a6-1cd331cbb99c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.023462 Aug 09 17:26:09.689767 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1717/3586] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:26:09 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 17:26:09.697803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2ec089e6-ca77-48b6-9131-2724e2ba3a56 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:09.746185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2ec089e6-ca77-48b6-9131-2724e2ba3a56 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:09.752415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2ec089e6-ca77-48b6-9131-2724e2ba3a56 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:26:09.794905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.compute.servers [None req-2ec089e6-ca77-48b6-9131-2724e2ba3a56 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Flavor 'non_existing_flavor' could not be found {{(pid=119432) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 09 17:26:09.796210 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2ec089e6-ca77-48b6-9131-2724e2ba3a56 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.104847 Aug 09 17:26:09.797257 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1718/3587] 10.222.0.93 () {58 vars in 1178 bytes} [Tue Aug 9 17:26:09 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:26:09.812185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-639a9151-d57a-43af-b443-d6b875e1a7db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:09.826925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-639a9151-d57a-43af-b443-d6b875e1a7db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:09.837396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-639a9151-d57a-43af-b443-d6b875e1a7db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:26:09.850931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-639a9151-d57a-43af-b443-d6b875e1a7db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:09.860508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-639a9151-d57a-43af-b443-d6b875e1a7db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:09.861265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-639a9151-d57a-43af-b443-d6b875e1a7db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:09.862329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-639a9151-d57a-43af-b443-d6b875e1a7db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:09.863078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-639a9151-d57a-43af-b443-d6b875e1a7db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:09.863757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-639a9151-d57a-43af-b443-d6b875e1a7db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:10.109875 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-639a9151-d57a-43af-b443-d6b875e1a7db tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.302118 Aug 09 17:26:10.111462 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1719/3588] 10.222.0.93 () {58 vars in 1174 bytes} [Tue Aug 9 17:26:09 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:26:10.116955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-084c0a0d-57dc-4672-af91-df87583911c1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:10.118173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-084c0a0d-57dc-4672-af91-df87583911c1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:10.125939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-084c0a0d-57dc-4672-af91-df87583911c1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:10.126896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-084c0a0d-57dc-4672-af91-df87583911c1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:10.129159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-084c0a0d-57dc-4672-af91-df87583911c1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:10.130555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-084c0a0d-57dc-4672-af91-df87583911c1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:10.131581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-084c0a0d-57dc-4672-af91-df87583911c1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:10.132411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-084c0a0d-57dc-4672-af91-df87583911c1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:10.655497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-084c0a0d-57dc-4672-af91-df87583911c1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:10.659152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-af4fb053-3d7a-4bff-bf6f-ae4f99c9a8c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:10.692174 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-084c0a0d-57dc-4672-af91-df87583911c1 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1275 microversion: 2.1 time: 0.574611 Aug 09 17:26:10.694664 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1720/3589] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:10 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1275 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:10.700289 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-af4fb053-3d7a-4bff-bf6f-ae4f99c9a8c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1682 microversion: 2.1 time: 1.374105 Aug 09 17:26:10.721296 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1870/3590] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:09 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1682 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:10.732630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-48efe946-797b-483b-8ea6-4127cbd53852 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:10.733825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-48efe946-797b-483b-8ea6-4127cbd53852 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:10.770789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f2100e67-aa58-4576-ad93-2f7dd22ee41c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:10.793493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48efe946-797b-483b-8ea6-4127cbd53852 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:10.800885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48efe946-797b-483b-8ea6-4127cbd53852 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:10.801707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48efe946-797b-483b-8ea6-4127cbd53852 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:10.803103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48efe946-797b-483b-8ea6-4127cbd53852 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:10.806593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f2100e67-aa58-4576-ad93-2f7dd22ee41c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:10.808793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f2100e67-aa58-4576-ad93-2f7dd22ee41c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:26:10.816695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48efe946-797b-483b-8ea6-4127cbd53852 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:10.817906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48efe946-797b-483b-8ea6-4127cbd53852 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:10.839557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2100e67-aa58-4576-ad93-2f7dd22ee41c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:10.840718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2100e67-aa58-4576-ad93-2f7dd22ee41c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:10.843136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2100e67-aa58-4576-ad93-2f7dd22ee41c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:10.846333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2100e67-aa58-4576-ad93-2f7dd22ee41c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:10.849319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2100e67-aa58-4576-ad93-2f7dd22ee41c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:10.852956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2100e67-aa58-4576-ad93-2f7dd22ee41c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:10.868013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:11.234910 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f2100e67-aa58-4576-ad93-2f7dd22ee41c tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.509095 Aug 09 17:26:11.236289 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1871/3591] 10.222.0.93 () {58 vars in 1184 bytes} [Tue Aug 9 17:26:10 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:26:11.261511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43d64358-051d-4f7a-98e4-00d8e5f4f027 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:11.264225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-43d64358-051d-4f7a-98e4-00d8e5f4f027 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:11.298693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d64358-051d-4f7a-98e4-00d8e5f4f027 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:11.299966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d64358-051d-4f7a-98e4-00d8e5f4f027 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:11.302108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d64358-051d-4f7a-98e4-00d8e5f4f027 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:11.305254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d64358-051d-4f7a-98e4-00d8e5f4f027 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:11.308458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d64358-051d-4f7a-98e4-00d8e5f4f027 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:11.311880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43d64358-051d-4f7a-98e4-00d8e5f4f027 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:11.626224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-43d64358-051d-4f7a-98e4-00d8e5f4f027 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:11.647075 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43d64358-051d-4f7a-98e4-00d8e5f4f027 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1251 microversion: 2.1 time: 0.400754 Aug 09 17:26:11.648099 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1872/3592] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:11 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1251 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:11.656746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:11.677076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:11.681922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Searching by: {'deleted': False, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:26:11.705781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:11.707932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:11.712033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:11.714110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:11.716371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:11.718272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:11.831023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:26:11.872592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-48efe946-797b-483b-8ea6-4127cbd53852 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:11.911210 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-48efe946-797b-483b-8ea6-4127cbd53852 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1489 microversion: 2.1 time: 1.211125 Aug 09 17:26:11.928777 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1721/3593] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:10 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1489 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:11.940096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:11.964239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:11.967526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:11.970427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:11.971509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9b4597c8-a3ce-46b2-bbad-a499609948c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:11.973308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9b4597c8-a3ce-46b2-bbad-a499609948c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:12.006372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b4597c8-a3ce-46b2-bbad-a499609948c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.010744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b4597c8-a3ce-46b2-bbad-a499609948c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.012114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b4597c8-a3ce-46b2-bbad-a499609948c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:12.017516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b4597c8-a3ce-46b2-bbad-a499609948c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.022140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b4597c8-a3ce-46b2-bbad-a499609948c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.031220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b4597c8-a3ce-46b2-bbad-a499609948c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:12.260492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9b4597c8-a3ce-46b2-bbad-a499609948c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:12.309120 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9b4597c8-a3ce-46b2-bbad-a499609948c0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1275 microversion: 2.1 time: 0.371079 Aug 09 17:26:12.312835 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1722/3594] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:11 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1275 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:12.367592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3d6dd1eb-351b-4a0b-a974-419a79c5c6cc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:12.373421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3d6dd1eb-351b-4a0b-a974-419a79c5c6cc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:12.423027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6dd1eb-351b-4a0b-a974-419a79c5c6cc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.424612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6dd1eb-351b-4a0b-a974-419a79c5c6cc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.425896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6dd1eb-351b-4a0b-a974-419a79c5c6cc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:12.428081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6dd1eb-351b-4a0b-a974-419a79c5c6cc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.429251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6dd1eb-351b-4a0b-a974-419a79c5c6cc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.433308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d6dd1eb-351b-4a0b-a974-419a79c5c6cc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:12.526858 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-85cf0883-a3b9-4516-b6e1-142d02380b9b tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.876976 Aug 09 17:26:12.535846 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1873/3595] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:26:11 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:12.555902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:12.556870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:12.569915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.570919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.576649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:12.577840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.578651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.579350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:12.621124 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Cannot 'pause' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state paused Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action HTTP/1.1 Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 13 Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: {"pause": {}} Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: exception: Cannot 'pause' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state paused Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9af26977-0da1-475d-b754-4460e79e4fc3', 'body': {'pause': {}}} Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 in vm_state paused. Cannot pause while the instance is in this state. Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state paused Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:12.624805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:12.632096 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:12.632096 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:12.632096 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:12.632096 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state paused Aug 09 17:26:12.632096 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:12.633845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 409 to user: Cannot 'pause' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state paused {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:12.635046 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-29255a2c-1c6b-4134-bfd7-b49449e4f7bd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 409 len: 143 microversion: 2.1 time: 0.098089 Aug 09 17:26:12.637199 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1874/3596] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:12 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 143 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:26:12.642894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6ad458a5-4bd9-4d75-9861-6da091dc1483 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:12.650351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6ad458a5-4bd9-4d75-9861-6da091dc1483 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:12.651995 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6ad458a5-4bd9-4d75-9861-6da091dc1483 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013199 Aug 09 17:26:12.653248 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1875/3597] 10.222.0.93 () {58 vars in 1178 bytes} [Tue Aug 9 17:26:12 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:26:12.658918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-402d79d4-a52c-45e5-ac73-5d30b5b659e4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:12.661371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-402d79d4-a52c-45e5-ac73-5d30b5b659e4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:12.674885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402d79d4-a52c-45e5-ac73-5d30b5b659e4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.675466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402d79d4-a52c-45e5-ac73-5d30b5b659e4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.678556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402d79d4-a52c-45e5-ac73-5d30b5b659e4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:12.678556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402d79d4-a52c-45e5-ac73-5d30b5b659e4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.678556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402d79d4-a52c-45e5-ac73-5d30b5b659e4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.678556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-402d79d4-a52c-45e5-ac73-5d30b5b659e4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:12.817661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:12.845148 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-402d79d4-a52c-45e5-ac73-5d30b5b659e4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 202 len: 0 microversion: 2.1 time: 0.189403 Aug 09 17:26:12.848221 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1876/3598] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:12 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:26:12.854611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d6dd1eb-351b-4a0b-a974-419a79c5c6cc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:12.864638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e84d07c3-0cb2-46d0-933d-58757bd22f74 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:12.875752 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3d6dd1eb-351b-4a0b-a974-419a79c5c6cc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 200 len: 1614 microversion: 2.1 time: 0.544554 Aug 09 17:26:12.880094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e84d07c3-0cb2-46d0-933d-58757bd22f74 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:12.880399 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1723/3599] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:12 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 1614 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:12.883422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e84d07c3-0cb2-46d0-933d-58757bd22f74 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Searching by: {'deleted': False, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:26:12.896059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e84d07c3-0cb2-46d0-933d-58757bd22f74 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.896343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad4b0364-be86-42c0-ba95-13724887fcc6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:12.897580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e84d07c3-0cb2-46d0-933d-58757bd22f74 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.899370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e84d07c3-0cb2-46d0-933d-58757bd22f74 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:12.901154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ad4b0364-be86-42c0-ba95-13724887fcc6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:12.901690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e84d07c3-0cb2-46d0-933d-58757bd22f74 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.903017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e84d07c3-0cb2-46d0-933d-58757bd22f74 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.904292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e84d07c3-0cb2-46d0-933d-58757bd22f74 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:12.944761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad4b0364-be86-42c0-ba95-13724887fcc6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.952993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad4b0364-be86-42c0-ba95-13724887fcc6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.956838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad4b0364-be86-42c0-ba95-13724887fcc6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:12.958808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad4b0364-be86-42c0-ba95-13724887fcc6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:12.960458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad4b0364-be86-42c0-ba95-13724887fcc6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:12.963782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad4b0364-be86-42c0-ba95-13724887fcc6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:13.022726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-e84d07c3-0cb2-46d0-933d-58757bd22f74 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:26:13.186616 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e84d07c3-0cb2-46d0-933d-58757bd22f74 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.330281 Aug 09 17:26:13.192122 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1877/3600] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:26:12 2022] GET /compute/v2.1/servers => generated 683 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:13.230554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-395a0fb5-a920-412a-80c5-5b6bbc4dd90f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:13.232728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-395a0fb5-a920-412a-80c5-5b6bbc4dd90f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:13.272937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395a0fb5-a920-412a-80c5-5b6bbc4dd90f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:13.274553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395a0fb5-a920-412a-80c5-5b6bbc4dd90f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:13.275418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395a0fb5-a920-412a-80c5-5b6bbc4dd90f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:13.276799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395a0fb5-a920-412a-80c5-5b6bbc4dd90f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:13.277698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395a0fb5-a920-412a-80c5-5b6bbc4dd90f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:13.278522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-395a0fb5-a920-412a-80c5-5b6bbc4dd90f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:13.998637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ad4b0364-be86-42c0-ba95-13724887fcc6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:14.017463 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad4b0364-be86-42c0-ba95-13724887fcc6 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1251 microversion: 2.1 time: 1.135299 Aug 09 17:26:14.020249 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1724/3601] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:12 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1251 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:14.036174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:14.037007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: a3849289-6789-43f2-a9d8-a9ad534af137] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:14.057546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:14.060757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:14.063000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:14.064049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:14.065713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:14.067410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:14.135480 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] HTTP exception thrown: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Request method failure captured: Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 HTTP/1.1 Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8piGO8VRgKg21tVdPdzsZc6KZqRfwYkHVC6H27Q_N2zGmGL3SQdNk7T1cmGAs1ERFC5EhLRzvewWux3hMyMDxZMRkBSF-BliO9n2qAQurEQtL-6v0g4xx8lAMv7qMhB4GxDwr5BOGcVDUOp9YVvqEfS5EeibdjWenJ486MlmEgrfIws Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: c5f08f55c76e4eedba90dd9877c4b9fb Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'a3849289-6789-43f2-a9d8-a9ad534af137'} Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:14.138655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:14.143221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:14.143221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:14.143221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:14.143221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:14.143221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:14.143221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:14.143221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:14.143221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:14.143221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:14.143221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:14.143221 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:14.147321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Returning 404 to user: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:14.148686 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2e08aca8-9703-46da-a170-e9d76c33b7fa tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137" status: 404 len: 111 microversion: 2.1 time: 0.126649 Aug 09 17:26:14.154412 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1725/3602] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:26:14 2022] DELETE /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:14.168663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-326f1c01-b0fc-49ed-b39c-5cfadec094a0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:14.172164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-326f1c01-b0fc-49ed-b39c-5cfadec094a0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:14.189855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326f1c01-b0fc-49ed-b39c-5cfadec094a0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:14.190634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326f1c01-b0fc-49ed-b39c-5cfadec094a0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:14.191243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326f1c01-b0fc-49ed-b39c-5cfadec094a0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:14.194651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326f1c01-b0fc-49ed-b39c-5cfadec094a0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:14.195555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326f1c01-b0fc-49ed-b39c-5cfadec094a0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:14.196806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-326f1c01-b0fc-49ed-b39c-5cfadec094a0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:14.404707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-326f1c01-b0fc-49ed-b39c-5cfadec094a0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:14.418390 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-326f1c01-b0fc-49ed-b39c-5cfadec094a0 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1275 microversion: 2.1 time: 0.262391 Aug 09 17:26:14.420368 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1726/3603] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:14 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:14.447878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-920b5faa-8350-4d5c-8990-4386ddf94507 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b85f3485-fb03-4e9b-a4b9-c39d05fb69a3"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:14.456984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-920b5faa-8350-4d5c-8990-4386ddf94507 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:14.481079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-920b5faa-8350-4d5c-8990-4386ddf94507 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:14.481729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-920b5faa-8350-4d5c-8990-4386ddf94507 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:14.482129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-920b5faa-8350-4d5c-8990-4386ddf94507 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:14.494051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-920b5faa-8350-4d5c-8990-4386ddf94507 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:14.499115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-920b5faa-8350-4d5c-8990-4386ddf94507 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:14.500649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-920b5faa-8350-4d5c-8990-4386ddf94507 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:14.664351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:15.309986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-395a0fb5-a920-412a-80c5-5b6bbc4dd90f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:15.351197 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-395a0fb5-a920-412a-80c5-5b6bbc4dd90f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1496 microversion: 2.1 time: 2.155411 Aug 09 17:26:15.372344 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1878/3604] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:13 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1496 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:15.387111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:15.394352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:15.420525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:15.424210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:15.425226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:15.432581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:15.434157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:15.436420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:15.510247 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e HTTP/1.1 Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '68d735cc-f758-4a9a-aff1-4831ccbeaf3e'} Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:15.523464 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:15.529188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:15.529188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:15.529188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:15.529188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:15.529188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:15.529188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:26:15.529188 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:15.534149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:15.536680 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-920b5faa-8350-4d5c-8990-4386ddf94507 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.113176 Aug 09 17:26:15.538448 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c7c191b1-ebd8-4e15-ab3a-6edad08b4aed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 404 len: 111 microversion: 2.1 time: 0.160897 Aug 09 17:26:15.543956 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1727/3605] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:26:14 2022] POST /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments => generated 194 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:15.547709 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1879/3606] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:15 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:15.579261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-858f2cfb-526e-4857-afec-009ba907d53e tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:15.580536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-31693321-12bb-41a0-828c-1171205f6ec4 req-fc9ee753-4180-4e81-855e-e5c4a78b3a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d735cc-f758-4a9a-aff1-4831ccbeaf3e", "name": "network-vif-deleted", "tag": "6d37a94b-6553-49ea-a0dc-ea5d53ef5fa5"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:15.583657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-858f2cfb-526e-4857-afec-009ba907d53e tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:15.637668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-858f2cfb-526e-4857-afec-009ba907d53e tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:15.639511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-858f2cfb-526e-4857-afec-009ba907d53e tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:15.640614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-858f2cfb-526e-4857-afec-009ba907d53e tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:15.643360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-858f2cfb-526e-4857-afec-009ba907d53e tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:15.644806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-858f2cfb-526e-4857-afec-009ba907d53e tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:15.647075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-858f2cfb-526e-4857-afec-009ba907d53e tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:15.684702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-31693321-12bb-41a0-828c-1171205f6ec4 req-fc9ee753-4180-4e81-855e-e5c4a78b3a92 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:15.685700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-31693321-12bb-41a0-828c-1171205f6ec4 req-fc9ee753-4180-4e81-855e-e5c4a78b3a92 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:15.686236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-31693321-12bb-41a0-828c-1171205f6ec4 req-fc9ee753-4180-4e81-855e-e5c4a78b3a92 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:15.753430 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-31693321-12bb-41a0-828c-1171205f6ec4 req-fc9ee753-4180-4e81-855e-e5c4a78b3a92 service nova] Creating event network-vif-deleted:6d37a94b-6553-49ea-a0dc-ea5d53ef5fa5 for instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e on n-h1-845781-6 Aug 09 17:26:15.788901 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-31693321-12bb-41a0-828c-1171205f6ec4 req-fc9ee753-4180-4e81-855e-e5c4a78b3a92 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226084 Aug 09 17:26:15.790000 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1728/3607] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:15.814506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-858f2cfb-526e-4857-afec-009ba907d53e tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:26:15.844629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f63ddc7e-83bc-4785-b65a-c5f56f3ad00c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:15.846154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f63ddc7e-83bc-4785-b65a-c5f56f3ad00c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:15.871997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f63ddc7e-83bc-4785-b65a-c5f56f3ad00c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:15.877417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f63ddc7e-83bc-4785-b65a-c5f56f3ad00c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:15.878967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f63ddc7e-83bc-4785-b65a-c5f56f3ad00c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:15.883958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f63ddc7e-83bc-4785-b65a-c5f56f3ad00c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:15.885501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f63ddc7e-83bc-4785-b65a-c5f56f3ad00c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:15.891498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f63ddc7e-83bc-4785-b65a-c5f56f3ad00c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:16.003088 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-858f2cfb-526e-4857-afec-009ba907d53e tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c" status: 204 len: 0 microversion: 2.1 time: 0.451411 Aug 09 17:26:16.004258 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1880/3608] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:26:15 2022] DELETE /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:26:16.052169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f96cea4d-5d2b-4ad9-a926-d1d56e33d402 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:16.075979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f96cea4d-5d2b-4ad9-a926-d1d56e33d402 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:16.115167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96cea4d-5d2b-4ad9-a926-d1d56e33d402 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:16.121679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96cea4d-5d2b-4ad9-a926-d1d56e33d402 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:16.128511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96cea4d-5d2b-4ad9-a926-d1d56e33d402 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:16.132255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96cea4d-5d2b-4ad9-a926-d1d56e33d402 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:16.133778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96cea4d-5d2b-4ad9-a926-d1d56e33d402 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:16.137246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f96cea4d-5d2b-4ad9-a926-d1d56e33d402 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:16.384619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f63ddc7e-83bc-4785-b65a-c5f56f3ad00c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:16.411612 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f63ddc7e-83bc-4785-b65a-c5f56f3ad00c tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1251 microversion: 2.1 time: 0.619573 Aug 09 17:26:16.412637 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1729/3609] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:15 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1251 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:16.444989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d0a5f1db-8944-4229-85d8-97beb092cdc4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '.version_select at 0x7fbbca514ee0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:16.500968 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d0a5f1db-8944-4229-85d8-97beb092cdc4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230050539" status: 202 len: 0 microversion: 2.1 time: 0.073623 Aug 09 17:26:16.507717 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1730/3610] 10.222.0.93 () {58 vars in 1221 bytes} [Tue Aug 9 17:26:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230050539 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:26:16.526416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ed8c6971-03ef-4b6b-b919-bb8dafcdf2e2 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:16.527301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ed8c6971-03ef-4b6b-b919-bb8dafcdf2e2 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:16.549712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8c6971-03ef-4b6b-b919-bb8dafcdf2e2 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:16.552228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8c6971-03ef-4b6b-b919-bb8dafcdf2e2 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:16.555130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8c6971-03ef-4b6b-b919-bb8dafcdf2e2 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:16.559010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8c6971-03ef-4b6b-b919-bb8dafcdf2e2 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:16.562409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8c6971-03ef-4b6b-b919-bb8dafcdf2e2 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:16.563980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed8c6971-03ef-4b6b-b919-bb8dafcdf2e2 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:16.666099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ed8c6971-03ef-4b6b-b919-bb8dafcdf2e2 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:26:16.929603 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ed8c6971-03ef-4b6b-b919-bb8dafcdf2e2 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 204 len: 0 microversion: 2.1 time: 0.420039 Aug 09 17:26:16.931349 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1731/3611] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:26:16 2022] DELETE /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:26:16.944876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a9633e5-0cc4-4bb1-beb7-d565c369837c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:16.952134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3a9633e5-0cc4-4bb1-beb7-d565c369837c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:16.965212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a9633e5-0cc4-4bb1-beb7-d565c369837c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:16.967978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a9633e5-0cc4-4bb1-beb7-d565c369837c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:16.969098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a9633e5-0cc4-4bb1-beb7-d565c369837c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:16.972666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a9633e5-0cc4-4bb1-beb7-d565c369837c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:16.973444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a9633e5-0cc4-4bb1-beb7-d565c369837c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:16.974121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a9633e5-0cc4-4bb1-beb7-d565c369837c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:17.066491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f96cea4d-5d2b-4ad9-a926-d1d56e33d402 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:17.093915 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f96cea4d-5d2b-4ad9-a926-d1d56e33d402 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1317 microversion: 2.1 time: 1.087522 Aug 09 17:26:17.101507 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1881/3612] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:16 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1317 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:17.115121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:17.126564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: a3849289-6789-43f2-a9d8-a9ad534af137] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:17.141872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:17.146815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:17.152750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:17.155164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:17.159176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:17.162544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:17.266599 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] HTTP exception thrown: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Request method failure captured: Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 HTTP/1.1 Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8piGO8VRgKg21tVdPdzsZc6KZqRfwYkHVC6H27Q_N2zGmGL3SQdNk7T1cmGAs1ERFC5EhLRzvewWux3hMyMDxZMRkBSF-BliO9n2qAQurEQtL-6v0g4xx8lAMv7qMhB4GxDwr5BOGcVDUOp9YVvqEfS5EeibdjWenJ486MlmEgrfIws Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: c5f08f55c76e4eedba90dd9877c4b9fb Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'a3849289-6789-43f2-a9d8-a9ad534af137'} Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:17.270304 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:17.280222 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:17.280222 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:17.280222 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:17.280222 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:17.280222 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:17.280222 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:17.280222 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. Aug 09 17:26:17.280222 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:17.280222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Returning 404 to user: Instance a3849289-6789-43f2-a9d8-a9ad534af137 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:17.289279 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d026b576-3c0a-4b73-83b3-3454e1c6e369 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137" status: 404 len: 111 microversion: 2.1 time: 0.185198 Aug 09 17:26:17.295405 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1882/3613] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:17 2022] GET /compute/v2.1/servers/a3849289-6789-43f2-a9d8-a9ad534af137 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:17.307376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7cdb9960-0e5f-4a9c-a1d3-6f80393e8711 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:17.308439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7cdb9960-0e5f-4a9c-a1d3-6f80393e8711 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:17.353365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdb9960-0e5f-4a9c-a1d3-6f80393e8711 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:17.358243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdb9960-0e5f-4a9c-a1d3-6f80393e8711 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:17.359605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdb9960-0e5f-4a9c-a1d3-6f80393e8711 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:17.370883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdb9960-0e5f-4a9c-a1d3-6f80393e8711 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:17.372381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdb9960-0e5f-4a9c-a1d3-6f80393e8711 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:17.373580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cdb9960-0e5f-4a9c-a1d3-6f80393e8711 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:17.851930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7cdb9960-0e5f-4a9c-a1d3-6f80393e8711 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:17.879189 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7cdb9960-0e5f-4a9c-a1d3-6f80393e8711 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c" status: 200 len: 1522 microversion: 2.1 time: 0.580197 Aug 09 17:26:17.881516 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1883/3614] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:17 2022] GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c => generated 1522 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:17.903737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:17.905131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:17.922722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:17.924005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:17.931137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:17.933678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:17.941693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:17.955827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:18.116999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:18.119609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:18.120902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:18.123456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lazy-loading 'fault' on Instance uuid 386101c4-2bef-4f17-86d6-e70ca4d09f4c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:26:18.276314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3910e7ce0b2488cadb01e3d6e617e94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c281514960bd499d83a4f683bf269d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:18.285567 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e7fd8c1-6418-46b6-a00b-4520e517c671 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 200 len: 1256 microversion: 2.1 time: 0.401042 Aug 09 17:26:18.291457 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1884/3615] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:17 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 1256 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:18.302269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-48adf47e-264e-4e0f-8a60-fdab878988de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:18.317795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-48adf47e-264e-4e0f-8a60-fdab878988de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:18.346886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48adf47e-264e-4e0f-8a60-fdab878988de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:18.350671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48adf47e-264e-4e0f-8a60-fdab878988de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:18.352581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48adf47e-264e-4e0f-8a60-fdab878988de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:18.355247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48adf47e-264e-4e0f-8a60-fdab878988de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:18.357134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48adf47e-264e-4e0f-8a60-fdab878988de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:18.357841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48adf47e-264e-4e0f-8a60-fdab878988de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:18.497653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a9633e5-0cc4-4bb1-beb7-d565c369837c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:18.511737 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3a9633e5-0cc4-4bb1-beb7-d565c369837c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.578786 Aug 09 17:26:18.526332 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1732/3616] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:16 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:18.550786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8fa9c0a3-e3f0-47ee-af17-6ad624d20f37 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:18.551547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8fa9c0a3-e3f0-47ee-af17-6ad624d20f37 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:18.572051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a3-e3f0-47ee-af17-6ad624d20f37 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:18.572739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a3-e3f0-47ee-af17-6ad624d20f37 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:18.573236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a3-e3f0-47ee-af17-6ad624d20f37 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:18.574148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a3-e3f0-47ee-af17-6ad624d20f37 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:18.575395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a3-e3f0-47ee-af17-6ad624d20f37 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:18.576639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa9c0a3-e3f0-47ee-af17-6ad624d20f37 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:19.482137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-48adf47e-264e-4e0f-8a60-fdab878988de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:19.517620 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-48adf47e-264e-4e0f-8a60-fdab878988de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1317 microversion: 2.1 time: 1.216918 Aug 09 17:26:19.518813 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1885/3617] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:18 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1317 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:19.562660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af140349-ab61-470c-aad2-7b15c893f42a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:19.565035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-af140349-ab61-470c-aad2-7b15c893f42a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:19.613743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af140349-ab61-470c-aad2-7b15c893f42a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:19.615378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af140349-ab61-470c-aad2-7b15c893f42a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:19.616415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af140349-ab61-470c-aad2-7b15c893f42a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:19.618306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af140349-ab61-470c-aad2-7b15c893f42a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:19.619608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af140349-ab61-470c-aad2-7b15c893f42a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:19.620697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af140349-ab61-470c-aad2-7b15c893f42a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:19.979646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=10 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:20.064067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8fa9c0a3-e3f0-47ee-af17-6ad624d20f37 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:20.077354 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8fa9c0a3-e3f0-47ee-af17-6ad624d20f37 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.534974 Aug 09 17:26:20.096524 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1733/3618] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:18 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:20.102511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:20.103146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] [instance: 386101c4-2bef-4f17-86d6-e70ca4d09f4c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:20.110855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:20.111351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:20.112068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:20.113065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:20.113699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:20.114668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:20.143788 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] HTTP exception thrown: Instance 386101c4-2bef-4f17-86d6-e70ca4d09f4c could not be found. Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Request method failure captured: Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c HTTP/1.1 Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pgPNy50WTU8qFUn2Wy4FisXig8Z1_MoPl3jTiqbt1i0CH8oq8xZbDNXIO6Ux7zKz3il15E5U20Gca6-ECdMLl4ru1xvS0JcH0iJmBJW84gC-kZXLS3yxdweaP2JK6VuFjlcWIEEYGSQGXBaUkmEJPReT89Y0Hap8tQJqMNoTu9gsC4 Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: c281514960bd499d83a4f683bf269d9e Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestBootFromVolume-76628901 Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c281514960bd499d83a4f683bf269d9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c281514960bd499d83a4f683bf269d9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c281514960bd499d83a4f683bf269d9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c281514960bd499d83a4f683bf269d9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestBootFromVolume-76628901 Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: c281514960bd499d83a4f683bf269d9e Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestBootFromVolume-76628901 Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestBootFromVolume-76628901-project Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: c3910e7ce0b2488cadb01e3d6e617e94 Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestBootFromVolume-76628901-project Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 386101c4-2bef-4f17-86d6-e70ca4d09f4c could not be found. Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '386101c4-2bef-4f17-86d6-e70ca4d09f4c'} Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 386101c4-2bef-4f17-86d6-e70ca4d09f4c could not be found. Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 386101c4-2bef-4f17-86d6-e70ca4d09f4c could not be found. Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:20.149541 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:20.154439 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:20.154439 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:20.154439 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:20.154439 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:20.154439 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:20.154439 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 386101c4-2bef-4f17-86d6-e70ca4d09f4c could not be found. Aug 09 17:26:20.154439 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:20.156033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Returning 404 to user: Instance 386101c4-2bef-4f17-86d6-e70ca4d09f4c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:20.158624 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5f616e0-2a51-47d7-a3d5-03dc1e8431b0 tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c" status: 404 len: 111 microversion: 2.1 time: 0.061229 Aug 09 17:26:20.160022 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1734/3619] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:20 2022] GET /compute/v2.1/servers/386101c4-2bef-4f17-86d6-e70ca4d09f4c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:20.170269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:20.179479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:20.204879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:20.205890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:20.206533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:20.207459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:20.208543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:20.209725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:20.244122 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c/action HTTP/1.1 Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 28 Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: {"reboot": {"type": "SOFT"}} Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '77c06398-1bb3-44b1-bc17-4db4dfd8294c', 'body': {'reboot': {'type': 'SOFT'}}} Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:20.246166 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:20.250910 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:26:20.250910 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:20.250910 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:20.250910 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:20.250910 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:20.250910 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:20.250910 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:20.250910 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:20.250910 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:20.250910 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:26:20.250910 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:20.252675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:20.253735 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ac480866-ecf0-4416-91af-bbbb352471c0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c/action" status: 404 len: 111 microversion: 2.1 time: 0.089238 Aug 09 17:26:20.260250 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1735/3620] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:20 2022] POST /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c/action => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:20.274971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-009c0dc4-15d8-4426-b7eb-d7215dfc29cf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] Calling method '.version_select at 0x7fbbca5968b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:20.294098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:20.322873 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-009c0dc4-15d8-4426-b7eb-d7215dfc29cf tempest-ServersTestBootFromVolume-76628901 tempest-ServersTestBootFromVolume-76628901-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-503018447" status: 202 len: 0 microversion: 2.1 time: 0.061020 Aug 09 17:26:20.324211 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1736/3621] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:26:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-503018447 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:26:20.337015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6258e2dc-7a53-4bbd-8b32-66c87afa37ce tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:20.344044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6258e2dc-7a53-4bbd-8b32-66c87afa37ce tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:20.381363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6258e2dc-7a53-4bbd-8b32-66c87afa37ce tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:20.382148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6258e2dc-7a53-4bbd-8b32-66c87afa37ce tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:20.382843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6258e2dc-7a53-4bbd-8b32-66c87afa37ce tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:20.383833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6258e2dc-7a53-4bbd-8b32-66c87afa37ce tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:20.384524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6258e2dc-7a53-4bbd-8b32-66c87afa37ce tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:20.385158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6258e2dc-7a53-4bbd-8b32-66c87afa37ce tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:20.780072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-af140349-ab61-470c-aad2-7b15c893f42a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:20.815293 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-af140349-ab61-470c-aad2-7b15c893f42a tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c" status: 200 len: 1522 microversion: 2.1 time: 1.287596 Aug 09 17:26:20.835452 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1886/3622] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:19 2022] GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c => generated 1522 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:20.855519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea487d57-48b2-4518-9044-c72fea7d859b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:20.865408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ea487d57-48b2-4518-9044-c72fea7d859b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:20.900542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea487d57-48b2-4518-9044-c72fea7d859b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:20.908915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea487d57-48b2-4518-9044-c72fea7d859b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:20.910432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea487d57-48b2-4518-9044-c72fea7d859b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:20.912175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea487d57-48b2-4518-9044-c72fea7d859b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:20.913551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea487d57-48b2-4518-9044-c72fea7d859b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:20.915233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea487d57-48b2-4518-9044-c72fea7d859b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:21.330389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ea487d57-48b2-4518-9044-c72fea7d859b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:21.346372 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ea487d57-48b2-4518-9044-c72fea7d859b tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1317 microversion: 2.1 time: 0.515440 Aug 09 17:26:21.350473 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1887/3623] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:20 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:21.379022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-155181d7-72ec-4809-8447-7e47d2e7b274 req-a3bdcb02-1f92-40f7-ac10-d9b1a4a43177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c69884e-c9e6-40ac-9855-1807d03686f1", "tag": "280cbdcc-d456-40b6-9c0f-cbe122512892"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:21.404761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-155181d7-72ec-4809-8447-7e47d2e7b274 req-a3bdcb02-1f92-40f7-ac10-d9b1a4a43177 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:21.408314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-155181d7-72ec-4809-8447-7e47d2e7b274 req-a3bdcb02-1f92-40f7-ac10-d9b1a4a43177 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:21.410710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-155181d7-72ec-4809-8447-7e47d2e7b274 req-a3bdcb02-1f92-40f7-ac10-d9b1a4a43177 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:21.457282 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-155181d7-72ec-4809-8447-7e47d2e7b274 req-a3bdcb02-1f92-40f7-ac10-d9b1a4a43177 service nova] Creating event network-changed:280cbdcc-d456-40b6-9c0f-cbe122512892 for instance 4c69884e-c9e6-40ac-9855-1807d03686f1 on n-h1-845781-6 Aug 09 17:26:21.477103 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-155181d7-72ec-4809-8447-7e47d2e7b274 req-a3bdcb02-1f92-40f7-ac10-d9b1a4a43177 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124384 Aug 09 17:26:21.478518 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1888/3624] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:21.887657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:21.892374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:21.937842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:21.964607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:21.971039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:21.974528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:21.985993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:21.988104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:21.992834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:22.114543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:22.117415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:22.122043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:22.124848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:22.128619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lazy-loading 'fault' on Instance uuid 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:26:22.193755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6258e2dc-7a53-4bbd-8b32-66c87afa37ce tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:22.209140 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6258e2dc-7a53-4bbd-8b32-66c87afa37ce tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.883440 Aug 09 17:26:22.218814 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1737/3625] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:20 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:22.249949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-54eb281d-d305-4c38-bf4b-54646c1cd333 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:22.251007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-54eb281d-d305-4c38-bf4b-54646c1cd333 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:22.268299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54eb281d-d305-4c38-bf4b-54646c1cd333 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:22.270472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54eb281d-d305-4c38-bf4b-54646c1cd333 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:22.274789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54eb281d-d305-4c38-bf4b-54646c1cd333 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:22.276033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54eb281d-d305-4c38-bf4b-54646c1cd333 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:22.276822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54eb281d-d305-4c38-bf4b-54646c1cd333 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:22.277704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54eb281d-d305-4c38-bf4b-54646c1cd333 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:22.323532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:22.344499 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f2a8701c-08f2-4590-8934-caf4743fefc9 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c" status: 200 len: 1313 microversion: 2.1 time: 0.480917 Aug 09 17:26:22.348833 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1889/3626] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:21 2022] GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:22.374773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c28c3713-527d-4597-aab0-6b3fac6d69e5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:22.375887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c28c3713-527d-4597-aab0-6b3fac6d69e5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:22.384004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c28c3713-527d-4597-aab0-6b3fac6d69e5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:22.391501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c28c3713-527d-4597-aab0-6b3fac6d69e5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:22.392840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c28c3713-527d-4597-aab0-6b3fac6d69e5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:22.397294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c28c3713-527d-4597-aab0-6b3fac6d69e5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:22.398349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c28c3713-527d-4597-aab0-6b3fac6d69e5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:22.401956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c28c3713-527d-4597-aab0-6b3fac6d69e5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:22.917066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:22.971373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c28c3713-527d-4597-aab0-6b3fac6d69e5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:22.980968 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c28c3713-527d-4597-aab0-6b3fac6d69e5 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1317 microversion: 2.1 time: 0.610214 Aug 09 17:26:22.988411 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1890/3627] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:22 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:23.204237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54eb281d-d305-4c38-bf4b-54646c1cd333 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:23.228456 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-54eb281d-d305-4c38-bf4b-54646c1cd333 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.978754 Aug 09 17:26:23.234739 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1738/3628] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:22 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:23.285418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1732811b-d3bc-4d5d-8c24-58ae3d05c94a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:23.289745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1732811b-d3bc-4d5d-8c24-58ae3d05c94a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: fe4a396f-261c-4147-b95e-01c1de837a65] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:23.333817 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-1732811b-d3bc-4d5d-8c24-58ae3d05c94a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance fe4a396f-261c-4147-b95e-01c1de837a65 could not be found. Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1732811b-d3bc-4d5d-8c24-58ae3d05c94a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/fe4a396f-261c-4147-b95e-01c1de837a65/action HTTP/1.1 Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 28 Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: {"reboot": {"type": "SOFT"}} Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fe4a396f-261c-4147-b95e-01c1de837a65 could not be found. Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'fe4a396f-261c-4147-b95e-01c1de837a65', 'body': {'reboot': {'type': 'SOFT'}}} Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4a396f-261c-4147-b95e-01c1de837a65 could not be found. Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4a396f-261c-4147-b95e-01c1de837a65 could not be found. Aug 09 17:26:23.341411 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:23.351067 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:23.351067 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:23.351067 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:23.351067 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:23.351067 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:23.351067 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:23.351067 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:23.351067 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4a396f-261c-4147-b95e-01c1de837a65 could not be found. Aug 09 17:26:23.351067 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:23.365732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1732811b-d3bc-4d5d-8c24-58ae3d05c94a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance fe4a396f-261c-4147-b95e-01c1de837a65 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:23.380076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:23.381231 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1732811b-d3bc-4d5d-8c24-58ae3d05c94a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/fe4a396f-261c-4147-b95e-01c1de837a65/action" status: 404 len: 111 microversion: 2.1 time: 0.093331 Aug 09 17:26:23.385784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:23.388482 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1891/3629] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:23 2022] POST /compute/v2.1/servers/fe4a396f-261c-4147-b95e-01c1de837a65/action => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:23.409295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-312d896c-5e28-49d2-9343-027602953532 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:23.418638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-312d896c-5e28-49d2-9343-027602953532 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:23.437355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-312d896c-5e28-49d2-9343-027602953532 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:23.443150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:23.446492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:23.447324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:23.452672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-312d896c-5e28-49d2-9343-027602953532 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:23.453291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:23.454091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:23.454754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:23.458983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-312d896c-5e28-49d2-9343-027602953532 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:23.460781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-312d896c-5e28-49d2-9343-027602953532 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:23.462071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-312d896c-5e28-49d2-9343-027602953532 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:23.473246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-312d896c-5e28-49d2-9343-027602953532 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:23.563219 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] HTTP exception thrown: Instance 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c could not be found. Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Request method failure captured: Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c HTTP/1.1 Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8piGO8VRgKg21tVdPdzsZc6KZqRfwYkHVC6H27Q_N2zGmGL3SQdNk7T1cmGAs1ERFC5EhLRzvewWux3hMyMDxZMRkBSF-BliO9n2qAQurEQtL-6v0g4xx8lAMv7qMhB4GxDwr5BOGcVDUOp9YVvqEfS5EeibdjWenJ486MlmEgrfIws Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: c5f08f55c76e4eedba90dd9877c4b9fb Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c could not be found. Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '4e4cb954-9e9a-40fa-aae8-792d85c3ec8c'} Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c could not be found. Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c could not be found. Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:23.572123 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:23.587453 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:23.587453 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:23.587453 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:23.587453 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:23.587453 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:23.587453 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:23.587453 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c could not be found. Aug 09 17:26:23.587453 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:23.587453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Returning 404 to user: Instance 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:23.587453 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-91d0b3a2-3807-4c4a-a4a5-d35cfde478f3 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c" status: 404 len: 111 microversion: 2.1 time: 0.202309 Aug 09 17:26:23.589918 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1739/3630] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:23 2022] GET /compute/v2.1/servers/4e4cb954-9e9a-40fa-aae8-792d85c3ec8c => generated 111 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:23.601403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b2df3110-d96e-4876-ba01-2eebe7262a55 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:23.608872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b2df3110-d96e-4876-ba01-2eebe7262a55 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:23.640392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2df3110-d96e-4876-ba01-2eebe7262a55 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:23.644094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2df3110-d96e-4876-ba01-2eebe7262a55 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:23.644984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2df3110-d96e-4876-ba01-2eebe7262a55 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:23.646352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2df3110-d96e-4876-ba01-2eebe7262a55 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:23.647071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2df3110-d96e-4876-ba01-2eebe7262a55 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:23.654528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2df3110-d96e-4876-ba01-2eebe7262a55 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:23.765439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:24.102492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b2df3110-d96e-4876-ba01-2eebe7262a55 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:24.145790 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b2df3110-d96e-4876-ba01-2eebe7262a55 tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1479 microversion: 2.1 time: 0.555769 Aug 09 17:26:24.164711 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1740/3631] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:23 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1479 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:24.172936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4758cb6c-5466-4ca6-aae3-4fe08da8972d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:24.175614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4758cb6c-5466-4ca6-aae3-4fe08da8972d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:24.193430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4758cb6c-5466-4ca6-aae3-4fe08da8972d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:24.194511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4758cb6c-5466-4ca6-aae3-4fe08da8972d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:24.205925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4758cb6c-5466-4ca6-aae3-4fe08da8972d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:24.207807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4758cb6c-5466-4ca6-aae3-4fe08da8972d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:24.208837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4758cb6c-5466-4ca6-aae3-4fe08da8972d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:24.211911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4758cb6c-5466-4ca6-aae3-4fe08da8972d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:24.512811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-4758cb6c-5466-4ca6-aae3-4fe08da8972d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lazy-loading 'services' on Instance uuid 55b120e8-277c-49bb-83e5-1de30e80fd50 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:26:24.563109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-312d896c-5e28-49d2-9343-027602953532 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:24.576803 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-312d896c-5e28-49d2-9343-027602953532 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.181690 Aug 09 17:26:24.582257 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1892/3632] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:23 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:24.594496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-62e3cfc1-3e6a-42a2-8f96-65684ea1a952 req-b3aba639-d4c4-4333-a6c2-cca2c10f91b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4cb954-9e9a-40fa-aae8-792d85c3ec8c", "name": "network-vif-deleted", "tag": "4d5e03c1-26f8-4526-ad81-4866e4f3a062"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:24.635022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-62e3cfc1-3e6a-42a2-8f96-65684ea1a952 req-b3aba639-d4c4-4333-a6c2-cca2c10f91b7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:24.636224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-62e3cfc1-3e6a-42a2-8f96-65684ea1a952 req-b3aba639-d4c4-4333-a6c2-cca2c10f91b7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:24.638115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-62e3cfc1-3e6a-42a2-8f96-65684ea1a952 req-b3aba639-d4c4-4333-a6c2-cca2c10f91b7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:24.661462 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-62e3cfc1-3e6a-42a2-8f96-65684ea1a952 req-b3aba639-d4c4-4333-a6c2-cca2c10f91b7 service nova] Creating event network-vif-deleted:4d5e03c1-26f8-4526-ad81-4866e4f3a062 for instance 4e4cb954-9e9a-40fa-aae8-792d85c3ec8c on n-h2-845781-6 Aug 09 17:26:24.685309 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-62e3cfc1-3e6a-42a2-8f96-65684ea1a952 req-b3aba639-d4c4-4333-a6c2-cca2c10f91b7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088387 Aug 09 17:26:24.687557 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1893/3633] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:24.694624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4ef50163-333c-410d-a4e5-348d1726d3d4 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:24.696385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4ef50163-333c-410d-a4e5-348d1726d3d4 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:24.721357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ef50163-333c-410d-a4e5-348d1726d3d4 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:24.722212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ef50163-333c-410d-a4e5-348d1726d3d4 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:24.723396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ef50163-333c-410d-a4e5-348d1726d3d4 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:24.727343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ef50163-333c-410d-a4e5-348d1726d3d4 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:24.729913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ef50163-333c-410d-a4e5-348d1726d3d4 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:24.730785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ef50163-333c-410d-a4e5-348d1726d3d4 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:24.740522 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4758cb6c-5466-4ca6-aae3-4fe08da8972d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments/7e5b64f0-1b05-42b9-957b-3298d9b70c4d" status: 202 len: 0 microversion: 2.1 time: 0.570521 Aug 09 17:26:24.742105 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1741/3634] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:26:24 2022] DELETE /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments/7e5b64f0-1b05-42b9-957b-3298d9b70c4d => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:26:24.754877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:24.760548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0913fd30-cb4e-4cde-90f2-0faf67f8491e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:24.762330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0913fd30-cb4e-4cde-90f2-0faf67f8491e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:24.787908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0913fd30-cb4e-4cde-90f2-0faf67f8491e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:24.788677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0913fd30-cb4e-4cde-90f2-0faf67f8491e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:24.788933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0913fd30-cb4e-4cde-90f2-0faf67f8491e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:24.791553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0913fd30-cb4e-4cde-90f2-0faf67f8491e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:24.795285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0913fd30-cb4e-4cde-90f2-0faf67f8491e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:24.795786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0913fd30-cb4e-4cde-90f2-0faf67f8491e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:25.144074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0913fd30-cb4e-4cde-90f2-0faf67f8491e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:25.167585 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0913fd30-cb4e-4cde-90f2-0faf67f8491e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.422538 Aug 09 17:26:25.191668 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1742/3635] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:24 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:25.201498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d309dc08-cffd-4f20-98ba-42e1199614c3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:25.214009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d309dc08-cffd-4f20-98ba-42e1199614c3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:25.240168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d309dc08-cffd-4f20-98ba-42e1199614c3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:25.241280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d309dc08-cffd-4f20-98ba-42e1199614c3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:25.244483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d309dc08-cffd-4f20-98ba-42e1199614c3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:25.245986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d309dc08-cffd-4f20-98ba-42e1199614c3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:25.253711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d309dc08-cffd-4f20-98ba-42e1199614c3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:25.254676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d309dc08-cffd-4f20-98ba-42e1199614c3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:25.371646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4ef50163-333c-410d-a4e5-348d1726d3d4 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:25.407154 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d309dc08-cffd-4f20-98ba-42e1199614c3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.225188 Aug 09 17:26:25.407386 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4ef50163-333c-410d-a4e5-348d1726d3d4 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1317 microversion: 2.1 time: 0.718029 Aug 09 17:26:25.408250 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1894/3636] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:24 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1317 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:25.417636 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1743/3637] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:26:25 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:25.420318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:25.421028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:25.435302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:25.441395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:25.441901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:25.442352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:25.443213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:25.445907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:25.446465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:25.453008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:25.479597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:25.481087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:25.489549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:25.491389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:25.493126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:25.494221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:25.519897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:25.521999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:25.524822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:25.525589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lazy-loading 'fault' on Instance uuid 1b045cc1-1ff2-49bc-b642-a2d09afba754 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:26:25.548406 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c/action HTTP/1.1 Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 65 Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '77c06398-1bb3-44b1-bc17-4db4dfd8294c', 'body': {'rebuild': {'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d'}}} Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 09 17:26:25.563693 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:26:25.577709 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:25.583204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:25.590014 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c1158f40-2305-427e-b569-919a6bd1fad3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c/action" status: 404 len: 111 microversion: 2.1 time: 0.166144 Aug 09 17:26:25.591524 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1744/3638] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:25 2022] POST /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c/action => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:25.618395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0474fb8c-d73f-4283-a5fb-d8a491a36207 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:25.627501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0474fb8c-d73f-4283-a5fb-d8a491a36207 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:25.654109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0474fb8c-d73f-4283-a5fb-d8a491a36207 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:25.655458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0474fb8c-d73f-4283-a5fb-d8a491a36207 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:25.656747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0474fb8c-d73f-4283-a5fb-d8a491a36207 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:25.659252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0474fb8c-d73f-4283-a5fb-d8a491a36207 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:25.667357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0474fb8c-d73f-4283-a5fb-d8a491a36207 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:25.668600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0474fb8c-d73f-4283-a5fb-d8a491a36207 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:25.763319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f08f55c76e4eedba90dd9877c4b9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0618f7424f8041c4b49eda56fcee9bb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:25.776009 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19fb451b-3e6b-47d1-b9ee-19dfec402deb tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 200 len: 1313 microversion: 2.1 time: 0.366505 Aug 09 17:26:25.781782 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1895/3639] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:25 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:26.425871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-183ef210-d661-47d2-9aa6-e060679ad9bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:26.430114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-183ef210-d661-47d2-9aa6-e060679ad9bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:26.457158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-183ef210-d661-47d2-9aa6-e060679ad9bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:26.463491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-183ef210-d661-47d2-9aa6-e060679ad9bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:26.464273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-183ef210-d661-47d2-9aa6-e060679ad9bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:26.465069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-183ef210-d661-47d2-9aa6-e060679ad9bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:26.468699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-183ef210-d661-47d2-9aa6-e060679ad9bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:26.471993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-183ef210-d661-47d2-9aa6-e060679ad9bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:26.633866 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-183ef210-d661-47d2-9aa6-e060679ad9bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213377 Aug 09 17:26:26.635267 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1896/3640] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:26:26 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:26.647320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-27efdfb0-0725-4562-810a-f9ea2b8a68d3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:26.648590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-27efdfb0-0725-4562-810a-f9ea2b8a68d3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:26.674451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27efdfb0-0725-4562-810a-f9ea2b8a68d3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:26.687910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27efdfb0-0725-4562-810a-f9ea2b8a68d3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:26.692401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27efdfb0-0725-4562-810a-f9ea2b8a68d3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:26.703666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27efdfb0-0725-4562-810a-f9ea2b8a68d3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:26.712708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27efdfb0-0725-4562-810a-f9ea2b8a68d3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:26.714199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27efdfb0-0725-4562-810a-f9ea2b8a68d3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:27.002824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0474fb8c-d73f-4283-a5fb-d8a491a36207 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:27.014473 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0474fb8c-d73f-4283-a5fb-d8a491a36207 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.410979 Aug 09 17:26:27.016256 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1745/3641] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:25 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:27.028570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-c11a3f4e-e55f-4e26-9e29-6b2482630f13 req-737e724d-bfa8-4dbb-be6b-0b36c403420a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b045cc1-1ff2-49bc-b642-a2d09afba754", "name": "network-vif-deleted", "tag": "2038b9f0-b2ff-4e5a-ad6e-c655c866443a"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:27.071598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c11a3f4e-e55f-4e26-9e29-6b2482630f13 req-737e724d-bfa8-4dbb-be6b-0b36c403420a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:27.072720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c11a3f4e-e55f-4e26-9e29-6b2482630f13 req-737e724d-bfa8-4dbb-be6b-0b36c403420a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:27.074085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c11a3f4e-e55f-4e26-9e29-6b2482630f13 req-737e724d-bfa8-4dbb-be6b-0b36c403420a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:27.109731 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-c11a3f4e-e55f-4e26-9e29-6b2482630f13 req-737e724d-bfa8-4dbb-be6b-0b36c403420a service nova] Creating event network-vif-deleted:2038b9f0-b2ff-4e5a-ad6e-c655c866443a for instance 1b045cc1-1ff2-49bc-b642-a2d09afba754 on n-h1-845781-6 Aug 09 17:26:27.124394 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-c11a3f4e-e55f-4e26-9e29-6b2482630f13 req-737e724d-bfa8-4dbb-be6b-0b36c403420a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103299 Aug 09 17:26:27.128981 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1746/3642] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:27.140435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:27.150314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] [instance: 1b045cc1-1ff2-49bc-b642-a2d09afba754] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:27.179073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:27.184834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:27.186244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:27.189235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:27.189788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:27.192423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:27.248176 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] HTTP exception thrown: Instance 1b045cc1-1ff2-49bc-b642-a2d09afba754 could not be found. Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Request method failure captured: Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 HTTP/1.1 Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8piGO8VRgKg21tVdPdzsZc6KZqRfwYkHVC6H27Q_N2zGmGL3SQdNk7T1cmGAs1ERFC5EhLRzvewWux3hMyMDxZMRkBSF-BliO9n2qAQurEQtL-6v0g4xx8lAMv7qMhB4GxDwr5BOGcVDUOp9YVvqEfS5EeibdjWenJ486MlmEgrfIws Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0618f7424f8041c4b49eda56fcee9bb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 0618f7424f8041c4b49eda56fcee9bb0 Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1949261148 Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: c5f08f55c76e4eedba90dd9877c4b9fb Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ListServersNegativeTestJSON-1949261148-project Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 1b045cc1-1ff2-49bc-b642-a2d09afba754 could not be found. Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '1b045cc1-1ff2-49bc-b642-a2d09afba754'} Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b045cc1-1ff2-49bc-b642-a2d09afba754 could not be found. Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b045cc1-1ff2-49bc-b642-a2d09afba754 could not be found. Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:27.253094 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:27.257950 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:27.257950 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:27.257950 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:27.257950 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:27.257950 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:27.257950 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:27.257950 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b045cc1-1ff2-49bc-b642-a2d09afba754 could not be found. Aug 09 17:26:27.257950 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:27.263423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] Returning 404 to user: Instance 1b045cc1-1ff2-49bc-b642-a2d09afba754 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:27.264713 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cc2d49af-469f-4120-8e72-14f1d0140d1f tempest-ListServersNegativeTestJSON-1949261148 tempest-ListServersNegativeTestJSON-1949261148-project] 10.222.0.93 "GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754" status: 404 len: 111 microversion: 2.1 time: 0.133652 Aug 09 17:26:27.265982 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1747/3643] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:27 2022] GET /compute/v2.1/servers/1b045cc1-1ff2-49bc-b642-a2d09afba754 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:27.272292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4f95f974-9715-4e1e-ac61-f9c17ca8c482 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:27.273433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4f95f974-9715-4e1e-ac61-f9c17ca8c482 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:27.282473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f95f974-9715-4e1e-ac61-f9c17ca8c482 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:27.283366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f95f974-9715-4e1e-ac61-f9c17ca8c482 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:27.284131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f95f974-9715-4e1e-ac61-f9c17ca8c482 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:27.285153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f95f974-9715-4e1e-ac61-f9c17ca8c482 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:27.285877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f95f974-9715-4e1e-ac61-f9c17ca8c482 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:27.286590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f95f974-9715-4e1e-ac61-f9c17ca8c482 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:28.522076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-27efdfb0-0725-4562-810a-f9ea2b8a68d3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:28.548900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-27efdfb0-0725-4562-810a-f9ea2b8a68d3 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1317 microversion: 2.1 time: 1.911610 Aug 09 17:26:28.557880 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1897/3644] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:26 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1317 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:28.579041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-889c3b45-5b75-400d-a15e-bbee45f3a0af tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:28.587003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-889c3b45-5b75-400d-a15e-bbee45f3a0af tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:28.612522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-889c3b45-5b75-400d-a15e-bbee45f3a0af tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:28.628154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-889c3b45-5b75-400d-a15e-bbee45f3a0af tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:28.634798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-889c3b45-5b75-400d-a15e-bbee45f3a0af tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:28.645044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-889c3b45-5b75-400d-a15e-bbee45f3a0af tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:28.646354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-889c3b45-5b75-400d-a15e-bbee45f3a0af tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:28.647510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-889c3b45-5b75-400d-a15e-bbee45f3a0af tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:28.794379 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-889c3b45-5b75-400d-a15e-bbee45f3a0af tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233666 Aug 09 17:26:28.808597 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1898/3645] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:26:28 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:29.250852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f95f974-9715-4e1e-ac61-f9c17ca8c482 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:29.278053 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4f95f974-9715-4e1e-ac61-f9c17ca8c482 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 2.010144 Aug 09 17:26:29.279581 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1748/3646] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:27 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:29.323561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-902e0753-a09e-4d60-a8f5-2d140cb32140 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:29.328642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-902e0753-a09e-4d60-a8f5-2d140cb32140 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: fd17852c-5f1f-49db-80a6-e1b60aabcd32] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:29.362173 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-902e0753-a09e-4d60-a8f5-2d140cb32140 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance fd17852c-5f1f-49db-80a6-e1b60aabcd32 could not be found. Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-902e0753-a09e-4d60-a8f5-2d140cb32140 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/fd17852c-5f1f-49db-80a6-e1b60aabcd32/action HTTP/1.1 Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 65 Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fd17852c-5f1f-49db-80a6-e1b60aabcd32 could not be found. Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'fd17852c-5f1f-49db-80a6-e1b60aabcd32', 'body': {'rebuild': {'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d'}}} Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd17852c-5f1f-49db-80a6-e1b60aabcd32 could not be found. Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 17:26:29.384709 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd17852c-5f1f-49db-80a6-e1b60aabcd32 could not be found. Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd17852c-5f1f-49db-80a6-e1b60aabcd32 could not be found. Aug 09 17:26:29.396503 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:29.406922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-902e0753-a09e-4d60-a8f5-2d140cb32140 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance fd17852c-5f1f-49db-80a6-e1b60aabcd32 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:29.416373 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-902e0753-a09e-4d60-a8f5-2d140cb32140 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/fd17852c-5f1f-49db-80a6-e1b60aabcd32/action" status: 404 len: 111 microversion: 2.1 time: 0.097398 Aug 09 17:26:29.419781 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1899/3647] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:29 2022] POST /compute/v2.1/servers/fd17852c-5f1f-49db-80a6-e1b60aabcd32/action => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:26:29.440768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9b11fa7e-7eb6-404b-968d-8049ddd45f74 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:29.445388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9b11fa7e-7eb6-404b-968d-8049ddd45f74 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:29.469758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b11fa7e-7eb6-404b-968d-8049ddd45f74 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:29.471060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b11fa7e-7eb6-404b-968d-8049ddd45f74 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:29.472151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b11fa7e-7eb6-404b-968d-8049ddd45f74 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:29.473697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b11fa7e-7eb6-404b-968d-8049ddd45f74 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:29.474798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b11fa7e-7eb6-404b-968d-8049ddd45f74 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:29.476108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b11fa7e-7eb6-404b-968d-8049ddd45f74 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:29.606168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-231acc0b-3e93-4b1a-8a75-687184475e43 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:29.609517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-231acc0b-3e93-4b1a-8a75-687184475e43 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:29.650489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-231acc0b-3e93-4b1a-8a75-687184475e43 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:29.651834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-231acc0b-3e93-4b1a-8a75-687184475e43 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:29.652902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-231acc0b-3e93-4b1a-8a75-687184475e43 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:29.654679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-231acc0b-3e93-4b1a-8a75-687184475e43 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:29.658702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-231acc0b-3e93-4b1a-8a75-687184475e43 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:29.660675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-231acc0b-3e93-4b1a-8a75-687184475e43 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:30.232239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9b11fa7e-7eb6-404b-968d-8049ddd45f74 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:30.260152 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9b11fa7e-7eb6-404b-968d-8049ddd45f74 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.827755 Aug 09 17:26:30.261237 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1749/3648] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:29 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:30.279920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-58f73d1c-2fb6-4b79-bda1-c90ecfa83853 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:30.299509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-58f73d1c-2fb6-4b79-bda1-c90ecfa83853 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:30.321892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f73d1c-2fb6-4b79-bda1-c90ecfa83853 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:30.327270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f73d1c-2fb6-4b79-bda1-c90ecfa83853 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:30.333903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f73d1c-2fb6-4b79-bda1-c90ecfa83853 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:30.335919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f73d1c-2fb6-4b79-bda1-c90ecfa83853 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:30.337093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f73d1c-2fb6-4b79-bda1-c90ecfa83853 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:30.344998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58f73d1c-2fb6-4b79-bda1-c90ecfa83853 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:30.358331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-231acc0b-3e93-4b1a-8a75-687184475e43 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:30.371656 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-231acc0b-3e93-4b1a-8a75-687184475e43 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1317 microversion: 2.1 time: 0.773902 Aug 09 17:26:30.373606 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1900/3649] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:29 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1317 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:30.382733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-aba36411-ce3b-4e7d-b5e6-dc1f0f3e5782 req-53307fca-fda2-4a2b-8437-6ac91c1a5286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c69884e-c9e6-40ac-9855-1807d03686f1", "name": "network-vif-plugged", "status": "completed", "tag": "280cbdcc-d456-40b6-9c0f-cbe122512892"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:30.408767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aba36411-ce3b-4e7d-b5e6-dc1f0f3e5782 req-53307fca-fda2-4a2b-8437-6ac91c1a5286 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:30.409267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aba36411-ce3b-4e7d-b5e6-dc1f0f3e5782 req-53307fca-fda2-4a2b-8437-6ac91c1a5286 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:30.409709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aba36411-ce3b-4e7d-b5e6-dc1f0f3e5782 req-53307fca-fda2-4a2b-8437-6ac91c1a5286 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:30.449142 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-aba36411-ce3b-4e7d-b5e6-dc1f0f3e5782 req-53307fca-fda2-4a2b-8437-6ac91c1a5286 service nova] Creating event network-vif-plugged:280cbdcc-d456-40b6-9c0f-cbe122512892 for instance 4c69884e-c9e6-40ac-9855-1807d03686f1 on n-h1-845781-6 Aug 09 17:26:30.455064 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-aba36411-ce3b-4e7d-b5e6-dc1f0f3e5782 req-53307fca-fda2-4a2b-8437-6ac91c1a5286 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078275 Aug 09 17:26:30.457757 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1901/3650] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:30.472797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9771cf1f-606b-4668-b6e8-c6f66f043815 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:30.473548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9771cf1f-606b-4668-b6e8-c6f66f043815 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:30.486082 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-58f73d1c-2fb6-4b79-bda1-c90ecfa83853 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212993 Aug 09 17:26:30.492841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9771cf1f-606b-4668-b6e8-c6f66f043815 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:30.494366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9771cf1f-606b-4668-b6e8-c6f66f043815 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:30.497112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9771cf1f-606b-4668-b6e8-c6f66f043815 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:30.497868 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1750/3651] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:26:30 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:30.500650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9771cf1f-606b-4668-b6e8-c6f66f043815 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:30.502114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9771cf1f-606b-4668-b6e8-c6f66f043815 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:30.502820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9771cf1f-606b-4668-b6e8-c6f66f043815 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:30.984489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9771cf1f-606b-4668-b6e8-c6f66f043815 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:31.015972 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9771cf1f-606b-4668-b6e8-c6f66f043815 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.552747 Aug 09 17:26:31.024267 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1902/3652] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:30 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:31.055667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-17058428-d87f-4534-9882-fcd7500ee0c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:31.057240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-17058428-d87f-4534-9882-fcd7500ee0c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: dafb0299-6945-45f1-a296-bed39b887ed8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:31.089530 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-17058428-d87f-4534-9882-fcd7500ee0c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance dafb0299-6945-45f1-a296-bed39b887ed8 could not be found. Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-17058428-d87f-4534-9882-fcd7500ee0c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/dafb0299-6945-45f1-a296-bed39b887ed8/action HTTP/1.1 Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 15 Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: {"restore": {}} Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance dafb0299-6945-45f1-a296-bed39b887ed8 could not be found. Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'dafb0299-6945-45f1-a296-bed39b887ed8', 'body': {'restore': {}}} Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dafb0299-6945-45f1-a296-bed39b887ed8 could not be found. Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dafb0299-6945-45f1-a296-bed39b887ed8 could not be found. Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:31.093495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:31.104754 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:31.104754 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:31.104754 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dafb0299-6945-45f1-a296-bed39b887ed8 could not be found. Aug 09 17:26:31.104754 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:31.111534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-17058428-d87f-4534-9882-fcd7500ee0c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance dafb0299-6945-45f1-a296-bed39b887ed8 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:31.113812 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-17058428-d87f-4534-9882-fcd7500ee0c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/dafb0299-6945-45f1-a296-bed39b887ed8/action" status: 404 len: 111 microversion: 2.1 time: 0.071791 Aug 09 17:26:31.117228 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1751/3653] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:31 2022] POST /compute/v2.1/servers/dafb0299-6945-45f1-a296-bed39b887ed8/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:31.132035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e4f3bbe-0fef-469e-8d4c-c9cf879a2552 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:31.137539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6e4f3bbe-0fef-469e-8d4c-c9cf879a2552 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:31.176023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e4f3bbe-0fef-469e-8d4c-c9cf879a2552 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:31.177404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e4f3bbe-0fef-469e-8d4c-c9cf879a2552 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:31.178749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e4f3bbe-0fef-469e-8d4c-c9cf879a2552 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:31.181259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e4f3bbe-0fef-469e-8d4c-c9cf879a2552 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:31.184134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e4f3bbe-0fef-469e-8d4c-c9cf879a2552 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:31.185459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e4f3bbe-0fef-469e-8d4c-c9cf879a2552 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:31.422924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-00196430-f7d2-4c35-a793-af3ca77ff32a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:31.430315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-00196430-f7d2-4c35-a793-af3ca77ff32a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:31.507055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00196430-f7d2-4c35-a793-af3ca77ff32a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:31.514281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00196430-f7d2-4c35-a793-af3ca77ff32a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:31.522260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00196430-f7d2-4c35-a793-af3ca77ff32a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:31.530056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00196430-f7d2-4c35-a793-af3ca77ff32a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:31.531545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00196430-f7d2-4c35-a793-af3ca77ff32a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:31.532792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00196430-f7d2-4c35-a793-af3ca77ff32a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:31.997390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e4f3bbe-0fef-469e-8d4c-c9cf879a2552 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:32.043277 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e4f3bbe-0fef-469e-8d4c-c9cf879a2552 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.914184 Aug 09 17:26:32.050174 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1903/3654] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:31 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:32.086823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d36e7e9e-761b-44cc-9f2d-2bfc60819b22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:32.096215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d36e7e9e-761b-44cc-9f2d-2bfc60819b22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:32.144699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36e7e9e-761b-44cc-9f2d-2bfc60819b22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:32.147355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36e7e9e-761b-44cc-9f2d-2bfc60819b22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:32.163957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36e7e9e-761b-44cc-9f2d-2bfc60819b22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:32.166150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36e7e9e-761b-44cc-9f2d-2bfc60819b22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:32.167444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36e7e9e-761b-44cc-9f2d-2bfc60819b22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:32.168713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d36e7e9e-761b-44cc-9f2d-2bfc60819b22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:32.318619 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d36e7e9e-761b-44cc-9f2d-2bfc60819b22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.265806 Aug 09 17:26:32.329418 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1904/3655] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:26:32 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments => generated 197 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:32.351524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d46a63c9-a2c8-4446-94ee-1915f3298ff8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:32.353104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d46a63c9-a2c8-4446-94ee-1915f3298ff8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:32.376484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d46a63c9-a2c8-4446-94ee-1915f3298ff8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:32.377862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d46a63c9-a2c8-4446-94ee-1915f3298ff8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:32.379013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d46a63c9-a2c8-4446-94ee-1915f3298ff8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:32.380690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d46a63c9-a2c8-4446-94ee-1915f3298ff8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:32.390377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d46a63c9-a2c8-4446-94ee-1915f3298ff8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:32.392011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d46a63c9-a2c8-4446-94ee-1915f3298ff8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:32.876943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-00196430-f7d2-4c35-a793-af3ca77ff32a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:32.897799 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-00196430-f7d2-4c35-a793-af3ca77ff32a tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1317 microversion: 2.1 time: 1.499473 Aug 09 17:26:32.919573 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1752/3656] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:31 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1317 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:33.026944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d46a63c9-a2c8-4446-94ee-1915f3298ff8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:33.064394 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d46a63c9-a2c8-4446-94ee-1915f3298ff8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.732723 Aug 09 17:26:33.067800 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1905/3657] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:32 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:33.095592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:33.096568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:33.123990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:33.136890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:33.138086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:33.140385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:33.141717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:33.142750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:33.233172 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Cannot 'restore' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action HTTP/1.1 Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 15 Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: {"restore": {}} Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: exception: Cannot 'restore' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9af26977-0da1-475d-b754-4460e79e4fc3', 'body': {'restore': {}}} Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 in vm_state active. Cannot restore while the instance is in this state. Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:33.236702 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:33.247258 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:33.247258 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:33.247258 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:33.247258 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:26:33.247258 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:33.250153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 409 to user: Cannot 'restore' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:33.252333 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-38efc97a-3bf7-412b-9755-3a1d1947cf46 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 409 len: 145 microversion: 2.1 time: 0.163617 Aug 09 17:26:33.255087 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1753/3658] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:33 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 145 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:26:33.266459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-60e0bd73-2a58-4d59-a542-91bddef99170 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:33.267188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-60e0bd73-2a58-4d59-a542-91bddef99170 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:33.282805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60e0bd73-2a58-4d59-a542-91bddef99170 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:33.283931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60e0bd73-2a58-4d59-a542-91bddef99170 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:33.284960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60e0bd73-2a58-4d59-a542-91bddef99170 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:33.289747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60e0bd73-2a58-4d59-a542-91bddef99170 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:33.292931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60e0bd73-2a58-4d59-a542-91bddef99170 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:33.294736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60e0bd73-2a58-4d59-a542-91bddef99170 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:33.352038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bc53c7a3-d39b-44b2-8a1f-3242a9b345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:33.374339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bc53c7a3-d39b-44b2-8a1f-3242a9b345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:33.392756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc53c7a3-d39b-44b2-8a1f-3242a9b345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:33.393641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc53c7a3-d39b-44b2-8a1f-3242a9b345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:33.400824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc53c7a3-d39b-44b2-8a1f-3242a9b345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:33.402659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc53c7a3-d39b-44b2-8a1f-3242a9b345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:33.404363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc53c7a3-d39b-44b2-8a1f-3242a9b345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:33.416908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc53c7a3-d39b-44b2-8a1f-3242a9b345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:33.577433 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bc53c7a3-d39b-44b2-8a1f-3242a9b345ed tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233591 Aug 09 17:26:33.585437 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1754/3659] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:26:33 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments => generated 197 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:33.938211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d72e0c07-7872-4d21-b697-8afe50ea95ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:33.941474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d72e0c07-7872-4d21-b697-8afe50ea95ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:33.991980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d72e0c07-7872-4d21-b697-8afe50ea95ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:33.993226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d72e0c07-7872-4d21-b697-8afe50ea95ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:33.995259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d72e0c07-7872-4d21-b697-8afe50ea95ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:34.004558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d72e0c07-7872-4d21-b697-8afe50ea95ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:34.005660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d72e0c07-7872-4d21-b697-8afe50ea95ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:34.009155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d72e0c07-7872-4d21-b697-8afe50ea95ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:34.457552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-60e0bd73-2a58-4d59-a542-91bddef99170 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:34.500326 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-60e0bd73-2a58-4d59-a542-91bddef99170 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.239195 Aug 09 17:26:34.501903 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1906/3660] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:33 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:34.547520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c095eed4-be45-4f52-9c60-b1c916afce26 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:34.549340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c095eed4-be45-4f52-9c60-b1c916afce26 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:34.587035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c095eed4-be45-4f52-9c60-b1c916afce26 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:34.596832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c095eed4-be45-4f52-9c60-b1c916afce26 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:34.599028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c095eed4-be45-4f52-9c60-b1c916afce26 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:34.601769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c095eed4-be45-4f52-9c60-b1c916afce26 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:34.606119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c095eed4-be45-4f52-9c60-b1c916afce26 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:34.608216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c095eed4-be45-4f52-9c60-b1c916afce26 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:34.866217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d72e0c07-7872-4d21-b697-8afe50ea95ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:34.878744 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d72e0c07-7872-4d21-b697-8afe50ea95ac tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1508 microversion: 2.1 time: 0.948178 Aug 09 17:26:34.879789 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1755/3661] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:33 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1508 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:34.885852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1dec1c9d-3e20-482b-83d3-7e51e522cb9f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:34.902213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1dec1c9d-3e20-482b-83d3-7e51e522cb9f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:34.922819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1dec1c9d-3e20-482b-83d3-7e51e522cb9f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:34.923965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1dec1c9d-3e20-482b-83d3-7e51e522cb9f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:34.924857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1dec1c9d-3e20-482b-83d3-7e51e522cb9f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:34.926206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1dec1c9d-3e20-482b-83d3-7e51e522cb9f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:34.927139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1dec1c9d-3e20-482b-83d3-7e51e522cb9f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:34.928035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1dec1c9d-3e20-482b-83d3-7e51e522cb9f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:35.038701 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1dec1c9d-3e20-482b-83d3-7e51e522cb9f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157291 Aug 09 17:26:35.044337 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1756/3662] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:26:34 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:35.066211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-90ebade8-ef98-4a3b-9a11-7e9a031a34e8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:35.067419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-90ebade8-ef98-4a3b-9a11-7e9a031a34e8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:35.098408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90ebade8-ef98-4a3b-9a11-7e9a031a34e8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:35.099521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90ebade8-ef98-4a3b-9a11-7e9a031a34e8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:35.100430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90ebade8-ef98-4a3b-9a11-7e9a031a34e8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:35.102074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90ebade8-ef98-4a3b-9a11-7e9a031a34e8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:35.102975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90ebade8-ef98-4a3b-9a11-7e9a031a34e8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:35.104252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90ebade8-ef98-4a3b-9a11-7e9a031a34e8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:35.560320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c095eed4-be45-4f52-9c60-b1c916afce26 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:35.587176 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c095eed4-be45-4f52-9c60-b1c916afce26 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.048444 Aug 09 17:26:35.588760 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1907/3663] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:34 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:35.639327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07e39e79-6f04-457d-9b94-37759b247e7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:35.640507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07e39e79-6f04-457d-9b94-37759b247e7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 81b84293-d3f0-409b-bea6-667858b3502c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:35.658899 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-07e39e79-6f04-457d-9b94-37759b247e7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 81b84293-d3f0-409b-bea6-667858b3502c could not be found. Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07e39e79-6f04-457d-9b94-37759b247e7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/81b84293-d3f0-409b-bea6-667858b3502c/action HTTP/1.1 Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 14 Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: {"resume": {}} Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 81b84293-d3f0-409b-bea6-667858b3502c could not be found. Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '81b84293-d3f0-409b-bea6-667858b3502c', 'body': {'resume': {}}} Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b84293-d3f0-409b-bea6-667858b3502c could not be found. Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b84293-d3f0-409b-bea6-667858b3502c could not be found. Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:35.674980 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:35.688526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:35.688526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:35.688526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b84293-d3f0-409b-bea6-667858b3502c could not be found. Aug 09 17:26:35.688526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:35.688526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07e39e79-6f04-457d-9b94-37759b247e7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 81b84293-d3f0-409b-bea6-667858b3502c could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:35.688526 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07e39e79-6f04-457d-9b94-37759b247e7c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/81b84293-d3f0-409b-bea6-667858b3502c/action" status: 404 len: 111 microversion: 2.1 time: 0.055794 Aug 09 17:26:35.694181 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1908/3664] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:35 2022] POST /compute/v2.1/servers/81b84293-d3f0-409b-bea6-667858b3502c/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:35.733840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-84123b00-3aea-4fbf-babf-1370480bff8a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:35.738175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-84123b00-3aea-4fbf-babf-1370480bff8a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:35.762718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84123b00-3aea-4fbf-babf-1370480bff8a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:35.764218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84123b00-3aea-4fbf-babf-1370480bff8a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:35.766664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84123b00-3aea-4fbf-babf-1370480bff8a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:35.769393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84123b00-3aea-4fbf-babf-1370480bff8a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:35.771073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84123b00-3aea-4fbf-babf-1370480bff8a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:35.773078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84123b00-3aea-4fbf-babf-1370480bff8a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:35.934751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90ebade8-ef98-4a3b-9a11-7e9a031a34e8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:35.944902 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-90ebade8-ef98-4a3b-9a11-7e9a031a34e8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1508 microversion: 2.1 time: 0.898558 Aug 09 17:26:35.950490 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1757/3665] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:35 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1508 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:35.986824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-65dd0e8e-7e25-45a1-acca-68d752a50069 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:35.992234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-65dd0e8e-7e25-45a1-acca-68d752a50069 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:36.005381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65dd0e8e-7e25-45a1-acca-68d752a50069 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:36.006622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65dd0e8e-7e25-45a1-acca-68d752a50069 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:36.007771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65dd0e8e-7e25-45a1-acca-68d752a50069 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:36.009312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65dd0e8e-7e25-45a1-acca-68d752a50069 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:36.010945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65dd0e8e-7e25-45a1-acca-68d752a50069 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:36.012090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65dd0e8e-7e25-45a1-acca-68d752a50069 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:36.179672 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-65dd0e8e-7e25-45a1-acca-68d752a50069 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "PUT /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1080 microversion: 2.1 time: 0.200992 Aug 09 17:26:36.183324 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1758/3666] 10.222.0.93 () {60 vars in 1256 bytes} [Tue Aug 9 17:26:35 2022] PUT /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1080 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:36.194203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c7a39c21-ac83-436c-9bc6-b30f9b59bf22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:36.199911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c7a39c21-ac83-436c-9bc6-b30f9b59bf22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:36.201757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-84123b00-3aea-4fbf-babf-1370480bff8a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:36.212913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a39c21-ac83-436c-9bc6-b30f9b59bf22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:36.213786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a39c21-ac83-436c-9bc6-b30f9b59bf22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:36.214038 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-84123b00-3aea-4fbf-babf-1370480bff8a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.516970 Aug 09 17:26:36.215189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a39c21-ac83-436c-9bc6-b30f9b59bf22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:36.216996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a39c21-ac83-436c-9bc6-b30f9b59bf22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:36.218225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a39c21-ac83-436c-9bc6-b30f9b59bf22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:36.219537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c7a39c21-ac83-436c-9bc6-b30f9b59bf22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:36.228703 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1909/3667] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:35 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:36.249402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-53fc9291-025c-40b3-87f1-8f87e5e56224 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:36.250271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-53fc9291-025c-40b3-87f1-8f87e5e56224 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:36.271007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53fc9291-025c-40b3-87f1-8f87e5e56224 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:36.271756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53fc9291-025c-40b3-87f1-8f87e5e56224 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:36.272234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53fc9291-025c-40b3-87f1-8f87e5e56224 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:36.273025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53fc9291-025c-40b3-87f1-8f87e5e56224 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:36.274181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53fc9291-025c-40b3-87f1-8f87e5e56224 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:36.274692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53fc9291-025c-40b3-87f1-8f87e5e56224 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:36.279937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:36.321409 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c7a39c21-ac83-436c-9bc6-b30f9b59bf22 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134929 Aug 09 17:26:36.324731 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1759/3668] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:26:36 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:36.337592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4f66f1b6-9b5e-43c7-83e6-97e0c6f34a4d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:36.339839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4f66f1b6-9b5e-43c7-83e6-97e0c6f34a4d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:36.354922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f66f1b6-9b5e-43c7-83e6-97e0c6f34a4d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:36.356396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f66f1b6-9b5e-43c7-83e6-97e0c6f34a4d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:36.357710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f66f1b6-9b5e-43c7-83e6-97e0c6f34a4d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:36.359545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f66f1b6-9b5e-43c7-83e6-97e0c6f34a4d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:36.360760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f66f1b6-9b5e-43c7-83e6-97e0c6f34a4d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:36.361856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f66f1b6-9b5e-43c7-83e6-97e0c6f34a4d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:36.661001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-53fc9291-025c-40b3-87f1-8f87e5e56224 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:36.671215 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-53fc9291-025c-40b3-87f1-8f87e5e56224 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1506 microversion: 2.1 time: 0.436280 Aug 09 17:26:36.673183 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1910/3669] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:36 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:36.702892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c26f579-b44b-431e-9dff-ace934021307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:36.704387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c26f579-b44b-431e-9dff-ace934021307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:36.722447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c26f579-b44b-431e-9dff-ace934021307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:36.724033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c26f579-b44b-431e-9dff-ace934021307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:36.724773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c26f579-b44b-431e-9dff-ace934021307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:36.726153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c26f579-b44b-431e-9dff-ace934021307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:36.726925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c26f579-b44b-431e-9dff-ace934021307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:36.727532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c26f579-b44b-431e-9dff-ace934021307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:37.199117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c26f579-b44b-431e-9dff-ace934021307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:37.231493 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c26f579-b44b-431e-9dff-ace934021307 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1506 microversion: 2.1 time: 0.529731 Aug 09 17:26:37.232770 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1911/3670] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:36 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1506 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:37.259824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f66f1b6-9b5e-43c7-83e6-97e0c6f34a4d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:37.274558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-37fa993b-53b1-41b7-9727-0e49cb9c9953 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:37.277829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-37fa993b-53b1-41b7-9727-0e49cb9c9953 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:37.291317 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4f66f1b6-9b5e-43c7-83e6-97e0c6f34a4d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.963302 Aug 09 17:26:37.297786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37fa993b-53b1-41b7-9727-0e49cb9c9953 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:37.298840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37fa993b-53b1-41b7-9727-0e49cb9c9953 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:37.299549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37fa993b-53b1-41b7-9727-0e49cb9c9953 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:37.300617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37fa993b-53b1-41b7-9727-0e49cb9c9953 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:37.301355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37fa993b-53b1-41b7-9727-0e49cb9c9953 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:37.304023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37fa993b-53b1-41b7-9727-0e49cb9c9953 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:37.305750 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1760/3671] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:36 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:37.346091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-005de797-1544-4309-9e67-4435c723d50f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:37.358787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-005de797-1544-4309-9e67-4435c723d50f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:37.383957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005de797-1544-4309-9e67-4435c723d50f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:37.385350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005de797-1544-4309-9e67-4435c723d50f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:37.386391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005de797-1544-4309-9e67-4435c723d50f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:37.387980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005de797-1544-4309-9e67-4435c723d50f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:37.389057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005de797-1544-4309-9e67-4435c723d50f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:37.390425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005de797-1544-4309-9e67-4435c723d50f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:37.468172 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-005de797-1544-4309-9e67-4435c723d50f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134506 Aug 09 17:26:37.481753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:37.491771 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1761/3672] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:26:37 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:37.501918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:37.504276 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-37fa993b-53b1-41b7-9727-0e49cb9c9953 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "PUT /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1082 microversion: 2.1 time: 0.237490 Aug 09 17:26:37.505275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:37.508321 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1912/3673] 10.222.0.93 () {60 vars in 1256 bytes} [Tue Aug 9 17:26:37 2022] PUT /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1082 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:37.528292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:37.530525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:37.536945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:37.539864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:37.543383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:37.544193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9e63b1f7-b4c7-4dd2-b9a3-7dfac126cae9 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:37.545403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9e63b1f7-b4c7-4dd2-b9a3-7dfac126cae9 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:37.548854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:37.565384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e63b1f7-b4c7-4dd2-b9a3-7dfac126cae9 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:37.573438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e63b1f7-b4c7-4dd2-b9a3-7dfac126cae9 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:37.578978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e63b1f7-b4c7-4dd2-b9a3-7dfac126cae9 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:37.583663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e63b1f7-b4c7-4dd2-b9a3-7dfac126cae9 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:37.584951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e63b1f7-b4c7-4dd2-b9a3-7dfac126cae9 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:37.591823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e63b1f7-b4c7-4dd2-b9a3-7dfac126cae9 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:37.657151 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Cannot 'resume' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action HTTP/1.1 Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 14 Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: {"resume": {}} Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: exception: Cannot 'resume' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9af26977-0da1-475d-b754-4460e79e4fc3', 'body': {'resume': {}}} Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 in vm_state active. Cannot resume while the instance is in this state. Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:37.698660 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:37.719721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:37.719721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:37.719721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:37.719721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:26:37.719721 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:37.719721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 409 to user: Cannot 'resume' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:37.719721 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dc032e98-c7a5-4bc5-bfe5-467de32149ca tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 409 len: 144 microversion: 2.1 time: 0.207425 Aug 09 17:26:37.719721 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1762/3674] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:37 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 144 bytes in 210 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:26:37.735054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-df7864b8-0633-4bfd-a9d4-d6788b43c004 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:37.736187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-df7864b8-0633-4bfd-a9d4-d6788b43c004 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:37.768571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df7864b8-0633-4bfd-a9d4-d6788b43c004 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:37.768975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df7864b8-0633-4bfd-a9d4-d6788b43c004 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:37.770244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df7864b8-0633-4bfd-a9d4-d6788b43c004 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:37.771186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df7864b8-0633-4bfd-a9d4-d6788b43c004 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:37.781978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df7864b8-0633-4bfd-a9d4-d6788b43c004 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:37.782985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df7864b8-0633-4bfd-a9d4-d6788b43c004 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:38.568086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-df7864b8-0633-4bfd-a9d4-d6788b43c004 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:38.595572 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-df7864b8-0633-4bfd-a9d4-d6788b43c004 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.881799 Aug 09 17:26:38.596740 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1763/3675] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:37 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:38.615781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f818b81e-8242-49f9-ad79-9190b1909671 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:38.628023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f818b81e-8242-49f9-ad79-9190b1909671 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:38.652665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f818b81e-8242-49f9-ad79-9190b1909671 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:38.665650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f818b81e-8242-49f9-ad79-9190b1909671 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:38.666493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f818b81e-8242-49f9-ad79-9190b1909671 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:38.667982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f818b81e-8242-49f9-ad79-9190b1909671 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:38.668896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f818b81e-8242-49f9-ad79-9190b1909671 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:38.669688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f818b81e-8242-49f9-ad79-9190b1909671 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:38.732747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9e63b1f7-b4c7-4dd2-b9a3-7dfac126cae9 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:38.749090 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9e63b1f7-b4c7-4dd2-b9a3-7dfac126cae9 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1508 microversion: 2.1 time: 1.212003 Aug 09 17:26:38.750382 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1913/3676] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:37 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1508 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:38.758881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d0d380e3-ed5d-4d54-a911-7826c598e5c6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:38.759852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d0d380e3-ed5d-4d54-a911-7826c598e5c6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:38.774030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d380e3-ed5d-4d54-a911-7826c598e5c6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:38.779216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d380e3-ed5d-4d54-a911-7826c598e5c6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:38.780963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d380e3-ed5d-4d54-a911-7826c598e5c6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:38.782814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d380e3-ed5d-4d54-a911-7826c598e5c6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:38.785990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d380e3-ed5d-4d54-a911-7826c598e5c6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:38.788241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d380e3-ed5d-4d54-a911-7826c598e5c6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:38.818339 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f818b81e-8242-49f9-ad79-9190b1909671 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.216708 Aug 09 17:26:38.819020 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1764/3677] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:26:38 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50/os-volume_attachments => generated 25 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:26:38.838134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ce7abbc4-f38b-4cc4-b154-16aca81c549d tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:38.845965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ce7abbc4-f38b-4cc4-b154-16aca81c549d tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:38.860997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce7abbc4-f38b-4cc4-b154-16aca81c549d tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:38.863722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce7abbc4-f38b-4cc4-b154-16aca81c549d tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:38.865075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce7abbc4-f38b-4cc4-b154-16aca81c549d tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:38.868180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce7abbc4-f38b-4cc4-b154-16aca81c549d tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:38.869394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce7abbc4-f38b-4cc4-b154-16aca81c549d tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:38.870667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce7abbc4-f38b-4cc4-b154-16aca81c549d tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:40.257372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ce7abbc4-f38b-4cc4-b154-16aca81c549d tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:40.267466 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ce7abbc4-f38b-4cc4-b154-16aca81c549d tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1508 microversion: 2.1 time: 1.444150 Aug 09 17:26:40.271184 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1765/3678] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:38 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1508 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:40.282423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8eef35d2-9a97-4aa1-9761-d494ccaebd40 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:40.288609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8eef35d2-9a97-4aa1-9761-d494ccaebd40 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:40.306189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eef35d2-9a97-4aa1-9761-d494ccaebd40 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:40.307335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eef35d2-9a97-4aa1-9761-d494ccaebd40 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:40.311352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eef35d2-9a97-4aa1-9761-d494ccaebd40 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:40.312492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eef35d2-9a97-4aa1-9761-d494ccaebd40 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:40.315743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eef35d2-9a97-4aa1-9761-d494ccaebd40 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:40.321553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8eef35d2-9a97-4aa1-9761-d494ccaebd40 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:40.341944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d0d380e3-ed5d-4d54-a911-7826c598e5c6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:40.372573 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d0d380e3-ed5d-4d54-a911-7826c598e5c6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.618961 Aug 09 17:26:40.372905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8eef35d2-9a97-4aa1-9761-d494ccaebd40 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:26:40.377152 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1914/3679] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:38 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:40.402027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3bf67dcc-c4ff-496b-a04e-35c64aafc39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:40.402974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3bf67dcc-c4ff-496b-a04e-35c64aafc39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:40.425336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf67dcc-c4ff-496b-a04e-35c64aafc39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:40.427373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf67dcc-c4ff-496b-a04e-35c64aafc39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:40.431323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf67dcc-c4ff-496b-a04e-35c64aafc39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:40.440096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf67dcc-c4ff-496b-a04e-35c64aafc39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:40.444443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf67dcc-c4ff-496b-a04e-35c64aafc39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:40.445176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bf67dcc-c4ff-496b-a04e-35c64aafc39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:40.560837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3bf67dcc-c4ff-496b-a04e-35c64aafc39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:26:40.706822 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8eef35d2-9a97-4aa1-9761-d494ccaebd40 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 204 len: 0 microversion: 2.1 time: 0.431956 Aug 09 17:26:40.714337 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1766/3680] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:26:40 2022] DELETE /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:26:40.739581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2be4cf2b-9421-4477-893f-f5863dcca19b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:40.746045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2be4cf2b-9421-4477-893f-f5863dcca19b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:40.781728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2be4cf2b-9421-4477-893f-f5863dcca19b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:40.793736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2be4cf2b-9421-4477-893f-f5863dcca19b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:40.796445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2be4cf2b-9421-4477-893f-f5863dcca19b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:40.809557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2be4cf2b-9421-4477-893f-f5863dcca19b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:40.811145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2be4cf2b-9421-4477-893f-f5863dcca19b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:40.812770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2be4cf2b-9421-4477-893f-f5863dcca19b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:40.869095 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3bf67dcc-c4ff-496b-a04e-35c64aafc39c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 204 len: 0 microversion: 2.1 time: 0.488069 Aug 09 17:26:40.869872 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1915/3681] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:26:40 2022] DELETE /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:26:40.886879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9b6a02b9-255c-419b-807e-9d74e577ece3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9b6a02b9-255c-419b-807e-9d74e577ece3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 160 Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "06107dcb-e281-407c-b425-37660f776641"}]}} Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': '', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'networks': [{'uuid': '06107dcb-e281-407c-b425-37660f776641'}]}}} Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi '' Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:26:40.900006 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:26:40.908026 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:40.915434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9b6a02b9-255c-419b-807e-9d74e577ece3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:40.916704 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9b6a02b9-255c-419b-807e-9d74e577ece3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.044466 Aug 09 17:26:40.917510 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1916/3682] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:26:40 2022] POST /compute/v2.1/servers => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:26:40.933091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b608890d-732d-4d5a-ab05-b3d950253c60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:40.946848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b608890d-732d-4d5a-ab05-b3d950253c60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:40.980980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b608890d-732d-4d5a-ab05-b3d950253c60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:40.981935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b608890d-732d-4d5a-ab05-b3d950253c60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:40.982592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b608890d-732d-4d5a-ab05-b3d950253c60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:40.983557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b608890d-732d-4d5a-ab05-b3d950253c60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:40.984939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b608890d-732d-4d5a-ab05-b3d950253c60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:40.985620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b608890d-732d-4d5a-ab05-b3d950253c60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:41.026305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b608890d-732d-4d5a-ab05-b3d950253c60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:26:41.130162 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.compute.api [None req-b608890d-732d-4d5a-ab05-b3d950253c60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Instance is already in deleting state, ignoring this request Aug 09 17:26:41.131378 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b608890d-732d-4d5a-ab05-b3d950253c60 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 204 len: 0 microversion: 2.1 time: 0.209191 Aug 09 17:26:41.137530 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1917/3683] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:26:40 2022] DELETE /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:26:41.153020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50598be3-e902-4c00-aed0-fd688d8e19ff tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:41.153677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-50598be3-e902-4c00-aed0-fd688d8e19ff tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:41.182981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50598be3-e902-4c00-aed0-fd688d8e19ff tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:41.184758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50598be3-e902-4c00-aed0-fd688d8e19ff tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:41.186068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50598be3-e902-4c00-aed0-fd688d8e19ff tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:41.187913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50598be3-e902-4c00-aed0-fd688d8e19ff tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:41.189236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50598be3-e902-4c00-aed0-fd688d8e19ff tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:41.190417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50598be3-e902-4c00-aed0-fd688d8e19ff tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:41.258992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2be4cf2b-9421-4477-893f-f5863dcca19b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:41.297168 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2be4cf2b-9421-4477-893f-f5863dcca19b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1681 microversion: 2.1 time: 0.575935 Aug 09 17:26:41.299950 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1767/3684] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:40 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1681 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:41.314340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0f3c9337-831a-4062-b582-77bd26491fa8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:41.315551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0f3c9337-831a-4062-b582-77bd26491fa8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:41.344228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f3c9337-831a-4062-b582-77bd26491fa8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:41.345155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f3c9337-831a-4062-b582-77bd26491fa8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:41.345939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f3c9337-831a-4062-b582-77bd26491fa8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:41.347232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f3c9337-831a-4062-b582-77bd26491fa8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:41.348161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f3c9337-831a-4062-b582-77bd26491fa8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:41.348930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f3c9337-831a-4062-b582-77bd26491fa8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:41.814748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0f3c9337-831a-4062-b582-77bd26491fa8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:41.828429 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0f3c9337-831a-4062-b582-77bd26491fa8 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1514 microversion: 2.1 time: 0.523703 Aug 09 17:26:41.856769 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1768/3685] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:41 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1514 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:42.303495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-50598be3-e902-4c00-aed0-fd688d8e19ff tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:42.330381 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-50598be3-e902-4c00-aed0-fd688d8e19ff tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.191534 Aug 09 17:26:42.352022 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1918/3686] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:41 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:42.352370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5e7b1e09-5546-40a3-8945-2813be9690c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:42.353092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5e7b1e09-5546-40a3-8945-2813be9690c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:42.383322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-82ec0441-3bdb-4a54-af9f-ba66d20fd0d1 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:42.384488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-82ec0441-3bdb-4a54-af9f-ba66d20fd0d1 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:42.389815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e09-5546-40a3-8945-2813be9690c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:42.395793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82ec0441-3bdb-4a54-af9f-ba66d20fd0d1 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:42.396130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e09-5546-40a3-8945-2813be9690c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:42.396615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82ec0441-3bdb-4a54-af9f-ba66d20fd0d1 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:42.396817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e09-5546-40a3-8945-2813be9690c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:42.397309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82ec0441-3bdb-4a54-af9f-ba66d20fd0d1 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:42.397957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e09-5546-40a3-8945-2813be9690c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:42.399617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82ec0441-3bdb-4a54-af9f-ba66d20fd0d1 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:42.400254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82ec0441-3bdb-4a54-af9f-ba66d20fd0d1 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:42.400832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82ec0441-3bdb-4a54-af9f-ba66d20fd0d1 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:42.413224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e09-5546-40a3-8945-2813be9690c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:42.416511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7b1e09-5546-40a3-8945-2813be9690c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:42.891141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-82ec0441-3bdb-4a54-af9f-ba66d20fd0d1 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:42.906542 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-82ec0441-3bdb-4a54-af9f-ba66d20fd0d1 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.534215 Aug 09 17:26:42.907540 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1919/3687] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:42 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:42.912707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29053037-4bf8-4152-8755-1e4942937205 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:42.924853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-29053037-4bf8-4152-8755-1e4942937205 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:42.937567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29053037-4bf8-4152-8755-1e4942937205 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:42.940359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29053037-4bf8-4152-8755-1e4942937205 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:42.944655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29053037-4bf8-4152-8755-1e4942937205 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:42.950174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29053037-4bf8-4152-8755-1e4942937205 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:42.953066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29053037-4bf8-4152-8755-1e4942937205 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:42.953711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29053037-4bf8-4152-8755-1e4942937205 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:43.387505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5e7b1e09-5546-40a3-8945-2813be9690c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:43.422070 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5e7b1e09-5546-40a3-8945-2813be9690c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1681 microversion: 2.1 time: 1.077459 Aug 09 17:26:43.450119 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1769/3688] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:42 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1681 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:43.511956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6fc69c39-337a-4cc6-9197-8975ecce81eb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:43.514006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6fc69c39-337a-4cc6-9197-8975ecce81eb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 19720757-973a-4c1a-ac22-01b896a74c25] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:43.528396 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-6fc69c39-337a-4cc6-9197-8975ecce81eb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 19720757-973a-4c1a-ac22-01b896a74c25 could not be found. Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6fc69c39-337a-4cc6-9197-8975ecce81eb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/19720757-973a-4c1a-ac22-01b896a74c25/action HTTP/1.1 Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 14 Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: {"shelve": {}} Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 19720757-973a-4c1a-ac22-01b896a74c25 could not be found. Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '19720757-973a-4c1a-ac22-01b896a74c25', 'body': {'shelve': {}}} Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19720757-973a-4c1a-ac22-01b896a74c25 could not be found. Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19720757-973a-4c1a-ac22-01b896a74c25 could not be found. Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:43.552760 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:43.565475 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:43.565475 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:43.565475 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19720757-973a-4c1a-ac22-01b896a74c25 could not be found. Aug 09 17:26:43.565475 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:43.568006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6fc69c39-337a-4cc6-9197-8975ecce81eb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 19720757-973a-4c1a-ac22-01b896a74c25 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:43.572240 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6fc69c39-337a-4cc6-9197-8975ecce81eb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/19720757-973a-4c1a-ac22-01b896a74c25/action" status: 404 len: 111 microversion: 2.1 time: 0.104728 Aug 09 17:26:43.575428 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1770/3689] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:43 2022] POST /compute/v2.1/servers/19720757-973a-4c1a-ac22-01b896a74c25/action => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:43.607567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab33456a-d250-49ea-bd39-717e4783faf5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:43.608904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ab33456a-d250-49ea-bd39-717e4783faf5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:43.631940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab33456a-d250-49ea-bd39-717e4783faf5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:43.634899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab33456a-d250-49ea-bd39-717e4783faf5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:43.638331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab33456a-d250-49ea-bd39-717e4783faf5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:43.639407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab33456a-d250-49ea-bd39-717e4783faf5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:43.640794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab33456a-d250-49ea-bd39-717e4783faf5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:43.641683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab33456a-d250-49ea-bd39-717e4783faf5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:44.641566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ab33456a-d250-49ea-bd39-717e4783faf5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:44.662842 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ab33456a-d250-49ea-bd39-717e4783faf5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.077754 Aug 09 17:26:44.669970 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1771/3690] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:43 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:44.688554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7a8c353e-5bd1-4fcd-bc79-459e0955b5b3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:44.689452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7a8c353e-5bd1-4fcd-bc79-459e0955b5b3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:44.690497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-29053037-4bf8-4152-8755-1e4942937205 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:44.699161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a8c353e-5bd1-4fcd-bc79-459e0955b5b3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:44.707760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a8c353e-5bd1-4fcd-bc79-459e0955b5b3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:44.708744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a8c353e-5bd1-4fcd-bc79-459e0955b5b3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:44.709737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a8c353e-5bd1-4fcd-bc79-459e0955b5b3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:44.710412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a8c353e-5bd1-4fcd-bc79-459e0955b5b3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:44.711097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a8c353e-5bd1-4fcd-bc79-459e0955b5b3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:44.733916 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-29053037-4bf8-4152-8755-1e4942937205 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1514 microversion: 2.1 time: 1.824583 Aug 09 17:26:44.769613 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1920/3691] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:42 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1514 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:44.790216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e7e4177-2dba-4f4c-9203-497710ea0d3c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:44.805558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3e7e4177-2dba-4f4c-9203-497710ea0d3c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:44.817130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7e4177-2dba-4f4c-9203-497710ea0d3c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:44.820209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7e4177-2dba-4f4c-9203-497710ea0d3c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:44.824615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7e4177-2dba-4f4c-9203-497710ea0d3c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:44.827710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7e4177-2dba-4f4c-9203-497710ea0d3c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:44.831016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7e4177-2dba-4f4c-9203-497710ea0d3c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:44.832256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7e4177-2dba-4f4c-9203-497710ea0d3c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:45.429019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3e7e4177-2dba-4f4c-9203-497710ea0d3c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:45.453923 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e7e4177-2dba-4f4c-9203-497710ea0d3c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.679843 Aug 09 17:26:45.455217 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1921/3692] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:44 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:45.495562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-613f242a-068b-4e76-b9f5-402db653b190 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:45.498221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-613f242a-068b-4e76-b9f5-402db653b190 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:45.508387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-613f242a-068b-4e76-b9f5-402db653b190 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:45.509262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-613f242a-068b-4e76-b9f5-402db653b190 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:45.510672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-613f242a-068b-4e76-b9f5-402db653b190 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:45.513653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-613f242a-068b-4e76-b9f5-402db653b190 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:45.515199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-613f242a-068b-4e76-b9f5-402db653b190 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:45.516548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-613f242a-068b-4e76-b9f5-402db653b190 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:45.558989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-613f242a-068b-4e76-b9f5-402db653b190 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lazy-loading 'flavor' on Instance uuid 9af26977-0da1-475d-b754-4460e79e4fc3 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:26:45.999936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7a8c353e-5bd1-4fcd-bc79-459e0955b5b3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:46.033407 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-613f242a-068b-4e76-b9f5-402db653b190 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 202 len: 0 microversion: 2.1 time: 0.548695 Aug 09 17:26:46.034360 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1922/3693] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:45 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:26:46.037407 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7a8c353e-5bd1-4fcd-bc79-459e0955b5b3 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1681 microversion: 2.1 time: 1.364495 Aug 09 17:26:46.043248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0aa9d5ac-1776-40e7-9ee5-05350389f90c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:46.044642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0aa9d5ac-1776-40e7-9ee5-05350389f90c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:46.052168 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1772/3694] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:44 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1681 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:46.078259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0aa9d5ac-1776-40e7-9ee5-05350389f90c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:46.079106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0aa9d5ac-1776-40e7-9ee5-05350389f90c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:46.087200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0aa9d5ac-1776-40e7-9ee5-05350389f90c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:46.088549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0aa9d5ac-1776-40e7-9ee5-05350389f90c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:46.089397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0aa9d5ac-1776-40e7-9ee5-05350389f90c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:46.089843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3fcab705-c89f-48fe-b908-7333320a3801 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:46.091142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3fcab705-c89f-48fe-b908-7333320a3801 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:46.100244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0aa9d5ac-1776-40e7-9ee5-05350389f90c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:46.117630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fcab705-c89f-48fe-b908-7333320a3801 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:46.123981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fcab705-c89f-48fe-b908-7333320a3801 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:46.126100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fcab705-c89f-48fe-b908-7333320a3801 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:46.128429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fcab705-c89f-48fe-b908-7333320a3801 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:46.130196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fcab705-c89f-48fe-b908-7333320a3801 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:46.131582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fcab705-c89f-48fe-b908-7333320a3801 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:46.503710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0aa9d5ac-1776-40e7-9ee5-05350389f90c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:46.519241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0aa9d5ac-1776-40e7-9ee5-05350389f90c tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1514 microversion: 2.1 time: 0.482846 Aug 09 17:26:46.521854 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1923/3695] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:46 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1514 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:47.117770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3fcab705-c89f-48fe-b908-7333320a3801 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:47.130080 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3fcab705-c89f-48fe-b908-7333320a3801 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1510 microversion: 2.1 time: 1.072216 Aug 09 17:26:47.135096 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1773/3696] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:46 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1510 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:47.149480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f95f98b6-5f1f-4c94-bb87-94e7af72eb24 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:47.150435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f95f98b6-5f1f-4c94-bb87-94e7af72eb24 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:47.166481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f95f98b6-5f1f-4c94-bb87-94e7af72eb24 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:47.172477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f95f98b6-5f1f-4c94-bb87-94e7af72eb24 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:47.173410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f95f98b6-5f1f-4c94-bb87-94e7af72eb24 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:47.174883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f95f98b6-5f1f-4c94-bb87-94e7af72eb24 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:47.175692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f95f98b6-5f1f-4c94-bb87-94e7af72eb24 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:47.176359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f95f98b6-5f1f-4c94-bb87-94e7af72eb24 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:47.390328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2047777404", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "bfce2ee9-7a33-44ac-9c09-0598d598d3cc"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:47.541064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] validate_networks() for [('bfce2ee9-7a33-44ac-9c09-0598d598d3cc', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:26:48.501751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:26:48.502869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:26:48.506240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:26:48.507526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:26:48.513173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:26:48.566836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:48.571148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:48.572781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:48.579168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:48.580666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:48.584197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:48.642937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f95f98b6-5f1f-4c94-bb87-94e7af72eb24 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:48.669342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Getting quotas for project fb1f1758036a4e29a7cc21f039a42464. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:26:48.688023 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f95f98b6-5f1f-4c94-bb87-94e7af72eb24 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1681 microversion: 2.1 time: 1.538579 Aug 09 17:26:48.688023 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1774/3697] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:47 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1681 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:48.698870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:48.699994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:48.716831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Getting quotas for user d133a19e7665449e81e6b4f1443cd29a and project fb1f1758036a4e29a7cc21f039a42464. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:26:48.717706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:48.718493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:48.721497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:48.723285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:48.725453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:48.727955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:48.738547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:26:48.743473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:26:49.016732 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2bec0298-1ef3-4212-830c-9ce6d4142405 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.023079 Aug 09 17:26:49.025249 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1924/3698] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:26:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:26:49.059932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9e274519-08b1-4490-b6ec-e471073c7997 req-cb054192-86c2-48ec-bd35-c45bc45be80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b120e8-277c-49bb-83e5-1de30e80fd50", "name": "network-vif-unplugged", "status": "completed", "tag": "8c141125-13a2-4dc7-9c17-2908b01ba8da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:49.271471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e274519-08b1-4490-b6ec-e471073c7997 req-cb054192-86c2-48ec-bd35-c45bc45be80d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:49.271471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e274519-08b1-4490-b6ec-e471073c7997 req-cb054192-86c2-48ec-bd35-c45bc45be80d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:49.271471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e274519-08b1-4490-b6ec-e471073c7997 req-cb054192-86c2-48ec-bd35-c45bc45be80d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:49.295620 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9e274519-08b1-4490-b6ec-e471073c7997 req-cb054192-86c2-48ec-bd35-c45bc45be80d service nova] Creating event network-vif-unplugged:8c141125-13a2-4dc7-9c17-2908b01ba8da for instance 55b120e8-277c-49bb-83e5-1de30e80fd50 on n-h1-845781-6 Aug 09 17:26:49.320937 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9e274519-08b1-4490-b6ec-e471073c7997 req-cb054192-86c2-48ec-bd35-c45bc45be80d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.288805 Aug 09 17:26:49.323430 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1925/3699] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:49.355393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-484e16fe-4e4c-4e33-aa72-819d8cda7e97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:49.356654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-484e16fe-4e4c-4e33-aa72-819d8cda7e97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:49.394364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-484e16fe-4e4c-4e33-aa72-819d8cda7e97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:49.397706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-484e16fe-4e4c-4e33-aa72-819d8cda7e97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:49.402278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-484e16fe-4e4c-4e33-aa72-819d8cda7e97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:49.409196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-484e16fe-4e4c-4e33-aa72-819d8cda7e97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:49.411026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-484e16fe-4e4c-4e33-aa72-819d8cda7e97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:49.413376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-484e16fe-4e4c-4e33-aa72-819d8cda7e97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:49.498311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:49.634103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:49.635180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:49.636320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:49.637850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lazy-loading 'fault' on Instance uuid 4c69884e-c9e6-40ac-9855-1807d03686f1 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:26:49.954579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-484e16fe-4e4c-4e33-aa72-819d8cda7e97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:49.960549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:49.994155 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-484e16fe-4e4c-4e33-aa72-819d8cda7e97 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1510 microversion: 2.1 time: 0.664048 Aug 09 17:26:49.995236 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1926/3700] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:49 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1510 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:50.032233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2834e09a-6c56-4808-9c26-aa7699006283 req-a12289f4-5f03-4323-97c2-c5210de8a319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c69884e-c9e6-40ac-9855-1807d03686f1", "name": "network-vif-deleted", "tag": "280cbdcc-d456-40b6-9c0f-cbe122512892"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:50.037967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ecbb00be7c34d3b930097d65e06ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d02fc56a4a14bb398febacd9f5d59b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:50.060015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2834e09a-6c56-4808-9c26-aa7699006283 req-a12289f4-5f03-4323-97c2-c5210de8a319 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:50.060871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2834e09a-6c56-4808-9c26-aa7699006283 req-a12289f4-5f03-4323-97c2-c5210de8a319 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:50.062064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2834e09a-6c56-4808-9c26-aa7699006283 req-a12289f4-5f03-4323-97c2-c5210de8a319 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:50.074916 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b330d650-64ce-4dcc-91b2-bf2f7e110f70 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 200 len: 1307 microversion: 2.1 time: 1.391020 Aug 09 17:26:50.093196 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1775/3701] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:48 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 1307 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:50.106173 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2834e09a-6c56-4808-9c26-aa7699006283 req-a12289f4-5f03-4323-97c2-c5210de8a319 service nova] Creating event network-vif-deleted:280cbdcc-d456-40b6-9c0f-cbe122512892 for instance 4c69884e-c9e6-40ac-9855-1807d03686f1 on n-h1-845781-6 Aug 09 17:26:50.122539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2352b98a-3c6e-466a-b7b5-3a646987d4b6 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:50.126568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2352b98a-3c6e-466a-b7b5-3a646987d4b6 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:50.148109 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2834e09a-6c56-4808-9c26-aa7699006283 req-a12289f4-5f03-4323-97c2-c5210de8a319 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136811 Aug 09 17:26:50.158613 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1927/3702] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:50.185340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-92d0dd1d-4ce2-4c9a-86c2-89232cbbf575 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:50.190810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-92d0dd1d-4ce2-4c9a-86c2-89232cbbf575 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:50.220186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92d0dd1d-4ce2-4c9a-86c2-89232cbbf575 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:50.226128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92d0dd1d-4ce2-4c9a-86c2-89232cbbf575 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:50.227461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92d0dd1d-4ce2-4c9a-86c2-89232cbbf575 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:50.228863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92d0dd1d-4ce2-4c9a-86c2-89232cbbf575 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:50.233069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92d0dd1d-4ce2-4c9a-86c2-89232cbbf575 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:50.235883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92d0dd1d-4ce2-4c9a-86c2-89232cbbf575 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:50.449324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-92d0dd1d-4ce2-4c9a-86c2-89232cbbf575 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:50.456131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2352b98a-3c6e-466a-b7b5-3a646987d4b6 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:50.465069 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-92d0dd1d-4ce2-4c9a-86c2-89232cbbf575 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1614 microversion: 2.1 time: 0.304206 Aug 09 17:26:50.466160 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1928/3703] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:50 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1614 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:50.494267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9afb99e7-4832-4aab-af9c-07644f551c8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:50.494570 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2352b98a-3c6e-466a-b7b5-3a646987d4b6 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1225 microversion: 2.1 time: 0.401063 Aug 09 17:26:50.498389 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1776/3704] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:50 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1225 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:50.501169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9afb99e7-4832-4aab-af9c-07644f551c8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:50.509807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:50.512176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9afb99e7-4832-4aab-af9c-07644f551c8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:50.512983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9afb99e7-4832-4aab-af9c-07644f551c8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:50.513991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9afb99e7-4832-4aab-af9c-07644f551c8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:50.515179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9afb99e7-4832-4aab-af9c-07644f551c8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:50.516019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9afb99e7-4832-4aab-af9c-07644f551c8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:50.516633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9afb99e7-4832-4aab-af9c-07644f551c8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:50.581253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-9afb99e7-4832-4aab-af9c-07644f551c8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lazy-loading 'flavor' on Instance uuid 91b4377c-cf52-4f83-8923-b86f8bdfff08 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:26:50.845525 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9afb99e7-4832-4aab-af9c-07644f551c8b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/action" status: 200 len: 32 microversion: 2.1 time: 0.370916 Aug 09 17:26:50.849937 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1929/3705] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:26:50 2022] POST /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/action => generated 32 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:26:50.865167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-25925b0f-4003-4c67-9a15-7f8f90aff594 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:50.866643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-25925b0f-4003-4c67-9a15-7f8f90aff594 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:50.901342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:50.936985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25925b0f-4003-4c67-9a15-7f8f90aff594 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:50.937615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25925b0f-4003-4c67-9a15-7f8f90aff594 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:50.940919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25925b0f-4003-4c67-9a15-7f8f90aff594 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:50.941877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25925b0f-4003-4c67-9a15-7f8f90aff594 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:50.942588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25925b0f-4003-4c67-9a15-7f8f90aff594 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:50.943112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25925b0f-4003-4c67-9a15-7f8f90aff594 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:51.040493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3470824-58f7-458f-baa8-5f2649c1ec61 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:51.043059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b3470824-58f7-458f-baa8-5f2649c1ec61 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:51.053368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3470824-58f7-458f-baa8-5f2649c1ec61 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:51.055204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3470824-58f7-458f-baa8-5f2649c1ec61 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:51.056235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3470824-58f7-458f-baa8-5f2649c1ec61 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:51.059132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3470824-58f7-458f-baa8-5f2649c1ec61 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:51.060559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3470824-58f7-458f-baa8-5f2649c1ec61 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:51.061509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3470824-58f7-458f-baa8-5f2649c1ec61 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:51.424887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3470824-58f7-458f-baa8-5f2649c1ec61 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:51.444055 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b3470824-58f7-458f-baa8-5f2649c1ec61 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1510 microversion: 2.1 time: 0.412463 Aug 09 17:26:51.459501 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1930/3706] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:51 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1510 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:51.465538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:51.466566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 4c69884e-c9e6-40ac-9855-1807d03686f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:51.478458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:51.479254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:51.480003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:51.480927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:51.481564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:51.483013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:51.512995 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] HTTP exception thrown: Instance 4c69884e-c9e6-40ac-9855-1807d03686f1 could not be found. Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Request method failure captured: Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 HTTP/1.1 Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pgGvGpV3owudcmFE7IRebqW9PQoAMcwGzR1dQsn7UzMNkMNkC-fX350NdKzkgJ8la5oVWlKXnLZ2MVPOHnU8Cd_KWUZ-GTMuwMhnEVkktBmffJ_dZjwKcsRbs1jh94Wpg9FmRZfJJOIzOcnyqqdT4ErGJvW18EkzLfqjRbQ6J6d_js Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 3d02fc56a4a14bb398febacd9f5d59b7 Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 3d02fc56a4a14bb398febacd9f5d59b7 Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerDiskConfigTestJSON-1096617605-project Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ecbb00be7c34d3b930097d65e06ee21 Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerDiskConfigTestJSON-1096617605-project Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 4c69884e-c9e6-40ac-9855-1807d03686f1 could not be found. Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '4c69884e-c9e6-40ac-9855-1807d03686f1'} Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c69884e-c9e6-40ac-9855-1807d03686f1 could not be found. Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c69884e-c9e6-40ac-9855-1807d03686f1 could not be found. Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:51.515090 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:51.518082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:51.518082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:51.518082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:51.518082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:51.518082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:51.518082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c69884e-c9e6-40ac-9855-1807d03686f1 could not be found. Aug 09 17:26:51.518082 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:51.520270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Returning 404 to user: Instance 4c69884e-c9e6-40ac-9855-1807d03686f1 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:51.521571 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-44bafe8a-5c16-423f-8723-f8ecd61df480 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1" status: 404 len: 111 microversion: 2.1 time: 0.060671 Aug 09 17:26:51.526600 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1931/3707] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:51 2022] GET /compute/v2.1/servers/4c69884e-c9e6-40ac-9855-1807d03686f1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:51.533624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6ca9d5b4-87f4-4540-963c-5876c327e512 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:51.534577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6ca9d5b4-87f4-4540-963c-5876c327e512 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:51.542595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ca9d5b4-87f4-4540-963c-5876c327e512 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:51.543473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ca9d5b4-87f4-4540-963c-5876c327e512 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:51.544185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ca9d5b4-87f4-4540-963c-5876c327e512 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:51.545158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ca9d5b4-87f4-4540-963c-5876c327e512 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:51.545848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ca9d5b4-87f4-4540-963c-5876c327e512 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:51.546497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ca9d5b4-87f4-4540-963c-5876c327e512 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:51.699451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6ca9d5b4-87f4-4540-963c-5876c327e512 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:51.728164 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6ca9d5b4-87f4-4540-963c-5876c327e512 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1614 microversion: 2.1 time: 0.199759 Aug 09 17:26:51.738608 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1932/3708] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:51 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1614 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:51.753741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:51.755658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:51.785910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:51.791698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:51.795422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:51.797591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:51.802365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:51.804287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:51.844792 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] HTTP exception thrown: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Request method failure captured: Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 HTTP/1.1 Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pgGvGpV3owudcmFE7IRebqW9PQoAMcwGzR1dQsn7UzMNkMNkC-fX350NdKzkgJ8la5oVWlKXnLZ2MVPOHnU8Cd_KWUZ-GTMuwMhnEVkktBmffJ_dZjwKcsRbs1jh94Wpg9FmRZfJJOIzOcnyqqdT4ErGJvW18EkzLfqjRbQ6J6d_js Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 3d02fc56a4a14bb398febacd9f5d59b7 Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 3d02fc56a4a14bb398febacd9f5d59b7 Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerDiskConfigTestJSON-1096617605-project Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ecbb00be7c34d3b930097d65e06ee21 Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerDiskConfigTestJSON-1096617605-project Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '77084f1c-828b-45e4-accc-a1ba292b1498'} Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:51.848028 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:51.852365 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. Aug 09 17:26:51.852365 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:51.852365 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:51.852365 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:51.852365 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:51.852365 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:51.852365 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:51.852365 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:51.852365 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:51.852365 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. Aug 09 17:26:51.852365 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:51.855560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Returning 404 to user: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:51.856774 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f618f7bf-4134-4c8b-af1f-60ec8e1191a2 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "DELETE /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 404 len: 111 microversion: 2.1 time: 0.116223 Aug 09 17:26:51.857465 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1933/3709] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:26:51 2022] DELETE /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:51.867892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06ad3a0b-5272-49bd-813c-751c29f31d33 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:51.868616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-06ad3a0b-5272-49bd-813c-751c29f31d33 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:51.881798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06ad3a0b-5272-49bd-813c-751c29f31d33 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:51.882667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06ad3a0b-5272-49bd-813c-751c29f31d33 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:51.883284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06ad3a0b-5272-49bd-813c-751c29f31d33 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:51.886561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06ad3a0b-5272-49bd-813c-751c29f31d33 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:51.887288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06ad3a0b-5272-49bd-813c-751c29f31d33 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:51.887959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06ad3a0b-5272-49bd-813c-751c29f31d33 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:52.109753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-06ad3a0b-5272-49bd-813c-751c29f31d33 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:52.124044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-25925b0f-4003-4c67-9a15-7f8f90aff594 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:52.152209 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-25925b0f-4003-4c67-9a15-7f8f90aff594 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1736 microversion: 2.1 time: 1.293743 Aug 09 17:26:52.155066 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1777/3710] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:50 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1736 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:52.189533 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-06ad3a0b-5272-49bd-813c-751c29f31d33 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1285 microversion: 2.1 time: 0.319447 Aug 09 17:26:52.201607 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1934/3711] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:51 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1285 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:52.270322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:52.279783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: 77084f1c-828b-45e4-accc-a1ba292b1498] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:52.325580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:52.326593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:52.327304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:52.328528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:52.329326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:52.330007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:52.407016 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] HTTP exception thrown: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Request method failure captured: Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 HTTP/1.1 Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pgGvGpV3owudcmFE7IRebqW9PQoAMcwGzR1dQsn7UzMNkMNkC-fX350NdKzkgJ8la5oVWlKXnLZ2MVPOHnU8Cd_KWUZ-GTMuwMhnEVkktBmffJ_dZjwKcsRbs1jh94Wpg9FmRZfJJOIzOcnyqqdT4ErGJvW18EkzLfqjRbQ6J6d_js Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 3d02fc56a4a14bb398febacd9f5d59b7 Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 3d02fc56a4a14bb398febacd9f5d59b7 Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerDiskConfigTestJSON-1096617605-project Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ecbb00be7c34d3b930097d65e06ee21 Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerDiskConfigTestJSON-1096617605-project Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '77084f1c-828b-45e4-accc-a1ba292b1498'} Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:52.425704 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.433514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:52.433514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:52.433514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:52.433514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:52.433514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:52.433514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. Aug 09 17:26:52.433514 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.433514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Returning 404 to user: Instance 77084f1c-828b-45e4-accc-a1ba292b1498 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:52.433514 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-26480708-3a73-4b2c-b6df-fe60168fb6a6 tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498" status: 404 len: 111 microversion: 2.1 time: 0.220567 Aug 09 17:26:52.433514 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1935/3712] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:52 2022] GET /compute/v2.1/servers/77084f1c-828b-45e4-accc-a1ba292b1498 => generated 111 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:52.442430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-495df738-715c-406d-9748-27b55184efaf req-c1f404e1-1d56-4684-9d0d-4a7feb1f7b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b120e8-277c-49bb-83e5-1de30e80fd50", "name": "network-vif-deleted", "tag": "8c141125-13a2-4dc7-9c17-2908b01ba8da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:52.504197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-495df738-715c-406d-9748-27b55184efaf req-c1f404e1-1d56-4684-9d0d-4a7feb1f7b3f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:52.505088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-495df738-715c-406d-9748-27b55184efaf req-c1f404e1-1d56-4684-9d0d-4a7feb1f7b3f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:52.505876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-495df738-715c-406d-9748-27b55184efaf req-c1f404e1-1d56-4684-9d0d-4a7feb1f7b3f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:52.584660 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-495df738-715c-406d-9748-27b55184efaf req-c1f404e1-1d56-4684-9d0d-4a7feb1f7b3f service nova] Creating event network-vif-deleted:8c141125-13a2-4dc7-9c17-2908b01ba8da for instance 55b120e8-277c-49bb-83e5-1de30e80fd50 on n-h1-845781-6 Aug 09 17:26:52.618885 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-495df738-715c-406d-9748-27b55184efaf req-c1f404e1-1d56-4684-9d0d-4a7feb1f7b3f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180087 Aug 09 17:26:52.632179 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1936/3713] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:26:52.651309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:52.652444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:52.689353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:52.690335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:52.691059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:52.712234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:52.713541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:52.715614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:52.796728 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] HTTP exception thrown: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Request method failure captured: Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 HTTP/1.1 Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pgGvGpV3owudcmFE7IRebqW9PQoAMcwGzR1dQsn7UzMNkMNkC-fX350NdKzkgJ8la5oVWlKXnLZ2MVPOHnU8Cd_KWUZ-GTMuwMhnEVkktBmffJ_dZjwKcsRbs1jh94Wpg9FmRZfJJOIzOcnyqqdT4ErGJvW18EkzLfqjRbQ6J6d_js Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 3d02fc56a4a14bb398febacd9f5d59b7 Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 3d02fc56a4a14bb398febacd9f5d59b7 Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerDiskConfigTestJSON-1096617605-project Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ecbb00be7c34d3b930097d65e06ee21 Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerDiskConfigTestJSON-1096617605-project Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'cd6760ec-412a-42a8-968d-ce3ebf298c73'} Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:52.800453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:52.803385 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. Aug 09 17:26:52.803385 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.803385 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:52.803385 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.803385 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:52.803385 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:52.803385 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:52.803385 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:52.803385 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:52.803385 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. Aug 09 17:26:52.803385 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.813937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Returning 404 to user: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:52.814705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad2ef72e-509a-4ebc-917e-68453f4f4e63 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1464306795", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:52.815385 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3be4b363-7a00-4fc6-8ad8-f59a70fd93cf tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 404 len: 111 microversion: 2.1 time: 0.181010 Aug 09 17:26:52.816343 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1937/3714] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:26:52 2022] DELETE /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:52.822716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a8f1c668-c6b2-4d92-a64e-762581399225 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:52.823969 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ad2ef72e-509a-4ebc-917e-68453f4f4e63 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] HTTP exception thrown: min_count must be <= max_count Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad2ef72e-509a-4ebc-917e-68453f4f4e63 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Request method failure captured: Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 184 Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pjbPyaMaEKUkNpGiqIUertEEAYbnIzFNvi_1AYMshZWnqpUd0soaDC6OjNGVLkWm1N8GIsATpp_r9dH3nPX-nwExF0XWIdWxmCEL2ll1eF8THkAO5fWU2OwSD-M2hVdOv7jPsPi4XroK18XNPd1DW0DGAJWGmXRzsQv2dCUZSOCIHw Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5d93b67a594a4bf8b9924aa2d4a2eaab Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5d93b67a594a4bf8b9924aa2d4a2eaab Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-MultipleCreateNegativeTestJSON-1223786353-project Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: aff9ade416d441408fad724f75a65325 Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1223786353-project Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1464306795", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: exception: min_count must be <= max_count Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1464306795', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 09 17:26:52.825577 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:52.840222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad2ef72e-509a-4ebc-917e-68453f4f4e63 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Returning 400 to user: min_count must be <= max_count {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:52.840222 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad2ef72e-509a-4ebc-917e-68453f4f4e63 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.670241 Aug 09 17:26:52.840222 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1778/3715] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:26:52 2022] POST /compute/v2.1/servers => generated 74 bytes in 671 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 17:26:52.846503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a8f1c668-c6b2-4d92-a64e-762581399225 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:52.852908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:52.853405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:52.860750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8f1c668-c6b2-4d92-a64e-762581399225 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:52.865189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8f1c668-c6b2-4d92-a64e-762581399225 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:52.867081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8f1c668-c6b2-4d92-a64e-762581399225 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:52.869015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8f1c668-c6b2-4d92-a64e-762581399225 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:52.869766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8f1c668-c6b2-4d92-a64e-762581399225 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:52.870534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8f1c668-c6b2-4d92-a64e-762581399225 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:52.905961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:52.912650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:52.913334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:52.930566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:52.933121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:52.938686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:53.065117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:53.068229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:53.076269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:53.077240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lazy-loading 'fault' on Instance uuid 55b120e8-277c-49bb-83e5-1de30e80fd50 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:26:53.432223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a8f1c668-c6b2-4d92-a64e-762581399225 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:53.483536 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a8f1c668-c6b2-4d92-a64e-762581399225 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1510 microversion: 2.1 time: 0.663908 Aug 09 17:26:53.486793 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1938/3716] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:52 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1510 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:53.517522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:53.521667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] [instance: cd6760ec-412a-42a8-968d-ce3ebf298c73] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:53.523287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:53.552819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:53.556270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:53.557354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:53.558590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:53.564774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:53.567173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:53.576063 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5bb286a-824f-4900-83a5-5acdc5850b58 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 200 len: 1330 microversion: 2.1 time: 0.729471 Aug 09 17:26:53.580838 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1779/3717] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:52 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 1330 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:53.608221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b44bac10-12d3-4e17-805d-f4b4562adabf tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1204068324", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "max_count": 0}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b44bac10-12d3-4e17-805d-f4b4562adabf tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Request method failure captured: Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 168 Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pjbPyaMaEKUkNpGiqIUertEEAYbnIzFNvi_1AYMshZWnqpUd0soaDC6OjNGVLkWm1N8GIsATpp_r9dH3nPX-nwExF0XWIdWxmCEL2ll1eF8THkAO5fWU2OwSD-M2hVdOv7jPsPi4XroK18XNPd1DW0DGAJWGmXRzsQv2dCUZSOCIHw Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5d93b67a594a4bf8b9924aa2d4a2eaab Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5d93b67a594a4bf8b9924aa2d4a2eaab Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-MultipleCreateNegativeTestJSON-1223786353-project Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: aff9ade416d441408fad724f75a65325 Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1223786353-project Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1204068324", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "max_count": 0}} Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1204068324', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'max_count': 0}}} Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 0 Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:26:53.629010 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 09 17:26:53.635286 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.641111 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] HTTP exception thrown: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Request method failure captured: Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 HTTP/1.1 Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pgGvGpV3owudcmFE7IRebqW9PQoAMcwGzR1dQsn7UzMNkMNkC-fX350NdKzkgJ8la5oVWlKXnLZ2MVPOHnU8Cd_KWUZ-GTMuwMhnEVkktBmffJ_dZjwKcsRbs1jh94Wpg9FmRZfJJOIzOcnyqqdT4ErGJvW18EkzLfqjRbQ6J6d_js Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 3d02fc56a4a14bb398febacd9f5d59b7 Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3d02fc56a4a14bb398febacd9f5d59b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 3d02fc56a4a14bb398febacd9f5d59b7 Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1096617605 Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerDiskConfigTestJSON-1096617605-project Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1ecbb00be7c34d3b930097d65e06ee21 Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerDiskConfigTestJSON-1096617605-project Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'cd6760ec-412a-42a8-968d-ce3ebf298c73'} Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:53.650346 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.658153 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:53.658153 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:53.658153 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:53.658153 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:53.658153 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:53.658153 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. Aug 09 17:26:53.658153 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:53.658153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] Returning 404 to user: Instance cd6760ec-412a-42a8-968d-ce3ebf298c73 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:53.659992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88cfbd07-87b4-4198-872d-01fb289396de tempest-ServerDiskConfigTestJSON-1096617605 tempest-ServerDiskConfigTestJSON-1096617605-project] 10.222.0.93 "GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73" status: 404 len: 111 microversion: 2.1 time: 0.167189 Aug 09 17:26:53.666292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b44bac10-12d3-4e17-805d-f4b4562adabf tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:53.668416 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1939/3718] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:53 2022] GET /compute/v2.1/servers/cd6760ec-412a-42a8-968d-ce3ebf298c73 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:53.673718 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b44bac10-12d3-4e17-805d-f4b4562adabf tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.090346 Aug 09 17:26:53.691793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-666995f5-592d-4e15-932a-3fa9eaee02c1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:53.691793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-666995f5-592d-4e15-932a-3fa9eaee02c1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:53.693071 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1780/3719] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:26:53 2022] POST /compute/v2.1/servers => generated 130 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:26:53.728828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-89800da6-5612-4d56-a6cf-9bf407378d6e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:53.736660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-89800da6-5612-4d56-a6cf-9bf407378d6e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:53.744237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-666995f5-592d-4e15-932a-3fa9eaee02c1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:53.745650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-666995f5-592d-4e15-932a-3fa9eaee02c1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:53.747254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-666995f5-592d-4e15-932a-3fa9eaee02c1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:53.752749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-666995f5-592d-4e15-932a-3fa9eaee02c1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:53.756467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-666995f5-592d-4e15-932a-3fa9eaee02c1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:53.757701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-666995f5-592d-4e15-932a-3fa9eaee02c1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:53.797777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-89800da6-5612-4d56-a6cf-9bf407378d6e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:53.801332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-89800da6-5612-4d56-a6cf-9bf407378d6e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:53.808198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-89800da6-5612-4d56-a6cf-9bf407378d6e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:53.810109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-89800da6-5612-4d56-a6cf-9bf407378d6e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:53.815653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-89800da6-5612-4d56-a6cf-9bf407378d6e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:53.817112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-89800da6-5612-4d56-a6cf-9bf407378d6e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:54.291423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-666995f5-592d-4e15-932a-3fa9eaee02c1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:54.333839 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-666995f5-592d-4e15-932a-3fa9eaee02c1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1736 microversion: 2.1 time: 0.661947 Aug 09 17:26:54.334906 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1940/3720] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:53 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1736 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:54.382490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fc00ea9e-150b-40f2-8a07-17d104a38139 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-396576354", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "max_count": 2.5}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fc00ea9e-150b-40f2-8a07-17d104a38139 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Request method failure captured: Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 169 Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pjbPyaMaEKUkNpGiqIUertEEAYbnIzFNvi_1AYMshZWnqpUd0soaDC6OjNGVLkWm1N8GIsATpp_r9dH3nPX-nwExF0XWIdWxmCEL2ll1eF8THkAO5fWU2OwSD-M2hVdOv7jPsPi4XroK18XNPd1DW0DGAJWGmXRzsQv2dCUZSOCIHw Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5d93b67a594a4bf8b9924aa2d4a2eaab Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5d93b67a594a4bf8b9924aa2d4a2eaab Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-MultipleCreateNegativeTestJSON-1223786353-project Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: aff9ade416d441408fad724f75a65325 Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1223786353-project Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-396576354", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "max_count": 2.5}} Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-396576354', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'max_count': 2.5}}} Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi 2.5 Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:26:54.413745 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.422988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fc00ea9e-150b-40f2-8a07-17d104a38139 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:54.428543 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fc00ea9e-150b-40f2-8a07-17d104a38139 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.048076 Aug 09 17:26:54.429644 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1941/3721] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:26:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:26:54.529292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b14f5740-91aa-4d7c-81f7-54dce3f3a358 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:54.530374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b14f5740-91aa-4d7c-81f7-54dce3f3a358 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:54.559506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14f5740-91aa-4d7c-81f7-54dce3f3a358 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:54.565539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14f5740-91aa-4d7c-81f7-54dce3f3a358 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:54.567015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14f5740-91aa-4d7c-81f7-54dce3f3a358 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:54.572264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14f5740-91aa-4d7c-81f7-54dce3f3a358 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:54.573523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14f5740-91aa-4d7c-81f7-54dce3f3a358 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:54.574553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14f5740-91aa-4d7c-81f7-54dce3f3a358 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:54.816835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-89800da6-5612-4d56-a6cf-9bf407378d6e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:54.848699 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-89800da6-5612-4d56-a6cf-9bf407378d6e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1283 microversion: 2.1 time: 1.138077 Aug 09 17:26:54.864517 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1781/3722] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:53 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1283 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:54.895241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a041c8e8-bc54-42d1-b7ed-7a78b530493b tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1891936558", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "min_count": 0}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a041c8e8-bc54-42d1-b7ed-7a78b530493b tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Request method failure captured: Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 168 Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pjbPyaMaEKUkNpGiqIUertEEAYbnIzFNvi_1AYMshZWnqpUd0soaDC6OjNGVLkWm1N8GIsATpp_r9dH3nPX-nwExF0XWIdWxmCEL2ll1eF8THkAO5fWU2OwSD-M2hVdOv7jPsPi4XroK18XNPd1DW0DGAJWGmXRzsQv2dCUZSOCIHw Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5d93b67a594a4bf8b9924aa2d4a2eaab Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5d93b67a594a4bf8b9924aa2d4a2eaab Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-MultipleCreateNegativeTestJSON-1223786353-project Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: aff9ade416d441408fad724f75a65325 Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1223786353-project Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1891936558", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "min_count": 0}} Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1891936558', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'min_count': 0}}} Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 0 Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:26:54.906085 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 09 17:26:54.914406 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:54.920198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a041c8e8-bc54-42d1-b7ed-7a78b530493b tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:54.921978 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a041c8e8-bc54-42d1-b7ed-7a78b530493b tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.055238 Aug 09 17:26:54.936517 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1782/3723] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:26:54 2022] POST /compute/v2.1/servers => generated 130 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:26:54.953010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:54.954188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:54.994734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:54.998718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:54.999804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:55.004057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:55.005163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:55.009502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:55.059803 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 HTTP/1.1 Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '55b120e8-277c-49bb-83e5-1de30e80fd50'} Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:55.063465 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.071450 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:55.071450 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:55.071450 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:55.071450 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:26:55.071450 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:26:55.071450 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:26:55.071450 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.074654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:55.076678 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f6460d29-f83c-499f-9b50-2fe0d3509cb4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 404 len: 111 microversion: 2.1 time: 0.138318 Aug 09 17:26:55.078475 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1783/3724] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:54 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:26:55.115884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-29500b67-1e55-4078-a3e3-0fe716d11dd0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '.version_select at 0x7fbbca3c6820>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:55.187580 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-29500b67-1e55-4078-a3e3-0fe716d11dd0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-605002989" status: 202 len: 0 microversion: 2.1 time: 0.101988 Aug 09 17:26:55.188949 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1784/3725] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:26:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-605002989 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:26:55.203724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-76cd1159-b79d-4f8d-bcdd-42c878432b64 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1710142187", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "min_count": 2.5}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-76cd1159-b79d-4f8d-bcdd-42c878432b64 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Request method failure captured: Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 170 Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pjbPyaMaEKUkNpGiqIUertEEAYbnIzFNvi_1AYMshZWnqpUd0soaDC6OjNGVLkWm1N8GIsATpp_r9dH3nPX-nwExF0XWIdWxmCEL2ll1eF8THkAO5fWU2OwSD-M2hVdOv7jPsPi4XroK18XNPd1DW0DGAJWGmXRzsQv2dCUZSOCIHw Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5d93b67a594a4bf8b9924aa2d4a2eaab Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5d93b67a594a4bf8b9924aa2d4a2eaab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5d93b67a594a4bf8b9924aa2d4a2eaab Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1223786353 Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-MultipleCreateNegativeTestJSON-1223786353-project Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: aff9ade416d441408fad724f75a65325 Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1223786353-project Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1710142187", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "min_count": 2.5}} Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1710142187', 'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d', 'flavorRef': '452', 'min_count': 2.5}}} Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 2.5 Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:26:55.215160 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 17:26:55.221209 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:26:55.235746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-76cd1159-b79d-4f8d-bcdd-42c878432b64 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:26:55.241783 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-76cd1159-b79d-4f8d-bcdd-42c878432b64 tempest-MultipleCreateNegativeTestJSON-1223786353 tempest-MultipleCreateNegativeTestJSON-1223786353-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.050763 Aug 09 17:26:55.250015 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1785/3726] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:26:55 2022] POST /compute/v2.1/servers => generated 139 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:26:55.280871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b14f5740-91aa-4d7c-81f7-54dce3f3a358 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:55.324801 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b14f5740-91aa-4d7c-81f7-54dce3f3a358 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1510 microversion: 2.1 time: 0.802472 Aug 09 17:26:55.326560 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1942/3727] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:54 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1510 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:55.392418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-50fde1d8-bf47-4197-a2a3-c8604faa8268 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:55.394186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-50fde1d8-bf47-4197-a2a3-c8604faa8268 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:55.425260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50fde1d8-bf47-4197-a2a3-c8604faa8268 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:55.428746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50fde1d8-bf47-4197-a2a3-c8604faa8268 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:55.431569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50fde1d8-bf47-4197-a2a3-c8604faa8268 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:55.442610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50fde1d8-bf47-4197-a2a3-c8604faa8268 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:55.446159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50fde1d8-bf47-4197-a2a3-c8604faa8268 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:55.447959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50fde1d8-bf47-4197-a2a3-c8604faa8268 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:55.891284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c5aa09cc-28b9-41bf-96ae-3c248448b45e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:55.894439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c5aa09cc-28b9-41bf-96ae-3c248448b45e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:55.962724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aa09cc-28b9-41bf-96ae-3c248448b45e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:55.964177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aa09cc-28b9-41bf-96ae-3c248448b45e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:55.967311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aa09cc-28b9-41bf-96ae-3c248448b45e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:55.972758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aa09cc-28b9-41bf-96ae-3c248448b45e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:55.977789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aa09cc-28b9-41bf-96ae-3c248448b45e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:55.978634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5aa09cc-28b9-41bf-96ae-3c248448b45e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:56.246021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c5aa09cc-28b9-41bf-96ae-3c248448b45e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:56.270139 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c5aa09cc-28b9-41bf-96ae-3c248448b45e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1283 microversion: 2.1 time: 0.386008 Aug 09 17:26:56.285383 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1943/3728] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:55 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1283 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:56.373844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5e6b11b1-bf5d-4782-9ee6-76098ef78ec5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:56.387981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5e6b11b1-bf5d-4782-9ee6-76098ef78ec5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:56.400900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6b11b1-bf5d-4782-9ee6-76098ef78ec5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:56.405220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6b11b1-bf5d-4782-9ee6-76098ef78ec5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:56.406204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6b11b1-bf5d-4782-9ee6-76098ef78ec5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:56.407578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6b11b1-bf5d-4782-9ee6-76098ef78ec5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:56.410993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6b11b1-bf5d-4782-9ee6-76098ef78ec5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:56.417110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6b11b1-bf5d-4782-9ee6-76098ef78ec5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:57.031528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5e6b11b1-bf5d-4782-9ee6-76098ef78ec5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:57.053664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5e6b11b1-bf5d-4782-9ee6-76098ef78ec5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1510 microversion: 2.1 time: 0.687714 Aug 09 17:26:57.054890 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1944/3729] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:56 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1510 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:57.068392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-50fde1d8-bf47-4197-a2a3-c8604faa8268 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:57.083888 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-50fde1d8-bf47-4197-a2a3-c8604faa8268 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1736 microversion: 2.1 time: 1.705625 Aug 09 17:26:57.100091 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1786/3730] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:55 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1736 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:26:57.309654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d834166d-8b71-4e3b-b08b-a5f890fa77e2 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:57.310411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d834166d-8b71-4e3b-b08b-a5f890fa77e2 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:57.352952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d834166d-8b71-4e3b-b08b-a5f890fa77e2 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:57.353730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d834166d-8b71-4e3b-b08b-a5f890fa77e2 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:57.354352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d834166d-8b71-4e3b-b08b-a5f890fa77e2 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:57.355126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d834166d-8b71-4e3b-b08b-a5f890fa77e2 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:57.355834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d834166d-8b71-4e3b-b08b-a5f890fa77e2 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:57.356137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d834166d-8b71-4e3b-b08b-a5f890fa77e2 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:57.739828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d834166d-8b71-4e3b-b08b-a5f890fa77e2 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:26:57.774525 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d834166d-8b71-4e3b-b08b-a5f890fa77e2 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1283 microversion: 2.1 time: 0.468677 Aug 09 17:26:57.791519 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1945/3731] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:57 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1283 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:26:58.094412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-86884fe2-35cb-46b5-b0d3-38b034210b89 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:58.095540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-86884fe2-35cb-46b5-b0d3-38b034210b89 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:58.132773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac82d54b-87c0-42dd-bd26-9d35a7fcb76a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:26:58.134176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86884fe2-35cb-46b5-b0d3-38b034210b89 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:58.135021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86884fe2-35cb-46b5-b0d3-38b034210b89 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:58.135828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86884fe2-35cb-46b5-b0d3-38b034210b89 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:58.137075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86884fe2-35cb-46b5-b0d3-38b034210b89 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:58.137904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86884fe2-35cb-46b5-b0d3-38b034210b89 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:58.138663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86884fe2-35cb-46b5-b0d3-38b034210b89 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:58.141842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ac82d54b-87c0-42dd-bd26-9d35a7fcb76a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:26:58.192187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac82d54b-87c0-42dd-bd26-9d35a7fcb76a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:58.193062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac82d54b-87c0-42dd-bd26-9d35a7fcb76a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:58.193844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac82d54b-87c0-42dd-bd26-9d35a7fcb76a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:58.198437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac82d54b-87c0-42dd-bd26-9d35a7fcb76a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:26:58.199386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac82d54b-87c0-42dd-bd26-9d35a7fcb76a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:26:58.244333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac82d54b-87c0-42dd-bd26-9d35a7fcb76a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:26:58.654645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:26:58.730379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:00.493074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:00.941390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ac82d54b-87c0-42dd-bd26-9d35a7fcb76a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:00.958677 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ac82d54b-87c0-42dd-bd26-9d35a7fcb76a tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1736 microversion: 2.1 time: 2.836547 Aug 09 17:27:00.963705 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1946/3732] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:58 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1736 bytes in 2844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:00.976633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3290f723-1087-4422-92a7-e94014d2c5a7 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:00.979393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3290f723-1087-4422-92a7-e94014d2c5a7 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:00.994591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3290f723-1087-4422-92a7-e94014d2c5a7 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:00.995437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3290f723-1087-4422-92a7-e94014d2c5a7 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:00.996076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3290f723-1087-4422-92a7-e94014d2c5a7 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:00.997438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3290f723-1087-4422-92a7-e94014d2c5a7 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:00.998754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3290f723-1087-4422-92a7-e94014d2c5a7 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:00.999473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3290f723-1087-4422-92a7-e94014d2c5a7 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:01.030447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:01.196696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-86884fe2-35cb-46b5-b0d3-38b034210b89 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:01.237389 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-86884fe2-35cb-46b5-b0d3-38b034210b89 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1531 microversion: 2.1 time: 3.149183 Aug 09 17:27:01.240566 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1787/3733] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:26:58 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1531 bytes in 3155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:02.004294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6aaefa61-6524-40f2-b4c4-92870a8f7e86 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:02.015434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6aaefa61-6524-40f2-b4c4-92870a8f7e86 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:02.055876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6aaefa61-6524-40f2-b4c4-92870a8f7e86 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:02.056931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6aaefa61-6524-40f2-b4c4-92870a8f7e86 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:02.057705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6aaefa61-6524-40f2-b4c4-92870a8f7e86 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:02.059264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6aaefa61-6524-40f2-b4c4-92870a8f7e86 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:02.068189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6aaefa61-6524-40f2-b4c4-92870a8f7e86 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:02.071929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6aaefa61-6524-40f2-b4c4-92870a8f7e86 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:02.319080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3290f723-1087-4422-92a7-e94014d2c5a7 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:02.359334 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3290f723-1087-4422-92a7-e94014d2c5a7 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1325 microversion: 2.1 time: 1.393481 Aug 09 17:27:02.365022 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1947/3734] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:00 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1325 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:02.402110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ebb0082e-e613-47ad-bf95-8e689c9deee3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:02.403725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ebb0082e-e613-47ad-bf95-8e689c9deee3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:02.439006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebb0082e-e613-47ad-bf95-8e689c9deee3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:02.458991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebb0082e-e613-47ad-bf95-8e689c9deee3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:02.460237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebb0082e-e613-47ad-bf95-8e689c9deee3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:02.463220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebb0082e-e613-47ad-bf95-8e689c9deee3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:02.467274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebb0082e-e613-47ad-bf95-8e689c9deee3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:02.468417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebb0082e-e613-47ad-bf95-8e689c9deee3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:03.404606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ebb0082e-e613-47ad-bf95-8e689c9deee3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:03.470826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6aaefa61-6524-40f2-b4c4-92870a8f7e86 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:03.484116 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ebb0082e-e613-47ad-bf95-8e689c9deee3 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 1.098660 Aug 09 17:27:03.485521 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1948/3735] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:02 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:03.500524 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6aaefa61-6524-40f2-b4c4-92870a8f7e86 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1736 microversion: 2.1 time: 1.497557 Aug 09 17:27:03.505005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-20dd9ee4-4736-4f81-93bb-72d145183c78 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: .version_select at 0x7fbbcb7f7550>, body: {"keypair": {"name": "tempest-keypair-930844384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6JXh7ms22pquIQ+qrPwUiKbe8EcIzPG16hLVkPStAWgCayOfmq5fBynLD02bB0/hdUdkmMlhMmy6UAMou6Fv4D3KduH0ueJCX0xvhbo2i0gLPJ4YOcxjFGwZVaPs8kpA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:03.524957 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1788/3736] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:01 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1736 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:03.546388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eb25dfb4-2ecb-4584-949f-88ae51cba422 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:03.548984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eb25dfb4-2ecb-4584-949f-88ae51cba422 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:03.580140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb25dfb4-2ecb-4584-949f-88ae51cba422 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:03.582596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb25dfb4-2ecb-4584-949f-88ae51cba422 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:03.583328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb25dfb4-2ecb-4584-949f-88ae51cba422 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:03.590837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb25dfb4-2ecb-4584-949f-88ae51cba422 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:03.592427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb25dfb4-2ecb-4584-949f-88ae51cba422 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:03.594107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb25dfb4-2ecb-4584-949f-88ae51cba422 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:03.649832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-20dd9ee4-4736-4f81-93bb-72d145183c78 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:27:03.685139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-20dd9ee4-4736-4f81-93bb-72d145183c78 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for user be0fad88d219437eaed454ba916c86e3 and project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:27:03.793980 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [None req-20dd9ee4-4736-4f81-93bb-72d145183c78 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [49dc9fd5-bcbd-4fa9-bc72-49fff9e68c2b] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 17:27:04.542731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eb25dfb4-2ecb-4584-949f-88ae51cba422 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:04.562510 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eb25dfb4-2ecb-4584-949f-88ae51cba422 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1325 microversion: 2.1 time: 1.026489 Aug 09 17:27:04.564256 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1789/3737] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:03 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1325 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:04.590801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ac680e15-ea5d-4f83-99df-3f0e8144e969 req-b5e4f6de-b687-4e87-8d0e-264d3e7bf981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af26977-0da1-475d-b754-4460e79e4fc3", "name": "network-vif-plugged", "status": "completed", "tag": "81270b4a-19dd-474c-8c8e-456472b48c81"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:04.670986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ac680e15-ea5d-4f83-99df-3f0e8144e969 req-b5e4f6de-b687-4e87-8d0e-264d3e7bf981 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:04.679244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ac680e15-ea5d-4f83-99df-3f0e8144e969 req-b5e4f6de-b687-4e87-8d0e-264d3e7bf981 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:04.681014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ac680e15-ea5d-4f83-99df-3f0e8144e969 req-b5e4f6de-b687-4e87-8d0e-264d3e7bf981 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:04.739397 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ac680e15-ea5d-4f83-99df-3f0e8144e969 req-b5e4f6de-b687-4e87-8d0e-264d3e7bf981 service nova] Creating event network-vif-plugged:81270b4a-19dd-474c-8c8e-456472b48c81 for instance 9af26977-0da1-475d-b754-4460e79e4fc3 on n-h2-845781-6 Aug 09 17:27:04.775797 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ac680e15-ea5d-4f83-99df-3f0e8144e969 req-b5e4f6de-b687-4e87-8d0e-264d3e7bf981 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190801 Aug 09 17:27:04.777103 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1790/3738] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:04.806901 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [None req-20dd9ee4-4736-4f81-93bb-72d145183c78 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [49dc9fd5-bcbd-4fa9-bc72-49fff9e68c2b] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 52042. Aug 09 17:27:04.823391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d25f22e4-6583-4492-8974-ca560b9e29fc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:04.837531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d25f22e4-6583-4492-8974-ca560b9e29fc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:04.839207 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-20dd9ee4-4736-4f81-93bb-72d145183c78 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.350065 Aug 09 17:27:04.854401 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1949/3739] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:27:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:04.863333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d25f22e4-6583-4492-8974-ca560b9e29fc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:04.869757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d25f22e4-6583-4492-8974-ca560b9e29fc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:04.870848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d25f22e4-6583-4492-8974-ca560b9e29fc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:04.872589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d25f22e4-6583-4492-8974-ca560b9e29fc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:04.876067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a6213e69-725f-430c-97ac-20acc47f7807 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:04.876916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d25f22e4-6583-4492-8974-ca560b9e29fc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:04.877436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a6213e69-725f-430c-97ac-20acc47f7807 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:04.878553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d25f22e4-6583-4492-8974-ca560b9e29fc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:04.901623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6213e69-725f-430c-97ac-20acc47f7807 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:04.908255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6213e69-725f-430c-97ac-20acc47f7807 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:04.914221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6213e69-725f-430c-97ac-20acc47f7807 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:04.915919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6213e69-725f-430c-97ac-20acc47f7807 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:04.916992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6213e69-725f-430c-97ac-20acc47f7807 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:04.921647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6213e69-725f-430c-97ac-20acc47f7807 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:05.708750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a6213e69-725f-430c-97ac-20acc47f7807 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:05.708750 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a6213e69-725f-430c-97ac-20acc47f7807 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1736 microversion: 2.1 time: 0.841930 Aug 09 17:27:05.708750 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1950/3740] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:04 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1736 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:05.801412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9fcb7352-24bd-4fa8-81ce-6919cf68820e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:05.811837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9fcb7352-24bd-4fa8-81ce-6919cf68820e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:05.881733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fcb7352-24bd-4fa8-81ce-6919cf68820e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:05.883035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fcb7352-24bd-4fa8-81ce-6919cf68820e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:05.884094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fcb7352-24bd-4fa8-81ce-6919cf68820e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:05.885999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fcb7352-24bd-4fa8-81ce-6919cf68820e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:05.887120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fcb7352-24bd-4fa8-81ce-6919cf68820e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:05.888144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fcb7352-24bd-4fa8-81ce-6919cf68820e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:06.758837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d25f22e4-6583-4492-8974-ca560b9e29fc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:06.790224 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d25f22e4-6583-4492-8974-ca560b9e29fc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 2.009966 Aug 09 17:27:06.792081 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1791/3741] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:04 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:06.849306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-851be00c-d049-4bbe-ad3b-78bcf9062cb4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:06.853324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-851be00c-d049-4bbe-ad3b-78bcf9062cb4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:06.870504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-851be00c-d049-4bbe-ad3b-78bcf9062cb4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:06.871988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-851be00c-d049-4bbe-ad3b-78bcf9062cb4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:06.873256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-851be00c-d049-4bbe-ad3b-78bcf9062cb4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:06.875189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-851be00c-d049-4bbe-ad3b-78bcf9062cb4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:06.876488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-851be00c-d049-4bbe-ad3b-78bcf9062cb4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:06.877644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-851be00c-d049-4bbe-ad3b-78bcf9062cb4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:07.317364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9fcb7352-24bd-4fa8-81ce-6919cf68820e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:07.353645 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9fcb7352-24bd-4fa8-81ce-6919cf68820e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1325 microversion: 2.1 time: 1.651078 Aug 09 17:27:07.355265 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1951/3742] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:05 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1325 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:07.381824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-35a16de7-8ca5-4ec2-b30d-f231914969bf req-2d1875f8-e54c-4e73-aa7d-5288df68e8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158021c5-716f-4598-8bdf-eccd0db5c3f3", "tag": "11c15c45-f68c-4bb9-a037-2f95fdd92bec"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:07.413579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-35a16de7-8ca5-4ec2-b30d-f231914969bf req-2d1875f8-e54c-4e73-aa7d-5288df68e8aa service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:07.415549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-35a16de7-8ca5-4ec2-b30d-f231914969bf req-2d1875f8-e54c-4e73-aa7d-5288df68e8aa service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:07.417494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-35a16de7-8ca5-4ec2-b30d-f231914969bf req-2d1875f8-e54c-4e73-aa7d-5288df68e8aa service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:07.453809 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-35a16de7-8ca5-4ec2-b30d-f231914969bf req-2d1875f8-e54c-4e73-aa7d-5288df68e8aa service nova] Creating event network-changed:11c15c45-f68c-4bb9-a037-2f95fdd92bec for instance 158021c5-716f-4598-8bdf-eccd0db5c3f3 on n-h1-845781-6 Aug 09 17:27:07.472551 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-35a16de7-8ca5-4ec2-b30d-f231914969bf req-2d1875f8-e54c-4e73-aa7d-5288df68e8aa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112002 Aug 09 17:27:07.477449 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1952/3743] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:07.849981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-79e4fbdb-9c41-4047-ba02-44df3c0b3bf7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:07.855441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-79e4fbdb-9c41-4047-ba02-44df3c0b3bf7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:07.891849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79e4fbdb-9c41-4047-ba02-44df3c0b3bf7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:07.896578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79e4fbdb-9c41-4047-ba02-44df3c0b3bf7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:07.901736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79e4fbdb-9c41-4047-ba02-44df3c0b3bf7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:07.904997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79e4fbdb-9c41-4047-ba02-44df3c0b3bf7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:07.906562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-851be00c-d049-4bbe-ad3b-78bcf9062cb4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:07.910492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79e4fbdb-9c41-4047-ba02-44df3c0b3bf7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:07.911321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79e4fbdb-9c41-4047-ba02-44df3c0b3bf7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:07.951088 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-851be00c-d049-4bbe-ad3b-78bcf9062cb4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1736 microversion: 2.1 time: 1.131347 Aug 09 17:27:07.953196 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1792/3744] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:06 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1736 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:08.405046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4628099d-5bc8-4e38-bcf1-ca98556d2e53 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:08.408344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4628099d-5bc8-4e38-bcf1-ca98556d2e53 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:08.449757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4628099d-5bc8-4e38-bcf1-ca98556d2e53 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:08.462708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4628099d-5bc8-4e38-bcf1-ca98556d2e53 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:08.464408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4628099d-5bc8-4e38-bcf1-ca98556d2e53 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:08.473081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4628099d-5bc8-4e38-bcf1-ca98556d2e53 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:08.474095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4628099d-5bc8-4e38-bcf1-ca98556d2e53 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:08.479889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4628099d-5bc8-4e38-bcf1-ca98556d2e53 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:08.835836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-79e4fbdb-9c41-4047-ba02-44df3c0b3bf7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:08.878625 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-79e4fbdb-9c41-4047-ba02-44df3c0b3bf7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 1.039788 Aug 09 17:27:08.880020 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1953/3745] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:07 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:09.005288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2fb4271a-8e09-4352-9fc4-b7be4c7ae897 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:09.008206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2fb4271a-8e09-4352-9fc4-b7be4c7ae897 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:09.046312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb4271a-8e09-4352-9fc4-b7be4c7ae897 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:09.047672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb4271a-8e09-4352-9fc4-b7be4c7ae897 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:09.050154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb4271a-8e09-4352-9fc4-b7be4c7ae897 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:09.051671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb4271a-8e09-4352-9fc4-b7be4c7ae897 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:09.064255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb4271a-8e09-4352-9fc4-b7be4c7ae897 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:09.065644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb4271a-8e09-4352-9fc4-b7be4c7ae897 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:09.443100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4628099d-5bc8-4e38-bcf1-ca98556d2e53 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:09.481309 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4628099d-5bc8-4e38-bcf1-ca98556d2e53 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1325 microversion: 2.1 time: 1.091373 Aug 09 17:27:09.489372 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1793/3746] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:08 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1325 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:27:09.907088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e3e66aac-a194-4919-ab49-2d21a3f80567 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:09.907768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e3e66aac-a194-4919-ab49-2d21a3f80567 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:09.935946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3e66aac-a194-4919-ab49-2d21a3f80567 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:09.936625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3e66aac-a194-4919-ab49-2d21a3f80567 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:09.937093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3e66aac-a194-4919-ab49-2d21a3f80567 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:09.937871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3e66aac-a194-4919-ab49-2d21a3f80567 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:09.938354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3e66aac-a194-4919-ab49-2d21a3f80567 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:09.938796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3e66aac-a194-4919-ab49-2d21a3f80567 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:11.044816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e3e66aac-a194-4919-ab49-2d21a3f80567 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:11.073975 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e3e66aac-a194-4919-ab49-2d21a3f80567 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 1.171530 Aug 09 17:27:11.081410 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1794/3747] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:09 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:11.094433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0a3dc15f-5799-4033-9516-51a63fec65f8 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:11.111939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0a3dc15f-5799-4033-9516-51a63fec65f8 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:11.161124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3dc15f-5799-4033-9516-51a63fec65f8 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:11.180389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3dc15f-5799-4033-9516-51a63fec65f8 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:11.185300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3dc15f-5799-4033-9516-51a63fec65f8 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:11.187292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3dc15f-5799-4033-9516-51a63fec65f8 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:11.199956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3dc15f-5799-4033-9516-51a63fec65f8 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:11.206326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3dc15f-5799-4033-9516-51a63fec65f8 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:11.232307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2fb4271a-8e09-4352-9fc4-b7be4c7ae897 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:11.259316 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2fb4271a-8e09-4352-9fc4-b7be4c7ae897 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1736 microversion: 2.1 time: 2.265762 Aug 09 17:27:11.304984 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1954/3748] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:08 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1736 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:12.014950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0a3dc15f-5799-4033-9516-51a63fec65f8 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:12.044840 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0a3dc15f-5799-4033-9516-51a63fec65f8 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1325 microversion: 2.1 time: 0.961078 Aug 09 17:27:12.078251 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1795/3749] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:11 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1325 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:12.109298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26782615-3a54-4763-8d30-e6352daae858 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:12.110378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-26782615-3a54-4763-8d30-e6352daae858 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:12.172898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26782615-3a54-4763-8d30-e6352daae858 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:12.178371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26782615-3a54-4763-8d30-e6352daae858 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:12.187565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26782615-3a54-4763-8d30-e6352daae858 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:12.193478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26782615-3a54-4763-8d30-e6352daae858 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:12.194666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26782615-3a54-4763-8d30-e6352daae858 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:12.201006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26782615-3a54-4763-8d30-e6352daae858 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:12.333178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-152771a2-9f1a-4d9c-ab4d-0c824426a681 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:12.357468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-152771a2-9f1a-4d9c-ab4d-0c824426a681 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:12.404889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-152771a2-9f1a-4d9c-ab4d-0c824426a681 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:12.415121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-152771a2-9f1a-4d9c-ab4d-0c824426a681 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:12.423159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-152771a2-9f1a-4d9c-ab4d-0c824426a681 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:12.428355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-152771a2-9f1a-4d9c-ab4d-0c824426a681 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:12.430020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-152771a2-9f1a-4d9c-ab4d-0c824426a681 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:12.431616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-152771a2-9f1a-4d9c-ab4d-0c824426a681 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:13.742954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:13.877599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-26782615-3a54-4763-8d30-e6352daae858 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:13.914527 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-26782615-3a54-4763-8d30-e6352daae858 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 1.813695 Aug 09 17:27:13.942227 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1955/3750] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:12 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:13.971823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3b839fea-9684-4769-9c8a-c4fb0f66743f tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:13.977999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3b839fea-9684-4769-9c8a-c4fb0f66743f tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:14.009869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b839fea-9684-4769-9c8a-c4fb0f66743f tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:14.015999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b839fea-9684-4769-9c8a-c4fb0f66743f tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:14.017298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b839fea-9684-4769-9c8a-c4fb0f66743f tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:14.022512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b839fea-9684-4769-9c8a-c4fb0f66743f tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:14.025513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b839fea-9684-4769-9c8a-c4fb0f66743f tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:14.029802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b839fea-9684-4769-9c8a-c4fb0f66743f tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:14.487114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-152771a2-9f1a-4d9c-ab4d-0c824426a681 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:14.517474 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-152771a2-9f1a-4d9c-ab4d-0c824426a681 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1736 microversion: 2.1 time: 2.198400 Aug 09 17:27:14.554139 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1796/3751] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:12 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1736 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:14.963126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a5e9f53c-c0a8-46d4-b0eb-f3c3a3c13a18 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:14.964111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a5e9f53c-c0a8-46d4-b0eb-f3c3a3c13a18 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:14.983600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5e9f53c-c0a8-46d4-b0eb-f3c3a3c13a18 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:14.984386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5e9f53c-c0a8-46d4-b0eb-f3c3a3c13a18 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:14.984988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5e9f53c-c0a8-46d4-b0eb-f3c3a3c13a18 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:14.986295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5e9f53c-c0a8-46d4-b0eb-f3c3a3c13a18 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:14.987188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5e9f53c-c0a8-46d4-b0eb-f3c3a3c13a18 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:14.987836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5e9f53c-c0a8-46d4-b0eb-f3c3a3c13a18 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:15.152127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3b839fea-9684-4769-9c8a-c4fb0f66743f tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:15.168809 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3b839fea-9684-4769-9c8a-c4fb0f66743f tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1325 microversion: 2.1 time: 1.224411 Aug 09 17:27:15.169428 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1956/3752] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:13 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1325 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:15.565508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e620772c-0834-4aae-b879-1982fe94e5c0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:15.566595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e620772c-0834-4aae-b879-1982fe94e5c0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:15.596333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e620772c-0834-4aae-b879-1982fe94e5c0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:15.597748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e620772c-0834-4aae-b879-1982fe94e5c0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:15.605066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e620772c-0834-4aae-b879-1982fe94e5c0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:15.606669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e620772c-0834-4aae-b879-1982fe94e5c0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:15.607846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e620772c-0834-4aae-b879-1982fe94e5c0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:15.608870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e620772c-0834-4aae-b879-1982fe94e5c0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:15.665961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a5e9f53c-c0a8-46d4-b0eb-f3c3a3c13a18 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:15.716321 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a5e9f53c-c0a8-46d4-b0eb-f3c3a3c13a18 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 0.757330 Aug 09 17:27:15.720440 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1797/3753] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:14 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:27:16.213244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ff7de671-f28e-42fa-90b5-80820c117b97 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:16.227165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ff7de671-f28e-42fa-90b5-80820c117b97 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:16.265087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff7de671-f28e-42fa-90b5-80820c117b97 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:16.266193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff7de671-f28e-42fa-90b5-80820c117b97 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:16.267460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff7de671-f28e-42fa-90b5-80820c117b97 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:16.269215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff7de671-f28e-42fa-90b5-80820c117b97 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:16.270477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff7de671-f28e-42fa-90b5-80820c117b97 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:16.272335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff7de671-f28e-42fa-90b5-80820c117b97 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:16.864088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e620772c-0834-4aae-b879-1982fe94e5c0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:16.925010 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e620772c-0834-4aae-b879-1982fe94e5c0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1736 microversion: 2.1 time: 1.366246 Aug 09 17:27:16.940441 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1957/3754] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:15 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1736 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:16.997509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac160e98-7947-4759-8986-a39b637e5f05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:16.998641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ac160e98-7947-4759-8986-a39b637e5f05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:17.015813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ff7de671-f28e-42fa-90b5-80820c117b97 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:17.021114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:17.031059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac160e98-7947-4759-8986-a39b637e5f05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:17.050045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac160e98-7947-4759-8986-a39b637e5f05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:17.050883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac160e98-7947-4759-8986-a39b637e5f05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:17.052282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac160e98-7947-4759-8986-a39b637e5f05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:17.053036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac160e98-7947-4759-8986-a39b637e5f05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:17.053777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac160e98-7947-4759-8986-a39b637e5f05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:17.082639 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ff7de671-f28e-42fa-90b5-80820c117b97 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1325 microversion: 2.1 time: 0.863807 Aug 09 17:27:17.093185 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1798/3755] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:16 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1325 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:17.171745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-88572679", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34fc5f4c-78d4-4016-ba62-ad51259fd9d6"}], "security_groups": [{"name": "tempest-securitygroup--298974518"}], "key_name": "tempest-keypair-930844384", "user_data": "}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:18.060305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] validate_networks() for [('34fc5f4c-78d4-4016-ba62-ad51259fd9d6', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:27:18.229777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ac160e98-7947-4759-8986-a39b637e5f05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:18.270751 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ac160e98-7947-4759-8986-a39b637e5f05 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 1.325358 Aug 09 17:27:18.302747 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1958/3756] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:16 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:18.331968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2e700aef-2252-47ae-97c4-5c22b0544d61 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:18.333332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2e700aef-2252-47ae-97c4-5c22b0544d61 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:18.363545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e700aef-2252-47ae-97c4-5c22b0544d61 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:18.364763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e700aef-2252-47ae-97c4-5c22b0544d61 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:18.365709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e700aef-2252-47ae-97c4-5c22b0544d61 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:18.367070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e700aef-2252-47ae-97c4-5c22b0544d61 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:18.370650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e700aef-2252-47ae-97c4-5c22b0544d61 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:18.372955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e700aef-2252-47ae-97c4-5c22b0544d61 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:20.798458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:27:20.799370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:27:20.800620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:27:20.801579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:27:20.802566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:27:20.843214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:20.849761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:20.849761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:20.849761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:20.850643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:20.851911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:20.870831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2e700aef-2252-47ae-97c4-5c22b0544d61 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:20.920261 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2e700aef-2252-47ae-97c4-5c22b0544d61 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1736 microversion: 2.1 time: 2.615524 Aug 09 17:27:20.938167 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1959/3757] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:18 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1736 bytes in 2635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:20.968842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d764dda7-3a97-4a1a-b26d-58564046156a tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:20.970980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d764dda7-3a97-4a1a-b26d-58564046156a tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:20.980488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:20.994375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:27:21.012545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d764dda7-3a97-4a1a-b26d-58564046156a tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:21.013690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d764dda7-3a97-4a1a-b26d-58564046156a tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:21.017741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d764dda7-3a97-4a1a-b26d-58564046156a tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:21.022029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:21.022789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d764dda7-3a97-4a1a-b26d-58564046156a tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:21.025248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for user be0fad88d219437eaed454ba916c86e3 and project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:27:21.025479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d764dda7-3a97-4a1a-b26d-58564046156a tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:21.026377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d764dda7-3a97-4a1a-b26d-58564046156a tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:21.060953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:27:21.065812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:27:21.168880 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4061347b-fbc6-4058-b7d0-ef1e90be5883 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.012457 Aug 09 17:27:21.170854 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1799/3758] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:27:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 4015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:27:21.181433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e6b7aa91-298e-4f7e-a311-5dd4c02d5975 req-290c4e91-2e98-47e2-900c-5faa20ddc56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158021c5-716f-4598-8bdf-eccd0db5c3f3", "name": "network-vif-plugged", "status": "completed", "tag": "11c15c45-f68c-4bb9-a037-2f95fdd92bec"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:21.202845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e6b7aa91-298e-4f7e-a311-5dd4c02d5975 req-290c4e91-2e98-47e2-900c-5faa20ddc56d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:21.203873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e6b7aa91-298e-4f7e-a311-5dd4c02d5975 req-290c4e91-2e98-47e2-900c-5faa20ddc56d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:21.204704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e6b7aa91-298e-4f7e-a311-5dd4c02d5975 req-290c4e91-2e98-47e2-900c-5faa20ddc56d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:21.234071 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e6b7aa91-298e-4f7e-a311-5dd4c02d5975 req-290c4e91-2e98-47e2-900c-5faa20ddc56d service nova] Creating event network-vif-plugged:11c15c45-f68c-4bb9-a037-2f95fdd92bec for instance 158021c5-716f-4598-8bdf-eccd0db5c3f3 on n-h1-845781-6 Aug 09 17:27:21.270254 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e6b7aa91-298e-4f7e-a311-5dd4c02d5975 req-290c4e91-2e98-47e2-900c-5faa20ddc56d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097029 Aug 09 17:27:21.277200 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1800/3759] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:21.325558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f78e1241-0843-40a0-920c-5721fa7aaca7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:21.328221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f78e1241-0843-40a0-920c-5721fa7aaca7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:21.354917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f78e1241-0843-40a0-920c-5721fa7aaca7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:21.356329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f78e1241-0843-40a0-920c-5721fa7aaca7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:21.357447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f78e1241-0843-40a0-920c-5721fa7aaca7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:21.361856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f78e1241-0843-40a0-920c-5721fa7aaca7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:21.363790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f78e1241-0843-40a0-920c-5721fa7aaca7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:21.367976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f78e1241-0843-40a0-920c-5721fa7aaca7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:22.260842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f78e1241-0843-40a0-920c-5721fa7aaca7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:22.312912 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f78e1241-0843-40a0-920c-5721fa7aaca7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 1.028732 Aug 09 17:27:22.330077 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1801/3760] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:21 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:22.384604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d48cf085-b054-4a56-a5c7-1bdb97deef3a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:22.387102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d48cf085-b054-4a56-a5c7-1bdb97deef3a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:22.641153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d48cf085-b054-4a56-a5c7-1bdb97deef3a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:22.658205 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d48cf085-b054-4a56-a5c7-1bdb97deef3a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1239 microversion: 2.1 time: 0.311514 Aug 09 17:27:22.660114 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1802/3761] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:22 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1239 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:22.672389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bb156884-fe15-4ee6-845d-029f62c654ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:22.674419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bb156884-fe15-4ee6-845d-029f62c654ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:22.711324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb156884-fe15-4ee6-845d-029f62c654ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:22.713038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb156884-fe15-4ee6-845d-029f62c654ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:22.714906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb156884-fe15-4ee6-845d-029f62c654ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:22.716643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb156884-fe15-4ee6-845d-029f62c654ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:22.718393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb156884-fe15-4ee6-845d-029f62c654ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:22.719671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bb156884-fe15-4ee6-845d-029f62c654ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:23.003552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d764dda7-3a97-4a1a-b26d-58564046156a tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:23.077981 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d764dda7-3a97-4a1a-b26d-58564046156a tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1325 microversion: 2.1 time: 2.135345 Aug 09 17:27:23.088744 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1960/3762] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:20 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1325 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:23.167755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bb156884-fe15-4ee6-845d-029f62c654ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:23.236121 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bb156884-fe15-4ee6-845d-029f62c654ee tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1716 microversion: 2.1 time: 0.573418 Aug 09 17:27:23.256529 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1803/3763] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:22 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1716 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:23.364111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f693ded-1282-46a9-886f-295b8a90a907 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:23.364813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6f693ded-1282-46a9-886f-295b8a90a907 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:23.376698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f693ded-1282-46a9-886f-295b8a90a907 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:23.377216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f693ded-1282-46a9-886f-295b8a90a907 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:23.377674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f693ded-1282-46a9-886f-295b8a90a907 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:23.378454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f693ded-1282-46a9-886f-295b8a90a907 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:23.378951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f693ded-1282-46a9-886f-295b8a90a907 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:23.379394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f693ded-1282-46a9-886f-295b8a90a907 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:23.702608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7cf0e268-a0c9-4570-a84f-f4f49686174c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:23.707128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7cf0e268-a0c9-4570-a84f-f4f49686174c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:23.735440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7cf0e268-a0c9-4570-a84f-f4f49686174c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:23.746134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7cf0e268-a0c9-4570-a84f-f4f49686174c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:23.747394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7cf0e268-a0c9-4570-a84f-f4f49686174c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:23.748731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7cf0e268-a0c9-4570-a84f-f4f49686174c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:23.749786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7cf0e268-a0c9-4570-a84f-f4f49686174c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:23.750845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7cf0e268-a0c9-4570-a84f-f4f49686174c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:23.974120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7cf0e268-a0c9-4570-a84f-f4f49686174c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:24.030958 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7cf0e268-a0c9-4570-a84f-f4f49686174c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1291 microversion: 2.1 time: 0.334607 Aug 09 17:27:24.055268 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1804/3764] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:23 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1291 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:27:24.061666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:24.088821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:24.107431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:24.113334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:24.115891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:24.118246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:24.119545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:24.120771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:24.432657 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] HTTP exception thrown: Cannot 'detach_volume' instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 while it is in vm_state rescued Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Request method failure captured: Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments/b85f3485-fb03-4e9b-a4b9-c39d05fb69a3 HTTP/1.1 Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfTXHKJ-127xoXOxvirCkOJ5Ga7oI06dbW5eRmTw3VceZ3fIPtVcpBoJqCQEzgHg892I33A2CZbgdV9GneqCNx7frvCudUtWkW3U62800gIkrYotA0sMKiw2vzfbegwV0AsonNcEy5cWuu85myYoWYiVD7fe2x9mfaYw2xpqmhRsNo Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d20bf24928749afb9b848946419f4f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: a34881c81ae2427fbf2cbb1cd8c4ef52 Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: exception: Cannot 'detach_volume' instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 while it is in vm_state rescued Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'server_id': '91b4377c-cf52-4f83-8923-b86f8bdfff08', 'id': 'b85f3485-fb03-4e9b-a4b9-c39d05fb69a3'} Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 while it is in vm_state rescued Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:24.441478 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:24.447861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:27:24.447861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:27:24.447861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:27:24.447861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:27:24.447861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 while it is in vm_state rescued Aug 09 17:27:24.447861 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:24.458521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Returning 409 to user: Cannot 'detach_volume' instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 while it is in vm_state rescued {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:27:24.461522 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8f84f399-4530-47de-a67d-8a22aec592d4 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "DELETE /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments/b85f3485-fb03-4e9b-a4b9-c39d05fb69a3" status: 409 len: 152 microversion: 2.1 time: 0.403662 Aug 09 17:27:24.467830 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1805/3765] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:27:24 2022] DELETE /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments/b85f3485-fb03-4e9b-a4b9-c39d05fb69a3 => generated 152 bytes in 412 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:27:24.482957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-74fb2403-5eb3-4744-8cb6-1c7318a24331 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:24.496052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-74fb2403-5eb3-4744-8cb6-1c7318a24331 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:24.519501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74fb2403-5eb3-4744-8cb6-1c7318a24331 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:24.526942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74fb2403-5eb3-4744-8cb6-1c7318a24331 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:24.528262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74fb2403-5eb3-4744-8cb6-1c7318a24331 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:24.529806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74fb2403-5eb3-4744-8cb6-1c7318a24331 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:24.537053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74fb2403-5eb3-4744-8cb6-1c7318a24331 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:24.538405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74fb2403-5eb3-4744-8cb6-1c7318a24331 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:25.098412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6f693ded-1282-46a9-886f-295b8a90a907 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:25.113655 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6f693ded-1282-46a9-886f-295b8a90a907 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 1.755077 Aug 09 17:27:25.117513 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1961/3766] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:23 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:25.138302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8ede1617-8e09-4989-a97a-43edefecb2a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:25.139795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ede1617-8e09-4989-a97a-43edefecb2a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:25.156678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ede1617-8e09-4989-a97a-43edefecb2a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:25.158009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ede1617-8e09-4989-a97a-43edefecb2a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:25.159392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ede1617-8e09-4989-a97a-43edefecb2a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:25.161076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ede1617-8e09-4989-a97a-43edefecb2a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:25.164016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ede1617-8e09-4989-a97a-43edefecb2a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:25.165334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ede1617-8e09-4989-a97a-43edefecb2a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:25.380084 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8ede1617-8e09-4989-a97a-43edefecb2a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/action" status: 202 len: 0 microversion: 2.1 time: 0.257685 Aug 09 17:27:25.395047 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1962/3767] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:27:25 2022] POST /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:27:25.415692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c9e5e204-aa71-4423-835d-40a74a2f18c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:25.427151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c9e5e204-aa71-4423-835d-40a74a2f18c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:25.458678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9e5e204-aa71-4423-835d-40a74a2f18c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:25.459872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9e5e204-aa71-4423-835d-40a74a2f18c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:25.461380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9e5e204-aa71-4423-835d-40a74a2f18c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:25.464012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9e5e204-aa71-4423-835d-40a74a2f18c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:25.464979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9e5e204-aa71-4423-835d-40a74a2f18c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:25.465802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9e5e204-aa71-4423-835d-40a74a2f18c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:25.760508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c9e5e204-aa71-4423-835d-40a74a2f18c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:25.771969 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c9e5e204-aa71-4423-835d-40a74a2f18c5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1297 microversion: 2.1 time: 0.367503 Aug 09 17:27:25.783697 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1963/3768] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:25 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1297 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:25.783697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-868beef1-4608-4ebe-852f-a3ee534b2e5c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:25.783697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-868beef1-4608-4ebe-852f-a3ee534b2e5c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:25.808499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-868beef1-4608-4ebe-852f-a3ee534b2e5c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:25.809411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-868beef1-4608-4ebe-852f-a3ee534b2e5c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:25.809852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-868beef1-4608-4ebe-852f-a3ee534b2e5c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:25.810633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-868beef1-4608-4ebe-852f-a3ee534b2e5c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:25.811104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-868beef1-4608-4ebe-852f-a3ee534b2e5c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:25.811525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-868beef1-4608-4ebe-852f-a3ee534b2e5c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:25.866057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:25.872553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-74fb2403-5eb3-4744-8cb6-1c7318a24331 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:25.897297 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-74fb2403-5eb3-4744-8cb6-1c7318a24331 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1523 microversion: 2.1 time: 1.426984 Aug 09 17:27:25.904792 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1806/3769] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:24 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1523 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:25.957155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:25.959410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:26.003319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:26.004126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:26.021727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:26.023938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:26.024759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:26.036016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:26.159934 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] HTTP exception thrown: Instance is not a member of specified network Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Request method failure captured: Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3/ips/invalid HTTP/1.1 Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pjWS1euQAznyfsjoczw3qFfFQOWLw7nlzqzUxiZFHp9RxBXfYupzmVM9uabK_l5EujJIES-xVqub06RI6iilPbSPkhxZQsnw5SgrfNzuoBNpSeJYBB5fFYzsLtBwmnvsqjzLn858RMdn1cBCAenKPgcS5jDPOdquoTXyisI9kWAdr0 Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fb1f1758036a4e29a7cc21f039a42464 Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-200306609 Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-200306609 Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fb1f1758036a4e29a7cc21f039a42464 Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-200306609 Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerAddressesNegativeTestJSON-200306609-project Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d133a19e7665449e81e6b4f1443cd29a Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-200306609-project Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance is not a member of specified network Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'server_id': '158021c5-716f-4598-8bdf-eccd0db5c3f3', 'id': 'invalid'} Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 09 17:27:26.173006 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:26.185710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:27:26.203837 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fc011f59-eab0-4da9-8bba-faaebaa70780 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.254169 Aug 09 17:27:26.211482 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1807/3770] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:27:25 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3/ips/invalid => generated 91 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 09 17:27:26.217779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ff63e31-95f2-4144-af42-bddf6bc6bf7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:26.228687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3ff63e31-95f2-4144-af42-bddf6bc6bf7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:26.254094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff63e31-95f2-4144-af42-bddf6bc6bf7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:26.258127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff63e31-95f2-4144-af42-bddf6bc6bf7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:26.258889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff63e31-95f2-4144-af42-bddf6bc6bf7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:26.259897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff63e31-95f2-4144-af42-bddf6bc6bf7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:26.262155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff63e31-95f2-4144-af42-bddf6bc6bf7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:26.264245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ff63e31-95f2-4144-af42-bddf6bc6bf7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:27.199302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3ff63e31-95f2-4144-af42-bddf6bc6bf7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:27.208624 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3ff63e31-95f2-4144-af42-bddf6bc6bf7d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 0.995427 Aug 09 17:27:27.209249 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1808/3771] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:26 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:27.230688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-af6bfa35-3b4b-4153-885a-3e7ef20e6052 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:27.231495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-af6bfa35-3b4b-4153-885a-3e7ef20e6052 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Failed to fetch instance by id 999 {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 17:27:27.232315 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-af6bfa35-3b4b-4153-885a-3e7ef20e6052 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] HTTP exception thrown: Instance 999 could not be found. Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-af6bfa35-3b4b-4153-885a-3e7ef20e6052 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Request method failure captured: Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pjWS1euQAznyfsjoczw3qFfFQOWLw7nlzqzUxiZFHp9RxBXfYupzmVM9uabK_l5EujJIES-xVqub06RI6iilPbSPkhxZQsnw5SgrfNzuoBNpSeJYBB5fFYzsLtBwmnvsqjzLn858RMdn1cBCAenKPgcS5jDPOdquoTXyisI9kWAdr0 Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fb1f1758036a4e29a7cc21f039a42464 Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-200306609 Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-200306609 Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fb1f1758036a4e29a7cc21f039a42464 Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-200306609 Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerAddressesNegativeTestJSON-200306609-project Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d133a19e7665449e81e6b4f1443cd29a Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-200306609-project Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 999 could not be found. Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'server_id': '999'} Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 09 17:27:27.234185 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:27.240009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-af6bfa35-3b4b-4153-885a-3e7ef20e6052 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:27:27.241269 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-af6bfa35-3b4b-4153-885a-3e7ef20e6052 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020611 Aug 09 17:27:27.242435 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1809/3772] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:27:27 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:27:27.467324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-868beef1-4608-4ebe-852f-a3ee534b2e5c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:27.503554 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-868beef1-4608-4ebe-852f-a3ee534b2e5c tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1724 microversion: 2.1 time: 1.724492 Aug 09 17:27:27.508790 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1964/3773] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:25 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1724 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:27.530633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0c603b7f-d8d2-4bbd-a459-2c862dc97bce tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:27.542355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0c603b7f-d8d2-4bbd-a459-2c862dc97bce tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:27.567063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c603b7f-d8d2-4bbd-a459-2c862dc97bce tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:27.568531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c603b7f-d8d2-4bbd-a459-2c862dc97bce tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:27.570213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c603b7f-d8d2-4bbd-a459-2c862dc97bce tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:27.580816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c603b7f-d8d2-4bbd-a459-2c862dc97bce tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:27.582209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c603b7f-d8d2-4bbd-a459-2c862dc97bce tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:27.583287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c603b7f-d8d2-4bbd-a459-2c862dc97bce tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:28.011025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0c603b7f-d8d2-4bbd-a459-2c862dc97bce tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:28.060737 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0c603b7f-d8d2-4bbd-a459-2c862dc97bce tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1297 microversion: 2.1 time: 0.549309 Aug 09 17:27:28.070251 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1965/3774] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:27 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1297 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:28.090091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b8e5222c-620a-49fb-bab7-9cdc8f9eb851 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:28.108977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b8e5222c-620a-49fb-bab7-9cdc8f9eb851 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:28.150882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8e5222c-620a-49fb-bab7-9cdc8f9eb851 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:28.151658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8e5222c-620a-49fb-bab7-9cdc8f9eb851 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:28.152303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8e5222c-620a-49fb-bab7-9cdc8f9eb851 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:28.153382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8e5222c-620a-49fb-bab7-9cdc8f9eb851 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:28.154059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8e5222c-620a-49fb-bab7-9cdc8f9eb851 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:28.154687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8e5222c-620a-49fb-bab7-9cdc8f9eb851 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:28.225870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a1952e04-9ff3-4e82-8fef-3fc611a7cdcf tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Action: 'create', calling method: .version_select at 0x7fbbca471940>, body: {"keypair": {"name": "tempest-keypair-216730259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbfqIn/a9+KB8tyGvInw0U1pTpsMWXp5CpQ8KsG4hz21Jk+Edlv6nIm0QOhLfabkRVrddmkviqdTcgf5k1HMN5ZALTpOQ4l30nU693H5iU6tjo/3mnKbQ/hv1+7/tQ41Q=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:28.303946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a1952e04-9ff3-4e82-8fef-3fc611a7cdcf tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Getting quotas for project f6ae6d27589644c9962214f14b27cb36. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:27:28.321650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b8e5222c-620a-49fb-bab7-9cdc8f9eb851 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:27:28.329277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a1952e04-9ff3-4e82-8fef-3fc611a7cdcf tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Getting quotas for user 79b19539de8745b4885239b5c5eaa34d and project f6ae6d27589644c9962214f14b27cb36. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:27:28.420446 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a1952e04-9ff3-4e82-8fef-3fc611a7cdcf tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.170825 Aug 09 17:27:28.432705 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1810/3775] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:27:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:28.441652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ee32aadc-137e-4e20-84b4-acf0ccbae059 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:28.442790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ee32aadc-137e-4e20-84b4-acf0ccbae059 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:28.479120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee32aadc-137e-4e20-84b4-acf0ccbae059 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:28.480989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee32aadc-137e-4e20-84b4-acf0ccbae059 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:28.482167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee32aadc-137e-4e20-84b4-acf0ccbae059 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:28.485547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee32aadc-137e-4e20-84b4-acf0ccbae059 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:28.492999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee32aadc-137e-4e20-84b4-acf0ccbae059 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:28.494035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee32aadc-137e-4e20-84b4-acf0ccbae059 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:28.668314 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b8e5222c-620a-49fb-bab7-9cdc8f9eb851 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "DELETE /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 204 len: 0 microversion: 2.1 time: 0.585409 Aug 09 17:27:28.690419 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1966/3776] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:27:28 2022] DELETE /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:27:28.744085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2e70d3a-2317-4e0b-a326-d25d7a9c24f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:28.745676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2e70d3a-2317-4e0b-a326-d25d7a9c24f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:28.785858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e70d3a-2317-4e0b-a326-d25d7a9c24f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:28.796318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e70d3a-2317-4e0b-a326-d25d7a9c24f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:28.797365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e70d3a-2317-4e0b-a326-d25d7a9c24f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:28.805702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e70d3a-2317-4e0b-a326-d25d7a9c24f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:28.810169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e70d3a-2317-4e0b-a326-d25d7a9c24f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:28.811153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e70d3a-2317-4e0b-a326-d25d7a9c24f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:29.315534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ee32aadc-137e-4e20-84b4-acf0ccbae059 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:29.334269 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ee32aadc-137e-4e20-84b4-acf0ccbae059 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 0.899585 Aug 09 17:27:29.336860 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1811/3777] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:28 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:29.365462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-27d24706-3812-4d59-9468-70feb0bde953 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:29.372127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-27d24706-3812-4d59-9468-70feb0bde953 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:29.398099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27d24706-3812-4d59-9468-70feb0bde953 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:29.398987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27d24706-3812-4d59-9468-70feb0bde953 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:29.407966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27d24706-3812-4d59-9468-70feb0bde953 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:29.411155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27d24706-3812-4d59-9468-70feb0bde953 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:29.412468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27d24706-3812-4d59-9468-70feb0bde953 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:29.414054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27d24706-3812-4d59-9468-70feb0bde953 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:29.999607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-27d24706-3812-4d59-9468-70feb0bde953 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:30.054950 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-27d24706-3812-4d59-9468-70feb0bde953 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1529 microversion: 2.1 time: 0.703279 Aug 09 17:27:30.056050 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1812/3778] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:29 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1529 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:30.110078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ecb1f0c-537f-4bcb-aaa0-743e66ccb264 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:30.111270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4ecb1f0c-537f-4bcb-aaa0-743e66ccb264 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:30.159718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ecb1f0c-537f-4bcb-aaa0-743e66ccb264 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:30.160756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ecb1f0c-537f-4bcb-aaa0-743e66ccb264 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:30.161561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ecb1f0c-537f-4bcb-aaa0-743e66ccb264 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:30.162849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ecb1f0c-537f-4bcb-aaa0-743e66ccb264 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:30.163778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ecb1f0c-537f-4bcb-aaa0-743e66ccb264 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:30.164568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ecb1f0c-537f-4bcb-aaa0-743e66ccb264 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:30.962496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:31.475145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ecb1f0c-537f-4bcb-aaa0-743e66ccb264 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:31.512676 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4ecb1f0c-537f-4bcb-aaa0-743e66ccb264 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1364 microversion: 2.1 time: 1.443713 Aug 09 17:27:31.516655 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1813/3779] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:30 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1364 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:31.542818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3336537c-08e1-4b07-83ce-fbd7d3d02103 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:31.544631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3336537c-08e1-4b07-83ce-fbd7d3d02103 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:31.601794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3336537c-08e1-4b07-83ce-fbd7d3d02103 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:31.603449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3336537c-08e1-4b07-83ce-fbd7d3d02103 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:31.604676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3336537c-08e1-4b07-83ce-fbd7d3d02103 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:31.606369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3336537c-08e1-4b07-83ce-fbd7d3d02103 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:31.607573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3336537c-08e1-4b07-83ce-fbd7d3d02103 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:31.609078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3336537c-08e1-4b07-83ce-fbd7d3d02103 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:31.722621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d2e70d3a-2317-4e0b-a326-d25d7a9c24f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:31.775341 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d2e70d3a-2317-4e0b-a326-d25d7a9c24f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1724 microversion: 2.1 time: 3.082487 Aug 09 17:27:31.776975 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1967/3780] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:28 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1724 bytes in 3086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:31.785463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b535d221-01af-434e-95b1-5105f90769f0 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:31.786691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b535d221-01af-434e-95b1-5105f90769f0 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:31.809516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b535d221-01af-434e-95b1-5105f90769f0 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:31.811013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b535d221-01af-434e-95b1-5105f90769f0 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:31.814951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b535d221-01af-434e-95b1-5105f90769f0 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:31.816856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b535d221-01af-434e-95b1-5105f90769f0 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:31.818537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b535d221-01af-434e-95b1-5105f90769f0 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:31.822504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b535d221-01af-434e-95b1-5105f90769f0 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:32.468183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3336537c-08e1-4b07-83ce-fbd7d3d02103 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:32.505582 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3336537c-08e1-4b07-83ce-fbd7d3d02103 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 0.984319 Aug 09 17:27:32.525667 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1814/3781] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:31 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:32.558236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba8452c7-a44c-4505-becf-ba75633a9180 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:32.561868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ba8452c7-a44c-4505-becf-ba75633a9180 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:32.601855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba8452c7-a44c-4505-becf-ba75633a9180 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:32.602770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba8452c7-a44c-4505-becf-ba75633a9180 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:32.603516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba8452c7-a44c-4505-becf-ba75633a9180 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:32.610220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba8452c7-a44c-4505-becf-ba75633a9180 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:32.611216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba8452c7-a44c-4505-becf-ba75633a9180 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:32.612018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba8452c7-a44c-4505-becf-ba75633a9180 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:33.918828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b535d221-01af-434e-95b1-5105f90769f0 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd133a19e7665449e81e6b4f1443cd29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f1758036a4e29a7cc21f039a42464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:33.974956 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b535d221-01af-434e-95b1-5105f90769f0 tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 200 len: 1529 microversion: 2.1 time: 2.192910 Aug 09 17:27:33.979033 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1968/3782] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:31 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 1529 bytes in 2201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:34.021712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5bb907dc-5257-4ada-bdd0-2df3c158dcca tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:34.028903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5bb907dc-5257-4ada-bdd0-2df3c158dcca tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:34.072466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ba8452c7-a44c-4505-becf-ba75633a9180 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:34.086679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bb907dc-5257-4ada-bdd0-2df3c158dcca tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:34.100271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bb907dc-5257-4ada-bdd0-2df3c158dcca tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:34.101821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bb907dc-5257-4ada-bdd0-2df3c158dcca tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:34.107853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bb907dc-5257-4ada-bdd0-2df3c158dcca tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:34.112442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bb907dc-5257-4ada-bdd0-2df3c158dcca tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:34.114516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bb907dc-5257-4ada-bdd0-2df3c158dcca tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:34.236232 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ba8452c7-a44c-4505-becf-ba75633a9180 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1364 microversion: 2.1 time: 1.683290 Aug 09 17:27:34.239578 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1815/3783] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:32 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1364 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:27:34.260038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-9305fc92-8fdb-495a-becb-5d362d1aa678 req-728f1383-5fc9-4eb8-8094-6b6dcf115099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158021c5-716f-4598-8bdf-eccd0db5c3f3", "name": "network-vif-deleted", "tag": "11c15c45-f68c-4bb9-a037-2f95fdd92bec"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:34.305981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9305fc92-8fdb-495a-becb-5d362d1aa678 req-728f1383-5fc9-4eb8-8094-6b6dcf115099 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:34.307704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9305fc92-8fdb-495a-becb-5d362d1aa678 req-728f1383-5fc9-4eb8-8094-6b6dcf115099 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:34.308844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9305fc92-8fdb-495a-becb-5d362d1aa678 req-728f1383-5fc9-4eb8-8094-6b6dcf115099 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:34.348940 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-9305fc92-8fdb-495a-becb-5d362d1aa678 req-728f1383-5fc9-4eb8-8094-6b6dcf115099 service nova] Creating event network-vif-deleted:11c15c45-f68c-4bb9-a037-2f95fdd92bec for instance 158021c5-716f-4598-8bdf-eccd0db5c3f3 on n-h1-845781-6 Aug 09 17:27:34.361321 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-9305fc92-8fdb-495a-becb-5d362d1aa678 req-728f1383-5fc9-4eb8-8094-6b6dcf115099 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115497 Aug 09 17:27:34.363408 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1816/3784] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:34.380072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-194dc061-f24e-41ab-b82d-52dee798efbe tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:34.383255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-194dc061-f24e-41ab-b82d-52dee798efbe tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:34.408764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-194dc061-f24e-41ab-b82d-52dee798efbe tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:34.411836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-194dc061-f24e-41ab-b82d-52dee798efbe tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:34.413091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-194dc061-f24e-41ab-b82d-52dee798efbe tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:34.423836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-194dc061-f24e-41ab-b82d-52dee798efbe tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:34.425312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-194dc061-f24e-41ab-b82d-52dee798efbe tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:34.426871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-194dc061-f24e-41ab-b82d-52dee798efbe tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:35.685504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-194dc061-f24e-41ab-b82d-52dee798efbe tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:35.709482 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-194dc061-f24e-41ab-b82d-52dee798efbe tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 1.341377 Aug 09 17:27:35.713412 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1817/3785] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:34 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:35.760038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:35.763732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] [instance: 158021c5-716f-4598-8bdf-eccd0db5c3f3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:35.793255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:35.795989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:35.799738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:35.803098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:35.806240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:35.807511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:35.851019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5bb907dc-5257-4ada-bdd0-2df3c158dcca tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:35.913980 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5bb907dc-5257-4ada-bdd0-2df3c158dcca tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1730 microversion: 2.1 time: 1.927709 Aug 09 17:27:35.927777 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1969/3786] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:33 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1730 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:35.945301 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] HTTP exception thrown: Instance 158021c5-716f-4598-8bdf-eccd0db5c3f3 could not be found. Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Request method failure captured: Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 HTTP/1.1 Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pjWS1euQAznyfsjoczw3qFfFQOWLw7nlzqzUxiZFHp9RxBXfYupzmVM9uabK_l5EujJIES-xVqub06RI6iilPbSPkhxZQsnw5SgrfNzuoBNpSeJYBB5fFYzsLtBwmnvsqjzLn858RMdn1cBCAenKPgcS5jDPOdquoTXyisI9kWAdr0 Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fb1f1758036a4e29a7cc21f039a42464 Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-200306609 Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fb1f1758036a4e29a7cc21f039a42464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-200306609 Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fb1f1758036a4e29a7cc21f039a42464 Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-200306609 Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerAddressesNegativeTestJSON-200306609-project Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d133a19e7665449e81e6b4f1443cd29a Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-200306609-project Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 158021c5-716f-4598-8bdf-eccd0db5c3f3 could not be found. Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '158021c5-716f-4598-8bdf-eccd0db5c3f3'} Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158021c5-716f-4598-8bdf-eccd0db5c3f3 could not be found. Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158021c5-716f-4598-8bdf-eccd0db5c3f3 could not be found. Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:35.950037 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:27:35.955532 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:35.955532 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:35.955532 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:27:35.955532 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:27:35.955532 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:27:35.955532 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:27:35.955532 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158021c5-716f-4598-8bdf-eccd0db5c3f3 could not be found. Aug 09 17:27:35.955532 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:35.958818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b9547adf-a129-4095-8bcb-6f175fd44953 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:35.960638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b9547adf-a129-4095-8bcb-6f175fd44953 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:35.964160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] Returning 404 to user: Instance 158021c5-716f-4598-8bdf-eccd0db5c3f3 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:27:35.966000 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0de98b6b-35f1-4256-9447-b4879a1e364e tempest-ServerAddressesNegativeTestJSON-200306609 tempest-ServerAddressesNegativeTestJSON-200306609-project] 10.222.0.93 "GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3" status: 404 len: 111 microversion: 2.1 time: 0.248911 Aug 09 17:27:35.970522 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1818/3787] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:35 2022] GET /compute/v2.1/servers/158021c5-716f-4598-8bdf-eccd0db5c3f3 => generated 111 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:27:36.004418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9547adf-a129-4095-8bcb-6f175fd44953 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:36.006694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9547adf-a129-4095-8bcb-6f175fd44953 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:36.008797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a3a4858d-2d0a-42bb-8aba-d1de24ad6fd6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:36.011054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9547adf-a129-4095-8bcb-6f175fd44953 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:36.012447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a3a4858d-2d0a-42bb-8aba-d1de24ad6fd6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:36.017665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9547adf-a129-4095-8bcb-6f175fd44953 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:36.020325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9547adf-a129-4095-8bcb-6f175fd44953 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:36.024624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9547adf-a129-4095-8bcb-6f175fd44953 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:36.052862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3a4858d-2d0a-42bb-8aba-d1de24ad6fd6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:36.055117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3a4858d-2d0a-42bb-8aba-d1de24ad6fd6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:36.060395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3a4858d-2d0a-42bb-8aba-d1de24ad6fd6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:36.067242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3a4858d-2d0a-42bb-8aba-d1de24ad6fd6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:36.068870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3a4858d-2d0a-42bb-8aba-d1de24ad6fd6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:36.073612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3a4858d-2d0a-42bb-8aba-d1de24ad6fd6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:36.602990 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a3a4858d-2d0a-42bb-8aba-d1de24ad6fd6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.629588 Aug 09 17:27:36.618783 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1819/3788] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:27:35 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-interface => generated 284 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:36.635702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-6d3f75ab-6bb2-4d61-b0f1-b1e19b9f4403 req-463fef24-9f9d-408b-ac11-146f1abca942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e76b7ec8-ebd0-4b60-b546-a0b6a5f52900", "tag": "a4f89caf-3c2a-4f3e-8236-df4de064b99d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:36.687548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6d3f75ab-6bb2-4d61-b0f1-b1e19b9f4403 req-463fef24-9f9d-408b-ac11-146f1abca942 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:36.689669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6d3f75ab-6bb2-4d61-b0f1-b1e19b9f4403 req-463fef24-9f9d-408b-ac11-146f1abca942 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:36.690735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6d3f75ab-6bb2-4d61-b0f1-b1e19b9f4403 req-463fef24-9f9d-408b-ac11-146f1abca942 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:36.738940 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-6d3f75ab-6bb2-4d61-b0f1-b1e19b9f4403 req-463fef24-9f9d-408b-ac11-146f1abca942 service nova] Creating event network-changed:a4f89caf-3c2a-4f3e-8236-df4de064b99d for instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 on n-h1-845781-6 Aug 09 17:27:36.771602 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-6d3f75ab-6bb2-4d61-b0f1-b1e19b9f4403 req-463fef24-9f9d-408b-ac11-146f1abca942 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150454 Aug 09 17:27:36.773553 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1820/3789] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:36.790770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8d791c55-986c-4932-9b54-fe39f1032e45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:36.793739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8d791c55-986c-4932-9b54-fe39f1032e45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:36.836926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d791c55-986c-4932-9b54-fe39f1032e45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:36.848878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d791c55-986c-4932-9b54-fe39f1032e45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:36.849995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d791c55-986c-4932-9b54-fe39f1032e45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:36.852150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d791c55-986c-4932-9b54-fe39f1032e45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:36.853215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d791c55-986c-4932-9b54-fe39f1032e45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:36.854201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d791c55-986c-4932-9b54-fe39f1032e45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:37.690203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8d791c55-986c-4932-9b54-fe39f1032e45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:37.709289 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8d791c55-986c-4932-9b54-fe39f1032e45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 0.933575 Aug 09 17:27:37.713137 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1821/3790] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:36 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:38.559145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b9547adf-a129-4095-8bcb-6f175fd44953 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:38.600239 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b9547adf-a129-4095-8bcb-6f175fd44953 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1364 microversion: 2.1 time: 2.667372 Aug 09 17:27:38.620774 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1970/3791] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:35 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1364 bytes in 2692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:38.755197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5e7cdd70-8799-4c61-9084-d0ba75a79649 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:38.760823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5e7cdd70-8799-4c61-9084-d0ba75a79649 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:38.776809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=12 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:38.795389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7cdd70-8799-4c61-9084-d0ba75a79649 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:38.797896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7cdd70-8799-4c61-9084-d0ba75a79649 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:38.798689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7cdd70-8799-4c61-9084-d0ba75a79649 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:38.800059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7cdd70-8799-4c61-9084-d0ba75a79649 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:38.800889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7cdd70-8799-4c61-9084-d0ba75a79649 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:38.810717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e7cdd70-8799-4c61-9084-d0ba75a79649 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:38.858598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:39.589183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5e7cdd70-8799-4c61-9084-d0ba75a79649 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:39.615330 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5e7cdd70-8799-4c61-9084-d0ba75a79649 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 0.867075 Aug 09 17:27:39.617828 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1822/3792] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:38 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:39.639075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fa93c08a-b435-4b24-879d-6a8e96b2f70f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:39.641309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fa93c08a-b435-4b24-879d-6a8e96b2f70f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:39.671926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa93c08a-b435-4b24-879d-6a8e96b2f70f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:39.680203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa93c08a-b435-4b24-879d-6a8e96b2f70f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:39.681598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa93c08a-b435-4b24-879d-6a8e96b2f70f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:39.683201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa93c08a-b435-4b24-879d-6a8e96b2f70f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:39.688915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa93c08a-b435-4b24-879d-6a8e96b2f70f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:39.690177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa93c08a-b435-4b24-879d-6a8e96b2f70f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:40.247395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fa93c08a-b435-4b24-879d-6a8e96b2f70f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:40.272372 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fa93c08a-b435-4b24-879d-6a8e96b2f70f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1364 microversion: 2.1 time: 0.639790 Aug 09 17:27:40.276349 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1971/3793] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:39 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1364 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:40.667122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4c84a7b6-65dc-41c2-8606-17fd82c3ed6c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:40.668226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4c84a7b6-65dc-41c2-8606-17fd82c3ed6c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:40.697128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c84a7b6-65dc-41c2-8606-17fd82c3ed6c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:40.700883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c84a7b6-65dc-41c2-8606-17fd82c3ed6c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:40.701849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c84a7b6-65dc-41c2-8606-17fd82c3ed6c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:40.704031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c84a7b6-65dc-41c2-8606-17fd82c3ed6c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:40.704843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c84a7b6-65dc-41c2-8606-17fd82c3ed6c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:40.706882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c84a7b6-65dc-41c2-8606-17fd82c3ed6c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:41.310261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9bd1d472-1a19-41ca-9f8b-d2ee7cf7291e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:41.314025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9bd1d472-1a19-41ca-9f8b-d2ee7cf7291e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:41.341504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd1d472-1a19-41ca-9f8b-d2ee7cf7291e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:41.344996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd1d472-1a19-41ca-9f8b-d2ee7cf7291e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:41.346203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd1d472-1a19-41ca-9f8b-d2ee7cf7291e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:41.348202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd1d472-1a19-41ca-9f8b-d2ee7cf7291e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:41.349433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd1d472-1a19-41ca-9f8b-d2ee7cf7291e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:41.350530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bd1d472-1a19-41ca-9f8b-d2ee7cf7291e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:42.091655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9bd1d472-1a19-41ca-9f8b-d2ee7cf7291e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:42.136070 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9bd1d472-1a19-41ca-9f8b-d2ee7cf7291e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1364 microversion: 2.1 time: 0.834753 Aug 09 17:27:42.138141 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1972/3794] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:41 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1364 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:27:42.203979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4c84a7b6-65dc-41c2-8606-17fd82c3ed6c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:42.240498 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4c84a7b6-65dc-41c2-8606-17fd82c3ed6c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1526 microversion: 2.1 time: 1.579692 Aug 09 17:27:42.244900 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1823/3795] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:40 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1526 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:42.303584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4cc25636-54c3-446b-817b-06938fa982b0 req-5dea6bd9-17b7-453c-bbde-b50432b2704f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76b7ec8-ebd0-4b60-b546-a0b6a5f52900", "name": "network-vif-plugged", "status": "completed", "tag": "a4f89caf-3c2a-4f3e-8236-df4de064b99d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:42.388731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4cc25636-54c3-446b-817b-06938fa982b0 req-5dea6bd9-17b7-453c-bbde-b50432b2704f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:42.389678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4cc25636-54c3-446b-817b-06938fa982b0 req-5dea6bd9-17b7-453c-bbde-b50432b2704f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:42.393599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4cc25636-54c3-446b-817b-06938fa982b0 req-5dea6bd9-17b7-453c-bbde-b50432b2704f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:42.429913 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4cc25636-54c3-446b-817b-06938fa982b0 req-5dea6bd9-17b7-453c-bbde-b50432b2704f service nova] Creating event network-vif-plugged:a4f89caf-3c2a-4f3e-8236-df4de064b99d for instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 on n-h1-845781-6 Aug 09 17:27:42.439147 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4cc25636-54c3-446b-817b-06938fa982b0 req-5dea6bd9-17b7-453c-bbde-b50432b2704f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148751 Aug 09 17:27:42.440163 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1973/3796] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:42.646805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-948972972", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "31db8f41-73a5-48f6-99c4-5ea0e14756fe"}], "security_groups": [{"name": "tempest-securitygroup--1364552204"}], "key_name": "tempest-keypair-216730259", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:42.933770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-46a278e1-0e5b-4c89-bee0-7ac1002f3737 req-f5f1049e-1b15-46ef-acdf-29fd9e55d431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b4377c-cf52-4f83-8923-b86f8bdfff08", "tag": "a797759a-bc26-46ce-954a-7c9861e667d9"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:42.958948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-46a278e1-0e5b-4c89-bee0-7ac1002f3737 req-f5f1049e-1b15-46ef-acdf-29fd9e55d431 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:42.959455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-46a278e1-0e5b-4c89-bee0-7ac1002f3737 req-f5f1049e-1b15-46ef-acdf-29fd9e55d431 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:42.959982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-46a278e1-0e5b-4c89-bee0-7ac1002f3737 req-f5f1049e-1b15-46ef-acdf-29fd9e55d431 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:43.018226 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-46a278e1-0e5b-4c89-bee0-7ac1002f3737 req-f5f1049e-1b15-46ef-acdf-29fd9e55d431 service nova] Creating event network-changed:a797759a-bc26-46ce-954a-7c9861e667d9 for instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 on n-h2-845781-6 Aug 09 17:27:43.038610 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-46a278e1-0e5b-4c89-bee0-7ac1002f3737 req-f5f1049e-1b15-46ef-acdf-29fd9e55d431 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110168 Aug 09 17:27:43.039252 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1974/3797] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:43.204604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-279fe0a6-1f62-4ea8-ab06-6b4d7a5342c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:43.206393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-279fe0a6-1f62-4ea8-ab06-6b4d7a5342c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:43.245814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-279fe0a6-1f62-4ea8-ab06-6b4d7a5342c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:43.249178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-279fe0a6-1f62-4ea8-ab06-6b4d7a5342c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:43.256893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-279fe0a6-1f62-4ea8-ab06-6b4d7a5342c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:43.269761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-279fe0a6-1f62-4ea8-ab06-6b4d7a5342c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:43.270907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-279fe0a6-1f62-4ea8-ab06-6b4d7a5342c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:43.271974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-279fe0a6-1f62-4ea8-ab06-6b4d7a5342c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:43.774912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] validate_networks() for [('31db8f41-73a5-48f6-99c4-5ea0e14756fe', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:27:44.629763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-279fe0a6-1f62-4ea8-ab06-6b4d7a5342c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:44.663089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-279fe0a6-1f62-4ea8-ab06-6b4d7a5342c7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1364 microversion: 2.1 time: 1.484086 Aug 09 17:27:44.676294 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1975/3798] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:43 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1364 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:44.693148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eff2bed7-c106-404c-9836-2573a9a981f0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:44.712527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eff2bed7-c106-404c-9836-2573a9a981f0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:44.740246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff2bed7-c106-404c-9836-2573a9a981f0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:44.741099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff2bed7-c106-404c-9836-2573a9a981f0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:44.742415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff2bed7-c106-404c-9836-2573a9a981f0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:44.745917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff2bed7-c106-404c-9836-2573a9a981f0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:44.746804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff2bed7-c106-404c-9836-2573a9a981f0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:44.747586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff2bed7-c106-404c-9836-2573a9a981f0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:46.017023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eff2bed7-c106-404c-9836-2573a9a981f0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:46.049078 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eff2bed7-c106-404c-9836-2573a9a981f0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1508 microversion: 2.1 time: 1.362708 Aug 09 17:27:46.060976 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1976/3799] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:44 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1508 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:46.114155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f42c174c-2231-4dea-93ed-98c39436a780 req-dd111b6a-2598-4531-a8de-22d083af6a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b4377c-cf52-4f83-8923-b86f8bdfff08", "tag": "a797759a-bc26-46ce-954a-7c9861e667d9"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:46.143107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f42c174c-2231-4dea-93ed-98c39436a780 req-dd111b6a-2598-4531-a8de-22d083af6a6e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:46.144133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f42c174c-2231-4dea-93ed-98c39436a780 req-dd111b6a-2598-4531-a8de-22d083af6a6e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:46.145170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f42c174c-2231-4dea-93ed-98c39436a780 req-dd111b6a-2598-4531-a8de-22d083af6a6e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:46.183811 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f42c174c-2231-4dea-93ed-98c39436a780 req-dd111b6a-2598-4531-a8de-22d083af6a6e service nova] Creating event network-changed:a797759a-bc26-46ce-954a-7c9861e667d9 for instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 on n-h2-845781-6 Aug 09 17:27:46.196556 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f42c174c-2231-4dea-93ed-98c39436a780 req-dd111b6a-2598-4531-a8de-22d083af6a6e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132039 Aug 09 17:27:46.198519 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1977/3800] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:46.211303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8a5c5b48-ec21-40d6-834e-d52161d80b8f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:46.214748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8a5c5b48-ec21-40d6-834e-d52161d80b8f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:46.228500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5c5b48-ec21-40d6-834e-d52161d80b8f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:46.230158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5c5b48-ec21-40d6-834e-d52161d80b8f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:46.231843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5c5b48-ec21-40d6-834e-d52161d80b8f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:46.236087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5c5b48-ec21-40d6-834e-d52161d80b8f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:46.237858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5c5b48-ec21-40d6-834e-d52161d80b8f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:46.239450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5c5b48-ec21-40d6-834e-d52161d80b8f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:47.227319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8a5c5b48-ec21-40d6-834e-d52161d80b8f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:47.252458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Getting quotas for project f6ae6d27589644c9962214f14b27cb36. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:27:47.257700 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8a5c5b48-ec21-40d6-834e-d52161d80b8f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1554 microversion: 2.1 time: 1.049970 Aug 09 17:27:47.259364 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1978/3801] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:46 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1554 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:47.273196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Getting quotas for user 79b19539de8745b4885239b5c5eaa34d and project f6ae6d27589644c9962214f14b27cb36. Resources: dict_keys(['metadata_items']) {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:27:47.275416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6de2fec1-ad5c-4861-a554-6289d751896e req-6e6a2e3d-0941-4ce1-9428-227f238f4164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af26977-0da1-475d-b754-4460e79e4fc3", "name": "network-vif-unplugged", "status": "completed", "tag": "81270b4a-19dd-474c-8c8e-456472b48c81"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:47.321060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6de2fec1-ad5c-4861-a554-6289d751896e req-6e6a2e3d-0941-4ce1-9428-227f238f4164 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:47.321884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6de2fec1-ad5c-4861-a554-6289d751896e req-6e6a2e3d-0941-4ce1-9428-227f238f4164 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:47.322666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6de2fec1-ad5c-4861-a554-6289d751896e req-6e6a2e3d-0941-4ce1-9428-227f238f4164 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:47.389402 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6de2fec1-ad5c-4861-a554-6289d751896e req-6e6a2e3d-0941-4ce1-9428-227f238f4164 service nova] Creating event network-vif-unplugged:81270b4a-19dd-474c-8c8e-456472b48c81 for instance 9af26977-0da1-475d-b754-4460e79e4fc3 on n-h2-845781-6 Aug 09 17:27:47.391080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:27:47.398004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:27:47.399507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:27:47.400845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:27:47.404293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:27:47.419471 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6de2fec1-ad5c-4861-a554-6289d751896e req-6e6a2e3d-0941-4ce1-9428-227f238f4164 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157627 Aug 09 17:27:47.421451 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1979/3802] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:47.459426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:47.461239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:47.462121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:47.467126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:47.470642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:47.475145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:47.611486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Getting quotas for project f6ae6d27589644c9962214f14b27cb36. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:27:47.664070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Getting quotas for user 79b19539de8745b4885239b5c5eaa34d and project f6ae6d27589644c9962214f14b27cb36. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:27:47.745884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:27:47.752075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:27:47.996020 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-96de08cf-1f7b-4569-bc9a-bf7b7ecb6a4c tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 5.355643 Aug 09 17:27:48.002310 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1824/3803] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:27:42 2022] POST /compute/v2.1/servers => generated 407 bytes in 5366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:27:48.013582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d1acd6a-9230-4274-8e2c-6ec02d8404d4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:48.016641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d1acd6a-9230-4274-8e2c-6ec02d8404d4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:48.035897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d1acd6a-9230-4274-8e2c-6ec02d8404d4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:48.040204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d1acd6a-9230-4274-8e2c-6ec02d8404d4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:48.040946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d1acd6a-9230-4274-8e2c-6ec02d8404d4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:48.042202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d1acd6a-9230-4274-8e2c-6ec02d8404d4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:48.044233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d1acd6a-9230-4274-8e2c-6ec02d8404d4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:48.044921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d1acd6a-9230-4274-8e2c-6ec02d8404d4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:48.150092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a2826178-14ed-4fc8-8b0d-2dc09306b0c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'create', calling method: .version_select at 0x7fbbcb578ee0>, body: {"keypair": {"name": "tempest-keypair-1947852563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJY4uooLYISZIZ5ejyaFskWYiBmc5tJOQscHY0+jLjMIkA03RaOVUcot6J2hRBOf0zEVXpV27KJmEJkPc1OJAA7NWHUYqUxRpvb7QzjfPdVOIDO/DGJmZpQ6FoMZn8h4A=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:48.202386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a2826178-14ed-4fc8-8b0d-2dc09306b0c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:27:48.242764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a2826178-14ed-4fc8-8b0d-2dc09306b0c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for user 62572816b806440aa8338fea1d0a297e and project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:27:48.366261 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a2826178-14ed-4fc8-8b0d-2dc09306b0c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.942276 Aug 09 17:27:48.369856 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1980/3804] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:27:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:48.392165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb7b5cc7-dd1d-425c-9f9a-4590c5526b44 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:48.393486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb7b5cc7-dd1d-425c-9f9a-4590c5526b44 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:48.431002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb7b5cc7-dd1d-425c-9f9a-4590c5526b44 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:48.434461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb7b5cc7-dd1d-425c-9f9a-4590c5526b44 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:48.436867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb7b5cc7-dd1d-425c-9f9a-4590c5526b44 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:48.440542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb7b5cc7-dd1d-425c-9f9a-4590c5526b44 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:48.450764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb7b5cc7-dd1d-425c-9f9a-4590c5526b44 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:48.452755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb7b5cc7-dd1d-425c-9f9a-4590c5526b44 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:49.115831 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb7b5cc7-dd1d-425c-9f9a-4590c5526b44 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.741606 Aug 09 17:27:49.129918 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1981/3805] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:27:48 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-interface => generated 284 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:49.138033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a6e7d006-fb1f-4721-bd6a-82dd64e93913 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:49.140661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a6e7d006-fb1f-4721-bd6a-82dd64e93913 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:49.197897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5d1acd6a-9230-4274-8e2c-6ec02d8404d4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:49.241729 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5d1acd6a-9230-4274-8e2c-6ec02d8404d4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1511 microversion: 2.1 time: 1.236785 Aug 09 17:27:49.245566 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1825/3806] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:48 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1511 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:49.295736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-33982834-8a17-400c-962c-217e9e57e82f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:49.303723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-33982834-8a17-400c-962c-217e9e57e82f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:49.329353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33982834-8a17-400c-962c-217e9e57e82f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:49.331406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33982834-8a17-400c-962c-217e9e57e82f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:49.332906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33982834-8a17-400c-962c-217e9e57e82f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:49.338381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33982834-8a17-400c-962c-217e9e57e82f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:49.360154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33982834-8a17-400c-962c-217e9e57e82f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:49.361693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33982834-8a17-400c-962c-217e9e57e82f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:50.032192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-33982834-8a17-400c-962c-217e9e57e82f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:50.046245 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-33982834-8a17-400c-962c-217e9e57e82f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1451 microversion: 2.1 time: 0.761539 Aug 09 17:27:50.055098 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1826/3807] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:49 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1451 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:50.199698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:50.200875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:50.215906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:50.221346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:50.222366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:50.227048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:50.233911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:50.242027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:50.361378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lazy-loading 'flavor' on Instance uuid 9af26977-0da1-475d-b754-4460e79e4fc3 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:27:50.441663 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Cannot 'shelve' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state shelved_offloaded Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action HTTP/1.1 Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 14 Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: {"shelve": {}} Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: exception: Cannot 'shelve' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state shelved_offloaded Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9af26977-0da1-475d-b754-4460e79e4fc3', 'body': {'shelve': {}}} Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 09 17:27:50.452129 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state shelved_offloaded Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state shelved_offloaded Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:27:50.459302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 409 to user: Cannot 'shelve' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state shelved_offloaded {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:27:50.463407 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-47e7ffed-4b46-4fd1-aeed-fb83533a9613 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 409 len: 155 microversion: 2.1 time: 0.263096 Aug 09 17:27:50.468205 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1827/3808] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:27:50 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 155 bytes in 275 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:27:50.527001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e6e7bb91-6b10-4bd6-9702-18bde5c14e68 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:50.528111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e6e7bb91-6b10-4bd6-9702-18bde5c14e68 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:50.533594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:50.562909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6e7bb91-6b10-4bd6-9702-18bde5c14e68 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:50.566675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6e7bb91-6b10-4bd6-9702-18bde5c14e68 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:50.570504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6e7bb91-6b10-4bd6-9702-18bde5c14e68 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:50.572125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6e7bb91-6b10-4bd6-9702-18bde5c14e68 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:50.574902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6e7bb91-6b10-4bd6-9702-18bde5c14e68 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:50.578515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6e7bb91-6b10-4bd6-9702-18bde5c14e68 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:50.920970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e6e7bb91-6b10-4bd6-9702-18bde5c14e68 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119432) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 09 17:27:51.014758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a6e7d006-fb1f-4721-bd6a-82dd64e93913 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:51.060846 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a6e7d006-fb1f-4721-bd6a-82dd64e93913 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1268 microversion: 2.1 time: 1.939490 Aug 09 17:27:51.071336 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1982/3809] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:49 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1268 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:51.180933 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e6e7bb91-6b10-4bd6-9702-18bde5c14e68 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 202 len: 0 microversion: 2.1 time: 0.705959 Aug 09 17:27:51.186638 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1828/3810] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:27:50 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:27:51.193540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a650d1ec-b7c4-4534-9e7d-52892e6a9b10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:51.194519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a650d1ec-b7c4-4534-9e7d-52892e6a9b10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:51.203825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:51.215612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a650d1ec-b7c4-4534-9e7d-52892e6a9b10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:51.217104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a650d1ec-b7c4-4534-9e7d-52892e6a9b10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:51.217883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a650d1ec-b7c4-4534-9e7d-52892e6a9b10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:51.224796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a650d1ec-b7c4-4534-9e7d-52892e6a9b10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:51.226346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a650d1ec-b7c4-4534-9e7d-52892e6a9b10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:51.235405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a650d1ec-b7c4-4534-9e7d-52892e6a9b10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:52.115251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-40688cef-1a11-41b1-a1b5-671b1ef0342e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:52.116679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-40688cef-1a11-41b1-a1b5-671b1ef0342e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:52.138757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40688cef-1a11-41b1-a1b5-671b1ef0342e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:52.141796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40688cef-1a11-41b1-a1b5-671b1ef0342e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:52.143892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40688cef-1a11-41b1-a1b5-671b1ef0342e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:52.145469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40688cef-1a11-41b1-a1b5-671b1ef0342e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:52.149056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40688cef-1a11-41b1-a1b5-671b1ef0342e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:52.149707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40688cef-1a11-41b1-a1b5-671b1ef0342e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:53.172248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-40688cef-1a11-41b1-a1b5-671b1ef0342e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:53.205526 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-40688cef-1a11-41b1-a1b5-671b1ef0342e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1326 microversion: 2.1 time: 1.109950 Aug 09 17:27:53.213921 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1829/3811] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:52 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1326 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:53.306435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a650d1ec-b7c4-4534-9e7d-52892e6a9b10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:53.335998 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a650d1ec-b7c4-4534-9e7d-52892e6a9b10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1459 microversion: 2.1 time: 2.145449 Aug 09 17:27:53.343820 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1983/3812] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:51 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1459 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:54.254562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d86ee9e-a19e-485b-bc7a-23716459f632 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:54.255592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d86ee9e-a19e-485b-bc7a-23716459f632 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:54.270191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d86ee9e-a19e-485b-bc7a-23716459f632 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:54.270774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d86ee9e-a19e-485b-bc7a-23716459f632 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:54.271238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d86ee9e-a19e-485b-bc7a-23716459f632 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:54.274468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d86ee9e-a19e-485b-bc7a-23716459f632 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:54.279147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d86ee9e-a19e-485b-bc7a-23716459f632 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:54.280584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d86ee9e-a19e-485b-bc7a-23716459f632 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:54.373226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d6adbe5e-b83a-46be-9c63-2e2b515aef31 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:54.374031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d6adbe5e-b83a-46be-9c63-2e2b515aef31 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:54.391612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6adbe5e-b83a-46be-9c63-2e2b515aef31 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:54.398437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6adbe5e-b83a-46be-9c63-2e2b515aef31 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:54.398907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6adbe5e-b83a-46be-9c63-2e2b515aef31 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:54.401373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6adbe5e-b83a-46be-9c63-2e2b515aef31 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:54.412234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6adbe5e-b83a-46be-9c63-2e2b515aef31 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:54.412992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6adbe5e-b83a-46be-9c63-2e2b515aef31 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:54.448549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:54.754700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5d86ee9e-a19e-485b-bc7a-23716459f632 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:54.792140 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5d86ee9e-a19e-485b-bc7a-23716459f632 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1326 microversion: 2.1 time: 0.542670 Aug 09 17:27:54.814377 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1830/3813] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:54 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1326 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:55.115291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d6adbe5e-b83a-46be-9c63-2e2b515aef31 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:55.133729 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d6adbe5e-b83a-46be-9c63-2e2b515aef31 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1459 microversion: 2.1 time: 0.764461 Aug 09 17:27:55.143274 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1984/3814] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:54 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1459 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:55.836874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0819f1ad-6982-4380-9980-57f05246306f tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:55.838976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0819f1ad-6982-4380-9980-57f05246306f tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:55.851949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0819f1ad-6982-4380-9980-57f05246306f tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:55.853138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0819f1ad-6982-4380-9980-57f05246306f tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:55.854206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0819f1ad-6982-4380-9980-57f05246306f tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:55.855765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0819f1ad-6982-4380-9980-57f05246306f tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:55.856854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0819f1ad-6982-4380-9980-57f05246306f tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:55.857833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0819f1ad-6982-4380-9980-57f05246306f tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:56.096078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a8f37880-4b1b-4b55-8eb7-07ea3f8982fc req-9dfef1e5-c67c-4932-b495-b988b7a47b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e76b7ec8-ebd0-4b60-b546-a0b6a5f52900", "tag": "a4f89caf-3c2a-4f3e-8236-df4de064b99d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:56.162863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a8f37880-4b1b-4b55-8eb7-07ea3f8982fc req-9dfef1e5-c67c-4932-b495-b988b7a47b88 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:56.164263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a8f37880-4b1b-4b55-8eb7-07ea3f8982fc req-9dfef1e5-c67c-4932-b495-b988b7a47b88 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:56.170427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a8f37880-4b1b-4b55-8eb7-07ea3f8982fc req-9dfef1e5-c67c-4932-b495-b988b7a47b88 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:56.236353 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a8f37880-4b1b-4b55-8eb7-07ea3f8982fc req-9dfef1e5-c67c-4932-b495-b988b7a47b88 service nova] Creating event network-changed:a4f89caf-3c2a-4f3e-8236-df4de064b99d for instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 on n-h1-845781-6 Aug 09 17:27:56.253628 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a8f37880-4b1b-4b55-8eb7-07ea3f8982fc req-9dfef1e5-c67c-4932-b495-b988b7a47b88 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163813 Aug 09 17:27:56.260239 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1985/3815] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:27:56.271481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4caeb21b-9abc-4db1-8856-7a65e9599306 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:56.273832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4caeb21b-9abc-4db1-8856-7a65e9599306 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:56.286094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4caeb21b-9abc-4db1-8856-7a65e9599306 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:56.286955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4caeb21b-9abc-4db1-8856-7a65e9599306 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:56.287716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4caeb21b-9abc-4db1-8856-7a65e9599306 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:56.289667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4caeb21b-9abc-4db1-8856-7a65e9599306 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:56.291156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4caeb21b-9abc-4db1-8856-7a65e9599306 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:56.291976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4caeb21b-9abc-4db1-8856-7a65e9599306 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:56.931391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0819f1ad-6982-4380-9980-57f05246306f tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:56.964635 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0819f1ad-6982-4380-9980-57f05246306f tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1326 microversion: 2.1 time: 1.127819 Aug 09 17:27:56.965882 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1831/3816] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:55 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1326 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:27:57.038720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4caeb21b-9abc-4db1-8856-7a65e9599306 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:57.066664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4caeb21b-9abc-4db1-8856-7a65e9599306 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.803885 Aug 09 17:27:57.092289 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1986/3817] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:56 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:57.235735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2060556087", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:57.467856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] validate_networks() for [('6b9c2e69-817b-412c-982c-bc31f897cb20', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:27:57.546940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:57.697778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=10 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:27:58.017522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d5e577c-12e6-4105-a9bb-15989282d0cb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:58.025747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1d5e577c-12e6-4105-a9bb-15989282d0cb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:58.058294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d5e577c-12e6-4105-a9bb-15989282d0cb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:58.061664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d5e577c-12e6-4105-a9bb-15989282d0cb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:58.062502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d5e577c-12e6-4105-a9bb-15989282d0cb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:58.071944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d5e577c-12e6-4105-a9bb-15989282d0cb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:58.073239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d5e577c-12e6-4105-a9bb-15989282d0cb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:58.074311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d5e577c-12e6-4105-a9bb-15989282d0cb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:58.354647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1d5e577c-12e6-4105-a9bb-15989282d0cb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:58.380422 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1d5e577c-12e6-4105-a9bb-15989282d0cb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1326 microversion: 2.1 time: 0.376884 Aug 09 17:27:58.390618 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1987/3818] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:58 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1326 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:27:58.420419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ef2adf91-59f9-4ec7-b246-c70eb41d7743 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:27:58.422143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ef2adf91-59f9-4ec7-b246-c70eb41d7743 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:27:58.438795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2adf91-59f9-4ec7-b246-c70eb41d7743 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:58.441662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2adf91-59f9-4ec7-b246-c70eb41d7743 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:58.442887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2adf91-59f9-4ec7-b246-c70eb41d7743 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:58.446142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2adf91-59f9-4ec7-b246-c70eb41d7743 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:27:58.447750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2adf91-59f9-4ec7-b246-c70eb41d7743 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:27:58.452718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2adf91-59f9-4ec7-b246-c70eb41d7743 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:27:58.896553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ef2adf91-59f9-4ec7-b246-c70eb41d7743 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:27:58.929842 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ef2adf91-59f9-4ec7-b246-c70eb41d7743 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.530422 Aug 09 17:27:58.931595 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1988/3819] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:27:58 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:27:59.266350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1507821355", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57c98899-0caf-4592-be88-405da8266825"}], "security_groups": [{"name": "tempest-securitygroup--409416144"}], "key_name": "tempest-keypair-1947852563", "user_data": "}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:27:59.756326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] validate_networks() for [('57c98899-0caf-4592-be88-405da8266825', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:28:00.846750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:28:00.847417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:28:00.848085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:28:00.849058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:28:00.851606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:28:00.873445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:00.874592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:00.875995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:00.877718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:00.879092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:00.880207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:00.930497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:28:00.945210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for user 62572816b806440aa8338fea1d0a297e and project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:28:00.992712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:28:00.998668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:28:01.150649 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f6f53e38-946e-4d6f-8eed-0d76d0cfa284 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.894338 Aug 09 17:28:01.158021 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1989/3820] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:27:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:28:01.181271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d676301d-d87e-46df-b383-3a7e326d9deb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:01.183219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d676301d-d87e-46df-b383-3a7e326d9deb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:01.215745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d676301d-d87e-46df-b383-3a7e326d9deb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:01.217639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d676301d-d87e-46df-b383-3a7e326d9deb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:01.221845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d676301d-d87e-46df-b383-3a7e326d9deb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:01.225082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d676301d-d87e-46df-b383-3a7e326d9deb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:01.228630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d676301d-d87e-46df-b383-3a7e326d9deb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:01.233159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d676301d-d87e-46df-b383-3a7e326d9deb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:01.822762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d676301d-d87e-46df-b383-3a7e326d9deb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:01.879342 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d676301d-d87e-46df-b383-3a7e326d9deb tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1394 microversion: 2.1 time: 0.718779 Aug 09 17:28:01.895298 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1990/3821] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:01 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1394 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:01.903928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2874bf0a-39a2-4e5f-be1e-6d12570ec2df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:01.905130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2874bf0a-39a2-4e5f-be1e-6d12570ec2df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:01.918407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2874bf0a-39a2-4e5f-be1e-6d12570ec2df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:01.919700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2874bf0a-39a2-4e5f-be1e-6d12570ec2df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:01.920778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2874bf0a-39a2-4e5f-be1e-6d12570ec2df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:01.922303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2874bf0a-39a2-4e5f-be1e-6d12570ec2df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:01.923474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2874bf0a-39a2-4e5f-be1e-6d12570ec2df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:01.924957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2874bf0a-39a2-4e5f-be1e-6d12570ec2df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:02.393972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2874bf0a-39a2-4e5f-be1e-6d12570ec2df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:02.413507 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2874bf0a-39a2-4e5f-be1e-6d12570ec2df tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.521504 Aug 09 17:28:02.428750 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1991/3822] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:01 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:02.437260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e30109f-5472-42fa-9e37-480b4b2a77dd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:02.438181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8e30109f-5472-42fa-9e37-480b4b2a77dd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:02.554265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8e30109f-5472-42fa-9e37-480b4b2a77dd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:02.564442 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e30109f-5472-42fa-9e37-480b4b2a77dd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1239 microversion: 2.1 time: 0.134413 Aug 09 17:28:02.568037 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1992/3823] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:02 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1239 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:02.751595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:28:02.753291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:28:02.754451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:28:02.757410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:28:02.758391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:28:02.767785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ba7240f9-e0e8-49b1-958f-b366b3b46ac0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:02.771914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba7240f9-e0e8-49b1-958f-b366b3b46ac0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:02.807824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7240f9-e0e8-49b1-958f-b366b3b46ac0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:02.811050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7240f9-e0e8-49b1-958f-b366b3b46ac0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:02.812286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7240f9-e0e8-49b1-958f-b366b3b46ac0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:02.818182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7240f9-e0e8-49b1-958f-b366b3b46ac0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:02.826211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7240f9-e0e8-49b1-958f-b366b3b46ac0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:02.829016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:02.829268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7240f9-e0e8-49b1-958f-b366b3b46ac0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:02.837291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:02.840696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:02.846636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:02.850851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:02.856712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:02.992054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Getting quotas for project 354ad7c984004cd1b1bd4a2058afb615. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:28:03.021421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Getting quotas for user d089ace53d1b4ad1bee793e97952705f and project 354ad7c984004cd1b1bd4a2058afb615. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:28:03.130631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:28:03.142226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:28:03.396152 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f12f62aa-b8bb-4094-a491-7e3b9a093202 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.416770 Aug 09 17:28:03.405816 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1832/3824] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:27:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 6439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:28:03.409572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-ba7240f9-e0e8-49b1-958f-b366b3b46ac0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lazy-loading 'services' on Instance uuid 91b4377c-cf52-4f83-8923-b86f8bdfff08 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:28:03.478506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e9a46bc7-abb0-474b-bf8b-fabc23a370de tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:03.483667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e9a46bc7-abb0-474b-bf8b-fabc23a370de tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:03.549299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9a46bc7-abb0-474b-bf8b-fabc23a370de tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:03.551364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9a46bc7-abb0-474b-bf8b-fabc23a370de tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:03.560154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9a46bc7-abb0-474b-bf8b-fabc23a370de tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:03.565114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9a46bc7-abb0-474b-bf8b-fabc23a370de tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:03.566516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9a46bc7-abb0-474b-bf8b-fabc23a370de tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:03.577692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9a46bc7-abb0-474b-bf8b-fabc23a370de tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:04.068219 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ba7240f9-e0e8-49b1-958f-b366b3b46ac0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "DELETE /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments/b85f3485-fb03-4e9b-a4b9-c39d05fb69a3" status: 202 len: 0 microversion: 2.1 time: 1.298768 Aug 09 17:28:04.072292 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1993/3825] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:28:02 2022] DELETE /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments/b85f3485-fb03-4e9b-a4b9-c39d05fb69a3 => generated 0 bytes in 1319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:28:04.095904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1756c9f8-9582-48a1-885a-35d2d789a0a5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:04.097680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1756c9f8-9582-48a1-885a-35d2d789a0a5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:04.753058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1756c9f8-9582-48a1-885a-35d2d789a0a5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:04.772061 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1756c9f8-9582-48a1-885a-35d2d789a0a5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1214 microversion: 2.1 time: 0.695471 Aug 09 17:28:04.795514 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1994/3826] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:04 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1214 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:04.822698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0437f84c-1db5-4ad5-8d78-59c3dda0b74b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:04.829416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0437f84c-1db5-4ad5-8d78-59c3dda0b74b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:04.845655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0437f84c-1db5-4ad5-8d78-59c3dda0b74b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:04.851361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0437f84c-1db5-4ad5-8d78-59c3dda0b74b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:04.854130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0437f84c-1db5-4ad5-8d78-59c3dda0b74b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:04.855217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0437f84c-1db5-4ad5-8d78-59c3dda0b74b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:04.860522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0437f84c-1db5-4ad5-8d78-59c3dda0b74b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:04.861382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0437f84c-1db5-4ad5-8d78-59c3dda0b74b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:05.388556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e9a46bc7-abb0-474b-bf8b-fabc23a370de tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:05.420523 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e9a46bc7-abb0-474b-bf8b-fabc23a370de tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1394 microversion: 2.1 time: 2.012087 Aug 09 17:28:05.422536 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1833/3827] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:03 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1394 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:05.453375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a53e9b7a-0e39-4351-9af3-fcdb5fb2290a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:05.454138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a53e9b7a-0e39-4351-9af3-fcdb5fb2290a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:05.513224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a53e9b7a-0e39-4351-9af3-fcdb5fb2290a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:05.513962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a53e9b7a-0e39-4351-9af3-fcdb5fb2290a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:05.514546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a53e9b7a-0e39-4351-9af3-fcdb5fb2290a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:05.515650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a53e9b7a-0e39-4351-9af3-fcdb5fb2290a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:05.528559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a53e9b7a-0e39-4351-9af3-fcdb5fb2290a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:05.529147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a53e9b7a-0e39-4351-9af3-fcdb5fb2290a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:05.551594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0437f84c-1db5-4ad5-8d78-59c3dda0b74b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:05.571183 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0437f84c-1db5-4ad5-8d78-59c3dda0b74b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.756253 Aug 09 17:28:05.585213 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1995/3828] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:04 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:05.617151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a28e3bbc-0f80-4c7b-93f5-20e75db9d147 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:05.631011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a28e3bbc-0f80-4c7b-93f5-20e75db9d147 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:05.667989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a28e3bbc-0f80-4c7b-93f5-20e75db9d147 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:05.668392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a28e3bbc-0f80-4c7b-93f5-20e75db9d147 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:05.668869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a28e3bbc-0f80-4c7b-93f5-20e75db9d147 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:05.677561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a28e3bbc-0f80-4c7b-93f5-20e75db9d147 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:05.688453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a28e3bbc-0f80-4c7b-93f5-20e75db9d147 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:05.691520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a28e3bbc-0f80-4c7b-93f5-20e75db9d147 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:05.974025 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a28e3bbc-0f80-4c7b-93f5-20e75db9d147 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.386902 Aug 09 17:28:05.977285 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1996/3829] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:28:05 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments => generated 197 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:06.003359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-897428ca-e8c7-4daf-aca5-7a33962f8fb1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:06.005330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-897428ca-e8c7-4daf-aca5-7a33962f8fb1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:06.275957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a53e9b7a-0e39-4351-9af3-fcdb5fb2290a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:06.324136 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a53e9b7a-0e39-4351-9af3-fcdb5fb2290a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1309 microversion: 2.1 time: 0.877318 Aug 09 17:28:06.326592 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1834/3830] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:05 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1309 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:06.420330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-897428ca-e8c7-4daf-aca5-7a33962f8fb1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:06.445264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-782d34c1-3231-47d6-be31-fedf88c3fe4e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:06.446219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-782d34c1-3231-47d6-be31-fedf88c3fe4e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:06.449714 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-897428ca-e8c7-4daf-aca5-7a33962f8fb1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1214 microversion: 2.1 time: 0.468225 Aug 09 17:28:06.452989 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1997/3831] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:05 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1214 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:06.474654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-782d34c1-3231-47d6-be31-fedf88c3fe4e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:06.475301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-782d34c1-3231-47d6-be31-fedf88c3fe4e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:06.479832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-782d34c1-3231-47d6-be31-fedf88c3fe4e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:06.483611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-782d34c1-3231-47d6-be31-fedf88c3fe4e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:06.491356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-782d34c1-3231-47d6-be31-fedf88c3fe4e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:06.494202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-782d34c1-3231-47d6-be31-fedf88c3fe4e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:06.614771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5264a801-4b2e-45c0-9e0a-6ed61da2bd6b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:06.617684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5264a801-4b2e-45c0-9e0a-6ed61da2bd6b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:06.650435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5264a801-4b2e-45c0-9e0a-6ed61da2bd6b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:06.651711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5264a801-4b2e-45c0-9e0a-6ed61da2bd6b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:06.652785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5264a801-4b2e-45c0-9e0a-6ed61da2bd6b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:06.659193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5264a801-4b2e-45c0-9e0a-6ed61da2bd6b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:06.663856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5264a801-4b2e-45c0-9e0a-6ed61da2bd6b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:06.665444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5264a801-4b2e-45c0-9e0a-6ed61da2bd6b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:07.301918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5264a801-4b2e-45c0-9e0a-6ed61da2bd6b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:07.336285 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5264a801-4b2e-45c0-9e0a-6ed61da2bd6b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.730880 Aug 09 17:28:07.343141 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1998/3832] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:06 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:07.396588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c95c361d-d9dd-4b1b-b081-83ba7bdb0e32 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:07.416090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c95c361d-d9dd-4b1b-b081-83ba7bdb0e32 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:07.481425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c95c361d-d9dd-4b1b-b081-83ba7bdb0e32 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:07.481425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c95c361d-d9dd-4b1b-b081-83ba7bdb0e32 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:07.489973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c95c361d-d9dd-4b1b-b081-83ba7bdb0e32 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:07.494320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c95c361d-d9dd-4b1b-b081-83ba7bdb0e32 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:07.507805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c95c361d-d9dd-4b1b-b081-83ba7bdb0e32 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:07.509073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c95c361d-d9dd-4b1b-b081-83ba7bdb0e32 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:07.842143 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c95c361d-d9dd-4b1b-b081-83ba7bdb0e32 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.480928 Aug 09 17:28:07.854892 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 1999/3833] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:28:07 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments => generated 197 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:07.872730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ab59ebbe-00fb-41c5-80a2-0af7d0f9b15b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:07.879365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ab59ebbe-00fb-41c5-80a2-0af7d0f9b15b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:07.902414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab59ebbe-00fb-41c5-80a2-0af7d0f9b15b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:07.925524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab59ebbe-00fb-41c5-80a2-0af7d0f9b15b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:07.925903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab59ebbe-00fb-41c5-80a2-0af7d0f9b15b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:07.929482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab59ebbe-00fb-41c5-80a2-0af7d0f9b15b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:07.934403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab59ebbe-00fb-41c5-80a2-0af7d0f9b15b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:07.935594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab59ebbe-00fb-41c5-80a2-0af7d0f9b15b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:08.480468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-782d34c1-3231-47d6-be31-fedf88c3fe4e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:08.551576 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-782d34c1-3231-47d6-be31-fedf88c3fe4e tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1394 microversion: 2.1 time: 2.111737 Aug 09 17:28:08.591929 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1835/3834] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:06 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1394 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:08.636764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e4d1bbf6-c597-445c-bca4-219034b32557 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:08.639384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e4d1bbf6-c597-445c-bca4-219034b32557 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:08.700306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4d1bbf6-c597-445c-bca4-219034b32557 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:08.713361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4d1bbf6-c597-445c-bca4-219034b32557 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:08.721168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4d1bbf6-c597-445c-bca4-219034b32557 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:08.728821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4d1bbf6-c597-445c-bca4-219034b32557 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:08.734016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4d1bbf6-c597-445c-bca4-219034b32557 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:08.736811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4d1bbf6-c597-445c-bca4-219034b32557 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:08.902463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ab59ebbe-00fb-41c5-80a2-0af7d0f9b15b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:08.971293 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ab59ebbe-00fb-41c5-80a2-0af7d0f9b15b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1297 microversion: 2.1 time: 1.105263 Aug 09 17:28:09.003704 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2000/3835] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:07 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1297 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:09.076438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6899206c-fd8a-4b44-ad9f-296f31dbece4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:09.096561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6899206c-fd8a-4b44-ad9f-296f31dbece4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:09.156970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6899206c-fd8a-4b44-ad9f-296f31dbece4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:09.179982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6899206c-fd8a-4b44-ad9f-296f31dbece4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:09.183131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6899206c-fd8a-4b44-ad9f-296f31dbece4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:09.208256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6899206c-fd8a-4b44-ad9f-296f31dbece4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:09.209858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6899206c-fd8a-4b44-ad9f-296f31dbece4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:09.211214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6899206c-fd8a-4b44-ad9f-296f31dbece4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:09.655793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e4d1bbf6-c597-445c-bca4-219034b32557 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:09.658882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:09.689730 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e4d1bbf6-c597-445c-bca4-219034b32557 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1272 microversion: 2.1 time: 1.095539 Aug 09 17:28:09.696812 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1836/3836] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:08 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1272 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:09.720126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-18633cef-b907-4e74-94fd-7fe094a439c7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:09.730352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-18633cef-b907-4e74-94fd-7fe094a439c7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:09.768343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18633cef-b907-4e74-94fd-7fe094a439c7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:09.769215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18633cef-b907-4e74-94fd-7fe094a439c7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:09.787364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18633cef-b907-4e74-94fd-7fe094a439c7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:09.809701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18633cef-b907-4e74-94fd-7fe094a439c7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:09.825577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18633cef-b907-4e74-94fd-7fe094a439c7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:09.829068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18633cef-b907-4e74-94fd-7fe094a439c7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:09.944579 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-18633cef-b907-4e74-94fd-7fe094a439c7 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.245847 Aug 09 17:28:09.955453 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1837/3837] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:28:09 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments => generated 197 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:09.967392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-669a60ae-c6dc-47ec-9c11-0cb93cc08b16 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:09.970005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-669a60ae-c6dc-47ec-9c11-0cb93cc08b16 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:09.987524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-669a60ae-c6dc-47ec-9c11-0cb93cc08b16 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:09.990464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-669a60ae-c6dc-47ec-9c11-0cb93cc08b16 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:09.991799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-669a60ae-c6dc-47ec-9c11-0cb93cc08b16 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:09.998013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-669a60ae-c6dc-47ec-9c11-0cb93cc08b16 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:09.998756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-669a60ae-c6dc-47ec-9c11-0cb93cc08b16 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:09.999396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-669a60ae-c6dc-47ec-9c11-0cb93cc08b16 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:10.125126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6899206c-fd8a-4b44-ad9f-296f31dbece4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:10.149983 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6899206c-fd8a-4b44-ad9f-296f31dbece4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 1.150344 Aug 09 17:28:10.176763 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2001/3838] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:08 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:10.216604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b896c93b-4541-48f0-81d7-642ef47eb0a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:10.218232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b896c93b-4541-48f0-81d7-642ef47eb0a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:10.242614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b896c93b-4541-48f0-81d7-642ef47eb0a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:10.247878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b896c93b-4541-48f0-81d7-642ef47eb0a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:10.250834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b896c93b-4541-48f0-81d7-642ef47eb0a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:10.254833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b896c93b-4541-48f0-81d7-642ef47eb0a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:10.258394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b896c93b-4541-48f0-81d7-642ef47eb0a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:10.259618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b896c93b-4541-48f0-81d7-642ef47eb0a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:10.746203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b896c93b-4541-48f0-81d7-642ef47eb0a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:10.805434 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b896c93b-4541-48f0-81d7-642ef47eb0a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1297 microversion: 2.1 time: 0.626384 Aug 09 17:28:10.815294 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2002/3839] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:10 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1297 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:10.841638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0fd1fa2e-00eb-43ea-9c23-4568dc32307a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:10.844731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0fd1fa2e-00eb-43ea-9c23-4568dc32307a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:10.874336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fd1fa2e-00eb-43ea-9c23-4568dc32307a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:10.875203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fd1fa2e-00eb-43ea-9c23-4568dc32307a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:10.883083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fd1fa2e-00eb-43ea-9c23-4568dc32307a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:10.886125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fd1fa2e-00eb-43ea-9c23-4568dc32307a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:10.890005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fd1fa2e-00eb-43ea-9c23-4568dc32307a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:10.894027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fd1fa2e-00eb-43ea-9c23-4568dc32307a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:10.910126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:11.289037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0fd1fa2e-00eb-43ea-9c23-4568dc32307a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:11.320911 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0fd1fa2e-00eb-43ea-9c23-4568dc32307a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1272 microversion: 2.1 time: 0.502027 Aug 09 17:28:11.333120 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2003/3840] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:10 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1272 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:11.346991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2edce3a5-b40a-459b-a746-89b13d933977 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:11.359813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2edce3a5-b40a-459b-a746-89b13d933977 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:11.373818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edce3a5-b40a-459b-a746-89b13d933977 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:11.374626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edce3a5-b40a-459b-a746-89b13d933977 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:11.375265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edce3a5-b40a-459b-a746-89b13d933977 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:11.376247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edce3a5-b40a-459b-a746-89b13d933977 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:11.377407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edce3a5-b40a-459b-a746-89b13d933977 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:11.377407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edce3a5-b40a-459b-a746-89b13d933977 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:11.464913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:11.474323 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2edce3a5-b40a-459b-a746-89b13d933977 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139271 Aug 09 17:28:11.485802 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2004/3841] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:28:11 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:11.495544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0770be84-61d2-4b74-842b-c39ce6c4eca6 req-0f4afb2d-82b7-43fd-b4d1-0eded50b66ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19aec690-8061-4bc1-9094-114cf9ecd9a0", "tag": "a2687548-41ba-453b-8009-ddf9b7632a3c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:11.535552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0770be84-61d2-4b74-842b-c39ce6c4eca6 req-0f4afb2d-82b7-43fd-b4d1-0eded50b66ad service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:11.536078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0770be84-61d2-4b74-842b-c39ce6c4eca6 req-0f4afb2d-82b7-43fd-b4d1-0eded50b66ad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:11.536524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0770be84-61d2-4b74-842b-c39ce6c4eca6 req-0f4afb2d-82b7-43fd-b4d1-0eded50b66ad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:11.599355 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0770be84-61d2-4b74-842b-c39ce6c4eca6 req-0f4afb2d-82b7-43fd-b4d1-0eded50b66ad service nova] Creating event network-changed:a2687548-41ba-453b-8009-ddf9b7632a3c for instance 19aec690-8061-4bc1-9094-114cf9ecd9a0 on n-h1-845781-6 Aug 09 17:28:11.635149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-669a60ae-c6dc-47ec-9c11-0cb93cc08b16 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:11.642318 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0770be84-61d2-4b74-842b-c39ce6c4eca6 req-0f4afb2d-82b7-43fd-b4d1-0eded50b66ad service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154459 Aug 09 17:28:11.644623 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2005/3842] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:11.654892 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-669a60ae-c6dc-47ec-9c11-0cb93cc08b16 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1394 microversion: 2.1 time: 1.697055 Aug 09 17:28:11.671149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-80af0662-52f2-49d4-815d-5e06676d5a48 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:11.680155 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1838/3843] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:09 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1394 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:11.696614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-80af0662-52f2-49d4-815d-5e06676d5a48 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:11.721553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80af0662-52f2-49d4-815d-5e06676d5a48 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:11.722749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80af0662-52f2-49d4-815d-5e06676d5a48 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:11.723310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80af0662-52f2-49d4-815d-5e06676d5a48 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:11.741254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80af0662-52f2-49d4-815d-5e06676d5a48 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:11.742187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80af0662-52f2-49d4-815d-5e06676d5a48 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:11.742846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80af0662-52f2-49d4-815d-5e06676d5a48 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:11.846768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fbd03636-a3a8-4635-b5c7-86d77082d544 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:11.848184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fbd03636-a3a8-4635-b5c7-86d77082d544 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:11.894400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbd03636-a3a8-4635-b5c7-86d77082d544 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:11.895273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbd03636-a3a8-4635-b5c7-86d77082d544 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:11.920360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbd03636-a3a8-4635-b5c7-86d77082d544 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:11.921755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbd03636-a3a8-4635-b5c7-86d77082d544 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:11.922582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbd03636-a3a8-4635-b5c7-86d77082d544 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:11.929356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbd03636-a3a8-4635-b5c7-86d77082d544 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:12.811447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fbd03636-a3a8-4635-b5c7-86d77082d544 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:12.833898 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fbd03636-a3a8-4635-b5c7-86d77082d544 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1297 microversion: 2.1 time: 0.993875 Aug 09 17:28:12.841146 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1839/3844] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:11 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1297 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:12.847124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-191adf6f-d9dc-4eb9-b9bc-13ae6bf21231 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:12.861112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-191adf6f-d9dc-4eb9-b9bc-13ae6bf21231 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:12.886656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191adf6f-d9dc-4eb9-b9bc-13ae6bf21231 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:12.888409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191adf6f-d9dc-4eb9-b9bc-13ae6bf21231 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:12.900409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191adf6f-d9dc-4eb9-b9bc-13ae6bf21231 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:12.901809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191adf6f-d9dc-4eb9-b9bc-13ae6bf21231 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:12.902575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191adf6f-d9dc-4eb9-b9bc-13ae6bf21231 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:12.904153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-191adf6f-d9dc-4eb9-b9bc-13ae6bf21231 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:13.009408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:13.087904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:13.653144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-80af0662-52f2-49d4-815d-5e06676d5a48 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:13.691100 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-80af0662-52f2-49d4-815d-5e06676d5a48 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 2.044115 Aug 09 17:28:13.701418 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2006/3845] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:11 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:13.744345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-457a4e4d-03e3-4107-8f0d-e62284931869 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:13.759752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-457a4e4d-03e3-4107-8f0d-e62284931869 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:13.795551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457a4e4d-03e3-4107-8f0d-e62284931869 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:13.796759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457a4e4d-03e3-4107-8f0d-e62284931869 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:13.797791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457a4e4d-03e3-4107-8f0d-e62284931869 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:13.799355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457a4e4d-03e3-4107-8f0d-e62284931869 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:13.802692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457a4e4d-03e3-4107-8f0d-e62284931869 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:13.804435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-457a4e4d-03e3-4107-8f0d-e62284931869 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:13.915732 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-457a4e4d-03e3-4107-8f0d-e62284931869 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204641 Aug 09 17:28:13.917718 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2007/3846] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:28:13 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:13.931731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bfef9053-409d-48d4-aadc-e805d96c5ab8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:13.933266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bfef9053-409d-48d4-aadc-e805d96c5ab8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:13.958781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfef9053-409d-48d4-aadc-e805d96c5ab8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:13.965779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfef9053-409d-48d4-aadc-e805d96c5ab8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:13.969562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfef9053-409d-48d4-aadc-e805d96c5ab8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:13.977219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfef9053-409d-48d4-aadc-e805d96c5ab8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:13.980007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfef9053-409d-48d4-aadc-e805d96c5ab8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:13.987870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfef9053-409d-48d4-aadc-e805d96c5ab8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:14.858903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-191adf6f-d9dc-4eb9-b9bc-13ae6bf21231 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:14.886402 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-191adf6f-d9dc-4eb9-b9bc-13ae6bf21231 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1272 microversion: 2.1 time: 2.043755 Aug 09 17:28:14.905415 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1840/3847] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:12 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1272 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:14.927796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-46f6d85b-530a-45ee-98be-4173c43c791f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:14.932892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-46f6d85b-530a-45ee-98be-4173c43c791f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:14.954596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46f6d85b-530a-45ee-98be-4173c43c791f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:14.961494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46f6d85b-530a-45ee-98be-4173c43c791f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:14.964671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46f6d85b-530a-45ee-98be-4173c43c791f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:14.969674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46f6d85b-530a-45ee-98be-4173c43c791f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:14.972476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46f6d85b-530a-45ee-98be-4173c43c791f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:14.977372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-46f6d85b-530a-45ee-98be-4173c43c791f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:15.071876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bfef9053-409d-48d4-aadc-e805d96c5ab8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:15.110634 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bfef9053-409d-48d4-aadc-e805d96c5ab8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1394 microversion: 2.1 time: 1.190144 Aug 09 17:28:15.123564 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2008/3848] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:13 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1394 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:15.146160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f54c999a-c332-4eae-a478-068cb0e362aa tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:15.157769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f54c999a-c332-4eae-a478-068cb0e362aa tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:15.197149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f54c999a-c332-4eae-a478-068cb0e362aa tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:15.211114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f54c999a-c332-4eae-a478-068cb0e362aa tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:15.217023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f54c999a-c332-4eae-a478-068cb0e362aa tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:15.220217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f54c999a-c332-4eae-a478-068cb0e362aa tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:15.223037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f54c999a-c332-4eae-a478-068cb0e362aa tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:15.225982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f54c999a-c332-4eae-a478-068cb0e362aa tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:15.360821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-46f6d85b-530a-45ee-98be-4173c43c791f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:15.403118 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-46f6d85b-530a-45ee-98be-4173c43c791f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1297 microversion: 2.1 time: 0.490959 Aug 09 17:28:15.408853 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1841/3849] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:14 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1297 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:15.437997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-59e4737e-1c33-432f-b92e-8e23dfae747f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:15.447309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-59e4737e-1c33-432f-b92e-8e23dfae747f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:15.487842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59e4737e-1c33-432f-b92e-8e23dfae747f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:15.489094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59e4737e-1c33-432f-b92e-8e23dfae747f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:15.494361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59e4737e-1c33-432f-b92e-8e23dfae747f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:15.498079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59e4737e-1c33-432f-b92e-8e23dfae747f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:15.503998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59e4737e-1c33-432f-b92e-8e23dfae747f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:15.505281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59e4737e-1c33-432f-b92e-8e23dfae747f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:15.690566 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-59e4737e-1c33-432f-b92e-8e23dfae747f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.274746 Aug 09 17:28:15.696447 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1842/3850] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:28:15 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments => generated 197 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:15.920959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2ae13e7c-5a80-4734-a84e-a52925b54a32 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:15.924837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2ae13e7c-5a80-4734-a84e-a52925b54a32 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:15.947931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ae13e7c-5a80-4734-a84e-a52925b54a32 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:15.952393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ae13e7c-5a80-4734-a84e-a52925b54a32 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:15.952733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ae13e7c-5a80-4734-a84e-a52925b54a32 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:15.954043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ae13e7c-5a80-4734-a84e-a52925b54a32 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:15.956874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ae13e7c-5a80-4734-a84e-a52925b54a32 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:15.961395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2ae13e7c-5a80-4734-a84e-a52925b54a32 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:16.216510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f54c999a-c332-4eae-a478-068cb0e362aa tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:16.257722 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f54c999a-c332-4eae-a478-068cb0e362aa tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 1.130222 Aug 09 17:28:16.262518 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2009/3851] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:15 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:16.285021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-004e36c9-50b3-4840-895c-f39df014e623 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:16.289225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-004e36c9-50b3-4840-895c-f39df014e623 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:16.307698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004e36c9-50b3-4840-895c-f39df014e623 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:16.309494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004e36c9-50b3-4840-895c-f39df014e623 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:16.312088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004e36c9-50b3-4840-895c-f39df014e623 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:16.312088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004e36c9-50b3-4840-895c-f39df014e623 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:16.312088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004e36c9-50b3-4840-895c-f39df014e623 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:16.314666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004e36c9-50b3-4840-895c-f39df014e623 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:16.450257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=18 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:17.072005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-004e36c9-50b3-4840-895c-f39df014e623 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:17.089249 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-004e36c9-50b3-4840-895c-f39df014e623 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1394 microversion: 2.1 time: 0.825094 Aug 09 17:28:17.090848 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2010/3852] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:16 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1394 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:17.105456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3f36a5a1-4b3e-41e7-9846-11f1f16ad743 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:17.106973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3f36a5a1-4b3e-41e7-9846-11f1f16ad743 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:17.122582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f36a5a1-4b3e-41e7-9846-11f1f16ad743 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:17.124552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f36a5a1-4b3e-41e7-9846-11f1f16ad743 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:17.125466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f36a5a1-4b3e-41e7-9846-11f1f16ad743 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:17.127062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f36a5a1-4b3e-41e7-9846-11f1f16ad743 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:17.128138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f36a5a1-4b3e-41e7-9846-11f1f16ad743 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:17.135703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f36a5a1-4b3e-41e7-9846-11f1f16ad743 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:17.395499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f36a5a1-4b3e-41e7-9846-11f1f16ad743 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:17.419589 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3f36a5a1-4b3e-41e7-9846-11f1f16ad743 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1297 microversion: 2.1 time: 0.327099 Aug 09 17:28:17.420481 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2011/3853] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:17 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1297 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:17.445256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1a644472-fb45-4cbe-9d20-2ea6ebc195b5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:17.448942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1a644472-fb45-4cbe-9d20-2ea6ebc195b5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:17.462128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a644472-fb45-4cbe-9d20-2ea6ebc195b5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:17.462128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a644472-fb45-4cbe-9d20-2ea6ebc195b5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:17.462542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a644472-fb45-4cbe-9d20-2ea6ebc195b5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:17.463117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a644472-fb45-4cbe-9d20-2ea6ebc195b5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:17.463596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a644472-fb45-4cbe-9d20-2ea6ebc195b5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:17.464067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a644472-fb45-4cbe-9d20-2ea6ebc195b5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:17.633300 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1a644472-fb45-4cbe-9d20-2ea6ebc195b5 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193414 Aug 09 17:28:17.633944 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2012/3854] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:28:17 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:17.659931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-17bef262-e17f-4370-b190-766da6eaba45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:17.663668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17bef262-e17f-4370-b190-766da6eaba45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:17.686819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17bef262-e17f-4370-b190-766da6eaba45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:17.687332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17bef262-e17f-4370-b190-766da6eaba45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:17.687820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17bef262-e17f-4370-b190-766da6eaba45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:17.688572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17bef262-e17f-4370-b190-766da6eaba45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:17.689042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17bef262-e17f-4370-b190-766da6eaba45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:17.710978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17bef262-e17f-4370-b190-766da6eaba45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:18.134584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2ae13e7c-5a80-4734-a84e-a52925b54a32 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:18.197111 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2ae13e7c-5a80-4734-a84e-a52925b54a32 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1314 microversion: 2.1 time: 2.282538 Aug 09 17:28:18.199097 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1843/3855] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:15 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1314 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:18.225751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4b034b0b-ac01-4615-a36d-6af6b75151a9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:18.229202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4b034b0b-ac01-4615-a36d-6af6b75151a9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:18.287292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b034b0b-ac01-4615-a36d-6af6b75151a9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:18.288807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b034b0b-ac01-4615-a36d-6af6b75151a9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:18.289927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b034b0b-ac01-4615-a36d-6af6b75151a9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:18.292264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b034b0b-ac01-4615-a36d-6af6b75151a9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:18.293346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b034b0b-ac01-4615-a36d-6af6b75151a9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:18.297284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b034b0b-ac01-4615-a36d-6af6b75151a9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:18.432846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-17bef262-e17f-4370-b190-766da6eaba45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:18.455516 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-17bef262-e17f-4370-b190-766da6eaba45 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.812152 Aug 09 17:28:18.462055 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2013/3856] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:17 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:18.469062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-119ba157-9f6a-403c-ba46-22a27c477674 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:18.496680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-119ba157-9f6a-403c-ba46-22a27c477674 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:18.534947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-119ba157-9f6a-403c-ba46-22a27c477674 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:18.541035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-119ba157-9f6a-403c-ba46-22a27c477674 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:18.547144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-119ba157-9f6a-403c-ba46-22a27c477674 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:18.559281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-119ba157-9f6a-403c-ba46-22a27c477674 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:18.560496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-119ba157-9f6a-403c-ba46-22a27c477674 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:18.572475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-119ba157-9f6a-403c-ba46-22a27c477674 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:19.210114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-119ba157-9f6a-403c-ba46-22a27c477674 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:19.242062 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-119ba157-9f6a-403c-ba46-22a27c477674 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 0.776129 Aug 09 17:28:19.249909 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2014/3857] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:18 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:19.291612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8b377853-754e-4cfa-9050-553ccbac9990 req-f6e670d1-a1ec-4398-88a0-89bbae4f1742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7acc97e-cd9f-4de6-afc7-734fb25d253e", "tag": "4c09ecb4-5d41-4c79-ad78-c9c698d2b1ff"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:19.363231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8b377853-754e-4cfa-9050-553ccbac9990 req-f6e670d1-a1ec-4398-88a0-89bbae4f1742 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:19.379065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8b377853-754e-4cfa-9050-553ccbac9990 req-f6e670d1-a1ec-4398-88a0-89bbae4f1742 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:19.383461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8b377853-754e-4cfa-9050-553ccbac9990 req-f6e670d1-a1ec-4398-88a0-89bbae4f1742 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:19.436342 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8b377853-754e-4cfa-9050-553ccbac9990 req-f6e670d1-a1ec-4398-88a0-89bbae4f1742 service nova] Creating event network-changed:4c09ecb4-5d41-4c79-ad78-c9c698d2b1ff for instance d7acc97e-cd9f-4de6-afc7-734fb25d253e on n-h1-845781-6 Aug 09 17:28:19.455061 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8b377853-754e-4cfa-9050-553ccbac9990 req-f6e670d1-a1ec-4398-88a0-89bbae4f1742 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194975 Aug 09 17:28:19.457982 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2015/3858] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:19.467139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d9e2e137-3531-46bb-af41-963eb408572f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:19.469830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d9e2e137-3531-46bb-af41-963eb408572f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:19.481518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e2e137-3531-46bb-af41-963eb408572f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:19.482416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e2e137-3531-46bb-af41-963eb408572f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:19.483172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e2e137-3531-46bb-af41-963eb408572f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:19.486742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e2e137-3531-46bb-af41-963eb408572f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:19.487602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e2e137-3531-46bb-af41-963eb408572f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:19.488581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9e2e137-3531-46bb-af41-963eb408572f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:19.562884 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d9e2e137-3531-46bb-af41-963eb408572f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102876 Aug 09 17:28:19.587239 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2016/3859] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:28:19 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:19.618902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3f4a2bf1-2327-4b9e-941d-5ceb6054493e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:19.628324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3f4a2bf1-2327-4b9e-941d-5ceb6054493e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:19.643929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4a2bf1-2327-4b9e-941d-5ceb6054493e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:19.644681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4a2bf1-2327-4b9e-941d-5ceb6054493e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:19.647352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4a2bf1-2327-4b9e-941d-5ceb6054493e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:19.655463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4a2bf1-2327-4b9e-941d-5ceb6054493e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:19.658003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4a2bf1-2327-4b9e-941d-5ceb6054493e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:19.659471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f4a2bf1-2327-4b9e-941d-5ceb6054493e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:20.682853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f4a2bf1-2327-4b9e-941d-5ceb6054493e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:20.692605 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3f4a2bf1-2327-4b9e-941d-5ceb6054493e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1314 microversion: 2.1 time: 1.098205 Aug 09 17:28:20.712518 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2017/3860] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:19 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1314 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:20.721084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea89e7d8-e3c5-43d1-9521-3d352ad6b236 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:20.726684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ea89e7d8-e3c5-43d1-9521-3d352ad6b236 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:20.738367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea89e7d8-e3c5-43d1-9521-3d352ad6b236 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:20.739134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea89e7d8-e3c5-43d1-9521-3d352ad6b236 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:20.739565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea89e7d8-e3c5-43d1-9521-3d352ad6b236 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:20.745942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea89e7d8-e3c5-43d1-9521-3d352ad6b236 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:20.746437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea89e7d8-e3c5-43d1-9521-3d352ad6b236 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:20.746889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea89e7d8-e3c5-43d1-9521-3d352ad6b236 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:21.141811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4b034b0b-ac01-4615-a36d-6af6b75151a9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:21.164780 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4b034b0b-ac01-4615-a36d-6af6b75151a9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1394 microversion: 2.1 time: 2.963598 Aug 09 17:28:21.182782 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1844/3861] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:18 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1394 bytes in 2983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:21.199571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5afc422-2905-4309-90ca-236e20548985 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:21.200459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5afc422-2905-4309-90ca-236e20548985 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:21.228467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:21.234326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5afc422-2905-4309-90ca-236e20548985 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:21.235516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5afc422-2905-4309-90ca-236e20548985 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:21.236129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5afc422-2905-4309-90ca-236e20548985 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:21.237402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5afc422-2905-4309-90ca-236e20548985 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:21.238538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5afc422-2905-4309-90ca-236e20548985 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:21.239217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5afc422-2905-4309-90ca-236e20548985 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:21.263613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ea89e7d8-e3c5-43d1-9521-3d352ad6b236 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:21.294824 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ea89e7d8-e3c5-43d1-9521-3d352ad6b236 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.580632 Aug 09 17:28:21.306160 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2018/3862] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:20 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:21.329448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3d3e9290-1f5f-4775-83dd-da571fec7abb tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:21.336201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3d3e9290-1f5f-4775-83dd-da571fec7abb tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:21.360646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:21.375903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d3e9290-1f5f-4775-83dd-da571fec7abb tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:21.377343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d3e9290-1f5f-4775-83dd-da571fec7abb tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:21.378542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d3e9290-1f5f-4775-83dd-da571fec7abb tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:21.380194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d3e9290-1f5f-4775-83dd-da571fec7abb tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:21.381977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d3e9290-1f5f-4775-83dd-da571fec7abb tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:21.383071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d3e9290-1f5f-4775-83dd-da571fec7abb tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:21.539870 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3d3e9290-1f5f-4775-83dd-da571fec7abb tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217661 Aug 09 17:28:21.548671 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2019/3863] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:28:21 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:21.718968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cbe9c273-b82b-4634-bab8-2760f607893a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:21.723130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cbe9c273-b82b-4634-bab8-2760f607893a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:21.765050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c273-b82b-4634-bab8-2760f607893a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:21.765878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c273-b82b-4634-bab8-2760f607893a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:21.774319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c273-b82b-4634-bab8-2760f607893a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:21.784403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c273-b82b-4634-bab8-2760f607893a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:21.790356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c273-b82b-4634-bab8-2760f607893a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:21.793689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbe9c273-b82b-4634-bab8-2760f607893a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:22.011410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e5afc422-2905-4309-90ca-236e20548985 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:22.024135 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5afc422-2905-4309-90ca-236e20548985 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 0.839361 Aug 09 17:28:22.035039 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1845/3864] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:21 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:22.190689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-386ff00d-e069-4844-ba69-c565ffb7095d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:22.196046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-386ff00d-e069-4844-ba69-c565ffb7095d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:22.218277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-386ff00d-e069-4844-ba69-c565ffb7095d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:22.218842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-386ff00d-e069-4844-ba69-c565ffb7095d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:22.219306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-386ff00d-e069-4844-ba69-c565ffb7095d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:22.231499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-386ff00d-e069-4844-ba69-c565ffb7095d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:22.233282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-386ff00d-e069-4844-ba69-c565ffb7095d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:22.236461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-386ff00d-e069-4844-ba69-c565ffb7095d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:22.921302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cbe9c273-b82b-4634-bab8-2760f607893a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:22.949153 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cbe9c273-b82b-4634-bab8-2760f607893a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1314 microversion: 2.1 time: 1.238081 Aug 09 17:28:22.969356 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2020/3865] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:21 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1314 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:22.982689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dd687425-6aaf-4566-94bd-cb029ba3aa00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:22.992541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dd687425-6aaf-4566-94bd-cb029ba3aa00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:23.019211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd687425-6aaf-4566-94bd-cb029ba3aa00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:23.026616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd687425-6aaf-4566-94bd-cb029ba3aa00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:23.030518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd687425-6aaf-4566-94bd-cb029ba3aa00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:23.035737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd687425-6aaf-4566-94bd-cb029ba3aa00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:23.039173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd687425-6aaf-4566-94bd-cb029ba3aa00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:23.042305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd687425-6aaf-4566-94bd-cb029ba3aa00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:23.455114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-386ff00d-e069-4844-ba69-c565ffb7095d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:23.520942 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-386ff00d-e069-4844-ba69-c565ffb7095d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1394 microversion: 2.1 time: 1.328034 Aug 09 17:28:23.522685 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1846/3866] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:22 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1394 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:23.594173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7d419bb4-f511-4800-ba17-b4ea945bfe8e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:23.634126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7d419bb4-f511-4800-ba17-b4ea945bfe8e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:23.690595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d419bb4-f511-4800-ba17-b4ea945bfe8e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:23.703997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d419bb4-f511-4800-ba17-b4ea945bfe8e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:23.705257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d419bb4-f511-4800-ba17-b4ea945bfe8e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:23.706702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d419bb4-f511-4800-ba17-b4ea945bfe8e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:23.717757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d419bb4-f511-4800-ba17-b4ea945bfe8e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:23.718910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d419bb4-f511-4800-ba17-b4ea945bfe8e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:23.891943 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7d419bb4-f511-4800-ba17-b4ea945bfe8e tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.322755 Aug 09 17:28:23.894068 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1847/3867] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:28:23 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08/os-volume_attachments => generated 25 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:28:23.923506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8afbf397-97b9-41cb-a16c-0b0807a890df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:23.940034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8afbf397-97b9-41cb-a16c-0b0807a890df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:23.998638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8afbf397-97b9-41cb-a16c-0b0807a890df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:23.999852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8afbf397-97b9-41cb-a16c-0b0807a890df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:24.000997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8afbf397-97b9-41cb-a16c-0b0807a890df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:24.002455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8afbf397-97b9-41cb-a16c-0b0807a890df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:24.003733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8afbf397-97b9-41cb-a16c-0b0807a890df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:24.004928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8afbf397-97b9-41cb-a16c-0b0807a890df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:24.119527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dd687425-6aaf-4566-94bd-cb029ba3aa00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:24.168342 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dd687425-6aaf-4566-94bd-cb029ba3aa00 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 1.196854 Aug 09 17:28:24.194219 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2021/3868] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:22 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:24.214948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d92f543f-fc65-4413-a0fc-5d8f1b634dea req-b960f9ec-940d-4829-8d43-7bfb043032b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aec690-8061-4bc1-9094-114cf9ecd9a0", "name": "network-vif-plugged", "status": "completed", "tag": "a2687548-41ba-453b-8009-ddf9b7632a3c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:24.252949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d92f543f-fc65-4413-a0fc-5d8f1b634dea req-b960f9ec-940d-4829-8d43-7bfb043032b6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:24.254413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d92f543f-fc65-4413-a0fc-5d8f1b634dea req-b960f9ec-940d-4829-8d43-7bfb043032b6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:24.261853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d92f543f-fc65-4413-a0fc-5d8f1b634dea req-b960f9ec-940d-4829-8d43-7bfb043032b6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:24.370277 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d92f543f-fc65-4413-a0fc-5d8f1b634dea req-b960f9ec-940d-4829-8d43-7bfb043032b6 service nova] Creating event network-vif-plugged:a2687548-41ba-453b-8009-ddf9b7632a3c for instance 19aec690-8061-4bc1-9094-114cf9ecd9a0 on n-h1-845781-6 Aug 09 17:28:24.386703 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d92f543f-fc65-4413-a0fc-5d8f1b634dea req-b960f9ec-940d-4829-8d43-7bfb043032b6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189537 Aug 09 17:28:24.388626 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2022/3869] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:24.415151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-33ab28e4-d23d-45eb-937f-911b4e5e575f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:24.418412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-33ab28e4-d23d-45eb-937f-911b4e5e575f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:24.448035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ab28e4-d23d-45eb-937f-911b4e5e575f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:24.455790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ab28e4-d23d-45eb-937f-911b4e5e575f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:24.457636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ab28e4-d23d-45eb-937f-911b4e5e575f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:24.460064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ab28e4-d23d-45eb-937f-911b4e5e575f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:24.465857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ab28e4-d23d-45eb-937f-911b4e5e575f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:24.466811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ab28e4-d23d-45eb-937f-911b4e5e575f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:24.600275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:25.057798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-33ab28e4-d23d-45eb-937f-911b4e5e575f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:25.093044 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-33ab28e4-d23d-45eb-937f-911b4e5e575f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1314 microversion: 2.1 time: 0.698608 Aug 09 17:28:25.096083 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2023/3870] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:24 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:25.124857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:25.144931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:25.158190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.159076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.160182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:25.161735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.163501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.164524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:25.178936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8afbf397-97b9-41cb-a16c-0b0807a890df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:25.196495 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8afbf397-97b9-41cb-a16c-0b0807a890df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 1.300387 Aug 09 17:28:25.197113 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1848/3871] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:23 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:25.202333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b951005b-a8d3-4432-884a-c2553714d60b tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:25.203232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b951005b-a8d3-4432-884a-c2553714d60b tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:25.227706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b951005b-a8d3-4432-884a-c2553714d60b tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.232865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b951005b-a8d3-4432-884a-c2553714d60b tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.233684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b951005b-a8d3-4432-884a-c2553714d60b tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:25.236534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b951005b-a8d3-4432-884a-c2553714d60b tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.238001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b951005b-a8d3-4432-884a-c2553714d60b tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.238816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b951005b-a8d3-4432-884a-c2553714d60b tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:25.256840 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] HTTP exception thrown: Cannot 'reboot' instance 750faee4-c702-4a68-b0ba-f57212ea276f while it is in vm_state rescued Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Request method failure captured: Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f/action HTTP/1.1 Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 28 Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfTXHKJ-127xoXOxvirCkOJ5Ga7oI06dbW5eRmTw3VceZ3fIPtVcpBoJqCQEzgHg892I33A2CZbgdV9GneqCNx7frvCudUtWkW3U62800gIkrYotA0sMKiw2vzfbegwV0AsonNcEy5cWuu85myYoWYiVD7fe2x9mfaYw2xpqmhRsNo Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d20bf24928749afb9b848946419f4f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a34881c81ae2427fbf2cbb1cd8c4ef52 Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: {"reboot": {"type": "HARD"}} Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: exception: Cannot 'reboot' instance 750faee4-c702-4a68-b0ba-f57212ea276f while it is in vm_state rescued Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '750faee4-c702-4a68-b0ba-f57212ea276f', 'body': {'reboot': {'type': 'HARD'}}} Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 750faee4-c702-4a68-b0ba-f57212ea276f in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:28:25.261250 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 750faee4-c702-4a68-b0ba-f57212ea276f while it is in vm_state rescued Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 750faee4-c702-4a68-b0ba-f57212ea276f while it is in vm_state rescued Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Returning 409 to user: Cannot 'reboot' instance 750faee4-c702-4a68-b0ba-f57212ea276f while it is in vm_state rescued {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:25.272740 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c65c6a84-5185-4f98-aede-5aa23f5690ba tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f/action" status: 409 len: 145 microversion: 2.1 time: 0.168702 Aug 09 17:28:25.277777 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2024/3872] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:25 2022] POST /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f/action => generated 145 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:28:25.291960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-95a22b4a-c2bb-4f7c-93a3-f90671c8f047 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:25.293458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-95a22b4a-c2bb-4f7c-93a3-f90671c8f047 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:25.308203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95a22b4a-c2bb-4f7c-93a3-f90671c8f047 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.309281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95a22b4a-c2bb-4f7c-93a3-f90671c8f047 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.310185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95a22b4a-c2bb-4f7c-93a3-f90671c8f047 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:25.313408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95a22b4a-c2bb-4f7c-93a3-f90671c8f047 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.315340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95a22b4a-c2bb-4f7c-93a3-f90671c8f047 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.317567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95a22b4a-c2bb-4f7c-93a3-f90671c8f047 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:25.612518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-95a22b4a-c2bb-4f7c-93a3-f90671c8f047 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:25.626700 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-95a22b4a-c2bb-4f7c-93a3-f90671c8f047 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.346823 Aug 09 17:28:25.627716 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2025/3873] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:25 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:25.636855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:25.642177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:25.653553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.654682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.655446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:25.656745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.657514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.658334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:25.717585 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] HTTP exception thrown: Cannot 'rebuild' instance 750faee4-c702-4a68-b0ba-f57212ea276f while it is in vm_state rescued Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Request method failure captured: Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f/action HTTP/1.1 Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 65 Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfTXHKJ-127xoXOxvirCkOJ5Ga7oI06dbW5eRmTw3VceZ3fIPtVcpBoJqCQEzgHg892I33A2CZbgdV9GneqCNx7frvCudUtWkW3U62800gIkrYotA0sMKiw2vzfbegwV0AsonNcEy5cWuu85myYoWYiVD7fe2x9mfaYw2xpqmhRsNo Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d20bf24928749afb9b848946419f4f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a34881c81ae2427fbf2cbb1cd8c4ef52 Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: exception: Cannot 'rebuild' instance 750faee4-c702-4a68-b0ba-f57212ea276f while it is in vm_state rescued Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '750faee4-c702-4a68-b0ba-f57212ea276f', 'body': {'rebuild': {'imageRef': 'f484be58-00e8-4507-b378-ca7d3c0dd32d'}}} Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 750faee4-c702-4a68-b0ba-f57212ea276f in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:25.719425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 750faee4-c702-4a68-b0ba-f57212ea276f while it is in vm_state rescued Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 750faee4-c702-4a68-b0ba-f57212ea276f while it is in vm_state rescued Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Returning 409 to user: Cannot 'rebuild' instance 750faee4-c702-4a68-b0ba-f57212ea276f while it is in vm_state rescued {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-93110dd7-d582-4b3b-8dfd-909ad4aa52f0 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "POST /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f/action" status: 409 len: 146 microversion: 2.1 time: 0.091706 Aug 09 17:28:25.727130 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2026/3874] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:25 2022] POST /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f/action => generated 146 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:28:25.734579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-902cc0a8-8e27-40c0-ae4e-082b1a62245b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:25.735224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-902cc0a8-8e27-40c0-ae4e-082b1a62245b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:25.743372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-902cc0a8-8e27-40c0-ae4e-082b1a62245b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.743997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-902cc0a8-8e27-40c0-ae4e-082b1a62245b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.744526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-902cc0a8-8e27-40c0-ae4e-082b1a62245b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:25.745340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-902cc0a8-8e27-40c0-ae4e-082b1a62245b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.745874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-902cc0a8-8e27-40c0-ae4e-082b1a62245b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.746378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-902cc0a8-8e27-40c0-ae4e-082b1a62245b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:25.791798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-902cc0a8-8e27-40c0-ae4e-082b1a62245b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:28:25.938664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-902cc0a8-8e27-40c0-ae4e-082b1a62245b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "DELETE /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 204 len: 0 microversion: 2.1 time: 0.205552 Aug 09 17:28:25.941992 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2027/3875] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:28:25 2022] DELETE /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:28:25.959735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09a170aa-411c-42aa-827a-68bafac531e2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:25.961811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09a170aa-411c-42aa-827a-68bafac531e2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:25.973065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a170aa-411c-42aa-827a-68bafac531e2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.974044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a170aa-411c-42aa-827a-68bafac531e2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.974911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a170aa-411c-42aa-827a-68bafac531e2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:25.976401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a170aa-411c-42aa-827a-68bafac531e2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:25.977334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a170aa-411c-42aa-827a-68bafac531e2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:25.978215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a170aa-411c-42aa-827a-68bafac531e2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:26.116151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b951005b-a8d3-4432-884a-c2553714d60b tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:26.159277 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b951005b-a8d3-4432-884a-c2553714d60b tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1394 microversion: 2.1 time: 0.957649 Aug 09 17:28:26.163713 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1849/3876] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:25 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1394 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:26.182273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-edf040c5-9f73-45be-afd0-b1202da3e22b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:26.185502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-edf040c5-9f73-45be-afd0-b1202da3e22b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:26.198703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edf040c5-9f73-45be-afd0-b1202da3e22b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:26.200222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edf040c5-9f73-45be-afd0-b1202da3e22b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:26.202415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edf040c5-9f73-45be-afd0-b1202da3e22b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:26.204365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edf040c5-9f73-45be-afd0-b1202da3e22b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:26.205439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edf040c5-9f73-45be-afd0-b1202da3e22b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:26.207320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edf040c5-9f73-45be-afd0-b1202da3e22b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:26.281568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-09a170aa-411c-42aa-827a-68bafac531e2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:26.294819 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09a170aa-411c-42aa-827a-68bafac531e2 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1690 microversion: 2.1 time: 0.343477 Aug 09 17:28:26.296409 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2028/3877] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:25 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1690 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:26.302012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd2353ea-9908-42b0-bc8a-ea7444c5c0f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:26.303143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd2353ea-9908-42b0-bc8a-ea7444c5c0f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:26.321655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2353ea-9908-42b0-bc8a-ea7444c5c0f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:26.323720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2353ea-9908-42b0-bc8a-ea7444c5c0f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:26.328747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2353ea-9908-42b0-bc8a-ea7444c5c0f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:26.331129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2353ea-9908-42b0-bc8a-ea7444c5c0f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:26.333123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2353ea-9908-42b0-bc8a-ea7444c5c0f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:26.335087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2353ea-9908-42b0-bc8a-ea7444c5c0f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:26.633135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd2353ea-9908-42b0-bc8a-ea7444c5c0f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:26.649726 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd2353ea-9908-42b0-bc8a-ea7444c5c0f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 0.351503 Aug 09 17:28:26.650974 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2029/3878] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:26 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:26.660074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f73bfe23-05c7-4c5a-a9a7-1ff18ae47433 req-7734939d-f5af-473b-ae5e-e3f85fdb060a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a30c674-6026-45bd-b50e-218ae7d69382", "tag": "a73935e9-c581-4296-b0ba-805a64e85308"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:26.679128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f73bfe23-05c7-4c5a-a9a7-1ff18ae47433 req-7734939d-f5af-473b-ae5e-e3f85fdb060a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:26.680183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f73bfe23-05c7-4c5a-a9a7-1ff18ae47433 req-7734939d-f5af-473b-ae5e-e3f85fdb060a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:26.681062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f73bfe23-05c7-4c5a-a9a7-1ff18ae47433 req-7734939d-f5af-473b-ae5e-e3f85fdb060a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:26.704463 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f73bfe23-05c7-4c5a-a9a7-1ff18ae47433 req-7734939d-f5af-473b-ae5e-e3f85fdb060a service nova] Creating event network-changed:a73935e9-c581-4296-b0ba-805a64e85308 for instance 1a30c674-6026-45bd-b50e-218ae7d69382 on n-h2-845781-6 Aug 09 17:28:26.721004 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f73bfe23-05c7-4c5a-a9a7-1ff18ae47433 req-7734939d-f5af-473b-ae5e-e3f85fdb060a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067571 Aug 09 17:28:26.722543 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2030/3879] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:26.729907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fee12dd8-5dd4-4628-a47f-79b9a0ad458d req-7f42c9cf-e0c8-415f-a149-f7094b0a828c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7acc97e-cd9f-4de6-afc7-734fb25d253e", "name": "network-vif-plugged", "status": "completed", "tag": "4c09ecb4-5d41-4c79-ad78-c9c698d2b1ff"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:26.744223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fee12dd8-5dd4-4628-a47f-79b9a0ad458d req-7f42c9cf-e0c8-415f-a149-f7094b0a828c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:26.744720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fee12dd8-5dd4-4628-a47f-79b9a0ad458d req-7f42c9cf-e0c8-415f-a149-f7094b0a828c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:26.745436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fee12dd8-5dd4-4628-a47f-79b9a0ad458d req-7f42c9cf-e0c8-415f-a149-f7094b0a828c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:26.756006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-edf040c5-9f73-45be-afd0-b1202da3e22b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:26.771373 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fee12dd8-5dd4-4628-a47f-79b9a0ad458d req-7f42c9cf-e0c8-415f-a149-f7094b0a828c service nova] Creating event network-vif-plugged:4c09ecb4-5d41-4c79-ad78-c9c698d2b1ff for instance d7acc97e-cd9f-4de6-afc7-734fb25d253e on n-h1-845781-6 Aug 09 17:28:26.778440 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-edf040c5-9f73-45be-afd0-b1202da3e22b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1314 microversion: 2.1 time: 0.611884 Aug 09 17:28:26.778737 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fee12dd8-5dd4-4628-a47f-79b9a0ad458d req-7f42c9cf-e0c8-415f-a149-f7094b0a828c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054404 Aug 09 17:28:26.779701 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2031/3880] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:26.779879 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1850/3881] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:26 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:26.804481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-03985d3c-30be-4a8a-8a99-3a063b9170f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:26.805956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-03985d3c-30be-4a8a-8a99-3a063b9170f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:26.824926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03985d3c-30be-4a8a-8a99-3a063b9170f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:26.825615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03985d3c-30be-4a8a-8a99-3a063b9170f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:26.826074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03985d3c-30be-4a8a-8a99-3a063b9170f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:26.831968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03985d3c-30be-4a8a-8a99-3a063b9170f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:26.833494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03985d3c-30be-4a8a-8a99-3a063b9170f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:26.835211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03985d3c-30be-4a8a-8a99-3a063b9170f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:27.190265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87362b7c-62f4-4afa-81db-6b24794408d3 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:27.192875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-87362b7c-62f4-4afa-81db-6b24794408d3 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:27.205739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87362b7c-62f4-4afa-81db-6b24794408d3 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:27.207049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87362b7c-62f4-4afa-81db-6b24794408d3 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:27.208198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87362b7c-62f4-4afa-81db-6b24794408d3 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:27.210226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87362b7c-62f4-4afa-81db-6b24794408d3 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:27.211454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87362b7c-62f4-4afa-81db-6b24794408d3 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:27.212619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87362b7c-62f4-4afa-81db-6b24794408d3 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:27.369093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-03985d3c-30be-4a8a-8a99-3a063b9170f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:27.378349 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-03985d3c-30be-4a8a-8a99-3a063b9170f4 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.588745 Aug 09 17:28:27.379890 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2032/3882] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:26 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:27.386579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d380e66c-5d09-4c8f-83df-22c5c24fa1a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:27.387206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d380e66c-5d09-4c8f-83df-22c5c24fa1a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:27.402542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d380e66c-5d09-4c8f-83df-22c5c24fa1a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:27.403046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d380e66c-5d09-4c8f-83df-22c5c24fa1a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:27.403495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d380e66c-5d09-4c8f-83df-22c5c24fa1a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:27.404276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d380e66c-5d09-4c8f-83df-22c5c24fa1a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:27.404741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d380e66c-5d09-4c8f-83df-22c5c24fa1a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:27.405277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d380e66c-5d09-4c8f-83df-22c5c24fa1a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:27.476286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-87362b7c-62f4-4afa-81db-6b24794408d3 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:27.494613 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-87362b7c-62f4-4afa-81db-6b24794408d3 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1574 microversion: 2.1 time: 0.310790 Aug 09 17:28:27.496672 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1851/3883] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:27 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1574 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:27.541474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5c7eeec6-b518-4eec-a850-e9bbd7307dc7 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:27.542801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5c7eeec6-b518-4eec-a850-e9bbd7307dc7 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:27.557536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c7eeec6-b518-4eec-a850-e9bbd7307dc7 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:27.558740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c7eeec6-b518-4eec-a850-e9bbd7307dc7 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:27.559727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c7eeec6-b518-4eec-a850-e9bbd7307dc7 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:27.561468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c7eeec6-b518-4eec-a850-e9bbd7307dc7 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:27.562747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c7eeec6-b518-4eec-a850-e9bbd7307dc7 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:27.563992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c7eeec6-b518-4eec-a850-e9bbd7307dc7 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:27.742648 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5c7eeec6-b518-4eec-a850-e9bbd7307dc7 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211232 Aug 09 17:28:27.744523 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1852/3884] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:28:27 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:28:27.778543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aa41414c-2219-4847-892b-ec8cac15e8db tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:27.798346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-aa41414c-2219-4847-892b-ec8cac15e8db tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:27.827648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa41414c-2219-4847-892b-ec8cac15e8db tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:27.829041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa41414c-2219-4847-892b-ec8cac15e8db tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:27.830255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa41414c-2219-4847-892b-ec8cac15e8db tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:27.833360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa41414c-2219-4847-892b-ec8cac15e8db tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:27.837040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa41414c-2219-4847-892b-ec8cac15e8db tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:27.838164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa41414c-2219-4847-892b-ec8cac15e8db tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:27.966480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d380e66c-5d09-4c8f-83df-22c5c24fa1a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:27.992936 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d380e66c-5d09-4c8f-83df-22c5c24fa1a6 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1690 microversion: 2.1 time: 0.610959 Aug 09 17:28:28.005551 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2033/3885] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:27 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1690 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:28.411582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a45519e-b160-4b38-b74b-bcedef6bafe5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:28.413283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a45519e-b160-4b38-b74b-bcedef6bafe5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:28.437846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a45519e-b160-4b38-b74b-bcedef6bafe5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:28.438349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a45519e-b160-4b38-b74b-bcedef6bafe5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:28.438811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a45519e-b160-4b38-b74b-bcedef6bafe5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:28.439578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a45519e-b160-4b38-b74b-bcedef6bafe5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:28.448587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a45519e-b160-4b38-b74b-bcedef6bafe5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:28.449156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a45519e-b160-4b38-b74b-bcedef6bafe5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:28.521834 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a45519e-b160-4b38-b74b-bcedef6bafe5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/ips" status: 200 len: 150 microversion: 2.1 time: 0.513840 Aug 09 17:28:28.545826 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2034/3886] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:28:28 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/ips => generated 150 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:28.560594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-107897e7-1bef-4eab-bcc5-0feac989a6c4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:28.563290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-107897e7-1bef-4eab-bcc5-0feac989a6c4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:28.581723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-107897e7-1bef-4eab-bcc5-0feac989a6c4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:28.584305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-107897e7-1bef-4eab-bcc5-0feac989a6c4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:28.585388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-107897e7-1bef-4eab-bcc5-0feac989a6c4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:28.586805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-107897e7-1bef-4eab-bcc5-0feac989a6c4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:28.587866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-107897e7-1bef-4eab-bcc5-0feac989a6c4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:28.588902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-107897e7-1bef-4eab-bcc5-0feac989a6c4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:28.937863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-aa41414c-2219-4847-892b-ec8cac15e8db tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:28.944111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:28.977657 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aa41414c-2219-4847-892b-ec8cac15e8db tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 1.230490 Aug 09 17:28:28.982160 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1853/3887] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:27 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:29.001268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9c867325-2524-46b6-b3a3-563f697dffe7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:29.010894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9c867325-2524-46b6-b3a3-563f697dffe7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:29.044113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c867325-2524-46b6-b3a3-563f697dffe7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:29.045797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c867325-2524-46b6-b3a3-563f697dffe7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:29.046859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c867325-2524-46b6-b3a3-563f697dffe7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:29.051098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c867325-2524-46b6-b3a3-563f697dffe7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:29.052920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c867325-2524-46b6-b3a3-563f697dffe7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:29.057060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c867325-2524-46b6-b3a3-563f697dffe7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:29.284843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-107897e7-1bef-4eab-bcc5-0feac989a6c4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:29.299221 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-107897e7-1bef-4eab-bcc5-0feac989a6c4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1500 microversion: 2.1 time: 0.749894 Aug 09 17:28:29.301181 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2035/3888] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:28 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1500 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:29.326108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c37938b2-a75d-4ee1-9e94-48440526f610 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:29.327477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c37938b2-a75d-4ee1-9e94-48440526f610 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:29.345772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c37938b2-a75d-4ee1-9e94-48440526f610 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:29.346394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c37938b2-a75d-4ee1-9e94-48440526f610 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:29.346967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c37938b2-a75d-4ee1-9e94-48440526f610 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:29.348056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c37938b2-a75d-4ee1-9e94-48440526f610 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:29.348549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c37938b2-a75d-4ee1-9e94-48440526f610 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:29.348985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c37938b2-a75d-4ee1-9e94-48440526f610 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:29.802937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c37938b2-a75d-4ee1-9e94-48440526f610 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:29.850850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9c867325-2524-46b6-b3a3-563f697dffe7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:29.865214 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c37938b2-a75d-4ee1-9e94-48440526f610 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1690 microversion: 2.1 time: 0.539460 Aug 09 17:28:29.867612 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9c867325-2524-46b6-b3a3-563f697dffe7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.883681 Aug 09 17:28:29.868888 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1854/3889] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:28 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:29.883441 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2036/3890] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:29 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1690 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:29.884354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1076c9a0-d782-456e-a0cb-9e82a51de7e3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:29.893160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1076c9a0-d782-456e-a0cb-9e82a51de7e3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:29.920065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1076c9a0-d782-456e-a0cb-9e82a51de7e3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:29.921568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1076c9a0-d782-456e-a0cb-9e82a51de7e3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:29.923721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1076c9a0-d782-456e-a0cb-9e82a51de7e3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:29.925359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1076c9a0-d782-456e-a0cb-9e82a51de7e3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:29.926468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1076c9a0-d782-456e-a0cb-9e82a51de7e3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:29.928839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1076c9a0-d782-456e-a0cb-9e82a51de7e3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:30.021619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-46505bcb-892b-4518-b83d-847c7d913926 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:30.025302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-1076c9a0-d782-456e-a0cb-9e82a51de7e3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lazy-loading 'flavor' on Instance uuid d7acc97e-cd9f-4de6-afc7-734fb25d253e {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:28:30.027568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-46505bcb-892b-4518-b83d-847c7d913926 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:30.061236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46505bcb-892b-4518-b83d-847c7d913926 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:30.062484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46505bcb-892b-4518-b83d-847c7d913926 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:30.063534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46505bcb-892b-4518-b83d-847c7d913926 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:30.065146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46505bcb-892b-4518-b83d-847c7d913926 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:30.066181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46505bcb-892b-4518-b83d-847c7d913926 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:30.067123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46505bcb-892b-4518-b83d-847c7d913926 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:30.303153 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1076c9a0-d782-456e-a0cb-9e82a51de7e3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "POST /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e/action" status: 200 len: 32 microversion: 2.1 time: 0.432052 Aug 09 17:28:30.317554 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1855/3891] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:29 2022] POST /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e/action => generated 32 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:28:30.363273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bfd448ef-40b0-49e5-99e5-773214dffe77 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:30.370370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bfd448ef-40b0-49e5-99e5-773214dffe77 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:30.408363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd448ef-40b0-49e5-99e5-773214dffe77 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:30.409768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd448ef-40b0-49e5-99e5-773214dffe77 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:30.412606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd448ef-40b0-49e5-99e5-773214dffe77 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:30.426171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd448ef-40b0-49e5-99e5-773214dffe77 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:30.433766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd448ef-40b0-49e5-99e5-773214dffe77 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:30.438141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfd448ef-40b0-49e5-99e5-773214dffe77 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:31.479837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bfd448ef-40b0-49e5-99e5-773214dffe77 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:31.548844 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bfd448ef-40b0-49e5-99e5-773214dffe77 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 1.217167 Aug 09 17:28:31.585374 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1856/3892] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:30 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:31.625602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9c3db74a-b3df-4ace-b3c9-3e2760c7d066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:31.627455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9c3db74a-b3df-4ace-b3c9-3e2760c7d066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:31.642791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c3db74a-b3df-4ace-b3c9-3e2760c7d066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:31.644832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c3db74a-b3df-4ace-b3c9-3e2760c7d066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:31.647487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c3db74a-b3df-4ace-b3c9-3e2760c7d066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:31.649312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c3db74a-b3df-4ace-b3c9-3e2760c7d066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:31.650491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c3db74a-b3df-4ace-b3c9-3e2760c7d066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:31.651814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c3db74a-b3df-4ace-b3c9-3e2760c7d066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:31.931261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-46505bcb-892b-4518-b83d-847c7d913926 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:31.961615 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-46505bcb-892b-4518-b83d-847c7d913926 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 1.947090 Aug 09 17:28:32.007391 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2037/3893] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:30 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:32.018803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d31efea-a09d-4c97-a917-134e79d1913b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:32.029137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0d31efea-a09d-4c97-a917-134e79d1913b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:32.056438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d31efea-a09d-4c97-a917-134e79d1913b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:32.057623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d31efea-a09d-4c97-a917-134e79d1913b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:32.058654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d31efea-a09d-4c97-a917-134e79d1913b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:32.064142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d31efea-a09d-4c97-a917-134e79d1913b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:32.065659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d31efea-a09d-4c97-a917-134e79d1913b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:32.074287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d31efea-a09d-4c97-a917-134e79d1913b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:32.874477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0d31efea-a09d-4c97-a917-134e79d1913b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:32.902274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0d31efea-a09d-4c97-a917-134e79d1913b tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1690 microversion: 2.1 time: 0.892474 Aug 09 17:28:32.914120 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2038/3894] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:32 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1690 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:32.944771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b2aab25c-f1de-4f1a-b7bb-f5c7819647ef req-2ef7af72-4f97-44dc-bf32-1337f9841903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af26977-0da1-475d-b754-4460e79e4fc3", "name": "network-vif-plugged", "status": "completed", "tag": "81270b4a-19dd-474c-8c8e-456472b48c81"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:32.994209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b2aab25c-f1de-4f1a-b7bb-f5c7819647ef req-2ef7af72-4f97-44dc-bf32-1337f9841903 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:33.000808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b2aab25c-f1de-4f1a-b7bb-f5c7819647ef req-2ef7af72-4f97-44dc-bf32-1337f9841903 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:33.004255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b2aab25c-f1de-4f1a-b7bb-f5c7819647ef req-2ef7af72-4f97-44dc-bf32-1337f9841903 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:33.069942 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b2aab25c-f1de-4f1a-b7bb-f5c7819647ef req-2ef7af72-4f97-44dc-bf32-1337f9841903 service nova] Creating event network-vif-plugged:81270b4a-19dd-474c-8c8e-456472b48c81 for instance 9af26977-0da1-475d-b754-4460e79e4fc3 on n-h2-845781-6 Aug 09 17:28:33.091050 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b2aab25c-f1de-4f1a-b7bb-f5c7819647ef req-2ef7af72-4f97-44dc-bf32-1337f9841903 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164679 Aug 09 17:28:33.092359 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2039/3895] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:33.098751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-15cb42ca-33c8-495e-abae-2f6f09554941 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:33.100639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-15cb42ca-33c8-495e-abae-2f6f09554941 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:33.109219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15cb42ca-33c8-495e-abae-2f6f09554941 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:33.110176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15cb42ca-33c8-495e-abae-2f6f09554941 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:33.110875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15cb42ca-33c8-495e-abae-2f6f09554941 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:33.111926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15cb42ca-33c8-495e-abae-2f6f09554941 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:33.112802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15cb42ca-33c8-495e-abae-2f6f09554941 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:33.113482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15cb42ca-33c8-495e-abae-2f6f09554941 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:33.643664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9c3db74a-b3df-4ace-b3c9-3e2760c7d066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:33.658631 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9c3db74a-b3df-4ace-b3c9-3e2760c7d066 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 2.070888 Aug 09 17:28:33.673685 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1857/3896] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:31 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:33.729527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-03b7f294-ea98-41a6-99dd-f0c1896593c4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:33.734731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-03b7f294-ea98-41a6-99dd-f0c1896593c4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:33.758744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b7f294-ea98-41a6-99dd-f0c1896593c4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:33.761171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b7f294-ea98-41a6-99dd-f0c1896593c4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:33.763342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b7f294-ea98-41a6-99dd-f0c1896593c4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:33.765830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b7f294-ea98-41a6-99dd-f0c1896593c4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:33.766916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b7f294-ea98-41a6-99dd-f0c1896593c4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:33.768307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03b7f294-ea98-41a6-99dd-f0c1896593c4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:34.276506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-15cb42ca-33c8-495e-abae-2f6f09554941 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:34.331546 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-15cb42ca-33c8-495e-abae-2f6f09554941 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 1.231956 Aug 09 17:28:34.361521 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2040/3897] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:33 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:34.373607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e441c525-0758-4d56-950d-728dd76f2ae1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b824b0f5-8c8c-4573-9ba0-088aa92a1640"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:34.379039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e441c525-0758-4d56-950d-728dd76f2ae1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:34.393386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e441c525-0758-4d56-950d-728dd76f2ae1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:34.395076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e441c525-0758-4d56-950d-728dd76f2ae1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:34.396260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e441c525-0758-4d56-950d-728dd76f2ae1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:34.398518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e441c525-0758-4d56-950d-728dd76f2ae1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:34.399685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e441c525-0758-4d56-950d-728dd76f2ae1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:34.400787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e441c525-0758-4d56-950d-728dd76f2ae1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:34.440860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:34.708798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-03b7f294-ea98-41a6-99dd-f0c1896593c4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:34.750389 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-03b7f294-ea98-41a6-99dd-f0c1896593c4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 1.074690 Aug 09 17:28:34.751502 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1858/3898] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:33 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:34.785559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c95358f2-f769-4a93-b8fd-24345589bfd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:34.787402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c95358f2-f769-4a93-b8fd-24345589bfd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:34.801150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c95358f2-f769-4a93-b8fd-24345589bfd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:34.803351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c95358f2-f769-4a93-b8fd-24345589bfd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:34.804526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c95358f2-f769-4a93-b8fd-24345589bfd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:34.806091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c95358f2-f769-4a93-b8fd-24345589bfd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:34.807150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c95358f2-f769-4a93-b8fd-24345589bfd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:34.808264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c95358f2-f769-4a93-b8fd-24345589bfd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:35.058202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c95358f2-f769-4a93-b8fd-24345589bfd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:35.072149 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c95358f2-f769-4a93-b8fd-24345589bfd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1622 microversion: 2.1 time: 0.290244 Aug 09 17:28:35.074741 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1859/3899] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:34 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1622 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:35.084632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1c7c4821-3c31-4b6f-b97b-aaf5da4a41e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:35.088610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1c7c4821-3c31-4b6f-b97b-aaf5da4a41e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:35.107424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c4821-3c31-4b6f-b97b-aaf5da4a41e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:35.120365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c4821-3c31-4b6f-b97b-aaf5da4a41e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:35.120855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c4821-3c31-4b6f-b97b-aaf5da4a41e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:35.121640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c4821-3c31-4b6f-b97b-aaf5da4a41e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:35.122120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c4821-3c31-4b6f-b97b-aaf5da4a41e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:35.122828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c7c4821-3c31-4b6f-b97b-aaf5da4a41e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:35.191417 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e441c525-0758-4d56-950d-728dd76f2ae1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818071 Aug 09 17:28:35.193427 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2041/3900] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:28:34 2022] POST /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 194 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:35.221845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5cef66be-3cec-448b-9504-e6125fca4262 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:35.224105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5cef66be-3cec-448b-9504-e6125fca4262 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:35.262490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cef66be-3cec-448b-9504-e6125fca4262 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:35.265597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cef66be-3cec-448b-9504-e6125fca4262 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:35.270425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cef66be-3cec-448b-9504-e6125fca4262 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:35.272152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cef66be-3cec-448b-9504-e6125fca4262 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:35.275706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cef66be-3cec-448b-9504-e6125fca4262 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:35.279356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cef66be-3cec-448b-9504-e6125fca4262 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:35.756258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1c7c4821-3c31-4b6f-b97b-aaf5da4a41e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:35.789009 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1c7c4821-3c31-4b6f-b97b-aaf5da4a41e5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.708559 Aug 09 17:28:35.798461 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1860/3901] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:35 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:35.866973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-62597a0d-dec5-4ecc-93f6-8a7c9d88d8f3 req-2151594f-7ebf-4283-8b4b-32f8f4afd4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19aec690-8061-4bc1-9094-114cf9ecd9a0", "tag": "a2687548-41ba-453b-8009-ddf9b7632a3c"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:35.963734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-62597a0d-dec5-4ecc-93f6-8a7c9d88d8f3 req-2151594f-7ebf-4283-8b4b-32f8f4afd4bc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:35.969427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-62597a0d-dec5-4ecc-93f6-8a7c9d88d8f3 req-2151594f-7ebf-4283-8b4b-32f8f4afd4bc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:35.973461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-62597a0d-dec5-4ecc-93f6-8a7c9d88d8f3 req-2151594f-7ebf-4283-8b4b-32f8f4afd4bc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:35.987957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5cef66be-3cec-448b-9504-e6125fca4262 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:36.027261 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5cef66be-3cec-448b-9504-e6125fca4262 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1574 microversion: 2.1 time: 0.824879 Aug 09 17:28:36.057722 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2042/3902] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:35 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1574 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:36.069358 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-62597a0d-dec5-4ecc-93f6-8a7c9d88d8f3 req-2151594f-7ebf-4283-8b4b-32f8f4afd4bc service nova] Creating event network-changed:a2687548-41ba-453b-8009-ddf9b7632a3c for instance 19aec690-8061-4bc1-9094-114cf9ecd9a0 on n-h1-845781-6 Aug 09 17:28:36.073466 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-62597a0d-dec5-4ecc-93f6-8a7c9d88d8f3 req-2151594f-7ebf-4283-8b4b-32f8f4afd4bc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272771 Aug 09 17:28:36.074942 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1861/3903] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:36.086389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ed5b707c-93d2-47a6-be4b-b698e0b609c4 req-4366cc11-2813-4068-8db1-884809e0c1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b4377c-cf52-4f83-8923-b86f8bdfff08", "name": "network-vif-unplugged", "status": "completed", "tag": "a797759a-bc26-46ce-954a-7c9861e667d9"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:36.100488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7db1c15a-e80b-4553-bfb0-038aa9c8c65d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:36.102462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7db1c15a-e80b-4553-bfb0-038aa9c8c65d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:36.115007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ed5b707c-93d2-47a6-be4b-b698e0b609c4 req-4366cc11-2813-4068-8db1-884809e0c1f9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:36.116268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ed5b707c-93d2-47a6-be4b-b698e0b609c4 req-4366cc11-2813-4068-8db1-884809e0c1f9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:36.117294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ed5b707c-93d2-47a6-be4b-b698e0b609c4 req-4366cc11-2813-4068-8db1-884809e0c1f9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:36.120946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7db1c15a-e80b-4553-bfb0-038aa9c8c65d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:36.121922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7db1c15a-e80b-4553-bfb0-038aa9c8c65d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:36.132749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7db1c15a-e80b-4553-bfb0-038aa9c8c65d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:36.133780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7db1c15a-e80b-4553-bfb0-038aa9c8c65d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:36.134358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7db1c15a-e80b-4553-bfb0-038aa9c8c65d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:36.134895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7db1c15a-e80b-4553-bfb0-038aa9c8c65d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:36.187990 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ed5b707c-93d2-47a6-be4b-b698e0b609c4 req-4366cc11-2813-4068-8db1-884809e0c1f9 service nova] Creating event network-vif-unplugged:a797759a-bc26-46ce-954a-7c9861e667d9 for instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 on n-h2-845781-6 Aug 09 17:28:36.210148 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ed5b707c-93d2-47a6-be4b-b698e0b609c4 req-4366cc11-2813-4068-8db1-884809e0c1f9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135678 Aug 09 17:28:36.216157 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2043/3904] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:36.242581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-539a90e9-3d2b-4ba2-aed5-bdc3d6eccde5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:36.244195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-539a90e9-3d2b-4ba2-aed5-bdc3d6eccde5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:36.275976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539a90e9-3d2b-4ba2-aed5-bdc3d6eccde5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:36.276871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539a90e9-3d2b-4ba2-aed5-bdc3d6eccde5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:36.283003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539a90e9-3d2b-4ba2-aed5-bdc3d6eccde5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:36.284884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539a90e9-3d2b-4ba2-aed5-bdc3d6eccde5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:36.285768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539a90e9-3d2b-4ba2-aed5-bdc3d6eccde5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:36.286560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539a90e9-3d2b-4ba2-aed5-bdc3d6eccde5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:36.826811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7db1c15a-e80b-4553-bfb0-038aa9c8c65d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:36.836257 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7db1c15a-e80b-4553-bfb0-038aa9c8c65d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.758974 Aug 09 17:28:36.847757 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1862/3905] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:36 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:37.130399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3f58db7e-4eb2-4c52-a7bf-9b5d5dc6a22e tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] Action: 'create', calling method: .version_select at 0x7fbbca604670>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:37.177119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-3f58db7e-4eb2-4c52-a7bf-9b5d5dc6a22e tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] Getting quotas for project d7222a9ac0e744b1a4cd1cc1f56dc432. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:28:37.214939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-3f58db7e-4eb2-4c52-a7bf-9b5d5dc6a22e tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] Getting quotas for user 6901ce7f8a034555a1bc5406603e7363 and project d7222a9ac0e744b1a4cd1cc1f56dc432. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:28:37.285387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-539a90e9-3d2b-4ba2-aed5-bdc3d6eccde5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:37.329429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-3f58db7e-4eb2-4c52-a7bf-9b5d5dc6a22e tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] Getting quotas for project d7222a9ac0e744b1a4cd1cc1f56dc432. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:28:37.334901 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-539a90e9-3d2b-4ba2-aed5-bdc3d6eccde5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 1.113164 Aug 09 17:28:37.346803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-3f58db7e-4eb2-4c52-a7bf-9b5d5dc6a22e tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] Getting quotas for user 6901ce7f8a034555a1bc5406603e7363 and project d7222a9ac0e744b1a4cd1cc1f56dc432. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:28:37.348185 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2044/3906] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:36 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:37.375129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:37.378201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:37.381651 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3f58db7e-4eb2-4c52-a7bf-9b5d5dc6a22e tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.532369 Aug 09 17:28:37.385001 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1863/3907] 10.222.0.93 () {62 vars in 1214 bytes} [Tue Aug 9 17:28:36 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:28:37.400284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-190621a3-42a5-46aa-80ab-50347af41638 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:37.402193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-190621a3-42a5-46aa-80ab-50347af41638 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:37.419999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190621a3-42a5-46aa-80ab-50347af41638 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:37.422305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190621a3-42a5-46aa-80ab-50347af41638 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:37.427645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190621a3-42a5-46aa-80ab-50347af41638 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:37.429296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190621a3-42a5-46aa-80ab-50347af41638 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:37.430189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190621a3-42a5-46aa-80ab-50347af41638 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:37.431067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190621a3-42a5-46aa-80ab-50347af41638 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:37.431603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:37.434980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:37.437976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:37.443676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:37.444688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:37.445494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:37.656871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:37.660263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:37.667144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:37.675141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lazy-loading 'fault' on Instance uuid 91b4377c-cf52-4f83-8923-b86f8bdfff08 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:28:38.005863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-190621a3-42a5-46aa-80ab-50347af41638 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:38.036362 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-190621a3-42a5-46aa-80ab-50347af41638 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1517 microversion: 2.1 time: 0.649299 Aug 09 17:28:38.039740 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1864/3908] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:37 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1517 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:38.048365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a0704e73-b590-4231-af9f-da18b23f9973 tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:38.066554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:38.112766 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b9276c48-4a03-4560-9305-f88ed64764ea tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 200 len: 1336 microversion: 2.1 time: 0.758974 Aug 09 17:28:38.136515 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a0704e73-b590-4231-af9f-da18b23f9973 tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.089005 Aug 09 17:28:38.137066 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2045/3909] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:37 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 1336 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:38.149372 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1865/3910] 10.222.0.93 () {60 vars in 1193 bytes} [Tue Aug 9 17:28:38 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:28:38.159670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-82c001ec-404d-46b5-9b26-b6d87a32c1d7 req-d22dbd86-272a-4f49-b168-89788f5433cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b4377c-cf52-4f83-8923-b86f8bdfff08", "name": "network-vif-deleted", "tag": "a797759a-bc26-46ce-954a-7c9861e667d9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:38.179470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6d74fa53-c742-41ca-a140-f5f4842152d5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:38.193688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6d74fa53-c742-41ca-a140-f5f4842152d5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:38.199469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-82c001ec-404d-46b5-9b26-b6d87a32c1d7 req-d22dbd86-272a-4f49-b168-89788f5433cd service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:38.204073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-82c001ec-404d-46b5-9b26-b6d87a32c1d7 req-d22dbd86-272a-4f49-b168-89788f5433cd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:38.205071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-82c001ec-404d-46b5-9b26-b6d87a32c1d7 req-d22dbd86-272a-4f49-b168-89788f5433cd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:38.236567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d74fa53-c742-41ca-a140-f5f4842152d5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:38.240317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d74fa53-c742-41ca-a140-f5f4842152d5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:38.242310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d74fa53-c742-41ca-a140-f5f4842152d5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:38.243507 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-82c001ec-404d-46b5-9b26-b6d87a32c1d7 req-d22dbd86-272a-4f49-b168-89788f5433cd service nova] Creating event network-vif-deleted:a797759a-bc26-46ce-954a-7c9861e667d9 for instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 on n-h2-845781-6 Aug 09 17:28:38.251007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d74fa53-c742-41ca-a140-f5f4842152d5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:38.253429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d74fa53-c742-41ca-a140-f5f4842152d5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:38.256134 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-82c001ec-404d-46b5-9b26-b6d87a32c1d7 req-d22dbd86-272a-4f49-b168-89788f5433cd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105676 Aug 09 17:28:38.258462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d74fa53-c742-41ca-a140-f5f4842152d5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:38.265916 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1866/3911] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:38.293731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-522d1da4-b40b-4688-aa67-3d00337b04a0 tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:38.330436 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-522d1da4-b40b-4688-aa67-3d00337b04a0 tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/9c22bbcb-cf59-4ed9-aed5-ac00014f138f" status: 200 len: 235 microversion: 2.64 time: 0.062507 Aug 09 17:28:38.336774 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1867/3912] 10.222.0.93 () {60 vars in 1304 bytes} [Tue Aug 9 17:28:38 2022] GET /compute/v2.1/os-server-groups/9c22bbcb-cf59-4ed9-aed5-ac00014f138f => generated 235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:28:38.359031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72fc1b1f-be69-40cf-9f42-357ea3030f26 tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:38.467523 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72fc1b1f-be69-40cf-9f42-357ea3030f26 tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/9c22bbcb-cf59-4ed9-aed5-ac00014f138f" status: 204 len: 0 microversion: 2.64 time: 0.120483 Aug 09 17:28:38.479296 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1868/3913] 10.222.0.93 () {60 vars in 1307 bytes} [Tue Aug 9 17:28:38 2022] DELETE /compute/v2.1/os-server-groups/9c22bbcb-cf59-4ed9-aed5-ac00014f138f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:28:38.493112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9efabca8-5045-4ad7-b028-e92a80dce83e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:38.494298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9efabca8-5045-4ad7-b028-e92a80dce83e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:38.514751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9efabca8-5045-4ad7-b028-e92a80dce83e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:38.515868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9efabca8-5045-4ad7-b028-e92a80dce83e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:38.516903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9efabca8-5045-4ad7-b028-e92a80dce83e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:38.518297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9efabca8-5045-4ad7-b028-e92a80dce83e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:38.519603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9efabca8-5045-4ad7-b028-e92a80dce83e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:38.523766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9efabca8-5045-4ad7-b028-e92a80dce83e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:38.959010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9efabca8-5045-4ad7-b028-e92a80dce83e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:38.985948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6d74fa53-c742-41ca-a140-f5f4842152d5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:39.025975 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9efabca8-5045-4ad7-b028-e92a80dce83e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 0.539798 Aug 09 17:28:39.032095 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1869/3914] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:38 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:39.047420 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6d74fa53-c742-41ca-a140-f5f4842152d5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.907053 Aug 09 17:28:39.078727 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2046/3915] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:38 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:39.090350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba30b613-fb81-439b-b7ce-0bcab840b928 tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:39.097859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6a9584d1-2270-4e9f-8775-de1f4e71354d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:39.099280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6a9584d1-2270-4e9f-8775-de1f4e71354d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:39.118677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a9584d1-2270-4e9f-8775-de1f4e71354d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:39.121218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a9584d1-2270-4e9f-8775-de1f4e71354d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:39.122297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a9584d1-2270-4e9f-8775-de1f4e71354d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:39.123850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a9584d1-2270-4e9f-8775-de1f4e71354d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:39.126073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a9584d1-2270-4e9f-8775-de1f4e71354d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:39.129489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a9584d1-2270-4e9f-8775-de1f4e71354d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:39.140007 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ba30b613-fb81-439b-b7ce-0bcab840b928 tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] HTTP exception thrown: Instance group 9c22bbcb-cf59-4ed9-aed5-ac00014f138f could not be found. Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba30b613-fb81-439b-b7ce-0bcab840b928 tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] Request method failure captured: Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-server-groups/9c22bbcb-cf59-4ed9-aed5-ac00014f138f HTTP/1.1 Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8plDoytz-fJrjA9rkzQtoVo8wUS5BZAa0iR1JJk5sZeKNJwvJM6bhrc3nFXyqVVSOPch-gzGXuzxAVpclCfggJsSZX-jeZi-us5_WoTF8d2CGukE2mz-5tLiZPIeqg-hJHr6hCWWntrLZ8J-UgtDy6gzLQ7Cm9LDOMPcbK6yoz3182M Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.64 Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: d7222a9ac0e744b1a4cd1cc1f56dc432 Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerGroup264TestJSON-1795266185 Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d7222a9ac0e744b1a4cd1cc1f56dc432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d7222a9ac0e744b1a4cd1cc1f56dc432"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d7222a9ac0e744b1a4cd1cc1f56dc432"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d7222a9ac0e744b1a4cd1cc1f56dc432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerGroup264TestJSON-1795266185 Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: d7222a9ac0e744b1a4cd1cc1f56dc432 Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1795266185 Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerGroup264TestJSON-1795266185-project Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 6901ce7f8a034555a1bc5406603e7363 Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerGroup264TestJSON-1795266185-project Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance group 9c22bbcb-cf59-4ed9-aed5-ac00014f138f could not be found. Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9c22bbcb-cf59-4ed9-aed5-ac00014f138f'} Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9c22bbcb-cf59-4ed9-aed5-ac00014f138f could not be found. Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9c22bbcb-cf59-4ed9-aed5-ac00014f138f could not be found. Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:39.153362 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:39.161681 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:39.161681 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:39.161681 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:39.161681 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:39.161681 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9c22bbcb-cf59-4ed9-aed5-ac00014f138f could not be found. Aug 09 17:28:39.161681 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:39.163573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba30b613-fb81-439b-b7ce-0bcab840b928 tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] Returning 404 to user: Instance group 9c22bbcb-cf59-4ed9-aed5-ac00014f138f could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:39.167122 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ba30b613-fb81-439b-b7ce-0bcab840b928 tempest-ServerGroup264TestJSON-1795266185 tempest-ServerGroup264TestJSON-1795266185-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/9c22bbcb-cf59-4ed9-aed5-ac00014f138f" status: 404 len: 117 microversion: 2.64 time: 0.128509 Aug 09 17:28:39.172172 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1870/3916] 10.222.0.93 () {60 vars in 1307 bytes} [Tue Aug 9 17:28:39 2022] DELETE /compute/v2.1/os-server-groups/9c22bbcb-cf59-4ed9-aed5-ac00014f138f => generated 117 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:28:39.194209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:39.206110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 91b4377c-cf52-4f83-8923-b86f8bdfff08] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:39.225466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:39.225987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:39.226445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:39.234191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:39.234705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:39.235161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:39.291103 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] HTTP exception thrown: Instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 could not be found. Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Request method failure captured: Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 HTTP/1.1 Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfTXHKJ-127xoXOxvirCkOJ5Ga7oI06dbW5eRmTw3VceZ3fIPtVcpBoJqCQEzgHg892I33A2CZbgdV9GneqCNx7frvCudUtWkW3U62800gIkrYotA0sMKiw2vzfbegwV0AsonNcEy5cWuu85myYoWYiVD7fe2x9mfaYw2xpqmhRsNo Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d20bf24928749afb9b848946419f4f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: a34881c81ae2427fbf2cbb1cd8c4ef52 Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 could not be found. Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '91b4377c-cf52-4f83-8923-b86f8bdfff08'} Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 could not be found. Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 could not be found. Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:39.292883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:39.296520 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:39.296520 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:39.296520 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:39.296520 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:39.296520 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:39.296520 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:39.296520 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 could not be found. Aug 09 17:28:39.296520 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:39.296520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Returning 404 to user: Instance 91b4377c-cf52-4f83-8923-b86f8bdfff08 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:39.296520 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5f98dda2-6973-4639-b702-cb9e57fb9cbe tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08" status: 404 len: 111 microversion: 2.1 time: 0.117409 Aug 09 17:28:39.311346 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1871/3917] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:39 2022] GET /compute/v2.1/servers/91b4377c-cf52-4f83-8923-b86f8bdfff08 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:28:39.325164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-74bf0144-0379-405b-9bb3-172d52b97a13 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '.version_select at 0x7fbbca3c6c10>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:39.420633 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-74bf0144-0379-405b-9bb3-172d52b97a13 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040796941" status: 202 len: 0 microversion: 2.1 time: 0.107262 Aug 09 17:28:39.429727 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1872/3918] 10.222.0.93 () {58 vars in 1221 bytes} [Tue Aug 9 17:28:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040796941 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:28:39.546427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6a9584d1-2270-4e9f-8775-de1f4e71354d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:39.566412 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6a9584d1-2270-4e9f-8775-de1f4e71354d tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.479259 Aug 09 17:28:39.586586 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2047/3919] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:39 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:39.596099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9e560a45-e6d8-42f7-bec7-d32ee5cdfc10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:39.597260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9e560a45-e6d8-42f7-bec7-d32ee5cdfc10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:39.617762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e560a45-e6d8-42f7-bec7-d32ee5cdfc10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:39.618277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e560a45-e6d8-42f7-bec7-d32ee5cdfc10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:39.622642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e560a45-e6d8-42f7-bec7-d32ee5cdfc10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:39.623450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e560a45-e6d8-42f7-bec7-d32ee5cdfc10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:39.626165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e560a45-e6d8-42f7-bec7-d32ee5cdfc10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:39.628358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e560a45-e6d8-42f7-bec7-d32ee5cdfc10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:40.092544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88437258-5722-4609-8838-ed0cb8ad21a6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:40.094060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88437258-5722-4609-8838-ed0cb8ad21a6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:40.123098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88437258-5722-4609-8838-ed0cb8ad21a6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:40.126483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88437258-5722-4609-8838-ed0cb8ad21a6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:40.128784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88437258-5722-4609-8838-ed0cb8ad21a6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:40.132867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88437258-5722-4609-8838-ed0cb8ad21a6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:40.133851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88437258-5722-4609-8838-ed0cb8ad21a6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:40.134465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88437258-5722-4609-8838-ed0cb8ad21a6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:40.378743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9e560a45-e6d8-42f7-bec7-d32ee5cdfc10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:40.398691 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9e560a45-e6d8-42f7-bec7-d32ee5cdfc10 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.810311 Aug 09 17:28:40.408414 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1873/3920] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:39 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:40.442532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-99ef5cd8-c06b-4ba5-ad5e-84ba5b3c29ef tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:40.450046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-99ef5cd8-c06b-4ba5-ad5e-84ba5b3c29ef tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:40.511728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99ef5cd8-c06b-4ba5-ad5e-84ba5b3c29ef tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:40.512871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99ef5cd8-c06b-4ba5-ad5e-84ba5b3c29ef tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:40.513828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99ef5cd8-c06b-4ba5-ad5e-84ba5b3c29ef tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:40.515284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99ef5cd8-c06b-4ba5-ad5e-84ba5b3c29ef tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:40.524564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99ef5cd8-c06b-4ba5-ad5e-84ba5b3c29ef tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:40.531190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99ef5cd8-c06b-4ba5-ad5e-84ba5b3c29ef tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:40.856671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-88437258-5722-4609-8838-ed0cb8ad21a6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:40.904541 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88437258-5722-4609-8838-ed0cb8ad21a6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 0.811630 Aug 09 17:28:40.906334 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2048/3921] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:40 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:40.926369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5cefb33a-8907-4116-b19c-90bcd0ef754c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:40.930341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5cefb33a-8907-4116-b19c-90bcd0ef754c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:40.980910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cefb33a-8907-4116-b19c-90bcd0ef754c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:40.982274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cefb33a-8907-4116-b19c-90bcd0ef754c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:40.983055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cefb33a-8907-4116-b19c-90bcd0ef754c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:40.987560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cefb33a-8907-4116-b19c-90bcd0ef754c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:40.988596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cefb33a-8907-4116-b19c-90bcd0ef754c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:40.989370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cefb33a-8907-4116-b19c-90bcd0ef754c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:41.495964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-99ef5cd8-c06b-4ba5-ad5e-84ba5b3c29ef tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:41.510382 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-99ef5cd8-c06b-4ba5-ad5e-84ba5b3c29ef tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 1.095729 Aug 09 17:28:41.511661 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1874/3922] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:40 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:41.953064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-74be4404-df35-4cbf-8967-5f3fdeb07516 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:41.956528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-74be4404-df35-4cbf-8967-5f3fdeb07516 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:41.974084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74be4404-df35-4cbf-8967-5f3fdeb07516 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:41.978388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74be4404-df35-4cbf-8967-5f3fdeb07516 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:41.979314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74be4404-df35-4cbf-8967-5f3fdeb07516 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:41.981978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74be4404-df35-4cbf-8967-5f3fdeb07516 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:41.982905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74be4404-df35-4cbf-8967-5f3fdeb07516 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:41.983358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74be4404-df35-4cbf-8967-5f3fdeb07516 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:41.988806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5cefb33a-8907-4116-b19c-90bcd0ef754c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:42.014598 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5cefb33a-8907-4116-b19c-90bcd0ef754c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 1.106142 Aug 09 17:28:42.016080 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2049/3923] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:40 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:42.053219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66bfecad-faba-43b2-9a83-5cb52e25688c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:42.073844 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-66bfecad-faba-43b2-9a83-5cb52e25688c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 5d2e075c-af79-4bf3-b3df-de91999fea59 has no mapping to a cell. Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66bfecad-faba-43b2-9a83-5cb52e25688c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/5d2e075c-af79-4bf3-b3df-de91999fea59/action HTTP/1.1 Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 15 Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: {"os-stop": {}} Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 5d2e075c-af79-4bf3-b3df-de91999fea59 has no mapping to a cell. Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '5d2e075c-af79-4bf3-b3df-de91999fea59', 'body': {'os-stop': {}}} Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 5d2e075c-af79-4bf3-b3df-de91999fea59 has no mapping to a cell. Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:28:42.082757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2e075c-af79-4bf3-b3df-de91999fea59 has no mapping to a cell. Aug 09 17:28:42.090312 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:42.090312 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:42.090312 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:42.090312 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:42.090312 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:42.090312 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:42.090312 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:42.090312 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:42.090312 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2e075c-af79-4bf3-b3df-de91999fea59 has no mapping to a cell. Aug 09 17:28:42.090312 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:42.095461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66bfecad-faba-43b2-9a83-5cb52e25688c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 5d2e075c-af79-4bf3-b3df-de91999fea59 has no mapping to a cell. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:42.097612 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66bfecad-faba-43b2-9a83-5cb52e25688c tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/5d2e075c-af79-4bf3-b3df-de91999fea59/action" status: 404 len: 117 microversion: 2.1 time: 0.053282 Aug 09 17:28:42.104263 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2050/3924] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:42 2022] POST /compute/v2.1/servers/5d2e075c-af79-4bf3-b3df-de91999fea59/action => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:28:42.133576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-03c2ef69-962d-4f6e-b3bb-5ea4ef641886 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:42.138492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-03c2ef69-962d-4f6e-b3bb-5ea4ef641886 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:42.164602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03c2ef69-962d-4f6e-b3bb-5ea4ef641886 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:42.165511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03c2ef69-962d-4f6e-b3bb-5ea4ef641886 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:42.168812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03c2ef69-962d-4f6e-b3bb-5ea4ef641886 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:42.170035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03c2ef69-962d-4f6e-b3bb-5ea4ef641886 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:42.171048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03c2ef69-962d-4f6e-b3bb-5ea4ef641886 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:42.173646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03c2ef69-962d-4f6e-b3bb-5ea4ef641886 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:42.335144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-74be4404-df35-4cbf-8967-5f3fdeb07516 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:42.346404 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-74be4404-df35-4cbf-8967-5f3fdeb07516 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 0.401278 Aug 09 17:28:42.352192 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1875/3925] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:41 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:42.558633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2137c0cc-3d55-4788-98aa-3b12f5d099c8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:42.559648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2137c0cc-3d55-4788-98aa-3b12f5d099c8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:42.591787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2137c0cc-3d55-4788-98aa-3b12f5d099c8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:42.592666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2137c0cc-3d55-4788-98aa-3b12f5d099c8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:42.593199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-03c2ef69-962d-4f6e-b3bb-5ea4ef641886 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:42.593560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2137c0cc-3d55-4788-98aa-3b12f5d099c8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:42.604540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2137c0cc-3d55-4788-98aa-3b12f5d099c8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:42.612364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2137c0cc-3d55-4788-98aa-3b12f5d099c8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:42.613268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2137c0cc-3d55-4788-98aa-3b12f5d099c8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:42.622751 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-03c2ef69-962d-4f6e-b3bb-5ea4ef641886 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.511019 Aug 09 17:28:42.624882 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2051/3926] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:42 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:42.664723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9314e510-f7ae-4e1e-9746-efc2094d9d2e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:42.667462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9314e510-f7ae-4e1e-9746-efc2094d9d2e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:42.687353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9314e510-f7ae-4e1e-9746-efc2094d9d2e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:42.688417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9314e510-f7ae-4e1e-9746-efc2094d9d2e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:42.689518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9314e510-f7ae-4e1e-9746-efc2094d9d2e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:42.691031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9314e510-f7ae-4e1e-9746-efc2094d9d2e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:42.692169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9314e510-f7ae-4e1e-9746-efc2094d9d2e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:42.693098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9314e510-f7ae-4e1e-9746-efc2094d9d2e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:42.710566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:43.014264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9314e510-f7ae-4e1e-9746-efc2094d9d2e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:43.049727 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9314e510-f7ae-4e1e-9746-efc2094d9d2e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.394457 Aug 09 17:28:43.053043 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2052/3927] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:42 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:43.092094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-531abbbe-1c32-4ed3-a568-e7334d5377d6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:43.092094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-531abbbe-1c32-4ed3-a568-e7334d5377d6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 844f7a91-d8f6-40d3-8b40-3698ccd00600] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:43.107915 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-531abbbe-1c32-4ed3-a568-e7334d5377d6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 844f7a91-d8f6-40d3-8b40-3698ccd00600 could not be found. Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-531abbbe-1c32-4ed3-a568-e7334d5377d6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/844f7a91-d8f6-40d3-8b40-3698ccd00600/action HTTP/1.1 Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 15 Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: {"suspend": {}} Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 844f7a91-d8f6-40d3-8b40-3698ccd00600 could not be found. Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '844f7a91-d8f6-40d3-8b40-3698ccd00600', 'body': {'suspend': {}}} Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 844f7a91-d8f6-40d3-8b40-3698ccd00600 could not be found. Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 844f7a91-d8f6-40d3-8b40-3698ccd00600 could not be found. Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:43.110258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:43.115114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:43.115114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:43.115114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 844f7a91-d8f6-40d3-8b40-3698ccd00600 could not be found. Aug 09 17:28:43.115114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:43.121091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-531abbbe-1c32-4ed3-a568-e7334d5377d6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 844f7a91-d8f6-40d3-8b40-3698ccd00600 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:43.122272 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-531abbbe-1c32-4ed3-a568-e7334d5377d6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/844f7a91-d8f6-40d3-8b40-3698ccd00600/action" status: 404 len: 111 microversion: 2.1 time: 0.036625 Aug 09 17:28:43.124123 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2053/3928] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:43 2022] POST /compute/v2.1/servers/844f7a91-d8f6-40d3-8b40-3698ccd00600/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:28:43.139268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a7db2cb-1832-4dc6-8486-f8a5df2574c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:43.140370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a7db2cb-1832-4dc6-8486-f8a5df2574c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:43.163190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a7db2cb-1832-4dc6-8486-f8a5df2574c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:43.167367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a7db2cb-1832-4dc6-8486-f8a5df2574c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:43.177242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a7db2cb-1832-4dc6-8486-f8a5df2574c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:43.179297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a7db2cb-1832-4dc6-8486-f8a5df2574c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:43.180047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a7db2cb-1832-4dc6-8486-f8a5df2574c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:43.180714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a7db2cb-1832-4dc6-8486-f8a5df2574c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:43.371435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2137c0cc-3d55-4788-98aa-3b12f5d099c8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:43.413220 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2137c0cc-3d55-4788-98aa-3b12f5d099c8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.859944 Aug 09 17:28:43.430275 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1876/3929] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:42 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:43.450729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a7db2cb-1832-4dc6-8486-f8a5df2574c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:43.466005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a177336a-772f-4a30-85b4-191d645b5c2a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:43.468974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a177336a-772f-4a30-85b4-191d645b5c2a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:43.485820 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a7db2cb-1832-4dc6-8486-f8a5df2574c5 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.354642 Aug 09 17:28:43.486933 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2054/3930] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:43 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:43.543484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2cc38d94-d87d-4879-91d5-8fa7333240c9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:43.550920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a177336a-772f-4a30-85b4-191d645b5c2a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:43.552190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a177336a-772f-4a30-85b4-191d645b5c2a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:43.557055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2cc38d94-d87d-4879-91d5-8fa7333240c9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:43.558508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a177336a-772f-4a30-85b4-191d645b5c2a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:43.560112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a177336a-772f-4a30-85b4-191d645b5c2a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:43.562342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a177336a-772f-4a30-85b4-191d645b5c2a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:43.564872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a177336a-772f-4a30-85b4-191d645b5c2a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:43.603778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cc38d94-d87d-4879-91d5-8fa7333240c9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:43.607331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cc38d94-d87d-4879-91d5-8fa7333240c9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:43.610863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cc38d94-d87d-4879-91d5-8fa7333240c9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:43.614919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cc38d94-d87d-4879-91d5-8fa7333240c9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:43.621159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cc38d94-d87d-4879-91d5-8fa7333240c9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:43.623728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cc38d94-d87d-4879-91d5-8fa7333240c9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:44.068511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2cc38d94-d87d-4879-91d5-8fa7333240c9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:44.085098 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2cc38d94-d87d-4879-91d5-8fa7333240c9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.563006 Aug 09 17:28:44.112617 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2055/3931] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:43 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:44.139277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-71ea8639-4318-4b6f-a9d7-130199297c5c req-1e590e67-301b-4041-b06d-3039402b60e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a30c674-6026-45bd-b50e-218ae7d69382", "name": "network-vif-plugged", "status": "completed", "tag": "a73935e9-c581-4296-b0ba-805a64e85308"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:44.188015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-71ea8639-4318-4b6f-a9d7-130199297c5c req-1e590e67-301b-4041-b06d-3039402b60e3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:44.188919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-71ea8639-4318-4b6f-a9d7-130199297c5c req-1e590e67-301b-4041-b06d-3039402b60e3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:44.189731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-71ea8639-4318-4b6f-a9d7-130199297c5c req-1e590e67-301b-4041-b06d-3039402b60e3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:44.234042 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-71ea8639-4318-4b6f-a9d7-130199297c5c req-1e590e67-301b-4041-b06d-3039402b60e3 service nova] Creating event network-vif-plugged:a73935e9-c581-4296-b0ba-805a64e85308 for instance 1a30c674-6026-45bd-b50e-218ae7d69382 on n-h2-845781-6 Aug 09 17:28:44.257190 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-71ea8639-4318-4b6f-a9d7-130199297c5c req-1e590e67-301b-4041-b06d-3039402b60e3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141578 Aug 09 17:28:44.258205 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2056/3932] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:44.265178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43843209-6b1b-4bfb-80fd-b6935fefe065 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:44.266095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-43843209-6b1b-4bfb-80fd-b6935fefe065 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:44.288415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43843209-6b1b-4bfb-80fd-b6935fefe065 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:44.302160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43843209-6b1b-4bfb-80fd-b6935fefe065 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:44.303191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43843209-6b1b-4bfb-80fd-b6935fefe065 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:44.312303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43843209-6b1b-4bfb-80fd-b6935fefe065 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:44.313544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43843209-6b1b-4bfb-80fd-b6935fefe065 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:44.314619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43843209-6b1b-4bfb-80fd-b6935fefe065 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:44.440439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-43843209-6b1b-4bfb-80fd-b6935fefe065 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lazy-loading 'flavor' on Instance uuid 9af26977-0da1-475d-b754-4460e79e4fc3 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:28:44.598412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a177336a-772f-4a30-85b4-191d645b5c2a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:44.620674 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a177336a-772f-4a30-85b4-191d645b5c2a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 1.174591 Aug 09 17:28:44.631689 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1877/3933] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:43 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:44.636234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b4d22753-74ec-405c-85b8-0d46c7010dd2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:44.637862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b4d22753-74ec-405c-85b8-0d46c7010dd2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:44.648259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:44.654290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4d22753-74ec-405c-85b8-0d46c7010dd2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:44.656601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4d22753-74ec-405c-85b8-0d46c7010dd2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:44.658024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4d22753-74ec-405c-85b8-0d46c7010dd2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:44.659868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4d22753-74ec-405c-85b8-0d46c7010dd2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:44.661145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4d22753-74ec-405c-85b8-0d46c7010dd2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:44.663211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4d22753-74ec-405c-85b8-0d46c7010dd2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:44.734433 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43843209-6b1b-4bfb-80fd-b6935fefe065 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 202 len: 0 microversion: 2.1 time: 0.471114 Aug 09 17:28:44.744779 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2057/3934] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:44 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:28:44.754609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b14346d5-d428-4c0f-96bb-fbe764fe9f3a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:44.768106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b14346d5-d428-4c0f-96bb-fbe764fe9f3a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:44.798823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14346d5-d428-4c0f-96bb-fbe764fe9f3a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:44.799448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14346d5-d428-4c0f-96bb-fbe764fe9f3a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:44.804168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14346d5-d428-4c0f-96bb-fbe764fe9f3a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:44.806665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14346d5-d428-4c0f-96bb-fbe764fe9f3a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:44.819412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14346d5-d428-4c0f-96bb-fbe764fe9f3a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:44.820561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b14346d5-d428-4c0f-96bb-fbe764fe9f3a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:44.856829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:45.219555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b14346d5-d428-4c0f-96bb-fbe764fe9f3a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:45.272431 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b14346d5-d428-4c0f-96bb-fbe764fe9f3a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1512 microversion: 2.1 time: 0.520465 Aug 09 17:28:45.274368 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2058/3935] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:44 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1512 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:45.564942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b4d22753-74ec-405c-85b8-0d46c7010dd2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:45.576930 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b4d22753-74ec-405c-85b8-0d46c7010dd2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.952608 Aug 09 17:28:45.577930 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1878/3936] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:44 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:45.668777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-52ad51db-3d98-4483-8afe-a2125d3f37eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:45.669988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-52ad51db-3d98-4483-8afe-a2125d3f37eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:45.699097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52ad51db-3d98-4483-8afe-a2125d3f37eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:45.700033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52ad51db-3d98-4483-8afe-a2125d3f37eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:45.700790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52ad51db-3d98-4483-8afe-a2125d3f37eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:45.702041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52ad51db-3d98-4483-8afe-a2125d3f37eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:45.702970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52ad51db-3d98-4483-8afe-a2125d3f37eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:45.703997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52ad51db-3d98-4483-8afe-a2125d3f37eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:45.969735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-52ad51db-3d98-4483-8afe-a2125d3f37eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:45.979020 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-52ad51db-3d98-4483-8afe-a2125d3f37eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1364 microversion: 2.1 time: 0.318334 Aug 09 17:28:45.979667 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2059/3937] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:45 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1364 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:46.312706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-71d258cc-20d8-4ba3-825f-11783a67f340 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:46.317541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-71d258cc-20d8-4ba3-825f-11783a67f340 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:46.344306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-71d258cc-20d8-4ba3-825f-11783a67f340 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:46.344528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-71d258cc-20d8-4ba3-825f-11783a67f340 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:46.345289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-71d258cc-20d8-4ba3-825f-11783a67f340 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:46.346645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-71d258cc-20d8-4ba3-825f-11783a67f340 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:46.347520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-71d258cc-20d8-4ba3-825f-11783a67f340 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:46.376420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-71d258cc-20d8-4ba3-825f-11783a67f340 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:46.613824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd39a1df-67c0-4c91-8bad-cffefa50d42b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:46.629567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd39a1df-67c0-4c91-8bad-cffefa50d42b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:46.680361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd39a1df-67c0-4c91-8bad-cffefa50d42b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:46.684561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd39a1df-67c0-4c91-8bad-cffefa50d42b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:46.688230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd39a1df-67c0-4c91-8bad-cffefa50d42b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:46.692165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd39a1df-67c0-4c91-8bad-cffefa50d42b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:46.694109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd39a1df-67c0-4c91-8bad-cffefa50d42b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:46.696684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd39a1df-67c0-4c91-8bad-cffefa50d42b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:46.921187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-71d258cc-20d8-4ba3-825f-11783a67f340 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:46.952012 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-71d258cc-20d8-4ba3-825f-11783a67f340 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1495 microversion: 2.1 time: 0.640663 Aug 09 17:28:46.961102 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1879/3938] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:46 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1495 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:46.989158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:46.992650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:47.021542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:47.025417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:47.026652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:47.029244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:47.030514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:47.031519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:47.137491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lazy-loading 'flavor' on Instance uuid 9af26977-0da1-475d-b754-4460e79e4fc3 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:28:47.154856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd39a1df-67c0-4c91-8bad-cffefa50d42b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:47.170902 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd39a1df-67c0-4c91-8bad-cffefa50d42b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.569857 Aug 09 17:28:47.171516 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2060/3939] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:46 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:47.192200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19f474c5-5a9c-4191-b2ac-aa0d66a0fe1d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:47.193064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19f474c5-5a9c-4191-b2ac-aa0d66a0fe1d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:47.200407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f474c5-5a9c-4191-b2ac-aa0d66a0fe1d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:47.201241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f474c5-5a9c-4191-b2ac-aa0d66a0fe1d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:47.201893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f474c5-5a9c-4191-b2ac-aa0d66a0fe1d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:47.204513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f474c5-5a9c-4191-b2ac-aa0d66a0fe1d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:47.204513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f474c5-5a9c-4191-b2ac-aa0d66a0fe1d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:47.204513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f474c5-5a9c-4191-b2ac-aa0d66a0fe1d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:47.225655 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Cannot 'suspend' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state suspended Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action HTTP/1.1 Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 15 Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: {"suspend": {}} Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: exception: Cannot 'suspend' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state suspended Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9af26977-0da1-475d-b754-4460e79e4fc3', 'body': {'suspend': {}}} Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 09 17:28:47.235295 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state suspended Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state suspended Aug 09 17:28:47.239461 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:47.244130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 409 to user: Cannot 'suspend' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state suspended {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:47.247402 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-019b8ee9-dff0-46d3-a6e5-3f28c1b3c12a tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 409 len: 148 microversion: 2.1 time: 0.275695 Aug 09 17:28:47.250771 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1880/3940] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:46 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 148 bytes in 280 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:28:47.270192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e93bed35-8888-403c-9c44-36e0964293fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:47.271041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e93bed35-8888-403c-9c44-36e0964293fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:47.297156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e93bed35-8888-403c-9c44-36e0964293fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:47.297678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e93bed35-8888-403c-9c44-36e0964293fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:47.304321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e93bed35-8888-403c-9c44-36e0964293fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:47.309348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e93bed35-8888-403c-9c44-36e0964293fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:47.310956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e93bed35-8888-403c-9c44-36e0964293fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:47.312862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e93bed35-8888-403c-9c44-36e0964293fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:47.391293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:47.597082 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e93bed35-8888-403c-9c44-36e0964293fd tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 202 len: 0 microversion: 2.1 time: 0.340492 Aug 09 17:28:47.599551 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1881/3941] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:47 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:28:47.611563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-93581099-c359-481b-b676-bbf222e704a9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:47.612809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-93581099-c359-481b-b676-bbf222e704a9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:47.625015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93581099-c359-481b-b676-bbf222e704a9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:47.625983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93581099-c359-481b-b676-bbf222e704a9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:47.626795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93581099-c359-481b-b676-bbf222e704a9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:47.627787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93581099-c359-481b-b676-bbf222e704a9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:47.628592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93581099-c359-481b-b676-bbf222e704a9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:47.629267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93581099-c359-481b-b676-bbf222e704a9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:47.803572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-19f474c5-5a9c-4191-b2ac-aa0d66a0fe1d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:47.855019 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19f474c5-5a9c-4191-b2ac-aa0d66a0fe1d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1551 microversion: 2.1 time: 0.681662 Aug 09 17:28:47.856128 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2061/3942] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:47 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1551 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:47.889347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f69555e4-8c42-47d5-a446-5ec30c5b0083 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:47.897553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f69555e4-8c42-47d5-a446-5ec30c5b0083 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:47.921486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f69555e4-8c42-47d5-a446-5ec30c5b0083 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:47.922380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f69555e4-8c42-47d5-a446-5ec30c5b0083 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:47.923413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f69555e4-8c42-47d5-a446-5ec30c5b0083 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:47.939359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f69555e4-8c42-47d5-a446-5ec30c5b0083 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:47.940532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f69555e4-8c42-47d5-a446-5ec30c5b0083 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:47.941357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f69555e4-8c42-47d5-a446-5ec30c5b0083 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:48.216175 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f69555e4-8c42-47d5-a446-5ec30c5b0083 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.334303 Aug 09 17:28:48.227659 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2062/3943] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:28:47 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/os-interface => generated 284 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:28:48.228138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df6fc056-9f16-440f-94f9-6d53609e6578 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:48.228866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df6fc056-9f16-440f-94f9-6d53609e6578 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:48.267717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6fc056-9f16-440f-94f9-6d53609e6578 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:48.269079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6fc056-9f16-440f-94f9-6d53609e6578 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:48.275937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6fc056-9f16-440f-94f9-6d53609e6578 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:48.277652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6fc056-9f16-440f-94f9-6d53609e6578 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:48.278796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6fc056-9f16-440f-94f9-6d53609e6578 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:48.279911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6fc056-9f16-440f-94f9-6d53609e6578 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:48.933496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-df6fc056-9f16-440f-94f9-6d53609e6578 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:48.965558 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df6fc056-9f16-440f-94f9-6d53609e6578 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.746422 Aug 09 17:28:48.972104 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2063/3944] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:48 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:49.303070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-93581099-c359-481b-b676-bbf222e704a9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:49.349281 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-93581099-c359-481b-b676-bbf222e704a9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1501 microversion: 2.1 time: 1.743864 Aug 09 17:28:49.352294 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1882/3945] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:47 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1501 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:50.013706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-68bd5b2e-6dcc-46d0-95e4-011d487805f7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:50.024202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-68bd5b2e-6dcc-46d0-95e4-011d487805f7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:50.051491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68bd5b2e-6dcc-46d0-95e4-011d487805f7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:50.052674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68bd5b2e-6dcc-46d0-95e4-011d487805f7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:50.054995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68bd5b2e-6dcc-46d0-95e4-011d487805f7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:50.056833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68bd5b2e-6dcc-46d0-95e4-011d487805f7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:50.058741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68bd5b2e-6dcc-46d0-95e4-011d487805f7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:50.059589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68bd5b2e-6dcc-46d0-95e4-011d487805f7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:50.387036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2587de61-bd08-4807-a8d5-1a4208abcfcb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:50.388529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2587de61-bd08-4807-a8d5-1a4208abcfcb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:50.461788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2587de61-bd08-4807-a8d5-1a4208abcfcb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:50.463101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2587de61-bd08-4807-a8d5-1a4208abcfcb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:50.469228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2587de61-bd08-4807-a8d5-1a4208abcfcb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:50.470578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2587de61-bd08-4807-a8d5-1a4208abcfcb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:50.476668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2587de61-bd08-4807-a8d5-1a4208abcfcb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:50.478119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2587de61-bd08-4807-a8d5-1a4208abcfcb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:50.938552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2587de61-bd08-4807-a8d5-1a4208abcfcb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:50.978193 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2587de61-bd08-4807-a8d5-1a4208abcfcb tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1501 microversion: 2.1 time: 0.601259 Aug 09 17:28:50.980945 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1883/3946] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:50 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1501 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:51.117339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-68bd5b2e-6dcc-46d0-95e4-011d487805f7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:51.134196 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-68bd5b2e-6dcc-46d0-95e4-011d487805f7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 1.128999 Aug 09 17:28:51.148459 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2064/3947] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:50 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:52.018898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a0114017-00cd-4d21-b35d-b2b1f3437a4b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:52.026005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a0114017-00cd-4d21-b35d-b2b1f3437a4b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:52.054322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0114017-00cd-4d21-b35d-b2b1f3437a4b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:52.055151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0114017-00cd-4d21-b35d-b2b1f3437a4b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:52.064714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0114017-00cd-4d21-b35d-b2b1f3437a4b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:52.066374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0114017-00cd-4d21-b35d-b2b1f3437a4b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:52.067088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0114017-00cd-4d21-b35d-b2b1f3437a4b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:52.068111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0114017-00cd-4d21-b35d-b2b1f3437a4b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:52.161293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21e25edb-27ce-4bc0-adaf-d68cbc3ecd4e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:52.162504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-21e25edb-27ce-4bc0-adaf-d68cbc3ecd4e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:52.187076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:52.202650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e25edb-27ce-4bc0-adaf-d68cbc3ecd4e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:52.203310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e25edb-27ce-4bc0-adaf-d68cbc3ecd4e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:52.203869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e25edb-27ce-4bc0-adaf-d68cbc3ecd4e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:52.204763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e25edb-27ce-4bc0-adaf-d68cbc3ecd4e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:52.205244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e25edb-27ce-4bc0-adaf-d68cbc3ecd4e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:52.205685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e25edb-27ce-4bc0-adaf-d68cbc3ecd4e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:52.634305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a0114017-00cd-4d21-b35d-b2b1f3437a4b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:52.660775 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a0114017-00cd-4d21-b35d-b2b1f3437a4b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.648440 Aug 09 17:28:52.672057 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1884/3948] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:52 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:52.706465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-21e25edb-27ce-4bc0-adaf-d68cbc3ecd4e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:52.723885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6d07ce42-7869-4f99-a18c-6500e07d999e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:52.726067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6d07ce42-7869-4f99-a18c-6500e07d999e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:52.740093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d07ce42-7869-4f99-a18c-6500e07d999e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:52.741382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d07ce42-7869-4f99-a18c-6500e07d999e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:52.742130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d07ce42-7869-4f99-a18c-6500e07d999e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:52.743416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d07ce42-7869-4f99-a18c-6500e07d999e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:52.744289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d07ce42-7869-4f99-a18c-6500e07d999e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:52.745311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6d07ce42-7869-4f99-a18c-6500e07d999e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:52.754876 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-21e25edb-27ce-4bc0-adaf-d68cbc3ecd4e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.600923 Aug 09 17:28:52.760749 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2065/3949] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:52 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:52.904106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c1b0c8ce-da13-43bb-ae1a-df81361729d7 req-92e5283e-ab1d-4370-ac6e-2e330a0f4fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a30c674-6026-45bd-b50e-218ae7d69382", "tag": "a73935e9-c581-4296-b0ba-805a64e85308"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:52.936819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c1b0c8ce-da13-43bb-ae1a-df81361729d7 req-92e5283e-ab1d-4370-ac6e-2e330a0f4fdc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:52.938172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c1b0c8ce-da13-43bb-ae1a-df81361729d7 req-92e5283e-ab1d-4370-ac6e-2e330a0f4fdc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:52.942976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c1b0c8ce-da13-43bb-ae1a-df81361729d7 req-92e5283e-ab1d-4370-ac6e-2e330a0f4fdc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:52.991131 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c1b0c8ce-da13-43bb-ae1a-df81361729d7 req-92e5283e-ab1d-4370-ac6e-2e330a0f4fdc service nova] Creating event network-changed:a73935e9-c581-4296-b0ba-805a64e85308 for instance 1a30c674-6026-45bd-b50e-218ae7d69382 on n-h2-845781-6 Aug 09 17:28:53.006719 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c1b0c8ce-da13-43bb-ae1a-df81361729d7 req-92e5283e-ab1d-4370-ac6e-2e330a0f4fdc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110968 Aug 09 17:28:53.007912 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2066/3950] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:28:53.542712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6d07ce42-7869-4f99-a18c-6500e07d999e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:53.567056 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6d07ce42-7869-4f99-a18c-6500e07d999e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.864662 Aug 09 17:28:53.580914 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1885/3951] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:52 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:53.611568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd75d828-4d4b-4f6a-99d1-f8030265494e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:53.612323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bd75d828-4d4b-4f6a-99d1-f8030265494e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: a5e061dc-5be2-42b6-9d80-b61a35f33574] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:53.650963 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-bd75d828-4d4b-4f6a-99d1-f8030265494e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance a5e061dc-5be2-42b6-9d80-b61a35f33574 could not be found. Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd75d828-4d4b-4f6a-99d1-f8030265494e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/a5e061dc-5be2-42b6-9d80-b61a35f33574/action HTTP/1.1 Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 15 Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: {"unpause": {}} Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance a5e061dc-5be2-42b6-9d80-b61a35f33574 could not be found. Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'a5e061dc-5be2-42b6-9d80-b61a35f33574', 'body': {'unpause': {}}} Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e061dc-5be2-42b6-9d80-b61a35f33574 could not be found. Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e061dc-5be2-42b6-9d80-b61a35f33574 could not be found. Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:53.658950 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:53.663123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:53.663123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:53.663123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e061dc-5be2-42b6-9d80-b61a35f33574 could not be found. Aug 09 17:28:53.663123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:53.663123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd75d828-4d4b-4f6a-99d1-f8030265494e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance a5e061dc-5be2-42b6-9d80-b61a35f33574 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:53.686256 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bd75d828-4d4b-4f6a-99d1-f8030265494e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/a5e061dc-5be2-42b6-9d80-b61a35f33574/action" status: 404 len: 111 microversion: 2.1 time: 0.080804 Aug 09 17:28:53.688000 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2067/3952] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:53 2022] POST /compute/v2.1/servers/a5e061dc-5be2-42b6-9d80-b61a35f33574/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:28:53.701272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c04f6001-1ca9-40ba-9dff-445677581668 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:53.702313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c04f6001-1ca9-40ba-9dff-445677581668 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:53.742331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c04f6001-1ca9-40ba-9dff-445677581668 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:53.743068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c04f6001-1ca9-40ba-9dff-445677581668 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:53.743846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c04f6001-1ca9-40ba-9dff-445677581668 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:53.745202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c04f6001-1ca9-40ba-9dff-445677581668 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:53.745784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c04f6001-1ca9-40ba-9dff-445677581668 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:53.746504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c04f6001-1ca9-40ba-9dff-445677581668 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:53.790735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-084f4dfb-1f1f-445a-9127-086d594d5f7b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:53.792166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-084f4dfb-1f1f-445a-9127-086d594d5f7b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:53.836500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-084f4dfb-1f1f-445a-9127-086d594d5f7b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:53.837751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-084f4dfb-1f1f-445a-9127-086d594d5f7b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:53.840663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-084f4dfb-1f1f-445a-9127-086d594d5f7b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:53.847601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-084f4dfb-1f1f-445a-9127-086d594d5f7b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:53.848863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-084f4dfb-1f1f-445a-9127-086d594d5f7b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:53.850013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-084f4dfb-1f1f-445a-9127-086d594d5f7b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:54.337380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-084f4dfb-1f1f-445a-9127-086d594d5f7b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:54.394481 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-084f4dfb-1f1f-445a-9127-086d594d5f7b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.613596 Aug 09 17:28:54.411621 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2068/3953] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:53 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:54.463691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c04f6001-1ca9-40ba-9dff-445677581668 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:54.477888 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c04f6001-1ca9-40ba-9dff-445677581668 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.784792 Aug 09 17:28:54.478487 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1886/3954] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:53 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:54.522030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6376718-9c34-430e-be7a-8702c76b2d38 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:54.523306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f6376718-9c34-430e-be7a-8702c76b2d38 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:54.553551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6376718-9c34-430e-be7a-8702c76b2d38 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:54.554093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6376718-9c34-430e-be7a-8702c76b2d38 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:54.554549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6376718-9c34-430e-be7a-8702c76b2d38 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:54.555301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6376718-9c34-430e-be7a-8702c76b2d38 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:54.555813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6376718-9c34-430e-be7a-8702c76b2d38 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:54.557417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6376718-9c34-430e-be7a-8702c76b2d38 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:54.975766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f6376718-9c34-430e-be7a-8702c76b2d38 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:55.006744 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f6376718-9c34-430e-be7a-8702c76b2d38 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.496400 Aug 09 17:28:55.020710 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2069/3955] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:54 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:55.056036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:55.058488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:55.073057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:55.074392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:55.075512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:55.077256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:55.079028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:55.080237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:55.221207 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Cannot 'unpause' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action HTTP/1.1 Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 15 Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: {"unpause": {}} Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: exception: Cannot 'unpause' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9af26977-0da1-475d-b754-4460e79e4fc3', 'body': {'unpause': {}}} Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 in vm_state active. Cannot unpause while the instance is in this state. Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:55.234730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:55.245106 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:55.245106 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:55.245106 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:55.245106 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:28:55.245106 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:55.250224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 409 to user: Cannot 'unpause' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:55.250224 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b8850e98-5508-4625-a76c-56b319234568 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 409 len: 145 microversion: 2.1 time: 0.200525 Aug 09 17:28:55.275263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-92cae08b-3733-4dc7-be65-2cd86bd5dc0b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:55.279167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1887/3956] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:55 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 145 bytes in 230 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:28:55.280602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-92cae08b-3733-4dc7-be65-2cd86bd5dc0b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:55.323920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92cae08b-3733-4dc7-be65-2cd86bd5dc0b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:55.330797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92cae08b-3733-4dc7-be65-2cd86bd5dc0b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:55.331724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92cae08b-3733-4dc7-be65-2cd86bd5dc0b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:55.333055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92cae08b-3733-4dc7-be65-2cd86bd5dc0b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:55.338587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92cae08b-3733-4dc7-be65-2cd86bd5dc0b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:55.343484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92cae08b-3733-4dc7-be65-2cd86bd5dc0b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:55.426320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a1a9d8d-1b92-4ea7-84c8-017ea27cdea3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:55.430919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3a1a9d8d-1b92-4ea7-84c8-017ea27cdea3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:55.461556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a1a9d8d-1b92-4ea7-84c8-017ea27cdea3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:55.465413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a1a9d8d-1b92-4ea7-84c8-017ea27cdea3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:55.466605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a1a9d8d-1b92-4ea7-84c8-017ea27cdea3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:55.477497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a1a9d8d-1b92-4ea7-84c8-017ea27cdea3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:55.479191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a1a9d8d-1b92-4ea7-84c8-017ea27cdea3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:55.483944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a1a9d8d-1b92-4ea7-84c8-017ea27cdea3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:55.957963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-92cae08b-3733-4dc7-be65-2cd86bd5dc0b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:55.986177 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-92cae08b-3733-4dc7-be65-2cd86bd5dc0b tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.719975 Aug 09 17:28:55.993577 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2070/3957] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:55 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:56.042149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df649a84-2faa-4931-98df-19f5d56bd6ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:56.049006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df649a84-2faa-4931-98df-19f5d56bd6ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:56.075018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df649a84-2faa-4931-98df-19f5d56bd6ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:56.077910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df649a84-2faa-4931-98df-19f5d56bd6ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:56.080883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df649a84-2faa-4931-98df-19f5d56bd6ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:56.090858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df649a84-2faa-4931-98df-19f5d56bd6ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:56.092583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df649a84-2faa-4931-98df-19f5d56bd6ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:56.110046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df649a84-2faa-4931-98df-19f5d56bd6ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:56.436624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a1a9d8d-1b92-4ea7-84c8-017ea27cdea3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:56.464636 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3a1a9d8d-1b92-4ea7-84c8-017ea27cdea3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 1.043293 Aug 09 17:28:56.475707 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1888/3958] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:55 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:56.533256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-df649a84-2faa-4931-98df-19f5d56bd6ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:56.557408 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df649a84-2faa-4931-98df-19f5d56bd6ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.527255 Aug 09 17:28:56.571160 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2071/3959] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:56 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:56.612777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5488bf7c-f9a9-4204-8a78-9d3e766b48ab tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:56.617204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5488bf7c-f9a9-4204-8a78-9d3e766b48ab tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: e7ae10fa-1539-4f26-bb1c-4c0c8e09abf5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:56.633444 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-5488bf7c-f9a9-4204-8a78-9d3e766b48ab tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance e7ae10fa-1539-4f26-bb1c-4c0c8e09abf5 could not be found. Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5488bf7c-f9a9-4204-8a78-9d3e766b48ab tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/e7ae10fa-1539-4f26-bb1c-4c0c8e09abf5/action HTTP/1.1 Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 18 Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: {"unshelve": null} Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance e7ae10fa-1539-4f26-bb1c-4c0c8e09abf5 could not be found. Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'e7ae10fa-1539-4f26-bb1c-4c0c8e09abf5', 'body': {'unshelve': None}} Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7ae10fa-1539-4f26-bb1c-4c0c8e09abf5 could not be found. Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7ae10fa-1539-4f26-bb1c-4c0c8e09abf5 could not be found. Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:56.640924 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:56.650310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:56.650310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:56.650310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:56.650310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:56.650310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:56.650310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:56.650310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7ae10fa-1539-4f26-bb1c-4c0c8e09abf5 could not be found. Aug 09 17:28:56.650310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:56.650310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5488bf7c-f9a9-4204-8a78-9d3e766b48ab tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance e7ae10fa-1539-4f26-bb1c-4c0c8e09abf5 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:56.653495 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5488bf7c-f9a9-4204-8a78-9d3e766b48ab tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/e7ae10fa-1539-4f26-bb1c-4c0c8e09abf5/action" status: 404 len: 111 microversion: 2.1 time: 0.052623 Aug 09 17:28:56.654847 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1889/3960] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:56 2022] POST /compute/v2.1/servers/e7ae10fa-1539-4f26-bb1c-4c0c8e09abf5/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:28:56.672018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-03fbcff1-92f1-493c-8ced-2aa1265fb81f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:56.673809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-03fbcff1-92f1-493c-8ced-2aa1265fb81f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:56.694515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03fbcff1-92f1-493c-8ced-2aa1265fb81f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:56.695562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03fbcff1-92f1-493c-8ced-2aa1265fb81f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:56.700123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03fbcff1-92f1-493c-8ced-2aa1265fb81f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:56.702624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03fbcff1-92f1-493c-8ced-2aa1265fb81f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:56.703673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03fbcff1-92f1-493c-8ced-2aa1265fb81f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:56.710554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03fbcff1-92f1-493c-8ced-2aa1265fb81f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:57.141988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-03fbcff1-92f1-493c-8ced-2aa1265fb81f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:57.168557 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-03fbcff1-92f1-493c-8ced-2aa1265fb81f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.507095 Aug 09 17:28:57.170857 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2072/3961] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:56 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:57.204787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2d43a67b-e8bb-41d7-ba66-fb92b4e144d7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:57.205990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2d43a67b-e8bb-41d7-ba66-fb92b4e144d7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:57.217834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d43a67b-e8bb-41d7-ba66-fb92b4e144d7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:57.218585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d43a67b-e8bb-41d7-ba66-fb92b4e144d7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:57.219317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d43a67b-e8bb-41d7-ba66-fb92b4e144d7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:57.220706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d43a67b-e8bb-41d7-ba66-fb92b4e144d7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:57.221509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d43a67b-e8bb-41d7-ba66-fb92b4e144d7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:57.222263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d43a67b-e8bb-41d7-ba66-fb92b4e144d7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:57.504137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2d43a67b-e8bb-41d7-ba66-fb92b4e144d7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:57.510443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75bc4447-17a6-404a-b8da-3face4ee5d08 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:57.511705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75bc4447-17a6-404a-b8da-3face4ee5d08 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:57.525815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75bc4447-17a6-404a-b8da-3face4ee5d08 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:57.527188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75bc4447-17a6-404a-b8da-3face4ee5d08 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:57.528339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75bc4447-17a6-404a-b8da-3face4ee5d08 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:57.529922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75bc4447-17a6-404a-b8da-3face4ee5d08 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:57.531043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75bc4447-17a6-404a-b8da-3face4ee5d08 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:57.532111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75bc4447-17a6-404a-b8da-3face4ee5d08 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:57.538152 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2d43a67b-e8bb-41d7-ba66-fb92b4e144d7 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.333496 Aug 09 17:28:57.546978 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1890/3962] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:57 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:57.595868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:57.601149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:57.620638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:57.627001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:57.634106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:57.640870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:57.641591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:57.642366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:57.728530 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Cannot 'unshelve' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action HTTP/1.1 Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 18 Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: {"unshelve": null} Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: exception: Cannot 'unshelve' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9af26977-0da1-475d-b754-4460e79e4fc3', 'body': {'unshelve': None}} Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 in vm_state active. Cannot unshelve while the instance is in this state. Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 17:28:57.736098 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 409 to user: Cannot 'unshelve' instance 9af26977-0da1-475d-b754-4460e79e4fc3 while it is in vm_state active {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:57.746676 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-49aeaf81-146c-4e32-a831-c2eb1c53f428 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action" status: 409 len: 146 microversion: 2.1 time: 0.180113 Aug 09 17:28:57.750097 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1891/3963] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:28:57 2022] POST /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3/action => generated 146 bytes in 188 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:28:57.769874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba9ca29d-2b60-401b-ba96-d443ee3ab152 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:57.770992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ba9ca29d-2b60-401b-ba96-d443ee3ab152 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:57.782171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9ca29d-2b60-401b-ba96-d443ee3ab152 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:57.782677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9ca29d-2b60-401b-ba96-d443ee3ab152 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:57.783127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9ca29d-2b60-401b-ba96-d443ee3ab152 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:57.784006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9ca29d-2b60-401b-ba96-d443ee3ab152 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:57.784725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9ca29d-2b60-401b-ba96-d443ee3ab152 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:57.785413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba9ca29d-2b60-401b-ba96-d443ee3ab152 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:58.076464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-75bc4447-17a6-404a-b8da-3face4ee5d08 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:58.091618 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75bc4447-17a6-404a-b8da-3face4ee5d08 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.589758 Aug 09 17:28:58.092550 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2073/3964] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:57 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:58.107720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ba9ca29d-2b60-401b-ba96-d443ee3ab152 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:58.127304 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ba9ca29d-2b60-401b-ba96-d443ee3ab152 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.372810 Aug 09 17:28:58.129781 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1892/3965] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:57 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:58.171871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c8b32e7d-a60c-40b3-96d3-90af1a24e865 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:58.174419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c8b32e7d-a60c-40b3-96d3-90af1a24e865 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:58.187485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8b32e7d-a60c-40b3-96d3-90af1a24e865 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:58.204316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8b32e7d-a60c-40b3-96d3-90af1a24e865 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:58.205315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8b32e7d-a60c-40b3-96d3-90af1a24e865 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:58.208092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8b32e7d-a60c-40b3-96d3-90af1a24e865 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:58.210960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8b32e7d-a60c-40b3-96d3-90af1a24e865 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:58.212251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8b32e7d-a60c-40b3-96d3-90af1a24e865 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:58.657189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c8b32e7d-a60c-40b3-96d3-90af1a24e865 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:58.676195 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c8b32e7d-a60c-40b3-96d3-90af1a24e865 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.511403 Aug 09 17:28:58.677839 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2074/3966] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:58 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:58.710760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b559e85a-12f7-478d-9ecf-cfdc9093ea98 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-907256260_updated"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:58.722292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b559e85a-12f7-478d-9ecf-cfdc9093ea98 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 3db99efc-2862-42b6-b090-e25e4f52770d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:58.741421 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b559e85a-12f7-478d-9ecf-cfdc9093ea98 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 3db99efc-2862-42b6-b090-e25e4f52770d could not be found. Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b559e85a-12f7-478d-9ecf-cfdc9093ea98 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/servers/3db99efc-2862-42b6-b090-e25e4f52770d HTTP/1.1 Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 80 Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-907256260_updated"}} Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 3db99efc-2862-42b6-b090-e25e4f52770d could not be found. Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '3db99efc-2862-42b6-b090-e25e4f52770d', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-907256260_updated'}}} Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db99efc-2862-42b6-b090-e25e4f52770d could not be found. Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 09 17:28:58.745945 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db99efc-2862-42b6-b090-e25e4f52770d could not be found. Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db99efc-2862-42b6-b090-e25e4f52770d could not be found. Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b559e85a-12f7-478d-9ecf-cfdc9093ea98 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 3db99efc-2862-42b6-b090-e25e4f52770d could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b559e85a-12f7-478d-9ecf-cfdc9093ea98 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "PUT /compute/v2.1/servers/3db99efc-2862-42b6-b090-e25e4f52770d" status: 404 len: 111 microversion: 2.1 time: 0.057457 Aug 09 17:28:58.758973 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1893/3967] 10.222.0.93 () {60 vars in 1256 bytes} [Tue Aug 9 17:28:58 2022] PUT /compute/v2.1/servers/3db99efc-2862-42b6-b090-e25e4f52770d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:28:58.772205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9e39c83b-c8a5-4210-9b9a-a59bcff76d17 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:58.773403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9e39c83b-c8a5-4210-9b9a-a59bcff76d17 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:58.791046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e39c83b-c8a5-4210-9b9a-a59bcff76d17 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:58.792004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e39c83b-c8a5-4210-9b9a-a59bcff76d17 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:58.793187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e39c83b-c8a5-4210-9b9a-a59bcff76d17 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:58.794428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e39c83b-c8a5-4210-9b9a-a59bcff76d17 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:58.795299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e39c83b-c8a5-4210-9b9a-a59bcff76d17 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:58.796140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e39c83b-c8a5-4210-9b9a-a59bcff76d17 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:59.126145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a24eac6-2544-45c5-84ef-bd6c47737391 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:59.126821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9a24eac6-2544-45c5-84ef-bd6c47737391 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:59.138176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a24eac6-2544-45c5-84ef-bd6c47737391 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:59.138683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a24eac6-2544-45c5-84ef-bd6c47737391 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:59.144296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a24eac6-2544-45c5-84ef-bd6c47737391 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:59.145198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a24eac6-2544-45c5-84ef-bd6c47737391 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:59.145697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a24eac6-2544-45c5-84ef-bd6c47737391 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:59.146269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a24eac6-2544-45c5-84ef-bd6c47737391 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:59.259226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9e39c83b-c8a5-4210-9b9a-a59bcff76d17 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:59.268798 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9e39c83b-c8a5-4210-9b9a-a59bcff76d17 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.504237 Aug 09 17:28:59.287864 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2075/3968] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:58 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:59.293313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b824b0f5-8c8c-4573-9ba0-088aa92a1640"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:28:59.295885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:59.304409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:59.304918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:59.305378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:59.306127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:59.306836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:59.307602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:59.440005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:59.455261 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Invalid volume: volume b824b0f5-8c8c-4573-9ba0-088aa92a1640 is already attached to instances: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments HTTP/1.1 Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 74 Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: {"volumeAttachment": {"volumeId": "b824b0f5-8c8c-4573-9ba0-088aa92a1640"}} Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid volume: volume b824b0f5-8c8c-4573-9ba0-088aa92a1640 is already attached to instances: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': 'e76b7ec8-ebd0-4b60-b546-a0b6a5f52900', 'body': {'volumeAttachment': {'volumeId': 'b824b0f5-8c8c-4573-9ba0-088aa92a1640'}}} Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b824b0f5-8c8c-4573-9ba0-088aa92a1640 is already attached to instances: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:59.462287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b824b0f5-8c8c-4573-9ba0-088aa92a1640 is already attached to instances: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b824b0f5-8c8c-4573-9ba0-088aa92a1640 is already attached to instances: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 400 to user: Invalid volume: volume b824b0f5-8c8c-4573-9ba0-088aa92a1640 is already attached to instances: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d54b30b1-ead7-426e-875d-5bfa1f5a75ad tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.175880 Aug 09 17:28:59.475397 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2076/3969] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:28:59 2022] POST /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 174 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:28:59.482754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-016e916d-1eb8-40e4-b81b-0469c21d5d73 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:59.484114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-016e916d-1eb8-40e4-b81b-0469c21d5d73 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:59.498443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-016e916d-1eb8-40e4-b81b-0469c21d5d73 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:59.505321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-016e916d-1eb8-40e4-b81b-0469c21d5d73 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:59.506563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-016e916d-1eb8-40e4-b81b-0469c21d5d73 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:59.508797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-016e916d-1eb8-40e4-b81b-0469c21d5d73 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:59.509388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-016e916d-1eb8-40e4-b81b-0469c21d5d73 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:59.509905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-016e916d-1eb8-40e4-b81b-0469c21d5d73 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:59.721177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a24eac6-2544-45c5-84ef-bd6c47737391 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:59.724305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:28:59.745871 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a24eac6-2544-45c5-84ef-bd6c47737391 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.620991 Aug 09 17:28:59.746930 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1894/3970] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:59 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:28:59.759650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a0985239-7674-4990-a605-c18b70940bd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:59.760189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a0985239-7674-4990-a605-c18b70940bd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:59.787295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0985239-7674-4990-a605-c18b70940bd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:59.788547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0985239-7674-4990-a605-c18b70940bd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:59.789023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0985239-7674-4990-a605-c18b70940bd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:59.789779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0985239-7674-4990-a605-c18b70940bd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:59.790395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0985239-7674-4990-a605-c18b70940bd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:59.790848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0985239-7674-4990-a605-c18b70940bd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:59.853928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a0985239-7674-4990-a605-c18b70940bd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:28:59.854222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-016e916d-1eb8-40e4-b81b-0469c21d5d73 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:28:59.868853 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-016e916d-1eb8-40e4-b81b-0469c21d5d73 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.394339 Aug 09 17:28:59.869512 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2077/3971] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:28:59 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:28:59.885667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ab68f4a3-25fc-4ae1-9254-222af8bef77d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:28:59.892303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ab68f4a3-25fc-4ae1-9254-222af8bef77d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:28:59.901127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab68f4a3-25fc-4ae1-9254-222af8bef77d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:59.901771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab68f4a3-25fc-4ae1-9254-222af8bef77d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:59.902507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab68f4a3-25fc-4ae1-9254-222af8bef77d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:28:59.903180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab68f4a3-25fc-4ae1-9254-222af8bef77d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:28:59.903779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab68f4a3-25fc-4ae1-9254-222af8bef77d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:28:59.904468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab68f4a3-25fc-4ae1-9254-222af8bef77d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:00.125800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-ab68f4a3-25fc-4ae1-9254-222af8bef77d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lazy-loading 'services' on Instance uuid e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:29:00.237532 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a0985239-7674-4990-a605-c18b70940bd1 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "DELETE /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 204 len: 0 microversion: 2.1 time: 0.487206 Aug 09 17:29:00.238545 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1895/3972] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:28:59 2022] DELETE /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:29:00.266131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ebfec4e9-2235-4daf-99e4-8ed9629cac6f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ebfec4e9-2235-4daf-99e4-8ed9629cac6f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 HTTP/1.1 Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 280 Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9af26977-0da1-475d-b754-4460e79e4fc3', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:00.284655 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 17:29:00.291777 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:00.298988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ebfec4e9-2235-4daf-99e4-8ed9629cac6f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:00.298988 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ebfec4e9-2235-4daf-99e4-8ed9629cac6f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "PUT /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 400 len: 619 microversion: 2.1 time: 0.048379 Aug 09 17:29:00.306548 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1896/3973] 10.222.0.93 () {60 vars in 1257 bytes} [Tue Aug 9 17:29:00 2022] PUT /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 619 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:29:00.330350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e3a237ce-e795-4a4a-95fe-e1593ac0439d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:00.345338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e3a237ce-e795-4a4a-95fe-e1593ac0439d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:00.345786 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ab68f4a3-25fc-4ae1-9254-222af8bef77d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments/b824b0f5-8c8c-4573-9ba0-088aa92a1640" status: 202 len: 0 microversion: 2.1 time: 0.470430 Aug 09 17:29:00.346505 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2078/3974] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:28:59 2022] DELETE /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments/b824b0f5-8c8c-4573-9ba0-088aa92a1640 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:29:00.358257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ef35b689-46ee-403b-80fa-7a4e98ec82b0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:00.364573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ef35b689-46ee-403b-80fa-7a4e98ec82b0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:00.367087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3a237ce-e795-4a4a-95fe-e1593ac0439d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:00.368098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3a237ce-e795-4a4a-95fe-e1593ac0439d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:00.368985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3a237ce-e795-4a4a-95fe-e1593ac0439d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:00.370495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3a237ce-e795-4a4a-95fe-e1593ac0439d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:00.378742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3a237ce-e795-4a4a-95fe-e1593ac0439d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:00.379432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3a237ce-e795-4a4a-95fe-e1593ac0439d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:00.390040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef35b689-46ee-403b-80fa-7a4e98ec82b0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:00.391212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef35b689-46ee-403b-80fa-7a4e98ec82b0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:00.393970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef35b689-46ee-403b-80fa-7a4e98ec82b0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:00.397259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef35b689-46ee-403b-80fa-7a4e98ec82b0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:00.398079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef35b689-46ee-403b-80fa-7a4e98ec82b0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:00.398555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef35b689-46ee-403b-80fa-7a4e98ec82b0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:00.787991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ef35b689-46ee-403b-80fa-7a4e98ec82b0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:00.821810 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ef35b689-46ee-403b-80fa-7a4e98ec82b0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.468143 Aug 09 17:29:00.827553 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2079/3975] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:00 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:00.879125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3fb663e-12e0-40b0-843d-f3b51cc06a49 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:00.886489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3fb663e-12e0-40b0-843d-f3b51cc06a49 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:00.913661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3fb663e-12e0-40b0-843d-f3b51cc06a49 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:00.914416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3fb663e-12e0-40b0-843d-f3b51cc06a49 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:00.915063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3fb663e-12e0-40b0-843d-f3b51cc06a49 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:00.919149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3fb663e-12e0-40b0-843d-f3b51cc06a49 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:00.924490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3fb663e-12e0-40b0-843d-f3b51cc06a49 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:00.925401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3fb663e-12e0-40b0-843d-f3b51cc06a49 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:01.072877 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3fb663e-12e0-40b0-843d-f3b51cc06a49 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227370 Aug 09 17:29:01.085744 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2080/3976] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:29:00 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:01.101215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-185b3be6-9ff5-4c8d-a73d-a8605a2cfb4d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:01.107357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-185b3be6-9ff5-4c8d-a73d-a8605a2cfb4d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:01.156786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e3a237ce-e795-4a4a-95fe-e1593ac0439d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:01.165404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-185b3be6-9ff5-4c8d-a73d-a8605a2cfb4d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:01.169848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-185b3be6-9ff5-4c8d-a73d-a8605a2cfb4d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:01.179609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-185b3be6-9ff5-4c8d-a73d-a8605a2cfb4d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:01.181361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-185b3be6-9ff5-4c8d-a73d-a8605a2cfb4d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:01.183130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-185b3be6-9ff5-4c8d-a73d-a8605a2cfb4d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:01.189114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-185b3be6-9ff5-4c8d-a73d-a8605a2cfb4d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:01.201264 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e3a237ce-e795-4a4a-95fe-e1593ac0439d tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1509 microversion: 2.1 time: 0.888362 Aug 09 17:29:01.204109 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1897/3977] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:00 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1509 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:01.233342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ce147bdf-5e68-43d8-8b7f-d214dd6c3eb2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:01.248153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ce147bdf-5e68-43d8-8b7f-d214dd6c3eb2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:01.269875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce147bdf-5e68-43d8-8b7f-d214dd6c3eb2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:01.271254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce147bdf-5e68-43d8-8b7f-d214dd6c3eb2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:01.272985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce147bdf-5e68-43d8-8b7f-d214dd6c3eb2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:01.281916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce147bdf-5e68-43d8-8b7f-d214dd6c3eb2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:01.289596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce147bdf-5e68-43d8-8b7f-d214dd6c3eb2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:01.297025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce147bdf-5e68-43d8-8b7f-d214dd6c3eb2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:02.087614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ce147bdf-5e68-43d8-8b7f-d214dd6c3eb2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:02.110588 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ce147bdf-5e68-43d8-8b7f-d214dd6c3eb2 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 0.904366 Aug 09 17:29:02.111444 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1898/3978] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:01 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:02.148109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-23fb2af1-d31d-4311-ad06-f8a0b4527c01 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:02.159773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-23fb2af1-d31d-4311-ad06-f8a0b4527c01 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:02.192430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-23fb2af1-d31d-4311-ad06-f8a0b4527c01 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:02.196073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-23fb2af1-d31d-4311-ad06-f8a0b4527c01 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:02.198250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-23fb2af1-d31d-4311-ad06-f8a0b4527c01 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:02.204658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-23fb2af1-d31d-4311-ad06-f8a0b4527c01 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:02.205832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-23fb2af1-d31d-4311-ad06-f8a0b4527c01 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:02.213658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-23fb2af1-d31d-4311-ad06-f8a0b4527c01 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:02.351847 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-23fb2af1-d31d-4311-ad06-f8a0b4527c01 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233111 Aug 09 17:29:02.360016 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1899/3979] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:29:02 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7e203d49-60a7-4405-9249-93363f330075 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7e203d49-60a7-4405-9249-93363f330075 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: request: PUT /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 HTTP/1.1 Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 24 Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: {"server": {"name": ""}} Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9af26977-0da1-475d-b754-4460e79e4fc3', 'body': {'server': {'name': ''}}} Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi '' Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:29:02.376612 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7e203d49-60a7-4405-9249-93363f330075 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:02.387943 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7e203d49-60a7-4405-9249-93363f330075 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "PUT /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 400 len: 108 microversion: 2.1 time: 0.022142 Aug 09 17:29:02.394646 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1900/3980] 10.222.0.93 () {60 vars in 1256 bytes} [Tue Aug 9 17:29:02 2022] PUT /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:29:02.403864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6a911ad7-01c1-4151-97ee-195574649851 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:02.411204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6a911ad7-01c1-4151-97ee-195574649851 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:02.447927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a911ad7-01c1-4151-97ee-195574649851 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:02.454003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a911ad7-01c1-4151-97ee-195574649851 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:02.455137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a911ad7-01c1-4151-97ee-195574649851 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:02.461209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a911ad7-01c1-4151-97ee-195574649851 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:02.462161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a911ad7-01c1-4151-97ee-195574649851 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:02.469200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a911ad7-01c1-4151-97ee-195574649851 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:02.572176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-185b3be6-9ff5-4c8d-a73d-a8605a2cfb4d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:02.602269 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-185b3be6-9ff5-4c8d-a73d-a8605a2cfb4d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 1.511389 Aug 09 17:29:02.606795 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2081/3981] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:01 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:02.631484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d81feea8-d4c5-447c-93d9-ea36dfc134e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:02.632974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d81feea8-d4c5-447c-93d9-ea36dfc134e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:02.646006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d81feea8-d4c5-447c-93d9-ea36dfc134e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:02.648003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d81feea8-d4c5-447c-93d9-ea36dfc134e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:02.649266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d81feea8-d4c5-447c-93d9-ea36dfc134e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:02.652164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d81feea8-d4c5-447c-93d9-ea36dfc134e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:02.653453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d81feea8-d4c5-447c-93d9-ea36dfc134e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:02.654603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d81feea8-d4c5-447c-93d9-ea36dfc134e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:03.221046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6a911ad7-01c1-4151-97ee-195574649851 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:03.236906 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6a911ad7-01c1-4151-97ee-195574649851 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 200 len: 1509 microversion: 2.1 time: 0.842496 Aug 09 17:29:03.239680 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1901/3982] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:02 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 1509 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:03.280694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-63d04668-81c3-457c-960c-822547896116 req-79ea18c1-d006-40ac-af55-6988f4bfc527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750faee4-c702-4a68-b0ba-f57212ea276f", "name": "network-vif-deleted", "tag": "a35c2ca0-d4b7-4330-8b26-aa287572ba0a"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:03.295333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-63d04668-81c3-457c-960c-822547896116 req-79ea18c1-d006-40ac-af55-6988f4bfc527 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:03.296816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-63d04668-81c3-457c-960c-822547896116 req-79ea18c1-d006-40ac-af55-6988f4bfc527 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:03.297753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-63d04668-81c3-457c-960c-822547896116 req-79ea18c1-d006-40ac-af55-6988f4bfc527 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:03.323418 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-63d04668-81c3-457c-960c-822547896116 req-79ea18c1-d006-40ac-af55-6988f4bfc527 service nova] Creating event network-vif-deleted:a35c2ca0-d4b7-4330-8b26-aa287572ba0a for instance 750faee4-c702-4a68-b0ba-f57212ea276f on n-h2-845781-6 Aug 09 17:29:03.334694 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-63d04668-81c3-457c-960c-822547896116 req-79ea18c1-d006-40ac-af55-6988f4bfc527 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055192 Aug 09 17:29:03.337390 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1902/3983] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:03.370560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3645faa5-3888-4254-9d57-974dc4f4e7f9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:03.375699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3645faa5-3888-4254-9d57-974dc4f4e7f9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:03.394986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3645faa5-3888-4254-9d57-974dc4f4e7f9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:03.397290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3645faa5-3888-4254-9d57-974dc4f4e7f9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:03.398870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3645faa5-3888-4254-9d57-974dc4f4e7f9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:03.404230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3645faa5-3888-4254-9d57-974dc4f4e7f9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:03.405114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3645faa5-3888-4254-9d57-974dc4f4e7f9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:03.405950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3645faa5-3888-4254-9d57-974dc4f4e7f9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:03.474121 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3645faa5-3888-4254-9d57-974dc4f4e7f9 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109102 Aug 09 17:29:03.481270 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1903/3984] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:29:03 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:03.641310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8c320583-a29e-4c6a-a6b0-ee9feadd7139 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:03.641310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8c320583-a29e-4c6a-a6b0-ee9feadd7139 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:03.650085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c320583-a29e-4c6a-a6b0-ee9feadd7139 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:03.650753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c320583-a29e-4c6a-a6b0-ee9feadd7139 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:03.651298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c320583-a29e-4c6a-a6b0-ee9feadd7139 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:03.652134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c320583-a29e-4c6a-a6b0-ee9feadd7139 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:03.652896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c320583-a29e-4c6a-a6b0-ee9feadd7139 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:03.653418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c320583-a29e-4c6a-a6b0-ee9feadd7139 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:03.910165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8c320583-a29e-4c6a-a6b0-ee9feadd7139 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:03.920099 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8c320583-a29e-4c6a-a6b0-ee9feadd7139 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.289470 Aug 09 17:29:03.945910 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1904/3985] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:03 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:04.276013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:04.276872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: 750faee4-c702-4a68-b0ba-f57212ea276f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:04.308769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:04.312650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:04.314604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:04.318348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:04.322634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:04.323976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:04.376330 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] HTTP exception thrown: Instance 750faee4-c702-4a68-b0ba-f57212ea276f could not be found. Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Request method failure captured: Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f HTTP/1.1 Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfTXHKJ-127xoXOxvirCkOJ5Ga7oI06dbW5eRmTw3VceZ3fIPtVcpBoJqCQEzgHg892I33A2CZbgdV9GneqCNx7frvCudUtWkW3U62800gIkrYotA0sMKiw2vzfbegwV0AsonNcEy5cWuu85myYoWYiVD7fe2x9mfaYw2xpqmhRsNo Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d20bf24928749afb9b848946419f4f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: a34881c81ae2427fbf2cbb1cd8c4ef52 Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 750faee4-c702-4a68-b0ba-f57212ea276f could not be found. Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '750faee4-c702-4a68-b0ba-f57212ea276f'} Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750faee4-c702-4a68-b0ba-f57212ea276f could not be found. Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750faee4-c702-4a68-b0ba-f57212ea276f could not be found. Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:04.379947 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:04.385140 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:04.385140 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:04.385140 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:04.385140 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:04.385140 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:29:04.385140 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:29:04.385140 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750faee4-c702-4a68-b0ba-f57212ea276f could not be found. Aug 09 17:29:04.385140 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:04.385140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Returning 404 to user: Instance 750faee4-c702-4a68-b0ba-f57212ea276f could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:04.385140 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5d3e8484-5958-429f-b4d8-f4793498408f tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f" status: 404 len: 111 microversion: 2.1 time: 0.114958 Aug 09 17:29:04.392550 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1905/3986] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:04 2022] GET /compute/v2.1/servers/750faee4-c702-4a68-b0ba-f57212ea276f => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:29:04.404352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b1abee90-a52c-431b-a1e6-6d939be95257 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:04.408497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b1abee90-a52c-431b-a1e6-6d939be95257 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:04.428773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1abee90-a52c-431b-a1e6-6d939be95257 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:04.429311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1abee90-a52c-431b-a1e6-6d939be95257 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:04.429774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1abee90-a52c-431b-a1e6-6d939be95257 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:04.430532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1abee90-a52c-431b-a1e6-6d939be95257 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:04.431003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1abee90-a52c-431b-a1e6-6d939be95257 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:04.431449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b1abee90-a52c-431b-a1e6-6d939be95257 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:04.520112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b1abee90-a52c-431b-a1e6-6d939be95257 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:29:04.719143 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b1abee90-a52c-431b-a1e6-6d939be95257 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 204 len: 0 microversion: 2.1 time: 0.324375 Aug 09 17:29:04.721167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1906/3987] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:29:04 2022] DELETE /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:29:04.732001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d534efad-2d6f-44af-b3e0-837a5e098546 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:04.738974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d534efad-2d6f-44af-b3e0-837a5e098546 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:04.767758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d534efad-2d6f-44af-b3e0-837a5e098546 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:04.767758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d534efad-2d6f-44af-b3e0-837a5e098546 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:04.767758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d534efad-2d6f-44af-b3e0-837a5e098546 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:04.767758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d534efad-2d6f-44af-b3e0-837a5e098546 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:04.767758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d534efad-2d6f-44af-b3e0-837a5e098546 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:04.767758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d534efad-2d6f-44af-b3e0-837a5e098546 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:04.855909 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d534efad-2d6f-44af-b3e0-837a5e098546 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132331 Aug 09 17:29:04.857590 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1907/3988] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:29:04 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:04.867908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b43adddf-828e-4ac8-ba3f-76060564d262 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:04.869030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b43adddf-828e-4ac8-ba3f-76060564d262 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:04.882683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b43adddf-828e-4ac8-ba3f-76060564d262 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:04.883559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b43adddf-828e-4ac8-ba3f-76060564d262 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:04.884395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b43adddf-828e-4ac8-ba3f-76060564d262 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:04.885701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b43adddf-828e-4ac8-ba3f-76060564d262 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:04.891303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b43adddf-828e-4ac8-ba3f-76060564d262 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:04.892279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b43adddf-828e-4ac8-ba3f-76060564d262 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:04.955431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d81feea8-d4c5-447c-93d9-ea36dfc134e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:04.968112 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d81feea8-d4c5-447c-93d9-ea36dfc134e9 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1504 microversion: 2.1 time: 2.351549 Aug 09 17:29:04.982455 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2082/3989] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:02 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1504 bytes in 2375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:04.998052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c67dfaa-b5a8-4fde-af07-6c93773b667f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:04.999465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c67dfaa-b5a8-4fde-af07-6c93773b667f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:05.025897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c67dfaa-b5a8-4fde-af07-6c93773b667f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:05.026830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c67dfaa-b5a8-4fde-af07-6c93773b667f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:05.033283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c67dfaa-b5a8-4fde-af07-6c93773b667f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:05.034870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c67dfaa-b5a8-4fde-af07-6c93773b667f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:05.036044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c67dfaa-b5a8-4fde-af07-6c93773b667f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:05.036784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c67dfaa-b5a8-4fde-af07-6c93773b667f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:05.264643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b43adddf-828e-4ac8-ba3f-76060564d262 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:05.284588 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b43adddf-828e-4ac8-ba3f-76060564d262 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 0.425150 Aug 09 17:29:05.286188 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1908/3990] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:04 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:05.644965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c67dfaa-b5a8-4fde-af07-6c93773b667f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:05.658345 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c67dfaa-b5a8-4fde-af07-6c93773b667f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.674060 Aug 09 17:29:05.673245 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2083/3991] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:04 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:05.870490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e7573d1e-3bd2-439b-9a91-34a21a03f7d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:05.872955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e7573d1e-3bd2-439b-9a91-34a21a03f7d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:05.899681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7573d1e-3bd2-439b-9a91-34a21a03f7d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:05.900538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7573d1e-3bd2-439b-9a91-34a21a03f7d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:05.901001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7573d1e-3bd2-439b-9a91-34a21a03f7d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:05.901760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7573d1e-3bd2-439b-9a91-34a21a03f7d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:05.902227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7573d1e-3bd2-439b-9a91-34a21a03f7d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:05.904235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7573d1e-3bd2-439b-9a91-34a21a03f7d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:06.016005 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e7573d1e-3bd2-439b-9a91-34a21a03f7d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149770 Aug 09 17:29:06.028169 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1909/3992] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:29:05 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:29:06.336922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b17d05c0-b09c-46bc-8bbf-22d3aa345808 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:06.338121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b17d05c0-b09c-46bc-8bbf-22d3aa345808 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:06.358880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b17d05c0-b09c-46bc-8bbf-22d3aa345808 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:06.361362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b17d05c0-b09c-46bc-8bbf-22d3aa345808 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:06.361957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b17d05c0-b09c-46bc-8bbf-22d3aa345808 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:06.364917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b17d05c0-b09c-46bc-8bbf-22d3aa345808 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:06.367687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b17d05c0-b09c-46bc-8bbf-22d3aa345808 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:06.369050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b17d05c0-b09c-46bc-8bbf-22d3aa345808 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:06.694246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b40fc8d7-b810-4b1a-ae63-8d20d0064e35 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:06.695257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b40fc8d7-b810-4b1a-ae63-8d20d0064e35 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:06.735937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b40fc8d7-b810-4b1a-ae63-8d20d0064e35 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:06.738483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b40fc8d7-b810-4b1a-ae63-8d20d0064e35 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:06.739667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b40fc8d7-b810-4b1a-ae63-8d20d0064e35 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:06.744886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b40fc8d7-b810-4b1a-ae63-8d20d0064e35 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:06.750417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b40fc8d7-b810-4b1a-ae63-8d20d0064e35 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:06.752696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b40fc8d7-b810-4b1a-ae63-8d20d0064e35 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:06.949022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b17d05c0-b09c-46bc-8bbf-22d3aa345808 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:06.972511 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b17d05c0-b09c-46bc-8bbf-22d3aa345808 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 0.639562 Aug 09 17:29:06.973809 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2084/3993] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:06 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:07.035753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4f6e3c44-a8c0-47fc-b7d9-e2fe3addfbb7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:07.040304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4f6e3c44-a8c0-47fc-b7d9-e2fe3addfbb7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:07.056692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6e3c44-a8c0-47fc-b7d9-e2fe3addfbb7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:07.059948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6e3c44-a8c0-47fc-b7d9-e2fe3addfbb7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:07.060942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6e3c44-a8c0-47fc-b7d9-e2fe3addfbb7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:07.062161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6e3c44-a8c0-47fc-b7d9-e2fe3addfbb7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:07.064254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6e3c44-a8c0-47fc-b7d9-e2fe3addfbb7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:07.068968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6e3c44-a8c0-47fc-b7d9-e2fe3addfbb7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:07.173206 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4f6e3c44-a8c0-47fc-b7d9-e2fe3addfbb7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139854 Aug 09 17:29:07.181210 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2085/3994] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:29:07 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:07.294907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4fa4e889-c8d4-4286-867e-f870dc4f214a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:07.306552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4fa4e889-c8d4-4286-867e-f870dc4f214a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:07.309857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4fa4e889-c8d4-4286-867e-f870dc4f214a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Searching by: {'deleted': False, 'project_id': 'f6ae6d27589644c9962214f14b27cb36'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:29:07.325319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fa4e889-c8d4-4286-867e-f870dc4f214a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:07.329132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fa4e889-c8d4-4286-867e-f870dc4f214a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:07.332251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fa4e889-c8d4-4286-867e-f870dc4f214a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:07.333209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fa4e889-c8d4-4286-867e-f870dc4f214a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:07.336280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fa4e889-c8d4-4286-867e-f870dc4f214a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:07.336746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fa4e889-c8d4-4286-867e-f870dc4f214a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:07.404304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-4fa4e889-c8d4-4286-867e-f870dc4f214a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:29:07.469986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b40fc8d7-b810-4b1a-ae63-8d20d0064e35 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:07.488419 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b40fc8d7-b810-4b1a-ae63-8d20d0064e35 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1506 microversion: 2.1 time: 0.806247 Aug 09 17:29:07.489438 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1910/3995] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:06 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1506 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:07.515872 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4fa4e889-c8d4-4286-867e-f870dc4f214a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.225284 Aug 09 17:29:07.519757 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2086/3996] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:29:07 2022] GET /compute/v2.1/servers => generated 333 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:07.540652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:07.566413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:07.570008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Searching by: {'deleted': False, 'project_id': 'f6ae6d27589644c9962214f14b27cb36'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:29:07.609829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:07.614197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:07.625997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:07.632248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:07.633014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:07.633658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:07.805064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:07.812928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:29:07.965213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:07.987451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:07.988397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:07.989194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:08.014684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e9267b3-dbe3-4084-96bb-70e9379c9332 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:08.016406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e9267b3-dbe3-4084-96bb-70e9379c9332 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:08.048600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9267b3-dbe3-4084-96bb-70e9379c9332 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:08.051194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9267b3-dbe3-4084-96bb-70e9379c9332 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:08.053401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9267b3-dbe3-4084-96bb-70e9379c9332 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:08.060237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9267b3-dbe3-4084-96bb-70e9379c9332 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:08.061414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9267b3-dbe3-4084-96bb-70e9379c9332 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:08.070392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9267b3-dbe3-4084-96bb-70e9379c9332 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:08.578926 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ca5466bd-319d-4e53-986c-70099a4aa4c9 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 1.044281 Aug 09 17:29:08.580823 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1911/3997] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:29:07 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:29:08.597308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1b35cf40-402b-4b22-a112-17b1016a9407 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:08.605705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1b35cf40-402b-4b22-a112-17b1016a9407 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:08.620890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b35cf40-402b-4b22-a112-17b1016a9407 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:08.634262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b35cf40-402b-4b22-a112-17b1016a9407 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:08.636728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b35cf40-402b-4b22-a112-17b1016a9407 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:08.641437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b35cf40-402b-4b22-a112-17b1016a9407 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:08.644941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b35cf40-402b-4b22-a112-17b1016a9407 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:08.653113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b35cf40-402b-4b22-a112-17b1016a9407 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:08.825118 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1b35cf40-402b-4b22-a112-17b1016a9407 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.242080 Aug 09 17:29:08.831738 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1912/3998] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:29:08 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 197 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:08.847970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e9267b3-dbe3-4084-96bb-70e9379c9332 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:08.880372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-362ee0e4-51f2-4fa6-8399-929cfb5cb0d7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:08.882524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-362ee0e4-51f2-4fa6-8399-929cfb5cb0d7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:08.898808 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e9267b3-dbe3-4084-96bb-70e9379c9332 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1523 microversion: 2.1 time: 0.870104 Aug 09 17:29:08.905739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-362ee0e4-51f2-4fa6-8399-929cfb5cb0d7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:08.907291 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2087/3999] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:08 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1523 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:08.916873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7eb82cc0-17b5-4035-91f5-288b24423497 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:08.924965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-362ee0e4-51f2-4fa6-8399-929cfb5cb0d7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:08.926154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-362ee0e4-51f2-4fa6-8399-929cfb5cb0d7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:08.927829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-362ee0e4-51f2-4fa6-8399-929cfb5cb0d7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:08.928952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-362ee0e4-51f2-4fa6-8399-929cfb5cb0d7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:08.934928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-362ee0e4-51f2-4fa6-8399-929cfb5cb0d7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:08.977057 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7eb82cc0-17b5-4035-91f5-288b24423497 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.067677 Aug 09 17:29:08.988009 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2088/4000] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:29:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:09.052926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9bd6fd6f-09b3-4395-80b6-f1f4afc77ebd req-120f3bbd-ee12-46d3-9df8-05f53ebbc1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d19cd5ee-f610-4a5a-9983-e233f32596f1", "name": "network-vif-deleted", "tag": "e0c82029-fc49-4dc8-bc60-ce44cb5efe54"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:09.082949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9bd6fd6f-09b3-4395-80b6-f1f4afc77ebd req-120f3bbd-ee12-46d3-9df8-05f53ebbc1f6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:09.083684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9bd6fd6f-09b3-4395-80b6-f1f4afc77ebd req-120f3bbd-ee12-46d3-9df8-05f53ebbc1f6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:09.085960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9bd6fd6f-09b3-4395-80b6-f1f4afc77ebd req-120f3bbd-ee12-46d3-9df8-05f53ebbc1f6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:09.113436 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9bd6fd6f-09b3-4395-80b6-f1f4afc77ebd req-120f3bbd-ee12-46d3-9df8-05f53ebbc1f6 service nova] Creating event network-vif-deleted:e0c82029-fc49-4dc8-bc60-ce44cb5efe54 for instance d19cd5ee-f610-4a5a-9983-e233f32596f1 on n-h2-845781-6 Aug 09 17:29:09.124502 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9bd6fd6f-09b3-4395-80b6-f1f4afc77ebd req-120f3bbd-ee12-46d3-9df8-05f53ebbc1f6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075360 Aug 09 17:29:09.125738 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2089/4001] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:29:09.296878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5412fc34-7152-4dbb-a3b4-77767c27708d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:09.298382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5412fc34-7152-4dbb-a3b4-77767c27708d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:09.309813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5412fc34-7152-4dbb-a3b4-77767c27708d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:09.315472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5412fc34-7152-4dbb-a3b4-77767c27708d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:09.316841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5412fc34-7152-4dbb-a3b4-77767c27708d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:09.318812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5412fc34-7152-4dbb-a3b4-77767c27708d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:09.319598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5412fc34-7152-4dbb-a3b4-77767c27708d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:09.322309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5412fc34-7152-4dbb-a3b4-77767c27708d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:09.404159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5412fc34-7152-4dbb-a3b4-77767c27708d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:29:09.630138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-362ee0e4-51f2-4fa6-8399-929cfb5cb0d7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:09.637033 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5412fc34-7152-4dbb-a3b4-77767c27708d tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "DELETE /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 204 len: 0 microversion: 2.1 time: 0.343122 Aug 09 17:29:09.640857 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2090/4002] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:29:09 2022] DELETE /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:29:09.653819 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-362ee0e4-51f2-4fa6-8399-929cfb5cb0d7 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1486 microversion: 2.1 time: 0.820253 Aug 09 17:29:09.654433 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1913/4003] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:08 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1486 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:09.655277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99a161ec-63ce-43c5-9dbb-3abebbaba181 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:09.656264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99a161ec-63ce-43c5-9dbb-3abebbaba181 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:09.663677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a161ec-63ce-43c5-9dbb-3abebbaba181 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:09.677363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a161ec-63ce-43c5-9dbb-3abebbaba181 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:09.678645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a161ec-63ce-43c5-9dbb-3abebbaba181 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:09.679576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a161ec-63ce-43c5-9dbb-3abebbaba181 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:09.682139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a161ec-63ce-43c5-9dbb-3abebbaba181 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:09.682786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99a161ec-63ce-43c5-9dbb-3abebbaba181 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:09.842387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-239665e4-a855-4fe0-89ad-fa0827be5343 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:09.847241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-239665e4-a855-4fe0-89ad-fa0827be5343 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:09.870684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239665e4-a855-4fe0-89ad-fa0827be5343 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:09.876410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239665e4-a855-4fe0-89ad-fa0827be5343 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:09.879054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239665e4-a855-4fe0-89ad-fa0827be5343 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:09.879713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239665e4-a855-4fe0-89ad-fa0827be5343 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:09.884677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239665e4-a855-4fe0-89ad-fa0827be5343 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:09.885269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239665e4-a855-4fe0-89ad-fa0827be5343 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:10.027307 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-239665e4-a855-4fe0-89ad-fa0827be5343 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191234 Aug 09 17:29:10.027945 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1914/4004] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:29:09 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:29:10.045392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:10.046495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:10.064956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:10.067268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:10.075683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:10.077763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:10.087851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:10.088610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:10.231150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:10.232542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:10.233596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:10.237109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lazy-loading 'fault' on Instance uuid d19cd5ee-f610-4a5a-9983-e233f32596f1 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:29:10.302098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99a161ec-63ce-43c5-9dbb-3abebbaba181 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:10.317402 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99a161ec-63ce-43c5-9dbb-3abebbaba181 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1699 microversion: 2.1 time: 0.668141 Aug 09 17:29:10.320016 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2091/4005] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:09 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1699 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:29:10.327973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1921666683", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:10.433928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34881c81ae2427fbf2cbb1cd8c4ef52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d20bf24928749afb9b848946419f4f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:10.446359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] validate_networks() for [('6b9c2e69-817b-412c-982c-bc31f897cb20', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:29:10.455360 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3bd58d79-c796-4c09-86bb-fa3c09a1ed35 tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 200 len: 1312 microversion: 2.1 time: 0.426309 Aug 09 17:29:10.459754 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1915/4006] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:10 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 1312 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:11.049268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-90c37964-4c15-409c-af97-6f82bf4f4e4b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:11.054823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-90c37964-4c15-409c-af97-6f82bf4f4e4b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:11.103806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90c37964-4c15-409c-af97-6f82bf4f4e4b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:11.104401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90c37964-4c15-409c-af97-6f82bf4f4e4b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:11.106110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90c37964-4c15-409c-af97-6f82bf4f4e4b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:11.108384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90c37964-4c15-409c-af97-6f82bf4f4e4b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:11.109832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90c37964-4c15-409c-af97-6f82bf4f4e4b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:11.113142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90c37964-4c15-409c-af97-6f82bf4f4e4b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:11.218836 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-90c37964-4c15-409c-af97-6f82bf4f4e4b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175840 Aug 09 17:29:11.224072 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1916/4007] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:29:11 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:29:11.347037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d36aa0bf-0905-4406-b373-32c619bee166 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:11.348491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d36aa0bf-0905-4406-b373-32c619bee166 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:11.383179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d36aa0bf-0905-4406-b373-32c619bee166 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:11.385099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d36aa0bf-0905-4406-b373-32c619bee166 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:11.391698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d36aa0bf-0905-4406-b373-32c619bee166 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:11.402230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d36aa0bf-0905-4406-b373-32c619bee166 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:11.403116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d36aa0bf-0905-4406-b373-32c619bee166 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:11.403612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d36aa0bf-0905-4406-b373-32c619bee166 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:11.929703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d36aa0bf-0905-4406-b373-32c619bee166 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:11.959668 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d36aa0bf-0905-4406-b373-32c619bee166 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1699 microversion: 2.1 time: 0.611121 Aug 09 17:29:11.964263 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1917/4008] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:11 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1699 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:29:11.987779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:11.992327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] [instance: d19cd5ee-f610-4a5a-9983-e233f32596f1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:12.018377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:12.020771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:12.027827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:12.029629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:12.030744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:12.031857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:12.117938 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] HTTP exception thrown: Instance d19cd5ee-f610-4a5a-9983-e233f32596f1 could not be found. Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Request method failure captured: Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 HTTP/1.1 Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfTXHKJ-127xoXOxvirCkOJ5Ga7oI06dbW5eRmTw3VceZ3fIPtVcpBoJqCQEzgHg892I33A2CZbgdV9GneqCNx7frvCudUtWkW3U62800gIkrYotA0sMKiw2vzfbegwV0AsonNcEy5cWuu85myYoWYiVD7fe2x9mfaYw2xpqmhRsNo Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1d20bf24928749afb9b848946419f4f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1d20bf24928749afb9b848946419f4f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1d20bf24928749afb9b848946419f4f6 Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1643699686 Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: a34881c81ae2427fbf2cbb1cd8c4ef52 Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1643699686-project Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance d19cd5ee-f610-4a5a-9983-e233f32596f1 could not be found. Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'd19cd5ee-f610-4a5a-9983-e233f32596f1'} Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d19cd5ee-f610-4a5a-9983-e233f32596f1 could not be found. Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d19cd5ee-f610-4a5a-9983-e233f32596f1 could not be found. Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:12.123087 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:12.130778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:12.130778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:12.130778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:12.130778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:12.130778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:29:12.130778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:29:12.130778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d19cd5ee-f610-4a5a-9983-e233f32596f1 could not be found. Aug 09 17:29:12.130778 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:12.130778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] Returning 404 to user: Instance d19cd5ee-f610-4a5a-9983-e233f32596f1 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:12.130778 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5d529d1-04e2-45a3-8769-0c54db3541ed tempest-ServerRescueNegativeTestJSON-1643699686 tempest-ServerRescueNegativeTestJSON-1643699686-project] 10.222.0.93 "GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1" status: 404 len: 111 microversion: 2.1 time: 0.162319 Aug 09 17:29:12.135673 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1918/4009] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:11 2022] GET /compute/v2.1/servers/d19cd5ee-f610-4a5a-9983-e233f32596f1 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:29:12.235703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-146c6eb2-060d-47ca-9242-53bb357783c6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:12.238472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-146c6eb2-060d-47ca-9242-53bb357783c6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:12.254106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-146c6eb2-060d-47ca-9242-53bb357783c6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:12.254653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-146c6eb2-060d-47ca-9242-53bb357783c6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:12.258914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-146c6eb2-060d-47ca-9242-53bb357783c6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:12.259751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-146c6eb2-060d-47ca-9242-53bb357783c6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:12.261033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-146c6eb2-060d-47ca-9242-53bb357783c6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:12.261525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-146c6eb2-060d-47ca-9242-53bb357783c6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:12.350324 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-146c6eb2-060d-47ca-9242-53bb357783c6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119059 Aug 09 17:29:12.357684 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1919/4010] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:29:12 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:29:12.983439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bc2b7434-427e-4b15-b576-a7498721c0d8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:12.984336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bc2b7434-427e-4b15-b576-a7498721c0d8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:13.001764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc2b7434-427e-4b15-b576-a7498721c0d8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:13.001764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc2b7434-427e-4b15-b576-a7498721c0d8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:13.019066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc2b7434-427e-4b15-b576-a7498721c0d8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:13.023372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc2b7434-427e-4b15-b576-a7498721c0d8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:13.023909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc2b7434-427e-4b15-b576-a7498721c0d8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:13.024565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc2b7434-427e-4b15-b576-a7498721c0d8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:13.320711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:29:13.321451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:29:13.321928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:29:13.322505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:29:13.323046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:29:13.365124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:13.380059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:13.380966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:13.383591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:13.389535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:13.390675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:13.583275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Getting quotas for project 354ad7c984004cd1b1bd4a2058afb615. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:29:13.624505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Getting quotas for user d089ace53d1b4ad1bee793e97952705f and project 354ad7c984004cd1b1bd4a2058afb615. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:29:13.663992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:29:13.671582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:29:13.892919 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fa88c4be-fb66-42c1-8fe2-6b1eb9b5997e tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.562752 Aug 09 17:29:13.912273 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2092/4011] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:29:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 3591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:29:13.959575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8a0eb9b6-fac3-4051-94bb-7987f95eb145 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:13.983235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8a0eb9b6-fac3-4051-94bb-7987f95eb145 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:14.018766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a0eb9b6-fac3-4051-94bb-7987f95eb145 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:14.022698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a0eb9b6-fac3-4051-94bb-7987f95eb145 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:14.026344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a0eb9b6-fac3-4051-94bb-7987f95eb145 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:14.028087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a0eb9b6-fac3-4051-94bb-7987f95eb145 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:14.028783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a0eb9b6-fac3-4051-94bb-7987f95eb145 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:14.030722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a0eb9b6-fac3-4051-94bb-7987f95eb145 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:14.035955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:14.154788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8a0eb9b6-fac3-4051-94bb-7987f95eb145 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.240743 Aug 09 17:29:14.155993 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2093/4012] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:29:13 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900/os-volume_attachments => generated 25 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:29:14.177334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5e1bdf8f-adc8-4965-b8b5-9d4705a646af tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:14.178002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5e1bdf8f-adc8-4965-b8b5-9d4705a646af tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:14.471610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5e1bdf8f-adc8-4965-b8b5-9d4705a646af tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:14.517521 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5e1bdf8f-adc8-4965-b8b5-9d4705a646af tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1214 microversion: 2.1 time: 0.343617 Aug 09 17:29:14.520119 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2094/4013] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:14 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:14.534687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-966bd686-c56e-4d5a-9fd3-52bb81b060d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:14.535606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-966bd686-c56e-4d5a-9fd3-52bb81b060d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:14.580325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966bd686-c56e-4d5a-9fd3-52bb81b060d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:14.596540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966bd686-c56e-4d5a-9fd3-52bb81b060d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:14.597297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966bd686-c56e-4d5a-9fd3-52bb81b060d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:14.598661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966bd686-c56e-4d5a-9fd3-52bb81b060d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:14.600096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966bd686-c56e-4d5a-9fd3-52bb81b060d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:14.600892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-966bd686-c56e-4d5a-9fd3-52bb81b060d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:14.790321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-966bd686-c56e-4d5a-9fd3-52bb81b060d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:29:14.886251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bc2b7434-427e-4b15-b576-a7498721c0d8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:14.925003 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bc2b7434-427e-4b15-b576-a7498721c0d8 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1699 microversion: 2.1 time: 1.945191 Aug 09 17:29:14.936756 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1920/4014] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:12 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1699 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:15.175198 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-966bd686-c56e-4d5a-9fd3-52bb81b060d4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 204 len: 0 microversion: 2.1 time: 0.652397 Aug 09 17:29:15.179176 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2095/4015] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:29:14 2022] DELETE /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:29:15.194741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-29b5955d-b39b-40f1-919c-9ac08bece455 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:15.197278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-29b5955d-b39b-40f1-919c-9ac08bece455 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:15.230379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:15.239357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29b5955d-b39b-40f1-919c-9ac08bece455 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:15.244781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29b5955d-b39b-40f1-919c-9ac08bece455 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:15.251264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29b5955d-b39b-40f1-919c-9ac08bece455 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:15.254819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29b5955d-b39b-40f1-919c-9ac08bece455 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:15.264486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29b5955d-b39b-40f1-919c-9ac08bece455 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:15.265488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29b5955d-b39b-40f1-919c-9ac08bece455 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:15.541488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-13ecfdb7-4c1a-4db3-8e3c-10a0b3eb1563 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:15.542774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-13ecfdb7-4c1a-4db3-8e3c-10a0b3eb1563 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:15.805764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-29b5955d-b39b-40f1-919c-9ac08bece455 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:15.814993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13ecfdb7-4c1a-4db3-8e3c-10a0b3eb1563 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:15.832354 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-13ecfdb7-4c1a-4db3-8e3c-10a0b3eb1563 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1214 microversion: 2.1 time: 0.291271 Aug 09 17:29:15.834600 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2096/4016] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:15 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1214 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:15.839160 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-29b5955d-b39b-40f1-919c-9ac08bece455 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1679 microversion: 2.1 time: 0.654629 Aug 09 17:29:15.846060 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1921/4017] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:15 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1679 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:15.968360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea659cd8-2010-4062-b9c2-9b6abb6a98d0 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:15.969011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ea659cd8-2010-4062-b9c2-9b6abb6a98d0 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:16.005314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea659cd8-2010-4062-b9c2-9b6abb6a98d0 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:16.008566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea659cd8-2010-4062-b9c2-9b6abb6a98d0 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:16.009321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea659cd8-2010-4062-b9c2-9b6abb6a98d0 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:16.010291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea659cd8-2010-4062-b9c2-9b6abb6a98d0 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:16.018753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea659cd8-2010-4062-b9c2-9b6abb6a98d0 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:16.019230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea659cd8-2010-4062-b9c2-9b6abb6a98d0 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:16.235264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ea659cd8-2010-4062-b9c2-9b6abb6a98d0 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:16.281494 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ea659cd8-2010-4062-b9c2-9b6abb6a98d0 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1631 microversion: 2.1 time: 0.325613 Aug 09 17:29:16.285892 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2097/4018] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:15 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1631 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:16.878129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72121534-f4d0-4830-9113-32d43ceab3f2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:16.881334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-72121534-f4d0-4830-9113-32d43ceab3f2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:16.882169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ab2e5082-6a9e-4b51-b396-57456f6022fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:16.885512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ab2e5082-6a9e-4b51-b396-57456f6022fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:16.915206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72121534-f4d0-4830-9113-32d43ceab3f2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:16.921164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72121534-f4d0-4830-9113-32d43ceab3f2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:16.922454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72121534-f4d0-4830-9113-32d43ceab3f2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:16.924628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72121534-f4d0-4830-9113-32d43ceab3f2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:16.925917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72121534-f4d0-4830-9113-32d43ceab3f2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:16.929599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72121534-f4d0-4830-9113-32d43ceab3f2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:16.943565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e5082-6a9e-4b51-b396-57456f6022fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:16.947872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e5082-6a9e-4b51-b396-57456f6022fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:16.952099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e5082-6a9e-4b51-b396-57456f6022fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:16.957882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e5082-6a9e-4b51-b396-57456f6022fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:16.961042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e5082-6a9e-4b51-b396-57456f6022fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:16.968558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab2e5082-6a9e-4b51-b396-57456f6022fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:17.479367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-72121534-f4d0-4830-9113-32d43ceab3f2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:17.508335 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72121534-f4d0-4830-9113-32d43ceab3f2 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1284 microversion: 2.1 time: 0.637001 Aug 09 17:29:17.527662 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1922/4019] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:16 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1284 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:17.535366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0ff8e7ef-ae04-44db-bc15-7744ebb2939a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:17.546652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0ff8e7ef-ae04-44db-bc15-7744ebb2939a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:17.576422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff8e7ef-ae04-44db-bc15-7744ebb2939a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:17.578178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff8e7ef-ae04-44db-bc15-7744ebb2939a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:17.581215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff8e7ef-ae04-44db-bc15-7744ebb2939a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:17.587609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff8e7ef-ae04-44db-bc15-7744ebb2939a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:17.588898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff8e7ef-ae04-44db-bc15-7744ebb2939a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:17.589805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ff8e7ef-ae04-44db-bc15-7744ebb2939a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:17.772623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:17.962032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:18.143907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ab2e5082-6a9e-4b51-b396-57456f6022fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:18.196393 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ab2e5082-6a9e-4b51-b396-57456f6022fc tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1679 microversion: 2.1 time: 1.318563 Aug 09 17:29:18.199229 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2098/4020] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:16 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1679 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:18.218077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f1c3d030-e25a-45d9-9613-06806e685573 req-619b0bee-2c3b-43e9-a9f1-a3b1584214ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aec690-8061-4bc1-9094-114cf9ecd9a0", "name": "network-vif-deleted", "tag": "a2687548-41ba-453b-8009-ddf9b7632a3c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:18.250037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f1c3d030-e25a-45d9-9613-06806e685573 req-619b0bee-2c3b-43e9-a9f1-a3b1584214ee service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:18.251025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f1c3d030-e25a-45d9-9613-06806e685573 req-619b0bee-2c3b-43e9-a9f1-a3b1584214ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:18.252405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f1c3d030-e25a-45d9-9613-06806e685573 req-619b0bee-2c3b-43e9-a9f1-a3b1584214ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:18.304429 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f1c3d030-e25a-45d9-9613-06806e685573 req-619b0bee-2c3b-43e9-a9f1-a3b1584214ee service nova] Creating event network-vif-deleted:a2687548-41ba-453b-8009-ddf9b7632a3c for instance 19aec690-8061-4bc1-9094-114cf9ecd9a0 on n-h1-845781-6 Aug 09 17:29:18.321717 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f1c3d030-e25a-45d9-9613-06806e685573 req-619b0bee-2c3b-43e9-a9f1-a3b1584214ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118727 Aug 09 17:29:18.329596 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2099/4021] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:18.347835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:18.352202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:18.363171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:18.397861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:18.397861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:18.397861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:18.397861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:18.397861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:18.403124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:18.448193 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c HTTP/1.1 Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '77c06398-1bb3-44b1-bc17-4db4dfd8294c'} Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:29:18.461343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:18.469498 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b12e00e-0035-4962-a037-13a95ce6fe0f tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "DELETE /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 404 len: 111 microversion: 2.1 time: 0.132839 Aug 09 17:29:18.472438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0ff8e7ef-ae04-44db-bc15-7744ebb2939a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b19539de8745b4885239b5c5eaa34d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ae6d27589644c9962214f14b27cb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:18.479028 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2100/4022] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:29:18 2022] DELETE /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:29:18.487154 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0ff8e7ef-ae04-44db-bc15-7744ebb2939a tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 200 len: 1631 microversion: 2.1 time: 0.973755 Aug 09 17:29:18.492049 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1923/4023] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:17 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 1631 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:18.499699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:18.501383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 77c06398-1bb3-44b1-bc17-4db4dfd8294c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:18.528389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:18.529740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:18.530846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:18.543051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c9959695-795f-41b1-b9c2-7b8d29aad430 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:18.544159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c9959695-795f-41b1-b9c2-7b8d29aad430 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:18.556234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:18.557383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:18.558539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:18.559389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9959695-795f-41b1-b9c2-7b8d29aad430 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:18.562902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9959695-795f-41b1-b9c2-7b8d29aad430 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:18.565624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9959695-795f-41b1-b9c2-7b8d29aad430 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:18.567139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9959695-795f-41b1-b9c2-7b8d29aad430 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:18.569107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9959695-795f-41b1-b9c2-7b8d29aad430 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:18.573217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9959695-795f-41b1-b9c2-7b8d29aad430 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:18.658052 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c HTTP/1.1 Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '77c06398-1bb3-44b1-bc17-4db4dfd8294c'} Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:18.668405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:18.680601 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:18.680601 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:18.680601 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:18.680601 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:29:18.680601 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:29:18.680601 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. Aug 09 17:29:18.680601 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:18.680601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 77c06398-1bb3-44b1-bc17-4db4dfd8294c could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:18.680601 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b56b4514-91b7-4430-acd9-b1d74c336683 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c" status: 404 len: 111 microversion: 2.1 time: 0.197994 Aug 09 17:29:18.687598 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2101/4024] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:18 2022] GET /compute/v2.1/servers/77c06398-1bb3-44b1-bc17-4db4dfd8294c => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:29:18.710615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c5c1ae9e-8a3f-47b0-abbb-cfbe8c99e7ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:18.711242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c5c1ae9e-8a3f-47b0-abbb-cfbe8c99e7ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:18.740901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5c1ae9e-8a3f-47b0-abbb-cfbe8c99e7ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:18.743244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5c1ae9e-8a3f-47b0-abbb-cfbe8c99e7ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:18.744844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5c1ae9e-8a3f-47b0-abbb-cfbe8c99e7ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:18.748261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5c1ae9e-8a3f-47b0-abbb-cfbe8c99e7ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:18.751946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5c1ae9e-8a3f-47b0-abbb-cfbe8c99e7ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:18.755518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5c1ae9e-8a3f-47b0-abbb-cfbe8c99e7ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:18.876765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c5c1ae9e-8a3f-47b0-abbb-cfbe8c99e7ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:29:19.137930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c9959695-795f-41b1-b9c2-7b8d29aad430 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:19.158008 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c5c1ae9e-8a3f-47b0-abbb-cfbe8c99e7ac tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 204 len: 0 microversion: 2.1 time: 0.462200 Aug 09 17:29:19.160665 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c9959695-795f-41b1-b9c2-7b8d29aad430 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1272 microversion: 2.1 time: 0.620986 Aug 09 17:29:19.161658 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2102/4025] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:29:18 2022] DELETE /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:29:19.163047 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1924/4026] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:18 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1272 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:19.181445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-15630097-5431-4e21-b352-fee8f6fbe8e8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:19.182365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-15630097-5431-4e21-b352-fee8f6fbe8e8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:19.214444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15630097-5431-4e21-b352-fee8f6fbe8e8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:19.214925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15630097-5431-4e21-b352-fee8f6fbe8e8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:19.215390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15630097-5431-4e21-b352-fee8f6fbe8e8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:19.221264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15630097-5431-4e21-b352-fee8f6fbe8e8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:19.222866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15630097-5431-4e21-b352-fee8f6fbe8e8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:19.223328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15630097-5431-4e21-b352-fee8f6fbe8e8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:19.262350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-260acdcb-c40a-417e-8af1-3d55cb9da21c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:19.289111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-260acdcb-c40a-417e-8af1-3d55cb9da21c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:19.314059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-260acdcb-c40a-417e-8af1-3d55cb9da21c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:19.324297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-260acdcb-c40a-417e-8af1-3d55cb9da21c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:19.325463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-260acdcb-c40a-417e-8af1-3d55cb9da21c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:19.326922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-260acdcb-c40a-417e-8af1-3d55cb9da21c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:19.330386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-260acdcb-c40a-417e-8af1-3d55cb9da21c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:19.341164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-260acdcb-c40a-417e-8af1-3d55cb9da21c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:19.631869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-15630097-5431-4e21-b352-fee8f6fbe8e8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:19.648552 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-15630097-5431-4e21-b352-fee8f6fbe8e8 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1510 microversion: 2.1 time: 0.481052 Aug 09 17:29:19.649149 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2103/4027] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:19 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1510 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:19.664926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:19.682207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] [instance: 19aec690-8061-4bc1-9094-114cf9ecd9a0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:19.697912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:19.698416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:19.698901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:19.699667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:19.700146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:19.704721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:19.742422 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] HTTP exception thrown: Instance 19aec690-8061-4bc1-9094-114cf9ecd9a0 could not be found. Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Request method failure captured: Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 HTTP/1.1 Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pj-7E6W0UpRgNP6RB1w-wBQ00J8RQ8KH8lPlYNSRbcpICILngrAKYTmjISLk1N2TjWyj89r-8j8xR-Wl_VwRjciyvA6PJfN-Br_6_c-ACTI6eKNvdDVzfjWUFoam4PoctXVd0ine9-Y-7UOeN1RtL_4qJbc6SKa7wFtaupC1GMgT-Q Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: f6ae6d27589644c9962214f14b27cb36 Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestJSON-845885865 Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f6ae6d27589644c9962214f14b27cb36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f6ae6d27589644c9962214f14b27cb36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f6ae6d27589644c9962214f14b27cb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f6ae6d27589644c9962214f14b27cb36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestJSON-845885865 Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: f6ae6d27589644c9962214f14b27cb36 Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestJSON-845885865 Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestJSON-845885865-project Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 79b19539de8745b4885239b5c5eaa34d Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestJSON-845885865-project Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 19aec690-8061-4bc1-9094-114cf9ecd9a0 could not be found. Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '19aec690-8061-4bc1-9094-114cf9ecd9a0'} Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19aec690-8061-4bc1-9094-114cf9ecd9a0 could not be found. Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19aec690-8061-4bc1-9094-114cf9ecd9a0 could not be found. Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:19.746807 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:19.751238 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:19.751238 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:19.751238 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:29:19.751238 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:29:19.751238 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19aec690-8061-4bc1-9094-114cf9ecd9a0 could not be found. Aug 09 17:29:19.751238 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:19.757126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Returning 404 to user: Instance 19aec690-8061-4bc1-9094-114cf9ecd9a0 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:19.760544 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9d4b1b6c-1de4-4b9e-af24-d16682d17f68 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0" status: 404 len: 111 microversion: 2.1 time: 0.108972 Aug 09 17:29:19.762792 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2104/4028] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:19 2022] GET /compute/v2.1/servers/19aec690-8061-4bc1-9094-114cf9ecd9a0 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:29:19.775720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8bbabef7-6322-43ce-8418-0d0f5f0335e2 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] Calling method '.version_select at 0x7fbbca6b08b0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:19.832079 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8bbabef7-6322-43ce-8418-0d0f5f0335e2 tempest-ServersTestJSON-845885865 tempest-ServersTestJSON-845885865-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-216730259" status: 202 len: 0 microversion: 2.1 time: 0.063618 Aug 09 17:29:19.833469 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2105/4029] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:29:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-216730259 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:29:20.205676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1a220e5c-9591-433e-84fb-a912adf989bd tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:20.206675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1a220e5c-9591-433e-84fb-a912adf989bd tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:20.214761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a220e5c-9591-433e-84fb-a912adf989bd tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:20.215269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a220e5c-9591-433e-84fb-a912adf989bd tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:20.215810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a220e5c-9591-433e-84fb-a912adf989bd tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:20.216717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a220e5c-9591-433e-84fb-a912adf989bd tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:20.217194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a220e5c-9591-433e-84fb-a912adf989bd tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:20.217629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a220e5c-9591-433e-84fb-a912adf989bd tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:20.384970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a220e5c-9591-433e-84fb-a912adf989bd tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:20.404559 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1a220e5c-9591-433e-84fb-a912adf989bd tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1272 microversion: 2.1 time: 0.201785 Aug 09 17:29:20.442052 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2106/4030] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:20 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:29:20.681734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b59b8a65-063f-4aa6-ad7a-6c8302f77ff0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:20.683152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b59b8a65-063f-4aa6-ad7a-6c8302f77ff0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:20.704552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b59b8a65-063f-4aa6-ad7a-6c8302f77ff0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:20.707173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b59b8a65-063f-4aa6-ad7a-6c8302f77ff0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:20.708007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b59b8a65-063f-4aa6-ad7a-6c8302f77ff0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:20.714442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b59b8a65-063f-4aa6-ad7a-6c8302f77ff0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:20.715059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b59b8a65-063f-4aa6-ad7a-6c8302f77ff0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:20.717011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b59b8a65-063f-4aa6-ad7a-6c8302f77ff0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:20.894792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-260acdcb-c40a-417e-8af1-3d55cb9da21c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:20.944738 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-260acdcb-c40a-417e-8af1-3d55cb9da21c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1679 microversion: 2.1 time: 1.688472 Aug 09 17:29:20.945467 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1925/4031] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:19 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1679 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:20.959027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-1fc05794-3f1f-4dd1-9b02-7d278410f70c req-1a4d6048-5886-43ab-8d1c-03f9e183d2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76b7ec8-ebd0-4b60-b546-a0b6a5f52900", "name": "network-vif-unplugged", "status": "completed", "tag": "a4f89caf-3c2a-4f3e-8236-df4de064b99d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:21.020871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1fc05794-3f1f-4dd1-9b02-7d278410f70c req-1a4d6048-5886-43ab-8d1c-03f9e183d2f5 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:21.021997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1fc05794-3f1f-4dd1-9b02-7d278410f70c req-1a4d6048-5886-43ab-8d1c-03f9e183d2f5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:21.032782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1fc05794-3f1f-4dd1-9b02-7d278410f70c req-1a4d6048-5886-43ab-8d1c-03f9e183d2f5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:21.079366 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-1fc05794-3f1f-4dd1-9b02-7d278410f70c req-1a4d6048-5886-43ab-8d1c-03f9e183d2f5 service nova] Creating event network-vif-unplugged:a4f89caf-3c2a-4f3e-8236-df4de064b99d for instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 on n-h1-845781-6 Aug 09 17:29:21.113570 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-1fc05794-3f1f-4dd1-9b02-7d278410f70c req-1a4d6048-5886-43ab-8d1c-03f9e183d2f5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166003 Aug 09 17:29:21.118863 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1926/4032] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:21.186272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b59b8a65-063f-4aa6-ad7a-6c8302f77ff0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:21.214971 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b59b8a65-063f-4aa6-ad7a-6c8302f77ff0 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1510 microversion: 2.1 time: 0.545503 Aug 09 17:29:21.216725 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2107/4033] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:20 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1510 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:21.432876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-129f50c9-153e-44d8-83f8-16cc5adb2526 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:21.434299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-129f50c9-153e-44d8-83f8-16cc5adb2526 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:21.470070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f50c9-153e-44d8-83f8-16cc5adb2526 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:21.471573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f50c9-153e-44d8-83f8-16cc5adb2526 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:21.473796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f50c9-153e-44d8-83f8-16cc5adb2526 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:21.476326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f50c9-153e-44d8-83f8-16cc5adb2526 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:21.491208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f50c9-153e-44d8-83f8-16cc5adb2526 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:21.491964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-129f50c9-153e-44d8-83f8-16cc5adb2526 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:21.862346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-129f50c9-153e-44d8-83f8-16cc5adb2526 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:21.892598 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-129f50c9-153e-44d8-83f8-16cc5adb2526 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1272 microversion: 2.1 time: 0.466491 Aug 09 17:29:21.901068 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1927/4034] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:21 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1272 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:21.994420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-004938fb-9583-4d9d-8366-77042a87312f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:21.995476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-004938fb-9583-4d9d-8366-77042a87312f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:22.021396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004938fb-9583-4d9d-8366-77042a87312f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:22.025139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004938fb-9583-4d9d-8366-77042a87312f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:22.026262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004938fb-9583-4d9d-8366-77042a87312f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:22.032625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004938fb-9583-4d9d-8366-77042a87312f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:22.040028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004938fb-9583-4d9d-8366-77042a87312f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:22.041325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-004938fb-9583-4d9d-8366-77042a87312f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:22.249810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9e7204b8-508b-447b-b6b0-e533088529dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:22.259141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9e7204b8-508b-447b-b6b0-e533088529dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:22.268793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e7204b8-508b-447b-b6b0-e533088529dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:22.276593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e7204b8-508b-447b-b6b0-e533088529dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:22.277334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e7204b8-508b-447b-b6b0-e533088529dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:22.278279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e7204b8-508b-447b-b6b0-e533088529dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:22.279469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e7204b8-508b-447b-b6b0-e533088529dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:22.280168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e7204b8-508b-447b-b6b0-e533088529dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:22.323346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:22.401899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-004938fb-9583-4d9d-8366-77042a87312f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:22.429789 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-004938fb-9583-4d9d-8366-77042a87312f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1679 microversion: 2.1 time: 0.439877 Aug 09 17:29:22.434953 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2108/4035] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:21 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1679 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:22.947604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb0bc291-3237-48a0-b490-1f326ac9412a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:22.949232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eb0bc291-3237-48a0-b490-1f326ac9412a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:22.966721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb0bc291-3237-48a0-b490-1f326ac9412a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:22.971366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb0bc291-3237-48a0-b490-1f326ac9412a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:22.975583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb0bc291-3237-48a0-b490-1f326ac9412a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:22.981608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb0bc291-3237-48a0-b490-1f326ac9412a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:22.982562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb0bc291-3237-48a0-b490-1f326ac9412a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:22.983192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb0bc291-3237-48a0-b490-1f326ac9412a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:23.433571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eb0bc291-3237-48a0-b490-1f326ac9412a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:23.446486 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eb0bc291-3237-48a0-b490-1f326ac9412a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1314 microversion: 2.1 time: 0.509820 Aug 09 17:29:23.464862 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2109/4036] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:22 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:23.480302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e865e015-db13-45af-aae5-5bdb074ae6bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:23.481345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e865e015-db13-45af-aae5-5bdb074ae6bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:23.483239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:23.512070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865e015-db13-45af-aae5-5bdb074ae6bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:23.516291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865e015-db13-45af-aae5-5bdb074ae6bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:23.518725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865e015-db13-45af-aae5-5bdb074ae6bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:23.520295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865e015-db13-45af-aae5-5bdb074ae6bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:23.522000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865e015-db13-45af-aae5-5bdb074ae6bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:23.524625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e865e015-db13-45af-aae5-5bdb074ae6bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:23.976586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9e7204b8-508b-447b-b6b0-e533088529dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:23.998297 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9e7204b8-508b-447b-b6b0-e533088529dc tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1510 microversion: 2.1 time: 1.757967 Aug 09 17:29:23.998911 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1928/4037] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:22 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1510 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:29:24.210234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e865e015-db13-45af-aae5-5bdb074ae6bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:24.230428 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e865e015-db13-45af-aae5-5bdb074ae6bb tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1679 microversion: 2.1 time: 0.751226 Aug 09 17:29:24.235453 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2110/4038] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:23 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1679 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:29:24.477136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6171dad8-9a2b-420f-a7da-7121f096a060 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:24.485857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6171dad8-9a2b-420f-a7da-7121f096a060 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:24.509586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6171dad8-9a2b-420f-a7da-7121f096a060 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:24.518030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6171dad8-9a2b-420f-a7da-7121f096a060 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:24.519121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6171dad8-9a2b-420f-a7da-7121f096a060 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:24.522924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6171dad8-9a2b-420f-a7da-7121f096a060 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:24.527326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6171dad8-9a2b-420f-a7da-7121f096a060 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:24.528552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6171dad8-9a2b-420f-a7da-7121f096a060 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:25.021488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93a00b2a-6924-4bd4-afdf-8ccd3686e82e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:25.022357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-93a00b2a-6924-4bd4-afdf-8ccd3686e82e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:25.042641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a00b2a-6924-4bd4-afdf-8ccd3686e82e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:25.044814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a00b2a-6924-4bd4-afdf-8ccd3686e82e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:25.047687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a00b2a-6924-4bd4-afdf-8ccd3686e82e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:25.050424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a00b2a-6924-4bd4-afdf-8ccd3686e82e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:25.056736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a00b2a-6924-4bd4-afdf-8ccd3686e82e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:25.059081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a00b2a-6924-4bd4-afdf-8ccd3686e82e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:25.620986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-93a00b2a-6924-4bd4-afdf-8ccd3686e82e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:25.631264 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-93a00b2a-6924-4bd4-afdf-8ccd3686e82e tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1510 microversion: 2.1 time: 0.613485 Aug 09 17:29:25.638618 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2111/4039] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:25 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1510 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:29:25.644479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26a4f3a8-2ba9-48e2-b5ec-142bc2676ef4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:25.653757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-26a4f3a8-2ba9-48e2-b5ec-142bc2676ef4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:25.677212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a4f3a8-2ba9-48e2-b5ec-142bc2676ef4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:25.678529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a4f3a8-2ba9-48e2-b5ec-142bc2676ef4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:25.679268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a4f3a8-2ba9-48e2-b5ec-142bc2676ef4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:25.680375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a4f3a8-2ba9-48e2-b5ec-142bc2676ef4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:25.681113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a4f3a8-2ba9-48e2-b5ec-142bc2676ef4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:25.682078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a4f3a8-2ba9-48e2-b5ec-142bc2676ef4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:25.686034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:25.824717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:25.905688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-26a4f3a8-2ba9-48e2-b5ec-142bc2676ef4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:25.931954 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-26a4f3a8-2ba9-48e2-b5ec-142bc2676ef4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1612 microversion: 2.1 time: 0.291843 Aug 09 17:29:25.933740 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2112/4040] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:25 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1612 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:25.968635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9bad7353-8906-4eaa-9773-466a1de3f966 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:25.970686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9bad7353-8906-4eaa-9773-466a1de3f966 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:25.992015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bad7353-8906-4eaa-9773-466a1de3f966 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:26.003392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bad7353-8906-4eaa-9773-466a1de3f966 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:26.003392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bad7353-8906-4eaa-9773-466a1de3f966 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:26.004640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bad7353-8906-4eaa-9773-466a1de3f966 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:26.005462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bad7353-8906-4eaa-9773-466a1de3f966 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:26.006797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bad7353-8906-4eaa-9773-466a1de3f966 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:26.616591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6171dad8-9a2b-420f-a7da-7121f096a060 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:26.642972 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6171dad8-9a2b-420f-a7da-7121f096a060 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1314 microversion: 2.1 time: 2.173297 Aug 09 17:29:26.658024 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1929/4041] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:24 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1314 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:26.672938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ec98f78d-9ce9-447a-aae6-f87acb3712f6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:26.673957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ec98f78d-9ce9-447a-aae6-f87acb3712f6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:26.691225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec98f78d-9ce9-447a-aae6-f87acb3712f6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:26.692205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec98f78d-9ce9-447a-aae6-f87acb3712f6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:26.694074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec98f78d-9ce9-447a-aae6-f87acb3712f6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:26.696519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec98f78d-9ce9-447a-aae6-f87acb3712f6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:26.700184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec98f78d-9ce9-447a-aae6-f87acb3712f6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:26.704555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec98f78d-9ce9-447a-aae6-f87acb3712f6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:26.969314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9bad7353-8906-4eaa-9773-466a1de3f966 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:27.009918 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9bad7353-8906-4eaa-9773-466a1de3f966 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.050160 Aug 09 17:29:27.013373 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2113/4042] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:25 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:27.069683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec689cba-ba88-4034-93bc-83427813c608 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:27.070998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ec689cba-ba88-4034-93bc-83427813c608 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:27.091659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec689cba-ba88-4034-93bc-83427813c608 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:27.091659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec689cba-ba88-4034-93bc-83427813c608 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:27.091659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec689cba-ba88-4034-93bc-83427813c608 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:27.091659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec689cba-ba88-4034-93bc-83427813c608 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:27.095115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec689cba-ba88-4034-93bc-83427813c608 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:27.106003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec689cba-ba88-4034-93bc-83427813c608 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:27.199955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ec98f78d-9ce9-447a-aae6-f87acb3712f6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c49c4b6c28441b3aec0f642e889b9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca6dd79a86743838bd94d3dfe74ef80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:27.221333 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ec98f78d-9ce9-447a-aae6-f87acb3712f6 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 200 len: 1468 microversion: 2.1 time: 0.553970 Aug 09 17:29:27.247696 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1930/4043] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:26 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 1468 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:29:27.257120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-855e28c7-6a2b-4ff8-92c6-32bc0fd4e771 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:27.265088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-855e28c7-6a2b-4ff8-92c6-32bc0fd4e771 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:27.283008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-855e28c7-6a2b-4ff8-92c6-32bc0fd4e771 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:27.301311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-855e28c7-6a2b-4ff8-92c6-32bc0fd4e771 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:27.301985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-855e28c7-6a2b-4ff8-92c6-32bc0fd4e771 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:27.303576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-855e28c7-6a2b-4ff8-92c6-32bc0fd4e771 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:27.304276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-855e28c7-6a2b-4ff8-92c6-32bc0fd4e771 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:27.304901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-855e28c7-6a2b-4ff8-92c6-32bc0fd4e771 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:27.956027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ec689cba-ba88-4034-93bc-83427813c608 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:28.012150 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ec689cba-ba88-4034-93bc-83427813c608 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 200 len: 1612 microversion: 2.1 time: 0.994516 Aug 09 17:29:28.019045 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2114/4044] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:27 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 1612 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:28.048842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-28c20c08-1dfe-40c8-af73-bbca80e8e223 req-37e5e44f-b6eb-4874-83b3-aa565f13888d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af26977-0da1-475d-b754-4460e79e4fc3", "name": "network-vif-deleted", "tag": "81270b4a-19dd-474c-8c8e-456472b48c81"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:28.104539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28c20c08-1dfe-40c8-af73-bbca80e8e223 req-37e5e44f-b6eb-4874-83b3-aa565f13888d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:28.106583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28c20c08-1dfe-40c8-af73-bbca80e8e223 req-37e5e44f-b6eb-4874-83b3-aa565f13888d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:28.107984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-28c20c08-1dfe-40c8-af73-bbca80e8e223 req-37e5e44f-b6eb-4874-83b3-aa565f13888d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:28.142401 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-28c20c08-1dfe-40c8-af73-bbca80e8e223 req-37e5e44f-b6eb-4874-83b3-aa565f13888d service nova] Creating event network-vif-deleted:81270b4a-19dd-474c-8c8e-456472b48c81 for instance 9af26977-0da1-475d-b754-4460e79e4fc3 on n-h2-845781-6 Aug 09 17:29:28.156226 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-28c20c08-1dfe-40c8-af73-bbca80e8e223 req-37e5e44f-b6eb-4874-83b3-aa565f13888d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134088 Aug 09 17:29:28.158396 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2115/4045] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:28.172557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-15e33443-a16e-4405-9c32-e4c726610238 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:28.174655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-15e33443-a16e-4405-9c32-e4c726610238 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:28.194488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15e33443-a16e-4405-9c32-e4c726610238 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:28.196013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15e33443-a16e-4405-9c32-e4c726610238 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:28.197112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15e33443-a16e-4405-9c32-e4c726610238 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:28.199196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15e33443-a16e-4405-9c32-e4c726610238 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:28.200510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15e33443-a16e-4405-9c32-e4c726610238 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:28.201749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15e33443-a16e-4405-9c32-e4c726610238 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:28.692129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-855e28c7-6a2b-4ff8-92c6-32bc0fd4e771 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:28.706907 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-855e28c7-6a2b-4ff8-92c6-32bc0fd4e771 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.456807 Aug 09 17:29:28.709965 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1931/4046] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:27 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:28.725443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:28.728680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] [instance: 9af26977-0da1-475d-b754-4460e79e4fc3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:28.801268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:28.802067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:28.804317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:28.806117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:28.807563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:28.808574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:28.867058 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] HTTP exception thrown: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 could not be found. Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Request method failure captured: Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 HTTP/1.1 Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8phAef6KIANp7dtnb5yu-Ez3hrlsQ5JzrObJ0Lj61_5uYo4PM8cCDBEKJXMJ4aciC4KhDSqtMQRb8CGUVJGtsMdb9VA_SYp55UInCargWtN-fVDmUssU4bq28HdBmHlsiA98zM59b9V01MzIGwns_4myVq3MluIcXLt1HR-f4N7rNPE Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5ca6dd79a86743838bd94d3dfe74ef80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 5ca6dd79a86743838bd94d3dfe74ef80 Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1592603320 Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 2c49c4b6c28441b3aec0f642e889b9f4 Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestJSON-1592603320-project Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 could not be found. Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9af26977-0da1-475d-b754-4460e79e4fc3'} Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 could not be found. Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 could not be found. Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:28.876904 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:28.880815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:28.880815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:28.880815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:28.880815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:29:28.880815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:29:28.880815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 could not be found. Aug 09 17:29:28.880815 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:28.888761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] Returning 404 to user: Instance 9af26977-0da1-475d-b754-4460e79e4fc3 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:28.890293 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4dc2ef4c-a170-4081-9875-a974761c9a53 tempest-ServersNegativeTestJSON-1592603320 tempest-ServersNegativeTestJSON-1592603320-project] 10.222.0.93 "GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3" status: 404 len: 111 microversion: 2.1 time: 0.176452 Aug 09 17:29:28.891534 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1932/4047] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:28 2022] GET /compute/v2.1/servers/9af26977-0da1-475d-b754-4460e79e4fc3 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:29:28.899891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7b0d06d2-37d2-4567-9000-b010a4e90e07 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:28.900926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7b0d06d2-37d2-4567-9000-b010a4e90e07 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:28.916708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b0d06d2-37d2-4567-9000-b010a4e90e07 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:28.917827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b0d06d2-37d2-4567-9000-b010a4e90e07 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:28.918534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b0d06d2-37d2-4567-9000-b010a4e90e07 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:28.919523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b0d06d2-37d2-4567-9000-b010a4e90e07 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:28.920449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b0d06d2-37d2-4567-9000-b010a4e90e07 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:28.921096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b0d06d2-37d2-4567-9000-b010a4e90e07 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:29.770505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-15e33443-a16e-4405-9c32-e4c726610238 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:29.787412 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-15e33443-a16e-4405-9c32-e4c726610238 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1314 microversion: 2.1 time: 1.621056 Aug 09 17:29:29.788522 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2116/4048] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:28 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1314 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:29.793895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:29.801258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:29.815439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:29.820732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:29.822379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:29.823829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:29.824662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:29.825361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:29.880112 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 HTTP/1.1 Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'e76b7ec8-ebd0-4b60-b546-a0b6a5f52900'} Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:29.883453 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:29.887152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:29.887152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:29.887152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:29.887152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:29:29.887152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:29:29.887152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:29:29.887152 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:29:29.895866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:29.897833 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb1ee930-3e16-40a4-80ec-eee0e9fe8fbd tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 404 len: 111 microversion: 2.1 time: 0.108004 Aug 09 17:29:29.900812 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2117/4049] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:29 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:29:29.914981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3945114d-0256-42d5-9261-7f0de48d890b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '.version_select at 0x7fbbca6534c0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:30.009308 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3945114d-0256-42d5-9261-7f0de48d890b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-930844384" status: 202 len: 0 microversion: 2.1 time: 0.099604 Aug 09 17:29:30.012499 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2118/4050] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:29:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-930844384 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:29:30.055208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7b0d06d2-37d2-4567-9000-b010a4e90e07 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:30.072869 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7b0d06d2-37d2-4567-9000-b010a4e90e07 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.179552 Aug 09 17:29:30.094663 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1933/4051] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:28 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:30.115414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-56dce814-fcbe-4ec8-8c22-9e98b73b0513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-583429648"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:30.118529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-56dce814-fcbe-4ec8-8c22-9e98b73b0513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:30.129083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56dce814-fcbe-4ec8-8c22-9e98b73b0513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:30.129801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56dce814-fcbe-4ec8-8c22-9e98b73b0513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:30.130461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56dce814-fcbe-4ec8-8c22-9e98b73b0513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:30.132570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56dce814-fcbe-4ec8-8c22-9e98b73b0513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:30.133498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56dce814-fcbe-4ec8-8c22-9e98b73b0513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:30.134878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56dce814-fcbe-4ec8-8c22-9e98b73b0513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:30.608627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-6169dfcd-6e42-4793-ae4f-693a8f065dd0 req-bbad8ef6-6dc3-4be5-8e8e-c2aa7063c97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76b7ec8-ebd0-4b60-b546-a0b6a5f52900", "name": "network-vif-deleted", "tag": "a4f89caf-3c2a-4f3e-8236-df4de064b99d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:30.643060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6169dfcd-6e42-4793-ae4f-693a8f065dd0 req-bbad8ef6-6dc3-4be5-8e8e-c2aa7063c97c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:30.644190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6169dfcd-6e42-4793-ae4f-693a8f065dd0 req-bbad8ef6-6dc3-4be5-8e8e-c2aa7063c97c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:30.647843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6169dfcd-6e42-4793-ae4f-693a8f065dd0 req-bbad8ef6-6dc3-4be5-8e8e-c2aa7063c97c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:30.663069 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-56dce814-fcbe-4ec8-8c22-9e98b73b0513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.565146 Aug 09 17:29:30.667510 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2119/4052] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:29:30 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 09 17:29:30.681228 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-6169dfcd-6e42-4793-ae4f-693a8f065dd0 req-bbad8ef6-6dc3-4be5-8e8e-c2aa7063c97c service nova] Creating event network-vif-deleted:a4f89caf-3c2a-4f3e-8236-df4de064b99d for instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 on n-h1-845781-6 Aug 09 17:29:30.693848 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-6169dfcd-6e42-4793-ae4f-693a8f065dd0 req-bbad8ef6-6dc3-4be5-8e8e-c2aa7063c97c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090257 Aug 09 17:29:30.700512 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1934/4053] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:29:30.827176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-688ecbff-1b76-4872-a513-8dc598f103ed tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:30.857195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-688ecbff-1b76-4872-a513-8dc598f103ed tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:30.894413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-688ecbff-1b76-4872-a513-8dc598f103ed tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:30.895554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-688ecbff-1b76-4872-a513-8dc598f103ed tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:30.897503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-688ecbff-1b76-4872-a513-8dc598f103ed tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:30.909392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-688ecbff-1b76-4872-a513-8dc598f103ed tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:30.911996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-688ecbff-1b76-4872-a513-8dc598f103ed tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:30.913284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-688ecbff-1b76-4872-a513-8dc598f103ed tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:32.667479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-688ecbff-1b76-4872-a513-8dc598f103ed tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:32.685806 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-688ecbff-1b76-4872-a513-8dc598f103ed tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1314 microversion: 2.1 time: 1.876392 Aug 09 17:29:32.691534 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2120/4054] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:30 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1314 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:32.833078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-532145dd-17a8-42a1-bfc0-dea516b8cb36 req-491069df-c222-443f-896e-722d1d5bc1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217bec43-82d1-4aa1-91c3-806af7f3d575", "tag": "f8195a31-7a13-4b23-a5c4-f6a4cc4ca7d1"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:32.893567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-532145dd-17a8-42a1-bfc0-dea516b8cb36 req-491069df-c222-443f-896e-722d1d5bc1e5 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:32.894336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-532145dd-17a8-42a1-bfc0-dea516b8cb36 req-491069df-c222-443f-896e-722d1d5bc1e5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:32.895136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-532145dd-17a8-42a1-bfc0-dea516b8cb36 req-491069df-c222-443f-896e-722d1d5bc1e5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:32.962156 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-532145dd-17a8-42a1-bfc0-dea516b8cb36 req-491069df-c222-443f-896e-722d1d5bc1e5 service nova] Creating event network-changed:f8195a31-7a13-4b23-a5c4-f6a4cc4ca7d1 for instance 217bec43-82d1-4aa1-91c3-806af7f3d575 on n-h2-845781-6 Aug 09 17:29:32.994794 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-532145dd-17a8-42a1-bfc0-dea516b8cb36 req-491069df-c222-443f-896e-722d1d5bc1e5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171050 Aug 09 17:29:32.996372 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1935/4055] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:33.730598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df8ca365-30c5-4736-be05-153d0c6576f3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:33.731583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df8ca365-30c5-4736-be05-153d0c6576f3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:33.786625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df8ca365-30c5-4736-be05-153d0c6576f3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:33.792980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df8ca365-30c5-4736-be05-153d0c6576f3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:33.793871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df8ca365-30c5-4736-be05-153d0c6576f3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:33.797628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df8ca365-30c5-4736-be05-153d0c6576f3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:33.801345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df8ca365-30c5-4736-be05-153d0c6576f3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:33.805319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df8ca365-30c5-4736-be05-153d0c6576f3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:34.575475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-df8ca365-30c5-4736-be05-153d0c6576f3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:34.600219 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df8ca365-30c5-4736-be05-153d0c6576f3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1314 microversion: 2.1 time: 0.883443 Aug 09 17:29:34.601832 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2121/4056] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:33 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1314 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:35.637056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ffe8b94d-c3e2-40cb-ba3d-6fd72e179732 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:35.637955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ffe8b94d-c3e2-40cb-ba3d-6fd72e179732 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:35.654346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe8b94d-c3e2-40cb-ba3d-6fd72e179732 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:35.655095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe8b94d-c3e2-40cb-ba3d-6fd72e179732 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:35.655571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe8b94d-c3e2-40cb-ba3d-6fd72e179732 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:35.661263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe8b94d-c3e2-40cb-ba3d-6fd72e179732 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:35.662560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe8b94d-c3e2-40cb-ba3d-6fd72e179732 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:35.663199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ffe8b94d-c3e2-40cb-ba3d-6fd72e179732 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:36.391863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c984e0ab-e26d-4201-9b67-c64fd5eda4ea tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: .version_select at 0x7fbbcb68ef70>, body: {"keypair": {"name": "tempest-keypair-581868477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxUbxsOznIUpcPKK8k89J7J7bQS0T5zTXi7+y7G68H4QZSEwFS3G3S69PKDq3hN3lIE4aUIS+2whkvxP08zsful+knA0CoAfmCf4XReGUaQwLL1dQMIT577/z4q1aOgQg=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:36.484879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ffe8b94d-c3e2-40cb-ba3d-6fd72e179732 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:36.500159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c984e0ab-e26d-4201-9b67-c64fd5eda4ea tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:29:36.504631 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ffe8b94d-c3e2-40cb-ba3d-6fd72e179732 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1314 microversion: 2.1 time: 0.868198 Aug 09 17:29:36.519902 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1936/4057] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:35 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:36.525505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c984e0ab-e26d-4201-9b67-c64fd5eda4ea tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for user be0fad88d219437eaed454ba916c86e3 and project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:29:36.623944 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c984e0ab-e26d-4201-9b67-c64fd5eda4ea tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.236257 Aug 09 17:29:36.636172 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2122/4058] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:29:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:29:37.535926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c0680a0-176a-4d15-a8e4-9e82d7ad4a8d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:37.542917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c0680a0-176a-4d15-a8e4-9e82d7ad4a8d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:37.572201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c0680a0-176a-4d15-a8e4-9e82d7ad4a8d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:37.573158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c0680a0-176a-4d15-a8e4-9e82d7ad4a8d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:37.579728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c0680a0-176a-4d15-a8e4-9e82d7ad4a8d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:37.581387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c0680a0-176a-4d15-a8e4-9e82d7ad4a8d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:37.583354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c0680a0-176a-4d15-a8e4-9e82d7ad4a8d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:37.584410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c0680a0-176a-4d15-a8e4-9e82d7ad4a8d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:38.026078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-66b82992-3059-432b-9b3e-ea0a54a19c96 req-846fb56f-51b6-4c1e-9c10-442f116f2fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a30c674-6026-45bd-b50e-218ae7d69382", "name": "network-vif-plugged", "status": "completed", "tag": "a73935e9-c581-4296-b0ba-805a64e85308"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:38.071287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-66b82992-3059-432b-9b3e-ea0a54a19c96 req-846fb56f-51b6-4c1e-9c10-442f116f2fb0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:38.073207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-66b82992-3059-432b-9b3e-ea0a54a19c96 req-846fb56f-51b6-4c1e-9c10-442f116f2fb0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:38.074852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-66b82992-3059-432b-9b3e-ea0a54a19c96 req-846fb56f-51b6-4c1e-9c10-442f116f2fb0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:38.154913 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-66b82992-3059-432b-9b3e-ea0a54a19c96 req-846fb56f-51b6-4c1e-9c10-442f116f2fb0 service nova] Creating event network-vif-plugged:a73935e9-c581-4296-b0ba-805a64e85308 for instance 1a30c674-6026-45bd-b50e-218ae7d69382 on n-h2-845781-6 Aug 09 17:29:38.198745 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-66b82992-3059-432b-9b3e-ea0a54a19c96 req-846fb56f-51b6-4c1e-9c10-442f116f2fb0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.170043 Aug 09 17:29:38.202377 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1937/4059] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:39.065640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c0680a0-176a-4d15-a8e4-9e82d7ad4a8d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:39.104805 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c0680a0-176a-4d15-a8e4-9e82d7ad4a8d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1314 microversion: 2.1 time: 1.573183 Aug 09 17:29:39.112253 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2123/4060] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:37 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1314 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:40.137275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4763fa10-e820-4709-a4c6-583230075d43 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:40.138233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4763fa10-e820-4709-a4c6-583230075d43 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:40.192655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4763fa10-e820-4709-a4c6-583230075d43 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:40.192655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4763fa10-e820-4709-a4c6-583230075d43 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:40.196441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4763fa10-e820-4709-a4c6-583230075d43 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:40.212146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4763fa10-e820-4709-a4c6-583230075d43 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:40.214889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4763fa10-e820-4709-a4c6-583230075d43 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:40.218887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4763fa10-e820-4709-a4c6-583230075d43 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:40.262390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-118fb619-a201-46df-b4ac-022ad0c78acf req-ca9ce7e7-0c12-48c7-ad8a-6aa3e5c532c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217bec43-82d1-4aa1-91c3-806af7f3d575", "name": "network-vif-plugged", "status": "completed", "tag": "f8195a31-7a13-4b23-a5c4-f6a4cc4ca7d1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:40.306060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-118fb619-a201-46df-b4ac-022ad0c78acf req-ca9ce7e7-0c12-48c7-ad8a-6aa3e5c532c0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:40.306989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-118fb619-a201-46df-b4ac-022ad0c78acf req-ca9ce7e7-0c12-48c7-ad8a-6aa3e5c532c0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:40.307746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-118fb619-a201-46df-b4ac-022ad0c78acf req-ca9ce7e7-0c12-48c7-ad8a-6aa3e5c532c0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:40.329316 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-118fb619-a201-46df-b4ac-022ad0c78acf req-ca9ce7e7-0c12-48c7-ad8a-6aa3e5c532c0 service nova] Creating event network-vif-plugged:f8195a31-7a13-4b23-a5c4-f6a4cc4ca7d1 for instance 217bec43-82d1-4aa1-91c3-806af7f3d575 on n-h2-845781-6 Aug 09 17:29:40.338346 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-118fb619-a201-46df-b4ac-022ad0c78acf req-ca9ce7e7-0c12-48c7-ad8a-6aa3e5c532c0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087810 Aug 09 17:29:40.340169 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2124/4061] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:29:41.381505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4763fa10-e820-4709-a4c6-583230075d43 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:41.402285 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4763fa10-e820-4709-a4c6-583230075d43 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1314 microversion: 2.1 time: 1.276204 Aug 09 17:29:41.404799 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1938/4062] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:40 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1314 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:42.343366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1347965030", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "6187ea45-023f-4521-bbb9-c82ebca0dd88"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:42.440207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5612f7c5-5966-424f-a9f1-6c2dda8b8e70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:42.450084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5612f7c5-5966-424f-a9f1-6c2dda8b8e70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:42.498658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] validate_networks() for [('6187ea45-023f-4521-bbb9-c82ebca0dd88', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:29:42.502276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5612f7c5-5966-424f-a9f1-6c2dda8b8e70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:42.506591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5612f7c5-5966-424f-a9f1-6c2dda8b8e70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:42.507362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5612f7c5-5966-424f-a9f1-6c2dda8b8e70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:42.508315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5612f7c5-5966-424f-a9f1-6c2dda8b8e70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:42.508954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5612f7c5-5966-424f-a9f1-6c2dda8b8e70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:42.509984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5612f7c5-5966-424f-a9f1-6c2dda8b8e70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:43.700812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5612f7c5-5966-424f-a9f1-6c2dda8b8e70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:43.724842 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5612f7c5-5966-424f-a9f1-6c2dda8b8e70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1314 microversion: 2.1 time: 1.300571 Aug 09 17:29:43.734648 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1939/4063] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:42 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:29:44.783588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ddd1676f-c201-4bd2-bdeb-36786820f04b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:44.784735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ddd1676f-c201-4bd2-bdeb-36786820f04b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:44.825260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd1676f-c201-4bd2-bdeb-36786820f04b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:44.825756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd1676f-c201-4bd2-bdeb-36786820f04b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:44.826201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd1676f-c201-4bd2-bdeb-36786820f04b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:44.826940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd1676f-c201-4bd2-bdeb-36786820f04b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:44.827394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd1676f-c201-4bd2-bdeb-36786820f04b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:44.836570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd1676f-c201-4bd2-bdeb-36786820f04b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:45.296934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ddd1676f-c201-4bd2-bdeb-36786820f04b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:45.317529 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ddd1676f-c201-4bd2-bdeb-36786820f04b tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1500 microversion: 2.1 time: 0.537718 Aug 09 17:29:45.322756 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1940/4064] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:44 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1500 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:45.366484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fb812a45-f60a-4be6-9347-e145c4235ed1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:45.369441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fb812a45-f60a-4be6-9347-e145c4235ed1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:45.393155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb812a45-f60a-4be6-9347-e145c4235ed1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:45.395384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb812a45-f60a-4be6-9347-e145c4235ed1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:45.398263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb812a45-f60a-4be6-9347-e145c4235ed1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:45.402602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb812a45-f60a-4be6-9347-e145c4235ed1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:45.403491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb812a45-f60a-4be6-9347-e145c4235ed1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:45.409212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb812a45-f60a-4be6-9347-e145c4235ed1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:45.555899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-fb812a45-f60a-4be6-9347-e145c4235ed1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lazy-loading 'flavor' on Instance uuid 217bec43-82d1-4aa1-91c3-806af7f3d575 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:29:45.765967 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fb812a45-f60a-4be6-9347-e145c4235ed1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "POST /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575/action" status: 200 len: 32 microversion: 2.1 time: 0.406478 Aug 09 17:29:45.768010 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1941/4065] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:29:45 2022] POST /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575/action => generated 32 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:29:45.795147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-147f3aaf-6e45-4b35-a16e-1b2fcd41f559 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:45.797503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-147f3aaf-6e45-4b35-a16e-1b2fcd41f559 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:45.806941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=42 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:45.834596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f3aaf-6e45-4b35-a16e-1b2fcd41f559 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:45.838502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f3aaf-6e45-4b35-a16e-1b2fcd41f559 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:45.840818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f3aaf-6e45-4b35-a16e-1b2fcd41f559 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:45.847228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f3aaf-6e45-4b35-a16e-1b2fcd41f559 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:45.849639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f3aaf-6e45-4b35-a16e-1b2fcd41f559 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:45.850790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-147f3aaf-6e45-4b35-a16e-1b2fcd41f559 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:46.229256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:29:46.229915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:29:46.230613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:29:46.233901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:29:46.234663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:29:46.258785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:46.259978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:46.260720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:46.262138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:46.262946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:46.264288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:46.307486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Getting quotas for project 09c918eb23d448e8969eeaa234540d17. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:29:46.319744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Getting quotas for user c30f510a9ab840439bd71dd64389d406 and project 09c918eb23d448e8969eeaa234540d17. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:29:46.394267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:29:46.408628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:29:46.637966 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b554b3d2-e544-4aac-bae6-83afbd530197 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.582341 Aug 09 17:29:46.638801 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2125/4066] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:29:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:29:46.679725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-543d4acf-cc02-4083-b7c8-45a43d97d182 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:46.680892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-543d4acf-cc02-4083-b7c8-45a43d97d182 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:47.204259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-543d4acf-cc02-4083-b7c8-45a43d97d182 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:47.240267 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-543d4acf-cc02-4083-b7c8-45a43d97d182 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1228 microversion: 2.1 time: 0.584240 Aug 09 17:29:47.241608 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2126/4067] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:46 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1228 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:47.244969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-147f3aaf-6e45-4b35-a16e-1b2fcd41f559 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:47.258113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1513022591", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34fc5f4c-78d4-4016-ba62-ad51259fd9d6"}], "security_groups": [{"name": "tempest-securitygroup--1526631049"}], "key_name": "tempest-keypair-581868477", "user_data": "}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:47.281639 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-147f3aaf-6e45-4b35-a16e-1b2fcd41f559 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 1.496068 Aug 09 17:29:47.295273 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1942/4068] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:45 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:47.741524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] validate_networks() for [('34fc5f4c-78d4-4016-ba62-ad51259fd9d6', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:29:48.265520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a05278ba-3711-46fa-936c-3cefdd2bb86b tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:48.266277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a05278ba-3711-46fa-936c-3cefdd2bb86b tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:48.929126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a05278ba-3711-46fa-936c-3cefdd2bb86b tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:48.946797 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a05278ba-3711-46fa-936c-3cefdd2bb86b tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1228 microversion: 2.1 time: 0.686224 Aug 09 17:29:48.963074 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1943/4069] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:48 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1228 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:48.969783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6a9d1101-01ae-4745-a83f-01872f8b0964 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:48.970715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6a9d1101-01ae-4745-a83f-01872f8b0964 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:48.978207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9d1101-01ae-4745-a83f-01872f8b0964 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:48.979154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9d1101-01ae-4745-a83f-01872f8b0964 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:48.979842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9d1101-01ae-4745-a83f-01872f8b0964 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:48.980833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9d1101-01ae-4745-a83f-01872f8b0964 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:48.981493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9d1101-01ae-4745-a83f-01872f8b0964 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:48.982092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a9d1101-01ae-4745-a83f-01872f8b0964 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:49.325884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:50.638207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:29:50.638867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:29:50.639617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:29:50.640332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:29:50.641056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:29:50.690993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:50.694766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:50.695571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:50.696612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:50.697248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:50.697854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:50.747383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:29:50.760095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Getting quotas for user be0fad88d219437eaed454ba916c86e3 and project a8f7b3787cde4d1fb5c8d8f8557a83ce. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:29:50.806972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:29:50.821165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:29:51.071502 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0a2525f5-927c-479d-92d9-a821ad017cd5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.823458 Aug 09 17:29:51.085868 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2127/4070] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:29:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 3843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:29:51.118838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e10f9a8f-557f-44b3-9700-9be93d465a89 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:51.119694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e10f9a8f-557f-44b3-9700-9be93d465a89 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:51.156170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e10f9a8f-557f-44b3-9700-9be93d465a89 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:51.159614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e10f9a8f-557f-44b3-9700-9be93d465a89 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:51.167726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e10f9a8f-557f-44b3-9700-9be93d465a89 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:51.170299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e10f9a8f-557f-44b3-9700-9be93d465a89 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:51.172681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e10f9a8f-557f-44b3-9700-9be93d465a89 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:51.173816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e10f9a8f-557f-44b3-9700-9be93d465a89 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:51.209003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6a9d1101-01ae-4745-a83f-01872f8b0964 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:51.218139 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6a9d1101-01ae-4745-a83f-01872f8b0964 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 2.253526 Aug 09 17:29:51.218749 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1944/4071] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:48 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:51.242316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6a2ba065-fc6c-4530-a481-9b5b50c30335 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:51.259392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6a2ba065-fc6c-4530-a481-9b5b50c30335 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:51.677785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6a2ba065-fc6c-4530-a481-9b5b50c30335 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:51.712970 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6a2ba065-fc6c-4530-a481-9b5b50c30335 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1241 microversion: 2.1 time: 0.478762 Aug 09 17:29:51.713588 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1945/4072] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:51 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1241 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:52.183979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e10f9a8f-557f-44b3-9700-9be93d465a89 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:52.241564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-de1658bb-259a-4df2-8bec-382c11e6260a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:52.243099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-de1658bb-259a-4df2-8bec-382c11e6260a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:52.271958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de1658bb-259a-4df2-8bec-382c11e6260a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:52.272557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de1658bb-259a-4df2-8bec-382c11e6260a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:52.277454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de1658bb-259a-4df2-8bec-382c11e6260a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:52.287301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de1658bb-259a-4df2-8bec-382c11e6260a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:52.290335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de1658bb-259a-4df2-8bec-382c11e6260a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:52.298922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de1658bb-259a-4df2-8bec-382c11e6260a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:52.299287 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e10f9a8f-557f-44b3-9700-9be93d465a89 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1286 microversion: 2.1 time: 1.206076 Aug 09 17:29:52.307017 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2128/4073] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:51 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1286 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:52.398004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:52.813762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ee09ab50-95df-4ddf-aac1-e2df397a4f31 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:52.817165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ee09ab50-95df-4ddf-aac1-e2df397a4f31 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:53.351189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ee09ab50-95df-4ddf-aac1-e2df397a4f31 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:53.379368 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ee09ab50-95df-4ddf-aac1-e2df397a4f31 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1241 microversion: 2.1 time: 0.621824 Aug 09 17:29:53.396593 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2129/4074] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:52 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1241 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:53.414820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f71964a1-8c15-447a-ae28-6204deaf4cb9 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:53.429158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f71964a1-8c15-447a-ae28-6204deaf4cb9 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:53.478062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f71964a1-8c15-447a-ae28-6204deaf4cb9 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:53.479279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f71964a1-8c15-447a-ae28-6204deaf4cb9 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:53.484250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f71964a1-8c15-447a-ae28-6204deaf4cb9 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:53.491187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f71964a1-8c15-447a-ae28-6204deaf4cb9 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:53.496957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f71964a1-8c15-447a-ae28-6204deaf4cb9 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:53.497926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f71964a1-8c15-447a-ae28-6204deaf4cb9 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:53.532251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-de1658bb-259a-4df2-8bec-382c11e6260a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:53.561160 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-de1658bb-259a-4df2-8bec-382c11e6260a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 1.322388 Aug 09 17:29:53.566260 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1946/4075] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:52 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:53.908940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f71964a1-8c15-447a-ae28-6204deaf4cb9 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:53.935337 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f71964a1-8c15-447a-ae28-6204deaf4cb9 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1286 microversion: 2.1 time: 0.536290 Aug 09 17:29:53.952261 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2130/4076] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:53 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1286 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:54.441628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3eb7e0b9-2a40-42d6-9240-24665efd12ee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:54.443363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3eb7e0b9-2a40-42d6-9240-24665efd12ee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:54.490860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3eb7e0b9-2a40-42d6-9240-24665efd12ee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:54.491801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3eb7e0b9-2a40-42d6-9240-24665efd12ee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:54.492613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3eb7e0b9-2a40-42d6-9240-24665efd12ee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:54.493974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3eb7e0b9-2a40-42d6-9240-24665efd12ee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:54.494807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3eb7e0b9-2a40-42d6-9240-24665efd12ee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:54.495591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3eb7e0b9-2a40-42d6-9240-24665efd12ee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:54.593898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7efe5a4-b968-4928-8dba-ec562f58faa8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:54.596364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b7efe5a4-b968-4928-8dba-ec562f58faa8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:54.645450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7efe5a4-b968-4928-8dba-ec562f58faa8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:54.649650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7efe5a4-b968-4928-8dba-ec562f58faa8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:54.653897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7efe5a4-b968-4928-8dba-ec562f58faa8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:54.655448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7efe5a4-b968-4928-8dba-ec562f58faa8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:54.662568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7efe5a4-b968-4928-8dba-ec562f58faa8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:54.670471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7efe5a4-b968-4928-8dba-ec562f58faa8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:55.034856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3eb7e0b9-2a40-42d6-9240-24665efd12ee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:55.059949 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3eb7e0b9-2a40-42d6-9240-24665efd12ee tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1301 microversion: 2.1 time: 0.626154 Aug 09 17:29:55.078954 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1947/4077] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:54 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1301 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:55.087465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-62ec8e8e-3572-4bee-93a4-4178e9ef552f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:55.090144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-62ec8e8e-3572-4bee-93a4-4178e9ef552f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:55.144142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62ec8e8e-3572-4bee-93a4-4178e9ef552f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:55.155740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62ec8e8e-3572-4bee-93a4-4178e9ef552f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:55.159204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62ec8e8e-3572-4bee-93a4-4178e9ef552f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:55.161087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62ec8e8e-3572-4bee-93a4-4178e9ef552f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:55.163061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62ec8e8e-3572-4bee-93a4-4178e9ef552f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:55.163661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62ec8e8e-3572-4bee-93a4-4178e9ef552f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:55.467145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-62ec8e8e-3572-4bee-93a4-4178e9ef552f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:55.483011 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-62ec8e8e-3572-4bee-93a4-4178e9ef552f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1286 microversion: 2.1 time: 0.401727 Aug 09 17:29:55.484037 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1948/4078] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:55 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1286 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:55.550886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b7efe5a4-b968-4928-8dba-ec562f58faa8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:55.560747 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7efe5a4-b968-4928-8dba-ec562f58faa8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 0.972751 Aug 09 17:29:55.571183 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2131/4079] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:54 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:56.099965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5c37f98f-57c3-4008-9802-ad7e07ab8319 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:56.102218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5c37f98f-57c3-4008-9802-ad7e07ab8319 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:56.143240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c37f98f-57c3-4008-9802-ad7e07ab8319 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:56.144581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c37f98f-57c3-4008-9802-ad7e07ab8319 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:56.146539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c37f98f-57c3-4008-9802-ad7e07ab8319 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:56.149839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c37f98f-57c3-4008-9802-ad7e07ab8319 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:56.159269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c37f98f-57c3-4008-9802-ad7e07ab8319 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:56.160422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5c37f98f-57c3-4008-9802-ad7e07ab8319 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:56.513037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-096d7c0d-b213-4a64-96d9-57aecec28244 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:56.515153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-096d7c0d-b213-4a64-96d9-57aecec28244 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:56.570743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096d7c0d-b213-4a64-96d9-57aecec28244 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:56.571753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096d7c0d-b213-4a64-96d9-57aecec28244 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:56.572635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096d7c0d-b213-4a64-96d9-57aecec28244 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:56.577128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096d7c0d-b213-4a64-96d9-57aecec28244 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:56.579934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096d7c0d-b213-4a64-96d9-57aecec28244 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:56.581113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-096d7c0d-b213-4a64-96d9-57aecec28244 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:56.696207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:29:57.061304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5c37f98f-57c3-4008-9802-ad7e07ab8319 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:57.111311 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5c37f98f-57c3-4008-9802-ad7e07ab8319 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1299 microversion: 2.1 time: 1.022205 Aug 09 17:29:57.142213 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1949/4080] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:56 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1299 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:57.165070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6bf2b681-1dc5-4716-bb32-a6f6e940fef5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:57.169330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6bf2b681-1dc5-4716-bb32-a6f6e940fef5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:57.193502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf2b681-1dc5-4716-bb32-a6f6e940fef5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:57.196447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf2b681-1dc5-4716-bb32-a6f6e940fef5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:57.198248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf2b681-1dc5-4716-bb32-a6f6e940fef5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:57.218273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf2b681-1dc5-4716-bb32-a6f6e940fef5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:57.221669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf2b681-1dc5-4716-bb32-a6f6e940fef5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:57.225705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf2b681-1dc5-4716-bb32-a6f6e940fef5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:57.382982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-096d7c0d-b213-4a64-96d9-57aecec28244 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:57.396214 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-096d7c0d-b213-4a64-96d9-57aecec28244 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1328 microversion: 2.1 time: 0.890106 Aug 09 17:29:57.397731 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2132/4081] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:56 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1328 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:58.184318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e7937da-fe94-447b-b05d-f903c0a73e95 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:58.187913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8e7937da-fe94-447b-b05d-f903c0a73e95 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:58.206347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7937da-fe94-447b-b05d-f903c0a73e95 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:58.208153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7937da-fe94-447b-b05d-f903c0a73e95 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:58.211444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7937da-fe94-447b-b05d-f903c0a73e95 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:58.215334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7937da-fe94-447b-b05d-f903c0a73e95 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:58.216410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7937da-fe94-447b-b05d-f903c0a73e95 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:58.218709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7937da-fe94-447b-b05d-f903c0a73e95 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:58.368865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8e7937da-fe94-447b-b05d-f903c0a73e95 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:58.384237 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e7937da-fe94-447b-b05d-f903c0a73e95 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1299 microversion: 2.1 time: 0.215389 Aug 09 17:29:58.389534 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2133/4082] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:58 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1299 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:58.419120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e6ac9e3-a1f5-4531-a9a9-233328e84990 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:58.421101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e6ac9e3-a1f5-4531-a9a9-233328e84990 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:58.446244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e6ac9e3-a1f5-4531-a9a9-233328e84990 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:58.447341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e6ac9e3-a1f5-4531-a9a9-233328e84990 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:58.450655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e6ac9e3-a1f5-4531-a9a9-233328e84990 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:58.451717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e6ac9e3-a1f5-4531-a9a9-233328e84990 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:58.452378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e6ac9e3-a1f5-4531-a9a9-233328e84990 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:58.455329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e6ac9e3-a1f5-4531-a9a9-233328e84990 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:58.457826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6bf2b681-1dc5-4716-bb32-a6f6e940fef5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:29:58.515738 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6bf2b681-1dc5-4716-bb32-a6f6e940fef5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 1.368042 Aug 09 17:29:58.517468 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1950/4083] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:57 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:29:59.112789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f824835d-e94b-44ff-9dfb-6f34c4163cfb tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Action: 'create', calling method: .version_select at 0x7fbbcb6a0670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-459721760", "metadata": {"Type": "work"}}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f824835d-e94b-44ff-9dfb-6f34c4163cfb tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Request method failure captured: Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 121 Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmWFXbgZ9h0dY5n9uA-QrHeCALmDGzSegd7XdJQqI-tqvVmftqIIlRK-G2gQzvNBVNWc80p13cSovc-CyNTcShc1nha-FVUcNGJf9wHGLV13bI6byKDjDfTjpLXlcPKTl1FLPP3L3CSacDvDxhJVESjZiZmGYX075S30jZgtWXfx7w Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9091cf51508448299979ad0dffe0759c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9091cf51508448299979ad0dffe0759c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesNegativeTest-248407836-project Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 84c4c69a9c464dc4ad1749eb63b455a5 Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesNegativeTest-248407836-project Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-459721760", "metadata": {"Type": "work"}}} Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-459721760', 'metadata': {'Type': 'work'}}}} Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:29:59.120886 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:29:59.124804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 17:29:59.124804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.124804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:59.124804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.124804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.124804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:59.124804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:59.124804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:29:59.124804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:29:59.124804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 17:29:59.124804 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.129428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f824835d-e94b-44ff-9dfb-6f34c4163cfb tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:59.131380 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f824835d-e94b-44ff-9dfb-6f34c4163cfb tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.286614 Aug 09 17:29:59.132632 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1951/4084] 10.222.0.93 () {60 vars in 1156 bytes} [Tue Aug 9 17:29:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 289 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 17:29:59.168318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b7a14bb9-d457-45cd-bddf-4b3fee9931f0 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Action: 'create', calling method: .version_select at 0x7fbbdc9e28b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-134911165", "metadata": {"Type": "work"}}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b7a14bb9-d457-45cd-bddf-4b3fee9931f0 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Request method failure captured: Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 119 Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmWFXbgZ9h0dY5n9uA-QrHeCALmDGzSegd7XdJQqI-tqvVmftqIIlRK-G2gQzvNBVNWc80p13cSovc-CyNTcShc1nha-FVUcNGJf9wHGLV13bI6byKDjDfTjpLXlcPKTl1FLPP3L3CSacDvDxhJVESjZiZmGYX075S30jZgtWXfx7w Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9091cf51508448299979ad0dffe0759c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9091cf51508448299979ad0dffe0759c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesNegativeTest-248407836-project Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 84c4c69a9c464dc4ad1749eb63b455a5 Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesNegativeTest-248407836-project Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-134911165", "metadata": {"Type": "work"}}} Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-134911165', 'metadata': {'Type': 'work'}}}} Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi '0' Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:29:59.174177 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:29:59.181363 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 17:29:59.181363 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.181363 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:59.181363 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.181363 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.181363 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:59.181363 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:59.181363 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:29:59.181363 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:29:59.181363 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 17:29:59.181363 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.188734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b7a14bb9-d457-45cd-bddf-4b3fee9931f0 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:59.190967 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b7a14bb9-d457-45cd-bddf-4b3fee9931f0 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.051541 Aug 09 17:29:59.197851 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1952/4085] 10.222.0.93 () {60 vars in 1156 bytes} [Tue Aug 9 17:29:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:29:59.214950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49cf6dff-c3a7-44f2-8a0f-51a77d788b22 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Action: 'create', calling method: .version_select at 0x7fbbca4711f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-552308998", "metadata": {"Type": "work"}}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49cf6dff-c3a7-44f2-8a0f-51a77d788b22 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Request method failure captured: Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 118 Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmWFXbgZ9h0dY5n9uA-QrHeCALmDGzSegd7XdJQqI-tqvVmftqIIlRK-G2gQzvNBVNWc80p13cSovc-CyNTcShc1nha-FVUcNGJf9wHGLV13bI6byKDjDfTjpLXlcPKTl1FLPP3L3CSacDvDxhJVESjZiZmGYX075S30jZgtWXfx7w Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9091cf51508448299979ad0dffe0759c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9091cf51508448299979ad0dffe0759c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesNegativeTest-248407836-project Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 84c4c69a9c464dc4ad1749eb63b455a5 Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesNegativeTest-248407836-project Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-552308998", "metadata": {"Type": "work"}}} Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-552308998', 'metadata': {'Type': 'work'}}}} Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise error Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi '' Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 17:29:59.235521 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 17:29:59.251484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 17:29:59.251484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.251484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:59.251484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.251484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.251484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:59.251484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:59.251484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 17:29:59.251484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 17:29:59.251484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 17:29:59.251484 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.259990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49cf6dff-c3a7-44f2-8a0f-51a77d788b22 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:59.320570 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-49cf6dff-c3a7-44f2-8a0f-51a77d788b22 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.105723 Aug 09 17:29:59.320570 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1953/4086] 10.222.0.93 () {60 vars in 1156 bytes} [Tue Aug 9 17:29:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:29:59.339714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-142d1cd3-29a8-49fd-99fc-c08e8d51444f tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Calling method '.version_select at 0x7fbbdca11f70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:59.490909 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-142d1cd3-29a8-49fd-99fc-c08e8d51444f tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] HTTP exception thrown: Volume tempest-invalid-2048487282 could not be found. Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-142d1cd3-29a8-49fd-99fc-c08e8d51444f tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Request method failure captured: Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2048487282 HTTP/1.1 Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmWFXbgZ9h0dY5n9uA-QrHeCALmDGzSegd7XdJQqI-tqvVmftqIIlRK-G2gQzvNBVNWc80p13cSovc-CyNTcShc1nha-FVUcNGJf9wHGLV13bI6byKDjDfTjpLXlcPKTl1FLPP3L3CSacDvDxhJVESjZiZmGYX075S30jZgtWXfx7w Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9091cf51508448299979ad0dffe0759c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9091cf51508448299979ad0dffe0759c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesNegativeTest-248407836-project Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 84c4c69a9c464dc4ad1749eb63b455a5 Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesNegativeTest-248407836-project Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: exception: Volume tempest-invalid-2048487282 could not be found. Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'tempest-invalid-2048487282'} Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2048487282 could not be found. (HTTP 404) (Request-ID: req-11eac708-0aca-4f85-9bdf-ebc8bcc58947) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:29:59.493351 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2048487282 could not be found. Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2048487282 could not be found. Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2048487282 could not be found. Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-142d1cd3-29a8-49fd-99fc-c08e8d51444f tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Returning 404 to user: Volume tempest-invalid-2048487282 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:29:59.497298 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-142d1cd3-29a8-49fd-99fc-c08e8d51444f tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2048487282" status: 404 len: 99 microversion: 2.1 time: 0.171307 Aug 09 17:29:59.501583 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1954/4087] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:29:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2048487282 => generated 99 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:29:59.513900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-688a7c4d-9538-4d9e-9dd1-6de625df176c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:29:59.516780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-688a7c4d-9538-4d9e-9dd1-6de625df176c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:29:59.544693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-688a7c4d-9538-4d9e-9dd1-6de625df176c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:59.545799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-688a7c4d-9538-4d9e-9dd1-6de625df176c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:59.548547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-688a7c4d-9538-4d9e-9dd1-6de625df176c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:29:59.550904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-688a7c4d-9538-4d9e-9dd1-6de625df176c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:29:59.551822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-688a7c4d-9538-4d9e-9dd1-6de625df176c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:29:59.553264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-688a7c4d-9538-4d9e-9dd1-6de625df176c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:00.056394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4e6ac9e3-a1f5-4531-a9a9-233328e84990 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:00.073287 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e6ac9e3-a1f5-4531-a9a9-233328e84990 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1328 microversion: 2.1 time: 1.657670 Aug 09 17:30:00.076092 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2134/4088] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:58 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1328 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:00.092423 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43c0e8fc-f716-44cc-9ee8-419d931002bc tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014506 Aug 09 17:30:00.098816 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2135/4089] 10.222.0.93 () {58 vars in 1140 bytes} [Tue Aug 9 17:30:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 17:30:00.108440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a2476056-29dd-4468-9965-80b841c868e5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:00.116033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a2476056-29dd-4468-9965-80b841c868e5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:00.132746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2476056-29dd-4468-9965-80b841c868e5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:00.133697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2476056-29dd-4468-9965-80b841c868e5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:00.136544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2476056-29dd-4468-9965-80b841c868e5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:00.138056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2476056-29dd-4468-9965-80b841c868e5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:00.142350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2476056-29dd-4468-9965-80b841c868e5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:00.144275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2476056-29dd-4468-9965-80b841c868e5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:00.722607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:00.858807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a2476056-29dd-4468-9965-80b841c868e5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:00.873835 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a2476056-29dd-4468-9965-80b841c868e5 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 0.772782 Aug 09 17:30:00.876623 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2136/4090] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:00 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:00.898555 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d317ce62-29ea-4e4c-9a5b-e2002f58eca0 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017595 Aug 09 17:30:00.899322 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2137/4091] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:30:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 17:30:00.916751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b48d1d3c-df67-4503-9221-813959a38db2 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Calling method '.version_select at 0x7fbbca6b0940>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:01.035843 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b48d1d3c-df67-4503-9221-813959a38db2 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] HTTP exception thrown: Volume edbd83d4-ad1a-4c78-918b-f9f87e552284 could not be found. Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b48d1d3c-df67-4503-9221-813959a38db2 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Request method failure captured: Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/os-volumes/edbd83d4-ad1a-4c78-918b-f9f87e552284 HTTP/1.1 Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmWFXbgZ9h0dY5n9uA-QrHeCALmDGzSegd7XdJQqI-tqvVmftqIIlRK-G2gQzvNBVNWc80p13cSovc-CyNTcShc1nha-FVUcNGJf9wHGLV13bI6byKDjDfTjpLXlcPKTl1FLPP3L3CSacDvDxhJVESjZiZmGYX075S30jZgtWXfx7w Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9091cf51508448299979ad0dffe0759c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9091cf51508448299979ad0dffe0759c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-VolumesNegativeTest-248407836 Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-VolumesNegativeTest-248407836-project Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 84c4c69a9c464dc4ad1749eb63b455a5 Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-VolumesNegativeTest-248407836-project Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: exception: Volume edbd83d4-ad1a-4c78-918b-f9f87e552284 could not be found. Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'edbd83d4-ad1a-4c78-918b-f9f87e552284'} Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume edbd83d4-ad1a-4c78-918b-f9f87e552284 could not be found. (HTTP 404) (Request-ID: req-9dd43b59-3515-4115-98f3-cf7c9c21ca4c) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:30:01.039560 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume edbd83d4-ad1a-4c78-918b-f9f87e552284 could not be found. Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume edbd83d4-ad1a-4c78-918b-f9f87e552284 could not be found. Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume edbd83d4-ad1a-4c78-918b-f9f87e552284 could not be found. Aug 09 17:30:01.044171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.048384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b48d1d3c-df67-4503-9221-813959a38db2 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Returning 404 to user: Volume edbd83d4-ad1a-4c78-918b-f9f87e552284 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:30:01.049659 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b48d1d3c-df67-4503-9221-813959a38db2 tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/edbd83d4-ad1a-4c78-918b-f9f87e552284" status: 404 len: 109 microversion: 2.1 time: 0.142900 Aug 09 17:30:01.050723 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2138/4092] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:30:00 2022] DELETE /compute/v2.1/os-volumes/edbd83d4-ad1a-4c78-918b-f9f87e552284 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:30:01.063976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f7a43e2-8f1b-42f7-8ca3-da669774ed9a tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Calling method '.version_select at 0x7fbbca674550>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:01.209038 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-7f7a43e2-8f1b-42f7-8ca3-da669774ed9a tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] HTTP exception thrown: Volume cab27440-8e84-48b4-a88c-76632f7c7f5f could not be found. Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f7a43e2-8f1b-42f7-8ca3-da669774ed9a tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Request method failure captured: Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-volumes/cab27440-8e84-48b4-a88c-76632f7c7f5f HTTP/1.1 Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmWFXbgZ9h0dY5n9uA-QrHeCALmDGzSegd7XdJQqI-tqvVmftqIIlRK-G2gQzvNBVNWc80p13cSovc-CyNTcShc1nha-FVUcNGJf9wHGLV13bI6byKDjDfTjpLXlcPKTl1FLPP3L3CSacDvDxhJVESjZiZmGYX075S30jZgtWXfx7w Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9091cf51508448299979ad0dffe0759c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9091cf51508448299979ad0dffe0759c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9091cf51508448299979ad0dffe0759c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-VolumesNegativeTest-248407836 Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 9091cf51508448299979ad0dffe0759c Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-VolumesNegativeTest-248407836 Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-VolumesNegativeTest-248407836-project Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 84c4c69a9c464dc4ad1749eb63b455a5 Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-VolumesNegativeTest-248407836-project Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: exception: Volume cab27440-8e84-48b4-a88c-76632f7c7f5f could not be found. Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'cab27440-8e84-48b4-a88c-76632f7c7f5f'} Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cab27440-8e84-48b4-a88c-76632f7c7f5f could not be found. (HTTP 404) (Request-ID: req-c3f1fb41-2a52-494e-8621-94a64bd1cfc3) Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:30:01.213555 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cab27440-8e84-48b4-a88c-76632f7c7f5f could not be found. Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cab27440-8e84-48b4-a88c-76632f7c7f5f could not be found. Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cab27440-8e84-48b4-a88c-76632f7c7f5f could not be found. Aug 09 17:30:01.217394 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:01.219420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f7a43e2-8f1b-42f7-8ca3-da669774ed9a tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] Returning 404 to user: Volume cab27440-8e84-48b4-a88c-76632f7c7f5f could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:30:01.228500 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f7a43e2-8f1b-42f7-8ca3-da669774ed9a tempest-VolumesNegativeTest-248407836 tempest-VolumesNegativeTest-248407836-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/cab27440-8e84-48b4-a88c-76632f7c7f5f" status: 404 len: 109 microversion: 2.1 time: 0.160537 Aug 09 17:30:01.229780 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2139/4093] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:30:01 2022] GET /compute/v2.1/os-volumes/cab27440-8e84-48b4-a88c-76632f7c7f5f => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:30:01.247157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-db9742d8-f2ec-4966-90b1-4b4f611e3427 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:01.250821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-db9742d8-f2ec-4966-90b1-4b4f611e3427 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:01.287372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db9742d8-f2ec-4966-90b1-4b4f611e3427 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:01.293152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db9742d8-f2ec-4966-90b1-4b4f611e3427 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:01.294371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db9742d8-f2ec-4966-90b1-4b4f611e3427 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:01.299143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db9742d8-f2ec-4966-90b1-4b4f611e3427 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:01.300372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db9742d8-f2ec-4966-90b1-4b4f611e3427 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:01.302809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-db9742d8-f2ec-4966-90b1-4b4f611e3427 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:01.713454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:01.852310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-688a7c4d-9538-4d9e-9dd1-6de625df176c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:01.877765 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-688a7c4d-9538-4d9e-9dd1-6de625df176c tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 2.374336 Aug 09 17:30:01.910958 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1955/4094] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:29:59 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 2409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:01.940061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7ee176d6-b15f-4c79-8cb3-907e39877c1c tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:01.941747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7ee176d6-b15f-4c79-8cb3-907e39877c1c tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:01.960759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ee176d6-b15f-4c79-8cb3-907e39877c1c tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:01.962012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ee176d6-b15f-4c79-8cb3-907e39877c1c tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:01.967255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ee176d6-b15f-4c79-8cb3-907e39877c1c tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:01.976874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ee176d6-b15f-4c79-8cb3-907e39877c1c tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:01.978365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ee176d6-b15f-4c79-8cb3-907e39877c1c tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:01.979328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ee176d6-b15f-4c79-8cb3-907e39877c1c tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:02.735967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-db9742d8-f2ec-4966-90b1-4b4f611e3427 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:02.767152 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-db9742d8-f2ec-4966-90b1-4b4f611e3427 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1328 microversion: 2.1 time: 1.535673 Aug 09 17:30:02.770774 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2140/4095] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:01 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1328 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:02.917798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3698079-3474-4f8d-894b-a41a062eed33 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:02.918866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b3698079-3474-4f8d-894b-a41a062eed33 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:02.933721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3698079-3474-4f8d-894b-a41a062eed33 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:02.934648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3698079-3474-4f8d-894b-a41a062eed33 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:02.936719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3698079-3474-4f8d-894b-a41a062eed33 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:02.939423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3698079-3474-4f8d-894b-a41a062eed33 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:02.949417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3698079-3474-4f8d-894b-a41a062eed33 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:02.954592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3698079-3474-4f8d-894b-a41a062eed33 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:03.303760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7ee176d6-b15f-4c79-8cb3-907e39877c1c tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:03.357998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=20 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:03.369951 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7ee176d6-b15f-4c79-8cb3-907e39877c1c tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 1.453581 Aug 09 17:30:03.382991 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1956/4096] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:01 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:03.787897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-00ae3a04-0962-4274-b93f-1023cf38bb8e req-1b248d4b-ef27-4889-9d53-788672fadc0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1114ad5-6ae1-41ba-a066-6db583981211", "tag": "532c971c-a863-4374-a246-9503453cdde4"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:03.875456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-00ae3a04-0962-4274-b93f-1023cf38bb8e req-1b248d4b-ef27-4889-9d53-788672fadc0c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:03.883049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-00ae3a04-0962-4274-b93f-1023cf38bb8e req-1b248d4b-ef27-4889-9d53-788672fadc0c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:03.884314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-00ae3a04-0962-4274-b93f-1023cf38bb8e req-1b248d4b-ef27-4889-9d53-788672fadc0c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:03.945403 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-00ae3a04-0962-4274-b93f-1023cf38bb8e req-1b248d4b-ef27-4889-9d53-788672fadc0c service nova] Creating event network-changed:532c971c-a863-4374-a246-9503453cdde4 for instance b1114ad5-6ae1-41ba-a066-6db583981211 on n-h1-845781-6 Aug 09 17:30:03.978161 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-00ae3a04-0962-4274-b93f-1023cf38bb8e req-1b248d4b-ef27-4889-9d53-788672fadc0c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.511295 Aug 09 17:30:03.984782 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1957/4097] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:30:04.013971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4226c8ae-7856-4acc-bd7a-a3f4d8d63491 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:04.017408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4226c8ae-7856-4acc-bd7a-a3f4d8d63491 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:04.046537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4226c8ae-7856-4acc-bd7a-a3f4d8d63491 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:04.054043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4226c8ae-7856-4acc-bd7a-a3f4d8d63491 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:04.054386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4226c8ae-7856-4acc-bd7a-a3f4d8d63491 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:04.059242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4226c8ae-7856-4acc-bd7a-a3f4d8d63491 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:04.066661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4226c8ae-7856-4acc-bd7a-a3f4d8d63491 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:04.067939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4226c8ae-7856-4acc-bd7a-a3f4d8d63491 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:04.433580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3698079-3474-4f8d-894b-a41a062eed33 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:04.449700 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b3698079-3474-4f8d-894b-a41a062eed33 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 1.532199 Aug 09 17:30:04.450510 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2141/4098] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:02 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:30:04.478601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb55db9b-7a85-4fc8-8f58-d4a821dd4859 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:04.481552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb55db9b-7a85-4fc8-8f58-d4a821dd4859 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:04.499944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb55db9b-7a85-4fc8-8f58-d4a821dd4859 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:04.501046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb55db9b-7a85-4fc8-8f58-d4a821dd4859 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:04.503406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb55db9b-7a85-4fc8-8f58-d4a821dd4859 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:04.505079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb55db9b-7a85-4fc8-8f58-d4a821dd4859 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:04.507588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb55db9b-7a85-4fc8-8f58-d4a821dd4859 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:04.509820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb55db9b-7a85-4fc8-8f58-d4a821dd4859 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:04.900974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4226c8ae-7856-4acc-bd7a-a3f4d8d63491 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:04.914918 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4226c8ae-7856-4acc-bd7a-a3f4d8d63491 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1328 microversion: 2.1 time: 0.927175 Aug 09 17:30:04.916911 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1958/4099] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:03 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1328 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:05.474076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f02ab91a-75ba-47ca-b235-0b8af0f50050 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:05.475026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f02ab91a-75ba-47ca-b235-0b8af0f50050 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:05.505920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f02ab91a-75ba-47ca-b235-0b8af0f50050 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:05.512627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f02ab91a-75ba-47ca-b235-0b8af0f50050 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:05.513802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f02ab91a-75ba-47ca-b235-0b8af0f50050 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:05.514835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f02ab91a-75ba-47ca-b235-0b8af0f50050 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:05.515544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f02ab91a-75ba-47ca-b235-0b8af0f50050 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:05.516609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f02ab91a-75ba-47ca-b235-0b8af0f50050 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:05.571426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cb55db9b-7a85-4fc8-8f58-d4a821dd4859 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:05.598241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb55db9b-7a85-4fc8-8f58-d4a821dd4859 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 1.132691 Aug 09 17:30:05.603761 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2142/4100] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:04 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:05.946773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-37e0caaa-5245-4b9d-8860-d64bebf98484 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:05.947424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-37e0caaa-5245-4b9d-8860-d64bebf98484 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:05.985510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e0caaa-5245-4b9d-8860-d64bebf98484 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:05.995972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e0caaa-5245-4b9d-8860-d64bebf98484 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:05.996600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e0caaa-5245-4b9d-8860-d64bebf98484 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:06.008119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e0caaa-5245-4b9d-8860-d64bebf98484 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:06.008726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e0caaa-5245-4b9d-8860-d64bebf98484 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:06.009190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e0caaa-5245-4b9d-8860-d64bebf98484 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:06.230092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f02ab91a-75ba-47ca-b235-0b8af0f50050 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:06.293418 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f02ab91a-75ba-47ca-b235-0b8af0f50050 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 0.823030 Aug 09 17:30:06.295388 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1959/4101] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:05 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:06.641019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1a397e29-c69e-4f30-8efb-8fb2a8203756 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:06.641766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1a397e29-c69e-4f30-8efb-8fb2a8203756 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:06.679829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a397e29-c69e-4f30-8efb-8fb2a8203756 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:06.684131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a397e29-c69e-4f30-8efb-8fb2a8203756 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:06.687998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a397e29-c69e-4f30-8efb-8fb2a8203756 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:06.693620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a397e29-c69e-4f30-8efb-8fb2a8203756 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:06.698848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a397e29-c69e-4f30-8efb-8fb2a8203756 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:06.699609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a397e29-c69e-4f30-8efb-8fb2a8203756 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:07.194526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-37e0caaa-5245-4b9d-8860-d64bebf98484 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:07.216119 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-37e0caaa-5245-4b9d-8860-d64bebf98484 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1328 microversion: 2.1 time: 1.276691 Aug 09 17:30:07.219856 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2143/4102] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:05 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1328 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:30:07.325277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fc729ef1-a26d-4f0b-a233-195e65c9823d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:07.326224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fc729ef1-a26d-4f0b-a233-195e65c9823d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:07.346218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc729ef1-a26d-4f0b-a233-195e65c9823d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:07.346989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc729ef1-a26d-4f0b-a233-195e65c9823d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:07.350343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc729ef1-a26d-4f0b-a233-195e65c9823d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:07.352847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc729ef1-a26d-4f0b-a233-195e65c9823d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:07.367151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc729ef1-a26d-4f0b-a233-195e65c9823d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:07.369948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc729ef1-a26d-4f0b-a233-195e65c9823d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:08.372824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fc729ef1-a26d-4f0b-a233-195e65c9823d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:08.399114 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fc729ef1-a26d-4f0b-a233-195e65c9823d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 1.064447 Aug 09 17:30:08.399760 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2144/4103] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:07 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:08.421912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a62931c2-76c8-4a23-ae65-6b69d0e8f55e tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:08.425211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a62931c2-76c8-4a23-ae65-6b69d0e8f55e tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:08.465083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a62931c2-76c8-4a23-ae65-6b69d0e8f55e tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:08.465616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a62931c2-76c8-4a23-ae65-6b69d0e8f55e tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:08.466175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a62931c2-76c8-4a23-ae65-6b69d0e8f55e tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:08.484503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a62931c2-76c8-4a23-ae65-6b69d0e8f55e tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:08.485530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a62931c2-76c8-4a23-ae65-6b69d0e8f55e tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:08.486171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a62931c2-76c8-4a23-ae65-6b69d0e8f55e tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:08.680650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1a397e29-c69e-4f30-8efb-8fb2a8203756 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:08.723379 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1a397e29-c69e-4f30-8efb-8fb2a8203756 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 2.095473 Aug 09 17:30:08.724496 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1960/4104] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:06 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:08.896018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-6635380b-a00e-422a-9358-66830d595ade req-15da4ad4-2d8a-4904-8deb-c92615535b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab40c63-640b-40d0-8845-8026b0b71e5d", "tag": "9098e32a-91ce-400a-99e7-63af9ce9c3da"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:08.999774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6635380b-a00e-422a-9358-66830d595ade req-15da4ad4-2d8a-4904-8deb-c92615535b95 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:09.003864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6635380b-a00e-422a-9358-66830d595ade req-15da4ad4-2d8a-4904-8deb-c92615535b95 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:09.005204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6635380b-a00e-422a-9358-66830d595ade req-15da4ad4-2d8a-4904-8deb-c92615535b95 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:09.121250 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-6635380b-a00e-422a-9358-66830d595ade req-15da4ad4-2d8a-4904-8deb-c92615535b95 service nova] Creating event network-changed:9098e32a-91ce-400a-99e7-63af9ce9c3da for instance fab40c63-640b-40d0-8845-8026b0b71e5d on n-h2-845781-6 Aug 09 17:30:09.160871 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-6635380b-a00e-422a-9358-66830d595ade req-15da4ad4-2d8a-4904-8deb-c92615535b95 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271223 Aug 09 17:30:09.167164 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1961/4105] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:09.339952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a62931c2-76c8-4a23-ae65-6b69d0e8f55e tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:09.357711 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a62931c2-76c8-4a23-ae65-6b69d0e8f55e tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1328 microversion: 2.1 time: 0.949239 Aug 09 17:30:09.358872 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2145/4106] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:08 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1328 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:09.448759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d34cb6de-1047-4988-a080-f1c813923620 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:09.449627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d34cb6de-1047-4988-a080-f1c813923620 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:09.465937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d34cb6de-1047-4988-a080-f1c813923620 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:09.466372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d34cb6de-1047-4988-a080-f1c813923620 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:09.466844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d34cb6de-1047-4988-a080-f1c813923620 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:09.467687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d34cb6de-1047-4988-a080-f1c813923620 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:09.468192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d34cb6de-1047-4988-a080-f1c813923620 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:09.468641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d34cb6de-1047-4988-a080-f1c813923620 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:09.753725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-91c47653-a4ed-4269-9831-0cc63f7c4d70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:09.761051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-91c47653-a4ed-4269-9831-0cc63f7c4d70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:09.779888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91c47653-a4ed-4269-9831-0cc63f7c4d70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:09.780930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91c47653-a4ed-4269-9831-0cc63f7c4d70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:09.781695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91c47653-a4ed-4269-9831-0cc63f7c4d70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:09.782638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91c47653-a4ed-4269-9831-0cc63f7c4d70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:09.783391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91c47653-a4ed-4269-9831-0cc63f7c4d70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:09.787615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91c47653-a4ed-4269-9831-0cc63f7c4d70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:11.809364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d34cb6de-1047-4988-a080-f1c813923620 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:11.876569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-91c47653-a4ed-4269-9831-0cc63f7c4d70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:11.905165 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d34cb6de-1047-4988-a080-f1c813923620 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 2.460624 Aug 09 17:30:11.914486 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1962/4107] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:09 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 2472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:11.993822 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-91c47653-a4ed-4269-9831-0cc63f7c4d70 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 2.246492 Aug 09 17:30:11.996750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-843a3447-f923-4655-bfd7-ec4757ded079 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:12.002462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-843a3447-f923-4655-bfd7-ec4757ded079 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:12.035109 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2146/4108] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:09 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:12.113833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-843a3447-f923-4655-bfd7-ec4757ded079 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:12.115478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-843a3447-f923-4655-bfd7-ec4757ded079 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:12.134677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-843a3447-f923-4655-bfd7-ec4757ded079 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:12.135502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-843a3447-f923-4655-bfd7-ec4757ded079 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:12.136032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-843a3447-f923-4655-bfd7-ec4757ded079 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:12.136484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-843a3447-f923-4655-bfd7-ec4757ded079 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:12.957754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d779f32-54a2-45c1-964a-35dbbd82947f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:12.970795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7d779f32-54a2-45c1-964a-35dbbd82947f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:13.049576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d779f32-54a2-45c1-964a-35dbbd82947f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:13.066986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d779f32-54a2-45c1-964a-35dbbd82947f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:13.070089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d779f32-54a2-45c1-964a-35dbbd82947f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:13.086738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d779f32-54a2-45c1-964a-35dbbd82947f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:13.102449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d779f32-54a2-45c1-964a-35dbbd82947f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:13.130784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d779f32-54a2-45c1-964a-35dbbd82947f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:14.376954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7d779f32-54a2-45c1-964a-35dbbd82947f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:14.427893 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7d779f32-54a2-45c1-964a-35dbbd82947f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 1.477318 Aug 09 17:30:14.440469 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2147/4109] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:12 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:14.446185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bb650342-223b-4c66-9f1f-9b9fb629af19 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:14.447046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bb650342-223b-4c66-9f1f-9b9fb629af19 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:14.475427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb650342-223b-4c66-9f1f-9b9fb629af19 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:14.476823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb650342-223b-4c66-9f1f-9b9fb629af19 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:14.477491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb650342-223b-4c66-9f1f-9b9fb629af19 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:14.478419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb650342-223b-4c66-9f1f-9b9fb629af19 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:14.479846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb650342-223b-4c66-9f1f-9b9fb629af19 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:14.480532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb650342-223b-4c66-9f1f-9b9fb629af19 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:15.352905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-843a3447-f923-4655-bfd7-ec4757ded079 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:15.447806 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-843a3447-f923-4655-bfd7-ec4757ded079 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1328 microversion: 2.1 time: 3.492838 Aug 09 17:30:15.450304 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1963/4110] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:11 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1328 bytes in 3534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:15.471700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-781e7d7f-8519-4827-96c1-bf54134a2980 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:15.471700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-781e7d7f-8519-4827-96c1-bf54134a2980 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:15.498857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e7d7f-8519-4827-96c1-bf54134a2980 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:15.507029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e7d7f-8519-4827-96c1-bf54134a2980 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:15.507813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e7d7f-8519-4827-96c1-bf54134a2980 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:15.513778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e7d7f-8519-4827-96c1-bf54134a2980 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:15.514376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e7d7f-8519-4827-96c1-bf54134a2980 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:15.516834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e7d7f-8519-4827-96c1-bf54134a2980 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:15.717374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bb650342-223b-4c66-9f1f-9b9fb629af19 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:15.728659 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bb650342-223b-4c66-9f1f-9b9fb629af19 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1486 microversion: 2.1 time: 1.286751 Aug 09 17:30:15.735711 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2148/4111] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:14 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1486 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:15.741446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-70734a43-7194-4110-ac76-5966df077b45 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:15.744013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-70734a43-7194-4110-ac76-5966df077b45 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:15.767010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70734a43-7194-4110-ac76-5966df077b45 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:15.767964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70734a43-7194-4110-ac76-5966df077b45 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:15.774848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70734a43-7194-4110-ac76-5966df077b45 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:15.776033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70734a43-7194-4110-ac76-5966df077b45 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:15.776776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70734a43-7194-4110-ac76-5966df077b45 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:15.777718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70734a43-7194-4110-ac76-5966df077b45 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:16.572980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-70734a43-7194-4110-ac76-5966df077b45 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:16.592269 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-70734a43-7194-4110-ac76-5966df077b45 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 0.845436 Aug 09 17:30:16.594239 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2149/4112] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:15 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:16.613755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-83dde8d6-e08b-43b7-bd0b-02f5efd41ab4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:16.615233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-83dde8d6-e08b-43b7-bd0b-02f5efd41ab4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:16.625905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83dde8d6-e08b-43b7-bd0b-02f5efd41ab4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:16.630717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83dde8d6-e08b-43b7-bd0b-02f5efd41ab4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:16.631368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83dde8d6-e08b-43b7-bd0b-02f5efd41ab4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:16.632139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83dde8d6-e08b-43b7-bd0b-02f5efd41ab4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:16.632725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83dde8d6-e08b-43b7-bd0b-02f5efd41ab4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:16.633173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83dde8d6-e08b-43b7-bd0b-02f5efd41ab4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:16.650237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-781e7d7f-8519-4827-96c1-bf54134a2980 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:16.668143 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-781e7d7f-8519-4827-96c1-bf54134a2980 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.200479 Aug 09 17:30:16.672643 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1964/4113] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:15 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:16.707073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-9ad4d3b0-4793-4f1b-8fe3-9fbe5c7016cd req-6533882a-4161-4872-ac49-43869f9b48bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1114ad5-6ae1-41ba-a066-6db583981211", "name": "network-vif-plugged", "status": "completed", "tag": "532c971c-a863-4374-a246-9503453cdde4"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:16.730896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=42 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:16.738524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9ad4d3b0-4793-4f1b-8fe3-9fbe5c7016cd req-6533882a-4161-4872-ac49-43869f9b48bf service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:16.740900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9ad4d3b0-4793-4f1b-8fe3-9fbe5c7016cd req-6533882a-4161-4872-ac49-43869f9b48bf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:16.741631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9ad4d3b0-4793-4f1b-8fe3-9fbe5c7016cd req-6533882a-4161-4872-ac49-43869f9b48bf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:16.778925 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-9ad4d3b0-4793-4f1b-8fe3-9fbe5c7016cd req-6533882a-4161-4872-ac49-43869f9b48bf service nova] Creating event network-vif-plugged:532c971c-a863-4374-a246-9503453cdde4 for instance b1114ad5-6ae1-41ba-a066-6db583981211 on n-h1-845781-6 Aug 09 17:30:16.790843 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-9ad4d3b0-4793-4f1b-8fe3-9fbe5c7016cd req-6533882a-4161-4872-ac49-43869f9b48bf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100229 Aug 09 17:30:16.794040 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1965/4114] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:16.803889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-db32d6b1-575f-43a4-bc0f-bfe047928eae tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:16.804921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-db32d6b1-575f-43a4-bc0f-bfe047928eae tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:16.815201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db32d6b1-575f-43a4-bc0f-bfe047928eae tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:16.815967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db32d6b1-575f-43a4-bc0f-bfe047928eae tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:16.817423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db32d6b1-575f-43a4-bc0f-bfe047928eae tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:16.818881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db32d6b1-575f-43a4-bc0f-bfe047928eae tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:16.820051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db32d6b1-575f-43a4-bc0f-bfe047928eae tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:16.821064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db32d6b1-575f-43a4-bc0f-bfe047928eae tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:17.039133 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-83dde8d6-e08b-43b7-bd0b-02f5efd41ab4 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "POST /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575/action" status: 202 len: 0 microversion: 2.1 time: 0.442841 Aug 09 17:30:17.066378 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2150/4115] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:30:16 2022] POST /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:30:17.103440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f465051-f9ba-430e-867d-754d04a527d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1737680673"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:17.130146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f465051-f9ba-430e-867d-754d04a527d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:17.181375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f465051-f9ba-430e-867d-754d04a527d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:17.183334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f465051-f9ba-430e-867d-754d04a527d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:17.186876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f465051-f9ba-430e-867d-754d04a527d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:17.188225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f465051-f9ba-430e-867d-754d04a527d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:17.190789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f465051-f9ba-430e-867d-754d04a527d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:17.191551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f465051-f9ba-430e-867d-754d04a527d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:17.369701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:17.882376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-db32d6b1-575f-43a4-bc0f-bfe047928eae tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:17.909356 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-db32d6b1-575f-43a4-bc0f-bfe047928eae tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1328 microversion: 2.1 time: 1.113189 Aug 09 17:30:17.911122 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1966/4116] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:16 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1328 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:17.957543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2bc40c23-7e28-4e7b-96d0-b202dd454d24 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:17.964856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2bc40c23-7e28-4e7b-96d0-b202dd454d24 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:17.969684 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f465051-f9ba-430e-867d-754d04a527d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.877488 Aug 09 17:30:17.974779 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2151/4117] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:30:17 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 09 17:30:17.998895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bc40c23-7e28-4e7b-96d0-b202dd454d24 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:18.000244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bc40c23-7e28-4e7b-96d0-b202dd454d24 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:18.001296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bc40c23-7e28-4e7b-96d0-b202dd454d24 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:18.002867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bc40c23-7e28-4e7b-96d0-b202dd454d24 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:18.007241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bc40c23-7e28-4e7b-96d0-b202dd454d24 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:18.008460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2bc40c23-7e28-4e7b-96d0-b202dd454d24 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:18.034953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3de7cb2-f07c-4c6d-b8bd-7d6bd2adb523 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:18.037499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3de7cb2-f07c-4c6d-b8bd-7d6bd2adb523 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:18.082279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3de7cb2-f07c-4c6d-b8bd-7d6bd2adb523 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:18.082914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3de7cb2-f07c-4c6d-b8bd-7d6bd2adb523 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:18.087881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3de7cb2-f07c-4c6d-b8bd-7d6bd2adb523 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:18.089549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3de7cb2-f07c-4c6d-b8bd-7d6bd2adb523 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:18.092379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3de7cb2-f07c-4c6d-b8bd-7d6bd2adb523 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:18.094154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3de7cb2-f07c-4c6d-b8bd-7d6bd2adb523 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:18.387433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f3de7cb2-f07c-4c6d-b8bd-7d6bd2adb523 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:18.408073 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3de7cb2-f07c-4c6d-b8bd-7d6bd2adb523 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 0.408984 Aug 09 17:30:18.427959 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2152/4118] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:17 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:18.953197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2660674f-1a8c-4a98-81ba-a0368c551c92 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:18.954329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2660674f-1a8c-4a98-81ba-a0368c551c92 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:18.968400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2660674f-1a8c-4a98-81ba-a0368c551c92 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:18.973208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2660674f-1a8c-4a98-81ba-a0368c551c92 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:18.974997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2660674f-1a8c-4a98-81ba-a0368c551c92 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:18.977531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2660674f-1a8c-4a98-81ba-a0368c551c92 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:18.980630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2660674f-1a8c-4a98-81ba-a0368c551c92 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:18.981376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2660674f-1a8c-4a98-81ba-a0368c551c92 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:19.066479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2bc40c23-7e28-4e7b-96d0-b202dd454d24 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:19.082844 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2bc40c23-7e28-4e7b-96d0-b202dd454d24 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1494 microversion: 2.1 time: 1.136981 Aug 09 17:30:19.096453 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1967/4119] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:17 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1494 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:19.436569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aa028965-de3d-4e98-9852-2b86288222f5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:19.437203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-aa028965-de3d-4e98-9852-2b86288222f5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:19.453200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa028965-de3d-4e98-9852-2b86288222f5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:19.458737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa028965-de3d-4e98-9852-2b86288222f5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:19.459452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa028965-de3d-4e98-9852-2b86288222f5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:19.460439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa028965-de3d-4e98-9852-2b86288222f5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:19.461106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa028965-de3d-4e98-9852-2b86288222f5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:19.463015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa028965-de3d-4e98-9852-2b86288222f5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:19.615375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2660674f-1a8c-4a98-81ba-a0368c551c92 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:19.637774 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2660674f-1a8c-4a98-81ba-a0368c551c92 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1328 microversion: 2.1 time: 0.692730 Aug 09 17:30:19.642155 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2153/4120] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:18 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1328 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:30:19.648543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1466609256", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ef83e3bd-9fef-43c6-8771-4e13dfd0d1c9"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:19.681826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:19.779216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] validate_networks() for [('ef83e3bd-9fef-43c6-8771-4e13dfd0d1c9', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:30:20.512493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-aa028965-de3d-4e98-9852-2b86288222f5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:20.530513 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aa028965-de3d-4e98-9852-2b86288222f5 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 1.099097 Aug 09 17:30:20.532170 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1968/4121] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:19 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:30:20.557041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-9da94617-f71b-4882-9f41-516506ebc2de req-0ae4ff72-0825-4788-9a4e-7b28b7e3108d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a30c674-6026-45bd-b50e-218ae7d69382", "name": "network-vif-unplugged", "status": "completed", "tag": "a73935e9-c581-4296-b0ba-805a64e85308"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:20.574201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9da94617-f71b-4882-9f41-516506ebc2de req-0ae4ff72-0825-4788-9a4e-7b28b7e3108d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:20.574627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9da94617-f71b-4882-9f41-516506ebc2de req-0ae4ff72-0825-4788-9a4e-7b28b7e3108d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:20.575487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9da94617-f71b-4882-9f41-516506ebc2de req-0ae4ff72-0825-4788-9a4e-7b28b7e3108d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:20.581704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:20.618951 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-9da94617-f71b-4882-9f41-516506ebc2de req-0ae4ff72-0825-4788-9a4e-7b28b7e3108d service nova] Creating event network-vif-unplugged:a73935e9-c581-4296-b0ba-805a64e85308 for instance 1a30c674-6026-45bd-b50e-218ae7d69382 on n-h2-845781-6 Aug 09 17:30:20.629889 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-9da94617-f71b-4882-9f41-516506ebc2de req-0ae4ff72-0825-4788-9a4e-7b28b7e3108d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095697 Aug 09 17:30:20.633613 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1969/4122] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:20.643607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1b6617eb-b76d-4a0d-826f-c720d5b26ebc tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:20.644658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1b6617eb-b76d-4a0d-826f-c720d5b26ebc tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:20.655049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6617eb-b76d-4a0d-826f-c720d5b26ebc tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:20.656156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6617eb-b76d-4a0d-826f-c720d5b26ebc tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:20.657187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6617eb-b76d-4a0d-826f-c720d5b26ebc tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:20.658780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6617eb-b76d-4a0d-826f-c720d5b26ebc tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:20.659473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6617eb-b76d-4a0d-826f-c720d5b26ebc tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:20.660248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b6617eb-b76d-4a0d-826f-c720d5b26ebc tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:21.102872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:30:21.103720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:30:21.103952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:30:21.104375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:30:21.105760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:30:21.130820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1b6617eb-b76d-4a0d-826f-c720d5b26ebc tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:21.135712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:21.136942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:21.138088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:21.139834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:21.140928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:21.141887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:21.142798 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1b6617eb-b76d-4a0d-826f-c720d5b26ebc tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1494 microversion: 2.1 time: 0.506190 Aug 09 17:30:21.145458 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1970/4123] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:20 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1494 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:21.162185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69ec8eed-326c-41ae-8a10-a2f9d15bc715 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:21.166422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-69ec8eed-326c-41ae-8a10-a2f9d15bc715 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:21.194975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Getting quotas for project 596fa4a2074f4863ba4d1e6edb7bf22c. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:30:21.196164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69ec8eed-326c-41ae-8a10-a2f9d15bc715 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:21.197123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69ec8eed-326c-41ae-8a10-a2f9d15bc715 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:21.197870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69ec8eed-326c-41ae-8a10-a2f9d15bc715 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:21.199293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69ec8eed-326c-41ae-8a10-a2f9d15bc715 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:21.207130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69ec8eed-326c-41ae-8a10-a2f9d15bc715 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:21.217057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69ec8eed-326c-41ae-8a10-a2f9d15bc715 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:21.243776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Getting quotas for user 55b13ba9ce5d492dba79fa082d58ca9f and project 596fa4a2074f4863ba4d1e6edb7bf22c. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:30:21.345851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:30:21.348416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:30:21.525108 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-92a3dc4b-e3c8-4d31-a0dc-532f8661312b tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.880243 Aug 09 17:30:21.526151 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2154/4124] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:30:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:30:21.644465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69ec8eed-326c-41ae-8a10-a2f9d15bc715 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:21.655923 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69ec8eed-326c-41ae-8a10-a2f9d15bc715 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1528 microversion: 2.1 time: 0.508851 Aug 09 17:30:21.656524 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1971/4125] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:21 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1528 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:21.676598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-311356ff-9a51-4689-8b2c-3414381a9497 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:21.692387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-311356ff-9a51-4689-8b2c-3414381a9497 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:21.821624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-311356ff-9a51-4689-8b2c-3414381a9497 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:21.834589 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-311356ff-9a51-4689-8b2c-3414381a9497 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1219 microversion: 2.1 time: 0.170825 Aug 09 17:30:21.836310 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1972/4126] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:21 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:21.842026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab347fc0-ab81-48df-8e53-49978b06f6d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:21.842635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ab347fc0-ab81-48df-8e53-49978b06f6d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:21.852876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab347fc0-ab81-48df-8e53-49978b06f6d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:21.853558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab347fc0-ab81-48df-8e53-49978b06f6d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:21.854163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab347fc0-ab81-48df-8e53-49978b06f6d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:21.855493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab347fc0-ab81-48df-8e53-49978b06f6d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:21.856152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab347fc0-ab81-48df-8e53-49978b06f6d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:21.856755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab347fc0-ab81-48df-8e53-49978b06f6d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:22.326430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-221128842", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "829cb0b3-9c78-4844-8875-46f5a554f097"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:22.591591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] validate_networks() for [('829cb0b3-9c78-4844-8875-46f5a554f097', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:30:22.692424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ab347fc0-ab81-48df-8e53-49978b06f6d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:22.715132 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ab347fc0-ab81-48df-8e53-49978b06f6d7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 0.877308 Aug 09 17:30:22.724934 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1973/4127] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:21 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:22.749596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9909b907-6982-4f79-a0e4-61ce9594339d tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:22.751314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9909b907-6982-4f79-a0e4-61ce9594339d tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:22.778236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9909b907-6982-4f79-a0e4-61ce9594339d tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:22.779669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9909b907-6982-4f79-a0e4-61ce9594339d tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:22.781657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9909b907-6982-4f79-a0e4-61ce9594339d tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:22.785833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9909b907-6982-4f79-a0e4-61ce9594339d tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:22.788559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9909b907-6982-4f79-a0e4-61ce9594339d tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:22.792348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9909b907-6982-4f79-a0e4-61ce9594339d tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:23.556522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9909b907-6982-4f79-a0e4-61ce9594339d tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:23.606104 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9909b907-6982-4f79-a0e4-61ce9594339d tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1528 microversion: 2.1 time: 0.869391 Aug 09 17:30:23.611905 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1974/4128] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:22 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1528 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:23.653239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-47c10875-263c-4cf1-95b4-71612bfea7ba tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:23.654786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-47c10875-263c-4cf1-95b4-71612bfea7ba tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:23.668347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c10875-263c-4cf1-95b4-71612bfea7ba tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:23.669592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c10875-263c-4cf1-95b4-71612bfea7ba tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:23.670625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c10875-263c-4cf1-95b4-71612bfea7ba tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:23.672638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c10875-263c-4cf1-95b4-71612bfea7ba tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:23.673746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c10875-263c-4cf1-95b4-71612bfea7ba tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:23.674890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47c10875-263c-4cf1-95b4-71612bfea7ba tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:24.409669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-47c10875-263c-4cf1-95b4-71612bfea7ba tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:24.420305 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-47c10875-263c-4cf1-95b4-71612bfea7ba tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1500 microversion: 2.1 time: 0.804180 Aug 09 17:30:24.461081 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1975/4129] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:23 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1500 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:24.483346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e856867e-0db7-4c51-ae29-f3af3090ce11 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:24.483765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e856867e-0db7-4c51-ae29-f3af3090ce11 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:24.525777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e856867e-0db7-4c51-ae29-f3af3090ce11 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:24.526285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e856867e-0db7-4c51-ae29-f3af3090ce11 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:24.531292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e856867e-0db7-4c51-ae29-f3af3090ce11 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:24.536301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e856867e-0db7-4c51-ae29-f3af3090ce11 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:24.536811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e856867e-0db7-4c51-ae29-f3af3090ce11 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:24.537266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e856867e-0db7-4c51-ae29-f3af3090ce11 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:24.801994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e856867e-0db7-4c51-ae29-f3af3090ce11 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:24.823675 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e856867e-0db7-4c51-ae29-f3af3090ce11 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1289 microversion: 2.1 time: 0.361231 Aug 09 17:30:24.839116 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1976/4130] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:24 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1289 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:24.874483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:30:24.875111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:30:24.875385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:30:24.875845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:30:24.876270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:30:24.926721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:24.930961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:24.933984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:24.935371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:24.935904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:24.938452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:25.010420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:30:25.029423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for user 1d4dd578ed0640fc943af026c4363e28 and project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:30:25.070749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:30:25.104416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:30:25.219101 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5fffc082-0583-446c-a9c9-7f6b68d5df0b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.691597 Aug 09 17:30:25.219808 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2155/4131] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:30:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:30:25.233903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f4a1fd6c-b042-440c-b075-2f9a092c05a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:25.240924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f4a1fd6c-b042-440c-b075-2f9a092c05a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:25.259878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a1fd6c-b042-440c-b075-2f9a092c05a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:25.261983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a1fd6c-b042-440c-b075-2f9a092c05a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:25.269676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a1fd6c-b042-440c-b075-2f9a092c05a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:25.284792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a1fd6c-b042-440c-b075-2f9a092c05a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:25.300316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a1fd6c-b042-440c-b075-2f9a092c05a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:25.310165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4a1fd6c-b042-440c-b075-2f9a092c05a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:25.520317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:25.521420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:25.547858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:25.564286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:25.565017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:25.565953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:25.566444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:25.566885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:25.660401 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] HTTP exception thrown: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Request method failure captured: Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 HTTP/1.1 Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmFMABotSxUY2LDoIgZXhhd8zcXGr7rFeM2qdP2U4WnMaMKW_hGceN7s18LiU7GbJ2m-nOSqJlbTDZvAXlp07wooCZIbt4AmpjmjDSrzHUxJwKYRps0f5oLdWBlhhYPkCA0zwWrbp6pbpOoJ31-xFlKhcWhrMN4Pwe4MosOs8S7qGc Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 6c016e935caf416da588cfc5fc55eedd Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1050616058 Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6c016e935caf416da588cfc5fc55eedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6c016e935caf416da588cfc5fc55eedd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6c016e935caf416da588cfc5fc55eedd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6c016e935caf416da588cfc5fc55eedd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1050616058 Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 6c016e935caf416da588cfc5fc55eedd Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1050616058 Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1050616058-project Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 6f8d8756cd0b4ccca72d7128909bc61d Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1050616058-project Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'b1114ad5-6ae1-41ba-a066-6db583981211'} Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:30:25.711819 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Returning 404 to user: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:30:25.716271 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5b246e7-e091-4a89-8a58-4880700dd2ad tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 404 len: 111 microversion: 2.1 time: 0.874165 Aug 09 17:30:25.744198 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1977/4132] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:30:24 2022] DELETE /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 111 bytes in 904 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:30:25.755934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a28725e4-fcbe-4c31-86d8-b99f8fb51445 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:25.758336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a28725e4-fcbe-4c31-86d8-b99f8fb51445 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:25.805508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a28725e4-fcbe-4c31-86d8-b99f8fb51445 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:25.806991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a28725e4-fcbe-4c31-86d8-b99f8fb51445 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:25.808101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a28725e4-fcbe-4c31-86d8-b99f8fb51445 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:25.809863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a28725e4-fcbe-4c31-86d8-b99f8fb51445 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:25.811253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a28725e4-fcbe-4c31-86d8-b99f8fb51445 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:25.812288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a28725e4-fcbe-4c31-86d8-b99f8fb51445 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:25.916544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a28725e4-fcbe-4c31-86d8-b99f8fb51445 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:30:26.260171 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a28725e4-fcbe-4c31-86d8-b99f8fb51445 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "DELETE /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 204 len: 0 microversion: 2.1 time: 0.513615 Aug 09 17:30:26.265523 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1978/4133] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:30:25 2022] DELETE /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:30:26.290937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9aecf683-c59c-4cf7-9e6c-c70799471cac tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:26.298876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9aecf683-c59c-4cf7-9e6c-c70799471cac tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:26.511248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9aecf683-c59c-4cf7-9e6c-c70799471cac tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:26.527639 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9aecf683-c59c-4cf7-9e6c-c70799471cac tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1192 microversion: 2.1 time: 0.254796 Aug 09 17:30:26.531306 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1979/4134] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:26 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1192 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:26.572316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3fc20b82-d275-4df7-92d2-4b967f8b8130 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:26.572316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3fc20b82-d275-4df7-92d2-4b967f8b8130 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:26.590697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fc20b82-d275-4df7-92d2-4b967f8b8130 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:26.591216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fc20b82-d275-4df7-92d2-4b967f8b8130 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:26.596071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fc20b82-d275-4df7-92d2-4b967f8b8130 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:26.598101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fc20b82-d275-4df7-92d2-4b967f8b8130 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:26.600092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fc20b82-d275-4df7-92d2-4b967f8b8130 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:26.602241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fc20b82-d275-4df7-92d2-4b967f8b8130 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:26.612634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f4a1fd6c-b042-440c-b075-2f9a092c05a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:26.622088 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f4a1fd6c-b042-440c-b075-2f9a092c05a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 1.392123 Aug 09 17:30:26.628907 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2156/4135] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:25 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:26.639575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-96e41923-ecea-400a-8974-54965e3c98a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:26.653141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-96e41923-ecea-400a-8974-54965e3c98a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:26.672878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96e41923-ecea-400a-8974-54965e3c98a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:26.676703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96e41923-ecea-400a-8974-54965e3c98a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:26.687422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96e41923-ecea-400a-8974-54965e3c98a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:26.688733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96e41923-ecea-400a-8974-54965e3c98a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:26.689643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96e41923-ecea-400a-8974-54965e3c98a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:26.690672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96e41923-ecea-400a-8974-54965e3c98a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:26.921948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3fc20b82-d275-4df7-92d2-4b967f8b8130 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:26.933450 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3fc20b82-d275-4df7-92d2-4b967f8b8130 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1528 microversion: 2.1 time: 0.398354 Aug 09 17:30:26.960005 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1980/4136] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:26 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1528 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:26.970139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4adf5e04-d3a1-41f4-a088-5282837624d1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:26.974519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4adf5e04-d3a1-41f4-a088-5282837624d1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:26.993398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4adf5e04-d3a1-41f4-a088-5282837624d1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:26.997565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4adf5e04-d3a1-41f4-a088-5282837624d1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:26.998558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4adf5e04-d3a1-41f4-a088-5282837624d1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:26.999612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4adf5e04-d3a1-41f4-a088-5282837624d1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:27.000466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4adf5e04-d3a1-41f4-a088-5282837624d1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:27.003354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4adf5e04-d3a1-41f4-a088-5282837624d1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:27.674806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-96e41923-ecea-400a-8974-54965e3c98a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:27.695026 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-96e41923-ecea-400a-8974-54965e3c98a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1319 microversion: 2.1 time: 1.063787 Aug 09 17:30:27.695544 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2157/4137] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:26 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1319 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:27.719238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b9e4c711-e986-462d-8b37-c279e200c31e req-20c2dec3-39df-4c77-8824-21614156060a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab40c63-640b-40d0-8845-8026b0b71e5d", "name": "network-vif-plugged", "status": "completed", "tag": "9098e32a-91ce-400a-99e7-63af9ce9c3da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:27.756839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b9e4c711-e986-462d-8b37-c279e200c31e req-20c2dec3-39df-4c77-8824-21614156060a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:27.757341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b9e4c711-e986-462d-8b37-c279e200c31e req-20c2dec3-39df-4c77-8824-21614156060a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:27.757781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b9e4c711-e986-462d-8b37-c279e200c31e req-20c2dec3-39df-4c77-8824-21614156060a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:27.793878 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b9e4c711-e986-462d-8b37-c279e200c31e req-20c2dec3-39df-4c77-8824-21614156060a service nova] Creating event network-vif-plugged:9098e32a-91ce-400a-99e7-63af9ce9c3da for instance fab40c63-640b-40d0-8845-8026b0b71e5d on n-h2-845781-6 Aug 09 17:30:27.810632 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b9e4c711-e986-462d-8b37-c279e200c31e req-20c2dec3-39df-4c77-8824-21614156060a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113761 Aug 09 17:30:27.811539 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2158/4138] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:27.829578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Action: 'update', calling method: >, body: {"server": {"name": "b1114ad5-6ae1-41ba-a066-6db583981211_new"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:27.839873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:27.895669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:27.896211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:27.896643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:27.897397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:27.897880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:27.898312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:27.965446 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] HTTP exception thrown: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Request method failure captured: Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: request: PUT /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 HTTP/1.1 Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 64 Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmFMABotSxUY2LDoIgZXhhd8zcXGr7rFeM2qdP2U4WnMaMKW_hGceN7s18LiU7GbJ2m-nOSqJlbTDZvAXlp07wooCZIbt4AmpjmjDSrzHUxJwKYRps0f5oLdWBlhhYPkCA0zwWrbp6pbpOoJ31-xFlKhcWhrMN4Pwe4MosOs8S7qGc Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 6c016e935caf416da588cfc5fc55eedd Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1050616058 Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6c016e935caf416da588cfc5fc55eedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6c016e935caf416da588cfc5fc55eedd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6c016e935caf416da588cfc5fc55eedd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6c016e935caf416da588cfc5fc55eedd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1050616058 Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 6c016e935caf416da588cfc5fc55eedd Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1050616058 Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1050616058-project Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6f8d8756cd0b4ccca72d7128909bc61d Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1050616058-project Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: {"server": {"name": "b1114ad5-6ae1-41ba-a066-6db583981211_new"}} Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b1114ad5-6ae1-41ba-a066-6db583981211', 'body': {'server': {'name': 'b1114ad5-6ae1-41ba-a066-6db583981211_new'}}} Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 17:30:27.967292 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] Returning 404 to user: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:30:27.975573 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a7468b7a-3f19-4996-8a14-c100b04557d5 tempest-ServersNegativeTestMultiTenantJSON-1050616058 tempest-ServersNegativeTestMultiTenantJSON-1050616058-project] 10.222.0.93 "PUT /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 404 len: 111 microversion: 2.1 time: 0.155799 Aug 09 17:30:27.982952 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2159/4139] 10.222.0.93 () {60 vars in 1256 bytes} [Tue Aug 9 17:30:27 2022] PUT /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:30:28.009157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1dae4ba1-18c5-46be-9a50-0a10590983f2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:28.013440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1dae4ba1-18c5-46be-9a50-0a10590983f2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:28.035062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dae4ba1-18c5-46be-9a50-0a10590983f2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:28.035872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dae4ba1-18c5-46be-9a50-0a10590983f2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:28.037013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dae4ba1-18c5-46be-9a50-0a10590983f2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:28.038158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dae4ba1-18c5-46be-9a50-0a10590983f2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:28.038795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dae4ba1-18c5-46be-9a50-0a10590983f2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:28.039393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1dae4ba1-18c5-46be-9a50-0a10590983f2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:28.554828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1dae4ba1-18c5-46be-9a50-0a10590983f2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:28.578592 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1dae4ba1-18c5-46be-9a50-0a10590983f2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1188 microversion: 2.1 time: 0.593800 Aug 09 17:30:28.586196 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2160/4140] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:27 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1188 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:28.617960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4adf5e04-d3a1-41f4-a088-5282837624d1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:28.623214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c821dbe-6c2a-4f70-86c7-ba1df8ac7fcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:28.624263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3c821dbe-6c2a-4f70-86c7-ba1df8ac7fcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:28.653210 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4adf5e04-d3a1-41f4-a088-5282837624d1 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 1.691466 Aug 09 17:30:28.659321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c821dbe-6c2a-4f70-86c7-ba1df8ac7fcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:28.663422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c821dbe-6c2a-4f70-86c7-ba1df8ac7fcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:28.669706 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1981/4141] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:26 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:28.675738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c821dbe-6c2a-4f70-86c7-ba1df8ac7fcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:28.683964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c821dbe-6c2a-4f70-86c7-ba1df8ac7fcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:28.692667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c821dbe-6c2a-4f70-86c7-ba1df8ac7fcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:28.695966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c821dbe-6c2a-4f70-86c7-ba1df8ac7fcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:28.715427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-db51e386-0cc2-47c4-8076-83ed908d38dc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:28.720350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-db51e386-0cc2-47c4-8076-83ed908d38dc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:28.803689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db51e386-0cc2-47c4-8076-83ed908d38dc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:28.810098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db51e386-0cc2-47c4-8076-83ed908d38dc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:28.811321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db51e386-0cc2-47c4-8076-83ed908d38dc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:28.814386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db51e386-0cc2-47c4-8076-83ed908d38dc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:28.824934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db51e386-0cc2-47c4-8076-83ed908d38dc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:28.825961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db51e386-0cc2-47c4-8076-83ed908d38dc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:28.960789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-db51e386-0cc2-47c4-8076-83ed908d38dc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:30:29.449962 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-db51e386-0cc2-47c4-8076-83ed908d38dc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 204 len: 0 microversion: 2.1 time: 0.778240 Aug 09 17:30:29.450570 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1982/4142] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:30:28 2022] DELETE /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:30:29.510894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4e5ca0d3-cb9e-4d13-a609-be80c9d99217 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:29.511862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4e5ca0d3-cb9e-4d13-a609-be80c9d99217 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:29.568060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e5ca0d3-cb9e-4d13-a609-be80c9d99217 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:29.568621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e5ca0d3-cb9e-4d13-a609-be80c9d99217 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:29.568995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e5ca0d3-cb9e-4d13-a609-be80c9d99217 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:29.569755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e5ca0d3-cb9e-4d13-a609-be80c9d99217 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:29.570224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e5ca0d3-cb9e-4d13-a609-be80c9d99217 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:29.570662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e5ca0d3-cb9e-4d13-a609-be80c9d99217 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:32.000956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3c821dbe-6c2a-4f70-86c7-ba1df8ac7fcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:32.045871 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3c821dbe-6c2a-4f70-86c7-ba1df8ac7fcf tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1367 microversion: 2.1 time: 3.456923 Aug 09 17:30:32.068197 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2161/4143] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:28 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1367 bytes in 3481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:32.095755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-30d79469-5129-4ae0-aae3-ea86290d469f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:32.100686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-30d79469-5129-4ae0-aae3-ea86290d469f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:32.132772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30d79469-5129-4ae0-aae3-ea86290d469f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:32.134187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30d79469-5129-4ae0-aae3-ea86290d469f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:32.135281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30d79469-5129-4ae0-aae3-ea86290d469f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:32.144344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30d79469-5129-4ae0-aae3-ea86290d469f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:32.146384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30d79469-5129-4ae0-aae3-ea86290d469f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:32.148822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30d79469-5129-4ae0-aae3-ea86290d469f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:32.203807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4e5ca0d3-cb9e-4d13-a609-be80c9d99217 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:32.219079 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4e5ca0d3-cb9e-4d13-a609-be80c9d99217 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1319 microversion: 2.1 time: 2.767199 Aug 09 17:30:32.219715 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1983/4144] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:29 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1319 bytes in 2769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:32.249770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a516d26b-370d-4486-bdda-1443ef437cfa tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:32.252209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a516d26b-370d-4486-bdda-1443ef437cfa tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:32.278488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a516d26b-370d-4486-bdda-1443ef437cfa tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:32.282802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a516d26b-370d-4486-bdda-1443ef437cfa tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:32.291776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a516d26b-370d-4486-bdda-1443ef437cfa tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:32.293013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a516d26b-370d-4486-bdda-1443ef437cfa tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:32.296001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a516d26b-370d-4486-bdda-1443ef437cfa tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:32.296912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a516d26b-370d-4486-bdda-1443ef437cfa tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:33.302704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-30d79469-5129-4ae0-aae3-ea86290d469f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:33.340981 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-30d79469-5129-4ae0-aae3-ea86290d469f tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1534 microversion: 2.1 time: 1.264984 Aug 09 17:30:33.357921 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2162/4145] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:32 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1534 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:33.384337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-56e4b640-4026-44ef-8106-a4798bc73659 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:33.389244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-56e4b640-4026-44ef-8106-a4798bc73659 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:33.406259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e4b640-4026-44ef-8106-a4798bc73659 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:33.409857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e4b640-4026-44ef-8106-a4798bc73659 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:33.413404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e4b640-4026-44ef-8106-a4798bc73659 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:33.416748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e4b640-4026-44ef-8106-a4798bc73659 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:33.417604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e4b640-4026-44ef-8106-a4798bc73659 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:33.419861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56e4b640-4026-44ef-8106-a4798bc73659 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:33.620957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a516d26b-370d-4486-bdda-1443ef437cfa tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:33.633611 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a516d26b-370d-4486-bdda-1443ef437cfa tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1250 microversion: 2.1 time: 1.405576 Aug 09 17:30:33.635996 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1984/4146] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:32 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1250 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:33.642387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-7ea8ed55-9ffb-4e8e-bc94-2e7159703b25 req-e116f838-8bbe-48e3-96c4-26bff0c099d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a30c674-6026-45bd-b50e-218ae7d69382", "name": "network-vif-plugged", "status": "completed", "tag": "a73935e9-c581-4296-b0ba-805a64e85308"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:33.668259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7ea8ed55-9ffb-4e8e-bc94-2e7159703b25 req-e116f838-8bbe-48e3-96c4-26bff0c099d2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:33.671561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7ea8ed55-9ffb-4e8e-bc94-2e7159703b25 req-e116f838-8bbe-48e3-96c4-26bff0c099d2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:33.676768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7ea8ed55-9ffb-4e8e-bc94-2e7159703b25 req-e116f838-8bbe-48e3-96c4-26bff0c099d2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:33.702862 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-7ea8ed55-9ffb-4e8e-bc94-2e7159703b25 req-e116f838-8bbe-48e3-96c4-26bff0c099d2 service nova] Creating event network-vif-plugged:a73935e9-c581-4296-b0ba-805a64e85308 for instance 1a30c674-6026-45bd-b50e-218ae7d69382 on n-h2-845781-6 Aug 09 17:30:33.710777 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-7ea8ed55-9ffb-4e8e-bc94-2e7159703b25 req-e116f838-8bbe-48e3-96c4-26bff0c099d2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073020 Aug 09 17:30:33.714950 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1985/4147] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:33.723305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-15f01a66-980c-4b21-825e-59f278e79b4d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:33.724643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-15f01a66-980c-4b21-825e-59f278e79b4d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:33.734689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15f01a66-980c-4b21-825e-59f278e79b4d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:33.735218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15f01a66-980c-4b21-825e-59f278e79b4d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:33.735675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15f01a66-980c-4b21-825e-59f278e79b4d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:33.736602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15f01a66-980c-4b21-825e-59f278e79b4d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:33.737069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15f01a66-980c-4b21-825e-59f278e79b4d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:33.737506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15f01a66-980c-4b21-825e-59f278e79b4d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:33.775001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:34.528957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-56e4b640-4026-44ef-8106-a4798bc73659 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:34.570806 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-56e4b640-4026-44ef-8106-a4798bc73659 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1506 microversion: 2.1 time: 1.210695 Aug 09 17:30:34.597390 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2163/4148] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:33 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1506 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:34.617068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a6a66151-3964-4394-b362-541eb8bc2ce5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:34.620534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a6a66151-3964-4394-b362-541eb8bc2ce5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:34.653687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a66151-3964-4394-b362-541eb8bc2ce5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:34.656495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a66151-3964-4394-b362-541eb8bc2ce5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:34.664562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a66151-3964-4394-b362-541eb8bc2ce5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:34.671796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a66151-3964-4394-b362-541eb8bc2ce5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:34.681809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a66151-3964-4394-b362-541eb8bc2ce5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:34.682908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a66151-3964-4394-b362-541eb8bc2ce5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:34.979187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:35.060151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:36.118007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a6a66151-3964-4394-b362-541eb8bc2ce5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:36.165035 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a6a66151-3964-4394-b362-541eb8bc2ce5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1319 microversion: 2.1 time: 1.559446 Aug 09 17:30:36.167766 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2164/4149] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:34 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1319 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:36.201232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3f9b4652-add4-4cc3-b336-0162b7c5e637 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:36.209836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3f9b4652-add4-4cc3-b336-0162b7c5e637 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:36.233989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9b4652-add4-4cc3-b336-0162b7c5e637 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:36.235537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9b4652-add4-4cc3-b336-0162b7c5e637 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:36.236287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9b4652-add4-4cc3-b336-0162b7c5e637 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:36.238552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9b4652-add4-4cc3-b336-0162b7c5e637 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:36.242371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9b4652-add4-4cc3-b336-0162b7c5e637 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:36.243435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f9b4652-add4-4cc3-b336-0162b7c5e637 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:36.337957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-15f01a66-980c-4b21-825e-59f278e79b4d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:36.362469 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-15f01a66-980c-4b21-825e-59f278e79b4d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1557 microversion: 2.1 time: 2.645634 Aug 09 17:30:36.389678 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1986/4150] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:33 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1557 bytes in 2674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:36.418032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d1aa3fb7-2ef7-43e1-9cad-bfcafd1100b6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:36.423032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d1aa3fb7-2ef7-43e1-9cad-bfcafd1100b6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:36.491567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1aa3fb7-2ef7-43e1-9cad-bfcafd1100b6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:36.492860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1aa3fb7-2ef7-43e1-9cad-bfcafd1100b6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:36.494211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1aa3fb7-2ef7-43e1-9cad-bfcafd1100b6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:36.499414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1aa3fb7-2ef7-43e1-9cad-bfcafd1100b6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:36.504447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1aa3fb7-2ef7-43e1-9cad-bfcafd1100b6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:36.510660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1aa3fb7-2ef7-43e1-9cad-bfcafd1100b6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:36.665325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:36.994253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f9b4652-add4-4cc3-b336-0162b7c5e637 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:37.025313 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3f9b4652-add4-4cc3-b336-0162b7c5e637 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1534 microversion: 2.1 time: 0.843373 Aug 09 17:30:37.027408 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2165/4151] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:36 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1534 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:37.037251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0f278736-8c33-4329-b07b-eff80e8586b5 req-b99ea43a-72af-4cb5-8058-b0b15611ae30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "034f8bad-5143-4cd6-bf2a-167ae912650e", "tag": "1ae60f86-b2f6-451b-b03e-e98626e6f84a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:37.061724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f278736-8c33-4329-b07b-eff80e8586b5 req-b99ea43a-72af-4cb5-8058-b0b15611ae30 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:37.062583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f278736-8c33-4329-b07b-eff80e8586b5 req-b99ea43a-72af-4cb5-8058-b0b15611ae30 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:37.063731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f278736-8c33-4329-b07b-eff80e8586b5 req-b99ea43a-72af-4cb5-8058-b0b15611ae30 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:37.084780 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0f278736-8c33-4329-b07b-eff80e8586b5 req-b99ea43a-72af-4cb5-8058-b0b15611ae30 service nova] Creating event network-changed:1ae60f86-b2f6-451b-b03e-e98626e6f84a for instance 034f8bad-5143-4cd6-bf2a-167ae912650e on n-h1-845781-6 Aug 09 17:30:37.094229 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0f278736-8c33-4329-b07b-eff80e8586b5 req-b99ea43a-72af-4cb5-8058-b0b15611ae30 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061464 Aug 09 17:30:37.097069 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2166/4152] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:37.113921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b666dc30-ec4e-4798-a3b0-05ebb010dee3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:37.116502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b666dc30-ec4e-4798-a3b0-05ebb010dee3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:37.140394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b666dc30-ec4e-4798-a3b0-05ebb010dee3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:37.141800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b666dc30-ec4e-4798-a3b0-05ebb010dee3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:37.149323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b666dc30-ec4e-4798-a3b0-05ebb010dee3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:37.150801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b666dc30-ec4e-4798-a3b0-05ebb010dee3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:37.151855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b666dc30-ec4e-4798-a3b0-05ebb010dee3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:37.153147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b666dc30-ec4e-4798-a3b0-05ebb010dee3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:37.816115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b666dc30-ec4e-4798-a3b0-05ebb010dee3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:37.854236 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b666dc30-ec4e-4798-a3b0-05ebb010dee3 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 200 len: 1464 microversion: 2.1 time: 0.752767 Aug 09 17:30:37.856643 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2167/4153] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:37 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 1464 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:37.884907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1cb96023-c5a5-4a95-a5a0-e4664ed6ad04 req-9de73cc5-0b9d-4194-98e0-d379d3520217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217bec43-82d1-4aa1-91c3-806af7f3d575", "name": "network-vif-unplugged", "status": "completed", "tag": "f8195a31-7a13-4b23-a5c4-f6a4cc4ca7d1"}, {"server_uuid": "b1114ad5-6ae1-41ba-a066-6db583981211", "name": "network-vif-unplugged", "status": "completed", "tag": "532c971c-a863-4374-a246-9503453cdde4"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:37.926715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1cb96023-c5a5-4a95-a5a0-e4664ed6ad04 req-9de73cc5-0b9d-4194-98e0-d379d3520217 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:37.929234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1cb96023-c5a5-4a95-a5a0-e4664ed6ad04 req-9de73cc5-0b9d-4194-98e0-d379d3520217 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:37.932336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1cb96023-c5a5-4a95-a5a0-e4664ed6ad04 req-9de73cc5-0b9d-4194-98e0-d379d3520217 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:37.979663 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1cb96023-c5a5-4a95-a5a0-e4664ed6ad04 req-9de73cc5-0b9d-4194-98e0-d379d3520217 service nova] Creating event network-vif-unplugged:f8195a31-7a13-4b23-a5c4-f6a4cc4ca7d1 for instance 217bec43-82d1-4aa1-91c3-806af7f3d575 on n-h2-845781-6 Aug 09 17:30:37.981247 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1cb96023-c5a5-4a95-a5a0-e4664ed6ad04 req-9de73cc5-0b9d-4194-98e0-d379d3520217 service nova] Creating event network-vif-unplugged:532c971c-a863-4374-a246-9503453cdde4 for instance b1114ad5-6ae1-41ba-a066-6db583981211 on n-h1-845781-6 Aug 09 17:30:38.000287 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1cb96023-c5a5-4a95-a5a0-e4664ed6ad04 req-9de73cc5-0b9d-4194-98e0-d379d3520217 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.135004 Aug 09 17:30:38.001729 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2168/4154] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:38.014944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-17c0596b-cace-4abb-aa2b-3ca5e0f79db2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:38.016589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17c0596b-cace-4abb-aa2b-3ca5e0f79db2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:38.034529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17c0596b-cace-4abb-aa2b-3ca5e0f79db2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:38.036094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17c0596b-cace-4abb-aa2b-3ca5e0f79db2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:38.037215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17c0596b-cace-4abb-aa2b-3ca5e0f79db2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:38.039445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17c0596b-cace-4abb-aa2b-3ca5e0f79db2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:38.040664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17c0596b-cace-4abb-aa2b-3ca5e0f79db2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:38.042009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17c0596b-cace-4abb-aa2b-3ca5e0f79db2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:38.293476 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-17c0596b-cace-4abb-aa2b-3ca5e0f79db2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.288990 Aug 09 17:30:38.295174 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2169/4155] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:30:38 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:38.315590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac50a599-6559-4f37-a6d7-649d7d918b67 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:38.326983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ac50a599-6559-4f37-a6d7-649d7d918b67 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:38.364399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac50a599-6559-4f37-a6d7-649d7d918b67 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:38.365290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac50a599-6559-4f37-a6d7-649d7d918b67 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:38.366035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac50a599-6559-4f37-a6d7-649d7d918b67 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:38.367275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac50a599-6559-4f37-a6d7-649d7d918b67 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:38.399939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac50a599-6559-4f37-a6d7-649d7d918b67 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:38.400846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac50a599-6559-4f37-a6d7-649d7d918b67 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:38.735752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d1aa3fb7-2ef7-43e1-9cad-bfcafd1100b6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:38.756767 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d1aa3fb7-2ef7-43e1-9cad-bfcafd1100b6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1292 microversion: 2.1 time: 2.356156 Aug 09 17:30:38.773128 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1987/4156] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:36 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1292 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:38.832678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-54081354-7c91-4cd7-a6c7-29dd15f809fc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:38.834386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-54081354-7c91-4cd7-a6c7-29dd15f809fc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:38.899130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54081354-7c91-4cd7-a6c7-29dd15f809fc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:38.900207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54081354-7c91-4cd7-a6c7-29dd15f809fc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:38.904855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54081354-7c91-4cd7-a6c7-29dd15f809fc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:38.910939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54081354-7c91-4cd7-a6c7-29dd15f809fc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:38.930369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54081354-7c91-4cd7-a6c7-29dd15f809fc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:38.931815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54081354-7c91-4cd7-a6c7-29dd15f809fc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:40.305587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54081354-7c91-4cd7-a6c7-29dd15f809fc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c30f510a9ab840439bd71dd64389d406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c918eb23d448e8969eeaa234540d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:40.317607 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-54081354-7c91-4cd7-a6c7-29dd15f809fc tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 200 len: 1313 microversion: 2.1 time: 1.542802 Aug 09 17:30:40.328388 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1988/4157] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:38 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 1313 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:40.340873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:40.353148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: 217bec43-82d1-4aa1-91c3-806af7f3d575] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:40.379684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:40.380666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:40.383533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:40.387829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:40.388701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:40.390235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:40.436881 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] HTTP exception thrown: Instance 217bec43-82d1-4aa1-91c3-806af7f3d575 could not be found. Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Request method failure captured: Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 HTTP/1.1 Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pkcJwT_rQOYKr4rum-_PinKChAcjTXVNFXmOgq65-BlI1MyJT2AMy3o_5SNGXnEixIgRk2XEAGlle7rUyxunzvnBpkZf9s72o82G6T_Xr1zaKyk47HB9AdZ6TXCGSj14TlHubgPaRiCRnw0YmDQQznj1Xyktl-WoEcgZb3f5jMNx1k Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 354ad7c984004cd1b1bd4a2058afb615 Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerRescueTestJSON-1038725306 Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_354ad7c984004cd1b1bd4a2058afb615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/354ad7c984004cd1b1bd4a2058afb615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/354ad7c984004cd1b1bd4a2058afb615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/354ad7c984004cd1b1bd4a2058afb615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerRescueTestJSON-1038725306 Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 354ad7c984004cd1b1bd4a2058afb615 Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerRescueTestJSON-1038725306 Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerRescueTestJSON-1038725306-project Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: d089ace53d1b4ad1bee793e97952705f Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerRescueTestJSON-1038725306-project Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 217bec43-82d1-4aa1-91c3-806af7f3d575 could not be found. Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '217bec43-82d1-4aa1-91c3-806af7f3d575'} Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217bec43-82d1-4aa1-91c3-806af7f3d575 could not be found. Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217bec43-82d1-4aa1-91c3-806af7f3d575 could not be found. Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:40.439654 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:30:40.447180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:40.447180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:40.447180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:40.447180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:30:40.447180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:30:40.447180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217bec43-82d1-4aa1-91c3-806af7f3d575 could not be found. Aug 09 17:30:40.447180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:30:40.449643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Returning 404 to user: Instance 217bec43-82d1-4aa1-91c3-806af7f3d575 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:30:40.456236 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0184ed7a-7c99-42f8-8aaf-2960e50bc706 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575" status: 404 len: 111 microversion: 2.1 time: 0.125578 Aug 09 17:30:40.465402 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1989/4158] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:40 2022] GET /compute/v2.1/servers/217bec43-82d1-4aa1-91c3-806af7f3d575 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:30:40.479581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6570b248-8b33-49a9-a63a-d1ceb051ec14 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:40.483387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6570b248-8b33-49a9-a63a-d1ceb051ec14 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:40.493278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6570b248-8b33-49a9-a63a-d1ceb051ec14 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:40.495075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6570b248-8b33-49a9-a63a-d1ceb051ec14 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:40.497900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6570b248-8b33-49a9-a63a-d1ceb051ec14 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:40.507147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6570b248-8b33-49a9-a63a-d1ceb051ec14 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:40.508728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6570b248-8b33-49a9-a63a-d1ceb051ec14 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:40.509366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6570b248-8b33-49a9-a63a-d1ceb051ec14 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:41.192060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ac50a599-6559-4f37-a6d7-649d7d918b67 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:41.281053 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ac50a599-6559-4f37-a6d7-649d7d918b67 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1319 microversion: 2.1 time: 2.982067 Aug 09 17:30:41.313542 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2170/4159] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:38 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1319 bytes in 3017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:41.355240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-660e7f40-58b7-4e4e-9c94-b65085945bd1 req-eb9c8b3b-b297-4dc3-9114-04ed47a51172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1114ad5-6ae1-41ba-a066-6db583981211", "name": "network-vif-deleted", "tag": "532c971c-a863-4374-a246-9503453cdde4"}, {"server_uuid": "217bec43-82d1-4aa1-91c3-806af7f3d575", "name": "network-vif-deleted", "tag": "f8195a31-7a13-4b23-a5c4-f6a4cc4ca7d1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:41.375414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-660e7f40-58b7-4e4e-9c94-b65085945bd1 req-eb9c8b3b-b297-4dc3-9114-04ed47a51172 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:41.376502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-660e7f40-58b7-4e4e-9c94-b65085945bd1 req-eb9c8b3b-b297-4dc3-9114-04ed47a51172 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:41.377141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-660e7f40-58b7-4e4e-9c94-b65085945bd1 req-eb9c8b3b-b297-4dc3-9114-04ed47a51172 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:41.401371 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-660e7f40-58b7-4e4e-9c94-b65085945bd1 req-eb9c8b3b-b297-4dc3-9114-04ed47a51172 service nova] Creating event network-vif-deleted:532c971c-a863-4374-a246-9503453cdde4 for instance b1114ad5-6ae1-41ba-a066-6db583981211 on n-h1-845781-6 Aug 09 17:30:41.402187 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-660e7f40-58b7-4e4e-9c94-b65085945bd1 req-eb9c8b3b-b297-4dc3-9114-04ed47a51172 service nova] Creating event network-vif-deleted:f8195a31-7a13-4b23-a5c4-f6a4cc4ca7d1 for instance 217bec43-82d1-4aa1-91c3-806af7f3d575 on n-h2-845781-6 Aug 09 17:30:41.420855 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-660e7f40-58b7-4e4e-9c94-b65085945bd1 req-eb9c8b3b-b297-4dc3-9114-04ed47a51172 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099709 Aug 09 17:30:41.422361 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2171/4160] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:41.430693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-03e5d65d-3cf8-4b8b-bfa7-fc6a17699005 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:41.432606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-03e5d65d-3cf8-4b8b-bfa7-fc6a17699005 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:41.451402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03e5d65d-3cf8-4b8b-bfa7-fc6a17699005 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:41.455531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03e5d65d-3cf8-4b8b-bfa7-fc6a17699005 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:41.456378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03e5d65d-3cf8-4b8b-bfa7-fc6a17699005 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:41.457699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03e5d65d-3cf8-4b8b-bfa7-fc6a17699005 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:41.460574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03e5d65d-3cf8-4b8b-bfa7-fc6a17699005 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:41.461360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03e5d65d-3cf8-4b8b-bfa7-fc6a17699005 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:41.467550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:41.626465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-03e5d65d-3cf8-4b8b-bfa7-fc6a17699005 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:30:42.080856 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-03e5d65d-3cf8-4b8b-bfa7-fc6a17699005 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 204 len: 0 microversion: 2.1 time: 0.655504 Aug 09 17:30:42.082230 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2172/4161] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:30:41 2022] DELETE /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:30:42.100805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:42.101549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] [instance: b1114ad5-6ae1-41ba-a066-6db583981211] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:42.141681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:42.143610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:42.144522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:42.148389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:42.148965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:42.149423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:42.169862 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] HTTP exception thrown: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Request method failure captured: Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 HTTP/1.1 Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8plv9_ZHO5zQIch4YTu_E9gv9z5dy8nRxf1_cc_MAEoONPVrFm6MdoxXkCJI7SMRWwSkHTzbx0MkW6BY9E9gE7HgAgl7QOvc_gDvJcWe2v7pLMisPzbEQrht9rYMI9myzmj6dPSi7a1iDbhinMrG3ERkL9y-wNA8aZAgIe-VXypYCWA Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 09c918eb23d448e8969eeaa234540d17 Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-234227319 Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_09c918eb23d448e8969eeaa234540d17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c918eb23d448e8969eeaa234540d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/09c918eb23d448e8969eeaa234540d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/09c918eb23d448e8969eeaa234540d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-234227319 Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 09c918eb23d448e8969eeaa234540d17 Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-234227319 Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestMultiTenantJSON-234227319-project Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: c30f510a9ab840439bd71dd64389d406 Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-234227319-project Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b1114ad5-6ae1-41ba-a066-6db583981211'} Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:42.171674 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] Returning 404 to user: Instance b1114ad5-6ae1-41ba-a066-6db583981211 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c878258d-dcec-4815-a58d-fc789a1c6803 tempest-ServersNegativeTestMultiTenantJSON-234227319 tempest-ServersNegativeTestMultiTenantJSON-234227319-project] 10.222.0.93 "GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211" status: 404 len: 111 microversion: 2.1 time: 0.080843 Aug 09 17:30:42.175506 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2173/4162] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:42 2022] GET /compute/v2.1/servers/b1114ad5-6ae1-41ba-a066-6db583981211 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:30:42.806433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6570b248-8b33-49a9-a63a-d1ceb051ec14 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:42.867910 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6570b248-8b33-49a9-a63a-d1ceb051ec14 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1292 microversion: 2.1 time: 2.399556 Aug 09 17:30:42.868849 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1990/4163] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:40 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1292 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:42.896916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a23d40bf-e3d7-47c8-80eb-1697c80ca338 req-563f0dac-7437-49e5-8cc6-0ebacf479385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0037d3e-a7b8-43c1-98c4-55edce1a4ff3", "tag": "c7628ef0-2168-4f56-94bc-bd4edc71890c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:42.909132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b895f425-7aec-4dce-a8ff-657d1255cbbf tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:42.910531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b895f425-7aec-4dce-a8ff-657d1255cbbf tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:42.922392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a23d40bf-e3d7-47c8-80eb-1697c80ca338 req-563f0dac-7437-49e5-8cc6-0ebacf479385 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:42.925272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a23d40bf-e3d7-47c8-80eb-1697c80ca338 req-563f0dac-7437-49e5-8cc6-0ebacf479385 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:42.928654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a23d40bf-e3d7-47c8-80eb-1697c80ca338 req-563f0dac-7437-49e5-8cc6-0ebacf479385 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:42.949558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b895f425-7aec-4dce-a8ff-657d1255cbbf tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:42.949805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b895f425-7aec-4dce-a8ff-657d1255cbbf tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:42.950442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b895f425-7aec-4dce-a8ff-657d1255cbbf tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:42.951586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b895f425-7aec-4dce-a8ff-657d1255cbbf tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:42.960809 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a23d40bf-e3d7-47c8-80eb-1697c80ca338 req-563f0dac-7437-49e5-8cc6-0ebacf479385 service nova] Creating event network-changed:c7628ef0-2168-4f56-94bc-bd4edc71890c for instance c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 on n-h1-845781-6 Aug 09 17:30:42.963686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b895f425-7aec-4dce-a8ff-657d1255cbbf tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:42.963686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b895f425-7aec-4dce-a8ff-657d1255cbbf tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:42.970033 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a23d40bf-e3d7-47c8-80eb-1697c80ca338 req-563f0dac-7437-49e5-8cc6-0ebacf479385 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.790866 Aug 09 17:30:42.971834 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2174/4164] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:42.981443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b89611ce-0c5e-4602-aa02-042f9d758a33 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:42.982912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b89611ce-0c5e-4602-aa02-042f9d758a33 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:42.991936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b89611ce-0c5e-4602-aa02-042f9d758a33 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:42.992932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b89611ce-0c5e-4602-aa02-042f9d758a33 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:42.993639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b89611ce-0c5e-4602-aa02-042f9d758a33 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:42.994642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b89611ce-0c5e-4602-aa02-042f9d758a33 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:42.995350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b89611ce-0c5e-4602-aa02-042f9d758a33 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:42.996070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b89611ce-0c5e-4602-aa02-042f9d758a33 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:43.678504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b895f425-7aec-4dce-a8ff-657d1255cbbf tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:43.692007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b89611ce-0c5e-4602-aa02-042f9d758a33 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:43.702751 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b895f425-7aec-4dce-a8ff-657d1255cbbf tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1492 microversion: 2.1 time: 0.822919 Aug 09 17:30:43.708877 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1991/4165] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:42 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1492 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:43.710599 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b89611ce-0c5e-4602-aa02-042f9d758a33 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1319 microversion: 2.1 time: 0.736359 Aug 09 17:30:43.711813 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2175/4166] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:42 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1319 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:43.897495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1a7a7518-66d7-4512-9685-7a878a05c682 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:43.898924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1a7a7518-66d7-4512-9685-7a878a05c682 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:43.936900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a7a7518-66d7-4512-9685-7a878a05c682 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:43.957874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a7a7518-66d7-4512-9685-7a878a05c682 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:44.017719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a7a7518-66d7-4512-9685-7a878a05c682 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.060s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:44.030946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a7a7518-66d7-4512-9685-7a878a05c682 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:44.041138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a7a7518-66d7-4512-9685-7a878a05c682 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:44.043544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a7a7518-66d7-4512-9685-7a878a05c682 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:44.730459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f5f2ae18-50d6-42ba-b45e-079581a959b8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:44.731305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f5f2ae18-50d6-42ba-b45e-079581a959b8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:44.776790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2ae18-50d6-42ba-b45e-079581a959b8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:44.791216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2ae18-50d6-42ba-b45e-079581a959b8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:44.792723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2ae18-50d6-42ba-b45e-079581a959b8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:44.793871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2ae18-50d6-42ba-b45e-079581a959b8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:44.795481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2ae18-50d6-42ba-b45e-079581a959b8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:44.799503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2ae18-50d6-42ba-b45e-079581a959b8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:45.777370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1a7a7518-66d7-4512-9685-7a878a05c682 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:45.805964 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1a7a7518-66d7-4512-9685-7a878a05c682 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1292 microversion: 2.1 time: 1.913337 Aug 09 17:30:45.805964 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1992/4167] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:43 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1292 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:45.869691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e759376a-71b8-4f3f-bfdb-c7ec9f42e702 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:45.874878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e759376a-71b8-4f3f-bfdb-c7ec9f42e702 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:45.912014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e759376a-71b8-4f3f-bfdb-c7ec9f42e702 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:45.924636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e759376a-71b8-4f3f-bfdb-c7ec9f42e702 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:45.927245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e759376a-71b8-4f3f-bfdb-c7ec9f42e702 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:45.933315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e759376a-71b8-4f3f-bfdb-c7ec9f42e702 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:45.939430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e759376a-71b8-4f3f-bfdb-c7ec9f42e702 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:45.943618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e759376a-71b8-4f3f-bfdb-c7ec9f42e702 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:46.477316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f5f2ae18-50d6-42ba-b45e-079581a959b8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:46.494530 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f5f2ae18-50d6-42ba-b45e-079581a959b8 tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1492 microversion: 2.1 time: 1.767889 Aug 09 17:30:46.495299 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2176/4168] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:44 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1492 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:46.500322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0f2b2cd2-c528-473a-ace8-81d8838e69c2 req-802bd826-0470-4bbf-8714-34bc8070ccc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab40c63-640b-40d0-8845-8026b0b71e5d", "tag": "9098e32a-91ce-400a-99e7-63af9ce9c3da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:46.535808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f2b2cd2-c528-473a-ace8-81d8838e69c2 req-802bd826-0470-4bbf-8714-34bc8070ccc1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:46.537379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f2b2cd2-c528-473a-ace8-81d8838e69c2 req-802bd826-0470-4bbf-8714-34bc8070ccc1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:46.538003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f2b2cd2-c528-473a-ace8-81d8838e69c2 req-802bd826-0470-4bbf-8714-34bc8070ccc1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:46.566828 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0f2b2cd2-c528-473a-ace8-81d8838e69c2 req-802bd826-0470-4bbf-8714-34bc8070ccc1 service nova] Creating event network-changed:9098e32a-91ce-400a-99e7-63af9ce9c3da for instance fab40c63-640b-40d0-8845-8026b0b71e5d on n-h2-845781-6 Aug 09 17:30:46.585249 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0f2b2cd2-c528-473a-ace8-81d8838e69c2 req-802bd826-0470-4bbf-8714-34bc8070ccc1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088500 Aug 09 17:30:46.586206 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2177/4169] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:46.718805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e759376a-71b8-4f3f-bfdb-c7ec9f42e702 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:46.778704 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e759376a-71b8-4f3f-bfdb-c7ec9f42e702 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1319 microversion: 2.1 time: 0.973811 Aug 09 17:30:46.830619 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1993/4170] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:45 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1319 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:46.836659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d58277e-954e-4e5c-ad3d-3eaa126c6b88 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:46.837390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5d58277e-954e-4e5c-ad3d-3eaa126c6b88 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:46.873562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d58277e-954e-4e5c-ad3d-3eaa126c6b88 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:46.882734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d58277e-954e-4e5c-ad3d-3eaa126c6b88 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:46.883592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d58277e-954e-4e5c-ad3d-3eaa126c6b88 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:46.889327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d58277e-954e-4e5c-ad3d-3eaa126c6b88 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:46.890057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d58277e-954e-4e5c-ad3d-3eaa126c6b88 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:46.901172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d58277e-954e-4e5c-ad3d-3eaa126c6b88 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:47.010249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-3f022c74-877b-4b10-8a2d-2221cb53a1c1 req-244bbc62-e5d5-4c22-8d5e-12437ee0ecf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034f8bad-5143-4cd6-bf2a-167ae912650e", "name": "network-vif-plugged", "status": "completed", "tag": "1ae60f86-b2f6-451b-b03e-e98626e6f84a"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:47.051324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:47.071796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3f022c74-877b-4b10-8a2d-2221cb53a1c1 req-244bbc62-e5d5-4c22-8d5e-12437ee0ecf3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:47.074179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3f022c74-877b-4b10-8a2d-2221cb53a1c1 req-244bbc62-e5d5-4c22-8d5e-12437ee0ecf3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:47.076860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3f022c74-877b-4b10-8a2d-2221cb53a1c1 req-244bbc62-e5d5-4c22-8d5e-12437ee0ecf3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:47.165901 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-3f022c74-877b-4b10-8a2d-2221cb53a1c1 req-244bbc62-e5d5-4c22-8d5e-12437ee0ecf3 service nova] Creating event network-vif-plugged:1ae60f86-b2f6-451b-b03e-e98626e6f84a for instance 034f8bad-5143-4cd6-bf2a-167ae912650e on n-h1-845781-6 Aug 09 17:30:47.185920 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-3f022c74-877b-4b10-8a2d-2221cb53a1c1 req-244bbc62-e5d5-4c22-8d5e-12437ee0ecf3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184722 Aug 09 17:30:47.203229 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1994/4171] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:30:47.530035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0c660edc-3654-4577-8a34-9d65d54d471a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:47.534889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0c660edc-3654-4577-8a34-9d65d54d471a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:47.602218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c660edc-3654-4577-8a34-9d65d54d471a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:47.603020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c660edc-3654-4577-8a34-9d65d54d471a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:47.603746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c660edc-3654-4577-8a34-9d65d54d471a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:47.621824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c660edc-3654-4577-8a34-9d65d54d471a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:47.622709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c660edc-3654-4577-8a34-9d65d54d471a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:47.623792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c660edc-3654-4577-8a34-9d65d54d471a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:47.742672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5d58277e-954e-4e5c-ad3d-3eaa126c6b88 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:47.753635 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5d58277e-954e-4e5c-ad3d-3eaa126c6b88 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1292 microversion: 2.1 time: 0.923569 Aug 09 17:30:47.762950 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2178/4172] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:46 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1292 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:47.829217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-012beed1-186b-4212-a871-ae8a1fd33a66 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:47.832711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-012beed1-186b-4212-a871-ae8a1fd33a66 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:47.873573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-012beed1-186b-4212-a871-ae8a1fd33a66 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:47.880802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-012beed1-186b-4212-a871-ae8a1fd33a66 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:47.890522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-012beed1-186b-4212-a871-ae8a1fd33a66 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:47.891539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-012beed1-186b-4212-a871-ae8a1fd33a66 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:47.893454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-012beed1-186b-4212-a871-ae8a1fd33a66 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:47.899502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-012beed1-186b-4212-a871-ae8a1fd33a66 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:48.350050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-012beed1-186b-4212-a871-ae8a1fd33a66 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:48.373207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0c660edc-3654-4577-8a34-9d65d54d471a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:48.394222 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-012beed1-186b-4212-a871-ae8a1fd33a66 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1319 microversion: 2.1 time: 0.569687 Aug 09 17:30:48.400678 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2179/4173] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:47 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1319 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:30:48.423730 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0c660edc-3654-4577-8a34-9d65d54d471a tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1450 microversion: 2.1 time: 0.903206 Aug 09 17:30:48.430197 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1995/4174] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:47 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1450 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:30:48.689441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-29f4a71b-c926-4c57-95a9-c42b4b17ebd9 req-349402ea-436b-4eab-91f7-e162a5a94f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7acc97e-cd9f-4de6-afc7-734fb25d253e", "name": "network-vif-deleted", "tag": "4c09ecb4-5d41-4c79-ad78-c9c698d2b1ff"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:48.702068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-29f4a71b-c926-4c57-95a9-c42b4b17ebd9 req-349402ea-436b-4eab-91f7-e162a5a94f10 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:48.702837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-29f4a71b-c926-4c57-95a9-c42b4b17ebd9 req-349402ea-436b-4eab-91f7-e162a5a94f10 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:48.703819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-29f4a71b-c926-4c57-95a9-c42b4b17ebd9 req-349402ea-436b-4eab-91f7-e162a5a94f10 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:48.747814 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-29f4a71b-c926-4c57-95a9-c42b4b17ebd9 req-349402ea-436b-4eab-91f7-e162a5a94f10 service nova] Creating event network-vif-deleted:4c09ecb4-5d41-4c79-ad78-c9c698d2b1ff for instance d7acc97e-cd9f-4de6-afc7-734fb25d253e on n-h1-845781-6 Aug 09 17:30:48.778550 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-29f4a71b-c926-4c57-95a9-c42b4b17ebd9 req-349402ea-436b-4eab-91f7-e162a5a94f10 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093415 Aug 09 17:30:48.786421 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2180/4175] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:48.804524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c0bde815-5090-445a-8309-9525d676b515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:48.806181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c0bde815-5090-445a-8309-9525d676b515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:48.822572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0bde815-5090-445a-8309-9525d676b515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:48.826071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0bde815-5090-445a-8309-9525d676b515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:48.827098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0bde815-5090-445a-8309-9525d676b515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:48.831139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0bde815-5090-445a-8309-9525d676b515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:48.832126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0bde815-5090-445a-8309-9525d676b515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:48.833832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c0bde815-5090-445a-8309-9525d676b515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:49.440431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1f95966-8219-4dd8-bf82-5b6d0afb2457 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:49.441592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d1f95966-8219-4dd8-bf82-5b6d0afb2457 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:49.460319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f95966-8219-4dd8-bf82-5b6d0afb2457 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:49.461438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f95966-8219-4dd8-bf82-5b6d0afb2457 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:49.462228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f95966-8219-4dd8-bf82-5b6d0afb2457 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:49.487089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f95966-8219-4dd8-bf82-5b6d0afb2457 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:49.494027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f95966-8219-4dd8-bf82-5b6d0afb2457 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:49.508390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f95966-8219-4dd8-bf82-5b6d0afb2457 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:50.184435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c0bde815-5090-445a-8309-9525d676b515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:50.219174 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c0bde815-5090-445a-8309-9525d676b515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1292 microversion: 2.1 time: 1.419451 Aug 09 17:30:50.221515 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1996/4176] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:48 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1292 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:50.235442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:50.237736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:50.265218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:50.266731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:50.268028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:50.271543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:50.273327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:50.274545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:50.470920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:50.486625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:50.487978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:50.498056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lazy-loading 'fault' on Instance uuid d7acc97e-cd9f-4de6-afc7-734fb25d253e {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:30:50.516513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d1f95966-8219-4dd8-bf82-5b6d0afb2457 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:50.550781 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1f95966-8219-4dd8-bf82-5b6d0afb2457 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1319 microversion: 2.1 time: 1.117238 Aug 09 17:30:50.553130 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2181/4177] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:49 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1319 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:30:50.793729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd089ace53d1b4ad1bee793e97952705f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354ad7c984004cd1b1bd4a2058afb615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:50.840574 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d0aefd5d-a846-4cfa-88c2-d363d372bf9d tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 200 len: 1304 microversion: 2.1 time: 0.591818 Aug 09 17:30:50.842050 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1997/4178] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:50 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 1304 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:51.276177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a6a8d41d-6a58-467a-9e65-8c4dc3db8e65 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:51.279035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a6a8d41d-6a58-467a-9e65-8c4dc3db8e65 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:51.308614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:30:51.357202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a8d41d-6a58-467a-9e65-8c4dc3db8e65 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:51.361694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a8d41d-6a58-467a-9e65-8c4dc3db8e65 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:51.364076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a8d41d-6a58-467a-9e65-8c4dc3db8e65 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:51.367051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a8d41d-6a58-467a-9e65-8c4dc3db8e65 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:51.371334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a8d41d-6a58-467a-9e65-8c4dc3db8e65 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:51.374331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6a8d41d-6a58-467a-9e65-8c4dc3db8e65 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:51.612552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-81b9713b-e584-470e-abd5-0acf5947ad8a tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:51.618380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-81b9713b-e584-470e-abd5-0acf5947ad8a tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:51.647096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b9713b-e584-470e-abd5-0acf5947ad8a tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:51.653557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b9713b-e584-470e-abd5-0acf5947ad8a tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:51.654199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b9713b-e584-470e-abd5-0acf5947ad8a tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:51.661890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b9713b-e584-470e-abd5-0acf5947ad8a tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:51.682490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b9713b-e584-470e-abd5-0acf5947ad8a tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:51.687749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b9713b-e584-470e-abd5-0acf5947ad8a tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:52.327538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a6a8d41d-6a58-467a-9e65-8c4dc3db8e65 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:52.356043 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a6a8d41d-6a58-467a-9e65-8c4dc3db8e65 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1292 microversion: 2.1 time: 1.115846 Aug 09 17:30:52.361522 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2182/4179] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:51 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1292 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:52.375085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:52.381500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] [instance: d7acc97e-cd9f-4de6-afc7-734fb25d253e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:52.406908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:52.411942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:52.415410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:52.417272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:52.418534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:52.419756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:52.470145 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] HTTP exception thrown: Instance d7acc97e-cd9f-4de6-afc7-734fb25d253e could not be found. Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Request method failure captured: Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e HTTP/1.1 Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pkcJwT_rQOYKr4rum-_PinKChAcjTXVNFXmOgq65-BlI1MyJT2AMy3o_5SNGXnEixIgRk2XEAGlle7rUyxunzvnBpkZf9s72o82G6T_Xr1zaKyk47HB9AdZ6TXCGSj14TlHubgPaRiCRnw0YmDQQznj1Xyktl-WoEcgZb3f5jMNx1k Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 354ad7c984004cd1b1bd4a2058afb615 Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerRescueTestJSON-1038725306 Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_354ad7c984004cd1b1bd4a2058afb615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/354ad7c984004cd1b1bd4a2058afb615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/354ad7c984004cd1b1bd4a2058afb615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/354ad7c984004cd1b1bd4a2058afb615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerRescueTestJSON-1038725306 Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 354ad7c984004cd1b1bd4a2058afb615 Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerRescueTestJSON-1038725306 Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerRescueTestJSON-1038725306-project Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d089ace53d1b4ad1bee793e97952705f Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerRescueTestJSON-1038725306-project Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance d7acc97e-cd9f-4de6-afc7-734fb25d253e could not be found. Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'd7acc97e-cd9f-4de6-afc7-734fb25d253e'} Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7acc97e-cd9f-4de6-afc7-734fb25d253e could not be found. Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7acc97e-cd9f-4de6-afc7-734fb25d253e could not be found. Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:30:52.478669 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:52.486397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:30:52.486397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:30:52.486397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:30:52.486397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:30:52.486397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:30:52.486397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7acc97e-cd9f-4de6-afc7-734fb25d253e could not be found. Aug 09 17:30:52.486397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:30:52.488963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] Returning 404 to user: Instance d7acc97e-cd9f-4de6-afc7-734fb25d253e could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:30:52.491304 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0d86a672-a98d-448a-a0df-4df3cd19ef2f tempest-ServerRescueTestJSON-1038725306 tempest-ServerRescueTestJSON-1038725306-project] 10.222.0.93 "GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e" status: 404 len: 111 microversion: 2.1 time: 0.125156 Aug 09 17:30:52.502150 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2183/4180] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:52 2022] GET /compute/v2.1/servers/d7acc97e-cd9f-4de6-afc7-734fb25d253e => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:30:52.966012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-81b9713b-e584-470e-abd5-0acf5947ad8a tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:52.998662 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-81b9713b-e584-470e-abd5-0acf5947ad8a tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1507 microversion: 2.1 time: 1.385628 Aug 09 17:30:53.006167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1998/4181] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:51 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1507 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:30:53.387165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8792971d-76ec-4d9b-b0a8-8b5e24246515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:53.397697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8792971d-76ec-4d9b-b0a8-8b5e24246515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:53.484138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8792971d-76ec-4d9b-b0a8-8b5e24246515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:53.486791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8792971d-76ec-4d9b-b0a8-8b5e24246515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:53.492794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8792971d-76ec-4d9b-b0a8-8b5e24246515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:53.497584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8792971d-76ec-4d9b-b0a8-8b5e24246515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:53.501324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8792971d-76ec-4d9b-b0a8-8b5e24246515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:53.503047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8792971d-76ec-4d9b-b0a8-8b5e24246515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:55.060735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8792971d-76ec-4d9b-b0a8-8b5e24246515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:55.128295 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8792971d-76ec-4d9b-b0a8-8b5e24246515 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1292 microversion: 2.1 time: 1.752602 Aug 09 17:30:55.147580 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2184/4182] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:53 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1292 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:55.998569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-8b02dca7-c6f7-46e8-a842-c08e108bedf3 req-4faeb545-475d-4ab1-9048-7fe76c339b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0037d3e-a7b8-43c1-98c4-55edce1a4ff3", "name": "network-vif-plugged", "status": "completed", "tag": "c7628ef0-2168-4f56-94bc-bd4edc71890c"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:30:56.063243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8b02dca7-c6f7-46e8-a842-c08e108bedf3 req-4faeb545-475d-4ab1-9048-7fe76c339b8d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:56.070809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8b02dca7-c6f7-46e8-a842-c08e108bedf3 req-4faeb545-475d-4ab1-9048-7fe76c339b8d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:56.074819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8b02dca7-c6f7-46e8-a842-c08e108bedf3 req-4faeb545-475d-4ab1-9048-7fe76c339b8d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:56.104174 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-8b02dca7-c6f7-46e8-a842-c08e108bedf3 req-4faeb545-475d-4ab1-9048-7fe76c339b8d service nova] Creating event network-vif-plugged:c7628ef0-2168-4f56-94bc-bd4edc71890c for instance c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 on n-h1-845781-6 Aug 09 17:30:56.124946 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-8b02dca7-c6f7-46e8-a842-c08e108bedf3 req-4faeb545-475d-4ab1-9048-7fe76c339b8d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135816 Aug 09 17:30:56.136821 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 1999/4183] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:30:56.185336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-14d58814-51fd-499f-80ba-8a8881aeaa38 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:56.187002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-14d58814-51fd-499f-80ba-8a8881aeaa38 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:56.256776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d58814-51fd-499f-80ba-8a8881aeaa38 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:56.258082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d58814-51fd-499f-80ba-8a8881aeaa38 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:56.261245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d58814-51fd-499f-80ba-8a8881aeaa38 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:56.269201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d58814-51fd-499f-80ba-8a8881aeaa38 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:56.281409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d58814-51fd-499f-80ba-8a8881aeaa38 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:56.290371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d58814-51fd-499f-80ba-8a8881aeaa38 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:57.431846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-14d58814-51fd-499f-80ba-8a8881aeaa38 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:30:57.447178 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-14d58814-51fd-499f-80ba-8a8881aeaa38 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1292 microversion: 2.1 time: 1.268031 Aug 09 17:30:57.466523 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2185/4184] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:56 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1292 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:30:58.484881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d946bc32-e239-4286-8c8f-2f0208131281 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:30:58.504676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d946bc32-e239-4286-8c8f-2f0208131281 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:30:58.540915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d946bc32-e239-4286-8c8f-2f0208131281 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:58.541772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d946bc32-e239-4286-8c8f-2f0208131281 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:58.542587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d946bc32-e239-4286-8c8f-2f0208131281 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:30:58.558082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d946bc32-e239-4286-8c8f-2f0208131281 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:30:58.559464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d946bc32-e239-4286-8c8f-2f0208131281 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:30:58.560643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d946bc32-e239-4286-8c8f-2f0208131281 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:00.251138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d946bc32-e239-4286-8c8f-2f0208131281 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:00.281017 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d946bc32-e239-4286-8c8f-2f0208131281 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1472 microversion: 2.1 time: 1.808256 Aug 09 17:31:00.299720 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2000/4185] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:30:58 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1472 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:00.857406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2051754970", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:05.722051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ce683e47-9b7d-40cd-8690-9fa1387801bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:05.725043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ce683e47-9b7d-40cd-8690-9fa1387801bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:05.757343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce683e47-9b7d-40cd-8690-9fa1387801bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:05.759690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce683e47-9b7d-40cd-8690-9fa1387801bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:05.760479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce683e47-9b7d-40cd-8690-9fa1387801bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:05.766113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce683e47-9b7d-40cd-8690-9fa1387801bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:05.767679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce683e47-9b7d-40cd-8690-9fa1387801bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:05.771854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ce683e47-9b7d-40cd-8690-9fa1387801bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:05.788472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=78 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:05.841871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] validate_networks() for [('829cb0b3-9c78-4844-8875-46f5a554f097', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:31:06.351236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ce683e47-9b7d-40cd-8690-9fa1387801bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:06.369354 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ce683e47-9b7d-40cd-8690-9fa1387801bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 0.656301 Aug 09 17:31:06.371863 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2001/4186] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:05 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:07.248121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:31:07.248931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:31:07.249669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:31:07.250380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:31:07.251047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:31:07.289582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:07.290556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:07.291269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:07.298220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:07.299487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:07.300078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:07.363754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:31:07.404171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-39c1fc75-05f3-457e-9dbd-25d4d282ed27 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:07.412361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for user 1d4dd578ed0640fc943af026c4363e28 and project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:31:07.414247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-39c1fc75-05f3-457e-9dbd-25d4d282ed27 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:07.451677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39c1fc75-05f3-457e-9dbd-25d4d282ed27 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:07.470349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39c1fc75-05f3-457e-9dbd-25d4d282ed27 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:07.473056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39c1fc75-05f3-457e-9dbd-25d4d282ed27 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:07.480245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39c1fc75-05f3-457e-9dbd-25d4d282ed27 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:07.485179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39c1fc75-05f3-457e-9dbd-25d4d282ed27 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:07.493880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39c1fc75-05f3-457e-9dbd-25d4d282ed27 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:07.516656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:31:07.527349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 6d406eec-14ff-4e90-a63e-f8b1d8e9e330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:31:07.647765 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eaaac1dc-fe15-4e0a-9059-3781ecd591f5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.795004 Aug 09 17:31:07.649798 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2186/4187] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:31:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 6798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:31:07.665686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-82b4e3b5-b3d7-4fbb-9156-e9441a7059ff tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:07.666556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-82b4e3b5-b3d7-4fbb-9156-e9441a7059ff tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 6d406eec-14ff-4e90-a63e-f8b1d8e9e330] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:07.701138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-82b4e3b5-b3d7-4fbb-9156-e9441a7059ff tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 6d406eec-14ff-4e90-a63e-f8b1d8e9e330] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:31:08.344150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-39c1fc75-05f3-457e-9dbd-25d4d282ed27 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:08.359835 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-39c1fc75-05f3-457e-9dbd-25d4d282ed27 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.962597 Aug 09 17:31:08.368388 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2002/4188] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:07 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:08.424631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-979ff14f-da43-4247-86b1-0c2fd1fd54d2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-326589157"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:08.431991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-979ff14f-da43-4247-86b1-0c2fd1fd54d2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:08.475860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-979ff14f-da43-4247-86b1-0c2fd1fd54d2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:08.475860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-979ff14f-da43-4247-86b1-0c2fd1fd54d2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:08.475860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-979ff14f-da43-4247-86b1-0c2fd1fd54d2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:08.475860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-979ff14f-da43-4247-86b1-0c2fd1fd54d2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:08.478866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-979ff14f-da43-4247-86b1-0c2fd1fd54d2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:08.482142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-979ff14f-da43-4247-86b1-0c2fd1fd54d2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:08.625220 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-82b4e3b5-b3d7-4fbb-9156-e9441a7059ff tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6d406eec-14ff-4e90-a63e-f8b1d8e9e330" status: 204 len: 0 microversion: 2.1 time: 0.967096 Aug 09 17:31:08.626959 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2187/4189] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:31:07 2022] DELETE /compute/v2.1/servers/6d406eec-14ff-4e90-a63e-f8b1d8e9e330 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:31:08.654250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6c20f02-69e8-4b2f-af61-a1cc2aca2765 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:08.654917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f6c20f02-69e8-4b2f-af61-a1cc2aca2765 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:08.708947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c20f02-69e8-4b2f-af61-a1cc2aca2765 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:08.709851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c20f02-69e8-4b2f-af61-a1cc2aca2765 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:08.713045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c20f02-69e8-4b2f-af61-a1cc2aca2765 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:08.718689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c20f02-69e8-4b2f-af61-a1cc2aca2765 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:08.723038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c20f02-69e8-4b2f-af61-a1cc2aca2765 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:08.729945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c20f02-69e8-4b2f-af61-a1cc2aca2765 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:08.852723 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f6c20f02-69e8-4b2f-af61-a1cc2aca2765 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/ips" status: 200 len: 150 microversion: 2.1 time: 0.220953 Aug 09 17:31:08.871086 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2188/4190] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:31:08 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/ips => generated 150 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:08.895556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50b6654d-b014-460f-912a-662ca1f7f917 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:08.897049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-50b6654d-b014-460f-912a-662ca1f7f917 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 6d406eec-14ff-4e90-a63e-f8b1d8e9e330] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:08.924676 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-50b6654d-b014-460f-912a-662ca1f7f917 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50b6654d-b014-460f-912a-662ca1f7f917 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/6d406eec-14ff-4e90-a63e-f8b1d8e9e330 HTTP/1.1 Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '6d406eec-14ff-4e90-a63e-f8b1d8e9e330'} Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:31:08.928711 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:31:08.937122 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:31:08.937122 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:31:08.937122 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:31:08.937122 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:31:08.937122 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:31:08.941038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50b6654d-b014-460f-912a-662ca1f7f917 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:31:08.943465 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-50b6654d-b014-460f-912a-662ca1f7f917 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/6d406eec-14ff-4e90-a63e-f8b1d8e9e330" status: 404 len: 111 microversion: 2.1 time: 0.067099 Aug 09 17:31:08.944629 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2189/4191] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:08 2022] GET /compute/v2.1/servers/6d406eec-14ff-4e90-a63e-f8b1d8e9e330 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:31:09.186415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-45270c66-3925-47f0-9626-1dd5c81589a9 req-135e3255-7e53-4e5a-a23e-9a051ab70cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a30c674-6026-45bd-b50e-218ae7d69382", "name": "network-vif-unplugged", "status": "completed", "tag": "a73935e9-c581-4296-b0ba-805a64e85308"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:09.217564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-45270c66-3925-47f0-9626-1dd5c81589a9 req-135e3255-7e53-4e5a-a23e-9a051ab70cb2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:09.218212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-45270c66-3925-47f0-9626-1dd5c81589a9 req-135e3255-7e53-4e5a-a23e-9a051ab70cb2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:09.218666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-45270c66-3925-47f0-9626-1dd5c81589a9 req-135e3255-7e53-4e5a-a23e-9a051ab70cb2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:09.256707 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-45270c66-3925-47f0-9626-1dd5c81589a9 req-135e3255-7e53-4e5a-a23e-9a051ab70cb2 service nova] Creating event network-vif-unplugged:a73935e9-c581-4296-b0ba-805a64e85308 for instance 1a30c674-6026-45bd-b50e-218ae7d69382 on n-h2-845781-6 Aug 09 17:31:09.278241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-45270c66-3925-47f0-9626-1dd5c81589a9 req-135e3255-7e53-4e5a-a23e-9a051ab70cb2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095741 Aug 09 17:31:09.287492 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2190/4192] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:31:09.733471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-868879979", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "829cb0b3-9c78-4844-8875-46f5a554f097"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:17.337517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:17.958010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:18.454845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=21 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:18.675478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=17 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:19.266071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:19.903955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:23.075688 n-d-845781-6 devstack@n-api.service[119432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:31:23.076648 n-d-845781-6 devstack@n-api.service[119432]: Tue Aug 9 17:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action (ip 10.222.0.93) !!! Aug 09 17:31:24.313647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] validate_networks() for [('829cb0b3-9c78-4844-8875-46f5a554f097', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:31:24.474298 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-979ff14f-da43-4247-86b1-0c2fd1fd54d2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 16.074854 Aug 09 17:31:24.475162 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2003/4193] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:31:08 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 16077 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 09 17:31:24.516708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0262fce0-c7a5-47f3-a4ae-2e15efc96178 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a68ee3e-12d1-42c5-8455-8b36d9d1c3a9"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:24.531044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0262fce0-c7a5-47f3-a4ae-2e15efc96178 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:24.551313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0262fce0-c7a5-47f3-a4ae-2e15efc96178 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:24.555327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0262fce0-c7a5-47f3-a4ae-2e15efc96178 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:24.555939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0262fce0-c7a5-47f3-a4ae-2e15efc96178 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:24.559759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0262fce0-c7a5-47f3-a4ae-2e15efc96178 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:24.562056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0262fce0-c7a5-47f3-a4ae-2e15efc96178 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:24.564432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0262fce0-c7a5-47f3-a4ae-2e15efc96178 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:25.247951 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0262fce0-c7a5-47f3-a4ae-2e15efc96178 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "POST /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752911 Aug 09 17:31:25.249097 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2004/4194] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:31:24 2022] POST /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 194 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:25.888779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:31:25.889766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:31:25.890937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:31:25.891973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:31:25.892974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:31:25.983253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:25.985901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:25.988819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:26.012132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:26.019033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:26.022970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:26.149322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:31:26.183569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for user 1d4dd578ed0640fc943af026c4363e28 and project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:31:26.198624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1896891858", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:26.257419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:31:26.273313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:31:26.530525 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-059feb52-781b-45ae-8b41-3354332c6a8a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.827924 Aug 09 17:31:26.532230 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2191/4195] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 16834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:31:26.543236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4d074365-dd40-4483-8316-b8743d32a3ea tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:26.544454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4d074365-dd40-4483-8316-b8743d32a3ea tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:26.560022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d074365-dd40-4483-8316-b8743d32a3ea tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:26.560873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d074365-dd40-4483-8316-b8743d32a3ea tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:26.561665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d074365-dd40-4483-8316-b8743d32a3ea tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:26.562958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d074365-dd40-4483-8316-b8743d32a3ea tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:26.563871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d074365-dd40-4483-8316-b8743d32a3ea tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:26.564911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d074365-dd40-4483-8316-b8743d32a3ea tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:27.124183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4d074365-dd40-4483-8316-b8743d32a3ea tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:27.139176 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4d074365-dd40-4483-8316-b8743d32a3ea tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1687 microversion: 2.1 time: 0.603323 Aug 09 17:31:27.143252 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2192/4196] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:26 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1687 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:27.153514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6a6e61bc-736d-4e35-97aa-02790cf036f3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:27.154153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6a6e61bc-736d-4e35-97aa-02790cf036f3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:27.290017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6a6e61bc-736d-4e35-97aa-02790cf036f3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:27.305915 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6a6e61bc-736d-4e35-97aa-02790cf036f3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1220 microversion: 2.1 time: 0.160945 Aug 09 17:31:27.308046 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2193/4197] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:27 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1220 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:27.871392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] validate_networks() for [('644cad86-9d4a-4b76-9a24-42ff0b91bd51', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:31:28.180300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4b714b3c-5b68-4871-86d5-d3b86b5fa498 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:28.188751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4b714b3c-5b68-4871-86d5-d3b86b5fa498 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:28.308663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b714b3c-5b68-4871-86d5-d3b86b5fa498 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:28.319838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b714b3c-5b68-4871-86d5-d3b86b5fa498 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:28.320679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b714b3c-5b68-4871-86d5-d3b86b5fa498 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:28.321629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b714b3c-5b68-4871-86d5-d3b86b5fa498 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:28.322175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b714b3c-5b68-4871-86d5-d3b86b5fa498 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:28.322661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b714b3c-5b68-4871-86d5-d3b86b5fa498 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:28.863102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4b714b3c-5b68-4871-86d5-d3b86b5fa498 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:28.888036 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4b714b3c-5b68-4871-86d5-d3b86b5fa498 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 0.723345 Aug 09 17:31:28.891395 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2194/4198] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:28 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:28.907675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8baa287b-43cb-483b-b013-1e1924f34de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:28.916611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8baa287b-43cb-483b-b013-1e1924f34de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:28.962355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8baa287b-43cb-483b-b013-1e1924f34de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:28.963121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8baa287b-43cb-483b-b013-1e1924f34de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:28.964010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8baa287b-43cb-483b-b013-1e1924f34de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:28.964957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8baa287b-43cb-483b-b013-1e1924f34de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:28.965604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8baa287b-43cb-483b-b013-1e1924f34de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:28.966215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8baa287b-43cb-483b-b013-1e1924f34de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:29.179892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8baa287b-43cb-483b-b013-1e1924f34de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:29.202320 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8baa287b-43cb-483b-b013-1e1924f34de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1224 microversion: 2.1 time: 0.302996 Aug 09 17:31:29.220520 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2195/4199] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:28 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1224 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:29.929133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7951b097-8668-459d-84fc-e754fc39906a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:29.930198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7951b097-8668-459d-84fc-e754fc39906a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:29.982900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7951b097-8668-459d-84fc-e754fc39906a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:29.984514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7951b097-8668-459d-84fc-e754fc39906a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:29.990640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7951b097-8668-459d-84fc-e754fc39906a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:29.994677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7951b097-8668-459d-84fc-e754fc39906a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:29.999074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7951b097-8668-459d-84fc-e754fc39906a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:30.007514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7951b097-8668-459d-84fc-e754fc39906a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:31.449344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7951b097-8668-459d-84fc-e754fc39906a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:31.476291 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7951b097-8668-459d-84fc-e754fc39906a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 1.551804 Aug 09 17:31:31.508437 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2196/4200] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:29 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:31.571067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-54668c56-03ad-4743-8780-6046f62a9875 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:31.581180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-54668c56-03ad-4743-8780-6046f62a9875 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:31.632662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54668c56-03ad-4743-8780-6046f62a9875 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:31.643699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54668c56-03ad-4743-8780-6046f62a9875 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:31.644866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54668c56-03ad-4743-8780-6046f62a9875 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:31.647101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54668c56-03ad-4743-8780-6046f62a9875 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:31.648055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54668c56-03ad-4743-8780-6046f62a9875 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:31.648860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54668c56-03ad-4743-8780-6046f62a9875 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:32.086298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:31:32.087356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:31:32.088721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:31:32.089422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:31:32.090038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:31:32.124459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:32.134943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:32.136066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:32.137342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:32.140966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:32.142209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:32.210750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-54668c56-03ad-4743-8780-6046f62a9875 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:32.253586 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-54668c56-03ad-4743-8780-6046f62a9875 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1278 microversion: 2.1 time: 0.728345 Aug 09 17:31:32.255267 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2197/4201] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:31 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1278 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:32.263027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Getting quotas for project f41de2908c5a4249980712f71d2e6de4. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:31:32.319613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Getting quotas for user 9583cf0668db41c3b576ba183678ea07 and project f41de2908c5a4249980712f71d2e6de4. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:31:32.428957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:31:32.442711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:31:32.554808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a0c3ce6b-2048-4fbf-948b-a00d3b120b8d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:32.556126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a0c3ce6b-2048-4fbf-948b-a00d3b120b8d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:32.610160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0c3ce6b-2048-4fbf-948b-a00d3b120b8d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:32.618027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0c3ce6b-2048-4fbf-948b-a00d3b120b8d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:32.624005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0c3ce6b-2048-4fbf-948b-a00d3b120b8d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:32.633829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0c3ce6b-2048-4fbf-948b-a00d3b120b8d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:32.637671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0c3ce6b-2048-4fbf-948b-a00d3b120b8d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:32.641639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0c3ce6b-2048-4fbf-948b-a00d3b120b8d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:32.850606 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2d25c5b3-07bb-43a6-80a3-4a5c8a668ed4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.599487 Aug 09 17:31:32.858304 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2005/4202] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:31:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 7608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:31:32.883286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-96e671a5-8a58-4c6f-b039-111f871d3d77 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:32.896270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-96e671a5-8a58-4c6f-b039-111f871d3d77 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:33.475754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a0c3ce6b-2048-4fbf-948b-a00d3b120b8d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:33.507755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a0c3ce6b-2048-4fbf-948b-a00d3b120b8d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 0.959777 Aug 09 17:31:33.508509 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2198/4203] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:32 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:33.524935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-84b95027-415c-4f15-91bf-24868ba5f0c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:33.526803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-84b95027-415c-4f15-91bf-24868ba5f0c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:33.530451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-96e671a5-8a58-4c6f-b039-111f871d3d77 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:33.544169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b95027-415c-4f15-91bf-24868ba5f0c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:33.545753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b95027-415c-4f15-91bf-24868ba5f0c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:33.547541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b95027-415c-4f15-91bf-24868ba5f0c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:33.548540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b95027-415c-4f15-91bf-24868ba5f0c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:33.552848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b95027-415c-4f15-91bf-24868ba5f0c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:33.553328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b95027-415c-4f15-91bf-24868ba5f0c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:33.594091 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-96e671a5-8a58-4c6f-b039-111f871d3d77 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1223 microversion: 2.1 time: 0.720612 Aug 09 17:31:33.609884 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2006/4204] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:32 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1223 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:34.109280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-84b95027-415c-4f15-91bf-24868ba5f0c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:34.142822 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-84b95027-415c-4f15-91bf-24868ba5f0c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1278 microversion: 2.1 time: 0.631351 Aug 09 17:31:34.157238 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2199/4205] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:33 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1278 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:34.551990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1893a077-901c-4583-8ff4-a9a1a5b56a35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:34.552868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1893a077-901c-4583-8ff4-a9a1a5b56a35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:34.577760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1893a077-901c-4583-8ff4-a9a1a5b56a35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:34.578961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1893a077-901c-4583-8ff4-a9a1a5b56a35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:34.580470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1893a077-901c-4583-8ff4-a9a1a5b56a35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:34.581377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1893a077-901c-4583-8ff4-a9a1a5b56a35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:34.583967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1893a077-901c-4583-8ff4-a9a1a5b56a35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:34.584563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1893a077-901c-4583-8ff4-a9a1a5b56a35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:34.623903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9be1b05e-43db-472b-9d93-3c6f17a996b0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:34.624671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9be1b05e-43db-472b-9d93-3c6f17a996b0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:35.164270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9be1b05e-43db-472b-9d93-3c6f17a996b0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:35.188989 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9be1b05e-43db-472b-9d93-3c6f17a996b0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1223 microversion: 2.1 time: 0.568887 Aug 09 17:31:35.209348 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2200/4206] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:34 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1223 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:35.214485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-62477792-f68b-4cc1-a593-3807c9b9818b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:35.240472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-62477792-f68b-4cc1-a593-3807c9b9818b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:35.286854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62477792-f68b-4cc1-a593-3807c9b9818b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:35.296891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62477792-f68b-4cc1-a593-3807c9b9818b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:35.306898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62477792-f68b-4cc1-a593-3807c9b9818b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:35.309235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62477792-f68b-4cc1-a593-3807c9b9818b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:35.310657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62477792-f68b-4cc1-a593-3807c9b9818b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:35.316944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62477792-f68b-4cc1-a593-3807c9b9818b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:35.736022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-62477792-f68b-4cc1-a593-3807c9b9818b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:35.824994 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-62477792-f68b-4cc1-a593-3807c9b9818b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1278 microversion: 2.1 time: 0.574965 Aug 09 17:31:35.843733 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2201/4207] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:35 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1278 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:36.215372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:36.221752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:36.226994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:36.319517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:36.331045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:36.332358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:36.354273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:36.363677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:36.364459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:36.658196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:36.683249 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1293 microversion: 2.1 time: 0.476056 Aug 09 17:31:36.700968 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2202/4208] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:36 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1293 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:36.705042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:36.710675 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b1b2e96d-5783-4829-a547-58ca57a18d6f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007677 Aug 09 17:31:36.714978 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2203/4209] 10.222.0.93 () {56 vars in 886 bytes} [Tue Aug 9 17:31:36 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 09 17:31:36.883091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1c515b9-7b58-4bcf-9175-2f76dd8f18f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:36.884265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1c515b9-7b58-4bcf-9175-2f76dd8f18f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:36.916959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c515b9-7b58-4bcf-9175-2f76dd8f18f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:36.918308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c515b9-7b58-4bcf-9175-2f76dd8f18f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:36.919389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c515b9-7b58-4bcf-9175-2f76dd8f18f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:36.923342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c515b9-7b58-4bcf-9175-2f76dd8f18f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:36.928367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c515b9-7b58-4bcf-9175-2f76dd8f18f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:36.929552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1c515b9-7b58-4bcf-9175-2f76dd8f18f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:37.518764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a1c515b9-7b58-4bcf-9175-2f76dd8f18f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:37.531517 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1c515b9-7b58-4bcf-9175-2f76dd8f18f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1278 microversion: 2.1 time: 0.656945 Aug 09 17:31:37.555828 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2204/4210] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:36 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1278 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:37.569309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d35fb563-11f6-4cd3-9d75-9e001963c80e req-5e784cca-a49a-4941-a16c-a2d2d2e4d3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a30c674-6026-45bd-b50e-218ae7d69382", "name": "network-vif-plugged", "status": "completed", "tag": "a73935e9-c581-4296-b0ba-805a64e85308"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:37.596260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d35fb563-11f6-4cd3-9d75-9e001963c80e req-5e784cca-a49a-4941-a16c-a2d2d2e4d3fb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:37.597077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d35fb563-11f6-4cd3-9d75-9e001963c80e req-5e784cca-a49a-4941-a16c-a2d2d2e4d3fb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:37.597692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d35fb563-11f6-4cd3-9d75-9e001963c80e req-5e784cca-a49a-4941-a16c-a2d2d2e4d3fb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:37.636724 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d35fb563-11f6-4cd3-9d75-9e001963c80e req-5e784cca-a49a-4941-a16c-a2d2d2e4d3fb service nova] Creating event network-vif-plugged:a73935e9-c581-4296-b0ba-805a64e85308 for instance 1a30c674-6026-45bd-b50e-218ae7d69382 on n-h2-845781-6 Aug 09 17:31:37.668304 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d35fb563-11f6-4cd3-9d75-9e001963c80e req-5e784cca-a49a-4941-a16c-a2d2d2e4d3fb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106416 Aug 09 17:31:37.673621 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2205/4211] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:37.737309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc2e6458-e16f-4629-9c96-bbbc982ceadb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:37.738217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bc2e6458-e16f-4629-9c96-bbbc982ceadb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:37.776612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc2e6458-e16f-4629-9c96-bbbc982ceadb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:37.776612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc2e6458-e16f-4629-9c96-bbbc982ceadb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:37.776612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc2e6458-e16f-4629-9c96-bbbc982ceadb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:37.776612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc2e6458-e16f-4629-9c96-bbbc982ceadb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:37.776612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc2e6458-e16f-4629-9c96-bbbc982ceadb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:37.776612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc2e6458-e16f-4629-9c96-bbbc982ceadb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:37.980806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1893a077-901c-4583-8ff4-a9a1a5b56a35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:38.002687 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1893a077-901c-4583-8ff4-a9a1a5b56a35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 3.455638 Aug 09 17:31:38.024981 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2007/4212] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:34 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 3479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:38.407134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bc2e6458-e16f-4629-9c96-bbbc982ceadb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:38.440192 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bc2e6458-e16f-4629-9c96-bbbc982ceadb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1281 microversion: 2.1 time: 0.706609 Aug 09 17:31:38.453113 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2206/4213] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:37 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1281 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:38.568114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9d9ef86e-7783-4b1b-a9a7-3aca06bd2e10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:38.575288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9d9ef86e-7783-4b1b-a9a7-3aca06bd2e10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:38.641714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d9ef86e-7783-4b1b-a9a7-3aca06bd2e10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:38.642557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d9ef86e-7783-4b1b-a9a7-3aca06bd2e10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:38.651063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d9ef86e-7783-4b1b-a9a7-3aca06bd2e10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:38.659006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d9ef86e-7783-4b1b-a9a7-3aca06bd2e10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:38.659847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d9ef86e-7783-4b1b-a9a7-3aca06bd2e10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:38.660672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9d9ef86e-7783-4b1b-a9a7-3aca06bd2e10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:39.069245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3095f6a5-f232-45dd-a320-0906904dd6ab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:39.070583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3095f6a5-f232-45dd-a320-0906904dd6ab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:39.090265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3095f6a5-f232-45dd-a320-0906904dd6ab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:39.094098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3095f6a5-f232-45dd-a320-0906904dd6ab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:39.094765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3095f6a5-f232-45dd-a320-0906904dd6ab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:39.095750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3095f6a5-f232-45dd-a320-0906904dd6ab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:39.097512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3095f6a5-f232-45dd-a320-0906904dd6ab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:39.099530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3095f6a5-f232-45dd-a320-0906904dd6ab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:40.050836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3095f6a5-f232-45dd-a320-0906904dd6ab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:40.065608 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3095f6a5-f232-45dd-a320-0906904dd6ab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 1.002177 Aug 09 17:31:40.072844 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2207/4214] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:39 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:40.084857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94fc62b7-6965-4ddb-81a6-15fa65ec731a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:40.088122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94fc62b7-6965-4ddb-81a6-15fa65ec731a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:40.110733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94fc62b7-6965-4ddb-81a6-15fa65ec731a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:40.125851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94fc62b7-6965-4ddb-81a6-15fa65ec731a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:40.127509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94fc62b7-6965-4ddb-81a6-15fa65ec731a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:40.137085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94fc62b7-6965-4ddb-81a6-15fa65ec731a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:40.137897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94fc62b7-6965-4ddb-81a6-15fa65ec731a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:40.138750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94fc62b7-6965-4ddb-81a6-15fa65ec731a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:40.297481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94fc62b7-6965-4ddb-81a6-15fa65ec731a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:40.322810 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94fc62b7-6965-4ddb-81a6-15fa65ec731a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1281 microversion: 2.1 time: 0.247731 Aug 09 17:31:40.326489 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2208/4215] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:40 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1281 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:40.772370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9d9ef86e-7783-4b1b-a9a7-3aca06bd2e10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:40.789597 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9d9ef86e-7783-4b1b-a9a7-3aca06bd2e10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1320 microversion: 2.1 time: 2.233941 Aug 09 17:31:40.802456 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2008/4216] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:38 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1320 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:41.111536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bb3250dc-5648-4474-abe0-0dcc4b11f230 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:41.112321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bb3250dc-5648-4474-abe0-0dcc4b11f230 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:41.131598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb3250dc-5648-4474-abe0-0dcc4b11f230 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:41.132152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb3250dc-5648-4474-abe0-0dcc4b11f230 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:41.132609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb3250dc-5648-4474-abe0-0dcc4b11f230 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:41.133388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb3250dc-5648-4474-abe0-0dcc4b11f230 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:41.133867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb3250dc-5648-4474-abe0-0dcc4b11f230 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:41.134307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb3250dc-5648-4474-abe0-0dcc4b11f230 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:41.350014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5776a934-116f-4e5d-866f-4ed92896f2f4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:41.350853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5776a934-116f-4e5d-866f-4ed92896f2f4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:41.389414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5776a934-116f-4e5d-866f-4ed92896f2f4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:41.390349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5776a934-116f-4e5d-866f-4ed92896f2f4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:41.391153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5776a934-116f-4e5d-866f-4ed92896f2f4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:41.392541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5776a934-116f-4e5d-866f-4ed92896f2f4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:41.393404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5776a934-116f-4e5d-866f-4ed92896f2f4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:41.394214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5776a934-116f-4e5d-866f-4ed92896f2f4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:41.755774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bb3250dc-5648-4474-abe0-0dcc4b11f230 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:41.780074 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bb3250dc-5648-4474-abe0-0dcc4b11f230 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 0.672534 Aug 09 17:31:41.788375 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2209/4217] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:41 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:41.848032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c2e73ec-3fd9-49e3-8a39-e57cea69477f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:41.858019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3c2e73ec-3fd9-49e3-8a39-e57cea69477f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:41.938841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c2e73ec-3fd9-49e3-8a39-e57cea69477f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:41.950044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c2e73ec-3fd9-49e3-8a39-e57cea69477f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:41.978388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c2e73ec-3fd9-49e3-8a39-e57cea69477f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:41.979230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c2e73ec-3fd9-49e3-8a39-e57cea69477f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:41.979760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c2e73ec-3fd9-49e3-8a39-e57cea69477f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:41.980210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c2e73ec-3fd9-49e3-8a39-e57cea69477f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:42.189413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:42.417502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5776a934-116f-4e5d-866f-4ed92896f2f4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:42.431018 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5776a934-116f-4e5d-866f-4ed92896f2f4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1323 microversion: 2.1 time: 1.087595 Aug 09 17:31:42.435995 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2009/4218] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:41 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1323 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:42.445712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-893a4bc9-65de-4c3d-ab07-41acbd76832a req-0974e24b-392a-46a8-88f4-33f9e7486b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc847515-8f05-40a2-a206-338fbe9037dc", "tag": "0d5ec547-0456-4168-b507-5bbc17142227"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:42.503520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-893a4bc9-65de-4c3d-ab07-41acbd76832a req-0974e24b-392a-46a8-88f4-33f9e7486b1e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:42.505129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-893a4bc9-65de-4c3d-ab07-41acbd76832a req-0974e24b-392a-46a8-88f4-33f9e7486b1e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:42.506884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-893a4bc9-65de-4c3d-ab07-41acbd76832a req-0974e24b-392a-46a8-88f4-33f9e7486b1e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:42.544147 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-893a4bc9-65de-4c3d-ab07-41acbd76832a req-0974e24b-392a-46a8-88f4-33f9e7486b1e service nova] Creating event network-changed:0d5ec547-0456-4168-b507-5bbc17142227 for instance cc847515-8f05-40a2-a206-338fbe9037dc on n-h1-845781-6 Aug 09 17:31:42.555496 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-893a4bc9-65de-4c3d-ab07-41acbd76832a req-0974e24b-392a-46a8-88f4-33f9e7486b1e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117847 Aug 09 17:31:42.561748 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2010/4219] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:42.828194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0480da7b-7ae2-4a6e-8595-dcbf160e4b0a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:42.828926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0480da7b-7ae2-4a6e-8595-dcbf160e4b0a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:42.851229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0480da7b-7ae2-4a6e-8595-dcbf160e4b0a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:42.851911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0480da7b-7ae2-4a6e-8595-dcbf160e4b0a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:42.852379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0480da7b-7ae2-4a6e-8595-dcbf160e4b0a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:42.856541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0480da7b-7ae2-4a6e-8595-dcbf160e4b0a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:42.857102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0480da7b-7ae2-4a6e-8595-dcbf160e4b0a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:42.857568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0480da7b-7ae2-4a6e-8595-dcbf160e4b0a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:42.917713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3c2e73ec-3fd9-49e3-8a39-e57cea69477f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:42.937570 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3c2e73ec-3fd9-49e3-8a39-e57cea69477f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1320 microversion: 2.1 time: 1.120465 Aug 09 17:31:42.954859 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2210/4220] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:41 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1320 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:43.474510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4a103c8-8428-43b4-bb10-e1ce9dd20f4b tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:43.475163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a4a103c8-8428-43b4-bb10-e1ce9dd20f4b tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:43.490158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a103c8-8428-43b4-bb10-e1ce9dd20f4b tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:43.490673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a103c8-8428-43b4-bb10-e1ce9dd20f4b tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:43.491127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a103c8-8428-43b4-bb10-e1ce9dd20f4b tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:43.491909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a103c8-8428-43b4-bb10-e1ce9dd20f4b tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:43.492385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a103c8-8428-43b4-bb10-e1ce9dd20f4b tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:43.492829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a103c8-8428-43b4-bb10-e1ce9dd20f4b tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:43.574357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:44.100579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0480da7b-7ae2-4a6e-8595-dcbf160e4b0a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:44.172624 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0480da7b-7ae2-4a6e-8595-dcbf160e4b0a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 1.344164 Aug 09 17:31:44.176940 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2011/4221] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:42 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:44.203126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4b96532c-5653-4e67-8b01-318d02a8b7cb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:44.207541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4b96532c-5653-4e67-8b01-318d02a8b7cb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:44.229286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b96532c-5653-4e67-8b01-318d02a8b7cb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:44.230583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b96532c-5653-4e67-8b01-318d02a8b7cb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:44.231553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b96532c-5653-4e67-8b01-318d02a8b7cb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:44.233075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b96532c-5653-4e67-8b01-318d02a8b7cb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:44.234175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b96532c-5653-4e67-8b01-318d02a8b7cb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:44.235891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b96532c-5653-4e67-8b01-318d02a8b7cb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:44.456654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a4a103c8-8428-43b4-bb10-e1ce9dd20f4b tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:44.461434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:44.468490 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4a103c8-8428-43b4-bb10-e1ce9dd20f4b tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1323 microversion: 2.1 time: 0.997965 Aug 09 17:31:44.471498 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2211/4222] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:43 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1323 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:44.859612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4b96532c-5653-4e67-8b01-318d02a8b7cb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:44.913221 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4b96532c-5653-4e67-8b01-318d02a8b7cb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1320 microversion: 2.1 time: 0.733778 Aug 09 17:31:44.917086 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2012/4223] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:44 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1320 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:45.273749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2b8856bf-2771-436f-9426-ee62db684854 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:45.275334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2b8856bf-2771-436f-9426-ee62db684854 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:45.297932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:45.341359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b8856bf-2771-436f-9426-ee62db684854 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:45.342223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b8856bf-2771-436f-9426-ee62db684854 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:45.342997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b8856bf-2771-436f-9426-ee62db684854 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:45.375391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b8856bf-2771-436f-9426-ee62db684854 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:45.378300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b8856bf-2771-436f-9426-ee62db684854 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:45.378877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b8856bf-2771-436f-9426-ee62db684854 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:45.508612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1a145bef-f12f-4ef0-9c38-2b631806a4cb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:45.510182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1a145bef-f12f-4ef0-9c38-2b631806a4cb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:45.544979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a145bef-f12f-4ef0-9c38-2b631806a4cb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:45.546374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a145bef-f12f-4ef0-9c38-2b631806a4cb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:45.549830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a145bef-f12f-4ef0-9c38-2b631806a4cb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:45.560371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a145bef-f12f-4ef0-9c38-2b631806a4cb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:45.561759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a145bef-f12f-4ef0-9c38-2b631806a4cb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:45.569187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a145bef-f12f-4ef0-9c38-2b631806a4cb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:46.074458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2b8856bf-2771-436f-9426-ee62db684854 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:46.119601 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2b8856bf-2771-436f-9426-ee62db684854 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 0.871238 Aug 09 17:31:46.121876 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2212/4224] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:45 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:46.162838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-61767b29-f7c7-419e-a46c-04e207a548b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:46.166975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61767b29-f7c7-419e-a46c-04e207a548b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:46.217279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61767b29-f7c7-419e-a46c-04e207a548b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:46.226199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61767b29-f7c7-419e-a46c-04e207a548b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:46.229037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61767b29-f7c7-419e-a46c-04e207a548b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:46.237871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61767b29-f7c7-419e-a46c-04e207a548b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:46.239445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61767b29-f7c7-419e-a46c-04e207a548b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:46.246200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61767b29-f7c7-419e-a46c-04e207a548b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:47.045358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-61767b29-f7c7-419e-a46c-04e207a548b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:47.081474 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-61767b29-f7c7-419e-a46c-04e207a548b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1320 microversion: 2.1 time: 0.948140 Aug 09 17:31:47.084956 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2213/4225] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:46 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1320 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:47.119141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-cef3f774-c411-4cdb-a773-954bccc40402 req-fa59a806-477d-4c55-bc13-fbfcb28d911b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72ddf4a-4d41-4db4-8230-1962c7c3d514", "tag": "59727f0b-da0d-46c9-9440-bb09cce8aed8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:47.186373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cef3f774-c411-4cdb-a773-954bccc40402 req-fa59a806-477d-4c55-bc13-fbfcb28d911b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:47.188110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cef3f774-c411-4cdb-a773-954bccc40402 req-fa59a806-477d-4c55-bc13-fbfcb28d911b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:47.191776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cef3f774-c411-4cdb-a773-954bccc40402 req-fa59a806-477d-4c55-bc13-fbfcb28d911b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:47.248638 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-cef3f774-c411-4cdb-a773-954bccc40402 req-fa59a806-477d-4c55-bc13-fbfcb28d911b service nova] Creating event network-changed:59727f0b-da0d-46c9-9440-bb09cce8aed8 for instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 on n-h2-845781-6 Aug 09 17:31:47.270546 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-cef3f774-c411-4cdb-a773-954bccc40402 req-fa59a806-477d-4c55-bc13-fbfcb28d911b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179263 Aug 09 17:31:47.277036 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2214/4226] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:47.335107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-569e6700-4c97-406e-8558-955e3c16a285 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:47.339812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1a145bef-f12f-4ef0-9c38-2b631806a4cb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:47.342237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-569e6700-4c97-406e-8558-955e3c16a285 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:47.398592 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1a145bef-f12f-4ef0-9c38-2b631806a4cb tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1323 microversion: 2.1 time: 1.906723 Aug 09 17:31:47.398993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569e6700-4c97-406e-8558-955e3c16a285 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:47.412085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569e6700-4c97-406e-8558-955e3c16a285 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:47.412085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569e6700-4c97-406e-8558-955e3c16a285 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:47.412085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569e6700-4c97-406e-8558-955e3c16a285 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:47.412085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569e6700-4c97-406e-8558-955e3c16a285 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:47.419675 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2013/4227] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:45 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1323 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:47.429101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569e6700-4c97-406e-8558-955e3c16a285 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:48.146523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c6dd98f-3879-4ea0-adf2-8909317f3fe8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:48.156608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2c6dd98f-3879-4ea0-adf2-8909317f3fe8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:48.242375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c6dd98f-3879-4ea0-adf2-8909317f3fe8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:48.248967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c6dd98f-3879-4ea0-adf2-8909317f3fe8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:48.249766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c6dd98f-3879-4ea0-adf2-8909317f3fe8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:48.250923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c6dd98f-3879-4ea0-adf2-8909317f3fe8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:48.251702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c6dd98f-3879-4ea0-adf2-8909317f3fe8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:48.277088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c6dd98f-3879-4ea0-adf2-8909317f3fe8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:48.294583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-569e6700-4c97-406e-8558-955e3c16a285 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:48.330426 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-569e6700-4c97-406e-8558-955e3c16a285 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 1.050699 Aug 09 17:31:48.331812 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2215/4228] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:47 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:48.445704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4785af22-800b-4bbd-9664-1fa046a94d19 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:48.447363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4785af22-800b-4bbd-9664-1fa046a94d19 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:48.517085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4785af22-800b-4bbd-9664-1fa046a94d19 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:48.519068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4785af22-800b-4bbd-9664-1fa046a94d19 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:48.521311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4785af22-800b-4bbd-9664-1fa046a94d19 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:48.522456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4785af22-800b-4bbd-9664-1fa046a94d19 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:48.525358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4785af22-800b-4bbd-9664-1fa046a94d19 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:48.526245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4785af22-800b-4bbd-9664-1fa046a94d19 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:49.740497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4785af22-800b-4bbd-9664-1fa046a94d19 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:49.841498 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4785af22-800b-4bbd-9664-1fa046a94d19 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1323 microversion: 2.1 time: 1.406229 Aug 09 17:31:49.843119 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2216/4229] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:48 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1323 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:49.850720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-913ad293-d3a2-4165-8694-c68058b1fd6b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:49.854236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-913ad293-d3a2-4165-8694-c68058b1fd6b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:49.889031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913ad293-d3a2-4165-8694-c68058b1fd6b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:49.906937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913ad293-d3a2-4165-8694-c68058b1fd6b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:49.920112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913ad293-d3a2-4165-8694-c68058b1fd6b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:49.925527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913ad293-d3a2-4165-8694-c68058b1fd6b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:49.925527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913ad293-d3a2-4165-8694-c68058b1fd6b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:49.929947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913ad293-d3a2-4165-8694-c68058b1fd6b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:50.159112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2c6dd98f-3879-4ea0-adf2-8909317f3fe8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:50.164406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:50.182485 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2c6dd98f-3879-4ea0-adf2-8909317f3fe8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1320 microversion: 2.1 time: 2.049140 Aug 09 17:31:50.184098 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2014/4230] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:48 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1320 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:50.884222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab964092-654b-47ac-b12c-97e81a830ea3 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:50.897837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ab964092-654b-47ac-b12c-97e81a830ea3 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:50.913114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:50.917363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab964092-654b-47ac-b12c-97e81a830ea3 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:50.918817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab964092-654b-47ac-b12c-97e81a830ea3 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:50.920031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab964092-654b-47ac-b12c-97e81a830ea3 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:50.922610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab964092-654b-47ac-b12c-97e81a830ea3 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:50.923888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab964092-654b-47ac-b12c-97e81a830ea3 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:50.925744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab964092-654b-47ac-b12c-97e81a830ea3 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:51.039966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-913ad293-d3a2-4165-8694-c68058b1fd6b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:51.096140 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-913ad293-d3a2-4165-8694-c68058b1fd6b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 1.245622 Aug 09 17:31:51.099232 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2217/4231] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:49 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:51.166044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4dd7439b-5bd5-4f6c-a716-9bf91b7c59e7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:51.173622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4dd7439b-5bd5-4f6c-a716-9bf91b7c59e7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:51.180646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:51.182647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd7439b-5bd5-4f6c-a716-9bf91b7c59e7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:51.183474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd7439b-5bd5-4f6c-a716-9bf91b7c59e7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:51.184128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd7439b-5bd5-4f6c-a716-9bf91b7c59e7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:51.185051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd7439b-5bd5-4f6c-a716-9bf91b7c59e7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:51.186486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd7439b-5bd5-4f6c-a716-9bf91b7c59e7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:51.187196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd7439b-5bd5-4f6c-a716-9bf91b7c59e7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:51.506012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-4dd7439b-5bd5-4f6c-a716-9bf91b7c59e7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lazy-loading 'services' on Instance uuid fab40c63-640b-40d0-8845-8026b0b71e5d {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:31:51.604491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ab964092-654b-47ac-b12c-97e81a830ea3 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:51.630781 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ab964092-654b-47ac-b12c-97e81a830ea3 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1323 microversion: 2.1 time: 0.755666 Aug 09 17:31:51.652380 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2015/4232] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:50 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1323 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:51.666612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-303bbfe6-58af-4330-9e26-21fb5a8dafa5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:51.673618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-303bbfe6-58af-4330-9e26-21fb5a8dafa5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:51.695380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-303bbfe6-58af-4330-9e26-21fb5a8dafa5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:51.725067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-303bbfe6-58af-4330-9e26-21fb5a8dafa5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:51.726834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-303bbfe6-58af-4330-9e26-21fb5a8dafa5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:51.728580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-303bbfe6-58af-4330-9e26-21fb5a8dafa5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:51.736052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-303bbfe6-58af-4330-9e26-21fb5a8dafa5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:51.742337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-303bbfe6-58af-4330-9e26-21fb5a8dafa5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:51.822420 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4dd7439b-5bd5-4f6c-a716-9bf91b7c59e7 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments/9a68ee3e-12d1-42c5-8455-8b36d9d1c3a9" status: 202 len: 0 microversion: 2.1 time: 0.659560 Aug 09 17:31:51.823536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2218/4233] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:31:51 2022] DELETE /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments/9a68ee3e-12d1-42c5-8455-8b36d9d1c3a9 => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:31:51.875102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8ecb3bb2-d4c2-4a59-bd35-06d7d9d323f2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:51.898342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ecb3bb2-d4c2-4a59-bd35-06d7d9d323f2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:51.937265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ecb3bb2-d4c2-4a59-bd35-06d7d9d323f2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:51.959311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ecb3bb2-d4c2-4a59-bd35-06d7d9d323f2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:51.961631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ecb3bb2-d4c2-4a59-bd35-06d7d9d323f2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:51.967220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ecb3bb2-d4c2-4a59-bd35-06d7d9d323f2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:51.968394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ecb3bb2-d4c2-4a59-bd35-06d7d9d323f2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:51.970320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ecb3bb2-d4c2-4a59-bd35-06d7d9d323f2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:52.186172 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8ecb3bb2-d4c2-4a59-bd35-06d7d9d323f2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.347611 Aug 09 17:31:52.189206 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2219/4234] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:31:51 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 197 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:52.210941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09b4980d-9e24-4bef-bdbd-6faf3cdfefe8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:52.212507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09b4980d-9e24-4bef-bdbd-6faf3cdfefe8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:52.244054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b4980d-9e24-4bef-bdbd-6faf3cdfefe8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:52.245179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b4980d-9e24-4bef-bdbd-6faf3cdfefe8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:52.246228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b4980d-9e24-4bef-bdbd-6faf3cdfefe8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:52.247846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b4980d-9e24-4bef-bdbd-6faf3cdfefe8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:52.254226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b4980d-9e24-4bef-bdbd-6faf3cdfefe8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:52.262112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b4980d-9e24-4bef-bdbd-6faf3cdfefe8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:52.703455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-09b4980d-9e24-4bef-bdbd-6faf3cdfefe8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:52.719907 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09b4980d-9e24-4bef-bdbd-6faf3cdfefe8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 0.528194 Aug 09 17:31:52.774312 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2220/4235] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:52 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:52.795291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-de676b27-d0e8-458f-bac3-120fc215aa16 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:52.795482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-de676b27-d0e8-458f-bac3-120fc215aa16 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:52.826832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de676b27-d0e8-458f-bac3-120fc215aa16 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:52.833355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de676b27-d0e8-458f-bac3-120fc215aa16 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:52.834540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de676b27-d0e8-458f-bac3-120fc215aa16 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:52.839668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de676b27-d0e8-458f-bac3-120fc215aa16 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:52.840932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de676b27-d0e8-458f-bac3-120fc215aa16 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:52.842783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de676b27-d0e8-458f-bac3-120fc215aa16 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:53.375080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-de676b27-d0e8-458f-bac3-120fc215aa16 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:53.404092 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-de676b27-d0e8-458f-bac3-120fc215aa16 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1323 microversion: 2.1 time: 0.623009 Aug 09 17:31:53.406145 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2221/4236] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:52 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1323 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:53.425966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0df670e1-bda9-482c-ba56-3a8b4495b863 req-0ee9cb72-79cc-4490-b072-06715e63bb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc847515-8f05-40a2-a206-338fbe9037dc", "name": "network-vif-plugged", "status": "completed", "tag": "0d5ec547-0456-4168-b507-5bbc17142227"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:53.462676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0df670e1-bda9-482c-ba56-3a8b4495b863 req-0ee9cb72-79cc-4490-b072-06715e63bb1d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:53.470304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0df670e1-bda9-482c-ba56-3a8b4495b863 req-0ee9cb72-79cc-4490-b072-06715e63bb1d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:53.471559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0df670e1-bda9-482c-ba56-3a8b4495b863 req-0ee9cb72-79cc-4490-b072-06715e63bb1d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:53.521440 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0df670e1-bda9-482c-ba56-3a8b4495b863 req-0ee9cb72-79cc-4490-b072-06715e63bb1d service nova] Creating event network-vif-plugged:0d5ec547-0456-4168-b507-5bbc17142227 for instance cc847515-8f05-40a2-a206-338fbe9037dc on n-h1-845781-6 Aug 09 17:31:53.543445 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0df670e1-bda9-482c-ba56-3a8b4495b863 req-0ee9cb72-79cc-4490-b072-06715e63bb1d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134162 Aug 09 17:31:53.545581 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2222/4237] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:53.565975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-290ed2f0-d939-4517-a3c1-e2f4d19b451f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:53.575507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-290ed2f0-d939-4517-a3c1-e2f4d19b451f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:53.607010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290ed2f0-d939-4517-a3c1-e2f4d19b451f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:53.612341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290ed2f0-d939-4517-a3c1-e2f4d19b451f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:53.613649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290ed2f0-d939-4517-a3c1-e2f4d19b451f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:53.617156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290ed2f0-d939-4517-a3c1-e2f4d19b451f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:53.622482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290ed2f0-d939-4517-a3c1-e2f4d19b451f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:53.623767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-290ed2f0-d939-4517-a3c1-e2f4d19b451f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:53.752326 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-290ed2f0-d939-4517-a3c1-e2f4d19b451f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195107 Aug 09 17:31:53.754122 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2223/4238] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:31:53 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:53.810708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a2acf005-2ddb-41f4-b3d4-a32c54e9ad98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:53.812755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a2acf005-2ddb-41f4-b3d4-a32c54e9ad98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:53.837825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2acf005-2ddb-41f4-b3d4-a32c54e9ad98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:53.838722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2acf005-2ddb-41f4-b3d4-a32c54e9ad98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:53.839542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2acf005-2ddb-41f4-b3d4-a32c54e9ad98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:53.840900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2acf005-2ddb-41f4-b3d4-a32c54e9ad98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:53.848436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2acf005-2ddb-41f4-b3d4-a32c54e9ad98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:53.849404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2acf005-2ddb-41f4-b3d4-a32c54e9ad98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:54.541257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a2acf005-2ddb-41f4-b3d4-a32c54e9ad98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:54.575817 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a2acf005-2ddb-41f4-b3d4-a32c54e9ad98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 0.795475 Aug 09 17:31:54.587986 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2224/4239] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:53 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:54.598427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4dffac0a-f212-4202-9bfa-37b68c5300b7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:54.598427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4dffac0a-f212-4202-9bfa-37b68c5300b7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:54.640664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dffac0a-f212-4202-9bfa-37b68c5300b7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:54.646001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dffac0a-f212-4202-9bfa-37b68c5300b7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:54.646962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dffac0a-f212-4202-9bfa-37b68c5300b7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:54.652744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dffac0a-f212-4202-9bfa-37b68c5300b7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:54.655874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dffac0a-f212-4202-9bfa-37b68c5300b7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:54.662600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-303bbfe6-58af-4330-9e26-21fb5a8dafa5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:54.673825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dffac0a-f212-4202-9bfa-37b68c5300b7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:54.721472 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-303bbfe6-58af-4330-9e26-21fb5a8dafa5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1320 microversion: 2.1 time: 3.064193 Aug 09 17:31:54.722606 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2016/4240] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:51 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1320 bytes in 3069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:54.785227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-615d8751-2cb5-4ee7-97fe-8454d0f4c465 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:54.798801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-615d8751-2cb5-4ee7-97fe-8454d0f4c465 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:54.863731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-615d8751-2cb5-4ee7-97fe-8454d0f4c465 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:54.867211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-615d8751-2cb5-4ee7-97fe-8454d0f4c465 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:54.872740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-615d8751-2cb5-4ee7-97fe-8454d0f4c465 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:54.874476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-615d8751-2cb5-4ee7-97fe-8454d0f4c465 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:54.877305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-615d8751-2cb5-4ee7-97fe-8454d0f4c465 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:54.881325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-615d8751-2cb5-4ee7-97fe-8454d0f4c465 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:55.042616 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-615d8751-2cb5-4ee7-97fe-8454d0f4c465 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.277468 Aug 09 17:31:55.043676 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2017/4241] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:31:54 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 197 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:55.409753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4dffac0a-f212-4202-9bfa-37b68c5300b7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:55.436726 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4dffac0a-f212-4202-9bfa-37b68c5300b7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1323 microversion: 2.1 time: 0.854731 Aug 09 17:31:55.437801 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2225/4242] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:54 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1323 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:55.630503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-964d093a-ae8f-46c9-bfcd-877c82417a84 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:55.630503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-964d093a-ae8f-46c9-bfcd-877c82417a84 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:55.681373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-964d093a-ae8f-46c9-bfcd-877c82417a84 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:55.682368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-964d093a-ae8f-46c9-bfcd-877c82417a84 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:55.692483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-964d093a-ae8f-46c9-bfcd-877c82417a84 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:55.698631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-964d093a-ae8f-46c9-bfcd-877c82417a84 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:55.699398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-964d093a-ae8f-46c9-bfcd-877c82417a84 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:55.702818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-964d093a-ae8f-46c9-bfcd-877c82417a84 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:55.776024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-82312196-b521-49fe-b3e2-200ec3f2030e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:55.778955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-82312196-b521-49fe-b3e2-200ec3f2030e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:55.890552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82312196-b521-49fe-b3e2-200ec3f2030e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:55.891471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82312196-b521-49fe-b3e2-200ec3f2030e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:55.892336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82312196-b521-49fe-b3e2-200ec3f2030e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:55.893601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82312196-b521-49fe-b3e2-200ec3f2030e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:55.894268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82312196-b521-49fe-b3e2-200ec3f2030e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:55.894911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82312196-b521-49fe-b3e2-200ec3f2030e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:56.888272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-82312196-b521-49fe-b3e2-200ec3f2030e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:56.898076 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-82312196-b521-49fe-b3e2-200ec3f2030e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1320 microversion: 2.1 time: 1.141958 Aug 09 17:31:56.898695 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2226/4243] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:55 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1320 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:56.921930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6235e4c3-0cf7-4171-8381-a63d377eabb4 req-0221fe50-ecb1-4d2d-a7cd-31c4e2a4d1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72ddf4a-4d41-4db4-8230-1962c7c3d514", "name": "network-vif-plugged", "status": "completed", "tag": "59727f0b-da0d-46c9-9440-bb09cce8aed8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:56.976664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6235e4c3-0cf7-4171-8381-a63d377eabb4 req-0221fe50-ecb1-4d2d-a7cd-31c4e2a4d1e8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:56.977247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6235e4c3-0cf7-4171-8381-a63d377eabb4 req-0221fe50-ecb1-4d2d-a7cd-31c4e2a4d1e8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:56.982916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6235e4c3-0cf7-4171-8381-a63d377eabb4 req-0221fe50-ecb1-4d2d-a7cd-31c4e2a4d1e8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:57.006740 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6235e4c3-0cf7-4171-8381-a63d377eabb4 req-0221fe50-ecb1-4d2d-a7cd-31c4e2a4d1e8 service nova] Creating event network-vif-plugged:59727f0b-da0d-46c9-9440-bb09cce8aed8 for instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 on n-h2-845781-6 Aug 09 17:31:57.017166 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6235e4c3-0cf7-4171-8381-a63d377eabb4 req-0221fe50-ecb1-4d2d-a7cd-31c4e2a4d1e8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115007 Aug 09 17:31:57.023328 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2227/4244] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:57.049275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1962d523-59fe-4755-a869-e0b8a2e046a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:57.053207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1962d523-59fe-4755-a869-e0b8a2e046a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:57.062002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1962d523-59fe-4755-a869-e0b8a2e046a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:57.101620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1962d523-59fe-4755-a869-e0b8a2e046a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:57.102173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1962d523-59fe-4755-a869-e0b8a2e046a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:57.102959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1962d523-59fe-4755-a869-e0b8a2e046a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:57.103455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1962d523-59fe-4755-a869-e0b8a2e046a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:57.119671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1962d523-59fe-4755-a869-e0b8a2e046a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:57.217887 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1962d523-59fe-4755-a869-e0b8a2e046a0 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196181 Aug 09 17:31:57.232058 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2228/4245] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:31:57 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:57.273383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b6b3bed-cc7f-434b-99ea-e5da672ea4c4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:57.281984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1b6b3bed-cc7f-434b-99ea-e5da672ea4c4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:57.353332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-964d093a-ae8f-46c9-bfcd-877c82417a84 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:57.361319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6b3bed-cc7f-434b-99ea-e5da672ea4c4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:57.363366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6b3bed-cc7f-434b-99ea-e5da672ea4c4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.054s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:57.370630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6b3bed-cc7f-434b-99ea-e5da672ea4c4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:57.384078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6b3bed-cc7f-434b-99ea-e5da672ea4c4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:57.393373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6b3bed-cc7f-434b-99ea-e5da672ea4c4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:57.402596 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-964d093a-ae8f-46c9-bfcd-877c82417a84 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 1.782825 Aug 09 17:31:57.404042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b6b3bed-cc7f-434b-99ea-e5da672ea4c4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:57.443419 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2018/4246] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:55 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:57.904025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1b6b3bed-cc7f-434b-99ea-e5da672ea4c4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:57.911346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:31:57.919700 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b6b3bed-cc7f-434b-99ea-e5da672ea4c4 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1323 microversion: 2.1 time: 0.677063 Aug 09 17:31:57.940946 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2229/4247] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:57 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1323 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:57.946156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e57a450-e283-4fef-ad60-91f023d708c2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:57.954907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0e57a450-e283-4fef-ad60-91f023d708c2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:58.006169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e57a450-e283-4fef-ad60-91f023d708c2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:58.034259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e57a450-e283-4fef-ad60-91f023d708c2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:58.045014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e57a450-e283-4fef-ad60-91f023d708c2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:58.055538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e57a450-e283-4fef-ad60-91f023d708c2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:58.056898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e57a450-e283-4fef-ad60-91f023d708c2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:58.063157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e57a450-e283-4fef-ad60-91f023d708c2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:58.239864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-56f952e4-6a35-45c2-b4ae-2cd111519ca2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:58.253705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-56f952e4-6a35-45c2-b4ae-2cd111519ca2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:58.290872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56f952e4-6a35-45c2-b4ae-2cd111519ca2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:58.297597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56f952e4-6a35-45c2-b4ae-2cd111519ca2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:58.298453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56f952e4-6a35-45c2-b4ae-2cd111519ca2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:58.316287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56f952e4-6a35-45c2-b4ae-2cd111519ca2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:58.318498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56f952e4-6a35-45c2-b4ae-2cd111519ca2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:58.321753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56f952e4-6a35-45c2-b4ae-2cd111519ca2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:58.426130 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-56f952e4-6a35-45c2-b4ae-2cd111519ca2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195492 Aug 09 17:31:58.449693 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2230/4248] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:31:58 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:58.466315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c9af2f8-03e7-4cb2-89a7-837643cecc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:58.471766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c9af2f8-03e7-4cb2-89a7-837643cecc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:58.493304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c9af2f8-03e7-4cb2-89a7-837643cecc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:58.498429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c9af2f8-03e7-4cb2-89a7-837643cecc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:58.500187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c9af2f8-03e7-4cb2-89a7-837643cecc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:58.504268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c9af2f8-03e7-4cb2-89a7-837643cecc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:58.508150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c9af2f8-03e7-4cb2-89a7-837643cecc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:58.511187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c9af2f8-03e7-4cb2-89a7-837643cecc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:58.723591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0e57a450-e283-4fef-ad60-91f023d708c2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:58.795809 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e57a450-e283-4fef-ad60-91f023d708c2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1500 microversion: 2.1 time: 0.859143 Aug 09 17:31:58.808040 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2019/4249] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:57 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1500 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:58.859224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e609e256-230f-43d9-bfc8-6b515dc638fd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:58.859224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e609e256-230f-43d9-bfc8-6b515dc638fd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:58.885632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e609e256-230f-43d9-bfc8-6b515dc638fd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:58.889110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e609e256-230f-43d9-bfc8-6b515dc638fd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:58.889843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e609e256-230f-43d9-bfc8-6b515dc638fd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:58.890956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e609e256-230f-43d9-bfc8-6b515dc638fd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:58.905030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e609e256-230f-43d9-bfc8-6b515dc638fd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:58.905891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e609e256-230f-43d9-bfc8-6b515dc638fd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:59.139875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c9af2f8-03e7-4cb2-89a7-837643cecc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:59.169114 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c9af2f8-03e7-4cb2-89a7-837643cecc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 0.709120 Aug 09 17:31:59.177160 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2231/4250] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:58 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:59.183497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a659bcd8-2641-4190-99c1-47c575b7d90c tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:59.194453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a659bcd8-2641-4190-99c1-47c575b7d90c tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:59.222467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a659bcd8-2641-4190-99c1-47c575b7d90c tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:59.223886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a659bcd8-2641-4190-99c1-47c575b7d90c tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:59.224680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a659bcd8-2641-4190-99c1-47c575b7d90c tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:59.226018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a659bcd8-2641-4190-99c1-47c575b7d90c tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:59.226893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a659bcd8-2641-4190-99c1-47c575b7d90c tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:59.227698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a659bcd8-2641-4190-99c1-47c575b7d90c tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:59.469972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e609e256-230f-43d9-bfc8-6b515dc638fd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:59.478863 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e609e256-230f-43d9-bfc8-6b515dc638fd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1500 microversion: 2.1 time: 0.636263 Aug 09 17:31:59.479403 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2020/4251] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:58 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1500 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:31:59.501586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-44c78854-c74e-4d7c-943b-5b5add2a03d2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:59.520719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-44c78854-c74e-4d7c-943b-5b5add2a03d2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:59.553416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44c78854-c74e-4d7c-943b-5b5add2a03d2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:59.556601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44c78854-c74e-4d7c-943b-5b5add2a03d2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:59.566658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44c78854-c74e-4d7c-943b-5b5add2a03d2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:59.568867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44c78854-c74e-4d7c-943b-5b5add2a03d2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:59.576585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44c78854-c74e-4d7c-943b-5b5add2a03d2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:59.577307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44c78854-c74e-4d7c-943b-5b5add2a03d2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:59.666146 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-44c78854-c74e-4d7c-943b-5b5add2a03d2 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168895 Aug 09 17:31:59.679943 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2021/4252] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:31:59 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:31:59.733111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b846039c-77d5-47ca-896b-37745bf7ff7b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:31:59.737584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b846039c-77d5-47ca-896b-37745bf7ff7b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:59.752965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a659bcd8-2641-4190-99c1-47c575b7d90c tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:31:59.775366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b846039c-77d5-47ca-896b-37745bf7ff7b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:59.777044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b846039c-77d5-47ca-896b-37745bf7ff7b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:59.783453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b846039c-77d5-47ca-896b-37745bf7ff7b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:59.787127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b846039c-77d5-47ca-896b-37745bf7ff7b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:59.793812 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a659bcd8-2641-4190-99c1-47c575b7d90c tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1519 microversion: 2.1 time: 0.593437 Aug 09 17:31:59.796171 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2232/4253] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:31:59 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1519 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:31:59.812926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b846039c-77d5-47ca-896b-37745bf7ff7b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:59.821121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b846039c-77d5-47ca-896b-37745bf7ff7b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:59.860312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66cb7bcf-b0be-49e0-b172-7f95a4ca43bd tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:31:59.869270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-66cb7bcf-b0be-49e0-b172-7f95a4ca43bd tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:31:59.908972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cb7bcf-b0be-49e0-b172-7f95a4ca43bd tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:59.918767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cb7bcf-b0be-49e0-b172-7f95a4ca43bd tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:59.922355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cb7bcf-b0be-49e0-b172-7f95a4ca43bd tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:31:59.928976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cb7bcf-b0be-49e0-b172-7f95a4ca43bd tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:31:59.932816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cb7bcf-b0be-49e0-b172-7f95a4ca43bd tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:31:59.935507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cb7bcf-b0be-49e0-b172-7f95a4ca43bd tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:00.000276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b846039c-77d5-47ca-896b-37745bf7ff7b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:32:00.100211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-66cb7bcf-b0be-49e0-b172-7f95a4ca43bd tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lazy-loading 'flavor' on Instance uuid a72ddf4a-4d41-4db4-8230-1962c7c3d514 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:32:00.621655 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66cb7bcf-b0be-49e0-b172-7f95a4ca43bd tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "POST /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514/action" status: 200 len: 32 microversion: 2.1 time: 0.793090 Aug 09 17:32:00.654817 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2233/4254] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:31:59 2022] POST /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514/action => generated 32 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:32:00.670124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b21e1c7-d615-4e7e-9828-c2b150f83f3e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:00.752982 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b846039c-77d5-47ca-896b-37745bf7ff7b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 204 len: 0 microversion: 2.1 time: 1.067063 Aug 09 17:32:00.755915 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2022/4255] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:31:59 2022] DELETE /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 0 bytes in 1071 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:32:00.791730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1b21e1c7-d615-4e7e-9828-c2b150f83f3e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:00.816044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1d02f9c1-3d69-4614-8763-64b87b8d02c5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:00.825250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1d02f9c1-3d69-4614-8763-64b87b8d02c5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:00.840219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b21e1c7-d615-4e7e-9828-c2b150f83f3e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:00.852607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b21e1c7-d615-4e7e-9828-c2b150f83f3e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:00.853551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b21e1c7-d615-4e7e-9828-c2b150f83f3e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:00.854564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b21e1c7-d615-4e7e-9828-c2b150f83f3e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:00.855565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d02f9c1-3d69-4614-8763-64b87b8d02c5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:00.856452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d02f9c1-3d69-4614-8763-64b87b8d02c5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:00.862419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d02f9c1-3d69-4614-8763-64b87b8d02c5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:00.863741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d02f9c1-3d69-4614-8763-64b87b8d02c5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:00.864936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b21e1c7-d615-4e7e-9828-c2b150f83f3e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:00.865129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d02f9c1-3d69-4614-8763-64b87b8d02c5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:00.867383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1d02f9c1-3d69-4614-8763-64b87b8d02c5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:00.873197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b21e1c7-d615-4e7e-9828-c2b150f83f3e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:01.281353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1b21e1c7-d615-4e7e-9828-c2b150f83f3e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:01.304530 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b21e1c7-d615-4e7e-9828-c2b150f83f3e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 0.647413 Aug 09 17:32:01.305793 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2234/4256] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:00 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:01.322210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e49013f-00bb-4eac-8a14-b22c7d236697 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:01.329896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8e49013f-00bb-4eac-8a14-b22c7d236697 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:01.351270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e49013f-00bb-4eac-8a14-b22c7d236697 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:01.354755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e49013f-00bb-4eac-8a14-b22c7d236697 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:01.355661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e49013f-00bb-4eac-8a14-b22c7d236697 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:01.356650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e49013f-00bb-4eac-8a14-b22c7d236697 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:01.360867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e49013f-00bb-4eac-8a14-b22c7d236697 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:01.361668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e49013f-00bb-4eac-8a14-b22c7d236697 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:01.483691 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e49013f-00bb-4eac-8a14-b22c7d236697 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168652 Aug 09 17:32:01.487084 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2235/4257] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:32:01 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:01.505680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:01.506696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:01.526753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:01.527562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:01.529605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:01.533240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:01.534083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:01.534789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:01.883176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:01.907548 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1506 microversion: 2.1 time: 0.418943 Aug 09 17:32:01.915531 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2236/4258] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:01 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:01.917796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:01.921328 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-52367ecc-417e-4777-992c-9fa06a6d92ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003663 Aug 09 17:32:01.939021 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2237/4259] 10.222.0.93 () {56 vars in 886 bytes} [Tue Aug 9 17:32:01 2022] GET /compute/ => generated 377 bytes in 19 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 09 17:32:02.338521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c33cdc3d-33c0-488f-b1fe-ab8697874277 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:02.339264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c33cdc3d-33c0-488f-b1fe-ab8697874277 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:02.360185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33cdc3d-33c0-488f-b1fe-ab8697874277 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:02.367217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33cdc3d-33c0-488f-b1fe-ab8697874277 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:02.368369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33cdc3d-33c0-488f-b1fe-ab8697874277 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:02.368664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33cdc3d-33c0-488f-b1fe-ab8697874277 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:02.374582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33cdc3d-33c0-488f-b1fe-ab8697874277 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:02.375142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c33cdc3d-33c0-488f-b1fe-ab8697874277 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:02.605941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1d02f9c1-3d69-4614-8763-64b87b8d02c5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:02.635050 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1d02f9c1-3d69-4614-8763-64b87b8d02c5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 1.876821 Aug 09 17:32:02.640069 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2023/4260] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:00 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:02.661826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f4362ac0-cd4f-4c40-b29a-30d5661a0f1b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:02.673101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f4362ac0-cd4f-4c40-b29a-30d5661a0f1b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:02.719693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4362ac0-cd4f-4c40-b29a-30d5661a0f1b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:02.721312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4362ac0-cd4f-4c40-b29a-30d5661a0f1b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:02.725864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4362ac0-cd4f-4c40-b29a-30d5661a0f1b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:02.728538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4362ac0-cd4f-4c40-b29a-30d5661a0f1b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:02.735808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4362ac0-cd4f-4c40-b29a-30d5661a0f1b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:02.740481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4362ac0-cd4f-4c40-b29a-30d5661a0f1b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:02.943288 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f4362ac0-cd4f-4c40-b29a-30d5661a0f1b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.298470 Aug 09 17:32:02.955577 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2024/4261] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:32:02 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 197 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:02.996895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c1f03cdd-db49-4502-a850-15ca5fc0df7d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:03.009158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c1f03cdd-db49-4502-a850-15ca5fc0df7d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:03.071518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1f03cdd-db49-4502-a850-15ca5fc0df7d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:03.087744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1f03cdd-db49-4502-a850-15ca5fc0df7d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:03.102223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1f03cdd-db49-4502-a850-15ca5fc0df7d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:03.117164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1f03cdd-db49-4502-a850-15ca5fc0df7d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:03.133476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1f03cdd-db49-4502-a850-15ca5fc0df7d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:03.134545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1f03cdd-db49-4502-a850-15ca5fc0df7d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:04.580238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c33cdc3d-33c0-488f-b1fe-ab8697874277 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:04.626515 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c33cdc3d-33c0-488f-b1fe-ab8697874277 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 2.291929 Aug 09 17:32:04.637014 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2238/4262] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:02 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 2303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:04.688894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-083aee8d-fe6f-42c1-ad9c-5f35f1cce562 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:04.698321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-083aee8d-fe6f-42c1-ad9c-5f35f1cce562 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:04.732975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083aee8d-fe6f-42c1-ad9c-5f35f1cce562 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:04.736610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083aee8d-fe6f-42c1-ad9c-5f35f1cce562 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:04.738122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083aee8d-fe6f-42c1-ad9c-5f35f1cce562 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:04.743000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083aee8d-fe6f-42c1-ad9c-5f35f1cce562 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:04.745289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083aee8d-fe6f-42c1-ad9c-5f35f1cce562 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:04.747884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-083aee8d-fe6f-42c1-ad9c-5f35f1cce562 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:05.271855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c1f03cdd-db49-4502-a850-15ca5fc0df7d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:05.321505 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c1f03cdd-db49-4502-a850-15ca5fc0df7d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1506 microversion: 2.1 time: 2.361724 Aug 09 17:32:05.353151 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2025/4263] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:02 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1506 bytes in 2397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:05.363888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c8e8acd3-63ee-4c0e-b56c-58534b58a899 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:05.387849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c8e8acd3-63ee-4c0e-b56c-58534b58a899 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:05.410059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e8acd3-63ee-4c0e-b56c-58534b58a899 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:05.411665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e8acd3-63ee-4c0e-b56c-58534b58a899 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:05.412888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e8acd3-63ee-4c0e-b56c-58534b58a899 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:05.421306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e8acd3-63ee-4c0e-b56c-58534b58a899 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:05.422691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e8acd3-63ee-4c0e-b56c-58534b58a899 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:05.423855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8e8acd3-63ee-4c0e-b56c-58534b58a899 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:05.493025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-083aee8d-fe6f-42c1-ad9c-5f35f1cce562 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:05.522858 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-083aee8d-fe6f-42c1-ad9c-5f35f1cce562 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 0.883825 Aug 09 17:32:05.550277 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c8e8acd3-63ee-4c0e-b56c-58534b58a899 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194506 Aug 09 17:32:05.564176 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2239/4264] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:04 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:05.565639 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2026/4265] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:32:05 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:05.664770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d05d5a48-87f0-4793-9dc2-491bde6a5147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:05.669544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d05d5a48-87f0-4793-9dc2-491bde6a5147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:05.721396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d05d5a48-87f0-4793-9dc2-491bde6a5147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:05.721915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d05d5a48-87f0-4793-9dc2-491bde6a5147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:05.722369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d05d5a48-87f0-4793-9dc2-491bde6a5147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:05.723149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d05d5a48-87f0-4793-9dc2-491bde6a5147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:05.723620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d05d5a48-87f0-4793-9dc2-491bde6a5147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:05.729881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d05d5a48-87f0-4793-9dc2-491bde6a5147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:06.194961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d15066aa-863b-4ec2-8d90-7545d7ac21b5 req-591f625f-704a-4163-8df1-c7c9474df449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc847515-8f05-40a2-a206-338fbe9037dc", "name": "network-vif-unplugged", "status": "completed", "tag": "0d5ec547-0456-4168-b507-5bbc17142227"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:06.366729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d15066aa-863b-4ec2-8d90-7545d7ac21b5 req-591f625f-704a-4163-8df1-c7c9474df449 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:06.374464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d15066aa-863b-4ec2-8d90-7545d7ac21b5 req-591f625f-704a-4163-8df1-c7c9474df449 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:06.377457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d15066aa-863b-4ec2-8d90-7545d7ac21b5 req-591f625f-704a-4163-8df1-c7c9474df449 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:06.446552 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d15066aa-863b-4ec2-8d90-7545d7ac21b5 req-591f625f-704a-4163-8df1-c7c9474df449 service nova] Creating event network-vif-unplugged:0d5ec547-0456-4168-b507-5bbc17142227 for instance cc847515-8f05-40a2-a206-338fbe9037dc on n-h1-845781-6 Aug 09 17:32:06.465839 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d15066aa-863b-4ec2-8d90-7545d7ac21b5 req-591f625f-704a-4163-8df1-c7c9474df449 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.284526 Aug 09 17:32:06.469014 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2027/4266] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:32:06.494861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-05cf36fc-28c2-476c-af76-50c31cff03c0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:06.498308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-05cf36fc-28c2-476c-af76-50c31cff03c0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:06.515991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cf36fc-28c2-476c-af76-50c31cff03c0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:06.519845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cf36fc-28c2-476c-af76-50c31cff03c0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:06.521430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cf36fc-28c2-476c-af76-50c31cff03c0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:06.522593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cf36fc-28c2-476c-af76-50c31cff03c0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:06.524494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cf36fc-28c2-476c-af76-50c31cff03c0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:06.525215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05cf36fc-28c2-476c-af76-50c31cff03c0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:06.943055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d05d5a48-87f0-4793-9dc2-491bde6a5147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:07.021654 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d05d5a48-87f0-4793-9dc2-491bde6a5147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 1.370292 Aug 09 17:32:07.024242 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2240/4267] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:05 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:07.049075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d71f874e-d6cf-4c95-b38c-28fe26b6a83e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:07.055577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d71f874e-d6cf-4c95-b38c-28fe26b6a83e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:07.098295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71f874e-d6cf-4c95-b38c-28fe26b6a83e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:07.098821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71f874e-d6cf-4c95-b38c-28fe26b6a83e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:07.099285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71f874e-d6cf-4c95-b38c-28fe26b6a83e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:07.100088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71f874e-d6cf-4c95-b38c-28fe26b6a83e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:07.100572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71f874e-d6cf-4c95-b38c-28fe26b6a83e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:07.101016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71f874e-d6cf-4c95-b38c-28fe26b6a83e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:08.149031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-05cf36fc-28c2-476c-af76-50c31cff03c0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:08.220964 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-05cf36fc-28c2-476c-af76-50c31cff03c0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 200 len: 1506 microversion: 2.1 time: 1.748127 Aug 09 17:32:08.236932 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2028/4268] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:06 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 1506 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:08.263902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2025aece-afaf-423e-b79b-93eae234b26f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:08.273391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2025aece-afaf-423e-b79b-93eae234b26f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:08.336397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2025aece-afaf-423e-b79b-93eae234b26f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:08.337821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2025aece-afaf-423e-b79b-93eae234b26f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:08.340719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2025aece-afaf-423e-b79b-93eae234b26f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:08.342487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2025aece-afaf-423e-b79b-93eae234b26f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:08.345043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2025aece-afaf-423e-b79b-93eae234b26f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:08.348654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2025aece-afaf-423e-b79b-93eae234b26f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:08.548214 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2025aece-afaf-423e-b79b-93eae234b26f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.300412 Aug 09 17:32:08.550995 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2029/4269] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:32:08 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 197 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:08.558436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d71f874e-d6cf-4c95-b38c-28fe26b6a83e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:08.577622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1447acf1-0617-437d-a9e1-487fa7defc47 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:08.579969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1447acf1-0617-437d-a9e1-487fa7defc47 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:08.594971 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d71f874e-d6cf-4c95-b38c-28fe26b6a83e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 1.568574 Aug 09 17:32:08.597681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1447acf1-0617-437d-a9e1-487fa7defc47 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:08.603529 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2241/4270] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:07 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:08.617771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1447acf1-0617-437d-a9e1-487fa7defc47 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:08.619039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1447acf1-0617-437d-a9e1-487fa7defc47 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:08.630936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e978776b-4691-4d9a-995a-8ff53013839b req-97fb62d6-e59f-4ae9-88b9-37db4da39694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc847515-8f05-40a2-a206-338fbe9037dc", "name": "network-vif-deleted", "tag": "0d5ec547-0456-4168-b507-5bbc17142227"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:08.638218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1447acf1-0617-437d-a9e1-487fa7defc47 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:08.641203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1447acf1-0617-437d-a9e1-487fa7defc47 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:08.644779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1447acf1-0617-437d-a9e1-487fa7defc47 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:08.691994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e978776b-4691-4d9a-995a-8ff53013839b req-97fb62d6-e59f-4ae9-88b9-37db4da39694 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:08.694425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e978776b-4691-4d9a-995a-8ff53013839b req-97fb62d6-e59f-4ae9-88b9-37db4da39694 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:08.696617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e978776b-4691-4d9a-995a-8ff53013839b req-97fb62d6-e59f-4ae9-88b9-37db4da39694 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:08.741320 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e978776b-4691-4d9a-995a-8ff53013839b req-97fb62d6-e59f-4ae9-88b9-37db4da39694 service nova] Creating event network-vif-deleted:0d5ec547-0456-4168-b507-5bbc17142227 for instance cc847515-8f05-40a2-a206-338fbe9037dc on n-h1-845781-6 Aug 09 17:32:08.761957 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e978776b-4691-4d9a-995a-8ff53013839b req-97fb62d6-e59f-4ae9-88b9-37db4da39694 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155461 Aug 09 17:32:08.789958 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2242/4271] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:08.843495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:09.264319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:09.274953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:09.327335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:09.329337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:09.336716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:09.342420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:09.358743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:09.366979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:09.468169 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc HTTP/1.1 Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'cc847515-8f05-40a2-a206-338fbe9037dc'} Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:09.476149 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:09.486455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:09.486455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:09.486455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:09.486455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:32:09.486455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:32:09.486455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:32:09.486455 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:09.486455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:32:09.486455 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aaf92197-b069-46c5-93a9-6c9c0150fa2d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 404 len: 111 microversion: 2.1 time: 0.225705 Aug 09 17:32:09.486455 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2243/4272] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:09 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 111 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:32:09.496195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-293861dc-8ffa-4ba1-90d6-802642119628 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'create', calling method: .version_select at 0x7fbbcb5e49d0>, body: {"keypair": {"name": "tempest-key-1562648640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0CTmoRNvk2/Oh3J95k4PAGXJ8KxBt6oMNKOGTQRazXDFcUtNrDagow+PSBmuBN/O0ZcIeq0vE9pvX62vosYDr5ywVrf5pQy4m+f+krCOXLKL1IE2EiCPXrT5i2y1mjXw=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:09.539242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-293861dc-8ffa-4ba1-90d6-802642119628 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:32:09.552613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-293861dc-8ffa-4ba1-90d6-802642119628 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for user 1d4dd578ed0640fc943af026c4363e28 and project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:32:09.619850 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-293861dc-8ffa-4ba1-90d6-802642119628 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.124223 Aug 09 17:32:09.629152 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2244/4273] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:32:09 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:09.644280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-18a06c01-9def-4945-8abe-3b78b7210e88 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:09.653526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-18a06c01-9def-4945-8abe-3b78b7210e88 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:09.692512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18a06c01-9def-4945-8abe-3b78b7210e88 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:09.694140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18a06c01-9def-4945-8abe-3b78b7210e88 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:09.700336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18a06c01-9def-4945-8abe-3b78b7210e88 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:09.702437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18a06c01-9def-4945-8abe-3b78b7210e88 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:09.711577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18a06c01-9def-4945-8abe-3b78b7210e88 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:09.713030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18a06c01-9def-4945-8abe-3b78b7210e88 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:09.909410 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-18a06c01-9def-4945-8abe-3b78b7210e88 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.277645 Aug 09 17:32:09.916446 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2245/4274] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:32:09 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 197 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:09.965501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9be35754-bb23-4783-aea0-98ff0bd6660d tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:09.970817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9be35754-bb23-4783-aea0-98ff0bd6660d tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:10.000518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be35754-bb23-4783-aea0-98ff0bd6660d tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:10.004725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1447acf1-0617-437d-a9e1-487fa7defc47 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:10.008016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be35754-bb23-4783-aea0-98ff0bd6660d tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:10.009485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be35754-bb23-4783-aea0-98ff0bd6660d tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:10.012906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be35754-bb23-4783-aea0-98ff0bd6660d tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:10.014354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be35754-bb23-4783-aea0-98ff0bd6660d tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:10.014710 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1447acf1-0617-437d-a9e1-487fa7defc47 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 1.448486 Aug 09 17:32:10.015347 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2030/4275] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:08 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:10.022251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be35754-bb23-4783-aea0-98ff0bd6660d tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:10.040319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b550aff0-c2b4-433c-957d-9d6ddefb82ac tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '.version_select at 0x7fbbcb73f3a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:10.071040 n-d-845781-6 devstack@n-api.service[119432]: WARNING oslo_db.sqlalchemy.utils [None req-b550aff0-c2b4-433c-957d-9d6ddefb82ac tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 17:32:10.116234 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b550aff0-c2b4-433c-957d-9d6ddefb82ac tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.099597 Aug 09 17:32:10.122637 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2031/4276] 10.222.0.93 () {58 vars in 1137 bytes} [Tue Aug 9 17:32:10 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:10.340046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e7837787-269f-49b1-b44e-95aad968d677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1c6d22c-66f2-475f-a808-ba9f98112847", "device": "/dev/sdb"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:10.351027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e7837787-269f-49b1-b44e-95aad968d677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:10.414145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7837787-269f-49b1-b44e-95aad968d677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:10.414968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7837787-269f-49b1-b44e-95aad968d677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:10.451307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7837787-269f-49b1-b44e-95aad968d677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:10.454040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7837787-269f-49b1-b44e-95aad968d677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:10.460008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7837787-269f-49b1-b44e-95aad968d677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:10.466143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7837787-269f-49b1-b44e-95aad968d677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:10.894315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9be35754-bb23-4783-aea0-98ff0bd6660d tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:10.938863 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9be35754-bb23-4783-aea0-98ff0bd6660d tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 1.002239 Aug 09 17:32:10.946905 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2246/4277] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:09 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:10.990422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1588960803", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "key_name": "tempest-key-1562648640", "networks": [{"uuid": "829cb0b3-9c78-4844-8875-46f5a554f097"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:11.233857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] validate_networks() for [('829cb0b3-9c78-4844-8875-46f5a554f097', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:32:11.553068 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e7837787-269f-49b1-b44e-95aad968d677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "POST /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.227586 Aug 09 17:32:11.558069 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2032/4278] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:32:10 2022] POST /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e/os-volume_attachments => generated 194 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:32:11.611603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3747a2e1-4d15-4662-b9c9-7588f7d16b84 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:11.621735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3747a2e1-4d15-4662-b9c9-7588f7d16b84 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:11.662652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3747a2e1-4d15-4662-b9c9-7588f7d16b84 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:11.666435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3747a2e1-4d15-4662-b9c9-7588f7d16b84 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:11.667272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3747a2e1-4d15-4662-b9c9-7588f7d16b84 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:11.672226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3747a2e1-4d15-4662-b9c9-7588f7d16b84 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:11.675219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3747a2e1-4d15-4662-b9c9-7588f7d16b84 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:11.679227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3747a2e1-4d15-4662-b9c9-7588f7d16b84 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:11.838916 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3747a2e1-4d15-4662-b9c9-7588f7d16b84 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.278491 Aug 09 17:32:11.843102 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2033/4279] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:32:11 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d/os-volume_attachments => generated 25 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:32:11.863561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-199def1d-a258-4cfb-b192-a65059b2f128 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:11.889305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-199def1d-a258-4cfb-b192-a65059b2f128 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:11.916787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-199def1d-a258-4cfb-b192-a65059b2f128 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:11.918575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-199def1d-a258-4cfb-b192-a65059b2f128 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:11.924222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-199def1d-a258-4cfb-b192-a65059b2f128 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:11.925874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-199def1d-a258-4cfb-b192-a65059b2f128 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:11.928977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-199def1d-a258-4cfb-b192-a65059b2f128 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:11.930150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-199def1d-a258-4cfb-b192-a65059b2f128 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:13.131785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:32:13.134353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:32:13.137981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:32:13.140240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:32:13.146668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:32:13.181272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:13.182669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:13.183821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:13.185736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:13.187378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:13.189673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:13.277002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:32:13.314179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for user 1d4dd578ed0640fc943af026c4363e28 and project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:32:13.390372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:32:13.409439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:32:13.685601 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a6eba098-0334-4b98-af3c-0356a6d6e5ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.731926 Aug 09 17:32:13.687229 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2247/4280] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:32:13.717833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e652bfb-2ef7-47b8-a4a4-f3ab7bf89f52 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:13.719046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8e652bfb-2ef7-47b8-a4a4-f3ab7bf89f52 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:13.784458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e652bfb-2ef7-47b8-a4a4-f3ab7bf89f52 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:13.791304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e652bfb-2ef7-47b8-a4a4-f3ab7bf89f52 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:13.798873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e652bfb-2ef7-47b8-a4a4-f3ab7bf89f52 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:13.806201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e652bfb-2ef7-47b8-a4a4-f3ab7bf89f52 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:13.809335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e652bfb-2ef7-47b8-a4a4-f3ab7bf89f52 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:13.810034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e652bfb-2ef7-47b8-a4a4-f3ab7bf89f52 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:13.928644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:13.940026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-199def1d-a258-4cfb-b192-a65059b2f128 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:13.971160 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-199def1d-a258-4cfb-b192-a65059b2f128 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 2.118816 Aug 09 17:32:13.985408 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2034/4281] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:11 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:14.023170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8df7ac40-ad77-4a34-94b2-2744283ae25d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:14.024457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8df7ac40-ad77-4a34-94b2-2744283ae25d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:14.041774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8df7ac40-ad77-4a34-94b2-2744283ae25d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:14.042897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8df7ac40-ad77-4a34-94b2-2744283ae25d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:14.043988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8df7ac40-ad77-4a34-94b2-2744283ae25d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:14.045651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8df7ac40-ad77-4a34-94b2-2744283ae25d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:14.047074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8df7ac40-ad77-4a34-94b2-2744283ae25d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:14.048905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8df7ac40-ad77-4a34-94b2-2744283ae25d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:14.261959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8df7ac40-ad77-4a34-94b2-2744283ae25d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:32:14.367054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8e652bfb-2ef7-47b8-a4a4-f3ab7bf89f52 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:14.384152 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e652bfb-2ef7-47b8-a4a4-f3ab7bf89f52 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 0.694684 Aug 09 17:32:14.400712 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2248/4282] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:13 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:14.425331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-401a60aa-908e-48d4-a20d-72bcd381c4c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:14.425895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-401a60aa-908e-48d4-a20d-72bcd381c4c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:14.761429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-401a60aa-908e-48d4-a20d-72bcd381c4c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:14.766691 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8df7ac40-ad77-4a34-94b2-2744283ae25d tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 204 len: 0 microversion: 2.1 time: 0.763781 Aug 09 17:32:14.767816 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2035/4283] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:32:13 2022] DELETE /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 0 bytes in 781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:32:14.793966 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-401a60aa-908e-48d4-a20d-72bcd381c4c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1229 microversion: 2.1 time: 0.391039 Aug 09 17:32:14.804737 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2249/4284] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:14 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1229 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:14.807294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-df3149a7-de5b-48c1-a123-29c35ffacdf4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:14.809191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-df3149a7-de5b-48c1-a123-29c35ffacdf4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:14.833404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df3149a7-de5b-48c1-a123-29c35ffacdf4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:14.836992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df3149a7-de5b-48c1-a123-29c35ffacdf4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:14.839939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df3149a7-de5b-48c1-a123-29c35ffacdf4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:14.842790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df3149a7-de5b-48c1-a123-29c35ffacdf4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:14.843659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df3149a7-de5b-48c1-a123-29c35ffacdf4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:14.844437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df3149a7-de5b-48c1-a123-29c35ffacdf4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:15.017637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-539874e1-21bb-4158-bb4d-b48aedb756c9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:15.018797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-539874e1-21bb-4158-bb4d-b48aedb756c9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:15.057930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539874e1-21bb-4158-bb4d-b48aedb756c9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:15.058636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539874e1-21bb-4158-bb4d-b48aedb756c9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:15.059434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539874e1-21bb-4158-bb4d-b48aedb756c9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:15.060763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539874e1-21bb-4158-bb4d-b48aedb756c9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:15.061553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539874e1-21bb-4158-bb4d-b48aedb756c9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:15.068000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-539874e1-21bb-4158-bb4d-b48aedb756c9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:15.663231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-539874e1-21bb-4158-bb4d-b48aedb756c9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:15.692295 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-539874e1-21bb-4158-bb4d-b48aedb756c9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 0.681800 Aug 09 17:32:15.703054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-df3149a7-de5b-48c1-a123-29c35ffacdf4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:15.714330 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2250/4285] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:15 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:32:15.777252 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-df3149a7-de5b-48c1-a123-29c35ffacdf4 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1682 microversion: 2.1 time: 1.002859 Aug 09 17:32:15.795700 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2036/4286] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:14 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1682 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:15.808346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3b6ccfe1-f065-4e04-b09b-c3b58dbd62a8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:15.809640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3b6ccfe1-f065-4e04-b09b-c3b58dbd62a8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:15.834550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-46e889ea-e7f6-48c4-9bb5-672a569e2625 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:15.838897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-46e889ea-e7f6-48c4-9bb5-672a569e2625 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:15.867384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b6ccfe1-f065-4e04-b09b-c3b58dbd62a8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:15.891333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b6ccfe1-f065-4e04-b09b-c3b58dbd62a8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:15.897832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b6ccfe1-f065-4e04-b09b-c3b58dbd62a8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:15.899117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b6ccfe1-f065-4e04-b09b-c3b58dbd62a8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:15.923562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b6ccfe1-f065-4e04-b09b-c3b58dbd62a8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:15.934011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b6ccfe1-f065-4e04-b09b-c3b58dbd62a8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:16.113575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-46e889ea-e7f6-48c4-9bb5-672a569e2625 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:16.126847 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-46e889ea-e7f6-48c4-9bb5-672a569e2625 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1229 microversion: 2.1 time: 0.303784 Aug 09 17:32:16.127941 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2037/4287] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:15 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1229 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:32:16.753534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-52baf0a3-f051-454f-830f-9c8392e98ea0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:16.765305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-52baf0a3-f051-454f-830f-9c8392e98ea0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:16.805673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52baf0a3-f051-454f-830f-9c8392e98ea0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:16.812864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52baf0a3-f051-454f-830f-9c8392e98ea0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:16.814170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52baf0a3-f051-454f-830f-9c8392e98ea0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:16.820399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52baf0a3-f051-454f-830f-9c8392e98ea0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:16.823025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52baf0a3-f051-454f-830f-9c8392e98ea0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:16.827325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52baf0a3-f051-454f-830f-9c8392e98ea0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:16.842674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3b6ccfe1-f065-4e04-b09b-c3b58dbd62a8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:16.886008 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3b6ccfe1-f065-4e04-b09b-c3b58dbd62a8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 1.156081 Aug 09 17:32:16.937863 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2251/4288] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:15 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:16.961673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9bef1681-3dba-430c-94fc-4651f2034962 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:16.963666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9bef1681-3dba-430c-94fc-4651f2034962 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:16.982453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bef1681-3dba-430c-94fc-4651f2034962 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:16.984520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bef1681-3dba-430c-94fc-4651f2034962 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:16.985655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bef1681-3dba-430c-94fc-4651f2034962 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:16.989201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bef1681-3dba-430c-94fc-4651f2034962 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:16.992334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bef1681-3dba-430c-94fc-4651f2034962 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:16.995874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bef1681-3dba-430c-94fc-4651f2034962 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:17.756516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9bef1681-3dba-430c-94fc-4651f2034962 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:17.784522 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9bef1681-3dba-430c-94fc-4651f2034962 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1682 microversion: 2.1 time: 0.843318 Aug 09 17:32:17.786196 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2252/4289] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:16 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1682 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:17.796492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9752de8e-507c-4b89-978d-4f8d2f3de9e7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:17.813696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9752de8e-507c-4b89-978d-4f8d2f3de9e7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:17.852502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9752de8e-507c-4b89-978d-4f8d2f3de9e7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:17.855616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9752de8e-507c-4b89-978d-4f8d2f3de9e7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:17.857841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9752de8e-507c-4b89-978d-4f8d2f3de9e7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:17.861171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9752de8e-507c-4b89-978d-4f8d2f3de9e7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:17.866462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9752de8e-507c-4b89-978d-4f8d2f3de9e7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:17.869033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9752de8e-507c-4b89-978d-4f8d2f3de9e7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:18.014315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9752de8e-507c-4b89-978d-4f8d2f3de9e7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:18.023797 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9752de8e-507c-4b89-978d-4f8d2f3de9e7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1287 microversion: 2.1 time: 0.235249 Aug 09 17:32:18.025046 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2253/4290] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:17 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1287 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:18.040707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6efb91c-c4d0-4d60-8b5c-66ec2bbc66f9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:18.041343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b6efb91c-c4d0-4d60-8b5c-66ec2bbc66f9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:18.052505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6efb91c-c4d0-4d60-8b5c-66ec2bbc66f9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:18.056825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6efb91c-c4d0-4d60-8b5c-66ec2bbc66f9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:18.058868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6efb91c-c4d0-4d60-8b5c-66ec2bbc66f9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:18.061067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6efb91c-c4d0-4d60-8b5c-66ec2bbc66f9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:18.062154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6efb91c-c4d0-4d60-8b5c-66ec2bbc66f9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:18.063434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6efb91c-c4d0-4d60-8b5c-66ec2bbc66f9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:18.255810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-52baf0a3-f051-454f-830f-9c8392e98ea0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:18.273114 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-52baf0a3-f051-454f-830f-9c8392e98ea0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1682 microversion: 2.1 time: 1.535977 Aug 09 17:32:18.276647 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2038/4291] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:16 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1682 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:18.466030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b6efb91c-c4d0-4d60-8b5c-66ec2bbc66f9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:18.483962 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6efb91c-c4d0-4d60-8b5c-66ec2bbc66f9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 0.457626 Aug 09 17:32:18.486638 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2254/4292] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:18 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:18.826987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-25bc808d-98d8-4cd8-b044-f8b76b83b6e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:18.831481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-25bc808d-98d8-4cd8-b044-f8b76b83b6e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:18.881704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25bc808d-98d8-4cd8-b044-f8b76b83b6e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:18.883446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25bc808d-98d8-4cd8-b044-f8b76b83b6e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:18.884582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25bc808d-98d8-4cd8-b044-f8b76b83b6e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:18.886202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25bc808d-98d8-4cd8-b044-f8b76b83b6e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:18.887405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25bc808d-98d8-4cd8-b044-f8b76b83b6e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:18.888557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25bc808d-98d8-4cd8-b044-f8b76b83b6e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:19.059756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a24378a-28dc-4551-917c-bdf4f2690c34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:19.060439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a24378a-28dc-4551-917c-bdf4f2690c34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:19.079787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:19.084258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a24378a-28dc-4551-917c-bdf4f2690c34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:19.086192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a24378a-28dc-4551-917c-bdf4f2690c34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:19.087114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a24378a-28dc-4551-917c-bdf4f2690c34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:19.091117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a24378a-28dc-4551-917c-bdf4f2690c34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:19.091844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a24378a-28dc-4551-917c-bdf4f2690c34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:19.096089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a24378a-28dc-4551-917c-bdf4f2690c34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:19.283785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a24378a-28dc-4551-917c-bdf4f2690c34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:19.295809 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a24378a-28dc-4551-917c-bdf4f2690c34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1287 microversion: 2.1 time: 0.241080 Aug 09 17:32:19.308288 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2255/4293] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:19 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1287 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:32:19.332190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e004b088-d058-40cc-92c5-2b2d7baf310b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:19.334088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e004b088-d058-40cc-92c5-2b2d7baf310b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:19.359829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e004b088-d058-40cc-92c5-2b2d7baf310b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:19.360722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e004b088-d058-40cc-92c5-2b2d7baf310b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:19.361527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e004b088-d058-40cc-92c5-2b2d7baf310b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:19.364930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e004b088-d058-40cc-92c5-2b2d7baf310b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:19.365738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e004b088-d058-40cc-92c5-2b2d7baf310b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:19.366508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e004b088-d058-40cc-92c5-2b2d7baf310b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:19.523302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-25bc808d-98d8-4cd8-b044-f8b76b83b6e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:19.552808 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-25bc808d-98d8-4cd8-b044-f8b76b83b6e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1682 microversion: 2.1 time: 0.732763 Aug 09 17:32:19.558884 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2039/4294] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:18 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1682 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:19.583694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-efbe0086-a233-419b-82de-9985232ab808 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:19.585286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-efbe0086-a233-419b-82de-9985232ab808 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:19.604146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efbe0086-a233-419b-82de-9985232ab808 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:19.605779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efbe0086-a233-419b-82de-9985232ab808 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:19.607142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efbe0086-a233-419b-82de-9985232ab808 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:19.608787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efbe0086-a233-419b-82de-9985232ab808 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:19.610584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efbe0086-a233-419b-82de-9985232ab808 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:19.611784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-efbe0086-a233-419b-82de-9985232ab808 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:20.470288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e004b088-d058-40cc-92c5-2b2d7baf310b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:20.498524 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e004b088-d058-40cc-92c5-2b2d7baf310b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.179469 Aug 09 17:32:20.505691 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2256/4295] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:19 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:32:20.525236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e829b843-117e-492d-b482-2700cf29f2df req-6358d8b7-448e-4a75-bd7f-96d828ce49f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab40c63-640b-40d0-8845-8026b0b71e5d", "name": "network-vif-unplugged", "status": "completed", "tag": "9098e32a-91ce-400a-99e7-63af9ce9c3da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:20.566450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e829b843-117e-492d-b482-2700cf29f2df req-6358d8b7-448e-4a75-bd7f-96d828ce49f0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:20.572617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e829b843-117e-492d-b482-2700cf29f2df req-6358d8b7-448e-4a75-bd7f-96d828ce49f0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:20.573605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e829b843-117e-492d-b482-2700cf29f2df req-6358d8b7-448e-4a75-bd7f-96d828ce49f0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:20.611362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-efbe0086-a233-419b-82de-9985232ab808 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:20.627607 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e829b843-117e-492d-b482-2700cf29f2df req-6358d8b7-448e-4a75-bd7f-96d828ce49f0 service nova] Creating event network-vif-unplugged:9098e32a-91ce-400a-99e7-63af9ce9c3da for instance fab40c63-640b-40d0-8845-8026b0b71e5d on n-h2-845781-6 Aug 09 17:32:20.648819 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e829b843-117e-492d-b482-2700cf29f2df req-6358d8b7-448e-4a75-bd7f-96d828ce49f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137857 Aug 09 17:32:20.653697 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2257/4296] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:20.677197 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-efbe0086-a233-419b-82de-9985232ab808 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 1.113165 Aug 09 17:32:20.677197 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2040/4297] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:19 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:20.683159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a9add58b-b452-4839-87ab-263e7eb6c436 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:20.689635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a9add58b-b452-4839-87ab-263e7eb6c436 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:20.713138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9add58b-b452-4839-87ab-263e7eb6c436 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:20.719947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9add58b-b452-4839-87ab-263e7eb6c436 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:20.721485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9add58b-b452-4839-87ab-263e7eb6c436 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:20.723710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9add58b-b452-4839-87ab-263e7eb6c436 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:20.728021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9add58b-b452-4839-87ab-263e7eb6c436 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:20.728330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-489c32ae-092a-4ea3-8c0a-195588fdab1a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:20.729406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-489c32ae-092a-4ea3-8c0a-195588fdab1a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:20.730706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9add58b-b452-4839-87ab-263e7eb6c436 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:20.788417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-489c32ae-092a-4ea3-8c0a-195588fdab1a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:20.797983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-489c32ae-092a-4ea3-8c0a-195588fdab1a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:20.799230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-489c32ae-092a-4ea3-8c0a-195588fdab1a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:20.800741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-489c32ae-092a-4ea3-8c0a-195588fdab1a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:20.801914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-489c32ae-092a-4ea3-8c0a-195588fdab1a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:20.807836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-489c32ae-092a-4ea3-8c0a-195588fdab1a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:21.023438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a9add58b-b452-4839-87ab-263e7eb6c436 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:21.049930 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a9add58b-b452-4839-87ab-263e7eb6c436 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1287 microversion: 2.1 time: 0.390049 Aug 09 17:32:21.057505 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2258/4298] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:20 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1287 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:21.079962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2597ac29-06bb-4707-bf5a-b75f1e71ca2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:21.086082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2597ac29-06bb-4707-bf5a-b75f1e71ca2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:21.109203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2597ac29-06bb-4707-bf5a-b75f1e71ca2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:21.114014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2597ac29-06bb-4707-bf5a-b75f1e71ca2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:21.115107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2597ac29-06bb-4707-bf5a-b75f1e71ca2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:21.117462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2597ac29-06bb-4707-bf5a-b75f1e71ca2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:21.121502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2597ac29-06bb-4707-bf5a-b75f1e71ca2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:21.122681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2597ac29-06bb-4707-bf5a-b75f1e71ca2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:21.453825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-489c32ae-092a-4ea3-8c0a-195588fdab1a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:21.497319 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-489c32ae-092a-4ea3-8c0a-195588fdab1a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1614 microversion: 2.1 time: 0.799698 Aug 09 17:32:21.501601 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2041/4299] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:20 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1614 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:21.707221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-47689f9b-b18d-4d0d-aa9d-48945707b68e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:21.724690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-47689f9b-b18d-4d0d-aa9d-48945707b68e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:21.739512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:21.742081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47689f9b-b18d-4d0d-aa9d-48945707b68e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:21.742890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47689f9b-b18d-4d0d-aa9d-48945707b68e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:21.743606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47689f9b-b18d-4d0d-aa9d-48945707b68e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:21.758235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47689f9b-b18d-4d0d-aa9d-48945707b68e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:21.761146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47689f9b-b18d-4d0d-aa9d-48945707b68e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:21.767344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47689f9b-b18d-4d0d-aa9d-48945707b68e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:22.834141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-47689f9b-b18d-4d0d-aa9d-48945707b68e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:22.886995 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-47689f9b-b18d-4d0d-aa9d-48945707b68e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 1.180168 Aug 09 17:32:22.890106 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2042/4300] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:21 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:32:22.920746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b7203195-ba08-4116-8ed2-bce9bf7aa3ae tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:22.923938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b7203195-ba08-4116-8ed2-bce9bf7aa3ae tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:22.947617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7203195-ba08-4116-8ed2-bce9bf7aa3ae tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:22.950785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7203195-ba08-4116-8ed2-bce9bf7aa3ae tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:22.952582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7203195-ba08-4116-8ed2-bce9bf7aa3ae tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:22.955515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7203195-ba08-4116-8ed2-bce9bf7aa3ae tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:22.957104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7203195-ba08-4116-8ed2-bce9bf7aa3ae tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:22.959451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7203195-ba08-4116-8ed2-bce9bf7aa3ae tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:23.048339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2597ac29-06bb-4707-bf5a-b75f1e71ca2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:23.080833 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2597ac29-06bb-4707-bf5a-b75f1e71ca2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 2.012367 Aug 09 17:32:23.082407 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2259/4301] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:21 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:23.104056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7aeac36f-3792-4657-8955-5377d0d167b1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:23.105133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7aeac36f-3792-4657-8955-5377d0d167b1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:23.135299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7aeac36f-3792-4657-8955-5377d0d167b1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:23.136166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7aeac36f-3792-4657-8955-5377d0d167b1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:23.136950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7aeac36f-3792-4657-8955-5377d0d167b1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:23.142972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7aeac36f-3792-4657-8955-5377d0d167b1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:23.144025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7aeac36f-3792-4657-8955-5377d0d167b1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:23.144794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7aeac36f-3792-4657-8955-5377d0d167b1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:23.233198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:23.493351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7aeac36f-3792-4657-8955-5377d0d167b1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0fad88d219437eaed454ba916c86e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f7b3787cde4d1fb5c8d8f8557a83ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:23.509580 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7aeac36f-3792-4657-8955-5377d0d167b1 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 200 len: 1326 microversion: 2.1 time: 0.425542 Aug 09 17:32:23.525920 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2260/4302] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:23 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 1326 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:23.538649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1ecb77e8-eed1-4158-8fd4-e22ec7258ef7 req-213a4f6d-5f06-40d7-a6ec-948074beaa72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a30c674-6026-45bd-b50e-218ae7d69382", "name": "network-vif-unplugged", "status": "completed", "tag": "a73935e9-c581-4296-b0ba-805a64e85308"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:23.569111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ecb77e8-eed1-4158-8fd4-e22ec7258ef7 req-213a4f6d-5f06-40d7-a6ec-948074beaa72 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:23.572178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ecb77e8-eed1-4158-8fd4-e22ec7258ef7 req-213a4f6d-5f06-40d7-a6ec-948074beaa72 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:23.572875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ecb77e8-eed1-4158-8fd4-e22ec7258ef7 req-213a4f6d-5f06-40d7-a6ec-948074beaa72 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:23.613276 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1ecb77e8-eed1-4158-8fd4-e22ec7258ef7 req-213a4f6d-5f06-40d7-a6ec-948074beaa72 service nova] Creating event network-vif-unplugged:a73935e9-c581-4296-b0ba-805a64e85308 for instance 1a30c674-6026-45bd-b50e-218ae7d69382 on n-h2-845781-6 Aug 09 17:32:23.621465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b7203195-ba08-4116-8ed2-bce9bf7aa3ae tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:23.640776 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1ecb77e8-eed1-4158-8fd4-e22ec7258ef7 req-213a4f6d-5f06-40d7-a6ec-948074beaa72 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113019 Aug 09 17:32:23.643676 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2261/4303] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:23.650025 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b7203195-ba08-4116-8ed2-bce9bf7aa3ae tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1329 microversion: 2.1 time: 0.758066 Aug 09 17:32:23.653003 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2043/4304] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:22 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1329 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:23.662872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-cf23eab6-b767-4f5a-b42c-d1b5d517570e req-38c5d7ef-7d4c-41ce-9fd7-e3808e335cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab40c63-640b-40d0-8845-8026b0b71e5d", "name": "network-vif-deleted", "tag": "9098e32a-91ce-400a-99e7-63af9ce9c3da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:23.692532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cf23eab6-b767-4f5a-b42c-d1b5d517570e req-38c5d7ef-7d4c-41ce-9fd7-e3808e335cf7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:23.693386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cf23eab6-b767-4f5a-b42c-d1b5d517570e req-38c5d7ef-7d4c-41ce-9fd7-e3808e335cf7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:23.694069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cf23eab6-b767-4f5a-b42c-d1b5d517570e req-38c5d7ef-7d4c-41ce-9fd7-e3808e335cf7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:23.713284 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-cf23eab6-b767-4f5a-b42c-d1b5d517570e req-38c5d7ef-7d4c-41ce-9fd7-e3808e335cf7 service nova] Creating event network-vif-deleted:9098e32a-91ce-400a-99e7-63af9ce9c3da for instance fab40c63-640b-40d0-8845-8026b0b71e5d on n-h2-845781-6 Aug 09 17:32:23.720405 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-cf23eab6-b767-4f5a-b42c-d1b5d517570e req-38c5d7ef-7d4c-41ce-9fd7-e3808e335cf7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074543 Aug 09 17:32:23.721448 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2262/4305] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:23.916178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fb216eb7-a17a-4290-b0f0-ab3ac3ea5bde tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:23.918667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fb216eb7-a17a-4290-b0f0-ab3ac3ea5bde tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:23.931821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb216eb7-a17a-4290-b0f0-ab3ac3ea5bde tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:23.932974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb216eb7-a17a-4290-b0f0-ab3ac3ea5bde tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:23.935220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb216eb7-a17a-4290-b0f0-ab3ac3ea5bde tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:23.948210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb216eb7-a17a-4290-b0f0-ab3ac3ea5bde tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:23.948897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb216eb7-a17a-4290-b0f0-ab3ac3ea5bde tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:23.950353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fb216eb7-a17a-4290-b0f0-ab3ac3ea5bde tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:24.551069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:24.556911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:24.607467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:24.610784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:24.632382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:24.639484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:24.643230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:24.647427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:24.706439 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d HTTP/1.1 Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'fab40c63-640b-40d0-8845-8026b0b71e5d'} Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:24.719545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:24.726454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:24.726454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:24.726454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:24.726454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:32:24.726454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:32:24.726454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:24.726454 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:24.726454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:32:24.726454 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6d1cd871-b9f9-4855-979d-c19e02248246 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 404 len: 111 microversion: 2.1 time: 0.188173 Aug 09 17:32:24.732589 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2263/4306] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:24 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:32:24.750617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4db77f4f-7174-4d2d-a727-f05f46403ca1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:24.751260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4db77f4f-7174-4d2d-a727-f05f46403ca1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:24.775106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4db77f4f-7174-4d2d-a727-f05f46403ca1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:24.776049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4db77f4f-7174-4d2d-a727-f05f46403ca1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:24.776637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4db77f4f-7174-4d2d-a727-f05f46403ca1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:24.782410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4db77f4f-7174-4d2d-a727-f05f46403ca1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:24.783692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4db77f4f-7174-4d2d-a727-f05f46403ca1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:24.791260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4db77f4f-7174-4d2d-a727-f05f46403ca1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:24.793931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:25.296307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4db77f4f-7174-4d2d-a727-f05f46403ca1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:25.321382 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4db77f4f-7174-4d2d-a727-f05f46403ca1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1329 microversion: 2.1 time: 0.586870 Aug 09 17:32:25.324051 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2264/4307] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:24 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1329 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:25.343142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-534e9f9a-a2f0-41ee-8997-d5c29685574a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '.version_select at 0x7fbbca5a1160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:25.398385 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-534e9f9a-a2f0-41ee-8997-d5c29685574a tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-581868477" status: 202 len: 0 microversion: 2.1 time: 0.071241 Aug 09 17:32:25.403519 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2265/4308] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:32:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-581868477 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:32:25.915165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fb216eb7-a17a-4290-b0f0-ab3ac3ea5bde tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:25.930881 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fb216eb7-a17a-4290-b0f0-ab3ac3ea5bde tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 2.021886 Aug 09 17:32:25.946722 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2044/4309] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:23 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:26.364807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cc2f6768-92af-4f31-b38c-407dc2985611 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:26.366265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cc2f6768-92af-4f31-b38c-407dc2985611 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:26.408513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc2f6768-92af-4f31-b38c-407dc2985611 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:26.412264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc2f6768-92af-4f31-b38c-407dc2985611 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:26.412791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc2f6768-92af-4f31-b38c-407dc2985611 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:26.418522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc2f6768-92af-4f31-b38c-407dc2985611 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:26.423913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc2f6768-92af-4f31-b38c-407dc2985611 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:26.427587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc2f6768-92af-4f31-b38c-407dc2985611 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:26.800708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ffcec40f-6e96-4e43-880e-898300badce0 req-afce0b0c-6426-43ec-8fbd-bcc9ef74f1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f46111bd-a4d2-4c54-8f11-ba106b20a1fb", "tag": "a611918f-51f5-4354-9230-c5b27a1255a9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:26.874448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:26.885971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ffcec40f-6e96-4e43-880e-898300badce0 req-afce0b0c-6426-43ec-8fbd-bcc9ef74f1f4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:26.890702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ffcec40f-6e96-4e43-880e-898300badce0 req-afce0b0c-6426-43ec-8fbd-bcc9ef74f1f4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:26.893344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ffcec40f-6e96-4e43-880e-898300badce0 req-afce0b0c-6426-43ec-8fbd-bcc9ef74f1f4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:26.962479 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ffcec40f-6e96-4e43-880e-898300badce0 req-afce0b0c-6426-43ec-8fbd-bcc9ef74f1f4 service nova] Creating event network-changed:a611918f-51f5-4354-9230-c5b27a1255a9 for instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb on n-h1-845781-6 Aug 09 17:32:26.976337 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ffcec40f-6e96-4e43-880e-898300badce0 req-afce0b0c-6426-43ec-8fbd-bcc9ef74f1f4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183463 Aug 09 17:32:26.980182 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2045/4310] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:26.993225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-32deb2b7-3464-4826-a7a6-45361025a2d0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:26.994783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-32deb2b7-3464-4826-a7a6-45361025a2d0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:27.019103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32deb2b7-3464-4826-a7a6-45361025a2d0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:27.021216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32deb2b7-3464-4826-a7a6-45361025a2d0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:27.023708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32deb2b7-3464-4826-a7a6-45361025a2d0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:27.024819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32deb2b7-3464-4826-a7a6-45361025a2d0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:27.027248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32deb2b7-3464-4826-a7a6-45361025a2d0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:27.029008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32deb2b7-3464-4826-a7a6-45361025a2d0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:27.432548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cc2f6768-92af-4f31-b38c-407dc2985611 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:27.449815 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cc2f6768-92af-4f31-b38c-407dc2985611 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1329 microversion: 2.1 time: 1.095852 Aug 09 17:32:27.465768 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2266/4311] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:26 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1329 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:27.476868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-532a98a3-4911-4073-8007-089aa0f03309 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:27.477746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-532a98a3-4911-4073-8007-089aa0f03309 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:27.485342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532a98a3-4911-4073-8007-089aa0f03309 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:27.486964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532a98a3-4911-4073-8007-089aa0f03309 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:27.487688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532a98a3-4911-4073-8007-089aa0f03309 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:27.489299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532a98a3-4911-4073-8007-089aa0f03309 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:27.490082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532a98a3-4911-4073-8007-089aa0f03309 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:27.490892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532a98a3-4911-4073-8007-089aa0f03309 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:27.690021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-32deb2b7-3464-4826-a7a6-45361025a2d0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:27.698206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:27.709276 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-32deb2b7-3464-4826-a7a6-45361025a2d0 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 0.725582 Aug 09 17:32:27.709930 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2046/4312] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:26 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:28.236497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-532a98a3-4911-4073-8007-089aa0f03309 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:28.305491 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-532a98a3-4911-4073-8007-089aa0f03309 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.831681 Aug 09 17:32:28.327917 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2267/4313] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:27 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:28.374293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a9381735-4ff8-43d0-8893-6443113ff4b8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:28.375897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a9381735-4ff8-43d0-8893-6443113ff4b8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:28.401354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9381735-4ff8-43d0-8893-6443113ff4b8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:28.402130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9381735-4ff8-43d0-8893-6443113ff4b8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:28.404656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9381735-4ff8-43d0-8893-6443113ff4b8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:28.406636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9381735-4ff8-43d0-8893-6443113ff4b8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:28.415405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9381735-4ff8-43d0-8893-6443113ff4b8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:28.416325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9381735-4ff8-43d0-8893-6443113ff4b8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:28.496861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d5b46eb-97c3-49b8-a1db-627343787db7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:28.506856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0d5b46eb-97c3-49b8-a1db-627343787db7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:28.537646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d5b46eb-97c3-49b8-a1db-627343787db7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:28.538150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d5b46eb-97c3-49b8-a1db-627343787db7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:28.540721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d5b46eb-97c3-49b8-a1db-627343787db7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:28.545672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d5b46eb-97c3-49b8-a1db-627343787db7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:28.546494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d5b46eb-97c3-49b8-a1db-627343787db7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:28.547106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d5b46eb-97c3-49b8-a1db-627343787db7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:29.017938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0d5b46eb-97c3-49b8-a1db-627343787db7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:29.037529 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0d5b46eb-97c3-49b8-a1db-627343787db7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1329 microversion: 2.1 time: 0.564095 Aug 09 17:32:29.038730 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2268/4314] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:28 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1329 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:29.061408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-788bc925-3027-4fe7-b19b-84e81b04574e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:29.062074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-788bc925-3027-4fe7-b19b-84e81b04574e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:29.083171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-788bc925-3027-4fe7-b19b-84e81b04574e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:29.083697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-788bc925-3027-4fe7-b19b-84e81b04574e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:29.090628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-788bc925-3027-4fe7-b19b-84e81b04574e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:29.092020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-788bc925-3027-4fe7-b19b-84e81b04574e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:29.092861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-788bc925-3027-4fe7-b19b-84e81b04574e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:29.093486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-788bc925-3027-4fe7-b19b-84e81b04574e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:29.471394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-788bc925-3027-4fe7-b19b-84e81b04574e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:29.475977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:29.484142 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-788bc925-3027-4fe7-b19b-84e81b04574e tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 0.441485 Aug 09 17:32:29.484819 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2269/4315] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:29 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:29.535680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a9381735-4ff8-43d0-8893-6443113ff4b8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:29.552419 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a9381735-4ff8-43d0-8893-6443113ff4b8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.187855 Aug 09 17:32:29.554944 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2047/4316] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:28 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:29.599580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-18e1f56c-788f-4c0f-86e4-2e3bc3516889 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:29.602053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-18e1f56c-788f-4c0f-86e4-2e3bc3516889 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:29.621217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18e1f56c-788f-4c0f-86e4-2e3bc3516889 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:29.622640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18e1f56c-788f-4c0f-86e4-2e3bc3516889 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:29.624022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18e1f56c-788f-4c0f-86e4-2e3bc3516889 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:29.625773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18e1f56c-788f-4c0f-86e4-2e3bc3516889 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:29.627752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18e1f56c-788f-4c0f-86e4-2e3bc3516889 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:29.643121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18e1f56c-788f-4c0f-86e4-2e3bc3516889 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:29.988254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-18e1f56c-788f-4c0f-86e4-2e3bc3516889 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:30.017818 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-18e1f56c-788f-4c0f-86e4-2e3bc3516889 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.426607 Aug 09 17:32:30.021044 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2270/4317] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:29 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:30.072336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-313a5b18-4217-4591-adae-1c2821227ca8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:30.077392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-313a5b18-4217-4591-adae-1c2821227ca8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:30.084321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fdab1ce9-c701-4053-a8f7-36558c4e1de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:30.088198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fdab1ce9-c701-4053-a8f7-36558c4e1de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:30.091513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-313a5b18-4217-4591-adae-1c2821227ca8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:30.092800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-313a5b18-4217-4591-adae-1c2821227ca8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:30.094078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-313a5b18-4217-4591-adae-1c2821227ca8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:30.096013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-313a5b18-4217-4591-adae-1c2821227ca8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:30.097351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-313a5b18-4217-4591-adae-1c2821227ca8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:30.098956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-313a5b18-4217-4591-adae-1c2821227ca8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:30.136340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdab1ce9-c701-4053-a8f7-36558c4e1de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:30.139456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdab1ce9-c701-4053-a8f7-36558c4e1de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:30.142909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdab1ce9-c701-4053-a8f7-36558c4e1de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:30.144333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdab1ce9-c701-4053-a8f7-36558c4e1de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:30.145236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdab1ce9-c701-4053-a8f7-36558c4e1de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:30.157093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdab1ce9-c701-4053-a8f7-36558c4e1de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:30.316791 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-313a5b18-4217-4591-adae-1c2821227ca8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.253453 Aug 09 17:32:30.318031 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2048/4318] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:32:30 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:32:30.326632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fd71436a-962b-4074-b024-3b107080c32c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Action: 'create', calling method: .version_select at 0x7fbbdc9c0af0>, body: {"keypair": {"name": "tempest-keypair-928410858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeJfmktAQHCAjkfz+JL14ROHTcL/0wy/eT5XLhKBTMwmyliJ2YoxD/ubOoV95P/qP0EkOmYWdhapzP80S+ZdGHysq2A92XCS7lZbYuXG8ZtDgO40Ske/WLGbxJbmzSktg=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:30.401140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fd71436a-962b-4074-b024-3b107080c32c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Getting quotas for project ffe16f946c5b4a3dbc82f2f66a74fbe6. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:32:30.431756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fd71436a-962b-4074-b024-3b107080c32c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Getting quotas for user 480979aea5644fc5bb060c893b0b5b05 and project ffe16f946c5b4a3dbc82f2f66a74fbe6. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:32:30.543028 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fd71436a-962b-4074-b024-3b107080c32c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.222960 Aug 09 17:32:30.555679 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2049/4319] 10.222.0.93 () {62 vars in 1200 bytes} [Tue Aug 9 17:32:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 226 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 17:32:30.555679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a5edd03c-62b1-4481-b3b6-112d8ffd8194 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:30.570432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a5edd03c-62b1-4481-b3b6-112d8ffd8194 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:30.605735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5edd03c-62b1-4481-b3b6-112d8ffd8194 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:30.608313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5edd03c-62b1-4481-b3b6-112d8ffd8194 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:30.611069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5edd03c-62b1-4481-b3b6-112d8ffd8194 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:30.613291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5edd03c-62b1-4481-b3b6-112d8ffd8194 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:30.615447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5edd03c-62b1-4481-b3b6-112d8ffd8194 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:30.616669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5edd03c-62b1-4481-b3b6-112d8ffd8194 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:30.822929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fdab1ce9-c701-4053-a8f7-36558c4e1de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:30.852170 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fdab1ce9-c701-4053-a8f7-36558c4e1de6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1329 microversion: 2.1 time: 0.788176 Aug 09 17:32:30.854673 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2271/4320] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:30 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1329 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:30.871573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d768dcd9-14d1-4fd8-a080-b238f6cad5f5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:30.873538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d768dcd9-14d1-4fd8-a080-b238f6cad5f5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:30.890540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d768dcd9-14d1-4fd8-a080-b238f6cad5f5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:30.892832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d768dcd9-14d1-4fd8-a080-b238f6cad5f5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:30.893872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d768dcd9-14d1-4fd8-a080-b238f6cad5f5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:30.896180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d768dcd9-14d1-4fd8-a080-b238f6cad5f5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:30.897399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d768dcd9-14d1-4fd8-a080-b238f6cad5f5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:30.898485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d768dcd9-14d1-4fd8-a080-b238f6cad5f5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:31.164799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d768dcd9-14d1-4fd8-a080-b238f6cad5f5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:31.180204 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d768dcd9-14d1-4fd8-a080-b238f6cad5f5 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 0.322845 Aug 09 17:32:31.181301 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2272/4321] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:30 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:31.572555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a5edd03c-62b1-4481-b3b6-112d8ffd8194 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:31.626071 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a5edd03c-62b1-4481-b3b6-112d8ffd8194 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1671 microversion: 2.1 time: 1.079374 Aug 09 17:32:31.651900 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2050/4322] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:30 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1671 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:31.893210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cac95461-66ad-4cf4-81d7-b29e6e58ed8f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:31.894208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cac95461-66ad-4cf4-81d7-b29e6e58ed8f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:31.920668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cac95461-66ad-4cf4-81d7-b29e6e58ed8f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:31.921749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cac95461-66ad-4cf4-81d7-b29e6e58ed8f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:31.924161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cac95461-66ad-4cf4-81d7-b29e6e58ed8f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:31.927814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cac95461-66ad-4cf4-81d7-b29e6e58ed8f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:31.930508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cac95461-66ad-4cf4-81d7-b29e6e58ed8f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:31.931801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cac95461-66ad-4cf4-81d7-b29e6e58ed8f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:32.224988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4c54a0cc-784a-4862-9252-7cd153ed4f94 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:32.226706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4c54a0cc-784a-4862-9252-7cd153ed4f94 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:32.254930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c54a0cc-784a-4862-9252-7cd153ed4f94 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:32.256473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c54a0cc-784a-4862-9252-7cd153ed4f94 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:32.257545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c54a0cc-784a-4862-9252-7cd153ed4f94 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:32.259086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c54a0cc-784a-4862-9252-7cd153ed4f94 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:32.260898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c54a0cc-784a-4862-9252-7cd153ed4f94 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:32.261943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c54a0cc-784a-4862-9252-7cd153ed4f94 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:32.447383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cac95461-66ad-4cf4-81d7-b29e6e58ed8f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:32.489684 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cac95461-66ad-4cf4-81d7-b29e6e58ed8f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1329 microversion: 2.1 time: 0.596577 Aug 09 17:32:32.491966 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2273/4323] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:31 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1329 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:32.674703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1daae8f-adce-470f-b9d5-cb9f211bbfa5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:32.675809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1daae8f-adce-470f-b9d5-cb9f211bbfa5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:32.702135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1daae8f-adce-470f-b9d5-cb9f211bbfa5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:32.703104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1daae8f-adce-470f-b9d5-cb9f211bbfa5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:32.703861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1daae8f-adce-470f-b9d5-cb9f211bbfa5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:32.704941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1daae8f-adce-470f-b9d5-cb9f211bbfa5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:32.705755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1daae8f-adce-470f-b9d5-cb9f211bbfa5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:32.709128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1daae8f-adce-470f-b9d5-cb9f211bbfa5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:33.155586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a1daae8f-adce-470f-b9d5-cb9f211bbfa5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:33.173530 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1daae8f-adce-470f-b9d5-cb9f211bbfa5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1671 microversion: 2.1 time: 0.501469 Aug 09 17:32:33.176690 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2274/4324] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:32 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1671 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:32:33.519511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-73cc2faf-97de-4611-a772-8d11c9591c05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:33.521029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-73cc2faf-97de-4611-a772-8d11c9591c05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:33.568626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73cc2faf-97de-4611-a772-8d11c9591c05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:33.571288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73cc2faf-97de-4611-a772-8d11c9591c05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:33.572433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73cc2faf-97de-4611-a772-8d11c9591c05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:33.581607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73cc2faf-97de-4611-a772-8d11c9591c05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:33.584121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73cc2faf-97de-4611-a772-8d11c9591c05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:33.584895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73cc2faf-97de-4611-a772-8d11c9591c05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:33.897116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4c54a0cc-784a-4862-9252-7cd153ed4f94 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:33.916841 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4c54a0cc-784a-4862-9252-7cd153ed4f94 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 1.717384 Aug 09 17:32:33.917437 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2051/4325] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:32 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:34.011794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-73cc2faf-97de-4611-a772-8d11c9591c05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:34.032832 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-73cc2faf-97de-4611-a772-8d11c9591c05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1329 microversion: 2.1 time: 0.521345 Aug 09 17:32:34.034334 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2275/4326] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:33 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1329 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:34.222469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b0031a1e-9476-4b33-a85f-d095d8c368a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:34.225326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b0031a1e-9476-4b33-a85f-d095d8c368a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:34.248135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0031a1e-9476-4b33-a85f-d095d8c368a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:34.248896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0031a1e-9476-4b33-a85f-d095d8c368a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:34.249553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0031a1e-9476-4b33-a85f-d095d8c368a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:34.250739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0031a1e-9476-4b33-a85f-d095d8c368a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:34.251385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0031a1e-9476-4b33-a85f-d095d8c368a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:34.253138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0031a1e-9476-4b33-a85f-d095d8c368a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:34.892610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b0031a1e-9476-4b33-a85f-d095d8c368a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:34.919180 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b0031a1e-9476-4b33-a85f-d095d8c368a7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1671 microversion: 2.1 time: 0.698894 Aug 09 17:32:34.939277 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2052/4327] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:34 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1671 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:32:34.959408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-73488ef2-d319-4b31-af6b-ce8b8e378815 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:34.963199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-73488ef2-d319-4b31-af6b-ce8b8e378815 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:34.993719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73488ef2-d319-4b31-af6b-ce8b8e378815 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:34.995514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73488ef2-d319-4b31-af6b-ce8b8e378815 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:35.000824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73488ef2-d319-4b31-af6b-ce8b8e378815 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:35.003038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73488ef2-d319-4b31-af6b-ce8b8e378815 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:35.007948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73488ef2-d319-4b31-af6b-ce8b8e378815 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:35.008990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73488ef2-d319-4b31-af6b-ce8b8e378815 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:35.070923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6297c85f-2fa6-48b6-8f32-ab77c223de4d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:35.075075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6297c85f-2fa6-48b6-8f32-ab77c223de4d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:35.113302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6297c85f-2fa6-48b6-8f32-ab77c223de4d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:35.116793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6297c85f-2fa6-48b6-8f32-ab77c223de4d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:35.119528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6297c85f-2fa6-48b6-8f32-ab77c223de4d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:35.124039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6297c85f-2fa6-48b6-8f32-ab77c223de4d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:35.126289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6297c85f-2fa6-48b6-8f32-ab77c223de4d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:35.127334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6297c85f-2fa6-48b6-8f32-ab77c223de4d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:35.552534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6297c85f-2fa6-48b6-8f32-ab77c223de4d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:35.568156 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6297c85f-2fa6-48b6-8f32-ab77c223de4d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1329 microversion: 2.1 time: 0.513633 Aug 09 17:32:35.568767 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2053/4328] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:35 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1329 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:32:35.772557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-73488ef2-d319-4b31-af6b-ce8b8e378815 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:35.791039 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-73488ef2-d319-4b31-af6b-ce8b8e378815 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1525 microversion: 2.1 time: 0.837750 Aug 09 17:32:35.811666 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2276/4329] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:34 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1525 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:35.960546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-67e594a8-3932-431c-9bcb-5ffde4b20c8c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:35.962091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-67e594a8-3932-431c-9bcb-5ffde4b20c8c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:35.969728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67e594a8-3932-431c-9bcb-5ffde4b20c8c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:35.970503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67e594a8-3932-431c-9bcb-5ffde4b20c8c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:35.971451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67e594a8-3932-431c-9bcb-5ffde4b20c8c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:35.972623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67e594a8-3932-431c-9bcb-5ffde4b20c8c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:35.973591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67e594a8-3932-431c-9bcb-5ffde4b20c8c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:35.974229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67e594a8-3932-431c-9bcb-5ffde4b20c8c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:36.109653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-06c4934b-5a3f-45f3-97a0-5039fe78151e req-83a20453-fc1b-4424-8815-47e4dc150248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46111bd-a4d2-4c54-8f11-ba106b20a1fb", "name": "network-vif-plugged", "status": "completed", "tag": "a611918f-51f5-4354-9230-c5b27a1255a9"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:36.156907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-06c4934b-5a3f-45f3-97a0-5039fe78151e req-83a20453-fc1b-4424-8815-47e4dc150248 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:36.159086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-06c4934b-5a3f-45f3-97a0-5039fe78151e req-83a20453-fc1b-4424-8815-47e4dc150248 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:36.162224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-06c4934b-5a3f-45f3-97a0-5039fe78151e req-83a20453-fc1b-4424-8815-47e4dc150248 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:36.231220 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-06c4934b-5a3f-45f3-97a0-5039fe78151e req-83a20453-fc1b-4424-8815-47e4dc150248 service nova] Creating event network-vif-plugged:a611918f-51f5-4354-9230-c5b27a1255a9 for instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb on n-h1-845781-6 Aug 09 17:32:36.253697 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-06c4934b-5a3f-45f3-97a0-5039fe78151e req-83a20453-fc1b-4424-8815-47e4dc150248 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145499 Aug 09 17:32:36.283139 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2277/4330] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:32:36.452038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-67e594a8-3932-431c-9bcb-5ffde4b20c8c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:36.480644 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-67e594a8-3932-431c-9bcb-5ffde4b20c8c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1676 microversion: 2.1 time: 0.524271 Aug 09 17:32:36.482825 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2054/4331] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:35 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1676 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:32:36.610986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1c6ac3cc-1cfc-4adf-be41-f7e3c407440b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:36.611978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1c6ac3cc-1cfc-4adf-be41-f7e3c407440b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:36.632086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6ac3cc-1cfc-4adf-be41-f7e3c407440b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:36.635314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6ac3cc-1cfc-4adf-be41-f7e3c407440b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:36.636980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6ac3cc-1cfc-4adf-be41-f7e3c407440b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:36.640652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6ac3cc-1cfc-4adf-be41-f7e3c407440b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:36.642950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6ac3cc-1cfc-4adf-be41-f7e3c407440b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:36.643586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c6ac3cc-1cfc-4adf-be41-f7e3c407440b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:36.835262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3905d89b-27aa-4eb8-b4a0-0f8aa8ab4f03 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:36.836178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3905d89b-27aa-4eb8-b4a0-0f8aa8ab4f03 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:36.872288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3905d89b-27aa-4eb8-b4a0-0f8aa8ab4f03 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:36.873208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3905d89b-27aa-4eb8-b4a0-0f8aa8ab4f03 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:36.873919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3905d89b-27aa-4eb8-b4a0-0f8aa8ab4f03 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:36.875095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3905d89b-27aa-4eb8-b4a0-0f8aa8ab4f03 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:36.875904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3905d89b-27aa-4eb8-b4a0-0f8aa8ab4f03 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:36.876835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3905d89b-27aa-4eb8-b4a0-0f8aa8ab4f03 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:37.599193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3905d89b-27aa-4eb8-b4a0-0f8aa8ab4f03 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:37.613049 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3905d89b-27aa-4eb8-b4a0-0f8aa8ab4f03 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1505 microversion: 2.1 time: 0.783601 Aug 09 17:32:37.635793 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2055/4332] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:36 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1505 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:32:37.648718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1675625354", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "158ab069-df0e-4ea7-960d-e1d962492b4f"}, {"port": "08d0cf84-a616-4f63-b18f-3820a0a3de7d", "tag": "port-1"}, {"port": "a3fc9a19-60ae-4faa-aa63-64fdb0f45a85", "tag": "port-2"}, {"uuid": "a8f0bd89-b536-4922-a0ea-6f644b473711", "tag": "net-1"}, {"uuid": "a8f0bd89-b536-4922-a0ea-6f644b473711"}, {"uuid": "f44f6d76-4311-4461-8a23-4489b072699e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f44f6d76-4311-4461-8a23-4489b072699e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "521f3cc4-d339-48e1-90d0-c2e8b0e1d24d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "717fd7a0-1be4-49d9-918c-3ee573dc5f4b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a6167f3e-c710-402c-966a-fd4425521167", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1616330713"}], "key_name": "tempest-keypair-928410858", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:37.731003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1c6ac3cc-1cfc-4adf-be41-f7e3c407440b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:37.740972 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1c6ac3cc-1cfc-4adf-be41-f7e3c407440b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1329 microversion: 2.1 time: 1.138145 Aug 09 17:32:37.751833 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2278/4333] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:36 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1329 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:37.773820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d938e2fd-e294-4877-a287-b990f1137b0d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:37.776094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d938e2fd-e294-4877-a287-b990f1137b0d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:37.797967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d938e2fd-e294-4877-a287-b990f1137b0d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:37.800696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d938e2fd-e294-4877-a287-b990f1137b0d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:37.804049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d938e2fd-e294-4877-a287-b990f1137b0d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:37.804981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d938e2fd-e294-4877-a287-b990f1137b0d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:37.806471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d938e2fd-e294-4877-a287-b990f1137b0d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:37.807493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d938e2fd-e294-4877-a287-b990f1137b0d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:38.049810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] validate_networks() for [('158ab069-df0e-4ea7-960d-e1d962492b4f', None, None, None, None, None), (None, None, '08d0cf84-a616-4f63-b18f-3820a0a3de7d', None, None, None), (None, None, 'a3fc9a19-60ae-4faa-aa63-64fdb0f45a85', None, None, None), ('a8f0bd89-b536-4922-a0ea-6f644b473711', None, None, None, None, None), ('a8f0bd89-b536-4922-a0ea-6f644b473711', None, None, None, None, None), ('f44f6d76-4311-4461-8a23-4489b072699e', '10.2.2.100', None, None, None, None), ('f44f6d76-4311-4461-8a23-4489b072699e', '10.2.2.200', None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:32:38.133971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d938e2fd-e294-4877-a287-b990f1137b0d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:38.143413 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d938e2fd-e294-4877-a287-b990f1137b0d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.389746 Aug 09 17:32:38.144140 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2279/4334] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:37 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:38.173865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4ea60b38-55bc-4ee7-b646-22bf2b8bf659 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Action: 'create', calling method: .version_select at 0x7fbbca549a60>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1323654446", "description": "tempest-description-550715476"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:38.474679 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4ea60b38-55bc-4ee7-b646-22bf2b8bf659 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.329269 Aug 09 17:32:38.475247 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2280/4335] 10.222.0.93 () {60 vars in 1180 bytes} [Tue Aug 9 17:32:38 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:38.481048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bbe2dc9d-94a4-44cc-818f-b0c33dbb7574 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:38.487401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bbe2dc9d-94a4-44cc-818f-b0c33dbb7574 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:38.508103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe2dc9d-94a4-44cc-818f-b0c33dbb7574 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:38.509061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe2dc9d-94a4-44cc-818f-b0c33dbb7574 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:38.509703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe2dc9d-94a4-44cc-818f-b0c33dbb7574 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:38.511304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe2dc9d-94a4-44cc-818f-b0c33dbb7574 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:38.512171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe2dc9d-94a4-44cc-818f-b0c33dbb7574 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:38.512977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe2dc9d-94a4-44cc-818f-b0c33dbb7574 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:38.573932 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bbe2dc9d-94a4-44cc-818f-b0c33dbb7574 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 200 len: 322 microversion: 2.1 time: 0.096495 Aug 09 17:32:38.575110 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2281/4336] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:32:38 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 322 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:38.588344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e15e580-99b8-4ab4-9c5a-0af091a1165a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1323654446"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:38.589447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6e15e580-99b8-4ab4-9c5a-0af091a1165a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:38.610945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e15e580-99b8-4ab4-9c5a-0af091a1165a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:38.611891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e15e580-99b8-4ab4-9c5a-0af091a1165a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:38.613227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e15e580-99b8-4ab4-9c5a-0af091a1165a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:38.614868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e15e580-99b8-4ab4-9c5a-0af091a1165a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:38.616485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e15e580-99b8-4ab4-9c5a-0af091a1165a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:38.617120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e15e580-99b8-4ab4-9c5a-0af091a1165a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:38.876036 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.network.security_group_api [None req-6e15e580-99b8-4ab4-9c5a-0af091a1165a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Adding security group f0ea9c48-af20-4414-aad8-41d7b85c553e to port 59727f0b-da0d-46c9-9440-bb09cce8aed8 Aug 09 17:32:39.676833 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e15e580-99b8-4ab4-9c5a-0af091a1165a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "POST /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514/action" status: 202 len: 0 microversion: 2.1 time: 1.099605 Aug 09 17:32:39.678950 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2282/4337] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:32:38 2022] POST /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514/action => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:32:39.685311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3a8082b-40d6-41fb-9f9a-d263b815377c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:39.685729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3a8082b-40d6-41fb-9f9a-d263b815377c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:39.697530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a8082b-40d6-41fb-9f9a-d263b815377c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:39.699198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a8082b-40d6-41fb-9f9a-d263b815377c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:39.700229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a8082b-40d6-41fb-9f9a-d263b815377c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:39.702934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a8082b-40d6-41fb-9f9a-d263b815377c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:39.703718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a8082b-40d6-41fb-9f9a-d263b815377c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:39.704423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a8082b-40d6-41fb-9f9a-d263b815377c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:40.111810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e3a8082b-40d6-41fb-9f9a-d263b815377c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:40.152321 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3a8082b-40d6-41fb-9f9a-d263b815377c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.471799 Aug 09 17:32:40.165115 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2283/4338] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:39 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:40.202965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-261403d6-f9c4-4fc1-a610-8a9914351503 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:40.209398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-261403d6-f9c4-4fc1-a610-8a9914351503 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:40.228361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261403d6-f9c4-4fc1-a610-8a9914351503 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:40.229746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261403d6-f9c4-4fc1-a610-8a9914351503 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:40.230422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261403d6-f9c4-4fc1-a610-8a9914351503 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:40.231764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261403d6-f9c4-4fc1-a610-8a9914351503 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:40.236551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261403d6-f9c4-4fc1-a610-8a9914351503 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:40.237456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261403d6-f9c4-4fc1-a610-8a9914351503 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:40.457210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:40.601731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-261403d6-f9c4-4fc1-a610-8a9914351503 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:40.613303 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-261403d6-f9c4-4fc1-a610-8a9914351503 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1509 microversion: 2.1 time: 0.447936 Aug 09 17:32:40.614938 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2284/4339] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:40 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1509 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:40.620100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:40.620607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:40.627612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:40.628585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:40.629038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:40.629915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:40.630390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:40.630833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:40.651617 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d HTTP/1.1 Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'fab40c63-640b-40d0-8845-8026b0b71e5d'} Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:32:40.653553 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:32:40.658179 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:40.658179 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:40.658179 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:40.658179 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:40.658179 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:40.658179 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:40.658179 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:40.658179 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:32:40.658179 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:32:40.658179 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:40.658179 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:40.661050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:32:40.662158 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f93f388e-7310-4b00-b616-91bcb4556534 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 404 len: 111 microversion: 2.1 time: 0.046542 Aug 09 17:32:40.662902 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2285/4340] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:32:40 2022] DELETE /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:32:40.673666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8bf3aec4-a508-47ee-a037-db751f993d82 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1323654446"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:40.674568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8bf3aec4-a508-47ee-a037-db751f993d82 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:40.683978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf3aec4-a508-47ee-a037-db751f993d82 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:40.684754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf3aec4-a508-47ee-a037-db751f993d82 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:40.685622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf3aec4-a508-47ee-a037-db751f993d82 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:40.686563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf3aec4-a508-47ee-a037-db751f993d82 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:40.687720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf3aec4-a508-47ee-a037-db751f993d82 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:40.688461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf3aec4-a508-47ee-a037-db751f993d82 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:41.005731 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.network.security_group_api [None req-8bf3aec4-a508-47ee-a037-db751f993d82 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Removing security group f0ea9c48-af20-4414-aad8-41d7b85c553e from port 59727f0b-da0d-46c9-9440-bb09cce8aed8 Aug 09 17:32:42.132730 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8bf3aec4-a508-47ee-a037-db751f993d82 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "POST /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514/action" status: 202 len: 0 microversion: 2.1 time: 1.467947 Aug 09 17:32:42.134243 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2286/4341] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:32:40 2022] POST /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514/action => generated 0 bytes in 1470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:32:42.148337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-490ed5f1-2dd9-4e62-9886-0d81764992a2 req-44934abe-39a2-4a1b-b50c-1dcf3b325126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72ddf4a-4d41-4db4-8230-1962c7c3d514", "tag": "59727f0b-da0d-46c9-9440-bb09cce8aed8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:42.205404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-490ed5f1-2dd9-4e62-9886-0d81764992a2 req-44934abe-39a2-4a1b-b50c-1dcf3b325126 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:42.206981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-490ed5f1-2dd9-4e62-9886-0d81764992a2 req-44934abe-39a2-4a1b-b50c-1dcf3b325126 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:42.207995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-490ed5f1-2dd9-4e62-9886-0d81764992a2 req-44934abe-39a2-4a1b-b50c-1dcf3b325126 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:42.277951 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-490ed5f1-2dd9-4e62-9886-0d81764992a2 req-44934abe-39a2-4a1b-b50c-1dcf3b325126 service nova] Creating event network-changed:59727f0b-da0d-46c9-9440-bb09cce8aed8 for instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 on n-h2-845781-6 Aug 09 17:32:42.304715 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-490ed5f1-2dd9-4e62-9886-0d81764992a2 req-44934abe-39a2-4a1b-b50c-1dcf3b325126 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162799 Aug 09 17:32:42.306750 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2287/4342] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:42.333718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67a0da87-7de4-48b8-89d3-e3bd61d71367 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:42.342445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-67a0da87-7de4-48b8-89d3-e3bd61d71367 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:42.359170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67a0da87-7de4-48b8-89d3-e3bd61d71367 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:42.360176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67a0da87-7de4-48b8-89d3-e3bd61d71367 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:42.361889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67a0da87-7de4-48b8-89d3-e3bd61d71367 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:42.366884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67a0da87-7de4-48b8-89d3-e3bd61d71367 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:42.368077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67a0da87-7de4-48b8-89d3-e3bd61d71367 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:42.373954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67a0da87-7de4-48b8-89d3-e3bd61d71367 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:42.753036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-67a0da87-7de4-48b8-89d3-e3bd61d71367 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:42.775044 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-67a0da87-7de4-48b8-89d3-e3bd61d71367 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.463237 Aug 09 17:32:42.776154 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2288/4343] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:42 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:42.783540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6ace0a1-8ad8-4d6e-b92f-37eb207f9b69 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:42.784279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b6ace0a1-8ad8-4d6e-b92f-37eb207f9b69 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:42.804027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6ace0a1-8ad8-4d6e-b92f-37eb207f9b69 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:42.804687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6ace0a1-8ad8-4d6e-b92f-37eb207f9b69 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:42.805154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6ace0a1-8ad8-4d6e-b92f-37eb207f9b69 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:42.805931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6ace0a1-8ad8-4d6e-b92f-37eb207f9b69 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:42.806446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6ace0a1-8ad8-4d6e-b92f-37eb207f9b69 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:42.807007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6ace0a1-8ad8-4d6e-b92f-37eb207f9b69 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:43.095992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b6ace0a1-8ad8-4d6e-b92f-37eb207f9b69 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:43.115459 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6ace0a1-8ad8-4d6e-b92f-37eb207f9b69 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1509 microversion: 2.1 time: 0.331397 Aug 09 17:32:43.118454 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2289/4344] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:42 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1509 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:43.128831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:43.135847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: fab40c63-640b-40d0-8845-8026b0b71e5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:43.144083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:43.144675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:43.145748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:43.146696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:43.147246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:43.147770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:43.169292 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d HTTP/1.1 Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'fab40c63-640b-40d0-8845-8026b0b71e5d'} Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:43.172114 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:43.177143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:43.177143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:43.177143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:43.177143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:32:43.177143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:32:43.177143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. Aug 09 17:32:43.177143 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:32:43.179796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance fab40c63-640b-40d0-8845-8026b0b71e5d could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:32:43.180947 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5071631d-b9e6-4eac-bc62-35403f6d13a8 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d" status: 404 len: 111 microversion: 2.1 time: 0.060594 Aug 09 17:32:43.182124 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2290/4345] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:43 2022] GET /compute/v2.1/servers/fab40c63-640b-40d0-8845-8026b0b71e5d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:32:43.192633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-39cab4f0-d5c7-4020-8425-5bfc8ef998e9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Action: 'create', calling method: .version_select at 0x7fbbca5271f0>, body: {"pool": null} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:47.613273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:47.708741 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-39cab4f0-d5c7-4020-8425-5bfc8ef998e9 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.523908 Aug 09 17:32:47.723837 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2291/4346] 10.222.0.93 () {60 vars in 1170 bytes} [Tue Aug 9 17:32:43 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:47.789596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:32:47.793966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:32:47.795157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:32:47.796087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:32:47.796920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:32:47.820594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:47.821421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:47.822193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:47.823772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:47.824612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:47.825369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:47.893420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Getting quotas for project ffe16f946c5b4a3dbc82f2f66a74fbe6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:32:47.906066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Getting quotas for user 480979aea5644fc5bb060c893b0b5b05 and project ffe16f946c5b4a3dbc82f2f66a74fbe6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:32:48.407979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9e548ec7-1eea-438b-9150-cc183651726e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:48.408486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:32:48.408602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9e548ec7-1eea-438b-9150-cc183651726e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:48.414967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='521f3cc4-d339-48e1-90d0-c2e8b0e1d24d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='717fd7a0-1be4-49d9-918c-3ee573dc5f4b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6167f3e-c710-402c-966a-fd4425521167',volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:32:48.417757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e548ec7-1eea-438b-9150-cc183651726e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:48.421072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e548ec7-1eea-438b-9150-cc183651726e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:48.424394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e548ec7-1eea-438b-9150-cc183651726e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:48.425473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e548ec7-1eea-438b-9150-cc183651726e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:48.426210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e548ec7-1eea-438b-9150-cc183651726e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:48.429431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e548ec7-1eea-438b-9150-cc183651726e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:48.475667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:48.743866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9e548ec7-1eea-438b-9150-cc183651726e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:48.755217 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9e548ec7-1eea-438b-9150-cc183651726e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.017437 Aug 09 17:32:48.760196 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2292/4347] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:47 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:48.786953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3d04cae-9326-465e-a63f-fd86443b50b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:48.791976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3d04cae-9326-465e-a63f-fd86443b50b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:48.845376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3d04cae-9326-465e-a63f-fd86443b50b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:48.846315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3d04cae-9326-465e-a63f-fd86443b50b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:48.846933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3d04cae-9326-465e-a63f-fd86443b50b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:48.853202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3d04cae-9326-465e-a63f-fd86443b50b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:48.862441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3d04cae-9326-465e-a63f-fd86443b50b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:48.866313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3d04cae-9326-465e-a63f-fd86443b50b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:48.934196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3d04cae-9326-465e-a63f-fd86443b50b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:32:49.115569 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3d04cae-9326-465e-a63f-fd86443b50b9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 204 len: 0 microversion: 2.1 time: 0.351545 Aug 09 17:32:49.120686 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2293/4348] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:32:48 2022] DELETE /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:32:49.133213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f931e5d5-56b7-4d36-9801-a63f0200b30b req-18ccf6c2-ce79-4b50-8921-f7d1d25dd6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72ddf4a-4d41-4db4-8230-1962c7c3d514", "tag": "59727f0b-da0d-46c9-9440-bb09cce8aed8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:49.155299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f931e5d5-56b7-4d36-9801-a63f0200b30b req-18ccf6c2-ce79-4b50-8921-f7d1d25dd6ef service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:49.155761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f931e5d5-56b7-4d36-9801-a63f0200b30b req-18ccf6c2-ce79-4b50-8921-f7d1d25dd6ef service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:49.156395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f931e5d5-56b7-4d36-9801-a63f0200b30b req-18ccf6c2-ce79-4b50-8921-f7d1d25dd6ef service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:49.174453 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f931e5d5-56b7-4d36-9801-a63f0200b30b req-18ccf6c2-ce79-4b50-8921-f7d1d25dd6ef service nova] Creating event network-changed:59727f0b-da0d-46c9-9440-bb09cce8aed8 for instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 on n-h2-845781-6 Aug 09 17:32:49.181666 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f931e5d5-56b7-4d36-9801-a63f0200b30b req-18ccf6c2-ce79-4b50-8921-f7d1d25dd6ef service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057093 Aug 09 17:32:49.182876 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2294/4349] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:49.189107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.66"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:49.193736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:49.200528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:49.202975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:49.203755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:49.204460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:49.205586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:49.206328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:49.206940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:49.282464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "refresh_cache-a72ddf4a-4d41-4db4-8230-1962c7c3d514" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:32:49.305765 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a6a43715-cfef-4b46-abd0-76ccd226cd2a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 11.665088 Aug 09 17:32:49.318881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquired lock "refresh_cache-a72ddf4a-4d41-4db4-8230-1962c7c3d514" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:32:49.321266 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2056/4350] 10.222.0.93 () {62 vars in 1189 bytes} [Tue Aug 9 17:32:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 11686 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:32:49.336925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aba70800-6ca5-42bf-9be9-9bcdd58ae88d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:49.346707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-aba70800-6ca5-42bf-9be9-9bcdd58ae88d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:49.370004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aba70800-6ca5-42bf-9be9-9bcdd58ae88d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:49.370876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aba70800-6ca5-42bf-9be9-9bcdd58ae88d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:49.371573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aba70800-6ca5-42bf-9be9-9bcdd58ae88d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:49.372595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aba70800-6ca5-42bf-9be9-9bcdd58ae88d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:49.373245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aba70800-6ca5-42bf-9be9-9bcdd58ae88d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:49.373877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aba70800-6ca5-42bf-9be9-9bcdd58ae88d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:49.887137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-aba70800-6ca5-42bf-9be9-9bcdd58ae88d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:49.901710 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aba70800-6ca5-42bf-9be9-9bcdd58ae88d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.577780 Aug 09 17:32:49.916652 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2057/4351] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:49 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:49.934187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:49.935617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:49.945119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:49.947171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:49.948038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:49.949029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:49.949718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:49.950593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:49.972458 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 HTTP/1.1 Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'e76b7ec8-ebd0-4b60-b546-a0b6a5f52900'} Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:32:49.975161 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:32:49.980680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:32:49.980680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:49.980680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:49.980680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:49.980680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:49.980680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:49.980680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:49.980680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:32:49.980680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:32:49.980680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:32:49.980680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:49.985015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:32:49.986511 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b4e252e5-43bb-4a4f-b39f-3f196fe5513b tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 404 len: 111 microversion: 2.1 time: 0.068342 Aug 09 17:32:49.991891 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2058/4352] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:32:49 2022] DELETE /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:32:49.998500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9285d3ce-6131-402f-966e-206e44f23a2a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:49.999901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9285d3ce-6131-402f-966e-206e44f23a2a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:50.010045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9285d3ce-6131-402f-966e-206e44f23a2a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:50.010984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9285d3ce-6131-402f-966e-206e44f23a2a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:50.012008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9285d3ce-6131-402f-966e-206e44f23a2a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:50.013002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9285d3ce-6131-402f-966e-206e44f23a2a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:50.015409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9285d3ce-6131-402f-966e-206e44f23a2a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:50.016441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9285d3ce-6131-402f-966e-206e44f23a2a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:50.535016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9285d3ce-6131-402f-966e-206e44f23a2a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:50.544916 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9285d3ce-6131-402f-966e-206e44f23a2a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1515 microversion: 2.1 time: 0.550464 Aug 09 17:32:50.549518 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2059/4353] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:49 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1515 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:50.564927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-38d515f0-7619-47c7-9252-49349c3f9de2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:50.566111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-38d515f0-7619-47c7-9252-49349c3f9de2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:50.879220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-38d515f0-7619-47c7-9252-49349c3f9de2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:50.890117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-38d515f0-7619-47c7-9252-49349c3f9de2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:50.896525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-38d515f0-7619-47c7-9252-49349c3f9de2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:50.898142 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-38d515f0-7619-47c7-9252-49349c3f9de2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1285 microversion: 2.32 time: 0.347168 Aug 09 17:32:50.903577 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2060/4354] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:32:50 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:32:50.922951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:50.926763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: e76b7ec8-ebd0-4b60-b546-a0b6a5f52900] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:50.951119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:50.954488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:50.959208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:50.964711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:50.965648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:50.966106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:51.012376 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 HTTP/1.1 Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'e76b7ec8-ebd0-4b60-b546-a0b6a5f52900'} Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:51.014180 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:51.018490 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:51.018490 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:51.018490 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:51.018490 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:32:51.018490 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:32:51.018490 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. Aug 09 17:32:51.018490 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:51.018490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:32:51.018490 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-457e22c6-1221-476f-a2fd-8173b929e2e6 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900" status: 404 len: 111 microversion: 2.1 time: 0.108522 Aug 09 17:32:51.020757 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2061/4355] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:50 2022] GET /compute/v2.1/servers/e76b7ec8-ebd0-4b60-b546-a0b6a5f52900 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:32:51.034392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-423022228", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "57c98899-0caf-4592-be88-405da8266825"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:51.130100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] validate_networks() for [('57c98899-0caf-4592-be88-405da8266825', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:32:52.682887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:32:52.682887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:32:52.682887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:32:52.682887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:32:52.682887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:32:52.682887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:32:52.702474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:52.705845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:52.706321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:52.707758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:52.724436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:52.724897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:52.739110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Building network info cache for instance {{(pid=119431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 17:32:52.793394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:32:52.821614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for user 62572816b806440aa8338fea1d0a297e and project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:32:52.901181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:32:52.904119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:32:53.128755 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9dc33273-9548-4bad-8e32-8a5e30905b77 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.106620 Aug 09 17:32:53.130740 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2062/4356] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:32:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:32:53.147273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:53.154854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:53.199544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:53.200488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:53.201392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:53.202716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:53.204813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:53.206988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:53.248076 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e HTTP/1.1 Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '68d735cc-f758-4a9a-aff1-4831ccbeaf3e'} Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:32:53.256744 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:32:53.260505 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:32:53.260505 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:53.260505 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:53.260505 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:53.260505 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:53.260505 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:53.260505 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:53.260505 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:32:53.260505 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:32:53.260505 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:32:53.260505 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:53.262842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:32:53.265860 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2c2aa49b-f67c-4046-add2-10187304832e tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 404 len: 111 microversion: 2.1 time: 0.133620 Aug 09 17:32:53.277635 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2063/4357] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:32:53 2022] DELETE /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:32:53.283222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:53.285444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:53.292977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:53.293829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:53.294485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:53.295684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:53.296242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:53.296793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:53.361339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:53.362054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:53.362748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:53.364014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lazy-loading 'fault' on Instance uuid f46111bd-a4d2-4c54-8f11-ba106b20a1fb {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:32:53.495214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:53.506601 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-33f80209-6f97-4bcf-b993-a057f92f9de9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 200 len: 1319 microversion: 2.1 time: 0.227479 Aug 09 17:32:53.513619 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2064/4358] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:53 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:53.519304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:53.520485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:53.532374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:53.542062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:53.545445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:53.549894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:53.550633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:53.551409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:54.108771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:54.152753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:54.163642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:54.171108 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ebb56e3b-f392-4124-9b84-d94b585e05f5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1593 microversion: 2.32 time: 0.654255 Aug 09 17:32:54.175316 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2065/4359] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:32:53 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1593 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:32:54.204301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-529cfd17-72a2-42c8-83df-8abf006f572e req-3f18e7be-17b7-4d17-9f29-614956ee9f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46111bd-a4d2-4c54-8f11-ba106b20a1fb", "name": "network-vif-deleted", "tag": "a611918f-51f5-4354-9230-c5b27a1255a9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:54.276211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-529cfd17-72a2-42c8-83df-8abf006f572e req-3f18e7be-17b7-4d17-9f29-614956ee9f05 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:54.276836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-529cfd17-72a2-42c8-83df-8abf006f572e req-3f18e7be-17b7-4d17-9f29-614956ee9f05 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:54.277455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-529cfd17-72a2-42c8-83df-8abf006f572e req-3f18e7be-17b7-4d17-9f29-614956ee9f05 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:54.302595 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-529cfd17-72a2-42c8-83df-8abf006f572e req-3f18e7be-17b7-4d17-9f29-614956ee9f05 service nova] Creating event network-vif-deleted:a611918f-51f5-4354-9230-c5b27a1255a9 for instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb on n-h1-845781-6 Aug 09 17:32:54.312950 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-529cfd17-72a2-42c8-83df-8abf006f572e req-3f18e7be-17b7-4d17-9f29-614956ee9f05 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132288 Aug 09 17:32:54.313825 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2066/4360] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:54.322660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a7a12642-35a5-4ea1-a690-120edb5ade46 req-b77b6fbc-9af1-41c0-8b0a-a4104148e550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72ddf4a-4d41-4db4-8230-1962c7c3d514", "tag": "59727f0b-da0d-46c9-9440-bb09cce8aed8"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:54.360583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a7a12642-35a5-4ea1-a690-120edb5ade46 req-b77b6fbc-9af1-41c0-8b0a-a4104148e550 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:54.361366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a7a12642-35a5-4ea1-a690-120edb5ade46 req-b77b6fbc-9af1-41c0-8b0a-a4104148e550 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:54.361981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a7a12642-35a5-4ea1-a690-120edb5ade46 req-b77b6fbc-9af1-41c0-8b0a-a4104148e550 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:54.389070 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a7a12642-35a5-4ea1-a690-120edb5ade46 req-b77b6fbc-9af1-41c0-8b0a-a4104148e550 service nova] Creating event network-changed:59727f0b-da0d-46c9-9440-bb09cce8aed8 for instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 on n-h2-845781-6 Aug 09 17:32:54.395908 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a7a12642-35a5-4ea1-a690-120edb5ade46 req-b77b6fbc-9af1-41c0-8b0a-a4104148e550 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076843 Aug 09 17:32:54.397668 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2067/4361] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:32:54.412883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2248a81f-628f-45a0-a147-ad9fae6f7283 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:54.413618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2248a81f-628f-45a0-a147-ad9fae6f7283 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:54.837725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2248a81f-628f-45a0-a147-ad9fae6f7283 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:54.874458 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2248a81f-628f-45a0-a147-ad9fae6f7283 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1214 microversion: 2.1 time: 0.467316 Aug 09 17:32:54.883712 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2068/4362] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:54 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1214 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:32:54.923384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:54.924636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 68d735cc-f758-4a9a-aff1-4831ccbeaf3e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:54.948724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:54.957096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:54.958966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:54.963836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:54.966217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:54.968081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:55.029459 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e HTTP/1.1 Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '68d735cc-f758-4a9a-aff1-4831ccbeaf3e'} Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:55.033948 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:55.040211 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:55.040211 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:55.040211 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:55.040211 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:32:55.040211 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:32:55.040211 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. Aug 09 17:32:55.040211 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:55.044743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance 68d735cc-f758-4a9a-aff1-4831ccbeaf3e could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:32:55.046093 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c01804f5-da56-4b2b-9ca2-365e1456db37 tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e" status: 404 len: 111 microversion: 2.1 time: 0.160555 Aug 09 17:32:55.052103 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2069/4363] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:54 2022] GET /compute/v2.1/servers/68d735cc-f758-4a9a-aff1-4831ccbeaf3e => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:32:55.058278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:55.059200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:55.071938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:55.073757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:55.080309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:55.084803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:55.088447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:55.089770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:55.153612 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb HTTP/1.1 Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'f46111bd-a4d2-4c54-8f11-ba106b20a1fb'} Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:32:55.159858 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:55.165921 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:32:55.165921 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:32:55.165921 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:32:55.165921 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:32:55.165921 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:32:55.165921 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:32:55.165921 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:32:55.221944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:32:55.229808 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5087846e-18f6-495d-89ea-45c7a872a30e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 404 len: 111 microversion: 2.1 time: 0.177872 Aug 09 17:32:55.231266 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2070/4364] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:55 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:32:55.248808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:55.249433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:55.273946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:55.274748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:55.276465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:55.277504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:55.279249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:55.280119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:55.729714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:55.748047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:55.752145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:55.757430 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5521e03c-4f22-4a48-be14-16dd0e8c3664 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1593 microversion: 2.32 time: 0.517353 Aug 09 17:32:55.759268 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2071/4365] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:32:55 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1593 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:32:55.771860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d5308cc0-4333-48ba-bd56-34de7c1e9432 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '.version_select at 0x7fbbca6b9940>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:55.841419 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d5308cc0-4333-48ba-bd56-34de7c1e9432 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-key-1562648640" status: 202 len: 0 microversion: 2.1 time: 0.080524 Aug 09 17:32:55.855339 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2072/4366] 10.222.0.93 () {58 vars in 1209 bytes} [Tue Aug 9 17:32:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1562648640 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:32:55.899494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8c606d3f-505c-480e-8843-efba7912504a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:32:55.900153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8c606d3f-505c-480e-8843-efba7912504a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:55.925204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c606d3f-505c-480e-8843-efba7912504a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:55.925716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c606d3f-505c-480e-8843-efba7912504a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:55.929273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c606d3f-505c-480e-8843-efba7912504a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:55.929273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c606d3f-505c-480e-8843-efba7912504a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:55.929273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c606d3f-505c-480e-8843-efba7912504a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:55.929273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c606d3f-505c-480e-8843-efba7912504a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:56.266671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8c606d3f-505c-480e-8843-efba7912504a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:32:56.281092 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8c606d3f-505c-480e-8843-efba7912504a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1266 microversion: 2.1 time: 0.383903 Aug 09 17:32:56.282402 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2073/4367] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:32:55 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:32:56.313584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1160935001", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "829cb0b3-9c78-4844-8875-46f5a554f097"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:56.440903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] validate_networks() for [('829cb0b3-9c78-4844-8875-46f5a554f097', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:32:56.448863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Updating instance_info_cache with network_info: [{"id": "59727f0b-da0d-46c9-9440-bb09cce8aed8", "address": "fa:16:3e:fd:1f:af", "network": {"id": "644cad86-9d4a-4b76-9a24-42ff0b91bd51", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1626514639-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f41de2908c5a4249980712f71d2e6de4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap59727f0b-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:32:56.472714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Releasing lock "refresh_cache-a72ddf4a-4d41-4db4-8230-1962c7c3d514" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:32:56.474887 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a34a6c18-4870-4bed-8232-d94d27e2d3a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "POST /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514/action" status: 202 len: 0 microversion: 2.1 time: 7.290421 Aug 09 17:32:56.475760 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2295/4368] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:32:49 2022] POST /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514/action => generated 0 bytes in 7292 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 17:32:56.493833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.66"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:32:57.092419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:32:57.100115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:57.100620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:57.101070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:57.101811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:32:57.102274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:32:57.102707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:32:57.707100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "refresh_cache-a72ddf4a-4d41-4db4-8230-1962c7c3d514" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 17:32:57.708162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquired lock "refresh_cache-a72ddf4a-4d41-4db4-8230-1962c7c3d514" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 17:33:00.418397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:33:00.419176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:33:00.419332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:33:00.419739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:33:00.420150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:33:00.438639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:00.439155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:00.439576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:00.440371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:00.440842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:00.441274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:00.490990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:33:00.502662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for user 1d4dd578ed0640fc943af026c4363e28 and project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:33:00.536716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:33:00.539095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:33:00.673612 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0ed76b50-4ddc-4f04-af71-ede4a6b4a7a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.364532 Aug 09 17:33:00.675769 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2074/4369] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:32:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:33:00.719665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:00.725950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:00.752290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:00.753649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:00.755804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:00.757588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:00.777551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:00.784280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:00.974248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Building network info cache for instance {{(pid=119431) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 17:33:01.704176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:01.727878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:01.734479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:01.736256 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7e40c27c-f504-4000-a635-0fa45281a879 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1661 microversion: 2.32 time: 1.058056 Aug 09 17:33:01.740332 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2075/4370] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:00 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1661 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:01.767588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-631c3387-6e5f-439b-af5e-667dab743dbe tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:01.778137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-631c3387-6e5f-439b-af5e-667dab743dbe tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:01.796472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-631c3387-6e5f-439b-af5e-667dab743dbe tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:01.798236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-631c3387-6e5f-439b-af5e-667dab743dbe tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:01.799605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-631c3387-6e5f-439b-af5e-667dab743dbe tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:01.801956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-631c3387-6e5f-439b-af5e-667dab743dbe tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:01.803045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-631c3387-6e5f-439b-af5e-667dab743dbe tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:01.804334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-631c3387-6e5f-439b-af5e-667dab743dbe tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:03.424865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-631c3387-6e5f-439b-af5e-667dab743dbe tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:03.502152 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-631c3387-6e5f-439b-af5e-667dab743dbe tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1314 microversion: 2.1 time: 1.759865 Aug 09 17:33:03.511329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Updating instance_info_cache with network_info: [{"id": "59727f0b-da0d-46c9-9440-bb09cce8aed8", "address": "fa:16:3e:fd:1f:af", "network": {"id": "644cad86-9d4a-4b76-9a24-42ff0b91bd51", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1626514639-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f41de2908c5a4249980712f71d2e6de4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap59727f0b-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:33:03.534402 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2076/4371] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:01 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1314 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:03.539591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Releasing lock "refresh_cache-a72ddf4a-4d41-4db4-8230-1962c7c3d514" {{(pid=119431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 17:33:03.543951 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0b4188f1-3175-464b-8960-8c400e1270ee tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "POST /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514/action" status: 202 len: 0 microversion: 2.1 time: 7.057350 Aug 09 17:33:03.545486 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2296/4372] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:32:56 2022] POST /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514/action => generated 0 bytes in 7062 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 17:33:03.554555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6c65098e-39e8-4c51-bc38-25425655f2cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:03.554979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6c65098e-39e8-4c51-bc38-25425655f2cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:03.575842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c65098e-39e8-4c51-bc38-25425655f2cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:03.576348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c65098e-39e8-4c51-bc38-25425655f2cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:03.576801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c65098e-39e8-4c51-bc38-25425655f2cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:03.576930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-32b8d6cc-e01e-4194-8157-b94712b75d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:03.578087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-32b8d6cc-e01e-4194-8157-b94712b75d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:03.582346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c65098e-39e8-4c51-bc38-25425655f2cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:03.585158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c65098e-39e8-4c51-bc38-25425655f2cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:03.585632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c65098e-39e8-4c51-bc38-25425655f2cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:03.602626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32b8d6cc-e01e-4194-8157-b94712b75d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:03.603139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32b8d6cc-e01e-4194-8157-b94712b75d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:03.603581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32b8d6cc-e01e-4194-8157-b94712b75d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:03.604340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32b8d6cc-e01e-4194-8157-b94712b75d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:03.604985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32b8d6cc-e01e-4194-8157-b94712b75d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:03.607186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32b8d6cc-e01e-4194-8157-b94712b75d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:03.813256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-32b8d6cc-e01e-4194-8157-b94712b75d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:03.822092 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-32b8d6cc-e01e-4194-8157-b94712b75d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1267 microversion: 2.1 time: 0.271081 Aug 09 17:33:03.833082 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2297/4373] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:03 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1267 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:03.863095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2c4658e6-a221-4c63-b4c0-075ba22dd69b req-644def9a-a414-488c-ab17-19de3b326ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72ddf4a-4d41-4db4-8230-1962c7c3d514", "tag": "59727f0b-da0d-46c9-9440-bb09cce8aed8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:03.886766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-6c65098e-39e8-4c51-bc38-25425655f2cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lazy-loading 'services' on Instance uuid 034f8bad-5143-4cd6-bf2a-167ae912650e {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:33:03.908369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2c4658e6-a221-4c63-b4c0-075ba22dd69b req-644def9a-a414-488c-ab17-19de3b326ab2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:03.908889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2c4658e6-a221-4c63-b4c0-075ba22dd69b req-644def9a-a414-488c-ab17-19de3b326ab2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:03.909459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2c4658e6-a221-4c63-b4c0-075ba22dd69b req-644def9a-a414-488c-ab17-19de3b326ab2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:03.947554 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2c4658e6-a221-4c63-b4c0-075ba22dd69b req-644def9a-a414-488c-ab17-19de3b326ab2 service nova] Creating event network-changed:59727f0b-da0d-46c9-9440-bb09cce8aed8 for instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 on n-h2-845781-6 Aug 09 17:33:03.960476 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2c4658e6-a221-4c63-b4c0-075ba22dd69b req-644def9a-a414-488c-ab17-19de3b326ab2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111047 Aug 09 17:33:03.962576 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2298/4374] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:03.983538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:03.994374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:04.030528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:04.032834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:04.035252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:04.044198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:04.047157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:04.048189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:04.188720 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6c65098e-39e8-4c51-bc38-25425655f2cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "DELETE /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e/os-volume_attachments/f1c6d22c-66f2-475f-a808-ba9f98112847" status: 202 len: 0 microversion: 2.1 time: 0.645663 Aug 09 17:33:04.192186 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2077/4375] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:33:03 2022] DELETE /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e/os-volume_attachments/f1c6d22c-66f2-475f-a808-ba9f98112847 => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:33:04.231596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ffe6bac5-2818-4646-ab8c-fcb6aa8cf44a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '.version_select at 0x7fbbcb42f9d0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:05.950049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:05.970578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:05.975355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:05.979388 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e0190bc8-6340-47f4-b6c4-417bea1dee59 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1708 microversion: 2.32 time: 2.013366 Aug 09 17:33:05.981624 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2299/4376] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:03 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1708 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:05.996346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4ebc3820-57af-4730-80de-9e27df931cf3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:05.998881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4ebc3820-57af-4730-80de-9e27df931cf3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:06.013739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ebc3820-57af-4730-80de-9e27df931cf3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:06.014251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ebc3820-57af-4730-80de-9e27df931cf3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:06.014712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ebc3820-57af-4730-80de-9e27df931cf3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:06.015472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ebc3820-57af-4730-80de-9e27df931cf3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:06.022001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ebc3820-57af-4730-80de-9e27df931cf3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:06.022462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ebc3820-57af-4730-80de-9e27df931cf3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:06.673687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4ebc3820-57af-4730-80de-9e27df931cf3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:06.690026 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4ebc3820-57af-4730-80de-9e27df931cf3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1314 microversion: 2.1 time: 0.705703 Aug 09 17:33:06.690640 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2300/4377] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:05 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:06.704441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a15927a-5ecd-4b0e-bbd8-ae4c893133c6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:06.705557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a15927a-5ecd-4b0e-bbd8-ae4c893133c6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:06.721092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a15927a-5ecd-4b0e-bbd8-ae4c893133c6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:06.724051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a15927a-5ecd-4b0e-bbd8-ae4c893133c6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:06.736446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a15927a-5ecd-4b0e-bbd8-ae4c893133c6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:06.737584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a15927a-5ecd-4b0e-bbd8-ae4c893133c6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:06.738277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a15927a-5ecd-4b0e-bbd8-ae4c893133c6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:06.739507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a15927a-5ecd-4b0e-bbd8-ae4c893133c6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:06.990467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4a15927a-5ecd-4b0e-bbd8-ae4c893133c6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:07.020800 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a15927a-5ecd-4b0e-bbd8-ae4c893133c6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1267 microversion: 2.1 time: 0.325740 Aug 09 17:33:07.023510 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2301/4378] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:06 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1267 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:07.052706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:07.054447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:07.082083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:07.086758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:07.090458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:07.092579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:07.096897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:07.098832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:08.043111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:08.064972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:08.067234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:08.071293 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-042297a4-f863-425e-acaa-1b29bf8cc4da tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1708 microversion: 2.32 time: 1.043298 Aug 09 17:33:08.074809 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2302/4379] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:07 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1708 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:08.085084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1cc52a3b-c822-4273-ad1d-10d7a8df926e req-4cd07724-50d4-4de9-b3fa-cf43c4cb9196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77e3b35-0756-4bdc-8188-21fbc830de23", "tag": "63287c14-5470-4c8b-be9a-e7d403891d6a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:08.112819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1cc52a3b-c822-4273-ad1d-10d7a8df926e req-4cd07724-50d4-4de9-b3fa-cf43c4cb9196 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:08.125033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1cc52a3b-c822-4273-ad1d-10d7a8df926e req-4cd07724-50d4-4de9-b3fa-cf43c4cb9196 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:08.126707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1cc52a3b-c822-4273-ad1d-10d7a8df926e req-4cd07724-50d4-4de9-b3fa-cf43c4cb9196 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:08.180057 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1cc52a3b-c822-4273-ad1d-10d7a8df926e req-4cd07724-50d4-4de9-b3fa-cf43c4cb9196 service nova] Creating event network-changed:63287c14-5470-4c8b-be9a-e7d403891d6a for instance f77e3b35-0756-4bdc-8188-21fbc830de23 on n-h1-845781-6 Aug 09 17:33:08.207249 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1cc52a3b-c822-4273-ad1d-10d7a8df926e req-4cd07724-50d4-4de9-b3fa-cf43c4cb9196 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118680 Aug 09 17:33:08.215330 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2303/4380] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:08.224871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c089ba9-9899-4f74-8761-b94a66622922 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:08.245425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c089ba9-9899-4f74-8761-b94a66622922 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:08.271552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c089ba9-9899-4f74-8761-b94a66622922 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:08.272927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c089ba9-9899-4f74-8761-b94a66622922 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:08.273952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c089ba9-9899-4f74-8761-b94a66622922 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:08.275790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c089ba9-9899-4f74-8761-b94a66622922 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:08.277272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c089ba9-9899-4f74-8761-b94a66622922 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:08.278388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c089ba9-9899-4f74-8761-b94a66622922 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:09.159493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c089ba9-9899-4f74-8761-b94a66622922 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:09.216932 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c089ba9-9899-4f74-8761-b94a66622922 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1314 microversion: 2.1 time: 0.996348 Aug 09 17:33:09.226133 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2304/4381] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:08 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1314 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:09.264832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dff046c6-9fc5-467d-b9d3-451b764866fc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:09.284346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dff046c6-9fc5-467d-b9d3-451b764866fc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:09.321609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff046c6-9fc5-467d-b9d3-451b764866fc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:09.324597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff046c6-9fc5-467d-b9d3-451b764866fc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:09.326433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff046c6-9fc5-467d-b9d3-451b764866fc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:09.330714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff046c6-9fc5-467d-b9d3-451b764866fc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:09.331237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff046c6-9fc5-467d-b9d3-451b764866fc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:09.337100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff046c6-9fc5-467d-b9d3-451b764866fc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:10.471502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:10.531039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=22 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:11.233006 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ffe6bac5-2818-4646-ab8c-fcb6aa8cf44a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/2be06e74-0e6c-464f-92d3-0ab3025ff1ea" status: 202 len: 0 microversion: 2.1 time: 7.026177 Aug 09 17:33:11.234992 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2078/4382] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:33:04 2022] DELETE /compute/v2.1/os-floating-ips/2be06e74-0e6c-464f-92d3-0ab3025ff1ea => generated 0 bytes in 7031 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:33:11.276343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:11.278547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:11.378190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:11.379983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:11.380797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:11.382356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:11.383172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:11.392237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:11.452325 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 HTTP/1.1 Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '55b120e8-277c-49bb-83e5-1de30e80fd50'} Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:33:11.466466 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:11.485708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:33:11.492443 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-27f56f90-e581-4dae-939e-3094e41221aa tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "DELETE /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 404 len: 111 microversion: 2.1 time: 0.247442 Aug 09 17:33:11.494329 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2079/4383] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:33:11 2022] DELETE /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 111 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:33:11.515597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:11.518522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:11.539830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:11.541074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:11.542399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:11.544897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:11.546846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:11.548006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:11.810639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dff046c6-9fc5-467d-b9d3-451b764866fc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:11.849554 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dff046c6-9fc5-467d-b9d3-451b764866fc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1309 microversion: 2.1 time: 2.610794 Aug 09 17:33:11.856866 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2305/4384] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:09 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1309 bytes in 2627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:11.883455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4cc08064-d3d6-42f4-98cd-91bdbd56df3b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:11.884720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4cc08064-d3d6-42f4-98cd-91bdbd56df3b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:11.907650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cc08064-d3d6-42f4-98cd-91bdbd56df3b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:11.910124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cc08064-d3d6-42f4-98cd-91bdbd56df3b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:11.910748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cc08064-d3d6-42f4-98cd-91bdbd56df3b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:11.912282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cc08064-d3d6-42f4-98cd-91bdbd56df3b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:11.918759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cc08064-d3d6-42f4-98cd-91bdbd56df3b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:11.919368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cc08064-d3d6-42f4-98cd-91bdbd56df3b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:12.390953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:12.414914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:12.416648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:12.417901 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3da63d3f-498f-40e6-aa89-2e036f6e25c6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1755 microversion: 2.32 time: 0.921866 Aug 09 17:33:12.421309 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2080/4385] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:11 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1755 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:12.428172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ef56526d-0d84-44db-9114-2c9cbb022614 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '.version_select at 0x7fbbcbe6c160>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:13.043344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4cc08064-d3d6-42f4-98cd-91bdbd56df3b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:13.068932 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4cc08064-d3d6-42f4-98cd-91bdbd56df3b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1314 microversion: 2.1 time: 1.206717 Aug 09 17:33:13.069822 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2306/4386] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:11 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1314 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:13.090470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:13.091609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] [instance: 55b120e8-277c-49bb-83e5-1de30e80fd50] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:13.110276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:13.111571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:13.114253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:13.128965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:13.130219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:13.131279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:13.174132 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] HTTP exception thrown: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Request method failure captured: Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 HTTP/1.1 Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pfuXyxobt38VPOxBRts2tYAqblebw20upIj5aJLMhf4H-xC0y-0EpSlKHzZrcBLztnm9MPxAihrziyNo5I49jyszA-dgT3ZBnpT_XFZag0FGzO-qKLQqYexNNFZGCQiCo4XrpZqT4QnGZo6ChtKsdYW2E41qj88ql0tSZ3RwgLDapM Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a8f7b3787cde4d1fb5c8d8f8557a83ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a8f7b3787cde4d1fb5c8d8f8557a83ce Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052238546 Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: be0fad88d219437eaed454ba916c86e3 Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeNegativeTest-1052238546-project Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '55b120e8-277c-49bb-83e5-1de30e80fd50'} Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:33:13.186938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:33:13.195097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:13.195097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:33:13.195097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:33:13.195097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:33:13.195097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:33:13.195097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. Aug 09 17:33:13.195097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:33:13.197367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] Returning 404 to user: Instance 55b120e8-277c-49bb-83e5-1de30e80fd50 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:33:13.199314 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-58f51122-9b02-4f36-ab4d-06b507fa490f tempest-AttachVolumeNegativeTest-1052238546 tempest-AttachVolumeNegativeTest-1052238546-project] 10.222.0.93 "GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50" status: 404 len: 111 microversion: 2.1 time: 0.127868 Aug 09 17:33:13.200926 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2307/4387] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:13 2022] GET /compute/v2.1/servers/55b120e8-277c-49bb-83e5-1de30e80fd50 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:33:13.216399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9700e998-f6f5-4c6b-a0a5-1de6a730186d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:13.225932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9700e998-f6f5-4c6b-a0a5-1de6a730186d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:13.243128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9700e998-f6f5-4c6b-a0a5-1de6a730186d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:13.244697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9700e998-f6f5-4c6b-a0a5-1de6a730186d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:13.249102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9700e998-f6f5-4c6b-a0a5-1de6a730186d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:13.250868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9700e998-f6f5-4c6b-a0a5-1de6a730186d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:13.256319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9700e998-f6f5-4c6b-a0a5-1de6a730186d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:13.257562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9700e998-f6f5-4c6b-a0a5-1de6a730186d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:13.267836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:13.462177 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ef56526d-0d84-44db-9114-2c9cbb022614 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/f0ea9c48-af20-4414-aad8-41d7b85c553e" status: 202 len: 0 microversion: 2.1 time: 1.039092 Aug 09 17:33:13.464013 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2081/4388] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 17:33:12 2022] DELETE /compute/v2.1/os-security-groups/f0ea9c48-af20-4414-aad8-41d7b85c553e => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:33:13.477442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:13.481633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:13.510199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:13.517331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:13.522063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:13.523845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:13.526658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:13.528210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:14.321259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9700e998-f6f5-4c6b-a0a5-1de6a730186d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:14.349603 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9700e998-f6f5-4c6b-a0a5-1de6a730186d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1309 microversion: 2.1 time: 1.142248 Aug 09 17:33:14.354749 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2308/4389] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:13 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1309 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:14.372614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3d39defe-42d4-434b-96d0-db5674bb2d99 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:14.378708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3d39defe-42d4-434b-96d0-db5674bb2d99 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:14.401911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d39defe-42d4-434b-96d0-db5674bb2d99 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:14.406584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d39defe-42d4-434b-96d0-db5674bb2d99 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:14.409009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d39defe-42d4-434b-96d0-db5674bb2d99 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:14.414389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d39defe-42d4-434b-96d0-db5674bb2d99 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:14.417541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d39defe-42d4-434b-96d0-db5674bb2d99 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:14.418719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d39defe-42d4-434b-96d0-db5674bb2d99 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:14.544281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3d39defe-42d4-434b-96d0-db5674bb2d99 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:33:14.836849 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3d39defe-42d4-434b-96d0-db5674bb2d99 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 204 len: 0 microversion: 2.1 time: 0.479506 Aug 09 17:33:14.838479 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2309/4390] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:33:14 2022] DELETE /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:33:14.865041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-faf8b14d-69d7-45cc-b630-1649db5833bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:14.866746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-faf8b14d-69d7-45cc-b630-1649db5833bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:14.894446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faf8b14d-69d7-45cc-b630-1649db5833bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:14.896454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faf8b14d-69d7-45cc-b630-1649db5833bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:14.898511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faf8b14d-69d7-45cc-b630-1649db5833bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:14.900981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faf8b14d-69d7-45cc-b630-1649db5833bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:14.904950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faf8b14d-69d7-45cc-b630-1649db5833bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:14.906235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faf8b14d-69d7-45cc-b630-1649db5833bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:15.151314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:15.220401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:15.229536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:15.232426 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6223cc45-8d14-4327-b4e6-d4ce2c119828 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1755 microversion: 2.32 time: 1.766140 Aug 09 17:33:15.271300 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2082/4391] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:13 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1755 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:15.331508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-61f14a08-b864-405e-9488-fb1b146d66a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:15.334390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-61f14a08-b864-405e-9488-fb1b146d66a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:15.370431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f14a08-b864-405e-9488-fb1b146d66a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:15.371095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f14a08-b864-405e-9488-fb1b146d66a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:15.378440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f14a08-b864-405e-9488-fb1b146d66a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:15.385515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f14a08-b864-405e-9488-fb1b146d66a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:15.392020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f14a08-b864-405e-9488-fb1b146d66a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:15.392941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f14a08-b864-405e-9488-fb1b146d66a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:15.831973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-faf8b14d-69d7-45cc-b630-1649db5833bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:15.863118 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-faf8b14d-69d7-45cc-b630-1649db5833bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1314 microversion: 2.1 time: 1.017394 Aug 09 17:33:15.864299 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2310/4392] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:14 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1314 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:15.870365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-949bce80-7074-42c0-a414-289729177f38 req-b83e34f3-71c3-4d67-8653-d8e36ff60261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e555d25-10e4-4fde-8477-95fcd23c1a93", "tag": "f8011ee0-4a12-4aba-88f2-04751be38be9"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:15.900307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-949bce80-7074-42c0-a414-289729177f38 req-b83e34f3-71c3-4d67-8653-d8e36ff60261 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:15.901514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-949bce80-7074-42c0-a414-289729177f38 req-b83e34f3-71c3-4d67-8653-d8e36ff60261 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:15.903085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-949bce80-7074-42c0-a414-289729177f38 req-b83e34f3-71c3-4d67-8653-d8e36ff60261 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:15.944969 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-949bce80-7074-42c0-a414-289729177f38 req-b83e34f3-71c3-4d67-8653-d8e36ff60261 service nova] Creating event network-changed:f8011ee0-4a12-4aba-88f2-04751be38be9 for instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 on n-h1-845781-6 Aug 09 17:33:15.956921 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-949bce80-7074-42c0-a414-289729177f38 req-b83e34f3-71c3-4d67-8653-d8e36ff60261 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088323 Aug 09 17:33:15.959008 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2311/4393] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:15.972270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-96274f6b-3d19-4e85-b3cc-ec82d7809be5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:15.974025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-96274f6b-3d19-4e85-b3cc-ec82d7809be5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:15.994474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96274f6b-3d19-4e85-b3cc-ec82d7809be5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:15.995212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96274f6b-3d19-4e85-b3cc-ec82d7809be5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:15.995792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96274f6b-3d19-4e85-b3cc-ec82d7809be5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:15.996708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96274f6b-3d19-4e85-b3cc-ec82d7809be5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:15.997273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96274f6b-3d19-4e85-b3cc-ec82d7809be5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:15.997797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96274f6b-3d19-4e85-b3cc-ec82d7809be5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:16.047128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-61f14a08-b864-405e-9488-fb1b146d66a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:16.083306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:16.093981 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-61f14a08-b864-405e-9488-fb1b146d66a7 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1511 microversion: 2.1 time: 0.818552 Aug 09 17:33:16.094584 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2083/4394] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:15 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1511 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:16.280432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:16.286435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:16.297113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:16.298728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:16.299596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:16.302056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:16.303274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:16.304302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:16.658256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-96274f6b-3d19-4e85-b3cc-ec82d7809be5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:16.690376 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-96274f6b-3d19-4e85-b3cc-ec82d7809be5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1309 microversion: 2.1 time: 0.728243 Aug 09 17:33:16.693462 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2312/4395] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:15 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1309 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:16.774687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-10fb88be-a4e7-467f-9e50-ae8bc24212b6 req-9de2658d-ed3b-46e8-8f1c-563f859a1e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e3b35-0756-4bdc-8188-21fbc830de23", "name": "network-vif-plugged", "status": "completed", "tag": "63287c14-5470-4c8b-be9a-e7d403891d6a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:16.788878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-10fb88be-a4e7-467f-9e50-ae8bc24212b6 req-9de2658d-ed3b-46e8-8f1c-563f859a1e10 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:16.795214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-10fb88be-a4e7-467f-9e50-ae8bc24212b6 req-9de2658d-ed3b-46e8-8f1c-563f859a1e10 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:16.800532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-10fb88be-a4e7-467f-9e50-ae8bc24212b6 req-9de2658d-ed3b-46e8-8f1c-563f859a1e10 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:16.838618 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-10fb88be-a4e7-467f-9e50-ae8bc24212b6 req-9de2658d-ed3b-46e8-8f1c-563f859a1e10 service nova] Creating event network-vif-plugged:63287c14-5470-4c8b-be9a-e7d403891d6a for instance f77e3b35-0756-4bdc-8188-21fbc830de23 on n-h1-845781-6 Aug 09 17:33:16.862524 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-10fb88be-a4e7-467f-9e50-ae8bc24212b6 req-9de2658d-ed3b-46e8-8f1c-563f859a1e10 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098082 Aug 09 17:33:16.864754 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2313/4396] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 09 17:33:16.909061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1a2472a4-1d6d-48df-afd9-0fac2f1b4f1e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:16.911474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1a2472a4-1d6d-48df-afd9-0fac2f1b4f1e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:16.956062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a2472a4-1d6d-48df-afd9-0fac2f1b4f1e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:16.956930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a2472a4-1d6d-48df-afd9-0fac2f1b4f1e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:16.957754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a2472a4-1d6d-48df-afd9-0fac2f1b4f1e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:16.959021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a2472a4-1d6d-48df-afd9-0fac2f1b4f1e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:16.959894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a2472a4-1d6d-48df-afd9-0fac2f1b4f1e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:16.960637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a2472a4-1d6d-48df-afd9-0fac2f1b4f1e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:17.395477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:17.411511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:17.414077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:17.419130 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-62744f5a-9d85-4157-b83f-3a8b198e4a14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1802 microversion: 2.32 time: 1.143833 Aug 09 17:33:17.419914 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2084/4397] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:16 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1802 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:17.428936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-25c488e2-597f-4fae-bc82-70301f62a2e8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:17.432896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-25c488e2-597f-4fae-bc82-70301f62a2e8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:17.454018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25c488e2-597f-4fae-bc82-70301f62a2e8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:17.454990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25c488e2-597f-4fae-bc82-70301f62a2e8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:17.455724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25c488e2-597f-4fae-bc82-70301f62a2e8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:17.456817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25c488e2-597f-4fae-bc82-70301f62a2e8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:17.457567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25c488e2-597f-4fae-bc82-70301f62a2e8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:17.458257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25c488e2-597f-4fae-bc82-70301f62a2e8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:18.043055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a2472a4-1d6d-48df-afd9-0fac2f1b4f1e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:18.109669 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1a2472a4-1d6d-48df-afd9-0fac2f1b4f1e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1314 microversion: 2.1 time: 1.207182 Aug 09 17:33:18.109898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-25c488e2-597f-4fae-bc82-70301f62a2e8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:18.130548 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2314/4398] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:16 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1314 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:18.138746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d683780d-6f6e-436a-9ae9-f4e0d31dbec6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:18.142032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d683780d-6f6e-436a-9ae9-f4e0d31dbec6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:18.150724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d683780d-6f6e-436a-9ae9-f4e0d31dbec6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:18.151397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d683780d-6f6e-436a-9ae9-f4e0d31dbec6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:18.151983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d683780d-6f6e-436a-9ae9-f4e0d31dbec6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:18.152838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d683780d-6f6e-436a-9ae9-f4e0d31dbec6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:18.153426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d683780d-6f6e-436a-9ae9-f4e0d31dbec6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:18.153974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d683780d-6f6e-436a-9ae9-f4e0d31dbec6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:18.158855 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-25c488e2-597f-4fae-bc82-70301f62a2e8 tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1511 microversion: 2.1 time: 0.734994 Aug 09 17:33:18.178832 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2085/4399] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:17 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1511 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:18.463793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-09ba349c-e790-4584-baec-015a453f4ce8 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:18.464762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-09ba349c-e790-4584-baec-015a453f4ce8 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:18.474837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09ba349c-e790-4584-baec-015a453f4ce8 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:18.476703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09ba349c-e790-4584-baec-015a453f4ce8 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:18.478887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09ba349c-e790-4584-baec-015a453f4ce8 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:18.480421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09ba349c-e790-4584-baec-015a453f4ce8 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:18.481589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09ba349c-e790-4584-baec-015a453f4ce8 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:18.485438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-09ba349c-e790-4584-baec-015a453f4ce8 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:18.597126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-09ba349c-e790-4584-baec-015a453f4ce8 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:33:18.799415 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-09ba349c-e790-4584-baec-015a453f4ce8 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "DELETE /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 204 len: 0 microversion: 2.1 time: 0.339980 Aug 09 17:33:18.800314 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2086/4400] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:33:18 2022] DELETE /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:33:18.808075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:18.813394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:18.832888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:18.833743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:18.837383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:18.842179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:18.843144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:18.843934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:19.000706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d683780d-6f6e-436a-9ae9-f4e0d31dbec6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:19.038124 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d683780d-6f6e-436a-9ae9-f4e0d31dbec6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1309 microversion: 2.1 time: 0.905196 Aug 09 17:33:19.042894 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2315/4401] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:18 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1309 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:19.063147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ecabbc2b-e597-404d-a649-f6c5dbaf93f6 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:19.065773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ecabbc2b-e597-404d-a649-f6c5dbaf93f6 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:19.080520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecabbc2b-e597-404d-a649-f6c5dbaf93f6 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:19.081928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecabbc2b-e597-404d-a649-f6c5dbaf93f6 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:19.083532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecabbc2b-e597-404d-a649-f6c5dbaf93f6 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:19.085240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecabbc2b-e597-404d-a649-f6c5dbaf93f6 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:19.097565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecabbc2b-e597-404d-a649-f6c5dbaf93f6 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:19.101141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecabbc2b-e597-404d-a649-f6c5dbaf93f6 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:19.597006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:19.642696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:19.645236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:19.652434 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a715dde3-5c44-431b-ab21-232398ca11a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1802 microversion: 2.32 time: 0.847903 Aug 09 17:33:19.653323 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2087/4402] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:18 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1802 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:19.677045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eb0afea1-0425-4433-8111-56c70bafadc3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:19.678123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eb0afea1-0425-4433-8111-56c70bafadc3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:19.703850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb0afea1-0425-4433-8111-56c70bafadc3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:19.704630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb0afea1-0425-4433-8111-56c70bafadc3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:19.705592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb0afea1-0425-4433-8111-56c70bafadc3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:19.706568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb0afea1-0425-4433-8111-56c70bafadc3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:19.708164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb0afea1-0425-4433-8111-56c70bafadc3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:19.712919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb0afea1-0425-4433-8111-56c70bafadc3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:19.882628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ecabbc2b-e597-404d-a649-f6c5dbaf93f6 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:19.908288 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ecabbc2b-e597-404d-a649-f6c5dbaf93f6 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1513 microversion: 2.1 time: 0.856067 Aug 09 17:33:19.911854 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2316/4403] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:19 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1513 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:19.947281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:19.949498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:19.953241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:19.979235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:19.980111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:19.980892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:19.982430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:19.987087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:19.988281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:20.111978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:20.112776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:20.112776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:20.113586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lazy-loading 'fault' on Instance uuid a72ddf4a-4d41-4db4-8230-1962c7c3d514 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:33:20.865425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9583cf0668db41c3b576ba183678ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41de2908c5a4249980712f71d2e6de4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:20.873665 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ffae350-6e24-4cf4-a328-da5661b0156a tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 200 len: 1313 microversion: 2.1 time: 0.958230 Aug 09 17:33:20.895756 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2317/4404] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:19 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 1313 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:20.895756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8ebad58c-918b-4e3c-a973-7e24fb0c3682 req-6e6d5fab-8348-4192-8f7b-3d900b8eb8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72ddf4a-4d41-4db4-8230-1962c7c3d514", "name": "network-vif-deleted", "tag": "59727f0b-da0d-46c9-9440-bb09cce8aed8"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:20.915396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8ebad58c-918b-4e3c-a973-7e24fb0c3682 req-6e6d5fab-8348-4192-8f7b-3d900b8eb8fc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:20.918917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8ebad58c-918b-4e3c-a973-7e24fb0c3682 req-6e6d5fab-8348-4192-8f7b-3d900b8eb8fc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:20.921909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8ebad58c-918b-4e3c-a973-7e24fb0c3682 req-6e6d5fab-8348-4192-8f7b-3d900b8eb8fc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:20.937222 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8ebad58c-918b-4e3c-a973-7e24fb0c3682 req-6e6d5fab-8348-4192-8f7b-3d900b8eb8fc service nova] Creating event network-vif-deleted:59727f0b-da0d-46c9-9440-bb09cce8aed8 for instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 on n-h2-845781-6 Aug 09 17:33:20.945954 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8ebad58c-918b-4e3c-a973-7e24fb0c3682 req-6e6d5fab-8348-4192-8f7b-3d900b8eb8fc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061791 Aug 09 17:33:20.946565 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2318/4405] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:20.953424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ee817511-3668-4b6f-a46a-e92b02228710 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:20.954822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ee817511-3668-4b6f-a46a-e92b02228710 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:20.963194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee817511-3668-4b6f-a46a-e92b02228710 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:20.963971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee817511-3668-4b6f-a46a-e92b02228710 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:20.964776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee817511-3668-4b6f-a46a-e92b02228710 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:20.965672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee817511-3668-4b6f-a46a-e92b02228710 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:20.966301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee817511-3668-4b6f-a46a-e92b02228710 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:20.966901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee817511-3668-4b6f-a46a-e92b02228710 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:21.225359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eb0afea1-0425-4433-8111-56c70bafadc3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:21.234205 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eb0afea1-0425-4433-8111-56c70bafadc3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1314 microversion: 2.1 time: 1.575623 Aug 09 17:33:21.235469 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2088/4406] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:19 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1314 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:21.241433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:21.242318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:21.249510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:21.250549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:21.251205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:21.252190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:21.252860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:21.253488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:21.333996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ee817511-3668-4b6f-a46a-e92b02228710 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:21.343777 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ee817511-3668-4b6f-a46a-e92b02228710 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1309 microversion: 2.1 time: 0.395146 Aug 09 17:33:21.349788 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2319/4407] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:20 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1309 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:21.370223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-529c36a9-0e24-4cea-ba4c-6d601f61acbd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:21.371354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-529c36a9-0e24-4cea-ba4c-6d601f61acbd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:21.380374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-529c36a9-0e24-4cea-ba4c-6d601f61acbd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:21.381199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-529c36a9-0e24-4cea-ba4c-6d601f61acbd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:21.381874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-529c36a9-0e24-4cea-ba4c-6d601f61acbd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:21.382839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-529c36a9-0e24-4cea-ba4c-6d601f61acbd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:21.383609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-529c36a9-0e24-4cea-ba4c-6d601f61acbd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:21.384317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-529c36a9-0e24-4cea-ba4c-6d601f61acbd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:22.046497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:22.090741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:22.094424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:22.097001 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-66d75ae5-caa4-462b-85fd-0742186910d3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1849 microversion: 2.32 time: 0.859709 Aug 09 17:33:22.124335 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2089/4408] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:21 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1849 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:22.156564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:22.159556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] [instance: a72ddf4a-4d41-4db4-8230-1962c7c3d514] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:22.171741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:22.173235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:22.174427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:22.176843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:22.178099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:22.178975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:22.208217 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] HTTP exception thrown: Instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 could not be found. Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Request method failure captured: Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 HTTP/1.1 Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pnn9dbneclqnTMvqfzJmg9RBMWLGjnFk44gkAqB_nqiVPZxQ4GuDxn_HBky2qOBg85G-0v0O-4ZZjViss3Knk4x4V74TwxbuArXZdpJ1bRC4iiTB_yDNxYrOkz70XNrhQAPJ788GTYiEEoHQoYe9k2ksfbMy6egQENXmA23UxdqVRI Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f41de2908c5a4249980712f71d2e6de4 Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1527330697 Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f41de2908c5a4249980712f71d2e6de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f41de2908c5a4249980712f71d2e6de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f41de2908c5a4249980712f71d2e6de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f41de2908c5a4249980712f71d2e6de4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1527330697 Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f41de2908c5a4249980712f71d2e6de4 Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1527330697 Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerRescueTestJSONUnderV235-1527330697-project Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 9583cf0668db41c3b576ba183678ea07 Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1527330697-project Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 could not be found. Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'a72ddf4a-4d41-4db4-8230-1962c7c3d514'} Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 could not be found. Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 could not be found. Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:22.215281 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:33:22.221184 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:22.221184 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:22.221184 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:33:22.221184 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:33:22.221184 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:33:22.221184 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:33:22.221184 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 could not be found. Aug 09 17:33:22.221184 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:22.221184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] Returning 404 to user: Instance a72ddf4a-4d41-4db4-8230-1962c7c3d514 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:33:22.226710 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-37c1ed5e-e8ae-4471-bd93-86a30d8dd26f tempest-ServerRescueTestJSONUnderV235-1527330697 tempest-ServerRescueTestJSONUnderV235-1527330697-project] 10.222.0.93 "GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514" status: 404 len: 111 microversion: 2.1 time: 0.096770 Aug 09 17:33:22.230379 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2090/4409] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:22 2022] GET /compute/v2.1/servers/a72ddf4a-4d41-4db4-8230-1962c7c3d514 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:33:22.261800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2b546518-afed-4b83-85aa-2a39e9a2c70a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:22.265629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2b546518-afed-4b83-85aa-2a39e9a2c70a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:22.288992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b546518-afed-4b83-85aa-2a39e9a2c70a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:22.289908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b546518-afed-4b83-85aa-2a39e9a2c70a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:22.290732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b546518-afed-4b83-85aa-2a39e9a2c70a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:22.292131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b546518-afed-4b83-85aa-2a39e9a2c70a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:22.293007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b546518-afed-4b83-85aa-2a39e9a2c70a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:22.304217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b546518-afed-4b83-85aa-2a39e9a2c70a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:22.832139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-529c36a9-0e24-4cea-ba4c-6d601f61acbd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:22.866793 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-529c36a9-0e24-4cea-ba4c-6d601f61acbd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1513 microversion: 2.1 time: 1.500006 Aug 09 17:33:22.868342 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2320/4410] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:21 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1513 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:22.888430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f5a5f044-97b3-4af4-838f-f8b509a87d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:22.889891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f5a5f044-97b3-4af4-838f-f8b509a87d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:22.900873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a5f044-97b3-4af4-838f-f8b509a87d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:22.909838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a5f044-97b3-4af4-838f-f8b509a87d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:22.910895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a5f044-97b3-4af4-838f-f8b509a87d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:22.912389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a5f044-97b3-4af4-838f-f8b509a87d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:22.913238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a5f044-97b3-4af4-838f-f8b509a87d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:22.914026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a5f044-97b3-4af4-838f-f8b509a87d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:23.524612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f5a5f044-97b3-4af4-838f-f8b509a87d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:23.569267 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f5a5f044-97b3-4af4-838f-f8b509a87d1a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1309 microversion: 2.1 time: 0.698822 Aug 09 17:33:23.570940 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2321/4411] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:22 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1309 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:23.589935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:23.595379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:23.613912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:23.615735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:23.616970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:23.621376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:23.622899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:23.625869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:23.861228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b546518-afed-4b83-85aa-2a39e9a2c70a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:23.894636 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2b546518-afed-4b83-85aa-2a39e9a2c70a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1501 microversion: 2.1 time: 1.640142 Aug 09 17:33:23.898761 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2091/4412] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:22 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1501 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:23.933147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5fb607e8-afee-400d-a366-4986cf14e7b5 req-98dc4037-636f-4190-8ce9-de119ef5347e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034f8bad-5143-4cd6-bf2a-167ae912650e", "name": "network-vif-deleted", "tag": "1ae60f86-b2f6-451b-b03e-e98626e6f84a"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:23.975296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:23.990076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5fb607e8-afee-400d-a366-4986cf14e7b5 req-98dc4037-636f-4190-8ce9-de119ef5347e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:23.995352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5fb607e8-afee-400d-a366-4986cf14e7b5 req-98dc4037-636f-4190-8ce9-de119ef5347e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:23.996483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5fb607e8-afee-400d-a366-4986cf14e7b5 req-98dc4037-636f-4190-8ce9-de119ef5347e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:24.030271 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5fb607e8-afee-400d-a366-4986cf14e7b5 req-98dc4037-636f-4190-8ce9-de119ef5347e service nova] Creating event network-vif-deleted:1ae60f86-b2f6-451b-b03e-e98626e6f84a for instance 034f8bad-5143-4cd6-bf2a-167ae912650e on n-h1-845781-6 Aug 09 17:33:24.041392 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5fb607e8-afee-400d-a366-4986cf14e7b5 req-98dc4037-636f-4190-8ce9-de119ef5347e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139544 Aug 09 17:33:24.043066 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2092/4413] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:24.054787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-50b20e81-eba7-4984-a778-04cce9d55c36 req-46860d4f-440f-4e42-886f-94fbe8c6e265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e555d25-10e4-4fde-8477-95fcd23c1a93", "name": "network-vif-plugged", "status": "completed", "tag": "f8011ee0-4a12-4aba-88f2-04751be38be9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:24.077737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-50b20e81-eba7-4984-a778-04cce9d55c36 req-46860d4f-440f-4e42-886f-94fbe8c6e265 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:24.078908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-50b20e81-eba7-4984-a778-04cce9d55c36 req-46860d4f-440f-4e42-886f-94fbe8c6e265 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:24.080461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-50b20e81-eba7-4984-a778-04cce9d55c36 req-46860d4f-440f-4e42-886f-94fbe8c6e265 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:24.108308 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-50b20e81-eba7-4984-a778-04cce9d55c36 req-46860d4f-440f-4e42-886f-94fbe8c6e265 service nova] Creating event network-vif-plugged:f8011ee0-4a12-4aba-88f2-04751be38be9 for instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 on n-h1-845781-6 Aug 09 17:33:24.124812 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-50b20e81-eba7-4984-a778-04cce9d55c36 req-46860d4f-440f-4e42-886f-94fbe8c6e265 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078949 Aug 09 17:33:24.132453 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2093/4414] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:24.144427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:24.145915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:24.159959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:24.165967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:24.166911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:24.168325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:24.169327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:24.170571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:24.276312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:24.277277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:24.278486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:24.280439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lazy-loading 'fault' on Instance uuid 034f8bad-5143-4cd6-bf2a-167ae912650e {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:33:24.385033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:24.439794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:24.450193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:24.459290 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-771e8698-558e-4032-8d44-a66bbcefc7af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1849 microversion: 2.32 time: 0.880451 Aug 09 17:33:24.461186 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2322/4415] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:23 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1849 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:24.478435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b29612a-5031-4b24-aa0f-e667070a8299 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:24.507724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b29612a-5031-4b24-aa0f-e667070a8299 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:24.510991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b29612a-5031-4b24-aa0f-e667070a8299 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:24.512787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b29612a-5031-4b24-aa0f-e667070a8299 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:24.520199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:24.533619 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bf13eddb-0896-4da5-b3b1-7210cc05fbdd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 200 len: 1309 microversion: 2.1 time: 0.398996 Aug 09 17:33:24.539472 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2094/4416] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:24 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 1309 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:24.587957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b29612a-5031-4b24-aa0f-e667070a8299 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Going to try to stop instance {{(pid=119431) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 17:33:24.609997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f2f680a-292d-409e-9fbf-065d1bf3b258 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:24.611669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8f2f680a-292d-409e-9fbf-065d1bf3b258 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:24.621975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2f680a-292d-409e-9fbf-065d1bf3b258 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:24.622765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2f680a-292d-409e-9fbf-065d1bf3b258 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:24.623556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2f680a-292d-409e-9fbf-065d1bf3b258 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:24.631845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2f680a-292d-409e-9fbf-065d1bf3b258 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:24.632714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2f680a-292d-409e-9fbf-065d1bf3b258 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:24.634106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f2f680a-292d-409e-9fbf-065d1bf3b258 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:24.702079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:24.725718 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b29612a-5031-4b24-aa0f-e667070a8299 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23/action" status: 202 len: 0 microversion: 2.1 time: 0.258086 Aug 09 17:33:24.726598 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2323/4417] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:33:24 2022] POST /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:33:24.756923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e54d7132-b854-4521-8f11-57720a960d06 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:24.757667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e54d7132-b854-4521-8f11-57720a960d06 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:24.779721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e54d7132-b854-4521-8f11-57720a960d06 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:24.780243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e54d7132-b854-4521-8f11-57720a960d06 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:24.782196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e54d7132-b854-4521-8f11-57720a960d06 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:24.784640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e54d7132-b854-4521-8f11-57720a960d06 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:24.786094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e54d7132-b854-4521-8f11-57720a960d06 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:24.786542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e54d7132-b854-4521-8f11-57720a960d06 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:25.042265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e54d7132-b854-4521-8f11-57720a960d06 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:25.058825 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e54d7132-b854-4521-8f11-57720a960d06 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 0.318827 Aug 09 17:33:25.064972 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2324/4418] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:24 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:25.294549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8f2f680a-292d-409e-9fbf-065d1bf3b258 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:25.314529 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8f2f680a-292d-409e-9fbf-065d1bf3b258 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1309 microversion: 2.1 time: 0.709103 Aug 09 17:33:25.315409 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2095/4419] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:24 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1309 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:33:25.487283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:25.488212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:25.508027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:25.508027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:25.508027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:25.515544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:25.515544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:25.515544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:25.558163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:25.558778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: 034f8bad-5143-4cd6-bf2a-167ae912650e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:25.574551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:25.575312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:25.575957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:25.576918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:25.577555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:25.579149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:25.621041 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] HTTP exception thrown: Instance 034f8bad-5143-4cd6-bf2a-167ae912650e could not be found. Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Request method failure captured: Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e HTTP/1.1 Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pkMP0fFe9Rcs1XI3QZKwVBTqyPoKqabsjnXpH_8tFYUXttWRhai5a7qtfrgmQWQouRIxkZbOnDPrqfwdKCqLza-n6LKzP9NQOEl1c679Fk8t3Jv8WP1IKSgMy_tn-YEpBj3hZUwJYyZDgHnZG5XzzXUZuoVrD7COLmJvje8E6wxtiA Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 596fa4a2074f4863ba4d1e6edb7bf22c Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1130522351 Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_596fa4a2074f4863ba4d1e6edb7bf22c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/596fa4a2074f4863ba4d1e6edb7bf22c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/596fa4a2074f4863ba4d1e6edb7bf22c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/596fa4a2074f4863ba4d1e6edb7bf22c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesSnapshotTestJSON-1130522351 Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 596fa4a2074f4863ba4d1e6edb7bf22c Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1130522351 Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesSnapshotTestJSON-1130522351-project Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 55b13ba9ce5d492dba79fa082d58ca9f Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesSnapshotTestJSON-1130522351-project Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 034f8bad-5143-4cd6-bf2a-167ae912650e could not be found. Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '034f8bad-5143-4cd6-bf2a-167ae912650e'} Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 034f8bad-5143-4cd6-bf2a-167ae912650e could not be found. Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 034f8bad-5143-4cd6-bf2a-167ae912650e could not be found. Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:33:25.623157 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:25.635391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:33:25.635391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:33:25.635391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:33:25.635391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:33:25.635391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:33:25.635391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 034f8bad-5143-4cd6-bf2a-167ae912650e could not be found. Aug 09 17:33:25.635391 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:33:25.635391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Returning 404 to user: Instance 034f8bad-5143-4cd6-bf2a-167ae912650e could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:33:25.635391 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5e57c42e-f96f-4b36-a8ff-bb45288bbf89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e" status: 404 len: 111 microversion: 2.1 time: 0.070676 Aug 09 17:33:25.635391 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2096/4420] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:25 2022] GET /compute/v2.1/servers/034f8bad-5143-4cd6-bf2a-167ae912650e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:33:26.029303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:26.056374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:26.063509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:26.068283 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9409a61a-a916-4857-8154-ac388beb853c tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1849 microversion: 2.32 time: 0.583816 Aug 09 17:33:26.085265 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2325/4421] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:25 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1849 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:33:26.110381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-51ff204a-94c8-42eb-9cfc-336021766f58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:26.110381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-51ff204a-94c8-42eb-9cfc-336021766f58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:26.121290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51ff204a-94c8-42eb-9cfc-336021766f58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:26.122102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51ff204a-94c8-42eb-9cfc-336021766f58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:26.122711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51ff204a-94c8-42eb-9cfc-336021766f58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:26.123675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51ff204a-94c8-42eb-9cfc-336021766f58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:26.124215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51ff204a-94c8-42eb-9cfc-336021766f58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:26.124885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51ff204a-94c8-42eb-9cfc-336021766f58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:26.274484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5a2d6da5-b918-42ba-8c59-0d5588595bc5 req-7c7e780a-8e04-40b1-9011-1a4d57005b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "tag": "816e38ad-dd4a-4517-9175-b3b52a3f92ce"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:26.291650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5a2d6da5-b918-42ba-8c59-0d5588595bc5 req-7c7e780a-8e04-40b1-9011-1a4d57005b4d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:26.292508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5a2d6da5-b918-42ba-8c59-0d5588595bc5 req-7c7e780a-8e04-40b1-9011-1a4d57005b4d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:26.293317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5a2d6da5-b918-42ba-8c59-0d5588595bc5 req-7c7e780a-8e04-40b1-9011-1a4d57005b4d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:26.393099 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5a2d6da5-b918-42ba-8c59-0d5588595bc5 req-7c7e780a-8e04-40b1-9011-1a4d57005b4d service nova] Creating event network-changed:816e38ad-dd4a-4517-9175-b3b52a3f92ce for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:33:26.418676 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5a2d6da5-b918-42ba-8c59-0d5588595bc5 req-7c7e780a-8e04-40b1-9011-1a4d57005b4d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144393 Aug 09 17:33:26.421342 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2326/4422] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:26.467567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3aaddab7-7704-45a0-9b03-d7b9f5dd7440 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:26.473561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3aaddab7-7704-45a0-9b03-d7b9f5dd7440 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:26.517845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3aaddab7-7704-45a0-9b03-d7b9f5dd7440 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:26.521166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3aaddab7-7704-45a0-9b03-d7b9f5dd7440 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:26.530071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3aaddab7-7704-45a0-9b03-d7b9f5dd7440 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:26.531391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3aaddab7-7704-45a0-9b03-d7b9f5dd7440 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:26.539540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3aaddab7-7704-45a0-9b03-d7b9f5dd7440 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:26.545250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3aaddab7-7704-45a0-9b03-d7b9f5dd7440 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:27.144030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3aaddab7-7704-45a0-9b03-d7b9f5dd7440 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:27.152499 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3aaddab7-7704-45a0-9b03-d7b9f5dd7440 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1309 microversion: 2.1 time: 0.724017 Aug 09 17:33:27.163872 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2327/4423] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:26 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1309 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:27.169237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:27.170129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:27.188616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:27.189445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:27.190060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:27.190973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:27.191786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:27.192870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:27.715468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-51ff204a-94c8-42eb-9cfc-336021766f58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:27.746479 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-51ff204a-94c8-42eb-9cfc-336021766f58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 1.661925 Aug 09 17:33:27.749335 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2097/4424] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:26 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:28.189188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2d60548c-4a0d-4e53-a7d7-909325fa74d5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:28.189936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2d60548c-4a0d-4e53-a7d7-909325fa74d5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:28.211291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d60548c-4a0d-4e53-a7d7-909325fa74d5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:28.217044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d60548c-4a0d-4e53-a7d7-909325fa74d5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:28.220266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d60548c-4a0d-4e53-a7d7-909325fa74d5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:28.222287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d60548c-4a0d-4e53-a7d7-909325fa74d5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:28.224057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d60548c-4a0d-4e53-a7d7-909325fa74d5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:28.228181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d60548c-4a0d-4e53-a7d7-909325fa74d5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:28.466996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:28.483300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:28.489915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:28.492214 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d591561d-e545-43a9-b36b-84a70cb1bae0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1849 microversion: 2.32 time: 1.326239 Aug 09 17:33:28.494997 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2328/4425] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:27 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1849 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:28.779260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f20d97fc-6d15-426d-9183-522efa4950f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:28.781660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f20d97fc-6d15-426d-9183-522efa4950f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:28.787188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2d60548c-4a0d-4e53-a7d7-909325fa74d5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:28.809057 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2d60548c-4a0d-4e53-a7d7-909325fa74d5 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1489 microversion: 2.1 time: 0.623672 Aug 09 17:33:28.810645 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2098/4426] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:28 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1489 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:28.820458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20d97fc-6d15-426d-9183-522efa4950f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:28.821365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20d97fc-6d15-426d-9183-522efa4950f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:28.822025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20d97fc-6d15-426d-9183-522efa4950f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:28.823232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20d97fc-6d15-426d-9183-522efa4950f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:28.824443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20d97fc-6d15-426d-9183-522efa4950f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:28.825199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f20d97fc-6d15-426d-9183-522efa4950f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:29.071718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1160935001", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "829cb0b3-9c78-4844-8875-46f5a554f097"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:29.349104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] validate_networks() for [('829cb0b3-9c78-4844-8875-46f5a554f097', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:33:29.911319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f20d97fc-6d15-426d-9183-522efa4950f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:29.966213 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f20d97fc-6d15-426d-9183-522efa4950f1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 1.189729 Aug 09 17:33:29.966997 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2329/4427] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:28 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:29.974146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d3bebb35-feb1-4833-9f67-d7470fc81e34 req-a7b02e1f-22cb-45ab-bc2b-600ccc211a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "tag": "08d0cf84-a616-4f63-b18f-3820a0a3de7d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:29.990559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d3bebb35-feb1-4833-9f67-d7470fc81e34 req-a7b02e1f-22cb-45ab-bc2b-600ccc211a6e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:29.991454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d3bebb35-feb1-4833-9f67-d7470fc81e34 req-a7b02e1f-22cb-45ab-bc2b-600ccc211a6e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:29.992385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d3bebb35-feb1-4833-9f67-d7470fc81e34 req-a7b02e1f-22cb-45ab-bc2b-600ccc211a6e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:30.010833 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d3bebb35-feb1-4833-9f67-d7470fc81e34 req-a7b02e1f-22cb-45ab-bc2b-600ccc211a6e service nova] Creating event network-changed:08d0cf84-a616-4f63-b18f-3820a0a3de7d for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:33:30.017607 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d3bebb35-feb1-4833-9f67-d7470fc81e34 req-a7b02e1f-22cb-45ab-bc2b-600ccc211a6e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048160 Aug 09 17:33:30.019086 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2330/4428] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:30.030421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:30.031478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:30.041439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:30.042651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:30.043616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:30.044727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:30.045571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:30.046315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:31.116717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:31.127898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:31.141751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:31.143346 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-885b9e5b-7e80-4a86-8e7a-ce71fcc67c09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1870 microversion: 2.32 time: 1.122383 Aug 09 17:33:31.144557 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2331/4429] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:30 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1870 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:31.159917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0fc84137-de74-4e37-accc-3b111faaecab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:31.161383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0fc84137-de74-4e37-accc-3b111faaecab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:31.179560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc84137-de74-4e37-accc-3b111faaecab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:31.180346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc84137-de74-4e37-accc-3b111faaecab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:31.180970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc84137-de74-4e37-accc-3b111faaecab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:31.181928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc84137-de74-4e37-accc-3b111faaecab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:31.182591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc84137-de74-4e37-accc-3b111faaecab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:31.183201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fc84137-de74-4e37-accc-3b111faaecab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:31.758085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0fc84137-de74-4e37-accc-3b111faaecab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:31.779004 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0fc84137-de74-4e37-accc-3b111faaecab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 0.631895 Aug 09 17:33:31.780366 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2332/4430] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:31 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:32.173926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:32.174973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:32.187308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:32.194901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:32.195495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:32.196309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:32.196795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:32.197236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:32.345475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:33:32.346340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:33:32.346596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:33:32.347209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:33:32.348527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:33:32.373296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:32.374336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:32.377816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:32.385200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:32.386236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:32.386871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:32.451125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:33:32.469858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for user 1d4dd578ed0640fc943af026c4363e28 and project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:33:32.510283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:33:32.515336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:33:32.579092 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ded86b7c-7ad5-403f-ad80-0230d6af7359 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.514898 Aug 09 17:33:32.588908 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2099/4431] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:33:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:33:32.594315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-968536bf-dd1d-499d-810f-6f3b91179ca2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:32.595360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-968536bf-dd1d-499d-810f-6f3b91179ca2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:32.790154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:32.837063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:32.845272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:32.855708 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-026e4c8b-6e25-4aef-96a8-8eecb29ce3c2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1891 microversion: 2.32 time: 0.683361 Aug 09 17:33:32.859063 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2333/4432] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:32 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1891 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:33:32.897647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69befd80-0c57-4e95-9aa8-6eef6e984bd9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:32.899942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-69befd80-0c57-4e95-9aa8-6eef6e984bd9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:32.943614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69befd80-0c57-4e95-9aa8-6eef6e984bd9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:32.944607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69befd80-0c57-4e95-9aa8-6eef6e984bd9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:32.945445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69befd80-0c57-4e95-9aa8-6eef6e984bd9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:32.947687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69befd80-0c57-4e95-9aa8-6eef6e984bd9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:32.951601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69befd80-0c57-4e95-9aa8-6eef6e984bd9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:32.951601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69befd80-0c57-4e95-9aa8-6eef6e984bd9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:33.027351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-968536bf-dd1d-499d-810f-6f3b91179ca2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:33.049060 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-968536bf-dd1d-499d-810f-6f3b91179ca2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1209 microversion: 2.1 time: 0.458258 Aug 09 17:33:33.055206 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2100/4433] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:32 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1209 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:33.575530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-69befd80-0c57-4e95-9aa8-6eef6e984bd9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:33.592358 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69befd80-0c57-4e95-9aa8-6eef6e984bd9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 0.730011 Aug 09 17:33:33.594267 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2334/4434] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:32 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:33.905528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:33.906456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:33.935272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:33.938313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:33.939139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:33.946498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:33.947664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:33.952316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:34.098873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d6fa2f3e-2b12-4e2d-90b9-b606dfc41d05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:34.100067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d6fa2f3e-2b12-4e2d-90b9-b606dfc41d05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:34.123567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6fa2f3e-2b12-4e2d-90b9-b606dfc41d05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:34.137447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6fa2f3e-2b12-4e2d-90b9-b606dfc41d05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:34.138296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6fa2f3e-2b12-4e2d-90b9-b606dfc41d05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:34.139827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6fa2f3e-2b12-4e2d-90b9-b606dfc41d05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:34.141154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6fa2f3e-2b12-4e2d-90b9-b606dfc41d05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:34.141877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6fa2f3e-2b12-4e2d-90b9-b606dfc41d05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:34.412668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d6fa2f3e-2b12-4e2d-90b9-b606dfc41d05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:34.441343 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d6fa2f3e-2b12-4e2d-90b9-b606dfc41d05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1205 microversion: 2.1 time: 0.349948 Aug 09 17:33:34.443470 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2335/4435] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:34 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1205 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:34.622410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b0ea552b-9be5-4133-9990-436acb597b87 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:34.631903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b0ea552b-9be5-4133-9990-436acb597b87 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:34.666951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea552b-9be5-4133-9990-436acb597b87 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:34.668309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea552b-9be5-4133-9990-436acb597b87 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:34.669412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea552b-9be5-4133-9990-436acb597b87 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:34.671081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea552b-9be5-4133-9990-436acb597b87 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:34.673012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea552b-9be5-4133-9990-436acb597b87 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:34.677380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea552b-9be5-4133-9990-436acb597b87 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:36.223947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:36.248786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:36.258467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:36.266986 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aa527839-2558-4d99-81ee-6ec37fe4c7a3 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1891 microversion: 2.32 time: 2.363487 Aug 09 17:33:36.268491 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2101/4436] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:33 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1891 bytes in 2371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:36.290975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-de0d196c-af05-43f3-819b-0dada0cfd2ab tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:36.292698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-de0d196c-af05-43f3-819b-0dada0cfd2ab tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:36.312276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de0d196c-af05-43f3-819b-0dada0cfd2ab tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:36.324875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de0d196c-af05-43f3-819b-0dada0cfd2ab tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:36.326130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de0d196c-af05-43f3-819b-0dada0cfd2ab tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:36.327816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de0d196c-af05-43f3-819b-0dada0cfd2ab tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:36.328980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de0d196c-af05-43f3-819b-0dada0cfd2ab tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:36.330019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de0d196c-af05-43f3-819b-0dada0cfd2ab tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:36.567471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b0ea552b-9be5-4133-9990-436acb597b87 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:36.603695 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b0ea552b-9be5-4133-9990-436acb597b87 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 1.987377 Aug 09 17:33:36.649063 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2336/4437] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:34 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:36.650498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-de0d196c-af05-43f3-819b-0dada0cfd2ab tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:36.657347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:36.665281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-60d56c74-1446-48e9-9b16-bcd3c87ee1aa req-8ede9b94-5537-4b3e-b367-d728a64e09d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "tag": "a3fc9a19-60ae-4faa-aa63-64fdb0f45a85"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:36.684051 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-de0d196c-af05-43f3-819b-0dada0cfd2ab tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1267 microversion: 2.1 time: 0.412783 Aug 09 17:33:36.685915 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2102/4438] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:36 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1267 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:36.712688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-60d56c74-1446-48e9-9b16-bcd3c87ee1aa req-8ede9b94-5537-4b3e-b367-d728a64e09d8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:36.714147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-60d56c74-1446-48e9-9b16-bcd3c87ee1aa req-8ede9b94-5537-4b3e-b367-d728a64e09d8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:36.719777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-60d56c74-1446-48e9-9b16-bcd3c87ee1aa req-8ede9b94-5537-4b3e-b367-d728a64e09d8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:36.782169 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-60d56c74-1446-48e9-9b16-bcd3c87ee1aa req-8ede9b94-5537-4b3e-b367-d728a64e09d8 service nova] Creating event network-changed:a3fc9a19-60ae-4faa-aa63-64fdb0f45a85 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:33:36.816044 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-60d56c74-1446-48e9-9b16-bcd3c87ee1aa req-8ede9b94-5537-4b3e-b367-d728a64e09d8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156368 Aug 09 17:33:36.818418 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2337/4439] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:37.329958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:37.332028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:37.370963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:37.376933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:37.378507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:37.382176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:37.387266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:37.388508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:37.659683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8884019b-e9a2-434c-9ae1-bf662409b3d4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:37.672660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8884019b-e9a2-434c-9ae1-bf662409b3d4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:37.698421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8884019b-e9a2-434c-9ae1-bf662409b3d4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:37.712020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8884019b-e9a2-434c-9ae1-bf662409b3d4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:37.713625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8884019b-e9a2-434c-9ae1-bf662409b3d4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:37.715436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8884019b-e9a2-434c-9ae1-bf662409b3d4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:37.716531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8884019b-e9a2-434c-9ae1-bf662409b3d4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:37.717504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8884019b-e9a2-434c-9ae1-bf662409b3d4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:38.241135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8884019b-e9a2-434c-9ae1-bf662409b3d4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:38.270504 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8884019b-e9a2-434c-9ae1-bf662409b3d4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 0.621278 Aug 09 17:33:38.280394 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2338/4440] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:37 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:38.302842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d8ee0592-81c1-4b7b-8785-9557967fac6f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:38.304644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d8ee0592-81c1-4b7b-8785-9557967fac6f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:38.327140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8ee0592-81c1-4b7b-8785-9557967fac6f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:38.331337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8ee0592-81c1-4b7b-8785-9557967fac6f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:38.334641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8ee0592-81c1-4b7b-8785-9557967fac6f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:38.337701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8ee0592-81c1-4b7b-8785-9557967fac6f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:38.339182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8ee0592-81c1-4b7b-8785-9557967fac6f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:38.342762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8ee0592-81c1-4b7b-8785-9557967fac6f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:39.491579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d8ee0592-81c1-4b7b-8785-9557967fac6f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:39.502656 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d8ee0592-81c1-4b7b-8785-9557967fac6f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1267 microversion: 2.1 time: 1.220066 Aug 09 17:33:39.508187 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2339/4441] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:38 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1267 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:39.527555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e5e0b52b-f837-4b64-b7cf-62fd923a1513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:39.528441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e5e0b52b-f837-4b64-b7cf-62fd923a1513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:39.543367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5e0b52b-f837-4b64-b7cf-62fd923a1513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:39.544317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5e0b52b-f837-4b64-b7cf-62fd923a1513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:39.545781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5e0b52b-f837-4b64-b7cf-62fd923a1513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:39.546758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5e0b52b-f837-4b64-b7cf-62fd923a1513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:39.547413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5e0b52b-f837-4b64-b7cf-62fd923a1513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:39.548248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5e0b52b-f837-4b64-b7cf-62fd923a1513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:39.950978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e5e0b52b-f837-4b64-b7cf-62fd923a1513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:39.969139 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e5e0b52b-f837-4b64-b7cf-62fd923a1513 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 0.459477 Aug 09 17:33:39.970123 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2340/4442] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:39 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:40.309936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1629780507", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ef83e3bd-9fef-43c6-8771-4e13dfd0d1c9"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:40.395974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:40.418591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:40.424968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:40.427038 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b48ba8ff-364f-4621-9efd-91172a19b6d8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1891 microversion: 2.32 time: 3.105035 Aug 09 17:33:40.430139 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2103/4443] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:37 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1891 bytes in 3109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:40.508575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] validate_networks() for [('ef83e3bd-9fef-43c6-8771-4e13dfd0d1c9', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:33:40.551002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0252e197-23de-49a1-bc91-9b3512f76af4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:40.552348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0252e197-23de-49a1-bc91-9b3512f76af4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:40.565119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0252e197-23de-49a1-bc91-9b3512f76af4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:40.567068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0252e197-23de-49a1-bc91-9b3512f76af4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:40.569965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0252e197-23de-49a1-bc91-9b3512f76af4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:40.576089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0252e197-23de-49a1-bc91-9b3512f76af4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:40.577043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0252e197-23de-49a1-bc91-9b3512f76af4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:40.577800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0252e197-23de-49a1-bc91-9b3512f76af4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:41.424660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0252e197-23de-49a1-bc91-9b3512f76af4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:41.437518 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0252e197-23de-49a1-bc91-9b3512f76af4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1309 microversion: 2.1 time: 0.891643 Aug 09 17:33:41.439072 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2104/4444] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:40 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1309 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:33:41.444797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e42505d9-ede4-4fdd-bad8-f57fb40a99e1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:41.445578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e42505d9-ede4-4fdd-bad8-f57fb40a99e1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:41.452260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e42505d9-ede4-4fdd-bad8-f57fb40a99e1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:41.453301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e42505d9-ede4-4fdd-bad8-f57fb40a99e1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:41.453901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e42505d9-ede4-4fdd-bad8-f57fb40a99e1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:41.454795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e42505d9-ede4-4fdd-bad8-f57fb40a99e1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:41.456131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e42505d9-ede4-4fdd-bad8-f57fb40a99e1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:41.457015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e42505d9-ede4-4fdd-bad8-f57fb40a99e1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:42.015225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e42505d9-ede4-4fdd-bad8-f57fb40a99e1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:42.079795 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e42505d9-ede4-4fdd-bad8-f57fb40a99e1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 0.618129 Aug 09 17:33:42.081776 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2105/4445] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:41 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:42.108548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-af8dc1c4-f323-4c82-bab6-d7d8b19ccb8c req-b489adb3-668e-445a-8e11-f84e2a06d76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "tag": "b31588f9-5215-4525-a306-7739e48dfd07"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:42.154859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-af8dc1c4-f323-4c82-bab6-d7d8b19ccb8c req-b489adb3-668e-445a-8e11-f84e2a06d76f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:42.156213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-af8dc1c4-f323-4c82-bab6-d7d8b19ccb8c req-b489adb3-668e-445a-8e11-f84e2a06d76f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:42.157700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-af8dc1c4-f323-4c82-bab6-d7d8b19ccb8c req-b489adb3-668e-445a-8e11-f84e2a06d76f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:42.199555 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-af8dc1c4-f323-4c82-bab6-d7d8b19ccb8c req-b489adb3-668e-445a-8e11-f84e2a06d76f service nova] Creating event network-changed:b31588f9-5215-4525-a306-7739e48dfd07 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:33:42.216447 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-af8dc1c4-f323-4c82-bab6-d7d8b19ccb8c req-b489adb3-668e-445a-8e11-f84e2a06d76f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126554 Aug 09 17:33:42.218757 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2106/4446] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:42.240095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:42.242363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:42.263436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:42.264436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:42.265300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:42.267140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:42.268267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:42.269580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:42.410292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:42.874813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:33:42.876730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:33:42.895456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:33:42.895456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:33:42.895456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:33:42.902890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:42.903563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:42.904143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:42.905093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:42.905838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:42.906355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:42.933275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Getting quotas for project 596fa4a2074f4863ba4d1e6edb7bf22c. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:33:42.942338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Getting quotas for user 55b13ba9ce5d492dba79fa082d58ca9f and project 596fa4a2074f4863ba4d1e6edb7bf22c. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:33:42.962093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:33:42.965129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:33:43.045258 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9269299e-ac39-42fd-97c6-45d18612ed5c tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.739572 Aug 09 17:33:43.046957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:43.056335 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2341/4447] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:33:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:33:43.065981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-39b4f57b-1726-4dd2-a196-1ca17cb2b4a6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:43.065981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-39b4f57b-1726-4dd2-a196-1ca17cb2b4a6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:43.074062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39b4f57b-1726-4dd2-a196-1ca17cb2b4a6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:43.076251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39b4f57b-1726-4dd2-a196-1ca17cb2b4a6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:43.077200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39b4f57b-1726-4dd2-a196-1ca17cb2b4a6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:43.078194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39b4f57b-1726-4dd2-a196-1ca17cb2b4a6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:43.078891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39b4f57b-1726-4dd2-a196-1ca17cb2b4a6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:43.079562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39b4f57b-1726-4dd2-a196-1ca17cb2b4a6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:43.243732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:43.262072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:43.263682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:43.264909 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cd3cef00-6ae7-454c-ab26-af5edf93a58d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.040563 Aug 09 17:33:43.265689 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2107/4448] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:42 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:43.273138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b8baa480-1dd8-4293-994a-cfc6ea840321 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:43.274173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b8baa480-1dd8-4293-994a-cfc6ea840321 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:43.528879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b8baa480-1dd8-4293-994a-cfc6ea840321 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:43.540201 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b8baa480-1dd8-4293-994a-cfc6ea840321 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1219 microversion: 2.1 time: 0.272178 Aug 09 17:33:43.553144 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2108/4449] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:43 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1219 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:43.553144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a9e6fd71-0c62-4a6a-9deb-77707c2d3632 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:43.553144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a9e6fd71-0c62-4a6a-9deb-77707c2d3632 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:43.571445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd71-0c62-4a6a-9deb-77707c2d3632 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:43.571985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd71-0c62-4a6a-9deb-77707c2d3632 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:43.572692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd71-0c62-4a6a-9deb-77707c2d3632 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:43.573556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd71-0c62-4a6a-9deb-77707c2d3632 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:43.574034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd71-0c62-4a6a-9deb-77707c2d3632 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:43.574531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a9e6fd71-0c62-4a6a-9deb-77707c2d3632 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:43.726610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-39b4f57b-1726-4dd2-a196-1ca17cb2b4a6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:43.742143 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-39b4f57b-1726-4dd2-a196-1ca17cb2b4a6 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1309 microversion: 2.1 time: 0.685320 Aug 09 17:33:43.749092 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2342/4450] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:43 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1309 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:44.303719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-33c52c2b-05bd-4cef-afa0-bd1103d5b470 req-b87cf4a4-ee41-4615-a9d0-281c72a797cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfb12d9f-3932-4603-bacc-5df2748c70a5", "tag": "691c25b0-5f7d-4f8b-9d77-7efa6541fdd4"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:44.351108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-33c52c2b-05bd-4cef-afa0-bd1103d5b470 req-b87cf4a4-ee41-4615-a9d0-281c72a797cb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:44.351583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-33c52c2b-05bd-4cef-afa0-bd1103d5b470 req-b87cf4a4-ee41-4615-a9d0-281c72a797cb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:44.352062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-33c52c2b-05bd-4cef-afa0-bd1103d5b470 req-b87cf4a4-ee41-4615-a9d0-281c72a797cb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:44.362290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:44.367660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a9e6fd71-0c62-4a6a-9deb-77707c2d3632 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:44.393145 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a9e6fd71-0c62-4a6a-9deb-77707c2d3632 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 0.850736 Aug 09 17:33:44.415931 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2109/4451] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:43 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:44.417164 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-33c52c2b-05bd-4cef-afa0-bd1103d5b470 req-b87cf4a4-ee41-4615-a9d0-281c72a797cb service nova] Creating event network-changed:691c25b0-5f7d-4f8b-9d77-7efa6541fdd4 for instance bfb12d9f-3932-4603-bacc-5df2748c70a5 on n-h2-845781-6 Aug 09 17:33:44.417477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:44.417477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:44.438224 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-33c52c2b-05bd-4cef-afa0-bd1103d5b470 req-b87cf4a4-ee41-4615-a9d0-281c72a797cb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146263 Aug 09 17:33:44.443924 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2343/4452] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:44.446083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:44.446632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:44.447776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:44.449245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:44.449923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:44.455216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:44.562352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e27720b-f1fc-4fb8-87ab-132392d4f479 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:44.563080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e27720b-f1fc-4fb8-87ab-132392d4f479 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:44.574422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e27720b-f1fc-4fb8-87ab-132392d4f479 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:44.575054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e27720b-f1fc-4fb8-87ab-132392d4f479 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:44.575511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e27720b-f1fc-4fb8-87ab-132392d4f479 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:44.576356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e27720b-f1fc-4fb8-87ab-132392d4f479 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:44.576829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e27720b-f1fc-4fb8-87ab-132392d4f479 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:44.577264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e27720b-f1fc-4fb8-87ab-132392d4f479 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:44.719970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e27720b-f1fc-4fb8-87ab-132392d4f479 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:44.736280 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e27720b-f1fc-4fb8-87ab-132392d4f479 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1271 microversion: 2.1 time: 0.178211 Aug 09 17:33:44.737333 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2344/4453] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:44 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:33:44.748537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1f7906f9-bb60-4d60-926c-caadbe76a8bc req-017484f3-75eb-4797-a299-e136e9ceb63e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "tag": "1f1ce345-17a7-4206-910b-0ef883357278"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:44.775036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1f7906f9-bb60-4d60-926c-caadbe76a8bc req-017484f3-75eb-4797-a299-e136e9ceb63e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:44.775889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1f7906f9-bb60-4d60-926c-caadbe76a8bc req-017484f3-75eb-4797-a299-e136e9ceb63e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:44.776750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1f7906f9-bb60-4d60-926c-caadbe76a8bc req-017484f3-75eb-4797-a299-e136e9ceb63e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:44.804439 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1f7906f9-bb60-4d60-926c-caadbe76a8bc req-017484f3-75eb-4797-a299-e136e9ceb63e service nova] Creating event network-changed:1f1ce345-17a7-4206-910b-0ef883357278 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:33:44.817617 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1f7906f9-bb60-4d60-926c-caadbe76a8bc req-017484f3-75eb-4797-a299-e136e9ceb63e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075217 Aug 09 17:33:44.818788 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2345/4454] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:44.840844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-85cc44a9-9557-44fd-902e-60f4423e0291 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:44.843427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-85cc44a9-9557-44fd-902e-60f4423e0291 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:44.868444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cc44a9-9557-44fd-902e-60f4423e0291 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:44.875681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cc44a9-9557-44fd-902e-60f4423e0291 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:44.876971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cc44a9-9557-44fd-902e-60f4423e0291 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:44.883703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cc44a9-9557-44fd-902e-60f4423e0291 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:44.885062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cc44a9-9557-44fd-902e-60f4423e0291 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:44.886150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85cc44a9-9557-44fd-902e-60f4423e0291 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:45.682307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-85cc44a9-9557-44fd-902e-60f4423e0291 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:45.696765 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-85cc44a9-9557-44fd-902e-60f4423e0291 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1309 microversion: 2.1 time: 0.876047 Aug 09 17:33:45.704465 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2346/4455] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:44 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1309 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:45.710440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f7c7ea8a-8e3e-4852-87bb-0e7646ff9adf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:45.718758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f7c7ea8a-8e3e-4852-87bb-0e7646ff9adf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:45.730407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7c7ea8a-8e3e-4852-87bb-0e7646ff9adf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:45.732292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7c7ea8a-8e3e-4852-87bb-0e7646ff9adf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:45.733351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7c7ea8a-8e3e-4852-87bb-0e7646ff9adf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:45.735832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7c7ea8a-8e3e-4852-87bb-0e7646ff9adf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:45.737587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7c7ea8a-8e3e-4852-87bb-0e7646ff9adf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:45.739945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7c7ea8a-8e3e-4852-87bb-0e7646ff9adf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:45.824640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:45.848666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:45.850614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:45.852725 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c9e00334-66f9-4895-a0e0-eb2abd4197a8 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.457933 Aug 09 17:33:45.853741 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2110/4456] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:44 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:45.860534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-90fe89c1-0cec-40a6-8bd8-70f0ed7ab0fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:45.862137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-90fe89c1-0cec-40a6-8bd8-70f0ed7ab0fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:45.869788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90fe89c1-0cec-40a6-8bd8-70f0ed7ab0fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:45.870669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90fe89c1-0cec-40a6-8bd8-70f0ed7ab0fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:45.872045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90fe89c1-0cec-40a6-8bd8-70f0ed7ab0fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:45.873216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90fe89c1-0cec-40a6-8bd8-70f0ed7ab0fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:45.873914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90fe89c1-0cec-40a6-8bd8-70f0ed7ab0fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:45.874549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90fe89c1-0cec-40a6-8bd8-70f0ed7ab0fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:46.165365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90fe89c1-0cec-40a6-8bd8-70f0ed7ab0fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:46.184598 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-90fe89c1-0cec-40a6-8bd8-70f0ed7ab0fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1277 microversion: 2.1 time: 0.329369 Aug 09 17:33:46.185849 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2111/4457] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:45 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1277 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:46.690736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f7c7ea8a-8e3e-4852-87bb-0e7646ff9adf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:46.709822 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f7c7ea8a-8e3e-4852-87bb-0e7646ff9adf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 1.003803 Aug 09 17:33:46.712048 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2347/4458] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:45 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:46.728846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e758b9ac-0f90-479e-946b-3ee5b7ca5cbd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:46.729469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e758b9ac-0f90-479e-946b-3ee5b7ca5cbd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:46.737067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e758b9ac-0f90-479e-946b-3ee5b7ca5cbd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:46.737881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e758b9ac-0f90-479e-946b-3ee5b7ca5cbd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:46.739040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e758b9ac-0f90-479e-946b-3ee5b7ca5cbd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:46.740679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e758b9ac-0f90-479e-946b-3ee5b7ca5cbd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:46.741391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e758b9ac-0f90-479e-946b-3ee5b7ca5cbd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:46.741998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e758b9ac-0f90-479e-946b-3ee5b7ca5cbd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:46.897363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:46.898121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:46.907139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:46.909749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:46.910565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:46.911423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:46.912428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:46.913164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:47.132326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e758b9ac-0f90-479e-946b-3ee5b7ca5cbd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:47.148594 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e758b9ac-0f90-479e-946b-3ee5b7ca5cbd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1309 microversion: 2.1 time: 0.423592 Aug 09 17:33:47.162871 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2112/4459] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:46 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1309 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:47.206904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f8f06787-41b8-499f-906b-115f5526c0ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:47.207911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f8f06787-41b8-499f-906b-115f5526c0ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:47.218601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f06787-41b8-499f-906b-115f5526c0ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:47.224490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f06787-41b8-499f-906b-115f5526c0ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:47.225464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f06787-41b8-499f-906b-115f5526c0ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:47.226963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f06787-41b8-499f-906b-115f5526c0ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:47.227678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f06787-41b8-499f-906b-115f5526c0ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:47.228351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f06787-41b8-499f-906b-115f5526c0ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:47.344333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:47.359937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:47.361634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:47.365424 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-292bd5bb-5b62-43f5-9241-07a3a34a7ad9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.472360 Aug 09 17:33:47.370146 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2348/4460] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:46 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:47.391544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f8f06787-41b8-499f-906b-115f5526c0ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:47.413976 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f8f06787-41b8-499f-906b-115f5526c0ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1277 microversion: 2.1 time: 0.210839 Aug 09 17:33:47.415229 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2113/4461] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:47 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:33:47.756212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f90e2b56-4263-4144-942d-e52d0d3d179b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:47.760265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f90e2b56-4263-4144-942d-e52d0d3d179b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:47.788845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f90e2b56-4263-4144-942d-e52d0d3d179b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:47.790101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f90e2b56-4263-4144-942d-e52d0d3d179b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:47.791195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f90e2b56-4263-4144-942d-e52d0d3d179b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:47.793346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f90e2b56-4263-4144-942d-e52d0d3d179b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:47.794517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f90e2b56-4263-4144-942d-e52d0d3d179b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:47.795522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f90e2b56-4263-4144-942d-e52d0d3d179b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:48.108390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f90e2b56-4263-4144-942d-e52d0d3d179b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:48.118629 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f90e2b56-4263-4144-942d-e52d0d3d179b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 0.381942 Aug 09 17:33:48.119871 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2349/4462] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:47 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:48.189689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-51656131-daec-4b84-9e74-e2e50912f731 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:48.191013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-51656131-daec-4b84-9e74-e2e50912f731 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:48.207806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51656131-daec-4b84-9e74-e2e50912f731 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:48.209443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51656131-daec-4b84-9e74-e2e50912f731 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:48.211371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51656131-daec-4b84-9e74-e2e50912f731 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:48.213483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51656131-daec-4b84-9e74-e2e50912f731 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:48.214371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51656131-daec-4b84-9e74-e2e50912f731 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:48.215612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51656131-daec-4b84-9e74-e2e50912f731 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:48.415853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:48.422774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:48.451444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:48.452311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:48.453080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:48.454358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:48.455436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:48.456812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:48.839061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:48.855035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:48.856840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:48.858084 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-833ffbd9-9087-4022-98dc-5a411bb74241 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.451078 Aug 09 17:33:48.858667 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2350/4463] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:48 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:33:48.875580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74d56b22-9495-4b35-be37-a15a8eed796e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:48.876413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-74d56b22-9495-4b35-be37-a15a8eed796e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:48.887811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d56b22-9495-4b35-be37-a15a8eed796e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:48.889012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d56b22-9495-4b35-be37-a15a8eed796e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:48.889676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d56b22-9495-4b35-be37-a15a8eed796e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:48.890617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d56b22-9495-4b35-be37-a15a8eed796e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:48.892073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d56b22-9495-4b35-be37-a15a8eed796e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:48.892577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d56b22-9495-4b35-be37-a15a8eed796e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:49.021578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-74d56b22-9495-4b35-be37-a15a8eed796e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:49.037203 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-74d56b22-9495-4b35-be37-a15a8eed796e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1277 microversion: 2.1 time: 0.165398 Aug 09 17:33:49.052599 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2351/4464] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:48 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:49.062782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-769118d7-ddfb-418e-b9cd-c05f5eac4c62 req-abadc512-d4de-4366-a857-1a2e89c65961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "tag": "4f7a2502-f30f-4735-9904-fbf8a52eb998"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:49.076174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-769118d7-ddfb-418e-b9cd-c05f5eac4c62 req-abadc512-d4de-4366-a857-1a2e89c65961 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:49.077249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-769118d7-ddfb-418e-b9cd-c05f5eac4c62 req-abadc512-d4de-4366-a857-1a2e89c65961 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:49.078531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-769118d7-ddfb-418e-b9cd-c05f5eac4c62 req-abadc512-d4de-4366-a857-1a2e89c65961 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:49.097757 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-769118d7-ddfb-418e-b9cd-c05f5eac4c62 req-abadc512-d4de-4366-a857-1a2e89c65961 service nova] Creating event network-changed:4f7a2502-f30f-4735-9904-fbf8a52eb998 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:33:49.105419 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-769118d7-ddfb-418e-b9cd-c05f5eac4c62 req-abadc512-d4de-4366-a857-1a2e89c65961 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060987 Aug 09 17:33:49.106457 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2352/4465] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:49.162563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f2eaf5f-9217-4949-bbb8-dabb72fd7568 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:49.163403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f2eaf5f-9217-4949-bbb8-dabb72fd7568 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:49.174178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2eaf5f-9217-4949-bbb8-dabb72fd7568 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:49.174757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2eaf5f-9217-4949-bbb8-dabb72fd7568 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:49.175272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2eaf5f-9217-4949-bbb8-dabb72fd7568 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:49.176089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2eaf5f-9217-4949-bbb8-dabb72fd7568 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:49.177208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2eaf5f-9217-4949-bbb8-dabb72fd7568 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:49.178426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2eaf5f-9217-4949-bbb8-dabb72fd7568 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:49.183789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-51656131-daec-4b84-9e74-e2e50912f731 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:49.191935 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-51656131-daec-4b84-9e74-e2e50912f731 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1309 microversion: 2.1 time: 1.024502 Aug 09 17:33:49.208000 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2114/4466] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:48 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1309 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:49.810342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9f2eaf5f-9217-4949-bbb8-dabb72fd7568 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:49.844456 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f2eaf5f-9217-4949-bbb8-dabb72fd7568 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 0.691541 Aug 09 17:33:49.846424 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2353/4467] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:49 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:33:49.883188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:49.883861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:49.894522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:49.895136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:49.895665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:49.902473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:49.903137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:49.905990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:50.031904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3ad946ef-6062-4625-a3a1-c04d74e96354 req-f43b226d-cb59-4acd-b67a-63b98ac96377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb12d9f-3932-4603-bacc-5df2748c70a5", "name": "network-vif-plugged", "status": "completed", "tag": "691c25b0-5f7d-4f8b-9d77-7efa6541fdd4"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:50.050125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:50.076075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ad946ef-6062-4625-a3a1-c04d74e96354 req-f43b226d-cb59-4acd-b67a-63b98ac96377 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:50.081714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ad946ef-6062-4625-a3a1-c04d74e96354 req-f43b226d-cb59-4acd-b67a-63b98ac96377 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:50.083854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ad946ef-6062-4625-a3a1-c04d74e96354 req-f43b226d-cb59-4acd-b67a-63b98ac96377 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:50.148849 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3ad946ef-6062-4625-a3a1-c04d74e96354 req-f43b226d-cb59-4acd-b67a-63b98ac96377 service nova] Creating event network-vif-plugged:691c25b0-5f7d-4f8b-9d77-7efa6541fdd4 for instance bfb12d9f-3932-4603-bacc-5df2748c70a5 on n-h2-845781-6 Aug 09 17:33:50.156444 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3ad946ef-6062-4625-a3a1-c04d74e96354 req-f43b226d-cb59-4acd-b67a-63b98ac96377 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132537 Aug 09 17:33:50.159536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2354/4468] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:50.169936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93cd761a-841e-45ef-8524-1d9e1ecc94ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:50.171439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-93cd761a-841e-45ef-8524-1d9e1ecc94ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:50.185012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93cd761a-841e-45ef-8524-1d9e1ecc94ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:50.186145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93cd761a-841e-45ef-8524-1d9e1ecc94ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:50.187228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93cd761a-841e-45ef-8524-1d9e1ecc94ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:50.195120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93cd761a-841e-45ef-8524-1d9e1ecc94ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:50.197697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93cd761a-841e-45ef-8524-1d9e1ecc94ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:50.199510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93cd761a-841e-45ef-8524-1d9e1ecc94ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:50.605866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-93cd761a-841e-45ef-8524-1d9e1ecc94ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:50.614469 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-93cd761a-841e-45ef-8524-1d9e1ecc94ab tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1319 microversion: 2.1 time: 0.450568 Aug 09 17:33:50.624398 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2355/4469] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:50 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:50.630419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c19ea0a-0db2-41ee-a273-33225d49702d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:50.631089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7c19ea0a-0db2-41ee-a273-33225d49702d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:50.649789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c19ea0a-0db2-41ee-a273-33225d49702d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:50.650623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c19ea0a-0db2-41ee-a273-33225d49702d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:50.652350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c19ea0a-0db2-41ee-a273-33225d49702d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:50.654045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c19ea0a-0db2-41ee-a273-33225d49702d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:50.655849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c19ea0a-0db2-41ee-a273-33225d49702d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:50.658073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c19ea0a-0db2-41ee-a273-33225d49702d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:50.898133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:50.923270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7c19ea0a-0db2-41ee-a273-33225d49702d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:50.934299 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7c19ea0a-0db2-41ee-a273-33225d49702d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1309 microversion: 2.1 time: 0.308663 Aug 09 17:33:50.935665 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2356/4470] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:50 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1309 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:50.945829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:50.949049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b91cc78c-e9e3-4be9-a6cc-3994519bdc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:50.949278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:50.954613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b91cc78c-e9e3-4be9-a6cc-3994519bdc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:50.958542 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d8faa0e4-51a7-43cf-9fe0-416309241dc4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.079718 Aug 09 17:33:50.960091 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2115/4471] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:49 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:50.974628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b91cc78c-e9e3-4be9-a6cc-3994519bdc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:50.975222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b91cc78c-e9e3-4be9-a6cc-3994519bdc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:50.976013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b91cc78c-e9e3-4be9-a6cc-3994519bdc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:50.977505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b91cc78c-e9e3-4be9-a6cc-3994519bdc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:50.978068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b91cc78c-e9e3-4be9-a6cc-3994519bdc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:50.978617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b91cc78c-e9e3-4be9-a6cc-3994519bdc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:51.290556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b91cc78c-e9e3-4be9-a6cc-3994519bdc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:51.308369 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b91cc78c-e9e3-4be9-a6cc-3994519bdc75 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 0.371071 Aug 09 17:33:51.309539 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2357/4472] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:50 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:51.661388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-019de079-dc2f-4688-b736-598d12a896bd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:51.663590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-019de079-dc2f-4688-b736-598d12a896bd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:51.705194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019de079-dc2f-4688-b736-598d12a896bd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:51.708132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019de079-dc2f-4688-b736-598d12a896bd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:51.710611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019de079-dc2f-4688-b736-598d12a896bd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:51.715821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019de079-dc2f-4688-b736-598d12a896bd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:51.721636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019de079-dc2f-4688-b736-598d12a896bd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:51.723361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-019de079-dc2f-4688-b736-598d12a896bd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:51.970124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c6f0c5dc-6baf-4ab1-9989-0e55ecab987f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:51.979646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c6f0c5dc-6baf-4ab1-9989-0e55ecab987f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:52.015478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5dc-6baf-4ab1-9989-0e55ecab987f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:52.021145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5dc-6baf-4ab1-9989-0e55ecab987f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:52.022639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5dc-6baf-4ab1-9989-0e55ecab987f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:52.027302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5dc-6baf-4ab1-9989-0e55ecab987f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:52.029831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5dc-6baf-4ab1-9989-0e55ecab987f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:52.032417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c6f0c5dc-6baf-4ab1-9989-0e55ecab987f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:52.374454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c6f0c5dc-6baf-4ab1-9989-0e55ecab987f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:52.398779 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c6f0c5dc-6baf-4ab1-9989-0e55ecab987f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1489 microversion: 2.1 time: 0.444280 Aug 09 17:33:52.418828 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2358/4473] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:51 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1489 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:52.428017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:52.430764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:52.471002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:52.474084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:52.474954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:52.476318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:52.477149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:52.498764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:52.895076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-019de079-dc2f-4688-b736-598d12a896bd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:52.915597 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-019de079-dc2f-4688-b736-598d12a896bd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1319 microversion: 2.1 time: 1.266087 Aug 09 17:33:52.931426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:52.947074 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2116/4474] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:51 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1319 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:52.953251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:52.958813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7c6ef7a-bf36-4087-b964-7850e98e3961 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:52.960589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f7c6ef7a-bf36-4087-b964-7850e98e3961 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:52.973925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c6ef7a-bf36-4087-b964-7850e98e3961 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:52.975179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c6ef7a-bf36-4087-b964-7850e98e3961 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:52.976346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c6ef7a-bf36-4087-b964-7850e98e3961 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:52.978478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c6ef7a-bf36-4087-b964-7850e98e3961 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:52.979670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c6ef7a-bf36-4087-b964-7850e98e3961 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:52.980654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c6ef7a-bf36-4087-b964-7850e98e3961 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:53.146663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:53.186183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:53.190682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:53.195886 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2bc9c948-21cc-45cf-a155-7458b4e1fa0b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.786542 Aug 09 17:33:53.211760 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2359/4475] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:52 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:53.211760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9aa46d7d-205f-4fcf-be08-ec77fc19e4f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:53.212058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9aa46d7d-205f-4fcf-be08-ec77fc19e4f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:53.221855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9aa46d7d-205f-4fcf-be08-ec77fc19e4f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:53.224032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9aa46d7d-205f-4fcf-be08-ec77fc19e4f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:53.224686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9aa46d7d-205f-4fcf-be08-ec77fc19e4f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:53.227525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9aa46d7d-205f-4fcf-be08-ec77fc19e4f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:53.228486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9aa46d7d-205f-4fcf-be08-ec77fc19e4f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:53.230274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9aa46d7d-205f-4fcf-be08-ec77fc19e4f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:53.515362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9aa46d7d-205f-4fcf-be08-ec77fc19e4f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:53.525775 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9aa46d7d-205f-4fcf-be08-ec77fc19e4f9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1489 microversion: 2.1 time: 0.325744 Aug 09 17:33:53.527094 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2360/4476] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:53 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1489 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:53.533831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:53.555226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b318bb3d-810c-4ad0-a7c2-4aee8458aed0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:53.558228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b318bb3d-810c-4ad0-a7c2-4aee8458aed0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:53.574832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b318bb3d-810c-4ad0-a7c2-4aee8458aed0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:53.576854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b318bb3d-810c-4ad0-a7c2-4aee8458aed0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:53.578044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b318bb3d-810c-4ad0-a7c2-4aee8458aed0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:53.579505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b318bb3d-810c-4ad0-a7c2-4aee8458aed0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:53.580446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b318bb3d-810c-4ad0-a7c2-4aee8458aed0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:53.581258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b318bb3d-810c-4ad0-a7c2-4aee8458aed0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:53.828685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b318bb3d-810c-4ad0-a7c2-4aee8458aed0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:53.852924 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b318bb3d-810c-4ad0-a7c2-4aee8458aed0 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1489 microversion: 2.1 time: 0.307314 Aug 09 17:33:53.855826 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2361/4477] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:53 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1489 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:53.893850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-caa2185a-cac6-432e-a9bf-026ae4209adc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:53.895783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-caa2185a-cac6-432e-a9bf-026ae4209adc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:53.906623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-caa2185a-cac6-432e-a9bf-026ae4209adc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:53.908131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-caa2185a-cac6-432e-a9bf-026ae4209adc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:53.909192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-caa2185a-cac6-432e-a9bf-026ae4209adc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:53.910945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-caa2185a-cac6-432e-a9bf-026ae4209adc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:53.912476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-caa2185a-cac6-432e-a9bf-026ae4209adc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:53.913627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-caa2185a-cac6-432e-a9bf-026ae4209adc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:53.922726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f7c6ef7a-bf36-4087-b964-7850e98e3961 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:53.964125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:53.986850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-caa2185a-cac6-432e-a9bf-026ae4209adc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:33:54.000456 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f7c6ef7a-bf36-4087-b964-7850e98e3961 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 1.050846 Aug 09 17:33:54.005367 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2117/4478] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:52 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:54.049181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-c9e2c2ed-7ca0-41ab-b700-f5a8f36ea618 req-c3449e0c-302f-418e-855c-6777fa8bee33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "tag": "cf24c4a2-69bb-44f3-8087-c67d8fe70264"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:54.077487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c9e2c2ed-7ca0-41ab-b700-f5a8f36ea618 req-c3449e0c-302f-418e-855c-6777fa8bee33 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:54.078866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c9e2c2ed-7ca0-41ab-b700-f5a8f36ea618 req-c3449e0c-302f-418e-855c-6777fa8bee33 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:54.080583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c9e2c2ed-7ca0-41ab-b700-f5a8f36ea618 req-c3449e0c-302f-418e-855c-6777fa8bee33 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:54.116538 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-c9e2c2ed-7ca0-41ab-b700-f5a8f36ea618 req-c3449e0c-302f-418e-855c-6777fa8bee33 service nova] Creating event network-changed:cf24c4a2-69bb-44f3-8087-c67d8fe70264 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:33:54.133853 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-c9e2c2ed-7ca0-41ab-b700-f5a8f36ea618 req-c3449e0c-302f-418e-855c-6777fa8bee33 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126001 Aug 09 17:33:54.136705 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2118/4479] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:54.151904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0079f387-6b23-4c68-ac77-245d35378c89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:54.156768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0079f387-6b23-4c68-ac77-245d35378c89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:54.188603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0079f387-6b23-4c68-ac77-245d35378c89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:54.190472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0079f387-6b23-4c68-ac77-245d35378c89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:54.191444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0079f387-6b23-4c68-ac77-245d35378c89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:54.195285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0079f387-6b23-4c68-ac77-245d35378c89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:54.196494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0079f387-6b23-4c68-ac77-245d35378c89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:54.197163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0079f387-6b23-4c68-ac77-245d35378c89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:54.295977 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-caa2185a-cac6-432e-a9bf-026ae4209adc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 204 len: 0 microversion: 2.1 time: 0.409263 Aug 09 17:33:54.303588 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2362/4480] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:33:53 2022] DELETE /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:33:54.311909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:54.319341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:54.329666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:54.330092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:54.330540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:54.331796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:54.332319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:54.332755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:54.707131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:54.719714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:54.722405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:54.724769 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9b64e48c-48f7-40ae-85cd-6b47a163f771 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.419630 Aug 09 17:33:54.726175 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2363/4481] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:54 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:54.733034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc87d42a-c1bf-458d-ad55-ec8865d13c7a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:54.733965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bc87d42a-c1bf-458d-ad55-ec8865d13c7a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:54.742457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87d42a-c1bf-458d-ad55-ec8865d13c7a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:54.743246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87d42a-c1bf-458d-ad55-ec8865d13c7a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:54.743987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87d42a-c1bf-458d-ad55-ec8865d13c7a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:54.744924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87d42a-c1bf-458d-ad55-ec8865d13c7a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:54.745580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87d42a-c1bf-458d-ad55-ec8865d13c7a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:54.746187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87d42a-c1bf-458d-ad55-ec8865d13c7a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:54.986642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bc87d42a-c1bf-458d-ad55-ec8865d13c7a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:55.001530 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bc87d42a-c1bf-458d-ad55-ec8865d13c7a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1495 microversion: 2.1 time: 0.273320 Aug 09 17:33:55.002164 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2364/4482] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:54 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1495 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:55.041284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b957a6c7-3cc4-4f54-b338-98dc86fca8d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:55.042191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b957a6c7-3cc4-4f54-b338-98dc86fca8d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:55.060805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-3cc4-4f54-b338-98dc86fca8d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:55.062853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-3cc4-4f54-b338-98dc86fca8d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:55.064065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-3cc4-4f54-b338-98dc86fca8d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:55.069920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-3cc4-4f54-b338-98dc86fca8d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:55.071145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-3cc4-4f54-b338-98dc86fca8d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:55.071820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b957a6c7-3cc4-4f54-b338-98dc86fca8d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:55.258781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0079f387-6b23-4c68-ac77-245d35378c89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:55.280676 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0079f387-6b23-4c68-ac77-245d35378c89 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1319 microversion: 2.1 time: 1.140983 Aug 09 17:33:55.296192 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2119/4483] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:54 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1319 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:55.527006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b957a6c7-3cc4-4f54-b338-98dc86fca8d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:55.584808 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b957a6c7-3cc4-4f54-b338-98dc86fca8d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1511 microversion: 2.1 time: 0.534830 Aug 09 17:33:55.588127 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2365/4484] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:55 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1511 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:33:55.770832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:55.771567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:55.774340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:55.794476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:55.795415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:55.795544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:55.797228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:55.797228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:55.797228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:56.044499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0f879214-cedd-4309-85d0-61307d46b088 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:56.046605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0f879214-cedd-4309-85d0-61307d46b088 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:56.059763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f879214-cedd-4309-85d0-61307d46b088 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:56.061116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f879214-cedd-4309-85d0-61307d46b088 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:56.062227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f879214-cedd-4309-85d0-61307d46b088 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:56.064164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f879214-cedd-4309-85d0-61307d46b088 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:56.065382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f879214-cedd-4309-85d0-61307d46b088 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:56.067022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f879214-cedd-4309-85d0-61307d46b088 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:56.494289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0f879214-cedd-4309-85d0-61307d46b088 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:56.511790 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0f879214-cedd-4309-85d0-61307d46b088 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1495 microversion: 2.1 time: 0.473896 Aug 09 17:33:56.513730 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2366/4485] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:56 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1495 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:33:56.522633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b06f261d-8a01-4036-b494-0963ff9ff888 req-cc559f06-23b2-43fd-8779-849ef2e11453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab7eacc-f17d-42aa-b80d-150c57cb9ed1", "tag": "8921d998-158f-49ea-a80e-b467a9534234"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:56.538809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b06f261d-8a01-4036-b494-0963ff9ff888 req-cc559f06-23b2-43fd-8779-849ef2e11453 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:56.540615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b06f261d-8a01-4036-b494-0963ff9ff888 req-cc559f06-23b2-43fd-8779-849ef2e11453 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:56.541549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b06f261d-8a01-4036-b494-0963ff9ff888 req-cc559f06-23b2-43fd-8779-849ef2e11453 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:56.559916 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b06f261d-8a01-4036-b494-0963ff9ff888 req-cc559f06-23b2-43fd-8779-849ef2e11453 service nova] Creating event network-changed:8921d998-158f-49ea-a80e-b467a9534234 for instance cab7eacc-f17d-42aa-b80d-150c57cb9ed1 on n-h1-845781-6 Aug 09 17:33:56.571206 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b06f261d-8a01-4036-b494-0963ff9ff888 req-cc559f06-23b2-43fd-8779-849ef2e11453 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055598 Aug 09 17:33:56.572429 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2367/4486] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:56.579352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f45d6e6-ad45-400c-bbc1-7868623d9b54 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:56.580036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5f45d6e6-ad45-400c-bbc1-7868623d9b54 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:56.586984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f45d6e6-ad45-400c-bbc1-7868623d9b54 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:56.587738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f45d6e6-ad45-400c-bbc1-7868623d9b54 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:56.588331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f45d6e6-ad45-400c-bbc1-7868623d9b54 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:56.589239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f45d6e6-ad45-400c-bbc1-7868623d9b54 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:56.589956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f45d6e6-ad45-400c-bbc1-7868623d9b54 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:56.590553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f45d6e6-ad45-400c-bbc1-7868623d9b54 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:56.776304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f45d6e6-ad45-400c-bbc1-7868623d9b54 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:56.789463 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f45d6e6-ad45-400c-bbc1-7868623d9b54 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1319 microversion: 2.1 time: 0.215132 Aug 09 17:33:56.790543 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2368/4487] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:56 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:56.799783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-16b0395c-a3b0-4f4c-ad87-6438120d63b4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:56.801595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-16b0395c-a3b0-4f4c-ad87-6438120d63b4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:56.822774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16b0395c-a3b0-4f4c-ad87-6438120d63b4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:56.824376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16b0395c-a3b0-4f4c-ad87-6438120d63b4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:56.826383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16b0395c-a3b0-4f4c-ad87-6438120d63b4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:56.828060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16b0395c-a3b0-4f4c-ad87-6438120d63b4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:56.829036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16b0395c-a3b0-4f4c-ad87-6438120d63b4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:56.829876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16b0395c-a3b0-4f4c-ad87-6438120d63b4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:57.066874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16b0395c-a3b0-4f4c-ad87-6438120d63b4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:57.078698 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-16b0395c-a3b0-4f4c-ad87-6438120d63b4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1488 microversion: 2.1 time: 0.285885 Aug 09 17:33:57.079986 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2369/4488] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:56 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1488 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:57.123715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2c479b77-3654-427c-830b-6164f844d816 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:57.128681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2c479b77-3654-427c-830b-6164f844d816 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:57.141324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c479b77-3654-427c-830b-6164f844d816 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:57.142233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c479b77-3654-427c-830b-6164f844d816 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:57.143404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c479b77-3654-427c-830b-6164f844d816 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:57.145288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c479b77-3654-427c-830b-6164f844d816 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:57.146111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c479b77-3654-427c-830b-6164f844d816 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:57.147086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c479b77-3654-427c-830b-6164f844d816 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:57.173896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:57.190876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:57.193685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:57.196605 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9588a3c1-ff5e-42b8-93aa-698428d30ee0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.436527 Aug 09 17:33:57.198514 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2120/4489] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:55 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:57.232856 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2c479b77-3654-427c-830b-6164f844d816 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 200 len: 152 microversion: 2.1 time: 0.118320 Aug 09 17:33:57.233811 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2370/4490] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:33:57 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 152 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:57.248777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7e9a1dd5-47db-4d21-ae38-bff37f352540 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:57.249682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7e9a1dd5-47db-4d21-ae38-bff37f352540 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:57.261114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e9a1dd5-47db-4d21-ae38-bff37f352540 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:57.261943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e9a1dd5-47db-4d21-ae38-bff37f352540 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:57.263003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e9a1dd5-47db-4d21-ae38-bff37f352540 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:57.264563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e9a1dd5-47db-4d21-ae38-bff37f352540 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:57.265554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e9a1dd5-47db-4d21-ae38-bff37f352540 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:57.266181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e9a1dd5-47db-4d21-ae38-bff37f352540 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:57.541371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6393eb31-4393-4c7c-9df3-c45d105d7a05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:57.542893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6393eb31-4393-4c7c-9df3-c45d105d7a05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:57.556492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6393eb31-4393-4c7c-9df3-c45d105d7a05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:57.557385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6393eb31-4393-4c7c-9df3-c45d105d7a05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:57.558904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6393eb31-4393-4c7c-9df3-c45d105d7a05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:57.560556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6393eb31-4393-4c7c-9df3-c45d105d7a05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:57.561768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6393eb31-4393-4c7c-9df3-c45d105d7a05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:57.563048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6393eb31-4393-4c7c-9df3-c45d105d7a05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:58.038253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6393eb31-4393-4c7c-9df3-c45d105d7a05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:58.073599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7e9a1dd5-47db-4d21-ae38-bff37f352540 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:58.077499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:33:58.078583 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6393eb31-4393-4c7c-9df3-c45d105d7a05 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1495 microversion: 2.1 time: 0.542196 Aug 09 17:33:58.086002 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2371/4491] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:57 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1495 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:58.088008 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7e9a1dd5-47db-4d21-ae38-bff37f352540 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.845877 Aug 09 17:33:58.089132 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2121/4492] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:57 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:58.148766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-88d85a71-23ea-4caa-b642-8a9f7ab29490 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:58.149667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-88d85a71-23ea-4caa-b642-8a9f7ab29490 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:58.163093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-37f3cdd8-aa24-4b28-b798-30e57e286bdc tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:58.163758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-37f3cdd8-aa24-4b28-b798-30e57e286bdc tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:58.183558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88d85a71-23ea-4caa-b642-8a9f7ab29490 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:58.184455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88d85a71-23ea-4caa-b642-8a9f7ab29490 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:58.184604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88d85a71-23ea-4caa-b642-8a9f7ab29490 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:58.185236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88d85a71-23ea-4caa-b642-8a9f7ab29490 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:58.188524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88d85a71-23ea-4caa-b642-8a9f7ab29490 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:58.189775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-88d85a71-23ea-4caa-b642-8a9f7ab29490 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:58.192382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37f3cdd8-aa24-4b28-b798-30e57e286bdc tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:58.192870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37f3cdd8-aa24-4b28-b798-30e57e286bdc tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:58.197505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37f3cdd8-aa24-4b28-b798-30e57e286bdc tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:58.198702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37f3cdd8-aa24-4b28-b798-30e57e286bdc tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:58.206952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37f3cdd8-aa24-4b28-b798-30e57e286bdc tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:58.208350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37f3cdd8-aa24-4b28-b798-30e57e286bdc tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:58.791452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-88d85a71-23ea-4caa-b642-8a9f7ab29490 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:58.810089 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-88d85a71-23ea-4caa-b642-8a9f7ab29490 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.663477 Aug 09 17:33:58.813179 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2122/4493] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:58 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:33:58.827857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:58.828920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:58.855044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:58.863225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:58.865358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:58.872082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:58.873339 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:58.874439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:59.232510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-37f3cdd8-aa24-4b28-b798-30e57e286bdc tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:59.241635 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-37f3cdd8-aa24-4b28-b798-30e57e286bdc tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1319 microversion: 2.1 time: 1.153482 Aug 09 17:33:59.245915 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2372/4494] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:58 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1319 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:59.254463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-26fce18c-cafb-4a2c-92cd-72942e97077d req-c3da4cc2-e015-405c-99ad-2d02f04f10d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb12d9f-3932-4603-bacc-5df2748c70a5", "name": "network-vif-deleted", "tag": "691c25b0-5f7d-4f8b-9d77-7efa6541fdd4"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:33:59.279875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-26fce18c-cafb-4a2c-92cd-72942e97077d req-c3da4cc2-e015-405c-99ad-2d02f04f10d5 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:59.281066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-26fce18c-cafb-4a2c-92cd-72942e97077d req-c3da4cc2-e015-405c-99ad-2d02f04f10d5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:59.286214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-26fce18c-cafb-4a2c-92cd-72942e97077d req-c3da4cc2-e015-405c-99ad-2d02f04f10d5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:59.318368 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-26fce18c-cafb-4a2c-92cd-72942e97077d req-c3da4cc2-e015-405c-99ad-2d02f04f10d5 service nova] Creating event network-vif-deleted:691c25b0-5f7d-4f8b-9d77-7efa6541fdd4 for instance bfb12d9f-3932-4603-bacc-5df2748c70a5 on n-h2-845781-6 Aug 09 17:33:59.332932 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-26fce18c-cafb-4a2c-92cd-72942e97077d req-c3da4cc2-e015-405c-99ad-2d02f04f10d5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084780 Aug 09 17:33:59.337438 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2373/4495] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:33:59.361640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4f4eedef-9d2b-4c7c-9077-c96051dc2c0b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:59.362836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4f4eedef-9d2b-4c7c-9077-c96051dc2c0b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:59.374145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f4eedef-9d2b-4c7c-9077-c96051dc2c0b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:59.380894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f4eedef-9d2b-4c7c-9077-c96051dc2c0b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:59.382289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f4eedef-9d2b-4c7c-9077-c96051dc2c0b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:59.383587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f4eedef-9d2b-4c7c-9077-c96051dc2c0b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:59.384501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f4eedef-9d2b-4c7c-9077-c96051dc2c0b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:59.386072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f4eedef-9d2b-4c7c-9077-c96051dc2c0b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:59.423274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:59.441576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:59.455070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:59.459502 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5daf60cc-23ce-4001-8746-8c593cbbc49d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.644420 Aug 09 17:33:59.460461 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2123/4496] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:33:58 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:33:59.480448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:59.481379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:59.492734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:59.496402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:59.497116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:59.498080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:59.507223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:59.508043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:59.577836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:59.586731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:59.587470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:59.588335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lazy-loading 'fault' on Instance uuid bfb12d9f-3932-4603-bacc-5df2748c70a5 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:33:59.724710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:59.738349 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-68c0cd39-2932-4412-9d31-d69c14462d1d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 200 len: 1299 microversion: 2.1 time: 0.274514 Aug 09 17:33:59.740196 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2124/4497] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:59 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 1299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:59.773758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4f4eedef-9d2b-4c7c-9077-c96051dc2c0b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:33:59.786294 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4f4eedef-9d2b-4c7c-9077-c96051dc2c0b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.445581 Aug 09 17:33:59.787689 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2374/4498] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:59 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:33:59.819795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d2b96496-f0be-49e1-b5e0-36e1d0c6f480 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:33:59.820757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d2b96496-f0be-49e1-b5e0-36e1d0c6f480 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:33:59.830441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2b96496-f0be-49e1-b5e0-36e1d0c6f480 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:59.831219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2b96496-f0be-49e1-b5e0-36e1d0c6f480 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:59.832271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2b96496-f0be-49e1-b5e0-36e1d0c6f480 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:33:59.833194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2b96496-f0be-49e1-b5e0-36e1d0c6f480 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:33:59.834580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2b96496-f0be-49e1-b5e0-36e1d0c6f480 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:33:59.835220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2b96496-f0be-49e1-b5e0-36e1d0c6f480 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:00.266347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4b4c65ca-7ef7-4f8a-9faa-348fd9c8299e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:00.271317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4b4c65ca-7ef7-4f8a-9faa-348fd9c8299e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:00.298145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b4c65ca-7ef7-4f8a-9faa-348fd9c8299e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:00.299262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b4c65ca-7ef7-4f8a-9faa-348fd9c8299e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:00.300126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b4c65ca-7ef7-4f8a-9faa-348fd9c8299e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:00.301970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b4c65ca-7ef7-4f8a-9faa-348fd9c8299e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:00.303050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b4c65ca-7ef7-4f8a-9faa-348fd9c8299e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:00.304786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b4c65ca-7ef7-4f8a-9faa-348fd9c8299e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:00.384039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d2b96496-f0be-49e1-b5e0-36e1d0c6f480 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:00.398641 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d2b96496-f0be-49e1-b5e0-36e1d0c6f480 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.584074 Aug 09 17:34:00.399708 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2125/4499] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:33:59 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:00.493819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:00.495022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:00.530132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:00.538765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:00.541431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:00.549465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:00.550902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:00.553198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:00.776582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4b4c65ca-7ef7-4f8a-9faa-348fd9c8299e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:00.793832 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4b4c65ca-7ef7-4f8a-9faa-348fd9c8299e tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1319 microversion: 2.1 time: 0.532418 Aug 09 17:34:00.794711 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2375/4500] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:00 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:00.808005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:00.809005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:00.822365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:00.824409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:00.829329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:00.831682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:00.832929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:00.835617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:00.879685 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 HTTP/1.1 Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'bfb12d9f-3932-4603-bacc-5df2748c70a5'} Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:34:00.882270 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:00.888424 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:00.888424 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:34:00.888424 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:34:00.888424 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:34:00.888424 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:34:00.888424 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:34:00.888424 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:00.896449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:34:00.898052 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07b65e77-badd-4f06-8d14-405dfc391522 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 404 len: 111 microversion: 2.1 time: 0.101667 Aug 09 17:34:00.898866 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2376/4501] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:00 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:34:00.914898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c98e8bf-43a6-47b2-be9d-71a88639322f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:00.915721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c98e8bf-43a6-47b2-be9d-71a88639322f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:00.931901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c98e8bf-43a6-47b2-be9d-71a88639322f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:00.939546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c98e8bf-43a6-47b2-be9d-71a88639322f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:00.940221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c98e8bf-43a6-47b2-be9d-71a88639322f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:00.941173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c98e8bf-43a6-47b2-be9d-71a88639322f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:00.942418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c98e8bf-43a6-47b2-be9d-71a88639322f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:00.944112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c98e8bf-43a6-47b2-be9d-71a88639322f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:01.028736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c98e8bf-43a6-47b2-be9d-71a88639322f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:34:01.246520 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c98e8bf-43a6-47b2-be9d-71a88639322f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 204 len: 0 microversion: 2.1 time: 0.341805 Aug 09 17:34:01.249819 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2377/4502] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:34:00 2022] DELETE /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:34:01.263397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1529525257", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "57c98899-0caf-4592-be88-405da8266825"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:01.356005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] validate_networks() for [('57c98899-0caf-4592-be88-405da8266825', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:34:01.415774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:01.426495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:01.433313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:01.437397 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6c47c47a-f085-40b7-b081-3cc3676a86b0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.954296 Aug 09 17:34:01.444511 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2126/4503] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:00 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:01.450080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e7495abb-5486-45ec-b91e-5b3e26b7793d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:01.451054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e7495abb-5486-45ec-b91e-5b3e26b7793d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:01.467654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7495abb-5486-45ec-b91e-5b3e26b7793d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:01.470979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7495abb-5486-45ec-b91e-5b3e26b7793d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:01.471918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7495abb-5486-45ec-b91e-5b3e26b7793d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:01.474997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7495abb-5486-45ec-b91e-5b3e26b7793d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:01.483816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7495abb-5486-45ec-b91e-5b3e26b7793d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:01.484629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7495abb-5486-45ec-b91e-5b3e26b7793d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:02.086337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e7495abb-5486-45ec-b91e-5b3e26b7793d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:02.108372 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e7495abb-5486-45ec-b91e-5b3e26b7793d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1495 microversion: 2.1 time: 0.662258 Aug 09 17:34:02.111299 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2127/4504] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:01 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1495 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:02.129951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-564e0eb8-4065-450e-9172-cbdb632c8843 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:02.131097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-564e0eb8-4065-450e-9172-cbdb632c8843 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:02.148168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-564e0eb8-4065-450e-9172-cbdb632c8843 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:02.148545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-564e0eb8-4065-450e-9172-cbdb632c8843 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:02.150644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-564e0eb8-4065-450e-9172-cbdb632c8843 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:02.155291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-564e0eb8-4065-450e-9172-cbdb632c8843 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:02.156142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-564e0eb8-4065-450e-9172-cbdb632c8843 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:02.156797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-564e0eb8-4065-450e-9172-cbdb632c8843 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:02.296693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:34:02.297435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:34:02.298095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:34:02.298691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:34:02.299567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:34:02.315872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:02.317959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:02.319165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:02.320778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:02.321787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:02.323254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:02.340543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:02.356883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:34:02.364244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for user 62572816b806440aa8338fea1d0a297e and project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:34:02.381741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:34:02.384918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:34:02.540866 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-84db0867-3450-4225-9d2b-da099b50f759 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.287876 Aug 09 17:34:02.558804 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2378/4505] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:34:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:34:02.587388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:02.589884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:02.620898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:02.624449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:02.631326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:02.633249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:02.634046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:02.635951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:02.849623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-564e0eb8-4065-450e-9172-cbdb632c8843 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:02.859294 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-564e0eb8-4065-450e-9172-cbdb632c8843 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1319 microversion: 2.1 time: 0.746713 Aug 09 17:34:02.859955 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2128/4506] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:02 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1319 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:02.884509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe2e4c5c-7135-4727-991b-2601b7afb002 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:02.885345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fe2e4c5c-7135-4727-991b-2601b7afb002 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:03.340831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fe2e4c5c-7135-4727-991b-2601b7afb002 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:03.364367 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fe2e4c5c-7135-4727-991b-2601b7afb002 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1215 microversion: 2.1 time: 0.498316 Aug 09 17:34:03.371542 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2129/4507] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:02 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1215 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:03.398565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-81b605ad-43a8-4456-acfc-b1d59f5506a7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:03.400644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-81b605ad-43a8-4456-acfc-b1d59f5506a7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:03.435878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b605ad-43a8-4456-acfc-b1d59f5506a7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:03.442887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b605ad-43a8-4456-acfc-b1d59f5506a7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:03.446061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b605ad-43a8-4456-acfc-b1d59f5506a7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:03.448536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b605ad-43a8-4456-acfc-b1d59f5506a7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:03.451377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b605ad-43a8-4456-acfc-b1d59f5506a7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:03.454836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-81b605ad-43a8-4456-acfc-b1d59f5506a7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:03.655556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:03.668626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:03.670854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:03.672612 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-346ecf65-be73-4a9b-9b1e-92d0cf31e988 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.112342 Aug 09 17:34:03.689270 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2379/4508] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:02 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:03.712689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-656b1602-dac2-4f65-9d2b-65c1557f9e0d req-1a3b0237-39e5-4216-b9fa-11d10e9f1926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab7eacc-f17d-42aa-b80d-150c57cb9ed1", "name": "network-vif-plugged", "status": "completed", "tag": "8921d998-158f-49ea-a80e-b467a9534234"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:03.768992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-656b1602-dac2-4f65-9d2b-65c1557f9e0d req-1a3b0237-39e5-4216-b9fa-11d10e9f1926 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:03.770379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-656b1602-dac2-4f65-9d2b-65c1557f9e0d req-1a3b0237-39e5-4216-b9fa-11d10e9f1926 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:03.771201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-656b1602-dac2-4f65-9d2b-65c1557f9e0d req-1a3b0237-39e5-4216-b9fa-11d10e9f1926 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:03.818176 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-656b1602-dac2-4f65-9d2b-65c1557f9e0d req-1a3b0237-39e5-4216-b9fa-11d10e9f1926 service nova] Creating event network-vif-plugged:8921d998-158f-49ea-a80e-b467a9534234 for instance cab7eacc-f17d-42aa-b80d-150c57cb9ed1 on n-h1-845781-6 Aug 09 17:34:03.843682 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-656b1602-dac2-4f65-9d2b-65c1557f9e0d req-1a3b0237-39e5-4216-b9fa-11d10e9f1926 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152176 Aug 09 17:34:03.845181 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2380/4509] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:03.898546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-decbc935-d695-433d-bf7f-1a5a941e9b7f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:03.902170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-decbc935-d695-433d-bf7f-1a5a941e9b7f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:03.939513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-decbc935-d695-433d-bf7f-1a5a941e9b7f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:03.940074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-decbc935-d695-433d-bf7f-1a5a941e9b7f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:03.946283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-decbc935-d695-433d-bf7f-1a5a941e9b7f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:03.948538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-decbc935-d695-433d-bf7f-1a5a941e9b7f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:03.949051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-decbc935-d695-433d-bf7f-1a5a941e9b7f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:03.954340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-decbc935-d695-433d-bf7f-1a5a941e9b7f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:04.764093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-decbc935-d695-433d-bf7f-1a5a941e9b7f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:04.775539 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-decbc935-d695-433d-bf7f-1a5a941e9b7f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1319 microversion: 2.1 time: 0.887907 Aug 09 17:34:04.780951 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2381/4510] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:03 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1319 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:04.795844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-84e8ce9b-bedc-4376-a8b0-7bb1826e1410 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:04.796871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-84e8ce9b-bedc-4376-a8b0-7bb1826e1410 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:04.812853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e8ce9b-bedc-4376-a8b0-7bb1826e1410 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:04.820897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e8ce9b-bedc-4376-a8b0-7bb1826e1410 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:04.821622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e8ce9b-bedc-4376-a8b0-7bb1826e1410 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:04.822664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e8ce9b-bedc-4376-a8b0-7bb1826e1410 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:04.823387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e8ce9b-bedc-4376-a8b0-7bb1826e1410 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:04.824223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84e8ce9b-bedc-4376-a8b0-7bb1826e1410 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:05.111180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-84e8ce9b-bedc-4376-a8b0-7bb1826e1410 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:05.134526 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-84e8ce9b-bedc-4376-a8b0-7bb1826e1410 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1275 microversion: 2.1 time: 0.351522 Aug 09 17:34:05.136513 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2382/4511] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:04 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1275 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:05.146888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:05.154727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:05.178321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:05.179883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:05.187796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:05.196575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-81b605ad-43a8-4456-acfc-b1d59f5506a7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:05.210786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:05.213017 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-81b605ad-43a8-4456-acfc-b1d59f5506a7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 200 len: 1495 microversion: 2.1 time: 1.839540 Aug 09 17:34:05.214953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:05.215723 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2130/4512] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:03 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 1495 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:05.216712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:05.544077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-99bf5a83-c29e-4134-9d8c-1240ada377d8 req-d4811236-9a18-403a-adaa-dce1f32dec47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e555d25-10e4-4fde-8477-95fcd23c1a93", "name": "network-vif-deleted", "tag": "f8011ee0-4a12-4aba-88f2-04751be38be9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:05.570354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-99bf5a83-c29e-4134-9d8c-1240ada377d8 req-d4811236-9a18-403a-adaa-dce1f32dec47 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:05.576015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-99bf5a83-c29e-4134-9d8c-1240ada377d8 req-d4811236-9a18-403a-adaa-dce1f32dec47 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:05.580056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-99bf5a83-c29e-4134-9d8c-1240ada377d8 req-d4811236-9a18-403a-adaa-dce1f32dec47 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:05.641070 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-99bf5a83-c29e-4134-9d8c-1240ada377d8 req-d4811236-9a18-403a-adaa-dce1f32dec47 service nova] Creating event network-vif-deleted:f8011ee0-4a12-4aba-88f2-04751be38be9 for instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 on n-h1-845781-6 Aug 09 17:34:05.682325 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-99bf5a83-c29e-4134-9d8c-1240ada377d8 req-d4811236-9a18-403a-adaa-dce1f32dec47 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140012 Aug 09 17:34:05.687015 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2131/4513] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:05.815460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5f4f5f7f-738c-4271-b251-25e2596e6677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:05.821245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5f4f5f7f-738c-4271-b251-25e2596e6677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:05.858825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f4f5f7f-738c-4271-b251-25e2596e6677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:05.875700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f4f5f7f-738c-4271-b251-25e2596e6677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:05.879688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f4f5f7f-738c-4271-b251-25e2596e6677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:05.881389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f4f5f7f-738c-4271-b251-25e2596e6677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:05.886799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f4f5f7f-738c-4271-b251-25e2596e6677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:05.892504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f4f5f7f-738c-4271-b251-25e2596e6677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:06.464902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:06.484051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:06.487727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:06.493482 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3f77cf60-0fe7-4241-bc09-9cfb91730aba tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.351351 Aug 09 17:34:06.496881 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2383/4514] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:05 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:06.511465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0eb29648-3f3c-4fe4-8abe-b0de029f4abf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:06.514192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0eb29648-3f3c-4fe4-8abe-b0de029f4abf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:06.549774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb29648-3f3c-4fe4-8abe-b0de029f4abf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:06.550501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb29648-3f3c-4fe4-8abe-b0de029f4abf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:06.551138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb29648-3f3c-4fe4-8abe-b0de029f4abf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:06.551869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb29648-3f3c-4fe4-8abe-b0de029f4abf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:06.556460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb29648-3f3c-4fe4-8abe-b0de029f4abf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:06.557082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb29648-3f3c-4fe4-8abe-b0de029f4abf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:06.982862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0eb29648-3f3c-4fe4-8abe-b0de029f4abf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:07.025790 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0eb29648-3f3c-4fe4-8abe-b0de029f4abf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1273 microversion: 2.1 time: 0.525172 Aug 09 17:34:07.033289 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2384/4515] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:06 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1273 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:07.067463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:07.070254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:07.087720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:07.088915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:07.089937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:07.091677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:07.094183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:07.096344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:07.137786 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 HTTP/1.1 Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '0e555d25-10e4-4fde-8477-95fcd23c1a93'} Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:34:07.143083 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:07.161344 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:07.161344 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:34:07.161344 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:34:07.161344 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:34:07.161344 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:34:07.161344 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:34:07.161344 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:07.165384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:34:07.167308 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4be8add5-8225-4d5e-9939-9377134faeba tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 404 len: 111 microversion: 2.1 time: 0.131465 Aug 09 17:34:07.170497 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2385/4516] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:07 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:34:07.214538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5f4f5f7f-738c-4271-b251-25e2596e6677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:07.219529 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5f4f5f7f-738c-4271-b251-25e2596e6677 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1319 microversion: 2.1 time: 1.418197 Aug 09 17:34:07.227677 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2132/4517] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:05 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1319 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:07.404641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1238919383", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "829cb0b3-9c78-4844-8875-46f5a554f097"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:07.487026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] validate_networks() for [('829cb0b3-9c78-4844-8875-46f5a554f097', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:34:07.521729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:07.522815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:07.529861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:07.530764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:07.531491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:07.532525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:07.533261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:07.533970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:08.430310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:08.465162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:08.468668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:08.472926 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cbcdc2ef-fcd5-44f4-b9e3-b045aaf4c809 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.955684 Aug 09 17:34:08.483078 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2133/4518] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:07 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:08.495956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-30f2b7da-e3aa-40e9-851c-85597ae810af tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:08.497745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-30f2b7da-e3aa-40e9-851c-85597ae810af tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:08.507341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f2b7da-e3aa-40e9-851c-85597ae810af tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:08.510637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f2b7da-e3aa-40e9-851c-85597ae810af tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:08.512874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f2b7da-e3aa-40e9-851c-85597ae810af tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:08.514486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f2b7da-e3aa-40e9-851c-85597ae810af tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:08.516272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f2b7da-e3aa-40e9-851c-85597ae810af tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:08.518380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-30f2b7da-e3aa-40e9-851c-85597ae810af tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:09.020130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-30f2b7da-e3aa-40e9-851c-85597ae810af tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:09.032234 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-30f2b7da-e3aa-40e9-851c-85597ae810af tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1315 microversion: 2.1 time: 0.547308 Aug 09 17:34:09.033376 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2134/4519] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:08 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:09.041246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69cac213-1621-4d6a-a829-082571ecd94d tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:09.042461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-69cac213-1621-4d6a-a829-082571ecd94d tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:09.061355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cac213-1621-4d6a-a829-082571ecd94d tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:09.062341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cac213-1621-4d6a-a829-082571ecd94d tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:09.066171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cac213-1621-4d6a-a829-082571ecd94d tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:09.067917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cac213-1621-4d6a-a829-082571ecd94d tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:09.069596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cac213-1621-4d6a-a829-082571ecd94d tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:09.070279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cac213-1621-4d6a-a829-082571ecd94d tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:09.598810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:34:09.600508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:34:09.601135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:34:09.601839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:34:09.602369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:34:09.645587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:09.646502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:09.647270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:09.648638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:09.658473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:09.665422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:09.688266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69cac213-1621-4d6a-a829-082571ecd94d tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:09.700014 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69cac213-1621-4d6a-a829-082571ecd94d tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1507 microversion: 2.1 time: 0.663437 Aug 09 17:34:09.701073 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2135/4520] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:09 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1507 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:09.715920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:09.716913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:09.733769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:09.736784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:09.748420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:09.749634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:09.750362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:09.751105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:09.754494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:34:09.767704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for user 1d4dd578ed0640fc943af026c4363e28 and project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:34:09.796783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:09.811922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:34:09.820427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:34:09.982650 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3d6e2b28-07c7-4ab9-9e6d-9f681ab7a870 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.585175 Aug 09 17:34:09.997399 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2386/4521] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:34:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:34:10.029218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-548ea362-23f3-4c6f-9d98-f2d99e09391f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "804a0784-77c6-41cf-9b27-443242cae9ce", "device": "/dev/sdb"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:10.034566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-548ea362-23f3-4c6f-9d98-f2d99e09391f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:10.071482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548ea362-23f3-4c6f-9d98-f2d99e09391f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:10.072456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548ea362-23f3-4c6f-9d98-f2d99e09391f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:10.073269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548ea362-23f3-4c6f-9d98-f2d99e09391f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:10.074669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548ea362-23f3-4c6f-9d98-f2d99e09391f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:10.075776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548ea362-23f3-4c6f-9d98-f2d99e09391f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:10.077022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548ea362-23f3-4c6f-9d98-f2d99e09391f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:10.709783 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-548ea362-23f3-4c6f-9d98-f2d99e09391f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "POST /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.709611 Aug 09 17:34:10.712126 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2387/4522] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:34:09 2022] POST /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:10.721377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fee3ffe8-4b43-48d1-be81-a72c526c9f96 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:10.722709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fee3ffe8-4b43-48d1-be81-a72c526c9f96 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:10.856008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:10.903521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:10.909545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:10.912267 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69f506e5-1e4c-4d60-9838-4d430b3f10e4 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.208550 Aug 09 17:34:10.915978 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2136/4523] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:09 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:10.937630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1aae2ff-e839-465d-9b71-5dac22a7119b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:10.946252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f1aae2ff-e839-465d-9b71-5dac22a7119b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:10.946625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fee3ffe8-4b43-48d1-be81-a72c526c9f96 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:10.971775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1aae2ff-e839-465d-9b71-5dac22a7119b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:10.972059 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fee3ffe8-4b43-48d1-be81-a72c526c9f96 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1209 microversion: 2.1 time: 0.258064 Aug 09 17:34:10.976358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1aae2ff-e839-465d-9b71-5dac22a7119b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:10.977670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1aae2ff-e839-465d-9b71-5dac22a7119b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:10.979354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1aae2ff-e839-465d-9b71-5dac22a7119b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:10.980756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1aae2ff-e839-465d-9b71-5dac22a7119b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:10.981059 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2388/4524] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:10 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1209 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:10.982058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1aae2ff-e839-465d-9b71-5dac22a7119b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:11.386192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-140f2738-9691-4781-b7ca-aa9e27f514e5 req-c1793b35-67bf-417c-afde-dd3d64d973dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66d35bb-7e44-4f00-9de9-18b1d9d97d5a", "tag": "34c16c39-de74-44d1-b8be-3b20669ef21c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:11.414416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-140f2738-9691-4781-b7ca-aa9e27f514e5 req-c1793b35-67bf-417c-afde-dd3d64d973dc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:11.414941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-140f2738-9691-4781-b7ca-aa9e27f514e5 req-c1793b35-67bf-417c-afde-dd3d64d973dc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:11.415414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-140f2738-9691-4781-b7ca-aa9e27f514e5 req-c1793b35-67bf-417c-afde-dd3d64d973dc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:11.448871 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-140f2738-9691-4781-b7ca-aa9e27f514e5 req-c1793b35-67bf-417c-afde-dd3d64d973dc service nova] Creating event network-changed:34c16c39-de74-44d1-b8be-3b20669ef21c for instance f66d35bb-7e44-4f00-9de9-18b1d9d97d5a on n-h2-845781-6 Aug 09 17:34:11.458957 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-140f2738-9691-4781-b7ca-aa9e27f514e5 req-c1793b35-67bf-417c-afde-dd3d64d973dc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076178 Aug 09 17:34:11.460293 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2389/4525] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:34:11.954446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:11.959354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:11.960230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f1aae2ff-e839-465d-9b71-5dac22a7119b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:11.968546 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f1aae2ff-e839-465d-9b71-5dac22a7119b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1315 microversion: 2.1 time: 1.046617 Aug 09 17:34:11.971920 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2137/4526] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:10 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1315 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:11.998641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-01cfc097-84ec-458b-a337-5a7b68233f34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:11.999602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-01cfc097-84ec-458b-a337-5a7b68233f34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:12.010588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01cfc097-84ec-458b-a337-5a7b68233f34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:12.015685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:12.016008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01cfc097-84ec-458b-a337-5a7b68233f34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:12.016481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01cfc097-84ec-458b-a337-5a7b68233f34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:12.016598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:12.017263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01cfc097-84ec-458b-a337-5a7b68233f34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:12.017400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:12.017727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01cfc097-84ec-458b-a337-5a7b68233f34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:12.018370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01cfc097-84ec-458b-a337-5a7b68233f34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:12.027391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:12.029673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:12.031410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:12.275968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-01cfc097-84ec-458b-a337-5a7b68233f34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:12.290599 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-01cfc097-84ec-458b-a337-5a7b68233f34 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1261 microversion: 2.1 time: 0.295799 Aug 09 17:34:12.291902 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2138/4527] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:11 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1261 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:13.000704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eaae297f-1a9a-4a43-907e-8ba11b0d61ad tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:13.003228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eaae297f-1a9a-4a43-907e-8ba11b0d61ad tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:13.028349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaae297f-1a9a-4a43-907e-8ba11b0d61ad tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:13.029265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaae297f-1a9a-4a43-907e-8ba11b0d61ad tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:13.029975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaae297f-1a9a-4a43-907e-8ba11b0d61ad tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:13.038158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaae297f-1a9a-4a43-907e-8ba11b0d61ad tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:13.040148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaae297f-1a9a-4a43-907e-8ba11b0d61ad tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:13.041550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaae297f-1a9a-4a43-907e-8ba11b0d61ad tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:13.063472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:13.105021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:13.120062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:13.127283 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-288c7cf4-49ad-4dc6-abb6-c2e51fc45b42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.187032 Aug 09 17:34:13.130244 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2390/4528] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:11 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:13.316805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e5d9df12-9b59-405b-87b0-0fc50c8dc2c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:13.317772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e5d9df12-9b59-405b-87b0-0fc50c8dc2c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:13.328122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d9df12-9b59-405b-87b0-0fc50c8dc2c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:13.336687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d9df12-9b59-405b-87b0-0fc50c8dc2c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:13.337509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d9df12-9b59-405b-87b0-0fc50c8dc2c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:13.338529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d9df12-9b59-405b-87b0-0fc50c8dc2c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:13.339175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d9df12-9b59-405b-87b0-0fc50c8dc2c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:13.339938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5d9df12-9b59-405b-87b0-0fc50c8dc2c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:13.363883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:13.501634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e5d9df12-9b59-405b-87b0-0fc50c8dc2c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:13.513464 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e5d9df12-9b59-405b-87b0-0fc50c8dc2c4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1267 microversion: 2.1 time: 0.204545 Aug 09 17:34:13.521284 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2391/4529] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:13 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:13.677018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eaae297f-1a9a-4a43-907e-8ba11b0d61ad tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:13.699266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:13.706584 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eaae297f-1a9a-4a43-907e-8ba11b0d61ad tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1315 microversion: 2.1 time: 0.707880 Aug 09 17:34:13.708886 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2139/4530] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:12 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:14.172854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:14.177509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:14.206702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:14.210539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:14.216374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:14.217848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:14.219155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:14.220300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:14.543777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-00ea3c3f-08c9-44fc-9dc9-127f34a6ac33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:14.545041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-00ea3c3f-08c9-44fc-9dc9-127f34a6ac33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:14.559817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00ea3c3f-08c9-44fc-9dc9-127f34a6ac33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:14.560542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00ea3c3f-08c9-44fc-9dc9-127f34a6ac33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:14.564858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00ea3c3f-08c9-44fc-9dc9-127f34a6ac33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:14.565952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00ea3c3f-08c9-44fc-9dc9-127f34a6ac33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:14.567431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00ea3c3f-08c9-44fc-9dc9-127f34a6ac33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:14.568318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00ea3c3f-08c9-44fc-9dc9-127f34a6ac33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:15.164833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:15.181809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-00ea3c3f-08c9-44fc-9dc9-127f34a6ac33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:15.201055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:15.204109 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-00ea3c3f-08c9-44fc-9dc9-127f34a6ac33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1309 microversion: 2.1 time: 0.660715 Aug 09 17:34:15.205114 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2140/4531] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:14 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1309 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:15.212374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:15.216402 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ad167af6-f3cd-45a5-8040-36f15db506a5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.059226 Aug 09 17:34:15.233457 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2392/4532] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:14 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:15.238713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e1e53932-0b53-4b56-8def-d6f961730a45 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:15.239771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e1e53932-0b53-4b56-8def-d6f961730a45 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:15.247208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1e53932-0b53-4b56-8def-d6f961730a45 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:15.248095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1e53932-0b53-4b56-8def-d6f961730a45 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:15.248758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1e53932-0b53-4b56-8def-d6f961730a45 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:15.249706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1e53932-0b53-4b56-8def-d6f961730a45 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:15.250396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1e53932-0b53-4b56-8def-d6f961730a45 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:15.251057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1e53932-0b53-4b56-8def-d6f961730a45 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:16.208750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e1e53932-0b53-4b56-8def-d6f961730a45 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:16.217635 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e1e53932-0b53-4b56-8def-d6f961730a45 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1315 microversion: 2.1 time: 1.007353 Aug 09 17:34:16.224067 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2141/4533] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:15 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1315 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:16.231448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19e318fb-9b19-48ec-9428-13489c853c1e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:16.237093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19e318fb-9b19-48ec-9428-13489c853c1e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:16.244628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:16.245683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:16.272531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:16.273145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:16.274609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e318fb-9b19-48ec-9428-13489c853c1e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:16.275113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:16.276003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:16.277053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e318fb-9b19-48ec-9428-13489c853c1e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:16.278828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:16.281297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e318fb-9b19-48ec-9428-13489c853c1e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:16.282025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:16.287849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e318fb-9b19-48ec-9428-13489c853c1e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:16.292091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e318fb-9b19-48ec-9428-13489c853c1e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:16.293566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19e318fb-9b19-48ec-9428-13489c853c1e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:16.973794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:16.988004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:16.997432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:16.998721 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f2fb7c8a-2c71-456c-8882-19bf7ece1a09 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.759099 Aug 09 17:34:17.005618 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2142/4534] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:16 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:17.243779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-54ba0503-56fe-4bed-9be0-9863ae680041 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:17.245386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-54ba0503-56fe-4bed-9be0-9863ae680041 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:17.260474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ba0503-56fe-4bed-9be0-9863ae680041 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:17.261304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ba0503-56fe-4bed-9be0-9863ae680041 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:17.261935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ba0503-56fe-4bed-9be0-9863ae680041 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:17.262907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ba0503-56fe-4bed-9be0-9863ae680041 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:17.263826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ba0503-56fe-4bed-9be0-9863ae680041 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:17.270547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54ba0503-56fe-4bed-9be0-9863ae680041 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:18.130760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54ba0503-56fe-4bed-9be0-9863ae680041 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:18.152764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-19e318fb-9b19-48ec-9428-13489c853c1e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:18.189143 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-54ba0503-56fe-4bed-9be0-9863ae680041 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1315 microversion: 2.1 time: 0.949893 Aug 09 17:34:18.225150 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2143/4535] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:17 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1315 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:18.230384 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19e318fb-9b19-48ec-9428-13489c853c1e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1309 microversion: 2.1 time: 2.007292 Aug 09 17:34:18.232690 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2393/4536] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:16 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1309 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:18.271252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-dadbf728-52c8-4c1b-ae79-cb0df12b12d2 req-b00d8c23-9810-479f-84b5-5961cca8ba88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8366e136-067e-49e8-b9f3-7da3504274fa", "tag": "cc6a7d05-e596-4973-983c-a6f38dbe889e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:18.279592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:18.281237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:18.318009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:18.320118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-dadbf728-52c8-4c1b-ae79-cb0df12b12d2 req-b00d8c23-9810-479f-84b5-5961cca8ba88 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:18.321422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-dadbf728-52c8-4c1b-ae79-cb0df12b12d2 req-b00d8c23-9810-479f-84b5-5961cca8ba88 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:18.322844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:18.324177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-dadbf728-52c8-4c1b-ae79-cb0df12b12d2 req-b00d8c23-9810-479f-84b5-5961cca8ba88 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:18.325482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:18.329301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:18.331037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:18.333578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:18.406427 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-dadbf728-52c8-4c1b-ae79-cb0df12b12d2 req-b00d8c23-9810-479f-84b5-5961cca8ba88 service nova] Creating event network-changed:cc6a7d05-e596-4973-983c-a6f38dbe889e for instance 8366e136-067e-49e8-b9f3-7da3504274fa on n-h1-845781-6 Aug 09 17:34:18.429119 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-dadbf728-52c8-4c1b-ae79-cb0df12b12d2 req-b00d8c23-9810-479f-84b5-5961cca8ba88 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201083 Aug 09 17:34:18.430774 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2144/4537] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:19.227568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1169487f-9345-4e41-bd0d-305226d32233 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:19.228971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1169487f-9345-4e41-bd0d-305226d32233 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:19.293056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1169487f-9345-4e41-bd0d-305226d32233 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:19.301511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1169487f-9345-4e41-bd0d-305226d32233 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:19.302462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1169487f-9345-4e41-bd0d-305226d32233 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:19.303957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1169487f-9345-4e41-bd0d-305226d32233 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:19.320284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1169487f-9345-4e41-bd0d-305226d32233 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:19.321291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1169487f-9345-4e41-bd0d-305226d32233 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:19.513023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:19.568044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:19.571769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:19.574531 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-27a82c89-e6ef-4e74-88d8-f8e363877e7a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.337138 Aug 09 17:34:19.576587 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2394/4538] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:18 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:19.596121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-91de35d0-1369-4eaa-9a17-412d66a5e58d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:19.597935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-91de35d0-1369-4eaa-9a17-412d66a5e58d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:19.613096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91de35d0-1369-4eaa-9a17-412d66a5e58d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:19.621460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91de35d0-1369-4eaa-9a17-412d66a5e58d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:19.630445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91de35d0-1369-4eaa-9a17-412d66a5e58d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:19.632135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91de35d0-1369-4eaa-9a17-412d66a5e58d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:19.633343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91de35d0-1369-4eaa-9a17-412d66a5e58d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:19.645677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-91de35d0-1369-4eaa-9a17-412d66a5e58d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:19.732357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:20.548188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-91de35d0-1369-4eaa-9a17-412d66a5e58d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:20.565946 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-91de35d0-1369-4eaa-9a17-412d66a5e58d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1309 microversion: 2.1 time: 0.986709 Aug 09 17:34:20.568081 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2395/4539] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:19 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1309 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:20.574183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1ffc02cc-510c-4bc8-bdef-0e458a1e0f45 req-fb94be4a-4b9e-4644-a167-e8dc1355dba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66d35bb-7e44-4f00-9de9-18b1d9d97d5a", "name": "network-vif-plugged", "status": "completed", "tag": "34c16c39-de74-44d1-b8be-3b20669ef21c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:20.588776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ffc02cc-510c-4bc8-bdef-0e458a1e0f45 req-fb94be4a-4b9e-4644-a167-e8dc1355dba6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:20.589327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ffc02cc-510c-4bc8-bdef-0e458a1e0f45 req-fb94be4a-4b9e-4644-a167-e8dc1355dba6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:20.589881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ffc02cc-510c-4bc8-bdef-0e458a1e0f45 req-fb94be4a-4b9e-4644-a167-e8dc1355dba6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:20.610572 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1ffc02cc-510c-4bc8-bdef-0e458a1e0f45 req-fb94be4a-4b9e-4644-a167-e8dc1355dba6 service nova] Creating event network-vif-plugged:34c16c39-de74-44d1-b8be-3b20669ef21c for instance f66d35bb-7e44-4f00-9de9-18b1d9d97d5a on n-h2-845781-6 Aug 09 17:34:20.616174 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1ffc02cc-510c-4bc8-bdef-0e458a1e0f45 req-fb94be4a-4b9e-4644-a167-e8dc1355dba6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046772 Aug 09 17:34:20.617134 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2396/4540] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:20.639999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:20.641716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:20.656253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:20.656872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:20.657403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:20.658475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:20.659021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:20.659742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:20.798516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1169487f-9345-4e41-bd0d-305226d32233 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:20.813074 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1169487f-9345-4e41-bd0d-305226d32233 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1315 microversion: 2.1 time: 1.602330 Aug 09 17:34:20.814581 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2145/4541] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:19 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1315 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:20.966656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=14 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:21.313141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:21.333530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:21.337273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:21.340053 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4fd1634c-59c9-4b0b-9f58-7bb08e1a6562 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.709175 Aug 09 17:34:21.341904 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2397/4542] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:20 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:21.593712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-add0ac51-dbea-47fe-b9a0-5aac86389459 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:21.594635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-add0ac51-dbea-47fe-b9a0-5aac86389459 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:21.617553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-add0ac51-dbea-47fe-b9a0-5aac86389459 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:21.618510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-add0ac51-dbea-47fe-b9a0-5aac86389459 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:21.619200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-add0ac51-dbea-47fe-b9a0-5aac86389459 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:21.620320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-add0ac51-dbea-47fe-b9a0-5aac86389459 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:21.621233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-add0ac51-dbea-47fe-b9a0-5aac86389459 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:21.624734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-add0ac51-dbea-47fe-b9a0-5aac86389459 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:21.845435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8059acb4-c31a-4d36-bc2b-0d4119f8afa9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:21.849821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8059acb4-c31a-4d36-bc2b-0d4119f8afa9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:21.887990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8059acb4-c31a-4d36-bc2b-0d4119f8afa9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:21.889769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8059acb4-c31a-4d36-bc2b-0d4119f8afa9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:21.896399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8059acb4-c31a-4d36-bc2b-0d4119f8afa9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:21.899155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8059acb4-c31a-4d36-bc2b-0d4119f8afa9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:21.901419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8059acb4-c31a-4d36-bc2b-0d4119f8afa9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:21.903498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8059acb4-c31a-4d36-bc2b-0d4119f8afa9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:21.982187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-add0ac51-dbea-47fe-b9a0-5aac86389459 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:22.012204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:22.013794 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-add0ac51-dbea-47fe-b9a0-5aac86389459 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1309 microversion: 2.1 time: 0.424899 Aug 09 17:34:22.035928 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2146/4543] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:21 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1309 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:22.388217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:22.399753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:22.437576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:22.438484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:22.445786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:22.447219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:22.448103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:22.448864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:23.048645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8059acb4-c31a-4d36-bc2b-0d4119f8afa9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:23.060659 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8059acb4-c31a-4d36-bc2b-0d4119f8afa9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1315 microversion: 2.1 time: 1.222905 Aug 09 17:34:23.065232 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2398/4544] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:21 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1315 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:23.074368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbcb3887-d3f7-4ffc-8f8c-35f3711fc211 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:23.079619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dbcb3887-d3f7-4ffc-8f8c-35f3711fc211 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:23.096543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbcb3887-d3f7-4ffc-8f8c-35f3711fc211 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:23.100340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbcb3887-d3f7-4ffc-8f8c-35f3711fc211 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:23.101055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbcb3887-d3f7-4ffc-8f8c-35f3711fc211 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:23.104710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbcb3887-d3f7-4ffc-8f8c-35f3711fc211 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:23.105795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbcb3887-d3f7-4ffc-8f8c-35f3711fc211 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:23.106465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbcb3887-d3f7-4ffc-8f8c-35f3711fc211 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:23.625971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dbcb3887-d3f7-4ffc-8f8c-35f3711fc211 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:23.658728 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dbcb3887-d3f7-4ffc-8f8c-35f3711fc211 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1309 microversion: 2.1 time: 0.592023 Aug 09 17:34:23.659679 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2399/4545] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:23 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1309 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:23.681844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:23.708195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:23.710049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:23.711326 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e0aa8646-f818-4182-a38e-fdcecc4e7a42 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.332408 Aug 09 17:34:23.721881 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2147/4546] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:22 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:24.088252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19699d98-0841-485a-a4e6-18e2a96666ba tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:24.089089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19699d98-0841-485a-a4e6-18e2a96666ba tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:24.098561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19699d98-0841-485a-a4e6-18e2a96666ba tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:24.099341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19699d98-0841-485a-a4e6-18e2a96666ba tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:24.099992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19699d98-0841-485a-a4e6-18e2a96666ba tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:24.101362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19699d98-0841-485a-a4e6-18e2a96666ba tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:24.102030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19699d98-0841-485a-a4e6-18e2a96666ba tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:24.102476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19699d98-0841-485a-a4e6-18e2a96666ba tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:24.335522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-19699d98-0841-485a-a4e6-18e2a96666ba tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:24.349625 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19699d98-0841-485a-a4e6-18e2a96666ba tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1502 microversion: 2.1 time: 0.265822 Aug 09 17:34:24.350479 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2400/4547] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:24 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1502 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:24.382028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0f027126-f54a-4b3f-8f0f-b3ff86574bb3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:24.385704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0f027126-f54a-4b3f-8f0f-b3ff86574bb3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:24.396157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f027126-f54a-4b3f-8f0f-b3ff86574bb3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:24.397174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f027126-f54a-4b3f-8f0f-b3ff86574bb3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:24.397857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f027126-f54a-4b3f-8f0f-b3ff86574bb3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:24.398886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f027126-f54a-4b3f-8f0f-b3ff86574bb3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:24.399593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f027126-f54a-4b3f-8f0f-b3ff86574bb3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:24.400271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f027126-f54a-4b3f-8f0f-b3ff86574bb3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:24.450038 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0f027126-f54a-4b3f-8f0f-b3ff86574bb3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action" status: 200 len: 14 microversion: 2.1 time: 0.073613 Aug 09 17:34:24.451948 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2148/4548] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:24 2022] POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:34:24.698953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4b1b8f0-e046-4897-9833-0483b28ee1ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:24.700379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d4b1b8f0-e046-4897-9833-0483b28ee1ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:24.710815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4b1b8f0-e046-4897-9833-0483b28ee1ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:24.712880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4b1b8f0-e046-4897-9833-0483b28ee1ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:24.714014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4b1b8f0-e046-4897-9833-0483b28ee1ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:24.716773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4b1b8f0-e046-4897-9833-0483b28ee1ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:24.717858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4b1b8f0-e046-4897-9833-0483b28ee1ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:24.718723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4b1b8f0-e046-4897-9833-0483b28ee1ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:24.770554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:24.775179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:24.801671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:24.802594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:24.803387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:24.807481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:24.808335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:24.808936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:25.044836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d4b1b8f0-e046-4897-9833-0483b28ee1ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:25.076584 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d4b1b8f0-e046-4897-9833-0483b28ee1ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1309 microversion: 2.1 time: 0.386200 Aug 09 17:34:25.082982 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2401/4549] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:24 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1309 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:25.103122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-eb6e62e1-0440-4237-ae67-9d0c31342283 req-69de2c02-afd1-44bb-9a5b-3aae2684b5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8366e136-067e-49e8-b9f3-7da3504274fa", "name": "network-vif-plugged", "status": "completed", "tag": "cc6a7d05-e596-4973-983c-a6f38dbe889e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:25.157651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-eb6e62e1-0440-4237-ae67-9d0c31342283 req-69de2c02-afd1-44bb-9a5b-3aae2684b5f7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:25.161792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-eb6e62e1-0440-4237-ae67-9d0c31342283 req-69de2c02-afd1-44bb-9a5b-3aae2684b5f7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:25.167842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-eb6e62e1-0440-4237-ae67-9d0c31342283 req-69de2c02-afd1-44bb-9a5b-3aae2684b5f7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:25.234775 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-eb6e62e1-0440-4237-ae67-9d0c31342283 req-69de2c02-afd1-44bb-9a5b-3aae2684b5f7 service nova] Creating event network-vif-plugged:cc6a7d05-e596-4973-983c-a6f38dbe889e for instance 8366e136-067e-49e8-b9f3-7da3504274fa on n-h1-845781-6 Aug 09 17:34:25.253320 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-eb6e62e1-0440-4237-ae67-9d0c31342283 req-69de2c02-afd1-44bb-9a5b-3aae2684b5f7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166639 Aug 09 17:34:25.258199 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2402/4550] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:25.477438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ce9e0526-72d3-47b0-a49b-4aaa5521b267 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:25.487988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ce9e0526-72d3-47b0-a49b-4aaa5521b267 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:25.508532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:25.513713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce9e0526-72d3-47b0-a49b-4aaa5521b267 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:25.515112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce9e0526-72d3-47b0-a49b-4aaa5521b267 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:25.516273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce9e0526-72d3-47b0-a49b-4aaa5521b267 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:25.518197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce9e0526-72d3-47b0-a49b-4aaa5521b267 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:25.520920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce9e0526-72d3-47b0-a49b-4aaa5521b267 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:25.522129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce9e0526-72d3-47b0-a49b-4aaa5521b267 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:25.544065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:25.551003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:25.555169 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9c23acef-315a-4c71-bb6d-eb0fc17d0057 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.791099 Aug 09 17:34:25.556968 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2149/4551] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:24 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:34:25.606282 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ce9e0526-72d3-47b0-a49b-4aaa5521b267 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action" status: 200 len: 14 microversion: 2.1 time: 0.141969 Aug 09 17:34:25.608107 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2403/4552] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:25 2022] POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:34:26.099297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3be6afdc-deb1-4dd5-86a8-12354e84ec5e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:26.100169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3be6afdc-deb1-4dd5-86a8-12354e84ec5e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:26.107584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=64 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:26.110217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3be6afdc-deb1-4dd5-86a8-12354e84ec5e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:26.110781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3be6afdc-deb1-4dd5-86a8-12354e84ec5e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:26.111165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3be6afdc-deb1-4dd5-86a8-12354e84ec5e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:26.112121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3be6afdc-deb1-4dd5-86a8-12354e84ec5e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:26.112597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3be6afdc-deb1-4dd5-86a8-12354e84ec5e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:26.113029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3be6afdc-deb1-4dd5-86a8-12354e84ec5e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:26.356930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3be6afdc-deb1-4dd5-86a8-12354e84ec5e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:26.371833 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3be6afdc-deb1-4dd5-86a8-12354e84ec5e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1309 microversion: 2.1 time: 0.276427 Aug 09 17:34:26.389220 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2150/4553] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:26 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1309 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:26.583450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:26.585174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:26.593846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:26.594680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:26.595122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:26.596340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:26.596957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:26.597620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:26.619994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d138aafb-1ebf-4593-a536-b5ca4420ed9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:26.623466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d138aafb-1ebf-4593-a536-b5ca4420ed9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:26.639069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d138aafb-1ebf-4593-a536-b5ca4420ed9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:26.640065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d138aafb-1ebf-4593-a536-b5ca4420ed9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:26.640718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d138aafb-1ebf-4593-a536-b5ca4420ed9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:26.641778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d138aafb-1ebf-4593-a536-b5ca4420ed9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:26.642261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d138aafb-1ebf-4593-a536-b5ca4420ed9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:26.642695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d138aafb-1ebf-4593-a536-b5ca4420ed9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:26.825043 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d138aafb-1ebf-4593-a536-b5ca4420ed9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action" status: 200 len: 14 microversion: 2.1 time: 0.208789 Aug 09 17:34:26.830576 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2151/4554] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:26 2022] POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:34:26.987177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:27.005574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:27.008875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:27.011184 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a55a17c5-5abc-4957-9440-d7c1171291f0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.431983 Aug 09 17:34:27.012361 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2404/4555] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:26 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:27.417220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3e1c74d0-dc4d-4db6-8424-64a2b2933182 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:27.421223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3e1c74d0-dc4d-4db6-8424-64a2b2933182 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:27.441059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1c74d0-dc4d-4db6-8424-64a2b2933182 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:27.442402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1c74d0-dc4d-4db6-8424-64a2b2933182 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:27.443900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1c74d0-dc4d-4db6-8424-64a2b2933182 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:27.446750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1c74d0-dc4d-4db6-8424-64a2b2933182 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:27.447983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1c74d0-dc4d-4db6-8424-64a2b2933182 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:27.451006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e1c74d0-dc4d-4db6-8424-64a2b2933182 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:27.814286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3e1c74d0-dc4d-4db6-8424-64a2b2933182 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:27.844284 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3e1c74d0-dc4d-4db6-8424-64a2b2933182 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1489 microversion: 2.1 time: 0.437614 Aug 09 17:34:27.856343 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2152/4556] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:27 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1489 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:27.857042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-47002775-89f8-42cf-b29a-981804e7ad89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:27.862572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-47002775-89f8-42cf-b29a-981804e7ad89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:27.889384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d67bc574-0b26-441b-b9d7-d14e7b09229d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:27.899709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47002775-89f8-42cf-b29a-981804e7ad89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:27.904432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d67bc574-0b26-441b-b9d7-d14e7b09229d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:27.904870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47002775-89f8-42cf-b29a-981804e7ad89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:27.908310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47002775-89f8-42cf-b29a-981804e7ad89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:27.909774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47002775-89f8-42cf-b29a-981804e7ad89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:27.910688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47002775-89f8-42cf-b29a-981804e7ad89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:27.915051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47002775-89f8-42cf-b29a-981804e7ad89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:27.934648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d67bc574-0b26-441b-b9d7-d14e7b09229d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:27.936041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d67bc574-0b26-441b-b9d7-d14e7b09229d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:27.937571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d67bc574-0b26-441b-b9d7-d14e7b09229d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:27.940712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d67bc574-0b26-441b-b9d7-d14e7b09229d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:27.946036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d67bc574-0b26-441b-b9d7-d14e7b09229d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:27.947105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d67bc574-0b26-441b-b9d7-d14e7b09229d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:28.059061 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-47002775-89f8-42cf-b29a-981804e7ad89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action" status: 200 len: 14 microversion: 2.1 time: 0.221450 Aug 09 17:34:28.061097 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2405/4557] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:27 2022] POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action => generated 14 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:34:28.076185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:28.078810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:28.101266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:28.103654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:28.104636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:28.105906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:28.107078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:28.108723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:28.154560 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d67bc574-0b26-441b-b9d7-d14e7b09229d tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "PUT /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1084 microversion: 2.1 time: 0.278250 Aug 09 17:34:28.156733 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2153/4558] 10.222.0.93 () {60 vars in 1256 bytes} [Tue Aug 9 17:34:27 2022] PUT /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1084 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:28.194612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ee801f6-3f16-4829-a096-56d626f84967 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:28.196902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3ee801f6-3f16-4829-a096-56d626f84967 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:28.223568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ee801f6-3f16-4829-a096-56d626f84967 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:28.228915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ee801f6-3f16-4829-a096-56d626f84967 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:28.230713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ee801f6-3f16-4829-a096-56d626f84967 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:28.232428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ee801f6-3f16-4829-a096-56d626f84967 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:28.233626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ee801f6-3f16-4829-a096-56d626f84967 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:28.234739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ee801f6-3f16-4829-a096-56d626f84967 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:28.864871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:28.922820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:28.930968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:28.933267 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9660bdce-c54e-4b2f-84c6-08b6c6087198 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.868347 Aug 09 17:34:28.949222 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2406/4559] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:28 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:29.077451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c543dd90-6cc8-4e8b-8b36-47f18bf249da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:29.099428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c543dd90-6cc8-4e8b-8b36-47f18bf249da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:29.130341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c543dd90-6cc8-4e8b-8b36-47f18bf249da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:29.131194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c543dd90-6cc8-4e8b-8b36-47f18bf249da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:29.132168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c543dd90-6cc8-4e8b-8b36-47f18bf249da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:29.133275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c543dd90-6cc8-4e8b-8b36-47f18bf249da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:29.139713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c543dd90-6cc8-4e8b-8b36-47f18bf249da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:29.145905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c543dd90-6cc8-4e8b-8b36-47f18bf249da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:29.238884 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c543dd90-6cc8-4e8b-8b36-47f18bf249da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action" status: 200 len: 14 microversion: 2.1 time: 0.168517 Aug 09 17:34:29.246656 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2407/4560] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:29 2022] POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:34:29.478733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3ee801f6-3f16-4829-a096-56d626f84967 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:29.525145 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3ee801f6-3f16-4829-a096-56d626f84967 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1510 microversion: 2.1 time: 1.350354 Aug 09 17:34:29.535823 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2154/4561] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:28 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1510 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:29.567492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c187dae3-bd05-4683-b07a-00a8bd6f2a0c tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:29.570892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c187dae3-bd05-4683-b07a-00a8bd6f2a0c tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:29.589389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c187dae3-bd05-4683-b07a-00a8bd6f2a0c tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:29.590748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c187dae3-bd05-4683-b07a-00a8bd6f2a0c tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:29.591731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c187dae3-bd05-4683-b07a-00a8bd6f2a0c tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:29.593632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c187dae3-bd05-4683-b07a-00a8bd6f2a0c tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:29.594647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c187dae3-bd05-4683-b07a-00a8bd6f2a0c tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:29.601908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c187dae3-bd05-4683-b07a-00a8bd6f2a0c tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:29.980917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:29.981493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:30.021950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:30.025951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:30.026931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:30.034046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:30.038169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:30.041086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:30.344578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c187dae3-bd05-4683-b07a-00a8bd6f2a0c tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:30.360349 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c187dae3-bd05-4683-b07a-00a8bd6f2a0c tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1510 microversion: 2.1 time: 0.804624 Aug 09 17:34:30.361206 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2408/4562] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:29 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1510 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:30.375333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64cc9459-870b-4740-957f-5db7a06ac32d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:30.378526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-64cc9459-870b-4740-957f-5db7a06ac32d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:30.406100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cc9459-870b-4740-957f-5db7a06ac32d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:30.411600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cc9459-870b-4740-957f-5db7a06ac32d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:30.412336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cc9459-870b-4740-957f-5db7a06ac32d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:30.413356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cc9459-870b-4740-957f-5db7a06ac32d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:30.414174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cc9459-870b-4740-957f-5db7a06ac32d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:30.415029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cc9459-870b-4740-957f-5db7a06ac32d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:30.498600 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-64cc9459-870b-4740-957f-5db7a06ac32d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action" status: 200 len: 14 microversion: 2.1 time: 0.131234 Aug 09 17:34:30.499261 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2409/4563] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:30 2022] POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:34:30.527259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ce19784d-bc92-4627-b778-964f7d3ddbd4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:30.527920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ce19784d-bc92-4627-b778-964f7d3ddbd4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:30.550097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce19784d-bc92-4627-b778-964f7d3ddbd4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:30.550599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce19784d-bc92-4627-b778-964f7d3ddbd4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:30.559156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce19784d-bc92-4627-b778-964f7d3ddbd4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:30.559974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce19784d-bc92-4627-b778-964f7d3ddbd4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:30.560458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce19784d-bc92-4627-b778-964f7d3ddbd4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:30.560898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce19784d-bc92-4627-b778-964f7d3ddbd4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:30.651582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ce19784d-bc92-4627-b778-964f7d3ddbd4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:34:30.867564 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ce19784d-bc92-4627-b778-964f7d3ddbd4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 204 len: 0 microversion: 2.1 time: 0.363429 Aug 09 17:34:30.868850 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2410/4564] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:34:30 2022] DELETE /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:34:30.878220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3eed392a-4902-453d-8094-043458b958bb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:30.880310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3eed392a-4902-453d-8094-043458b958bb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:30.894210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eed392a-4902-453d-8094-043458b958bb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:30.896280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eed392a-4902-453d-8094-043458b958bb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:30.897761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eed392a-4902-453d-8094-043458b958bb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:30.901122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eed392a-4902-453d-8094-043458b958bb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:30.901885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eed392a-4902-453d-8094-043458b958bb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:30.902498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3eed392a-4902-453d-8094-043458b958bb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:31.299794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:31.366612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:31.375827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:31.378591 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e3b051d6-202e-400e-bae0-e2eba0389df1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.407277 Aug 09 17:34:31.384770 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2155/4565] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:29 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:31.528094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2dfd31a5-309b-4785-8057-a03619d183bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:31.528094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2dfd31a5-309b-4785-8057-a03619d183bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:31.548346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dfd31a5-309b-4785-8057-a03619d183bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:31.578377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dfd31a5-309b-4785-8057-a03619d183bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:31.585705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dfd31a5-309b-4785-8057-a03619d183bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:31.595130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dfd31a5-309b-4785-8057-a03619d183bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:31.596607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dfd31a5-309b-4785-8057-a03619d183bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:31.601090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dfd31a5-309b-4785-8057-a03619d183bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:31.641612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3eed392a-4902-453d-8094-043458b958bb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:31.655263 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3eed392a-4902-453d-8094-043458b958bb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1516 microversion: 2.1 time: 0.777367 Aug 09 17:34:31.657952 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2411/4566] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:30 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1516 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:31.829065 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2dfd31a5-309b-4785-8057-a03619d183bb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action" status: 200 len: 14 microversion: 2.1 time: 0.318840 Aug 09 17:34:31.841126 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2156/4567] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:31 2022] POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action => generated 14 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 17:34:32.423208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:32.429495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:32.481822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:32.482631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:32.483437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:32.484979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:32.492955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:32.493647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:32.703804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0f1a1891-d4c4-4aec-8f06-a0a516cc3eee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:32.718860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0f1a1891-d4c4-4aec-8f06-a0a516cc3eee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:32.759054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f1a1891-d4c4-4aec-8f06-a0a516cc3eee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:32.808826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f1a1891-d4c4-4aec-8f06-a0a516cc3eee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:32.817907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f1a1891-d4c4-4aec-8f06-a0a516cc3eee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.051s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:32.821426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f1a1891-d4c4-4aec-8f06-a0a516cc3eee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:32.828254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f1a1891-d4c4-4aec-8f06-a0a516cc3eee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:32.829246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f1a1891-d4c4-4aec-8f06-a0a516cc3eee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:33.186791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:33.542382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0f1a1891-d4c4-4aec-8f06-a0a516cc3eee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:33.557687 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0f1a1891-d4c4-4aec-8f06-a0a516cc3eee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1516 microversion: 2.1 time: 0.877144 Aug 09 17:34:33.566894 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2157/4568] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:32 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1516 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:33.593109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-59c82aa9-d10b-4f16-90fe-5c0db33f0c65 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:33.597175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-59c82aa9-d10b-4f16-90fe-5c0db33f0c65 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:33.637951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59c82aa9-d10b-4f16-90fe-5c0db33f0c65 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:33.639004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59c82aa9-d10b-4f16-90fe-5c0db33f0c65 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:33.639880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59c82aa9-d10b-4f16-90fe-5c0db33f0c65 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:33.641414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59c82aa9-d10b-4f16-90fe-5c0db33f0c65 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:33.642348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59c82aa9-d10b-4f16-90fe-5c0db33f0c65 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:33.643044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59c82aa9-d10b-4f16-90fe-5c0db33f0c65 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:33.839740 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-59c82aa9-d10b-4f16-90fe-5c0db33f0c65 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action" status: 200 len: 14 microversion: 2.1 time: 0.265217 Aug 09 17:34:33.853495 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2158/4569] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:33 2022] POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action => generated 14 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:34:34.595215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ec880867-5521-4bf9-8746-ed251d14c234 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:34.597633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ec880867-5521-4bf9-8746-ed251d14c234 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:34.642306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec880867-5521-4bf9-8746-ed251d14c234 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:34.643372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec880867-5521-4bf9-8746-ed251d14c234 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:34.653320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec880867-5521-4bf9-8746-ed251d14c234 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:34.654860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec880867-5521-4bf9-8746-ed251d14c234 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:34.661192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec880867-5521-4bf9-8746-ed251d14c234 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:34.665266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec880867-5521-4bf9-8746-ed251d14c234 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:34.726418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:34.830629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:34.845621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:34.853214 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-be0d089c-46d6-4b7e-b753-bc307459cb68 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 2.443909 Aug 09 17:34:34.878719 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2412/4570] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:32 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 2464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:34.899858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-31c12754-5daf-4422-9db6-25a66f76dab3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:34.907355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-31c12754-5daf-4422-9db6-25a66f76dab3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:34.939838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31c12754-5daf-4422-9db6-25a66f76dab3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:34.940814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31c12754-5daf-4422-9db6-25a66f76dab3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:34.941504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31c12754-5daf-4422-9db6-25a66f76dab3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:34.954277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31c12754-5daf-4422-9db6-25a66f76dab3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:34.955844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31c12754-5daf-4422-9db6-25a66f76dab3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:34.965607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31c12754-5daf-4422-9db6-25a66f76dab3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:35.150547 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-31c12754-5daf-4422-9db6-25a66f76dab3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action" status: 200 len: 8208 microversion: 2.1 time: 0.276486 Aug 09 17:34:35.162837 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2413/4571] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:34 2022] POST /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a/action => generated 8208 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:35.213472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-770c0851-273b-4205-9604-73df78f385da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:35.217543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-770c0851-273b-4205-9604-73df78f385da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:35.241553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-770c0851-273b-4205-9604-73df78f385da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:35.252599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-770c0851-273b-4205-9604-73df78f385da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:35.253938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-770c0851-273b-4205-9604-73df78f385da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:35.255484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-770c0851-273b-4205-9604-73df78f385da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:35.256690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-770c0851-273b-4205-9604-73df78f385da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:35.259941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-770c0851-273b-4205-9604-73df78f385da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:36.049336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-770c0851-273b-4205-9604-73df78f385da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:36.066035 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-770c0851-273b-4205-9604-73df78f385da tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.901158 Aug 09 17:34:36.075208 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2414/4572] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:35 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:36.116210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:36.118443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:36.136866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:36.139023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:36.140088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:36.141351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:36.149240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:36.154280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:36.681750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:36.687125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:36.725911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:36.729823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:36.731494 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d7e04ce8-6c0b-46aa-b204-c5bf6f22f414 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.654666 Aug 09 17:34:36.763231 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2415/4573] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:36 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:36.779245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ecf5cfc0-366d-4c88-a561-d35ac13384c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:36.781889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ecf5cfc0-366d-4c88-a561-d35ac13384c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:36.802489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecf5cfc0-366d-4c88-a561-d35ac13384c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:36.803348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecf5cfc0-366d-4c88-a561-d35ac13384c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:36.804086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecf5cfc0-366d-4c88-a561-d35ac13384c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:36.805142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecf5cfc0-366d-4c88-a561-d35ac13384c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:36.805985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecf5cfc0-366d-4c88-a561-d35ac13384c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:36.806838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecf5cfc0-366d-4c88-a561-d35ac13384c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:36.892979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ec880867-5521-4bf9-8746-ed251d14c234 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:36.917480 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ec880867-5521-4bf9-8746-ed251d14c234 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 200 len: 1516 microversion: 2.1 time: 2.323592 Aug 09 17:34:36.921866 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2159/4574] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:34 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 1516 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:36.965955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ed2b1613-f55f-4d09-8aa0-279e7a6a8807 req-506c09b8-2949-4d44-898a-11de1640fe21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8366e136-067e-49e8-b9f3-7da3504274fa", "name": "network-vif-deleted", "tag": "cc6a7d05-e596-4973-983c-a6f38dbe889e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:37.020034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ed2b1613-f55f-4d09-8aa0-279e7a6a8807 req-506c09b8-2949-4d44-898a-11de1640fe21 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:37.021092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ed2b1613-f55f-4d09-8aa0-279e7a6a8807 req-506c09b8-2949-4d44-898a-11de1640fe21 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:37.022381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ed2b1613-f55f-4d09-8aa0-279e7a6a8807 req-506c09b8-2949-4d44-898a-11de1640fe21 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:37.082499 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ed2b1613-f55f-4d09-8aa0-279e7a6a8807 req-506c09b8-2949-4d44-898a-11de1640fe21 service nova] Creating event network-vif-deleted:cc6a7d05-e596-4973-983c-a6f38dbe889e for instance 8366e136-067e-49e8-b9f3-7da3504274fa on n-h1-845781-6 Aug 09 17:34:37.089876 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ed2b1613-f55f-4d09-8aa0-279e7a6a8807 req-506c09b8-2949-4d44-898a-11de1640fe21 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161862 Aug 09 17:34:37.092181 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2160/4575] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:37.389349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ecf5cfc0-366d-4c88-a561-d35ac13384c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:37.407451 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ecf5cfc0-366d-4c88-a561-d35ac13384c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.642536 Aug 09 17:34:37.409407 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2416/4576] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:36 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:37.432258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6da3bd04-ab65-46c6-b193-4d37bf0cd8a8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:37.433351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6da3bd04-ab65-46c6-b193-4d37bf0cd8a8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:37.447408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6da3bd04-ab65-46c6-b193-4d37bf0cd8a8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:37.449541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6da3bd04-ab65-46c6-b193-4d37bf0cd8a8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:37.452316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6da3bd04-ab65-46c6-b193-4d37bf0cd8a8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:37.453699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6da3bd04-ab65-46c6-b193-4d37bf0cd8a8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:37.455447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6da3bd04-ab65-46c6-b193-4d37bf0cd8a8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:37.461161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6da3bd04-ab65-46c6-b193-4d37bf0cd8a8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:37.774038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:37.786250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:37.835611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:37.837794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:37.838910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:37.840502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:37.841608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:37.842670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:38.716846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6da3bd04-ab65-46c6-b193-4d37bf0cd8a8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:38.765816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:38.782069 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6da3bd04-ab65-46c6-b193-4d37bf0cd8a8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.352393 Aug 09 17:34:38.803918 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2161/4577] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:37 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:38.812710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:38.820944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:38.826734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:38.835503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:38.846122 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c129efc4-47e0-4246-8154-b0451b3770b5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.087779 Aug 09 17:34:38.853820 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2417/4578] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:37 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:38.856783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:38.861611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:38.862313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:38.866328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:38.867363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:38.868101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:38.876138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bca23abb-e34c-4eaa-894b-4369697a20f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:38.877218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bca23abb-e34c-4eaa-894b-4369697a20f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:38.900708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bca23abb-e34c-4eaa-894b-4369697a20f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:38.904416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bca23abb-e34c-4eaa-894b-4369697a20f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:38.905115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bca23abb-e34c-4eaa-894b-4369697a20f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:38.907022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bca23abb-e34c-4eaa-894b-4369697a20f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:38.907720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bca23abb-e34c-4eaa-894b-4369697a20f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:38.915286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bca23abb-e34c-4eaa-894b-4369697a20f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:38.932006 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa HTTP/1.1 Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '8366e136-067e-49e8-b9f3-7da3504274fa'} Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:34:38.943141 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:34:38.949352 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:38.949352 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:34:38.949352 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:34:38.949352 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:34:38.949352 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:34:38.949352 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:34:38.949352 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:34:38.949352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:34:38.950457 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7f2728ac-3d73-4cbb-a1ea-6603d481d394 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 404 len: 111 microversion: 2.1 time: 0.153159 Aug 09 17:34:38.951498 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2162/4579] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:38 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:34:39.244411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1311674574", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "829cb0b3-9c78-4844-8875-46f5a554f097"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:39.427479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] validate_networks() for [('829cb0b3-9c78-4844-8875-46f5a554f097', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:34:39.573915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bca23abb-e34c-4eaa-894b-4369697a20f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:39.598964 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bca23abb-e34c-4eaa-894b-4369697a20f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.738259 Aug 09 17:34:39.602088 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2418/4580] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:38 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:39.629833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3295f594-6eba-44ab-9897-e4cdb4b01255 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:39.657750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3295f594-6eba-44ab-9897-e4cdb4b01255 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:39.688019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295f594-6eba-44ab-9897-e4cdb4b01255 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:39.688950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295f594-6eba-44ab-9897-e4cdb4b01255 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:39.689645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295f594-6eba-44ab-9897-e4cdb4b01255 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:39.690931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295f594-6eba-44ab-9897-e4cdb4b01255 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:39.691730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295f594-6eba-44ab-9897-e4cdb4b01255 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:39.692408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295f594-6eba-44ab-9897-e4cdb4b01255 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:39.842129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3295f594-6eba-44ab-9897-e4cdb4b01255 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Locking {{(pid=119431) lock /opt/stack/nova/nova/compute/api.py:4794}} Aug 09 17:34:39.950883 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3295f594-6eba-44ab-9897-e4cdb4b01255 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.329030 Aug 09 17:34:39.951913 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2419/4581] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:39 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:34:39.974409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:39.975097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:39.997223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:39.997932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:40.008701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:40.009602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:40.010105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:40.010557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:40.552868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:40.569567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:40.574145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:40.576146 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-282ec01c-f57b-40cc-8ecf-601a66762f2f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.623028 Aug 09 17:34:40.595111 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2420/4582] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:39 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:40.615516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38223021-0c76-480a-b8df-998ec6f6e5cc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:40.620048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-38223021-0c76-480a-b8df-998ec6f6e5cc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:40.627824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:40.683257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38223021-0c76-480a-b8df-998ec6f6e5cc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:40.684866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38223021-0c76-480a-b8df-998ec6f6e5cc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:40.688965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38223021-0c76-480a-b8df-998ec6f6e5cc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:40.690907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38223021-0c76-480a-b8df-998ec6f6e5cc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:40.693882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38223021-0c76-480a-b8df-998ec6f6e5cc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:40.697144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38223021-0c76-480a-b8df-998ec6f6e5cc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:40.943155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:34:40.943919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:34:40.944370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:34:40.945696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:34:40.946285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:34:40.958802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:40.959714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:40.960405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:40.961486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:40.974552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:40.975356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:40.998435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:34:41.008165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Getting quotas for user 1d4dd578ed0640fc943af026c4363e28 and project fa49d1ed7496493d81aea5dd05615d4a. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:34:41.031575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:34:41.034601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:34:41.144075 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-570354ae-aaee-4fcc-81e6-dd50ae5cb52f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.910297 Aug 09 17:34:41.152498 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2163/4583] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:34:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:34:41.183928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c3ec5924-1470-4f20-b650-555697182b37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:41.184132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c3ec5924-1470-4f20-b650-555697182b37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:41.392998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-38223021-0c76-480a-b8df-998ec6f6e5cc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:41.411168 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-38223021-0c76-480a-b8df-998ec6f6e5cc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.814088 Aug 09 17:34:41.415597 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2421/4584] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:40 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:41.442204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ace5431-c8bb-4d71-bb9e-5b2b2c88104e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:41.457240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ace5431-c8bb-4d71-bb9e-5b2b2c88104e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:41.459454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ace5431-c8bb-4d71-bb9e-5b2b2c88104e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:41.461444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ace5431-c8bb-4d71-bb9e-5b2b2c88104e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:41.532571 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-2ace5431-c8bb-4d71-bb9e-5b2b2c88104e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] HTTP exception thrown: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 is locked Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ace5431-c8bb-4d71-bb9e-5b2b2c88104e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Request method failure captured: Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action HTTP/1.1 Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 15 Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pkS_0b8ItkJO97o1bEJ5HRPxDD9WqTw4B54mMaSsBc9otrK3JnRrU3vGI9NL_jGO6L5V6mu39PI1DIc6ecdm5wHtaDqBnhlt31WibB3ymvtcQm3wOXoKuthF_k0m8v2oV46db59aVNUFJwuCCQA6VKNesTqzja4E13a59VpNmdK2aM Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 62572816b806440aa8338fea1d0a297e Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: {"os-stop": {}} Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 is locked Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1a30c674-6026-45bd-b50e-218ae7d69382', 'body': {'os-stop': {}}} Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 is locked Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 is locked Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 is locked Aug 09 17:34:41.534240 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:34:41.540370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ace5431-c8bb-4d71-bb9e-5b2b2c88104e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Returning 409 to user: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 is locked {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:34:41.541330 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ace5431-c8bb-4d71-bb9e-5b2b2c88104e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 409 len: 107 microversion: 2.1 time: 0.105525 Aug 09 17:34:41.548846 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2422/4585] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:41 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 107 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 17:34:41.559916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a560138-7b84-4188-9201-80577c908c35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:41.560696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a560138-7b84-4188-9201-80577c908c35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:41.574399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a560138-7b84-4188-9201-80577c908c35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:41.574806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a560138-7b84-4188-9201-80577c908c35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:41.575263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a560138-7b84-4188-9201-80577c908c35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:41.580592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a560138-7b84-4188-9201-80577c908c35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:41.581102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a560138-7b84-4188-9201-80577c908c35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:41.581551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a560138-7b84-4188-9201-80577c908c35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:41.617730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c3ec5924-1470-4f20-b650-555697182b37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:41.653783 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c3ec5924-1470-4f20-b650-555697182b37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1209 microversion: 2.1 time: 0.479467 Aug 09 17:34:41.654252 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2164/4586] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:41 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1209 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:41.670475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:41.671938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:41.680385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:41.682282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:41.683221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:41.684603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:41.685405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:41.686183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:41.751152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a560138-7b84-4188-9201-80577c908c35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Unlocking {{(pid=119431) unlock /opt/stack/nova/nova/compute/api.py:4823}} Aug 09 17:34:42.040081 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a560138-7b84-4188-9201-80577c908c35 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.489227 Aug 09 17:34:42.047810 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2423/4587] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:41 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:34:42.063442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac9a576f-63af-4998-b5ff-d9cbde0d0218 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:42.102308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac9a576f-63af-4998-b5ff-d9cbde0d0218 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:42.103452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac9a576f-63af-4998-b5ff-d9cbde0d0218 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:42.104317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ac9a576f-63af-4998-b5ff-d9cbde0d0218 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:42.285552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ac9a576f-63af-4998-b5ff-d9cbde0d0218 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Going to try to stop instance {{(pid=119431) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 17:34:42.526763 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ac9a576f-63af-4998-b5ff-d9cbde0d0218 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.471509 Aug 09 17:34:42.528510 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2424/4588] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:42 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:34:42.545774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b581eab0-834c-485f-9c1e-f8b852632179 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:42.552808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b581eab0-834c-485f-9c1e-f8b852632179 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:42.579947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b581eab0-834c-485f-9c1e-f8b852632179 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:42.610354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b581eab0-834c-485f-9c1e-f8b852632179 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:42.617979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b581eab0-834c-485f-9c1e-f8b852632179 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:42.619565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b581eab0-834c-485f-9c1e-f8b852632179 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:42.620463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b581eab0-834c-485f-9c1e-f8b852632179 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:42.621219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b581eab0-834c-485f-9c1e-f8b852632179 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:43.184624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:43.235053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:43.249577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:43.252028 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7c2e4c0a-0941-4607-94b0-86390ae86739 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.596284 Aug 09 17:34:43.261830 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2165/4589] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:41 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:43.299839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-44f19758-aa0c-415d-a800-c5c2777c941b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:43.305139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-44f19758-aa0c-415d-a800-c5c2777c941b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:43.345388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44f19758-aa0c-415d-a800-c5c2777c941b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:43.349666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44f19758-aa0c-415d-a800-c5c2777c941b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:43.351848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44f19758-aa0c-415d-a800-c5c2777c941b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:43.354088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44f19758-aa0c-415d-a800-c5c2777c941b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:43.358190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44f19758-aa0c-415d-a800-c5c2777c941b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:43.362198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44f19758-aa0c-415d-a800-c5c2777c941b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:43.686392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-44f19758-aa0c-415d-a800-c5c2777c941b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:43.697785 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-44f19758-aa0c-415d-a800-c5c2777c941b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1261 microversion: 2.1 time: 0.433950 Aug 09 17:34:43.702252 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2166/4590] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:43 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1261 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:43.932371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b581eab0-834c-485f-9c1e-f8b852632179 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:43.949536 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b581eab0-834c-485f-9c1e-f8b852632179 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1679 microversion: 2.1 time: 1.413973 Aug 09 17:34:43.951493 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2425/4591] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:42 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1679 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:44.297834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:44.302721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:44.338796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:44.343135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:44.345214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:44.347195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:44.353634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:44.357501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:44.727954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d9500cef-e22d-4f85-babe-707d2c332484 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:44.728708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d9500cef-e22d-4f85-babe-707d2c332484 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:44.738971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9500cef-e22d-4f85-babe-707d2c332484 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:44.739512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9500cef-e22d-4f85-babe-707d2c332484 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:44.739994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9500cef-e22d-4f85-babe-707d2c332484 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:44.746952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9500cef-e22d-4f85-babe-707d2c332484 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:44.748384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9500cef-e22d-4f85-babe-707d2c332484 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:44.749063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9500cef-e22d-4f85-babe-707d2c332484 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:45.038609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d9500cef-e22d-4f85-babe-707d2c332484 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:45.067224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:45.081717 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d9500cef-e22d-4f85-babe-707d2c332484 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1267 microversion: 2.1 time: 0.358990 Aug 09 17:34:45.092267 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2426/4592] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:44 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1267 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:45.111400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2f0a313d-744a-49af-a03c-c3ff8a024dae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:45.112967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2f0a313d-744a-49af-a03c-c3ff8a024dae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:45.142067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f0a313d-744a-49af-a03c-c3ff8a024dae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:45.143105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f0a313d-744a-49af-a03c-c3ff8a024dae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:45.145587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f0a313d-744a-49af-a03c-c3ff8a024dae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:45.149533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f0a313d-744a-49af-a03c-c3ff8a024dae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:45.153135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f0a313d-744a-49af-a03c-c3ff8a024dae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:45.154306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f0a313d-744a-49af-a03c-c3ff8a024dae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:45.591784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:45.617245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:45.622718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:45.631022 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e569e873-6caf-4c73-b50b-87748262ed9f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.342069 Aug 09 17:34:45.635968 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2167/4593] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:44 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:46.114441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8db98e07-b6ca-4d48-95c1-aba2cd5c76ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:46.116208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8db98e07-b6ca-4d48-95c1-aba2cd5c76ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:46.148760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8db98e07-b6ca-4d48-95c1-aba2cd5c76ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:46.148760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8db98e07-b6ca-4d48-95c1-aba2cd5c76ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:46.149246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8db98e07-b6ca-4d48-95c1-aba2cd5c76ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:46.150038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8db98e07-b6ca-4d48-95c1-aba2cd5c76ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:46.150506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8db98e07-b6ca-4d48-95c1-aba2cd5c76ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:46.150969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8db98e07-b6ca-4d48-95c1-aba2cd5c76ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:46.715502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2f0a313d-744a-49af-a03c-c3ff8a024dae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:46.744470 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2f0a313d-744a-49af-a03c-c3ff8a024dae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1679 microversion: 2.1 time: 1.636671 Aug 09 17:34:46.745239 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2427/4594] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:45 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1679 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:46.767952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:46.773188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:46.804632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:46.809170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:46.811142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:46.812257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:46.812962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:46.813654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:46.887478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8db98e07-b6ca-4d48-95c1-aba2cd5c76ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:46.976257 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8db98e07-b6ca-4d48-95c1-aba2cd5c76ad tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1267 microversion: 2.1 time: 0.868438 Aug 09 17:34:46.976257 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2168/4595] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:46 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1267 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:47.739040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:47.771578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-838d4b65-c007-4545-a9f2-81ee0bdaaea2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:47.772335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-838d4b65-c007-4545-a9f2-81ee0bdaaea2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:47.783085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-838d4b65-c007-4545-a9f2-81ee0bdaaea2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:47.784790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-838d4b65-c007-4545-a9f2-81ee0bdaaea2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:47.785669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-838d4b65-c007-4545-a9f2-81ee0bdaaea2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:47.788035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-838d4b65-c007-4545-a9f2-81ee0bdaaea2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:47.790905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-838d4b65-c007-4545-a9f2-81ee0bdaaea2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:47.792324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-838d4b65-c007-4545-a9f2-81ee0bdaaea2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:47.832479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:47.844621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:47.847397 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a496430-c019-46aa-a5b2-46f8f7f2fbe0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.095859 Aug 09 17:34:47.849574 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2428/4596] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:46 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:48.003924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-741ccb49-f124-4239-bbb5-f08b83a74a33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:48.015373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-741ccb49-f124-4239-bbb5-f08b83a74a33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:48.039686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-741ccb49-f124-4239-bbb5-f08b83a74a33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:48.046362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-741ccb49-f124-4239-bbb5-f08b83a74a33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:48.047311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-741ccb49-f124-4239-bbb5-f08b83a74a33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:48.048524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-741ccb49-f124-4239-bbb5-f08b83a74a33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:48.049664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-741ccb49-f124-4239-bbb5-f08b83a74a33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:48.051342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-741ccb49-f124-4239-bbb5-f08b83a74a33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:48.285759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-838d4b65-c007-4545-a9f2-81ee0bdaaea2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:48.304315 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-838d4b65-c007-4545-a9f2-81ee0bdaaea2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1679 microversion: 2.1 time: 0.539617 Aug 09 17:34:48.306589 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2169/4597] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:47 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1679 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:48.789511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-741ccb49-f124-4239-bbb5-f08b83a74a33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:48.799183 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-741ccb49-f124-4239-bbb5-f08b83a74a33 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1309 microversion: 2.1 time: 0.802993 Aug 09 17:34:48.808781 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2429/4598] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:47 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1309 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:48.901106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:48.903518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:48.936440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:48.938817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:48.942588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:48.944629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:48.945738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:48.946559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:49.336241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7a7e2ec9-4aa3-4f26-bc56-69784c9fc114 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:49.337374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7a7e2ec9-4aa3-4f26-bc56-69784c9fc114 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:49.372447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a7e2ec9-4aa3-4f26-bc56-69784c9fc114 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:49.373321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a7e2ec9-4aa3-4f26-bc56-69784c9fc114 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:49.374126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a7e2ec9-4aa3-4f26-bc56-69784c9fc114 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:49.375502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a7e2ec9-4aa3-4f26-bc56-69784c9fc114 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:49.392817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a7e2ec9-4aa3-4f26-bc56-69784c9fc114 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:49.393634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a7e2ec9-4aa3-4f26-bc56-69784c9fc114 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:49.521025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:49.567044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:49.587172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:49.592090 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1c148857-c657-43ed-9fc7-9e7186cb2673 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.703942 Aug 09 17:34:49.599688 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2170/4599] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:48 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:49.848127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-267c03b0-ab22-43d4-8608-abe5bbc9b288 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:49.848975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-267c03b0-ab22-43d4-8608-abe5bbc9b288 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:49.869540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-267c03b0-ab22-43d4-8608-abe5bbc9b288 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:49.869719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-267c03b0-ab22-43d4-8608-abe5bbc9b288 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:49.873796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-267c03b0-ab22-43d4-8608-abe5bbc9b288 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:49.875026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-267c03b0-ab22-43d4-8608-abe5bbc9b288 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:49.875793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-267c03b0-ab22-43d4-8608-abe5bbc9b288 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:49.879688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-267c03b0-ab22-43d4-8608-abe5bbc9b288 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:50.987731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:51.133067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-267c03b0-ab22-43d4-8608-abe5bbc9b288 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:51.252825 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-267c03b0-ab22-43d4-8608-abe5bbc9b288 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1309 microversion: 2.1 time: 1.404181 Aug 09 17:34:51.254056 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2171/4600] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:49 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1309 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:51.293896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:51.312159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:51.331700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:51.332725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:51.333374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:51.334320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:51.335420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:51.336264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:51.387505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7a7e2ec9-4aa3-4f26-bc56-69784c9fc114 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:51.401834 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7a7e2ec9-4aa3-4f26-bc56-69784c9fc114 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1679 microversion: 2.1 time: 2.076437 Aug 09 17:34:51.413076 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2430/4601] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:49 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1679 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:51.634701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:52.219325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-36557563-cd06-4e65-95d3-ace2de641035 req-98e2f170-1b54-4be1-bf60-5071cb023d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-plugged", "status": "completed", "tag": "4f7a2502-f30f-4735-9904-fbf8a52eb998"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:52.263278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-36557563-cd06-4e65-95d3-ace2de641035 req-98e2f170-1b54-4be1-bf60-5071cb023d3d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:52.263850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-36557563-cd06-4e65-95d3-ace2de641035 req-98e2f170-1b54-4be1-bf60-5071cb023d3d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:52.264302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-36557563-cd06-4e65-95d3-ace2de641035 req-98e2f170-1b54-4be1-bf60-5071cb023d3d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:52.334801 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-36557563-cd06-4e65-95d3-ace2de641035 req-98e2f170-1b54-4be1-bf60-5071cb023d3d service nova] Creating event network-vif-plugged:4f7a2502-f30f-4735-9904-fbf8a52eb998 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:34:52.355028 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-36557563-cd06-4e65-95d3-ace2de641035 req-98e2f170-1b54-4be1-bf60-5071cb023d3d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.666806 Aug 09 17:34:52.357979 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2431/4602] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:52.381124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1bb4eba6-d0a8-40de-872c-766e3b0672c0 req-36d816b9-0021-4d63-91b9-cedaaece15f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f7a36b-8045-44a8-8dc6-da874810810d", "tag": "2cbd3a03-feec-49ec-9f40-ac4ce8889536"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:52.462889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1bb4eba6-d0a8-40de-872c-766e3b0672c0 req-36d816b9-0021-4d63-91b9-cedaaece15f4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:52.467776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1bb4eba6-d0a8-40de-872c-766e3b0672c0 req-36d816b9-0021-4d63-91b9-cedaaece15f4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:52.471025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1bb4eba6-d0a8-40de-872c-766e3b0672c0 req-36d816b9-0021-4d63-91b9-cedaaece15f4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:52.555101 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1bb4eba6-d0a8-40de-872c-766e3b0672c0 req-36d816b9-0021-4d63-91b9-cedaaece15f4 service nova] Creating event network-changed:2cbd3a03-feec-49ec-9f40-ac4ce8889536 for instance 95f7a36b-8045-44a8-8dc6-da874810810d on n-h1-845781-6 Aug 09 17:34:52.571503 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1bb4eba6-d0a8-40de-872c-766e3b0672c0 req-36d816b9-0021-4d63-91b9-cedaaece15f4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205513 Aug 09 17:34:52.578664 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2432/4603] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:52.610273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c5be7fb-6844-4b71-b86f-e7a4a6b614e1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:52.613947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7c5be7fb-6844-4b71-b86f-e7a4a6b614e1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:52.644535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c5be7fb-6844-4b71-b86f-e7a4a6b614e1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:52.646267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c5be7fb-6844-4b71-b86f-e7a4a6b614e1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:52.648774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c5be7fb-6844-4b71-b86f-e7a4a6b614e1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:52.651591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c5be7fb-6844-4b71-b86f-e7a4a6b614e1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:52.654321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c5be7fb-6844-4b71-b86f-e7a4a6b614e1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:52.654991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c5be7fb-6844-4b71-b86f-e7a4a6b614e1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:53.120373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:53.156272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:53.161236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:53.162521 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6c82dc17-1b0d-4a4e-8848-e507a7339833 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.881733 Aug 09 17:34:53.167469 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2172/4604] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:51 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:53.179122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-859b4fc8-8d37-4486-a499-6d138cbbe18d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:53.181395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-859b4fc8-8d37-4486-a499-6d138cbbe18d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:53.202968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-859b4fc8-8d37-4486-a499-6d138cbbe18d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:53.208464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-859b4fc8-8d37-4486-a499-6d138cbbe18d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:53.209265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-859b4fc8-8d37-4486-a499-6d138cbbe18d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:53.213569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-859b4fc8-8d37-4486-a499-6d138cbbe18d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:53.214464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-859b4fc8-8d37-4486-a499-6d138cbbe18d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:53.215167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-859b4fc8-8d37-4486-a499-6d138cbbe18d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:53.528836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7c5be7fb-6844-4b71-b86f-e7a4a6b614e1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:53.546209 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7c5be7fb-6844-4b71-b86f-e7a4a6b614e1 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1309 microversion: 2.1 time: 0.965618 Aug 09 17:34:53.548797 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2433/4605] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:52 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1309 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:53.790738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-859b4fc8-8d37-4486-a499-6d138cbbe18d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:53.812211 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-859b4fc8-8d37-4486-a499-6d138cbbe18d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1656 microversion: 2.1 time: 0.643157 Aug 09 17:34:53.814513 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2173/4606] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:53 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1656 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:53.843999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-76eb417a-d17a-446f-b489-4306552e9f19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:53.846297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-39ef6916-76ae-473b-bb11-02907a7567cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:53.846874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-39ef6916-76ae-473b-bb11-02907a7567cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:53.857847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76eb417a-d17a-446f-b489-4306552e9f19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:53.859372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39ef6916-76ae-473b-bb11-02907a7567cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:53.859876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76eb417a-d17a-446f-b489-4306552e9f19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:53.860028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39ef6916-76ae-473b-bb11-02907a7567cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:53.860366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39ef6916-76ae-473b-bb11-02907a7567cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:53.862443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76eb417a-d17a-446f-b489-4306552e9f19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:53.864771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39ef6916-76ae-473b-bb11-02907a7567cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:53.865278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39ef6916-76ae-473b-bb11-02907a7567cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:53.865736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39ef6916-76ae-473b-bb11-02907a7567cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:53.915359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-76eb417a-d17a-446f-b489-4306552e9f19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Going to try to start instance {{(pid=119432) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 17:34:54.016993 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-76eb417a-d17a-446f-b489-4306552e9f19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.176996 Aug 09 17:34:54.018179 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2174/4607] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:34:53 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:34:54.028651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b70c6126-7e49-4d3b-b733-e02a38c1ead0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:54.029419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b70c6126-7e49-4d3b-b733-e02a38c1ead0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:54.046157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-39ef6916-76ae-473b-bb11-02907a7567cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lazy-loading 'services' on Instance uuid cab7eacc-f17d-42aa-b80d-150c57cb9ed1 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:34:54.051737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b70c6126-7e49-4d3b-b733-e02a38c1ead0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:54.052281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b70c6126-7e49-4d3b-b733-e02a38c1ead0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:54.055883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b70c6126-7e49-4d3b-b733-e02a38c1ead0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:54.056837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b70c6126-7e49-4d3b-b733-e02a38c1ead0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:54.072842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b70c6126-7e49-4d3b-b733-e02a38c1ead0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:54.073343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b70c6126-7e49-4d3b-b733-e02a38c1ead0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:54.268089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-39ef6916-76ae-473b-bb11-02907a7567cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1/os-volume_attachments/804a0784-77c6-41cf-9b27-443242cae9ce" status: 202 len: 0 microversion: 2.1 time: 0.425582 Aug 09 17:34:54.273546 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2434/4608] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:34:53 2022] DELETE /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1/os-volume_attachments/804a0784-77c6-41cf-9b27-443242cae9ce => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:34:54.292750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:54.295030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:54.329851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:54.331168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:54.333115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:54.336643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:54.338015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:54.340301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:54.761612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:54.808738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:54.813333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:54.817950 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5fc2339a-3107-41fc-8560-fd2cddf38cf2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 0.540458 Aug 09 17:34:54.823718 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2435/4609] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:54 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:54.834602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f9d35c96-12fc-4d6c-8c58-0a3cf49f2b23 req-693c9fd3-dabd-442b-adf7-69a792b589d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-plugged", "status": "completed", "tag": "1f1ce345-17a7-4206-910b-0ef883357278"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:54.862151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f9d35c96-12fc-4d6c-8c58-0a3cf49f2b23 req-693c9fd3-dabd-442b-adf7-69a792b589d6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:54.872523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f9d35c96-12fc-4d6c-8c58-0a3cf49f2b23 req-693c9fd3-dabd-442b-adf7-69a792b589d6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:54.873148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f9d35c96-12fc-4d6c-8c58-0a3cf49f2b23 req-693c9fd3-dabd-442b-adf7-69a792b589d6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:54.908115 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f9d35c96-12fc-4d6c-8c58-0a3cf49f2b23 req-693c9fd3-dabd-442b-adf7-69a792b589d6 service nova] Creating event network-vif-plugged:1f1ce345-17a7-4206-910b-0ef883357278 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:34:54.917417 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f9d35c96-12fc-4d6c-8c58-0a3cf49f2b23 req-693c9fd3-dabd-442b-adf7-69a792b589d6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091837 Aug 09 17:34:54.925070 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2436/4610] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:54.932036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0eb553b7-7da1-4750-84da-b94bea9b33bd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:54.942526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0eb553b7-7da1-4750-84da-b94bea9b33bd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:54.958886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb553b7-7da1-4750-84da-b94bea9b33bd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:54.959395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb553b7-7da1-4750-84da-b94bea9b33bd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:54.959889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb553b7-7da1-4750-84da-b94bea9b33bd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:54.960638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb553b7-7da1-4750-84da-b94bea9b33bd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:54.961104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb553b7-7da1-4750-84da-b94bea9b33bd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:54.961538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0eb553b7-7da1-4750-84da-b94bea9b33bd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:55.392850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0eb553b7-7da1-4750-84da-b94bea9b33bd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:55.410600 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0eb553b7-7da1-4750-84da-b94bea9b33bd tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1309 microversion: 2.1 time: 0.478457 Aug 09 17:34:55.412315 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2437/4611] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:54 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1309 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:55.816147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b70c6126-7e49-4d3b-b733-e02a38c1ead0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:55.839694 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b70c6126-7e49-4d3b-b733-e02a38c1ead0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1665 microversion: 2.1 time: 1.815713 Aug 09 17:34:55.848273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:55.849879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:55.868107 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2175/4612] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:54 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1665 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:55.878040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:55.879655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:55.880406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:55.881641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:55.882704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:55.884192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:56.463676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1ad197d-67b2-4d02-978f-5a5ed1c183fb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:56.464318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f1ad197d-67b2-4d02-978f-5a5ed1c183fb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:56.467053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:56.478360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1ad197d-67b2-4d02-978f-5a5ed1c183fb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:56.478879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1ad197d-67b2-4d02-978f-5a5ed1c183fb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:56.479341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1ad197d-67b2-4d02-978f-5a5ed1c183fb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:56.480140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1ad197d-67b2-4d02-978f-5a5ed1c183fb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:56.480626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1ad197d-67b2-4d02-978f-5a5ed1c183fb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:56.481069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1ad197d-67b2-4d02-978f-5a5ed1c183fb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:56.541539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:34:57.119381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f1ad197d-67b2-4d02-978f-5a5ed1c183fb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:57.137607 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f1ad197d-67b2-4d02-978f-5a5ed1c183fb tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1309 microversion: 2.1 time: 0.677745 Aug 09 17:34:57.150284 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2176/4613] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:56 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1309 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:57.163500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1e92ed7f-7006-4c0c-bf3d-1e3bd99d5712 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:57.164613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1e92ed7f-7006-4c0c-bf3d-1e3bd99d5712 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:57.184165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:57.191854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e92ed7f-7006-4c0c-bf3d-1e3bd99d5712 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:57.192761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e92ed7f-7006-4c0c-bf3d-1e3bd99d5712 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:57.193579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e92ed7f-7006-4c0c-bf3d-1e3bd99d5712 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:57.194911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e92ed7f-7006-4c0c-bf3d-1e3bd99d5712 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:57.208273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e92ed7f-7006-4c0c-bf3d-1e3bd99d5712 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:57.209228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e92ed7f-7006-4c0c-bf3d-1e3bd99d5712 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:57.224802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:57.238499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:57.240876 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-49d1b84e-1ed7-4ce9-9f73-caae2c283b6d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.398038 Aug 09 17:34:57.286562 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2438/4614] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:55 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:57.301486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8d6b0dc4-ef83-40cf-9b6f-f5d6c4f4b182 req-43b1e619-21ff-4237-9cd0-c171d9df6a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-plugged", "status": "completed", "tag": "a3fc9a19-60ae-4faa-aa63-64fdb0f45a85"}, {"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-plugged", "status": "completed", "tag": "b31588f9-5215-4525-a306-7739e48dfd07"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:57.359015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8d6b0dc4-ef83-40cf-9b6f-f5d6c4f4b182 req-43b1e619-21ff-4237-9cd0-c171d9df6a27 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:57.359973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8d6b0dc4-ef83-40cf-9b6f-f5d6c4f4b182 req-43b1e619-21ff-4237-9cd0-c171d9df6a27 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:57.363870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8d6b0dc4-ef83-40cf-9b6f-f5d6c4f4b182 req-43b1e619-21ff-4237-9cd0-c171d9df6a27 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:57.389939 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8d6b0dc4-ef83-40cf-9b6f-f5d6c4f4b182 req-43b1e619-21ff-4237-9cd0-c171d9df6a27 service nova] Creating event network-vif-plugged:a3fc9a19-60ae-4faa-aa63-64fdb0f45a85 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:34:57.391013 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8d6b0dc4-ef83-40cf-9b6f-f5d6c4f4b182 req-43b1e619-21ff-4237-9cd0-c171d9df6a27 service nova] Creating event network-vif-plugged:b31588f9-5215-4525-a306-7739e48dfd07 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:34:57.406064 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8d6b0dc4-ef83-40cf-9b6f-f5d6c4f4b182 req-43b1e619-21ff-4237-9cd0-c171d9df6a27 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.117162 Aug 09 17:34:57.413415 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2439/4615] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:58.074263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1e92ed7f-7006-4c0c-bf3d-1e3bd99d5712 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:58.085646 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1e92ed7f-7006-4c0c-bf3d-1e3bd99d5712 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1665 microversion: 2.1 time: 0.933660 Aug 09 17:34:58.104826 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2177/4616] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:57 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1665 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:58.187511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ed3680a6-2ec8-4f22-bbd6-b6bf3c2b01b7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:58.193911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ed3680a6-2ec8-4f22-bbd6-b6bf3c2b01b7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:58.221531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed3680a6-2ec8-4f22-bbd6-b6bf3c2b01b7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:58.226115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed3680a6-2ec8-4f22-bbd6-b6bf3c2b01b7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:58.230463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed3680a6-2ec8-4f22-bbd6-b6bf3c2b01b7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:58.233065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed3680a6-2ec8-4f22-bbd6-b6bf3c2b01b7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:58.244885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed3680a6-2ec8-4f22-bbd6-b6bf3c2b01b7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:58.246200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed3680a6-2ec8-4f22-bbd6-b6bf3c2b01b7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:58.293951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:58.294924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:58.310491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:58.315757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:58.318046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:58.321109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:58.323970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:58.325963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:58.770172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ed3680a6-2ec8-4f22-bbd6-b6bf3c2b01b7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:58.783501 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ed3680a6-2ec8-4f22-bbd6-b6bf3c2b01b7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1309 microversion: 2.1 time: 0.605761 Aug 09 17:34:58.792804 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2440/4617] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:58 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1309 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:34:59.115810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b48ce51c-4066-4254-9c8d-2af34d9780f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:59.116740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b48ce51c-4066-4254-9c8d-2af34d9780f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:59.133713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b48ce51c-4066-4254-9c8d-2af34d9780f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:59.134459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b48ce51c-4066-4254-9c8d-2af34d9780f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:59.135055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b48ce51c-4066-4254-9c8d-2af34d9780f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:59.136021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b48ce51c-4066-4254-9c8d-2af34d9780f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:59.136643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b48ce51c-4066-4254-9c8d-2af34d9780f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:59.137234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b48ce51c-4066-4254-9c8d-2af34d9780f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:59.442806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:59.463075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:59.464679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:59.473312 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e449124-12b3-42d9-b76f-fa2332f9986d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.184098 Aug 09 17:34:59.473944 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2178/4618] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:34:58 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:34:59.530841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b48ce51c-4066-4254-9c8d-2af34d9780f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:34:59.547760 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b48ce51c-4066-4254-9c8d-2af34d9780f3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.435988 Aug 09 17:34:59.548937 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2441/4619] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:59 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:34:59.579584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b5746277-f8e3-4c00-b26e-4f1e91cb9874 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:59.580326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b5746277-f8e3-4c00-b26e-4f1e91cb9874 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:59.597499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5746277-f8e3-4c00-b26e-4f1e91cb9874 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:59.598436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5746277-f8e3-4c00-b26e-4f1e91cb9874 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:59.598907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5746277-f8e3-4c00-b26e-4f1e91cb9874 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:59.599673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5746277-f8e3-4c00-b26e-4f1e91cb9874 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:59.600156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5746277-f8e3-4c00-b26e-4f1e91cb9874 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:59.607865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5746277-f8e3-4c00-b26e-4f1e91cb9874 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:59.720978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6123339a-2d9f-4862-8308-b69dbdc4dd0f req-a291ab5b-e818-4d41-8151-21dbc784230c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-plugged", "status": "completed", "tag": "08d0cf84-a616-4f63-b18f-3820a0a3de7d"}, {"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-plugged", "status": "completed", "tag": "cf24c4a2-69bb-44f3-8087-c67d8fe70264"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:34:59.733513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6123339a-2d9f-4862-8308-b69dbdc4dd0f req-a291ab5b-e818-4d41-8151-21dbc784230c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:59.734331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6123339a-2d9f-4862-8308-b69dbdc4dd0f req-a291ab5b-e818-4d41-8151-21dbc784230c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:59.734952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6123339a-2d9f-4862-8308-b69dbdc4dd0f req-a291ab5b-e818-4d41-8151-21dbc784230c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:59.757142 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6123339a-2d9f-4862-8308-b69dbdc4dd0f req-a291ab5b-e818-4d41-8151-21dbc784230c service nova] Creating event network-vif-plugged:08d0cf84-a616-4f63-b18f-3820a0a3de7d for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:34:59.757954 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6123339a-2d9f-4862-8308-b69dbdc4dd0f req-a291ab5b-e818-4d41-8151-21dbc784230c service nova] Creating event network-vif-plugged:cf24c4a2-69bb-44f3-8087-c67d8fe70264 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:34:59.764408 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6123339a-2d9f-4862-8308-b69dbdc4dd0f req-a291ab5b-e818-4d41-8151-21dbc784230c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047346 Aug 09 17:34:59.765678 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2442/4620] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:34:59.840727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c84d5d7-4b35-42c3-bf64-6f16106ac04e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:34:59.842041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c84d5d7-4b35-42c3-bf64-6f16106ac04e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:34:59.851059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c84d5d7-4b35-42c3-bf64-6f16106ac04e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:59.852062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c84d5d7-4b35-42c3-bf64-6f16106ac04e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:59.852715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c84d5d7-4b35-42c3-bf64-6f16106ac04e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:34:59.853712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c84d5d7-4b35-42c3-bf64-6f16106ac04e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:34:59.854399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c84d5d7-4b35-42c3-bf64-6f16106ac04e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:34:59.855033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c84d5d7-4b35-42c3-bf64-6f16106ac04e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:00.084101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5c84d5d7-4b35-42c3-bf64-6f16106ac04e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:00.100084 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c84d5d7-4b35-42c3-bf64-6f16106ac04e tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1309 microversion: 2.1 time: 0.264378 Aug 09 17:35:00.101860 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2443/4621] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:59 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1309 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:35:00.512447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:00.515463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:00.541890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:00.542954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:00.543440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:00.545163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:00.546297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:00.547322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:00.829147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b5746277-f8e3-4c00-b26e-4f1e91cb9874 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:00.849644 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b5746277-f8e3-4c00-b26e-4f1e91cb9874 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.274571 Aug 09 17:35:00.852738 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2179/4622] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:34:59 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:00.889571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fedc614b-492a-434a-97cf-a8fbed68509d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:00.890663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fedc614b-492a-434a-97cf-a8fbed68509d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:00.898920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fedc614b-492a-434a-97cf-a8fbed68509d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:00.900115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fedc614b-492a-434a-97cf-a8fbed68509d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:00.901024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fedc614b-492a-434a-97cf-a8fbed68509d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:00.908375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fedc614b-492a-434a-97cf-a8fbed68509d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:00.910155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fedc614b-492a-434a-97cf-a8fbed68509d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:00.911920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fedc614b-492a-434a-97cf-a8fbed68509d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:01.028784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fedc614b-492a-434a-97cf-a8fbed68509d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Unlocking {{(pid=119432) unlock /opt/stack/nova/nova/compute/api.py:4823}} Aug 09 17:35:01.199239 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fedc614b-492a-434a-97cf-a8fbed68509d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.314655 Aug 09 17:35:01.206084 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2180/4623] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:35:00 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:35:01.214322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1b505b0-d772-47c7-b237-5519cc0fddbc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:01.218099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f1b505b0-d772-47c7-b237-5519cc0fddbc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:01.226079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1b505b0-d772-47c7-b237-5519cc0fddbc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:01.226826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1b505b0-d772-47c7-b237-5519cc0fddbc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:01.227431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1b505b0-d772-47c7-b237-5519cc0fddbc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:01.228362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1b505b0-d772-47c7-b237-5519cc0fddbc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:01.228998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1b505b0-d772-47c7-b237-5519cc0fddbc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:01.229626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1b505b0-d772-47c7-b237-5519cc0fddbc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:01.598948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:01.659036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:01.688867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:01.696862 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bc87c444-7033-4729-a698-791fdb44d28a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.201879 Aug 09 17:35:01.703976 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2444/4624] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:35:00 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:35:01.713089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-61421f2e-ebfa-4f94-9720-32e571e4a6a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:01.728346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61421f2e-ebfa-4f94-9720-32e571e4a6a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:01.752747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61421f2e-ebfa-4f94-9720-32e571e4a6a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:01.756712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61421f2e-ebfa-4f94-9720-32e571e4a6a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:01.757539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61421f2e-ebfa-4f94-9720-32e571e4a6a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:01.762156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61421f2e-ebfa-4f94-9720-32e571e4a6a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:01.763031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61421f2e-ebfa-4f94-9720-32e571e4a6a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:01.763768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61421f2e-ebfa-4f94-9720-32e571e4a6a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:01.944508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f1b505b0-d772-47c7-b237-5519cc0fddbc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:01.958023 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f1b505b0-d772-47c7-b237-5519cc0fddbc tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1309 microversion: 2.1 time: 0.749788 Aug 09 17:35:01.964111 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2181/4625] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:01 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1309 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:01.978299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-4445ad3c-0d55-4fc6-adb4-0417826a7ff0 req-35f10d88-6872-4bb2-af3b-528a4d076df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-plugged", "status": "completed", "tag": "816e38ad-dd4a-4517-9175-b3b52a3f92ce"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:02.057638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4445ad3c-0d55-4fc6-adb4-0417826a7ff0 req-35f10d88-6872-4bb2-af3b-528a4d076df2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:02.066210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4445ad3c-0d55-4fc6-adb4-0417826a7ff0 req-35f10d88-6872-4bb2-af3b-528a4d076df2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:02.066991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4445ad3c-0d55-4fc6-adb4-0417826a7ff0 req-35f10d88-6872-4bb2-af3b-528a4d076df2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:02.132226 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-4445ad3c-0d55-4fc6-adb4-0417826a7ff0 req-35f10d88-6872-4bb2-af3b-528a4d076df2 service nova] Creating event network-vif-plugged:816e38ad-dd4a-4517-9175-b3b52a3f92ce for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:35:02.139893 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-4445ad3c-0d55-4fc6-adb4-0417826a7ff0 req-35f10d88-6872-4bb2-af3b-528a4d076df2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174150 Aug 09 17:35:02.147695 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2182/4626] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:35:02.649128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-61421f2e-ebfa-4f94-9720-32e571e4a6a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:02.672127 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-61421f2e-ebfa-4f94-9720-32e571e4a6a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.963823 Aug 09 17:35:02.684411 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2445/4627] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:01 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:02.701985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2325a07d-4a15-4144-a9f8-7bc90f19d237 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:02.706013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2325a07d-4a15-4144-a9f8-7bc90f19d237 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:02.715926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2325a07d-4a15-4144-a9f8-7bc90f19d237 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:02.716412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2325a07d-4a15-4144-a9f8-7bc90f19d237 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:02.716920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2325a07d-4a15-4144-a9f8-7bc90f19d237 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:02.718112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2325a07d-4a15-4144-a9f8-7bc90f19d237 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:02.718595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2325a07d-4a15-4144-a9f8-7bc90f19d237 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:02.719580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2325a07d-4a15-4144-a9f8-7bc90f19d237 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:02.745426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:02.746913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:02.775077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:02.783248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:02.783791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:02.784584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:02.785108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:02.789284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:02.807231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:35:03.570256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2325a07d-4a15-4144-a9f8-7bc90f19d237 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:03.584898 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2325a07d-4a15-4144-a9f8-7bc90f19d237 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.888470 Aug 09 17:35:03.585692 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2183/4628] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:02 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:03.612183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6ee723cc-0d0e-471f-a2b5-50b4df881c55 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:03.612963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6ee723cc-0d0e-471f-a2b5-50b4df881c55 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:03.669047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee723cc-0d0e-471f-a2b5-50b4df881c55 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:03.669551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee723cc-0d0e-471f-a2b5-50b4df881c55 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:03.680308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee723cc-0d0e-471f-a2b5-50b4df881c55 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:03.681207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee723cc-0d0e-471f-a2b5-50b4df881c55 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:03.681707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee723cc-0d0e-471f-a2b5-50b4df881c55 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:03.682160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee723cc-0d0e-471f-a2b5-50b4df881c55 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:04.275417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:04.292163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:04.294660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:04.298160 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5209c136-82b1-4034-a270-ac76cd4c4a5f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.568697 Aug 09 17:35:04.299442 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2446/4629] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:35:02 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:35:04.305484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b1351ea6-481d-4249-bf8e-766e095a4bab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:04.306534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b1351ea6-481d-4249-bf8e-766e095a4bab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:04.315244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1351ea6-481d-4249-bf8e-766e095a4bab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:04.316047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1351ea6-481d-4249-bf8e-766e095a4bab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:04.317260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1351ea6-481d-4249-bf8e-766e095a4bab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:04.318256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1351ea6-481d-4249-bf8e-766e095a4bab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:04.319110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1351ea6-481d-4249-bf8e-766e095a4bab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:04.319741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1351ea6-481d-4249-bf8e-766e095a4bab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:04.700557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6ee723cc-0d0e-471f-a2b5-50b4df881c55 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:04.713458 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6ee723cc-0d0e-471f-a2b5-50b4df881c55 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1309 microversion: 2.1 time: 1.126607 Aug 09 17:35:04.720464 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2184/4630] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:03 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1309 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:04.726012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ff0e7f46-bd1c-4007-bda7-504d8a776dff req-930be3ce-62fb-4f7f-ad95-e004fc259ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f7a36b-8045-44a8-8dc6-da874810810d", "name": "network-vif-plugged", "status": "completed", "tag": "2cbd3a03-feec-49ec-9f40-ac4ce8889536"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:04.763656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ff0e7f46-bd1c-4007-bda7-504d8a776dff req-930be3ce-62fb-4f7f-ad95-e004fc259ac4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:04.770298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ff0e7f46-bd1c-4007-bda7-504d8a776dff req-930be3ce-62fb-4f7f-ad95-e004fc259ac4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:04.771118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ff0e7f46-bd1c-4007-bda7-504d8a776dff req-930be3ce-62fb-4f7f-ad95-e004fc259ac4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:04.801334 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ff0e7f46-bd1c-4007-bda7-504d8a776dff req-930be3ce-62fb-4f7f-ad95-e004fc259ac4 service nova] Creating event network-vif-plugged:2cbd3a03-feec-49ec-9f40-ac4ce8889536 for instance 95f7a36b-8045-44a8-8dc6-da874810810d on n-h1-845781-6 Aug 09 17:35:04.823768 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ff0e7f46-bd1c-4007-bda7-504d8a776dff req-930be3ce-62fb-4f7f-ad95-e004fc259ac4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101432 Aug 09 17:35:04.824919 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2185/4631] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:35:05.298661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b1351ea6-481d-4249-bf8e-766e095a4bab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:05.315870 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b1351ea6-481d-4249-bf8e-766e095a4bab tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.014828 Aug 09 17:35:05.324053 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2447/4632] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:04 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:05.340893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:05.341980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:05.367309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b1acf75c-05cf-43a1-93a6-a8236940d344 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:05.368474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b1acf75c-05cf-43a1-93a6-a8236940d344 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:05.374836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:05.387185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:05.389092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:05.391321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:05.396946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1acf75c-05cf-43a1-93a6-a8236940d344 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:05.398013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:05.399883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:05.410080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1acf75c-05cf-43a1-93a6-a8236940d344 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:05.413799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1acf75c-05cf-43a1-93a6-a8236940d344 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:05.415143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1acf75c-05cf-43a1-93a6-a8236940d344 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:05.418313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1acf75c-05cf-43a1-93a6-a8236940d344 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:05.419165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1acf75c-05cf-43a1-93a6-a8236940d344 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:05.702851 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b1acf75c-05cf-43a1-93a6-a8236940d344 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.342017 Aug 09 17:35:05.706187 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2448/4633] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:35:05 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:35:05.725601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a985f165-1f4b-4fba-804a-d69c90fbd445 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:05.744304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a985f165-1f4b-4fba-804a-d69c90fbd445 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:05.772581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a985f165-1f4b-4fba-804a-d69c90fbd445 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:05.795853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a985f165-1f4b-4fba-804a-d69c90fbd445 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:05.804390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a985f165-1f4b-4fba-804a-d69c90fbd445 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:05.805587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a985f165-1f4b-4fba-804a-d69c90fbd445 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:05.812432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a985f165-1f4b-4fba-804a-d69c90fbd445 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:05.813164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a985f165-1f4b-4fba-804a-d69c90fbd445 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:06.304329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a985f165-1f4b-4fba-804a-d69c90fbd445 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:06.313663 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a985f165-1f4b-4fba-804a-d69c90fbd445 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1674 microversion: 2.1 time: 0.599970 Aug 09 17:35:06.315046 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2449/4634] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:05 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1674 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:35:06.321029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7576149f-ee20-4a0d-b516-9ac8ccafd0c7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:06.322022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7576149f-ee20-4a0d-b516-9ac8ccafd0c7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:06.329619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7576149f-ee20-4a0d-b516-9ac8ccafd0c7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:06.330545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7576149f-ee20-4a0d-b516-9ac8ccafd0c7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:06.331206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7576149f-ee20-4a0d-b516-9ac8ccafd0c7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:06.332912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7576149f-ee20-4a0d-b516-9ac8ccafd0c7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:06.333689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7576149f-ee20-4a0d-b516-9ac8ccafd0c7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:06.334434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7576149f-ee20-4a0d-b516-9ac8ccafd0c7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:06.612934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:06.640465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:06.645957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:06.651099 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f176f837-a7cd-4e7b-8c91-777eeb794686 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1879 microversion: 2.32 time: 1.313522 Aug 09 17:35:06.671268 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2186/4635] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:35:05 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1879 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:35:06.687298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a6a44843-92e2-4f25-8888-0e20e6e408fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:06.688637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a6a44843-92e2-4f25-8888-0e20e6e408fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:06.706487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a44843-92e2-4f25-8888-0e20e6e408fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:06.708065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a44843-92e2-4f25-8888-0e20e6e408fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:06.709274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a44843-92e2-4f25-8888-0e20e6e408fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:06.712505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a44843-92e2-4f25-8888-0e20e6e408fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:06.713841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a44843-92e2-4f25-8888-0e20e6e408fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:06.714829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6a44843-92e2-4f25-8888-0e20e6e408fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:06.873611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a6a44843-92e2-4f25-8888-0e20e6e408fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:35:07.086635 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a6a44843-92e2-4f25-8888-0e20e6e408fa tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 204 len: 0 microversion: 2.1 time: 0.412658 Aug 09 17:35:07.089730 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2187/4636] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:35:06 2022] DELETE /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:35:07.112477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-74f2e412-920f-4eeb-ab32-8e03267568cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:07.113732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-74f2e412-920f-4eeb-ab32-8e03267568cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:07.127007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7576149f-ee20-4a0d-b516-9ac8ccafd0c7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:07.141213 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7576149f-ee20-4a0d-b516-9ac8ccafd0c7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1309 microversion: 2.1 time: 0.824095 Aug 09 17:35:07.144236 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2450/4637] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:06 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1309 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:07.157838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74f2e412-920f-4eeb-ab32-8e03267568cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:07.158543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74f2e412-920f-4eeb-ab32-8e03267568cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:07.159144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74f2e412-920f-4eeb-ab32-8e03267568cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:07.165230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74f2e412-920f-4eeb-ab32-8e03267568cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:07.167420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74f2e412-920f-4eeb-ab32-8e03267568cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:07.168209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74f2e412-920f-4eeb-ab32-8e03267568cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:07.360599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ece296b7-ddf0-401b-ab5b-78f25790d88a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:07.362964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ece296b7-ddf0-401b-ab5b-78f25790d88a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:07.376572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece296b7-ddf0-401b-ab5b-78f25790d88a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:07.377493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece296b7-ddf0-401b-ab5b-78f25790d88a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:07.378314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece296b7-ddf0-401b-ab5b-78f25790d88a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:07.379809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece296b7-ddf0-401b-ab5b-78f25790d88a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:07.380707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece296b7-ddf0-401b-ab5b-78f25790d88a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:07.381526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece296b7-ddf0-401b-ab5b-78f25790d88a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:07.776254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ece296b7-ddf0-401b-ab5b-78f25790d88a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:07.793532 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ece296b7-ddf0-401b-ab5b-78f25790d88a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1654 microversion: 2.1 time: 0.441962 Aug 09 17:35:07.794142 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2451/4638] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:07 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1654 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:35:07.803501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:07.804449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:07.825640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:07.826432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:07.827054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:07.828016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:07.829817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:07.829817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:08.243552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-74f2e412-920f-4eeb-ab32-8e03267568cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:08.260378 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-74f2e412-920f-4eeb-ab32-8e03267568cd tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1513 microversion: 2.1 time: 1.161945 Aug 09 17:35:08.262164 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2188/4639] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:07 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1513 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:08.274317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4d3bb583-3dc2-4967-9855-1b3f093bda2e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:08.276262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4d3bb583-3dc2-4967-9855-1b3f093bda2e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:08.326994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d3bb583-3dc2-4967-9855-1b3f093bda2e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:08.330971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d3bb583-3dc2-4967-9855-1b3f093bda2e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:08.332581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d3bb583-3dc2-4967-9855-1b3f093bda2e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:08.334151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d3bb583-3dc2-4967-9855-1b3f093bda2e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:08.334963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d3bb583-3dc2-4967-9855-1b3f093bda2e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:08.336034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d3bb583-3dc2-4967-9855-1b3f093bda2e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:08.452217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:35:08.455774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:08.473583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:08.475208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:08.476582 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-efdc265f-2562-40f6-8d65-7ac2d33b056a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2834 microversion: 2.32 time: 0.681258 Aug 09 17:35:08.492436 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2452/4640] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:35:07 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2834 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:35:08.498004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-83220b8e-4857-476a-91c0-7ebb1269c3c8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:08.498899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-83220b8e-4857-476a-91c0-7ebb1269c3c8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:08.513584 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4d3bb583-3dc2-4967-9855-1b3f093bda2e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.249372 Aug 09 17:35:08.514621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83220b8e-4857-476a-91c0-7ebb1269c3c8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:08.515873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83220b8e-4857-476a-91c0-7ebb1269c3c8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:08.520152 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2189/4641] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:35:08 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:35:08.532903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83220b8e-4857-476a-91c0-7ebb1269c3c8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:08.534942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4a77a246-1b6d-482c-b36e-b6c16a203618 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:08.536501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4a77a246-1b6d-482c-b36e-b6c16a203618 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:08.538822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83220b8e-4857-476a-91c0-7ebb1269c3c8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:08.540021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83220b8e-4857-476a-91c0-7ebb1269c3c8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:08.546300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83220b8e-4857-476a-91c0-7ebb1269c3c8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:08.548692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a77a246-1b6d-482c-b36e-b6c16a203618 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:08.554637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a77a246-1b6d-482c-b36e-b6c16a203618 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:08.555245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a77a246-1b6d-482c-b36e-b6c16a203618 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:08.556230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a77a246-1b6d-482c-b36e-b6c16a203618 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:08.556961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a77a246-1b6d-482c-b36e-b6c16a203618 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:08.557685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a77a246-1b6d-482c-b36e-b6c16a203618 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:08.953555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4a77a246-1b6d-482c-b36e-b6c16a203618 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:08.972252 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4a77a246-1b6d-482c-b36e-b6c16a203618 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1661 microversion: 2.1 time: 0.447427 Aug 09 17:35:08.974640 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2190/4642] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:08 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1661 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:35:08.990178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c6d0a0e0-7fc7-460d-87db-695fa4e68d1d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:08.991243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c6d0a0e0-7fc7-460d-87db-695fa4e68d1d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:09.009785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6d0a0e0-7fc7-460d-87db-695fa4e68d1d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:09.018109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6d0a0e0-7fc7-460d-87db-695fa4e68d1d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:09.027583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6d0a0e0-7fc7-460d-87db-695fa4e68d1d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:09.031792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6d0a0e0-7fc7-460d-87db-695fa4e68d1d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:09.034351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6d0a0e0-7fc7-460d-87db-695fa4e68d1d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:09.035824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6d0a0e0-7fc7-460d-87db-695fa4e68d1d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:09.258798 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c6d0a0e0-7fc7-460d-87db-695fa4e68d1d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.281599 Aug 09 17:35:09.260227 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2191/4643] 10.222.0.93 () {60 vars in 1316 bytes} [Tue Aug 9 17:35:08 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92/os-interface => generated 1832 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:35:09.305600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c28377dd-2546-4646-a2ed-ffda31d3407f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:09.310523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c28377dd-2546-4646-a2ed-ffda31d3407f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:09.330310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c28377dd-2546-4646-a2ed-ffda31d3407f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:09.335057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c28377dd-2546-4646-a2ed-ffda31d3407f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:09.337975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c28377dd-2546-4646-a2ed-ffda31d3407f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:09.339111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c28377dd-2546-4646-a2ed-ffda31d3407f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:09.342230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c28377dd-2546-4646-a2ed-ffda31d3407f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:09.343059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c28377dd-2546-4646-a2ed-ffda31d3407f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:09.656605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c28377dd-2546-4646-a2ed-ffda31d3407f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:09.669620 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c28377dd-2546-4646-a2ed-ffda31d3407f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1513 microversion: 2.1 time: 0.369893 Aug 09 17:35:09.688094 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2192/4644] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:09 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1513 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:09.857652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-83220b8e-4857-476a-91c0-7ebb1269c3c8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:09.868260 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-83220b8e-4857-476a-91c0-7ebb1269c3c8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1309 microversion: 2.1 time: 1.374279 Aug 09 17:35:09.873589 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2453/4645] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:08 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1309 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:09.999821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ac27f3f4-e7ea-4d2b-a58c-b78329297c89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:10.000992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ac27f3f4-e7ea-4d2b-a58c-b78329297c89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:10.015575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac27f3f4-e7ea-4d2b-a58c-b78329297c89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:10.016121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac27f3f4-e7ea-4d2b-a58c-b78329297c89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:10.016574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac27f3f4-e7ea-4d2b-a58c-b78329297c89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:10.017308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac27f3f4-e7ea-4d2b-a58c-b78329297c89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:10.017772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac27f3f4-e7ea-4d2b-a58c-b78329297c89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:10.018206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac27f3f4-e7ea-4d2b-a58c-b78329297c89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:10.362946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ac27f3f4-e7ea-4d2b-a58c-b78329297c89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:10.382455 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ac27f3f4-e7ea-4d2b-a58c-b78329297c89 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.386643 Aug 09 17:35:10.383348 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2193/4646] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:09 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:10.429554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0c5a26fc-e86f-44e2-b5ce-238bf1473968 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:10.430171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0c5a26fc-e86f-44e2-b5ce-238bf1473968 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:10.454321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c5a26fc-e86f-44e2-b5ce-238bf1473968 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:10.459787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c5a26fc-e86f-44e2-b5ce-238bf1473968 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:10.460462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c5a26fc-e86f-44e2-b5ce-238bf1473968 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:10.468047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c5a26fc-e86f-44e2-b5ce-238bf1473968 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:10.469145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c5a26fc-e86f-44e2-b5ce-238bf1473968 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:10.469781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c5a26fc-e86f-44e2-b5ce-238bf1473968 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:10.718369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-086792f9-5b4e-42a8-9644-1764474dea4f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:10.721039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-086792f9-5b4e-42a8-9644-1764474dea4f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:10.740110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086792f9-5b4e-42a8-9644-1764474dea4f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:10.741039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086792f9-5b4e-42a8-9644-1764474dea4f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:10.741658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086792f9-5b4e-42a8-9644-1764474dea4f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:10.742765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086792f9-5b4e-42a8-9644-1764474dea4f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:10.746177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086792f9-5b4e-42a8-9644-1764474dea4f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:10.747063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-086792f9-5b4e-42a8-9644-1764474dea4f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:11.360711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-086792f9-5b4e-42a8-9644-1764474dea4f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b13ba9ce5d492dba79fa082d58ca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596fa4a2074f4863ba4d1e6edb7bf22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:11.361206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0c5a26fc-e86f-44e2-b5ce-238bf1473968 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:11.377116 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-086792f9-5b4e-42a8-9644-1764474dea4f tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 200 len: 1513 microversion: 2.1 time: 0.674505 Aug 09 17:35:11.377738 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2194/4647] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:10 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 1513 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:11.384634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e55bf1e8-a598-4e09-9cfc-213e47a78c0a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:11.385556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e55bf1e8-a598-4e09-9cfc-213e47a78c0a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:11.394857 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0c5a26fc-e86f-44e2-b5ce-238bf1473968 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.969625 Aug 09 17:35:11.396167 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2454/4648] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:10 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:11.396848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55bf1e8-a598-4e09-9cfc-213e47a78c0a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:11.397574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55bf1e8-a598-4e09-9cfc-213e47a78c0a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:11.398169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55bf1e8-a598-4e09-9cfc-213e47a78c0a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:11.399241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55bf1e8-a598-4e09-9cfc-213e47a78c0a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:11.399927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55bf1e8-a598-4e09-9cfc-213e47a78c0a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:11.400530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e55bf1e8-a598-4e09-9cfc-213e47a78c0a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:11.436054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c5f99ae1-d14d-43ab-b257-70a1cb697727 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:11.437325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c5f99ae1-d14d-43ab-b257-70a1cb697727 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:11.440697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=68 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:35:11.451929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5f99ae1-d14d-43ab-b257-70a1cb697727 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:11.457823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5f99ae1-d14d-43ab-b257-70a1cb697727 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:11.458548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5f99ae1-d14d-43ab-b257-70a1cb697727 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:11.459506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5f99ae1-d14d-43ab-b257-70a1cb697727 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:11.460335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5f99ae1-d14d-43ab-b257-70a1cb697727 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:11.461129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5f99ae1-d14d-43ab-b257-70a1cb697727 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:11.986435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e55bf1e8-a598-4e09-9cfc-213e47a78c0a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:12.027918 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e55bf1e8-a598-4e09-9cfc-213e47a78c0a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1490 microversion: 2.1 time: 0.649049 Aug 09 17:35:12.041833 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2195/4649] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:11 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1490 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:12.055514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-20d4bb75-b45f-41e8-848f-21b36c983367 req-61f2551e-f529-48b5-9b00-7ef5e12d4afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab7eacc-f17d-42aa-b80d-150c57cb9ed1", "name": "network-vif-deleted", "tag": "8921d998-158f-49ea-a80e-b467a9534234"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:12.071420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-20d4bb75-b45f-41e8-848f-21b36c983367 req-61f2551e-f529-48b5-9b00-7ef5e12d4afc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:12.072229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-20d4bb75-b45f-41e8-848f-21b36c983367 req-61f2551e-f529-48b5-9b00-7ef5e12d4afc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:12.072782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-20d4bb75-b45f-41e8-848f-21b36c983367 req-61f2551e-f529-48b5-9b00-7ef5e12d4afc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:12.104353 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-20d4bb75-b45f-41e8-848f-21b36c983367 req-61f2551e-f529-48b5-9b00-7ef5e12d4afc service nova] Creating event network-vif-deleted:8921d998-158f-49ea-a80e-b467a9534234 for instance cab7eacc-f17d-42aa-b80d-150c57cb9ed1 on n-h1-845781-6 Aug 09 17:35:12.111377 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-20d4bb75-b45f-41e8-848f-21b36c983367 req-61f2551e-f529-48b5-9b00-7ef5e12d4afc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067942 Aug 09 17:35:12.112553 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2196/4650] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:35:12.118735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d2ffa668-1264-4d62-98e6-f5aa475b4d89 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-90498408"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:12.121717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d2ffa668-1264-4d62-98e6-f5aa475b4d89 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:12.128733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2ffa668-1264-4d62-98e6-f5aa475b4d89 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:12.129393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2ffa668-1264-4d62-98e6-f5aa475b4d89 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:12.129904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2ffa668-1264-4d62-98e6-f5aa475b4d89 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:12.130722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2ffa668-1264-4d62-98e6-f5aa475b4d89 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:12.131268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2ffa668-1264-4d62-98e6-f5aa475b4d89 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:12.131821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2ffa668-1264-4d62-98e6-f5aa475b4d89 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:12.240190 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d2ffa668-1264-4d62-98e6-f5aa475b4d89 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "PUT /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1073 microversion: 2.1 time: 0.126186 Aug 09 17:35:12.241486 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2197/4651] 10.222.0.93 () {60 vars in 1256 bytes} [Tue Aug 9 17:35:12 2022] PUT /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1073 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:12.260404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2e885340-0c5a-411e-8a58-266e339c1868 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:12.261353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2e885340-0c5a-411e-8a58-266e339c1868 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:12.285079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e885340-0c5a-411e-8a58-266e339c1868 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:12.288487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e885340-0c5a-411e-8a58-266e339c1868 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:12.293268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e885340-0c5a-411e-8a58-266e339c1868 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:12.294698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e885340-0c5a-411e-8a58-266e339c1868 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:12.295492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e885340-0c5a-411e-8a58-266e339c1868 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:12.296204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2e885340-0c5a-411e-8a58-266e339c1868 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:12.849593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c5f99ae1-d14d-43ab-b257-70a1cb697727 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:12.865626 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c5f99ae1-d14d-43ab-b257-70a1cb697727 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.433357 Aug 09 17:35:12.869289 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2455/4652] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:11 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:35:12.889381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:12.893717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] [instance: cab7eacc-f17d-42aa-b80d-150c57cb9ed1] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:12.931180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:12.936590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:12.937989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:12.940444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:12.942906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:12.946248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:13.025638 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] HTTP exception thrown: Instance cab7eacc-f17d-42aa-b80d-150c57cb9ed1 could not be found. Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Request method failure captured: Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 HTTP/1.1 Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pkMP0fFe9Rcs1XI3QZKwVBTqyPoKqabsjnXpH_8tFYUXttWRhai5a7qtfrgmQWQouRIxkZbOnDPrqfwdKCqLza-n6LKzP9NQOEl1c679Fk8t3Jv8WP1IKSgMy_tn-YEpBj3hZUwJYyZDgHnZG5XzzXUZuoVrD7COLmJvje8E6wxtiA Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 596fa4a2074f4863ba4d1e6edb7bf22c Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1130522351 Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_596fa4a2074f4863ba4d1e6edb7bf22c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/596fa4a2074f4863ba4d1e6edb7bf22c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/596fa4a2074f4863ba4d1e6edb7bf22c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/596fa4a2074f4863ba4d1e6edb7bf22c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-VolumesSnapshotTestJSON-1130522351 Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 596fa4a2074f4863ba4d1e6edb7bf22c Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1130522351 Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-VolumesSnapshotTestJSON-1130522351-project Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 55b13ba9ce5d492dba79fa082d58ca9f Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-VolumesSnapshotTestJSON-1130522351-project Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance cab7eacc-f17d-42aa-b80d-150c57cb9ed1 could not be found. Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'cab7eacc-f17d-42aa-b80d-150c57cb9ed1'} Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab7eacc-f17d-42aa-b80d-150c57cb9ed1 could not be found. Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab7eacc-f17d-42aa-b80d-150c57cb9ed1 could not be found. Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:13.029965 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:13.048833 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:13.048833 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:13.048833 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:13.048833 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:13.048833 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:13.048833 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab7eacc-f17d-42aa-b80d-150c57cb9ed1 could not be found. Aug 09 17:35:13.048833 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:13.048833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] Returning 404 to user: Instance cab7eacc-f17d-42aa-b80d-150c57cb9ed1 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:13.048833 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-78ad0263-5392-4e40-8755-7f888b35e0a5 tempest-VolumesSnapshotTestJSON-1130522351 tempest-VolumesSnapshotTestJSON-1130522351-project] 10.222.0.93 "GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1" status: 404 len: 111 microversion: 2.1 time: 0.169220 Aug 09 17:35:13.048833 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2456/4653] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:12 2022] GET /compute/v2.1/servers/cab7eacc-f17d-42aa-b80d-150c57cb9ed1 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:13.062073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c4e3cb9-7191-429e-9cbc-13c9fbc3e559 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:13.062720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c4e3cb9-7191-429e-9cbc-13c9fbc3e559 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:13.074879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c4e3cb9-7191-429e-9cbc-13c9fbc3e559 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:13.075393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c4e3cb9-7191-429e-9cbc-13c9fbc3e559 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:13.076013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c4e3cb9-7191-429e-9cbc-13c9fbc3e559 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:13.079103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c4e3cb9-7191-429e-9cbc-13c9fbc3e559 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:13.079711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c4e3cb9-7191-429e-9cbc-13c9fbc3e559 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:13.080247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c4e3cb9-7191-429e-9cbc-13c9fbc3e559 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:13.201354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2e885340-0c5a-411e-8a58-266e339c1868 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:13.218838 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2e885340-0c5a-411e-8a58-266e339c1868 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1499 microversion: 2.1 time: 0.963668 Aug 09 17:35:13.246296 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2198/4654] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:12 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1499 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:35:13.252988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7d5251d5-ae41-43ac-9a34-0cd297bd674b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:13.253609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7d5251d5-ae41-43ac-9a34-0cd297bd674b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:13.262140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d5251d5-ae41-43ac-9a34-0cd297bd674b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:13.262637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d5251d5-ae41-43ac-9a34-0cd297bd674b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:13.266323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d5251d5-ae41-43ac-9a34-0cd297bd674b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:13.269229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d5251d5-ae41-43ac-9a34-0cd297bd674b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:13.271430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d5251d5-ae41-43ac-9a34-0cd297bd674b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:13.272140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7d5251d5-ae41-43ac-9a34-0cd297bd674b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:13.569926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7d5251d5-ae41-43ac-9a34-0cd297bd674b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:13.592593 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7d5251d5-ae41-43ac-9a34-0cd297bd674b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1499 microversion: 2.1 time: 0.343782 Aug 09 17:35:13.601441 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2199/4655] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:13 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1499 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:13.622179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e1c0d597-7a54-497d-a33c-c6a931565c81 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:13.646895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1c0d597-7a54-497d-a33c-c6a931565c81 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:13.651073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1c0d597-7a54-497d-a33c-c6a931565c81 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:13.651441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1c0d597-7a54-497d-a33c-c6a931565c81 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:13.715188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e1c0d597-7a54-497d-a33c-c6a931565c81 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Going to try to stop instance {{(pid=119432) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 17:35:13.880236 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e1c0d597-7a54-497d-a33c-c6a931565c81 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "POST /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d/action" status: 202 len: 0 microversion: 2.1 time: 0.266167 Aug 09 17:35:13.885788 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2200/4656] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:35:13 2022] POST /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:35:13.905500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c262b5c9-aabd-4afc-a49a-3cbca1ed1021 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:13.908311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c262b5c9-aabd-4afc-a49a-3cbca1ed1021 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:13.923254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c262b5c9-aabd-4afc-a49a-3cbca1ed1021 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:13.930824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c262b5c9-aabd-4afc-a49a-3cbca1ed1021 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:13.931601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c262b5c9-aabd-4afc-a49a-3cbca1ed1021 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:13.933922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c262b5c9-aabd-4afc-a49a-3cbca1ed1021 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:13.934748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c262b5c9-aabd-4afc-a49a-3cbca1ed1021 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:13.936229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c262b5c9-aabd-4afc-a49a-3cbca1ed1021 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:14.066997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5c4e3cb9-7191-429e-9cbc-13c9fbc3e559 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:14.079156 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c4e3cb9-7191-429e-9cbc-13c9fbc3e559 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.036497 Aug 09 17:35:14.081156 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2457/4657] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:13 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:14.125164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e5237867-fe95-4534-8aa8-8fe3e4d68c37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:14.126937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e5237867-fe95-4534-8aa8-8fe3e4d68c37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:14.140429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5237867-fe95-4534-8aa8-8fe3e4d68c37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:14.141878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5237867-fe95-4534-8aa8-8fe3e4d68c37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:14.143056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5237867-fe95-4534-8aa8-8fe3e4d68c37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:14.145849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5237867-fe95-4534-8aa8-8fe3e4d68c37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:14.152479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5237867-fe95-4534-8aa8-8fe3e4d68c37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:14.152973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5237867-fe95-4534-8aa8-8fe3e4d68c37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:14.497366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c262b5c9-aabd-4afc-a49a-3cbca1ed1021 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:14.525167 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c262b5c9-aabd-4afc-a49a-3cbca1ed1021 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1509 microversion: 2.1 time: 0.636627 Aug 09 17:35:14.532583 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2201/4658] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:13 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1509 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:14.799712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-87bdf6fe-803f-4eb1-af30-98e72d91dcaa req-bb60ff44-9a16-433b-9518-887d95d7a8ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "tag": "816e38ad-dd4a-4517-9175-b3b52a3f92ce"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:14.827723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-87bdf6fe-803f-4eb1-af30-98e72d91dcaa req-bb60ff44-9a16-433b-9518-887d95d7a8ad service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:14.830010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-87bdf6fe-803f-4eb1-af30-98e72d91dcaa req-bb60ff44-9a16-433b-9518-887d95d7a8ad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:14.832865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-87bdf6fe-803f-4eb1-af30-98e72d91dcaa req-bb60ff44-9a16-433b-9518-887d95d7a8ad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:14.911699 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-87bdf6fe-803f-4eb1-af30-98e72d91dcaa req-bb60ff44-9a16-433b-9518-887d95d7a8ad service nova] Creating event network-changed:816e38ad-dd4a-4517-9175-b3b52a3f92ce for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:35:14.932388 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-87bdf6fe-803f-4eb1-af30-98e72d91dcaa req-bb60ff44-9a16-433b-9518-887d95d7a8ad service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139672 Aug 09 17:35:14.933506 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2202/4659] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:35:14.958202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e5237867-fe95-4534-8aa8-8fe3e4d68c37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:14.982404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e5237867-fe95-4534-8aa8-8fe3e4d68c37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.864700 Aug 09 17:35:14.994994 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2458/4660] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:14 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:15.006153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f4772fb2-4464-48e2-93c1-f00d3214587c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:15.006872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f4772fb2-4464-48e2-93c1-f00d3214587c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:15.021690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4772fb2-4464-48e2-93c1-f00d3214587c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:15.022587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4772fb2-4464-48e2-93c1-f00d3214587c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:15.023887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4772fb2-4464-48e2-93c1-f00d3214587c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:15.024935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4772fb2-4464-48e2-93c1-f00d3214587c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:15.025667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4772fb2-4464-48e2-93c1-f00d3214587c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:15.026400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4772fb2-4464-48e2-93c1-f00d3214587c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:15.441850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f4772fb2-4464-48e2-93c1-f00d3214587c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:15.465680 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f4772fb2-4464-48e2-93c1-f00d3214587c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.464419 Aug 09 17:35:15.478350 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2203/4661] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:14 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:15.553992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6523a4f6-9c31-4577-862e-41f7e822ac43 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:15.555426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6523a4f6-9c31-4577-862e-41f7e822ac43 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:15.566781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-9c31-4577-862e-41f7e822ac43 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:15.572982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-9c31-4577-862e-41f7e822ac43 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:15.573954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-9c31-4577-862e-41f7e822ac43 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:15.575955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-9c31-4577-862e-41f7e822ac43 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:15.576830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-9c31-4577-862e-41f7e822ac43 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:15.577544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6523a4f6-9c31-4577-862e-41f7e822ac43 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:16.047677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6523a4f6-9c31-4577-862e-41f7e822ac43 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:16.068879 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6523a4f6-9c31-4577-862e-41f7e822ac43 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1509 microversion: 2.1 time: 0.515090 Aug 09 17:35:16.071871 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2459/4662] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:15 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1509 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:17.118066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0298c536-23cd-48d7-a6d1-4cc8bb6c60ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:17.122897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0298c536-23cd-48d7-a6d1-4cc8bb6c60ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:17.179607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0298c536-23cd-48d7-a6d1-4cc8bb6c60ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:17.183314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0298c536-23cd-48d7-a6d1-4cc8bb6c60ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:17.184690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0298c536-23cd-48d7-a6d1-4cc8bb6c60ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:17.186434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0298c536-23cd-48d7-a6d1-4cc8bb6c60ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:17.188023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0298c536-23cd-48d7-a6d1-4cc8bb6c60ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:17.192831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0298c536-23cd-48d7-a6d1-4cc8bb6c60ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:17.896503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0298c536-23cd-48d7-a6d1-4cc8bb6c60ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:17.917739 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0298c536-23cd-48d7-a6d1-4cc8bb6c60ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1509 microversion: 2.1 time: 0.821795 Aug 09 17:35:17.936732 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2204/4663] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:17 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1509 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:18.946693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e3b9e61-d6a3-4e5c-92b0-1651ad14b233 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:18.948110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e3b9e61-d6a3-4e5c-92b0-1651ad14b233 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:18.975276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e3b9e61-d6a3-4e5c-92b0-1651ad14b233 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:18.978429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e3b9e61-d6a3-4e5c-92b0-1651ad14b233 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:18.981340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e3b9e61-d6a3-4e5c-92b0-1651ad14b233 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:18.987213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e3b9e61-d6a3-4e5c-92b0-1651ad14b233 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:18.989725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e3b9e61-d6a3-4e5c-92b0-1651ad14b233 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:18.991719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e3b9e61-d6a3-4e5c-92b0-1651ad14b233 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:19.372074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e3b9e61-d6a3-4e5c-92b0-1651ad14b233 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:19.403764 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e3b9e61-d6a3-4e5c-92b0-1651ad14b233 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1509 microversion: 2.1 time: 0.458068 Aug 09 17:35:19.405930 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2460/4664] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:18 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1509 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:20.430180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72b740de-f24c-44cd-8d9a-e64925860da3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:20.431260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-72b740de-f24c-44cd-8d9a-e64925860da3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:20.440740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b740de-f24c-44cd-8d9a-e64925860da3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:20.441236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b740de-f24c-44cd-8d9a-e64925860da3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:20.448861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b740de-f24c-44cd-8d9a-e64925860da3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:20.449927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b740de-f24c-44cd-8d9a-e64925860da3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:20.450580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b740de-f24c-44cd-8d9a-e64925860da3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:20.451015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72b740de-f24c-44cd-8d9a-e64925860da3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:20.758629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-72b740de-f24c-44cd-8d9a-e64925860da3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:20.804359 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72b740de-f24c-44cd-8d9a-e64925860da3 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1509 microversion: 2.1 time: 0.377539 Aug 09 17:35:20.809550 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2205/4665] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:20 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1509 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:22.729157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5390e9bf-5dc5-4686-b9ba-016000114e37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:22.730410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5390e9bf-5dc5-4686-b9ba-016000114e37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:22.748959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5390e9bf-5dc5-4686-b9ba-016000114e37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:22.749461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5390e9bf-5dc5-4686-b9ba-016000114e37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:22.749902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5390e9bf-5dc5-4686-b9ba-016000114e37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:22.750635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5390e9bf-5dc5-4686-b9ba-016000114e37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:22.751097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5390e9bf-5dc5-4686-b9ba-016000114e37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:22.751687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5390e9bf-5dc5-4686-b9ba-016000114e37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:23.422202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5390e9bf-5dc5-4686-b9ba-016000114e37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:23.438676 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5390e9bf-5dc5-4686-b9ba-016000114e37 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1509 microversion: 2.1 time: 1.612876 Aug 09 17:35:23.454265 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2461/4666] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:21 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1509 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:35:24.475967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a0017b50-3934-40ca-8410-822513ca5357 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:24.480063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a0017b50-3934-40ca-8410-822513ca5357 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:24.516343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0017b50-3934-40ca-8410-822513ca5357 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:24.521692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0017b50-3934-40ca-8410-822513ca5357 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:24.523687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0017b50-3934-40ca-8410-822513ca5357 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:24.525113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0017b50-3934-40ca-8410-822513ca5357 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:24.525991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0017b50-3934-40ca-8410-822513ca5357 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:24.526803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a0017b50-3934-40ca-8410-822513ca5357 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:24.555378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:35:25.355827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a0017b50-3934-40ca-8410-822513ca5357 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:25.385300 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a0017b50-3934-40ca-8410-822513ca5357 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1509 microversion: 2.1 time: 0.926561 Aug 09 17:35:25.404344 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2206/4667] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:24 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1509 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:26.462549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c7de813d-0e0f-42de-8211-47dc17ff256b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:26.465393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c7de813d-0e0f-42de-8211-47dc17ff256b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:26.480242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7de813d-0e0f-42de-8211-47dc17ff256b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:26.481299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7de813d-0e0f-42de-8211-47dc17ff256b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:26.482392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7de813d-0e0f-42de-8211-47dc17ff256b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:26.483973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7de813d-0e0f-42de-8211-47dc17ff256b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:26.485721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7de813d-0e0f-42de-8211-47dc17ff256b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:26.487572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7de813d-0e0f-42de-8211-47dc17ff256b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:26.530607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:35:27.309837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c7de813d-0e0f-42de-8211-47dc17ff256b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:27.325738 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c7de813d-0e0f-42de-8211-47dc17ff256b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1509 microversion: 2.1 time: 0.892581 Aug 09 17:35:27.368153 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2462/4668] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:26 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1509 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:28.382984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cb3cb300-0823-465c-94d9-738d3d9ffd10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:28.386497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cb3cb300-0823-465c-94d9-738d3d9ffd10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:28.386497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:35:28.402656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb3cb300-0823-465c-94d9-738d3d9ffd10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:28.403191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb3cb300-0823-465c-94d9-738d3d9ffd10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:28.403668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb3cb300-0823-465c-94d9-738d3d9ffd10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:28.404435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb3cb300-0823-465c-94d9-738d3d9ffd10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:28.406642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb3cb300-0823-465c-94d9-738d3d9ffd10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:28.407123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb3cb300-0823-465c-94d9-738d3d9ffd10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:29.199607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cb3cb300-0823-465c-94d9-738d3d9ffd10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:29.233692 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cb3cb300-0823-465c-94d9-738d3d9ffd10 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1509 microversion: 2.1 time: 0.854589 Aug 09 17:35:29.250182 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2207/4669] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:28 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1509 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:35:30.282654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-392e1540-e88a-4ef8-8ecd-ebbab723ebb2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:30.283996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-392e1540-e88a-4ef8-8ecd-ebbab723ebb2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:30.310943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-392e1540-e88a-4ef8-8ecd-ebbab723ebb2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:30.316275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-392e1540-e88a-4ef8-8ecd-ebbab723ebb2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:30.316789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-392e1540-e88a-4ef8-8ecd-ebbab723ebb2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:30.317584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-392e1540-e88a-4ef8-8ecd-ebbab723ebb2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:30.318071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-392e1540-e88a-4ef8-8ecd-ebbab723ebb2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:30.322685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-392e1540-e88a-4ef8-8ecd-ebbab723ebb2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:31.147767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-392e1540-e88a-4ef8-8ecd-ebbab723ebb2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:31.197663 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-392e1540-e88a-4ef8-8ecd-ebbab723ebb2 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1486 microversion: 2.1 time: 0.926434 Aug 09 17:35:31.212363 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2463/4670] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:30 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1486 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:31.235447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3c506a0b-aa81-492e-840a-3456883e9505 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1048824152"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:31.239429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3c506a0b-aa81-492e-840a-3456883e9505 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:31.251176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c506a0b-aa81-492e-840a-3456883e9505 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:31.251991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c506a0b-aa81-492e-840a-3456883e9505 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:31.252718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c506a0b-aa81-492e-840a-3456883e9505 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:31.253644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c506a0b-aa81-492e-840a-3456883e9505 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:31.255560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c506a0b-aa81-492e-840a-3456883e9505 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:31.256551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3c506a0b-aa81-492e-840a-3456883e9505 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:31.624705 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3c506a0b-aa81-492e-840a-3456883e9505 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "PUT /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1061 microversion: 2.1 time: 0.390535 Aug 09 17:35:31.632685 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2208/4671] 10.222.0.93 () {60 vars in 1256 bytes} [Tue Aug 9 17:35:31 2022] PUT /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1061 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:31.666958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bf7348a6-df22-460f-b9a4-8a0db606def7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:31.673729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bf7348a6-df22-460f-b9a4-8a0db606def7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:31.707968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf7348a6-df22-460f-b9a4-8a0db606def7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:31.712140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf7348a6-df22-460f-b9a4-8a0db606def7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:31.715333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf7348a6-df22-460f-b9a4-8a0db606def7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:31.722972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf7348a6-df22-460f-b9a4-8a0db606def7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:31.728331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf7348a6-df22-460f-b9a4-8a0db606def7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:31.732122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf7348a6-df22-460f-b9a4-8a0db606def7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:32.361109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bf7348a6-df22-460f-b9a4-8a0db606def7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:32.374803 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bf7348a6-df22-460f-b9a4-8a0db606def7 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1488 microversion: 2.1 time: 0.728430 Aug 09 17:35:32.376859 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2464/4672] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:31 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1488 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:32.415804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-35810363-f6df-40a5-832b-db5d7cb940ec tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:32.417753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-35810363-f6df-40a5-832b-db5d7cb940ec tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:32.443827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35810363-f6df-40a5-832b-db5d7cb940ec tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:32.447457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35810363-f6df-40a5-832b-db5d7cb940ec tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:32.447948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35810363-f6df-40a5-832b-db5d7cb940ec tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:32.451368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35810363-f6df-40a5-832b-db5d7cb940ec tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:32.452747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35810363-f6df-40a5-832b-db5d7cb940ec tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:32.453422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35810363-f6df-40a5-832b-db5d7cb940ec tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:33.082950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-35810363-f6df-40a5-832b-db5d7cb940ec tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:33.107553 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-35810363-f6df-40a5-832b-db5d7cb940ec tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1488 microversion: 2.1 time: 0.695102 Aug 09 17:35:33.110766 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2209/4673] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:32 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1488 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:33.174041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11f11a49-f68c-4a02-a544-55ceee45c0ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:33.177438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-11f11a49-f68c-4a02-a544-55ceee45c0ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:33.213265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11f11a49-f68c-4a02-a544-55ceee45c0ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:33.214242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11f11a49-f68c-4a02-a544-55ceee45c0ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:33.215300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11f11a49-f68c-4a02-a544-55ceee45c0ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:33.218696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11f11a49-f68c-4a02-a544-55ceee45c0ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:33.219951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11f11a49-f68c-4a02-a544-55ceee45c0ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:33.230016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11f11a49-f68c-4a02-a544-55ceee45c0ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:33.321653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-11f11a49-f68c-4a02-a544-55ceee45c0ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:35:33.622319 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11f11a49-f68c-4a02-a544-55ceee45c0ea tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 204 len: 0 microversion: 2.1 time: 0.483433 Aug 09 17:35:33.636323 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2465/4674] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:35:33 2022] DELETE /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:35:33.654694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72e932bb-7433-487e-b1cc-aa7b636f27d4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:33.657953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-72e932bb-7433-487e-b1cc-aa7b636f27d4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:33.678761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e932bb-7433-487e-b1cc-aa7b636f27d4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:33.680243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e932bb-7433-487e-b1cc-aa7b636f27d4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:33.681451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e932bb-7433-487e-b1cc-aa7b636f27d4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:33.684149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e932bb-7433-487e-b1cc-aa7b636f27d4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:33.685599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e932bb-7433-487e-b1cc-aa7b636f27d4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:33.686694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e932bb-7433-487e-b1cc-aa7b636f27d4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:34.536721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-72e932bb-7433-487e-b1cc-aa7b636f27d4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:34.549423 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72e932bb-7433-487e-b1cc-aa7b636f27d4 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1494 microversion: 2.1 time: 0.905346 Aug 09 17:35:34.550037 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2210/4675] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:33 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1494 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:35.527534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d92c229d-4073-408d-978c-b72e32968e86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:35.530336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d92c229d-4073-408d-978c-b72e32968e86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:35.552490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d92c229d-4073-408d-978c-b72e32968e86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:35.555043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d92c229d-4073-408d-978c-b72e32968e86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:35.559493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d92c229d-4073-408d-978c-b72e32968e86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:35.565674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d92c229d-4073-408d-978c-b72e32968e86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:35.565674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d92c229d-4073-408d-978c-b72e32968e86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:35.566774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d92c229d-4073-408d-978c-b72e32968e86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:35.579806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-12a80d53-2800-48b5-8cd8-6a945d3d2cd8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:35.584201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-12a80d53-2800-48b5-8cd8-6a945d3d2cd8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:35.609705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12a80d53-2800-48b5-8cd8-6a945d3d2cd8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:35.612275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12a80d53-2800-48b5-8cd8-6a945d3d2cd8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:35.613098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12a80d53-2800-48b5-8cd8-6a945d3d2cd8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:35.615304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12a80d53-2800-48b5-8cd8-6a945d3d2cd8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:35.617009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12a80d53-2800-48b5-8cd8-6a945d3d2cd8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:35.620087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12a80d53-2800-48b5-8cd8-6a945d3d2cd8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:35.762995 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d92c229d-4073-408d-978c-b72e32968e86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.241401 Aug 09 17:35:35.767139 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2466/4676] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:35:35 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:35:35.784540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-02c3f34b-0c63-4183-8cfc-c9bbfd16f2ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:35.785937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-02c3f34b-0c63-4183-8cfc-c9bbfd16f2ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:35.797513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02c3f34b-0c63-4183-8cfc-c9bbfd16f2ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:35.804120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02c3f34b-0c63-4183-8cfc-c9bbfd16f2ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:35.804849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02c3f34b-0c63-4183-8cfc-c9bbfd16f2ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:35.806227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02c3f34b-0c63-4183-8cfc-c9bbfd16f2ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:35.807070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02c3f34b-0c63-4183-8cfc-c9bbfd16f2ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:35.808636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02c3f34b-0c63-4183-8cfc-c9bbfd16f2ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:36.105503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-12a80d53-2800-48b5-8cd8-6a945d3d2cd8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:36.137818 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-12a80d53-2800-48b5-8cd8-6a945d3d2cd8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1494 microversion: 2.1 time: 0.565087 Aug 09 17:35:36.142545 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2211/4677] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:35 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1494 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:37.004431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-02c3f34b-0c63-4183-8cfc-c9bbfd16f2ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:37.031904 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-02c3f34b-0c63-4183-8cfc-c9bbfd16f2ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1671 microversion: 2.1 time: 1.262476 Aug 09 17:35:37.033670 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2467/4678] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:35 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1671 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:37.181825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-86dc2bad-9168-4517-b855-ab42e24f07a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:37.183394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-86dc2bad-9168-4517-b855-ab42e24f07a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:37.205362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86dc2bad-9168-4517-b855-ab42e24f07a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:37.207746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86dc2bad-9168-4517-b855-ab42e24f07a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:37.208781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86dc2bad-9168-4517-b855-ab42e24f07a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:37.213073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86dc2bad-9168-4517-b855-ab42e24f07a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:37.214721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86dc2bad-9168-4517-b855-ab42e24f07a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:37.215307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86dc2bad-9168-4517-b855-ab42e24f07a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:37.506516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-86dc2bad-9168-4517-b855-ab42e24f07a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:37.522206 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-86dc2bad-9168-4517-b855-ab42e24f07a9 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1494 microversion: 2.1 time: 0.361517 Aug 09 17:35:37.527337 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2212/4679] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:37 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1494 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:38.062653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f348c54-7d12-43e8-8266-f137921207d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:38.064802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f348c54-7d12-43e8-8266-f137921207d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:38.085147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f348c54-7d12-43e8-8266-f137921207d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:38.087415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f348c54-7d12-43e8-8266-f137921207d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:38.088607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f348c54-7d12-43e8-8266-f137921207d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:38.090177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f348c54-7d12-43e8-8266-f137921207d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:38.091289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f348c54-7d12-43e8-8266-f137921207d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:38.092405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f348c54-7d12-43e8-8266-f137921207d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:38.574917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-57ceba69-e90b-4481-b3bc-5a85b30b2a80 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:38.576973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-57ceba69-e90b-4481-b3bc-5a85b30b2a80 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:38.606641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57ceba69-e90b-4481-b3bc-5a85b30b2a80 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:38.607999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57ceba69-e90b-4481-b3bc-5a85b30b2a80 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:38.608986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57ceba69-e90b-4481-b3bc-5a85b30b2a80 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:38.611397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57ceba69-e90b-4481-b3bc-5a85b30b2a80 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:38.612561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57ceba69-e90b-4481-b3bc-5a85b30b2a80 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:38.614014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-57ceba69-e90b-4481-b3bc-5a85b30b2a80 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:38.802794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-57ceba69-e90b-4481-b3bc-5a85b30b2a80 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:38.835498 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-57ceba69-e90b-4481-b3bc-5a85b30b2a80 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1452 microversion: 2.1 time: 0.270119 Aug 09 17:35:38.854589 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2213/4680] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:38 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1452 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:35:39.214440 n-d-845781-6 devstack@n-api.service[119432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:35:39.214736 n-d-845781-6 devstack@n-api.service[119432]: Tue Aug 9 17:35:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:35:39.350317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a460df72-6796-4d59-ae00-fe4e76b92af6 req-98ad948e-7635-42d7-8f73-0adcb7bdfc42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f7a36b-8045-44a8-8dc6-da874810810d", "name": "network-vif-deleted", "tag": "2cbd3a03-feec-49ec-9f40-ac4ce8889536"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:39.375060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a460df72-6796-4d59-ae00-fe4e76b92af6 req-98ad948e-7635-42d7-8f73-0adcb7bdfc42 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:39.377382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a460df72-6796-4d59-ae00-fe4e76b92af6 req-98ad948e-7635-42d7-8f73-0adcb7bdfc42 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:39.380699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a460df72-6796-4d59-ae00-fe4e76b92af6 req-98ad948e-7635-42d7-8f73-0adcb7bdfc42 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:39.399774 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a460df72-6796-4d59-ae00-fe4e76b92af6 req-98ad948e-7635-42d7-8f73-0adcb7bdfc42 service nova] Creating event network-vif-deleted:2cbd3a03-feec-49ec-9f40-ac4ce8889536 for instance 95f7a36b-8045-44a8-8dc6-da874810810d on n-h1-845781-6 Aug 09 17:35:39.412112 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a460df72-6796-4d59-ae00-fe4e76b92af6 req-98ad948e-7635-42d7-8f73-0adcb7bdfc42 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070135 Aug 09 17:35:39.413602 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2214/4681] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:35:39.534255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f348c54-7d12-43e8-8266-f137921207d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:39.547571 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f348c54-7d12-43e8-8266-f137921207d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1671 microversion: 2.1 time: 1.493942 Aug 09 17:35:39.548226 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2468/4682] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:38 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1671 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:39.877960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:39.879872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:39.918594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:39.919182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:39.923841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:39.949963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:39.950656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:39.952201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:40.308448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:40.310949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:40.317496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:40.318897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lazy-loading 'fault' on Instance uuid 95f7a36b-8045-44a8-8dc6-da874810810d {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:35:40.594271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3f84a8e-4918-40b6-9114-5b73ce27c9d8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:40.595349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3f84a8e-4918-40b6-9114-5b73ce27c9d8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:40.631108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:40.640523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3f84a8e-4918-40b6-9114-5b73ce27c9d8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:40.641465 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-902bebb1-0f0c-4b9f-b8b2-d65ef9ccf15b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 200 len: 1310 microversion: 2.1 time: 0.768288 Aug 09 17:35:40.641690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3f84a8e-4918-40b6-9114-5b73ce27c9d8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:40.642320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3f84a8e-4918-40b6-9114-5b73ce27c9d8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:40.652562 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2215/4683] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:39 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 1310 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:40.665899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3f84a8e-4918-40b6-9114-5b73ce27c9d8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:40.666623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3f84a8e-4918-40b6-9114-5b73ce27c9d8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:40.667513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3f84a8e-4918-40b6-9114-5b73ce27c9d8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:41.400592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e3f84a8e-4918-40b6-9114-5b73ce27c9d8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:41.416164 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3f84a8e-4918-40b6-9114-5b73ce27c9d8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1676 microversion: 2.1 time: 0.827213 Aug 09 17:35:41.416885 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2469/4684] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:40 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1676 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:41.697247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:41.698926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:41.715776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:41.716651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:41.717322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:41.718280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:41.719369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:41.720137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:41.750928 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d HTTP/1.1 Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '95f7a36b-8045-44a8-8dc6-da874810810d'} Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:41.753292 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.758528 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:41.758528 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:41.758528 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:41.758528 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:41.758528 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:41.758528 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.758528 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.761049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:41.762196 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f3fe0f12-a7d7-49cf-b4a1-438478e87401 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 404 len: 111 microversion: 2.1 time: 0.069838 Aug 09 17:35:41.763401 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2216/4685] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:41 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:41.781614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:41.782956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:41.786611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:35:41.795271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:41.796152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:41.796795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:41.797863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:41.798716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:41.799394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:41.824772 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d HTTP/1.1 Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '95f7a36b-8045-44a8-8dc6-da874810810d'} Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:41.839844 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.844355 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.844355 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:41.844355 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.844355 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:41.844355 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:41.844355 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:41.844355 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:41.844355 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:41.844355 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.844355 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.848957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:41.850812 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-05ea725a-eecc-4993-b63f-c26d7a82afa8 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 404 len: 111 microversion: 2.1 time: 0.075784 Aug 09 17:35:41.852074 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2470/4686] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:35:41 2022] DELETE /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:41.862803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:41.866364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 95f7a36b-8045-44a8-8dc6-da874810810d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:41.883368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:41.884363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:41.886071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:41.887238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:41.889012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:41.889707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:41.932357 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d HTTP/1.1 Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '95f7a36b-8045-44a8-8dc6-da874810810d'} Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:41.939155 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.945344 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:41.945344 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:41.945344 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:41.945344 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:41.945344 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:41.945344 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. Aug 09 17:35:41.945344 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:41.949974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 95f7a36b-8045-44a8-8dc6-da874810810d could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:41.952128 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ab0414b1-810b-4514-acb2-688dd59e2302 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d" status: 404 len: 111 microversion: 2.1 time: 0.094015 Aug 09 17:35:41.953658 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2217/4687] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:41 2022] GET /compute/v2.1/servers/95f7a36b-8045-44a8-8dc6-da874810810d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:41.964984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:41.965803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:41.992405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:41.998451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:41.999875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.004590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.005426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.006789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.039255 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa HTTP/1.1 Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8366e136-067e-49e8-b9f3-7da3504274fa'} Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:42.044696 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:35:42.049896 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.049896 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.049896 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.049896 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.049896 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.049896 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.049896 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:42.049896 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:42.049896 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:35:42.049896 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.052406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:42.054113 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a82cf311-2a5d-432c-91a7-b191b459e9ee tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 404 len: 111 microversion: 2.1 time: 0.094074 Aug 09 17:35:42.055270 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2471/4688] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:35:41 2022] DELETE /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:35:42.069833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:42.070726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 8366e136-067e-49e8-b9f3-7da3504274fa] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:42.087760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.090240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.091164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.094401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.096830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.098143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.138217 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa HTTP/1.1 Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '8366e136-067e-49e8-b9f3-7da3504274fa'} Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.143215 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.148310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.148310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.148310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.148310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:42.148310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:42.148310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. Aug 09 17:35:42.148310 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.153148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 8366e136-067e-49e8-b9f3-7da3504274fa could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:42.154338 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9f981806-877f-4e0d-b42c-fb716f2f213b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa" status: 404 len: 111 microversion: 2.1 time: 0.093440 Aug 09 17:35:42.161007 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2218/4689] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:42 2022] GET /compute/v2.1/servers/8366e136-067e-49e8-b9f3-7da3504274fa => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:42.173107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:42.173933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:42.197935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.201500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.202084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.204578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.207518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.210105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.269764 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 HTTP/1.1 Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'bfb12d9f-3932-4603-bacc-5df2748c70a5'} Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:42.271421 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:35:42.279902 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.279902 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.279902 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.279902 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.279902 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.279902 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.279902 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:42.279902 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:42.279902 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:35:42.279902 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.283933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:42.283933 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1301cb63-e299-4a9d-b12b-dfe10447c209 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 404 len: 111 microversion: 2.1 time: 0.116835 Aug 09 17:35:42.288834 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2472/4690] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:35:42 2022] DELETE /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:35:42.302997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:42.304365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: bfb12d9f-3932-4603-bacc-5df2748c70a5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:42.340899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.344459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.348798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.351563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.354426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.356975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.461797 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:35:42.465366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3f1bccdc-e5d9-46b0-b4d9-169175b7025f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:42.466393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3f1bccdc-e5d9-46b0-b4d9-169175b7025f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:42.485565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f1bccdc-e5d9-46b0-b4d9-169175b7025f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.490096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f1bccdc-e5d9-46b0-b4d9-169175b7025f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 HTTP/1.1 Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'bfb12d9f-3932-4603-bacc-5df2748c70a5'} Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.490636 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.495540 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.495540 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.495540 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.495540 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:42.495540 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:42.495540 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. Aug 09 17:35:42.495540 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.495540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance bfb12d9f-3932-4603-bacc-5df2748c70a5 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:42.497618 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f70db80e-e049-4c09-89f5-6ded9a9a106f tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5" status: 404 len: 111 microversion: 2.1 time: 0.200764 Aug 09 17:35:42.499941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f1bccdc-e5d9-46b0-b4d9-169175b7025f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.501191 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2219/4691] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:42 2022] GET /compute/v2.1/servers/bfb12d9f-3932-4603-bacc-5df2748c70a5 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:42.503402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f1bccdc-e5d9-46b0-b4d9-169175b7025f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.504623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f1bccdc-e5d9-46b0-b4d9-169175b7025f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.506348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f1bccdc-e5d9-46b0-b4d9-169175b7025f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.554254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:42.561835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:42.613852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.614922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.617864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.621003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.628207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.641812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.749567 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 HTTP/1.1 Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '0e555d25-10e4-4fde-8477-95fcd23c1a93'} Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:42.773699 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:35:42.777896 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.777896 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.777896 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.777896 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.777896 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.777896 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.777896 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:42.777896 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:42.777896 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:35:42.777896 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.785185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:42.786982 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9c577a7b-3782-47b0-a70c-9939be5c643a tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 404 len: 111 microversion: 2.1 time: 0.277920 Aug 09 17:35:42.792116 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2220/4692] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:35:42 2022] DELETE /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 111 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:35:42.814584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:42.816082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 0e555d25-10e4-4fde-8477-95fcd23c1a93] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:42.842640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.848659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.850151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.851821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:42.853022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:42.860839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:42.923128 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 HTTP/1.1 Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '0e555d25-10e4-4fde-8477-95fcd23c1a93'} Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:42.931791 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.940263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:42.940263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:42.940263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:42.940263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:42.940263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:42.940263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. Aug 09 17:35:42.940263 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:42.950758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 0e555d25-10e4-4fde-8477-95fcd23c1a93 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:42.950758 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5a382e6a-6b29-40d8-995f-80c6701724ed tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93" status: 404 len: 111 microversion: 2.1 time: 0.149568 Aug 09 17:35:42.951657 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2221/4693] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:42 2022] GET /compute/v2.1/servers/0e555d25-10e4-4fde-8477-95fcd23c1a93 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:42.966469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:42.972200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:42.994845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:43.000497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:43.001380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:43.002777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:43.006319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:43.008572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:43.109842 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb HTTP/1.1 Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'f46111bd-a4d2-4c54-8f11-ba106b20a1fb'} Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:43.121053 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:35:43.125459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.125459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.125459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.125459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.125459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.125459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.125459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:43.125459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:43.125459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:35:43.125459 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.132687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:43.140342 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9e9cc9b1-b495-454d-acc2-05e2da6c9d26 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 404 len: 111 microversion: 2.1 time: 0.183482 Aug 09 17:35:43.144095 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2222/4694] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:35:42 2022] DELETE /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:43.173855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:43.174618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: f46111bd-a4d2-4c54-8f11-ba106b20a1fb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:43.200316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:43.206822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:43.207976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:43.209006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:43.209724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:43.210381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:43.276867 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb HTTP/1.1 Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'f46111bd-a4d2-4c54-8f11-ba106b20a1fb'} Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.285189 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.289438 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.289438 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.289438 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.289438 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:43.289438 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:43.289438 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. Aug 09 17:35:43.289438 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.293490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance f46111bd-a4d2-4c54-8f11-ba106b20a1fb could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:43.294938 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0d8e6180-b350-44e3-96c0-5c5f4e12a273 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb" status: 404 len: 111 microversion: 2.1 time: 0.144195 Aug 09 17:35:43.297428 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2223/4695] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:43 2022] GET /compute/v2.1/servers/f46111bd-a4d2-4c54-8f11-ba106b20a1fb => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:43.309404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:43.309901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:43.354448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:43.359113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:43.359848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:43.368491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:43.370535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:43.373155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:43.448120 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc HTTP/1.1 Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'cc847515-8f05-40a2-a206-338fbe9037dc'} Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:43.451495 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:43.470132 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-51e7e9a9-6c35-4780-8a23-cfd8bdcf5185 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 404 len: 111 microversion: 2.1 time: 0.146085 Aug 09 17:35:43.477696 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2224/4696] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:35:43 2022] DELETE /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:43.502031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:43.502675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: cc847515-8f05-40a2-a206-338fbe9037dc] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:43.521955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:43.525024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:43.525755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:43.526552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:43.527035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:43.527547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:43.587303 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc HTTP/1.1 Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'cc847515-8f05-40a2-a206-338fbe9037dc'} Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.589762 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.594603 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.594603 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.594603 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.594603 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:43.594603 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:43.594603 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. Aug 09 17:35:43.594603 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.601804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance cc847515-8f05-40a2-a206-338fbe9037dc could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:43.602979 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a29f92ec-98f9-4a2c-924d-f74afe9f652b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc" status: 404 len: 111 microversion: 2.1 time: 0.119629 Aug 09 17:35:43.604408 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2225/4697] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:43 2022] GET /compute/v2.1/servers/cc847515-8f05-40a2-a206-338fbe9037dc => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:43.616675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-be2e2507-b2ce-4b40-95d5-0db7b58a8d53 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:43.623752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-be2e2507-b2ce-4b40-95d5-0db7b58a8d53 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 6d406eec-14ff-4e90-a63e-f8b1d8e9e330] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:43.631150 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-be2e2507-b2ce-4b40-95d5-0db7b58a8d53 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-be2e2507-b2ce-4b40-95d5-0db7b58a8d53 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/6d406eec-14ff-4e90-a63e-f8b1d8e9e330 HTTP/1.1 Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '6d406eec-14ff-4e90-a63e-f8b1d8e9e330'} Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.632869 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.644001 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.644001 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.644001 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.644001 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:43.644001 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:43.644001 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:35:43.644001 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.644001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-be2e2507-b2ce-4b40-95d5-0db7b58a8d53 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:43.644001 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-be2e2507-b2ce-4b40-95d5-0db7b58a8d53 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6d406eec-14ff-4e90-a63e-f8b1d8e9e330" status: 404 len: 111 microversion: 2.1 time: 0.024086 Aug 09 17:35:43.644001 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2226/4698] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:35:43 2022] DELETE /compute/v2.1/servers/6d406eec-14ff-4e90-a63e-f8b1d8e9e330 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:35:43.670300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f6b120ef-e714-4495-95ec-8d4c02dcf937 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:43.675392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f6b120ef-e714-4495-95ec-8d4c02dcf937 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: 6d406eec-14ff-4e90-a63e-f8b1d8e9e330] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:43.705628 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-f6b120ef-e714-4495-95ec-8d4c02dcf937 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f6b120ef-e714-4495-95ec-8d4c02dcf937 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/6d406eec-14ff-4e90-a63e-f8b1d8e9e330 HTTP/1.1 Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '6d406eec-14ff-4e90-a63e-f8b1d8e9e330'} Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:43.708278 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:43.716628 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:43.716628 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:43.716628 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:43.716628 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. Aug 09 17:35:43.716628 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:43.716628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f6b120ef-e714-4495-95ec-8d4c02dcf937 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance 6d406eec-14ff-4e90-a63e-f8b1d8e9e330 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:43.716628 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f6b120ef-e714-4495-95ec-8d4c02dcf937 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/6d406eec-14ff-4e90-a63e-f8b1d8e9e330" status: 404 len: 111 microversion: 2.1 time: 0.070262 Aug 09 17:35:43.716628 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2227/4699] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:43 2022] GET /compute/v2.1/servers/6d406eec-14ff-4e90-a63e-f8b1d8e9e330 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:43.728115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7fb3578-f9d7-4d1a-962f-ded521e8c660 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:43.728879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f7fb3578-f9d7-4d1a-962f-ded521e8c660 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:43.754560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb3578-f9d7-4d1a-962f-ded521e8c660 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:43.755321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb3578-f9d7-4d1a-962f-ded521e8c660 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:43.755321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb3578-f9d7-4d1a-962f-ded521e8c660 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:43.761125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb3578-f9d7-4d1a-962f-ded521e8c660 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:43.762776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb3578-f9d7-4d1a-962f-ded521e8c660 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:43.763293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb3578-f9d7-4d1a-962f-ded521e8c660 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:43.848512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f7fb3578-f9d7-4d1a-962f-ded521e8c660 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:35:44.060646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f1bccdc-e5d9-46b0-b4d9-169175b7025f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:44.106253 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3f1bccdc-e5d9-46b0-b4d9-169175b7025f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.630276 Aug 09 17:35:44.109363 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2473/4700] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:42 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:44.262336 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f7fb3578-f9d7-4d1a-962f-ded521e8c660 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 204 len: 0 microversion: 2.1 time: 0.538603 Aug 09 17:35:44.286854 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2228/4701] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:35:43 2022] DELETE /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:35:44.288818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec1fc755-7abe-4006-b746-b4a617decd46 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:44.290638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ec1fc755-7abe-4006-b746-b4a617decd46 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:44.310830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec1fc755-7abe-4006-b746-b4a617decd46 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:44.320136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec1fc755-7abe-4006-b746-b4a617decd46 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:44.325775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec1fc755-7abe-4006-b746-b4a617decd46 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:44.333321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec1fc755-7abe-4006-b746-b4a617decd46 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:44.337768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec1fc755-7abe-4006-b746-b4a617decd46 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:44.341603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec1fc755-7abe-4006-b746-b4a617decd46 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:45.044300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ec1fc755-7abe-4006-b746-b4a617decd46 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:45.087249 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ec1fc755-7abe-4006-b746-b4a617decd46 tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1478 microversion: 2.1 time: 0.812086 Aug 09 17:35:45.103089 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2474/4702] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:44 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1478 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:46.139734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7292f6fc-5cb9-4ea3-9d5c-51038175f83b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:46.140766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7292f6fc-5cb9-4ea3-9d5c-51038175f83b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:46.179882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7292f6fc-5cb9-4ea3-9d5c-51038175f83b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:46.181696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7292f6fc-5cb9-4ea3-9d5c-51038175f83b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:46.183081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7292f6fc-5cb9-4ea3-9d5c-51038175f83b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:46.185977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7292f6fc-5cb9-4ea3-9d5c-51038175f83b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:46.188582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7292f6fc-5cb9-4ea3-9d5c-51038175f83b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:46.190652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7292f6fc-5cb9-4ea3-9d5c-51038175f83b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:46.245845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:35:46.990506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7292f6fc-5cb9-4ea3-9d5c-51038175f83b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:47.016274 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7292f6fc-5cb9-4ea3-9d5c-51038175f83b tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1478 microversion: 2.1 time: 0.881018 Aug 09 17:35:47.017338 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2229/4703] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:46 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1478 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:35:48.049604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:48.051217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:48.116961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:48.117988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:48.130785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:48.137423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:48.145416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:48.146998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:48.338250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:48.339332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:48.340247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:48.345445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lazy-loading 'fault' on Instance uuid c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:35:48.618509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4dd578ed0640fc943af026c4363e28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa49d1ed7496493d81aea5dd05615d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:35:48.649850 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b119099f-50b6-4cad-9c6e-c990a5fed5da tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 200 len: 1282 microversion: 2.1 time: 0.610796 Aug 09 17:35:48.657253 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2230/4704] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:48 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 1282 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:35:48.794170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a9fd15ee-3e87-4ef2-a2ee-7f920c23a4c8 req-66a730a6-99a0-46d4-8baf-6ba97eb44706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0037d3e-a7b8-43c1-98c4-55edce1a4ff3", "name": "network-vif-deleted", "tag": "c7628ef0-2168-4f56-94bc-bd4edc71890c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:35:48.884169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a9fd15ee-3e87-4ef2-a2ee-7f920c23a4c8 req-66a730a6-99a0-46d4-8baf-6ba97eb44706 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:48.885418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a9fd15ee-3e87-4ef2-a2ee-7f920c23a4c8 req-66a730a6-99a0-46d4-8baf-6ba97eb44706 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:48.886435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a9fd15ee-3e87-4ef2-a2ee-7f920c23a4c8 req-66a730a6-99a0-46d4-8baf-6ba97eb44706 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:48.913626 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a9fd15ee-3e87-4ef2-a2ee-7f920c23a4c8 req-66a730a6-99a0-46d4-8baf-6ba97eb44706 service nova] Creating event network-vif-deleted:c7628ef0-2168-4f56-94bc-bd4edc71890c for instance c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 on n-h1-845781-6 Aug 09 17:35:48.928193 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a9fd15ee-3e87-4ef2-a2ee-7f920c23a4c8 req-66a730a6-99a0-46d4-8baf-6ba97eb44706 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.418426 Aug 09 17:35:48.931142 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2475/4705] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:35:49.694073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:35:49.694988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] [instance: c0037d3e-a7b8-43c1-98c4-55edce1a4ff3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:35:49.734412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:49.735303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:49.735968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:49.737474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:35:49.738141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:35:49.744497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:35:49.818538 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] HTTP exception thrown: Instance c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 could not be found. Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Request method failure captured: Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 HTTP/1.1 Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmsowLSetBuTIi3GwWcrfLiRIGzkaauy8HS3wY0RvtfXg2lzQ7ga2HbES3I8rxRM6o9XC8e0fMO-0sezXMBLxtSMwKTQ2yWIOkfeDzEbHxTntZXZpND6ewr79iiGx7ee3II1VTMpqrP1zIiwhGmxyT6O9YkURq_P26FIs5zbSUUKek Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fa49d1ed7496493d81aea5dd05615d4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServersTestJSON-2128695639 Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: fa49d1ed7496493d81aea5dd05615d4a Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServersTestJSON-2128695639 Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 1d4dd578ed0640fc943af026c4363e28 Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServersTestJSON-2128695639-project Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 could not be found. Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'c0037d3e-a7b8-43c1-98c4-55edce1a4ff3'} Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 could not be found. Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 could not be found. Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:35:49.824545 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:49.840797 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:35:49.840797 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:35:49.840797 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:35:49.840797 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:35:49.840797 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:35:49.840797 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 could not be found. Aug 09 17:35:49.840797 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:35:49.845612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] Returning 404 to user: Instance c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:35:49.847836 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-36702475-dded-411e-a6ed-726fa27790bf tempest-ServersTestJSON-2128695639 tempest-ServersTestJSON-2128695639-project] 10.222.0.93 "GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3" status: 404 len: 111 microversion: 2.1 time: 0.157874 Aug 09 17:35:49.850460 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2231/4706] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:35:49 2022] GET /compute/v2.1/servers/c0037d3e-a7b8-43c1-98c4-55edce1a4ff3 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:35:59.284546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=11 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:35:59.287197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:00.311493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:00.314811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:00.332582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:00.334166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:00.335542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:00.337421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:00.338595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:00.339832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:01.873767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:01.909366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:01.911476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:01.912827 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f4e53f85-0f85-4772-a001-bd31357c66dc tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2952 microversion: 2.32 time: 2.635620 Aug 09 17:36:01.935824 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2476/4707] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:35:59 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2952 bytes in 2661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:01.972375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-131c6de5-ca97-49fa-be1d-7a16de285468 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:01.973761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-131c6de5-ca97-49fa-be1d-7a16de285468 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:02.007260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:02.008332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=13 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:02.013829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-131c6de5-ca97-49fa-be1d-7a16de285468 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:02.014792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-131c6de5-ca97-49fa-be1d-7a16de285468 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:02.022451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-131c6de5-ca97-49fa-be1d-7a16de285468 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:02.023419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-131c6de5-ca97-49fa-be1d-7a16de285468 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:02.031128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-131c6de5-ca97-49fa-be1d-7a16de285468 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:02.031838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-131c6de5-ca97-49fa-be1d-7a16de285468 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:03.414025 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-131c6de5-ca97-49fa-be1d-7a16de285468 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92/os-interface" status: 200 len: 1832 microversion: 2.32 time: 1.448312 Aug 09 17:36:03.418000 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2232/4708] 10.222.0.93 () {60 vars in 1316 bytes} [Tue Aug 9 17:36:01 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92/os-interface => generated 1832 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:16.221755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ab89b614-f32e-418f-815a-a39575226311 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:16.223730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ab89b614-f32e-418f-815a-a39575226311 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:16.236519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:16.240966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:16.242818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab89b614-f32e-418f-815a-a39575226311 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:16.247141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab89b614-f32e-418f-815a-a39575226311 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:16.248618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab89b614-f32e-418f-815a-a39575226311 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:16.252636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab89b614-f32e-418f-815a-a39575226311 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:16.255432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab89b614-f32e-418f-815a-a39575226311 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:16.257004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab89b614-f32e-418f-815a-a39575226311 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:17.048370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:17.050468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:17.281064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1861500265", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": "none"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:36:17.357538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:36:17.358412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:36:17.359270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:36:17.361085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:36:17.361842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:36:17.374365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:17.376175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:17.376945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:17.378051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:17.378864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:17.380221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:17.412931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Getting quotas for project 79dcc2b8878a401dba1b721446303d21. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:36:17.421744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Getting quotas for user 74ecb7576c2d4cf5a0060a166d0ea0bd and project 79dcc2b8878a401dba1b721446303d21. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:36:17.440578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:36:17.444401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:36:17.536016 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b6142e86-8de2-4481-b60b-f302dc076309 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.487755 Aug 09 17:36:17.539364 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2233/4709] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:36:17.552565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c98c72a3-9615-4a04-b638-7987bf041b3e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:17.555416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c98c72a3-9615-4a04-b638-7987bf041b3e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:17.635238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ab89b614-f32e-418f-815a-a39575226311 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:17.645639 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ab89b614-f32e-418f-815a-a39575226311 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.427142 Aug 09 17:36:17.647037 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2477/4710] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:16 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:17.672202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a306026c-6f0b-42c2-9d52-b6e5850a88b6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:17.672844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a306026c-6f0b-42c2-9d52-b6e5850a88b6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:17.690185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a306026c-6f0b-42c2-9d52-b6e5850a88b6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:17.690185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a306026c-6f0b-42c2-9d52-b6e5850a88b6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:17.690185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a306026c-6f0b-42c2-9d52-b6e5850a88b6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:17.690185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a306026c-6f0b-42c2-9d52-b6e5850a88b6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:17.690185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a306026c-6f0b-42c2-9d52-b6e5850a88b6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:17.690185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a306026c-6f0b-42c2-9d52-b6e5850a88b6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:17.821462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c98c72a3-9615-4a04-b638-7987bf041b3e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:17.841215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c98c72a3-9615-4a04-b638-7987bf041b3e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:17.850217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c98c72a3-9615-4a04-b638-7987bf041b3e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:17.863850 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c98c72a3-9615-4a04-b638-7987bf041b3e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1278 microversion: 2.54 time: 0.306365 Aug 09 17:36:17.868080 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2234/4711] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:17 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1278 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:18.900922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:18.917100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:18.958183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:18.959336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:18.960606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:18.962150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:18.968581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:18.969209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:19.219265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:19.232216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:19.236764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:19.240185 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bbeb8c5a-b5a5-4b8f-97e1-c30d73b07a60 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1282 microversion: 2.54 time: 0.346912 Aug 09 17:36:19.248268 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2235/4712] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:18 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1282 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:19.322345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a306026c-6f0b-42c2-9d52-b6e5850a88b6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:19.341715 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a306026c-6f0b-42c2-9d52-b6e5850a88b6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.674629 Aug 09 17:36:19.360033 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2478/4713] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:17 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:19.366269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d58048a1-eb40-44b4-a193-b1f961c21140 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:19.367085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d58048a1-eb40-44b4-a193-b1f961c21140 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:19.380825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d58048a1-eb40-44b4-a193-b1f961c21140 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:19.381459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d58048a1-eb40-44b4-a193-b1f961c21140 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:19.392061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d58048a1-eb40-44b4-a193-b1f961c21140 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:19.393446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d58048a1-eb40-44b4-a193-b1f961c21140 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:19.394161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d58048a1-eb40-44b4-a193-b1f961c21140 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:19.394868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d58048a1-eb40-44b4-a193-b1f961c21140 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:20.085859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d58048a1-eb40-44b4-a193-b1f961c21140 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:20.114533 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d58048a1-eb40-44b4-a193-b1f961c21140 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.752716 Aug 09 17:36:20.116154 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2236/4714] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:19 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:36:20.139341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f2f4817-a434-400b-9e6b-547871c88564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:20.140644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f2f4817-a434-400b-9e6b-547871c88564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:20.153032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2f4817-a434-400b-9e6b-547871c88564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:20.153910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2f4817-a434-400b-9e6b-547871c88564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:20.155175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2f4817-a434-400b-9e6b-547871c88564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:20.166026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2f4817-a434-400b-9e6b-547871c88564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:20.166844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2f4817-a434-400b-9e6b-547871c88564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:20.167801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f2f4817-a434-400b-9e6b-547871c88564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:20.275553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:20.276188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:20.287861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:20.289749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:20.290744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:20.292689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:20.296492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:20.297340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:20.555651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:20.602383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:20.610495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:20.617532 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a4be5ad2-ac25-4058-af7f-b92e1d226c7e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1336 microversion: 2.54 time: 0.345162 Aug 09 17:36:20.619303 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2237/4715] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:20 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1336 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:36:20.915275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9f2f4817-a434-400b-9e6b-547871c88564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:20.937363 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f2f4817-a434-400b-9e6b-547871c88564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.801829 Aug 09 17:36:20.953906 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2479/4716] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:20 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:21.203757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1426984804", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "57c98899-0caf-4592-be88-405da8266825"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:36:21.328943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] validate_networks() for [('57c98899-0caf-4592-be88-405da8266825', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:36:21.648143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:21.649219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:21.664798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:21.673126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:21.674238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:21.676927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:21.681846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:21.684405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:21.844919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:21.855711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:21.857456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:21.859137 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3d2f2c3b-ce94-4fb3-ba5d-3046228c046c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1336 microversion: 2.54 time: 0.219282 Aug 09 17:36:21.874545 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2480/4717] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:21 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1336 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:36:22.926645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:22.929580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:22.938977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:22.950151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:22.950758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:22.951552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:22.952077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:22.952625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:23.093045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:23.106496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:23.108248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:23.109753 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dd89b6a3-134f-4a47-a3d6-388c3abbf276 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1357 microversion: 2.54 time: 0.220870 Aug 09 17:36:23.110884 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2481/4718] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:22 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:23.164091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88d9f765-53eb-4f70-990d-37ddafeedf87 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Action: 'create', calling method: .version_select at 0x7fbbcbae93a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-278310109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6H647Kwm2VDK8Iw+jEY1OsZzVqqEqA3PH6uJiy9z5GMUaE9ji4UjQN4b0F4DeYJRkzGc9CumomYEiumqqtd3/HLqqWMPxevFPm5cIwUt219kM8em7uRsudVNHVmj9XAw=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:36:23.207729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-88d9f765-53eb-4f70-990d-37ddafeedf87 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Getting quotas for project 79dcc2b8878a401dba1b721446303d21. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:36:23.226749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-88d9f765-53eb-4f70-990d-37ddafeedf87 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Getting quotas for user 74ecb7576c2d4cf5a0060a166d0ea0bd and project 79dcc2b8878a401dba1b721446303d21. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:36:23.280796 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88d9f765-53eb-4f70-990d-37ddafeedf87 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.124206 Aug 09 17:36:23.282084 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2482/4719] 10.222.0.93 () {62 vars in 1200 bytes} [Tue Aug 9 17:36:23 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 09 17:36:23.307821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:36:23.310768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:36:23.313266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:36:23.314591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:36:23.315803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:36:23.331881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-278310109", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:36:23.350377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:23.361784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:23.368891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:23.374760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:23.376005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:23.377254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:23.377715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:23.378693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:23.379838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:23.380327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:23.390633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:23.393043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:23.397574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:23.479815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:36:23.512136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for user 62572816b806440aa8338fea1d0a297e and project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:36:23.590097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:36:23.594288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:36:23.633437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:36:23.635116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:36:23.635867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:36:23.636471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:36:23.637006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:36:23.835667 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-96339fe7-2fec-4350-a7f8-024b2cc2031b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.635943 Aug 09 17:36:23.860162 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2238/4720] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:36:23.870970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d1dc2df5-679e-45a0-870c-eb8e910404ca tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:23.875373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d1dc2df5-679e-45a0-870c-eb8e910404ca tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:23.904941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:23.965606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:23.970521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:23.978120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:23.980920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:23.985125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:23.986455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:24.096390 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e6acd5d9-de3c-48db-8bec-fd63725adcbf tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "POST /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06/action" status: 202 len: 1139 microversion: 2.54 time: 0.802540 Aug 09 17:36:24.117556 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2483/4721] 10.222.0.93 () {62 vars in 1320 bytes} [Tue Aug 9 17:36:23 2022] POST /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06/action => generated 1139 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 09 17:36:24.162081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:24.171309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:24.196984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:24.199036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:24.208072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:24.209744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:24.210799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:24.212187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:24.474373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d1dc2df5-679e-45a0-870c-eb8e910404ca tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:24.522345 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d1dc2df5-679e-45a0-870c-eb8e910404ca tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1215 microversion: 2.1 time: 0.659376 Aug 09 17:36:24.541091 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2239/4722] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:23 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1215 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:36:24.803910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:24.839924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:24.852225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:24.855172 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-81abda8b-38ce-40a3-ba5a-e21011536103 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.701221 Aug 09 17:36:24.856850 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2484/4723] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:24 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:36:25.562316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad341141-f86d-4a50-8865-1b9811769800 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:25.565899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ad341141-f86d-4a50-8865-1b9811769800 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:25.602711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad341141-f86d-4a50-8865-1b9811769800 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:25.604005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad341141-f86d-4a50-8865-1b9811769800 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:25.606404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad341141-f86d-4a50-8865-1b9811769800 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:25.609047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad341141-f86d-4a50-8865-1b9811769800 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:25.628497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad341141-f86d-4a50-8865-1b9811769800 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:25.633206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad341141-f86d-4a50-8865-1b9811769800 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:25.910668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:25.925556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:25.952134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:25.953486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:25.954593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:25.956213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:25.957972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:25.965682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:26.180742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ad341141-f86d-4a50-8865-1b9811769800 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:26.211404 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad341141-f86d-4a50-8865-1b9811769800 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1211 microversion: 2.1 time: 0.654541 Aug 09 17:36:26.237356 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2240/4724] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:25 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1211 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:26.589344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:26.603388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:26.605332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:26.606752 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f2e51698-ee33-431a-b328-76fde6d8d546 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.707334 Aug 09 17:36:26.611759 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2485/4725] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:25 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:36:27.258211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-503c619e-262c-44a9-b678-f56a8347a046 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:27.258865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-503c619e-262c-44a9-b678-f56a8347a046 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:27.277123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-503c619e-262c-44a9-b678-f56a8347a046 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:27.277632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-503c619e-262c-44a9-b678-f56a8347a046 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:27.278089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-503c619e-262c-44a9-b678-f56a8347a046 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:27.278830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-503c619e-262c-44a9-b678-f56a8347a046 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:27.279296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-503c619e-262c-44a9-b678-f56a8347a046 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:27.279790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-503c619e-262c-44a9-b678-f56a8347a046 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:27.642694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:27.643319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:27.662239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:27.663063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:27.663719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:27.664722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:27.665386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:27.666009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:27.946718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-503c619e-262c-44a9-b678-f56a8347a046 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:27.950371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:27.958687 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-503c619e-262c-44a9-b678-f56a8347a046 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1273 microversion: 2.1 time: 0.704279 Aug 09 17:36:27.960058 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2241/4726] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:27 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1273 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:27.963679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:27.965372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:27.966643 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d3bf8cf6-ce56-4cb1-93ba-62a78e2b949a tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.329201 Aug 09 17:36:27.967225 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2486/4727] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:27 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:36:28.985648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72c9b64e-94b7-4c24-bf04-77943af2e998 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:28.990691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-72c9b64e-94b7-4c24-bf04-77943af2e998 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:28.998952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:28.999891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:29.014381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:29.015164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:29.015655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:29.016476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:29.016937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:29.024350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:29.027107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c9b64e-94b7-4c24-bf04-77943af2e998 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:29.028050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c9b64e-94b7-4c24-bf04-77943af2e998 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:29.035045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c9b64e-94b7-4c24-bf04-77943af2e998 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:29.036519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c9b64e-94b7-4c24-bf04-77943af2e998 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:29.037738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c9b64e-94b7-4c24-bf04-77943af2e998 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:29.039720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72c9b64e-94b7-4c24-bf04-77943af2e998 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:29.224523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-72c9b64e-94b7-4c24-bf04-77943af2e998 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:29.245333 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72c9b64e-94b7-4c24-bf04-77943af2e998 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1273 microversion: 2.1 time: 0.267909 Aug 09 17:36:29.252615 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2242/4728] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:28 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:29.398631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:29.413281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:29.416980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:29.420645 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-129f08ae-f376-4ab6-8b70-63a954526a8c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.427485 Aug 09 17:36:29.442452 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2487/4729] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:28 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:30.282550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1b32d97f-1696-4ea1-89d4-fef00ca8147c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:30.283786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1b32d97f-1696-4ea1-89d4-fef00ca8147c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:30.311673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b32d97f-1696-4ea1-89d4-fef00ca8147c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:30.325151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b32d97f-1696-4ea1-89d4-fef00ca8147c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:30.325990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b32d97f-1696-4ea1-89d4-fef00ca8147c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:30.327883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b32d97f-1696-4ea1-89d4-fef00ca8147c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:30.328334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b32d97f-1696-4ea1-89d4-fef00ca8147c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:30.329140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b32d97f-1696-4ea1-89d4-fef00ca8147c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:30.447957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:30.449878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:30.477448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:30.480321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:30.482170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:30.488000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:30.489571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:30.490929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:30.738004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1b32d97f-1696-4ea1-89d4-fef00ca8147c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:30.765854 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1b32d97f-1696-4ea1-89d4-fef00ca8147c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1315 microversion: 2.1 time: 0.490956 Aug 09 17:36:30.772153 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2243/4730] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:30 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:30.849556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:30.906162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:30.923269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:30.927191 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6433b5b3-ebae-438c-acb2-d7e8b61062a6 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.483435 Aug 09 17:36:30.932710 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2488/4731] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:30 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:31.796483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ec3f5eb2-69aa-4a97-b3cd-c4d3afbf7d93 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:31.797602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ec3f5eb2-69aa-4a97-b3cd-c4d3afbf7d93 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:31.826758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec3f5eb2-69aa-4a97-b3cd-c4d3afbf7d93 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:31.828024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec3f5eb2-69aa-4a97-b3cd-c4d3afbf7d93 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:31.829004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec3f5eb2-69aa-4a97-b3cd-c4d3afbf7d93 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:31.833202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec3f5eb2-69aa-4a97-b3cd-c4d3afbf7d93 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:31.834487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec3f5eb2-69aa-4a97-b3cd-c4d3afbf7d93 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:31.835500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ec3f5eb2-69aa-4a97-b3cd-c4d3afbf7d93 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:31.961853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:31.963457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:31.992739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:31.993615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:31.996287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:31.997399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:32.000279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:32.001209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:32.218541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:32.229557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:32.231773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:32.234055 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86d98cdb-0dd2-4ba8-99f5-593ed2ea4826 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.277645 Aug 09 17:36:32.235237 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2489/4732] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:31 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:36:32.319299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ec3f5eb2-69aa-4a97-b3cd-c4d3afbf7d93 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:32.337390 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ec3f5eb2-69aa-4a97-b3cd-c4d3afbf7d93 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1315 microversion: 2.1 time: 0.551000 Aug 09 17:36:32.338687 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2244/4733] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:31 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:33.259872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:33.260716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:33.267557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:33.277419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:33.278721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:33.279395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:33.280428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:33.282988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:33.283521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:33.367751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ea8eed1d-4209-40c5-a532-b017625a063d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:33.375302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ea8eed1d-4209-40c5-a532-b017625a063d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:33.394951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8eed1d-4209-40c5-a532-b017625a063d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:33.396342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8eed1d-4209-40c5-a532-b017625a063d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:33.397657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8eed1d-4209-40c5-a532-b017625a063d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:33.399758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8eed1d-4209-40c5-a532-b017625a063d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:33.402844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8eed1d-4209-40c5-a532-b017625a063d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:33.404161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea8eed1d-4209-40c5-a532-b017625a063d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:33.463482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:33.473035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:33.482929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:33.487747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:33.492088 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-faa56f5e-30b9-461d-b063-d4d340651517 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.238191 Aug 09 17:36:33.492861 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2490/4734] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:33 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:33.895063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ea8eed1d-4209-40c5-a532-b017625a063d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:33.924747 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ea8eed1d-4209-40c5-a532-b017625a063d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1315 microversion: 2.1 time: 0.567523 Aug 09 17:36:33.925891 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2245/4735] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:33 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:34.517674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:34.519031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:34.537657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:34.540111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:34.540934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:34.545541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:34.546432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:34.547862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:34.745575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:34.767052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:34.776845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:34.781190 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1246bfd6-2c79-4bde-a4be-94221c2362f0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.268765 Aug 09 17:36:34.783195 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2491/4736] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:34 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:34.905393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-54a3daef-8b71-4895-ab5c-e738be3c64b8 req-17462a64-c04d-41e4-a3df-158cbdc6c5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11538f74-5456-470b-96ff-6ffceb5e5218", "tag": "937926c7-6c58-4ddd-91e7-3c5a998f4f99"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:36:34.935119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=16 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:34.949068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7a43f874-ea6c-45c6-9d79-02a119164da0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:34.949891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7a43f874-ea6c-45c6-9d79-02a119164da0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:34.956619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-54a3daef-8b71-4895-ab5c-e738be3c64b8 req-17462a64-c04d-41e4-a3df-158cbdc6c5b7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:34.958353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-54a3daef-8b71-4895-ab5c-e738be3c64b8 req-17462a64-c04d-41e4-a3df-158cbdc6c5b7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:34.960639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-54a3daef-8b71-4895-ab5c-e738be3c64b8 req-17462a64-c04d-41e4-a3df-158cbdc6c5b7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:34.967804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a43f874-ea6c-45c6-9d79-02a119164da0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:34.969314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a43f874-ea6c-45c6-9d79-02a119164da0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:34.977371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a43f874-ea6c-45c6-9d79-02a119164da0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:34.980835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a43f874-ea6c-45c6-9d79-02a119164da0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:34.986700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a43f874-ea6c-45c6-9d79-02a119164da0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:34.988958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a43f874-ea6c-45c6-9d79-02a119164da0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:34.994744 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-54a3daef-8b71-4895-ab5c-e738be3c64b8 req-17462a64-c04d-41e4-a3df-158cbdc6c5b7 service nova] Creating event network-changed:937926c7-6c58-4ddd-91e7-3c5a998f4f99 for instance 11538f74-5456-470b-96ff-6ffceb5e5218 on n-h2-845781-6 Aug 09 17:36:35.001921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:35.013389 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-54a3daef-8b71-4895-ab5c-e738be3c64b8 req-17462a64-c04d-41e4-a3df-158cbdc6c5b7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126644 Aug 09 17:36:35.019273 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2246/4737] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:36:35.718881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7a43f874-ea6c-45c6-9d79-02a119164da0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:35.736786 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7a43f874-ea6c-45c6-9d79-02a119164da0 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1315 microversion: 2.1 time: 0.793453 Aug 09 17:36:35.739496 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2492/4738] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:34 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1315 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:35.824053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:35.825984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:35.857463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:35.858893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:35.860432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:35.873414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:35.874586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:35.875753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:36.489497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:36.529922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:36.542463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:36.548993 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7e1a89d4-28d7-4993-b8ad-16ae42669bd8 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.731441 Aug 09 17:36:36.554073 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2247/4739] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:35 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:36.768870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ab98a0da-9f3f-496a-a685-88f305f26a37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:36.770843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ab98a0da-9f3f-496a-a685-88f305f26a37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:36.803242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab98a0da-9f3f-496a-a685-88f305f26a37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:36.804333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab98a0da-9f3f-496a-a685-88f305f26a37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:36.805940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab98a0da-9f3f-496a-a685-88f305f26a37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:36.807352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab98a0da-9f3f-496a-a685-88f305f26a37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:36.808083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab98a0da-9f3f-496a-a685-88f305f26a37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:36.809380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab98a0da-9f3f-496a-a685-88f305f26a37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:37.137930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ab98a0da-9f3f-496a-a685-88f305f26a37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:37.156615 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ab98a0da-9f3f-496a-a685-88f305f26a37 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1315 microversion: 2.1 time: 0.396271 Aug 09 17:36:37.188840 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2493/4740] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:36 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:36:37.584934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:37.585869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:37.610653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:37.611281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:37.611859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:37.612732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:37.613684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:37.614395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:37.854794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:37.900338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:37.909388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:37.917942 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b119b25c-1ba8-4be4-b950-275190b48dd4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.338217 Aug 09 17:36:37.927958 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2248/4741] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:37 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:38.212162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-802b504d-52ca-46af-aad9-2ee2b902d2bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:38.219039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-802b504d-52ca-46af-aad9-2ee2b902d2bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:38.256520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802b504d-52ca-46af-aad9-2ee2b902d2bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:38.262342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802b504d-52ca-46af-aad9-2ee2b902d2bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:38.262735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802b504d-52ca-46af-aad9-2ee2b902d2bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:38.268189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802b504d-52ca-46af-aad9-2ee2b902d2bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:38.272601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802b504d-52ca-46af-aad9-2ee2b902d2bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:38.278226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-802b504d-52ca-46af-aad9-2ee2b902d2bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:38.971456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-802b504d-52ca-46af-aad9-2ee2b902d2bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:38.981484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:38.982114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:38.994655 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-802b504d-52ca-46af-aad9-2ee2b902d2bd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1315 microversion: 2.1 time: 0.795045 Aug 09 17:36:38.995293 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2494/4742] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:38 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1315 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:39.006433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:39.007174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:39.008916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:39.011050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:39.011561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:39.012049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:39.174150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:39.186932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:39.188602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:39.198624 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-349ece71-4161-48ff-a3ec-6f461b198cfb tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.224765 Aug 09 17:36:39.201928 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2249/4743] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:38 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:40.017602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ff570696-025c-43c0-ba88-599453d559fd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:40.018402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ff570696-025c-43c0-ba88-599453d559fd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:40.032322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff570696-025c-43c0-ba88-599453d559fd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:40.032978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff570696-025c-43c0-ba88-599453d559fd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:40.036833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff570696-025c-43c0-ba88-599453d559fd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:40.037858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff570696-025c-43c0-ba88-599453d559fd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:40.038550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff570696-025c-43c0-ba88-599453d559fd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:40.039208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff570696-025c-43c0-ba88-599453d559fd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:40.249896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:40.250721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:40.266345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:40.267603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:40.270798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:40.272182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:40.274047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:40.274709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:40.354563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ff570696-025c-43c0-ba88-599453d559fd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:40.373966 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ff570696-025c-43c0-ba88-599453d559fd tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1315 microversion: 2.1 time: 0.359163 Aug 09 17:36:40.376390 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2495/4744] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:40 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:36:40.636542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:40.671961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:40.678282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:40.681089 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-be84d22d-e292-4b52-80c1-ccf6e4fbb2b0 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.434900 Aug 09 17:36:40.699383 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2250/4745] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:40 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:41.413772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e444daec-d802-4fbe-93a7-b62773e39116 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:41.415410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e444daec-d802-4fbe-93a7-b62773e39116 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:41.436059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e444daec-d802-4fbe-93a7-b62773e39116 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:41.439158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e444daec-d802-4fbe-93a7-b62773e39116 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:41.440645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e444daec-d802-4fbe-93a7-b62773e39116 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:41.447057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e444daec-d802-4fbe-93a7-b62773e39116 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:41.447884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e444daec-d802-4fbe-93a7-b62773e39116 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:41.448795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e444daec-d802-4fbe-93a7-b62773e39116 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:41.720636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e444daec-d802-4fbe-93a7-b62773e39116 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:41.735516 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e444daec-d802-4fbe-93a7-b62773e39116 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1315 microversion: 2.1 time: 0.326959 Aug 09 17:36:41.739003 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2496/4746] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:41 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:41.740153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:41.749386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:41.788361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:41.789323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:41.793305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:41.800326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:41.804082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:41.808544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:42.156435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:42.221803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:42.231502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:42.236305 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4bd09de5-57a1-48f7-b4a2-90676c032c8e tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.512153 Aug 09 17:36:42.268577 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2251/4747] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:41 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:42.770837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4cde30a8-aada-415b-8211-0a338aa61bc5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:42.772175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4cde30a8-aada-415b-8211-0a338aa61bc5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:42.789162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cde30a8-aada-415b-8211-0a338aa61bc5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:42.797331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cde30a8-aada-415b-8211-0a338aa61bc5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:42.798098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cde30a8-aada-415b-8211-0a338aa61bc5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:42.799050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cde30a8-aada-415b-8211-0a338aa61bc5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:42.799759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cde30a8-aada-415b-8211-0a338aa61bc5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:42.800395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cde30a8-aada-415b-8211-0a338aa61bc5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:43.151987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4cde30a8-aada-415b-8211-0a338aa61bc5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:43.165001 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4cde30a8-aada-415b-8211-0a338aa61bc5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1315 microversion: 2.1 time: 0.406410 Aug 09 17:36:43.165608 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2497/4748] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:42 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:36:43.289984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:43.291125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:43.331771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:43.333645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:43.335126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:43.337006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:43.338938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:43.340273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:43.950926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:43.978221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:43.984777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:43.990898 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2fccd51a-cc26-4551-bd34-7fc9f15bb2fd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.709079 Aug 09 17:36:43.993093 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2252/4749] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:43 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:44.200786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c61d3173-9140-4d44-9a58-4cbdbe5c68d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:44.202161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c61d3173-9140-4d44-9a58-4cbdbe5c68d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:44.219671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c61d3173-9140-4d44-9a58-4cbdbe5c68d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:44.222309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c61d3173-9140-4d44-9a58-4cbdbe5c68d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:44.223726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c61d3173-9140-4d44-9a58-4cbdbe5c68d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:44.232419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c61d3173-9140-4d44-9a58-4cbdbe5c68d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:44.233009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c61d3173-9140-4d44-9a58-4cbdbe5c68d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:44.233548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c61d3173-9140-4d44-9a58-4cbdbe5c68d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:45.035534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:45.036999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:45.049750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:45.052809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:45.053176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:45.056292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:45.057597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:45.062842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:45.104882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:45.190205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c61d3173-9140-4d44-9a58-4cbdbe5c68d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:45.204668 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c61d3173-9140-4d44-9a58-4cbdbe5c68d6 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1315 microversion: 2.1 time: 1.006766 Aug 09 17:36:45.206579 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2498/4750] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:44 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1315 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:45.372670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:45.384195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:45.390560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:45.397321 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f8037752-8dd6-4645-8d90-6070f0172fdc tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.365847 Aug 09 17:36:45.398769 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2253/4751] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:45 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:46.025149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-15a6f52e-4788-4d46-8c16-deb0f7803309 req-902444db-e800-4184-bd75-9de0b31bcf71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11538f74-5456-470b-96ff-6ffceb5e5218", "name": "network-vif-plugged", "status": "completed", "tag": "937926c7-6c58-4ddd-91e7-3c5a998f4f99"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:36:46.073462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-15a6f52e-4788-4d46-8c16-deb0f7803309 req-902444db-e800-4184-bd75-9de0b31bcf71 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:46.079550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-15a6f52e-4788-4d46-8c16-deb0f7803309 req-902444db-e800-4184-bd75-9de0b31bcf71 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:46.080362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-15a6f52e-4788-4d46-8c16-deb0f7803309 req-902444db-e800-4184-bd75-9de0b31bcf71 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:46.122875 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-15a6f52e-4788-4d46-8c16-deb0f7803309 req-902444db-e800-4184-bd75-9de0b31bcf71 service nova] Creating event network-vif-plugged:937926c7-6c58-4ddd-91e7-3c5a998f4f99 for instance 11538f74-5456-470b-96ff-6ffceb5e5218 on n-h2-845781-6 Aug 09 17:36:46.135875 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-15a6f52e-4788-4d46-8c16-deb0f7803309 req-902444db-e800-4184-bd75-9de0b31bcf71 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119051 Aug 09 17:36:46.139425 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2499/4752] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:36:46.245948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3fa60528-452a-42b3-b357-7b518e6abd21 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:46.247075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3fa60528-452a-42b3-b357-7b518e6abd21 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:46.276664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fa60528-452a-42b3-b357-7b518e6abd21 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:46.278512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fa60528-452a-42b3-b357-7b518e6abd21 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:46.278984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fa60528-452a-42b3-b357-7b518e6abd21 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:46.279788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fa60528-452a-42b3-b357-7b518e6abd21 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:46.280277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fa60528-452a-42b3-b357-7b518e6abd21 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:46.280717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fa60528-452a-42b3-b357-7b518e6abd21 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:46.445270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:46.446128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:46.459944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:46.464502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:46.465168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:46.471701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:46.474052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:46.477311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:46.478123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:46.790963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:46.802175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:46.804697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:46.806274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fd72f575-7ac6-4e06-aea7-97b31c331ee3 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.368296 Aug 09 17:36:46.807528 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2500/4753] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:46 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:46.937684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3fa60528-452a-42b3-b357-7b518e6abd21 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:46.986770 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3fa60528-452a-42b3-b357-7b518e6abd21 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1315 microversion: 2.1 time: 0.746404 Aug 09 17:36:46.995701 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2254/4754] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:46 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:47.833643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:47.835045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:47.851119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:47.852122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:47.852757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:47.854683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:47.855425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:47.856888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:48.020580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f0d5f57-a308-4ea1-b0b0-c5fe2fda14a1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:48.022182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8f0d5f57-a308-4ea1-b0b0-c5fe2fda14a1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:48.044494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:36:48.048725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f0d5f57-a308-4ea1-b0b0-c5fe2fda14a1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:48.049523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f0d5f57-a308-4ea1-b0b0-c5fe2fda14a1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:48.050552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f0d5f57-a308-4ea1-b0b0-c5fe2fda14a1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:48.051917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f0d5f57-a308-4ea1-b0b0-c5fe2fda14a1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:48.052616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f0d5f57-a308-4ea1-b0b0-c5fe2fda14a1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:48.053284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f0d5f57-a308-4ea1-b0b0-c5fe2fda14a1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:48.150718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:48.165175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:48.174341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:48.176746 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1334d5a9-9c07-41c8-8775-2473e86590ee tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.351130 Aug 09 17:36:48.177933 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2501/4755] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:47 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:36:48.474637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8f0d5f57-a308-4ea1-b0b0-c5fe2fda14a1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:48.492138 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8f0d5f57-a308-4ea1-b0b0-c5fe2fda14a1 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1502 microversion: 2.1 time: 0.478067 Aug 09 17:36:48.516365 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2255/4756] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:48 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1502 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:36:48.542628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b7d0c5e-f7c2-46c9-99af-47b126dfa9c2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:36:48.543672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7b7d0c5e-f7c2-46c9-99af-47b126dfa9c2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:48.579127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c5e-f7c2-46c9-99af-47b126dfa9c2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:48.585427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c5e-f7c2-46c9-99af-47b126dfa9c2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:48.586623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c5e-f7c2-46c9-99af-47b126dfa9c2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:48.588172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c5e-f7c2-46c9-99af-47b126dfa9c2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:48.591324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c5e-f7c2-46c9-99af-47b126dfa9c2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:48.594378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7d0c5e-f7c2-46c9-99af-47b126dfa9c2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:49.189025 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.network.security_group_api [None req-7b7d0c5e-f7c2-46c9-99af-47b126dfa9c2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Removing security group d256ebd0-ed8b-4ea1-b26c-ee2c05ec2c90 from port 937926c7-6c58-4ddd-91e7-3c5a998f4f99 Aug 09 17:36:49.211026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:49.213719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:49.229132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:49.230610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:49.231820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:49.235715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:49.237156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:49.238962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:49.412886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:49.472834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:49.481216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:49.489476 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ccc0fc35-77b6-4657-8ebf-1792a4d4c960 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.286975 Aug 09 17:36:49.511791 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2256/4757] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:49 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:50.286052 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b7d0c5e-f7c2-46c9-99af-47b126dfa9c2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218/action" status: 202 len: 0 microversion: 2.1 time: 1.753600 Aug 09 17:36:50.290186 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2502/4758] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:36:48 2022] POST /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218/action => generated 0 bytes in 1757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:36:50.303002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-343ac39d-c2dc-4486-b5ea-3ba86ebb5b81 req-b98f6dfb-4e37-40f8-b251-e8f51e460f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11538f74-5456-470b-96ff-6ffceb5e5218", "tag": "937926c7-6c58-4ddd-91e7-3c5a998f4f99"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:36:50.307839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-83fcae20-d6c4-4e89-a07c-6dcfbf129f9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:50.309023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-83fcae20-d6c4-4e89-a07c-6dcfbf129f9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:50.327342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83fcae20-d6c4-4e89-a07c-6dcfbf129f9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:50.329651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83fcae20-d6c4-4e89-a07c-6dcfbf129f9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:50.330644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83fcae20-d6c4-4e89-a07c-6dcfbf129f9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:50.332669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83fcae20-d6c4-4e89-a07c-6dcfbf129f9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:50.333621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83fcae20-d6c4-4e89-a07c-6dcfbf129f9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:50.334542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83fcae20-d6c4-4e89-a07c-6dcfbf129f9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:50.336062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-343ac39d-c2dc-4486-b5ea-3ba86ebb5b81 req-b98f6dfb-4e37-40f8-b251-e8f51e460f7c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:50.338932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-343ac39d-c2dc-4486-b5ea-3ba86ebb5b81 req-b98f6dfb-4e37-40f8-b251-e8f51e460f7c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:50.339816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-343ac39d-c2dc-4486-b5ea-3ba86ebb5b81 req-b98f6dfb-4e37-40f8-b251-e8f51e460f7c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:50.373416 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-343ac39d-c2dc-4486-b5ea-3ba86ebb5b81 req-b98f6dfb-4e37-40f8-b251-e8f51e460f7c service nova] Creating event network-changed:937926c7-6c58-4ddd-91e7-3c5a998f4f99 for instance 11538f74-5456-470b-96ff-6ffceb5e5218 on n-h2-845781-6 Aug 09 17:36:50.389348 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-343ac39d-c2dc-4486-b5ea-3ba86ebb5b81 req-b98f6dfb-4e37-40f8-b251-e8f51e460f7c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089629 Aug 09 17:36:50.391380 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2503/4759] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:36:50.543272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:50.544213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:50.569519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:50.577775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:50.578462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:50.591444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:50.592112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:50.592688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:50.922699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:50.954550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:50.968649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:50.972615 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e422041-fc7b-4baf-815b-624886ab1ffd tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1408 microversion: 2.54 time: 0.434593 Aug 09 17:36:50.976207 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2504/4760] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:50 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1408 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:36:51.286698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-83fcae20-d6c4-4e89-a07c-6dcfbf129f9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:51.312430 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-83fcae20-d6c4-4e89-a07c-6dcfbf129f9e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1460 microversion: 2.1 time: 1.019074 Aug 09 17:36:51.318467 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2257/4761] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:50 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1460 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:51.343097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-30f28fd0-0afc-4058-83dc-07e9c263fe17 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:51.344543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-30f28fd0-0afc-4058-83dc-07e9c263fe17 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:51.366298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30f28fd0-0afc-4058-83dc-07e9c263fe17 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:51.367181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30f28fd0-0afc-4058-83dc-07e9c263fe17 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:51.367901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30f28fd0-0afc-4058-83dc-07e9c263fe17 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:51.368917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30f28fd0-0afc-4058-83dc-07e9c263fe17 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:51.369757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30f28fd0-0afc-4058-83dc-07e9c263fe17 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:51.370278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30f28fd0-0afc-4058-83dc-07e9c263fe17 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:52.031282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:52.032086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:52.040272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:52.040765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:52.041208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:52.042646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:52.043392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:52.044126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:52.132601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-30f28fd0-0afc-4058-83dc-07e9c263fe17 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:52.160548 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-30f28fd0-0afc-4058-83dc-07e9c263fe17 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.819751 Aug 09 17:36:52.162734 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2505/4762] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:51 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:36:52.213773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b6f491d-f7ca-41e0-b1af-ae2383bdf0f2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:52.218222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7b6f491d-f7ca-41e0-b1af-ae2383bdf0f2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:52.244837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6f491d-f7ca-41e0-b1af-ae2383bdf0f2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:52.255132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6f491d-f7ca-41e0-b1af-ae2383bdf0f2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:52.256493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6f491d-f7ca-41e0-b1af-ae2383bdf0f2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:52.258053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6f491d-f7ca-41e0-b1af-ae2383bdf0f2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:52.278991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6f491d-f7ca-41e0-b1af-ae2383bdf0f2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:52.286925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b6f491d-f7ca-41e0-b1af-ae2383bdf0f2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:52.627051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:52.705808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:52.708216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:52.728121 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-40dd465c-c761-42bc-8955-65a3a3141c53 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1414 microversion: 2.54 time: 0.682665 Aug 09 17:36:52.739664 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2258/4763] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:52 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1414 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:52.758404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7b6f491d-f7ca-41e0-b1af-ae2383bdf0f2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:52.784324 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b6f491d-f7ca-41e0-b1af-ae2383bdf0f2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.578077 Aug 09 17:36:52.788482 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2506/4764] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:52 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:52.830802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-93e4a6a0-053e-4f23-ac36-3dfde394a564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:52.831535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-93e4a6a0-053e-4f23-ac36-3dfde394a564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:52.871791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93e4a6a0-053e-4f23-ac36-3dfde394a564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:52.872514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93e4a6a0-053e-4f23-ac36-3dfde394a564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:52.872972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93e4a6a0-053e-4f23-ac36-3dfde394a564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:52.873919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93e4a6a0-053e-4f23-ac36-3dfde394a564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:52.875093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93e4a6a0-053e-4f23-ac36-3dfde394a564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:52.875740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-93e4a6a0-053e-4f23-ac36-3dfde394a564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:53.782891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:53.783525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:53.800311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:53.802305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:53.804739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:53.807341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:53.808621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:53.809992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:53.861534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-93e4a6a0-053e-4f23-ac36-3dfde394a564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:53.874842 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-93e4a6a0-053e-4f23-ac36-3dfde394a564 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.052939 Aug 09 17:36:53.881615 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2259/4765] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:52 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:53.911680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-13282c14-75d0-4809-8812-1612e29d6957 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:53.912464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-13282c14-75d0-4809-8812-1612e29d6957 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:53.927143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13282c14-75d0-4809-8812-1612e29d6957 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:53.928182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13282c14-75d0-4809-8812-1612e29d6957 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:53.929002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13282c14-75d0-4809-8812-1612e29d6957 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:53.930057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13282c14-75d0-4809-8812-1612e29d6957 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:53.930832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13282c14-75d0-4809-8812-1612e29d6957 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:53.931586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13282c14-75d0-4809-8812-1612e29d6957 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:54.046697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:54.062215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:54.068743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:54.073150 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eaa3e979-6030-45cd-962e-1e5ac461beb9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1414 microversion: 2.54 time: 0.295147 Aug 09 17:36:54.074768 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2507/4766] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:53 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1414 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:54.579385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-13282c14-75d0-4809-8812-1612e29d6957 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:54.607369 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-13282c14-75d0-4809-8812-1612e29d6957 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.704371 Aug 09 17:36:54.608190 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2260/4767] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:53 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:36:54.856489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-533033668", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "57c98899-0caf-4592-be88-405da8266825"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:36:55.020505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] validate_networks() for [('57c98899-0caf-4592-be88-405da8266825', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:36:55.121490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:55.123249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:55.140509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:55.141494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:55.143716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:55.150769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:55.155806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:55.156672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:55.504598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:55.550540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:55.562270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:55.586923 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7a6e84b9-af64-432e-88aa-d6ef9f96bb5c tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1399 microversion: 2.54 time: 0.466899 Aug 09 17:36:55.616076 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2261/4768] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:55 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1399 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:55.654985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-40f45bc6-7e4e-47f9-9c8c-3e6698d33d84 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '.version_select at 0x7fbbca381ca0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:55.731393 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-40f45bc6-7e4e-47f9-9c8c-3e6698d33d84 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-278310109" status: 204 len: 0 microversion: 2.54 time: 0.084194 Aug 09 17:36:55.743015 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2262/4769] 10.222.0.93 () {60 vars in 1316 bytes} [Tue Aug 9 17:36:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-278310109 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 17:36:55.776224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-818d7f86-c5ed-4ad1-839d-a54e1ddd2231 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:55.777571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-818d7f86-c5ed-4ad1-839d-a54e1ddd2231 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:55.816954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818d7f86-c5ed-4ad1-839d-a54e1ddd2231 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:55.818189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818d7f86-c5ed-4ad1-839d-a54e1ddd2231 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:55.819000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818d7f86-c5ed-4ad1-839d-a54e1ddd2231 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:55.826773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818d7f86-c5ed-4ad1-839d-a54e1ddd2231 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:55.828055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818d7f86-c5ed-4ad1-839d-a54e1ddd2231 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:55.828926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818d7f86-c5ed-4ad1-839d-a54e1ddd2231 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:55.944740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-818d7f86-c5ed-4ad1-839d-a54e1ddd2231 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:36:56.305161 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-818d7f86-c5ed-4ad1-839d-a54e1ddd2231 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "DELETE /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 204 len: 0 microversion: 2.54 time: 0.554704 Aug 09 17:36:56.310016 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2263/4770] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:36:55 2022] DELETE /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:36:56.351563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:56.357663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:56.398962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:56.403120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:56.409380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:56.459996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:56.459996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:56.459996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:56.777551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:56.800812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:56.805205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:56.808199 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-836209cc-1b72-4e9e-879c-7b870d8720a4 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1405 microversion: 2.54 time: 0.487171 Aug 09 17:36:56.840303 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2264/4771] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:56 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1405 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:36:57.864075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:57.865069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:57.888978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:57.889600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:57.890235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:57.891288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:57.900349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:57.901315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:58.183995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:58.202611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:58.204915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:58.213019 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-deec1e19-6d70-447f-8441-dd1868ff5e57 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1405 microversion: 2.54 time: 0.349074 Aug 09 17:36:58.213736 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2265/4772] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:57 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:36:58.583185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:36:58.584089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:36:58.584335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:36:58.584785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:36:58.585221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:36:58.617752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:58.618659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:58.619448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:58.620911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:58.621788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:58.622576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:58.712213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:36:58.736183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Getting quotas for user 62572816b806440aa8338fea1d0a297e and project 69e28a1803f040bd91230e6b0e71a6bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:36:58.811402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:36:58.827830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:36:59.049196 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9a731c96-5d84-4a01-b876-095a9d8aa77e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.198166 Aug 09 17:36:59.051087 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2508/4773] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:36:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:36:59.068785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-61235543-d1d1-4c3b-9ad2-a29ec5a46907 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:59.070117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-61235543-d1d1-4c3b-9ad2-a29ec5a46907 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:59.226404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-61235543-d1d1-4c3b-9ad2-a29ec5a46907 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:36:59.265283 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-61235543-d1d1-4c3b-9ad2-a29ec5a46907 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1214 microversion: 2.1 time: 0.195008 Aug 09 17:36:59.265644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:36:59.266806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:36:59.267033 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2266/4774] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:36:59 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:36:59.303004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:59.303961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:59.304656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:36:59.308869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:36:59.312002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:36:59.317304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:00.109987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:00.146055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:00.156218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74ecb7576c2d4cf5a0060a166d0ea0bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dcc2b8878a401dba1b721446303d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:00.158664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-28253327-a224-4e7e-b6be-bd33d2f71be9 tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 200 len: 1405 microversion: 2.54 time: 0.899795 Aug 09 17:37:00.164543 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2509/4775] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:36:59 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 1405 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:37:00.307755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c41598ba-b1f3-417f-905b-b0ad9274d783 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:00.308839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c41598ba-b1f3-417f-905b-b0ad9274d783 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:00.503948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c41598ba-b1f3-417f-905b-b0ad9274d783 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:00.513159 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c41598ba-b1f3-417f-905b-b0ad9274d783 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1214 microversion: 2.1 time: 0.214200 Aug 09 17:37:00.514430 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2267/4776] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:00 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:01.208542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:01.209388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] [instance: 64f4d6cc-70de-4628-b0f7-90217b2d7d06] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:01.219101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:01.219434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:01.219973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:01.228616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:01.229124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:01.229570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:01.267922 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] HTTP exception thrown: Instance 64f4d6cc-70de-4628-b0f7-90217b2d7d06 could not be found. Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Request method failure captured: Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 HTTP/1.1 Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8psQs7w8Dd4ul0llq7vilEVjXhjNdYRbQz0dKbPGkE2ru2faDbawzh95lOrqBpUbhxD467r0eFEHVy_h2WLF3Wzhq3h_wvtot7e2d0Rxz-ZUIujuJeBVQOmJC6Gdfwy2P1NpMlFn1Ih72tCjnwU_8Ee-xYR2XormjWKXsozZ-gSYQkY Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.54 Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 79dcc2b8878a401dba1b721446303d21 Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerShowV254Test-2104326742 Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_79dcc2b8878a401dba1b721446303d21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/79dcc2b8878a401dba1b721446303d21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/79dcc2b8878a401dba1b721446303d21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/79dcc2b8878a401dba1b721446303d21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerShowV254Test-2104326742 Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 79dcc2b8878a401dba1b721446303d21 Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerShowV254Test-2104326742 Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerShowV254Test-2104326742-project Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 74ecb7576c2d4cf5a0060a166d0ea0bd Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerShowV254Test-2104326742-project Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 64f4d6cc-70de-4628-b0f7-90217b2d7d06 could not be found. Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '64f4d6cc-70de-4628-b0f7-90217b2d7d06'} Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f4d6cc-70de-4628-b0f7-90217b2d7d06 could not be found. Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f4d6cc-70de-4628-b0f7-90217b2d7d06 could not be found. Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:37:01.270551 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:37:01.276063 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:37:01.276063 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:37:01.276063 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:37:01.276063 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:37:01.276063 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:37:01.276063 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f4d6cc-70de-4628-b0f7-90217b2d7d06 could not be found. Aug 09 17:37:01.276063 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:37:01.280243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] Returning 404 to user: Instance 64f4d6cc-70de-4628-b0f7-90217b2d7d06 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:37:01.281415 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1bd3549-f798-43f7-975c-eeea4de8749d tempest-ServerShowV254Test-2104326742 tempest-ServerShowV254Test-2104326742-project] 10.222.0.93 "GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06" status: 404 len: 111 microversion: 2.54 time: 0.077580 Aug 09 17:37:01.282546 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2510/4777] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:37:01 2022] GET /compute/v2.1/servers/64f4d6cc-70de-4628-b0f7-90217b2d7d06 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:37:01.551273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-406fa439-55e2-446a-b6c3-ef7daf21a28a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:01.552174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-406fa439-55e2-446a-b6c3-ef7daf21a28a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:01.574812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-406fa439-55e2-446a-b6c3-ef7daf21a28a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:01.576298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-406fa439-55e2-446a-b6c3-ef7daf21a28a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:01.577732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-406fa439-55e2-446a-b6c3-ef7daf21a28a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:01.581371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-406fa439-55e2-446a-b6c3-ef7daf21a28a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:01.582700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-406fa439-55e2-446a-b6c3-ef7daf21a28a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:01.583405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-406fa439-55e2-446a-b6c3-ef7daf21a28a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:01.704952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-406fa439-55e2-446a-b6c3-ef7daf21a28a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:01.740433 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-406fa439-55e2-446a-b6c3-ef7daf21a28a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1266 microversion: 2.1 time: 0.193789 Aug 09 17:37:01.743382 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2268/4778] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:01 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:37:02.810651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e0c6172-ce79-4279-8172-cb94edd20a19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:02.819695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1e0c6172-ce79-4279-8172-cb94edd20a19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:02.854134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e0c6172-ce79-4279-8172-cb94edd20a19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:02.868165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e0c6172-ce79-4279-8172-cb94edd20a19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:02.870293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e0c6172-ce79-4279-8172-cb94edd20a19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:02.875856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e0c6172-ce79-4279-8172-cb94edd20a19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:02.877365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e0c6172-ce79-4279-8172-cb94edd20a19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:02.885055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e0c6172-ce79-4279-8172-cb94edd20a19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:03.554076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1e0c6172-ce79-4279-8172-cb94edd20a19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:03.600093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:03.607122 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e0c6172-ce79-4279-8172-cb94edd20a19 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1272 microversion: 2.1 time: 0.824817 Aug 09 17:37:03.608930 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2511/4779] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:02 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1272 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:04.645241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d8e6d2e2-4099-434f-94dd-73e6a62c38a2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:04.646065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d8e6d2e2-4099-434f-94dd-73e6a62c38a2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:04.681262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8e6d2e2-4099-434f-94dd-73e6a62c38a2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:04.682664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8e6d2e2-4099-434f-94dd-73e6a62c38a2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:04.683779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8e6d2e2-4099-434f-94dd-73e6a62c38a2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:04.685482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8e6d2e2-4099-434f-94dd-73e6a62c38a2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:04.687132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8e6d2e2-4099-434f-94dd-73e6a62c38a2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:04.700357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d8e6d2e2-4099-434f-94dd-73e6a62c38a2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:05.084905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d8e6d2e2-4099-434f-94dd-73e6a62c38a2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:05.097460 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d8e6d2e2-4099-434f-94dd-73e6a62c38a2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1272 microversion: 2.1 time: 0.457794 Aug 09 17:37:05.098125 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2269/4780] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:04 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1272 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:37:06.120378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8be95fce-3e54-4d19-9853-d895e8362da4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:06.121912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8be95fce-3e54-4d19-9853-d895e8362da4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:06.130918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be95fce-3e54-4d19-9853-d895e8362da4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:06.131971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be95fce-3e54-4d19-9853-d895e8362da4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:06.132638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be95fce-3e54-4d19-9853-d895e8362da4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:06.134140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be95fce-3e54-4d19-9853-d895e8362da4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:06.135075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be95fce-3e54-4d19-9853-d895e8362da4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:06.136265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be95fce-3e54-4d19-9853-d895e8362da4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:06.492107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dd40b114-0ee7-483e-b981-7fcaa53eac58 tempest-ExtensionsTest-214945760 tempest-ExtensionsTest-214945760-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:06.508842 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dd40b114-0ee7-483e-b981-7fcaa53eac58 tempest-ExtensionsTest-214945760 tempest-ExtensionsTest-214945760-project] 10.222.0.93 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.526592 Aug 09 17:37:06.514518 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2512/4781] 10.222.0.93 () {58 vars in 1170 bytes} [Tue Aug 9 17:37:05 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:37:06.538349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86ef1703-c682-4732-95fd-a1582013f64b tempest-ExtensionsTest-214945760 tempest-ExtensionsTest-214945760-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:06.544357 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86ef1703-c682-4732-95fd-a1582013f64b tempest-ExtensionsTest-214945760 tempest-ExtensionsTest-214945760-project] 10.222.0.93 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.024996 Aug 09 17:37:06.546559 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2513/4782] 10.222.0.93 () {58 vars in 1134 bytes} [Tue Aug 9 17:37:06 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:37:07.253351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8be95fce-3e54-4d19-9853-d895e8362da4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:07.261836 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8be95fce-3e54-4d19-9853-d895e8362da4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1314 microversion: 2.1 time: 1.146473 Aug 09 17:37:07.262454 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2270/4783] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:06 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1314 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:37:08.289965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b40d4da9-5392-45b0-956c-ccd85e2df7d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:08.290881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b40d4da9-5392-45b0-956c-ccd85e2df7d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:08.318383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b40d4da9-5392-45b0-956c-ccd85e2df7d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:08.318900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b40d4da9-5392-45b0-956c-ccd85e2df7d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:08.319466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b40d4da9-5392-45b0-956c-ccd85e2df7d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:08.320398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b40d4da9-5392-45b0-956c-ccd85e2df7d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:08.320917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b40d4da9-5392-45b0-956c-ccd85e2df7d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:08.322355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b40d4da9-5392-45b0-956c-ccd85e2df7d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:08.662266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:08.772464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:09.533687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b40d4da9-5392-45b0-956c-ccd85e2df7d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:09.550286 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b40d4da9-5392-45b0-956c-ccd85e2df7d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1314 microversion: 2.1 time: 1.264057 Aug 09 17:37:09.569589 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2514/4784] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:08 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1314 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:10.579295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c6e922db-7f66-4a9f-a1cb-2893dae74565 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:10.580893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c6e922db-7f66-4a9f-a1cb-2893dae74565 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:10.584893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:10.616644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6e922db-7f66-4a9f-a1cb-2893dae74565 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:10.617790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6e922db-7f66-4a9f-a1cb-2893dae74565 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:10.618679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6e922db-7f66-4a9f-a1cb-2893dae74565 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:10.620050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6e922db-7f66-4a9f-a1cb-2893dae74565 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:10.620882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6e922db-7f66-4a9f-a1cb-2893dae74565 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:10.628213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c6e922db-7f66-4a9f-a1cb-2893dae74565 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:10.688648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:11.362646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e0bf391b-2c53-4d32-a606-b6149aa28152 req-1761fff4-f9bd-4e98-b522-5244bebe1abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c299fda1-8657-46b4-ab0a-3592f096c1b3", "tag": "57024231-91a0-48b5-9317-3a85be55d7a1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:37:11.383816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e0bf391b-2c53-4d32-a606-b6149aa28152 req-1761fff4-f9bd-4e98-b522-5244bebe1abb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:11.384311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e0bf391b-2c53-4d32-a606-b6149aa28152 req-1761fff4-f9bd-4e98-b522-5244bebe1abb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:11.385481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e0bf391b-2c53-4d32-a606-b6149aa28152 req-1761fff4-f9bd-4e98-b522-5244bebe1abb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:11.418361 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e0bf391b-2c53-4d32-a606-b6149aa28152 req-1761fff4-f9bd-4e98-b522-5244bebe1abb service nova] Creating event network-changed:57024231-91a0-48b5-9317-3a85be55d7a1 for instance c299fda1-8657-46b4-ab0a-3592f096c1b3 on n-h1-845781-6 Aug 09 17:37:11.433615 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e0bf391b-2c53-4d32-a606-b6149aa28152 req-1761fff4-f9bd-4e98-b522-5244bebe1abb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075575 Aug 09 17:37:11.434606 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2515/4785] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:37:11.661463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c6e922db-7f66-4a9f-a1cb-2893dae74565 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:11.672884 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c6e922db-7f66-4a9f-a1cb-2893dae74565 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1314 microversion: 2.1 time: 1.099562 Aug 09 17:37:11.673519 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2271/4786] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:10 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1314 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:12.697721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9386acb8-98a2-45fd-a733-7e9beb42c318 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:12.699897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9386acb8-98a2-45fd-a733-7e9beb42c318 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:12.735594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9386acb8-98a2-45fd-a733-7e9beb42c318 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:12.742714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9386acb8-98a2-45fd-a733-7e9beb42c318 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:12.743477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9386acb8-98a2-45fd-a733-7e9beb42c318 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:12.750637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9386acb8-98a2-45fd-a733-7e9beb42c318 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:12.754654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9386acb8-98a2-45fd-a733-7e9beb42c318 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:12.755512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9386acb8-98a2-45fd-a733-7e9beb42c318 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:13.934920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9386acb8-98a2-45fd-a733-7e9beb42c318 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:13.944853 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9386acb8-98a2-45fd-a733-7e9beb42c318 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1314 microversion: 2.1 time: 1.253719 Aug 09 17:37:13.946072 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2516/4787] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:12 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1314 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:37:14.968437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4c2bff6a-56c3-44fb-8cb5-2194dc7ec0c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:14.969387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4c2bff6a-56c3-44fb-8cb5-2194dc7ec0c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:14.982397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c2bff6a-56c3-44fb-8cb5-2194dc7ec0c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:14.984492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c2bff6a-56c3-44fb-8cb5-2194dc7ec0c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:14.986546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c2bff6a-56c3-44fb-8cb5-2194dc7ec0c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:14.995709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c2bff6a-56c3-44fb-8cb5-2194dc7ec0c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:14.996857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c2bff6a-56c3-44fb-8cb5-2194dc7ec0c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:14.998225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c2bff6a-56c3-44fb-8cb5-2194dc7ec0c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:16.336607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4c2bff6a-56c3-44fb-8cb5-2194dc7ec0c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:16.345017 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4c2bff6a-56c3-44fb-8cb5-2194dc7ec0c5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1314 microversion: 2.1 time: 1.380365 Aug 09 17:37:16.345636 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2272/4788] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:14 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1314 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:37:17.390209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-01ded34b-bec3-462e-a179-0c0dd59cef70 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:17.391074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-01ded34b-bec3-462e-a179-0c0dd59cef70 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:17.402000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:17.403456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01ded34b-bec3-462e-a179-0c0dd59cef70 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:17.407904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01ded34b-bec3-462e-a179-0c0dd59cef70 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:17.408414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01ded34b-bec3-462e-a179-0c0dd59cef70 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:17.411777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01ded34b-bec3-462e-a179-0c0dd59cef70 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:17.415348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01ded34b-bec3-462e-a179-0c0dd59cef70 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:17.416113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01ded34b-bec3-462e-a179-0c0dd59cef70 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:17.927716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ea86bc65-f077-42de-b8a0-b50bbcbdc9b4 req-ec61fcfd-1b32-478c-a6de-06a211e74a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c299fda1-8657-46b4-ab0a-3592f096c1b3", "name": "network-vif-plugged", "status": "completed", "tag": "57024231-91a0-48b5-9317-3a85be55d7a1"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:37:17.952022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ea86bc65-f077-42de-b8a0-b50bbcbdc9b4 req-ec61fcfd-1b32-478c-a6de-06a211e74a50 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:17.952891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ea86bc65-f077-42de-b8a0-b50bbcbdc9b4 req-ec61fcfd-1b32-478c-a6de-06a211e74a50 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:17.953681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ea86bc65-f077-42de-b8a0-b50bbcbdc9b4 req-ec61fcfd-1b32-478c-a6de-06a211e74a50 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:18.002622 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ea86bc65-f077-42de-b8a0-b50bbcbdc9b4 req-ec61fcfd-1b32-478c-a6de-06a211e74a50 service nova] Creating event network-vif-plugged:57024231-91a0-48b5-9317-3a85be55d7a1 for instance c299fda1-8657-46b4-ab0a-3592f096c1b3 on n-h1-845781-6 Aug 09 17:37:18.015695 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ea86bc65-f077-42de-b8a0-b50bbcbdc9b4 req-ec61fcfd-1b32-478c-a6de-06a211e74a50 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094018 Aug 09 17:37:18.017578 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2273/4789] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:37:18.645069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-01ded34b-bec3-462e-a179-0c0dd59cef70 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:18.661594 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-01ded34b-bec3-462e-a179-0c0dd59cef70 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1314 microversion: 2.1 time: 1.278833 Aug 09 17:37:18.662844 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2517/4790] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:17 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1314 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:19.711770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3288de16-a8fb-4184-ae93-654c8941c0eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:19.714539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3288de16-a8fb-4184-ae93-654c8941c0eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:19.731800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:19.750046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3288de16-a8fb-4184-ae93-654c8941c0eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:19.751551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3288de16-a8fb-4184-ae93-654c8941c0eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:19.752659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3288de16-a8fb-4184-ae93-654c8941c0eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:19.754778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3288de16-a8fb-4184-ae93-654c8941c0eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:19.759666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3288de16-a8fb-4184-ae93-654c8941c0eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:19.760475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3288de16-a8fb-4184-ae93-654c8941c0eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:20.333757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3288de16-a8fb-4184-ae93-654c8941c0eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:20.377903 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3288de16-a8fb-4184-ae93-654c8941c0eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1314 microversion: 2.1 time: 0.682943 Aug 09 17:37:20.379560 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2274/4791] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:19 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:21.403520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43e57ded-ae0d-4f62-98e5-0b02aa62b66e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:21.406108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-43e57ded-ae0d-4f62-98e5-0b02aa62b66e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:21.431164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e57ded-ae0d-4f62-98e5-0b02aa62b66e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:21.431831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e57ded-ae0d-4f62-98e5-0b02aa62b66e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:21.432297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e57ded-ae0d-4f62-98e5-0b02aa62b66e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:21.433052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e57ded-ae0d-4f62-98e5-0b02aa62b66e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:21.433526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e57ded-ae0d-4f62-98e5-0b02aa62b66e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:21.433965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43e57ded-ae0d-4f62-98e5-0b02aa62b66e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:22.345492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-43e57ded-ae0d-4f62-98e5-0b02aa62b66e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:22.361655 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43e57ded-ae0d-4f62-98e5-0b02aa62b66e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1502 microversion: 2.1 time: 0.964583 Aug 09 17:37:22.363046 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2518/4792] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:21 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1502 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:22.385821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-239b2174-3fb0-4558-92e8-6181e5718fae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:37:22.387804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-239b2174-3fb0-4558-92e8-6181e5718fae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:22.397859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239b2174-3fb0-4558-92e8-6181e5718fae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:22.398648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239b2174-3fb0-4558-92e8-6181e5718fae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:22.399259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239b2174-3fb0-4558-92e8-6181e5718fae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:22.401109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239b2174-3fb0-4558-92e8-6181e5718fae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:22.401820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239b2174-3fb0-4558-92e8-6181e5718fae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:22.402427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-239b2174-3fb0-4558-92e8-6181e5718fae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:22.630593 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-239b2174-3fb0-4558-92e8-6181e5718fae tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3/action" status: 202 len: 0 microversion: 2.1 time: 0.247965 Aug 09 17:37:22.631773 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2275/4793] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:37:22 2022] POST /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:37:22.642157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e118969-218f-4af3-a880-f96853d4c43d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:22.644390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6e118969-218f-4af3-a880-f96853d4c43d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:22.656879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e118969-218f-4af3-a880-f96853d4c43d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:22.657902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e118969-218f-4af3-a880-f96853d4c43d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:22.658624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e118969-218f-4af3-a880-f96853d4c43d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:22.661663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e118969-218f-4af3-a880-f96853d4c43d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:22.662712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e118969-218f-4af3-a880-f96853d4c43d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:22.663157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e118969-218f-4af3-a880-f96853d4c43d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:23.701522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e118969-218f-4af3-a880-f96853d4c43d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:23.725495 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e118969-218f-4af3-a880-f96853d4c43d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1507 microversion: 2.1 time: 1.088593 Aug 09 17:37:23.732708 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2519/4794] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:22 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1507 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:24.814384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-76e3f03a-e789-4a13-b62d-de1e9b5ccd8a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:24.817848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-76e3f03a-e789-4a13-b62d-de1e9b5ccd8a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:24.840819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76e3f03a-e789-4a13-b62d-de1e9b5ccd8a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:24.842582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76e3f03a-e789-4a13-b62d-de1e9b5ccd8a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:24.846175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76e3f03a-e789-4a13-b62d-de1e9b5ccd8a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:24.848568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76e3f03a-e789-4a13-b62d-de1e9b5ccd8a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:24.850201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76e3f03a-e789-4a13-b62d-de1e9b5ccd8a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:24.850377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76e3f03a-e789-4a13-b62d-de1e9b5ccd8a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:25.347731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-76e3f03a-e789-4a13-b62d-de1e9b5ccd8a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:25.358249 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-76e3f03a-e789-4a13-b62d-de1e9b5ccd8a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1487 microversion: 2.1 time: 0.604517 Aug 09 17:37:25.358865 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2276/4795] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:24 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1487 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:25.389922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-65ec5b57-7f6a-4216-8fe5-606f940acdd7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:37:25.390897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-65ec5b57-7f6a-4216-8fe5-606f940acdd7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:25.426365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65ec5b57-7f6a-4216-8fe5-606f940acdd7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:25.427274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65ec5b57-7f6a-4216-8fe5-606f940acdd7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:25.435654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65ec5b57-7f6a-4216-8fe5-606f940acdd7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:25.437275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65ec5b57-7f6a-4216-8fe5-606f940acdd7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:25.438566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65ec5b57-7f6a-4216-8fe5-606f940acdd7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:25.439677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65ec5b57-7f6a-4216-8fe5-606f940acdd7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:25.524487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-65ec5b57-7f6a-4216-8fe5-606f940acdd7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lazy-loading 'flavor' on Instance uuid c299fda1-8657-46b4-ab0a-3592f096c1b3 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:37:25.859306 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-65ec5b57-7f6a-4216-8fe5-606f940acdd7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3/action" status: 202 len: 0 microversion: 2.1 time: 0.483442 Aug 09 17:37:25.860052 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2520/4796] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:37:25 2022] POST /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:37:25.869411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-64fcd778-7dd3-4920-951f-11d79ca7f546 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:25.871079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-64fcd778-7dd3-4920-951f-11d79ca7f546 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:25.882155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64fcd778-7dd3-4920-951f-11d79ca7f546 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:25.893076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64fcd778-7dd3-4920-951f-11d79ca7f546 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:25.893546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64fcd778-7dd3-4920-951f-11d79ca7f546 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:25.894404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64fcd778-7dd3-4920-951f-11d79ca7f546 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:25.903693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64fcd778-7dd3-4920-951f-11d79ca7f546 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:25.904723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64fcd778-7dd3-4920-951f-11d79ca7f546 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:27.032030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-64fcd778-7dd3-4920-951f-11d79ca7f546 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:27.055972 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-64fcd778-7dd3-4920-951f-11d79ca7f546 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1493 microversion: 2.1 time: 1.190440 Aug 09 17:37:27.057049 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2277/4797] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:25 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1493 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:28.103377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0f7de41e-4525-46b4-a7e1-0b5152626964 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:28.116552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0f7de41e-4525-46b4-a7e1-0b5152626964 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:28.139404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f7de41e-4525-46b4-a7e1-0b5152626964 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:28.140058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f7de41e-4525-46b4-a7e1-0b5152626964 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:28.140588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f7de41e-4525-46b4-a7e1-0b5152626964 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:28.141832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f7de41e-4525-46b4-a7e1-0b5152626964 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:28.142457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f7de41e-4525-46b4-a7e1-0b5152626964 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:28.142965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f7de41e-4525-46b4-a7e1-0b5152626964 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:28.614162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0f7de41e-4525-46b4-a7e1-0b5152626964 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:28.634964 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0f7de41e-4525-46b4-a7e1-0b5152626964 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 0.541404 Aug 09 17:37:28.639545 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2521/4798] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:28 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:29.690496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e78ae769-4f39-462f-b45f-a4ee300b5089 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:29.692427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e78ae769-4f39-462f-b45f-a4ee300b5089 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:29.731337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78ae769-4f39-462f-b45f-a4ee300b5089 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:29.732284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78ae769-4f39-462f-b45f-a4ee300b5089 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:29.733121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78ae769-4f39-462f-b45f-a4ee300b5089 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:29.739192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78ae769-4f39-462f-b45f-a4ee300b5089 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:29.741441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78ae769-4f39-462f-b45f-a4ee300b5089 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:29.742313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e78ae769-4f39-462f-b45f-a4ee300b5089 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:29.949522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-49b62a80-6f3c-44fb-871b-41d6a33a3947 req-8ed3e173-05bd-4ae0-971c-acafb3efc744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c299fda1-8657-46b4-ab0a-3592f096c1b3", "name": "network-vif-plugged", "status": "completed", "tag": "57024231-91a0-48b5-9317-3a85be55d7a1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:37:29.976115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-49b62a80-6f3c-44fb-871b-41d6a33a3947 req-8ed3e173-05bd-4ae0-971c-acafb3efc744 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:29.976933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-49b62a80-6f3c-44fb-871b-41d6a33a3947 req-8ed3e173-05bd-4ae0-971c-acafb3efc744 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:29.977554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-49b62a80-6f3c-44fb-871b-41d6a33a3947 req-8ed3e173-05bd-4ae0-971c-acafb3efc744 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:29.992788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-49b62a80-6f3c-44fb-871b-41d6a33a3947 req-8ed3e173-05bd-4ae0-971c-acafb3efc744 service nova] Creating event network-vif-plugged:57024231-91a0-48b5-9317-3a85be55d7a1 for instance c299fda1-8657-46b4-ab0a-3592f096c1b3 on n-h1-845781-6 Aug 09 17:37:30.001094 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-49b62a80-6f3c-44fb-871b-41d6a33a3947 req-8ed3e173-05bd-4ae0-971c-acafb3efc744 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065139 Aug 09 17:37:30.002431 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2522/4799] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:37:31.230463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e78ae769-4f39-462f-b45f-a4ee300b5089 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:31.246054 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e78ae769-4f39-462f-b45f-a4ee300b5089 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 1.564587 Aug 09 17:37:31.246716 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2278/4800] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:29 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:32.290975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c14c03f9-20ab-4e78-a11a-ff95b67aafb8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:32.293007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c14c03f9-20ab-4e78-a11a-ff95b67aafb8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:32.313846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14c03f9-20ab-4e78-a11a-ff95b67aafb8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:32.317490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14c03f9-20ab-4e78-a11a-ff95b67aafb8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:32.318159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14c03f9-20ab-4e78-a11a-ff95b67aafb8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:32.322643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14c03f9-20ab-4e78-a11a-ff95b67aafb8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:32.324137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14c03f9-20ab-4e78-a11a-ff95b67aafb8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:32.329324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14c03f9-20ab-4e78-a11a-ff95b67aafb8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:33.719756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c14c03f9-20ab-4e78-a11a-ff95b67aafb8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:33.757050 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c14c03f9-20ab-4e78-a11a-ff95b67aafb8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 1.469748 Aug 09 17:37:33.758401 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2523/4801] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:32 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:34.786660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1e8fed39-b799-4a33-b9c1-74a60f8f50cb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:34.788134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1e8fed39-b799-4a33-b9c1-74a60f8f50cb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:34.814263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e8fed39-b799-4a33-b9c1-74a60f8f50cb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:34.817037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e8fed39-b799-4a33-b9c1-74a60f8f50cb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:34.818300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e8fed39-b799-4a33-b9c1-74a60f8f50cb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:34.821902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e8fed39-b799-4a33-b9c1-74a60f8f50cb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:34.823581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e8fed39-b799-4a33-b9c1-74a60f8f50cb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:34.825065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e8fed39-b799-4a33-b9c1-74a60f8f50cb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:36.538459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1e8fed39-b799-4a33-b9c1-74a60f8f50cb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:36.579368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1e8fed39-b799-4a33-b9c1-74a60f8f50cb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 1.798306 Aug 09 17:37:36.583025 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2279/4802] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:34 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:37.607825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aa2440e1-e3bb-4249-9f6c-033992a0e0ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:37.609257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aa2440e1-e3bb-4249-9f6c-033992a0e0ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:37.630933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa2440e1-e3bb-4249-9f6c-033992a0e0ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:37.632376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa2440e1-e3bb-4249-9f6c-033992a0e0ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:37.633412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa2440e1-e3bb-4249-9f6c-033992a0e0ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:37.634361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa2440e1-e3bb-4249-9f6c-033992a0e0ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:37.635019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa2440e1-e3bb-4249-9f6c-033992a0e0ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:37.637102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aa2440e1-e3bb-4249-9f6c-033992a0e0ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:37.693812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:37.985368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aa2440e1-e3bb-4249-9f6c-033992a0e0ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:37.996126 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aa2440e1-e3bb-4249-9f6c-033992a0e0ef tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 0.394190 Aug 09 17:37:38.010648 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2524/4803] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:37 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:38.247813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1dbe135e-1574-48f1-8ace-5bf747c58d97 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Action: 'create', calling method: .version_select at 0x7fbbca2a3430>, body: {"keypair": {"name": "tempest-keypair-474605747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAu53fxDwpEiSXmQjyElpNZDV4A9sjyCwqZyYQcAuRsXp3lM80GzxuInnbaepNRsnyLoy8Li8vZZEbdD8inld1hzCK7onuMmPwO6wyNxqQ2TKhmY19lZepAk2ATMX4jLzw=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:37:38.312600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-1dbe135e-1574-48f1-8ace-5bf747c58d97 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Getting quotas for project 39ce4b0e2bf84d778a3cf81d91868f0d. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:37:38.330488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-1dbe135e-1574-48f1-8ace-5bf747c58d97 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Getting quotas for user e5530d014d1a44119b8f0c5fa9e76b3a and project 39ce4b0e2bf84d778a3cf81d91868f0d. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:37:38.421426 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1dbe135e-1574-48f1-8ace-5bf747c58d97 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.610759 Aug 09 17:37:38.422676 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2280/4804] 10.222.0.93 () {62 vars in 1200 bytes} [Tue Aug 9 17:37:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 613 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 17:37:39.030468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-478cce72-8611-4908-ab8a-70f9a7734023 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:39.036136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-478cce72-8611-4908-ab8a-70f9a7734023 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:39.064291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478cce72-8611-4908-ab8a-70f9a7734023 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:39.065220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478cce72-8611-4908-ab8a-70f9a7734023 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:39.078840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478cce72-8611-4908-ab8a-70f9a7734023 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:39.084708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478cce72-8611-4908-ab8a-70f9a7734023 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:39.090525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478cce72-8611-4908-ab8a-70f9a7734023 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:39.092678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-478cce72-8611-4908-ab8a-70f9a7734023 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:40.255285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-478cce72-8611-4908-ab8a-70f9a7734023 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:40.300034 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-478cce72-8611-4908-ab8a-70f9a7734023 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 1.278110 Aug 09 17:37:40.307673 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2525/4805] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:39 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:41.346601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-791f1ac1-ee1b-4876-88f9-b5864fd11338 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:41.348531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-791f1ac1-ee1b-4876-88f9-b5864fd11338 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:41.370711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-791f1ac1-ee1b-4876-88f9-b5864fd11338 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:41.375059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-791f1ac1-ee1b-4876-88f9-b5864fd11338 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:41.375833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-791f1ac1-ee1b-4876-88f9-b5864fd11338 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:41.388047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-791f1ac1-ee1b-4876-88f9-b5864fd11338 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:41.388899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-791f1ac1-ee1b-4876-88f9-b5864fd11338 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:41.393298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-791f1ac1-ee1b-4876-88f9-b5864fd11338 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:41.494911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:42.193131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-791f1ac1-ee1b-4876-88f9-b5864fd11338 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:42.207063 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-791f1ac1-ee1b-4876-88f9-b5864fd11338 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 0.866134 Aug 09 17:37:42.213450 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2281/4806] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:41 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:43.238083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-61ef5016-d075-4b86-abc9-d1197bc4acd5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:43.238768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61ef5016-d075-4b86-abc9-d1197bc4acd5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:43.258853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61ef5016-d075-4b86-abc9-d1197bc4acd5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:43.259370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61ef5016-d075-4b86-abc9-d1197bc4acd5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:43.259890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61ef5016-d075-4b86-abc9-d1197bc4acd5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:43.260646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61ef5016-d075-4b86-abc9-d1197bc4acd5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:43.272911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61ef5016-d075-4b86-abc9-d1197bc4acd5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:43.273375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61ef5016-d075-4b86-abc9-d1197bc4acd5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:43.904080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-61ef5016-d075-4b86-abc9-d1197bc4acd5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:43.926537 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-61ef5016-d075-4b86-abc9-d1197bc4acd5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 0.691335 Aug 09 17:37:43.946767 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2526/4807] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:43 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:44.953862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b28118d2-f49b-4866-b180-8feab791c2e2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:44.954718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b28118d2-f49b-4866-b180-8feab791c2e2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:44.964058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28118d2-f49b-4866-b180-8feab791c2e2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:44.970416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28118d2-f49b-4866-b180-8feab791c2e2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:44.971176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28118d2-f49b-4866-b180-8feab791c2e2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:44.972268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28118d2-f49b-4866-b180-8feab791c2e2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:44.973593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28118d2-f49b-4866-b180-8feab791c2e2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:44.976942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b28118d2-f49b-4866-b180-8feab791c2e2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:45.806365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b28118d2-f49b-4866-b180-8feab791c2e2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:45.818585 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b28118d2-f49b-4866-b180-8feab791c2e2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 0.870459 Aug 09 17:37:45.825060 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2282/4808] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:44 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:46.852527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2f41b6c-a7ea-45ea-8a64-72ee9459b4e7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:46.853403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2f41b6c-a7ea-45ea-8a64-72ee9459b4e7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:46.877679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2f41b6c-a7ea-45ea-8a64-72ee9459b4e7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:46.878212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2f41b6c-a7ea-45ea-8a64-72ee9459b4e7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:46.878677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2f41b6c-a7ea-45ea-8a64-72ee9459b4e7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:46.880042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2f41b6c-a7ea-45ea-8a64-72ee9459b4e7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:46.880528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2f41b6c-a7ea-45ea-8a64-72ee9459b4e7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:46.880971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2f41b6c-a7ea-45ea-8a64-72ee9459b4e7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:49.996789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d2f41b6c-a7ea-45ea-8a64-72ee9459b4e7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:50.037110 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d2f41b6c-a7ea-45ea-8a64-72ee9459b4e7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 3.193671 Aug 09 17:37:50.043292 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2527/4809] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:46 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 3201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:51.038924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-846858447", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b22187c-a932-4523-93ee-b42529a54c2c"}], "security_groups": [{"name": "tempest-securitygroup--1484008669"}], "key_name": "tempest-keypair-474605747", "user_data": "}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:37:51.093163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a54ccce1-8303-45d6-9b6c-e03cbef1d23e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:51.097350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a54ccce1-8303-45d6-9b6c-e03cbef1d23e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:51.126709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:51.128005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:51.160286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=22 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:37:51.177974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54ccce1-8303-45d6-9b6c-e03cbef1d23e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:51.180990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54ccce1-8303-45d6-9b6c-e03cbef1d23e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:51.192932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54ccce1-8303-45d6-9b6c-e03cbef1d23e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:51.210608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54ccce1-8303-45d6-9b6c-e03cbef1d23e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:51.211797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54ccce1-8303-45d6-9b6c-e03cbef1d23e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:51.212635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54ccce1-8303-45d6-9b6c-e03cbef1d23e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:52.130429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] validate_networks() for [('9b22187c-a932-4523-93ee-b42529a54c2c', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:37:52.193259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a54ccce1-8303-45d6-9b6c-e03cbef1d23e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:52.271795 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a54ccce1-8303-45d6-9b6c-e03cbef1d23e tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 1.189019 Aug 09 17:37:52.298768 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2528/4810] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:51 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:37:53.330970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ecd9345c-55e2-4da3-8ae3-c0332c180901 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:53.338341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ecd9345c-55e2-4da3-8ae3-c0332c180901 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:53.363996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecd9345c-55e2-4da3-8ae3-c0332c180901 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:53.376588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecd9345c-55e2-4da3-8ae3-c0332c180901 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:53.377408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecd9345c-55e2-4da3-8ae3-c0332c180901 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:53.379456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecd9345c-55e2-4da3-8ae3-c0332c180901 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:53.380523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecd9345c-55e2-4da3-8ae3-c0332c180901 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:53.381491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecd9345c-55e2-4da3-8ae3-c0332c180901 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:53.857564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:37:53.858061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:37:53.858509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:37:53.858881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:37:53.859300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:37:53.877715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:53.878210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:53.878659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:53.880017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:53.880518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:53.881156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:53.902948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Getting quotas for project 39ce4b0e2bf84d778a3cf81d91868f0d. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:37:53.909460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Getting quotas for user e5530d014d1a44119b8f0c5fa9e76b3a and project 39ce4b0e2bf84d778a3cf81d91868f0d. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:37:53.932738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:37:53.936089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:37:53.995876 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fa43e343-60b8-42f3-ad2d-d3e7d0742955 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.965709 Aug 09 17:37:53.997808 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2283/4811] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:37:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2969 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:37:54.011003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3650c0c2-ab13-4064-93ce-baa465d86f0e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:54.012206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3650c0c2-ab13-4064-93ce-baa465d86f0e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:54.106736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3650c0c2-ab13-4064-93ce-baa465d86f0e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:54.116905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3650c0c2-ab13-4064-93ce-baa465d86f0e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:54.125929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3650c0c2-ab13-4064-93ce-baa465d86f0e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:54.128606 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3650c0c2-ab13-4064-93ce-baa465d86f0e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1280 microversion: 2.20 time: 0.121792 Aug 09 17:37:54.145582 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2284/4812] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:37:54 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1280 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:37:54.295096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ecd9345c-55e2-4da3-8ae3-c0332c180901 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:54.312394 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ecd9345c-55e2-4da3-8ae3-c0332c180901 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 0.990226 Aug 09 17:37:54.335427 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2529/4813] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:53 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:37:55.154597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:55.155214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:55.170829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:55.171343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:55.171846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:55.172582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:55.173051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:55.173489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:55.342404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3833e41a-9239-4832-b460-ff899adaad9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:55.344037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3833e41a-9239-4832-b460-ff899adaad9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:55.383149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:55.392534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:55.396129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:55.397598 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5826616f-eb49-4199-889c-430d559c654e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1284 microversion: 2.20 time: 0.247203 Aug 09 17:37:55.398384 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2285/4814] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:37:55 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:37:55.410611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3833e41a-9239-4832-b460-ff899adaad9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:55.411523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3833e41a-9239-4832-b460-ff899adaad9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:55.412292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3833e41a-9239-4832-b460-ff899adaad9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:55.413677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3833e41a-9239-4832-b460-ff899adaad9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:55.414518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3833e41a-9239-4832-b460-ff899adaad9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:55.426775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3833e41a-9239-4832-b460-ff899adaad9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:55.985076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3833e41a-9239-4832-b460-ff899adaad9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:55.985076 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3833e41a-9239-4832-b460-ff899adaad9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1509 microversion: 2.1 time: 0.638861 Aug 09 17:37:55.985076 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2530/4815] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:55 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1509 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:37:56.425447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:56.426884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:56.438093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:56.439605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:56.443944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:56.444726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:56.445215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:56.445655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:56.579437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:56.595352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:56.597103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:56.606040 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-939d61a3-fcb8-495f-8e1a-47460f1d5c85 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1350 microversion: 2.20 time: 0.179683 Aug 09 17:37:56.606040 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2286/4816] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:37:56 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1350 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:37:57.011371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c5d3f118-bd62-41c2-980c-f0d0ac0aebbc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:57.013687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c5d3f118-bd62-41c2-980c-f0d0ac0aebbc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:57.041282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5d3f118-bd62-41c2-980c-f0d0ac0aebbc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:57.050157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5d3f118-bd62-41c2-980c-f0d0ac0aebbc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:57.051525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5d3f118-bd62-41c2-980c-f0d0ac0aebbc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:57.053016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5d3f118-bd62-41c2-980c-f0d0ac0aebbc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:57.053797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5d3f118-bd62-41c2-980c-f0d0ac0aebbc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:57.054748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5d3f118-bd62-41c2-980c-f0d0ac0aebbc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:57.627864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:57.629746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:57.639056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:57.639870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:57.640580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:57.641638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:57.642418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:57.643081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:57.766734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:57.790879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:57.794279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:57.796115 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-698e4d6c-72a1-4481-aa13-d9beb4b379c0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1338 microversion: 2.20 time: 0.172207 Aug 09 17:37:57.809801 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2287/4817] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:37:57 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1338 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:37:58.779339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c5d3f118-bd62-41c2-980c-f0d0ac0aebbc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:58.792246 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c5d3f118-bd62-41c2-980c-f0d0ac0aebbc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1506 microversion: 2.1 time: 1.788359 Aug 09 17:37:58.793241 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2531/4818] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:57 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1506 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:37:58.829972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:58.839336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:58.860021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:58.862194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:58.863998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:58.866618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:58.868014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:58.869744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:59.068206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:59.106188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:59.121267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:37:59.130357 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-00d1dd10-a1ce-4576-980b-56b34945ff64 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1338 microversion: 2.20 time: 0.306155 Aug 09 17:37:59.131597 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2288/4819] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:37:58 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1338 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:37:59.822790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6842039f-664a-47c0-9478-64744aecc943 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:37:59.823415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6842039f-664a-47c0-9478-64744aecc943 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:37:59.835347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6842039f-664a-47c0-9478-64744aecc943 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:59.835911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6842039f-664a-47c0-9478-64744aecc943 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:59.836364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6842039f-664a-47c0-9478-64744aecc943 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:37:59.837114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6842039f-664a-47c0-9478-64744aecc943 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:37:59.840099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6842039f-664a-47c0-9478-64744aecc943 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:37:59.840656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6842039f-664a-47c0-9478-64744aecc943 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:00.167791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:00.176841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:00.216107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:00.219195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:00.219924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:00.223570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:00.224463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:00.230055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:00.445463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:00.456696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:00.469927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:00.471767 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-819fa6b6-0180-4900-b2f8-22445f0dd949 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1338 microversion: 2.20 time: 0.318742 Aug 09 17:38:00.488740 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2289/4820] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:00 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1338 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:01.035615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6842039f-664a-47c0-9478-64744aecc943 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:01.046645 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6842039f-664a-47c0-9478-64744aecc943 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1506 microversion: 2.1 time: 1.227907 Aug 09 17:38:01.048025 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2532/4821] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:37:59 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1506 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:01.499073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:01.501309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:01.515383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:01.519912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:01.520591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:01.521727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:01.522401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:01.522951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:01.652268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:01.667600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:01.670178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:01.676370 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5bb22e1b-d4b4-4570-aa66-7a493b1249ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1338 microversion: 2.20 time: 0.176809 Aug 09 17:38:01.677236 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2290/4822] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:01 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1338 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:02.001385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-97763045-a320-4d0a-84bd-7848a09f12cf req-9175c56e-aaf5-4c39-996b-1ae15ec7bddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c299fda1-8657-46b4-ab0a-3592f096c1b3", "name": "network-vif-unplugged", "status": "completed", "tag": "57024231-91a0-48b5-9317-3a85be55d7a1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:02.027654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97763045-a320-4d0a-84bd-7848a09f12cf req-9175c56e-aaf5-4c39-996b-1ae15ec7bddc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:02.030571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97763045-a320-4d0a-84bd-7848a09f12cf req-9175c56e-aaf5-4c39-996b-1ae15ec7bddc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:02.031584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97763045-a320-4d0a-84bd-7848a09f12cf req-9175c56e-aaf5-4c39-996b-1ae15ec7bddc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:02.054860 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-97763045-a320-4d0a-84bd-7848a09f12cf req-9175c56e-aaf5-4c39-996b-1ae15ec7bddc service nova] Creating event network-vif-unplugged:57024231-91a0-48b5-9317-3a85be55d7a1 for instance c299fda1-8657-46b4-ab0a-3592f096c1b3 on n-h1-845781-6 Aug 09 17:38:02.070065 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-97763045-a320-4d0a-84bd-7848a09f12cf req-9175c56e-aaf5-4c39-996b-1ae15ec7bddc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078530 Aug 09 17:38:02.071596 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2533/4823] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:02.095775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-176cd510-a857-4570-b04e-203255eb6a83 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:02.096414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-176cd510-a857-4570-b04e-203255eb6a83 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:02.103333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-176cd510-a857-4570-b04e-203255eb6a83 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:02.103879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-176cd510-a857-4570-b04e-203255eb6a83 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:02.104526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-176cd510-a857-4570-b04e-203255eb6a83 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:02.105480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-176cd510-a857-4570-b04e-203255eb6a83 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:02.106300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-176cd510-a857-4570-b04e-203255eb6a83 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:02.106916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-176cd510-a857-4570-b04e-203255eb6a83 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:02.403957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-176cd510-a857-4570-b04e-203255eb6a83 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:02.417819 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-176cd510-a857-4570-b04e-203255eb6a83 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1506 microversion: 2.1 time: 0.326600 Aug 09 17:38:02.421999 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2291/4824] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:02 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:02.702043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:02.702899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:02.717636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:02.724198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:02.725094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:02.726558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:02.727310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:02.728024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:03.459264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-da3d29b2-cb99-44c5-bb5e-065e1799b118 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:03.460659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-da3d29b2-cb99-44c5-bb5e-065e1799b118 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:03.468648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da3d29b2-cb99-44c5-bb5e-065e1799b118 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:03.469452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da3d29b2-cb99-44c5-bb5e-065e1799b118 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:03.470317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da3d29b2-cb99-44c5-bb5e-065e1799b118 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:03.471306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da3d29b2-cb99-44c5-bb5e-065e1799b118 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:03.472052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da3d29b2-cb99-44c5-bb5e-065e1799b118 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:03.473318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-da3d29b2-cb99-44c5-bb5e-065e1799b118 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:03.630702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:03.653294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:03.658449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:03.660381 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-de36f261-a6ec-4d7a-8ca0-658767ac8dc7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1406 microversion: 2.20 time: 0.963255 Aug 09 17:38:03.661771 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2534/4825] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:02 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1406 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:38:03.895582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:04.115910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:04.709106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:04.719343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:04.744934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:04.747345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:04.749004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:04.750774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-da3d29b2-cb99-44c5-bb5e-065e1799b118 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:04.751996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:04.753217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:04.754387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:04.784092 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-da3d29b2-cb99-44c5-bb5e-065e1799b118 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1506 microversion: 2.1 time: 1.329033 Aug 09 17:38:04.805227 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2292/4826] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:03 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1506 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:05.830172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5ccd30d9-4bdf-4a9e-8bb0-94b5df78d0fc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:05.830939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5ccd30d9-4bdf-4a9e-8bb0-94b5df78d0fc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:05.859347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd30d9-4bdf-4a9e-8bb0-94b5df78d0fc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:05.861775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd30d9-4bdf-4a9e-8bb0-94b5df78d0fc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:05.862925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd30d9-4bdf-4a9e-8bb0-94b5df78d0fc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:05.868459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd30d9-4bdf-4a9e-8bb0-94b5df78d0fc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:05.868970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd30d9-4bdf-4a9e-8bb0-94b5df78d0fc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:05.869641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd30d9-4bdf-4a9e-8bb0-94b5df78d0fc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:06.300340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:06.316593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:06.323046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:06.324709 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2801613a-37b5-4742-8220-e6f6977dff13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1406 microversion: 2.20 time: 1.638494 Aug 09 17:38:06.326035 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2535/4827] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:04 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1406 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:06.538157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5ccd30d9-4bdf-4a9e-8bb0-94b5df78d0fc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:06.547056 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5ccd30d9-4bdf-4a9e-8bb0-94b5df78d0fc tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 200 len: 1449 microversion: 2.1 time: 0.721949 Aug 09 17:38:06.547749 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2293/4828] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:05 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 1449 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:38:06.579163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-749457ae-1d1c-494e-ba20-ea17bdbe8cf7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:06.586627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-749457ae-1d1c-494e-ba20-ea17bdbe8cf7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:06.616853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-749457ae-1d1c-494e-ba20-ea17bdbe8cf7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:06.617941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-749457ae-1d1c-494e-ba20-ea17bdbe8cf7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:06.619423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-749457ae-1d1c-494e-ba20-ea17bdbe8cf7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:06.621326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-749457ae-1d1c-494e-ba20-ea17bdbe8cf7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:06.622822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-749457ae-1d1c-494e-ba20-ea17bdbe8cf7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:06.624343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-749457ae-1d1c-494e-ba20-ea17bdbe8cf7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:07.356421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:07.358046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:07.369059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:07.370960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:07.371807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:07.373900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:07.375831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:07.376757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:07.481857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-749457ae-1d1c-494e-ba20-ea17bdbe8cf7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:07.540423 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-749457ae-1d1c-494e-ba20-ea17bdbe8cf7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.973657 Aug 09 17:38:07.549005 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2536/4829] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:06 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:07.597070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6c30967-41a1-4ec7-88ad-611dab4e67c8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:07.600061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f6c30967-41a1-4ec7-88ad-611dab4e67c8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:07.610185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c30967-41a1-4ec7-88ad-611dab4e67c8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:07.611754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c30967-41a1-4ec7-88ad-611dab4e67c8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:07.614400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c30967-41a1-4ec7-88ad-611dab4e67c8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:07.616680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c30967-41a1-4ec7-88ad-611dab4e67c8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:07.617458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c30967-41a1-4ec7-88ad-611dab4e67c8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:07.618125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6c30967-41a1-4ec7-88ad-611dab4e67c8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:07.849001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:07.895513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:07.903483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:07.922786 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e640a59c-7265-45ea-b02c-ddb692c5ac3d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1406 microversion: 2.20 time: 0.561969 Aug 09 17:38:07.926678 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2294/4830] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:07 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1406 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:08.751680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bd733445-3962-4214-94ff-ef84b1e77aec tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:08.753639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bd733445-3962-4214-94ff-ef84b1e77aec tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:08.774044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd733445-3962-4214-94ff-ef84b1e77aec tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:08.774748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd733445-3962-4214-94ff-ef84b1e77aec tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:08.775330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f6c30967-41a1-4ec7-88ad-611dab4e67c8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:08.775872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd733445-3962-4214-94ff-ef84b1e77aec tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:08.776669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd733445-3962-4214-94ff-ef84b1e77aec tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:08.787838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd733445-3962-4214-94ff-ef84b1e77aec tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:08.788145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd733445-3962-4214-94ff-ef84b1e77aec tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:08.793237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=78 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:08.805522 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f6c30967-41a1-4ec7-88ad-611dab4e67c8 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.224090 Aug 09 17:38:08.806506 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2537/4831] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:07 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:08.834713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a58e6dd6-a786-45a8-a85a-c4b60100e062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:08.836362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a58e6dd6-a786-45a8-a85a-c4b60100e062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:08.849029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a58e6dd6-a786-45a8-a85a-c4b60100e062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:08.849986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a58e6dd6-a786-45a8-a85a-c4b60100e062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:08.851076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a58e6dd6-a786-45a8-a85a-c4b60100e062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:08.854654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a58e6dd6-a786-45a8-a85a-c4b60100e062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:08.855903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a58e6dd6-a786-45a8-a85a-c4b60100e062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:08.857299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a58e6dd6-a786-45a8-a85a-c4b60100e062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:08.917168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bd733445-3962-4214-94ff-ef84b1e77aec tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:38:09.163222 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bd733445-3962-4214-94ff-ef84b1e77aec tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 204 len: 0 microversion: 2.32 time: 0.415858 Aug 09 17:38:09.167541 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2295/4832] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:38:08 2022] DELETE /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:38:09.174048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:09.174886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:09.182876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:09.183496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:09.184100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:09.184958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:09.185540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:09.186166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:09.434323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:09.456740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:09.461760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:09.464129 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a2492237-2c82-499a-8190-90b9d8a94650 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1406 microversion: 2.20 time: 0.294629 Aug 09 17:38:09.465327 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2296/4833] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:09 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:09.475321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d838d283-12fe-4a81-95d0-df06bef42ffc req-a370d58f-0fa2-4de4-9f84-92032a20c3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8deacdae-0205-41a6-b164-640022f2eef4", "tag": "a322ddf6-871d-4af1-8243-03824c9855a1"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:09.495351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d838d283-12fe-4a81-95d0-df06bef42ffc req-a370d58f-0fa2-4de4-9f84-92032a20c3d8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:09.497054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d838d283-12fe-4a81-95d0-df06bef42ffc req-a370d58f-0fa2-4de4-9f84-92032a20c3d8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:09.498423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d838d283-12fe-4a81-95d0-df06bef42ffc req-a370d58f-0fa2-4de4-9f84-92032a20c3d8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:09.525907 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d838d283-12fe-4a81-95d0-df06bef42ffc req-a370d58f-0fa2-4de4-9f84-92032a20c3d8 service nova] Creating event network-changed:a322ddf6-871d-4af1-8243-03824c9855a1 for instance 8deacdae-0205-41a6-b164-640022f2eef4 on n-h2-845781-6 Aug 09 17:38:09.536227 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d838d283-12fe-4a81-95d0-df06bef42ffc req-a370d58f-0fa2-4de4-9f84-92032a20c3d8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068643 Aug 09 17:38:09.538284 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2297/4834] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:09.548628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:09.550476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:09.564177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:09.566100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:09.568134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:09.569829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:09.571015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:09.572127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:09.621653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:10.008966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:10.021098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:10.024659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:10.027030 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-24c4bfd5-17ad-49b7-84d0-47f8ea996f37 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2958 microversion: 2.32 time: 0.486523 Aug 09 17:38:10.027653 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2298/4835] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:09 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2958 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:10.494472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:10.495307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:10.509515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:10.510947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:10.511809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:10.513180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:10.513907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:10.514803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:10.698448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a58e6dd6-a786-45a8-a85a-c4b60100e062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:10.730873 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a58e6dd6-a786-45a8-a85a-c4b60100e062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.901185 Aug 09 17:38:10.735074 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2538/4836] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:08 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:10.836619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:10.850299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:10.852624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:10.854360 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4c9283ac-2cb2-4e0e-a74d-ec3927038732 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1406 microversion: 2.20 time: 0.366410 Aug 09 17:38:10.855837 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2299/4837] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:10 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:10.863208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d2f5b524-c400-4eab-bef5-21ffa1224edf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:10.864895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d2f5b524-c400-4eab-bef5-21ffa1224edf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:10.874050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2f5b524-c400-4eab-bef5-21ffa1224edf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:10.874880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2f5b524-c400-4eab-bef5-21ffa1224edf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:10.875515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2f5b524-c400-4eab-bef5-21ffa1224edf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:10.877055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2f5b524-c400-4eab-bef5-21ffa1224edf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:10.878586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2f5b524-c400-4eab-bef5-21ffa1224edf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:10.879618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2f5b524-c400-4eab-bef5-21ffa1224edf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:11.067541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d2f5b524-c400-4eab-bef5-21ffa1224edf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:11.081134 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d2f5b524-c400-4eab-bef5-21ffa1224edf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.222952 Aug 09 17:38:11.101345 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2300/4838] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:10 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:11.104826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9ccec7c9-fa4d-4759-b832-927950d6ee66 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-371489579", "availability_zone": "foo_zone"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:11.108773 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:38:11.108773 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:38:11.110357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.aggregate [None req-9ccec7c9-fa4d-4759-b832-927950d6ee66 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Generated uuid 954d2b48-1b31-443c-aeae-9b4770307257 for aggregate {{(pid=119431) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 17:38:11.115001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:11.115819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:11.123667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:11.125149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:11.125818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:11.126782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:11.127429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:11.128085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:11.153955 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9ccec7c9-fa4d-4759-b832-927950d6ee66 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.414006 Aug 09 17:38:11.175977 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2539/4839] 10.222.0.93 () {60 vars in 1164 bytes} [Tue Aug 9 17:38:10 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:11.185696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b9dab7a8-c552-4cb2-8b15-816d4783e953 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:11.199533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9dab7a8-c552-4cb2-8b15-816d4783e953 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:11.200972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9dab7a8-c552-4cb2-8b15-816d4783e953 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:11.201936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9dab7a8-c552-4cb2-8b15-816d4783e953 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:11.239984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b9dab7a8-c552-4cb2-8b15-816d4783e953 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Going to try to stop instance {{(pid=119431) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 17:38:11.331493 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b9dab7a8-c552-4cb2-8b15-816d4783e953 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.151293 Aug 09 17:38:11.346811 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2540/4840] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:38:11 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:38:11.372749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-da5bd06f-079a-47f9-8952-14405d69e367 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:11.377537 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:38:11.377537 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:38:11.466079 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-da5bd06f-079a-47f9-8952-14405d69e367 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.106666 Aug 09 17:38:11.467177 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2541/4841] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:38:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:11.482280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b964574c-10b2-431c-8c29-ad38b888c3a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:11.489393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b964574c-10b2-431c-8c29-ad38b888c3a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:11.517556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b964574c-10b2-431c-8c29-ad38b888c3a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:11.519444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b964574c-10b2-431c-8c29-ad38b888c3a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:11.522125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b964574c-10b2-431c-8c29-ad38b888c3a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:11.526141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b964574c-10b2-431c-8c29-ad38b888c3a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:11.527903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b964574c-10b2-431c-8c29-ad38b888c3a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:11.529897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b964574c-10b2-431c-8c29-ad38b888c3a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:12.257812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b964574c-10b2-431c-8c29-ad38b888c3a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:12.282694 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b964574c-10b2-431c-8c29-ad38b888c3a9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1679 microversion: 2.1 time: 0.806336 Aug 09 17:38:12.283364 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2542/4842] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:11 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1679 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:12.291780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69aff81b-c9ea-4c89-b9f3-d3ab3e9fd3a9 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:12.295245 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:38:12.295245 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:38:12.306996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69aff81b-c9ea-4c89-b9f3-d3ab3e9fd3a9 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:12.307574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69aff81b-c9ea-4c89-b9f3-d3ab3e9fd3a9 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:12.308278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69aff81b-c9ea-4c89-b9f3-d3ab3e9fd3a9 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:12.309139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69aff81b-c9ea-4c89-b9f3-d3ab3e9fd3a9 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:12.309675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69aff81b-c9ea-4c89-b9f3-d3ab3e9fd3a9 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:12.310661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69aff81b-c9ea-4c89-b9f3-d3ab3e9fd3a9 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:12.376967 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69aff81b-c9ea-4c89-b9f3-d3ab3e9fd3a9 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.092196 Aug 09 17:38:12.377718 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2543/4843] 10.222.0.93 () {58 vars in 1176 bytes} [Tue Aug 9 17:38:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:12.383366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:12.392627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:12.406416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:12.411426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:12.412250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:12.413269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:12.413971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:12.414649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:12.803177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:12.819491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:12.822439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:12.830207 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aab43284-b22d-42bc-a070-6c95a5db6795 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1406 microversion: 2.20 time: 0.448197 Aug 09 17:38:12.831828 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2544/4844] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:12 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1406 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:12.843854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-378066fc-55eb-4026-b39f-0f00199b30d1 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:12.847576 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:38:12.847576 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:38:12.871237 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-378066fc-55eb-4026-b39f-0f00199b30d1 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.037443 Aug 09 17:38:12.875154 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2545/4845] 10.222.0.93 () {58 vars in 1143 bytes} [Tue Aug 9 17:38:12 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:12.899460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07ca58f7-fa0d-46c2-af1f-247d135e4c3f tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-845781-6"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:12.902380 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:38:12.902380 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:38:12.921330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ca58f7-fa0d-46c2-af1f-247d135e4c3f tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:12.921837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ca58f7-fa0d-46c2-af1f-247d135e4c3f tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:12.922279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ca58f7-fa0d-46c2-af1f-247d135e4c3f tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:13.535049 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07ca58f7-fa0d-46c2-af1f-247d135e4c3f tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.641320 Aug 09 17:38:13.539218 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2546/4846] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:38:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:38:13.545883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-35b9656d-3cad-4a93-ac72-7716403d8d58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:13.553175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-35b9656d-3cad-4a93-ac72-7716403d8d58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:13.569045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b9656d-3cad-4a93-ac72-7716403d8d58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:13.572048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b9656d-3cad-4a93-ac72-7716403d8d58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:13.573810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b9656d-3cad-4a93-ac72-7716403d8d58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:13.574591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b9656d-3cad-4a93-ac72-7716403d8d58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:13.575063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b9656d-3cad-4a93-ac72-7716403d8d58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:13.575687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b9656d-3cad-4a93-ac72-7716403d8d58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:13.985703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:14.033688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:14.054318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:14.068677 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-32136322-4833-4023-90c0-a97fd80b873f tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2958 microversion: 2.32 time: 2.964803 Aug 09 17:38:14.080754 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2301/4847] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:11 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2958 bytes in 2978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:14.111427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2137380e-892b-49c4-adfd-07d34ae609a5 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:14.113632 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:38:14.113632 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:38:14.131106 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2137380e-892b-49c4-adfd-07d34ae609a5 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.047360 Aug 09 17:38:14.132647 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2302/4848] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:38:14 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:14.181650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:14.183161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:14.216801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:14.218313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:14.219575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:14.221872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:14.224149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:14.225279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:15.163399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-35b9656d-3cad-4a93-ac72-7716403d8d58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:15.173660 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-35b9656d-3cad-4a93-ac72-7716403d8d58 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1683 microversion: 2.1 time: 1.632919 Aug 09 17:38:15.174277 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2547/4849] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:13 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1683 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:15.210776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-519ded6d-e055-4da1-a9e2-79d1371c8b13 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-809432052", "availability_zone": "foo_zone"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:15.539752 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:38:15.539752 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 17:38:15.666609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:15.678889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:15.683236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:15.687275 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ab85e11a-4cf0-4709-851d-a8bf17b272c1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1410 microversion: 2.20 time: 1.531262 Aug 09 17:38:15.703879 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-519ded6d-e055-4da1-a9e2-79d1371c8b13 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.502272 Aug 09 17:38:15.714203 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2303/4850] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:14 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1410 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:15.716326 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2548/4851] 10.222.0.93 () {60 vars in 1173 bytes} [Tue Aug 9 17:38:15 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:15.722469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a2e96fe9-381e-4990-bd79-9cffb24ce63f req-d02c9725-c21b-40f6-a7fd-48dabb6ec15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-unplugged", "status": "completed", "tag": "4f7a2502-f30f-4735-9904-fbf8a52eb998"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:15.726012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:15.727582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:15.745780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:15.755313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:15.757337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:15.762378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:15.764868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:15.768090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:15.772987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a2e96fe9-381e-4990-bd79-9cffb24ce63f req-d02c9725-c21b-40f6-a7fd-48dabb6ec15b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:15.774313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a2e96fe9-381e-4990-bd79-9cffb24ce63f req-d02c9725-c21b-40f6-a7fd-48dabb6ec15b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:15.775479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a2e96fe9-381e-4990-bd79-9cffb24ce63f req-d02c9725-c21b-40f6-a7fd-48dabb6ec15b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:15.853288 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a2e96fe9-381e-4990-bd79-9cffb24ce63f req-d02c9725-c21b-40f6-a7fd-48dabb6ec15b service nova] Creating event network-vif-unplugged:4f7a2502-f30f-4735-9904-fbf8a52eb998 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:38:15.885875 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a2e96fe9-381e-4990-bd79-9cffb24ce63f req-d02c9725-c21b-40f6-a7fd-48dabb6ec15b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161946 Aug 09 17:38:15.887352 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2304/4852] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:15.905019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9c503f34-3dbb-4981-a7fa-efb2eef104b0 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:15.921256 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:38:15.921256 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:38:16.078584 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9c503f34-3dbb-4981-a7fa-efb2eef104b0 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.189003 Aug 09 17:38:16.102378 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2305/4853] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:38:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:16.134924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-883c4d88-d446-4687-857d-eb429304e4b5 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:16.138907 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:38:16.138907 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:38:16.168186 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-883c4d88-d446-4687-857d-eb429304e4b5 tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.050426 Aug 09 17:38:16.173091 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2306/4854] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:38:16 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:16.198353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dd494ebd-4599-4acd-a42f-95ba22b1053e tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-845781-6"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:16.202345 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:38:16.202345 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:38:16.229122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd494ebd-4599-4acd-a42f-95ba22b1053e tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:16.232867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd494ebd-4599-4acd-a42f-95ba22b1053e tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:16.232867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dd494ebd-4599-4acd-a42f-95ba22b1053e tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:16.751200 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dd494ebd-4599-4acd-a42f-95ba22b1053e tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.562267 Aug 09 17:38:16.756031 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2307/4855] 10.222.0.93 () {60 vars in 1194 bytes} [Tue Aug 9 17:38:16 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:16.771803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a97dd9a-581c-4b38-8541-0d6e1e6d80eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:16.773214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3a97dd9a-581c-4b38-8541-0d6e1e6d80eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:16.789837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a97dd9a-581c-4b38-8541-0d6e1e6d80eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:16.792531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a97dd9a-581c-4b38-8541-0d6e1e6d80eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:16.793618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a97dd9a-581c-4b38-8541-0d6e1e6d80eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:16.802878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a97dd9a-581c-4b38-8541-0d6e1e6d80eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:16.803563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a97dd9a-581c-4b38-8541-0d6e1e6d80eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:16.804162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a97dd9a-581c-4b38-8541-0d6e1e6d80eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:17.131860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:17.154502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:17.157412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:17.163264 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb023dfc-ffc9-4cae-8e1c-634298d036ef tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2962 microversion: 2.32 time: 1.445026 Aug 09 17:38:17.165890 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2549/4856] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:15 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2962 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:17.173676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:17.181395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:17.192037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:17.192980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:17.193651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:17.194697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:17.195415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:17.196105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:17.864902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3a97dd9a-581c-4b38-8541-0d6e1e6d80eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:17.877067 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3a97dd9a-581c-4b38-8541-0d6e1e6d80eb tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1679 microversion: 2.1 time: 1.119285 Aug 09 17:38:17.877697 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2308/4857] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:16 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1679 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:17.889930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9622b463-0b1d-46c0-94fe-635b116e26af tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:17.892880 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:38:17.892880 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:38:17.943346 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9622b463-0b1d-46c0-94fe-635b116e26af tempest-TestAggregatesBasicOps-1932365879 tempest-TestAggregatesBasicOps-1932365879-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.063910 Aug 09 17:38:17.944005 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2309/4858] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:38:17 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 17:38:17.998624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-70b47220-0d7e-4743-9824-9f6106190140 req-f0ed965e-8e00-4fb6-958c-ea6628c40475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-unplugged", "status": "completed", "tag": "1f1ce345-17a7-4206-910b-0ef883357278"}, {"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-unplugged", "status": "completed", "tag": "a3fc9a19-60ae-4faa-aa63-64fdb0f45a85"}, {"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-unplugged", "status": "completed", "tag": "b31588f9-5215-4525-a306-7739e48dfd07"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:18.016375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-70b47220-0d7e-4743-9824-9f6106190140 req-f0ed965e-8e00-4fb6-958c-ea6628c40475 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:18.017215 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-70b47220-0d7e-4743-9824-9f6106190140 req-f0ed965e-8e00-4fb6-958c-ea6628c40475 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:18.017823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-70b47220-0d7e-4743-9824-9f6106190140 req-f0ed965e-8e00-4fb6-958c-ea6628c40475 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:18.031566 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-70b47220-0d7e-4743-9824-9f6106190140 req-f0ed965e-8e00-4fb6-958c-ea6628c40475 service nova] Creating event network-vif-unplugged:1f1ce345-17a7-4206-910b-0ef883357278 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:38:18.032433 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-70b47220-0d7e-4743-9824-9f6106190140 req-f0ed965e-8e00-4fb6-958c-ea6628c40475 service nova] Creating event network-vif-unplugged:a3fc9a19-60ae-4faa-aa63-64fdb0f45a85 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:38:18.033236 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-70b47220-0d7e-4743-9824-9f6106190140 req-f0ed965e-8e00-4fb6-958c-ea6628c40475 service nova] Creating event network-vif-unplugged:b31588f9-5215-4525-a306-7739e48dfd07 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:38:18.052943 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-70b47220-0d7e-4743-9824-9f6106190140 req-f0ed965e-8e00-4fb6-958c-ea6628c40475 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.050497 Aug 09 17:38:18.052943 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2310/4859] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:18.150432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:18.172828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:18.176950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:18.186867 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2b4ccb18-1a16-4937-a485-38272520c3ca tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1406 microversion: 2.20 time: 1.012330 Aug 09 17:38:18.188098 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2550/4860] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:17 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1406 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:18.232553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:18.234133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:18.249376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:18.250647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:18.251925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:18.253525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:18.254711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:18.255794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:18.919550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a032f93d-65a0-4a81-9539-36d528d407d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:18.920631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a032f93d-65a0-4a81-9539-36d528d407d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:18.929792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a032f93d-65a0-4a81-9539-36d528d407d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:18.930660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a032f93d-65a0-4a81-9539-36d528d407d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:18.931322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a032f93d-65a0-4a81-9539-36d528d407d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:18.932343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a032f93d-65a0-4a81-9539-36d528d407d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:18.933050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a032f93d-65a0-4a81-9539-36d528d407d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:18.933700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a032f93d-65a0-4a81-9539-36d528d407d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:19.473288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a032f93d-65a0-4a81-9539-36d528d407d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:19.531111 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a032f93d-65a0-4a81-9539-36d528d407d7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1679 microversion: 2.1 time: 0.613955 Aug 09 17:38:19.532363 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2551/4861] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:18 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1679 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:38:19.593621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:19.605697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:19.664405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:19.672564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:19.673601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:19.683153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:19.695810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:19.696561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:20.983222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:21.018682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:21.037115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:21.043667 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b5b851eb-4954-4fae-9f6b-975a46f77fcd tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2937 microversion: 2.32 time: 2.831161 Aug 09 17:38:21.048978 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2311/4862] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:18 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2937 bytes in 2838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:21.065842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-de35bfab-2edd-497b-a44b-df0813050a76 req-4ccf047b-40fe-435d-a7ef-8bed71bba98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-unplugged", "status": "completed", "tag": "cf24c4a2-69bb-44f3-8087-c67d8fe70264"}, {"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-unplugged", "status": "completed", "tag": "816e38ad-dd4a-4517-9175-b3b52a3f92ce"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:21.110473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-de35bfab-2edd-497b-a44b-df0813050a76 req-4ccf047b-40fe-435d-a7ef-8bed71bba98b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:21.117930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-de35bfab-2edd-497b-a44b-df0813050a76 req-4ccf047b-40fe-435d-a7ef-8bed71bba98b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:21.118626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-de35bfab-2edd-497b-a44b-df0813050a76 req-4ccf047b-40fe-435d-a7ef-8bed71bba98b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:21.151462 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-de35bfab-2edd-497b-a44b-df0813050a76 req-4ccf047b-40fe-435d-a7ef-8bed71bba98b service nova] Creating event network-vif-unplugged:cf24c4a2-69bb-44f3-8087-c67d8fe70264 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:38:21.152306 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-de35bfab-2edd-497b-a44b-df0813050a76 req-4ccf047b-40fe-435d-a7ef-8bed71bba98b service nova] Creating event network-vif-unplugged:816e38ad-dd4a-4517-9175-b3b52a3f92ce for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:38:21.165820 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-de35bfab-2edd-497b-a44b-df0813050a76 req-4ccf047b-40fe-435d-a7ef-8bed71bba98b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.115143 Aug 09 17:38:21.166585 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2312/4863] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:21.183104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f0b18766-7cd6-4310-98d4-d5e2ce399e20 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:21.183438 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f0b18766-7cd6-4310-98d4-d5e2ce399e20 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:21.192502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:21.206149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0b18766-7cd6-4310-98d4-d5e2ce399e20 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:21.208050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0b18766-7cd6-4310-98d4-d5e2ce399e20 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:21.213505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0b18766-7cd6-4310-98d4-d5e2ce399e20 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:21.215041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0b18766-7cd6-4310-98d4-d5e2ce399e20 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:21.218440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0b18766-7cd6-4310-98d4-d5e2ce399e20 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:21.219342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0b18766-7cd6-4310-98d4-d5e2ce399e20 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:21.799309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:21.880162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:21.892392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:21.896412 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4345458b-9eb0-4467-9325-8fa47d6bcdc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1406 microversion: 2.20 time: 2.327188 Aug 09 17:38:21.906502 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2552/4864] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:19 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1406 bytes in 2373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:22.095126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:22.096850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:22.122893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:22.126939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:22.140657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:22.141480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:22.145290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:22.145290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:22.148090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:22.218765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f0b18766-7cd6-4310-98d4-d5e2ce399e20 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:22.236451 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f0b18766-7cd6-4310-98d4-d5e2ce399e20 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1679 microversion: 2.1 time: 1.063246 Aug 09 17:38:22.253873 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2313/4865] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:21 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1679 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:22.316217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:22.655328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:22.671794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:22.673810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:22.681616 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a8ea8574-7201-463d-9acf-a1d2186752af tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2916 microversion: 2.32 time: 0.597188 Aug 09 17:38:22.682800 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2553/4866] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:22 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2916 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:22.949113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:22.950223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:22.972173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:22.972827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:22.973434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:22.974278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:22.974835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:22.975365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:23.432520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:23.471468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:23.475238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:23.484153 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-39bbb1a9-ebd6-42a5-981b-e05f3d77a2c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1406 microversion: 2.20 time: 0.539352 Aug 09 17:38:23.519614 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2314/4867] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:22 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1406 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:23.530660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad051f88-176f-4bab-98c4-62b82bebfbc7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:23.544690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ad051f88-176f-4bab-98c4-62b82bebfbc7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:23.571817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad051f88-176f-4bab-98c4-62b82bebfbc7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:23.573136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad051f88-176f-4bab-98c4-62b82bebfbc7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:23.574272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad051f88-176f-4bab-98c4-62b82bebfbc7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:23.576039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad051f88-176f-4bab-98c4-62b82bebfbc7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:23.579602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad051f88-176f-4bab-98c4-62b82bebfbc7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:23.580686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad051f88-176f-4bab-98c4-62b82bebfbc7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:23.762004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2e36c11e-a15e-4b7c-865c-704b4cdba7c1 req-7880367f-1864-4a0d-a3e4-e4ff9fc3ad49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-deleted", "tag": "cf24c4a2-69bb-44f3-8087-c67d8fe70264"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:23.798919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2e36c11e-a15e-4b7c-865c-704b4cdba7c1 req-7880367f-1864-4a0d-a3e4-e4ff9fc3ad49 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:23.799801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2e36c11e-a15e-4b7c-865c-704b4cdba7c1 req-7880367f-1864-4a0d-a3e4-e4ff9fc3ad49 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:23.800616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2e36c11e-a15e-4b7c-865c-704b4cdba7c1 req-7880367f-1864-4a0d-a3e4-e4ff9fc3ad49 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:23.845283 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2e36c11e-a15e-4b7c-865c-704b4cdba7c1 req-7880367f-1864-4a0d-a3e4-e4ff9fc3ad49 service nova] Creating event network-vif-deleted:cf24c4a2-69bb-44f3-8087-c67d8fe70264 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:38:23.855912 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2e36c11e-a15e-4b7c-865c-704b4cdba7c1 req-7880367f-1864-4a0d-a3e4-e4ff9fc3ad49 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.768028 Aug 09 17:38:23.857821 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2554/4868] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:23.869871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d294293b-3f3f-48c9-898a-0ae3c0dcbb39 req-a03916d2-ffff-4c10-90e5-c4a997355dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deacdae-0205-41a6-b164-640022f2eef4", "name": "network-vif-plugged", "status": "completed", "tag": "a322ddf6-871d-4af1-8243-03824c9855a1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:23.896309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d294293b-3f3f-48c9-898a-0ae3c0dcbb39 req-a03916d2-ffff-4c10-90e5-c4a997355dda service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:23.898260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d294293b-3f3f-48c9-898a-0ae3c0dcbb39 req-a03916d2-ffff-4c10-90e5-c4a997355dda service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:23.899348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d294293b-3f3f-48c9-898a-0ae3c0dcbb39 req-a03916d2-ffff-4c10-90e5-c4a997355dda service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:23.950883 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d294293b-3f3f-48c9-898a-0ae3c0dcbb39 req-a03916d2-ffff-4c10-90e5-c4a997355dda service nova] Creating event network-vif-plugged:a322ddf6-871d-4af1-8243-03824c9855a1 for instance 8deacdae-0205-41a6-b164-640022f2eef4 on n-h2-845781-6 Aug 09 17:38:23.967142 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d294293b-3f3f-48c9-898a-0ae3c0dcbb39 req-a03916d2-ffff-4c10-90e5-c4a997355dda service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106254 Aug 09 17:38:24.007015 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2555/4869] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:24.050700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:24.058645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:24.101765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:24.106351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:24.107152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:24.111967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:24.113370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:24.115144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:24.261514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ad051f88-176f-4bab-98c4-62b82bebfbc7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:24.278958 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad051f88-176f-4bab-98c4-62b82bebfbc7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1656 microversion: 2.1 time: 0.756951 Aug 09 17:38:24.283246 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2315/4870] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:23 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1656 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:24.328584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dbeedfa3-0b66-49a5-8f75-dec21085fa3d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:24.346613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dbeedfa3-0b66-49a5-8f75-dec21085fa3d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:24.346886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dbeedfa3-0b66-49a5-8f75-dec21085fa3d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:24.347990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dbeedfa3-0b66-49a5-8f75-dec21085fa3d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:24.386382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dbeedfa3-0b66-49a5-8f75-dec21085fa3d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Going to try to start instance {{(pid=119432) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 17:38:24.480664 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dbeedfa3-0b66-49a5-8f75-dec21085fa3d tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.154566 Aug 09 17:38:24.483172 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2316/4871] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:38:24 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:38:24.498660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0b07fe10-7e59-45da-8aa8-432b55fd542c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:24.500203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0b07fe10-7e59-45da-8aa8-432b55fd542c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:24.512612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b07fe10-7e59-45da-8aa8-432b55fd542c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:24.513556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b07fe10-7e59-45da-8aa8-432b55fd542c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:24.514411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b07fe10-7e59-45da-8aa8-432b55fd542c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:24.515271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b07fe10-7e59-45da-8aa8-432b55fd542c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:24.515933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b07fe10-7e59-45da-8aa8-432b55fd542c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:24.516795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b07fe10-7e59-45da-8aa8-432b55fd542c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:24.526542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:24.570855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:24.586010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:24.586545 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-24f257ba-8bf6-4893-8ae4-ee808fab753a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2755 microversion: 2.32 time: 0.568017 Aug 09 17:38:24.587166 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2556/4872] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:24 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2755 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:24.615263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:24.616289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:24.624803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:24.625781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:24.627139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:24.628144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:24.628838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:24.630011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:25.292605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:25.303372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:25.318860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:25.320584 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99476259-94d3-4e04-8333-fe2a3968a9b0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1406 microversion: 2.20 time: 0.718561 Aug 09 17:38:25.323093 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2557/4873] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:24 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1406 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:25.498259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0b07fe10-7e59-45da-8aa8-432b55fd542c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:25.530767 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0b07fe10-7e59-45da-8aa8-432b55fd542c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1665 microversion: 2.1 time: 1.042896 Aug 09 17:38:25.531909 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2317/4874] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:24 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1665 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:25.632164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:25.635239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:25.655342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:25.659523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:25.662613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:25.674550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:25.678554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:25.679806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:26.352541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:26.358211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:26.387255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:26.388095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:26.389331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:26.390462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:26.391142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:26.391807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:26.791152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:26.806668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:26.824458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:26.826264 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-442ad1e4-2c02-4b15-a493-da57d48fe030 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2708 microversion: 2.32 time: 1.213681 Aug 09 17:38:26.837588 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2558/4875] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:25 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2708 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:26.851447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2546b072-a15b-4cd1-9bef-d24a6220f507 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:26.855717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2546b072-a15b-4cd1-9bef-d24a6220f507 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:26.890513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2546b072-a15b-4cd1-9bef-d24a6220f507 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:26.895712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2546b072-a15b-4cd1-9bef-d24a6220f507 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:26.896136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2546b072-a15b-4cd1-9bef-d24a6220f507 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:26.896917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2546b072-a15b-4cd1-9bef-d24a6220f507 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:26.897404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2546b072-a15b-4cd1-9bef-d24a6220f507 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:26.897846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2546b072-a15b-4cd1-9bef-d24a6220f507 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:28.009435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:28.060042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:28.097216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2546b072-a15b-4cd1-9bef-d24a6220f507 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:28.102141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:28.102436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:28.109694 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2546b072-a15b-4cd1-9bef-d24a6220f507 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1665 microversion: 2.1 time: 1.269982 Aug 09 17:38:28.110635 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2559/4876] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:26 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1665 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:28.111526 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-13564af0-57b1-4c3e-b0ae-ead674c7d959 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1406 microversion: 2.20 time: 1.765807 Aug 09 17:38:28.121414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:28.124254 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2318/4877] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:26 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1406 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:38:28.127300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:28.148638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:28.149601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:28.150267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:28.151585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:28.153333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:28.154146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:28.854133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:28.883072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:28.887396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:28.891798 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9be8440b-1e1d-4035-8625-b0065dd6c141 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2708 microversion: 2.32 time: 0.779346 Aug 09 17:38:28.893282 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2560/4878] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:28 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2708 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:29.054969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-06bff72d-9f16-4b38-900b-f9ad4cad2546 req-b395e5b7-6a1b-44e7-8f01-79247581c490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-deleted", "tag": "816e38ad-dd4a-4517-9175-b3b52a3f92ce"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:29.066476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-06bff72d-9f16-4b38-900b-f9ad4cad2546 req-b395e5b7-6a1b-44e7-8f01-79247581c490 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:29.067484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-06bff72d-9f16-4b38-900b-f9ad4cad2546 req-b395e5b7-6a1b-44e7-8f01-79247581c490 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:29.068229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-06bff72d-9f16-4b38-900b-f9ad4cad2546 req-b395e5b7-6a1b-44e7-8f01-79247581c490 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:29.083026 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-06bff72d-9f16-4b38-900b-f9ad4cad2546 req-b395e5b7-6a1b-44e7-8f01-79247581c490 service nova] Creating event network-vif-deleted:816e38ad-dd4a-4517-9175-b3b52a3f92ce for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:38:29.089488 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-06bff72d-9f16-4b38-900b-f9ad4cad2546 req-b395e5b7-6a1b-44e7-8f01-79247581c490 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038927 Aug 09 17:38:29.090768 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2319/4879] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:29.151763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51cb2514-59cc-4734-8b42-3567296d88c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:29.153117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-51cb2514-59cc-4734-8b42-3567296d88c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:29.162999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51cb2514-59cc-4734-8b42-3567296d88c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:29.164152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51cb2514-59cc-4734-8b42-3567296d88c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:29.164916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51cb2514-59cc-4734-8b42-3567296d88c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:29.165808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:29.166303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51cb2514-59cc-4734-8b42-3567296d88c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:29.166531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:29.167138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51cb2514-59cc-4734-8b42-3567296d88c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:29.168462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51cb2514-59cc-4734-8b42-3567296d88c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:29.179513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:29.180070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:29.180523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:29.181277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:29.181746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:29.182189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:29.407157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-51cb2514-59cc-4734-8b42-3567296d88c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:29.416289 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51cb2514-59cc-4734-8b42-3567296d88c3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.271268 Aug 09 17:38:29.417336 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2561/4880] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:29 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:38:29.439258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0240f020-d307-4ad8-869c-24f51bb99143 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:29.440096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0240f020-d307-4ad8-869c-24f51bb99143 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:29.446765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0240f020-d307-4ad8-869c-24f51bb99143 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:29.447601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0240f020-d307-4ad8-869c-24f51bb99143 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:29.448251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0240f020-d307-4ad8-869c-24f51bb99143 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:29.449590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0240f020-d307-4ad8-869c-24f51bb99143 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:29.450211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0240f020-d307-4ad8-869c-24f51bb99143 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:29.450765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0240f020-d307-4ad8-869c-24f51bb99143 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:30.174362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:30.203363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:30.208725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:30.215390 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c22c7794-5a1c-4a09-a53e-7676f811bc94 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1597 microversion: 2.20 time: 1.054956 Aug 09 17:38:30.216348 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2320/4881] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:29 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1597 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:30.227419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:30.232854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:30.246924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:30.248081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:30.248795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:30.250354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:30.251028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:30.253826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:30.270916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:30.278432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0240f020-d307-4ad8-869c-24f51bb99143 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:30.292629 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0240f020-d307-4ad8-869c-24f51bb99143 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.857967 Aug 09 17:38:30.295107 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2562/4882] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:29 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:38:30.319022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5488ad28-f5a3-4780-b09d-26652c7b90f8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:30.320908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5488ad28-f5a3-4780-b09d-26652c7b90f8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:30.346700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5488ad28-f5a3-4780-b09d-26652c7b90f8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:30.351807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5488ad28-f5a3-4780-b09d-26652c7b90f8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:30.352427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5488ad28-f5a3-4780-b09d-26652c7b90f8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:30.353309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5488ad28-f5a3-4780-b09d-26652c7b90f8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:30.357294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5488ad28-f5a3-4780-b09d-26652c7b90f8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:30.359760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5488ad28-f5a3-4780-b09d-26652c7b90f8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:30.741823 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5488ad28-f5a3-4780-b09d-26652c7b90f8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.444785 Aug 09 17:38:30.744317 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2563/4883] 10.222.0.93 () {60 vars in 1316 bytes} [Tue Aug 9 17:38:30 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-interface => generated 284 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:38:30.763182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9315ae32-cead-4e61-bafb-40ff90694c9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:30.774698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9315ae32-cead-4e61-bafb-40ff90694c9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:30.822071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9315ae32-cead-4e61-bafb-40ff90694c9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:30.823133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9315ae32-cead-4e61-bafb-40ff90694c9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:30.823703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9315ae32-cead-4e61-bafb-40ff90694c9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:30.824851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9315ae32-cead-4e61-bafb-40ff90694c9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:30.850183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9315ae32-cead-4e61-bafb-40ff90694c9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:30.857871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9315ae32-cead-4e61-bafb-40ff90694c9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:31.099713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:31.111834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:31.114817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:31.116592 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-52fcfb7a-84bd-49ee-a310-17958c256a3a tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2421 microversion: 2.32 time: 0.898764 Aug 09 17:38:31.117772 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2321/4884] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:30 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2421 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:31.681798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9315ae32-cead-4e61-bafb-40ff90694c9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:31.697043 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9315ae32-cead-4e61-bafb-40ff90694c9a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.950386 Aug 09 17:38:31.698662 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2564/4885] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:30 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:31.741029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-94a7cf88-fbf2-42d6-8e86-7581acd4e8b5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:31.743156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-94a7cf88-fbf2-42d6-8e86-7581acd4e8b5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:31.755383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94a7cf88-fbf2-42d6-8e86-7581acd4e8b5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:31.756676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94a7cf88-fbf2-42d6-8e86-7581acd4e8b5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:31.757786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94a7cf88-fbf2-42d6-8e86-7581acd4e8b5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:31.759399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94a7cf88-fbf2-42d6-8e86-7581acd4e8b5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:31.760951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94a7cf88-fbf2-42d6-8e86-7581acd4e8b5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:31.761992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94a7cf88-fbf2-42d6-8e86-7581acd4e8b5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:32.160121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:32.161454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:32.177820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:32.181224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:32.182158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:32.184774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:32.187683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:32.188558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:32.947831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:32.964985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:32.969640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:32.972235 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-075f93d5-8493-487e-82ea-bb63664565c7 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2374 microversion: 2.32 time: 0.816538 Aug 09 17:38:32.974001 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2565/4886] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:32 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2374 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:32.981101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-da9f475a-447a-421a-9dd5-e79f3a16bf95 req-47536aee-6800-43bd-bd0a-52a380329732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-deleted", "tag": "b31588f9-5215-4525-a306-7739e48dfd07"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:32.994553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-da9f475a-447a-421a-9dd5-e79f3a16bf95 req-47536aee-6800-43bd-bd0a-52a380329732 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:32.995440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-da9f475a-447a-421a-9dd5-e79f3a16bf95 req-47536aee-6800-43bd-bd0a-52a380329732 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:32.996275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-da9f475a-447a-421a-9dd5-e79f3a16bf95 req-47536aee-6800-43bd-bd0a-52a380329732 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:33.016267 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-da9f475a-447a-421a-9dd5-e79f3a16bf95 req-47536aee-6800-43bd-bd0a-52a380329732 service nova] Creating event network-vif-deleted:b31588f9-5215-4525-a306-7739e48dfd07 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:38:33.025245 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-da9f475a-447a-421a-9dd5-e79f3a16bf95 req-47536aee-6800-43bd-bd0a-52a380329732 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049412 Aug 09 17:38:33.027747 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2566/4887] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:33.584037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-94a7cf88-fbf2-42d6-8e86-7581acd4e8b5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:33.634709 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-94a7cf88-fbf2-42d6-8e86-7581acd4e8b5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.902901 Aug 09 17:38:33.646913 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2322/4888] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:31 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:33.689157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ef0ae8d3-844a-4def-a131-e13f7b872a2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:33.690476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ef0ae8d3-844a-4def-a131-e13f7b872a2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:33.709711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0ae8d3-844a-4def-a131-e13f7b872a2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:33.710596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0ae8d3-844a-4def-a131-e13f7b872a2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:33.711400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0ae8d3-844a-4def-a131-e13f7b872a2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:33.712744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0ae8d3-844a-4def-a131-e13f7b872a2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:33.713592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0ae8d3-844a-4def-a131-e13f7b872a2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:33.714333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef0ae8d3-844a-4def-a131-e13f7b872a2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:34.028000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:34.029914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:34.058294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:34.060599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:34.061953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:34.064352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:34.067151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:34.068377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:34.737943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ef0ae8d3-844a-4def-a131-e13f7b872a2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:34.818262 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ef0ae8d3-844a-4def-a131-e13f7b872a2c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.145288 Aug 09 17:38:34.818873 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2567/4889] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:33 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:34.856627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3b4ed6e-17f0-417e-b780-9989d81b9b78 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:34.857524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c3b4ed6e-17f0-417e-b780-9989d81b9b78 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:34.877833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b4ed6e-17f0-417e-b780-9989d81b9b78 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:34.878769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b4ed6e-17f0-417e-b780-9989d81b9b78 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:34.879386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b4ed6e-17f0-417e-b780-9989d81b9b78 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:34.880506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b4ed6e-17f0-417e-b780-9989d81b9b78 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:34.881127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b4ed6e-17f0-417e-b780-9989d81b9b78 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:34.881649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b4ed6e-17f0-417e-b780-9989d81b9b78 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:34.948101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-c3b4ed6e-17f0-417e-b780-9989d81b9b78 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lazy-loading 'flavor' on Instance uuid 1a30c674-6026-45bd-b50e-218ae7d69382 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:38:35.197826 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c3b4ed6e-17f0-417e-b780-9989d81b9b78 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.344470 Aug 09 17:38:35.200558 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2568/4890] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:38:34 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:38:35.218708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-778d0449-0b27-4d35-8a57-678cd554708c req-9c8065b4-a83a-4cf6-9ed6-36afcf38a496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8deacdae-0205-41a6-b164-640022f2eef4", "tag": "a322ddf6-871d-4af1-8243-03824c9855a1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:35.245834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-778d0449-0b27-4d35-8a57-678cd554708c req-9c8065b4-a83a-4cf6-9ed6-36afcf38a496 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:35.247149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-778d0449-0b27-4d35-8a57-678cd554708c req-9c8065b4-a83a-4cf6-9ed6-36afcf38a496 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:35.248328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-778d0449-0b27-4d35-8a57-678cd554708c req-9c8065b4-a83a-4cf6-9ed6-36afcf38a496 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:35.278929 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-778d0449-0b27-4d35-8a57-678cd554708c req-9c8065b4-a83a-4cf6-9ed6-36afcf38a496 service nova] Creating event network-changed:a322ddf6-871d-4af1-8243-03824c9855a1 for instance 8deacdae-0205-41a6-b164-640022f2eef4 on n-h2-845781-6 Aug 09 17:38:35.292480 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-778d0449-0b27-4d35-8a57-678cd554708c req-9c8065b4-a83a-4cf6-9ed6-36afcf38a496 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080926 Aug 09 17:38:35.298064 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2569/4891] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:35.322485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-de91c94d-1d5d-4b9e-8857-3298b20d3e34 req-5490793a-fdaa-4c54-aa73-63a1f05c7b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-deleted", "tag": "1f1ce345-17a7-4206-910b-0ef883357278"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:35.356071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-de91c94d-1d5d-4b9e-8857-3298b20d3e34 req-5490793a-fdaa-4c54-aa73-63a1f05c7b0e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:35.360308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-de91c94d-1d5d-4b9e-8857-3298b20d3e34 req-5490793a-fdaa-4c54-aa73-63a1f05c7b0e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:35.362839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-de91c94d-1d5d-4b9e-8857-3298b20d3e34 req-5490793a-fdaa-4c54-aa73-63a1f05c7b0e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:35.398177 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-de91c94d-1d5d-4b9e-8857-3298b20d3e34 req-5490793a-fdaa-4c54-aa73-63a1f05c7b0e service nova] Creating event network-vif-deleted:1f1ce345-17a7-4206-910b-0ef883357278 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:38:35.411771 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-de91c94d-1d5d-4b9e-8857-3298b20d3e34 req-5490793a-fdaa-4c54-aa73-63a1f05c7b0e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097833 Aug 09 17:38:35.413698 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2570/4892] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:35.428953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b36b5a0-a709-4488-bca2-54ab7b2dd147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:35.430919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b36b5a0-a709-4488-bca2-54ab7b2dd147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:35.444678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b36b5a0-a709-4488-bca2-54ab7b2dd147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:35.446231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b36b5a0-a709-4488-bca2-54ab7b2dd147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:35.449674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b36b5a0-a709-4488-bca2-54ab7b2dd147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:35.452860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b36b5a0-a709-4488-bca2-54ab7b2dd147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:35.455084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b36b5a0-a709-4488-bca2-54ab7b2dd147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:35.456666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b36b5a0-a709-4488-bca2-54ab7b2dd147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:35.487299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:35.536935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:35.541955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:35.544065 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d7997ba5-09e5-49ed-8d31-722633401f38 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 2213 microversion: 2.32 time: 1.529807 Aug 09 17:38:35.545235 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2323/4893] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:34 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 2213 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:36.576533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:36.581877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:36.614906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:36.619892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:36.620689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:36.621982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:36.627236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:36.630213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:36.859719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:36.928106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:36.944737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:36.950459 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-82efb814-427c-467b-84c0-df891d1fa25d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.383812 Aug 09 17:38:36.967162 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2324/4894] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:36 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:37.472630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-4c666aa4-9415-48fc-b812-cf1ec272a6a8 req-7a91359e-1e4f-4a7a-b9c6-cdd95d1cf29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8fcac7-61be-4c8b-9ea5-82f88d299d92", "name": "network-vif-deleted", "tag": "4f7a2502-f30f-4735-9904-fbf8a52eb998"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:37.509765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6b36b5a0-a709-4488-bca2-54ab7b2dd147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:37.518739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4c666aa4-9415-48fc-b812-cf1ec272a6a8 req-7a91359e-1e4f-4a7a-b9c6-cdd95d1cf29c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:37.521181 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b36b5a0-a709-4488-bca2-54ab7b2dd147 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1677 microversion: 2.1 time: 2.102279 Aug 09 17:38:37.521802 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2571/4895] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:35 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1677 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:37.532828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4c666aa4-9415-48fc-b812-cf1ec272a6a8 req-7a91359e-1e4f-4a7a-b9c6-cdd95d1cf29c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:37.536230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-4c666aa4-9415-48fc-b812-cf1ec272a6a8 req-7a91359e-1e4f-4a7a-b9c6-cdd95d1cf29c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:37.588896 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-4c666aa4-9415-48fc-b812-cf1ec272a6a8 req-7a91359e-1e4f-4a7a-b9c6-cdd95d1cf29c service nova] Creating event network-vif-deleted:4f7a2502-f30f-4735-9904-fbf8a52eb998 for instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 on n-h2-845781-6 Aug 09 17:38:37.623659 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-4c666aa4-9415-48fc-b812-cf1ec272a6a8 req-7a91359e-1e4f-4a7a-b9c6-cdd95d1cf29c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162456 Aug 09 17:38:37.624771 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2325/4896] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:38:37.981015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:37.981659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:38.011250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:38.012734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:38.013219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:38.020102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:38.023204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:38.023707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:38.417497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:38.463182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:38.470192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:38.476986 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-35f35f72-17a8-4a7a-bdb7-45f43759ac04 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.498613 Aug 09 17:38:38.480274 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2572/4897] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:37 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:38.567422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ea0f2446-cf1a-4678-9913-f50e4402df38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:38.575024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ea0f2446-cf1a-4678-9913-f50e4402df38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:38.604780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea0f2446-cf1a-4678-9913-f50e4402df38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:38.607615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea0f2446-cf1a-4678-9913-f50e4402df38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:38.608741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea0f2446-cf1a-4678-9913-f50e4402df38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:38.610314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea0f2446-cf1a-4678-9913-f50e4402df38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:38.611465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea0f2446-cf1a-4678-9913-f50e4402df38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:38.612676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ea0f2446-cf1a-4678-9913-f50e4402df38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:39.130229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ea0f2446-cf1a-4678-9913-f50e4402df38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:39.149171 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ea0f2446-cf1a-4678-9913-f50e4402df38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1660 microversion: 2.1 time: 0.591087 Aug 09 17:38:39.169393 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2326/4898] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:38 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1660 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:39.184653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0f4a26e3-1b04-4163-b553-a6acf633bf23 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:39.192852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0f4a26e3-1b04-4163-b553-a6acf633bf23 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:39.234433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f4a26e3-1b04-4163-b553-a6acf633bf23 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:39.241111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f4a26e3-1b04-4163-b553-a6acf633bf23 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:39.242137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f4a26e3-1b04-4163-b553-a6acf633bf23 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:39.243541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f4a26e3-1b04-4163-b553-a6acf633bf23 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:39.244446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f4a26e3-1b04-4163-b553-a6acf633bf23 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:39.245465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f4a26e3-1b04-4163-b553-a6acf633bf23 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:39.429320 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0f4a26e3-1b04-4163-b553-a6acf633bf23 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action" status: 202 len: 0 microversion: 2.1 time: 0.253500 Aug 09 17:38:39.433657 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2573/4899] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:38:39 2022] POST /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:38:39.464645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa32619e-b515-41ed-955c-f5b754fe9a38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:39.468044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fa32619e-b515-41ed-955c-f5b754fe9a38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:39.515021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa32619e-b515-41ed-955c-f5b754fe9a38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:39.523943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa32619e-b515-41ed-955c-f5b754fe9a38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:39.525077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa32619e-b515-41ed-955c-f5b754fe9a38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:39.527046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa32619e-b515-41ed-955c-f5b754fe9a38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:39.528228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa32619e-b515-41ed-955c-f5b754fe9a38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:39.529292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa32619e-b515-41ed-955c-f5b754fe9a38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:39.540193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:39.546318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:39.584487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:39.587100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:39.589392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:39.593200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:39.600251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:39.602460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:40.106376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:40.150898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:40.154623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:40.160650 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f1d122c9-d893-4ece-8c4f-f69810073497 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.633843 Aug 09 17:38:40.170925 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2574/4900] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:39 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:41.210520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:41.224085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:41.262405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:41.272526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:41.275508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:41.276449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:41.276946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:41.277398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:41.521825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fa32619e-b515-41ed-955c-f5b754fe9a38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:41.547803 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fa32619e-b515-41ed-955c-f5b754fe9a38 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1666 microversion: 2.1 time: 2.108064 Aug 09 17:38:41.557724 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2327/4901] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:39 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1666 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:41.587609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:41.599335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:41.601591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:41.604188 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-241a5e79-93fa-4081-bd26-5ae6c0caaa06 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.403595 Aug 09 17:38:41.620973 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2575/4902] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:41 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:38:42.581704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2b3525f7-ceb8-44b6-bca8-da87af80dd5c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:42.583183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2b3525f7-ceb8-44b6-bca8-da87af80dd5c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:42.591874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b3525f7-ceb8-44b6-bca8-da87af80dd5c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:42.593024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b3525f7-ceb8-44b6-bca8-da87af80dd5c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:42.593759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b3525f7-ceb8-44b6-bca8-da87af80dd5c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:42.594799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b3525f7-ceb8-44b6-bca8-da87af80dd5c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:42.595807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b3525f7-ceb8-44b6-bca8-da87af80dd5c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:42.596488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b3525f7-ceb8-44b6-bca8-da87af80dd5c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:42.636155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:42.643506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:42.662087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:42.663206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:42.664068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:42.665443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:42.666267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:42.667052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:42.745130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:43.716754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:43.757701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:43.763035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:43.769191 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b5373415-1834-4f3d-a5f3-db8eaee2c2c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 1.141116 Aug 09 17:38:43.793201 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2576/4903] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:42 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:38:43.799311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b3525f7-ceb8-44b6-bca8-da87af80dd5c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:43.809568 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2b3525f7-ceb8-44b6-bca8-da87af80dd5c tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1666 microversion: 2.1 time: 1.233228 Aug 09 17:38:43.827948 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2328/4904] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:42 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1666 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:44.846208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a92520c5-f6ed-4d79-a6c6-b013cf93660b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:44.848828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:44.851234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:44.853149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a92520c5-f6ed-4d79-a6c6-b013cf93660b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:44.889774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a92520c5-f6ed-4d79-a6c6-b013cf93660b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:44.899739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:44.902363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a92520c5-f6ed-4d79-a6c6-b013cf93660b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:44.906367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a92520c5-f6ed-4d79-a6c6-b013cf93660b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:44.906950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:44.908159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:44.912352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a92520c5-f6ed-4d79-a6c6-b013cf93660b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:44.914091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:44.916562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a92520c5-f6ed-4d79-a6c6-b013cf93660b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:44.917758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:44.922093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a92520c5-f6ed-4d79-a6c6-b013cf93660b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:44.923678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:45.265458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:45.303598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:45.320824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:45.326210 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eae10ed9-7580-4312-9bc1-d5b5a93405b9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.500047 Aug 09 17:38:45.344809 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2577/4905] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:44 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:45.948006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a92520c5-f6ed-4d79-a6c6-b013cf93660b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:45.975842 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a92520c5-f6ed-4d79-a6c6-b013cf93660b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1666 microversion: 2.1 time: 1.143370 Aug 09 17:38:45.993116 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2329/4906] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:44 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1666 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:46.373816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:46.374870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:46.402038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:46.402906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:46.403709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:46.405008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:46.405845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:46.406609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:46.649750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:46.679176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:46.692425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:46.694709 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6f2451c7-1752-460f-a06b-80180aac9f9b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.324837 Aug 09 17:38:46.700140 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2578/4907] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:46 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:47.012887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e27c2f63-cc7c-4bdb-9f9f-f40647a8f782 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:47.020279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e27c2f63-cc7c-4bdb-9f9f-f40647a8f782 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:47.049842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e27c2f63-cc7c-4bdb-9f9f-f40647a8f782 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:47.051170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e27c2f63-cc7c-4bdb-9f9f-f40647a8f782 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:47.052219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e27c2f63-cc7c-4bdb-9f9f-f40647a8f782 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:47.061371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e27c2f63-cc7c-4bdb-9f9f-f40647a8f782 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:47.062615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e27c2f63-cc7c-4bdb-9f9f-f40647a8f782 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:47.063730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e27c2f63-cc7c-4bdb-9f9f-f40647a8f782 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:47.722781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e27c2f63-cc7c-4bdb-9f9f-f40647a8f782 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:47.723141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:47.724346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:47.749070 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e27c2f63-cc7c-4bdb-9f9f-f40647a8f782 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1666 microversion: 2.1 time: 0.743673 Aug 09 17:38:47.750490 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2330/4908] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:47 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1666 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:47.764534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:47.765342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:47.766185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:47.767701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:47.780881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:47.781781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:48.177264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:48.220488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:48.229312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:48.232178 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd1ea1b9-df1e-478a-8813-9e57c4b465a2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.516470 Aug 09 17:38:48.237648 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2579/4909] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:47 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:48.781344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-405dd769-fec0-4a1c-b8b9-c4be7f494408 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:48.782265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-405dd769-fec0-4a1c-b8b9-c4be7f494408 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:48.797777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-405dd769-fec0-4a1c-b8b9-c4be7f494408 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:48.798390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-405dd769-fec0-4a1c-b8b9-c4be7f494408 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:48.800221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-405dd769-fec0-4a1c-b8b9-c4be7f494408 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:48.801137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-405dd769-fec0-4a1c-b8b9-c4be7f494408 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:48.815449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-405dd769-fec0-4a1c-b8b9-c4be7f494408 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:48.816163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-405dd769-fec0-4a1c-b8b9-c4be7f494408 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:49.272109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:49.278202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:49.314015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:49.315909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:49.317737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:49.324077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-405dd769-fec0-4a1c-b8b9-c4be7f494408 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:49.325967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:49.327142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:49.338548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:49.357069 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-405dd769-fec0-4a1c-b8b9-c4be7f494408 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 0.577486 Aug 09 17:38:49.373431 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2331/4910] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:48 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:49.414530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c4355c5f-9645-41c7-adab-8e0640dfdfa3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:49.418506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c4355c5f-9645-41c7-adab-8e0640dfdfa3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:49.446207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4355c5f-9645-41c7-adab-8e0640dfdfa3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:49.455774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4355c5f-9645-41c7-adab-8e0640dfdfa3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:49.458114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4355c5f-9645-41c7-adab-8e0640dfdfa3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:49.460528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4355c5f-9645-41c7-adab-8e0640dfdfa3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:49.462601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4355c5f-9645-41c7-adab-8e0640dfdfa3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:49.465205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4355c5f-9645-41c7-adab-8e0640dfdfa3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:49.638444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:49.686366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:49.696254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:49.716562 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e2752ea-cf6d-4758-85de-0e6dbf7a3c69 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.437517 Aug 09 17:38:49.727302 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2580/4911] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:49 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:50.426861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c4355c5f-9645-41c7-adab-8e0640dfdfa3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:50.444673 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c4355c5f-9645-41c7-adab-8e0640dfdfa3 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1669 microversion: 2.1 time: 1.044491 Aug 09 17:38:50.449475 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2332/4912] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:49 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1669 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:38:50.500291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:50.501413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:50.534372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:50.542176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:50.543099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:50.544706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:50.545667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:50.546530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:50.657648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:38:50.685517 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.compute.api [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Working on deleting snapshot 9191e349-b1c7-4d24-a6e6-e5cf410a808a from shelved instance... Aug 09 17:38:50.743211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:50.745924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:50.757603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:50.757603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:50.757995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:50.758482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:50.758972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:50.759418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:51.289334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:51.302537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:51.304194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:51.317343 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9528e9ab-3781-4870-9296-7c4e2c8e6ce0 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.578829 Aug 09 17:38:51.318663 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2333/4913] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:50 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:38:52.350882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:52.353616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:52.366935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=41 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:52.387042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:52.389951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:52.390884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:52.392751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:52.393424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:52.399033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:52.579223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:52.602490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:52.604599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:52.606296 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-83a842ae-62be-4568-8e92-996097becdb1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.263225 Aug 09 17:38:52.608843 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2334/4914] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:52 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:38:52.812888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=58 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:52.818091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Doing local delete in cell 64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) {{(pid=119431) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 09 17:38:52.821080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:52.822222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:52.823071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:52.823858 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.compute.api [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 09 17:38:52.830804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] deallocate_for_instance() {{(pid=119431) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 09 17:38:53.651504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:53.656150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:53.690051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:53.691290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:53.704303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:53.708175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:53.709095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:53.709874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:54.014424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:54.050380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:54.059656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:54.071701 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3d1c84f9-8b86-4260-bdc5-fbf1b47595c9 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.431524 Aug 09 17:38:54.073325 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2335/4915] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:53 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:38:55.107560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:55.114303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:55.152297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:55.153028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:55.153788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:55.154846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:55.155584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:55.156383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:56.211828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:56.232453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:56.236397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:56.241801 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1e856e2f-902c-4bcf-9956-48db0ee5069d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 1.144159 Aug 09 17:38:56.263875 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2336/4916] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:55 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:56.333888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Updating instance_info_cache with network_info: [] {{(pid=119431) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 17:38:56.353335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-69d0a50a-3154-438d-8e2d-17677a2993c9 req-1eec55bc-c87d-4e0f-892d-fe600a49bd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c299fda1-8657-46b4-ab0a-3592f096c1b3", "name": "network-vif-deleted", "tag": "57024231-91a0-48b5-9317-3a85be55d7a1"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:38:56.385724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-69d0a50a-3154-438d-8e2d-17677a2993c9 req-1eec55bc-c87d-4e0f-892d-fe600a49bd51 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:56.386223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-69d0a50a-3154-438d-8e2d-17677a2993c9 req-1eec55bc-c87d-4e0f-892d-fe600a49bd51 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:56.386667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-69d0a50a-3154-438d-8e2d-17677a2993c9 req-1eec55bc-c87d-4e0f-892d-fe600a49bd51 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:56.412100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.compute.server_external_events [req-69d0a50a-3154-438d-8e2d-17677a2993c9 req-1eec55bc-c87d-4e0f-892d-fe600a49bd51 service nova] Unable to find a host for instance c299fda1-8657-46b4-ab0a-3592f096c1b3. Dropping event network-vif-deleted {{(pid=119432) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 17:38:56.414424 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-69d0a50a-3154-438d-8e2d-17677a2993c9 req-1eec55bc-c87d-4e0f-892d-fe600a49bd51 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.064129 Aug 09 17:38:56.419574 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2337/4917] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 09 17:38:56.965303 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c7823a8a-057f-4207-a5c7-f9dfd2291a28 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 204 len: 0 microversion: 2.1 time: 6.474406 Aug 09 17:38:56.965942 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2581/4918] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:38:50 2022] DELETE /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 0 bytes in 6476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:38:56.979760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:56.982229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: c299fda1-8657-46b4-ab0a-3592f096c1b3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:56.997807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:57.000200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:57.001301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:57.003124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:57.006316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:57.007557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:57.060557 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] HTTP exception thrown: Instance c299fda1-8657-46b4-ab0a-3592f096c1b3 could not be found. Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Request method failure captured: Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 HTTP/1.1 Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pkS_0b8ItkJO97o1bEJ5HRPxDD9WqTw4B54mMaSsBc9otrK3JnRrU3vGI9NL_jGO6L5V6mu39PI1DIc6ecdm5wHtaDqBnhlt31WibB3ymvtcQm3wOXoKuthF_k0m8v2oV46db59aVNUFJwuCCQA6VKNesTqzja4E13a59VpNmdK2aM Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 62572816b806440aa8338fea1d0a297e Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance c299fda1-8657-46b4-ab0a-3592f096c1b3 could not be found. Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'c299fda1-8657-46b4-ab0a-3592f096c1b3'} Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c299fda1-8657-46b4-ab0a-3592f096c1b3 could not be found. Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c299fda1-8657-46b4-ab0a-3592f096c1b3 could not be found. Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:38:57.067814 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:38:57.089272 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:38:57.089272 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:38:57.089272 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:38:57.089272 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:38:57.089272 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:38:57.089272 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c299fda1-8657-46b4-ab0a-3592f096c1b3 could not be found. Aug 09 17:38:57.089272 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:38:57.089272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Returning 404 to user: Instance c299fda1-8657-46b4-ab0a-3592f096c1b3 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:38:57.089272 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-74477c8f-50ed-4910-8c4f-6a2df3ad2409 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3" status: 404 len: 111 microversion: 2.1 time: 0.110649 Aug 09 17:38:57.095736 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2338/4919] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:56 2022] GET /compute/v2.1/servers/c299fda1-8657-46b4-ab0a-3592f096c1b3 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:38:57.106679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9fc402c3-f4e5-4d4f-9f95-a5dcea98c221 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:57.107393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9fc402c3-f4e5-4d4f-9f95-a5dcea98c221 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:57.119946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fc402c3-f4e5-4d4f-9f95-a5dcea98c221 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:57.120455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fc402c3-f4e5-4d4f-9f95-a5dcea98c221 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:57.120974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fc402c3-f4e5-4d4f-9f95-a5dcea98c221 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:57.121806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fc402c3-f4e5-4d4f-9f95-a5dcea98c221 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:57.122189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fc402c3-f4e5-4d4f-9f95-a5dcea98c221 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:57.122692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fc402c3-f4e5-4d4f-9f95-a5dcea98c221 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:57.220443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9fc402c3-f4e5-4d4f-9f95-a5dcea98c221 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:38:57.272083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:57.276576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:57.341364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:57.342407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:57.344586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:57.355420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:57.357553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:57.371660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:57.431952 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9fc402c3-f4e5-4d4f-9f95-a5dcea98c221 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "DELETE /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 204 len: 0 microversion: 2.1 time: 0.335657 Aug 09 17:38:57.434940 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2582/4920] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:38:57 2022] DELETE /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:38:57.449898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a8535edf-ba1f-4124-9acd-9ae708615ea4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:57.453321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a8535edf-ba1f-4124-9acd-9ae708615ea4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:57.467796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8535edf-ba1f-4124-9acd-9ae708615ea4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:57.468970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8535edf-ba1f-4124-9acd-9ae708615ea4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:57.470234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8535edf-ba1f-4124-9acd-9ae708615ea4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:57.472386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8535edf-ba1f-4124-9acd-9ae708615ea4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:57.473841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8535edf-ba1f-4124-9acd-9ae708615ea4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:57.475293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8535edf-ba1f-4124-9acd-9ae708615ea4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:57.648169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:57.651609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:57.672448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:57.680785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:57.685299 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c33e3deb-e198-4792-89ed-b02a9f4644c5 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.420638 Aug 09 17:38:57.699713 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2339/4921] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:57 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:38:57.857475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a8535edf-ba1f-4124-9acd-9ae708615ea4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:57.894074 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a8535edf-ba1f-4124-9acd-9ae708615ea4 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1466 microversion: 2.1 time: 0.452581 Aug 09 17:38:57.896812 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2583/4922] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:57 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1466 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:38:58.718801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:58.728599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:58.759726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:58.761019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:58.767276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:58.769448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:58.771325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:58.776772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:58.927146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ed4e53ed-b518-4e65-a0af-4fcb27d8bd98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:38:58.931404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ed4e53ed-b518-4e65-a0af-4fcb27d8bd98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:38:58.958926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed4e53ed-b518-4e65-a0af-4fcb27d8bd98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:58.960673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed4e53ed-b518-4e65-a0af-4fcb27d8bd98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:58.961480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed4e53ed-b518-4e65-a0af-4fcb27d8bd98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:58.962978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed4e53ed-b518-4e65-a0af-4fcb27d8bd98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:38:58.964226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed4e53ed-b518-4e65-a0af-4fcb27d8bd98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:38:58.983986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ed4e53ed-b518-4e65-a0af-4fcb27d8bd98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:38:59.061526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:59.098669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:59.104013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:59.107759 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b03ccac5-7eb4-47c6-90df-ab9ac69993f1 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.396579 Aug 09 17:38:59.109519 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2340/4923] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:38:58 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:38:59.152574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ed4e53ed-b518-4e65-a0af-4fcb27d8bd98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:38:59.166834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:38:59.174877 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ed4e53ed-b518-4e65-a0af-4fcb27d8bd98 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1466 microversion: 2.1 time: 0.256290 Aug 09 17:38:59.176979 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2584/4924] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:38:58 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1466 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:39:00.142052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:00.148830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:00.171403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:00.180868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:00.182607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:00.192835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:00.194345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:00.195467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:00.224350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5483bfd6-7da5-464b-9eef-31a0591dfa1f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:00.225723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5483bfd6-7da5-464b-9eef-31a0591dfa1f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:00.242659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5483bfd6-7da5-464b-9eef-31a0591dfa1f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:00.248863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5483bfd6-7da5-464b-9eef-31a0591dfa1f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:00.249674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5483bfd6-7da5-464b-9eef-31a0591dfa1f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:00.250689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5483bfd6-7da5-464b-9eef-31a0591dfa1f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:00.251391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5483bfd6-7da5-464b-9eef-31a0591dfa1f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:00.252504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5483bfd6-7da5-464b-9eef-31a0591dfa1f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:00.430970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:00.445476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:00.453880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:00.455590 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-65b2b1a8-b077-4276-892f-9a82695c618b tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.325223 Aug 09 17:39:00.460793 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2341/4925] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:00 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:00.575233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5483bfd6-7da5-464b-9eef-31a0591dfa1f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:00.585057 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5483bfd6-7da5-464b-9eef-31a0591dfa1f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1466 microversion: 2.1 time: 0.367892 Aug 09 17:39:00.594331 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2585/4926] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:00 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1466 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:39:01.510889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:01.511847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:01.560665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:01.563909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:01.564678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:01.573954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:01.574914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:01.577097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:01.635444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09956359-462f-44cb-ab45-de444b60a263 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:01.636377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09956359-462f-44cb-ab45-de444b60a263 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:01.657878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09956359-462f-44cb-ab45-de444b60a263 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:01.666373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09956359-462f-44cb-ab45-de444b60a263 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:01.668804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09956359-462f-44cb-ab45-de444b60a263 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:01.670013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09956359-462f-44cb-ab45-de444b60a263 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:01.678230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09956359-462f-44cb-ab45-de444b60a263 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:01.678924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09956359-462f-44cb-ab45-de444b60a263 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:01.950016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-09956359-462f-44cb-ab45-de444b60a263 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:01.970289 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09956359-462f-44cb-ab45-de444b60a263 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 200 len: 1466 microversion: 2.1 time: 0.340251 Aug 09 17:39:01.990261 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2586/4927] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:01 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 1466 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:39:02.000000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:02.003414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-7043f2cf-4ba0-4737-a68d-035c5652a6bb req-aae6267f-a54f-4439-9fe3-d88261fc7202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11538f74-5456-470b-96ff-6ffceb5e5218", "name": "network-vif-deleted", "tag": "937926c7-6c58-4ddd-91e7-3c5a998f4f99"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:39:02.022183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:02.023896 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:02.025339 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-66cec6e9-f83f-434e-9cd6-f5c395d8abb6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.523724 Aug 09 17:39:02.037730 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2342/4928] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:01 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:02.101290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7043f2cf-4ba0-4737-a68d-035c5652a6bb req-aae6267f-a54f-4439-9fe3-d88261fc7202 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:02.108147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7043f2cf-4ba0-4737-a68d-035c5652a6bb req-aae6267f-a54f-4439-9fe3-d88261fc7202 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:02.110793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7043f2cf-4ba0-4737-a68d-035c5652a6bb req-aae6267f-a54f-4439-9fe3-d88261fc7202 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:02.218155 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-7043f2cf-4ba0-4737-a68d-035c5652a6bb req-aae6267f-a54f-4439-9fe3-d88261fc7202 service nova] Creating event network-vif-deleted:937926c7-6c58-4ddd-91e7-3c5a998f4f99 for instance 11538f74-5456-470b-96ff-6ffceb5e5218 on n-h2-845781-6 Aug 09 17:39:02.238754 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-7043f2cf-4ba0-4737-a68d-035c5652a6bb req-aae6267f-a54f-4439-9fe3-d88261fc7202 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246244 Aug 09 17:39:02.239814 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2587/4929] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:39:03.039559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:03.040474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 11538f74-5456-470b-96ff-6ffceb5e5218] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:03.068582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:03.069318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:03.072119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:03.072626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:03.073073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:03.073817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:03.091079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:03.091592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:03.092073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:03.092870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:03.093354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:03.093792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:03.096368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:03.096931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:03.141997 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] HTTP exception thrown: Instance 11538f74-5456-470b-96ff-6ffceb5e5218 could not be found. Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Request method failure captured: Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 HTTP/1.1 Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pkS_0b8ItkJO97o1bEJ5HRPxDD9WqTw4B54mMaSsBc9otrK3JnRrU3vGI9NL_jGO6L5V6mu39PI1DIc6ecdm5wHtaDqBnhlt31WibB3ymvtcQm3wOXoKuthF_k0m8v2oV46db59aVNUFJwuCCQA6VKNesTqzja4E13a59VpNmdK2aM Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 62572816b806440aa8338fea1d0a297e Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 11538f74-5456-470b-96ff-6ffceb5e5218 could not be found. Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '11538f74-5456-470b-96ff-6ffceb5e5218'} Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11538f74-5456-470b-96ff-6ffceb5e5218 could not be found. Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11538f74-5456-470b-96ff-6ffceb5e5218 could not be found. Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:03.143669 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:03.148928 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:03.148928 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:03.148928 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:03.148928 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:39:03.148928 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:39:03.148928 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11538f74-5456-470b-96ff-6ffceb5e5218 could not be found. Aug 09 17:39:03.148928 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:03.148928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Returning 404 to user: Instance 11538f74-5456-470b-96ff-6ffceb5e5218 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:39:03.175825 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9bad6296-381c-4fb9-9084-f7ce051e27de tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218" status: 404 len: 111 microversion: 2.1 time: 0.141767 Aug 09 17:39:03.177000 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2343/4930] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:03 2022] GET /compute/v2.1/servers/11538f74-5456-470b-96ff-6ffceb5e5218 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:39:03.188574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c039c20a-87b4-4f49-9346-c0e8c9d5d3d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:03.189095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c039c20a-87b4-4f49-9346-c0e8c9d5d3d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:03.228840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c039c20a-87b4-4f49-9346-c0e8c9d5d3d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:03.234726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c039c20a-87b4-4f49-9346-c0e8c9d5d3d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:03.235220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c039c20a-87b4-4f49-9346-c0e8c9d5d3d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:03.236042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c039c20a-87b4-4f49-9346-c0e8c9d5d3d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:03.236542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c039c20a-87b4-4f49-9346-c0e8c9d5d3d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:03.236987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c039c20a-87b4-4f49-9346-c0e8c9d5d3d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:03.373517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c039c20a-87b4-4f49-9346-c0e8c9d5d3d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:39:03.611341 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c039c20a-87b4-4f49-9346-c0e8c9d5d3d5 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 204 len: 0 microversion: 2.1 time: 0.426750 Aug 09 17:39:03.611992 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2344/4931] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:39:03 2022] DELETE /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:39:03.634589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-df31b591-4cbc-48c4-9c05-c4c511964304 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:03.635892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-df31b591-4cbc-48c4-9c05-c4c511964304 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:03.654134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df31b591-4cbc-48c4-9c05-c4c511964304 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:03.654647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df31b591-4cbc-48c4-9c05-c4c511964304 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:03.655097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df31b591-4cbc-48c4-9c05-c4c511964304 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:03.655863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df31b591-4cbc-48c4-9c05-c4c511964304 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:03.656333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df31b591-4cbc-48c4-9c05-c4c511964304 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:03.656768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df31b591-4cbc-48c4-9c05-c4c511964304 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:03.696993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:03.801900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:03.807418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:03.811048 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-52670215-4351-4597-9b3b-0e5a7376526d tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.748757 Aug 09 17:39:03.813052 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2588/4932] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:03 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:04.715368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-df31b591-4cbc-48c4-9c05-c4c511964304 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:04.749039 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-df31b591-4cbc-48c4-9c05-c4c511964304 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1508 microversion: 2.1 time: 1.124876 Aug 09 17:39:04.762816 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2345/4933] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:03 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1508 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:39:04.868770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:04.873696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:04.906274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:04.907564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:04.908813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:04.911660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:04.913288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:04.914919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:05.340936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:05.360706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:05.366299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:05.367569 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a5781b91-269a-4ea2-bf76-562d5a976be2 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.533581 Aug 09 17:39:05.390458 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2589/4934] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:04 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:05.823480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-985c3255-cc1a-4dec-81ae-f9437c524fe9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:05.832482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-985c3255-cc1a-4dec-81ae-f9437c524fe9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:05.862967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-985c3255-cc1a-4dec-81ae-f9437c524fe9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:05.864043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-985c3255-cc1a-4dec-81ae-f9437c524fe9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:05.864514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-985c3255-cc1a-4dec-81ae-f9437c524fe9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:05.865329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-985c3255-cc1a-4dec-81ae-f9437c524fe9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:05.865814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-985c3255-cc1a-4dec-81ae-f9437c524fe9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:05.866285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-985c3255-cc1a-4dec-81ae-f9437c524fe9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:06.398773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:06.399652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:06.416573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:06.417245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:06.417863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:06.418959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:06.419714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:06.426728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:06.578008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:06.596664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:06.602854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:06.610740 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09cfd48f-797a-4019-8365-ebc840df2e46 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 0.216748 Aug 09 17:39:06.611834 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2590/4935] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:06 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:07.126106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-985c3255-cc1a-4dec-81ae-f9437c524fe9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:07.144258 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-985c3255-cc1a-4dec-81ae-f9437c524fe9 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1508 microversion: 2.1 time: 1.338210 Aug 09 17:39:07.145112 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2346/4936] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:05 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1508 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:39:07.184746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3295b412-f357-4638-8d19-9e9b35a5e648 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:07.193779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3295b412-f357-4638-8d19-9e9b35a5e648 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:07.241474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295b412-f357-4638-8d19-9e9b35a5e648 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:07.256450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295b412-f357-4638-8d19-9e9b35a5e648 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:07.257347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295b412-f357-4638-8d19-9e9b35a5e648 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:07.263048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295b412-f357-4638-8d19-9e9b35a5e648 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:07.270538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295b412-f357-4638-8d19-9e9b35a5e648 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:07.272070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3295b412-f357-4638-8d19-9e9b35a5e648 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:07.409612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-0786a138-8d95-4003-8f1a-4dfff3b2d998 req-4273c1d6-6ac9-46e7-9e2a-91c570ed8786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66d35bb-7e44-4f00-9de9-18b1d9d97d5a", "name": "network-vif-deleted", "tag": "34c16c39-de74-44d1-b8be-3b20669ef21c"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:39:07.429382 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3295b412-f357-4638-8d19-9e9b35a5e648 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/ips" status: 200 len: 151 microversion: 2.20 time: 0.244370 Aug 09 17:39:07.432234 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2591/4937] 10.222.0.93 () {60 vars in 1289 bytes} [Tue Aug 9 17:39:07 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/ips => generated 151 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:39:07.454361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0786a138-8d95-4003-8f1a-4dfff3b2d998 req-4273c1d6-6ac9-46e7-9e2a-91c570ed8786 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:07.461891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0786a138-8d95-4003-8f1a-4dfff3b2d998 req-4273c1d6-6ac9-46e7-9e2a-91c570ed8786 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:07.466974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0786a138-8d95-4003-8f1a-4dfff3b2d998 req-4273c1d6-6ac9-46e7-9e2a-91c570ed8786 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:07.532249 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-0786a138-8d95-4003-8f1a-4dfff3b2d998 req-4273c1d6-6ac9-46e7-9e2a-91c570ed8786 service nova] Creating event network-vif-deleted:34c16c39-de74-44d1-b8be-3b20669ef21c for instance f66d35bb-7e44-4f00-9de9-18b1d9d97d5a on n-h2-845781-6 Aug 09 17:39:07.551199 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-0786a138-8d95-4003-8f1a-4dfff3b2d998 req-4273c1d6-6ac9-46e7-9e2a-91c570ed8786 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138320 Aug 09 17:39:07.551199 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2347/4938] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:39:07.651355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:07.652579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:07.711597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:07.712527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:07.713371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:07.731122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:07.732213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:07.733025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:08.202131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:08.206117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:08.239589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:08.249012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:08.249678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:08.257306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:08.258510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:08.261940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:08.431955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:08.432927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:08.433636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:08.434420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lazy-loading 'fault' on Instance uuid f66d35bb-7e44-4f00-9de9-18b1d9d97d5a {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:39:09.382417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:09.456478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:09.470616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:09.519900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a636085d-9922-48ac-ab6c-f806af93601e tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1604 microversion: 2.32 time: 1.844778 Aug 09 17:39:09.527894 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2592/4939] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:07 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1604 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:10.022385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:10.030354 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2780bac2-8a4d-490a-b233-13a50f5db9df tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 200 len: 1305 microversion: 2.1 time: 1.835605 Aug 09 17:39:10.044195 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2348/4940] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:08 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 1305 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:39:10.597301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:10.610321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:10.708807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:10.709795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:10.720388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:10.731054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:10.733578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:10.736911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:10.975434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:10.976336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:10.977290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:10.978054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lazy-loading 'fault' on Instance uuid da8fcac7-61be-4c8b-9ea5-82f88d299d92 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:39:11.077513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:11.077513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f66d35bb-7e44-4f00-9de9-18b1d9d97d5a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:11.105307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:11.110083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:11.112113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:11.113923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:11.136146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:11.137346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:11.178586 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] HTTP exception thrown: Instance f66d35bb-7e44-4f00-9de9-18b1d9d97d5a could not be found. Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Request method failure captured: Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a HTTP/1.1 Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pkS_0b8ItkJO97o1bEJ5HRPxDD9WqTw4B54mMaSsBc9otrK3JnRrU3vGI9NL_jGO6L5V6mu39PI1DIc6ecdm5wHtaDqBnhlt31WibB3ymvtcQm3wOXoKuthF_k0m8v2oV46db59aVNUFJwuCCQA6VKNesTqzja4E13a59VpNmdK2aM Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 62572816b806440aa8338fea1d0a297e Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance f66d35bb-7e44-4f00-9de9-18b1d9d97d5a could not be found. Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'f66d35bb-7e44-4f00-9de9-18b1d9d97d5a'} Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66d35bb-7e44-4f00-9de9-18b1d9d97d5a could not be found. Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66d35bb-7e44-4f00-9de9-18b1d9d97d5a could not be found. Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:11.180959 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:11.185872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:11.185872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:11.185872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:11.185872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:39:11.185872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:39:11.185872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66d35bb-7e44-4f00-9de9-18b1d9d97d5a could not be found. Aug 09 17:39:11.185872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:11.191970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Returning 404 to user: Instance f66d35bb-7e44-4f00-9de9-18b1d9d97d5a could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:39:11.193295 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-734a0284-f91c-4f3d-a331-0dce42890a4b tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a" status: 404 len: 111 microversion: 2.1 time: 0.122684 Aug 09 17:39:11.196280 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2349/4941] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:11 2022] GET /compute/v2.1/servers/f66d35bb-7e44-4f00-9de9-18b1d9d97d5a => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:39:11.206245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69cf8c11-3560-4d09-9b24-09706c3e0062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:11.207346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-69cf8c11-3560-4d09-9b24-09706c3e0062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:11.229149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cf8c11-3560-4d09-9b24-09706c3e0062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:11.231239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cf8c11-3560-4d09-9b24-09706c3e0062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:11.234585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cf8c11-3560-4d09-9b24-09706c3e0062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:11.237839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cf8c11-3560-4d09-9b24-09706c3e0062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:11.239244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cf8c11-3560-4d09-9b24-09706c3e0062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:11.241056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-69cf8c11-3560-4d09-9b24-09706c3e0062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:11.318574 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-69cf8c11-3560-4d09-9b24-09706c3e0062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:39:11.633238 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69cf8c11-3560-4d09-9b24-09706c3e0062 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 204 len: 0 microversion: 2.1 time: 0.422966 Aug 09 17:39:11.635675 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2350/4942] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:39:11 2022] DELETE /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:39:11.697976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b4e016c3-722c-4828-9169-9df1b6e053ee tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:11.700892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b4e016c3-722c-4828-9169-9df1b6e053ee tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:11.729104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:11.729816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e016c3-722c-4828-9169-9df1b6e053ee tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:11.730246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e016c3-722c-4828-9169-9df1b6e053ee tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:11.730716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e016c3-722c-4828-9169-9df1b6e053ee tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:11.731498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e016c3-722c-4828-9169-9df1b6e053ee tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:11.732300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e016c3-722c-4828-9169-9df1b6e053ee tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:11.732765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4e016c3-722c-4828-9169-9df1b6e053ee tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:11.774683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:11.777425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '480979aea5644fc5bb060c893b0b5b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe16f946c5b4a3dbc82f2f66a74fbe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:11.789124 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-33569df2-a979-4bbd-b4d2-addb960022e6 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 200 len: 1371 microversion: 2.32 time: 1.242450 Aug 09 17:39:11.789660 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2593/4943] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:10 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 1371 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:12.757556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e20294d-30e2-40a2-8245-6a3ad990bb04 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:39:12.758221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1e20294d-30e2-40a2-8245-6a3ad990bb04 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:12.780593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e20294d-30e2-40a2-8245-6a3ad990bb04 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:12.783712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e20294d-30e2-40a2-8245-6a3ad990bb04 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:12.786971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e20294d-30e2-40a2-8245-6a3ad990bb04 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:12.790934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e20294d-30e2-40a2-8245-6a3ad990bb04 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:12.792748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e20294d-30e2-40a2-8245-6a3ad990bb04 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:12.794484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e20294d-30e2-40a2-8245-6a3ad990bb04 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:12.872747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-1e20294d-30e2-40a2-8245-6a3ad990bb04 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lazy-loading 'flavor' on Instance uuid 8deacdae-0205-41a6-b164-640022f2eef4 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:39:12.943950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b4e016c3-722c-4828-9169-9df1b6e053ee tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:12.959773 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b4e016c3-722c-4828-9169-9df1b6e053ee tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1494 microversion: 2.1 time: 1.318653 Aug 09 17:39:12.960674 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2351/4944] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:11 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1494 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:39:12.965825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:12.972376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:12.990305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:12.991123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:12.993732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:12.994877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:12.995549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:12.998747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:13.023663 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] HTTP exception thrown: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Request method failure captured: Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 HTTP/1.1 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pmpVbvV6n924c8MkxcYlr6U1Doa5S5rW6FxHqBHH-DQ92BGyNMYcIxGIILiQ4mFicBuzZD6Gcg2a3bMkX6iWxNYJ1fZFGAJM0zEJXc_OwIvKU21QZFJVrqLjIQwO_Tlfxfho6k9DGfA5AYJsvUIQeqr27esL9pw4oBoMo5LUWjo5Q8 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.32 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: ffe16f946c5b4a3dbc82f2f66a74fbe6 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TaggedBootDevicesTest-1572847585 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TaggedBootDevicesTest-1572847585 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: ffe16f946c5b4a3dbc82f2f66a74fbe6 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1572847585 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TaggedBootDevicesTest-1572847585-project Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 480979aea5644fc5bb060c893b0b5b05 Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TaggedBootDevicesTest-1572847585-project Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'da8fcac7-61be-4c8b-9ea5-82f88d299d92'} Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:13.026872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:13.032504 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:13.032504 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:13.032504 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:13.032504 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:13.032504 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:39:13.032504 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:39:13.032504 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:13.032504 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:13.036658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Returning 404 to user: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:39:13.038110 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-186beea5-b4c1-426d-b219-97d50f0bce14 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 404 len: 111 microversion: 2.32 time: 0.076190 Aug 09 17:39:13.043340 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2352/4945] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:12 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:39:13.049005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0a2b0461-ce6d-4125-98e9-4665faaeb000 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '.version_select at 0x7fbbca397ee0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:13.084804 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0a2b0461-ce6d-4125-98e9-4665faaeb000 tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-928410858" status: 204 len: 0 microversion: 2.32 time: 0.039940 Aug 09 17:39:13.089339 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2353/4946] 10.222.0.93 () {60 vars in 1259 bytes} [Tue Aug 9 17:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-928410858 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:39:13.636383 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e20294d-30e2-40a2-8245-6a3ad990bb04 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "POST /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/action" status: 202 len: 0 microversion: 2.20 time: 0.884749 Aug 09 17:39:13.636709 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2594/4947] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:39:12 2022] POST /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/action => generated 0 bytes in 887 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:39:13.665150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:13.667973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:13.687952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:13.689318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:13.690447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:13.692139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:13.694652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:13.696883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:14.008659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bbe77e69-eecb-4d74-bd5d-2b519cf7bf01 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:14.009465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bbe77e69-eecb-4d74-bd5d-2b519cf7bf01 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:14.060698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe77e69-eecb-4d74-bd5d-2b519cf7bf01 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:14.061307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe77e69-eecb-4d74-bd5d-2b519cf7bf01 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:14.064403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe77e69-eecb-4d74-bd5d-2b519cf7bf01 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:14.065206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe77e69-eecb-4d74-bd5d-2b519cf7bf01 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:14.070919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe77e69-eecb-4d74-bd5d-2b519cf7bf01 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:14.071341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbe77e69-eecb-4d74-bd5d-2b519cf7bf01 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:14.156790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:14.190370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:14.194354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:14.203671 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-038319be-fdb5-4b38-997e-b72ed598ea41 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1722 microversion: 2.20 time: 0.556915 Aug 09 17:39:14.209742 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2354/4948] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:13 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1722 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:39:14.228214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-98712d55-2ac7-4ca8-84fc-28cd216a391d req-f77bfe31-dd2e-49e1-b6b0-f02a9c6c7feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77e3b35-0756-4bdc-8188-21fbc830de23", "name": "network-vif-deleted", "tag": "63287c14-5470-4c8b-be9a-e7d403891d6a"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:39:14.320034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-98712d55-2ac7-4ca8-84fc-28cd216a391d req-f77bfe31-dd2e-49e1-b6b0-f02a9c6c7feb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:14.323085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-98712d55-2ac7-4ca8-84fc-28cd216a391d req-f77bfe31-dd2e-49e1-b6b0-f02a9c6c7feb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:14.324916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bbe77e69-eecb-4d74-bd5d-2b519cf7bf01 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:14.325488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-98712d55-2ac7-4ca8-84fc-28cd216a391d req-f77bfe31-dd2e-49e1-b6b0-f02a9c6c7feb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:14.340094 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bbe77e69-eecb-4d74-bd5d-2b519cf7bf01 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 200 len: 1452 microversion: 2.1 time: 0.339414 Aug 09 17:39:14.344392 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2595/4949] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:13 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 1452 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:39:14.420483 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-98712d55-2ac7-4ca8-84fc-28cd216a391d req-f77bfe31-dd2e-49e1-b6b0-f02a9c6c7feb service nova] Creating event network-vif-deleted:63287c14-5470-4c8b-be9a-e7d403891d6a for instance f77e3b35-0756-4bdc-8188-21fbc830de23 on n-h1-845781-6 Aug 09 17:39:14.453341 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-98712d55-2ac7-4ca8-84fc-28cd216a391d req-f77bfe31-dd2e-49e1-b6b0-f02a9c6c7feb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238829 Aug 09 17:39:14.455261 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2355/4950] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:39:15.247895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:15.252308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:15.316510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:15.317982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:15.323589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:15.332726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:15.333675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:15.334881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:15.386628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:15.387357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: f77e3b35-0756-4bdc-8188-21fbc830de23] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:15.403029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:15.404238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:15.405887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:15.410013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:15.411341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:15.412213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:15.447135 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] HTTP exception thrown: Instance f77e3b35-0756-4bdc-8188-21fbc830de23 could not be found. Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Request method failure captured: Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 HTTP/1.1 Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pkS_0b8ItkJO97o1bEJ5HRPxDD9WqTw4B54mMaSsBc9otrK3JnRrU3vGI9NL_jGO6L5V6mu39PI1DIc6ecdm5wHtaDqBnhlt31WibB3ymvtcQm3wOXoKuthF_k0m8v2oV46db59aVNUFJwuCCQA6VKNesTqzja4E13a59VpNmdK2aM Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 62572816b806440aa8338fea1d0a297e Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance f77e3b35-0756-4bdc-8188-21fbc830de23 could not be found. Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'f77e3b35-0756-4bdc-8188-21fbc830de23'} Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f77e3b35-0756-4bdc-8188-21fbc830de23 could not be found. Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f77e3b35-0756-4bdc-8188-21fbc830de23 could not be found. Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:15.449710 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:15.455941 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:15.455941 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:15.455941 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:15.455941 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:39:15.455941 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:39:15.455941 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f77e3b35-0756-4bdc-8188-21fbc830de23 could not be found. Aug 09 17:39:15.455941 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:15.460024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Returning 404 to user: Instance f77e3b35-0756-4bdc-8188-21fbc830de23 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:39:15.461152 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-08b9fba4-74ec-4506-b8c7-0101920c460a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23" status: 404 len: 111 microversion: 2.1 time: 0.079486 Aug 09 17:39:15.461924 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2356/4951] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:15 2022] GET /compute/v2.1/servers/f77e3b35-0756-4bdc-8188-21fbc830de23 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:39:15.470953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cab67a12-1b3e-43b6-b6ea-cbae6a6f8f95 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:15.472159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cab67a12-1b3e-43b6-b6ea-cbae6a6f8f95 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:15.480733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cab67a12-1b3e-43b6-b6ea-cbae6a6f8f95 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:15.481856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cab67a12-1b3e-43b6-b6ea-cbae6a6f8f95 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:15.482577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cab67a12-1b3e-43b6-b6ea-cbae6a6f8f95 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:15.483740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cab67a12-1b3e-43b6-b6ea-cbae6a6f8f95 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:15.484494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cab67a12-1b3e-43b6-b6ea-cbae6a6f8f95 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:15.485216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cab67a12-1b3e-43b6-b6ea-cbae6a6f8f95 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:15.522230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cab67a12-1b3e-43b6-b6ea-cbae6a6f8f95 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:39:15.529954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:39:15.649130 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cab67a12-1b3e-43b6-b6ea-cbae6a6f8f95 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 204 len: 0 microversion: 2.1 time: 0.182120 Aug 09 17:39:15.651515 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2357/4952] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:39:15 2022] DELETE /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:39:15.664225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ccf56ba2-6c3c-426b-9f7b-0ad0eb928a86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:15.665537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ccf56ba2-6c3c-426b-9f7b-0ad0eb928a86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:15.673367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccf56ba2-6c3c-426b-9f7b-0ad0eb928a86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:15.675117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccf56ba2-6c3c-426b-9f7b-0ad0eb928a86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:15.676012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccf56ba2-6c3c-426b-9f7b-0ad0eb928a86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:15.677935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccf56ba2-6c3c-426b-9f7b-0ad0eb928a86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:15.679095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccf56ba2-6c3c-426b-9f7b-0ad0eb928a86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:15.679801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccf56ba2-6c3c-426b-9f7b-0ad0eb928a86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:16.101864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:16.102163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ccf56ba2-6c3c-426b-9f7b-0ad0eb928a86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:16.124303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:16.126544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:16.128159 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-46e294a4-a17c-4a50-a352-7c1c4c141c06 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1722 microversion: 2.20 time: 0.896520 Aug 09 17:39:16.135579 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ccf56ba2-6c3c-426b-9f7b-0ad0eb928a86 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1675 microversion: 2.1 time: 0.476893 Aug 09 17:39:16.144407 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2358/4953] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:15 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1675 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:39:16.146678 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2596/4954] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:15 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1722 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:39:17.164953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:17.169234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:17.184282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e8afee9-1631-4885-9f98-f979f487bca2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:17.184282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6e8afee9-1631-4885-9f98-f979f487bca2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:17.208213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e8afee9-1631-4885-9f98-f979f487bca2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:17.208785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e8afee9-1631-4885-9f98-f979f487bca2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:17.209252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e8afee9-1631-4885-9f98-f979f487bca2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:17.210115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e8afee9-1631-4885-9f98-f979f487bca2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:17.210591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e8afee9-1631-4885-9f98-f979f487bca2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:17.211036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e8afee9-1631-4885-9f98-f979f487bca2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:17.235824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:17.241087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:17.244915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:17.252599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:17.255424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:17.262509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:18.010336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e8afee9-1631-4885-9f98-f979f487bca2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:18.048158 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e8afee9-1631-4885-9f98-f979f487bca2 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1675 microversion: 2.1 time: 0.869893 Aug 09 17:39:18.052161 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2597/4955] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:17 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1675 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:39:18.399658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:18.440475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:18.455033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:18.457482 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-796bd68f-c170-4c80-a149-81ca6f88e88c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1722 microversion: 2.20 time: 1.305618 Aug 09 17:39:18.463265 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2359/4956] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:17 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1722 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:19.098985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b489b24b-fa59-4744-9e0c-17962c4b81bf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:19.101298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b489b24b-fa59-4744-9e0c-17962c4b81bf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:19.137644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b489b24b-fa59-4744-9e0c-17962c4b81bf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:19.138751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b489b24b-fa59-4744-9e0c-17962c4b81bf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:19.139424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b489b24b-fa59-4744-9e0c-17962c4b81bf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:19.141383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b489b24b-fa59-4744-9e0c-17962c4b81bf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:19.142149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b489b24b-fa59-4744-9e0c-17962c4b81bf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:19.152585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b489b24b-fa59-4744-9e0c-17962c4b81bf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:19.492623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:19.495101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:19.531639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:19.532859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:19.537046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:19.538773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:19.540125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:19.545231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:20.778788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:20.824665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:20.835214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:20.842303 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4db37bb5-995c-4a05-8265-863a71f10615 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1722 microversion: 2.20 time: 1.359994 Aug 09 17:39:20.859668 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2360/4957] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:19 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1722 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:20.962656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b489b24b-fa59-4744-9e0c-17962c4b81bf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:21.003051 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b489b24b-fa59-4744-9e0c-17962c4b81bf tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1675 microversion: 2.1 time: 1.911973 Aug 09 17:39:21.005015 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2598/4958] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:19 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1675 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:39:21.898017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:21.902156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:21.917594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:21.919060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:21.920482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:21.923389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:21.925117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:21.926847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:22.048275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e4083317-ee64-4368-9839-bdec2e90ad7a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:22.053526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e4083317-ee64-4368-9839-bdec2e90ad7a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:22.065035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4083317-ee64-4368-9839-bdec2e90ad7a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:22.066438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4083317-ee64-4368-9839-bdec2e90ad7a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:22.068104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4083317-ee64-4368-9839-bdec2e90ad7a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:22.069772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4083317-ee64-4368-9839-bdec2e90ad7a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:22.071103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4083317-ee64-4368-9839-bdec2e90ad7a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:22.072346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4083317-ee64-4368-9839-bdec2e90ad7a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:22.426461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4083317-ee64-4368-9839-bdec2e90ad7a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:22.471494 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e4083317-ee64-4368-9839-bdec2e90ad7a tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1608 microversion: 2.1 time: 0.432032 Aug 09 17:39:22.500946 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2599/4959] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:22 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1608 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:39:23.078058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:23.140428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:23.154780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:23.166047 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7332c6a9-625f-4d32-b8d8-83e7f9fe21fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1722 microversion: 2.20 time: 1.276745 Aug 09 17:39:23.176157 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2361/4960] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:21 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1722 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:23.523570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bb6d2100-8bff-4a4c-9f29-7d682176e13f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:23.525959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bb6d2100-8bff-4a4c-9f29-7d682176e13f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:23.545845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:39:23.606480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb6d2100-8bff-4a4c-9f29-7d682176e13f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:23.608302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb6d2100-8bff-4a4c-9f29-7d682176e13f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:23.608302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb6d2100-8bff-4a4c-9f29-7d682176e13f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:23.623737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb6d2100-8bff-4a4c-9f29-7d682176e13f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:23.624753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb6d2100-8bff-4a4c-9f29-7d682176e13f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:23.625547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb6d2100-8bff-4a4c-9f29-7d682176e13f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:23.668895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:39:24.042239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-239d1c00-8f30-46ff-a563-858e9eb6d0e8 req-b487171e-c6c6-4797-a700-d31bf397010b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a30c674-6026-45bd-b50e-218ae7d69382", "name": "network-vif-deleted", "tag": "a73935e9-c581-4296-b0ba-805a64e85308"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:39:24.142327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:39:24.178544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-239d1c00-8f30-46ff-a563-858e9eb6d0e8 req-b487171e-c6c6-4797-a700-d31bf397010b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:24.185503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-239d1c00-8f30-46ff-a563-858e9eb6d0e8 req-b487171e-c6c6-4797-a700-d31bf397010b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:24.186585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-239d1c00-8f30-46ff-a563-858e9eb6d0e8 req-b487171e-c6c6-4797-a700-d31bf397010b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:24.290379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bb6d2100-8bff-4a4c-9f29-7d682176e13f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62572816b806440aa8338fea1d0a297e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e28a1803f040bd91230e6b0e71a6bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:24.314593 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bb6d2100-8bff-4a4c-9f29-7d682176e13f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 200 len: 1608 microversion: 2.1 time: 0.798368 Aug 09 17:39:24.316919 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2600/4961] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:23 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 1608 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:39:24.340459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:24.344374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:24.355998 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-239d1c00-8f30-46ff-a563-858e9eb6d0e8 req-b487171e-c6c6-4797-a700-d31bf397010b service nova] Creating event network-vif-deleted:a73935e9-c581-4296-b0ba-805a64e85308 for instance 1a30c674-6026-45bd-b50e-218ae7d69382 on n-h2-845781-6 Aug 09 17:39:24.360967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:24.364977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:24.365842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:24.366861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:24.370075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:24.370915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:24.401163 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-239d1c00-8f30-46ff-a563-858e9eb6d0e8 req-b487171e-c6c6-4797-a700-d31bf397010b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.355676 Aug 09 17:39:24.403509 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2362/4962] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:39:25.139261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:25.159400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:25.164312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:25.167460 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7733a275-cdf1-4db8-bf0b-04d02e3365af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1743 microversion: 2.20 time: 0.848462 Aug 09 17:39:25.184818 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2601/4963] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:24 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1743 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:25.364097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:25.364885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] [instance: 1a30c674-6026-45bd-b50e-218ae7d69382] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:25.388042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:25.388738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:25.389218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:25.390030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:25.390519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:25.390975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:25.456762 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] HTTP exception thrown: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 could not be found. Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Request method failure captured: Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 HTTP/1.1 Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pkS_0b8ItkJO97o1bEJ5HRPxDD9WqTw4B54mMaSsBc9otrK3JnRrU3vGI9NL_jGO6L5V6mu39PI1DIc6ecdm5wHtaDqBnhlt31WibB3ymvtcQm3wOXoKuthF_k0m8v2oV46db59aVNUFJwuCCQA6VKNesTqzja4E13a59VpNmdK2aM Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/69e28a1803f040bd91230e6b0e71a6bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 69e28a1803f040bd91230e6b0e71a6bf Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerActionsTestJSON-1261987552 Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 62572816b806440aa8338fea1d0a297e Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerActionsTestJSON-1261987552-project Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 could not be found. Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '1a30c674-6026-45bd-b50e-218ae7d69382'} Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 could not be found. Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 could not be found. Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:25.464449 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:25.469982 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:25.469982 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:25.469982 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:25.469982 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:39:25.469982 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:39:25.469982 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 could not be found. Aug 09 17:39:25.469982 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:39:25.472355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Returning 404 to user: Instance 1a30c674-6026-45bd-b50e-218ae7d69382 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:39:25.473712 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b2b0ab83-6ae5-402e-b8e6-68c6b3a1d47f tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382" status: 404 len: 111 microversion: 2.1 time: 0.114815 Aug 09 17:39:25.476052 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2363/4964] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:25 2022] GET /compute/v2.1/servers/1a30c674-6026-45bd-b50e-218ae7d69382 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:39:25.486618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-496d30dd-9458-4805-b777-f311b68fb5c7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] Calling method '.version_select at 0x7fbbcb9d6dc0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:25.550505 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-496d30dd-9458-4805-b777-f311b68fb5c7 tempest-ServerActionsTestJSON-1261987552 tempest-ServerActionsTestJSON-1261987552-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947852563" status: 202 len: 0 microversion: 2.1 time: 0.069005 Aug 09 17:39:25.557372 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2602/4965] 10.222.0.93 () {58 vars in 1221 bytes} [Tue Aug 9 17:39:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947852563 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:39:26.232614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:26.233355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:26.272903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:26.273873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:26.282298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:26.284297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:26.285226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:26.286408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:28.488974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:28.518070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:28.521576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:28.526477 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a4be0e70-d9c1-40d8-ad52-bee1fdaa7131 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 2.298674 Aug 09 17:39:28.551762 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2364/4966] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:26 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 2326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:29.556951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:29.558221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:29.578273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:29.584482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:29.585258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:29.586246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:29.586922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:29.587579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:30.718116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:30.728183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:30.742922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:30.745465 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4073f09c-bb85-4510-82c5-5e103ddf5890 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 1.194548 Aug 09 17:39:30.758635 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2603/4967] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:29 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:31.797815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:31.802055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:31.833867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:31.843143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:31.850034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:31.856498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:31.860802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:31.876094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:33.250179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c34b9e12-ceee-41d5-bd3b-64fad7fbd9a9 req-12864153-c190-40ff-9234-edc0d4ec1955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deacdae-0205-41a6-b164-640022f2eef4", "name": "network-vif-plugged", "status": "completed", "tag": "a322ddf6-871d-4af1-8243-03824c9855a1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:39:33.286335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c34b9e12-ceee-41d5-bd3b-64fad7fbd9a9 req-12864153-c190-40ff-9234-edc0d4ec1955 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:33.287405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c34b9e12-ceee-41d5-bd3b-64fad7fbd9a9 req-12864153-c190-40ff-9234-edc0d4ec1955 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:33.289612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c34b9e12-ceee-41d5-bd3b-64fad7fbd9a9 req-12864153-c190-40ff-9234-edc0d4ec1955 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:33.347719 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c34b9e12-ceee-41d5-bd3b-64fad7fbd9a9 req-12864153-c190-40ff-9234-edc0d4ec1955 service nova] Creating event network-vif-plugged:a322ddf6-871d-4af1-8243-03824c9855a1 for instance 8deacdae-0205-41a6-b164-640022f2eef4 on n-h2-845781-6 Aug 09 17:39:33.360836 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c34b9e12-ceee-41d5-bd3b-64fad7fbd9a9 req-12864153-c190-40ff-9234-edc0d4ec1955 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115081 Aug 09 17:39:33.361856 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2604/4968] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:39:34.039822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:34.066464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:34.072576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:34.084547 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6dfed327-dde0-4915-9539-2c99712d5f17 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 2.293021 Aug 09 17:39:34.089175 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2365/4969] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:31 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 2300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:35.115728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:35.118280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:35.146533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:35.148309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:35.149012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:35.153092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:35.156240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:35.157066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:35.860407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:35.898102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:35.913741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:35.915213 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f05fb40-3b3d-485c-a1bf-bc2fbca23d96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 0.807763 Aug 09 17:39:35.917200 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2605/4970] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:35 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:36.940322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:36.941773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:36.963875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:36.975864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:36.976695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:36.980743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:36.984250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:36.987755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:40.250824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:40.300682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:40.305331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:40.311508 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-45beac3f-97a9-4112-a55e-056cb5c8855a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 3.374789 Aug 09 17:39:40.312563 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2366/4971] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:36 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 3378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:41.211235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:41.214805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:41.288580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:41.289858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:41.290757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:41.293809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:41.294615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:41.295338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:41.342766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:41.343926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:41.393258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:41.394132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:41.394947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:41.409347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:41.410880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:41.411751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:41.422391 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] HTTP exception thrown: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Request method failure captured: Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 HTTP/1.1 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmpVbvV6n924c8MkxcYlr6U1Doa5S5rW6FxHqBHH-DQ92BGyNMYcIxGIILiQ4mFicBuzZD6Gcg2a3bMkX6iWxNYJ1fZFGAJM0zEJXc_OwIvKU21QZFJVrqLjIQwO_Tlfxfho6k9DGfA5AYJsvUIQeqr27esL9pw4oBoMo5LUWjo5Q8 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.32 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ffe16f946c5b4a3dbc82f2f66a74fbe6 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TaggedBootDevicesTest-1572847585 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TaggedBootDevicesTest-1572847585 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ffe16f946c5b4a3dbc82f2f66a74fbe6 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1572847585 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TaggedBootDevicesTest-1572847585-project Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 480979aea5644fc5bb060c893b0b5b05 Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TaggedBootDevicesTest-1572847585-project Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'da8fcac7-61be-4c8b-9ea5-82f88d299d92'} Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:39:41.426030 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:39:41.429576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:41.429576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:39:41.429576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:41.429576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:39:41.429576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:41.429576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:41.429576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:41.429576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:39:41.429576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:39:41.429576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:41.429576 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:39:41.443279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Returning 404 to user: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:39:41.444949 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3de85604-2b30-406c-8bf8-cfc84cba96df tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 404 len: 111 microversion: 2.32 time: 0.241818 Aug 09 17:39:41.448593 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2606/4972] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:39:41 2022] DELETE /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 111 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:39:41.459771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:41.460762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] [instance: da8fcac7-61be-4c8b-9ea5-82f88d299d92] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:41.478125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:41.479008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:41.479661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:41.480643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:41.484033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:41.484942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:41.521866 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] HTTP exception thrown: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Request method failure captured: Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 HTTP/1.1 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pmpVbvV6n924c8MkxcYlr6U1Doa5S5rW6FxHqBHH-DQ92BGyNMYcIxGIILiQ4mFicBuzZD6Gcg2a3bMkX6iWxNYJ1fZFGAJM0zEJXc_OwIvKU21QZFJVrqLjIQwO_Tlfxfho6k9DGfA5AYJsvUIQeqr27esL9pw4oBoMo5LUWjo5Q8 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.32 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ffe16f946c5b4a3dbc82f2f66a74fbe6 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TaggedBootDevicesTest-1572847585 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ffe16f946c5b4a3dbc82f2f66a74fbe6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TaggedBootDevicesTest-1572847585 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ffe16f946c5b4a3dbc82f2f66a74fbe6 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1572847585 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TaggedBootDevicesTest-1572847585-project Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 480979aea5644fc5bb060c893b0b5b05 Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TaggedBootDevicesTest-1572847585-project Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'da8fcac7-61be-4c8b-9ea5-82f88d299d92'} Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:39:41.523842 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:39:41.526955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:39:41.526955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:39:41.526955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:39:41.526955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:39:41.526955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:39:41.526955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:39:41.526955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. Aug 09 17:39:41.526955 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:39:41.530968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] Returning 404 to user: Instance da8fcac7-61be-4c8b-9ea5-82f88d299d92 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:39:41.532603 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d4bbf47f-c1f4-48b6-b637-978b1561a7fa tempest-TaggedBootDevicesTest-1572847585 tempest-TaggedBootDevicesTest-1572847585-project] 10.222.0.93 "GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92" status: 404 len: 111 microversion: 2.32 time: 0.076855 Aug 09 17:39:41.533650 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2607/4973] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:41 2022] GET /compute/v2.1/servers/da8fcac7-61be-4c8b-9ea5-82f88d299d92 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:39:42.469999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:42.510029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:42.541834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:42.572717 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4ddf1060-9ea8-4beb-876a-d0638a8217fb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 1.225042 Aug 09 17:39:42.584184 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2367/4974] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:41 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:42.659520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8224dbbc-4965-4348-a8e0-c685223ee04a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Action: 'create', calling method: .version_select at 0x7fbbcb566dc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1054273672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5Jg8P/bTjtjOIqMbFliyyjCkQMBjOIzWcjIcm45WiQcH1futgrk36WibNXF65VliZuCb5T1BPhuTFBoHSAg2GjOpFSysFvDyu9YYaM+wCM+hljccWoyyH77FGzW/XORQ=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:39:42.828287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8224dbbc-4965-4348-a8e0-c685223ee04a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for project 95efa122e86846beb9abcb02ac118e94. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:39:42.854509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8224dbbc-4965-4348-a8e0-c685223ee04a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for user cbb30087336245ce95a13efe7c2f382e and project 95efa122e86846beb9abcb02ac118e94. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:39:42.964147 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8224dbbc-4965-4348-a8e0-c685223ee04a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.312821 Aug 09 17:39:42.969403 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2608/4975] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:39:42 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:39:43.607396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:43.620422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:43.662884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:43.663989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:43.664898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:43.680248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:43.682094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:43.683546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:45.460407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:45.500131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:45.513707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:45.521784 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-101cfb66-973f-4301-b3c5-7a9684a08739 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 1.919546 Aug 09 17:39:45.526473 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2368/4976] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:43 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:46.554642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:46.555677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:46.579375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:46.582553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:46.584949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:46.586895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:46.587780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:46.589610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:47.514204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:47.569355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:47.575810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:47.592702 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b8e4f03-3f9a-438d-a90a-6cb670483ac6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 1.045497 Aug 09 17:39:47.603383 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2609/4977] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:46 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:48.638617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:48.650119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:48.696527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:48.699356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:48.700157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:48.710761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:48.712599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:48.714760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:48.728485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:39:50.229330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:50.267660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:50.277179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:50.280037 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ed937ebc-90ad-4a00-9354-37ccef116a13 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 1.651408 Aug 09 17:39:50.284509 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2369/4978] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:48 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:51.307174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:51.308602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:51.325480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:51.326596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:51.331042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:51.333006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:51.333749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:51.336754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:52.690570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:52.714165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:52.721710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:52.726840 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-74d1ba43-643a-485b-a880-2f8d8ed52bd8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 1.423454 Aug 09 17:39:52.728841 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2610/4979] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:51 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:53.790875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:53.792270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:53.824449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:53.831844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:53.838048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:53.849284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:53.854783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:53.859242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:54.350220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1981869781", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "36fe2f5c-a852-4009-abfb-7c3982e6b386"}], "key_name": "tempest-TestNetworkBasicOps-1054273672", "security_groups": [{"name": "tempest-secgroup-smoke-1256792538"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:39:54.391435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:39:54.399421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:39:54.973402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:54.978782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] validate_networks() for [('36fe2f5c-a852-4009-abfb-7c3982e6b386', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:39:54.990450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:55.011565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:55.016846 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d2fadfbb-3cce-4324-82e0-c6e301764529 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 1.242016 Aug 09 17:39:55.020672 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2370/4980] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:53 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:39:56.046588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:56.047543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:56.058262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=18 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:39:56.093050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:56.100042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:56.105817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:56.105817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:56.123045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:56.126523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:57.587239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:39:57.588374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:39:57.592750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:39:57.593657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:39:57.594440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:39:57.705643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:57.742419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:57.744644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:57.744919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:57.759013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:57.771843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:57.776241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:57.778034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:57.797862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:57.804073 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fa9489d8-846c-43a6-b636-5859036efd76 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 1.761174 Aug 09 17:39:57.812914 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2371/4981] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:56 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:39:57.904148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=42 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:39:58.006988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for project 95efa122e86846beb9abcb02ac118e94. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:39:58.066488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for user cbb30087336245ce95a13efe7c2f382e and project 95efa122e86846beb9abcb02ac118e94. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:39:58.186387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:39:58.218392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:39:58.533274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-faa6dd0b-9c1d-4086-9e5a-3f2836818bdf tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.186937 Aug 09 17:39:58.562926 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2611/4982] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:39:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 4218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:39:58.566846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ae6d66f4-1948-4a3e-9687-1dd2ac0c1d95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:58.567610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ae6d66f4-1948-4a3e-9687-1dd2ac0c1d95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:58.854597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:39:58.856410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:39:58.916566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:58.917495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:58.918302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:58.919593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:39:58.920499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:39:58.921282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:39:59.264079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ae6d66f4-1948-4a3e-9687-1dd2ac0c1d95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:39:59.311930 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ae6d66f4-1948-4a3e-9687-1dd2ac0c1d95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1249 microversion: 2.1 time: 0.749014 Aug 09 17:39:59.316028 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2372/4983] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:39:58 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1249 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:00.347927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fb66a53e-cc8c-4b6b-b594-cbcc250cadde tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:00.349538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fb66a53e-cc8c-4b6b-b594-cbcc250cadde tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:00.858080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:00.875904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:00.884559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:00.887151 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-33ca8e1b-e34a-4684-b52d-67992386211f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 2.040631 Aug 09 17:40:00.890330 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2612/4984] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:39:58 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:40:01.251539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fb66a53e-cc8c-4b6b-b594-cbcc250cadde tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:01.289687 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fb66a53e-cc8c-4b6b-b594-cbcc250cadde tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1249 microversion: 2.1 time: 0.945946 Aug 09 17:40:01.298742 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2373/4985] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:00 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1249 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:01.929249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:01.930540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:01.957142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:01.957986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:01.968058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:01.969549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:01.970326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:01.971099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:02.340576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-badef467-4785-43b0-abc6-eb03e2f32cd3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:02.351089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-badef467-4785-43b0-abc6-eb03e2f32cd3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:02.455744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-badef467-4785-43b0-abc6-eb03e2f32cd3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:02.464243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-badef467-4785-43b0-abc6-eb03e2f32cd3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:02.465084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-badef467-4785-43b0-abc6-eb03e2f32cd3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:02.480398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-badef467-4785-43b0-abc6-eb03e2f32cd3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:02.484957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-badef467-4785-43b0-abc6-eb03e2f32cd3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:02.491112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-badef467-4785-43b0-abc6-eb03e2f32cd3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:02.819250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:02.840000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:02.851083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:02.853127 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a02920ec-d46b-43c3-829e-239b2e91bfce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 0.929822 Aug 09 17:40:02.856845 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2613/4986] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:01 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:03.614758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-badef467-4785-43b0-abc6-eb03e2f32cd3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:03.653047 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-badef467-4785-43b0-abc6-eb03e2f32cd3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1319 microversion: 2.1 time: 1.318540 Aug 09 17:40:03.683378 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2374/4987] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:02 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1319 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:03.913541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:03.914404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:03.942950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:03.947261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:03.956065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:03.957240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:03.957934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:03.960665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:04.691890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-407b23b6-7258-44e9-9df7-9c3c1677a25c tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:04.693352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-407b23b6-7258-44e9-9df7-9c3c1677a25c tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:04.710701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-407b23b6-7258-44e9-9df7-9c3c1677a25c tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:04.713452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-407b23b6-7258-44e9-9df7-9c3c1677a25c tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:04.714226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-407b23b6-7258-44e9-9df7-9c3c1677a25c tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:04.717498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-407b23b6-7258-44e9-9df7-9c3c1677a25c tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:04.721305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-407b23b6-7258-44e9-9df7-9c3c1677a25c tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:04.722121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-407b23b6-7258-44e9-9df7-9c3c1677a25c tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:05.105995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-407b23b6-7258-44e9-9df7-9c3c1677a25c tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:05.123509 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-407b23b6-7258-44e9-9df7-9c3c1677a25c tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1307 microversion: 2.1 time: 0.435995 Aug 09 17:40:05.135934 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2375/4988] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:04 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1307 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:06.193926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e31f7dd3-4013-4aea-b947-7e3b4270968d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:06.196696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e31f7dd3-4013-4aea-b947-7e3b4270968d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:06.222343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e31f7dd3-4013-4aea-b947-7e3b4270968d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:06.224039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e31f7dd3-4013-4aea-b947-7e3b4270968d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:06.225008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e31f7dd3-4013-4aea-b947-7e3b4270968d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:06.226512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e31f7dd3-4013-4aea-b947-7e3b4270968d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:06.239937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e31f7dd3-4013-4aea-b947-7e3b4270968d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:06.246577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e31f7dd3-4013-4aea-b947-7e3b4270968d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:06.464065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:06.474324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:06.481890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:06.489826 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1f30e12-2091-413b-a818-bf7de7328636 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 2.594303 Aug 09 17:40:06.496317 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2614/4989] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:03 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 2601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:40:06.545127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e31f7dd3-4013-4aea-b947-7e3b4270968d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:06.587826 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e31f7dd3-4013-4aea-b947-7e3b4270968d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1307 microversion: 2.1 time: 0.419431 Aug 09 17:40:06.596142 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2376/4990] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:06 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1307 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:07.570547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:07.580044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:07.629192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c4025673-78f2-460e-8e93-b7410c0e75fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:07.633555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c4025673-78f2-460e-8e93-b7410c0e75fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:07.646831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4025673-78f2-460e-8e93-b7410c0e75fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:07.649632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:07.651131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:07.656726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:07.658550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:07.662236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:07.665227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:07.667761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4025673-78f2-460e-8e93-b7410c0e75fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:07.669713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4025673-78f2-460e-8e93-b7410c0e75fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:07.673037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4025673-78f2-460e-8e93-b7410c0e75fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:07.673901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4025673-78f2-460e-8e93-b7410c0e75fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:07.674693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c4025673-78f2-460e-8e93-b7410c0e75fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:07.899517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:08.125874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:09.564312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c4025673-78f2-460e-8e93-b7410c0e75fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:09.588386 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c4025673-78f2-460e-8e93-b7410c0e75fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1307 microversion: 2.1 time: 1.963872 Aug 09 17:40:09.590252 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2377/4991] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:07 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1307 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:40:10.332045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:10.356951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:10.369508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:10.373380 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e2a2e39f-8504-4357-a8fc-0619e50dd17e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 2.836991 Aug 09 17:40:10.403665 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2615/4992] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:07 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 2853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:10.627053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-295fc7f5-f343-47d7-9be7-ad2c1de58029 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:10.628118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-295fc7f5-f343-47d7-9be7-ad2c1de58029 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:10.654009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-295fc7f5-f343-47d7-9be7-ad2c1de58029 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:10.654513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-295fc7f5-f343-47d7-9be7-ad2c1de58029 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:10.654965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-295fc7f5-f343-47d7-9be7-ad2c1de58029 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:10.673669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-295fc7f5-f343-47d7-9be7-ad2c1de58029 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:10.674283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-295fc7f5-f343-47d7-9be7-ad2c1de58029 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:10.674749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-295fc7f5-f343-47d7-9be7-ad2c1de58029 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:11.259601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:11.395951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-295fc7f5-f343-47d7-9be7-ad2c1de58029 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:11.427368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:11.436610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:11.455088 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-295fc7f5-f343-47d7-9be7-ad2c1de58029 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1307 microversion: 2.1 time: 0.826030 Aug 09 17:40:11.458324 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2378/4993] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:10 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1307 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:11.501373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:11.502829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:11.507230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:11.515765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:11.519031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:11.524132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:12.512383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-86860bca-ddea-487b-8e06-c20e5ea27a8f tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:12.514460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-86860bca-ddea-487b-8e06-c20e5ea27a8f tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:12.541821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86860bca-ddea-487b-8e06-c20e5ea27a8f tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:12.543172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86860bca-ddea-487b-8e06-c20e5ea27a8f tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:12.544307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86860bca-ddea-487b-8e06-c20e5ea27a8f tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:12.545841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86860bca-ddea-487b-8e06-c20e5ea27a8f tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:12.549485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86860bca-ddea-487b-8e06-c20e5ea27a8f tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:12.556791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86860bca-ddea-487b-8e06-c20e5ea27a8f tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:13.166633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-86860bca-ddea-487b-8e06-c20e5ea27a8f tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:13.221700 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-86860bca-ddea-487b-8e06-c20e5ea27a8f tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1307 microversion: 2.1 time: 0.723661 Aug 09 17:40:13.245279 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2379/4994] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:12 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1307 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:40:13.404996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:13.457745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:13.479867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:13.482255 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5aff8c10-72d8-422f-9022-09b2951a4657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1738 microversion: 2.20 time: 2.063702 Aug 09 17:40:13.483298 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2616/4995] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:11 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1738 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:40:14.273590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b9e90d09-876f-4ec4-86e3-3cafbe2a51c5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:14.274644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b9e90d09-876f-4ec4-86e3-3cafbe2a51c5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:14.340936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9e90d09-876f-4ec4-86e3-3cafbe2a51c5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:14.341995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9e90d09-876f-4ec4-86e3-3cafbe2a51c5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:14.342971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9e90d09-876f-4ec4-86e3-3cafbe2a51c5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:14.363017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9e90d09-876f-4ec4-86e3-3cafbe2a51c5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:14.364602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9e90d09-876f-4ec4-86e3-3cafbe2a51c5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:14.365437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9e90d09-876f-4ec4-86e3-3cafbe2a51c5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:14.529816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:14.531896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:14.586119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:14.591706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:14.595700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:14.600766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:14.608077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:14.623202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:15.413513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:15.469666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:15.487399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:15.489986 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3f47a554-8bdc-46a1-938a-aaa0e4618af6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1720 microversion: 2.20 time: 0.966329 Aug 09 17:40:15.540185 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2617/4996] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:14 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1720 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:16.559199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:16.569964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:16.625068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:16.643483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:16.661072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:16.669150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:16.672926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:16.676811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:16.871987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b9e90d09-876f-4ec4-86e3-3cafbe2a51c5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:16.906188 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b9e90d09-876f-4ec4-86e3-3cafbe2a51c5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 2.642027 Aug 09 17:40:16.917482 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2380/4997] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:14 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 2655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:17.957955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7895e1c5-9f84-420b-8436-8a3629bda547 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:17.958968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7895e1c5-9f84-420b-8436-8a3629bda547 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:17.970634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7895e1c5-9f84-420b-8436-8a3629bda547 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:17.976053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7895e1c5-9f84-420b-8436-8a3629bda547 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:17.976633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7895e1c5-9f84-420b-8436-8a3629bda547 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:17.977558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7895e1c5-9f84-420b-8436-8a3629bda547 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:17.978125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7895e1c5-9f84-420b-8436-8a3629bda547 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:17.978673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7895e1c5-9f84-420b-8436-8a3629bda547 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:18.117998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:18.178838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:18.194351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:18.196905 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-18aa8b80-ce92-4997-b117-4e851bd61fe2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1720 microversion: 2.20 time: 1.647511 Aug 09 17:40:18.197805 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2618/4998] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:16 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1720 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:40:19.380126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-77302e3b-41d5-4fab-b77e-be9fb387478d req-3ff86014-ed8d-4433-8c18-36d665409750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deacdae-0205-41a6-b164-640022f2eef4", "name": "network-vif-unplugged", "status": "completed", "tag": "a322ddf6-871d-4af1-8243-03824c9855a1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:40:19.393410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-77302e3b-41d5-4fab-b77e-be9fb387478d req-3ff86014-ed8d-4433-8c18-36d665409750 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:19.394292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-77302e3b-41d5-4fab-b77e-be9fb387478d req-3ff86014-ed8d-4433-8c18-36d665409750 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:19.394934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-77302e3b-41d5-4fab-b77e-be9fb387478d req-3ff86014-ed8d-4433-8c18-36d665409750 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:19.421131 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-77302e3b-41d5-4fab-b77e-be9fb387478d req-3ff86014-ed8d-4433-8c18-36d665409750 service nova] Creating event network-vif-unplugged:a322ddf6-871d-4af1-8243-03824c9855a1 for instance 8deacdae-0205-41a6-b164-640022f2eef4 on n-h2-845781-6 Aug 09 17:40:19.442404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-77302e3b-41d5-4fab-b77e-be9fb387478d req-3ff86014-ed8d-4433-8c18-36d665409750 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.476077 Aug 09 17:40:19.443542 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2619/4999] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:40:19.472874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:19.480455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:19.499445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:19.500899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:19.501904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:19.514206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:19.515108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:19.515980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:19.896799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:19.912092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:19.918289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:19.922384 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-555c6d8a-93f6-4f92-a95e-0a7898169cf2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1720 microversion: 2.20 time: 0.457140 Aug 09 17:40:19.940605 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2620/5000] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:19 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1720 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:20.613761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7895e1c5-9f84-420b-8436-8a3629bda547 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:20.636645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=64 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:20.640639 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7895e1c5-9f84-420b-8436-8a3629bda547 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 2.686715 Aug 09 17:40:20.654635 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2381/5001] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:17 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:40:20.949564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:20.950424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:20.977519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:20.980535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:20.981321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:20.982288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:20.984999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:20.985763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:21.345174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:21.359900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:21.369016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:21.372154 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d03f9a05-9281-4541-83f4-58fda1a32a9d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1720 microversion: 2.20 time: 0.426437 Aug 09 17:40:21.384852 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2621/5002] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:20 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1720 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:21.667529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e666740d-6f2d-436e-99cb-749076b43538 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:21.668922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e666740d-6f2d-436e-99cb-749076b43538 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:21.692753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e666740d-6f2d-436e-99cb-749076b43538 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:21.693265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e666740d-6f2d-436e-99cb-749076b43538 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:21.694719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e666740d-6f2d-436e-99cb-749076b43538 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:21.707190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e666740d-6f2d-436e-99cb-749076b43538 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:21.708281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e666740d-6f2d-436e-99cb-749076b43538 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:21.708738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e666740d-6f2d-436e-99cb-749076b43538 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:22.364254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e666740d-6f2d-436e-99cb-749076b43538 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:22.378616 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e666740d-6f2d-436e-99cb-749076b43538 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 0.716761 Aug 09 17:40:22.387691 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2382/5003] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:21 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:22.427355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:22.429973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:22.447022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:22.450801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:22.451886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:22.466614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:22.468624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:22.470106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:22.499048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e49e7b8a-640a-4470-8441-03858a048830 req-741a06cd-fc53-4af7-809e-5895427b6a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2dffdb-cb37-41f1-985b-63d3c84f8894", "tag": "c7ce58af-3ea5-40a3-a8a3-1c38d41c3ce7"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:40:22.534441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e49e7b8a-640a-4470-8441-03858a048830 req-741a06cd-fc53-4af7-809e-5895427b6a36 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:22.536002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e49e7b8a-640a-4470-8441-03858a048830 req-741a06cd-fc53-4af7-809e-5895427b6a36 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:22.540763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e49e7b8a-640a-4470-8441-03858a048830 req-741a06cd-fc53-4af7-809e-5895427b6a36 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:22.601145 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e49e7b8a-640a-4470-8441-03858a048830 req-741a06cd-fc53-4af7-809e-5895427b6a36 service nova] Creating event network-changed:c7ce58af-3ea5-40a3-a8a3-1c38d41c3ce7 for instance 4c2dffdb-cb37-41f1-985b-63d3c84f8894 on n-h1-845781-6 Aug 09 17:40:22.616349 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e49e7b8a-640a-4470-8441-03858a048830 req-741a06cd-fc53-4af7-809e-5895427b6a36 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127862 Aug 09 17:40:22.617394 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2383/5004] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:40:23.402576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-64e16a0f-6816-46c4-b185-517b3e3b599a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:23.404338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-64e16a0f-6816-46c4-b185-517b3e3b599a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:23.433481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64e16a0f-6816-46c4-b185-517b3e3b599a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:23.439902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64e16a0f-6816-46c4-b185-517b3e3b599a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:23.441747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64e16a0f-6816-46c4-b185-517b3e3b599a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:23.443644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64e16a0f-6816-46c4-b185-517b3e3b599a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:23.447876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64e16a0f-6816-46c4-b185-517b3e3b599a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:23.448963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64e16a0f-6816-46c4-b185-517b3e3b599a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:23.606975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:23.621849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:23.623516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:23.624963 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8771ae4e-4a88-47a5-9a49-105dcc3a5490 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1720 microversion: 2.20 time: 1.207011 Aug 09 17:40:23.630956 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2622/5005] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:22 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1720 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:24.134312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-64e16a0f-6816-46c4-b185-517b3e3b599a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:24.154480 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-64e16a0f-6816-46c4-b185-517b3e3b599a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 0.757033 Aug 09 17:40:24.167757 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2384/5006] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:23 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:40:24.651116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:24.652520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:24.659697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:24.685265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:24.686254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:24.696139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:24.697257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:24.699402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:24.703475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:25.189006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ac58ef56-d01d-4c84-9e0f-279e1f351ab9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:25.192932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ac58ef56-d01d-4c84-9e0f-279e1f351ab9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:25.244167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac58ef56-d01d-4c84-9e0f-279e1f351ab9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:25.249944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac58ef56-d01d-4c84-9e0f-279e1f351ab9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:25.254401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac58ef56-d01d-4c84-9e0f-279e1f351ab9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:25.257680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac58ef56-d01d-4c84-9e0f-279e1f351ab9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:25.260687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac58ef56-d01d-4c84-9e0f-279e1f351ab9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:25.262998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac58ef56-d01d-4c84-9e0f-279e1f351ab9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:25.442394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:25.467796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:25.471161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:25.486294 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5cb6bf1e-2588-4b9a-8795-d1e4d797102e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1663 microversion: 2.20 time: 0.839581 Aug 09 17:40:25.487554 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2623/5007] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:24 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1663 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:25.536804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-104d37bd-7ed6-4443-beea-3a713f73cc2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98aa7623-7394-4c50-b333-385c4c88901d"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:40:25.541239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-104d37bd-7ed6-4443-beea-3a713f73cc2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:25.578517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-104d37bd-7ed6-4443-beea-3a713f73cc2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:25.579415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-104d37bd-7ed6-4443-beea-3a713f73cc2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:25.580256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-104d37bd-7ed6-4443-beea-3a713f73cc2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:25.581786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-104d37bd-7ed6-4443-beea-3a713f73cc2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:25.582770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-104d37bd-7ed6-4443-beea-3a713f73cc2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:25.583455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-104d37bd-7ed6-4443-beea-3a713f73cc2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:26.269863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ac58ef56-d01d-4c84-9e0f-279e1f351ab9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:26.286868 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ac58ef56-d01d-4c84-9e0f-279e1f351ab9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 1.106989 Aug 09 17:40:26.287747 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2385/5008] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:25 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:40:26.313646 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-104d37bd-7ed6-4443-beea-3a713f73cc2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "POST /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.784770 Aug 09 17:40:26.314963 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2624/5009] 10.222.0.93 () {62 vars in 1364 bytes} [Tue Aug 9 17:40:25 2022] POST /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 188 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 17:40:26.723138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:40:26.724273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:26.734703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=34 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:26.736454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:26.737040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:26.737489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:26.738274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:26.738858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:26.739327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:26.892582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119432) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 09 17:40:27.089849 n-d-845781-6 devstack@n-api.service[119432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [f16fc364-b9b3-4351-a431-d2fb5d977256] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 17:40:27.309076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-97f682a0-723c-4cf1-aed5-cf2b36e4aa9e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:27.309822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-97f682a0-723c-4cf1-aed5-cf2b36e4aa9e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:27.329097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97f682a0-723c-4cf1-aed5-cf2b36e4aa9e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:27.330035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97f682a0-723c-4cf1-aed5-cf2b36e4aa9e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:27.330394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97f682a0-723c-4cf1-aed5-cf2b36e4aa9e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:27.331619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97f682a0-723c-4cf1-aed5-cf2b36e4aa9e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:27.337686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97f682a0-723c-4cf1-aed5-cf2b36e4aa9e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:27.338481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97f682a0-723c-4cf1-aed5-cf2b36e4aa9e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:28.101121 n-d-845781-6 devstack@n-api.service[119432]: INFO oslo.messaging._drivers.impl_rabbit [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [f16fc364-b9b3-4351-a431-d2fb5d977256] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 37222. Aug 09 17:40:28.115565 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8c9d655b-8c83-4cc7-b218-cd53888bdb2e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "POST /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/action" status: 202 len: 0 microversion: 2.20 time: 1.397542 Aug 09 17:40:28.116246 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2386/5010] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:40:26 2022] POST /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/action => generated 0 bytes in 1399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:40:28.134416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:28.146588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:28.162433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:28.163769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:28.164548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:28.167034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:28.169084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:28.169755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:28.741766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-97f682a0-723c-4cf1-aed5-cf2b36e4aa9e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:28.752428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:28.769917 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-97f682a0-723c-4cf1-aed5-cf2b36e4aa9e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 1.464046 Aug 09 17:40:28.771900 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2625/5011] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:27 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:40:28.948523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:29.019022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:29.028200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:29.030756 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8cbf74e1-1a9d-41c5-83a7-bf02e94746b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1749 microversion: 2.20 time: 0.907459 Aug 09 17:40:29.037172 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2387/5012] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:28 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1749 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:29.809191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-524f783e-cce2-40ac-9d33-ce4bc9e2bdb9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:29.809816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-524f783e-cce2-40ac-9d33-ce4bc9e2bdb9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:29.820350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-524f783e-cce2-40ac-9d33-ce4bc9e2bdb9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:29.825887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-524f783e-cce2-40ac-9d33-ce4bc9e2bdb9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:29.826495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-524f783e-cce2-40ac-9d33-ce4bc9e2bdb9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:29.827441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-524f783e-cce2-40ac-9d33-ce4bc9e2bdb9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:29.827942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-524f783e-cce2-40ac-9d33-ce4bc9e2bdb9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:29.828373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-524f783e-cce2-40ac-9d33-ce4bc9e2bdb9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:30.077197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:30.083739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:30.117263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:30.117764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:30.118213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:30.118940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:30.132921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:30.133557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:30.767361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-524f783e-cce2-40ac-9d33-ce4bc9e2bdb9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:30.799978 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-524f783e-cce2-40ac-9d33-ce4bc9e2bdb9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 0.993796 Aug 09 17:40:30.825939 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2626/5013] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:29 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:31.030868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:31.057701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:31.066535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:31.075196 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-580e1a3d-4599-412a-9dd8-8a9d5184775a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1749 microversion: 2.20 time: 1.017682 Aug 09 17:40:31.102054 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2388/5014] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:30 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1749 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:31.822443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-699c11e0-5cd0-4a77-bbb9-b68ca260ff23 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:31.823393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-699c11e0-5cd0-4a77-bbb9-b68ca260ff23 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:31.837445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-699c11e0-5cd0-4a77-bbb9-b68ca260ff23 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:31.837445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-699c11e0-5cd0-4a77-bbb9-b68ca260ff23 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:31.843436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-699c11e0-5cd0-4a77-bbb9-b68ca260ff23 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:31.844807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-699c11e0-5cd0-4a77-bbb9-b68ca260ff23 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:31.845774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-699c11e0-5cd0-4a77-bbb9-b68ca260ff23 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:31.846237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-699c11e0-5cd0-4a77-bbb9-b68ca260ff23 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:32.108056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:32.108056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:32.130222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:32.131981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:32.132994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:32.134374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:32.135322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:32.136091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:32.501939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-699c11e0-5cd0-4a77-bbb9-b68ca260ff23 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:32.517521 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-699c11e0-5cd0-4a77-bbb9-b68ca260ff23 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 0.699448 Aug 09 17:40:32.523360 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2627/5015] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:31 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:33.548554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df07b948-936c-4819-af8f-7551c9ae0190 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:33.557141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df07b948-936c-4819-af8f-7551c9ae0190 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:33.603088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df07b948-936c-4819-af8f-7551c9ae0190 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:33.608667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df07b948-936c-4819-af8f-7551c9ae0190 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:33.612983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df07b948-936c-4819-af8f-7551c9ae0190 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:33.617699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df07b948-936c-4819-af8f-7551c9ae0190 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:33.618573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df07b948-936c-4819-af8f-7551c9ae0190 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:33.620367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df07b948-936c-4819-af8f-7551c9ae0190 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:34.014447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:34.036809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:34.046737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:34.049556 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f372b357-ecb9-4f6b-a974-8ba3758e022d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1751 microversion: 2.20 time: 1.945029 Aug 09 17:40:34.056095 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2389/5016] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:32 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1751 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:34.717868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-df07b948-936c-4819-af8f-7551c9ae0190 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:34.735007 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df07b948-936c-4819-af8f-7551c9ae0190 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 1.189913 Aug 09 17:40:34.736277 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2628/5017] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:33 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:35.078667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:35.079454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:35.096580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:35.097128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:35.097601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:35.098413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:35.098890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:35.102495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:35.770472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25022c32-352f-41dc-9144-cdb085120b95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:35.771902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-25022c32-352f-41dc-9144-cdb085120b95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:35.793046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25022c32-352f-41dc-9144-cdb085120b95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:35.793956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25022c32-352f-41dc-9144-cdb085120b95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:35.794660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25022c32-352f-41dc-9144-cdb085120b95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:35.797662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25022c32-352f-41dc-9144-cdb085120b95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:35.801025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25022c32-352f-41dc-9144-cdb085120b95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:35.803155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25022c32-352f-41dc-9144-cdb085120b95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:35.885099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:35.902832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:35.908336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:35.913673 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c48b7f73-b06e-461c-89f7-b188d72ccea8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1751 microversion: 2.20 time: 0.839076 Aug 09 17:40:35.915069 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2390/5018] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:35 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1751 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:36.437196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-25022c32-352f-41dc-9144-cdb085120b95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:36.452177 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-25022c32-352f-41dc-9144-cdb085120b95 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 0.696313 Aug 09 17:40:36.454461 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2629/5019] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:35 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:40:36.631737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-495720576", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "72a27d84-41c5-4eb6-bce7-cc9a06e02ca6"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:40:36.763371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] validate_networks() for [('72a27d84-41c5-4eb6-bce7-cc9a06e02ca6', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:40:36.962399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:36.963210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:36.980204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:36.980838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:36.981310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:36.982088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:36.982570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:36.987411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:37.729080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:37.745547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:37.752274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:37.756695 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a3fd2231-d81b-4a0e-97bf-d87c3eef4d66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1751 microversion: 2.20 time: 0.798976 Aug 09 17:40:37.759010 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2630/5020] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:36 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1751 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:37.775945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fccd072b-e510-4d93-a78c-670844fab01f req-8ba00512-6d2b-4174-9918-9bbb5503b084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2dffdb-cb37-41f1-985b-63d3c84f8894", "name": "network-vif-plugged", "status": "completed", "tag": "c7ce58af-3ea5-40a3-a8a3-1c38d41c3ce7"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:40:37.791402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fccd072b-e510-4d93-a78c-670844fab01f req-8ba00512-6d2b-4174-9918-9bbb5503b084 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:37.792553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fccd072b-e510-4d93-a78c-670844fab01f req-8ba00512-6d2b-4174-9918-9bbb5503b084 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:37.793333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fccd072b-e510-4d93-a78c-670844fab01f req-8ba00512-6d2b-4174-9918-9bbb5503b084 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:37.829255 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fccd072b-e510-4d93-a78c-670844fab01f req-8ba00512-6d2b-4174-9918-9bbb5503b084 service nova] Creating event network-vif-plugged:c7ce58af-3ea5-40a3-a8a3-1c38d41c3ce7 for instance 4c2dffdb-cb37-41f1-985b-63d3c84f8894 on n-h1-845781-6 Aug 09 17:40:37.836146 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fccd072b-e510-4d93-a78c-670844fab01f req-8ba00512-6d2b-4174-9918-9bbb5503b084 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073518 Aug 09 17:40:37.837495 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2631/5021] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:40:37.854183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-33dbd29b-b13c-4b27-bb80-bd75c2cf398b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:37.857578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-33dbd29b-b13c-4b27-bb80-bd75c2cf398b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:37.880498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33dbd29b-b13c-4b27-bb80-bd75c2cf398b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:37.881611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33dbd29b-b13c-4b27-bb80-bd75c2cf398b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:37.884820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33dbd29b-b13c-4b27-bb80-bd75c2cf398b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:37.886129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33dbd29b-b13c-4b27-bb80-bd75c2cf398b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:37.887460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33dbd29b-b13c-4b27-bb80-bd75c2cf398b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:37.888323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33dbd29b-b13c-4b27-bb80-bd75c2cf398b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:38.962314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-33dbd29b-b13c-4b27-bb80-bd75c2cf398b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:38.993089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-33dbd29b-b13c-4b27-bb80-bd75c2cf398b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 1.153882 Aug 09 17:40:39.007573 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2632/5022] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:37 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:39.013739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:39.015000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:39.025385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:39.026178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:39.026848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:39.027980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:39.028668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:39.029317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:39.696925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:39.724260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:39.727040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:39.728872 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d7430b91-416c-44cd-9195-b4c7a2768eb3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1751 microversion: 2.20 time: 0.719729 Aug 09 17:40:39.730071 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2633/5023] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:39 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1751 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:40.023830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-46775c0d-6c3c-4083-b652-b84593ee0769 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:40.024944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-46775c0d-6c3c-4083-b652-b84593ee0769 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:40.041253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46775c0d-6c3c-4083-b652-b84593ee0769 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:40.041759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46775c0d-6c3c-4083-b652-b84593ee0769 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:40.046608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46775c0d-6c3c-4083-b652-b84593ee0769 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:40.047782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46775c0d-6c3c-4083-b652-b84593ee0769 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:40.050737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46775c0d-6c3c-4083-b652-b84593ee0769 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:40.051984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46775c0d-6c3c-4083-b652-b84593ee0769 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:40.376191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-46775c0d-6c3c-4083-b652-b84593ee0769 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:40.389964 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-46775c0d-6c3c-4083-b652-b84593ee0769 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1375 microversion: 2.1 time: 0.374701 Aug 09 17:40:40.393380 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2634/5024] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:40 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1375 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:40.762936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:40.769861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:40.802885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:40.803887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:40.805782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:40.809671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:40.810879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:40.811568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:41.096520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:40:41.097234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:40:41.098118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:40:41.098847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:40:41.111475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:40:41.159242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:41.167345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:41.168479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:41.170199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:41.171280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:41.175875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:41.295050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Getting quotas for project 1564e627ac9f4f819154528d8e86e69c. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:40:41.326156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Getting quotas for user f5f403684cff468c8ede64c651bd4d75 and project 1564e627ac9f4f819154528d8e86e69c. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:40:41.419282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:41.421311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:40:41.430268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:40:41.483967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:41.492627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:41.506974 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a17c03e-a1cf-4a7f-b041-4693f9d492dc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1751 microversion: 2.20 time: 0.752169 Aug 09 17:40:41.510697 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2635/5025] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:40 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1751 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:41.533752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1bcc4e96-31b1-46cd-9be5-2825070bbb96 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:41.536900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1bcc4e96-31b1-46cd-9be5-2825070bbb96 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:41.562126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcc4e96-31b1-46cd-9be5-2825070bbb96 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:41.564635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcc4e96-31b1-46cd-9be5-2825070bbb96 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:41.567268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcc4e96-31b1-46cd-9be5-2825070bbb96 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:41.569787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcc4e96-31b1-46cd-9be5-2825070bbb96 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:41.570947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcc4e96-31b1-46cd-9be5-2825070bbb96 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:41.572221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bcc4e96-31b1-46cd-9be5-2825070bbb96 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:41.757279 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0a3858ca-ce53-4e99-ab0f-b0f985d58c43 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.840250 Aug 09 17:40:41.760257 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2391/5026] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:40:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 5844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:40:41.784241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-26f8c592-6c24-4c99-b2ed-2e2f0e4f1dd8 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:41.786161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-26f8c592-6c24-4c99-b2ed-2e2f0e4f1dd8 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:42.576634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-26f8c592-6c24-4c99-b2ed-2e2f0e4f1dd8 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:42.599870 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-26f8c592-6c24-4c99-b2ed-2e2f0e4f1dd8 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1216 microversion: 2.1 time: 0.827454 Aug 09 17:40:42.601715 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2392/5027] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:41 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1216 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:40:42.616346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:42.618437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:42.660671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1bcc4e96-31b1-46cd-9be5-2825070bbb96 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:42.662021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:42.662557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:42.663020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:42.668063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:42.670957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:42.671516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:42.738670 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1bcc4e96-31b1-46cd-9be5-2825070bbb96 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1548 microversion: 2.1 time: 1.225574 Aug 09 17:40:42.748728 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2636/5028] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:41 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1548 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:42.782199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f410e95-78d7-497a-895a-53cae4cc0c32 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:42.807128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f410e95-78d7-497a-895a-53cae4cc0c32 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:42.862295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f410e95-78d7-497a-895a-53cae4cc0c32 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:42.874379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f410e95-78d7-497a-895a-53cae4cc0c32 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:42.877194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f410e95-78d7-497a-895a-53cae4cc0c32 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:42.881514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f410e95-78d7-497a-895a-53cae4cc0c32 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:42.889271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f410e95-78d7-497a-895a-53cae4cc0c32 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:42.890603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f410e95-78d7-497a-895a-53cae4cc0c32 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:43.899818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9f410e95-78d7-497a-895a-53cae4cc0c32 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:43.957565 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f410e95-78d7-497a-895a-53cae4cc0c32 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1548 microversion: 2.1 time: 1.170135 Aug 09 17:40:43.988141 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2637/5029] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:42 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1548 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:40:44.004827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-31e456ca-5086-4b59-aca7-f054c6d08e3b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:44.004827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-31e456ca-5086-4b59-aca7-f054c6d08e3b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:44.040444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31e456ca-5086-4b59-aca7-f054c6d08e3b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:44.041325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31e456ca-5086-4b59-aca7-f054c6d08e3b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:44.044707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31e456ca-5086-4b59-aca7-f054c6d08e3b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:44.050136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31e456ca-5086-4b59-aca7-f054c6d08e3b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:44.051458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31e456ca-5086-4b59-aca7-f054c6d08e3b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:44.052597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31e456ca-5086-4b59-aca7-f054c6d08e3b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:44.632073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-31e456ca-5086-4b59-aca7-f054c6d08e3b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:44.662839 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-31e456ca-5086-4b59-aca7-f054c6d08e3b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1212 microversion: 2.1 time: 0.688208 Aug 09 17:40:44.663471 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2638/5030] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:43 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1212 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:45.687867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fc719ab8-c4b7-4890-8e57-36bd10d0be0e tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:45.690096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fc719ab8-c4b7-4890-8e57-36bd10d0be0e tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:45.719846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc719ab8-c4b7-4890-8e57-36bd10d0be0e tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:45.724350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc719ab8-c4b7-4890-8e57-36bd10d0be0e tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:45.727297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc719ab8-c4b7-4890-8e57-36bd10d0be0e tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:45.728392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc719ab8-c4b7-4890-8e57-36bd10d0be0e tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:45.729409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc719ab8-c4b7-4890-8e57-36bd10d0be0e tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:45.732294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc719ab8-c4b7-4890-8e57-36bd10d0be0e tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:45.934217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fc719ab8-c4b7-4890-8e57-36bd10d0be0e tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:45.943901 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fc719ab8-c4b7-4890-8e57-36bd10d0be0e tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1274 microversion: 2.1 time: 0.260411 Aug 09 17:40:45.945152 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2639/5031] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:45 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:40:46.752481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:46.776556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:46.778344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:46.780295 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3209d4e1-7073-482b-8d7e-e0f9f92f1c05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1751 microversion: 2.20 time: 4.175259 Aug 09 17:40:46.800629 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2393/5032] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:42 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1751 bytes in 4196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:46.990628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c03371b-19a4-45fb-a693-ced7f3aa0eb5 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:46.991934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c03371b-19a4-45fb-a693-ced7f3aa0eb5 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:47.007061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c03371b-19a4-45fb-a693-ced7f3aa0eb5 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:47.007913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c03371b-19a4-45fb-a693-ced7f3aa0eb5 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:47.011360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c03371b-19a4-45fb-a693-ced7f3aa0eb5 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:47.012363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c03371b-19a4-45fb-a693-ced7f3aa0eb5 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:47.013008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c03371b-19a4-45fb-a693-ced7f3aa0eb5 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:47.013606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c03371b-19a4-45fb-a693-ced7f3aa0eb5 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:47.524657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5c03371b-19a4-45fb-a693-ced7f3aa0eb5 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:47.553959 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c03371b-19a4-45fb-a693-ced7f3aa0eb5 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1274 microversion: 2.1 time: 0.567113 Aug 09 17:40:47.555197 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2640/5033] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:46 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1274 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:47.825031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:47.826782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:47.852746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:47.853978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:47.860588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:47.862312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:47.864998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:47.868625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:48.600921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-30ea778e-26f5-42c3-8d7f-ee754cdacc26 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:48.602991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-30ea778e-26f5-42c3-8d7f-ee754cdacc26 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:48.618020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:48.637166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ea778e-26f5-42c3-8d7f-ee754cdacc26 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:48.638619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ea778e-26f5-42c3-8d7f-ee754cdacc26 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:48.639700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ea778e-26f5-42c3-8d7f-ee754cdacc26 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:48.641482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ea778e-26f5-42c3-8d7f-ee754cdacc26 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:48.642834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ea778e-26f5-42c3-8d7f-ee754cdacc26 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:48.643908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30ea778e-26f5-42c3-8d7f-ee754cdacc26 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:48.657320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:48.670477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:48.693223 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4dbfcb81-1bdf-42e8-86a7-10e8d3f2d5a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 0.880573 Aug 09 17:40:48.694937 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2394/5034] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:47 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:48.939927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-30ea778e-26f5-42c3-8d7f-ee754cdacc26 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:48.953443 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-30ea778e-26f5-42c3-8d7f-ee754cdacc26 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1274 microversion: 2.1 time: 0.360085 Aug 09 17:40:48.954379 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2641/5035] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:48 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1274 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:49.738746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:49.741038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:49.772264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:49.777535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:49.778449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:49.790264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:49.792161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:49.792917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:50.003673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c3b036a-deaf-4f35-9d04-05d06ed3c0e3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:50.004321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7c3b036a-deaf-4f35-9d04-05d06ed3c0e3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:50.022383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3b036a-deaf-4f35-9d04-05d06ed3c0e3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:50.029467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3b036a-deaf-4f35-9d04-05d06ed3c0e3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:50.030010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3b036a-deaf-4f35-9d04-05d06ed3c0e3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:50.030803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3b036a-deaf-4f35-9d04-05d06ed3c0e3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:50.031347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3b036a-deaf-4f35-9d04-05d06ed3c0e3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:50.031882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c3b036a-deaf-4f35-9d04-05d06ed3c0e3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:50.542485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:50.568083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:50.576424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:50.583132 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a8681448-39bf-4e62-b7e7-dcc3901a04d2 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 0.849393 Aug 09 17:40:50.584902 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2395/5036] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:49 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:51.113472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7c3b036a-deaf-4f35-9d04-05d06ed3c0e3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:51.124837 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7c3b036a-deaf-4f35-9d04-05d06ed3c0e3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1316 microversion: 2.1 time: 1.133194 Aug 09 17:40:51.127169 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2642/5037] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:49 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1316 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:51.635552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:51.645105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:51.664430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:51.677799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:51.678606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:51.679417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:51.692472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:51.702927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:51.704094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:51.791332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:52.151590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-294757f7-3e10-4ac2-9a16-0ba672ff90ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:52.153043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-294757f7-3e10-4ac2-9a16-0ba672ff90ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:52.168517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-294757f7-3e10-4ac2-9a16-0ba672ff90ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:52.169046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-294757f7-3e10-4ac2-9a16-0ba672ff90ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:52.169486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-294757f7-3e10-4ac2-9a16-0ba672ff90ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:52.170272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-294757f7-3e10-4ac2-9a16-0ba672ff90ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:52.182351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-294757f7-3e10-4ac2-9a16-0ba672ff90ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:52.182899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-294757f7-3e10-4ac2-9a16-0ba672ff90ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:52.198872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:52.591780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:52.946323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-294757f7-3e10-4ac2-9a16-0ba672ff90ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:52.966361 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-294757f7-3e10-4ac2-9a16-0ba672ff90ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1316 microversion: 2.1 time: 0.823265 Aug 09 17:40:52.967613 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2643/5038] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:52 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1316 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:53.820150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9e7ce826-c690-4ad2-8c1c-cd802d794839 req-383d3e87-e482-4376-a639-8a6b1eec8887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2dffdb-cb37-41f1-985b-63d3c84f8894", "tag": "c7ce58af-3ea5-40a3-a8a3-1c38d41c3ce7"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:40:53.920388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e7ce826-c690-4ad2-8c1c-cd802d794839 req-383d3e87-e482-4376-a639-8a6b1eec8887 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:53.921728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e7ce826-c690-4ad2-8c1c-cd802d794839 req-383d3e87-e482-4376-a639-8a6b1eec8887 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:53.925740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e7ce826-c690-4ad2-8c1c-cd802d794839 req-383d3e87-e482-4376-a639-8a6b1eec8887 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:54.030059 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9e7ce826-c690-4ad2-8c1c-cd802d794839 req-383d3e87-e482-4376-a639-8a6b1eec8887 service nova] Creating event network-changed:c7ce58af-3ea5-40a3-a8a3-1c38d41c3ce7 for instance 4c2dffdb-cb37-41f1-985b-63d3c84f8894 on n-h1-845781-6 Aug 09 17:40:54.085109 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9e7ce826-c690-4ad2-8c1c-cd802d794839 req-383d3e87-e482-4376-a639-8a6b1eec8887 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.104273 Aug 09 17:40:54.092582 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2644/5039] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:40:54.147129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-595faf44-d5fb-48a2-a895-ab7e038dc8ba tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:54.156361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-595faf44-d5fb-48a2-a895-ab7e038dc8ba tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:54.194231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-595faf44-d5fb-48a2-a895-ab7e038dc8ba tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:54.194736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-595faf44-d5fb-48a2-a895-ab7e038dc8ba tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:54.204420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-595faf44-d5fb-48a2-a895-ab7e038dc8ba tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:54.223025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-595faf44-d5fb-48a2-a895-ab7e038dc8ba tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:54.224663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-595faf44-d5fb-48a2-a895-ab7e038dc8ba tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:54.227576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-595faf44-d5fb-48a2-a895-ab7e038dc8ba tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:54.296682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:54.323408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:54.334389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:54.339961 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-90e8a1e2-1aa8-4494-99c2-be1aacdb3d5d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 2.711756 Aug 09 17:40:54.342196 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2396/5040] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:51 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 2716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:55.389865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-595faf44-d5fb-48a2-a895-ab7e038dc8ba tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:55.400976 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-595faf44-d5fb-48a2-a895-ab7e038dc8ba tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1316 microversion: 2.1 time: 1.295944 Aug 09 17:40:55.407562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:55.408416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:55.409468 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2645/5041] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:54 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1316 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:40:55.428219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:55.428921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:55.430371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:55.434413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:55.436091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:55.443224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:56.456428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e7e20b0-6342-436d-b299-52e988351bd6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:56.458793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8e7e20b0-6342-436d-b299-52e988351bd6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:56.462187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=46 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:56.517907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7e20b0-6342-436d-b299-52e988351bd6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:56.526820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7e20b0-6342-436d-b299-52e988351bd6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:56.528033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7e20b0-6342-436d-b299-52e988351bd6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:56.531294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7e20b0-6342-436d-b299-52e988351bd6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:56.532177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7e20b0-6342-436d-b299-52e988351bd6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:56.532864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e7e20b0-6342-436d-b299-52e988351bd6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:58.194493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:58.209305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:58.229770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:58.237374 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-54509c14-6a31-4162-b5c5-e8ee29a725cb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 2.834030 Aug 09 17:40:58.244482 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2397/5042] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:55 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 2842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:40:58.284132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5c71a560-060e-470a-b088-b221e28a46e5 req-aa344b7d-a6c0-4ea6-910a-20fb2385c6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d84dcb0-2b24-4f81-9c30-cc8af4f77c45", "tag": "4d96b7a7-955e-443d-9fa1-1e6bc673b914"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:40:58.334427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:40:58.395770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5c71a560-060e-470a-b088-b221e28a46e5 req-aa344b7d-a6c0-4ea6-910a-20fb2385c6ca service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:58.400086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5c71a560-060e-470a-b088-b221e28a46e5 req-aa344b7d-a6c0-4ea6-910a-20fb2385c6ca service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:58.404782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5c71a560-060e-470a-b088-b221e28a46e5 req-aa344b7d-a6c0-4ea6-910a-20fb2385c6ca service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:58.490491 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5c71a560-060e-470a-b088-b221e28a46e5 req-aa344b7d-a6c0-4ea6-910a-20fb2385c6ca service nova] Creating event network-changed:4d96b7a7-955e-443d-9fa1-1e6bc673b914 for instance 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 on n-h2-845781-6 Aug 09 17:40:58.515383 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5c71a560-060e-470a-b088-b221e28a46e5 req-aa344b7d-a6c0-4ea6-910a-20fb2385c6ca service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259801 Aug 09 17:40:58.526140 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2398/5043] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:40:59.280291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:40:59.281042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:40:59.298010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:59.304069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:59.305449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:59.306857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:40:59.307593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:40:59.309267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:40:59.725053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8e7e20b0-6342-436d-b299-52e988351bd6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:40:59.741416 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e7e20b0-6342-436d-b299-52e988351bd6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1316 microversion: 2.1 time: 3.288947 Aug 09 17:40:59.743097 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2646/5044] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:40:56 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1316 bytes in 3292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:41:00.773296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-150e50c2-39fd-4ef5-80df-157e391cb966 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:00.779241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-150e50c2-39fd-4ef5-80df-157e391cb966 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:00.808838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-150e50c2-39fd-4ef5-80df-157e391cb966 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:00.824511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-150e50c2-39fd-4ef5-80df-157e391cb966 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:00.825662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-150e50c2-39fd-4ef5-80df-157e391cb966 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:00.829971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-150e50c2-39fd-4ef5-80df-157e391cb966 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:00.831136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-150e50c2-39fd-4ef5-80df-157e391cb966 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:00.834491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-150e50c2-39fd-4ef5-80df-157e391cb966 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:01.710025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:01.799924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:01.811781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:01.826386 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-938aca70-700a-42e1-81a5-b28da95185b7 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 2.552459 Aug 09 17:41:01.833335 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2399/5045] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:40:59 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 2564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:41:02.424938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-150e50c2-39fd-4ef5-80df-157e391cb966 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:02.452961 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-150e50c2-39fd-4ef5-80df-157e391cb966 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1316 microversion: 2.1 time: 1.686707 Aug 09 17:41:02.458637 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2647/5046] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:00 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1316 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:02.861838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:02.866320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:02.933071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:02.934967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:02.936088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:02.937890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:02.941675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:02.947383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:03.485562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9359a283-49a3-4634-a457-6b6a35df817b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:03.495592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9359a283-49a3-4634-a457-6b6a35df817b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:03.551090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9359a283-49a3-4634-a457-6b6a35df817b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:03.560071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9359a283-49a3-4634-a457-6b6a35df817b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:03.563956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9359a283-49a3-4634-a457-6b6a35df817b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:03.566739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9359a283-49a3-4634-a457-6b6a35df817b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:03.571681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9359a283-49a3-4634-a457-6b6a35df817b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:03.578663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9359a283-49a3-4634-a457-6b6a35df817b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:04.373699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:04.423176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:04.438909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:04.445023 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fa1fedb5-62af-42e1-8c9b-8c26eff6d1be tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 1.592029 Aug 09 17:41:04.455034 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2400/5047] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:02 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:41:05.487361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:05.489770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:05.540549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:05.546949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:05.548264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:05.549944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:05.557199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:05.559412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:05.809709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9359a283-49a3-4634-a457-6b6a35df817b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:05.824329 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9359a283-49a3-4634-a457-6b6a35df817b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1316 microversion: 2.1 time: 2.347273 Aug 09 17:41:05.824961 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2648/5048] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:03 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1316 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:06.145633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6fe8add-b8f0-48a9-8dc9-327134cafabd tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:41:06.167360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e6fe8add-b8f0-48a9-8dc9-327134cafabd tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:06.193594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6fe8add-b8f0-48a9-8dc9-327134cafabd tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:06.194096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6fe8add-b8f0-48a9-8dc9-327134cafabd tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:06.194561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6fe8add-b8f0-48a9-8dc9-327134cafabd tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:06.195324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6fe8add-b8f0-48a9-8dc9-327134cafabd tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:06.201880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6fe8add-b8f0-48a9-8dc9-327134cafabd tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:06.203602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6fe8add-b8f0-48a9-8dc9-327134cafabd tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:06.301162 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e6fe8add-b8f0-48a9-8dc9-327134cafabd tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "POST /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894/action" status: 200 len: 24538 microversion: 2.1 time: 0.162342 Aug 09 17:41:06.323157 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2649/5049] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:41:06 2022] POST /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894/action => generated 24538 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:41:06.852951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b87efcae-37ca-4def-8dab-7db07a198377 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:06.853666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b87efcae-37ca-4def-8dab-7db07a198377 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:06.867762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b87efcae-37ca-4def-8dab-7db07a198377 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:06.868571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b87efcae-37ca-4def-8dab-7db07a198377 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:06.869208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b87efcae-37ca-4def-8dab-7db07a198377 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:06.870544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b87efcae-37ca-4def-8dab-7db07a198377 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:06.871394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b87efcae-37ca-4def-8dab-7db07a198377 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:06.872024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b87efcae-37ca-4def-8dab-7db07a198377 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:06.928823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:06.960970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:06.985686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:06.996473 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a06c68f2-216e-4167-a057-88fb9b5c66bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 1.512132 Aug 09 17:41:06.999052 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2401/5050] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:05 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:41:08.027204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:08.028288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:08.044422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:08.053140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:08.053894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:08.055567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:08.058345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:08.063143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:08.502382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b87efcae-37ca-4def-8dab-7db07a198377 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:08.514431 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b87efcae-37ca-4def-8dab-7db07a198377 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1316 microversion: 2.1 time: 1.665996 Aug 09 17:41:08.515074 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2650/5051] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:06 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1316 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:41:09.330842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:09.346375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:09.350380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:09.358840 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2a5fa8fd-027b-422d-b146-dd4b08c0dacc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 1.335347 Aug 09 17:41:09.376168 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2402/5052] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:08 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:41:09.564861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-744fe385-2568-4419-bedb-6aa172626679 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:09.566060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-744fe385-2568-4419-bedb-6aa172626679 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:09.634787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-744fe385-2568-4419-bedb-6aa172626679 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:09.635497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-744fe385-2568-4419-bedb-6aa172626679 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:09.647068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-744fe385-2568-4419-bedb-6aa172626679 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:09.648366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-744fe385-2568-4419-bedb-6aa172626679 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:09.649195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-744fe385-2568-4419-bedb-6aa172626679 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:09.649944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-744fe385-2568-4419-bedb-6aa172626679 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:10.371337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-32939998-c76e-4bc2-9f61-f746cfc72c4d req-9c40685e-5e06-4fee-be1a-936696100cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d84dcb0-2b24-4f81-9c30-cc8af4f77c45", "name": "network-vif-plugged", "status": "completed", "tag": "4d96b7a7-955e-443d-9fa1-1e6bc673b914"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:41:10.459580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-32939998-c76e-4bc2-9f61-f746cfc72c4d req-9c40685e-5e06-4fee-be1a-936696100cb3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:10.465780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-32939998-c76e-4bc2-9f61-f746cfc72c4d req-9c40685e-5e06-4fee-be1a-936696100cb3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:10.475443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-32939998-c76e-4bc2-9f61-f746cfc72c4d req-9c40685e-5e06-4fee-be1a-936696100cb3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:10.579183 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-32939998-c76e-4bc2-9f61-f746cfc72c4d req-9c40685e-5e06-4fee-be1a-936696100cb3 service nova] Creating event network-vif-plugged:4d96b7a7-955e-443d-9fa1-1e6bc673b914 for instance 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 on n-h2-845781-6 Aug 09 17:41:10.618106 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-32939998-c76e-4bc2-9f61-f746cfc72c4d req-9c40685e-5e06-4fee-be1a-936696100cb3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261857 Aug 09 17:41:10.630348 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2403/5053] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 09 17:41:10.666755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:10.672474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:10.738461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:10.740071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:10.740857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:10.752679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:10.753630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:10.759410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:12.349246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:12.368355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:12.374563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:12.378600 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-91b11ac9-0b50-4461-98da-46a9c4c23c10 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 1.744321 Aug 09 17:41:12.381565 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2404/5054] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:10 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:41:12.382841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-744fe385-2568-4419-bedb-6aa172626679 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:12.397255 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-744fe385-2568-4419-bedb-6aa172626679 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1316 microversion: 2.1 time: 2.847678 Aug 09 17:41:12.422070 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2651/5055] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:09 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1316 bytes in 2873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:13.424853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:13.425583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:13.437100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94a11377-0cf2-40cd-a5fc-cfe06922dc4d tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:13.440215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94a11377-0cf2-40cd-a5fc-cfe06922dc4d tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:13.440791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:13.441570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:13.442789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:13.443973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:13.444695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:13.445357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:13.462365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94a11377-0cf2-40cd-a5fc-cfe06922dc4d tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:13.463756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94a11377-0cf2-40cd-a5fc-cfe06922dc4d tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:13.464811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94a11377-0cf2-40cd-a5fc-cfe06922dc4d tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:13.466367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94a11377-0cf2-40cd-a5fc-cfe06922dc4d tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:13.467556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94a11377-0cf2-40cd-a5fc-cfe06922dc4d tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:13.468651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94a11377-0cf2-40cd-a5fc-cfe06922dc4d tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:14.102345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94a11377-0cf2-40cd-a5fc-cfe06922dc4d tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:14.132980 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94a11377-0cf2-40cd-a5fc-cfe06922dc4d tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1316 microversion: 2.1 time: 0.701460 Aug 09 17:41:14.164270 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2652/5056] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:13 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1316 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:14.258811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:14.303303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:14.306981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:14.313940 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cc6805a8-9cd7-4282-9785-a3fdd9b51967 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 0.897356 Aug 09 17:41:14.335771 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2405/5057] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:13 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:41:15.170384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efbe8ec8-1e4e-4200-84eb-c787fcb6c54a tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:15.171195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-efbe8ec8-1e4e-4200-84eb-c787fcb6c54a tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:15.184774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efbe8ec8-1e4e-4200-84eb-c787fcb6c54a tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:15.185888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efbe8ec8-1e4e-4200-84eb-c787fcb6c54a tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:15.187135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efbe8ec8-1e4e-4200-84eb-c787fcb6c54a tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:15.190370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efbe8ec8-1e4e-4200-84eb-c787fcb6c54a tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:15.194000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efbe8ec8-1e4e-4200-84eb-c787fcb6c54a tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:15.195772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efbe8ec8-1e4e-4200-84eb-c787fcb6c54a tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:15.373414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:15.374477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:15.409244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:15.410108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:15.410936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:15.412262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:15.413093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:15.413870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:15.573839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-efbe8ec8-1e4e-4200-84eb-c787fcb6c54a tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:15.590141 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-efbe8ec8-1e4e-4200-84eb-c787fcb6c54a tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1505 microversion: 2.1 time: 0.424012 Aug 09 17:41:15.592076 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2653/5058] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:15 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:41:15.634568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c79c87e-5062-437b-8dbf-1ca4b22cc7cb tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:15.640566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c79c87e-5062-437b-8dbf-1ca4b22cc7cb tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:15.677808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c79c87e-5062-437b-8dbf-1ca4b22cc7cb tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:15.679415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c79c87e-5062-437b-8dbf-1ca4b22cc7cb tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:15.686887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c79c87e-5062-437b-8dbf-1ca4b22cc7cb tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:15.688709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c79c87e-5062-437b-8dbf-1ca4b22cc7cb tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:15.690007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c79c87e-5062-437b-8dbf-1ca4b22cc7cb tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:15.691012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c79c87e-5062-437b-8dbf-1ca4b22cc7cb tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:15.803902 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c79c87e-5062-437b-8dbf-1ca4b22cc7cb tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45/ips" status: 200 len: 109 microversion: 2.1 time: 0.189280 Aug 09 17:41:15.806792 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2654/5059] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:41:15 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45/ips => generated 109 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:41:15.826610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1da7815e-5dc6-4945-8c14-bf35d073c963 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:15.837156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1da7815e-5dc6-4945-8c14-bf35d073c963 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:15.863749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da7815e-5dc6-4945-8c14-bf35d073c963 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:15.865389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da7815e-5dc6-4945-8c14-bf35d073c963 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:15.866308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da7815e-5dc6-4945-8c14-bf35d073c963 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:15.871837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da7815e-5dc6-4945-8c14-bf35d073c963 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:15.873139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da7815e-5dc6-4945-8c14-bf35d073c963 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:15.874255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da7815e-5dc6-4945-8c14-bf35d073c963 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:16.039099 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1da7815e-5dc6-4945-8c14-bf35d073c963 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45/ips" status: 200 len: 109 microversion: 2.1 time: 0.220767 Aug 09 17:41:16.046924 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2655/5060] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:41:15 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45/ips => generated 109 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:41:16.063239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-42e8828c-0ada-488a-b1ce-ef224917ca0b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:16.070666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-42e8828c-0ada-488a-b1ce-ef224917ca0b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:16.092174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e8828c-0ada-488a-b1ce-ef224917ca0b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:16.093951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e8828c-0ada-488a-b1ce-ef224917ca0b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:16.095145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e8828c-0ada-488a-b1ce-ef224917ca0b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:16.102505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e8828c-0ada-488a-b1ce-ef224917ca0b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:16.104092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e8828c-0ada-488a-b1ce-ef224917ca0b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:16.109452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e8828c-0ada-488a-b1ce-ef224917ca0b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:16.216821 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-42e8828c-0ada-488a-b1ce-ef224917ca0b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45/ips/tempest-ServerAddressesTestJSON-520118887-network" status: 200 len: 94 microversion: 2.1 time: 0.164010 Aug 09 17:41:16.219485 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2656/5061] 10.222.0.93 () {58 vars in 1398 bytes} [Tue Aug 9 17:41:16 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45/ips/tempest-ServerAddressesTestJSON-520118887-network => generated 94 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:41:16.234529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:16.237264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-662de2c0-3a35-46d5-baf3-9194b8a421ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:16.241397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-662de2c0-3a35-46d5-baf3-9194b8a421ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:16.263176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662de2c0-3a35-46d5-baf3-9194b8a421ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:16.264913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662de2c0-3a35-46d5-baf3-9194b8a421ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:16.267239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662de2c0-3a35-46d5-baf3-9194b8a421ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:16.268762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662de2c0-3a35-46d5-baf3-9194b8a421ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:16.271097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662de2c0-3a35-46d5-baf3-9194b8a421ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:16.271552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662de2c0-3a35-46d5-baf3-9194b8a421ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:16.290934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:16.296367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:16.300300 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c74b4349-644d-406a-b0a8-2a393df99676 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 0.934810 Aug 09 17:41:16.304361 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2406/5062] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:15 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:41:16.366067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-662de2c0-3a35-46d5-baf3-9194b8a421ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:41:16.631258 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-662de2c0-3a35-46d5-baf3-9194b8a421ee tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 204 len: 0 microversion: 2.1 time: 0.402361 Aug 09 17:41:16.633726 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2657/5063] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:41:16 2022] DELETE /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:41:16.642380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc8c7af8-33a5-4087-a9c6-c857a627b6c3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:16.644354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cc8c7af8-33a5-4087-a9c6-c857a627b6c3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:16.661424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc8c7af8-33a5-4087-a9c6-c857a627b6c3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:16.662222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc8c7af8-33a5-4087-a9c6-c857a627b6c3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:16.663827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc8c7af8-33a5-4087-a9c6-c857a627b6c3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:16.669001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc8c7af8-33a5-4087-a9c6-c857a627b6c3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:16.669791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc8c7af8-33a5-4087-a9c6-c857a627b6c3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:16.670473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc8c7af8-33a5-4087-a9c6-c857a627b6c3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:17.011233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cc8c7af8-33a5-4087-a9c6-c857a627b6c3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:17.022884 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cc8c7af8-33a5-4087-a9c6-c857a627b6c3 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1511 microversion: 2.1 time: 0.384846 Aug 09 17:41:17.023529 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2407/5064] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:16 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1511 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:17.345381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:17.346631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:17.370619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:17.371575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:17.376555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:17.378798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:17.383245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:17.386279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:18.051023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d71a26d7-381e-4e61-b971-0a4c837d200f tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:18.053740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d71a26d7-381e-4e61-b971-0a4c837d200f tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:18.064426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:18.077416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d71a26d7-381e-4e61-b971-0a4c837d200f tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:18.079791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:18.080748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d71a26d7-381e-4e61-b971-0a4c837d200f tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:18.081327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d71a26d7-381e-4e61-b971-0a4c837d200f tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:18.083377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d71a26d7-381e-4e61-b971-0a4c837d200f tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:18.084054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:18.086055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d71a26d7-381e-4e61-b971-0a4c837d200f tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:18.087070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d71a26d7-381e-4e61-b971-0a4c837d200f tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:18.091446 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3dfe0423-23d6-4f93-97e0-421fa78bd340 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 0.755477 Aug 09 17:41:18.092717 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2658/5065] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:17 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:41:18.355327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d71a26d7-381e-4e61-b971-0a4c837d200f tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:18.380558 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d71a26d7-381e-4e61-b971-0a4c837d200f tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1511 microversion: 2.1 time: 0.334985 Aug 09 17:41:18.403591 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2408/5066] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:18 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1511 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:41:19.119134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:19.120144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:19.149115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:19.150280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:19.150907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:19.152205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:19.152871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:19.158421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:19.435757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cae6509b-989d-4148-9233-47b3e291b31b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:19.442607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cae6509b-989d-4148-9233-47b3e291b31b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:19.488542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cae6509b-989d-4148-9233-47b3e291b31b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:19.494635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cae6509b-989d-4148-9233-47b3e291b31b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:19.495515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cae6509b-989d-4148-9233-47b3e291b31b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:19.504938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cae6509b-989d-4148-9233-47b3e291b31b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:19.505440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cae6509b-989d-4148-9233-47b3e291b31b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:19.505897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cae6509b-989d-4148-9233-47b3e291b31b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:20.093994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:20.181720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:20.201049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:20.216763 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-95be8503-b1a1-441c-8e30-7d5b7bc9b8e3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 1.096181 Aug 09 17:41:20.224088 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2659/5067] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:19 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:41:20.256662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cae6509b-989d-4148-9233-47b3e291b31b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:20.267030 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cae6509b-989d-4148-9233-47b3e291b31b tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1511 microversion: 2.1 time: 0.843258 Aug 09 17:41:20.273167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2409/5068] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:19 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1511 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:21.247834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:21.249423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:21.279479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:21.282676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:21.285427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:21.287478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:21.288766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:21.290609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:21.305981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-25e93a23-a4a9-455f-b497-845bcd94f0a6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:21.307909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-25e93a23-a4a9-455f-b497-845bcd94f0a6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:21.319523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:41:21.325019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25e93a23-a4a9-455f-b497-845bcd94f0a6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:21.335468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25e93a23-a4a9-455f-b497-845bcd94f0a6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:21.338479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25e93a23-a4a9-455f-b497-845bcd94f0a6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:21.339784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25e93a23-a4a9-455f-b497-845bcd94f0a6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:21.343170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25e93a23-a4a9-455f-b497-845bcd94f0a6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:21.345858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-25e93a23-a4a9-455f-b497-845bcd94f0a6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:21.581780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-25e93a23-a4a9-455f-b497-845bcd94f0a6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:21.596332 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-25e93a23-a4a9-455f-b497-845bcd94f0a6 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1469 microversion: 2.1 time: 0.294482 Aug 09 17:41:21.608365 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2410/5069] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:21 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:21.671532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-cfc962b4-1fbb-4033-bcc3-1076925eed92 req-84a966d6-7f0b-445a-87bc-838719f079b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d84dcb0-2b24-4f81-9c30-cc8af4f77c45", "name": "network-vif-deleted", "tag": "4d96b7a7-955e-443d-9fa1-1e6bc673b914"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:41:21.705789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cfc962b4-1fbb-4033-bcc3-1076925eed92 req-84a966d6-7f0b-445a-87bc-838719f079b2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:21.706681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cfc962b4-1fbb-4033-bcc3-1076925eed92 req-84a966d6-7f0b-445a-87bc-838719f079b2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:21.708956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cfc962b4-1fbb-4033-bcc3-1076925eed92 req-84a966d6-7f0b-445a-87bc-838719f079b2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:21.741724 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-cfc962b4-1fbb-4033-bcc3-1076925eed92 req-84a966d6-7f0b-445a-87bc-838719f079b2 service nova] Creating event network-vif-deleted:4d96b7a7-955e-443d-9fa1-1e6bc673b914 for instance 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 on n-h2-845781-6 Aug 09 17:41:21.765483 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-cfc962b4-1fbb-4033-bcc3-1076925eed92 req-84a966d6-7f0b-445a-87bc-838719f079b2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098393 Aug 09 17:41:21.766909 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2411/5070] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:41:22.308594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:22.352296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:22.362288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:22.368391 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3ef6f391-8ce9-4a57-8de2-9fedd6affe5b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 1.116742 Aug 09 17:41:22.369087 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2660/5071] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:21 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:41:22.635458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:22.638430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:22.649435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:22.650716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:22.651403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:22.652336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:22.652895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:22.653523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:22.659668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=81 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:41:22.707392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:22.708818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:22.709706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:22.710519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lazy-loading 'fault' on Instance uuid 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:41:22.769324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5f403684cff468c8ede64c651bd4d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1564e627ac9f4f819154528d8e86e69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:22.786707 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8561e351-3ae1-485c-be62-7517a5780154 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 200 len: 1306 microversion: 2.1 time: 0.164738 Aug 09 17:41:22.801705 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2412/5072] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:22 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 1306 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:23.417946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:23.429131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:23.463802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:23.467033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:23.471248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:23.478487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:23.479760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:23.481685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:23.814014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:23.815486 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] [instance: 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:23.830205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:23.835508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:23.837139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:23.839763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:23.847495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:23.848688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:23.880885 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] HTTP exception thrown: Instance 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 could not be found. Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Request method failure captured: Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 HTTP/1.1 Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pwTufL_2xljwV4XcuTJm17ln3ou0JxRih3dhhYPJlLGZxdw0ZpUeCRwSUIyuWeAE-0blqc2yD9yB165nmyNU68MqB-VhxmbHzt-iE7wXf4zoKX_OSDxOxbo6b7pzUCdxSC_2YkSpzaTHL3fnaWY1mhWEwjNOub1totdPx0SAM424KA Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1564e627ac9f4f819154528d8e86e69c Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerAddressesTestJSON-1748510489 Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1564e627ac9f4f819154528d8e86e69c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1564e627ac9f4f819154528d8e86e69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1564e627ac9f4f819154528d8e86e69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1564e627ac9f4f819154528d8e86e69c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerAddressesTestJSON-1748510489 Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1564e627ac9f4f819154528d8e86e69c Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1748510489 Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerAddressesTestJSON-1748510489-project Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: f5f403684cff468c8ede64c651bd4d75 Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerAddressesTestJSON-1748510489-project Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 could not be found. Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '5d84dcb0-2b24-4f81-9c30-cc8af4f77c45'} Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 could not be found. Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 could not be found. Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:41:23.882872 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:41:23.886773 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:41:23.886773 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:41:23.886773 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:41:23.886773 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:41:23.886773 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:41:23.886773 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 could not be found. Aug 09 17:41:23.886773 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:41:23.886773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] Returning 404 to user: Instance 5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:41:23.889220 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d6c53019-29a2-4764-a800-963799fc0a91 tempest-ServerAddressesTestJSON-1748510489 tempest-ServerAddressesTestJSON-1748510489-project] 10.222.0.93 "GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45" status: 404 len: 111 microversion: 2.1 time: 0.076670 Aug 09 17:41:23.894142 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2413/5073] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:23 2022] GET /compute/v2.1/servers/5d84dcb0-2b24-4f81-9c30-cc8af4f77c45 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:41:24.396209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:24.406295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:24.408475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:24.410102 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-20a929e8-f79f-4872-8a2d-c286584e7b4d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 1.002584 Aug 09 17:41:24.427303 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2661/5074] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:23 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:41:25.436255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:25.436930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:25.448474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:25.450705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:25.451983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:25.454206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:25.456740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:25.458261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:26.476553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:26.509005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:26.516955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:26.521446 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4808ba9d-0dfe-4288-8ec6-ec2e65946bbb tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 1.089988 Aug 09 17:41:26.523240 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2414/5075] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:25 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:41:27.536898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9b33b1a2-67c6-4455-99ab-3bbc9c4b375c req-10b74302-2fa8-4dd4-b652-2d141e65fff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deacdae-0205-41a6-b164-640022f2eef4", "name": "network-vif-plugged", "status": "completed", "tag": "a322ddf6-871d-4af1-8243-03824c9855a1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:41:27.552165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:27.553030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:27.572540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:41:27.575648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:27.576763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:27.577066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9b33b1a2-67c6-4455-99ab-3bbc9c4b375c req-10b74302-2fa8-4dd4-b652-2d141e65fff1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:27.577560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9b33b1a2-67c6-4455-99ab-3bbc9c4b375c req-10b74302-2fa8-4dd4-b652-2d141e65fff1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:27.577742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:27.577984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9b33b1a2-67c6-4455-99ab-3bbc9c4b375c req-10b74302-2fa8-4dd4-b652-2d141e65fff1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:27.580061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:27.581692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:27.582827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:27.620202 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9b33b1a2-67c6-4455-99ab-3bbc9c4b375c req-10b74302-2fa8-4dd4-b652-2d141e65fff1 service nova] Creating event network-vif-plugged:a322ddf6-871d-4af1-8243-03824c9855a1 for instance 8deacdae-0205-41a6-b164-640022f2eef4 on n-h2-845781-6 Aug 09 17:41:27.667697 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9b33b1a2-67c6-4455-99ab-3bbc9c4b375c req-10b74302-2fa8-4dd4-b652-2d141e65fff1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166584 Aug 09 17:41:27.669895 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2662/5076] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:41:28.528458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:28.557291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:28.563712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:28.568040 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-43aa45eb-8b27-4bc0-bf96-982d142c0ce9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 1.020296 Aug 09 17:41:28.583678 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2415/5077] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:27 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:41:29.605778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:29.606856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:29.616563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:29.617556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:29.618456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:29.619497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:29.620365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:29.621352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:29.738719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fedc04d7-9b36-419c-a1a0-abec9d7f48f3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Action: 'create', calling method: .version_select at 0x7fbbcb94f670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1829740202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7y6jbDmFP5O0qZh9DDrTiNK/ybaPq829Y66K3y6PEC+mNBKP1MBgms09XOkavpj5DK/Ij40XKCDT6TK0FK3OXeemIaKVhImEBT02sl9jaR6Fw/+BK6AYsZ9WEfYLPAtg=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:41:29.749743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=38 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:41:29.820240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fedc04d7-9b36-419c-a1a0-abec9d7f48f3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for project 95efa122e86846beb9abcb02ac118e94. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:41:29.853999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-fedc04d7-9b36-419c-a1a0-abec9d7f48f3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for user cbb30087336245ce95a13efe7c2f382e and project 95efa122e86846beb9abcb02ac118e94. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:41:29.994287 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fedc04d7-9b36-419c-a1a0-abec9d7f48f3 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.249937 Aug 09 17:41:29.995321 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2416/5078] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:41:29 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:41:30.673466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:30.712612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:30.716046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:30.727780 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-954df414-6dd2-41cc-b72d-c7c490d706b5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 1.135377 Aug 09 17:41:30.734842 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2663/5079] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:29 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:41:31.775334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:31.789156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:31.840856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:31.844456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:31.846537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:31.862834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:31.885789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:31.892528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:32.930879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:32.945064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:32.949564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:32.959268 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a910d8d3-4dcf-48d1-b0ea-369660c63f9a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1807 microversion: 2.20 time: 1.205818 Aug 09 17:41:32.963988 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2417/5080] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:31 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1807 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:41:33.999226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:34.000066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:34.019018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:34.019668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:34.020204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:34.024380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:34.024881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:34.025539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:35.558928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:35.579912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:35.582193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:35.585168 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d6bca82e-3d2c-47f5-84d8-9d240948c2ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1794 microversion: 2.20 time: 1.590756 Aug 09 17:41:35.588969 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2664/5081] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:41:33 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1794 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:41:43.298892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1566084491", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "7a0ac385-bac3-4b32-9039-27ebfe4ee8c4"}], "key_name": "tempest-TestNetworkBasicOps-1829740202", "security_groups": [{"name": "tempest-secgroup-smoke-2119504516"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:41:43.373760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:41:43.375447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:41:43.377376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=27 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:41:44.205707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] validate_networks() for [('7a0ac385-bac3-4b32-9039-27ebfe4ee8c4', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:41:45.890111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:41:45.902145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:41:45.903078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:41:45.903932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:41:45.904746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:41:45.960876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:45.975138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:45.975954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:45.979922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:45.981473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:45.983315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:46.046852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for project 95efa122e86846beb9abcb02ac118e94. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:41:46.082771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for user cbb30087336245ce95a13efe7c2f382e and project 95efa122e86846beb9abcb02ac118e94. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:41:46.177161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:41:46.185924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:41:46.397200 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b01c77d7-cfa3-4559-aaf3-64558de8b4fa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.115383 Aug 09 17:41:46.400730 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2418/5082] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:41:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 3122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:41:46.422933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eeae0cfd-3fa5-44d8-bc21-a96a4dcf976e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:46.426568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eeae0cfd-3fa5-44d8-bc21-a96a4dcf976e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:46.460715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=5 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:41:46.463230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=25 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:41:46.989528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eeae0cfd-3fa5-44d8-bc21-a96a4dcf976e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:47.014338 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eeae0cfd-3fa5-44d8-bc21-a96a4dcf976e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1249 microversion: 2.1 time: 0.598789 Aug 09 17:41:47.066617 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2665/5083] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:46 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1249 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:41:48.091468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b94f57e6-970e-4fb2-b53e-702b14154799 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:48.092823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b94f57e6-970e-4fb2-b53e-702b14154799 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:48.561424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b94f57e6-970e-4fb2-b53e-702b14154799 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:48.594072 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b94f57e6-970e-4fb2-b53e-702b14154799 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1249 microversion: 2.1 time: 0.504479 Aug 09 17:41:48.600060 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2666/5084] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:48 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1249 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:49.122719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1764576495", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "6013f0f7-67f7-477e-8d10-bbfef6011949"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:41:49.401857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] validate_networks() for [('6013f0f7-67f7-477e-8d10-bbfef6011949', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:41:49.657982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-494e45dc-c3f2-4bfd-a1ad-b6b18b1a88fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:49.659443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-494e45dc-c3f2-4bfd-a1ad-b6b18b1a88fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:49.696316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-494e45dc-c3f2-4bfd-a1ad-b6b18b1a88fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:49.697630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-494e45dc-c3f2-4bfd-a1ad-b6b18b1a88fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:49.699738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-494e45dc-c3f2-4bfd-a1ad-b6b18b1a88fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:49.701870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-494e45dc-c3f2-4bfd-a1ad-b6b18b1a88fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:49.703074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-494e45dc-c3f2-4bfd-a1ad-b6b18b1a88fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:49.705531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-494e45dc-c3f2-4bfd-a1ad-b6b18b1a88fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:50.236033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-494e45dc-c3f2-4bfd-a1ad-b6b18b1a88fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:50.288216 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-494e45dc-c3f2-4bfd-a1ad-b6b18b1a88fb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1301 microversion: 2.1 time: 0.637710 Aug 09 17:41:50.292936 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2667/5085] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:49 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1301 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:50.844282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:41:50.845269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:41:50.846116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:41:50.847012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:41:50.847845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:41:50.921679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:50.922578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:50.928422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:50.929970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:50.930715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:50.931389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:51.047238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Getting quotas for project 40a4a3ec423d44088b980f87360221a5. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:41:51.079436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Getting quotas for user 643cb507595841ef80dfc05a069d021b and project 40a4a3ec423d44088b980f87360221a5. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:41:51.124811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Going to run 2 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:41:51.133066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 1c866f02-8911-484b-821b-4b8528f0f84b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:41:51.262043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=1c866f02-8911-484b-821b-4b8528f0f84b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:41:51.345959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d5dbd4a-00d5-40b9-bbc4-3343c2ea333d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:51.353005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5d5dbd4a-00d5-40b9-bbc4-3343c2ea333d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:51.380830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d5dbd4a-00d5-40b9-bbc4-3343c2ea333d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:51.381611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d5dbd4a-00d5-40b9-bbc4-3343c2ea333d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:51.382253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d5dbd4a-00d5-40b9-bbc4-3343c2ea333d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:51.385359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d5dbd4a-00d5-40b9-bbc4-3343c2ea333d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:51.389163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d5dbd4a-00d5-40b9-bbc4-3343c2ea333d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:51.390279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d5dbd4a-00d5-40b9-bbc4-3343c2ea333d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:51.643509 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c733de24-89dc-479a-990c-81565b88f306 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.684500 Aug 09 17:41:51.650097 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2419/5086] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:41:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:41:51.688948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c39d59d6-d40b-4c5e-b48a-328425f43cbd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:51.744900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c39d59d6-d40b-4c5e-b48a-328425f43cbd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:51.752516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c39d59d6-d40b-4c5e-b48a-328425f43cbd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Searching by: {'deleted': False, 'project_id': '40a4a3ec423d44088b980f87360221a5'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:41:51.862443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5d5dbd4a-00d5-40b9-bbc4-3343c2ea333d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:51.878047 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5d5dbd4a-00d5-40b9-bbc4-3343c2ea333d tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1307 microversion: 2.1 time: 0.541078 Aug 09 17:41:51.878681 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2668/5087] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:51 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1307 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:51.931520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c39d59d6-d40b-4c5e-b48a-328425f43cbd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:51.932534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c39d59d6-d40b-4c5e-b48a-328425f43cbd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:51.932973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c39d59d6-d40b-4c5e-b48a-328425f43cbd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:51.947585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c39d59d6-d40b-4c5e-b48a-328425f43cbd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:51.952422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c39d59d6-d40b-4c5e-b48a-328425f43cbd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:51.956706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c39d59d6-d40b-4c5e-b48a-328425f43cbd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:52.073799 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c39d59d6-d40b-4c5e-b48a-328425f43cbd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.408420 Aug 09 17:41:52.077310 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2420/5088] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:41:51 2022] GET /compute/v2.1/servers => generated 677 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:41:52.110082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ac36d09c-2d24-414e-abaf-53ff46c93c01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:52.111273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ac36d09c-2d24-414e-abaf-53ff46c93c01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:52.928304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d5103a4-03bb-4da5-9391-ad6da22543a0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:52.928953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d5103a4-03bb-4da5-9391-ad6da22543a0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:52.955496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d5103a4-03bb-4da5-9391-ad6da22543a0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:52.956635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d5103a4-03bb-4da5-9391-ad6da22543a0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:52.956635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d5103a4-03bb-4da5-9391-ad6da22543a0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:52.957234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d5103a4-03bb-4da5-9391-ad6da22543a0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:52.958251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d5103a4-03bb-4da5-9391-ad6da22543a0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:52.958922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d5103a4-03bb-4da5-9391-ad6da22543a0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:53.136167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ac36d09c-2d24-414e-abaf-53ff46c93c01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:53.187147 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ac36d09c-2d24-414e-abaf-53ff46c93c01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1220 microversion: 2.1 time: 1.085715 Aug 09 17:41:53.192080 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2669/5089] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:52 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1220 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:53.402083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5d5103a4-03bb-4da5-9391-ad6da22543a0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:53.424013 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5d5103a4-03bb-4da5-9391-ad6da22543a0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1307 microversion: 2.1 time: 0.499814 Aug 09 17:41:53.425267 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2421/5090] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:52 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1307 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:54.246311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a8c0117a-9bb7-4558-b902-98c5fe5ba5f5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:54.250438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a8c0117a-9bb7-4558-b902-98c5fe5ba5f5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:54.320229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8c0117a-9bb7-4558-b902-98c5fe5ba5f5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:54.329042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8c0117a-9bb7-4558-b902-98c5fe5ba5f5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:54.329877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8c0117a-9bb7-4558-b902-98c5fe5ba5f5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:54.340898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8c0117a-9bb7-4558-b902-98c5fe5ba5f5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:54.341717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8c0117a-9bb7-4558-b902-98c5fe5ba5f5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:54.342417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8c0117a-9bb7-4558-b902-98c5fe5ba5f5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:54.473119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aa77dcb9-80b2-4fa5-8875-bfe8e09d8ee0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:54.474177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-aa77dcb9-80b2-4fa5-8875-bfe8e09d8ee0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:54.518719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa77dcb9-80b2-4fa5-8875-bfe8e09d8ee0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:54.519278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa77dcb9-80b2-4fa5-8875-bfe8e09d8ee0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:54.519785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa77dcb9-80b2-4fa5-8875-bfe8e09d8ee0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:54.521071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa77dcb9-80b2-4fa5-8875-bfe8e09d8ee0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:54.521551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa77dcb9-80b2-4fa5-8875-bfe8e09d8ee0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:54.521993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa77dcb9-80b2-4fa5-8875-bfe8e09d8ee0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:55.219919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a8c0117a-9bb7-4558-b902-98c5fe5ba5f5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:55.243297 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a8c0117a-9bb7-4558-b902-98c5fe5ba5f5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1224 microversion: 2.1 time: 1.031914 Aug 09 17:41:55.252048 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2670/5091] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:54 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1224 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:55.935302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-aa77dcb9-80b2-4fa5-8875-bfe8e09d8ee0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:55.960407 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aa77dcb9-80b2-4fa5-8875-bfe8e09d8ee0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1307 microversion: 2.1 time: 1.484941 Aug 09 17:41:55.961420 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2422/5092] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:54 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1307 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:56.265804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-31bb5ad1-5efc-4f9f-bcf5-59db3ed5db8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:56.266614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-31bb5ad1-5efc-4f9f-bcf5-59db3ed5db8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:56.278643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31bb5ad1-5efc-4f9f-bcf5-59db3ed5db8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:56.279157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31bb5ad1-5efc-4f9f-bcf5-59db3ed5db8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:56.279609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31bb5ad1-5efc-4f9f-bcf5-59db3ed5db8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:56.280393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31bb5ad1-5efc-4f9f-bcf5-59db3ed5db8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:56.280855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31bb5ad1-5efc-4f9f-bcf5-59db3ed5db8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:56.281291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31bb5ad1-5efc-4f9f-bcf5-59db3ed5db8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:56.546553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-31bb5ad1-5efc-4f9f-bcf5-59db3ed5db8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:56.564486 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-31bb5ad1-5efc-4f9f-bcf5-59db3ed5db8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1290 microversion: 2.1 time: 0.303022 Aug 09 17:41:56.573535 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2671/5093] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:56 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1290 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:57.007803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a8044aa8-20b4-4859-93ec-fd203185b658 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:57.009058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a8044aa8-20b4-4859-93ec-fd203185b658 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:57.025538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8044aa8-20b4-4859-93ec-fd203185b658 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:57.032688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8044aa8-20b4-4859-93ec-fd203185b658 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:57.034749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8044aa8-20b4-4859-93ec-fd203185b658 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:57.042857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8044aa8-20b4-4859-93ec-fd203185b658 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:57.047371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8044aa8-20b4-4859-93ec-fd203185b658 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:57.048952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8044aa8-20b4-4859-93ec-fd203185b658 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:57.599712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bfee7b59-c7f1-4dc0-b1e8-219eec7f74d5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:57.600974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bfee7b59-c7f1-4dc0-b1e8-219eec7f74d5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:57.618209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfee7b59-c7f1-4dc0-b1e8-219eec7f74d5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:57.619965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfee7b59-c7f1-4dc0-b1e8-219eec7f74d5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:57.621196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfee7b59-c7f1-4dc0-b1e8-219eec7f74d5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:57.622197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfee7b59-c7f1-4dc0-b1e8-219eec7f74d5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:57.622906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfee7b59-c7f1-4dc0-b1e8-219eec7f74d5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:57.623833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfee7b59-c7f1-4dc0-b1e8-219eec7f74d5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:57.749794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bfee7b59-c7f1-4dc0-b1e8-219eec7f74d5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:57.763518 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bfee7b59-c7f1-4dc0-b1e8-219eec7f74d5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1278 microversion: 2.1 time: 0.169800 Aug 09 17:41:57.782861 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2672/5094] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:57 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:58.237928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fc30908d-01de-4ab7-a710-fa62a4ac3810 req-01206d6f-b710-4f0e-82d0-23be7345ae7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f08b71-f5c9-4d4b-80e1-32932dabb8d4", "tag": "eaed783a-87e8-4729-b6e6-4896ace3e817"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:41:58.260372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fc30908d-01de-4ab7-a710-fa62a4ac3810 req-01206d6f-b710-4f0e-82d0-23be7345ae7f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:58.261155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fc30908d-01de-4ab7-a710-fa62a4ac3810 req-01206d6f-b710-4f0e-82d0-23be7345ae7f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:58.261798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fc30908d-01de-4ab7-a710-fa62a4ac3810 req-01206d6f-b710-4f0e-82d0-23be7345ae7f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:58.276369 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fc30908d-01de-4ab7-a710-fa62a4ac3810 req-01206d6f-b710-4f0e-82d0-23be7345ae7f service nova] Creating event network-changed:eaed783a-87e8-4729-b6e6-4896ace3e817 for instance 84f08b71-f5c9-4d4b-80e1-32932dabb8d4 on n-h2-845781-6 Aug 09 17:41:58.282077 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fc30908d-01de-4ab7-a710-fa62a4ac3810 req-01206d6f-b710-4f0e-82d0-23be7345ae7f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048104 Aug 09 17:41:58.283306 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2673/5095] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:41:58.533702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a8044aa8-20b4-4859-93ec-fd203185b658 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:58.543160 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a8044aa8-20b4-4859-93ec-fd203185b658 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1375 microversion: 2.1 time: 1.539779 Aug 09 17:41:58.544195 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2423/5096] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:57 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1375 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:41:58.803453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75b1d574-83df-4395-b1d3-d21c24887576 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:58.804912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75b1d574-83df-4395-b1d3-d21c24887576 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:58.829668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b1d574-83df-4395-b1d3-d21c24887576 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:58.832217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b1d574-83df-4395-b1d3-d21c24887576 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:58.837740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b1d574-83df-4395-b1d3-d21c24887576 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:58.840288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b1d574-83df-4395-b1d3-d21c24887576 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:58.843284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b1d574-83df-4395-b1d3-d21c24887576 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:58.849713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b1d574-83df-4395-b1d3-d21c24887576 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:59.491766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-75b1d574-83df-4395-b1d3-d21c24887576 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:41:59.565299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a525dc7c-2935-4770-8c0f-1c4eb2b68a13 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:41:59.566973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a525dc7c-2935-4770-8c0f-1c4eb2b68a13 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:41:59.575381 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75b1d574-83df-4395-b1d3-d21c24887576 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1278 microversion: 2.1 time: 0.756926 Aug 09 17:41:59.580875 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2674/5097] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:58 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1278 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:41:59.624066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a525dc7c-2935-4770-8c0f-1c4eb2b68a13 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:59.627093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a525dc7c-2935-4770-8c0f-1c4eb2b68a13 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:59.631393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a525dc7c-2935-4770-8c0f-1c4eb2b68a13 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:41:59.634700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a525dc7c-2935-4770-8c0f-1c4eb2b68a13 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:41:59.640805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a525dc7c-2935-4770-8c0f-1c4eb2b68a13 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:41:59.648454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a525dc7c-2935-4770-8c0f-1c4eb2b68a13 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:00.270756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a525dc7c-2935-4770-8c0f-1c4eb2b68a13 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:00.291145 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a525dc7c-2935-4770-8c0f-1c4eb2b68a13 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1375 microversion: 2.1 time: 0.730016 Aug 09 17:42:00.294663 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2424/5098] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:41:59 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1375 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:00.616295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9333ffda-dce8-4b10-b4de-f9a0ff41a37b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:00.621846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9333ffda-dce8-4b10-b4de-f9a0ff41a37b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:00.664190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9333ffda-dce8-4b10-b4de-f9a0ff41a37b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:00.676218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9333ffda-dce8-4b10-b4de-f9a0ff41a37b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:00.681305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9333ffda-dce8-4b10-b4de-f9a0ff41a37b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:00.690458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9333ffda-dce8-4b10-b4de-f9a0ff41a37b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:00.696972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9333ffda-dce8-4b10-b4de-f9a0ff41a37b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:00.702265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9333ffda-dce8-4b10-b4de-f9a0ff41a37b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:01.339733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a7f93f62-297f-49c3-9acb-0709e4239032 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:01.341577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a7f93f62-297f-49c3-9acb-0709e4239032 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:01.345699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=12 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:01.362635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f93f62-297f-49c3-9acb-0709e4239032 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:01.363258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f93f62-297f-49c3-9acb-0709e4239032 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:01.382479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f93f62-297f-49c3-9acb-0709e4239032 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:01.383472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f93f62-297f-49c3-9acb-0709e4239032 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:01.392570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f93f62-297f-49c3-9acb-0709e4239032 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:01.395679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7f93f62-297f-49c3-9acb-0709e4239032 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:02.014219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:02.917334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a7f93f62-297f-49c3-9acb-0709e4239032 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:02.931884 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a7f93f62-297f-49c3-9acb-0709e4239032 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1375 microversion: 2.1 time: 1.592005 Aug 09 17:42:02.946130 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2425/5099] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:01 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1375 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:42:03.126589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9333ffda-dce8-4b10-b4de-f9a0ff41a37b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:03.154279 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9333ffda-dce8-4b10-b4de-f9a0ff41a37b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 2.550997 Aug 09 17:42:03.158527 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2675/5100] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:00 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 2556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:03.962284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4cf6a274-a1db-4af2-af0a-e1e01d7cd477 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:03.964712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4cf6a274-a1db-4af2-af0a-e1e01d7cd477 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:03.997872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf6a274-a1db-4af2-af0a-e1e01d7cd477 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:04.001481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf6a274-a1db-4af2-af0a-e1e01d7cd477 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:04.003673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf6a274-a1db-4af2-af0a-e1e01d7cd477 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:04.009361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf6a274-a1db-4af2-af0a-e1e01d7cd477 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:04.013173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf6a274-a1db-4af2-af0a-e1e01d7cd477 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:04.014269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf6a274-a1db-4af2-af0a-e1e01d7cd477 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:04.200329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-83a8d50c-5c65-47d5-8f8a-0f2fa92b3cca tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:04.201434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-83a8d50c-5c65-47d5-8f8a-0f2fa92b3cca tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:04.213154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:04.243420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a8d50c-5c65-47d5-8f8a-0f2fa92b3cca tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:04.255793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a8d50c-5c65-47d5-8f8a-0f2fa92b3cca tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:04.256932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a8d50c-5c65-47d5-8f8a-0f2fa92b3cca tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:04.258455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a8d50c-5c65-47d5-8f8a-0f2fa92b3cca tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:04.259481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a8d50c-5c65-47d5-8f8a-0f2fa92b3cca tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:04.264786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a8d50c-5c65-47d5-8f8a-0f2fa92b3cca tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:05.240530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-83a8d50c-5c65-47d5-8f8a-0f2fa92b3cca tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:05.322370 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-83a8d50c-5c65-47d5-8f8a-0f2fa92b3cca tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 1.128785 Aug 09 17:42:05.330887 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2676/5101] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:04 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:05.358528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a455124f-4df9-4613-9dff-af7ad30f1046 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:05.367605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a455124f-4df9-4613-9dff-af7ad30f1046 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:05.412773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a455124f-4df9-4613-9dff-af7ad30f1046 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:05.415698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a455124f-4df9-4613-9dff-af7ad30f1046 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:05.417666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a455124f-4df9-4613-9dff-af7ad30f1046 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:05.419172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a455124f-4df9-4613-9dff-af7ad30f1046 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:05.423474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a455124f-4df9-4613-9dff-af7ad30f1046 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:05.424601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a455124f-4df9-4613-9dff-af7ad30f1046 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:05.607881 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a455124f-4df9-4613-9dff-af7ad30f1046 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments/98aa7623-7394-4c50-b333-385c4c88901d" status: 200 len: 194 microversion: 2.20 time: 0.269511 Aug 09 17:42:05.609763 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2677/5102] 10.222.0.93 () {60 vars in 1454 bytes} [Tue Aug 9 17:42:05 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments/98aa7623-7394-4c50-b333-385c4c88901d => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:42:05.832465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0bcc416b-b550-460c-9cce-c629e1b8d9e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:05.835163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0bcc416b-b550-460c-9cce-c629e1b8d9e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:05.854705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcc416b-b550-460c-9cce-c629e1b8d9e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:05.856314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcc416b-b550-460c-9cce-c629e1b8d9e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:05.857495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcc416b-b550-460c-9cce-c629e1b8d9e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:05.859143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcc416b-b550-460c-9cce-c629e1b8d9e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:05.860587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcc416b-b550-460c-9cce-c629e1b8d9e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:05.861914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcc416b-b550-460c-9cce-c629e1b8d9e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:06.061658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4cf6a274-a1db-4af2-af0a-e1e01d7cd477 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:06.076854 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4cf6a274-a1db-4af2-af0a-e1e01d7cd477 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1375 microversion: 2.1 time: 2.126180 Aug 09 17:42:06.087910 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2426/5103] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:03 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1375 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:06.236287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-0bcc416b-b550-460c-9cce-c629e1b8d9e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lazy-loading 'services' on Instance uuid 8deacdae-0205-41a6-b164-640022f2eef4 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:42:06.351869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f0014c65-b299-4b8f-b103-ffce7ef36504 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:06.354977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f0014c65-b299-4b8f-b103-ffce7ef36504 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:06.380549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0014c65-b299-4b8f-b103-ffce7ef36504 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:06.382153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0014c65-b299-4b8f-b103-ffce7ef36504 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:06.386643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0014c65-b299-4b8f-b103-ffce7ef36504 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:06.387992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0014c65-b299-4b8f-b103-ffce7ef36504 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:06.389261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0014c65-b299-4b8f-b103-ffce7ef36504 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:06.391939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0014c65-b299-4b8f-b103-ffce7ef36504 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:06.633297 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0bcc416b-b550-460c-9cce-c629e1b8d9e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments/98aa7623-7394-4c50-b333-385c4c88901d" status: 202 len: 0 microversion: 2.20 time: 0.809231 Aug 09 17:42:06.636286 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2678/5104] 10.222.0.93 () {60 vars in 1457 bytes} [Tue Aug 9 17:42:05 2022] DELETE /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments/98aa7623-7394-4c50-b333-385c4c88901d => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:42:06.654436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-82b595fe-4437-4f02-acb0-1bf615865939 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:06.664102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-82b595fe-4437-4f02-acb0-1bf615865939 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:06.706566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82b595fe-4437-4f02-acb0-1bf615865939 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:06.712104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82b595fe-4437-4f02-acb0-1bf615865939 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:06.712735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82b595fe-4437-4f02-acb0-1bf615865939 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:06.724556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82b595fe-4437-4f02-acb0-1bf615865939 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:06.725270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82b595fe-4437-4f02-acb0-1bf615865939 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:06.727758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82b595fe-4437-4f02-acb0-1bf615865939 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:06.917637 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-82b595fe-4437-4f02-acb0-1bf615865939 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.275905 Aug 09 17:42:06.930188 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2679/5105] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:42:06 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 197 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:42:07.117801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f2b2d81-aa88-4258-9546-8f2b142ff219 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:07.127593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f2b2d81-aa88-4258-9546-8f2b142ff219 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:07.160913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2b2d81-aa88-4258-9546-8f2b142ff219 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:07.162193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2b2d81-aa88-4258-9546-8f2b142ff219 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:07.163207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2b2d81-aa88-4258-9546-8f2b142ff219 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:07.168961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2b2d81-aa88-4258-9546-8f2b142ff219 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:07.170185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2b2d81-aa88-4258-9546-8f2b142ff219 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:07.171238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2b2d81-aa88-4258-9546-8f2b142ff219 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:07.907180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f2b2d81-aa88-4258-9546-8f2b142ff219 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:07.939726 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f2b2d81-aa88-4258-9546-8f2b142ff219 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1375 microversion: 2.1 time: 0.829554 Aug 09 17:42:07.961454 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2680/5106] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:07 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1375 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:07.989705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ebeb14c3-8f88-49f7-b077-e2b5f97cb2c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:08.011770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ebeb14c3-8f88-49f7-b077-e2b5f97cb2c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:08.067273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebeb14c3-8f88-49f7-b077-e2b5f97cb2c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:08.068327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebeb14c3-8f88-49f7-b077-e2b5f97cb2c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:08.078762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebeb14c3-8f88-49f7-b077-e2b5f97cb2c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:08.081713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebeb14c3-8f88-49f7-b077-e2b5f97cb2c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:08.082670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebeb14c3-8f88-49f7-b077-e2b5f97cb2c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:08.087157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebeb14c3-8f88-49f7-b077-e2b5f97cb2c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:08.272999 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ebeb14c3-8f88-49f7-b077-e2b5f97cb2c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.309192 Aug 09 17:42:08.280592 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2681/5107] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:42:07 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 197 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:42:08.405553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f0014c65-b299-4b8f-b103-ffce7ef36504 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:08.435801 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f0014c65-b299-4b8f-b103-ffce7ef36504 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 2.085557 Aug 09 17:42:08.443524 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2427/5108] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:06 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:42:08.999871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ee9bed81-7009-4048-9a31-09c0ea26c026 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:09.012306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ee9bed81-7009-4048-9a31-09c0ea26c026 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:09.034070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee9bed81-7009-4048-9a31-09c0ea26c026 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:09.056661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee9bed81-7009-4048-9a31-09c0ea26c026 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:09.061051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee9bed81-7009-4048-9a31-09c0ea26c026 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:09.066887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee9bed81-7009-4048-9a31-09c0ea26c026 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:09.068407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee9bed81-7009-4048-9a31-09c0ea26c026 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:09.069464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee9bed81-7009-4048-9a31-09c0ea26c026 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:09.304797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-069c8543-80df-4ce4-8231-09b3f0cddd5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:09.315820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-069c8543-80df-4ce4-8231-09b3f0cddd5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:09.349876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-069c8543-80df-4ce4-8231-09b3f0cddd5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:09.350740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-069c8543-80df-4ce4-8231-09b3f0cddd5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:09.351502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-069c8543-80df-4ce4-8231-09b3f0cddd5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:09.381201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-069c8543-80df-4ce4-8231-09b3f0cddd5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:09.382348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-069c8543-80df-4ce4-8231-09b3f0cddd5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:09.383157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-069c8543-80df-4ce4-8231-09b3f0cddd5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:09.558027 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-069c8543-80df-4ce4-8231-09b3f0cddd5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.250868 Aug 09 17:42:09.559202 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2428/5109] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:42:09 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 197 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:42:09.588181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad85cae2-4f28-4eb0-b3ab-961e5f836cdd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:09.589263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ad85cae2-4f28-4eb0-b3ab-961e5f836cdd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:09.625435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad85cae2-4f28-4eb0-b3ab-961e5f836cdd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:09.626785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad85cae2-4f28-4eb0-b3ab-961e5f836cdd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:09.627615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad85cae2-4f28-4eb0-b3ab-961e5f836cdd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:09.628989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad85cae2-4f28-4eb0-b3ab-961e5f836cdd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:09.630364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad85cae2-4f28-4eb0-b3ab-961e5f836cdd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:09.631471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad85cae2-4f28-4eb0-b3ab-961e5f836cdd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:10.371860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ee9bed81-7009-4048-9a31-09c0ea26c026 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:10.412925 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ee9bed81-7009-4048-9a31-09c0ea26c026 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1375 microversion: 2.1 time: 1.420040 Aug 09 17:42:10.415687 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2682/5110] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:08 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1375 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:10.581162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5cb7170e-dd49-4639-9538-eae897a656ff tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:10.591543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5cb7170e-dd49-4639-9538-eae897a656ff tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:10.621623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb7170e-dd49-4639-9538-eae897a656ff tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:10.623573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb7170e-dd49-4639-9538-eae897a656ff tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:10.625331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb7170e-dd49-4639-9538-eae897a656ff tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:10.629620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb7170e-dd49-4639-9538-eae897a656ff tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:10.630426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb7170e-dd49-4639-9538-eae897a656ff tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:10.631087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cb7170e-dd49-4639-9538-eae897a656ff tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:10.832593 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5cb7170e-dd49-4639-9538-eae897a656ff tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.260597 Aug 09 17:42:10.835847 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2683/5111] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:42:10 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 197 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:42:11.454944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a99ac16-d7f3-47af-acd6-1fb908cb6223 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:11.458386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a99ac16-d7f3-47af-acd6-1fb908cb6223 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:11.513807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a99ac16-d7f3-47af-acd6-1fb908cb6223 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:11.535329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a99ac16-d7f3-47af-acd6-1fb908cb6223 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:11.539731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a99ac16-d7f3-47af-acd6-1fb908cb6223 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:11.542878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a99ac16-d7f3-47af-acd6-1fb908cb6223 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:11.546507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a99ac16-d7f3-47af-acd6-1fb908cb6223 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:11.573016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a99ac16-d7f3-47af-acd6-1fb908cb6223 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:11.795478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:12.989812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ad85cae2-4f28-4eb0-b3ab-961e5f836cdd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:13.008575 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad85cae2-4f28-4eb0-b3ab-961e5f836cdd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 3.443650 Aug 09 17:42:13.010128 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2429/5112] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:09 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 3450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:13.030810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e95fead8-770a-4b2f-9e2a-381af90613fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:13.042137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e95fead8-770a-4b2f-9e2a-381af90613fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:13.085888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e95fead8-770a-4b2f-9e2a-381af90613fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:13.089616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e95fead8-770a-4b2f-9e2a-381af90613fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:13.094125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e95fead8-770a-4b2f-9e2a-381af90613fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:13.096955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e95fead8-770a-4b2f-9e2a-381af90613fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:13.105050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e95fead8-770a-4b2f-9e2a-381af90613fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:13.114886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e95fead8-770a-4b2f-9e2a-381af90613fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:13.196646 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e95fead8-770a-4b2f-9e2a-381af90613fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.176928 Aug 09 17:42:13.203903 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2430/5113] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:42:13 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:42:13.424107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-38163f39-92d9-47fd-8775-a19b332b3a2f req-e4b4958b-512c-47f5-9306-5e59ef19aa60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f08b71-f5c9-4d4b-80e1-32932dabb8d4", "name": "network-vif-plugged", "status": "completed", "tag": "eaed783a-87e8-4729-b6e6-4896ace3e817"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:13.447374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=9 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:13.477894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-38163f39-92d9-47fd-8775-a19b332b3a2f req-e4b4958b-512c-47f5-9306-5e59ef19aa60 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:13.478460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-38163f39-92d9-47fd-8775-a19b332b3a2f req-e4b4958b-512c-47f5-9306-5e59ef19aa60 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:13.480568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-38163f39-92d9-47fd-8775-a19b332b3a2f req-e4b4958b-512c-47f5-9306-5e59ef19aa60 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:13.492749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=67 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:13.523765 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-38163f39-92d9-47fd-8775-a19b332b3a2f req-e4b4958b-512c-47f5-9306-5e59ef19aa60 service nova] Creating event network-vif-plugged:eaed783a-87e8-4729-b6e6-4896ace3e817 for instance 84f08b71-f5c9-4d4b-80e1-32932dabb8d4 on n-h2-845781-6 Aug 09 17:42:13.537069 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-38163f39-92d9-47fd-8775-a19b332b3a2f req-e4b4958b-512c-47f5-9306-5e59ef19aa60 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119084 Aug 09 17:42:13.537712 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2431/5114] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:42:14.041203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e753692-f746-4393-9487-bf242dd7b091 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:14.041850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8e753692-f746-4393-9487-bf242dd7b091 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:14.057504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e753692-f746-4393-9487-bf242dd7b091 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:14.058029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e753692-f746-4393-9487-bf242dd7b091 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:14.058489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e753692-f746-4393-9487-bf242dd7b091 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:14.068027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e753692-f746-4393-9487-bf242dd7b091 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:14.069041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e753692-f746-4393-9487-bf242dd7b091 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:14.069848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e753692-f746-4393-9487-bf242dd7b091 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:14.457923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4a99ac16-d7f3-47af-acd6-1fb908cb6223 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:14.492664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a99ac16-d7f3-47af-acd6-1fb908cb6223 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1375 microversion: 2.1 time: 3.044846 Aug 09 17:42:14.493748 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2684/5115] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:11 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1375 bytes in 3047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:14.500848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-55442e53-dcfd-4143-a7bf-748153c82485 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:14.515183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-55442e53-dcfd-4143-a7bf-748153c82485 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:14.567095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55442e53-dcfd-4143-a7bf-748153c82485 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:14.571744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55442e53-dcfd-4143-a7bf-748153c82485 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:14.575857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55442e53-dcfd-4143-a7bf-748153c82485 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:14.577023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55442e53-dcfd-4143-a7bf-748153c82485 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:14.583429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55442e53-dcfd-4143-a7bf-748153c82485 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:14.586244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55442e53-dcfd-4143-a7bf-748153c82485 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:14.722792 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-55442e53-dcfd-4143-a7bf-748153c82485 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.227417 Aug 09 17:42:14.734568 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2685/5116] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:42:14 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:42:15.532693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d867a8c-d646-42c9-9c3e-e7279ea96751 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:15.533320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9d867a8c-d646-42c9-9c3e-e7279ea96751 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:15.546831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d867a8c-d646-42c9-9c3e-e7279ea96751 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:15.547348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d867a8c-d646-42c9-9c3e-e7279ea96751 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:15.547842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d867a8c-d646-42c9-9c3e-e7279ea96751 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:15.548600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d867a8c-d646-42c9-9c3e-e7279ea96751 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:15.551801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d867a8c-d646-42c9-9c3e-e7279ea96751 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:15.552420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d867a8c-d646-42c9-9c3e-e7279ea96751 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:16.895229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8e753692-f746-4393-9487-bf242dd7b091 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:16.940568 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e753692-f746-4393-9487-bf242dd7b091 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 2.903590 Aug 09 17:42:16.951473 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2432/5117] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:14 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 2916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:16.977285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-76cd9042-1482-4dee-9b38-cf1fb97406ea tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:16.988512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-76cd9042-1482-4dee-9b38-cf1fb97406ea tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:17.044660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76cd9042-1482-4dee-9b38-cf1fb97406ea tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:17.045665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76cd9042-1482-4dee-9b38-cf1fb97406ea tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:17.056542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76cd9042-1482-4dee-9b38-cf1fb97406ea tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:17.061364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76cd9042-1482-4dee-9b38-cf1fb97406ea tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:17.064582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76cd9042-1482-4dee-9b38-cf1fb97406ea tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:17.068224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76cd9042-1482-4dee-9b38-cf1fb97406ea tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:17.227037 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-76cd9042-1482-4dee-9b38-cf1fb97406ea tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.273195 Aug 09 17:42:17.235950 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2433/5118] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:42:16 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 197 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:42:17.458510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9d867a8c-d646-42c9-9c3e-e7279ea96751 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:17.484580 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9d867a8c-d646-42c9-9c3e-e7279ea96751 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1375 microversion: 2.1 time: 1.955333 Aug 09 17:42:17.486190 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2686/5119] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:15 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1375 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:17.968719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-beb8d814-d073-4e81-a817-876ec4af3c64 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:17.973003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-beb8d814-d073-4e81-a817-876ec4af3c64 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:18.077000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beb8d814-d073-4e81-a817-876ec4af3c64 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:18.079246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beb8d814-d073-4e81-a817-876ec4af3c64 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:18.084184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beb8d814-d073-4e81-a817-876ec4af3c64 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:18.085920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beb8d814-d073-4e81-a817-876ec4af3c64 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:18.091024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beb8d814-d073-4e81-a817-876ec4af3c64 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:18.091914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-beb8d814-d073-4e81-a817-876ec4af3c64 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:18.251882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64c80a16-36a8-405a-8525-7f26edbdd3a9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:18.254542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-64c80a16-36a8-405a-8525-7f26edbdd3a9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:18.271796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=51 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:18.294949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c80a16-36a8-405a-8525-7f26edbdd3a9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:18.299694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c80a16-36a8-405a-8525-7f26edbdd3a9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:18.300254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c80a16-36a8-405a-8525-7f26edbdd3a9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:18.301054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c80a16-36a8-405a-8525-7f26edbdd3a9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:18.309578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c80a16-36a8-405a-8525-7f26edbdd3a9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:18.310350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64c80a16-36a8-405a-8525-7f26edbdd3a9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:18.421658 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-64c80a16-36a8-405a-8525-7f26edbdd3a9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.172505 Aug 09 17:42:18.428353 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2687/5120] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:42:18 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 17:42:18.518898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1416090-dda3-4d5b-b3dc-d61a640c5936 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:18.520941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1416090-dda3-4d5b-b3dc-d61a640c5936 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:18.537871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1416090-dda3-4d5b-b3dc-d61a640c5936 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:18.538396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1416090-dda3-4d5b-b3dc-d61a640c5936 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:18.538851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1416090-dda3-4d5b-b3dc-d61a640c5936 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:18.542998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1416090-dda3-4d5b-b3dc-d61a640c5936 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:18.550088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1416090-dda3-4d5b-b3dc-d61a640c5936 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:18.551090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1416090-dda3-4d5b-b3dc-d61a640c5936 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:18.748631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-beb8d814-d073-4e81-a817-876ec4af3c64 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:18.769754 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-beb8d814-d073-4e81-a817-876ec4af3c64 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 0.806996 Aug 09 17:42:18.770534 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2434/5121] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:17 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:19.310799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a3ca5910-fc27-4329-b695-e412869f2be2 req-24a80426-4d54-4c4a-a453-3d666fc33c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4442cee9-cb78-4700-8abd-feb6a46950a7", "tag": "37145207-aba5-438e-82db-e9896949a8cb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:19.361959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a3ca5910-fc27-4329-b695-e412869f2be2 req-24a80426-4d54-4c4a-a453-3d666fc33c84 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:19.362709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a3ca5910-fc27-4329-b695-e412869f2be2 req-24a80426-4d54-4c4a-a453-3d666fc33c84 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:19.363366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a3ca5910-fc27-4329-b695-e412869f2be2 req-24a80426-4d54-4c4a-a453-3d666fc33c84 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:19.443007 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a3ca5910-fc27-4329-b695-e412869f2be2 req-24a80426-4d54-4c4a-a453-3d666fc33c84 service nova] Creating event network-changed:37145207-aba5-438e-82db-e9896949a8cb for instance 4442cee9-cb78-4700-8abd-feb6a46950a7 on n-h2-845781-6 Aug 09 17:42:19.457155 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a3ca5910-fc27-4329-b695-e412869f2be2 req-24a80426-4d54-4c4a-a453-3d666fc33c84 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151055 Aug 09 17:42:19.458417 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2435/5122] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:19.470206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3920793f-b713-471b-abe4-121491080cc8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:19.474696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3920793f-b713-471b-abe4-121491080cc8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:19.489909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3920793f-b713-471b-abe4-121491080cc8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:19.490666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3920793f-b713-471b-abe4-121491080cc8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:19.495158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3920793f-b713-471b-abe4-121491080cc8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:19.496439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3920793f-b713-471b-abe4-121491080cc8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:19.496955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3920793f-b713-471b-abe4-121491080cc8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:19.497418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3920793f-b713-471b-abe4-121491080cc8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:19.593921 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3920793f-b713-471b-abe4-121491080cc8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133192 Aug 09 17:42:19.601681 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2436/5123] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:42:19 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:42:19.799703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4d98b861-8e71-4ea6-8b3c-0f0726883a01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:19.803713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4d98b861-8e71-4ea6-8b3c-0f0726883a01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:19.842363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d98b861-8e71-4ea6-8b3c-0f0726883a01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:19.848321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d98b861-8e71-4ea6-8b3c-0f0726883a01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:19.852109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d98b861-8e71-4ea6-8b3c-0f0726883a01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:19.860846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d98b861-8e71-4ea6-8b3c-0f0726883a01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:19.863390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d98b861-8e71-4ea6-8b3c-0f0726883a01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:19.869496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d98b861-8e71-4ea6-8b3c-0f0726883a01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:20.432174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a1416090-dda3-4d5b-b3dc-d61a640c5936 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:20.463471 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1416090-dda3-4d5b-b3dc-d61a640c5936 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1548 microversion: 2.1 time: 1.933412 Aug 09 17:42:20.465066 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2688/5124] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:18 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1548 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:20.493634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-00ca6cfd-6663-4a86-af1e-f2d34d25ade6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:20.497191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-00ca6cfd-6663-4a86-af1e-f2d34d25ade6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:20.526908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ca6cfd-6663-4a86-af1e-f2d34d25ade6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:20.528196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ca6cfd-6663-4a86-af1e-f2d34d25ade6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:20.529024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ca6cfd-6663-4a86-af1e-f2d34d25ade6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:20.530421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ca6cfd-6663-4a86-af1e-f2d34d25ade6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:20.531252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ca6cfd-6663-4a86-af1e-f2d34d25ade6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:20.532092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ca6cfd-6663-4a86-af1e-f2d34d25ade6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:21.213986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-00ca6cfd-6663-4a86-af1e-f2d34d25ade6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:21.255484 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-00ca6cfd-6663-4a86-af1e-f2d34d25ade6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1548 microversion: 2.1 time: 0.779574 Aug 09 17:42:21.276737 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2689/5125] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:20 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1548 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:21.313515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-051ea853-f7d5-4877-b069-4e9d851f7657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:21.332681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-051ea853-f7d5-4877-b069-4e9d851f7657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:21.373896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051ea853-f7d5-4877-b069-4e9d851f7657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:21.375269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051ea853-f7d5-4877-b069-4e9d851f7657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:21.376716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051ea853-f7d5-4877-b069-4e9d851f7657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:21.385399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051ea853-f7d5-4877-b069-4e9d851f7657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:21.389014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051ea853-f7d5-4877-b069-4e9d851f7657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:21.390159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051ea853-f7d5-4877-b069-4e9d851f7657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:21.565409 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-051ea853-f7d5-4877-b069-4e9d851f7657 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.272078 Aug 09 17:42:21.567260 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2690/5126] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:42:21 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 197 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:42:21.591817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4d98b861-8e71-4ea6-8b3c-0f0726883a01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:21.608318 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4d98b861-8e71-4ea6-8b3c-0f0726883a01 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 1.816878 Aug 09 17:42:21.618498 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2437/5127] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:19 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:22.062117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-b30556f5-0de7-46da-8b6b-6793cf730dfe req-71505768-4d86-4b0a-b711-659866bcc22a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c866f02-8911-484b-821b-4b8528f0f84b", "tag": "f9688d6c-0cee-41f7-9086-8ad3891cac5c"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:22.105334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1f7f9a9c-3725-4173-a303-a83375bbf8f1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Action: 'create', calling method: .version_select at 0x7fbbca4e2940>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1796031749", "policies": ["affinity"]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:22.164688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-1f7f9a9c-3725-4173-a303-a83375bbf8f1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:22.173194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b30556f5-0de7-46da-8b6b-6793cf730dfe req-71505768-4d86-4b0a-b711-659866bcc22a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:22.176431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b30556f5-0de7-46da-8b6b-6793cf730dfe req-71505768-4d86-4b0a-b711-659866bcc22a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:22.176710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-1f7f9a9c-3725-4173-a303-a83375bbf8f1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:22.177319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-b30556f5-0de7-46da-8b6b-6793cf730dfe req-71505768-4d86-4b0a-b711-659866bcc22a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:22.240819 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1f7f9a9c-3725-4173-a303-a83375bbf8f1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [49dc9fd5-bcbd-4fa9-bc72-49fff9e68c2b] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 17:42:22.280931 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-b30556f5-0de7-46da-8b6b-6793cf730dfe req-71505768-4d86-4b0a-b711-659866bcc22a service nova] Creating event network-changed:f9688d6c-0cee-41f7-9086-8ad3891cac5c for instance 1c866f02-8911-484b-821b-4b8528f0f84b on n-h1-845781-6 Aug 09 17:42:22.295997 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-b30556f5-0de7-46da-8b6b-6793cf730dfe req-71505768-4d86-4b0a-b711-659866bcc22a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243170 Aug 09 17:42:22.297139 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2438/5128] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:22.580568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c46bf4f0-128e-4a39-834f-67c909ef0ff4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:22.583212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c46bf4f0-128e-4a39-834f-67c909ef0ff4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:22.603593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c46bf4f0-128e-4a39-834f-67c909ef0ff4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:22.604842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c46bf4f0-128e-4a39-834f-67c909ef0ff4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:22.605461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c46bf4f0-128e-4a39-834f-67c909ef0ff4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:22.606382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c46bf4f0-128e-4a39-834f-67c909ef0ff4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:22.607158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c46bf4f0-128e-4a39-834f-67c909ef0ff4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:22.607811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c46bf4f0-128e-4a39-834f-67c909ef0ff4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:22.670798 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c46bf4f0-128e-4a39-834f-67c909ef0ff4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.095693 Aug 09 17:42:22.689674 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2439/5129] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:42:22 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:22.695429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7e3b3770-d4a0-47a7-b032-6a9350bac055 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:22.696297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7e3b3770-d4a0-47a7-b032-6a9350bac055 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:22.703138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e3b3770-d4a0-47a7-b032-6a9350bac055 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:22.703925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e3b3770-d4a0-47a7-b032-6a9350bac055 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:22.704699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e3b3770-d4a0-47a7-b032-6a9350bac055 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:22.705823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e3b3770-d4a0-47a7-b032-6a9350bac055 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:22.706461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e3b3770-d4a0-47a7-b032-6a9350bac055 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:22.707143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7e3b3770-d4a0-47a7-b032-6a9350bac055 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:23.253256 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [None req-1f7f9a9c-3725-4173-a303-a83375bbf8f1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [49dc9fd5-bcbd-4fa9-bc72-49fff9e68c2b] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 38886. Aug 09 17:42:23.311345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-1f7f9a9c-3725-4173-a303-a83375bbf8f1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:23.324485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-1f7f9a9c-3725-4173-a303-a83375bbf8f1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:23.369585 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1f7f9a9c-3725-4173-a303-a83375bbf8f1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 1.800076 Aug 09 17:42:23.380761 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2691/5130] 10.222.0.93 () {60 vars in 1174 bytes} [Tue Aug 9 17:42:21 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:23.392222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88c05ed5-bf00-486c-8257-7b854c94e050 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:23.393661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88c05ed5-bf00-486c-8257-7b854c94e050 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:23.409036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88c05ed5-bf00-486c-8257-7b854c94e050 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:23.410491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88c05ed5-bf00-486c-8257-7b854c94e050 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:23.412703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88c05ed5-bf00-486c-8257-7b854c94e050 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:23.414467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88c05ed5-bf00-486c-8257-7b854c94e050 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:23.415786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88c05ed5-bf00-486c-8257-7b854c94e050 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:23.416961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88c05ed5-bf00-486c-8257-7b854c94e050 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:23.479793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88c05ed5-bf00-486c-8257-7b854c94e050 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:42:23.708087 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88c05ed5-bf00-486c-8257-7b854c94e050 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 204 len: 0 microversion: 2.20 time: 0.321419 Aug 09 17:42:23.709314 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2692/5131] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:42:23 2022] DELETE /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:42:23.728435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f469c209-deef-4ae3-8d53-a38b378b02fb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Action: 'create', calling method: .version_select at 0x7fbbca7909d0>, body: {"server_group": {"name": "tempest-server-group-800656462", "policies": ["affinity"]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:23.772397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7e3b3770-d4a0-47a7-b032-6a9350bac055 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:23.773811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f469c209-deef-4ae3-8d53-a38b378b02fb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:23.801136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f469c209-deef-4ae3-8d53-a38b378b02fb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:23.803806 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7e3b3770-d4a0-47a7-b032-6a9350bac055 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 1.098212 Aug 09 17:42:23.804525 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2440/5132] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:22 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:23.820656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:23.821289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:23.849208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:23.850118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:23.850955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:23.865303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:23.866456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:23.867572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:23.944559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f469c209-deef-4ae3-8d53-a38b378b02fb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:23.956138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f469c209-deef-4ae3-8d53-a38b378b02fb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:23.987875 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f469c209-deef-4ae3-8d53-a38b378b02fb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.275781 Aug 09 17:42:23.998786 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2693/5133] 10.222.0.93 () {60 vars in 1173 bytes} [Tue Aug 9 17:42:23 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:24.005256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4ecfd80-1f0c-45b6-8ee6-996fe9386c04 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Action: 'create', calling method: .version_select at 0x7fbbca700b80>, body: {"server_group": {"name": "tempest-server-group-800656462", "policies": ["affinity"]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:24.067075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c4ecfd80-1f0c-45b6-8ee6-996fe9386c04 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:24.100966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c4ecfd80-1f0c-45b6-8ee6-996fe9386c04 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:24.252143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c4ecfd80-1f0c-45b6-8ee6-996fe9386c04 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:24.261617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c4ecfd80-1f0c-45b6-8ee6-996fe9386c04 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:24.285136 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c4ecfd80-1f0c-45b6-8ee6-996fe9386c04 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.284431 Aug 09 17:42:24.286985 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2694/5134] 10.222.0.93 () {60 vars in 1173 bytes} [Tue Aug 9 17:42:23 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:24.300390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-417e0b7b-cafd-4dd1-a896-4349fbd67402 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:24.320690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:24.358539 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-417e0b7b-cafd-4dd1-a896-4349fbd67402 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/bbb58aee-3c29-490c-8b1c-7a60af6b5590" status: 204 len: 0 microversion: 2.1 time: 0.063504 Aug 09 17:42:24.363668 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2695/5135] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:42:24 2022] DELETE /compute/v2.1/os-server-groups/bbb58aee-3c29-490c-8b1c-7a60af6b5590 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:42:24.383659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c84c123-a55e-4c30-8f93-57b51a8ed6dd tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:24.388054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:24.407472 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c84c123-a55e-4c30-8f93-57b51a8ed6dd tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.042320 Aug 09 17:42:24.415396 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2696/5136] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:42:24 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:24.421390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ca61f38-b57b-4424-ae90-789e763a41c2 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:24.433730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:24.436969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:24.438999 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5f50f575-8502-4f91-8552-d4135bc4b347 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1722 microversion: 2.20 time: 0.633146 Aug 09 17:42:24.463408 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ca61f38-b57b-4424-ae90-789e763a41c2 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/5bce2dd3-d76f-4ec9-a95a-c97565e02ac6" status: 204 len: 0 microversion: 2.1 time: 0.046719 Aug 09 17:42:24.464370 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2697/5137] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:42:24 2022] DELETE /compute/v2.1/os-server-groups/5bce2dd3-d76f-4ec9-a95a-c97565e02ac6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:42:24.476796 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2441/5138] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:42:23 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1722 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:42:24.483381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b814f39e-72fb-46a6-aa4f-230646b61401 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:24.515817 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b814f39e-72fb-46a6-aa4f-230646b61401 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.044598 Aug 09 17:42:24.531582 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2698/5139] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:42:24 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:24.549236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-de7570a3-58e0-4564-b1de-148874b136ce tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Action: 'create', calling method: .version_select at 0x7fbbdc9d2040>, body: {"server_group": {"name": "tempest-server-group-391981592", "policies": ["affinity"]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:24.595160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-de7570a3-58e0-4564-b1de-148874b136ce tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:24.610527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-de7570a3-58e0-4564-b1de-148874b136ce tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:24.802900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-de7570a3-58e0-4564-b1de-148874b136ce tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:24.813513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-de7570a3-58e0-4564-b1de-148874b136ce tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:24.837434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c379f3ce-22a0-45ea-8076-d30f2e373afb tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:24.838534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c379f3ce-22a0-45ea-8076-d30f2e373afb tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:24.852718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c379f3ce-22a0-45ea-8076-d30f2e373afb tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:24.854649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c379f3ce-22a0-45ea-8076-d30f2e373afb tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:24.856210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c379f3ce-22a0-45ea-8076-d30f2e373afb tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:24.858157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c379f3ce-22a0-45ea-8076-d30f2e373afb tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:24.859341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c379f3ce-22a0-45ea-8076-d30f2e373afb tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:24.861555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c379f3ce-22a0-45ea-8076-d30f2e373afb tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:24.875392 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-de7570a3-58e0-4564-b1de-148874b136ce tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.343462 Aug 09 17:42:24.885949 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2442/5140] 10.222.0.93 () {60 vars in 1173 bytes} [Tue Aug 9 17:42:24 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:24.897183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-73c6c6d0-c03d-4f8c-9777-ec1ba1597098 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:24.999513 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-73c6c6d0-c03d-4f8c-9777-ec1ba1597098 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/9ddb05c5-ef3a-446f-8424-d8fe1f1da361" status: 204 len: 0 microversion: 2.1 time: 0.110875 Aug 09 17:42:25.008167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2443/5141] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:42:24 2022] DELETE /compute/v2.1/os-server-groups/9ddb05c5-ef3a-446f-8424-d8fe1f1da361 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:42:25.028159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f4cb33b4-1cdc-43f8-aef5-ab2a4748926f tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:25.064710 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f4cb33b4-1cdc-43f8-aef5-ab2a4748926f tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.049455 Aug 09 17:42:25.079341 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2444/5142] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:42:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:25.087533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c4a5f6f5-ee61-4a1e-ac57-bac15cd25b22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Action: 'create', calling method: .version_select at 0x7fbbcb73f430>, body: {"server_group": {"name": "tempest-server-group-848625118", "policies": ["anti-affinity"]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:25.135682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-c4a5f6f5-ee61-4a1e-ac57-bac15cd25b22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:25.155579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-c4a5f6f5-ee61-4a1e-ac57-bac15cd25b22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:25.301326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-c4a5f6f5-ee61-4a1e-ac57-bac15cd25b22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:25.331569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-c4a5f6f5-ee61-4a1e-ac57-bac15cd25b22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_groups'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:25.367353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c379f3ce-22a0-45ea-8076-d30f2e373afb tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:25.374027 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c4a5f6f5-ee61-4a1e-ac57-bac15cd25b22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.293372 Aug 09 17:42:25.384412 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2445/5143] 10.222.0.93 () {60 vars in 1173 bytes} [Tue Aug 9 17:42:25 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:25.399489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e4e50ec9-30ce-46fc-98d8-e033f2833682 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:25.424568 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c379f3ce-22a0-45ea-8076-d30f2e373afb tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 0.586975 Aug 09 17:42:25.432216 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2699/5144] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:24 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:42:25.502067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:25.508227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:25.565489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:25.566642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:25.568334 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e4e50ec9-30ce-46fc-98d8-e033f2833682 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/4e24e208-e015-4205-8dc2-2f64b1f0133c" status: 204 len: 0 microversion: 2.1 time: 0.172196 Aug 09 17:42:25.573855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:25.576139 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2446/5145] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:42:25 2022] DELETE /compute/v2.1/os-server-groups/4e24e208-e015-4205-8dc2-2f64b1f0133c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:42:25.578864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:25.580636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:25.582614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:25.607750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b3ae7ad2-81d9-470e-803d-5c0dbd181e9b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:25.689754 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b3ae7ad2-81d9-470e-803d-5c0dbd181e9b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.090782 Aug 09 17:42:25.696709 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2447/5146] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:42:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:26.104167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1068128738", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "11b141f7-31e0-4c4e-9a49-0485ad99db87"}]}, "os:scheduler_hints": {"group": "b3e3f15c-d5ea-44d4-808b-b073bec42294"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:26.287583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] validate_networks() for [('11b141f7-31e0-4c4e-9a49-0485ad99db87', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:42:27.714698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:27.734753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:27.736848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:27.738534 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c76fe44a-bb05-41d0-af28-3aaed0e91461 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1722 microversion: 2.20 time: 2.253381 Aug 09 17:42:27.740207 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2700/5147] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:42:25 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1722 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:42:27.768584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0184eaf9-053e-4be0-82a7-0529204b35f4 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:27.772722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0184eaf9-053e-4be0-82a7-0529204b35f4 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:27.790452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0184eaf9-053e-4be0-82a7-0529204b35f4 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:27.792926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0184eaf9-053e-4be0-82a7-0529204b35f4 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:27.795865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0184eaf9-053e-4be0-82a7-0529204b35f4 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:27.798217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0184eaf9-053e-4be0-82a7-0529204b35f4 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:27.799057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0184eaf9-053e-4be0-82a7-0529204b35f4 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:27.799773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0184eaf9-053e-4be0-82a7-0529204b35f4 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:29.674178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0184eaf9-053e-4be0-82a7-0529204b35f4 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:29.704561 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0184eaf9-053e-4be0-82a7-0529204b35f4 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 1.961851 Aug 09 17:42:29.735871 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2701/5148] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:27 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:29.752896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2f6abcbc-af47-4c4a-b4c4-9b73084ae819 req-1a5f2753-5d89-4da5-a7f8-2c7b38bbe8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deacdae-0205-41a6-b164-640022f2eef4", "name": "network-vif-unplugged", "status": "completed", "tag": "a322ddf6-871d-4af1-8243-03824c9855a1"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:29.790191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2f6abcbc-af47-4c4a-b4c4-9b73084ae819 req-1a5f2753-5d89-4da5-a7f8-2c7b38bbe8ee service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:29.795861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2f6abcbc-af47-4c4a-b4c4-9b73084ae819 req-1a5f2753-5d89-4da5-a7f8-2c7b38bbe8ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:29.797838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2f6abcbc-af47-4c4a-b4c4-9b73084ae819 req-1a5f2753-5d89-4da5-a7f8-2c7b38bbe8ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:29.852962 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2f6abcbc-af47-4c4a-b4c4-9b73084ae819 req-1a5f2753-5d89-4da5-a7f8-2c7b38bbe8ee service nova] Creating event network-vif-unplugged:a322ddf6-871d-4af1-8243-03824c9855a1 for instance 8deacdae-0205-41a6-b164-640022f2eef4 on n-h2-845781-6 Aug 09 17:42:29.878864 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2f6abcbc-af47-4c4a-b4c4-9b73084ae819 req-1a5f2753-5d89-4da5-a7f8-2c7b38bbe8ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140221 Aug 09 17:42:29.881445 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2702/5149] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:29.899353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:29.901315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:29.915227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:29.916823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:29.918462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:29.920487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:29.921809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:29.923010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:31.184366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:42:31.185256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:42:31.188284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:42:31.190281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:42:31.193309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:42:31.219183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:31.256203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:31.256987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:31.259258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:31.260417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:31.261780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:31.266732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:31.321262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:31.353706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:31.427489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:42:31.441097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:42:31.456979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:31.532834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:31.536938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:31.543559 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d5e6169d-6dbb-4a77-acfa-54f589ed7964 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1722 microversion: 2.20 time: 1.659570 Aug 09 17:42:31.555657 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2703/5150] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:42:29 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1722 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:42:31.579502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd4a6c3c-2129-428f-8fed-641ff51369a8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:31.580983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd4a6c3c-2129-428f-8fed-641ff51369a8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:31.618084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd4a6c3c-2129-428f-8fed-641ff51369a8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:31.619335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd4a6c3c-2129-428f-8fed-641ff51369a8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:31.620658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd4a6c3c-2129-428f-8fed-641ff51369a8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:31.622447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd4a6c3c-2129-428f-8fed-641ff51369a8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:31.624536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd4a6c3c-2129-428f-8fed-641ff51369a8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:31.625930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd4a6c3c-2129-428f-8fed-641ff51369a8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:31.696320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:31.710289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:31.844922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:31.873739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Getting quotas for user 59ffaf351662478a979f72d9ca4a4437 and project a5f4ce5e4396489cab58595253784bcf. Resources: {'server_group_members'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:32.056665 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8cab00d1-956f-4913-9484-36c75f45acf3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.966524 Aug 09 17:42:32.062060 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2448/5151] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:42:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 5973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:42:32.089810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9c297b8a-a14c-46bf-9680-d6a16c36df3e tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:32.095216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9c297b8a-a14c-46bf-9680-d6a16c36df3e tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:32.698607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9c297b8a-a14c-46bf-9680-d6a16c36df3e tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:32.710718 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9c297b8a-a14c-46bf-9680-d6a16c36df3e tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1213 microversion: 2.1 time: 0.640150 Aug 09 17:42:32.716874 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2449/5152] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:32 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1213 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:32.743096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-7843d525-c1d2-418d-97c9-0ea983ba040d req-66bf0792-168c-4bba-9c1d-0889b6f350c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4442cee9-cb78-4700-8abd-feb6a46950a7", "name": "network-vif-plugged", "status": "completed", "tag": "37145207-aba5-438e-82db-e9896949a8cb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:32.769510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7843d525-c1d2-418d-97c9-0ea983ba040d req-66bf0792-168c-4bba-9c1d-0889b6f350c6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:32.773986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7843d525-c1d2-418d-97c9-0ea983ba040d req-66bf0792-168c-4bba-9c1d-0889b6f350c6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:32.774726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7843d525-c1d2-418d-97c9-0ea983ba040d req-66bf0792-168c-4bba-9c1d-0889b6f350c6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:32.814562 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-7843d525-c1d2-418d-97c9-0ea983ba040d req-66bf0792-168c-4bba-9c1d-0889b6f350c6 service nova] Creating event network-vif-plugged:37145207-aba5-438e-82db-e9896949a8cb for instance 4442cee9-cb78-4700-8abd-feb6a46950a7 on n-h2-845781-6 Aug 09 17:42:32.849473 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-7843d525-c1d2-418d-97c9-0ea983ba040d req-66bf0792-168c-4bba-9c1d-0889b6f350c6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107873 Aug 09 17:42:32.851725 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2450/5153] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:32.890663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:32.906010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:32.943908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:32.948119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:32.949204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:32.950571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:32.951442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:32.952247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:33.178151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:33.189188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:33.202144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:33.204519 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-396ab0b6-fca8-423c-94bc-370740ee737f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1654 microversion: 2.20 time: 0.344222 Aug 09 17:42:33.205400 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2451/5154] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:42:32 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1654 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:42:33.260802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd4a6c3c-2129-428f-8fed-641ff51369a8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:33.273427 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd4a6c3c-2129-428f-8fed-641ff51369a8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 1.715282 Aug 09 17:42:33.275780 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2704/5155] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:31 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:33.480307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-f7757b37-42a7-47fe-854e-c0394a369de3 req-009d45e6-da41-4535-a081-c396e8c7c489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deacdae-0205-41a6-b164-640022f2eef4", "name": "network-vif-deleted", "tag": "a322ddf6-871d-4af1-8243-03824c9855a1"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:33.514226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f7757b37-42a7-47fe-854e-c0394a369de3 req-009d45e6-da41-4535-a081-c396e8c7c489 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:33.518513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f7757b37-42a7-47fe-854e-c0394a369de3 req-009d45e6-da41-4535-a081-c396e8c7c489 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:33.521356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f7757b37-42a7-47fe-854e-c0394a369de3 req-009d45e6-da41-4535-a081-c396e8c7c489 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:33.625832 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-f7757b37-42a7-47fe-854e-c0394a369de3 req-009d45e6-da41-4535-a081-c396e8c7c489 service nova] Creating event network-vif-deleted:a322ddf6-871d-4af1-8243-03824c9855a1 for instance 8deacdae-0205-41a6-b164-640022f2eef4 on n-h2-845781-6 Aug 09 17:42:33.649957 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-f7757b37-42a7-47fe-854e-c0394a369de3 req-009d45e6-da41-4535-a081-c396e8c7c489 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197172 Aug 09 17:42:33.653777 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2452/5156] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:33.743398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2138e76d-62e3-4673-bc63-ebffd36926d3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:33.744212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2138e76d-62e3-4673-bc63-ebffd36926d3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:34.037217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2138e76d-62e3-4673-bc63-ebffd36926d3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:34.056477 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2138e76d-62e3-4673-bc63-ebffd36926d3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1213 microversion: 2.1 time: 0.315314 Aug 09 17:42:34.061827 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2705/5157] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:33 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1213 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:34.272568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:34.277330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:34.298098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c83cf92e-e82e-4e56-a5e7-16f6232e58cc tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:34.300567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c83cf92e-e82e-4e56-a5e7-16f6232e58cc tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:34.310710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:34.315799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:34.317801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:34.320380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c83cf92e-e82e-4e56-a5e7-16f6232e58cc tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:34.321292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:34.323418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:34.325663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:34.329870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c83cf92e-e82e-4e56-a5e7-16f6232e58cc tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:34.332279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c83cf92e-e82e-4e56-a5e7-16f6232e58cc tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:34.338265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c83cf92e-e82e-4e56-a5e7-16f6232e58cc tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:34.339422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c83cf92e-e82e-4e56-a5e7-16f6232e58cc tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:34.343232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c83cf92e-e82e-4e56-a5e7-16f6232e58cc tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:34.575053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:34.578245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:34.580751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:34.584250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lazy-loading 'fault' on Instance uuid 8deacdae-0205-41a6-b164-640022f2eef4 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:42:34.722278 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:34.735329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:34.741238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:34.748014 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-21ebf2a8-7517-45f4-924d-4b34d8767209 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 200 len: 1370 microversion: 2.20 time: 0.497608 Aug 09 17:42:34.750039 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2453/5158] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:42:34 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 1370 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:42:35.078028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c83cf92e-e82e-4e56-a5e7-16f6232e58cc tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:35.081790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1b5352a2-c37b-4b66-92c0-fc2b45954f53 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:35.083570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1b5352a2-c37b-4b66-92c0-fc2b45954f53 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:35.100502 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c83cf92e-e82e-4e56-a5e7-16f6232e58cc tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1320 microversion: 2.1 time: 0.800367 Aug 09 17:42:35.100502 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2706/5159] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:34 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1320 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:42:35.145483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b5352a2-c37b-4b66-92c0-fc2b45954f53 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:35.147360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b5352a2-c37b-4b66-92c0-fc2b45954f53 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:35.149509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b5352a2-c37b-4b66-92c0-fc2b45954f53 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:35.153414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b5352a2-c37b-4b66-92c0-fc2b45954f53 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:35.154139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b5352a2-c37b-4b66-92c0-fc2b45954f53 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:35.155168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1b5352a2-c37b-4b66-92c0-fc2b45954f53 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:35.402695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1b5352a2-c37b-4b66-92c0-fc2b45954f53 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:35.419696 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1b5352a2-c37b-4b66-92c0-fc2b45954f53 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1209 microversion: 2.1 time: 0.341969 Aug 09 17:42:35.453969 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2454/5160] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:35 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1209 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:35.778265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:35.779664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:35.796998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:35.803497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:35.806063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:35.808625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:35.813284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:35.815615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:35.900725 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] HTTP exception thrown: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Request method failure captured: Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 HTTP/1.1 Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pthMYdFxPYDku5unJwmhNtbW-CIsOCbcuzoSvZ1sUYsCWJDOK-PRp7ZrwqoOGBff1iE8OYCV2XhVOe0o5u0YhJo3NfdpuauYANC7XmZNwepkMQxxWJlaW5IilHkGR8cbJRr892I6gW6td5IwpwjU-Nm4mRlCKdr6CSrJxTF8vaIb30 Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e5530d014d1a44119b8f0c5fa9e76b3a Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8deacdae-0205-41a6-b164-640022f2eef4'} Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:42:35.909952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:42:35.914760 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:42:35.914760 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:42:35.914760 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:42:35.914760 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:42:35.914760 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:42:35.914760 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:42:35.914760 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:42:35.914760 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:42:35.918807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Returning 404 to user: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:42:35.924714 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d7abc8d0-3202-4328-9901-577802574f80 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 404 len: 111 microversion: 2.20 time: 0.150638 Aug 09 17:42:35.930613 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2707/5161] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:42:35 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:42:35.940149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5e018bdb-a103-4d30-90ba-b9d805e07a72 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '.version_select at 0x7fbbcb4e3d30>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:36.007194 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5e018bdb-a103-4d30-90ba-b9d805e07a72 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-474605747" status: 204 len: 0 microversion: 2.20 time: 0.071000 Aug 09 17:42:36.008429 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2455/5162] 10.222.0.93 () {60 vars in 1259 bytes} [Tue Aug 9 17:42:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-474605747 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:42:36.130950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4acc6fa2-5a26-4b83-a04e-b442ab2fdcf3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:36.132394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4acc6fa2-5a26-4b83-a04e-b442ab2fdcf3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:36.179394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4acc6fa2-5a26-4b83-a04e-b442ab2fdcf3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:36.180200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4acc6fa2-5a26-4b83-a04e-b442ab2fdcf3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:36.182739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4acc6fa2-5a26-4b83-a04e-b442ab2fdcf3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:36.190096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4acc6fa2-5a26-4b83-a04e-b442ab2fdcf3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:36.191429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4acc6fa2-5a26-4b83-a04e-b442ab2fdcf3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:36.191953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4acc6fa2-5a26-4b83-a04e-b442ab2fdcf3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:36.460813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dff1d1c9-22d1-4168-91ba-872bea09e4f0 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:36.462259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dff1d1c9-22d1-4168-91ba-872bea09e4f0 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:36.488990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dff1d1c9-22d1-4168-91ba-872bea09e4f0 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:36.490610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dff1d1c9-22d1-4168-91ba-872bea09e4f0 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:36.493108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dff1d1c9-22d1-4168-91ba-872bea09e4f0 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:36.494113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dff1d1c9-22d1-4168-91ba-872bea09e4f0 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:36.496380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dff1d1c9-22d1-4168-91ba-872bea09e4f0 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:36.500227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dff1d1c9-22d1-4168-91ba-872bea09e4f0 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:36.716776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dff1d1c9-22d1-4168-91ba-872bea09e4f0 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:36.730506 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dff1d1c9-22d1-4168-91ba-872bea09e4f0 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1271 microversion: 2.1 time: 0.274555 Aug 09 17:42:36.733619 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2456/5163] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:36 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:37.771593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-85fa1e8c-7f79-4032-beb0-7c6d2f44e6cc tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:37.782024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-85fa1e8c-7f79-4032-beb0-7c6d2f44e6cc tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:37.842940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85fa1e8c-7f79-4032-beb0-7c6d2f44e6cc tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:37.864025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85fa1e8c-7f79-4032-beb0-7c6d2f44e6cc tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:37.865613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85fa1e8c-7f79-4032-beb0-7c6d2f44e6cc tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:37.866971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85fa1e8c-7f79-4032-beb0-7c6d2f44e6cc tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:37.875426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85fa1e8c-7f79-4032-beb0-7c6d2f44e6cc tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:37.886011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85fa1e8c-7f79-4032-beb0-7c6d2f44e6cc tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:38.162553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-85fa1e8c-7f79-4032-beb0-7c6d2f44e6cc tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:38.176369 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-85fa1e8c-7f79-4032-beb0-7c6d2f44e6cc tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1271 microversion: 2.1 time: 0.427337 Aug 09 17:42:38.184230 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2457/5164] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:37 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1271 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:42:38.197709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-3c16d97e-7193-4ad9-bddd-9201414dc4a1 req-50062839-8a75-4c31-b69a-0ef60e8526c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c866f02-8911-484b-821b-4b8528f0f84b", "name": "network-vif-plugged", "status": "completed", "tag": "f9688d6c-0cee-41f7-9086-8ad3891cac5c"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:38.247894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3c16d97e-7193-4ad9-bddd-9201414dc4a1 req-50062839-8a75-4c31-b69a-0ef60e8526c6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:38.251165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4acc6fa2-5a26-4b83-a04e-b442ab2fdcf3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:38.252369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3c16d97e-7193-4ad9-bddd-9201414dc4a1 req-50062839-8a75-4c31-b69a-0ef60e8526c6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:38.253082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-3c16d97e-7193-4ad9-bddd-9201414dc4a1 req-50062839-8a75-4c31-b69a-0ef60e8526c6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:38.258833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:38.287227 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-3c16d97e-7193-4ad9-bddd-9201414dc4a1 req-50062839-8a75-4c31-b69a-0ef60e8526c6 service nova] Creating event network-vif-plugged:f9688d6c-0cee-41f7-9086-8ad3891cac5c for instance 1c866f02-8911-484b-821b-4b8528f0f84b on n-h1-845781-6 Aug 09 17:42:38.312093 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-3c16d97e-7193-4ad9-bddd-9201414dc4a1 req-50062839-8a75-4c31-b69a-0ef60e8526c6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126352 Aug 09 17:42:38.313362 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2458/5165] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:38.328712 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4acc6fa2-5a26-4b83-a04e-b442ab2fdcf3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 200 len: 1507 microversion: 2.1 time: 2.200321 Aug 09 17:42:38.333028 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2708/5166] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:36 2022] GET /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 1507 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:38.372021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ded7297-bcc9-42a5-acfd-48e9853e5580 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:38.373362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4ded7297-bcc9-42a5-acfd-48e9853e5580 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 1c866f02-8911-484b-821b-4b8528f0f84b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:38.398292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ded7297-bcc9-42a5-acfd-48e9853e5580 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:38.403591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ded7297-bcc9-42a5-acfd-48e9853e5580 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:38.404748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ded7297-bcc9-42a5-acfd-48e9853e5580 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:38.415831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ded7297-bcc9-42a5-acfd-48e9853e5580 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:38.417808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ded7297-bcc9-42a5-acfd-48e9853e5580 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:38.419068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ded7297-bcc9-42a5-acfd-48e9853e5580 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:39.202346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-63b88b84-3bcd-43f8-b168-9692cf9416d5 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:39.203147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-63b88b84-3bcd-43f8-b168-9692cf9416d5 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:39.220530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63b88b84-3bcd-43f8-b168-9692cf9416d5 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:39.221187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63b88b84-3bcd-43f8-b168-9692cf9416d5 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:39.221890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63b88b84-3bcd-43f8-b168-9692cf9416d5 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:39.222926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63b88b84-3bcd-43f8-b168-9692cf9416d5 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:39.224279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63b88b84-3bcd-43f8-b168-9692cf9416d5 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:39.224960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63b88b84-3bcd-43f8-b168-9692cf9416d5 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:39.454153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4ded7297-bcc9-42a5-acfd-48e9853e5580 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:39.462782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-63b88b84-3bcd-43f8-b168-9692cf9416d5 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:39.469623 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4ded7297-bcc9-42a5-acfd-48e9853e5580 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/1c866f02-8911-484b-821b-4b8528f0f84b" status: 200 len: 1320 microversion: 2.1 time: 1.102471 Aug 09 17:42:39.470767 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2459/5167] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:38 2022] GET /compute/v2.1/servers/1c866f02-8911-484b-821b-4b8528f0f84b => generated 1320 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:39.473570 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-63b88b84-3bcd-43f8-b168-9692cf9416d5 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1271 microversion: 2.1 time: 0.274975 Aug 09 17:42:39.488980 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2709/5168] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:39 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:42:40.508509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c97ecdae-8729-4b3d-ac26-9127caa761e1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:40.509177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c97ecdae-8729-4b3d-ac26-9127caa761e1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:40.516481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-faff5b29-d6a6-41e6-950e-d157b7ff502c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:40.517147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-faff5b29-d6a6-41e6-950e-d157b7ff502c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 1c866f02-8911-484b-821b-4b8528f0f84b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:40.540372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faff5b29-d6a6-41e6-950e-d157b7ff502c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:40.543101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c97ecdae-8729-4b3d-ac26-9127caa761e1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:40.549299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faff5b29-d6a6-41e6-950e-d157b7ff502c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:40.557324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c97ecdae-8729-4b3d-ac26-9127caa761e1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:40.557918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c97ecdae-8729-4b3d-ac26-9127caa761e1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:40.558718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c97ecdae-8729-4b3d-ac26-9127caa761e1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:40.559214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c97ecdae-8729-4b3d-ac26-9127caa761e1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:40.559747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c97ecdae-8729-4b3d-ac26-9127caa761e1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:40.564394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faff5b29-d6a6-41e6-950e-d157b7ff502c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:40.565176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faff5b29-d6a6-41e6-950e-d157b7ff502c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:40.565670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faff5b29-d6a6-41e6-950e-d157b7ff502c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:40.566121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faff5b29-d6a6-41e6-950e-d157b7ff502c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:40.589133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:41.219081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c97ecdae-8729-4b3d-ac26-9127caa761e1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:41.244628 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c97ecdae-8729-4b3d-ac26-9127caa761e1 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1313 microversion: 2.1 time: 0.735735 Aug 09 17:42:41.266258 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2460/5169] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:40 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:41.280752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-69daf93f-3db5-4f84-89c3-b5420ca04744 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Action: 'create', calling method: .version_select at 0x7fbbca386550>, body: {"keypair": {"name": "tempest-keypair-873118361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHAg/PioY0zE8I+5eGKHMEcot/RIDxf7SL1XJHbk5xSGYXGovqTkJW6hbvWfedJJNERWe3Atuf8+X5ZBC1WG4HnWKz2Kr6UPCvu1Rd0BeLgmq8DcE8bFD32kb9O0qHczg=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:41.369515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:41.412981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-69daf93f-3db5-4f84-89c3-b5420ca04744 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Getting quotas for project 39ce4b0e2bf84d778a3cf81d91868f0d. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:41.435478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-faff5b29-d6a6-41e6-950e-d157b7ff502c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:41.441163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-69daf93f-3db5-4f84-89c3-b5420ca04744 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Getting quotas for user e5530d014d1a44119b8f0c5fa9e76b3a and project 39ce4b0e2bf84d778a3cf81d91868f0d. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:41.447857 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-faff5b29-d6a6-41e6-950e-d157b7ff502c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/1c866f02-8911-484b-821b-4b8528f0f84b" status: 200 len: 1507 microversion: 2.1 time: 0.943548 Aug 09 17:42:41.455939 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2710/5170] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:40 2022] GET /compute/v2.1/servers/1c866f02-8911-484b-821b-4b8528f0f84b => generated 1507 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:41.494413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c5199be2-8ae2-4eaa-8de1-c49f29f8f35b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:41.502160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c5199be2-8ae2-4eaa-8de1-c49f29f8f35b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 1c866f02-8911-484b-821b-4b8528f0f84b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:41.525742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5199be2-8ae2-4eaa-8de1-c49f29f8f35b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:41.527506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5199be2-8ae2-4eaa-8de1-c49f29f8f35b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:41.528241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5199be2-8ae2-4eaa-8de1-c49f29f8f35b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:41.535245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5199be2-8ae2-4eaa-8de1-c49f29f8f35b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:41.536751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5199be2-8ae2-4eaa-8de1-c49f29f8f35b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:41.537199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c5199be2-8ae2-4eaa-8de1-c49f29f8f35b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:41.560480 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-69daf93f-3db5-4f84-89c3-b5420ca04744 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.290656 Aug 09 17:42:41.569017 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2461/5171] 10.222.0.93 () {62 vars in 1200 bytes} [Tue Aug 9 17:42:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 302 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 17:42:41.679168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c5199be2-8ae2-4eaa-8de1-c49f29f8f35b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 1c866f02-8911-484b-821b-4b8528f0f84b] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:42:41.859760 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c5199be2-8ae2-4eaa-8de1-c49f29f8f35b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1c866f02-8911-484b-821b-4b8528f0f84b" status: 204 len: 0 microversion: 2.1 time: 0.369259 Aug 09 17:42:41.861261 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2711/5172] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:42:41 2022] DELETE /compute/v2.1/servers/1c866f02-8911-484b-821b-4b8528f0f84b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:42:41.873289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aa2974ad-546e-4105-bbcc-45a355a0435c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:41.873934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-aa2974ad-546e-4105-bbcc-45a355a0435c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:41.903297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa2974ad-546e-4105-bbcc-45a355a0435c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:41.907664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa2974ad-546e-4105-bbcc-45a355a0435c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:41.908322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa2974ad-546e-4105-bbcc-45a355a0435c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:41.909245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa2974ad-546e-4105-bbcc-45a355a0435c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:41.911830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa2974ad-546e-4105-bbcc-45a355a0435c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:41.912684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aa2974ad-546e-4105-bbcc-45a355a0435c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:41.997500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-aa2974ad-546e-4105-bbcc-45a355a0435c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 4442cee9-cb78-4700-8abd-feb6a46950a7] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:42:42.212259 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aa2974ad-546e-4105-bbcc-45a355a0435c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7" status: 204 len: 0 microversion: 2.1 time: 0.344139 Aug 09 17:42:42.216224 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2462/5173] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:42:41 2022] DELETE /compute/v2.1/servers/4442cee9-cb78-4700-8abd-feb6a46950a7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:42:42.275330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07f696c3-80f2-4278-b8de-eaf7b50c3c1b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:42.277735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07f696c3-80f2-4278-b8de-eaf7b50c3c1b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:42.328648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07f696c3-80f2-4278-b8de-eaf7b50c3c1b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:42.329432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07f696c3-80f2-4278-b8de-eaf7b50c3c1b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:42.330576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07f696c3-80f2-4278-b8de-eaf7b50c3c1b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:42.345336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07f696c3-80f2-4278-b8de-eaf7b50c3c1b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:42.346410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07f696c3-80f2-4278-b8de-eaf7b50c3c1b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:42.347255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07f696c3-80f2-4278-b8de-eaf7b50c3c1b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:42.615032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-825335127", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "6013f0f7-67f7-477e-8d10-bbfef6011949"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:42.809947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] validate_networks() for [('6013f0f7-67f7-477e-8d10-bbfef6011949', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:42:43.013086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-07f696c3-80f2-4278-b8de-eaf7b50c3c1b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:43.037817 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07f696c3-80f2-4278-b8de-eaf7b50c3c1b tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1313 microversion: 2.1 time: 0.766109 Aug 09 17:42:43.039922 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2712/5174] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:42 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1313 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:44.068221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0c55da82-5163-42b2-ae8a-51c2c940f07c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:44.069241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0c55da82-5163-42b2-ae8a-51c2c940f07c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:44.095067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=26 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:44.152984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c55da82-5163-42b2-ae8a-51c2c940f07c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:44.154463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c55da82-5163-42b2-ae8a-51c2c940f07c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:44.160054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c55da82-5163-42b2-ae8a-51c2c940f07c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:44.164233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c55da82-5163-42b2-ae8a-51c2c940f07c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:44.172915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c55da82-5163-42b2-ae8a-51c2c940f07c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:44.177263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c55da82-5163-42b2-ae8a-51c2c940f07c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:45.569271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:42:45.569883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:42:45.570603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:42:45.571281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:42:45.571946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:42:45.595928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:45.598262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:45.599209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:45.604751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:45.605517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:45.606137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:45.671181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Getting quotas for project 40a4a3ec423d44088b980f87360221a5. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:45.691708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Getting quotas for user 643cb507595841ef80dfc05a069d021b and project 40a4a3ec423d44088b980f87360221a5. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:45.745220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Going to run 2 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:42:45.750385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:42:45.780249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:45.860110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:42:45.906503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0c55da82-5163-42b2-ae8a-51c2c940f07c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:45.949735 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0c55da82-5163-42b2-ae8a-51c2c940f07c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1313 microversion: 2.1 time: 1.890150 Aug 09 17:42:45.985354 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2713/5175] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:44 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1313 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:46.004635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-afc1ab78-7091-4e10-9ebf-ccf06cbd5980 req-02369583-6533-40e1-97c8-219f700c75be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24167e99-cd62-4011-b7f8-d12a1cefd13b", "tag": "c67fdaea-d77e-4077-ab40-269c74fbb684"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:46.062822 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2cf69d4b-91ff-4c62-bf2f-e597d8310527 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.452926 Aug 09 17:42:46.065089 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2463/5176] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:42:42 2022] POST /compute/v2.1/servers => generated 32 bytes in 3457 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 09 17:42:46.072842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-afc1ab78-7091-4e10-9ebf-ccf06cbd5980 req-02369583-6533-40e1-97c8-219f700c75be service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:46.079070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-afc1ab78-7091-4e10-9ebf-ccf06cbd5980 req-02369583-6533-40e1-97c8-219f700c75be service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:46.082604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-afc1ab78-7091-4e10-9ebf-ccf06cbd5980 req-02369583-6533-40e1-97c8-219f700c75be service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:46.087465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8460f64e-ed5e-417a-8e7f-48c3d4d62a14 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:46.121891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8460f64e-ed5e-417a-8e7f-48c3d4d62a14 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:46.124246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8460f64e-ed5e-417a-8e7f-48c3d4d62a14 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Searching by: {'deleted': False, 'project_id': '40a4a3ec423d44088b980f87360221a5'} {{(pid=119432) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 17:42:46.130985 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-afc1ab78-7091-4e10-9ebf-ccf06cbd5980 req-02369583-6533-40e1-97c8-219f700c75be service nova] Creating event network-changed:c67fdaea-d77e-4077-ab40-269c74fbb684 for instance 24167e99-cd62-4011-b7f8-d12a1cefd13b on n-h1-845781-6 Aug 09 17:42:46.142944 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-afc1ab78-7091-4e10-9ebf-ccf06cbd5980 req-02369583-6533-40e1-97c8-219f700c75be service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155835 Aug 09 17:42:46.151464 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2714/5177] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:46.170348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8460f64e-ed5e-417a-8e7f-48c3d4d62a14 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:46.171901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8460f64e-ed5e-417a-8e7f-48c3d4d62a14 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:46.172972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8460f64e-ed5e-417a-8e7f-48c3d4d62a14 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:46.175964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8460f64e-ed5e-417a-8e7f-48c3d4d62a14 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:46.177293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8460f64e-ed5e-417a-8e7f-48c3d4d62a14 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:46.178338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8460f64e-ed5e-417a-8e7f-48c3d4d62a14 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:46.290240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.multi_cell_list [None req-8460f64e-ed5e-417a-8e7f-48c3d4d62a14 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119432) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 17:42:46.311730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9e0f5873-41fa-4686-8f7d-5dc9385e5f31 req-8e7c7907-7c21-4d20-8362-8f10d53ad3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c866f02-8911-484b-821b-4b8528f0f84b", "name": "network-vif-deleted", "tag": "f9688d6c-0cee-41f7-9086-8ad3891cac5c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:46.331470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e0f5873-41fa-4686-8f7d-5dc9385e5f31 req-8e7c7907-7c21-4d20-8362-8f10d53ad3ca service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:46.343838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e0f5873-41fa-4686-8f7d-5dc9385e5f31 req-8e7c7907-7c21-4d20-8362-8f10d53ad3ca service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:46.345109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e0f5873-41fa-4686-8f7d-5dc9385e5f31 req-8e7c7907-7c21-4d20-8362-8f10d53ad3ca service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:46.388399 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9e0f5873-41fa-4686-8f7d-5dc9385e5f31 req-8e7c7907-7c21-4d20-8362-8f10d53ad3ca service nova] Creating event network-vif-deleted:f9688d6c-0cee-41f7-9086-8ad3891cac5c for instance 1c866f02-8911-484b-821b-4b8528f0f84b on n-h1-845781-6 Aug 09 17:42:46.404729 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9e0f5873-41fa-4686-8f7d-5dc9385e5f31 req-8e7c7907-7c21-4d20-8362-8f10d53ad3ca service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102623 Aug 09 17:42:46.421186 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2715/5178] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:42:46.558853 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8460f64e-ed5e-417a-8e7f-48c3d4d62a14 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.477928 Aug 09 17:42:46.561162 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2464/5179] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 17:42:46 2022] GET /compute/v2.1/servers => generated 1335 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:46.575092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88dfa178-251b-43c9-8def-593c5ae969e8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:46.576019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88dfa178-251b-43c9-8def-593c5ae969e8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:46.812359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-88dfa178-251b-43c9-8def-593c5ae969e8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:46.823106 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88dfa178-251b-43c9-8def-593c5ae969e8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1217 microversion: 2.1 time: 0.252708 Aug 09 17:42:46.826875 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2716/5180] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:46 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1217 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:46.991791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-18644096-5849-4a67-978c-b9d6cba57f69 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:46.992639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-18644096-5849-4a67-978c-b9d6cba57f69 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:47.009148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18644096-5849-4a67-978c-b9d6cba57f69 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:47.009659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18644096-5849-4a67-978c-b9d6cba57f69 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:47.010118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18644096-5849-4a67-978c-b9d6cba57f69 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:47.010864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18644096-5849-4a67-978c-b9d6cba57f69 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:47.011331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18644096-5849-4a67-978c-b9d6cba57f69 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:47.027865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18644096-5849-4a67-978c-b9d6cba57f69 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:47.863523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c3cabc1-ef65-49f1-ab70-b6e43f6a2ebe tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:47.871770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c3cabc1-ef65-49f1-ab70-b6e43f6a2ebe tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:48.357088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c3cabc1-ef65-49f1-ab70-b6e43f6a2ebe tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:48.397857 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c3cabc1-ef65-49f1-ab70-b6e43f6a2ebe tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1217 microversion: 2.1 time: 0.540670 Aug 09 17:42:48.417722 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2717/5181] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:47 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1217 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:48.463605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-bc62b6bf-eb92-4c25-8bd8-60659d9d706f req-a15d0a27-79b6-4b99-8e66-c443e461f775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4442cee9-cb78-4700-8abd-feb6a46950a7", "name": "network-vif-deleted", "tag": "37145207-aba5-438e-82db-e9896949a8cb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:48.517676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bc62b6bf-eb92-4c25-8bd8-60659d9d706f req-a15d0a27-79b6-4b99-8e66-c443e461f775 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:48.523431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bc62b6bf-eb92-4c25-8bd8-60659d9d706f req-a15d0a27-79b6-4b99-8e66-c443e461f775 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:48.524416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bc62b6bf-eb92-4c25-8bd8-60659d9d706f req-a15d0a27-79b6-4b99-8e66-c443e461f775 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:48.590189 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-bc62b6bf-eb92-4c25-8bd8-60659d9d706f req-a15d0a27-79b6-4b99-8e66-c443e461f775 service nova] Creating event network-vif-deleted:37145207-aba5-438e-82db-e9896949a8cb for instance 4442cee9-cb78-4700-8abd-feb6a46950a7 on n-h2-845781-6 Aug 09 17:42:48.610007 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-bc62b6bf-eb92-4c25-8bd8-60659d9d706f req-a15d0a27-79b6-4b99-8e66-c443e461f775 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178829 Aug 09 17:42:48.620491 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2718/5182] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:49.452347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9e1b12f7-8081-4128-817f-5c83f416872a tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:49.455405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9e1b12f7-8081-4128-817f-5c83f416872a tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:49.477206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e1b12f7-8081-4128-817f-5c83f416872a tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:49.478899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e1b12f7-8081-4128-817f-5c83f416872a tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:49.480349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e1b12f7-8081-4128-817f-5c83f416872a tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:49.481807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e1b12f7-8081-4128-817f-5c83f416872a tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:49.482923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e1b12f7-8081-4128-817f-5c83f416872a tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:49.484867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e1b12f7-8081-4128-817f-5c83f416872a tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:49.906589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9e1b12f7-8081-4128-817f-5c83f416872a tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:49.925297 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9e1b12f7-8081-4128-817f-5c83f416872a tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1213 microversion: 2.1 time: 0.485504 Aug 09 17:42:49.928723 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2719/5183] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:49 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1213 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:50.965123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb812baf-bfd2-4ae9-9561-00967d9bb968 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:50.968462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb812baf-bfd2-4ae9-9561-00967d9bb968 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:50.993776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb812baf-bfd2-4ae9-9561-00967d9bb968 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:50.994832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb812baf-bfd2-4ae9-9561-00967d9bb968 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:50.999668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb812baf-bfd2-4ae9-9561-00967d9bb968 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:51.000737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb812baf-bfd2-4ae9-9561-00967d9bb968 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:51.001404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb812baf-bfd2-4ae9-9561-00967d9bb968 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:51.002009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb812baf-bfd2-4ae9-9561-00967d9bb968 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:51.814018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-18644096-5849-4a67-978c-b9d6cba57f69 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:51.829925 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-18644096-5849-4a67-978c-b9d6cba57f69 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1313 microversion: 2.1 time: 4.842720 Aug 09 17:42:51.835278 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2465/5184] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:46 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1313 bytes in 4849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:42:52.503041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cb812baf-bfd2-4ae9-9561-00967d9bb968 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:52.548896 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb812baf-bfd2-4ae9-9561-00967d9bb968 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1287 microversion: 2.1 time: 1.587507 Aug 09 17:42:52.563664 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2720/5185] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:50 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1287 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:52.873228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6bf7a6de-30ed-43e5-9b78-f557f5e4468c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:52.882571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6bf7a6de-30ed-43e5-9b78-f557f5e4468c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:52.913082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf7a6de-30ed-43e5-9b78-f557f5e4468c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:52.915876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf7a6de-30ed-43e5-9b78-f557f5e4468c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:52.918867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf7a6de-30ed-43e5-9b78-f557f5e4468c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:52.920861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf7a6de-30ed-43e5-9b78-f557f5e4468c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:52.924116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf7a6de-30ed-43e5-9b78-f557f5e4468c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:52.924116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6bf7a6de-30ed-43e5-9b78-f557f5e4468c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:53.580492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f418fc83-2f85-4234-9d97-b8a16f37bd66 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:53.581204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f418fc83-2f85-4234-9d97-b8a16f37bd66 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:53.601171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f418fc83-2f85-4234-9d97-b8a16f37bd66 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:53.602780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f418fc83-2f85-4234-9d97-b8a16f37bd66 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:53.604378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f418fc83-2f85-4234-9d97-b8a16f37bd66 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:53.605924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f418fc83-2f85-4234-9d97-b8a16f37bd66 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:53.606436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f418fc83-2f85-4234-9d97-b8a16f37bd66 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:53.609151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f418fc83-2f85-4234-9d97-b8a16f37bd66 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:53.624697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6bf7a6de-30ed-43e5-9b78-f557f5e4468c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:53.649503 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6bf7a6de-30ed-43e5-9b78-f557f5e4468c tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1313 microversion: 2.1 time: 0.778578 Aug 09 17:42:53.655138 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2466/5186] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:52 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:53.798366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f418fc83-2f85-4234-9d97-b8a16f37bd66 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:53.812442 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f418fc83-2f85-4234-9d97-b8a16f37bd66 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1275 microversion: 2.1 time: 0.235781 Aug 09 17:42:53.815918 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2721/5187] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:53 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1275 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:54.675276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-86c251d8-1203-46d4-8eaf-32de451f38a7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:54.679321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-86c251d8-1203-46d4-8eaf-32de451f38a7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:54.701680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86c251d8-1203-46d4-8eaf-32de451f38a7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:54.703357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86c251d8-1203-46d4-8eaf-32de451f38a7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:54.705972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86c251d8-1203-46d4-8eaf-32de451f38a7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:54.709096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86c251d8-1203-46d4-8eaf-32de451f38a7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:54.710545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86c251d8-1203-46d4-8eaf-32de451f38a7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:54.711458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86c251d8-1203-46d4-8eaf-32de451f38a7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:54.840709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e616cb95-f48f-4192-bdbf-c227bc25682c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:54.842313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e616cb95-f48f-4192-bdbf-c227bc25682c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:54.847152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:54.862214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e616cb95-f48f-4192-bdbf-c227bc25682c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:54.862731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e616cb95-f48f-4192-bdbf-c227bc25682c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:54.863182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e616cb95-f48f-4192-bdbf-c227bc25682c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:54.863961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e616cb95-f48f-4192-bdbf-c227bc25682c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:54.864961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e616cb95-f48f-4192-bdbf-c227bc25682c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:54.865405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e616cb95-f48f-4192-bdbf-c227bc25682c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:55.497461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e616cb95-f48f-4192-bdbf-c227bc25682c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:55.528972 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e616cb95-f48f-4192-bdbf-c227bc25682c tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 0.692265 Aug 09 17:42:55.531152 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2722/5188] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:54 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:42:55.557077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-291053612", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b22187c-a932-4523-93ee-b42529a54c2c"}], "security_groups": [{"name": "tempest-securitygroup--1027924081"}], "key_name": "tempest-keypair-873118361", "user_data": "}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:55.714009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=42 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:56.117327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] validate_networks() for [('9b22187c-a932-4523-93ee-b42529a54c2c', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:42:56.214754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:42:56.608788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-86c251d8-1203-46d4-8eaf-32de451f38a7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:56.673253 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-86c251d8-1203-46d4-8eaf-32de451f38a7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1313 microversion: 2.1 time: 2.004179 Aug 09 17:42:56.674033 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2467/5189] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:54 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1313 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:56.679786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-6f3d90c8-1fca-41e4-895a-5ac4c660a113 req-b0edd5d1-616c-4fa1-8cd9-c3ae74a05c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24167e99-cd62-4011-b7f8-d12a1cefd13b", "name": "network-vif-plugged", "status": "completed", "tag": "c67fdaea-d77e-4077-ab40-269c74fbb684"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:42:56.716185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6f3d90c8-1fca-41e4-895a-5ac4c660a113 req-b0edd5d1-616c-4fa1-8cd9-c3ae74a05c29 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:56.717335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6f3d90c8-1fca-41e4-895a-5ac4c660a113 req-b0edd5d1-616c-4fa1-8cd9-c3ae74a05c29 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:56.720398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6f3d90c8-1fca-41e4-895a-5ac4c660a113 req-b0edd5d1-616c-4fa1-8cd9-c3ae74a05c29 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:56.757472 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-6f3d90c8-1fca-41e4-895a-5ac4c660a113 req-b0edd5d1-616c-4fa1-8cd9-c3ae74a05c29 service nova] Creating event network-vif-plugged:c67fdaea-d77e-4077-ab40-269c74fbb684 for instance 24167e99-cd62-4011-b7f8-d12a1cefd13b on n-h1-845781-6 Aug 09 17:42:56.776824 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-6f3d90c8-1fca-41e4-895a-5ac4c660a113 req-b0edd5d1-616c-4fa1-8cd9-c3ae74a05c29 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100989 Aug 09 17:42:56.786380 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2468/5190] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:42:56.803694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-11a68108-9669-4d70-8ae2-cb733b853364 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:56.806087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-11a68108-9669-4d70-8ae2-cb733b853364 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:56.815838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11a68108-9669-4d70-8ae2-cb733b853364 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:56.816729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11a68108-9669-4d70-8ae2-cb733b853364 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:56.817922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11a68108-9669-4d70-8ae2-cb733b853364 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:56.819010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11a68108-9669-4d70-8ae2-cb733b853364 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:56.819742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11a68108-9669-4d70-8ae2-cb733b853364 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:56.820687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11a68108-9669-4d70-8ae2-cb733b853364 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:58.045923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:42:58.045923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:42:58.046776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:42:58.046776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:42:58.047075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:42:58.058218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:58.058722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:58.059332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:58.060440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:58.061086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:58.061707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:58.085085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Getting quotas for project 39ce4b0e2bf84d778a3cf81d91868f0d. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:42:58.092278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Getting quotas for user e5530d014d1a44119b8f0c5fa9e76b3a and project 39ce4b0e2bf84d778a3cf81d91868f0d. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:42:58.112512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:42:58.117278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:42:58.174001 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [6b3ec2f9-1042-4e8c-badc-96a0a986ec88] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 17:42:58.428793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-11a68108-9669-4d70-8ae2-cb733b853364 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:58.444065 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-11a68108-9669-4d70-8ae2-cb733b853364 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 1.655578 Aug 09 17:42:58.445365 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2469/5191] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:56 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:58.454703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7485edb8-db5d-4863-9b90-2d68057960ff tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:58.455679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7485edb8-db5d-4863-9b90-2d68057960ff tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:58.475813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7485edb8-db5d-4863-9b90-2d68057960ff tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:58.476877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7485edb8-db5d-4863-9b90-2d68057960ff tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:58.477874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7485edb8-db5d-4863-9b90-2d68057960ff tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:58.479693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7485edb8-db5d-4863-9b90-2d68057960ff tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:58.481708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7485edb8-db5d-4863-9b90-2d68057960ff tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:58.481708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7485edb8-db5d-4863-9b90-2d68057960ff tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:58.916126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7485edb8-db5d-4863-9b90-2d68057960ff tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:58.926439 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7485edb8-db5d-4863-9b90-2d68057960ff tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1313 microversion: 2.1 time: 0.479030 Aug 09 17:42:58.933242 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2470/5192] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:58 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:42:59.189816 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [6b3ec2f9-1042-4e8c-badc-96a0a986ec88] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 39456. Aug 09 17:42:59.203740 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-25d4a344-e110-44d1-b129-84a697a50fa4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.669614 Aug 09 17:42:59.216655 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2723/5193] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:42:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 3674 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:42:59.226508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2672a048-0a18-470e-8c68-370187ffa69e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:59.228217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2672a048-0a18-470e-8c68-370187ffa69e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:59.406923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2672a048-0a18-470e-8c68-370187ffa69e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:59.425546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2672a048-0a18-470e-8c68-370187ffa69e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:59.431281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2672a048-0a18-470e-8c68-370187ffa69e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:42:59.435675 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2672a048-0a18-470e-8c68-370187ffa69e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1280 microversion: 2.20 time: 0.215341 Aug 09 17:42:59.439071 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2471/5194] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:42:59 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:42:59.478072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9147912a-154b-4af4-b138-b8597df78400 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:59.479295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9147912a-154b-4af4-b138-b8597df78400 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:59.493472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9147912a-154b-4af4-b138-b8597df78400 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:59.496668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9147912a-154b-4af4-b138-b8597df78400 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:59.499342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9147912a-154b-4af4-b138-b8597df78400 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:59.503531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9147912a-154b-4af4-b138-b8597df78400 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:59.504870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9147912a-154b-4af4-b138-b8597df78400 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:59.506297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9147912a-154b-4af4-b138-b8597df78400 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:59.698004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7be0e159-bfb8-459e-a1ea-c5321750238a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:42:59.699168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7be0e159-bfb8-459e-a1ea-c5321750238a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:42:59.714508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7be0e159-bfb8-459e-a1ea-c5321750238a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:59.716828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7be0e159-bfb8-459e-a1ea-c5321750238a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:59.732487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7be0e159-bfb8-459e-a1ea-c5321750238a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:59.740540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7be0e159-bfb8-459e-a1ea-c5321750238a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:42:59.743137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7be0e159-bfb8-459e-a1ea-c5321750238a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:42:59.743910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7be0e159-bfb8-459e-a1ea-c5321750238a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:42:59.827241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7be0e159-bfb8-459e-a1ea-c5321750238a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:43:00.024097 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7be0e159-bfb8-459e-a1ea-c5321750238a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "DELETE /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 204 len: 0 microversion: 2.1 time: 0.333289 Aug 09 17:43:00.025092 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2472/5195] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:42:59 2022] DELETE /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:43:00.035089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1db1a872-c06c-493b-906e-17ff35cc0cc7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:00.039000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1db1a872-c06c-493b-906e-17ff35cc0cc7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:00.058544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db1a872-c06c-493b-906e-17ff35cc0cc7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:00.060198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db1a872-c06c-493b-906e-17ff35cc0cc7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:00.061650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db1a872-c06c-493b-906e-17ff35cc0cc7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:00.063416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db1a872-c06c-493b-906e-17ff35cc0cc7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:00.064710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db1a872-c06c-493b-906e-17ff35cc0cc7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:00.065889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1db1a872-c06c-493b-906e-17ff35cc0cc7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:01.274204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1db1a872-c06c-493b-906e-17ff35cc0cc7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:01.311395 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1db1a872-c06c-493b-906e-17ff35cc0cc7 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1499 microversion: 2.1 time: 1.284853 Aug 09 17:43:01.312127 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2473/5196] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:00 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1499 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:01.337775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-61f4237c-66c4-4dbe-9478-9378f149b3b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:01.338840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-61f4237c-66c4-4dbe-9478-9378f149b3b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:01.375191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f4237c-66c4-4dbe-9478-9378f149b3b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:01.377623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f4237c-66c4-4dbe-9478-9378f149b3b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:01.386825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f4237c-66c4-4dbe-9478-9378f149b3b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:01.400917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f4237c-66c4-4dbe-9478-9378f149b3b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:01.404055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f4237c-66c4-4dbe-9478-9378f149b3b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:01.409043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-61f4237c-66c4-4dbe-9478-9378f149b3b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:01.672373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9147912a-154b-4af4-b138-b8597df78400 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:01.689733 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9147912a-154b-4af4-b138-b8597df78400 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 2.214475 Aug 09 17:43:01.708294 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2724/5197] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:42:59 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:43:01.725396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:01.727656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:01.745394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:01.745895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:01.746346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:01.754013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:01.754645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:01.755689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:02.119266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:02.175015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:02.181769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:02.191344 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a2d45176-f10b-45b5-840f-8a3918c1072c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1332 microversion: 2.20 time: 0.476803 Aug 09 17:43:02.194104 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2725/5198] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:01 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1332 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:43:02.211821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-564b2e88-3f00-4909-af4a-482e3dca23c9 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:02.301238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.compute.server_groups [None req-564b2e88-3f00-4909-af4a-482e3dca23c9 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Querying cell 64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) for 1 instances {{(pid=119431) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 09 17:43:02.302756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-564b2e88-3f00-4909-af4a-482e3dca23c9 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:02.316859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-564b2e88-3f00-4909-af4a-482e3dca23c9 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:02.325445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-564b2e88-3f00-4909-af4a-482e3dca23c9 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:02.469321 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-564b2e88-3f00-4909-af4a-482e3dca23c9 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/b3e3f15c-d5ea-44d4-808b-b073bec42294" status: 200 len: 222 microversion: 2.1 time: 0.267029 Aug 09 17:43:02.481520 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2726/5199] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:43:02 2022] GET /compute/v2.1/os-server-groups/b3e3f15c-d5ea-44d4-808b-b073bec42294 => generated 222 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:43:02.496284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-53c2353e-96b8-46a2-918c-bd57d80a4797 req-bd424d4c-c67f-4232-ab23-7a241490c4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8", "tag": "24f51608-5f6b-4cfa-9a7f-caa32e793098"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:02.546240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-53c2353e-96b8-46a2-918c-bd57d80a4797 req-bd424d4c-c67f-4232-ab23-7a241490c4ff service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:02.547337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-53c2353e-96b8-46a2-918c-bd57d80a4797 req-bd424d4c-c67f-4232-ab23-7a241490c4ff service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:02.548200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-53c2353e-96b8-46a2-918c-bd57d80a4797 req-bd424d4c-c67f-4232-ab23-7a241490c4ff service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:02.575652 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-53c2353e-96b8-46a2-918c-bd57d80a4797 req-bd424d4c-c67f-4232-ab23-7a241490c4ff service nova] Creating event network-changed:24f51608-5f6b-4cfa-9a7f-caa32e793098 for instance 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 on n-h1-845781-6 Aug 09 17:43:02.588404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-53c2353e-96b8-46a2-918c-bd57d80a4797 req-bd424d4c-c67f-4232-ab23-7a241490c4ff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112737 Aug 09 17:43:02.590255 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2727/5200] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:43:02.604952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2989c357-7c9f-4ddb-a65a-06c6c57a42eb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:02.607347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2989c357-7c9f-4ddb-a65a-06c6c57a42eb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:02.621209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2989c357-7c9f-4ddb-a65a-06c6c57a42eb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:02.624810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2989c357-7c9f-4ddb-a65a-06c6c57a42eb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:02.625878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2989c357-7c9f-4ddb-a65a-06c6c57a42eb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:02.626849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2989c357-7c9f-4ddb-a65a-06c6c57a42eb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:02.631553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2989c357-7c9f-4ddb-a65a-06c6c57a42eb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:02.632555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2989c357-7c9f-4ddb-a65a-06c6c57a42eb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:02.738168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2989c357-7c9f-4ddb-a65a-06c6c57a42eb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:43:02.882559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:43:03.059365 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2989c357-7c9f-4ddb-a65a-06c6c57a42eb tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "DELETE /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 204 len: 0 microversion: 2.1 time: 0.467217 Aug 09 17:43:03.070195 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2728/5201] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:43:02 2022] DELETE /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:43:03.086231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26a21cb0-d922-498b-975e-e293f00c0c61 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:03.087221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-26a21cb0-d922-498b-975e-e293f00c0c61 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:03.102000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a21cb0-d922-498b-975e-e293f00c0c61 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:03.102514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a21cb0-d922-498b-975e-e293f00c0c61 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:03.102967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a21cb0-d922-498b-975e-e293f00c0c61 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:03.103743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a21cb0-d922-498b-975e-e293f00c0c61 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:03.104217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a21cb0-d922-498b-975e-e293f00c0c61 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:03.104663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26a21cb0-d922-498b-975e-e293f00c0c61 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:03.483364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-26a21cb0-d922-498b-975e-e293f00c0c61 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:03.503877 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-26a21cb0-d922-498b-975e-e293f00c0c61 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 0.428977 Aug 09 17:43:03.504507 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2729/5202] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:03 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:03.521712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-520df917-a552-4ec9-afae-1dd01271fb22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:03.530822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-520df917-a552-4ec9-afae-1dd01271fb22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:03.565142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520df917-a552-4ec9-afae-1dd01271fb22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:03.572741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520df917-a552-4ec9-afae-1dd01271fb22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:03.573532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520df917-a552-4ec9-afae-1dd01271fb22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:03.580078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520df917-a552-4ec9-afae-1dd01271fb22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:03.580964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520df917-a552-4ec9-afae-1dd01271fb22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:03.585127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-520df917-a552-4ec9-afae-1dd01271fb22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:04.017648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-61f4237c-66c4-4dbe-9478-9378f149b3b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:04.037198 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-61f4237c-66c4-4dbe-9478-9378f149b3b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1554 microversion: 2.1 time: 2.717303 Aug 09 17:43:04.039167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2474/5203] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:01 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1554 bytes in 2721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:04.053249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:04.056414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:04.070986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:04.072478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:04.073633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:04.075262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:04.076503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:04.077600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:04.152887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-520df917-a552-4ec9-afae-1dd01271fb22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:04.179302 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-520df917-a552-4ec9-afae-1dd01271fb22 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1505 microversion: 2.1 time: 0.666978 Aug 09 17:43:04.182128 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2730/5204] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:03 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1505 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:04.376869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-82f130d7-7ed4-4d80-9f57-280f0547958d req-9ba60791-59e1-4326-964a-fbbc174aa88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f08b71-f5c9-4d4b-80e1-32932dabb8d4", "name": "network-vif-unplugged", "status": "completed", "tag": "eaed783a-87e8-4729-b6e6-4896ace3e817"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:04.413462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-82f130d7-7ed4-4d80-9f57-280f0547958d req-9ba60791-59e1-4326-964a-fbbc174aa88b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:04.414404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-82f130d7-7ed4-4d80-9f57-280f0547958d req-9ba60791-59e1-4326-964a-fbbc174aa88b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:04.414986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-82f130d7-7ed4-4d80-9f57-280f0547958d req-9ba60791-59e1-4326-964a-fbbc174aa88b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:04.478568 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-82f130d7-7ed4-4d80-9f57-280f0547958d req-9ba60791-59e1-4326-964a-fbbc174aa88b service nova] Creating event network-vif-unplugged:eaed783a-87e8-4729-b6e6-4896ace3e817 for instance 84f08b71-f5c9-4d4b-80e1-32932dabb8d4 on n-h2-845781-6 Aug 09 17:43:04.488307 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-82f130d7-7ed4-4d80-9f57-280f0547958d req-9ba60791-59e1-4326-964a-fbbc174aa88b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117756 Aug 09 17:43:04.490369 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2731/5205] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:43:04.554514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4de7cd8-a459-4020-9440-2d8d65b25b4b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:04.558307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c4de7cd8-a459-4020-9440-2d8d65b25b4b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:04.585773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:04.613607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4de7cd8-a459-4020-9440-2d8d65b25b4b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:04.615330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4de7cd8-a459-4020-9440-2d8d65b25b4b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:04.616056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4de7cd8-a459-4020-9440-2d8d65b25b4b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:04.620128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4de7cd8-a459-4020-9440-2d8d65b25b4b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:04.629791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4de7cd8-a459-4020-9440-2d8d65b25b4b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:04.633474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:04.634624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4de7cd8-a459-4020-9440-2d8d65b25b4b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:04.643005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:04.654465 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9ace8008-b932-4a42-8be7-9096ced6b0b6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1338 microversion: 2.20 time: 0.611203 Aug 09 17:43:04.664777 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2475/5206] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:04 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1338 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:43:05.089032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5ccd41cc-2015-4a04-b011-fcbf274e4b52 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:05.090225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5ccd41cc-2015-4a04-b011-fcbf274e4b52 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:05.132272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd41cc-2015-4a04-b011-fcbf274e4b52 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:05.134082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd41cc-2015-4a04-b011-fcbf274e4b52 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:05.135259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd41cc-2015-4a04-b011-fcbf274e4b52 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:05.138761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd41cc-2015-4a04-b011-fcbf274e4b52 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:05.139701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd41cc-2015-4a04-b011-fcbf274e4b52 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:05.141781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ccd41cc-2015-4a04-b011-fcbf274e4b52 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:05.224388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:43:05.950596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5ccd41cc-2015-4a04-b011-fcbf274e4b52 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:05.968487 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5ccd41cc-2015-4a04-b011-fcbf274e4b52 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1554 microversion: 2.1 time: 0.890784 Aug 09 17:43:05.969531 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2476/5207] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:05 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1554 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:43:05.975071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e45525d6-4ac8-4c19-8955-9136f45a94ad tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:05.976160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e45525d6-4ac8-4c19-8955-9136f45a94ad tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:05.990106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e45525d6-4ac8-4c19-8955-9136f45a94ad tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:05.995536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e45525d6-4ac8-4c19-8955-9136f45a94ad tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:05.996416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e45525d6-4ac8-4c19-8955-9136f45a94ad tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:05.997440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e45525d6-4ac8-4c19-8955-9136f45a94ad tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:06.000040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e45525d6-4ac8-4c19-8955-9136f45a94ad tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:06.000847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e45525d6-4ac8-4c19-8955-9136f45a94ad tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:06.134658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c4de7cd8-a459-4020-9440-2d8d65b25b4b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:06.206352 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c4de7cd8-a459-4020-9440-2d8d65b25b4b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 1.659397 Aug 09 17:43:06.207556 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2732/5208] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:04 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:06.228393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1e217eee-814b-466b-b5d7-ca7f3c26c691 req-c19171e7-d9ac-4031-8de1-e04cd248eaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a239a0-1f3f-4715-83ae-7135780ad8a2", "tag": "a6c45ab2-6a14-4304-adbd-f068077d3468"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:06.277753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1e217eee-814b-466b-b5d7-ca7f3c26c691 req-c19171e7-d9ac-4031-8de1-e04cd248eaf3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:06.278321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1e217eee-814b-466b-b5d7-ca7f3c26c691 req-c19171e7-d9ac-4031-8de1-e04cd248eaf3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:06.278813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1e217eee-814b-466b-b5d7-ca7f3c26c691 req-c19171e7-d9ac-4031-8de1-e04cd248eaf3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:06.350580 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1e217eee-814b-466b-b5d7-ca7f3c26c691 req-c19171e7-d9ac-4031-8de1-e04cd248eaf3 service nova] Creating event network-changed:a6c45ab2-6a14-4304-adbd-f068077d3468 for instance f8a239a0-1f3f-4715-83ae-7135780ad8a2 on n-h2-845781-6 Aug 09 17:43:06.374856 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1e217eee-814b-466b-b5d7-ca7f3c26c691 req-c19171e7-d9ac-4031-8de1-e04cd248eaf3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160713 Aug 09 17:43:06.377476 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2733/5209] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:43:06.408504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:06.409666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:06.439590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:06.439590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:06.439590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:06.439590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:06.440291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:06.440717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:06.685815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:06.718419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:06.731350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:06.740485 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ca27f83c-e518-4069-af62-390376667956 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1338 microversion: 2.20 time: 0.356339 Aug 09 17:43:06.745012 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2734/5210] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:06 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1338 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:43:06.996245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9bec4214-cf67-44cb-a31a-2c2a1d626f44 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:06.997397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9bec4214-cf67-44cb-a31a-2c2a1d626f44 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:07.035152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bec4214-cf67-44cb-a31a-2c2a1d626f44 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:07.044106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bec4214-cf67-44cb-a31a-2c2a1d626f44 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:07.045159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bec4214-cf67-44cb-a31a-2c2a1d626f44 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:07.046539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bec4214-cf67-44cb-a31a-2c2a1d626f44 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:07.047444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bec4214-cf67-44cb-a31a-2c2a1d626f44 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:07.048508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9bec4214-cf67-44cb-a31a-2c2a1d626f44 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:07.332567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e45525d6-4ac8-4c19-8955-9136f45a94ad tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:07.353406 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e45525d6-4ac8-4c19-8955-9136f45a94ad tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1505 microversion: 2.1 time: 1.382221 Aug 09 17:43:07.354534 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2477/5211] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:05 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1505 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:07.361785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eef839b5-f130-4196-9d85-772608ec5dc8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:07.362691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eef839b5-f130-4196-9d85-772608ec5dc8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:07.376991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eef839b5-f130-4196-9d85-772608ec5dc8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:07.377853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eef839b5-f130-4196-9d85-772608ec5dc8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:07.378655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eef839b5-f130-4196-9d85-772608ec5dc8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:07.379618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eef839b5-f130-4196-9d85-772608ec5dc8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:07.381137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eef839b5-f130-4196-9d85-772608ec5dc8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:07.381804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eef839b5-f130-4196-9d85-772608ec5dc8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:07.444452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9bec4214-cf67-44cb-a31a-2c2a1d626f44 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:07.466040 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9bec4214-cf67-44cb-a31a-2c2a1d626f44 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 200 len: 1486 microversion: 2.1 time: 0.475000 Aug 09 17:43:07.467943 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2735/5212] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:06 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 1486 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:43:07.785053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:07.785960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:07.798445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:07.798972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:07.799429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:07.810650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:07.811430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:07.812131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:08.075398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:43:08.105535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:43:08.366690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eef839b5-f130-4196-9d85-772608ec5dc8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:08.388060 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eef839b5-f130-4196-9d85-772608ec5dc8 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 1.031635 Aug 09 17:43:08.411892 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2478/5213] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:07 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:08.421750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:08.422967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:08.441328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:08.442190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:08.442910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:08.443914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:08.444619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:08.445257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:08.517876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:08.518382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:08.524454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:08.525219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lazy-loading 'fault' on Instance uuid 24167e99-cd62-4011-b7f8-d12a1cefd13b {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:43:08.641843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59ffaf351662478a979f72d9ca4a4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5f4ce5e4396489cab58595253784bcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:08.670429 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-742c7a33-3e26-4b54-9664-0b790dc4284a tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 200 len: 1303 microversion: 2.1 time: 0.266113 Aug 09 17:43:08.696625 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2479/5214] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:08 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 1303 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:08.712976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a408dea8-0a34-4f0a-a7aa-52075484e833 req-b5821b3d-9f02-4504-860b-56bac07b3e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f08b71-f5c9-4d4b-80e1-32932dabb8d4", "name": "network-vif-deleted", "tag": "eaed783a-87e8-4729-b6e6-4896ace3e817"}, {"server_uuid": "24167e99-cd62-4011-b7f8-d12a1cefd13b", "name": "network-vif-deleted", "tag": "c67fdaea-d77e-4077-ab40-269c74fbb684"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:08.740487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a408dea8-0a34-4f0a-a7aa-52075484e833 req-b5821b3d-9f02-4504-860b-56bac07b3e0a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:08.756695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a408dea8-0a34-4f0a-a7aa-52075484e833 req-b5821b3d-9f02-4504-860b-56bac07b3e0a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:08.761294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a408dea8-0a34-4f0a-a7aa-52075484e833 req-b5821b3d-9f02-4504-860b-56bac07b3e0a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:08.800929 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a408dea8-0a34-4f0a-a7aa-52075484e833 req-b5821b3d-9f02-4504-860b-56bac07b3e0a service nova] Creating event network-vif-deleted:eaed783a-87e8-4729-b6e6-4896ace3e817 for instance 84f08b71-f5c9-4d4b-80e1-32932dabb8d4 on n-h2-845781-6 Aug 09 17:43:08.805829 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a408dea8-0a34-4f0a-a7aa-52075484e833 req-b5821b3d-9f02-4504-860b-56bac07b3e0a service nova] Creating event network-vif-deleted:c67fdaea-d77e-4077-ab40-269c74fbb684 for instance 24167e99-cd62-4011-b7f8-d12a1cefd13b on n-h1-845781-6 Aug 09 17:43:08.839568 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a408dea8-0a34-4f0a-a7aa-52075484e833 req-b5821b3d-9f02-4504-860b-56bac07b3e0a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.140601 Aug 09 17:43:08.849641 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2480/5215] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:43:08.867408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:08.870556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 84f08b71-f5c9-4d4b-80e1-32932dabb8d4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:08.898823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:08.904035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:08.908076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:08.911590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:08.912508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:08.917677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:08.992044 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] HTTP exception thrown: Instance 84f08b71-f5c9-4d4b-80e1-32932dabb8d4 could not be found. Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Request method failure captured: Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 HTTP/1.1 Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pu27kmxlk7aADrjz2CKRwT-C5Zjwi_lNUjwiXZ5Z6gfQkfbibdq9sozm41HtXTWrQWFzYpTCPzwEVRV5MEPWrgm9BB2RPWNWBWWTa_z10AU7kE5C1ZuYz_dNAkBGHAMa8hiEQoQ_A4YuLRqMZcuri0tai7o9yDQbwxczVEjvdYvU9c Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 95efa122e86846beb9abcb02ac118e94 Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TestNetworkBasicOps-1268708530 Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_95efa122e86846beb9abcb02ac118e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/95efa122e86846beb9abcb02ac118e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/95efa122e86846beb9abcb02ac118e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/95efa122e86846beb9abcb02ac118e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TestNetworkBasicOps-1268708530 Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 95efa122e86846beb9abcb02ac118e94 Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TestNetworkBasicOps-1268708530 Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TestNetworkBasicOps-1268708530-project Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: cbb30087336245ce95a13efe7c2f382e Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TestNetworkBasicOps-1268708530-project Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 84f08b71-f5c9-4d4b-80e1-32932dabb8d4 could not be found. Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '84f08b71-f5c9-4d4b-80e1-32932dabb8d4'} Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84f08b71-f5c9-4d4b-80e1-32932dabb8d4 could not be found. Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f08b71-f5c9-4d4b-80e1-32932dabb8d4 could not be found. Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:08.996820 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:09.001510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:09.001510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:09.001510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:09.001510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:43:09.001510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:43:09.001510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f08b71-f5c9-4d4b-80e1-32932dabb8d4 could not be found. Aug 09 17:43:09.001510 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:09.010554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Returning 404 to user: Instance 84f08b71-f5c9-4d4b-80e1-32932dabb8d4 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:43:09.014955 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-adb9be7c-6ed5-4da4-b08f-f99ac5b62078 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4" status: 404 len: 111 microversion: 2.1 time: 0.161751 Aug 09 17:43:09.027840 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2481/5216] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:08 2022] GET /compute/v2.1/servers/84f08b71-f5c9-4d4b-80e1-32932dabb8d4 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:43:09.428640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8d47f847-e6b9-461e-975f-4862b0455afd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:09.429863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8d47f847-e6b9-461e-975f-4862b0455afd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:09.445894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:43:09.453621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d47f847-e6b9-461e-975f-4862b0455afd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:09.454829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d47f847-e6b9-461e-975f-4862b0455afd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:09.457166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d47f847-e6b9-461e-975f-4862b0455afd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:09.469126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d47f847-e6b9-461e-975f-4862b0455afd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:09.471418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d47f847-e6b9-461e-975f-4862b0455afd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:09.473517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d47f847-e6b9-461e-975f-4862b0455afd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:10.089488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:10.099745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:10.118613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:10.120685 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c5a0d3e-4c58-4f8d-9999-f4df42791662 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1406 microversion: 2.20 time: 2.340023 Aug 09 17:43:10.125938 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2736/5217] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:07 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1406 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:43:10.138834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:10.139475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:10.172928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:10.173470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:10.174067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:10.174993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:10.175492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:10.192349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:10.254499 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] HTTP exception thrown: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Request method failure captured: Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b HTTP/1.1 Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8px8p0tIzh_9ZHV67UVEAStLhrPlhin5p_e_WqSzxx92RKEvliCYL2PmYVX3lNYI49yo0xn1GHbSGiR_7sQrRZHcxBWozArcJx9erfT0MqZXUmuJuWCMysE4aaLRVExDq6kzy8OQIASvAfuqsvnNZBhdbjvsfDSoPXZHtTrdKaBOMrg Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 59ffaf351662478a979f72d9ca4a4437 Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '24167e99-cd62-4011-b7f8-d12a1cefd13b'} Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:10.261300 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.271498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:10.271498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:10.271498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:10.271498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:43:10.271498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:43:10.271498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.271498 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.307199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Returning 404 to user: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:43:10.314103 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1fa348b-d17a-46b3-b29a-d316b14576a6 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 404 len: 111 microversion: 2.1 time: 0.180614 Aug 09 17:43:10.316335 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2737/5218] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:10 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:43:10.349653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88232682-237b-4e74-ad8b-894f501982a3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:10.422734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.compute.server_groups [None req-88232682-237b-4e74-ad8b-894f501982a3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Querying cell 64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) for 1 instances {{(pid=119431) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 09 17:43:10.429848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88232682-237b-4e74-ad8b-894f501982a3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:10.441824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88232682-237b-4e74-ad8b-894f501982a3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:10.443196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88232682-237b-4e74-ad8b-894f501982a3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:10.483457 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88232682-237b-4e74-ad8b-894f501982a3 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.159540 Aug 09 17:43:10.484376 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2738/5219] 10.222.0.93 () {58 vars in 1152 bytes} [Tue Aug 9 17:43:10 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:43:10.501219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51bb68bf-3fec-4208-b5a2-dfd6ab7db779 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:10.535584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.compute.server_groups [None req-51bb68bf-3fec-4208-b5a2-dfd6ab7db779 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Querying cell 64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3(cell1) for 1 instances {{(pid=119431) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 09 17:43:10.537358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51bb68bf-3fec-4208-b5a2-dfd6ab7db779 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:10.538081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51bb68bf-3fec-4208-b5a2-dfd6ab7db779 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:10.538748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51bb68bf-3fec-4208-b5a2-dfd6ab7db779 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:10.561054 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51bb68bf-3fec-4208-b5a2-dfd6ab7db779 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/b3e3f15c-d5ea-44d4-808b-b073bec42294" status: 200 len: 184 microversion: 2.1 time: 0.062332 Aug 09 17:43:10.561982 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2739/5220] 10.222.0.93 () {58 vars in 1263 bytes} [Tue Aug 9 17:43:10 2022] GET /compute/v2.1/os-server-groups/b3e3f15c-d5ea-44d4-808b-b073bec42294 => generated 184 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:43:10.578711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:10.579670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:10.604302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:10.605647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:10.606804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:10.608581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:10.625205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:10.627999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:10.734759 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] HTTP exception thrown: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Request method failure captured: Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b HTTP/1.1 Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8px8p0tIzh_9ZHV67UVEAStLhrPlhin5p_e_WqSzxx92RKEvliCYL2PmYVX3lNYI49yo0xn1GHbSGiR_7sQrRZHcxBWozArcJx9erfT0MqZXUmuJuWCMysE4aaLRVExDq6kzy8OQIASvAfuqsvnNZBhdbjvsfDSoPXZHtTrdKaBOMrg Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 59ffaf351662478a979f72d9ca4a4437 Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '24167e99-cd62-4011-b7f8-d12a1cefd13b'} Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:43:10.742097 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:43:10.753854 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.753854 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.753854 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:10.753854 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.753854 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:10.753854 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:10.753854 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:10.753854 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:43:10.753854 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:43:10.753854 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.753854 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.762808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Returning 404 to user: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:43:10.765014 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6042d8fe-95f6-4da6-a57b-f3b55f8aa278 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "DELETE /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 404 len: 111 microversion: 2.1 time: 0.190048 Aug 09 17:43:10.776538 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2740/5221] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:43:10 2022] DELETE /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:43:10.828046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:10.835910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] [instance: 24167e99-cd62-4011-b7f8-d12a1cefd13b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:10.881804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:10.887832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:10.889005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:10.895501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:10.900737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:10.901681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:10.987181 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] HTTP exception thrown: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Request method failure captured: Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b HTTP/1.1 Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8px8p0tIzh_9ZHV67UVEAStLhrPlhin5p_e_WqSzxx92RKEvliCYL2PmYVX3lNYI49yo0xn1GHbSGiR_7sQrRZHcxBWozArcJx9erfT0MqZXUmuJuWCMysE4aaLRVExDq6kzy8OQIASvAfuqsvnNZBhdbjvsfDSoPXZHtTrdKaBOMrg Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 59ffaf351662478a979f72d9ca4a4437 Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '24167e99-cd62-4011-b7f8-d12a1cefd13b'} Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:10.990343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:10.998813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:10.998813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:10.998813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:10.998813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:43:10.998813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:43:10.998813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. Aug 09 17:43:10.998813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:11.001978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Returning 404 to user: Instance 24167e99-cd62-4011-b7f8-d12a1cefd13b could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:43:11.010498 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a70baf8f-29b5-408e-a62f-6e2baf0c0f58 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b" status: 404 len: 111 microversion: 2.1 time: 0.205278 Aug 09 17:43:11.012080 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2741/5222] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:10 2022] GET /compute/v2.1/servers/24167e99-cd62-4011-b7f8-d12a1cefd13b => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:43:11.047417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dc70fc46-ec40-4a55-aac0-907ad48a6bca tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:11.103390 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-dc70fc46-ec40-4a55-aac0-907ad48a6bca tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] HTTP exception thrown: Instance group 4e24e208-e015-4205-8dc2-2f64b1f0133c could not be found. Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dc70fc46-ec40-4a55-aac0-907ad48a6bca tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Request method failure captured: Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/os-server-groups/4e24e208-e015-4205-8dc2-2f64b1f0133c HTTP/1.1 Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8px8p0tIzh_9ZHV67UVEAStLhrPlhin5p_e_WqSzxx92RKEvliCYL2PmYVX3lNYI49yo0xn1GHbSGiR_7sQrRZHcxBWozArcJx9erfT0MqZXUmuJuWCMysE4aaLRVExDq6kzy8OQIASvAfuqsvnNZBhdbjvsfDSoPXZHtTrdKaBOMrg Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 59ffaf351662478a979f72d9ca4a4437 Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance group 4e24e208-e015-4205-8dc2-2f64b1f0133c could not be found. Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '4e24e208-e015-4205-8dc2-2f64b1f0133c'} Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4e24e208-e015-4205-8dc2-2f64b1f0133c could not be found. Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4e24e208-e015-4205-8dc2-2f64b1f0133c could not be found. Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:11.115439 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:11.125526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:11.125526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:11.125526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:43:11.125526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:43:11.125526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4e24e208-e015-4205-8dc2-2f64b1f0133c could not be found. Aug 09 17:43:11.125526 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:11.125526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dc70fc46-ec40-4a55-aac0-907ad48a6bca tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Returning 404 to user: Instance group 4e24e208-e015-4205-8dc2-2f64b1f0133c could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:43:11.125526 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dc70fc46-ec40-4a55-aac0-907ad48a6bca tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/4e24e208-e015-4205-8dc2-2f64b1f0133c" status: 404 len: 117 microversion: 2.1 time: 0.098939 Aug 09 17:43:11.128898 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2742/5223] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:43:11 2022] DELETE /compute/v2.1/os-server-groups/4e24e208-e015-4205-8dc2-2f64b1f0133c => generated 117 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:43:11.154664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f685b4d0-d344-4575-bb7c-6a12d86b8285 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:11.194359 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f685b4d0-d344-4575-bb7c-6a12d86b8285 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] HTTP exception thrown: Instance group 9ddb05c5-ef3a-446f-8424-d8fe1f1da361 could not be found. Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f685b4d0-d344-4575-bb7c-6a12d86b8285 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Request method failure captured: Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/os-server-groups/9ddb05c5-ef3a-446f-8424-d8fe1f1da361 HTTP/1.1 Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8px8p0tIzh_9ZHV67UVEAStLhrPlhin5p_e_WqSzxx92RKEvliCYL2PmYVX3lNYI49yo0xn1GHbSGiR_7sQrRZHcxBWozArcJx9erfT0MqZXUmuJuWCMysE4aaLRVExDq6kzy8OQIASvAfuqsvnNZBhdbjvsfDSoPXZHtTrdKaBOMrg Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 59ffaf351662478a979f72d9ca4a4437 Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance group 9ddb05c5-ef3a-446f-8424-d8fe1f1da361 could not be found. Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9ddb05c5-ef3a-446f-8424-d8fe1f1da361'} Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9ddb05c5-ef3a-446f-8424-d8fe1f1da361 could not be found. Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9ddb05c5-ef3a-446f-8424-d8fe1f1da361 could not be found. Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:11.206942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:11.217787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:11.217787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:11.217787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:43:11.217787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:43:11.217787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9ddb05c5-ef3a-446f-8424-d8fe1f1da361 could not be found. Aug 09 17:43:11.217787 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:11.220786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f685b4d0-d344-4575-bb7c-6a12d86b8285 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Returning 404 to user: Instance group 9ddb05c5-ef3a-446f-8424-d8fe1f1da361 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:43:11.224965 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f685b4d0-d344-4575-bb7c-6a12d86b8285 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/9ddb05c5-ef3a-446f-8424-d8fe1f1da361" status: 404 len: 117 microversion: 2.1 time: 0.091945 Aug 09 17:43:11.242346 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2743/5224] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:43:11 2022] DELETE /compute/v2.1/os-server-groups/9ddb05c5-ef3a-446f-8424-d8fe1f1da361 => generated 117 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:43:11.263529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:11.265232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:11.281405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:11.282910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:11.284428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:11.287451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:11.289224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:11.290284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:11.963479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8d47f847-e6b9-461e-975f-4862b0455afd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:11.982202 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8d47f847-e6b9-461e-975f-4862b0455afd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 2.557249 Aug 09 17:43:11.985167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2482/5225] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:09 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 2563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:43:11.994548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-06720c6b-839b-48dd-99bc-4f5fec787736 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:12.023500 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-06720c6b-839b-48dd-99bc-4f5fec787736 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] HTTP exception thrown: Instance group 5bce2dd3-d76f-4ec9-a95a-c97565e02ac6 could not be found. Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-06720c6b-839b-48dd-99bc-4f5fec787736 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Request method failure captured: Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-server-groups/5bce2dd3-d76f-4ec9-a95a-c97565e02ac6 HTTP/1.1 Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8px8p0tIzh_9ZHV67UVEAStLhrPlhin5p_e_WqSzxx92RKEvliCYL2PmYVX3lNYI49yo0xn1GHbSGiR_7sQrRZHcxBWozArcJx9erfT0MqZXUmuJuWCMysE4aaLRVExDq6kzy8OQIASvAfuqsvnNZBhdbjvsfDSoPXZHtTrdKaBOMrg Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 59ffaf351662478a979f72d9ca4a4437 Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance group 5bce2dd3-d76f-4ec9-a95a-c97565e02ac6 could not be found. Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '5bce2dd3-d76f-4ec9-a95a-c97565e02ac6'} Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5bce2dd3-d76f-4ec9-a95a-c97565e02ac6 could not be found. Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5bce2dd3-d76f-4ec9-a95a-c97565e02ac6 could not be found. Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:12.029929 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:12.033780 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:12.033780 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:12.033780 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:43:12.033780 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:43:12.033780 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5bce2dd3-d76f-4ec9-a95a-c97565e02ac6 could not be found. Aug 09 17:43:12.033780 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:12.039355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-06720c6b-839b-48dd-99bc-4f5fec787736 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Returning 404 to user: Instance group 5bce2dd3-d76f-4ec9-a95a-c97565e02ac6 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:43:12.043578 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-06720c6b-839b-48dd-99bc-4f5fec787736 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/5bce2dd3-d76f-4ec9-a95a-c97565e02ac6" status: 404 len: 117 microversion: 2.1 time: 0.055640 Aug 09 17:43:12.045147 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2483/5226] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:43:11 2022] DELETE /compute/v2.1/os-server-groups/5bce2dd3-d76f-4ec9-a95a-c97565e02ac6 => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:43:12.059418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-212dee2a-01de-4703-83d8-84b6efa681df tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:12.082682 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-212dee2a-01de-4703-83d8-84b6efa681df tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] HTTP exception thrown: Instance group bbb58aee-3c29-490c-8b1c-7a60af6b5590 could not be found. Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-212dee2a-01de-4703-83d8-84b6efa681df tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Request method failure captured: Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-server-groups/bbb58aee-3c29-490c-8b1c-7a60af6b5590 HTTP/1.1 Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8px8p0tIzh_9ZHV67UVEAStLhrPlhin5p_e_WqSzxx92RKEvliCYL2PmYVX3lNYI49yo0xn1GHbSGiR_7sQrRZHcxBWozArcJx9erfT0MqZXUmuJuWCMysE4aaLRVExDq6kzy8OQIASvAfuqsvnNZBhdbjvsfDSoPXZHtTrdKaBOMrg Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a5f4ce5e4396489cab58595253784bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: a5f4ce5e4396489cab58595253784bcf Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerGroupTestJSON-431092185 Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 59ffaf351662478a979f72d9ca4a4437 Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerGroupTestJSON-431092185-project Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance group bbb58aee-3c29-490c-8b1c-7a60af6b5590 could not be found. Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'bbb58aee-3c29-490c-8b1c-7a60af6b5590'} Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bbb58aee-3c29-490c-8b1c-7a60af6b5590 could not be found. Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bbb58aee-3c29-490c-8b1c-7a60af6b5590 could not be found. Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:12.088730 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:12.097046 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:12.097046 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:12.097046 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:43:12.097046 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:43:12.097046 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bbb58aee-3c29-490c-8b1c-7a60af6b5590 could not be found. Aug 09 17:43:12.097046 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:12.097046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-212dee2a-01de-4703-83d8-84b6efa681df tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Returning 404 to user: Instance group bbb58aee-3c29-490c-8b1c-7a60af6b5590 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:43:12.101153 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-212dee2a-01de-4703-83d8-84b6efa681df tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/bbb58aee-3c29-490c-8b1c-7a60af6b5590" status: 404 len: 117 microversion: 2.1 time: 0.048102 Aug 09 17:43:12.104165 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2484/5227] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:43:12 2022] DELETE /compute/v2.1/os-server-groups/bbb58aee-3c29-490c-8b1c-7a60af6b5590 => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:43:12.118404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-adea040c-9a48-4c88-ba5b-7d384218d566 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:12.158388 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-adea040c-9a48-4c88-ba5b-7d384218d566 tempest-ServerGroupTestJSON-431092185 tempest-ServerGroupTestJSON-431092185-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/b3e3f15c-d5ea-44d4-808b-b073bec42294" status: 204 len: 0 microversion: 2.1 time: 0.049801 Aug 09 17:43:12.159417 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2485/5228] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:43:12 2022] DELETE /compute/v2.1/os-server-groups/b3e3f15c-d5ea-44d4-808b-b073bec42294 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:43:12.443763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7bb2de41-903b-431f-aa11-7172a68226b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '.version_select at 0x7fbbdca11820>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:12.485048 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7bb2de41-903b-431f-aa11-7172a68226b2 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1829740202" status: 202 len: 0 microversion: 2.1 time: 0.047633 Aug 09 17:43:12.491718 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2486/5229] 10.222.0.93 () {58 vars in 1257 bytes} [Tue Aug 9 17:43:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1829740202 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:43:13.026635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ae090a66-02b5-4767-b3e3-4116a61ea1b3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:13.027167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ae090a66-02b5-4767-b3e3-4116a61ea1b3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:13.046162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae090a66-02b5-4767-b3e3-4116a61ea1b3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:13.047968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae090a66-02b5-4767-b3e3-4116a61ea1b3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:13.050612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae090a66-02b5-4767-b3e3-4116a61ea1b3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:13.052902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae090a66-02b5-4767-b3e3-4116a61ea1b3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:13.056423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae090a66-02b5-4767-b3e3-4116a61ea1b3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:13.058757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae090a66-02b5-4767-b3e3-4116a61ea1b3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:13.133711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:13.148271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:13.150519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:13.161258 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f0160ffb-920b-40a6-a199-7ba4a51c025d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1406 microversion: 2.20 time: 1.906547 Aug 09 17:43:13.162275 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2744/5230] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:11 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1406 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:43:13.453425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-01a98a6c-4bff-411b-9cda-16975289a154 req-a6505b28-a3c8-44f9-b85a-992e51853a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8", "name": "network-vif-plugged", "status": "completed", "tag": "24f51608-5f6b-4cfa-9a7f-caa32e793098"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:13.495027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-01a98a6c-4bff-411b-9cda-16975289a154 req-a6505b28-a3c8-44f9-b85a-992e51853a0f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:13.501601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-01a98a6c-4bff-411b-9cda-16975289a154 req-a6505b28-a3c8-44f9-b85a-992e51853a0f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:13.502361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-01a98a6c-4bff-411b-9cda-16975289a154 req-a6505b28-a3c8-44f9-b85a-992e51853a0f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:13.540423 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-01a98a6c-4bff-411b-9cda-16975289a154 req-a6505b28-a3c8-44f9-b85a-992e51853a0f service nova] Creating event network-vif-plugged:24f51608-5f6b-4cfa-9a7f-caa32e793098 for instance 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 on n-h1-845781-6 Aug 09 17:43:13.559725 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-01a98a6c-4bff-411b-9cda-16975289a154 req-a6505b28-a3c8-44f9-b85a-992e51853a0f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119742 Aug 09 17:43:13.560652 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2745/5231] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:43:13.852134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fada8fed-00c6-4f5d-a58c-b4199deb311f req-8b2f49d0-1ac3-42aa-a85a-9ac449de017a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a34552-f7cd-4770-b3ef-be9226b0cd78", "tag": "0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:13.884845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fada8fed-00c6-4f5d-a58c-b4199deb311f req-8b2f49d0-1ac3-42aa-a85a-9ac449de017a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:13.886538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fada8fed-00c6-4f5d-a58c-b4199deb311f req-8b2f49d0-1ac3-42aa-a85a-9ac449de017a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:13.888692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fada8fed-00c6-4f5d-a58c-b4199deb311f req-8b2f49d0-1ac3-42aa-a85a-9ac449de017a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:13.914536 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fada8fed-00c6-4f5d-a58c-b4199deb311f req-8b2f49d0-1ac3-42aa-a85a-9ac449de017a service nova] Creating event network-changed:0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90 for instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 on n-h2-845781-6 Aug 09 17:43:13.925928 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fada8fed-00c6-4f5d-a58c-b4199deb311f req-8b2f49d0-1ac3-42aa-a85a-9ac449de017a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098867 Aug 09 17:43:13.929216 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2746/5232] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:43:14.209759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:14.212303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:14.260194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:14.264518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:14.268418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:14.276700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:14.281850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:14.284586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:14.778957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ae090a66-02b5-4767-b3e3-4116a61ea1b3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:14.811447 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ae090a66-02b5-4767-b3e3-4116a61ea1b3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 1.805526 Aug 09 17:43:14.819428 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2487/5233] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:13 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:43:15.357815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:15.368600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:15.399554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:15.401224 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eff05134-b350-4d75-8c6e-41e968474b93 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1406 microversion: 2.20 time: 1.200646 Aug 09 17:43:15.416988 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2747/5234] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:14 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1406 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:43:15.846467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-814883f8-3098-4fc7-8990-b86819e206f7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:15.847325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-814883f8-3098-4fc7-8990-b86819e206f7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:15.896769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-814883f8-3098-4fc7-8990-b86819e206f7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:15.898820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-814883f8-3098-4fc7-8990-b86819e206f7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:15.900644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-814883f8-3098-4fc7-8990-b86819e206f7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:15.909750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-814883f8-3098-4fc7-8990-b86819e206f7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:15.910497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-814883f8-3098-4fc7-8990-b86819e206f7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:15.911862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-814883f8-3098-4fc7-8990-b86819e206f7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:16.435517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:16.440568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:16.462521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:16.468439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:16.469558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:16.470683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:16.471512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:16.472361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:16.864395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-814883f8-3098-4fc7-8990-b86819e206f7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:16.920718 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-814883f8-3098-4fc7-8990-b86819e206f7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 1.083640 Aug 09 17:43:16.923681 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2488/5235] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:15 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:16.988866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:17.022709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:17.029936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:17.031200 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-12c1ba4b-c5f1-470f-aff4-368dd8e6cae4 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1406 microversion: 2.20 time: 0.604627 Aug 09 17:43:17.031887 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2748/5236] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:16 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1406 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:43:17.973032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-31b7ddf6-8cfc-459e-86dd-33ce6c7f7ccd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:17.984296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-31b7ddf6-8cfc-459e-86dd-33ce6c7f7ccd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:17.997036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:43:18.020068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b7ddf6-8cfc-459e-86dd-33ce6c7f7ccd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:18.021120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b7ddf6-8cfc-459e-86dd-33ce6c7f7ccd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:18.021582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b7ddf6-8cfc-459e-86dd-33ce6c7f7ccd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:18.022335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b7ddf6-8cfc-459e-86dd-33ce6c7f7ccd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:18.025746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b7ddf6-8cfc-459e-86dd-33ce6c7f7ccd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:18.026099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b7ddf6-8cfc-459e-86dd-33ce6c7f7ccd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:18.064174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:18.065527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:18.091063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:18.093615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:18.094471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:18.096813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:18.100689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:18.109196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:18.942231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-31b7ddf6-8cfc-459e-86dd-33ce6c7f7ccd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:18.998485 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-31b7ddf6-8cfc-459e-86dd-33ce6c7f7ccd tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 1.052259 Aug 09 17:43:18.999595 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2489/5237] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:17 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:19.583796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:19.599438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:19.609741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:19.613750 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a7462f08-5834-485e-9761-34478c982f96 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1406 microversion: 2.20 time: 1.555984 Aug 09 17:43:19.647654 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2749/5238] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:18 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1406 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:43:20.038142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7f667f0b-a407-49ba-b33d-dd1af28c7032 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:20.039904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7f667f0b-a407-49ba-b33d-dd1af28c7032 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:20.061753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f667f0b-a407-49ba-b33d-dd1af28c7032 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:20.063340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f667f0b-a407-49ba-b33d-dd1af28c7032 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:20.065338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f667f0b-a407-49ba-b33d-dd1af28c7032 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:20.066547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f667f0b-a407-49ba-b33d-dd1af28c7032 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:20.068540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f667f0b-a407-49ba-b33d-dd1af28c7032 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:20.070327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f667f0b-a407-49ba-b33d-dd1af28c7032 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:20.209968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3e5703ec-cf1f-4169-8075-b6ee43e3a03c req-fcb24997-0f80-4c08-aa7e-ff652e52fdf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a239a0-1f3f-4715-83ae-7135780ad8a2", "name": "network-vif-plugged", "status": "completed", "tag": "a6c45ab2-6a14-4304-adbd-f068077d3468"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:20.247149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3e5703ec-cf1f-4169-8075-b6ee43e3a03c req-fcb24997-0f80-4c08-aa7e-ff652e52fdf3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:20.247674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3e5703ec-cf1f-4169-8075-b6ee43e3a03c req-fcb24997-0f80-4c08-aa7e-ff652e52fdf3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:20.258106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3e5703ec-cf1f-4169-8075-b6ee43e3a03c req-fcb24997-0f80-4c08-aa7e-ff652e52fdf3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:20.291661 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3e5703ec-cf1f-4169-8075-b6ee43e3a03c req-fcb24997-0f80-4c08-aa7e-ff652e52fdf3 service nova] Creating event network-vif-plugged:a6c45ab2-6a14-4304-adbd-f068077d3468 for instance f8a239a0-1f3f-4715-83ae-7135780ad8a2 on n-h2-845781-6 Aug 09 17:43:20.316393 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3e5703ec-cf1f-4169-8075-b6ee43e3a03c req-fcb24997-0f80-4c08-aa7e-ff652e52fdf3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116078 Aug 09 17:43:20.319732 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2750/5239] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:43:20.649830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:20.650549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:20.688236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:20.688754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:20.696070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:20.697308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:20.698009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:20.698666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:21.520197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7f667f0b-a407-49ba-b33d-dd1af28c7032 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:21.529629 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7f667f0b-a407-49ba-b33d-dd1af28c7032 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 1.496203 Aug 09 17:43:21.552892 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2490/5240] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:20 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:22.553420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:22.563836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:22.566247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-50b59df8-a5fe-4e37-b1f7-6d52be3f0a0f tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:22.566883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-50b59df8-a5fe-4e37-b1f7-6d52be3f0a0f tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:22.576785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:22.578402 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-89b8c539-cad2-4006-8b65-d2f369892a36 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1406 microversion: 2.20 time: 1.934041 Aug 09 17:43:22.591964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50b59df8-a5fe-4e37-b1f7-6d52be3f0a0f tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:22.591964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50b59df8-a5fe-4e37-b1f7-6d52be3f0a0f tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:22.591964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50b59df8-a5fe-4e37-b1f7-6d52be3f0a0f tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:22.591964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50b59df8-a5fe-4e37-b1f7-6d52be3f0a0f tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:22.591964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50b59df8-a5fe-4e37-b1f7-6d52be3f0a0f tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:22.591964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-50b59df8-a5fe-4e37-b1f7-6d52be3f0a0f tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:22.593224 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2751/5241] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:20 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1406 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:43:23.585578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dee76eeb-2a48-4b82-80f7-6a53daf186d5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:23.586694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dee76eeb-2a48-4b82-80f7-6a53daf186d5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:23.610119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee76eeb-2a48-4b82-80f7-6a53daf186d5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:23.610618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee76eeb-2a48-4b82-80f7-6a53daf186d5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:23.611067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee76eeb-2a48-4b82-80f7-6a53daf186d5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:23.611875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee76eeb-2a48-4b82-80f7-6a53daf186d5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:23.612341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee76eeb-2a48-4b82-80f7-6a53daf186d5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:23.616666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dee76eeb-2a48-4b82-80f7-6a53daf186d5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:23.702310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dee76eeb-2a48-4b82-80f7-6a53daf186d5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:43:23.790185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:43:23.809828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-50b59df8-a5fe-4e37-b1f7-6d52be3f0a0f tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:23.841463 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-50b59df8-a5fe-4e37-b1f7-6d52be3f0a0f tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1317 microversion: 2.1 time: 1.278647 Aug 09 17:43:23.857074 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2491/5242] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:22 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1317 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:43:23.882187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:23.884517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:23.897646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:23.899114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:23.900265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:23.906638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:23.908026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:23.909091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:24.216788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dee76eeb-2a48-4b82-80f7-6a53daf186d5 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 204 len: 0 microversion: 2.1 time: 0.636067 Aug 09 17:43:24.217740 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2752/5243] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:43:23 2022] DELETE /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:43:24.390965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1719df91-b9da-4d0b-a7c4-d0083cf91ab2 req-aa6134a7-946c-4b64-9ad5-f6cc549269f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2dffdb-cb37-41f1-985b-63d3c84f8894", "tag": "c7ce58af-3ea5-40a3-a8a3-1c38d41c3ce7"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:24.425580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1719df91-b9da-4d0b-a7c4-d0083cf91ab2 req-aa6134a7-946c-4b64-9ad5-f6cc549269f1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:24.428740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1719df91-b9da-4d0b-a7c4-d0083cf91ab2 req-aa6134a7-946c-4b64-9ad5-f6cc549269f1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:24.430786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1719df91-b9da-4d0b-a7c4-d0083cf91ab2 req-aa6134a7-946c-4b64-9ad5-f6cc549269f1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:24.963207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:24.982181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:24.986543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:24.995995 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-03a84538-d7b9-4d20-aa50-fa446329e10f tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1406 microversion: 2.20 time: 1.134727 Aug 09 17:43:24.997227 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2492/5244] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:23 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1406 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:43:25.014450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9152a784-7f00-4fd3-90db-91e60f7149f9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:25.015472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9152a784-7f00-4fd3-90db-91e60f7149f9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:25.029582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9152a784-7f00-4fd3-90db-91e60f7149f9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:25.033957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9152a784-7f00-4fd3-90db-91e60f7149f9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:25.034714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9152a784-7f00-4fd3-90db-91e60f7149f9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:25.039535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9152a784-7f00-4fd3-90db-91e60f7149f9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:25.040898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9152a784-7f00-4fd3-90db-91e60f7149f9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:25.041575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9152a784-7f00-4fd3-90db-91e60f7149f9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:25.312682 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1719df91-b9da-4d0b-a7c4-d0083cf91ab2 req-aa6134a7-946c-4b64-9ad5-f6cc549269f1 service nova] Creating event network-changed:c7ce58af-3ea5-40a3-a8a3-1c38d41c3ce7 for instance 4c2dffdb-cb37-41f1-985b-63d3c84f8894 on n-h1-845781-6 Aug 09 17:43:25.340453 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1719df91-b9da-4d0b-a7c4-d0083cf91ab2 req-aa6134a7-946c-4b64-9ad5-f6cc549269f1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.116867 Aug 09 17:43:25.349753 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2753/5245] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:43:25.381804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-043e5cab-d855-440a-a082-8ada12ae3ea3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:25.395326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-043e5cab-d855-440a-a082-8ada12ae3ea3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:25.400267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:43:25.429686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-043e5cab-d855-440a-a082-8ada12ae3ea3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:25.431269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-043e5cab-d855-440a-a082-8ada12ae3ea3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:25.432514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-043e5cab-d855-440a-a082-8ada12ae3ea3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:25.434228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-043e5cab-d855-440a-a082-8ada12ae3ea3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:25.444368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-043e5cab-d855-440a-a082-8ada12ae3ea3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:25.445656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-043e5cab-d855-440a-a082-8ada12ae3ea3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:25.899721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9152a784-7f00-4fd3-90db-91e60f7149f9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:25.960344 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9152a784-7f00-4fd3-90db-91e60f7149f9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1672 microversion: 2.1 time: 0.914415 Aug 09 17:43:25.960344 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2493/5246] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:24 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1672 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:26.037934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:26.038642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:26.064809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:26.067053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:26.071360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:26.074547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:26.094554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:26.097550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:26.891151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-043e5cab-d855-440a-a082-8ada12ae3ea3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:26.917117 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-043e5cab-d855-440a-a082-8ada12ae3ea3 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1505 microversion: 2.1 time: 1.563445 Aug 09 17:43:26.919710 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2754/5247] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:25 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1505 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:26.945308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-80e1c0d6-4b0e-463a-b408-f967547545e5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:26.946318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-80e1c0d6-4b0e-463a-b408-f967547545e5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:26.962317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80e1c0d6-4b0e-463a-b408-f967547545e5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:26.963708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80e1c0d6-4b0e-463a-b408-f967547545e5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:26.964514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80e1c0d6-4b0e-463a-b408-f967547545e5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:26.965563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80e1c0d6-4b0e-463a-b408-f967547545e5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:26.966898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80e1c0d6-4b0e-463a-b408-f967547545e5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:26.967557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80e1c0d6-4b0e-463a-b408-f967547545e5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:27.293642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:27.338893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:27.359887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:27.369844 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2faa55fe-c241-4cae-a1a4-9813279ec02e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1406 microversion: 2.20 time: 1.341758 Aug 09 17:43:27.371042 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2494/5248] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:26 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1406 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:43:27.411948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-34c48ff4-882f-452a-b038-4f7cf24c9baa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:27.416743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-34c48ff4-882f-452a-b038-4f7cf24c9baa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:27.453689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34c48ff4-882f-452a-b038-4f7cf24c9baa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:27.454273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34c48ff4-882f-452a-b038-4f7cf24c9baa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:27.457135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34c48ff4-882f-452a-b038-4f7cf24c9baa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:27.465112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34c48ff4-882f-452a-b038-4f7cf24c9baa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:27.470446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34c48ff4-882f-452a-b038-4f7cf24c9baa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:27.471025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-34c48ff4-882f-452a-b038-4f7cf24c9baa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:28.358135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-34c48ff4-882f-452a-b038-4f7cf24c9baa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:28.388606 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-34c48ff4-882f-452a-b038-4f7cf24c9baa tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1672 microversion: 2.1 time: 1.011230 Aug 09 17:43:28.394755 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2495/5249] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:27 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1672 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:28.426703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a8336609-9d58-4aa4-8a06-c5bec53574f4 req-6828df32-3abf-42b1-8c23-270ccb7f296f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a34552-f7cd-4770-b3ef-be9226b0cd78", "name": "network-vif-plugged", "status": "completed", "tag": "0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:28.467061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a8336609-9d58-4aa4-8a06-c5bec53574f4 req-6828df32-3abf-42b1-8c23-270ccb7f296f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:28.467819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a8336609-9d58-4aa4-8a06-c5bec53574f4 req-6828df32-3abf-42b1-8c23-270ccb7f296f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:28.468443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a8336609-9d58-4aa4-8a06-c5bec53574f4 req-6828df32-3abf-42b1-8c23-270ccb7f296f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:28.488489 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a8336609-9d58-4aa4-8a06-c5bec53574f4 req-6828df32-3abf-42b1-8c23-270ccb7f296f service nova] Creating event network-vif-plugged:0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90 for instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 on n-h2-845781-6 Aug 09 17:43:28.494453 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a8336609-9d58-4aa4-8a06-c5bec53574f4 req-6828df32-3abf-42b1-8c23-270ccb7f296f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094537 Aug 09 17:43:28.495538 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2496/5250] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:43:28.503459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:28.503735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:28.511895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:28.512620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:28.513088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:28.513905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:28.514385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:28.514894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:28.637274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-80e1c0d6-4b0e-463a-b408-f967547545e5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:28.672354 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-80e1c0d6-4b0e-463a-b408-f967547545e5 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8" status: 200 len: 1504 microversion: 2.1 time: 1.731666 Aug 09 17:43:28.697205 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2755/5251] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:26 2022] GET /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 => generated 1504 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:43:28.750781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-596afd0e-8905-4beb-acf9-10fbdbede26e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:28.751903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-596afd0e-8905-4beb-acf9-10fbdbede26e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:28.775420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-596afd0e-8905-4beb-acf9-10fbdbede26e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:28.783782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-596afd0e-8905-4beb-acf9-10fbdbede26e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:28.785180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-596afd0e-8905-4beb-acf9-10fbdbede26e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:28.786870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-596afd0e-8905-4beb-acf9-10fbdbede26e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:28.790153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-596afd0e-8905-4beb-acf9-10fbdbede26e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:28.799471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-596afd0e-8905-4beb-acf9-10fbdbede26e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:28.857908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-596afd0e-8905-4beb-acf9-10fbdbede26e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:43:28.993592 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-596afd0e-8905-4beb-acf9-10fbdbede26e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8" status: 204 len: 0 microversion: 2.1 time: 0.252313 Aug 09 17:43:28.996324 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2756/5252] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:43:28 2022] DELETE /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:43:29.017756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8ed06dec-5966-4ad5-8042-7c80e6c193c0 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:29.022333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ed06dec-5966-4ad5-8042-7c80e6c193c0 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:29.045081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed06dec-5966-4ad5-8042-7c80e6c193c0 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:29.046097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed06dec-5966-4ad5-8042-7c80e6c193c0 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:29.047549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed06dec-5966-4ad5-8042-7c80e6c193c0 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:29.049685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed06dec-5966-4ad5-8042-7c80e6c193c0 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:29.051136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed06dec-5966-4ad5-8042-7c80e6c193c0 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:29.052811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ed06dec-5966-4ad5-8042-7c80e6c193c0 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:29.135455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ed06dec-5966-4ad5-8042-7c80e6c193c0 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:43:29.345948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:29.389815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:29.400314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:29.407491 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-90d305c3-bced-4695-bd06-05ceed7268fa tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1406 microversion: 2.20 time: 0.907928 Aug 09 17:43:29.408669 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2497/5253] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:28 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1406 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:43:29.432703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e774f5b9-bcf8-4a05-a81b-d61369a32303 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:29.434194 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8ed06dec-5966-4ad5-8042-7c80e6c193c0 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 204 len: 0 microversion: 2.1 time: 0.430689 Aug 09 17:43:29.438020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e774f5b9-bcf8-4a05-a81b-d61369a32303 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:29.446724 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2757/5254] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:43:29 2022] DELETE /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:43:29.462996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2730256c-1b9b-4415-8745-1fee48542bb7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:29.464929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2730256c-1b9b-4415-8745-1fee48542bb7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:29.465847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e774f5b9-bcf8-4a05-a81b-d61369a32303 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:29.466771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e774f5b9-bcf8-4a05-a81b-d61369a32303 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:29.469905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e774f5b9-bcf8-4a05-a81b-d61369a32303 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:29.473433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e774f5b9-bcf8-4a05-a81b-d61369a32303 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:29.474989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e774f5b9-bcf8-4a05-a81b-d61369a32303 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:29.479437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e774f5b9-bcf8-4a05-a81b-d61369a32303 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:29.482194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2730256c-1b9b-4415-8745-1fee48542bb7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:29.484543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2730256c-1b9b-4415-8745-1fee48542bb7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:29.485704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2730256c-1b9b-4415-8745-1fee48542bb7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:29.487766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2730256c-1b9b-4415-8745-1fee48542bb7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:29.489994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2730256c-1b9b-4415-8745-1fee48542bb7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:29.491245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2730256c-1b9b-4415-8745-1fee48542bb7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:29.807199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e774f5b9-bcf8-4a05-a81b-d61369a32303 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:29.811269 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:43:29.840922 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e774f5b9-bcf8-4a05-a81b-d61369a32303 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1604 microversion: 2.1 time: 0.427156 Aug 09 17:43:29.847771 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2498/5255] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:29 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1604 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:30.436766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:30.437951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:30.484672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:30.488435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:30.491414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:30.498805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:30.500191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:30.504601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:30.934349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2730256c-1b9b-4415-8745-1fee48542bb7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:30.945533 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2730256c-1b9b-4415-8745-1fee48542bb7 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8" status: 200 len: 1510 microversion: 2.1 time: 1.496596 Aug 09 17:43:30.952438 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2758/5256] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:29 2022] GET /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 => generated 1510 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:30.968880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-183d0732-0233-4d0c-8a2a-29cd5e164541 req-45861ea4-5bb4-45d4-85c2-f4ffceaa63c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2dffdb-cb37-41f1-985b-63d3c84f8894", "name": "network-vif-deleted", "tag": "c7ce58af-3ea5-40a3-a8a3-1c38d41c3ce7"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:31.032962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-183d0732-0233-4d0c-8a2a-29cd5e164541 req-45861ea4-5bb4-45d4-85c2-f4ffceaa63c8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:31.040680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-183d0732-0233-4d0c-8a2a-29cd5e164541 req-45861ea4-5bb4-45d4-85c2-f4ffceaa63c8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:31.043239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-183d0732-0233-4d0c-8a2a-29cd5e164541 req-45861ea4-5bb4-45d4-85c2-f4ffceaa63c8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:31.080388 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-183d0732-0233-4d0c-8a2a-29cd5e164541 req-45861ea4-5bb4-45d4-85c2-f4ffceaa63c8 service nova] Creating event network-vif-deleted:c7ce58af-3ea5-40a3-a8a3-1c38d41c3ce7 for instance 4c2dffdb-cb37-41f1-985b-63d3c84f8894 on n-h1-845781-6 Aug 09 17:43:31.136239 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-183d0732-0233-4d0c-8a2a-29cd5e164541 req-45861ea4-5bb4-45d4-85c2-f4ffceaa63c8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176925 Aug 09 17:43:31.143074 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2759/5257] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:43:31.179657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:31.201305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:31.252026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:31.264175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:31.269073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:31.276469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:31.296685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:31.298665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:31.506058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:31.512157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:31.514880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:31.523371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lazy-loading 'fault' on Instance uuid 4c2dffdb-cb37-41f1-985b-63d3c84f8894 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:43:31.640869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:31.674701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:31.679125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:31.692321 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5235706d-8294-4466-af34-17b9e47e09c9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1406 microversion: 2.20 time: 1.260389 Aug 09 17:43:31.731378 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2499/5258] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:30 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1406 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:43:31.982179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-86588d97-c7a3-490c-8434-9cd485b23d43 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:31.986063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-86588d97-c7a3-490c-8434-9cd485b23d43 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:32.026535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86588d97-c7a3-490c-8434-9cd485b23d43 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:32.029267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86588d97-c7a3-490c-8434-9cd485b23d43 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:32.032182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86588d97-c7a3-490c-8434-9cd485b23d43 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:32.037208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86588d97-c7a3-490c-8434-9cd485b23d43 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:32.041330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86588d97-c7a3-490c-8434-9cd485b23d43 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:32.044822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86588d97-c7a3-490c-8434-9cd485b23d43 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:32.330048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:32.339732 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8446eaf6-c257-44c2-a72a-dbfe0426a663 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 200 len: 1339 microversion: 2.1 time: 1.194477 Aug 09 17:43:32.346982 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2760/5259] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:31 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 1339 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:32.531560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-86588d97-c7a3-490c-8434-9cd485b23d43 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:32.550082 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-86588d97-c7a3-490c-8434-9cd485b23d43 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8" status: 200 len: 1510 microversion: 2.1 time: 0.576815 Aug 09 17:43:32.572378 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2500/5260] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:31 2022] GET /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 => generated 1510 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:43:32.740229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:32.741442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:32.750673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:32.753697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:32.759724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:32.760949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:32.761946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:32.762663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:32.891245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-84ac56d1-e4b8-4280-abbf-f953e4462325 req-20f70132-6f8b-4a86-8690-03988f5109f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8", "name": "network-vif-deleted", "tag": "24f51608-5f6b-4cfa-9a7f-caa32e793098"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:32.910143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-84ac56d1-e4b8-4280-abbf-f953e4462325 req-20f70132-6f8b-4a86-8690-03988f5109f9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:32.910686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-84ac56d1-e4b8-4280-abbf-f953e4462325 req-20f70132-6f8b-4a86-8690-03988f5109f9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:32.912110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-84ac56d1-e4b8-4280-abbf-f953e4462325 req-20f70132-6f8b-4a86-8690-03988f5109f9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:32.941573 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-84ac56d1-e4b8-4280-abbf-f953e4462325 req-20f70132-6f8b-4a86-8690-03988f5109f9 service nova] Creating event network-vif-deleted:24f51608-5f6b-4cfa-9a7f-caa32e793098 for instance 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 on n-h1-845781-6 Aug 09 17:43:32.959166 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-84ac56d1-e4b8-4280-abbf-f953e4462325 req-20f70132-6f8b-4a86-8690-03988f5109f9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072213 Aug 09 17:43:32.960172 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2501/5261] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:43:33.394709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:33.395581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 4c2dffdb-cb37-41f1-985b-63d3c84f8894] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:33.403972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:33.404483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:33.405086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:33.405772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:33.406623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:33.408321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:33.443168 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] HTTP exception thrown: Instance 4c2dffdb-cb37-41f1-985b-63d3c84f8894 could not be found. Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Request method failure captured: Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 HTTP/1.1 Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pu27kmxlk7aADrjz2CKRwT-C5Zjwi_lNUjwiXZ5Z6gfQkfbibdq9sozm41HtXTWrQWFzYpTCPzwEVRV5MEPWrgm9BB2RPWNWBWWTa_z10AU7kE5C1ZuYz_dNAkBGHAMa8hiEQoQ_A4YuLRqMZcuri0tai7o9yDQbwxczVEjvdYvU9c Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 95efa122e86846beb9abcb02ac118e94 Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TestNetworkBasicOps-1268708530 Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_95efa122e86846beb9abcb02ac118e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/95efa122e86846beb9abcb02ac118e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/95efa122e86846beb9abcb02ac118e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/95efa122e86846beb9abcb02ac118e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TestNetworkBasicOps-1268708530 Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 95efa122e86846beb9abcb02ac118e94 Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TestNetworkBasicOps-1268708530 Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TestNetworkBasicOps-1268708530-project Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: cbb30087336245ce95a13efe7c2f382e Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TestNetworkBasicOps-1268708530-project Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 4c2dffdb-cb37-41f1-985b-63d3c84f8894 could not be found. Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '4c2dffdb-cb37-41f1-985b-63d3c84f8894'} Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2dffdb-cb37-41f1-985b-63d3c84f8894 could not be found. Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2dffdb-cb37-41f1-985b-63d3c84f8894 could not be found. Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:33.455680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:33.459782 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:33.459782 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:33.459782 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:33.459782 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:43:33.459782 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:43:33.459782 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2dffdb-cb37-41f1-985b-63d3c84f8894 could not be found. Aug 09 17:43:33.459782 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:43:33.459782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Returning 404 to user: Instance 4c2dffdb-cb37-41f1-985b-63d3c84f8894 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:43:33.459782 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a6ab661c-045c-4466-8f02-332d7ff52328 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894" status: 404 len: 111 microversion: 2.1 time: 0.070945 Aug 09 17:43:33.459782 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2502/5262] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:33 2022] GET /compute/v2.1/servers/4c2dffdb-cb37-41f1-985b-63d3c84f8894 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:43:33.594419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:33.596196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:33.625793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:33.655106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:33.658303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:33.679250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:33.683893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:33.684377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:33.877088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:33.877930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:33.878733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:33.879576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lazy-loading 'fault' on Instance uuid 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:43:34.049100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:34.061622 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bfa37315-1334-4a64-829b-1b3412d5977e tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8" status: 200 len: 1307 microversion: 2.1 time: 0.473079 Aug 09 17:43:34.082895 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2503/5263] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:33 2022] GET /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 => generated 1307 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:43:34.213835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-32536068-6e79-44bf-a378-b908622db562 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '.version_select at 0x7fbbcb609c10>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:34.276382 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-32536068-6e79-44bf-a378-b908622db562 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1054273672" status: 202 len: 0 microversion: 2.1 time: 0.067666 Aug 09 17:43:34.277174 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2504/5264] 10.222.0.93 () {58 vars in 1257 bytes} [Tue Aug 9 17:43:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1054273672 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:43:34.785296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:34.830168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:34.848591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:34.856623 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-77bcb906-7e2c-4ae3-bc41-406c7da7f441 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1598 microversion: 2.20 time: 2.119494 Aug 09 17:43:34.860284 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2761/5265] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:43:32 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1598 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:43:34.905108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f8f6112e-c52b-421c-85fa-fc2bc0320855 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:34.906445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f8f6112e-c52b-421c-85fa-fc2bc0320855 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:34.925702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f6112e-c52b-421c-85fa-fc2bc0320855 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:34.927824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f6112e-c52b-421c-85fa-fc2bc0320855 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:34.929478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f6112e-c52b-421c-85fa-fc2bc0320855 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:34.931015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f6112e-c52b-421c-85fa-fc2bc0320855 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:34.932160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f6112e-c52b-421c-85fa-fc2bc0320855 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:34.933186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8f6112e-c52b-421c-85fa-fc2bc0320855 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:35.104873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:35.106673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:35.136118 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f8f6112e-c52b-421c-85fa-fc2bc0320855 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.240796 Aug 09 17:43:35.150313 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2505/5266] 10.222.0.93 () {60 vars in 1316 bytes} [Tue Aug 9 17:43:34 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/os-interface => generated 285 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:43:35.165011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:35.165899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:35.166631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:35.167967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:35.168952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:35.180649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:35.230906 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] HTTP exception thrown: Instance 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 could not be found. Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Request method failure captured: Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 HTTP/1.1 Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pxbUMAYA19n1NqVFt9Cqqcm3NZUPRjQAy4Dq3PKF8iOIkzuXxLe8hv4zMrPAgSx5LqRx0OyEMPf5LtuFoCDj3Hpeb2YU-01_gL6KUa43v2AL9ZKo8g1rXstPDzRdPPo1U1WEgH8YF0zvysFlRREAaVhrxx7zs6NY_eb2jg44BD1u20 Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 40a4a3ec423d44088b980f87360221a5 Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-MultipleCreateTestJSON-1272031294 Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_40a4a3ec423d44088b980f87360221a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/40a4a3ec423d44088b980f87360221a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/40a4a3ec423d44088b980f87360221a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/40a4a3ec423d44088b980f87360221a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-MultipleCreateTestJSON-1272031294 Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 40a4a3ec423d44088b980f87360221a5 Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1272031294 Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-MultipleCreateTestJSON-1272031294-project Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 643cb507595841ef80dfc05a069d021b Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-MultipleCreateTestJSON-1272031294-project Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 could not be found. Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8'} Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 could not be found. Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 could not be found. Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:35.239248 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:35.245171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:35.245171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:35.245171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:35.245171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:43:35.245171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:43:35.245171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 could not be found. Aug 09 17:43:35.245171 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:35.246847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Returning 404 to user: Instance 8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:43:35.248717 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3177ccb4-c9a9-4caf-aa6f-48e53265df8d tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8" status: 404 len: 111 microversion: 2.1 time: 0.162641 Aug 09 17:43:35.250107 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2762/5267] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:35 2022] GET /compute/v2.1/servers/8ee624e9-3bb9-4e02-9f86-d3bde70b1bb8 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:43:35.268203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6cc50035-88d9-4997-9a75-8577bf1708e1 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:35.274869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6cc50035-88d9-4997-9a75-8577bf1708e1 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:35.315181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cc50035-88d9-4997-9a75-8577bf1708e1 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:35.315691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cc50035-88d9-4997-9a75-8577bf1708e1 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:35.316363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cc50035-88d9-4997-9a75-8577bf1708e1 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:35.317342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cc50035-88d9-4997-9a75-8577bf1708e1 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:35.321394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cc50035-88d9-4997-9a75-8577bf1708e1 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:35.322276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6cc50035-88d9-4997-9a75-8577bf1708e1 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:36.016608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-020723c4-e609-4ea7-bbcb-8d43d390598e req-e2613b1f-07aa-4aad-b378-9117880382f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a239a0-1f3f-4715-83ae-7135780ad8a2", "name": "network-vif-deleted", "tag": "a6c45ab2-6a14-4304-adbd-f068077d3468"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:36.043231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-020723c4-e609-4ea7-bbcb-8d43d390598e req-e2613b1f-07aa-4aad-b378-9117880382f7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:36.044184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-020723c4-e609-4ea7-bbcb-8d43d390598e req-e2613b1f-07aa-4aad-b378-9117880382f7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:36.044798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-020723c4-e609-4ea7-bbcb-8d43d390598e req-e2613b1f-07aa-4aad-b378-9117880382f7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:36.068942 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-020723c4-e609-4ea7-bbcb-8d43d390598e req-e2613b1f-07aa-4aad-b378-9117880382f7 service nova] Creating event network-vif-deleted:a6c45ab2-6a14-4304-adbd-f068077d3468 for instance f8a239a0-1f3f-4715-83ae-7135780ad8a2 on n-h2-845781-6 Aug 09 17:43:36.074682 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-020723c4-e609-4ea7-bbcb-8d43d390598e req-e2613b1f-07aa-4aad-b378-9117880382f7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065830 Aug 09 17:43:36.075901 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2763/5268] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:43:36.647934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6cc50035-88d9-4997-9a75-8577bf1708e1 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643cb507595841ef80dfc05a069d021b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4a3ec423d44088b980f87360221a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:43:36.684937 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6cc50035-88d9-4997-9a75-8577bf1708e1 tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 200 len: 1469 microversion: 2.1 time: 1.429128 Aug 09 17:43:36.686276 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2506/5269] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:35 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 1469 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:43:37.716547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:43:37.718822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] [instance: f8a239a0-1f3f-4715-83ae-7135780ad8a2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:43:37.735616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:37.737003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:37.738063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:37.741592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:37.742766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:37.743833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:37.788169 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] HTTP exception thrown: Instance f8a239a0-1f3f-4715-83ae-7135780ad8a2 could not be found. Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Request method failure captured: Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 HTTP/1.1 Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pxbUMAYA19n1NqVFt9Cqqcm3NZUPRjQAy4Dq3PKF8iOIkzuXxLe8hv4zMrPAgSx5LqRx0OyEMPf5LtuFoCDj3Hpeb2YU-01_gL6KUa43v2AL9ZKo8g1rXstPDzRdPPo1U1WEgH8YF0zvysFlRREAaVhrxx7zs6NY_eb2jg44BD1u20 Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 40a4a3ec423d44088b980f87360221a5 Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-MultipleCreateTestJSON-1272031294 Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_40a4a3ec423d44088b980f87360221a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/40a4a3ec423d44088b980f87360221a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/40a4a3ec423d44088b980f87360221a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/40a4a3ec423d44088b980f87360221a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-MultipleCreateTestJSON-1272031294 Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 40a4a3ec423d44088b980f87360221a5 Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1272031294 Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-MultipleCreateTestJSON-1272031294-project Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 643cb507595841ef80dfc05a069d021b Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-MultipleCreateTestJSON-1272031294-project Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance f8a239a0-1f3f-4715-83ae-7135780ad8a2 could not be found. Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'f8a239a0-1f3f-4715-83ae-7135780ad8a2'} Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a239a0-1f3f-4715-83ae-7135780ad8a2 could not be found. Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a239a0-1f3f-4715-83ae-7135780ad8a2 could not be found. Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:43:37.793271 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:37.800737 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:43:37.800737 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:43:37.800737 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:43:37.800737 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:43:37.800737 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:43:37.800737 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a239a0-1f3f-4715-83ae-7135780ad8a2 could not be found. Aug 09 17:43:37.800737 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:43:37.805110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] Returning 404 to user: Instance f8a239a0-1f3f-4715-83ae-7135780ad8a2 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:43:37.810852 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f405b3fb-a12c-4fde-85c0-8516952e2e0b tempest-MultipleCreateTestJSON-1272031294 tempest-MultipleCreateTestJSON-1272031294-project] 10.222.0.93 "GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2" status: 404 len: 111 microversion: 2.1 time: 0.103546 Aug 09 17:43:37.818803 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2764/5270] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:43:37 2022] GET /compute/v2.1/servers/f8a239a0-1f3f-4715-83ae-7135780ad8a2 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:43:42.356254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-95fb447d-4054-467f-bacc-f057b0381222 req-2c68ec01-1d2c-4943-b77e-5233af5a631d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a34552-f7cd-4770-b3ef-be9226b0cd78", "tag": "0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:43:42.392463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-95fb447d-4054-467f-bacc-f057b0381222 req-2c68ec01-1d2c-4943-b77e-5233af5a631d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:43:42.394881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-95fb447d-4054-467f-bacc-f057b0381222 req-2c68ec01-1d2c-4943-b77e-5233af5a631d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:43:42.395844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-95fb447d-4054-467f-bacc-f057b0381222 req-2c68ec01-1d2c-4943-b77e-5233af5a631d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:43:42.451760 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-95fb447d-4054-467f-bacc-f057b0381222 req-2c68ec01-1d2c-4943-b77e-5233af5a631d service nova] Creating event network-changed:0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90 for instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 on n-h2-845781-6 Aug 09 17:43:42.464103 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-95fb447d-4054-467f-bacc-f057b0381222 req-2c68ec01-1d2c-4943-b77e-5233af5a631d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112865 Aug 09 17:43:42.468560 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2507/5271] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:44:07.796439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9da24d32-f7c4-4e13-bc66-82bba41748a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:07.797752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9da24d32-f7c4-4e13-bc66-82bba41748a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:07.801297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:07.802461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:07.821996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9da24d32-f7c4-4e13-bc66-82bba41748a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:07.850800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9da24d32-f7c4-4e13-bc66-82bba41748a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:07.851861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9da24d32-f7c4-4e13-bc66-82bba41748a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:07.858279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9da24d32-f7c4-4e13-bc66-82bba41748a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:07.859668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9da24d32-f7c4-4e13-bc66-82bba41748a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:07.861613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9da24d32-f7c4-4e13-bc66-82bba41748a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:07.950628 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9da24d32-f7c4-4e13-bc66-82bba41748a8 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/ips" status: 200 len: 152 microversion: 2.20 time: 0.146963 Aug 09 17:44:07.954252 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2765/5272] 10.222.0.93 () {60 vars in 1289 bytes} [Tue Aug 9 17:44:07 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/ips => generated 152 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:44:12.878323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-015b799e-b3e7-416f-b56e-008949453425 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:44:12.881112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-015b799e-b3e7-416f-b56e-008949453425 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:12.893677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:12.894953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=37 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:12.929881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-015b799e-b3e7-416f-b56e-008949453425 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:12.930819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-015b799e-b3e7-416f-b56e-008949453425 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:12.934591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-015b799e-b3e7-416f-b56e-008949453425 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:12.942089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-015b799e-b3e7-416f-b56e-008949453425 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:12.943716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-015b799e-b3e7-416f-b56e-008949453425 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:12.944455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-015b799e-b3e7-416f-b56e-008949453425 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:13.009425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-015b799e-b3e7-416f-b56e-008949453425 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lazy-loading 'flavor' on Instance uuid 08a34552-f7cd-4770-b3ef-be9226b0cd78 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:44:13.735671 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-015b799e-b3e7-416f-b56e-008949453425 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "POST /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/action" status: 202 len: 0 microversion: 2.20 time: 0.882713 Aug 09 17:44:13.736954 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2508/5273] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:44:12 2022] POST /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/action => generated 0 bytes in 887 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:44:13.757380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:13.757993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:13.795199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:13.796586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:13.799338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:13.802274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:13.804343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:13.806894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:15.191235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:15.202588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:15.211130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:15.212426 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4cfd05c2-7343-4d8e-97ea-47553bab3105 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1723 microversion: 2.20 time: 1.469061 Aug 09 17:44:15.213030 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2766/5274] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:13 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1723 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:16.244923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:16.244923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:16.268459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:16.269020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:16.269477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:16.270232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:16.270701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:16.271804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:16.492555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-599843266", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "e42616ff-06f5-4332-89e9-fa5f0c31a151"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:44:16.638636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] validate_networks() for [('e42616ff-06f5-4332-89e9-fa5f0c31a151', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:44:17.572359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:17.655642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:17.676204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:17.685550 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c68768ba-8e3b-4276-a4c9-8164072a72bc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1723 microversion: 2.20 time: 1.448475 Aug 09 17:44:17.697207 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2767/5275] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:16 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1723 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:18.726357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:18.727817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:18.741963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:18.744350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:18.746033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:18.748627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:18.751906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:18.753486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:19.960509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:44:19.961609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:44:19.962255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:44:19.962899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:44:19.963471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:44:19.992472 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:19.995363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:19.997460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:19.998825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:20.001735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:20.002405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:20.021109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:20.046562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:20.068019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:20.077923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Getting quotas for project f20b15fadc774d91aebf553ea3234e39. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:44:20.079089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fc901dd0-e79a-4331-ae1c-6e7db36ff358 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1723 microversion: 2.20 time: 1.357606 Aug 09 17:44:20.083155 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2768/5276] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:18 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1723 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:20.105426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Getting quotas for user aa3a9cbdb61d44c1a10a8a1d8447472c and project f20b15fadc774d91aebf553ea3234e39. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:44:20.156570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:44:20.159111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:44:20.289521 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e4be4cff-c784-485d-b3d9-c2a3d9e87510 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.025529 Aug 09 17:44:20.290192 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2509/5277] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:44:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 5027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:44:20.305669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1832f433-14c3-44b3-a540-07f5ead49979 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:20.306871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1832f433-14c3-44b3-a540-07f5ead49979 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:20.544737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1832f433-14c3-44b3-a540-07f5ead49979 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:20.585859 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1832f433-14c3-44b3-a540-07f5ead49979 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1215 microversion: 2.1 time: 0.287813 Aug 09 17:44:20.615234 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2769/5278] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:20 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1215 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:21.111103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:21.112167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:21.159941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:21.160794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:21.162328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:21.164513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:21.165894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:21.168585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:21.618602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ed8e4e7b-b6be-45b2-8373-3b62f293b1db tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:21.619868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ed8e4e7b-b6be-45b2-8373-3b62f293b1db tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:21.734452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:21.749261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ed8e4e7b-b6be-45b2-8373-3b62f293b1db tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:21.749974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:21.754723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:21.759201 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e0c23057-c145-42c6-a105-ca7958809de3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1723 microversion: 2.20 time: 0.655514 Aug 09 17:44:21.761009 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ed8e4e7b-b6be-45b2-8373-3b62f293b1db tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1215 microversion: 2.1 time: 0.146042 Aug 09 17:44:21.762048 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2510/5279] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:21 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1723 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:21.762783 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2770/5280] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:21 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:22.798160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6fa3cc35-e94a-42b7-9471-9b3eb6927705 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:22.803031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:22.805386 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6fa3cc35-e94a-42b7-9471-9b3eb6927705 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:22.807946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:22.824851 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fa3cc35-e94a-42b7-9471-9b3eb6927705 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:22.826249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:22.827441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:22.828295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fa3cc35-e94a-42b7-9471-9b3eb6927705 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:22.829017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:22.829848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fa3cc35-e94a-42b7-9471-9b3eb6927705 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:22.831311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:22.833128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:22.833492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fa3cc35-e94a-42b7-9471-9b3eb6927705 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:22.835954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:22.836519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fa3cc35-e94a-42b7-9471-9b3eb6927705 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:22.837395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fa3cc35-e94a-42b7-9471-9b3eb6927705 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:23.195745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6fa3cc35-e94a-42b7-9471-9b3eb6927705 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:23.210587 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6fa3cc35-e94a-42b7-9471-9b3eb6927705 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1267 microversion: 2.1 time: 0.415653 Aug 09 17:44:23.213343 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2511/5281] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:22 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1267 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:23.328364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:23.338302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:23.345413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:23.346737 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a81959e-c81b-47fe-ba5c-1dd3d3648e47 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1723 microversion: 2.20 time: 0.553071 Aug 09 17:44:23.363679 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2771/5282] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:22 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1723 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:24.236231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6fed4d6e-6d4a-4a42-b8c2-44b674c1f31c tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:24.238579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6fed4d6e-6d4a-4a42-b8c2-44b674c1f31c tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:24.256616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fed4d6e-6d4a-4a42-b8c2-44b674c1f31c tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:24.261295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fed4d6e-6d4a-4a42-b8c2-44b674c1f31c tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:24.262152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fed4d6e-6d4a-4a42-b8c2-44b674c1f31c tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:24.263126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fed4d6e-6d4a-4a42-b8c2-44b674c1f31c tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:24.263814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fed4d6e-6d4a-4a42-b8c2-44b674c1f31c tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:24.266511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6fed4d6e-6d4a-4a42-b8c2-44b674c1f31c tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:24.382572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:24.387332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:24.470083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:24.479665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:24.487898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:24.498367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:24.506303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:24.508940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:25.033257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6fed4d6e-6d4a-4a42-b8c2-44b674c1f31c tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:25.051430 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6fed4d6e-6d4a-4a42-b8c2-44b674c1f31c tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1273 microversion: 2.1 time: 0.819986 Aug 09 17:44:25.071029 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2512/5283] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:24 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1273 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:25.093931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6a59a391-6374-4cec-9b93-2fbc99a6a735 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Action: 'create', calling method: .version_select at 0x7fbbdc9d4f70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1204313964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfhHZD0RXoHT6NiSXxfPD+C1TBMLwiXp+FCSqNs1Ux21crV+gk9CPc6SsyGv7ANl+HoJphXPQ0ppixpHRBuM2jz4JyPQOUh63ruFmKLh2EYguQzy+Phknm6Cj6LCjyaSQ=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:44:25.152152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-6a59a391-6374-4cec-9b93-2fbc99a6a735 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for project 95efa122e86846beb9abcb02ac118e94. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:44:25.195500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-6a59a391-6374-4cec-9b93-2fbc99a6a735 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for user cbb30087336245ce95a13efe7c2f382e and project 95efa122e86846beb9abcb02ac118e94. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:44:25.336691 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6a59a391-6374-4cec-9b93-2fbc99a6a735 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.264416 Aug 09 17:44:25.344774 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2513/5284] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:44:25 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:44:25.681718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:25.696555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:25.712770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:25.718776 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c97ce024-d312-4ef8-b2a9-31071a739a35 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1723 microversion: 2.20 time: 1.345531 Aug 09 17:44:25.719566 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2772/5285] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:24 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1723 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:26.109769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dab57db6-4f01-4564-8a8f-1acc391208b1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:26.110395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dab57db6-4f01-4564-8a8f-1acc391208b1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:26.162382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab57db6-4f01-4564-8a8f-1acc391208b1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:26.163280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab57db6-4f01-4564-8a8f-1acc391208b1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:26.164030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab57db6-4f01-4564-8a8f-1acc391208b1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:26.165240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab57db6-4f01-4564-8a8f-1acc391208b1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:26.174708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab57db6-4f01-4564-8a8f-1acc391208b1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:26.193797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dab57db6-4f01-4564-8a8f-1acc391208b1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:26.754786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:26.759458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:26.761461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dab57db6-4f01-4564-8a8f-1acc391208b1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:26.771172 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dab57db6-4f01-4564-8a8f-1acc391208b1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1273 microversion: 2.1 time: 0.665691 Aug 09 17:44:26.788160 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2514/5286] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:26 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1273 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:26.838274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:26.843847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:26.845619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:26.850859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:26.854895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:26.858514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:27.829205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a8aacee6-0fae-488f-83fd-8bd9d86b734f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:27.830726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a8aacee6-0fae-488f-83fd-8bd9d86b734f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:27.859804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8aacee6-0fae-488f-83fd-8bd9d86b734f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:27.871923 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8aacee6-0fae-488f-83fd-8bd9d86b734f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:27.872748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8aacee6-0fae-488f-83fd-8bd9d86b734f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:27.874162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8aacee6-0fae-488f-83fd-8bd9d86b734f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:27.874570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8aacee6-0fae-488f-83fd-8bd9d86b734f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:27.875125 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a8aacee6-0fae-488f-83fd-8bd9d86b734f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:28.023951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:28.080678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:28.104216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:28.109670 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f9461dbb-5061-4517-b0a3-60031f6df01c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1723 microversion: 2.20 time: 1.369763 Aug 09 17:44:28.113049 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2773/5287] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:26 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1723 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:28.393796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a8aacee6-0fae-488f-83fd-8bd9d86b734f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:28.437270 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a8aacee6-0fae-488f-83fd-8bd9d86b734f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1273 microversion: 2.1 time: 0.612016 Aug 09 17:44:28.445946 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2515/5288] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:27 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1273 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:44:29.139747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:29.141004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:29.158204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:29.159031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:29.159681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:29.160626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:29.161465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:29.167353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:29.489017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba93ac51-8be0-4f29-a1a2-fd3da49178b2 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:29.491652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ba93ac51-8be0-4f29-a1a2-fd3da49178b2 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:29.509398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba93ac51-8be0-4f29-a1a2-fd3da49178b2 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:29.513452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba93ac51-8be0-4f29-a1a2-fd3da49178b2 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:29.514326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba93ac51-8be0-4f29-a1a2-fd3da49178b2 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:29.516644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba93ac51-8be0-4f29-a1a2-fd3da49178b2 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:29.522586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba93ac51-8be0-4f29-a1a2-fd3da49178b2 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:29.523685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba93ac51-8be0-4f29-a1a2-fd3da49178b2 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:30.039576 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:30.265603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:30.305652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:30.308255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:30.310797 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ae52b721-eaca-4115-be87-2a12b4a5d772 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1723 microversion: 2.20 time: 1.175297 Aug 09 17:44:30.312062 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2774/5289] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:29 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1723 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:31.343443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:31.351745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:31.409945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:31.412163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:31.412984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:31.436152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:31.442054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:31.444440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:31.759312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:31.932682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ba93ac51-8be0-4f29-a1a2-fd3da49178b2 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:31.967477 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ba93ac51-8be0-4f29-a1a2-fd3da49178b2 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1315 microversion: 2.1 time: 2.480575 Aug 09 17:44:31.969604 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2516/5290] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:29 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1315 bytes in 2485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:32.841244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:32.874803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:32.886690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:32.895861 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3ffbb624-5943-42aa-a66f-3ce50fb1e614 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 1.559156 Aug 09 17:44:32.897027 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2775/5291] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:31 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:33.046642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-28b7fe31-d8fd-4446-b4e7-8afe48cb5cd0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:33.056211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-28b7fe31-d8fd-4446-b4e7-8afe48cb5cd0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:33.103077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28b7fe31-d8fd-4446-b4e7-8afe48cb5cd0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:33.104288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28b7fe31-d8fd-4446-b4e7-8afe48cb5cd0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:33.107319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28b7fe31-d8fd-4446-b4e7-8afe48cb5cd0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:33.118734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28b7fe31-d8fd-4446-b4e7-8afe48cb5cd0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:33.119730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28b7fe31-d8fd-4446-b4e7-8afe48cb5cd0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:33.120582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-28b7fe31-d8fd-4446-b4e7-8afe48cb5cd0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:33.824211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-28b7fe31-d8fd-4446-b4e7-8afe48cb5cd0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:33.860050 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-28b7fe31-d8fd-4446-b4e7-8afe48cb5cd0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1315 microversion: 2.1 time: 0.844181 Aug 09 17:44:33.861732 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2517/5292] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:33 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:33.926754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:33.929706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:33.960201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:33.961447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:33.962365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:33.967064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:33.968564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:33.969475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:34.348834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e747233f-cb41-49c7-889c-8b4f1ca461d7 req-4e707211-c1a9-4030-96da-ce2746a61541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa950500-d319-4ae4-bd01-e9629aaa7b60", "tag": "139da233-e0be-4e02-ba58-ab30751f3b19"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:44:34.374244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e747233f-cb41-49c7-889c-8b4f1ca461d7 req-4e707211-c1a9-4030-96da-ce2746a61541 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:34.376353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e747233f-cb41-49c7-889c-8b4f1ca461d7 req-4e707211-c1a9-4030-96da-ce2746a61541 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:34.376979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e747233f-cb41-49c7-889c-8b4f1ca461d7 req-4e707211-c1a9-4030-96da-ce2746a61541 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:34.407248 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e747233f-cb41-49c7-889c-8b4f1ca461d7 req-4e707211-c1a9-4030-96da-ce2746a61541 service nova] Creating event network-changed:139da233-e0be-4e02-ba58-ab30751f3b19 for instance aa950500-d319-4ae4-bd01-e9629aaa7b60 on n-h1-845781-6 Aug 09 17:44:34.425551 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e747233f-cb41-49c7-889c-8b4f1ca461d7 req-4e707211-c1a9-4030-96da-ce2746a61541 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082224 Aug 09 17:44:34.426198 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2518/5293] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:44:34.639128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:34.667117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:34.669100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:34.677322 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9a7d05e8-d3e7-4818-8b18-0f3f056c2e1d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 0.754922 Aug 09 17:44:34.681100 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2776/5294] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:33 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:34.888053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e51778b6-ccff-4051-b91b-5cec64c3b842 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:34.888787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e51778b6-ccff-4051-b91b-5cec64c3b842 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:34.899839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51778b6-ccff-4051-b91b-5cec64c3b842 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:34.900345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51778b6-ccff-4051-b91b-5cec64c3b842 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:34.905725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51778b6-ccff-4051-b91b-5cec64c3b842 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:34.910422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51778b6-ccff-4051-b91b-5cec64c3b842 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:34.913051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51778b6-ccff-4051-b91b-5cec64c3b842 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:34.919115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51778b6-ccff-4051-b91b-5cec64c3b842 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:35.251692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=10 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:35.711958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:35.713941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:35.741500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:35.748290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:35.753764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:35.757637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:35.771047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:35.775181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:36.007174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e51778b6-ccff-4051-b91b-5cec64c3b842 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:36.022759 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e51778b6-ccff-4051-b91b-5cec64c3b842 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1315 microversion: 2.1 time: 1.142700 Aug 09 17:44:36.027017 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2519/5295] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:34 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1315 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:36.165984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-652200321", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "b8170380-26ed-4f1f-b48a-699183ed6a9b"}], "key_name": "tempest-TestNetworkBasicOps-1204313964", "security_groups": [{"name": "tempest-secgroup-smoke-399838770"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:44:36.621694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:36.651095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:36.655500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:36.668415 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a0f5ce4-653a-4de0-85a3-a88d63f917e0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 0.954576 Aug 09 17:44:36.672482 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2777/5296] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:35 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:36.747019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] validate_networks() for [('b8170380-26ed-4f1f-b48a-699183ed6a9b', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:44:37.054477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b70bc764-392b-4d9a-809d-15fc1175ccb0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:37.055422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b70bc764-392b-4d9a-809d-15fc1175ccb0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:37.085503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b70bc764-392b-4d9a-809d-15fc1175ccb0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:37.093336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b70bc764-392b-4d9a-809d-15fc1175ccb0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:37.094724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b70bc764-392b-4d9a-809d-15fc1175ccb0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:37.095744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b70bc764-392b-4d9a-809d-15fc1175ccb0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:37.100337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b70bc764-392b-4d9a-809d-15fc1175ccb0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:37.107149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b70bc764-392b-4d9a-809d-15fc1175ccb0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:37.938136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b70bc764-392b-4d9a-809d-15fc1175ccb0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:37.960051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=69 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:37.966638 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b70bc764-392b-4d9a-809d-15fc1175ccb0 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1315 microversion: 2.1 time: 0.918166 Aug 09 17:44:37.969872 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2778/5297] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:37 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1315 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:37.981219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:37.982715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:37.998859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=33 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:38.003164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:38.004080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:38.005499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:38.012020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:38.013025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:38.015001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:38.413859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:44:38.415652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:44:38.416800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:44:38.420333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:44:38.421748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:44:38.533562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:38.539159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:38.547100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:38.553407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:38.556204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:38.559337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:38.671223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for project 95efa122e86846beb9abcb02ac118e94. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:44:38.696524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Getting quotas for user cbb30087336245ce95a13efe7c2f382e and project 95efa122e86846beb9abcb02ac118e94. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:44:38.750420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:38.757202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:44:38.766418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:38.774601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:44:38.779018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:38.779872 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2e5419fb-d1b5-4a46-9691-f0832ae092a1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 0.808251 Aug 09 17:44:38.788910 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2779/5298] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:37 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:38.942344 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-605e0e24-50c9-4169-9a73-1678e1351e5e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.777620 Aug 09 17:44:38.942878 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2520/5299] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:44:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 2782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:44:38.962850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-124a252f-0c90-4495-9a46-db0b8ce3d1d1 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:38.963494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-124a252f-0c90-4495-9a46-db0b8ce3d1d1 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:38.993264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-379f39b1-0351-438c-b3c2-dc488752fcc4 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:38.994396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-379f39b1-0351-438c-b3c2-dc488752fcc4 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:39.006251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379f39b1-0351-438c-b3c2-dc488752fcc4 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:39.006744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379f39b1-0351-438c-b3c2-dc488752fcc4 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:39.007192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379f39b1-0351-438c-b3c2-dc488752fcc4 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:39.019848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379f39b1-0351-438c-b3c2-dc488752fcc4 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:39.020470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379f39b1-0351-438c-b3c2-dc488752fcc4 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:39.022499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-379f39b1-0351-438c-b3c2-dc488752fcc4 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:39.269530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-124a252f-0c90-4495-9a46-db0b8ce3d1d1 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:39.279356 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-124a252f-0c90-4495-9a46-db0b8ce3d1d1 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1248 microversion: 2.1 time: 0.321823 Aug 09 17:44:39.292126 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2780/5300] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:38 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1248 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:39.814332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:39.815954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:39.851079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:39.861365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:39.863811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:39.867185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:39.868467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:39.870829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:40.407515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:40.428826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:40.430864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:40.432430 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-22f0bcff-9d15-42c6-b7bd-c102dbedfef9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 0.622767 Aug 09 17:44:40.433010 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2781/5301] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:39 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:40.454732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-922cc8a9-6c7b-485a-887d-88cb104fe5bb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:40.455879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-922cc8a9-6c7b-485a-887d-88cb104fe5bb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:40.458802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-379f39b1-0351-438c-b3c2-dc488752fcc4 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:40.481047 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-379f39b1-0351-438c-b3c2-dc488752fcc4 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1315 microversion: 2.1 time: 1.488974 Aug 09 17:44:40.484760 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2521/5302] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:38 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1315 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:44:40.598062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-922cc8a9-6c7b-485a-887d-88cb104fe5bb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:40.611066 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-922cc8a9-6c7b-485a-887d-88cb104fe5bb tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1248 microversion: 2.1 time: 0.167895 Aug 09 17:44:40.614538 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2782/5303] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:40 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1248 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:41.006707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2a2837ad-5a51-48ac-a814-8533d9e1b05b req-1fd52e4e-18bb-481c-8b17-77dc7cdb3a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a34552-f7cd-4770-b3ef-be9226b0cd78", "name": "network-vif-plugged", "status": "completed", "tag": "0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:44:41.041139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2a2837ad-5a51-48ac-a814-8533d9e1b05b req-1fd52e4e-18bb-481c-8b17-77dc7cdb3a99 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:41.046017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2a2837ad-5a51-48ac-a814-8533d9e1b05b req-1fd52e4e-18bb-481c-8b17-77dc7cdb3a99 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:41.046967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2a2837ad-5a51-48ac-a814-8533d9e1b05b req-1fd52e4e-18bb-481c-8b17-77dc7cdb3a99 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:41.138124 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2a2837ad-5a51-48ac-a814-8533d9e1b05b req-1fd52e4e-18bb-481c-8b17-77dc7cdb3a99 service nova] Creating event network-vif-plugged:0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90 for instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 on n-h2-845781-6 Aug 09 17:44:41.173492 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-2a2837ad-5a51-48ac-a814-8533d9e1b05b req-1fd52e4e-18bb-481c-8b17-77dc7cdb3a99 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171875 Aug 09 17:44:41.174500 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2522/5304] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:44:41.465716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:41.466655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:41.496671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:41.500878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:41.502207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:41.504069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ee6c746b-15c5-46d1-8684-82fbc8e0b4ff tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:41.505448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ee6c746b-15c5-46d1-8684-82fbc8e0b4ff tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:41.508402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:41.509570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:41.514501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:41.527111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee6c746b-15c5-46d1-8684-82fbc8e0b4ff tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:41.527677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee6c746b-15c5-46d1-8684-82fbc8e0b4ff tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:41.528181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee6c746b-15c5-46d1-8684-82fbc8e0b4ff tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:41.529124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee6c746b-15c5-46d1-8684-82fbc8e0b4ff tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:41.531188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee6c746b-15c5-46d1-8684-82fbc8e0b4ff tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:41.538854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee6c746b-15c5-46d1-8684-82fbc8e0b4ff tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:42.158994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ee6c746b-15c5-46d1-8684-82fbc8e0b4ff tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:42.170800 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ee6c746b-15c5-46d1-8684-82fbc8e0b4ff tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1315 microversion: 2.1 time: 0.669007 Aug 09 17:44:42.173446 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2523/5305] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:41 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:44:42.190694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a258a76e-179a-4d3d-aaf6-6175313d194b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:42.191519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a258a76e-179a-4d3d-aaf6-6175313d194b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:42.229903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a258a76e-179a-4d3d-aaf6-6175313d194b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:42.230561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a258a76e-179a-4d3d-aaf6-6175313d194b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:42.232218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a258a76e-179a-4d3d-aaf6-6175313d194b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:42.233379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a258a76e-179a-4d3d-aaf6-6175313d194b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:42.235263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a258a76e-179a-4d3d-aaf6-6175313d194b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:42.239988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a258a76e-179a-4d3d-aaf6-6175313d194b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:42.932678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a258a76e-179a-4d3d-aaf6-6175313d194b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:42.943542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:42.959348 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a258a76e-179a-4d3d-aaf6-6175313d194b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1306 microversion: 2.1 time: 0.784075 Aug 09 17:44:42.964697 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2524/5306] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:42 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1306 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:43.194394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b25915d9-8db1-4cb8-b76f-2b8881f0d91f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:43.195473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b25915d9-8db1-4cb8-b76f-2b8881f0d91f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:43.221320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=7 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:43.223321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b25915d9-8db1-4cb8-b76f-2b8881f0d91f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:43.228443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b25915d9-8db1-4cb8-b76f-2b8881f0d91f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:43.229109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b25915d9-8db1-4cb8-b76f-2b8881f0d91f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:43.230607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b25915d9-8db1-4cb8-b76f-2b8881f0d91f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:43.231180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b25915d9-8db1-4cb8-b76f-2b8881f0d91f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:43.236520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b25915d9-8db1-4cb8-b76f-2b8881f0d91f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:44.020254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b25915d9-8db1-4cb8-b76f-2b8881f0d91f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:44.030276 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b25915d9-8db1-4cb8-b76f-2b8881f0d91f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1315 microversion: 2.1 time: 0.841385 Aug 09 17:44:44.051161 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2525/5307] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:43 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:44.066812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e3423954-68b3-4aca-a23b-5580ea13f42a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:44.072611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e3423954-68b3-4aca-a23b-5580ea13f42a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:44.101034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3423954-68b3-4aca-a23b-5580ea13f42a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:44.101478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3423954-68b3-4aca-a23b-5580ea13f42a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:44.101934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3423954-68b3-4aca-a23b-5580ea13f42a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:44.102682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3423954-68b3-4aca-a23b-5580ea13f42a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:44.103152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3423954-68b3-4aca-a23b-5580ea13f42a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:44.103588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3423954-68b3-4aca-a23b-5580ea13f42a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:44.518251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:44.541195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:44.549739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:44.556468 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a38040b3-43f3-4df8-b054-3e798e5f2659 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 3.098452 Aug 09 17:44:44.557479 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2783/5308] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:41 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 3102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:44.976518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e3423954-68b3-4aca-a23b-5580ea13f42a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:45.000389 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e3423954-68b3-4aca-a23b-5580ea13f42a tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1306 microversion: 2.1 time: 0.947458 Aug 09 17:44:45.001210 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2526/5309] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:44 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1306 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:45.055178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-78efdd62-fd25-4e1d-a31e-de23a7b19792 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:45.055839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-78efdd62-fd25-4e1d-a31e-de23a7b19792 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:45.069170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78efdd62-fd25-4e1d-a31e-de23a7b19792 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:45.070556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78efdd62-fd25-4e1d-a31e-de23a7b19792 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:45.071270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78efdd62-fd25-4e1d-a31e-de23a7b19792 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:45.074359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78efdd62-fd25-4e1d-a31e-de23a7b19792 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:45.075236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78efdd62-fd25-4e1d-a31e-de23a7b19792 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:45.077772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78efdd62-fd25-4e1d-a31e-de23a7b19792 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:45.584749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:45.585385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:45.621580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:45.624573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:45.625223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:45.626109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:45.628286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:45.633876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:45.740685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-78efdd62-fd25-4e1d-a31e-de23a7b19792 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:45.751391 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-78efdd62-fd25-4e1d-a31e-de23a7b19792 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1315 microversion: 2.1 time: 0.704687 Aug 09 17:44:45.787620 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2784/5310] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:45 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:44:46.039285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c0460968-4569-4905-8d7b-a63959b0f3ec tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:46.039957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c0460968-4569-4905-8d7b-a63959b0f3ec tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:46.051131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0460968-4569-4905-8d7b-a63959b0f3ec tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:46.051701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0460968-4569-4905-8d7b-a63959b0f3ec tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:46.054688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0460968-4569-4905-8d7b-a63959b0f3ec tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:46.055740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0460968-4569-4905-8d7b-a63959b0f3ec tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:46.058202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0460968-4569-4905-8d7b-a63959b0f3ec tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:46.059031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0460968-4569-4905-8d7b-a63959b0f3ec tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:46.190453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c0460968-4569-4905-8d7b-a63959b0f3ec tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:46.204613 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c0460968-4569-4905-8d7b-a63959b0f3ec tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1306 microversion: 2.1 time: 0.169937 Aug 09 17:44:46.205495 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2785/5311] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:46 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1306 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:46.588643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:46.633602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:46.636928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:46.639196 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4688bb9b-0027-4191-a010-143d2e2f0324 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 1.061853 Aug 09 17:44:46.668340 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2527/5312] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:45 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:44:46.776488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d0f509c5-7697-4bd4-8520-86797cb9ce7f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:46.777974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d0f509c5-7697-4bd4-8520-86797cb9ce7f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:46.796478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0f509c5-7697-4bd4-8520-86797cb9ce7f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:46.798903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0f509c5-7697-4bd4-8520-86797cb9ce7f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:46.800898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0f509c5-7697-4bd4-8520-86797cb9ce7f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:46.802423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0f509c5-7697-4bd4-8520-86797cb9ce7f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:46.804492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0f509c5-7697-4bd4-8520-86797cb9ce7f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:46.806766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0f509c5-7697-4bd4-8520-86797cb9ce7f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:47.019961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-8a2f52ac-90bb-43c6-950e-bacbd4b0c8e6 req-a209ec57-47e0-4089-bdd2-791b047c95d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa950500-d319-4ae4-bd01-e9629aaa7b60", "name": "network-vif-plugged", "status": "completed", "tag": "139da233-e0be-4e02-ba58-ab30751f3b19"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:44:47.076124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8a2f52ac-90bb-43c6-950e-bacbd4b0c8e6 req-a209ec57-47e0-4089-bdd2-791b047c95d1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:47.084095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8a2f52ac-90bb-43c6-950e-bacbd4b0c8e6 req-a209ec57-47e0-4089-bdd2-791b047c95d1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:47.084998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8a2f52ac-90bb-43c6-950e-bacbd4b0c8e6 req-a209ec57-47e0-4089-bdd2-791b047c95d1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:47.141507 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-8a2f52ac-90bb-43c6-950e-bacbd4b0c8e6 req-a209ec57-47e0-4089-bdd2-791b047c95d1 service nova] Creating event network-vif-plugged:139da233-e0be-4e02-ba58-ab30751f3b19 for instance aa950500-d319-4ae4-bd01-e9629aaa7b60 on n-h1-845781-6 Aug 09 17:44:47.179570 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-8a2f52ac-90bb-43c6-950e-bacbd4b0c8e6 req-a209ec57-47e0-4089-bdd2-791b047c95d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165956 Aug 09 17:44:47.182757 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2528/5313] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:44:47.240397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-49738d78-454c-4017-a2b6-eee5776b2d0e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:47.243292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-49738d78-454c-4017-a2b6-eee5776b2d0e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:47.280368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49738d78-454c-4017-a2b6-eee5776b2d0e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:47.281630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49738d78-454c-4017-a2b6-eee5776b2d0e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:47.285530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49738d78-454c-4017-a2b6-eee5776b2d0e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:47.287570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49738d78-454c-4017-a2b6-eee5776b2d0e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:47.296878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49738d78-454c-4017-a2b6-eee5776b2d0e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:47.299812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-49738d78-454c-4017-a2b6-eee5776b2d0e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:47.752430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-49738d78-454c-4017-a2b6-eee5776b2d0e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:47.808329 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-49738d78-454c-4017-a2b6-eee5776b2d0e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1306 microversion: 2.1 time: 0.555921 Aug 09 17:44:47.809475 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2529/5314] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:47 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1306 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:44:47.847696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:47.864492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:47.901268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:47.907031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d0f509c5-7697-4bd4-8520-86797cb9ce7f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:47.909161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:47.911354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:47.915827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:47.916639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:47.919930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:47.962090 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d0f509c5-7697-4bd4-8520-86797cb9ce7f tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1315 microversion: 2.1 time: 1.189309 Aug 09 17:44:47.972129 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2786/5315] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:46 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1315 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:48.634769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:48.729495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:48.855058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c468b3e-37e0-41c8-ac3c-294fe8c007f8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:48.869317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c468b3e-37e0-41c8-ac3c-294fe8c007f8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:48.899235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c468b3e-37e0-41c8-ac3c-294fe8c007f8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:48.900592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c468b3e-37e0-41c8-ac3c-294fe8c007f8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:48.901658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c468b3e-37e0-41c8-ac3c-294fe8c007f8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:48.903150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c468b3e-37e0-41c8-ac3c-294fe8c007f8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:48.904292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c468b3e-37e0-41c8-ac3c-294fe8c007f8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:48.905360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c468b3e-37e0-41c8-ac3c-294fe8c007f8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:49.080366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:49.098249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:49.108229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:49.108533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c468b3e-37e0-41c8-ac3c-294fe8c007f8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:49.114692 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5e3dcf97-6299-4bb9-98db-f5ed54d06370 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 1.297201 Aug 09 17:44:49.120163 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2530/5316] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:47 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:49.150504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ed24370c-4585-44d9-b30d-9d3cad6aa0ea tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:49.158936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ed24370c-4585-44d9-b30d-9d3cad6aa0ea tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:49.169337 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c468b3e-37e0-41c8-ac3c-294fe8c007f8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1306 microversion: 2.1 time: 0.322358 Aug 09 17:44:49.176465 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2787/5317] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:48 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1306 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:44:49.179493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed24370c-4585-44d9-b30d-9d3cad6aa0ea tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:49.180808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed24370c-4585-44d9-b30d-9d3cad6aa0ea tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:49.183687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed24370c-4585-44d9-b30d-9d3cad6aa0ea tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:49.185915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed24370c-4585-44d9-b30d-9d3cad6aa0ea tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:49.190783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed24370c-4585-44d9-b30d-9d3cad6aa0ea tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:49.191719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ed24370c-4585-44d9-b30d-9d3cad6aa0ea tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:50.165518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:50.173976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:50.221417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:50.222031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:50.222404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:50.235984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:50.236619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:50.237085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:50.614134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:50.941217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ed24370c-4585-44d9-b30d-9d3cad6aa0ea tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:50.960168 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ed24370c-4585-44d9-b30d-9d3cad6aa0ea tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1315 microversion: 2.1 time: 1.837846 Aug 09 17:44:50.961367 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2531/5318] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:49 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1315 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:50.968393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-005da650-d2fb-4885-8af8-e5e645ed0413 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:50.969477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-005da650-d2fb-4885-8af8-e5e645ed0413 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:50.979122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005da650-d2fb-4885-8af8-e5e645ed0413 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:50.980097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005da650-d2fb-4885-8af8-e5e645ed0413 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:50.980909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005da650-d2fb-4885-8af8-e5e645ed0413 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:50.982305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005da650-d2fb-4885-8af8-e5e645ed0413 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:50.983142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005da650-d2fb-4885-8af8-e5e645ed0413 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:50.985374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-005da650-d2fb-4885-8af8-e5e645ed0413 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:51.050104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:51.077394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:51.079494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:51.081132 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5dccf1f6-bc37-4d3a-9bb3-4f5e45092898 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 0.921456 Aug 09 17:44:51.083306 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2788/5319] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:50 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:44:51.651893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-005da650-d2fb-4885-8af8-e5e645ed0413 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:51.704993 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-005da650-d2fb-4885-8af8-e5e645ed0413 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1373 microversion: 2.1 time: 0.741781 Aug 09 17:44:51.716281 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2532/5320] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:50 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1373 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:51.982103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b8f8ca0-7868-4a34-83b1-571cbd9af4af tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:51.982749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1b8f8ca0-7868-4a34-83b1-571cbd9af4af tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:52.002007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8f8ca0-7868-4a34-83b1-571cbd9af4af tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:52.002984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8f8ca0-7868-4a34-83b1-571cbd9af4af tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:52.006719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8f8ca0-7868-4a34-83b1-571cbd9af4af tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:52.014709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8f8ca0-7868-4a34-83b1-571cbd9af4af tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:52.016236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8f8ca0-7868-4a34-83b1-571cbd9af4af tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:52.017230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8f8ca0-7868-4a34-83b1-571cbd9af4af tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:52.114976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:52.117050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:52.156255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:52.157482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:52.158374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:52.163121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:52.173998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:52.179669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:52.951933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:53.011909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:53.013871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:53.015243 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-081b7c7a-39ea-40c7-8a0e-eba851b58f05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 0.908175 Aug 09 17:44:53.028616 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2533/5321] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:52 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:53.038465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5445798e-42a1-4328-a796-5a77b821355b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:53.039430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5445798e-42a1-4328-a796-5a77b821355b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:53.049651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5445798e-42a1-4328-a796-5a77b821355b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:53.050570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5445798e-42a1-4328-a796-5a77b821355b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:53.051213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5445798e-42a1-4328-a796-5a77b821355b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:53.052221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5445798e-42a1-4328-a796-5a77b821355b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:53.059426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5445798e-42a1-4328-a796-5a77b821355b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:53.060298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5445798e-42a1-4328-a796-5a77b821355b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:53.337726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1b8f8ca0-7868-4a34-83b1-571cbd9af4af tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:53.351094 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b8f8ca0-7868-4a34-83b1-571cbd9af4af tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1503 microversion: 2.1 time: 1.370411 Aug 09 17:44:53.354108 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2789/5322] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:51 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1503 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:53.384612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3282016f-d297-4338-b4c8-2c2c846649d7 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:53.385423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3282016f-d297-4338-b4c8-2c2c846649d7 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:53.401184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3282016f-d297-4338-b4c8-2c2c846649d7 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:53.402411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3282016f-d297-4338-b4c8-2c2c846649d7 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:53.403118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3282016f-d297-4338-b4c8-2c2c846649d7 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:53.403954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3282016f-d297-4338-b4c8-2c2c846649d7 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:53.425543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3282016f-d297-4338-b4c8-2c2c846649d7 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:53.426065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3282016f-d297-4338-b4c8-2c2c846649d7 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:53.670152 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3282016f-d297-4338-b4c8-2c2c846649d7 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "DELETE /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.290882 Aug 09 17:44:53.670808 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2790/5323] 10.222.0.93 () {58 vars in 1296 bytes} [Tue Aug 9 17:44:53 2022] DELETE /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60/os-server-password => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:44:53.746144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-adc1d26b-dad2-4c1b-ab2e-23bd53c06add tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:53.746963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-adc1d26b-dad2-4c1b-ab2e-23bd53c06add tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:53.772969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adc1d26b-dad2-4c1b-ab2e-23bd53c06add tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:53.780782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adc1d26b-dad2-4c1b-ab2e-23bd53c06add tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:53.784913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adc1d26b-dad2-4c1b-ab2e-23bd53c06add tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:53.786053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adc1d26b-dad2-4c1b-ab2e-23bd53c06add tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:53.789546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adc1d26b-dad2-4c1b-ab2e-23bd53c06add tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:53.790262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adc1d26b-dad2-4c1b-ab2e-23bd53c06add tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:53.903328 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-adc1d26b-dad2-4c1b-ab2e-23bd53c06add tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.161566 Aug 09 17:44:53.906193 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2791/5324] 10.222.0.93 () {58 vars in 1293 bytes} [Tue Aug 9 17:44:53 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60/os-server-password => generated 16 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:44:53.928959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-751ff46d-d6de-4134-9704-4f5b5d665dec tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:53.929920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-751ff46d-d6de-4134-9704-4f5b5d665dec tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:53.940579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-751ff46d-d6de-4134-9704-4f5b5d665dec tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:53.941774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-751ff46d-d6de-4134-9704-4f5b5d665dec tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:53.943802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-751ff46d-d6de-4134-9704-4f5b5d665dec tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:53.944832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-751ff46d-d6de-4134-9704-4f5b5d665dec tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:53.945654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-751ff46d-d6de-4134-9704-4f5b5d665dec tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:53.946786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-751ff46d-d6de-4134-9704-4f5b5d665dec tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:53.969891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5445798e-42a1-4328-a796-5a77b821355b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:53.989041 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5445798e-42a1-4328-a796-5a77b821355b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1373 microversion: 2.1 time: 0.957430 Aug 09 17:44:53.990897 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2534/5325] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:53 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1373 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:54.003885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-751ff46d-d6de-4134-9704-4f5b5d665dec tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:44:54.050653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:54.056295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:54.090165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:54.091221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:54.091916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:54.092898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:54.095055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:54.097933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:54.218630 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-751ff46d-d6de-4134-9704-4f5b5d665dec tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "DELETE /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 204 len: 0 microversion: 2.1 time: 0.302634 Aug 09 17:44:54.223944 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2792/5326] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:44:53 2022] DELETE /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:44:54.249989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-97dd406e-c267-401c-8530-b5a5ed83f3d3 req-490fa34b-ba67-45f2-b55f-7163c0cf735d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47118aba-2b8a-4610-a011-b1272efef756", "tag": "16418928-bb1f-40fa-9024-4ae50ac9b943"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:44:54.285308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97dd406e-c267-401c-8530-b5a5ed83f3d3 req-490fa34b-ba67-45f2-b55f-7163c0cf735d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:54.285308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97dd406e-c267-401c-8530-b5a5ed83f3d3 req-490fa34b-ba67-45f2-b55f-7163c0cf735d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:54.285308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97dd406e-c267-401c-8530-b5a5ed83f3d3 req-490fa34b-ba67-45f2-b55f-7163c0cf735d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:54.336369 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-97dd406e-c267-401c-8530-b5a5ed83f3d3 req-490fa34b-ba67-45f2-b55f-7163c0cf735d service nova] Creating event network-changed:16418928-bb1f-40fa-9024-4ae50ac9b943 for instance 47118aba-2b8a-4610-a011-b1272efef756 on n-h2-845781-6 Aug 09 17:44:54.353895 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-97dd406e-c267-401c-8530-b5a5ed83f3d3 req-490fa34b-ba67-45f2-b55f-7163c0cf735d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124707 Aug 09 17:44:54.357341 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2793/5327] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:44:54.378734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-305b389b-8bbe-4314-9809-dc356b6f14d1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:54.381689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-305b389b-8bbe-4314-9809-dc356b6f14d1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:54.389644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-305b389b-8bbe-4314-9809-dc356b6f14d1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:54.390388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-305b389b-8bbe-4314-9809-dc356b6f14d1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:54.391063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-305b389b-8bbe-4314-9809-dc356b6f14d1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:54.392108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-305b389b-8bbe-4314-9809-dc356b6f14d1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:54.397270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-305b389b-8bbe-4314-9809-dc356b6f14d1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:54.399480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-305b389b-8bbe-4314-9809-dc356b6f14d1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:54.732660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:54.748460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:54.763180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:54.772451 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c254c309-1b2e-42dd-91fa-7514a3a522ac tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 0.725249 Aug 09 17:44:54.778815 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2535/5328] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:54 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:55.015230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0bca9146-2300-4441-a2d0-036c709ddcd9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:55.015821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0bca9146-2300-4441-a2d0-036c709ddcd9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:55.036802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bca9146-2300-4441-a2d0-036c709ddcd9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:55.041491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bca9146-2300-4441-a2d0-036c709ddcd9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:55.043332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bca9146-2300-4441-a2d0-036c709ddcd9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:55.048090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bca9146-2300-4441-a2d0-036c709ddcd9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:55.052317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bca9146-2300-4441-a2d0-036c709ddcd9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:55.057176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bca9146-2300-4441-a2d0-036c709ddcd9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:55.713369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-305b389b-8bbe-4314-9809-dc356b6f14d1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:55.723033 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-305b389b-8bbe-4314-9809-dc356b6f14d1 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1509 microversion: 2.1 time: 1.362862 Aug 09 17:44:55.734398 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2794/5329] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:54 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1509 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:55.809881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:55.810608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:55.847536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:55.849091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:55.851603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:55.852973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:55.853867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:55.854665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:56.053321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:44:56.934931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0bca9146-2300-4441-a2d0-036c709ddcd9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:56.999539 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0bca9146-2300-4441-a2d0-036c709ddcd9 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1373 microversion: 2.1 time: 1.988670 Aug 09 17:44:57.012339 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2536/5330] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:55 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1373 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:57.054295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-24a3e1c3-79b2-40e9-b725-28f9c4834805 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:57.055974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-24a3e1c3-79b2-40e9-b725-28f9c4834805 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:57.103021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24a3e1c3-79b2-40e9-b725-28f9c4834805 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:57.107153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24a3e1c3-79b2-40e9-b725-28f9c4834805 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:57.117143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24a3e1c3-79b2-40e9-b725-28f9c4834805 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:57.117993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24a3e1c3-79b2-40e9-b725-28f9c4834805 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:57.118927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24a3e1c3-79b2-40e9-b725-28f9c4834805 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:57.132159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-24a3e1c3-79b2-40e9-b725-28f9c4834805 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:57.809212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-24a3e1c3-79b2-40e9-b725-28f9c4834805 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:57.829944 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-24a3e1c3-79b2-40e9-b725-28f9c4834805 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1467 microversion: 2.1 time: 0.815493 Aug 09 17:44:57.857104 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2537/5331] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:57 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1467 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:58.029643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-af626ba3-07fe-45c8-beb8-1bd4365d64b6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:58.031455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-af626ba3-07fe-45c8-beb8-1bd4365d64b6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:58.052977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af626ba3-07fe-45c8-beb8-1bd4365d64b6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:58.054299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af626ba3-07fe-45c8-beb8-1bd4365d64b6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:58.056904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af626ba3-07fe-45c8-beb8-1bd4365d64b6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:58.060709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af626ba3-07fe-45c8-beb8-1bd4365d64b6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:58.063249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af626ba3-07fe-45c8-beb8-1bd4365d64b6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:58.064164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-af626ba3-07fe-45c8-beb8-1bd4365d64b6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:58.889261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:58.921490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:58.924383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:58.964003 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6f84ecc2-e238-4928-891b-3f2642b17bc0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 3.158849 Aug 09 17:44:58.978430 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2795/5332] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:55 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 3174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:44:59.031933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-dac28834-0222-44e7-9e84-84d838fb80c6 req-7a19719a-d932-4aa0-92c6-bed5566b9cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa950500-d319-4ae4-bd01-e9629aaa7b60", "name": "network-vif-deleted", "tag": "139da233-e0be-4e02-ba58-ab30751f3b19"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:44:59.149406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dac28834-0222-44e7-9e84-84d838fb80c6 req-7a19719a-d932-4aa0-92c6-bed5566b9cff service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:59.150648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dac28834-0222-44e7-9e84-84d838fb80c6 req-7a19719a-d932-4aa0-92c6-bed5566b9cff service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:59.152502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dac28834-0222-44e7-9e84-84d838fb80c6 req-7a19719a-d932-4aa0-92c6-bed5566b9cff service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:59.213080 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-dac28834-0222-44e7-9e84-84d838fb80c6 req-7a19719a-d932-4aa0-92c6-bed5566b9cff service nova] Creating event network-vif-deleted:139da233-e0be-4e02-ba58-ab30751f3b19 for instance aa950500-d319-4ae4-bd01-e9629aaa7b60 on n-h1-845781-6 Aug 09 17:44:59.223983 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-dac28834-0222-44e7-9e84-84d838fb80c6 req-7a19719a-d932-4aa0-92c6-bed5566b9cff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222857 Aug 09 17:44:59.225854 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2796/5333] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:44:59.233984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:44:59.235415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:44:59.247421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:59.249199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:59.249909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:59.250901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:59.251787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:59.252555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:59.345921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:44:59.349845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:44:59.352356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:44:59.352846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lazy-loading 'fault' on Instance uuid aa950500-d319-4ae4-bd01-e9629aaa7b60 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:44:59.455013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3a9cbdb61d44c1a10a8a1d8447472c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b15fadc774d91aebf553ea3234e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:59.464745 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-254c03d3-7259-487e-b66f-875dda152392 tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 200 len: 1305 microversion: 2.1 time: 0.236664 Aug 09 17:44:59.470176 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2797/5334] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:59 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 1305 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:44:59.574809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-af626ba3-07fe-45c8-beb8-1bd4365d64b6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:44:59.626705 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-af626ba3-07fe-45c8-beb8-1bd4365d64b6 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1373 microversion: 2.1 time: 1.603768 Aug 09 17:44:59.636103 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2538/5335] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:44:58 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1373 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:45:00.025078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:00.027172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:00.060607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:00.061413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:00.062196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:00.064250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:00.066377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:00.067366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:00.516287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:00.517252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] [instance: aa950500-d319-4ae4-bd01-e9629aaa7b60] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:00.554065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:00.561706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:00.566145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:00.574618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:00.578550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:00.580144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:00.677390 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] HTTP exception thrown: Instance aa950500-d319-4ae4-bd01-e9629aaa7b60 could not be found. Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Request method failure captured: Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 HTTP/1.1 Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pzu7trP7VNTAOUG_nA-ExcdhF_bPDA46kLHpLZvFgXtg3maKwRhazMSU60mp4sCmEy5wwI3kQtJyFsA6RpoR4OFzQr4GCQXFBzIiBgMENjXT2HN-QOIUjMGS8f6EdgL4dVJxxRdBoSMzMc-L56vfac-GVQ_EsJ6Rt8Jxit20QafvKU Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: f20b15fadc774d91aebf553ea3234e39 Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-ServerPasswordTestJSON-238400462 Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f20b15fadc774d91aebf553ea3234e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f20b15fadc774d91aebf553ea3234e39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f20b15fadc774d91aebf553ea3234e39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f20b15fadc774d91aebf553ea3234e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-ServerPasswordTestJSON-238400462 Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: f20b15fadc774d91aebf553ea3234e39 Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-ServerPasswordTestJSON-238400462 Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-ServerPasswordTestJSON-238400462-project Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: aa3a9cbdb61d44c1a10a8a1d8447472c Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-ServerPasswordTestJSON-238400462-project Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance aa950500-d319-4ae4-bd01-e9629aaa7b60 could not be found. Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'aa950500-d319-4ae4-bd01-e9629aaa7b60'} Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa950500-d319-4ae4-bd01-e9629aaa7b60 could not be found. Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa950500-d319-4ae4-bd01-e9629aaa7b60 could not be found. Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:45:00.687980 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:45:00.692883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:45:00.692883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:45:00.692883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:45:00.692883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:45:00.692883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:45:00.692883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa950500-d319-4ae4-bd01-e9629aaa7b60 could not be found. Aug 09 17:45:00.692883 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:45:00.695470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] Returning 404 to user: Instance aa950500-d319-4ae4-bd01-e9629aaa7b60 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:45:00.701254 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fe8add47-19f7-4c4f-87de-0f02a46ac30a tempest-ServerPasswordTestJSON-238400462 tempest-ServerPasswordTestJSON-238400462-project] 10.222.0.93 "GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60" status: 404 len: 111 microversion: 2.1 time: 0.189467 Aug 09 17:45:00.710292 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2539/5336] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:00 2022] GET /compute/v2.1/servers/aa950500-d319-4ae4-bd01-e9629aaa7b60 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:45:00.732302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-75533dc9-40ff-46da-b14b-b0750a03e461 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:00.744566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-75533dc9-40ff-46da-b14b-b0750a03e461 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:00.784593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75533dc9-40ff-46da-b14b-b0750a03e461 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:00.788047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75533dc9-40ff-46da-b14b-b0750a03e461 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:00.788636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75533dc9-40ff-46da-b14b-b0750a03e461 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:00.789445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75533dc9-40ff-46da-b14b-b0750a03e461 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:00.796737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75533dc9-40ff-46da-b14b-b0750a03e461 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:00.797208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75533dc9-40ff-46da-b14b-b0750a03e461 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:01.503953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:01.538457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:01.547791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:01.551584 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e7e14be9-9064-4caa-bcd5-0a34ece3097c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 1.550250 Aug 09 17:45:01.558391 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2798/5337] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:44:59 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:02.583113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:02.585025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:02.608611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:02.609120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:02.612736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:02.613754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:02.617480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:02.617839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:03.277598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-75533dc9-40ff-46da-b14b-b0750a03e461 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:03.300370 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-75533dc9-40ff-46da-b14b-b0750a03e461 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1373 microversion: 2.1 time: 2.587635 Aug 09 17:45:03.302548 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2540/5338] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:00 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1373 bytes in 2591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:45:03.382581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:03.404653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:03.410337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:03.421652 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7cc35c0d-332b-48d5-b202-007bb29f5f5e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 0.842927 Aug 09 17:45:03.436291 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2799/5339] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:02 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:04.324864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a37f23b3-e92b-4b27-99fa-a7e47aa11177 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:04.325706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a37f23b3-e92b-4b27-99fa-a7e47aa11177 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:04.342281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a37f23b3-e92b-4b27-99fa-a7e47aa11177 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:04.342784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a37f23b3-e92b-4b27-99fa-a7e47aa11177 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:04.343233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a37f23b3-e92b-4b27-99fa-a7e47aa11177 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:04.344147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a37f23b3-e92b-4b27-99fa-a7e47aa11177 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:04.344627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a37f23b3-e92b-4b27-99fa-a7e47aa11177 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:04.345074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a37f23b3-e92b-4b27-99fa-a7e47aa11177 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:04.457975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:04.480468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:04.528781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:04.529689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:04.530424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:04.531717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:04.532543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:04.533325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:05.035653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a37f23b3-e92b-4b27-99fa-a7e47aa11177 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:05.051560 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a37f23b3-e92b-4b27-99fa-a7e47aa11177 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1373 microversion: 2.1 time: 0.727669 Aug 09 17:45:05.051560 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2541/5340] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:04 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1373 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:45:05.076959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:05.091249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:05.099454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:05.103053 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a53fade3-b4ca-4acc-98eb-2deaa6ebf808 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 0.653654 Aug 09 17:45:05.113785 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2800/5341] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:04 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:06.071306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7e3b3f4-6133-41d8-99b9-0570e01edeac tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:06.072069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f7e3b3f4-6133-41d8-99b9-0570e01edeac tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:06.089216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7e3b3f4-6133-41d8-99b9-0570e01edeac tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:06.089720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7e3b3f4-6133-41d8-99b9-0570e01edeac tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:06.092294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7e3b3f4-6133-41d8-99b9-0570e01edeac tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:06.100870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7e3b3f4-6133-41d8-99b9-0570e01edeac tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:06.102026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7e3b3f4-6133-41d8-99b9-0570e01edeac tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:06.102721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7e3b3f4-6133-41d8-99b9-0570e01edeac tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:06.135269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:06.135269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:06.167911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:06.174978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:06.176225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:06.178453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:06.180196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:06.181438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:06.500795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:06.518835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:06.525655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:06.528068 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-81da77d2-65d8-4465-98ad-8c1b556faba1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 0.401319 Aug 09 17:45:06.534319 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2801/5342] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:06 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:45:06.852494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f7e3b3f4-6133-41d8-99b9-0570e01edeac tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:06.884340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:06.906965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6850d553-eb6c-4eac-9ee5-8c9b928ebdb8 req-e76fac6b-e20b-4550-9c11-a49b0f005a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47118aba-2b8a-4610-a011-b1272efef756", "name": "network-vif-plugged", "status": "completed", "tag": "16418928-bb1f-40fa-9024-4ae50ac9b943"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:06.916351 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f7e3b3f4-6133-41d8-99b9-0570e01edeac tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1373 microversion: 2.1 time: 0.849705 Aug 09 17:45:06.916969 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2542/5343] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:06 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1373 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:45:06.957305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6850d553-eb6c-4eac-9ee5-8c9b928ebdb8 req-e76fac6b-e20b-4550-9c11-a49b0f005a71 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:06.957803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6850d553-eb6c-4eac-9ee5-8c9b928ebdb8 req-e76fac6b-e20b-4550-9c11-a49b0f005a71 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:06.968107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6850d553-eb6c-4eac-9ee5-8c9b928ebdb8 req-e76fac6b-e20b-4550-9c11-a49b0f005a71 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:07.017541 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6850d553-eb6c-4eac-9ee5-8c9b928ebdb8 req-e76fac6b-e20b-4550-9c11-a49b0f005a71 service nova] Creating event network-vif-plugged:16418928-bb1f-40fa-9024-4ae50ac9b943 for instance 47118aba-2b8a-4610-a011-b1272efef756 on n-h2-845781-6 Aug 09 17:45:07.043922 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6850d553-eb6c-4eac-9ee5-8c9b928ebdb8 req-e76fac6b-e20b-4550-9c11-a49b0f005a71 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152560 Aug 09 17:45:07.049776 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2802/5344] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:45:07.561080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:07.562721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:07.577284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:07.578512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:07.581306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:07.584379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:07.589848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:07.590684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:07.997562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51997602-e39b-45dd-ba64-98e61f2875af tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:08.005534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-51997602-e39b-45dd-ba64-98e61f2875af tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:08.043513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51997602-e39b-45dd-ba64-98e61f2875af tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:08.046473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51997602-e39b-45dd-ba64-98e61f2875af tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:08.048507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51997602-e39b-45dd-ba64-98e61f2875af tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:08.050228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51997602-e39b-45dd-ba64-98e61f2875af tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:08.051377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51997602-e39b-45dd-ba64-98e61f2875af tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:08.052546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51997602-e39b-45dd-ba64-98e61f2875af tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:08.271248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:08.292423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:08.308777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:08.310861 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c106f2bc-9bcb-412a-96b5-89582594b7b1 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1739 microversion: 2.20 time: 0.755342 Aug 09 17:45:08.315433 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2543/5345] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:07 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1739 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:08.691455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-51997602-e39b-45dd-ba64-98e61f2875af tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:08.703243 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51997602-e39b-45dd-ba64-98e61f2875af tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1373 microversion: 2.1 time: 0.743619 Aug 09 17:45:08.715020 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2803/5346] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:07 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1373 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:45:09.350626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:09.361519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:09.417591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:09.428383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:09.429874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:09.432333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:09.433949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:09.436287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:09.743016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f51f8d7c-355e-4918-9983-aa82a8554b07 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:09.743929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f51f8d7c-355e-4918-9983-aa82a8554b07 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:09.767435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:09.780553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51f8d7c-355e-4918-9983-aa82a8554b07 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:09.788192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51f8d7c-355e-4918-9983-aa82a8554b07 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:09.789189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51f8d7c-355e-4918-9983-aa82a8554b07 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:09.790272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51f8d7c-355e-4918-9983-aa82a8554b07 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:09.791299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51f8d7c-355e-4918-9983-aa82a8554b07 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:09.792052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51f8d7c-355e-4918-9983-aa82a8554b07 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:10.829627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:10.843391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:10.845158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:10.846430 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d74be6b1-c96e-496b-ac7f-e3eb6f31dde3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1721 microversion: 2.20 time: 1.507855 Aug 09 17:45:10.847547 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2544/5347] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:09 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1721 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:10.861657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f51f8d7c-355e-4918-9983-aa82a8554b07 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:10.886352 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f51f8d7c-355e-4918-9983-aa82a8554b07 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1545 microversion: 2.1 time: 1.147354 Aug 09 17:45:10.887293 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2804/5348] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:09 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1545 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:45:10.940688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f667a8b8-699d-4c01-820c-158640456279 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:10.942772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f667a8b8-699d-4c01-820c-158640456279 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:10.958077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f667a8b8-699d-4c01-820c-158640456279 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:10.960187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f667a8b8-699d-4c01-820c-158640456279 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:10.961942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f667a8b8-699d-4c01-820c-158640456279 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:10.966667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f667a8b8-699d-4c01-820c-158640456279 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:10.968241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f667a8b8-699d-4c01-820c-158640456279 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:10.971200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f667a8b8-699d-4c01-820c-158640456279 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:11.405884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f667a8b8-699d-4c01-820c-158640456279 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:11.423230 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f667a8b8-699d-4c01-820c-158640456279 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1545 microversion: 2.1 time: 0.496585 Aug 09 17:45:11.424520 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2545/5349] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:10 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1545 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:45:11.875853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:11.876486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:11.893520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:11.894491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:11.895105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:11.896227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:11.897087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:11.897682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:12.207104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-6360ce1d-bb2c-4e42-91e9-572ff4d2354d req-591e8e45-874f-4467-b3e5-a30689c82679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a34552-f7cd-4770-b3ef-be9226b0cd78", "name": "network-vif-unplugged", "status": "completed", "tag": "0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:12.227070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6360ce1d-bb2c-4e42-91e9-572ff4d2354d req-591e8e45-874f-4467-b3e5-a30689c82679 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:12.227557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6360ce1d-bb2c-4e42-91e9-572ff4d2354d req-591e8e45-874f-4467-b3e5-a30689c82679 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:12.230495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6360ce1d-bb2c-4e42-91e9-572ff4d2354d req-591e8e45-874f-4467-b3e5-a30689c82679 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:12.267134 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-6360ce1d-bb2c-4e42-91e9-572ff4d2354d req-591e8e45-874f-4467-b3e5-a30689c82679 service nova] Creating event network-vif-unplugged:0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90 for instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 on n-h2-845781-6 Aug 09 17:45:12.286352 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-6360ce1d-bb2c-4e42-91e9-572ff4d2354d req-591e8e45-874f-4467-b3e5-a30689c82679 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083572 Aug 09 17:45:12.287906 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2546/5350] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:45:13.555788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:13.574840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:13.581572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:13.583128 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-12446c6d-a2cb-499e-becb-a2d987f77bbc tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1721 microversion: 2.20 time: 1.712372 Aug 09 17:45:13.596781 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2805/5351] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:11 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1721 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:45:14.642883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:14.649680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:14.685607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=44 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:14.690276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:14.709999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:14.712310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:14.714230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:14.718488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:14.720050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:15.407042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:15.419295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:15.423813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:15.425431 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-40b046fa-e79e-40cd-bce3-388afcc50c8d tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1721 microversion: 2.20 time: 0.816678 Aug 09 17:45:15.426218 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2547/5352] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:14 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1721 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:16.459904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:16.468504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:16.487494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:16.500906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:16.502406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:16.504635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:16.505890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:16.506964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:17.256689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:17.303982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:17.307977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:17.310207 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99c1a0fd-dfb9-441d-8edc-bf1b69f9be05 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1721 microversion: 2.20 time: 0.859562 Aug 09 17:45:17.325385 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2806/5353] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:16 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1721 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:18.362290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:18.364323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:18.393524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:18.397164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:18.400570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:18.407681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:18.421022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:18.424427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:18.773604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b7c4b0c6-61a5-4484-952c-e89db50e6a37 req-34dbc178-1047-45cb-a501-ecd663ccf471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47118aba-2b8a-4610-a011-b1272efef756", "tag": "16418928-bb1f-40fa-9024-4ae50ac9b943"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:18.830752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b7c4b0c6-61a5-4484-952c-e89db50e6a37 req-34dbc178-1047-45cb-a501-ecd663ccf471 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:18.831774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b7c4b0c6-61a5-4484-952c-e89db50e6a37 req-34dbc178-1047-45cb-a501-ecd663ccf471 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:18.832918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b7c4b0c6-61a5-4484-952c-e89db50e6a37 req-34dbc178-1047-45cb-a501-ecd663ccf471 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:18.895448 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b7c4b0c6-61a5-4484-952c-e89db50e6a37 req-34dbc178-1047-45cb-a501-ecd663ccf471 service nova] Creating event network-changed:16418928-bb1f-40fa-9024-4ae50ac9b943 for instance 47118aba-2b8a-4610-a011-b1272efef756 on n-h2-845781-6 Aug 09 17:45:18.914059 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b7c4b0c6-61a5-4484-952c-e89db50e6a37 req-34dbc178-1047-45cb-a501-ecd663ccf471 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159696 Aug 09 17:45:18.915808 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2807/5354] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:45:19.087371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:19.101153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:19.102800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:19.114198 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1fe2e468-8952-4521-b08c-2bfa1b9ec283 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1664 microversion: 2.20 time: 0.750661 Aug 09 17:45:19.114881 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2548/5355] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:18 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1664 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:19.159985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9ac61aba-6b3f-41fe-be56-1ff114787330 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaac49d1-5b88-43d9-87b6-2bfc9a68db71"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:19.162978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9ac61aba-6b3f-41fe-be56-1ff114787330 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:19.177836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ac61aba-6b3f-41fe-be56-1ff114787330 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:19.188601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ac61aba-6b3f-41fe-be56-1ff114787330 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:19.188601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ac61aba-6b3f-41fe-be56-1ff114787330 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:19.200544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ac61aba-6b3f-41fe-be56-1ff114787330 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:19.205886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ac61aba-6b3f-41fe-be56-1ff114787330 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:19.212375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ac61aba-6b3f-41fe-be56-1ff114787330 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:20.024473 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9ac61aba-6b3f-41fe-be56-1ff114787330 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "POST /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.870143 Aug 09 17:45:20.031018 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2808/5356] 10.222.0.93 () {62 vars in 1364 bytes} [Tue Aug 9 17:45:19 2022] POST /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/os-volume_attachments => generated 188 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:45:20.337017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-21c4591a-10cc-42f8-a073-6c2935726f9b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:20.338318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-21c4591a-10cc-42f8-a073-6c2935726f9b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:20.369514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21c4591a-10cc-42f8-a073-6c2935726f9b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:20.371264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21c4591a-10cc-42f8-a073-6c2935726f9b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:20.374377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21c4591a-10cc-42f8-a073-6c2935726f9b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:20.379452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21c4591a-10cc-42f8-a073-6c2935726f9b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:20.383767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21c4591a-10cc-42f8-a073-6c2935726f9b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:20.385076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-21c4591a-10cc-42f8-a073-6c2935726f9b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:20.914373 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-21c4591a-10cc-42f8-a073-6c2935726f9b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "DELETE /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/os-volume_attachments/aaac49d1-5b88-43d9-87b6-2bfc9a68db71" status: 202 len: 0 microversion: 2.20 time: 0.583382 Aug 09 17:45:20.915833 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2549/5357] 10.222.0.93 () {60 vars in 1457 bytes} [Tue Aug 9 17:45:20 2022] DELETE /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/os-volume_attachments/aaac49d1-5b88-43d9-87b6-2bfc9a68db71 => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:45:21.063279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e417c4e-0294-467e-b226-911834c05ae9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:21.064386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e417c4e-0294-467e-b226-911834c05ae9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:21.093079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e417c4e-0294-467e-b226-911834c05ae9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:21.093874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e417c4e-0294-467e-b226-911834c05ae9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:21.097214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e417c4e-0294-467e-b226-911834c05ae9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:21.103386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e417c4e-0294-467e-b226-911834c05ae9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:21.107125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e417c4e-0294-467e-b226-911834c05ae9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:21.107597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e417c4e-0294-467e-b226-911834c05ae9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:21.241189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e417c4e-0294-467e-b226-911834c05ae9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119431) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 09 17:45:21.377052 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e417c4e-0294-467e-b226-911834c05ae9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "POST /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/action" status: 202 len: 0 microversion: 2.20 time: 0.321445 Aug 09 17:45:21.378178 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2809/5358] 10.222.0.93 () {62 vars in 1319 bytes} [Tue Aug 9 17:45:21 2022] POST /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:45:21.394188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:21.395419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:21.439177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:21.441219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:21.444636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:21.445833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:21.448379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:21.449345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:22.231068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:22.249809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:22.251795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:22.253146 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-acfe47a6-f86c-4d4a-8888-6c36ec57e5ec tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1672 microversion: 2.20 time: 0.868418 Aug 09 17:45:22.267313 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2550/5359] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:21 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1672 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:23.308734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:23.309803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:23.355390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:23.357833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:23.360633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:23.364328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:23.364796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:23.365336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:23.379884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:23.856448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:23.869395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:23.871523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:23.873057 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b885400-d4a7-4711-a8bd-ef7d3ceceb1a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1672 microversion: 2.20 time: 0.574304 Aug 09 17:45:23.887672 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2810/5360] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:23 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1672 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:24.922788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:24.924523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:24.944922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:24.945613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:24.946082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:24.947001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:24.947729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:24.948277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:25.494331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:25.508626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:25.510500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:25.511885 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-19009cee-c558-4ad2-8761-862fa2a567ce tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1672 microversion: 2.20 time: 0.599615 Aug 09 17:45:25.512499 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2551/5361] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:24 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1672 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:26.561243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:26.562538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:26.577701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:26.578480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:26.579307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:26.580437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:26.582247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:26.584654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:27.105545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:27.124580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:27.137398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:27.144855 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-adef687a-3ad0-4f84-ba5b-8b3ba3002088 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.598910 Aug 09 17:45:27.145850 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2811/5362] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:26 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:28.171816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:28.173145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:28.179941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:28.180917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:28.181883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:28.182830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:28.183496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:28.184197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:28.863139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-67f3bc02-70ea-4f49-87f5-f1c9e4a35913 req-68bab503-9bc3-4093-b46c-357d0698d9ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a34552-f7cd-4770-b3ef-be9226b0cd78", "tag": "0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:28.874508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-67f3bc02-70ea-4f49-87f5-f1c9e4a35913 req-68bab503-9bc3-4093-b46c-357d0698d9ac service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:28.875406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-67f3bc02-70ea-4f49-87f5-f1c9e4a35913 req-68bab503-9bc3-4093-b46c-357d0698d9ac service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:28.876105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-67f3bc02-70ea-4f49-87f5-f1c9e4a35913 req-68bab503-9bc3-4093-b46c-357d0698d9ac service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:28.897144 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-67f3bc02-70ea-4f49-87f5-f1c9e4a35913 req-68bab503-9bc3-4093-b46c-357d0698d9ac service nova] Creating event network-changed:0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90 for instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 on n-h1-845781-6 Aug 09 17:45:28.935908 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-67f3bc02-70ea-4f49-87f5-f1c9e4a35913 req-68bab503-9bc3-4093-b46c-357d0698d9ac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076584 Aug 09 17:45:28.937818 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2812/5363] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:45:29.539110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:29.555674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:29.557376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:29.558782 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f036bbff-b402-46fc-b6b5-26d0dfd193bf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 1.392278 Aug 09 17:45:29.567749 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2552/5364] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:28 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:30.612231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:30.612959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:30.640582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:30.641382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:30.642023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:30.643224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:30.656822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:30.657985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:31.177107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:31.200894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:31.207859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:31.215586 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f7838598-2ce7-42c3-9c16-7d5d2508fffe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.615892 Aug 09 17:45:31.217889 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2813/5365] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:30 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:32.252621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:32.254436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:32.267304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:32.268142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:32.269323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:32.270442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:32.271178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:32.272455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:33.180682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:33.198722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:33.209566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:33.213443 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-edde4d87-5ff5-4ce9-bcae-b24a6f0450a0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.972759 Aug 09 17:45:33.232889 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2553/5366] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:32 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:34.259447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:34.260735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:34.282953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:34.283502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:34.284012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:34.284769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:34.285236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:34.285678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:34.790255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:34.809548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:34.814543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:34.815854 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e2ce91c5-75fd-4f2b-b2ee-3733230b8311 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.561174 Aug 09 17:45:34.820366 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2814/5367] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:34 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:35.848225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:35.849065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:35.859180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:35.865953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:35.866412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:35.867404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:35.868123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:35.876430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:36.602210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-54cafb92-c1c0-4ea1-a759-8dde6135955e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:36.613109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-54cafb92-c1c0-4ea1-a759-8dde6135955e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:36.645568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54cafb92-c1c0-4ea1-a759-8dde6135955e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:36.645568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54cafb92-c1c0-4ea1-a759-8dde6135955e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:36.647768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54cafb92-c1c0-4ea1-a759-8dde6135955e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:36.652584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54cafb92-c1c0-4ea1-a759-8dde6135955e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:36.656122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54cafb92-c1c0-4ea1-a759-8dde6135955e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:36.657041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54cafb92-c1c0-4ea1-a759-8dde6135955e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:36.826801 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-54cafb92-c1c0-4ea1-a759-8dde6135955e tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "POST /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756/action" status: 200 len: 24560 microversion: 2.1 time: 0.233096 Aug 09 17:45:36.834656 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2815/5368] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:45:36 2022] POST /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756/action => generated 24560 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:45:37.646468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:37.667542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:37.705200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:37.707313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:37.709523 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c991a5ad-02c9-4aa3-8ff3-8312ba5b152b tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 1.866300 Aug 09 17:45:37.725606 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2554/5369] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:35 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:38.738711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:38.739419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:38.773894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:38.777890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:38.778447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:38.779223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:38.779740 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:38.782072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:39.364595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-172378171", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "099fdd89-b0a4-4c0e-b8a0-7fe2b0eb74c0"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:39.365616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:39.393672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:39.398045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:39.402638 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4797ad0f-7561-4003-9ff0-11d9b05f7da0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.667564 Aug 09 17:45:39.409045 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2555/5370] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:38 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:39.645323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] validate_networks() for [('099fdd89-b0a4-4c0e-b8a0-7fe2b0eb74c0', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:45:40.440979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:40.441618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:40.477360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:40.479412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:40.480780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:40.485016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:40.486272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:40.504668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:41.070212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:45:41.071188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:45:41.072099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:45:41.072857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:45:41.073604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:45:41.077354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:41.143097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:41.144059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:41.149571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:41.155858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:41.158682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:41.159191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:41.208769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:41.233938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:41.237210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:41.242898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Getting quotas for project 56d75d62dcf5420f8c8a5626d47dc544. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:45:41.244788 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f7fb355c-4840-40bc-8763-c666ea4d4ec0 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.813504 Aug 09 17:45:41.245422 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2556/5371] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:40 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:45:41.279044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Getting quotas for user 8a7a6ec59344499d9adc695f9cd72b5e and project 56d75d62dcf5420f8c8a5626d47dc544. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:45:41.297071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:45:41.300347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:45:41.370089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75c3f255-f89d-40da-bc5a-7e68ff382912 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.767394 Aug 09 17:45:41.385612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-92da9353-4fb3-495d-9d0a-23a6ff657122 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:41.386366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-92da9353-4fb3-495d-9d0a-23a6ff657122 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:41.390625 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2816/5372] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:45:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2789 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 17:45:41.496872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-92da9353-4fb3-495d-9d0a-23a6ff657122 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:41.512736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-92da9353-4fb3-495d-9d0a-23a6ff657122 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:41.522418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-92da9353-4fb3-495d-9d0a-23a6ff657122 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:41.530099 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-92da9353-4fb3-495d-9d0a-23a6ff657122 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1261 microversion: 2.26 time: 0.149716 Aug 09 17:45:41.545960 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2557/5373] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:41 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:42.285152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:42.292842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:42.323142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:42.333833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:42.335919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:42.338183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:42.343262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:42.348264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:42.569325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:42.574570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:42.681010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:42.701952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:42.706175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:42.716192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:42.728703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:42.738618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:42.871374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:42.940161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:42.950686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:42.958196 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3e741239-858d-41c7-89c5-6ca26ebde9dd tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1265 microversion: 2.26 time: 0.397569 Aug 09 17:45:42.962793 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2558/5374] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:42 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1265 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:43.422105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:43.433371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:43.435020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:43.461921 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f927516b-786d-49e9-a31c-5bd954cbbcfe tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 1.187363 Aug 09 17:45:43.468761 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2817/5375] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:42 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:43.635743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ae460d3e-ec38-4a29-b5ce-09d8ea6687f0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:43.641295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ae460d3e-ec38-4a29-b5ce-09d8ea6687f0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:43.713753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae460d3e-ec38-4a29-b5ce-09d8ea6687f0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:43.721922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae460d3e-ec38-4a29-b5ce-09d8ea6687f0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:43.722573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae460d3e-ec38-4a29-b5ce-09d8ea6687f0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:43.731111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae460d3e-ec38-4a29-b5ce-09d8ea6687f0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:43.746664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae460d3e-ec38-4a29-b5ce-09d8ea6687f0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:43.748275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ae460d3e-ec38-4a29-b5ce-09d8ea6687f0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:43.842262 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ae460d3e-ec38-4a29-b5ce-09d8ea6687f0 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "POST /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756/action" status: 200 len: 32632 microversion: 2.1 time: 0.210865 Aug 09 17:45:43.844764 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2559/5376] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:45:43 2022] POST /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756/action => generated 32632 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:45:44.022889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:44.023715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:44.043998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:44.044514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:44.044968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:44.056600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:44.057183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:44.057643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:44.503543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:44.504588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:44.537789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:44.541176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:44.542132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:44.543288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:44.555729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:44.560341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:44.571533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:44.595041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:44.604735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:44.618661 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e7d8ff2-15c8-4b91-9190-bcaf748bb262 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1321 microversion: 2.26 time: 0.594307 Aug 09 17:45:44.622724 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2818/5377] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:44 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:45.513490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:45.523050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:45.533606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:45.543742 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bdfd0dc4-8fc2-4aac-a57f-717edd2f0e86 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 1.051556 Aug 09 17:45:45.545085 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2560/5378] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:44 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:45:45.647654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:45.648929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:45.669058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:45.669635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:45.670095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:45.670857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:45.671331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:45.680471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:45.944826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:45.958791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:45.961126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:45.962376 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-22d23e33-c9ed-4078-9fef-03ad0d823734 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1319 microversion: 2.26 time: 0.319573 Aug 09 17:45:45.962959 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2819/5379] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:45 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:46.596030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:46.597587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:46.631551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=30 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:46.637634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:46.642374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:46.645855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:46.651264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:46.652601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:46.656329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:46.988259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:46.989195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:47.006532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:47.013184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:47.013939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:47.014819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:47.015644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:47.018754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:47.107147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:47.120171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:47.121767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:47.123007 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-11aa14f7-878f-445b-827f-8da6a25092c3 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.532634 Aug 09 17:45:47.129007 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2561/5380] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:46 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:45:47.426877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6ef11fe7-9826-4800-89ac-aaadf1f180ed tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:47.436690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6ef11fe7-9826-4800-89ac-aaadf1f180ed tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:47.450110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ef11fe7-9826-4800-89ac-aaadf1f180ed tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:47.451415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ef11fe7-9826-4800-89ac-aaadf1f180ed tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:47.452503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ef11fe7-9826-4800-89ac-aaadf1f180ed tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:47.453978 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ef11fe7-9826-4800-89ac-aaadf1f180ed tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:47.455149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ef11fe7-9826-4800-89ac-aaadf1f180ed tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:47.456243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ef11fe7-9826-4800-89ac-aaadf1f180ed tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:47.499235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:47.515102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:47.521712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:47.523386 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-13d886c3-f63f-420c-8ecc-de358aeb3d83 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1361 microversion: 2.26 time: 0.539891 Aug 09 17:45:47.528285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6ef11fe7-9826-4800-89ac-aaadf1f180ed tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:45:47.544600 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2820/5381] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:46 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1361 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:45:47.552006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-82245878-bacd-4733-a7c8-1fa11c214dce req-d0cd9312-67f2-4736-af60-8b48b4466bcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47118aba-2b8a-4610-a011-b1272efef756", "tag": "16418928-bb1f-40fa-9024-4ae50ac9b943"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:47.565210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-82245878-bacd-4733-a7c8-1fa11c214dce req-d0cd9312-67f2-4736-af60-8b48b4466bcd service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:47.566240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-82245878-bacd-4733-a7c8-1fa11c214dce req-d0cd9312-67f2-4736-af60-8b48b4466bcd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:47.566936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-82245878-bacd-4733-a7c8-1fa11c214dce req-d0cd9312-67f2-4736-af60-8b48b4466bcd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:47.586061 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-82245878-bacd-4733-a7c8-1fa11c214dce req-d0cd9312-67f2-4736-af60-8b48b4466bcd service nova] Creating event network-changed:16418928-bb1f-40fa-9024-4ae50ac9b943 for instance 47118aba-2b8a-4610-a011-b1272efef756 on n-h2-845781-6 Aug 09 17:45:47.593202 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-82245878-bacd-4733-a7c8-1fa11c214dce req-d0cd9312-67f2-4736-af60-8b48b4466bcd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046727 Aug 09 17:45:47.594569 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2821/5382] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:45:47.727781 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6ef11fe7-9826-4800-89ac-aaadf1f180ed tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "DELETE /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 204 len: 0 microversion: 2.1 time: 0.309041 Aug 09 17:45:47.735839 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2562/5383] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:45:47 2022] DELETE /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:45:47.758083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9961d0db-7bfb-497f-925d-9a9a7e03a708 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:47.759370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9961d0db-7bfb-497f-925d-9a9a7e03a708 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:47.770409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9961d0db-7bfb-497f-925d-9a9a7e03a708 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:47.771264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9961d0db-7bfb-497f-925d-9a9a7e03a708 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:47.772535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9961d0db-7bfb-497f-925d-9a9a7e03a708 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:47.773672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9961d0db-7bfb-497f-925d-9a9a7e03a708 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:47.774422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9961d0db-7bfb-497f-925d-9a9a7e03a708 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:47.775546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9961d0db-7bfb-497f-925d-9a9a7e03a708 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:47.977447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9961d0db-7bfb-497f-925d-9a9a7e03a708 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:47.993223 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9961d0db-7bfb-497f-925d-9a9a7e03a708 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1669 microversion: 2.1 time: 0.247332 Aug 09 17:45:47.995682 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2822/5384] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:47 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1669 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:45:48.160671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:48.161390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:48.175230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:48.175773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:48.176225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:48.176963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:48.177432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:48.177922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:48.510661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:48.558867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:48.560170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:48.560814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:48.567227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:48.570413 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1cf8371b-31de-421f-8b46-ebacd2d52e2c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.413635 Aug 09 17:45:48.574895 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2563/5385] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:48 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:45:48.582466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:48.582978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:48.583684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:48.584716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:48.585632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:48.586496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:48.713157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5eedb08c-1531-4a30-8d57-5bd582c55a78 req-17b95a04-a152-402b-a480-04c983d567c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e60dede-6ae6-410a-8900-2b964de7299c", "tag": "735e1bc9-8168-4c47-bf3d-d039f7910ac3"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:48.750858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5eedb08c-1531-4a30-8d57-5bd582c55a78 req-17b95a04-a152-402b-a480-04c983d567c3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:48.755026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5eedb08c-1531-4a30-8d57-5bd582c55a78 req-17b95a04-a152-402b-a480-04c983d567c3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:48.758209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5eedb08c-1531-4a30-8d57-5bd582c55a78 req-17b95a04-a152-402b-a480-04c983d567c3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:48.811846 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5eedb08c-1531-4a30-8d57-5bd582c55a78 req-17b95a04-a152-402b-a480-04c983d567c3 service nova] Creating event network-changed:735e1bc9-8168-4c47-bf3d-d039f7910ac3 for instance 4e60dede-6ae6-410a-8900-2b964de7299c on n-h1-845781-6 Aug 09 17:45:48.837825 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5eedb08c-1531-4a30-8d57-5bd582c55a78 req-17b95a04-a152-402b-a480-04c983d567c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132245 Aug 09 17:45:48.839561 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2564/5386] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:45:49.018237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-80d2dd6f-3f86-42c1-94f5-c9f20aa5f6c8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:49.018969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-80d2dd6f-3f86-42c1-94f5-c9f20aa5f6c8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:49.031057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80d2dd6f-3f86-42c1-94f5-c9f20aa5f6c8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:49.031551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80d2dd6f-3f86-42c1-94f5-c9f20aa5f6c8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:49.034135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80d2dd6f-3f86-42c1-94f5-c9f20aa5f6c8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:49.038565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80d2dd6f-3f86-42c1-94f5-c9f20aa5f6c8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:49.040162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80d2dd6f-3f86-42c1-94f5-c9f20aa5f6c8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:49.042742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-80d2dd6f-3f86-42c1-94f5-c9f20aa5f6c8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:49.096384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:49.109960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:49.113740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:49.123544 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-371e5a86-ec8f-4036-815a-5351ca20bdbf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1361 microversion: 2.26 time: 0.569480 Aug 09 17:45:49.124760 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2823/5387] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:48 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1361 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:49.439712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-80d2dd6f-3f86-42c1-94f5-c9f20aa5f6c8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:49.449266 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-80d2dd6f-3f86-42c1-94f5-c9f20aa5f6c8 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1669 microversion: 2.1 time: 0.435258 Aug 09 17:45:49.453600 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2565/5388] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:49 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1669 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:45:49.603966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:49.604582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:49.621031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:49.621369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:49.624375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:49.628327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:49.629088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:49.629586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:50.159061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:50.162547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:50.163179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:50.173245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:50.176922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:50.179278 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-14d039df-052a-4697-88b6-fefdc00c6c5a tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.582910 Aug 09 17:45:50.180191 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2824/5389] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:49 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:50.180333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:50.180780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:50.181221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:50.181942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:50.182409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:50.182835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:50.500350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a4c3eae-f081-4ae5-8fae-43f12110b8ff tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:50.501353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9a4c3eae-f081-4ae5-8fae-43f12110b8ff tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:50.512496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4c3eae-f081-4ae5-8fae-43f12110b8ff tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:50.513324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4c3eae-f081-4ae5-8fae-43f12110b8ff tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:50.514086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4c3eae-f081-4ae5-8fae-43f12110b8ff tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:50.516062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4c3eae-f081-4ae5-8fae-43f12110b8ff tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:50.516959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4c3eae-f081-4ae5-8fae-43f12110b8ff tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:50.517881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a4c3eae-f081-4ae5-8fae-43f12110b8ff tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:50.641615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9a4c3eae-f081-4ae5-8fae-43f12110b8ff tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:50.654780 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9a4c3eae-f081-4ae5-8fae-43f12110b8ff tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1484 microversion: 2.1 time: 0.163834 Aug 09 17:45:50.655676 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2825/5390] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:50 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1484 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:45:51.118785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-dcbe4d39-f1cb-4c29-9c3b-3dfce1212e96 req-53fd4f64-aedf-492a-8935-386eca7e79e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47118aba-2b8a-4610-a011-b1272efef756", "name": "network-vif-deleted", "tag": "16418928-bb1f-40fa-9024-4ae50ac9b943"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:51.132109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dcbe4d39-f1cb-4c29-9c3b-3dfce1212e96 req-53fd4f64-aedf-492a-8935-386eca7e79e3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:51.132805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dcbe4d39-f1cb-4c29-9c3b-3dfce1212e96 req-53fd4f64-aedf-492a-8935-386eca7e79e3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:51.133297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dcbe4d39-f1cb-4c29-9c3b-3dfce1212e96 req-53fd4f64-aedf-492a-8935-386eca7e79e3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:51.151034 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-dcbe4d39-f1cb-4c29-9c3b-3dfce1212e96 req-53fd4f64-aedf-492a-8935-386eca7e79e3 service nova] Creating event network-vif-deleted:16418928-bb1f-40fa-9024-4ae50ac9b943 for instance 47118aba-2b8a-4610-a011-b1272efef756 on n-h2-845781-6 Aug 09 17:45:51.159254 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-dcbe4d39-f1cb-4c29-9c3b-3dfce1212e96 req-53fd4f64-aedf-492a-8935-386eca7e79e3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044576 Aug 09 17:45:51.161668 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2826/5391] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:45:51.199944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:51.210396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:51.211217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:51.225901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:51.228672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:51.230065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:51.231690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:51.233731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:51.235186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:51.265648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:51.279731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:51.281302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:51.282497 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2236a891-ad4a-4cc6-b6eb-a7b557a07577 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1361 microversion: 2.26 time: 1.124479 Aug 09 17:45:51.283079 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2566/5392] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:50 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1361 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:45:51.293351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:51.512518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:51.523006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:51.525756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:51.528450 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-352df1c5-f92a-4ebd-bb40-a7abcaf4fd45 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.329557 Aug 09 17:45:51.529916 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2827/5393] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:51 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:51.687351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:51.688685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:51.690855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:51.697491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:51.698387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:51.699076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:51.700224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:51.700966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:51.701656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:51.774252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:51.779335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:51.780021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:51.780527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lazy-loading 'fault' on Instance uuid 47118aba-2b8a-4610-a011-b1272efef756 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:45:51.938632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb30087336245ce95a13efe7c2f382e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95efa122e86846beb9abcb02ac118e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:51.949292 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9fdcf5e0-c1b5-42f8-8fd8-d9d940e83787 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 200 len: 1338 microversion: 2.1 time: 0.265997 Aug 09 17:45:51.959710 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2567/5394] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:51 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 1338 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:45:52.327916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:52.329520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:52.344035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:52.352665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:52.353687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:52.354709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:52.356855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:52.357572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:52.850248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-faf903db-7e83-46b1-8568-d83f30782409 req-ad05ab48-bda9-41dd-897c-79fe03b8231b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a34552-f7cd-4770-b3ef-be9226b0cd78", "name": "network-vif-plugged", "status": "completed", "tag": "0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:52.883467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-faf903db-7e83-46b1-8568-d83f30782409 req-ad05ab48-bda9-41dd-897c-79fe03b8231b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:52.888408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-faf903db-7e83-46b1-8568-d83f30782409 req-ad05ab48-bda9-41dd-897c-79fe03b8231b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:52.891119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-faf903db-7e83-46b1-8568-d83f30782409 req-ad05ab48-bda9-41dd-897c-79fe03b8231b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:52.930196 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-faf903db-7e83-46b1-8568-d83f30782409 req-ad05ab48-bda9-41dd-897c-79fe03b8231b service nova] Creating event network-vif-plugged:0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90 for instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 on n-h1-845781-6 Aug 09 17:45:52.942670 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-faf903db-7e83-46b1-8568-d83f30782409 req-ad05ab48-bda9-41dd-897c-79fe03b8231b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.517176 Aug 09 17:45:52.946454 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2568/5395] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:45:52.961280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:52.964026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:52.984309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:52.985679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:52.986728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:52.988722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:52.991616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:52.994335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:53.177459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:53.200741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:53.206215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:53.210788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fb70dc51-52c4-4408-8f11-c471f4f7df7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1361 microversion: 2.26 time: 0.884669 Aug 09 17:45:53.218803 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2828/5396] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:52 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1361 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:53.227039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:53.228917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] [instance: 47118aba-2b8a-4610-a011-b1272efef756] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:53.242956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:53.243865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:53.244603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:53.245520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:53.246002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:53.246443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:53.281884 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] HTTP exception thrown: Instance 47118aba-2b8a-4610-a011-b1272efef756 could not be found. Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Request method failure captured: Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 HTTP/1.1 Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pu27kmxlk7aADrjz2CKRwT-C5Zjwi_lNUjwiXZ5Z6gfQkfbibdq9sozm41HtXTWrQWFzYpTCPzwEVRV5MEPWrgm9BB2RPWNWBWWTa_z10AU7kE5C1ZuYz_dNAkBGHAMa8hiEQoQ_A4YuLRqMZcuri0tai7o9yDQbwxczVEjvdYvU9c Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 95efa122e86846beb9abcb02ac118e94 Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestNetworkBasicOps-1268708530 Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_95efa122e86846beb9abcb02ac118e94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/95efa122e86846beb9abcb02ac118e94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/95efa122e86846beb9abcb02ac118e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/95efa122e86846beb9abcb02ac118e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestNetworkBasicOps-1268708530 Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 95efa122e86846beb9abcb02ac118e94 Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestNetworkBasicOps-1268708530 Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestNetworkBasicOps-1268708530-project Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: cbb30087336245ce95a13efe7c2f382e Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestNetworkBasicOps-1268708530-project Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 47118aba-2b8a-4610-a011-b1272efef756 could not be found. Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '47118aba-2b8a-4610-a011-b1272efef756'} Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47118aba-2b8a-4610-a011-b1272efef756 could not be found. Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47118aba-2b8a-4610-a011-b1272efef756 could not be found. Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:45:53.285573 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:45:53.290968 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:45:53.290968 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:45:53.290968 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:45:53.290968 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:45:53.290968 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:45:53.290968 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47118aba-2b8a-4610-a011-b1272efef756 could not be found. Aug 09 17:45:53.290968 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:45:53.290968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Returning 404 to user: Instance 47118aba-2b8a-4610-a011-b1272efef756 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:45:53.290968 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a24ff21b-d47e-472d-94e7-bfa1b1f4271b tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756" status: 404 len: 111 microversion: 2.1 time: 0.068656 Aug 09 17:45:53.290968 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2829/5397] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:45:53 2022] GET /compute/v2.1/servers/47118aba-2b8a-4610-a011-b1272efef756 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:45:53.448308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:53.471595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:53.479119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:53.483378 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b32b9ee3-105e-4ae3-8fa7-aeb03e0416b9 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.533118 Aug 09 17:45:53.489586 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2569/5398] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:52 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:53.662752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cf1bed95-4fc3-45e0-bd23-d7da463b8465 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] Calling method '.version_select at 0x7fbbd80c4790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:53.718211 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cf1bed95-4fc3-45e0-bd23-d7da463b8465 tempest-TestNetworkBasicOps-1268708530 tempest-TestNetworkBasicOps-1268708530-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1204313964" status: 202 len: 0 microversion: 2.1 time: 0.065408 Aug 09 17:45:53.730290 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2830/5399] 10.222.0.93 () {58 vars in 1257 bytes} [Tue Aug 9 17:45:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1204313964 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:45:54.251887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:54.253542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:54.263315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:54.263990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:54.264433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:54.265864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:54.266318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:54.266741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:54.514664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:54.515673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:54.532502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:54.533109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:54.533574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:54.534319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:54.534833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:54.535418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:54.554017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:54.606418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:54.618124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:54.640047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:54.648626 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b3b78634-5553-4662-813e-ced2c9887cf2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1361 microversion: 2.26 time: 0.396457 Aug 09 17:45:54.649796 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2570/5400] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:54 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1361 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:54.926891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:54.967182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:54.986905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:54.987586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2bcf079c-a8a3-4fb5-ba18-83e04ebd9a91 req-f4c5dd7b-81ba-4ee2-82f0-e6d212c0f2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e60dede-6ae6-410a-8900-2b964de7299c", "name": "network-vif-plugged", "status": "completed", "tag": "735e1bc9-8168-4c47-bf3d-d039f7910ac3"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:45:54.990037 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b64f3f0e-4880-4e96-bfdb-ce39b39eaa75 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.479894 Aug 09 17:45:54.991922 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2831/5401] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:54 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:45:55.008296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2bcf079c-a8a3-4fb5-ba18-83e04ebd9a91 req-f4c5dd7b-81ba-4ee2-82f0-e6d212c0f2f0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:55.008779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2bcf079c-a8a3-4fb5-ba18-83e04ebd9a91 req-f4c5dd7b-81ba-4ee2-82f0-e6d212c0f2f0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:55.009430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2bcf079c-a8a3-4fb5-ba18-83e04ebd9a91 req-f4c5dd7b-81ba-4ee2-82f0-e6d212c0f2f0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:55.035361 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2bcf079c-a8a3-4fb5-ba18-83e04ebd9a91 req-f4c5dd7b-81ba-4ee2-82f0-e6d212c0f2f0 service nova] Creating event network-vif-plugged:735e1bc9-8168-4c47-bf3d-d039f7910ac3 for instance 4e60dede-6ae6-410a-8900-2b964de7299c on n-h1-845781-6 Aug 09 17:45:55.042532 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-2bcf079c-a8a3-4fb5-ba18-83e04ebd9a91 req-f4c5dd7b-81ba-4ee2-82f0-e6d212c0f2f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058500 Aug 09 17:45:55.043959 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2571/5402] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:45:55.690999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:55.697715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:55.749465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:55.752666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:55.755831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:55.763456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:55.766115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:55.770183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:56.038694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:56.040680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:56.067250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:56.069245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:56.072054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:56.074623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:56.075440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:56.079542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:56.441768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:56.508882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:56.515360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:56.523828 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d55f8c19-e8d7-49fe-b4b8-eec39a23db55 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1361 microversion: 2.26 time: 0.850601 Aug 09 17:45:56.527508 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2832/5403] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:55 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1361 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:56.569877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:56.572836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:45:56.594825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:56.596449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:56.597705 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-190778d2-8db3-419f-aee6-1db4cb2ee9cd tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1730 microversion: 2.20 time: 0.564983 Aug 09 17:45:56.598295 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2572/5404] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:56 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1730 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:45:57.586481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:57.588294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:57.616651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:57.618091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:57.619338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:57.622357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:57.623651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:57.625225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:57.670608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:57.678253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:57.714304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:57.718837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:57.723234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:57.727499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:57.730344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:57.732800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.012936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:58.025084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:58.025084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:58.039042 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-22de622c-1f8b-4a4c-8ceb-cc5221d0115b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1544 microversion: 2.26 time: 0.463093 Aug 09 17:45:58.039891 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2833/5405] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:57 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1544 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:58.084145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcb984f70>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:58.101552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.102801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.109880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.111316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:58.126363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.127781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.129092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.130870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.132248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.133359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.213601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.213601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.216086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.262705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.265479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.266263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.284362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:58.296495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:58.298432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:45:58.301202 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-56a5d46c-b072-46c1-ac55-f0ceda055bd5 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1717 microversion: 2.20 time: 0.663099 Aug 09 17:45:58.302293 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2573/5406] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:45:57 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1717 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:45:58.338842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:45:58.361134 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-60eb9187-efce-4189-976a-4831c0b0ddaf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-281574777" status: 201 len: 0 microversion: 2.26 time: 0.284655 Aug 09 17:45:58.362350 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2834/5407] 10.222.0.93 () {62 vars in 1377 bytes} [Tue Aug 9 17:45:58 2022] PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-281574777 => generated 0 bytes in 287 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 09 17:45:58.383875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6a738713-1b49-45f9-85f5-50c420981cdf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcb945d30>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:58.407790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a738713-1b49-45f9-85f5-50c420981cdf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.409007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a738713-1b49-45f9-85f5-50c420981cdf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.410002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a738713-1b49-45f9-85f5-50c420981cdf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.462954 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6a738713-1b49-45f9-85f5-50c420981cdf tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-281574777" status: 204 len: 0 microversion: 2.26 time: 0.089196 Aug 09 17:45:58.465955 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2574/5408] 10.222.0.93 () {60 vars in 1358 bytes} [Tue Aug 9 17:45:58 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-281574777 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 17:45:58.476381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbdc8bc160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:58.487508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.495318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.496506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.497241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:58.510755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.512272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.513297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.516974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.517715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.518885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.587569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.587569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.587569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.632414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:45:58.697567 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99269c17-f3a2-48ff-9926-4265e2350de2 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags" status: 204 len: 0 microversion: 2.26 time: 0.225867 Aug 09 17:45:58.698899 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2835/5409] 10.222.0.93 () {60 vars in 1295 bytes} [Tue Aug 9 17:45:58 2022] DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:45:58.712614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-67e086ba-af0f-48be-9efe-81daf0846b45 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcb673a60>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:58.737030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67e086ba-af0f-48be-9efe-81daf0846b45 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.740550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67e086ba-af0f-48be-9efe-81daf0846b45 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.741296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67e086ba-af0f-48be-9efe-81daf0846b45 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.829499 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-67e086ba-af0f-48be-9efe-81daf0846b45 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags" status: 200 len: 12 microversion: 2.26 time: 0.120523 Aug 09 17:45:58.830275 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2575/5410] 10.222.0.93 () {60 vars in 1292 bytes} [Tue Aug 9 17:45:58 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags => generated 12 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:45:58.850331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbca4e7790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:58.879970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.881747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.882853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.884312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:58.895293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.897309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.898621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:58.900263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:58.901384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:58.902387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.001452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.003932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.004875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.035843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.040618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.042725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.104527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:45:59.147307 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a76ea08-4f5c-434f-805e-f20957874478 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-1725647137" status: 201 len: 0 microversion: 2.26 time: 0.306161 Aug 09 17:45:59.155820 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2836/5411] 10.222.0.93 () {62 vars in 1380 bytes} [Tue Aug 9 17:45:58 2022] PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-1725647137 => generated 0 bytes in 316 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 09 17:45:59.164958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-629461d8-9f06-4c38-8416-0e6fbc253b7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcb9458b0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:59.203887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-629461d8-9f06-4c38-8416-0e6fbc253b7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.221120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-629461d8-9f06-4c38-8416-0e6fbc253b7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.224377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-629461d8-9f06-4c38-8416-0e6fbc253b7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.266461 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-629461d8-9f06-4c38-8416-0e6fbc253b7d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags" status: 200 len: 36 microversion: 2.26 time: 0.109119 Aug 09 17:45:59.269912 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2576/5412] 10.222.0.93 () {60 vars in 1292 bytes} [Tue Aug 9 17:45:59 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags => generated 36 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:45:59.285332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcbb7aee0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:59.319565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.320384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.321143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.321977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:59.345074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.347575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.350679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.354186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.355081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.355872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.438207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.439045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.439825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.503043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:45:59.542920 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-02d9fc98-9de2-499d-a32d-39725202f117 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-1725647137" status: 204 len: 0 microversion: 2.26 time: 0.266883 Aug 09 17:45:59.545474 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2837/5413] 10.222.0.93 () {60 vars in 1364 bytes} [Tue Aug 9 17:45:59 2022] DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-1725647137 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:45:59.560891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cbc8090c-e44f-4adb-978c-44db9cbea206 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbdc9e6700>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:59.576166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbc8090c-e44f-4adb-978c-44db9cbea206 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.577323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbc8090c-e44f-4adb-978c-44db9cbea206 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.578069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cbc8090c-e44f-4adb-978c-44db9cbea206 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.597292 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cbc8090c-e44f-4adb-978c-44db9cbea206 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags" status: 200 len: 12 microversion: 2.26 time: 0.045397 Aug 09 17:45:59.600533 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2577/5414] 10.222.0.93 () {60 vars in 1292 bytes} [Tue Aug 9 17:45:59 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags => generated 12 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:45:59.624154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcb9f2430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:59.682652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.700126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.701168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.701799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:59.715957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.717168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.718483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.720126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.721209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.722224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.826016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.828643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.830569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.857004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:45:59.897940 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-22fac3cf-c26d-4b56-9477-e559e2916611 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags" status: 204 len: 0 microversion: 2.26 time: 0.288885 Aug 09 17:45:59.899061 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2838/5415] 10.222.0.93 () {60 vars in 1295 bytes} [Tue Aug 9 17:45:59 2022] DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:45:59.911358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcb6ecdc0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:45:59.941815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.942688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.943533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.958277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:45:59.975608 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.976517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.977620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:45:59.979206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:45:59.980404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:45:59.981712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.070702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.077573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.079687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.113716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.114366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.114909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.167010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:46:00.202246 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1c432b10-93f2-4568-be73-9caed77efd8a tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-1887291796" status: 201 len: 0 microversion: 2.26 time: 0.296654 Aug 09 17:46:00.204042 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2578/5416] 10.222.0.93 () {62 vars in 1380 bytes} [Tue Aug 9 17:45:59 2022] PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-1887291796 => generated 0 bytes in 300 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 09 17:46:00.223769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcb8234c0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:00.252551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.254528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.256716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.259015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:00.273205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.280233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.282303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.283926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.285016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.286062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.370081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.370624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.371976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.398016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.398396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.404835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.442623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:46:00.464176 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0b12bbde-8360-4112-bee4-3f5e1e33bd25 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-735139059" status: 201 len: 0 microversion: 2.26 time: 0.252205 Aug 09 17:46:00.465617 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2839/5417] 10.222.0.93 () {62 vars in 1377 bytes} [Tue Aug 9 17:46:00 2022] PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-735139059 => generated 0 bytes in 255 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 09 17:46:00.491496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbdc815670>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:00.500147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.501503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.502159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.502817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:00.510262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.510765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.511245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.512214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.512674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.513230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.542994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.543802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.544678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.566453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:46:00.601526 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8cfdbe98-8034-4b9e-a786-f5c9462519c0 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags" status: 204 len: 0 microversion: 2.26 time: 0.126878 Aug 09 17:46:00.605308 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2579/5418] 10.222.0.93 () {60 vars in 1295 bytes} [Tue Aug 9 17:46:00 2022] DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:46:00.616472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74997587-97d2-4dff-9694-d3cf2017308d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbca40c550>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:00.629394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74997587-97d2-4dff-9694-d3cf2017308d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.630526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74997587-97d2-4dff-9694-d3cf2017308d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.631325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74997587-97d2-4dff-9694-d3cf2017308d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.636038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:00.650466 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-74997587-97d2-4dff-9694-d3cf2017308d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags" status: 200 len: 12 microversion: 2.26 time: 0.043068 Aug 09 17:46:00.652654 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2840/5419] 10.222.0.93 () {60 vars in 1292 bytes} [Tue Aug 9 17:46:00 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags => generated 12 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:46:00.669769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcb95d430>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:00.683718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.684559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.684559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.684559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:00.692308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.693044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.693699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.694598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.695421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.696059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.744357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.745101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.745705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.769082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:46:00.808682 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-db59b90c-14d3-490d-998d-671744d1b0a4 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags" status: 204 len: 0 microversion: 2.26 time: 0.147498 Aug 09 17:46:00.824290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcbb7ab80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:00.834510 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2580/5420] 10.222.0.93 () {60 vars in 1295 bytes} [Tue Aug 9 17:46:00 2022] DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:46:00.844445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.844867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.845384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.845886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:00.858094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.862439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.862906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.863703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.864366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.864965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.915866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.917035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.918202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:00.950912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:00.952895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:00.954265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.024841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:46:01.089003 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b4f30c6f-35de-4df6-851f-49c6dfc8af81 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-1236765352" status: 201 len: 0 microversion: 2.26 time: 0.264745 Aug 09 17:46:01.104703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbca67e940>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:01.110462 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2841/5421] 10.222.0.93 () {62 vars in 1380 bytes} [Tue Aug 9 17:46:00 2022] PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-1236765352 => generated 0 bytes in 273 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 09 17:46:01.131433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.131983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.132432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.133154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:01.151021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.151536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.152022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.152769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.153260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.153678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.298744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.299425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.299839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.314805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.315404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.316249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.364807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:46:01.388116 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9dac468f-9c5d-436d-9117-95dd7cf5c573 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-1677735553" status: 201 len: 0 microversion: 2.26 time: 0.288981 Aug 09 17:46:01.393237 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2581/5422] 10.222.0.93 () {62 vars in 1380 bytes} [Tue Aug 9 17:46:01 2022] PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags/tempest-tag-1677735553 => generated 0 bytes in 291 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 09 17:46:01.404877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Action: 'update_all', calling method: .version_select at 0x7fbbcb580670>, body: {"tags": ["tempest-tag-783971737", "tempest-tag-1895673503"]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:46:01.428360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.429130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.429861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.430861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:01.438234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.438948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.439744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.440564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.441336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.446155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.489888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.491225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.491983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.526148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:46:01.567878 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0718d2f1-c145-4e4f-886e-32e8ecfe4285 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags" status: 200 len: 61 microversion: 2.26 time: 0.172310 Aug 09 17:46:01.569731 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2842/5423] 10.222.0.93 () {62 vars in 1312 bytes} [Tue Aug 9 17:46:01 2022] PUT /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags => generated 61 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:46:01.580309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ddc02e7f-aeb8-415d-ba03-949ed0222b1d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcb6a05e0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:01.589349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddc02e7f-aeb8-415d-ba03-949ed0222b1d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.589820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddc02e7f-aeb8-415d-ba03-949ed0222b1d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.590489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddc02e7f-aeb8-415d-ba03-949ed0222b1d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.602375 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ddc02e7f-aeb8-415d-ba03-949ed0222b1d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags" status: 200 len: 61 microversion: 2.26 time: 0.026284 Aug 09 17:46:01.603448 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2582/5424] 10.222.0.93 () {60 vars in 1292 bytes} [Tue Aug 9 17:46:01 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags => generated 61 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:46:01.619479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '.version_select at 0x7fbbcbb13670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:01.651494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.653108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.653791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.654645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:01.664735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.665505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.666191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.667592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.668474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.669171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.701903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.702408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.702856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.724043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'flavor' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:46:01.746062 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e5c4a3b1-30ba-4a2b-832b-f52ca7b00a8c tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags" status: 204 len: 0 microversion: 2.26 time: 0.134886 Aug 09 17:46:01.747172 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2843/5425] 10.222.0.93 () {60 vars in 1295 bytes} [Tue Aug 9 17:46:01 2022] DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c/tags => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:46:01.778248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d186a7f9-11db-490d-9b4c-8289d8c8749d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:01.779213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d186a7f9-11db-490d-9b4c-8289d8c8749d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:01.802682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d186a7f9-11db-490d-9b4c-8289d8c8749d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.804099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d186a7f9-11db-490d-9b4c-8289d8c8749d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.805204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d186a7f9-11db-490d-9b4c-8289d8c8749d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.806569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d186a7f9-11db-490d-9b4c-8289d8c8749d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:01.807563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d186a7f9-11db-490d-9b4c-8289d8c8749d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:01.808708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d186a7f9-11db-490d-9b4c-8289d8c8749d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:01.868368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d186a7f9-11db-490d-9b4c-8289d8c8749d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:46:02.087805 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d186a7f9-11db-490d-9b4c-8289d8c8749d tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 204 len: 0 microversion: 2.26 time: 0.333335 Aug 09 17:46:02.089644 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2583/5426] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:46:01 2022] DELETE /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:46:02.105413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:02.106747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:02.123032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:02.124440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:02.125475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:02.127458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:02.129340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:02.130582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:02.523256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:02.549837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:02.559318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:02.561959 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e127f026-452a-4587-91b1-df7723f73c64 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1550 microversion: 2.26 time: 0.466322 Aug 09 17:46:02.573055 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2844/5427] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:02 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1550 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:03.612712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:03.615109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:03.626778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:03.628246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:03.629366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:03.631498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:03.632687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:03.633728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:04.030080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:04.059894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:04.067214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:04.070251 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9fbe4d1d-374a-4cdf-b119-323a57a87a27 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1550 microversion: 2.26 time: 0.467131 Aug 09 17:46:04.073855 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2584/5428] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:03 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1550 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:04.446912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-aad73eea-344c-4806-bfcc-806fe4f7af78 req-1e185393-7397-42f8-8690-76a7d75c64a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e60dede-6ae6-410a-8900-2b964de7299c", "name": "network-vif-deleted", "tag": "735e1bc9-8168-4c47-bf3d-d039f7910ac3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:46:04.468093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aad73eea-344c-4806-bfcc-806fe4f7af78 req-1e185393-7397-42f8-8690-76a7d75c64a4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:04.469373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aad73eea-344c-4806-bfcc-806fe4f7af78 req-1e185393-7397-42f8-8690-76a7d75c64a4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:04.470034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aad73eea-344c-4806-bfcc-806fe4f7af78 req-1e185393-7397-42f8-8690-76a7d75c64a4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:04.490932 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-aad73eea-344c-4806-bfcc-806fe4f7af78 req-1e185393-7397-42f8-8690-76a7d75c64a4 service nova] Creating event network-vif-deleted:735e1bc9-8168-4c47-bf3d-d039f7910ac3 for instance 4e60dede-6ae6-410a-8900-2b964de7299c on n-h1-845781-6 Aug 09 17:46:04.499750 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-aad73eea-344c-4806-bfcc-806fe4f7af78 req-1e185393-7397-42f8-8690-76a7d75c64a4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056468 Aug 09 17:46:04.534973 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2845/5429] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:46:05.097302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:05.098674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:05.112910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:05.116676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:05.117201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:05.117919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:05.118396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:05.120675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:05.189102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:05.211421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:05.212517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:05.213773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:05.214487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lazy-loading 'fault' on Instance uuid 4e60dede-6ae6-410a-8900-2b964de7299c {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:46:05.334830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:05.344781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:05.352744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a7a6ec59344499d9adc695f9cd72b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d75d62dcf5420f8c8a5626d47dc544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:05.355310 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0c183167-1828-479d-953e-9d09f3908361 tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 200 len: 1351 microversion: 2.26 time: 0.262314 Aug 09 17:46:05.356172 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2585/5430] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:05 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 1351 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:06.406998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:06.409856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] [instance: 4e60dede-6ae6-410a-8900-2b964de7299c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:06.446717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:06.450023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:06.452770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:06.461583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:06.462917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:06.463567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:06.502692 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] HTTP exception thrown: Instance 4e60dede-6ae6-410a-8900-2b964de7299c could not be found. Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Request method failure captured: Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c HTTP/1.1 Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p1Ctf7WIn7bZvLIa9XrKDQMynJreZuOGNgunR5x9F9uVuB_ezf_3Fzil9aV8y4OD1KYZu_w9o6g1v9bDN5Umy8ZmBCZDbnhntSqpkdp1-qlOY4RgO050LIgfwlyrBOBjns28EgC_3WdHC9hyoV8A8A-qbvy9NZDK89KMorLlUcwZ80 Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.26 Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 56d75d62dcf5420f8c8a5626d47dc544 Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerTagsTestJSON-550359506 Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_56d75d62dcf5420f8c8a5626d47dc544"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56d75d62dcf5420f8c8a5626d47dc544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/56d75d62dcf5420f8c8a5626d47dc544"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/56d75d62dcf5420f8c8a5626d47dc544"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerTagsTestJSON-550359506 Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 56d75d62dcf5420f8c8a5626d47dc544 Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerTagsTestJSON-550359506 Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerTagsTestJSON-550359506-project Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 8a7a6ec59344499d9adc695f9cd72b5e Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerTagsTestJSON-550359506-project Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 4e60dede-6ae6-410a-8900-2b964de7299c could not be found. Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '4e60dede-6ae6-410a-8900-2b964de7299c'} Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e60dede-6ae6-410a-8900-2b964de7299c could not be found. Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e60dede-6ae6-410a-8900-2b964de7299c could not be found. Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:06.507946 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:06.512998 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:06.512998 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:06.512998 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:06.512998 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:46:06.512998 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:46:06.512998 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e60dede-6ae6-410a-8900-2b964de7299c could not be found. Aug 09 17:46:06.512998 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:06.514103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] Returning 404 to user: Instance 4e60dede-6ae6-410a-8900-2b964de7299c could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:46:06.515802 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-64709845-1044-41a9-8b49-a7893f4b613b tempest-ServerTagsTestJSON-550359506 tempest-ServerTagsTestJSON-550359506-project] 10.222.0.93 "GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c" status: 404 len: 111 microversion: 2.26 time: 0.119715 Aug 09 17:46:06.523048 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2846/5431] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:06 2022] GET /compute/v2.1/servers/4e60dede-6ae6-410a-8900-2b964de7299c => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:46:14.625392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-08649491-9ed8-4c91-9e71-ed613eca35bf tempest-PortsAdminExtendedAttrsTestJSON-1179015450 tempest-PortsAdminExtendedAttrsTestJSON-1179015450-project-admin] Calling method '.version_select at 0x7fbbcb942700>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:14.629124 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:46:14.629124 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:46:14.632865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08649491-9ed8-4c91-9e71-ed613eca35bf tempest-PortsAdminExtendedAttrsTestJSON-1179015450 tempest-PortsAdminExtendedAttrsTestJSON-1179015450-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:14.635161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08649491-9ed8-4c91-9e71-ed613eca35bf tempest-PortsAdminExtendedAttrsTestJSON-1179015450 tempest-PortsAdminExtendedAttrsTestJSON-1179015450-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:14.636384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08649491-9ed8-4c91-9e71-ed613eca35bf tempest-PortsAdminExtendedAttrsTestJSON-1179015450 tempest-PortsAdminExtendedAttrsTestJSON-1179015450-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:14.701435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08649491-9ed8-4c91-9e71-ed613eca35bf tempest-PortsAdminExtendedAttrsTestJSON-1179015450 tempest-PortsAdminExtendedAttrsTestJSON-1179015450-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:14.703141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08649491-9ed8-4c91-9e71-ed613eca35bf tempest-PortsAdminExtendedAttrsTestJSON-1179015450 tempest-PortsAdminExtendedAttrsTestJSON-1179015450-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:14.706614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08649491-9ed8-4c91-9e71-ed613eca35bf tempest-PortsAdminExtendedAttrsTestJSON-1179015450 tempest-PortsAdminExtendedAttrsTestJSON-1179015450-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:14.729295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08649491-9ed8-4c91-9e71-ed613eca35bf tempest-PortsAdminExtendedAttrsTestJSON-1179015450 tempest-PortsAdminExtendedAttrsTestJSON-1179015450-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:14.729806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08649491-9ed8-4c91-9e71-ed613eca35bf tempest-PortsAdminExtendedAttrsTestJSON-1179015450 tempest-PortsAdminExtendedAttrsTestJSON-1179015450-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:14.730669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-08649491-9ed8-4c91-9e71-ed613eca35bf tempest-PortsAdminExtendedAttrsTestJSON-1179015450 tempest-PortsAdminExtendedAttrsTestJSON-1179015450-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:14.740864 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-08649491-9ed8-4c91-9e71-ed613eca35bf tempest-PortsAdminExtendedAttrsTestJSON-1179015450 tempest-PortsAdminExtendedAttrsTestJSON-1179015450-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.817704 Aug 09 17:46:14.744470 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2586/5432] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 17:46:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:46:16.341723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-226221083", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": "none"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:46:16.357432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:16.416355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:46:16.417101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:46:16.417801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:46:16.418206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:46:16.418831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:46:16.430438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:16.430926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:16.431814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:16.432502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:16.432967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:16.433397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:16.465668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Getting quotas for project 2b1350a2b195475d84d2a2d6600c2eaf. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:46:16.475734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Getting quotas for user d028bae2da824b9d9d49306644dd1e50 and project 2b1350a2b195475d84d2a2d6600c2eaf. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:46:16.492767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:46:16.495359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:46:16.543842 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bb1dc3bd-2cb9-4f45-8545-7659243f1ac7 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.443732 Aug 09 17:46:16.544759 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2847/5433] 10.222.0.93 () {62 vars in 1188 bytes} [Tue Aug 9 17:46:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 09 17:46:16.565134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-04021083-861d-4c9d-ac5e-1c43c6dad682 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:16.566132 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-04021083-861d-4c9d-ac5e-1c43c6dad682 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:16.717848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-04021083-861d-4c9d-ac5e-1c43c6dad682 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:16.742745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-04021083-861d-4c9d-ac5e-1c43c6dad682 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:16.747167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-04021083-861d-4c9d-ac5e-1c43c6dad682 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:16.750560 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-04021083-861d-4c9d-ac5e-1c43c6dad682 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1277 microversion: 2.57 time: 0.192345 Aug 09 17:46:16.773826 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2587/5434] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:16 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:17.793658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:17.795606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:17.804754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:17.805709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:17.806149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:17.807082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:17.807759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:17.808474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:17.933195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:17.950478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:17.954513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:17.957231 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a25cfda-28d1-431e-8e1c-8b5e52e66f81 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1329 microversion: 2.57 time: 0.168831 Aug 09 17:46:17.958783 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2848/5435] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:17 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1329 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:18.997280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:18.998805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:19.004006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:19.009048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:19.009815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:19.010571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:19.011808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:19.012491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:19.013654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:19.151050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:19.163992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:19.166071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:19.167350 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8dc62822-5070-482f-a3db-4fb43cde4ed1 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1335 microversion: 2.57 time: 0.188384 Aug 09 17:46:19.167956 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2588/5436] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:18 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1335 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:46:20.202814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:20.204616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:20.213918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:20.214748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:20.215415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:20.216233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:20.216901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:20.217877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:20.336798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:20.356080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:20.358279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:20.360211 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-16bc38da-6258-4edf-957e-1d074ed68758 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1335 microversion: 2.57 time: 0.161505 Aug 09 17:46:20.361485 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2849/5437] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:20 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1335 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:21.401617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:21.402956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:21.413287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:21.414206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:21.415012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:21.416156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:21.416863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:21.417517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:21.546805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:21.559424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:21.562353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:21.564575 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-989f047b-252b-47fa-bb72-aee4013c56c5 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1356 microversion: 2.57 time: 0.167460 Aug 09 17:46:21.565781 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2589/5438] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:21 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:21.616384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:46:21.631287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:21.647849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:21.648734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:21.650182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:21.651848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:21.652854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:21.653724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:21.843360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:46:21.844220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:46:21.844582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:46:21.845364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:46:21.845981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:46:21.938901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:21.949266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:21.950203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:21.950972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:21.952018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:21.952975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:21.954122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:22.001453 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e383abd2-555b-4bae-924f-332c832c116b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "POST /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3/action" status: 202 len: 1137 microversion: 2.57 time: 0.398463 Aug 09 17:46:22.002638 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2850/5439] 10.222.0.93 () {62 vars in 1320 bytes} [Tue Aug 9 17:46:21 2022] POST /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3/action => generated 1137 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 09 17:46:22.041220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:22.042643 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:22.057016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:22.058443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:22.059474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:22.061118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:22.062604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:22.063548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:22.273183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:22.291160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:22.294995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:22.298164 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-94f84e20-ebf0-4eff-a922-5dc908e23691 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.263924 Aug 09 17:46:22.299686 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2590/5440] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:22 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:23.343027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:23.344578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:23.360922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:23.363579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:23.364659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:23.367334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:23.368365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:23.369223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:23.518165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:23.545778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:23.549775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:23.552382 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3bbe0371-c69e-49ab-91cb-3e01d39e2f0d tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.218663 Aug 09 17:46:23.554315 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2851/5441] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:23 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:24.607128 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:24.610827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:24.625901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:24.629554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:24.631861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:24.633041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:24.634309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:24.635349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:24.799538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:24.818276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:24.821729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:24.824579 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4754c6de-b4f8-4761-91d6-fffb327a7fdf tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.233887 Aug 09 17:46:24.826094 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2591/5442] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:24 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:25.855204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:25.856917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:25.877609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:25.878788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:25.879518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:25.881565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:25.882860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:25.883810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:26.016909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:26.032675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:26.036692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:26.040213 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dbb81ef3-3e48-4910-adc5-361b715f5ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.191809 Aug 09 17:46:26.043471 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2852/5443] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:25 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:27.095878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:27.096637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:27.102052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:27.110763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:27.111861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:27.112783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:27.113928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:27.114404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:27.116151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:27.213780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:27.227314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:27.229306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:27.230661 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eaa1a7c2-0049-4d9e-8d59-8ecda1c12efb tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.141437 Aug 09 17:46:27.244666 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2592/5444] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:27 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:28.263102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:28.265304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:28.281607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:28.300806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:28.304923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:28.305843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:28.306595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:28.321068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:28.321884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:28.322653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:28.508179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:28.521385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:28.533116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:28.538275 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4b6ba42f-16e7-4f76-a0b8-d48416cc73e0 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.283273 Aug 09 17:46:28.554324 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2853/5445] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:28 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:29.577390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:29.578065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:29.585975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:29.585975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:29.587819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:29.588650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:29.589140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:29.589584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:29.794334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:29.815505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:29.817434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:29.828297 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3ae3352c-b118-457d-8588-061fa3a3fe67 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.256730 Aug 09 17:46:29.844079 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2593/5446] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:29 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:46:30.869857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:30.871038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:30.885119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:30.886694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:30.887973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:30.889523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:30.890831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:30.892104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:30.907810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:31.160629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:31.181239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:31.183415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:31.185329 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aec8eece-2d2c-4745-80ee-93e1c16e608b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.327308 Aug 09 17:46:31.200694 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2854/5447] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:30 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:31.664584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-deeaa62b-4afc-4d6e-8bff-c2ec17ddad66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:31.668582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-deeaa62b-4afc-4d6e-8bff-c2ec17ddad66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:31.681361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deeaa62b-4afc-4d6e-8bff-c2ec17ddad66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:31.690715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deeaa62b-4afc-4d6e-8bff-c2ec17ddad66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:31.696144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deeaa62b-4afc-4d6e-8bff-c2ec17ddad66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:31.697447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deeaa62b-4afc-4d6e-8bff-c2ec17ddad66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:31.698114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deeaa62b-4afc-4d6e-8bff-c2ec17ddad66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:31.698742 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-deeaa62b-4afc-4d6e-8bff-c2ec17ddad66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:31.775911 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-deeaa62b-4afc-4d6e-8bff-c2ec17ddad66 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.118160 Aug 09 17:46:31.778355 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2594/5448] 10.222.0.93 () {60 vars in 1343 bytes} [Tue Aug 9 17:46:31 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:46:31.909169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f1ae581-1801-4ff9-a635-f8ba8a7a5d49 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:31.909755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f1ae581-1801-4ff9-a635-f8ba8a7a5d49 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:31.919702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f1ae581-1801-4ff9-a635-f8ba8a7a5d49 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:31.920505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f1ae581-1801-4ff9-a635-f8ba8a7a5d49 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:31.921451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f1ae581-1801-4ff9-a635-f8ba8a7a5d49 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:31.922834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f1ae581-1801-4ff9-a635-f8ba8a7a5d49 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:31.923700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f1ae581-1801-4ff9-a635-f8ba8a7a5d49 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:31.924520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f1ae581-1801-4ff9-a635-f8ba8a7a5d49 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:31.959978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f1ae581-1801-4ff9-a635-f8ba8a7a5d49 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:46:32.167612 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f1ae581-1801-4ff9-a635-f8ba8a7a5d49 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "DELETE /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 204 len: 0 microversion: 2.20 time: 0.262528 Aug 09 17:46:32.171847 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2855/5449] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:46:31 2022] DELETE /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 17:46:32.181329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:32.182775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:32.190749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:32.191891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:32.192931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:32.194526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:32.195363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:32.196116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:32.223664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:32.233922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:32.269377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:32.270313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:32.271264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:32.273462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:32.275180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:32.275967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:32.406644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:32.424493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:32.428548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:32.430407 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-352ab096-73a1-4ef6-893e-83f1a464bbaf tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1723 microversion: 2.20 time: 0.256367 Aug 09 17:46:32.431849 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2595/5450] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:32 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:32.472674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:32.486658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:32.489539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:32.491458 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0da375e1-244b-41ec-9b7a-e2f9dc645207 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.277687 Aug 09 17:46:32.492921 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2856/5451] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:32 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:33.482367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:33.483659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:33.509446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:33.512173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:33.513503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:33.515010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:33.517378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:33.518222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:33.538607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:33.539929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:33.553438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:33.555604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:33.556401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:33.558083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:33.558663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:33.559879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:33.686381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:33.696847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:33.698910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:33.701373 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b2a0247-823f-4809-aecd-f965d53e4ae6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.171769 Aug 09 17:46:33.703313 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2857/5452] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:33 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:33.762459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:33.771860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:33.774009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:33.775509 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8be27c17-ff86-4561-8f55-1da1bcbe3983 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1723 microversion: 2.20 time: 0.323068 Aug 09 17:46:33.777751 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2596/5453] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:33 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:34.739305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:34.743243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:34.772873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:34.774162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:34.775246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:34.776877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:34.777973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:34.779322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:34.818401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:34.820325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:34.851667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:34.852650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:34.853516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:34.854865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:34.860421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:34.861572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:35.024378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:35.057038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:35.059156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:35.062105 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-57b2879b-677e-4dfe-adf7-7c2f21243ecd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.338550 Aug 09 17:46:35.062711 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2858/5454] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:34 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:35.305876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:35.310259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=69 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:35.346145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:35.355750 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:35.362773 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a4e0a7c5-0da7-4bfb-9c91-c09f46c42063 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1655 microversion: 2.20 time: 0.549823 Aug 09 17:46:35.369440 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2597/5455] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:34 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1655 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:46:35.839195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2593e271-6c7d-4a64-ad6c-2d1995917c0b req-71482f94-da54-4495-8414-808f4a718e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a34552-f7cd-4770-b3ef-be9226b0cd78", "name": "network-vif-deleted", "tag": "0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:46:35.867164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2593e271-6c7d-4a64-ad6c-2d1995917c0b req-71482f94-da54-4495-8414-808f4a718e66 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:35.871758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2593e271-6c7d-4a64-ad6c-2d1995917c0b req-71482f94-da54-4495-8414-808f4a718e66 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:35.872442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2593e271-6c7d-4a64-ad6c-2d1995917c0b req-71482f94-da54-4495-8414-808f4a718e66 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:35.898577 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2593e271-6c7d-4a64-ad6c-2d1995917c0b req-71482f94-da54-4495-8414-808f4a718e66 service nova] Creating event network-vif-deleted:0c4a1ebc-aebf-4bf7-80e3-e34dcb03dc90 for instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 on n-h1-845781-6 Aug 09 17:46:35.912517 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2593e271-6c7d-4a64-ad6c-2d1995917c0b req-71482f94-da54-4495-8414-808f4a718e66 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080130 Aug 09 17:46:35.913209 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2859/5456] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:46:36.099288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:36.100788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:36.117725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:36.117959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:36.118450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:36.119220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:36.120964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:36.121558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:36.280134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:36.294401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:36.296524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:36.301877 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5ebe6f10-ffc2-41cf-8ff7-18706bfa1b72 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.207803 Aug 09 17:46:36.305952 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2598/5457] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:36 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:46:36.413185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:36.414359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:36.424885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:36.425715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:36.426400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:36.438166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:36.445439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:36.446283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:36.508157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:36.508907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:36.509616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:36.510503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lazy-loading 'fault' on Instance uuid 08a34552-f7cd-4770-b3ef-be9226b0cd78 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:46:36.673493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:36.697631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:36.702723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5530d014d1a44119b8f0c5fa9e76b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ce4b0e2bf84d778a3cf81d91868f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:36.713793 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-71939de7-8793-4352-a866-82eaa3e77d3e tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 200 len: 1370 microversion: 2.20 time: 0.302897 Aug 09 17:46:36.714803 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2860/5458] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:36 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 1370 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:46:37.347844 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:37.348718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:37.363610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:37.364936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:37.367091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:37.368715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:37.370008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:37.371831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:37.491705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:37.503366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:37.512491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:37.513377 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d3af6110-6008-4274-9ed8-ed5af93c6ed3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.170126 Aug 09 17:46:37.515322 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2599/5459] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:37 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:46:37.754318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:37.757248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:37.766493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:37.767496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:37.768224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:37.769198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:37.769898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:37.770590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:37.792937 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] HTTP exception thrown: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Request method failure captured: Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 HTTP/1.1 Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pthMYdFxPYDku5unJwmhNtbW-CIsOCbcuzoSvZ1sUYsCWJDOK-PRp7ZrwqoOGBff1iE8OYCV2XhVOe0o5u0YhJo3NfdpuauYANC7XmZNwepkMQxxWJlaW5IilHkGR8cbJRr892I6gW6td5IwpwjU-Nm4mRlCKdr6CSrJxTF8vaIb30 Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e5530d014d1a44119b8f0c5fa9e76b3a Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '08a34552-f7cd-4770-b3ef-be9226b0cd78'} Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:37.795474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:37.801262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:37.801262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:37.801262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:37.801262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:37.801262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:46:37.801262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:46:37.801262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:37.801262 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:37.804856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Returning 404 to user: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:46:37.806133 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7adf6355-52f2-4149-8eeb-084ca2765d48 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 404 len: 111 microversion: 2.20 time: 0.056592 Aug 09 17:46:37.807338 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2861/5460] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:37 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:46:37.820429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d68ccfc8-5134-405d-9a11-52f6420844af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '.version_select at 0x7fbbdc9c09d0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:37.862401 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d68ccfc8-5134-405d-9a11-52f6420844af tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873118361" status: 204 len: 0 microversion: 2.20 time: 0.046386 Aug 09 17:46:37.863251 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2600/5461] 10.222.0.93 () {60 vars in 1259 bytes} [Tue Aug 9 17:46:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873118361 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:46:38.561289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:38.561811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:38.569925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:38.570419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:38.570865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:38.571605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:38.602761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:38.603315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:38.736261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:38.755596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:38.764893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:38.767162 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66ba9b56-413d-4efa-8548-808d2ecabc11 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.211660 Aug 09 17:46:38.771221 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2862/5462] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:38 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:46:39.816380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:39.821693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:39.851409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:39.852241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:39.853407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:39.854665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:39.855494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:39.856109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:40.027670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:40.067068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:40.072109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:40.077131 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1fbcf541-d91d-47b4-a1b6-4c4f1123b9b3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.269269 Aug 09 17:46:40.097759 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2601/5463] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:39 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:41.121080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:41.121795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:41.134335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:41.134847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:41.138721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:41.139580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:41.142356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:41.143026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:41.388628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:41.418007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:41.419599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:41.436213 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c978ac6-490d-4cbe-8322-a224825ca9ae tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.318409 Aug 09 17:46:41.439175 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2863/5464] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:41 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:42.495803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:42.496960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:42.536795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:42.538022 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:42.539276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:42.543812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:42.544618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:42.545294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:42.886946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:42.913865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:42.918106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:42.925427 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f0aae2f6-0bf2-4d61-8cf1-ef1e64b2f7d4 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.436999 Aug 09 17:46:42.930494 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2602/5465] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:42 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:44.017877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:44.024034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:44.085680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:44.086923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:44.087549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:44.088849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:44.089636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:44.090502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:44.263960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:44.282811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:44.298253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:44.299578 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-30089cfa-e4b6-4385-8699-718cbaf8ce3c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.315038 Aug 09 17:46:44.300599 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2864/5466] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:43 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:45.353667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:45.355528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:45.383313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:45.384867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:45.385693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:45.388327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:45.390214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:45.390785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:45.431140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:45.439746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:45.464325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:45.465193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:45.465994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:45.467337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:45.468244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:45.469364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:45.538089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] HTTP exception thrown: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Request method failure captured: Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 HTTP/1.1 Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pthMYdFxPYDku5unJwmhNtbW-CIsOCbcuzoSvZ1sUYsCWJDOK-PRp7ZrwqoOGBff1iE8OYCV2XhVOe0o5u0YhJo3NfdpuauYANC7XmZNwepkMQxxWJlaW5IilHkGR8cbJRr892I6gW6td5IwpwjU-Nm4mRlCKdr6CSrJxTF8vaIb30 Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e5530d014d1a44119b8f0c5fa9e76b3a Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '08a34552-f7cd-4770-b3ef-be9226b0cd78'} Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:46:45.540934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Returning 404 to user: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:46:45.550839 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-26b605f7-67e2-4a0f-b792-46d1ef852511 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "DELETE /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 404 len: 111 microversion: 2.20 time: 0.121414 Aug 09 17:46:45.554100 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2865/5467] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:46:45 2022] DELETE /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:46:45.559356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:45.563954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 08a34552-f7cd-4770-b3ef-be9226b0cd78] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:45.579354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:45.588583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:45.590476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:45.594190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:45.595457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:45.596944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:45.624996 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] HTTP exception thrown: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Request method failure captured: Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 HTTP/1.1 Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pthMYdFxPYDku5unJwmhNtbW-CIsOCbcuzoSvZ1sUYsCWJDOK-PRp7ZrwqoOGBff1iE8OYCV2XhVOe0o5u0YhJo3NfdpuauYANC7XmZNwepkMQxxWJlaW5IilHkGR8cbJRr892I6gW6td5IwpwjU-Nm4mRlCKdr6CSrJxTF8vaIb30 Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e5530d014d1a44119b8f0c5fa9e76b3a Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '08a34552-f7cd-4770-b3ef-be9226b0cd78'} Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:45.641087 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:45.645405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:45.645405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:45.645405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:45.645405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:45.645405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:46:45.645405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:46:45.645405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. Aug 09 17:46:45.645405 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:45.648121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Returning 404 to user: Instance 08a34552-f7cd-4770-b3ef-be9226b0cd78 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:46:45.649207 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-485c1d54-763c-4486-bbb9-81a020f6b78c tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78" status: 404 len: 111 microversion: 2.20 time: 0.096496 Aug 09 17:46:45.656846 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2866/5468] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:45 2022] GET /compute/v2.1/servers/08a34552-f7cd-4770-b3ef-be9226b0cd78 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:46:45.702274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:45.751826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:45.755175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:45.781556 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f052bb59-73cf-4b1a-a049-344540bbe0dd tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.456453 Aug 09 17:46:45.785282 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2603/5469] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:45 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:46.853625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:46.858396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:46.886780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:46.891794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:46.893806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:46.894879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:46.896400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:46.901200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:46.904137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:47.123035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:47.153543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:47.161650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:47.163089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0b02df04-3fd2-48d1-93d6-6e4e91f23284 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.331616 Aug 09 17:46:47.163742 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2867/5470] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:46 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:48.215026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:48.220841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:48.242783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:48.243584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:48.244237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:48.245370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:48.246003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:48.246598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:48.341628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:48.357181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:48.359165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:48.361490 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ccbbc046-56e4-477e-acb3-72182d40f66c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.156479 Aug 09 17:46:48.362699 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2604/5471] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:48 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:49.409403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:49.421204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:49.438123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:49.439392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:49.440840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:49.442679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:49.444380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:49.445388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:49.624304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:49.643168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:49.648861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:49.651618 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b06e231c-16a4-480d-a30c-bd1ac05127f6 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.253005 Aug 09 17:46:49.653100 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2868/5472] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:49 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:50.698610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:50.704048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:50.713787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:50.735551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:50.736105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:50.742368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:50.743366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:50.744172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:50.744640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:50.891337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:50.910618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:50.914760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:50.917882 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f73beb96-7bcb-4b74-851b-86e92f106f4c tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.226973 Aug 09 17:46:50.932810 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2605/5473] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:50 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:51.499822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:51.500733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:51.516057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:51.517403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:51.518252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:51.519525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:51.520392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:51.521316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:51.553809 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] HTTP exception thrown: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Request method failure captured: Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 HTTP/1.1 Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8pthMYdFxPYDku5unJwmhNtbW-CIsOCbcuzoSvZ1sUYsCWJDOK-PRp7ZrwqoOGBff1iE8OYCV2XhVOe0o5u0YhJo3NfdpuauYANC7XmZNwepkMQxxWJlaW5IilHkGR8cbJRr892I6gW6td5IwpwjU-Nm4mRlCKdr6CSrJxTF8vaIb30 Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e5530d014d1a44119b8f0c5fa9e76b3a Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8deacdae-0205-41a6-b164-640022f2eef4'} Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:46:51.557294 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Returning 404 to user: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a39dd80b-ed6f-4b17-b349-ea94b9461b82 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 404 len: 111 microversion: 2.20 time: 0.069468 Aug 09 17:46:51.567232 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2869/5474] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:46:51 2022] DELETE /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:46:51.573657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:51.574200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] [instance: 8deacdae-0205-41a6-b164-640022f2eef4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:51.582585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:51.583090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:51.583836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:51.585171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:51.585647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:51.586082 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:51.603050 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] HTTP exception thrown: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Request method failure captured: Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 HTTP/1.1 Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8pthMYdFxPYDku5unJwmhNtbW-CIsOCbcuzoSvZ1sUYsCWJDOK-PRp7ZrwqoOGBff1iE8OYCV2XhVOe0o5u0YhJo3NfdpuauYANC7XmZNwepkMQxxWJlaW5IilHkGR8cbJRr892I6gW6td5IwpwjU-Nm4mRlCKdr6CSrJxTF8vaIb30 Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39ce4b0e2bf84d778a3cf81d91868f0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 39ce4b0e2bf84d778a3cf81d91868f0d Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-411198214 Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: e5530d014d1a44119b8f0c5fa9e76b3a Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-AttachVolumeShelveTestJSON-411198214-project Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '8deacdae-0205-41a6-b164-640022f2eef4'} Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:46:51.605413 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:46:51.612084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:46:51.612084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:46:51.612084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:46:51.612084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:46:51.612084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:46:51.612084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:46:51.612084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. Aug 09 17:46:51.612084 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:46:51.615364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] Returning 404 to user: Instance 8deacdae-0205-41a6-b164-640022f2eef4 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:46:51.615364 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-de09ddee-9452-4492-8b2d-36c04d58d4f6 tempest-AttachVolumeShelveTestJSON-411198214 tempest-AttachVolumeShelveTestJSON-411198214-project] 10.222.0.93 "GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4" status: 404 len: 111 microversion: 2.20 time: 0.045723 Aug 09 17:46:51.616632 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2606/5475] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:51 2022] GET /compute/v2.1/servers/8deacdae-0205-41a6-b164-640022f2eef4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:46:51.961833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:51.962982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:51.984096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:51.991532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:51.992466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:51.994319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:51.997577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:51.998475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:52.273134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:52.309800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:52.316445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:52.318822 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a99b2492-ad85-4bc9-abe8-9f0a1458d9b9 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.364152 Aug 09 17:46:52.320030 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2870/5476] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:51 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:53.350670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:53.356235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:53.378594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:53.388614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:53.389404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:53.391490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:53.392656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:53.393719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:53.564520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:53.582518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:53.586313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:53.589375 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ced17ce7-4042-435e-a359-bfdad0299f68 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.247485 Aug 09 17:46:53.590941 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2607/5477] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:53 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:54.621156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:54.623518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:54.636851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:54.637851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:54.638946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:54.640093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:54.640774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:54.641354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:54.886168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:54.898765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:54.901339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:54.906493 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e4ac5d3e-b9d2-4b90-88e2-451d8266aad3 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1365 microversion: 2.57 time: 0.294993 Aug 09 17:46:54.908726 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2871/5478] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:54 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:55.952567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:55.953591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:55.982289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:55.983365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:55.984602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:55.986298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:55.987072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:55.987871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:56.323854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:56.363661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:56.367069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:56.376139 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2fff4a6f-2a9f-4942-8308-a85f5fe3fb2b tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1371 microversion: 2.57 time: 0.426147 Aug 09 17:46:56.377754 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2608/5479] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:55 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:46:57.450483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:57.453720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:57.477995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:57.479083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:57.479354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:57.489431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:57.490604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:57.492523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:57.508181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:46:57.800355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:57.830104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:57.868325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:57.876305 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-29fc5e74-b93c-44f4-964a-3fa20e07d615 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1371 microversion: 2.57 time: 0.440343 Aug 09 17:46:57.891660 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2872/5480] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:57 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:58.911414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:58.913437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:58.933227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:58.934633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:58.935846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:58.936816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:58.965900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:58.966858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:59.299941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:59.321818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:59.323705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:46:59.331683 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-17e42d7d-c699-4d1c-9f9b-f17e5aa4ac65 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1356 microversion: 2.57 time: 0.423368 Aug 09 17:46:59.360979 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2609/5481] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:58 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1356 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:46:59.375361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e66a28ec-b7f1-4958-bd8a-6a4fcc1a88a8 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:59.376917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e66a28ec-b7f1-4958-bd8a-6a4fcc1a88a8 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:59.406801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66a28ec-b7f1-4958-bd8a-6a4fcc1a88a8 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:59.407659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66a28ec-b7f1-4958-bd8a-6a4fcc1a88a8 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:59.408325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66a28ec-b7f1-4958-bd8a-6a4fcc1a88a8 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:59.409100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66a28ec-b7f1-4958-bd8a-6a4fcc1a88a8 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:59.409587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66a28ec-b7f1-4958-bd8a-6a4fcc1a88a8 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:59.410031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66a28ec-b7f1-4958-bd8a-6a4fcc1a88a8 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:59.500793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e66a28ec-b7f1-4958-bd8a-6a4fcc1a88a8 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:46:59.730570 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e66a28ec-b7f1-4958-bd8a-6a4fcc1a88a8 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 204 len: 0 microversion: 2.57 time: 0.358794 Aug 09 17:46:59.732544 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2873/5482] 10.222.0.93 () {60 vars in 1280 bytes} [Tue Aug 9 17:46:59 2022] DELETE /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:46:59.749490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:46:59.772559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:46:59.811292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:59.812993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:59.814077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:46:59.815123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:46:59.815885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:46:59.816489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:00.151483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:00.163140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:00.178628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:00.183961 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-41ccb169-3a04-460d-a417-575f80207add tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1362 microversion: 2.57 time: 0.444888 Aug 09 17:47:00.189949 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2610/5483] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:46:59 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 17:47:01.236435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:01.237911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:01.259783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:01.260996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:01.261988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:01.264151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:01.265130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:01.265795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:01.535793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:01.580696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:01.586747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:01.591506 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b4a0857d-ba75-4eb8-9085-b620656c8479 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1362 microversion: 2.57 time: 0.358855 Aug 09 17:47:01.597094 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2874/5484] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:47:01 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:47:02.644914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:02.650157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:02.669759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:02.674804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:02.679955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:02.681605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:02.682621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:02.684096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:02.803889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:02.808553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:02.811199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:02.812212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lazy-loading 'fault' on Instance uuid e0c66646-9fac-477b-8980-27d6c5e759c3 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:47:02.942159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:02.958427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:02.964407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd028bae2da824b9d9d49306644dd1e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1350a2b195475d84d2a2d6600c2eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:02.975047 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-52ef30b7-206b-4f69-a421-bad18897d37a tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 200 len: 1367 microversion: 2.57 time: 0.337903 Aug 09 17:47:02.976844 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2611/5485] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:47:02 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:47:04.021572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:04.022904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] [instance: e0c66646-9fac-477b-8980-27d6c5e759c3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:04.039733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:04.040631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:04.041347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:04.042340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:04.043055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:04.044073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:04.075456 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] HTTP exception thrown: Instance e0c66646-9fac-477b-8980-27d6c5e759c3 could not be found. Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Request method failure captured: Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 HTTP/1.1 Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p1nDWnZJ2UXe1bBaF8GOQPAsxCKvaImsPbMzhs2ccGDyiupFcruCnye5EkKTVw4h5IxiLIZ1AYzI7boquBIsdxLxqH1kWXCwTkrc1u229eW0fRbPabDSyKQYBGn0tNEAHrunMmJA8mIY85XtoAsERo5SEI3MQQ5mdhiqSBnyMI2tiQ Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Openstack-Nova-Api-Version: 2.57 Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 2b1350a2b195475d84d2a2d6600c2eaf Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerShowV257Test-1034124152 Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2b1350a2b195475d84d2a2d6600c2eaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b1350a2b195475d84d2a2d6600c2eaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b1350a2b195475d84d2a2d6600c2eaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2b1350a2b195475d84d2a2d6600c2eaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerShowV257Test-1034124152 Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 2b1350a2b195475d84d2a2d6600c2eaf Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerShowV257Test-1034124152 Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerShowV257Test-1034124152-project Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: d028bae2da824b9d9d49306644dd1e50 Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerShowV257Test-1034124152-project Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance e0c66646-9fac-477b-8980-27d6c5e759c3 could not be found. Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'e0c66646-9fac-477b-8980-27d6c5e759c3'} Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0c66646-9fac-477b-8980-27d6c5e759c3 could not be found. Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0c66646-9fac-477b-8980-27d6c5e759c3 could not be found. Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:47:04.077306 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:47:04.087857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:47:04.087857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:47:04.087857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:47:04.087857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:47:04.087857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:47:04.087857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0c66646-9fac-477b-8980-27d6c5e759c3 could not be found. Aug 09 17:47:04.087857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:47:04.087857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] Returning 404 to user: Instance e0c66646-9fac-477b-8980-27d6c5e759c3 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:47:04.087857 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-421abe3d-6e5d-4eca-9cc6-4ea50f15d670 tempest-ServerShowV257Test-1034124152 tempest-ServerShowV257Test-1034124152-project] 10.222.0.93 "GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3" status: 404 len: 111 microversion: 2.57 time: 0.062446 Aug 09 17:47:04.087857 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2875/5486] 10.222.0.93 () {60 vars in 1277 bytes} [Tue Aug 9 17:47:04 2022] GET /compute/v2.1/servers/e0c66646-9fac-477b-8980-27d6c5e759c3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:47:10.201454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7e5ed58d-cf24-4d3e-a40a-6fabbd6af8c9 tempest-ComputeTenantNetworksTest-2109369193 tempest-ComputeTenantNetworksTest-2109369193-project] Calling method '.version_select at 0x7fbbcb9453a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:10.580249 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7e5ed58d-cf24-4d3e-a40a-6fabbd6af8c9 tempest-ComputeTenantNetworksTest-2109369193 tempest-ComputeTenantNetworksTest-2109369193-project] 10.222.0.93 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.006500 Aug 09 17:47:10.583571 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2612/5487] 10.222.0.93 () {58 vars in 1158 bytes} [Tue Aug 9 17:47:09 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:47:10.596995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4da802ba-4405-4ae9-ae89-22c6371571ca tempest-ComputeTenantNetworksTest-2109369193 tempest-ComputeTenantNetworksTest-2109369193-project] Calling method '.version_select at 0x7fbbcb7b6d30>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:11.187487 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4da802ba-4405-4ae9-ae89-22c6371571ca tempest-ComputeTenantNetworksTest-2109369193 tempest-ComputeTenantNetworksTest-2109369193-project] 10.222.0.93 "GET /compute/v2.1/os-tenant-networks/71ef3979-b7aa-475a-947c-e46f68da30c8" status: 200 len: 140 microversion: 2.1 time: 0.595105 Aug 09 17:47:11.188435 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2876/5488] 10.222.0.93 () {58 vars in 1269 bytes} [Tue Aug 9 17:47:10 2022] GET /compute/v2.1/os-tenant-networks/71ef3979-b7aa-475a-947c-e46f68da30c8 => generated 140 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:47:28.117499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=15 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:47:28.120372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=77 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:47:28.725853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-897a92f8-e767-4b20-a96b-964e3baa1129 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Action: 'create', calling method: .version_select at 0x7fbbca51b1f0>, body: {"keypair": {"name": "tempest-keypair-593823927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZnf6ELlS/bwWz5JWn42AB3UoEgQff7yKJfd/MWhf69g0UlIuboB/Q7k0D2dpJnG2/y1d5lnfF28GUPUEEB96HZH+G7LmQv8OslpQOC+nFB3TIUbTFj8PWTT0X19dg7vg=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:47:28.795697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-897a92f8-e767-4b20-a96b-964e3baa1129 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Getting quotas for project 0c1b430bf48d450e88109a61dd2865df. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:47:28.802399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-897a92f8-e767-4b20-a96b-964e3baa1129 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Getting quotas for user a1c8a42d2fc848d4a6badae1b1e0a387 and project 0c1b430bf48d450e88109a61dd2865df. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:47:28.871986 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-897a92f8-e767-4b20-a96b-964e3baa1129 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.763352 Aug 09 17:47:28.876872 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2613/5489] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:47:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:47:33.055316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1737565155", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbce853b-2ef9-401c-86fd-3dd869f5aabb"}], "security_groups": [{"name": "tempest-securitygroup--532204042"}], "key_name": "tempest-keypair-593823927", "user_data": "}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:47:33.072702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:47:33.073672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:47:33.326685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] validate_networks() for [('dbce853b-2ef9-401c-86fd-3dd869f5aabb', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:47:34.309686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:47:34.310586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:47:34.310586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:47:34.310944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:47:34.311403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:47:34.330518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:34.334477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:34.335519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:34.336484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:34.336894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:34.337333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:34.389931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Getting quotas for project 0c1b430bf48d450e88109a61dd2865df. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:47:34.397870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Getting quotas for user a1c8a42d2fc848d4a6badae1b1e0a387 and project 0c1b430bf48d450e88109a61dd2865df. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:47:34.426553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:47:34.430976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:47:34.579535 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2d3bde8d-c244-4a33-af48-5af48b0ce741 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.524518 Aug 09 17:47:34.594984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-426c19e8-95df-4590-9e14-d5e9e8a36b40 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:34.595605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-426c19e8-95df-4590-9e14-d5e9e8a36b40 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:34.609243 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2877/5490] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:47:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:47:34.861455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-426c19e8-95df-4590-9e14-d5e9e8a36b40 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:34.877279 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-426c19e8-95df-4590-9e14-d5e9e8a36b40 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1237 microversion: 2.1 time: 0.286339 Aug 09 17:47:34.878106 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2614/5491] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:34 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1237 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:47:35.919273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-90e5bb5b-d7c0-4a26-b363-8810b76efee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:35.920846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-90e5bb5b-d7c0-4a26-b363-8810b76efee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:36.058968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-90e5bb5b-d7c0-4a26-b363-8810b76efee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:36.078282 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-90e5bb5b-d7c0-4a26-b363-8810b76efee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1237 microversion: 2.1 time: 0.167180 Aug 09 17:47:36.079581 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2878/5492] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:35 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1237 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:47:37.122355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7f624399-85b5-4aea-8f27-aeab6c8d8762 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:37.123171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7f624399-85b5-4aea-8f27-aeab6c8d8762 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:37.142406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f624399-85b5-4aea-8f27-aeab6c8d8762 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:37.143014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f624399-85b5-4aea-8f27-aeab6c8d8762 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:37.143470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f624399-85b5-4aea-8f27-aeab6c8d8762 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:37.144243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f624399-85b5-4aea-8f27-aeab6c8d8762 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:37.144703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f624399-85b5-4aea-8f27-aeab6c8d8762 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:37.145346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7f624399-85b5-4aea-8f27-aeab6c8d8762 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:37.454004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7f624399-85b5-4aea-8f27-aeab6c8d8762 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:37.494752 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7f624399-85b5-4aea-8f27-aeab6c8d8762 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1297 microversion: 2.1 time: 0.374728 Aug 09 17:47:37.497610 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2615/5493] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:37 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1297 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:38.533808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-85385616-a219-4033-ad52-390f6322ed98 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:38.540952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-85385616-a219-4033-ad52-390f6322ed98 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:38.575597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85385616-a219-4033-ad52-390f6322ed98 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:38.578496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85385616-a219-4033-ad52-390f6322ed98 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:38.580121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85385616-a219-4033-ad52-390f6322ed98 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:38.586041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85385616-a219-4033-ad52-390f6322ed98 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:38.586992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85385616-a219-4033-ad52-390f6322ed98 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:38.590837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85385616-a219-4033-ad52-390f6322ed98 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:38.740659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-85385616-a219-4033-ad52-390f6322ed98 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:38.755955 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-85385616-a219-4033-ad52-390f6322ed98 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1295 microversion: 2.1 time: 0.236244 Aug 09 17:47:38.758551 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2879/5494] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:38 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1295 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:39.787715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0c3e26b2-7387-460c-97c3-f5fd6d43af06 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:39.788829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0c3e26b2-7387-460c-97c3-f5fd6d43af06 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:39.821925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c3e26b2-7387-460c-97c3-f5fd6d43af06 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:39.823359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c3e26b2-7387-460c-97c3-f5fd6d43af06 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:39.823982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c3e26b2-7387-460c-97c3-f5fd6d43af06 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:39.831491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c3e26b2-7387-460c-97c3-f5fd6d43af06 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:39.832156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c3e26b2-7387-460c-97c3-f5fd6d43af06 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:39.832718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0c3e26b2-7387-460c-97c3-f5fd6d43af06 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:40.460960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0c3e26b2-7387-460c-97c3-f5fd6d43af06 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:40.473171 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0c3e26b2-7387-460c-97c3-f5fd6d43af06 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1362 microversion: 2.1 time: 0.697636 Aug 09 17:47:40.483945 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2616/5495] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:39 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1362 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:40.771189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-711e0a60-3567-4530-b6a7-37970baa6a20 req-3c1bfd7c-cc43-4c98-8bca-cbe3f9d2204f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925758f3-e4b4-44d9-941d-d10ba53df59e", "tag": "9fc9d744-a71d-4de6-a351-dd88cd2f8459"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:47:40.793435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-711e0a60-3567-4530-b6a7-37970baa6a20 req-3c1bfd7c-cc43-4c98-8bca-cbe3f9d2204f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:40.798001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-711e0a60-3567-4530-b6a7-37970baa6a20 req-3c1bfd7c-cc43-4c98-8bca-cbe3f9d2204f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:40.798295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-711e0a60-3567-4530-b6a7-37970baa6a20 req-3c1bfd7c-cc43-4c98-8bca-cbe3f9d2204f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:40.824708 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-711e0a60-3567-4530-b6a7-37970baa6a20 req-3c1bfd7c-cc43-4c98-8bca-cbe3f9d2204f service nova] Creating event network-changed:9fc9d744-a71d-4de6-a351-dd88cd2f8459 for instance 925758f3-e4b4-44d9-941d-d10ba53df59e on n-h1-845781-6 Aug 09 17:47:40.837313 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-711e0a60-3567-4530-b6a7-37970baa6a20 req-3c1bfd7c-cc43-4c98-8bca-cbe3f9d2204f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070248 Aug 09 17:47:40.839505 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2880/5496] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:47:41.501894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d1a2bcc7-1f44-457f-8262-d7792e745920 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:41.503901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d1a2bcc7-1f44-457f-8262-d7792e745920 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:41.514241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1a2bcc7-1f44-457f-8262-d7792e745920 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:41.515112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1a2bcc7-1f44-457f-8262-d7792e745920 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:41.515866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1a2bcc7-1f44-457f-8262-d7792e745920 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:41.516940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1a2bcc7-1f44-457f-8262-d7792e745920 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:41.517577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1a2bcc7-1f44-457f-8262-d7792e745920 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:41.518579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d1a2bcc7-1f44-457f-8262-d7792e745920 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:41.754131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d1a2bcc7-1f44-457f-8262-d7792e745920 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:41.772237 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d1a2bcc7-1f44-457f-8262-d7792e745920 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1362 microversion: 2.1 time: 0.275437 Aug 09 17:47:41.773571 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2617/5497] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:41 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:42.796244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-57002a1d-ad98-4651-b9f4-eedef50327c2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:42.797016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-57002a1d-ad98-4651-b9f4-eedef50327c2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:42.812850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57002a1d-ad98-4651-b9f4-eedef50327c2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:42.813361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57002a1d-ad98-4651-b9f4-eedef50327c2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:42.813810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57002a1d-ad98-4651-b9f4-eedef50327c2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:42.814539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57002a1d-ad98-4651-b9f4-eedef50327c2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:42.815004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57002a1d-ad98-4651-b9f4-eedef50327c2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:42.815439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-57002a1d-ad98-4651-b9f4-eedef50327c2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:43.206974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-57002a1d-ad98-4651-b9f4-eedef50327c2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:43.226139 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-57002a1d-ad98-4651-b9f4-eedef50327c2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1362 microversion: 2.1 time: 0.431200 Aug 09 17:47:43.228778 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2881/5498] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:42 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:44.268593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e7e9f94d-686c-4ea7-8dd4-aa1312e537b9 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:44.269435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e7e9f94d-686c-4ea7-8dd4-aa1312e537b9 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:44.278603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7e9f94d-686c-4ea7-8dd4-aa1312e537b9 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:44.279274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7e9f94d-686c-4ea7-8dd4-aa1312e537b9 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:44.279756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7e9f94d-686c-4ea7-8dd4-aa1312e537b9 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:44.280727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7e9f94d-686c-4ea7-8dd4-aa1312e537b9 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:44.281203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7e9f94d-686c-4ea7-8dd4-aa1312e537b9 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:44.281637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7e9f94d-686c-4ea7-8dd4-aa1312e537b9 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:44.477000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e7e9f94d-686c-4ea7-8dd4-aa1312e537b9 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:44.491734 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e7e9f94d-686c-4ea7-8dd4-aa1312e537b9 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1362 microversion: 2.1 time: 0.227280 Aug 09 17:47:44.493137 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2618/5499] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:44 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:45.535115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66cdc567-794a-48a1-a924-11c0c04f3162 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:45.542990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-66cdc567-794a-48a1-a924-11c0c04f3162 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:45.568087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:47:45.604516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cdc567-794a-48a1-a924-11c0c04f3162 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:45.605556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cdc567-794a-48a1-a924-11c0c04f3162 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:45.617066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cdc567-794a-48a1-a924-11c0c04f3162 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:45.619210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cdc567-794a-48a1-a924-11c0c04f3162 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:45.620065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cdc567-794a-48a1-a924-11c0c04f3162 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:45.621298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66cdc567-794a-48a1-a924-11c0c04f3162 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:45.963461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-66cdc567-794a-48a1-a924-11c0c04f3162 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:46.029267 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66cdc567-794a-48a1-a924-11c0c04f3162 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1362 microversion: 2.1 time: 0.498879 Aug 09 17:47:46.038634 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2882/5500] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:45 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1362 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:47.053886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c3fd9859-372d-4f17-9d32-b9b831beea05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:47.054818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c3fd9859-372d-4f17-9d32-b9b831beea05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:47.057061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:47:47.080808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3fd9859-372d-4f17-9d32-b9b831beea05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:47.082648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3fd9859-372d-4f17-9d32-b9b831beea05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:47.083175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3fd9859-372d-4f17-9d32-b9b831beea05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:47.083983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3fd9859-372d-4f17-9d32-b9b831beea05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:47.084462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3fd9859-372d-4f17-9d32-b9b831beea05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:47.087893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c3fd9859-372d-4f17-9d32-b9b831beea05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:47.488023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c3fd9859-372d-4f17-9d32-b9b831beea05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:47.497923 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c3fd9859-372d-4f17-9d32-b9b831beea05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1362 microversion: 2.1 time: 0.450667 Aug 09 17:47:47.502806 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2619/5501] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:47 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1362 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:48.520594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:47:48.527927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88e365f8-838e-40ab-9be2-bd855f3514ae tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:48.529114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88e365f8-838e-40ab-9be2-bd855f3514ae tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:48.568844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e365f8-838e-40ab-9be2-bd855f3514ae tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:48.581697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e365f8-838e-40ab-9be2-bd855f3514ae tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:48.582677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e365f8-838e-40ab-9be2-bd855f3514ae tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:48.595822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e365f8-838e-40ab-9be2-bd855f3514ae tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:48.598995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e365f8-838e-40ab-9be2-bd855f3514ae tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:48.605324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e365f8-838e-40ab-9be2-bd855f3514ae tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:48.872588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-05c8f364-f5c0-4e1d-81cc-3ea64e97c5c9 req-4733e4a9-2c02-4a0b-8bf9-b4bf7b4730bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925758f3-e4b4-44d9-941d-d10ba53df59e", "name": "network-vif-plugged", "status": "completed", "tag": "9fc9d744-a71d-4de6-a351-dd88cd2f8459"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:47:48.899413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-05c8f364-f5c0-4e1d-81cc-3ea64e97c5c9 req-4733e4a9-2c02-4a0b-8bf9-b4bf7b4730bf service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:48.902154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-05c8f364-f5c0-4e1d-81cc-3ea64e97c5c9 req-4733e4a9-2c02-4a0b-8bf9-b4bf7b4730bf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:48.904546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-05c8f364-f5c0-4e1d-81cc-3ea64e97c5c9 req-4733e4a9-2c02-4a0b-8bf9-b4bf7b4730bf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:48.940129 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-05c8f364-f5c0-4e1d-81cc-3ea64e97c5c9 req-4733e4a9-2c02-4a0b-8bf9-b4bf7b4730bf service nova] Creating event network-vif-plugged:9fc9d744-a71d-4de6-a351-dd88cd2f8459 for instance 925758f3-e4b4-44d9-941d-d10ba53df59e on n-h1-845781-6 Aug 09 17:47:48.958329 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-05c8f364-f5c0-4e1d-81cc-3ea64e97c5c9 req-4733e4a9-2c02-4a0b-8bf9-b4bf7b4730bf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094397 Aug 09 17:47:48.960322 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2620/5502] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 09 17:47:49.138977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-88e365f8-838e-40ab-9be2-bd855f3514ae tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:49.153324 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88e365f8-838e-40ab-9be2-bd855f3514ae tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1362 microversion: 2.1 time: 0.630414 Aug 09 17:47:49.154107 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2883/5503] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:48 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1362 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:50.203448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-45b9dc17-5274-437b-a264-7b7dd179bccf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:50.203448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-45b9dc17-5274-437b-a264-7b7dd179bccf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:50.243928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45b9dc17-5274-437b-a264-7b7dd179bccf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:50.245442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45b9dc17-5274-437b-a264-7b7dd179bccf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:50.248258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45b9dc17-5274-437b-a264-7b7dd179bccf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:50.258041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45b9dc17-5274-437b-a264-7b7dd179bccf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:50.260211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45b9dc17-5274-437b-a264-7b7dd179bccf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:50.261894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45b9dc17-5274-437b-a264-7b7dd179bccf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:50.889868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45b9dc17-5274-437b-a264-7b7dd179bccf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:50.904399 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-45b9dc17-5274-437b-a264-7b7dd179bccf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1362 microversion: 2.1 time: 0.712940 Aug 09 17:47:50.906179 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2621/5504] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:50 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1362 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:51.934758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-103fe2af-9ee3-4391-ac22-3f51fac66a10 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:51.936236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-103fe2af-9ee3-4391-ac22-3f51fac66a10 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:51.952238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103fe2af-9ee3-4391-ac22-3f51fac66a10 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:51.953313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103fe2af-9ee3-4391-ac22-3f51fac66a10 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:51.954055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103fe2af-9ee3-4391-ac22-3f51fac66a10 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:51.955542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103fe2af-9ee3-4391-ac22-3f51fac66a10 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:51.956559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103fe2af-9ee3-4391-ac22-3f51fac66a10 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:51.961857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103fe2af-9ee3-4391-ac22-3f51fac66a10 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:52.374604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-103fe2af-9ee3-4391-ac22-3f51fac66a10 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:52.394858 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-103fe2af-9ee3-4391-ac22-3f51fac66a10 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1546 microversion: 2.1 time: 0.468846 Aug 09 17:47:52.402591 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2884/5505] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:51 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1546 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:52.435893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4a5f02c0-e52b-48e9-bde1-fc7e2e100691 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:52.436798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4a5f02c0-e52b-48e9-bde1-fc7e2e100691 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:52.469221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a5f02c0-e52b-48e9-bde1-fc7e2e100691 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:52.469701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a5f02c0-e52b-48e9-bde1-fc7e2e100691 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:52.470410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a5f02c0-e52b-48e9-bde1-fc7e2e100691 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:52.472006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a5f02c0-e52b-48e9-bde1-fc7e2e100691 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:52.473383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a5f02c0-e52b-48e9-bde1-fc7e2e100691 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:52.478516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4a5f02c0-e52b-48e9-bde1-fc7e2e100691 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:52.742104 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4a5f02c0-e52b-48e9-bde1-fc7e2e100691 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.314438 Aug 09 17:47:52.743059 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2622/5506] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:47:52 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/os-interface => generated 284 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:47:54.518650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-954224298", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "54ba96d2-a204-4b69-9763-06fce9fb3bfc"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:47:54.703028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] validate_networks() for [('54ba96d2-a204-4b69-9763-06fce9fb3bfc', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:47:55.714331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:47:55.716396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:47:55.717496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:47:55.718427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:47:55.719145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:47:55.747910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:55.748929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:55.749807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:55.751790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:55.753223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:55.754364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:55.807891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Getting quotas for project 851c31088c424620850af4b3894deb0b. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:47:55.823176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Getting quotas for user 66fd4303341d449c92c2837c2e08e205 and project 851c31088c424620850af4b3894deb0b. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:47:55.915755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:47:55.932675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:47:56.183085 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bc0b8b6e-7f1d-423e-83c4-b85d29ff0017 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.973508 Aug 09 17:47:56.213621 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2885/5507] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:47:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:47:56.223820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c184d085-763a-42d6-9ca6-e20233cff929 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:56.225029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c184d085-763a-42d6-9ca6-e20233cff929 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:56.426431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c184d085-763a-42d6-9ca6-e20233cff929 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:56.439537 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c184d085-763a-42d6-9ca6-e20233cff929 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1213 microversion: 2.1 time: 0.235163 Aug 09 17:47:56.456290 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2623/5508] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:56 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1213 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:56.500441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-875d8afb-2dd4-4e19-8cce-7105e0d935db req-c5abaede-81ca-418f-871f-aadbe222e5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925758f3-e4b4-44d9-941d-d10ba53df59e", "tag": "9fc9d744-a71d-4de6-a351-dd88cd2f8459"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:47:56.545638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-875d8afb-2dd4-4e19-8cce-7105e0d935db req-c5abaede-81ca-418f-871f-aadbe222e5ee service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:56.548343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-875d8afb-2dd4-4e19-8cce-7105e0d935db req-c5abaede-81ca-418f-871f-aadbe222e5ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:56.551300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-875d8afb-2dd4-4e19-8cce-7105e0d935db req-c5abaede-81ca-418f-871f-aadbe222e5ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:56.598348 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-875d8afb-2dd4-4e19-8cce-7105e0d935db req-c5abaede-81ca-418f-871f-aadbe222e5ee service nova] Creating event network-changed:9fc9d744-a71d-4de6-a351-dd88cd2f8459 for instance 925758f3-e4b4-44d9-941d-d10ba53df59e on n-h1-845781-6 Aug 09 17:47:56.610859 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-875d8afb-2dd4-4e19-8cce-7105e0d935db req-c5abaede-81ca-418f-871f-aadbe222e5ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115329 Aug 09 17:47:56.612669 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2886/5509] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:47:57.465224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a877957-5373-4eef-a79c-f0993ba88198 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:57.466530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9a877957-5373-4eef-a79c-f0993ba88198 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:57.666045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a877957-5373-4eef-a79c-f0993ba88198 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:57.696225 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a877957-5373-4eef-a79c-f0993ba88198 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1213 microversion: 2.1 time: 0.230731 Aug 09 17:47:57.696934 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2624/5510] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:57 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1213 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:47:58.735510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eac065c9-b763-4972-9528-a43d71d18f96 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:47:58.738693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eac065c9-b763-4972-9528-a43d71d18f96 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:47:58.776369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eac065c9-b763-4972-9528-a43d71d18f96 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:58.779150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eac065c9-b763-4972-9528-a43d71d18f96 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:58.780570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eac065c9-b763-4972-9528-a43d71d18f96 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:58.784443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eac065c9-b763-4972-9528-a43d71d18f96 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:47:58.788265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eac065c9-b763-4972-9528-a43d71d18f96 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:47:58.791032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eac065c9-b763-4972-9528-a43d71d18f96 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:47:59.055327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eac065c9-b763-4972-9528-a43d71d18f96 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:47:59.066768 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eac065c9-b763-4972-9528-a43d71d18f96 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1265 microversion: 2.1 time: 0.347803 Aug 09 17:47:59.068176 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2887/5511] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:47:58 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1265 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:00.114761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-53d72b5c-d4e6-4cf9-9a78-7c39b53041e2 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:00.118614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-53d72b5c-d4e6-4cf9-9a78-7c39b53041e2 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:00.136821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:00.159271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53d72b5c-d4e6-4cf9-9a78-7c39b53041e2 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:00.161434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53d72b5c-d4e6-4cf9-9a78-7c39b53041e2 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:00.162370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53d72b5c-d4e6-4cf9-9a78-7c39b53041e2 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:00.166106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53d72b5c-d4e6-4cf9-9a78-7c39b53041e2 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:00.168821 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53d72b5c-d4e6-4cf9-9a78-7c39b53041e2 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:00.171117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53d72b5c-d4e6-4cf9-9a78-7c39b53041e2 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:00.193992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=43 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:00.587376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-53d72b5c-d4e6-4cf9-9a78-7c39b53041e2 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:00.604513 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-53d72b5c-d4e6-4cf9-9a78-7c39b53041e2 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1313 microversion: 2.1 time: 0.513882 Aug 09 17:48:00.626741 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2625/5512] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:00 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1313 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:01.657384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94785a5f-fa34-40aa-9a4e-cd51e8c682f4 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:01.657384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94785a5f-fa34-40aa-9a4e-cd51e8c682f4 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:01.671691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94785a5f-fa34-40aa-9a4e-cd51e8c682f4 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:01.672612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94785a5f-fa34-40aa-9a4e-cd51e8c682f4 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:01.674047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94785a5f-fa34-40aa-9a4e-cd51e8c682f4 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:01.675715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94785a5f-fa34-40aa-9a4e-cd51e8c682f4 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:01.678955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94785a5f-fa34-40aa-9a4e-cd51e8c682f4 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:01.681131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94785a5f-fa34-40aa-9a4e-cd51e8c682f4 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:01.997563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-f4d782cd-badc-43dd-a706-b6884955271e req-4801b4c5-2798-433f-8f0c-a8e7856b363c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608d1f24-7fbe-4df1-bfe1-a807d1ba2d76", "tag": "2e29cbff-99ca-4eda-aaa0-3a6e9356d817"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:48:02.035315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f4d782cd-badc-43dd-a706-b6884955271e req-4801b4c5-2798-433f-8f0c-a8e7856b363c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:02.040100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f4d782cd-badc-43dd-a706-b6884955271e req-4801b4c5-2798-433f-8f0c-a8e7856b363c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:02.041072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f4d782cd-badc-43dd-a706-b6884955271e req-4801b4c5-2798-433f-8f0c-a8e7856b363c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:02.084466 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-f4d782cd-badc-43dd-a706-b6884955271e req-4801b4c5-2798-433f-8f0c-a8e7856b363c service nova] Creating event network-changed:2e29cbff-99ca-4eda-aaa0-3a6e9356d817 for instance 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 on n-h2-845781-6 Aug 09 17:48:02.085419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94785a5f-fa34-40aa-9a4e-cd51e8c682f4 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:02.105557 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94785a5f-fa34-40aa-9a4e-cd51e8c682f4 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1313 microversion: 2.1 time: 0.460603 Aug 09 17:48:02.106451 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2888/5513] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:01 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:02.114282 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-f4d782cd-badc-43dd-a706-b6884955271e req-4801b4c5-2798-433f-8f0c-a8e7856b363c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120256 Aug 09 17:48:02.123026 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2626/5514] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:48:03.157980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8ad9848e-7e75-4c2c-8e6c-b5a6120d308d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:03.160454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ad9848e-7e75-4c2c-8e6c-b5a6120d308d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:03.181274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:03.186079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ad9848e-7e75-4c2c-8e6c-b5a6120d308d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:03.188220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ad9848e-7e75-4c2c-8e6c-b5a6120d308d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:03.188785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ad9848e-7e75-4c2c-8e6c-b5a6120d308d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:03.190185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ad9848e-7e75-4c2c-8e6c-b5a6120d308d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:03.190428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ad9848e-7e75-4c2c-8e6c-b5a6120d308d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:03.190848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ad9848e-7e75-4c2c-8e6c-b5a6120d308d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:03.218970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=51 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:03.488009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8ad9848e-7e75-4c2c-8e6c-b5a6120d308d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:03.497231 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8ad9848e-7e75-4c2c-8e6c-b5a6120d308d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1313 microversion: 2.1 time: 0.359733 Aug 09 17:48:03.511899 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2889/5515] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:03 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:04.522692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7df3bb6e-a5a5-4592-8bab-8860a729f615 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:04.523548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7df3bb6e-a5a5-4592-8bab-8860a729f615 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:04.540027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7df3bb6e-a5a5-4592-8bab-8860a729f615 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:04.540532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7df3bb6e-a5a5-4592-8bab-8860a729f615 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:04.540974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7df3bb6e-a5a5-4592-8bab-8860a729f615 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:04.541694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7df3bb6e-a5a5-4592-8bab-8860a729f615 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:04.542165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7df3bb6e-a5a5-4592-8bab-8860a729f615 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:04.542596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7df3bb6e-a5a5-4592-8bab-8860a729f615 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:04.738796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7df3bb6e-a5a5-4592-8bab-8860a729f615 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:04.763184 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7df3bb6e-a5a5-4592-8bab-8860a729f615 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1313 microversion: 2.1 time: 0.247445 Aug 09 17:48:04.767597 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2627/5516] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:04 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:05.806833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-63adbdcd-4901-4fe6-9703-2c950566379e tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:05.807511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-63adbdcd-4901-4fe6-9703-2c950566379e tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:05.810729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:05.820200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63adbdcd-4901-4fe6-9703-2c950566379e tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:05.820996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63adbdcd-4901-4fe6-9703-2c950566379e tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:05.821624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63adbdcd-4901-4fe6-9703-2c950566379e tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:05.822548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63adbdcd-4901-4fe6-9703-2c950566379e tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:05.823271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63adbdcd-4901-4fe6-9703-2c950566379e tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:05.823909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63adbdcd-4901-4fe6-9703-2c950566379e tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:05.875489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:05.994574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-63adbdcd-4901-4fe6-9703-2c950566379e tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:06.005684 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-63adbdcd-4901-4fe6-9703-2c950566379e tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1313 microversion: 2.1 time: 0.202681 Aug 09 17:48:06.006414 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2890/5517] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:05 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:07.061121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-675792ab-f3bc-436a-b910-a93ac3deef14 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:07.064516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-675792ab-f3bc-436a-b910-a93ac3deef14 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:07.088835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675792ab-f3bc-436a-b910-a93ac3deef14 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:07.089888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675792ab-f3bc-436a-b910-a93ac3deef14 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:07.091536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675792ab-f3bc-436a-b910-a93ac3deef14 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:07.093371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675792ab-f3bc-436a-b910-a93ac3deef14 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:07.094511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675792ab-f3bc-436a-b910-a93ac3deef14 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:07.095408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675792ab-f3bc-436a-b910-a93ac3deef14 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:07.572969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-675792ab-f3bc-436a-b910-a93ac3deef14 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:07.588706 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-675792ab-f3bc-436a-b910-a93ac3deef14 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1313 microversion: 2.1 time: 0.535332 Aug 09 17:48:07.590608 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2628/5518] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:07 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:08.622689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e0d72960-f8f0-43b0-b761-145a9eafe49d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:08.623405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e0d72960-f8f0-43b0-b761-145a9eafe49d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:08.634146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0d72960-f8f0-43b0-b761-145a9eafe49d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:08.634685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0d72960-f8f0-43b0-b761-145a9eafe49d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:08.637593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0d72960-f8f0-43b0-b761-145a9eafe49d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:08.640954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0d72960-f8f0-43b0-b761-145a9eafe49d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:08.646881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0d72960-f8f0-43b0-b761-145a9eafe49d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:08.647904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0d72960-f8f0-43b0-b761-145a9eafe49d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:09.090189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-13b34e1f-0c38-4bdd-8bad-9bd02ad978be req-4edaabc6-9504-4f9f-a62a-1ce3eeaf7517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608d1f24-7fbe-4df1-bfe1-a807d1ba2d76", "name": "network-vif-plugged", "status": "completed", "tag": "2e29cbff-99ca-4eda-aaa0-3a6e9356d817"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:48:09.106190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:09.124747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-13b34e1f-0c38-4bdd-8bad-9bd02ad978be req-4edaabc6-9504-4f9f-a62a-1ce3eeaf7517 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:09.125235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-13b34e1f-0c38-4bdd-8bad-9bd02ad978be req-4edaabc6-9504-4f9f-a62a-1ce3eeaf7517 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:09.125665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-13b34e1f-0c38-4bdd-8bad-9bd02ad978be req-4edaabc6-9504-4f9f-a62a-1ce3eeaf7517 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:09.156380 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-13b34e1f-0c38-4bdd-8bad-9bd02ad978be req-4edaabc6-9504-4f9f-a62a-1ce3eeaf7517 service nova] Creating event network-vif-plugged:2e29cbff-99ca-4eda-aaa0-3a6e9356d817 for instance 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 on n-h2-845781-6 Aug 09 17:48:09.163592 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-13b34e1f-0c38-4bdd-8bad-9bd02ad978be req-4edaabc6-9504-4f9f-a62a-1ce3eeaf7517 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079872 Aug 09 17:48:09.167176 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2629/5519] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:48:09.494288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e0d72960-f8f0-43b0-b761-145a9eafe49d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:09.528173 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e0d72960-f8f0-43b0-b761-145a9eafe49d tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1313 microversion: 2.1 time: 0.908800 Aug 09 17:48:09.529511 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2891/5520] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:08 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1313 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:10.566711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba1413a0-f770-4202-bc42-869983ad1149 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:10.567525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ba1413a0-f770-4202-bc42-869983ad1149 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:10.580697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba1413a0-f770-4202-bc42-869983ad1149 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:10.581077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba1413a0-f770-4202-bc42-869983ad1149 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:10.581756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba1413a0-f770-4202-bc42-869983ad1149 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:10.582379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba1413a0-f770-4202-bc42-869983ad1149 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:10.582831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba1413a0-f770-4202-bc42-869983ad1149 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:10.583281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba1413a0-f770-4202-bc42-869983ad1149 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:10.914737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ba1413a0-f770-4202-bc42-869983ad1149 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:10.928192 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ba1413a0-f770-4202-bc42-869983ad1149 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1313 microversion: 2.1 time: 0.366626 Aug 09 17:48:10.947663 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2630/5521] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:10 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:11.977282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-449beb0e-3f46-41cd-b815-70f00c4b81a6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:11.980687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-449beb0e-3f46-41cd-b815-70f00c4b81a6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:12.014325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449beb0e-3f46-41cd-b815-70f00c4b81a6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:12.020788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449beb0e-3f46-41cd-b815-70f00c4b81a6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:12.021980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449beb0e-3f46-41cd-b815-70f00c4b81a6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:12.028882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449beb0e-3f46-41cd-b815-70f00c4b81a6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:12.030695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449beb0e-3f46-41cd-b815-70f00c4b81a6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:12.031790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-449beb0e-3f46-41cd-b815-70f00c4b81a6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:12.391089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-449beb0e-3f46-41cd-b815-70f00c4b81a6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:12.405818 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-449beb0e-3f46-41cd-b815-70f00c4b81a6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1496 microversion: 2.1 time: 0.436166 Aug 09 17:48:12.406913 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2892/5522] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:11 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1496 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:18.294492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2a78a383-50db-4756-b2b2-ddd0dab97630 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:18.295262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2a78a383-50db-4756-b2b2-ddd0dab97630 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:18.311216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a78a383-50db-4756-b2b2-ddd0dab97630 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:18.314341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a78a383-50db-4756-b2b2-ddd0dab97630 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:18.317005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a78a383-50db-4756-b2b2-ddd0dab97630 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:18.318177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a78a383-50db-4756-b2b2-ddd0dab97630 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:18.321315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a78a383-50db-4756-b2b2-ddd0dab97630 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:18.322195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2a78a383-50db-4756-b2b2-ddd0dab97630 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:18.421505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2a78a383-50db-4756-b2b2-ddd0dab97630 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:48:18.629591 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2a78a383-50db-4756-b2b2-ddd0dab97630 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "DELETE /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 204 len: 0 microversion: 2.1 time: 0.340849 Aug 09 17:48:18.631539 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2631/5523] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:48:18 2022] DELETE /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:48:18.645027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2773f80d-87a5-47b3-92fb-c6c00c1a0573 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:18.647262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2773f80d-87a5-47b3-92fb-c6c00c1a0573 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:18.687424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2773f80d-87a5-47b3-92fb-c6c00c1a0573 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:18.696787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2773f80d-87a5-47b3-92fb-c6c00c1a0573 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:18.699262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2773f80d-87a5-47b3-92fb-c6c00c1a0573 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:18.703268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2773f80d-87a5-47b3-92fb-c6c00c1a0573 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:18.707358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2773f80d-87a5-47b3-92fb-c6c00c1a0573 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:18.708301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2773f80d-87a5-47b3-92fb-c6c00c1a0573 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:19.098905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2773f80d-87a5-47b3-92fb-c6c00c1a0573 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:19.117888 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2773f80d-87a5-47b3-92fb-c6c00c1a0573 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1502 microversion: 2.1 time: 0.479072 Aug 09 17:48:19.119464 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2893/5524] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:18 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1502 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:20.164503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3b490809-1a53-4c23-87e0-2ed625272f3a tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:20.169025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3b490809-1a53-4c23-87e0-2ed625272f3a tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:20.202999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b490809-1a53-4c23-87e0-2ed625272f3a tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:20.207296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b490809-1a53-4c23-87e0-2ed625272f3a tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:20.210752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b490809-1a53-4c23-87e0-2ed625272f3a tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:20.212343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b490809-1a53-4c23-87e0-2ed625272f3a tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:20.213232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b490809-1a53-4c23-87e0-2ed625272f3a tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:20.214039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3b490809-1a53-4c23-87e0-2ed625272f3a tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:20.854901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3b490809-1a53-4c23-87e0-2ed625272f3a tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:20.872409 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3b490809-1a53-4c23-87e0-2ed625272f3a tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1502 microversion: 2.1 time: 0.719810 Aug 09 17:48:20.875475 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2632/5525] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:20 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1502 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:21.753387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-86a18204-57c8-47bb-81e7-bd013cc5e476 req-0a929d2e-d9d0-4802-901d-9d7aa650e068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608d1f24-7fbe-4df1-bfe1-a807d1ba2d76", "name": "network-vif-deleted", "tag": "2e29cbff-99ca-4eda-aaa0-3a6e9356d817"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:48:21.821398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-86a18204-57c8-47bb-81e7-bd013cc5e476 req-0a929d2e-d9d0-4802-901d-9d7aa650e068 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:21.822592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-86a18204-57c8-47bb-81e7-bd013cc5e476 req-0a929d2e-d9d0-4802-901d-9d7aa650e068 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:21.823862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-86a18204-57c8-47bb-81e7-bd013cc5e476 req-0a929d2e-d9d0-4802-901d-9d7aa650e068 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:21.875976 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-86a18204-57c8-47bb-81e7-bd013cc5e476 req-0a929d2e-d9d0-4802-901d-9d7aa650e068 service nova] Creating event network-vif-deleted:2e29cbff-99ca-4eda-aaa0-3a6e9356d817 for instance 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 on n-h2-845781-6 Aug 09 17:48:21.890648 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-86a18204-57c8-47bb-81e7-bd013cc5e476 req-0a929d2e-d9d0-4802-901d-9d7aa650e068 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150235 Aug 09 17:48:21.891973 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2894/5526] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:48:21.927019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:21.928912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:21.949708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:21.950548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:21.952589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:21.953615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:21.957897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:21.958967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:22.014726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:22.015253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:22.015751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:22.016274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lazy-loading 'fault' on Instance uuid 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:48:22.489778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66fd4303341d449c92c2837c2e08e205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c31088c424620850af4b3894deb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:22.506482 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8b54a0dd-251a-4e4c-8acf-eb0a1531f828 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 200 len: 1303 microversion: 2.1 time: 0.594326 Aug 09 17:48:22.507242 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2633/5527] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:21 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 1303 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:23.552470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:23.555994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] [instance: 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:23.590251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:23.593944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:23.595099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:23.602191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:23.603319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:23.604572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:23.638366 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] HTTP exception thrown: Instance 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 could not be found. Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Request method failure captured: Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 HTTP/1.1 Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p3GvPUGkRTnuftV6wHZrsAPAW1d2fUu_lHqW2Ak7U_p7fASHomAlR31wrL9ypVGzwkJjAI5MTmRRl7a6PZj9sOIZ7Dht4GOEFC6YF4LaipfZMbyu1-ZORAyZom-Ia82lIxbZ-uWJePvRj9z4apdfUWAdOvO4wF_mHp7hpds8minP0E Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 851c31088c424620850af4b3894deb0b Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-VolumesActionsTest-252128056 Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_851c31088c424620850af4b3894deb0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/851c31088c424620850af4b3894deb0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/851c31088c424620850af4b3894deb0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/851c31088c424620850af4b3894deb0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-VolumesActionsTest-252128056 Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 851c31088c424620850af4b3894deb0b Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-VolumesActionsTest-252128056 Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-VolumesActionsTest-252128056-project Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 66fd4303341d449c92c2837c2e08e205 Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-VolumesActionsTest-252128056-project Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 could not be found. Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '608d1f24-7fbe-4df1-bfe1-a807d1ba2d76'} Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 could not be found. Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 could not be found. Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:48:23.641518 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:48:23.649879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:48:23.649879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:48:23.649879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:48:23.649879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:48:23.649879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:48:23.649879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 could not be found. Aug 09 17:48:23.649879 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:48:23.655524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] Returning 404 to user: Instance 608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:48:23.657226 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19bfeab5-8ca6-427b-9183-f9ffa22ef5e6 tempest-VolumesActionsTest-252128056 tempest-VolumesActionsTest-252128056-project] 10.222.0.93 "GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76" status: 404 len: 111 microversion: 2.1 time: 0.115622 Aug 09 17:48:23.668028 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2895/5528] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:23 2022] GET /compute/v2.1/servers/608d1f24-7fbe-4df1-bfe1-a807d1ba2d76 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:48:30.076712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e66333ca-bddb-463c-8bbf-9450d4a747a6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:30.077955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e66333ca-bddb-463c-8bbf-9450d4a747a6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:30.095410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e66333ca-bddb-463c-8bbf-9450d4a747a6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:30.096247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e66333ca-bddb-463c-8bbf-9450d4a747a6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:30.096924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e66333ca-bddb-463c-8bbf-9450d4a747a6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:30.098031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e66333ca-bddb-463c-8bbf-9450d4a747a6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:30.099212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e66333ca-bddb-463c-8bbf-9450d4a747a6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:30.100110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e66333ca-bddb-463c-8bbf-9450d4a747a6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:30.137498 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e66333ca-bddb-463c-8bbf-9450d4a747a6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/ips" status: 200 len: 144 microversion: 2.1 time: 0.063478 Aug 09 17:48:30.138889 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2634/5529] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:48:30 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/ips => generated 144 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:48:34.250873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c2a91420-2e38-4c3e-a8f1-09588c0ffa04 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9c17985-4c37-4072-8b80-dcb51abae9e7"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:48:34.253643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c2a91420-2e38-4c3e-a8f1-09588c0ffa04 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:34.263436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=13 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:34.271280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=33 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:34.274439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2a91420-2e38-4c3e-a8f1-09588c0ffa04 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:34.275114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2a91420-2e38-4c3e-a8f1-09588c0ffa04 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:34.275753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2a91420-2e38-4c3e-a8f1-09588c0ffa04 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:34.288718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2a91420-2e38-4c3e-a8f1-09588c0ffa04 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:34.289330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2a91420-2e38-4c3e-a8f1-09588c0ffa04 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:34.289936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2a91420-2e38-4c3e-a8f1-09588c0ffa04 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:34.993715 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c2a91420-2e38-4c3e-a8f1-09588c0ffa04 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "POST /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744610 Aug 09 17:48:35.012382 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2896/5530] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:48:34 2022] POST /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:48:53.388046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5135f9b4-2b32-4de6-8dc7-651a3b40d046 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:48:53.393129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:53.395290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:53.403037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5135f9b4-2b32-4de6-8dc7-651a3b40d046 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:53.403939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5135f9b4-2b32-4de6-8dc7-651a3b40d046 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:53.404778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5135f9b4-2b32-4de6-8dc7-651a3b40d046 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:53.459700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5135f9b4-2b32-4de6-8dc7-651a3b40d046 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Going to try to stop instance {{(pid=119432) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 17:48:53.572810 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5135f9b4-2b32-4de6-8dc7-651a3b40d046 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "POST /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/action" status: 202 len: 0 microversion: 2.1 time: 0.192395 Aug 09 17:48:53.574251 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2635/5531] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:48:53 2022] POST /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:48:53.586143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:53.587485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:48:53.612086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-edc8536f-4870-4362-820d-15fb30cfde08 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:53.616150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-edc8536f-4870-4362-820d-15fb30cfde08 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:53.649854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edc8536f-4870-4362-820d-15fb30cfde08 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:53.650627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edc8536f-4870-4362-820d-15fb30cfde08 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:53.651398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edc8536f-4870-4362-820d-15fb30cfde08 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:53.661470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edc8536f-4870-4362-820d-15fb30cfde08 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:53.667843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edc8536f-4870-4362-820d-15fb30cfde08 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:53.668982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edc8536f-4870-4362-820d-15fb30cfde08 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:54.573636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-edc8536f-4870-4362-820d-15fb30cfde08 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:54.592253 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-edc8536f-4870-4362-820d-15fb30cfde08 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 1.010543 Aug 09 17:48:54.610168 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2897/5532] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:53 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:48:55.648647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ded6a527-6635-4eb4-bd77-485a8f50d3e1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:55.650957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ded6a527-6635-4eb4-bd77-485a8f50d3e1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:55.673462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded6a527-6635-4eb4-bd77-485a8f50d3e1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:55.673974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded6a527-6635-4eb4-bd77-485a8f50d3e1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:55.674427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded6a527-6635-4eb4-bd77-485a8f50d3e1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:55.675168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded6a527-6635-4eb4-bd77-485a8f50d3e1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:55.680534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded6a527-6635-4eb4-bd77-485a8f50d3e1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:55.681366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ded6a527-6635-4eb4-bd77-485a8f50d3e1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:56.090281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ded6a527-6635-4eb4-bd77-485a8f50d3e1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:56.114593 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ded6a527-6635-4eb4-bd77-485a8f50d3e1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.480519 Aug 09 17:48:56.116452 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2636/5533] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:55 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:57.164472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ca9e064-8936-4266-ae32-116e5d045f84 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:57.167833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ca9e064-8936-4266-ae32-116e5d045f84 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:57.190243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca9e064-8936-4266-ae32-116e5d045f84 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:57.191467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca9e064-8936-4266-ae32-116e5d045f84 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:57.192738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca9e064-8936-4266-ae32-116e5d045f84 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:57.198100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca9e064-8936-4266-ae32-116e5d045f84 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:57.199215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca9e064-8936-4266-ae32-116e5d045f84 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:57.204021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca9e064-8936-4266-ae32-116e5d045f84 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:57.500600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5ca9e064-8936-4266-ae32-116e5d045f84 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:57.530272 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ca9e064-8936-4266-ae32-116e5d045f84 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.374127 Aug 09 17:48:57.533352 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2898/5534] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:57 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:58.577883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-487e800a-4b43-4807-a7ee-f86c5ba77c1e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:58.578766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-487e800a-4b43-4807-a7ee-f86c5ba77c1e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:58.595353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-487e800a-4b43-4807-a7ee-f86c5ba77c1e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:58.595907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-487e800a-4b43-4807-a7ee-f86c5ba77c1e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:58.596455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-487e800a-4b43-4807-a7ee-f86c5ba77c1e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:58.597291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-487e800a-4b43-4807-a7ee-f86c5ba77c1e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:58.597763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-487e800a-4b43-4807-a7ee-f86c5ba77c1e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:58.598261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-487e800a-4b43-4807-a7ee-f86c5ba77c1e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:58.883323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-487e800a-4b43-4807-a7ee-f86c5ba77c1e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:48:58.893295 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-487e800a-4b43-4807-a7ee-f86c5ba77c1e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.319375 Aug 09 17:48:58.894902 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2637/5535] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:58 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:48:59.933677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7997cd69-7340-49a9-8a09-77de153afb67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:48:59.934415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7997cd69-7340-49a9-8a09-77de153afb67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:48:59.948039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7997cd69-7340-49a9-8a09-77de153afb67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:59.950659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7997cd69-7340-49a9-8a09-77de153afb67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:59.951228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7997cd69-7340-49a9-8a09-77de153afb67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:48:59.952210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7997cd69-7340-49a9-8a09-77de153afb67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:48:59.953586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7997cd69-7340-49a9-8a09-77de153afb67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:48:59.954307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7997cd69-7340-49a9-8a09-77de153afb67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:00.302328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7997cd69-7340-49a9-8a09-77de153afb67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:00.315411 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7997cd69-7340-49a9-8a09-77de153afb67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.386933 Aug 09 17:49:00.316431 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2899/5536] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:48:59 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:01.355976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-48113563-a686-43c7-9b9a-65f7cdb451a0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:01.357273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-48113563-a686-43c7-9b9a-65f7cdb451a0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:01.364805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48113563-a686-43c7-9b9a-65f7cdb451a0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:01.365305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48113563-a686-43c7-9b9a-65f7cdb451a0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:01.366079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48113563-a686-43c7-9b9a-65f7cdb451a0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:01.367604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48113563-a686-43c7-9b9a-65f7cdb451a0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:01.368274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48113563-a686-43c7-9b9a-65f7cdb451a0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:01.368876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-48113563-a686-43c7-9b9a-65f7cdb451a0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:01.729667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-48113563-a686-43c7-9b9a-65f7cdb451a0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:01.739235 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-48113563-a686-43c7-9b9a-65f7cdb451a0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.387402 Aug 09 17:49:01.754475 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2638/5537] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:01 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:02.767818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b121c752-8abc-473c-a720-a24fc27b43ab tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:02.781200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b121c752-8abc-473c-a720-a24fc27b43ab tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:02.798052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121c752-8abc-473c-a720-a24fc27b43ab tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:02.798956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121c752-8abc-473c-a720-a24fc27b43ab tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:02.800223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121c752-8abc-473c-a720-a24fc27b43ab tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:02.802415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121c752-8abc-473c-a720-a24fc27b43ab tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:02.803676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121c752-8abc-473c-a720-a24fc27b43ab tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:02.805613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121c752-8abc-473c-a720-a24fc27b43ab tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:03.461255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b121c752-8abc-473c-a720-a24fc27b43ab tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:03.497767 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b121c752-8abc-473c-a720-a24fc27b43ab tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.738012 Aug 09 17:49:03.503663 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2900/5538] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:02 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:04.618044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ac689b80-a97f-4b51-a2d5-7f4e8d6a294b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:04.620156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ac689b80-a97f-4b51-a2d5-7f4e8d6a294b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:04.634176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac689b80-a97f-4b51-a2d5-7f4e8d6a294b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:04.638743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac689b80-a97f-4b51-a2d5-7f4e8d6a294b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:04.639917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac689b80-a97f-4b51-a2d5-7f4e8d6a294b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:04.641704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac689b80-a97f-4b51-a2d5-7f4e8d6a294b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:04.642488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac689b80-a97f-4b51-a2d5-7f4e8d6a294b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:04.643107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ac689b80-a97f-4b51-a2d5-7f4e8d6a294b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:05.145488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ac689b80-a97f-4b51-a2d5-7f4e8d6a294b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:05.162504 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ac689b80-a97f-4b51-a2d5-7f4e8d6a294b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.548665 Aug 09 17:49:05.163247 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2639/5539] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:04 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:06.189458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f0c7bca3-aaa7-4815-ab27-2366341ead92 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:06.192693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f0c7bca3-aaa7-4815-ab27-2366341ead92 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:06.211687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0c7bca3-aaa7-4815-ab27-2366341ead92 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:06.217242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0c7bca3-aaa7-4815-ab27-2366341ead92 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:06.217938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0c7bca3-aaa7-4815-ab27-2366341ead92 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:06.218812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0c7bca3-aaa7-4815-ab27-2366341ead92 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:06.219407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0c7bca3-aaa7-4815-ab27-2366341ead92 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:06.219995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0c7bca3-aaa7-4815-ab27-2366341ead92 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:06.618420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f0c7bca3-aaa7-4815-ab27-2366341ead92 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:06.630551 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f0c7bca3-aaa7-4815-ab27-2366341ead92 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.445568 Aug 09 17:49:06.631796 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2901/5540] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:06 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:07.668936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f4b62a32-0ddb-4c77-9a6f-fae3753bca38 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:07.669698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f4b62a32-0ddb-4c77-9a6f-fae3753bca38 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:07.683954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4b62a32-0ddb-4c77-9a6f-fae3753bca38 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:07.687656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4b62a32-0ddb-4c77-9a6f-fae3753bca38 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:07.688258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4b62a32-0ddb-4c77-9a6f-fae3753bca38 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:07.689282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4b62a32-0ddb-4c77-9a6f-fae3753bca38 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:07.689886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4b62a32-0ddb-4c77-9a6f-fae3753bca38 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:07.691071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f4b62a32-0ddb-4c77-9a6f-fae3753bca38 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:08.262883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f4b62a32-0ddb-4c77-9a6f-fae3753bca38 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:08.296253 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f4b62a32-0ddb-4c77-9a6f-fae3753bca38 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.631878 Aug 09 17:49:08.306186 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2640/5541] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:07 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:09.361375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0cf860b3-56a6-478d-8bf4-bee6a032b849 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:09.364572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0cf860b3-56a6-478d-8bf4-bee6a032b849 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:09.380678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cf860b3-56a6-478d-8bf4-bee6a032b849 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:09.383093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cf860b3-56a6-478d-8bf4-bee6a032b849 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:09.385083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cf860b3-56a6-478d-8bf4-bee6a032b849 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:09.386635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cf860b3-56a6-478d-8bf4-bee6a032b849 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:09.387764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cf860b3-56a6-478d-8bf4-bee6a032b849 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:09.389424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0cf860b3-56a6-478d-8bf4-bee6a032b849 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:10.123953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0cf860b3-56a6-478d-8bf4-bee6a032b849 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:10.186194 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0cf860b3-56a6-478d-8bf4-bee6a032b849 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.854452 Aug 09 17:49:10.187326 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2902/5542] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:09 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:11.217790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f386e241-7162-4cce-bd35-a566c9000958 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:11.221696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f386e241-7162-4cce-bd35-a566c9000958 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:11.254579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f386e241-7162-4cce-bd35-a566c9000958 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:11.258047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f386e241-7162-4cce-bd35-a566c9000958 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:11.260525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f386e241-7162-4cce-bd35-a566c9000958 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:11.266262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f386e241-7162-4cce-bd35-a566c9000958 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:11.268795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f386e241-7162-4cce-bd35-a566c9000958 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:11.271073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f386e241-7162-4cce-bd35-a566c9000958 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:11.658688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f386e241-7162-4cce-bd35-a566c9000958 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:11.671154 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f386e241-7162-4cce-bd35-a566c9000958 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.462344 Aug 09 17:49:11.672712 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2641/5543] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:11 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:12.698625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c8e6041b-d17c-4d71-8051-aa62493d0b9a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:12.699270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c8e6041b-d17c-4d71-8051-aa62493d0b9a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:12.734381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e6041b-d17c-4d71-8051-aa62493d0b9a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:12.735241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e6041b-d17c-4d71-8051-aa62493d0b9a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:12.736198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e6041b-d17c-4d71-8051-aa62493d0b9a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:12.737895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e6041b-d17c-4d71-8051-aa62493d0b9a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:12.738620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e6041b-d17c-4d71-8051-aa62493d0b9a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:12.739249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e6041b-d17c-4d71-8051-aa62493d0b9a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:13.140735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c8e6041b-d17c-4d71-8051-aa62493d0b9a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:13.152679 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c8e6041b-d17c-4d71-8051-aa62493d0b9a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.459713 Aug 09 17:49:13.153732 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2903/5544] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:12 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:14.189384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b4bf169b-fc57-45b1-b970-043e29b0f6b5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:14.190994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b4bf169b-fc57-45b1-b970-043e29b0f6b5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:14.212813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4bf169b-fc57-45b1-b970-043e29b0f6b5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:14.213787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4bf169b-fc57-45b1-b970-043e29b0f6b5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:14.214491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4bf169b-fc57-45b1-b970-043e29b0f6b5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:14.215451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4bf169b-fc57-45b1-b970-043e29b0f6b5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:14.218633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4bf169b-fc57-45b1-b970-043e29b0f6b5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:14.219578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b4bf169b-fc57-45b1-b970-043e29b0f6b5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:14.577270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b4bf169b-fc57-45b1-b970-043e29b0f6b5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:14.625924 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b4bf169b-fc57-45b1-b970-043e29b0f6b5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.445306 Aug 09 17:49:14.628843 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2642/5545] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:14 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:15.653437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f3cdb98-34db-4401-b874-ad4584828350 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:15.655152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f3cdb98-34db-4401-b874-ad4584828350 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:15.677592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f3cdb98-34db-4401-b874-ad4584828350 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:15.680219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f3cdb98-34db-4401-b874-ad4584828350 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:15.681046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f3cdb98-34db-4401-b874-ad4584828350 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:15.683709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f3cdb98-34db-4401-b874-ad4584828350 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:15.690589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f3cdb98-34db-4401-b874-ad4584828350 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:15.691334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f3cdb98-34db-4401-b874-ad4584828350 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:16.200890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f3cdb98-34db-4401-b874-ad4584828350 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:16.225030 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f3cdb98-34db-4401-b874-ad4584828350 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.577458 Aug 09 17:49:16.236102 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2904/5546] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:15 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:17.265748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b0027c9f-0de1-446b-a174-0e480dafb6e0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:17.267309 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b0027c9f-0de1-446b-a174-0e480dafb6e0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:17.278169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0027c9f-0de1-446b-a174-0e480dafb6e0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:17.279072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0027c9f-0de1-446b-a174-0e480dafb6e0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:17.279807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0027c9f-0de1-446b-a174-0e480dafb6e0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:17.280827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0027c9f-0de1-446b-a174-0e480dafb6e0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:17.281532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0027c9f-0de1-446b-a174-0e480dafb6e0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:17.282216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b0027c9f-0de1-446b-a174-0e480dafb6e0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:17.863419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b0027c9f-0de1-446b-a174-0e480dafb6e0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:17.887140 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b0027c9f-0de1-446b-a174-0e480dafb6e0 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.625584 Aug 09 17:49:17.889051 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2643/5547] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:17 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:18.676275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1493096219", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "5a50d42e-4d25-4f1a-8eb6-c42748e8f014"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:18.852200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] validate_networks() for [('5a50d42e-4d25-4f1a-8eb6-c42748e8f014', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:49:18.926943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-952c29f8-f974-4ea5-852f-5a040fcb5db2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:18.944640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-952c29f8-f974-4ea5-852f-5a040fcb5db2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:18.994639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952c29f8-f974-4ea5-852f-5a040fcb5db2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:18.995385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952c29f8-f974-4ea5-852f-5a040fcb5db2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:19.002070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952c29f8-f974-4ea5-852f-5a040fcb5db2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:19.003053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952c29f8-f974-4ea5-852f-5a040fcb5db2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:19.003560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952c29f8-f974-4ea5-852f-5a040fcb5db2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:19.004058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-952c29f8-f974-4ea5-852f-5a040fcb5db2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:19.356204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-952c29f8-f974-4ea5-852f-5a040fcb5db2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:19.384556 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-952c29f8-f974-4ea5-852f-5a040fcb5db2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.465585 Aug 09 17:49:19.385611 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2644/5548] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:18 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:19.748536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:49:19.749281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:49:19.749852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:49:19.750882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:49:19.751423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:49:19.770794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:19.772087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:19.773779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:19.775357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:19.776428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:19.777398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:19.812499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Getting quotas for project 6af2357b654547678fa8dcb676c95fbb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:49:19.824850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Getting quotas for user e287e35124e54b548af734119ac3c4d4 and project 6af2357b654547678fa8dcb676c95fbb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:49:19.855290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:49:19.861071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:49:19.969346 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f250be96-d810-4845-abb3-e842ec4333f0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302362 Aug 09 17:49:19.970837 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2905/5549] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:49:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:49:19.989559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-097c8a2e-874a-450a-bc52-2a46215919bb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:19.993029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-097c8a2e-874a-450a-bc52-2a46215919bb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:20.115186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-097c8a2e-874a-450a-bc52-2a46215919bb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:20.134870 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-097c8a2e-874a-450a-bc52-2a46215919bb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1214 microversion: 2.1 time: 0.154810 Aug 09 17:49:20.156052 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2645/5550] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:19 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:20.413163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ea873ba6-4633-402d-918b-950ca0058c22 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:20.414043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ea873ba6-4633-402d-918b-950ca0058c22 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:20.424476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea873ba6-4633-402d-918b-950ca0058c22 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:20.426022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea873ba6-4633-402d-918b-950ca0058c22 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:20.429085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea873ba6-4633-402d-918b-950ca0058c22 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:20.429902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea873ba6-4633-402d-918b-950ca0058c22 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:20.430406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea873ba6-4633-402d-918b-950ca0058c22 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:20.430839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ea873ba6-4633-402d-918b-950ca0058c22 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:20.731904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ea873ba6-4633-402d-918b-950ca0058c22 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:20.742771 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ea873ba6-4633-402d-918b-950ca0058c22 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.333010 Aug 09 17:49:20.756589 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2906/5551] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:20 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:21.184995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-52f4fbc8-fba7-44ed-a24a-9c2968dc2aeb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:21.188627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-52f4fbc8-fba7-44ed-a24a-9c2968dc2aeb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:21.205811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52f4fbc8-fba7-44ed-a24a-9c2968dc2aeb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:21.206683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52f4fbc8-fba7-44ed-a24a-9c2968dc2aeb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:21.209275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52f4fbc8-fba7-44ed-a24a-9c2968dc2aeb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:21.210702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52f4fbc8-fba7-44ed-a24a-9c2968dc2aeb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:21.213571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52f4fbc8-fba7-44ed-a24a-9c2968dc2aeb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:21.215917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-52f4fbc8-fba7-44ed-a24a-9c2968dc2aeb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:21.372342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-52f4fbc8-fba7-44ed-a24a-9c2968dc2aeb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:21.381561 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-52f4fbc8-fba7-44ed-a24a-9c2968dc2aeb tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1210 microversion: 2.1 time: 0.211430 Aug 09 17:49:21.383329 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2646/5552] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:21 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1210 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:21.768884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b557a83-4676-43c0-9571-28e6566a156d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:21.769685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7b557a83-4676-43c0-9571-28e6566a156d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:21.804906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b557a83-4676-43c0-9571-28e6566a156d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:21.807103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b557a83-4676-43c0-9571-28e6566a156d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:21.812412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b557a83-4676-43c0-9571-28e6566a156d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:21.818063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b557a83-4676-43c0-9571-28e6566a156d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:21.819769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b557a83-4676-43c0-9571-28e6566a156d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:21.826463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b557a83-4676-43c0-9571-28e6566a156d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:22.190531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7b557a83-4676-43c0-9571-28e6566a156d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:22.208421 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b557a83-4676-43c0-9571-28e6566a156d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.444913 Aug 09 17:49:22.223240 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2907/5553] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:21 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:22.405809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cc3b9313-a92a-41d8-9a57-4ae8c6a8d049 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:22.407244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cc3b9313-a92a-41d8-9a57-4ae8c6a8d049 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:22.419941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc3b9313-a92a-41d8-9a57-4ae8c6a8d049 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:22.420684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc3b9313-a92a-41d8-9a57-4ae8c6a8d049 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:22.420876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc3b9313-a92a-41d8-9a57-4ae8c6a8d049 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:22.424383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc3b9313-a92a-41d8-9a57-4ae8c6a8d049 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:22.424879 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc3b9313-a92a-41d8-9a57-4ae8c6a8d049 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:22.425325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cc3b9313-a92a-41d8-9a57-4ae8c6a8d049 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:22.562348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cc3b9313-a92a-41d8-9a57-4ae8c6a8d049 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:22.581772 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cc3b9313-a92a-41d8-9a57-4ae8c6a8d049 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1272 microversion: 2.1 time: 0.180559 Aug 09 17:49:22.589276 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2647/5554] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:22 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:23.241983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-04d977d1-ec83-41ef-a522-035a4b42522e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:23.244838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-04d977d1-ec83-41ef-a522-035a4b42522e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:23.268909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04d977d1-ec83-41ef-a522-035a4b42522e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:23.272029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04d977d1-ec83-41ef-a522-035a4b42522e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:23.275871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04d977d1-ec83-41ef-a522-035a4b42522e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:23.278949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04d977d1-ec83-41ef-a522-035a4b42522e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:23.281545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04d977d1-ec83-41ef-a522-035a4b42522e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:23.283504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04d977d1-ec83-41ef-a522-035a4b42522e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:23.622547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-84a38aff-bea3-4f1c-b0e5-ad539d423815 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:23.624419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-84a38aff-bea3-4f1c-b0e5-ad539d423815 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:23.630900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-04d977d1-ec83-41ef-a522-035a4b42522e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:23.631881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=29 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:23.646708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a38aff-bea3-4f1c-b0e5-ad539d423815 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:23.649541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a38aff-bea3-4f1c-b0e5-ad539d423815 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:23.650915 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-04d977d1-ec83-41ef-a522-035a4b42522e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1721 microversion: 2.1 time: 0.412989 Aug 09 17:49:23.651775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a38aff-bea3-4f1c-b0e5-ad539d423815 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:23.652864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a38aff-bea3-4f1c-b0e5-ad539d423815 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:23.654552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a38aff-bea3-4f1c-b0e5-ad539d423815 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:23.656776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a38aff-bea3-4f1c-b0e5-ad539d423815 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:23.666006 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2908/5555] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:23 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1721 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:23.696904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:24.034488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-84a38aff-bea3-4f1c-b0e5-ad539d423815 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:24.044460 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-84a38aff-bea3-4f1c-b0e5-ad539d423815 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1314 microversion: 2.1 time: 0.427038 Aug 09 17:49:24.067833 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2648/5556] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:23 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:24.693398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4465b498-dc90-48b8-8143-4257d2d7a92f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:24.695479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4465b498-dc90-48b8-8143-4257d2d7a92f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:24.702123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:24.713863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4465b498-dc90-48b8-8143-4257d2d7a92f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:24.714839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4465b498-dc90-48b8-8143-4257d2d7a92f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:24.715797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4465b498-dc90-48b8-8143-4257d2d7a92f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:24.717179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4465b498-dc90-48b8-8143-4257d2d7a92f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:24.718289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4465b498-dc90-48b8-8143-4257d2d7a92f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:24.719075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4465b498-dc90-48b8-8143-4257d2d7a92f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:24.727236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=69 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:25.085112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4465b498-dc90-48b8-8143-4257d2d7a92f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:25.094840 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4465b498-dc90-48b8-8143-4257d2d7a92f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1698 microversion: 2.1 time: 0.407590 Aug 09 17:49:25.107834 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2909/5557] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:24 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1698 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:25.107834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-edcde4b9-df09-4357-bdb5-8e8687dfcaff tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:25.107834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-edcde4b9-df09-4357-bdb5-8e8687dfcaff tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:25.114264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edcde4b9-df09-4357-bdb5-8e8687dfcaff tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:25.114264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edcde4b9-df09-4357-bdb5-8e8687dfcaff tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:25.114264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edcde4b9-df09-4357-bdb5-8e8687dfcaff tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:25.114264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edcde4b9-df09-4357-bdb5-8e8687dfcaff tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:25.114264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edcde4b9-df09-4357-bdb5-8e8687dfcaff tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:25.114264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edcde4b9-df09-4357-bdb5-8e8687dfcaff tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:25.397430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-edcde4b9-df09-4357-bdb5-8e8687dfcaff tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:25.407810 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-edcde4b9-df09-4357-bdb5-8e8687dfcaff tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1314 microversion: 2.1 time: 0.310734 Aug 09 17:49:25.412220 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2910/5558] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:25 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:25.432793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bf264bba-1c74-4e74-8fb7-dbb5b1536195 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:25.440442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf264bba-1c74-4e74-8fb7-dbb5b1536195 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:25.441243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf264bba-1c74-4e74-8fb7-dbb5b1536195 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:25.441860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf264bba-1c74-4e74-8fb7-dbb5b1536195 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:25.478415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bf264bba-1c74-4e74-8fb7-dbb5b1536195 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Going to try to start instance {{(pid=119431) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 17:49:25.479596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-9a695bd1-9516-4640-823d-c025ee617bfd req-ecb3c3dd-3d45-4095-8c33-f218518bda95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48027a66-2c47-4c7a-b2be-6da321db5749", "tag": "160df2a3-eb08-434a-8dec-09db075228ee"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:25.539860 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9a695bd1-9516-4640-823d-c025ee617bfd req-ecb3c3dd-3d45-4095-8c33-f218518bda95 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:25.541068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9a695bd1-9516-4640-823d-c025ee617bfd req-ecb3c3dd-3d45-4095-8c33-f218518bda95 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:25.541928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9a695bd1-9516-4640-823d-c025ee617bfd req-ecb3c3dd-3d45-4095-8c33-f218518bda95 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:25.578660 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-9a695bd1-9516-4640-823d-c025ee617bfd req-ecb3c3dd-3d45-4095-8c33-f218518bda95 service nova] Creating event network-changed:160df2a3-eb08-434a-8dec-09db075228ee for instance 48027a66-2c47-4c7a-b2be-6da321db5749 on n-h2-845781-6 Aug 09 17:49:25.593924 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bf264bba-1c74-4e74-8fb7-dbb5b1536195 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "POST /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/action" status: 202 len: 0 microversion: 2.1 time: 0.167762 Aug 09 17:49:25.601795 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2911/5559] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:49:25 2022] POST /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:49:25.602148 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-9a695bd1-9516-4640-823d-c025ee617bfd req-ecb3c3dd-3d45-4095-8c33-f218518bda95 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.607885 Aug 09 17:49:25.602148 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2649/5560] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:25.610143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d22a0f1b-2f83-44b3-869a-379fa68f4c7f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:25.611704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d22a0f1b-2f83-44b3-869a-379fa68f4c7f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:25.628567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d22a0f1b-2f83-44b3-869a-379fa68f4c7f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:25.629226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d22a0f1b-2f83-44b3-869a-379fa68f4c7f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:25.629773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d22a0f1b-2f83-44b3-869a-379fa68f4c7f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:25.630624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d22a0f1b-2f83-44b3-869a-379fa68f4c7f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:25.631174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d22a0f1b-2f83-44b3-869a-379fa68f4c7f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:25.631540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d22a0f1b-2f83-44b3-869a-379fa68f4c7f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:26.034247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d22a0f1b-2f83-44b3-869a-379fa68f4c7f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:26.059332 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d22a0f1b-2f83-44b3-869a-379fa68f4c7f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1707 microversion: 2.1 time: 0.457618 Aug 09 17:49:26.062281 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2912/5561] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:25 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1707 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:26.440338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3659b5c7-c67a-4ea6-b10d-55b7d223776e tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:26.440338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3659b5c7-c67a-4ea6-b10d-55b7d223776e tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:26.448203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3659b5c7-c67a-4ea6-b10d-55b7d223776e tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:26.448797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3659b5c7-c67a-4ea6-b10d-55b7d223776e tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:26.449151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3659b5c7-c67a-4ea6-b10d-55b7d223776e tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:26.449901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3659b5c7-c67a-4ea6-b10d-55b7d223776e tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:26.451018 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3659b5c7-c67a-4ea6-b10d-55b7d223776e tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:26.451484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3659b5c7-c67a-4ea6-b10d-55b7d223776e tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:26.918174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3659b5c7-c67a-4ea6-b10d-55b7d223776e tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:26.927802 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3659b5c7-c67a-4ea6-b10d-55b7d223776e tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1314 microversion: 2.1 time: 0.495830 Aug 09 17:49:26.930229 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2650/5562] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:26 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:27.109693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-386b5b42-9bbf-4a32-94c0-1cc74ce059a5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:27.117418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-386b5b42-9bbf-4a32-94c0-1cc74ce059a5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:27.141298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386b5b42-9bbf-4a32-94c0-1cc74ce059a5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:27.156872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386b5b42-9bbf-4a32-94c0-1cc74ce059a5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:27.157863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386b5b42-9bbf-4a32-94c0-1cc74ce059a5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:27.159338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386b5b42-9bbf-4a32-94c0-1cc74ce059a5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:27.160404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386b5b42-9bbf-4a32-94c0-1cc74ce059a5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:27.161340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-386b5b42-9bbf-4a32-94c0-1cc74ce059a5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:27.643247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-386b5b42-9bbf-4a32-94c0-1cc74ce059a5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:27.674342 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-386b5b42-9bbf-4a32-94c0-1cc74ce059a5 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1707 microversion: 2.1 time: 0.571623 Aug 09 17:49:27.679784 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2913/5563] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:27 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1707 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:27.974375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b9acb3fe-642f-46b1-afbc-3b95a551efb0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:27.975306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b9acb3fe-642f-46b1-afbc-3b95a551efb0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:27.987698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9acb3fe-642f-46b1-afbc-3b95a551efb0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:27.992109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9acb3fe-642f-46b1-afbc-3b95a551efb0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:27.992552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9acb3fe-642f-46b1-afbc-3b95a551efb0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:27.993300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9acb3fe-642f-46b1-afbc-3b95a551efb0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:27.993760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9acb3fe-642f-46b1-afbc-3b95a551efb0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:27.994187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9acb3fe-642f-46b1-afbc-3b95a551efb0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:28.321646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b9acb3fe-642f-46b1-afbc-3b95a551efb0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:28.378188 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b9acb3fe-642f-46b1-afbc-3b95a551efb0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1314 microversion: 2.1 time: 0.415529 Aug 09 17:49:28.379050 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2651/5564] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:27 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:28.716308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8dec3b94-dcec-4261-aff0-d499b9451ee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:28.717242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8dec3b94-dcec-4261-aff0-d499b9451ee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:28.744328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8dec3b94-dcec-4261-aff0-d499b9451ee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:28.746416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8dec3b94-dcec-4261-aff0-d499b9451ee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:28.748188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8dec3b94-dcec-4261-aff0-d499b9451ee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:28.749978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8dec3b94-dcec-4261-aff0-d499b9451ee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:28.751271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8dec3b94-dcec-4261-aff0-d499b9451ee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:28.752545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8dec3b94-dcec-4261-aff0-d499b9451ee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:29.197630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8dec3b94-dcec-4261-aff0-d499b9451ee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:29.224089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8dec3b94-dcec-4261-aff0-d499b9451ee7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1711 microversion: 2.1 time: 0.511877 Aug 09 17:49:29.228652 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2914/5565] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:28 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1711 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:29.438331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ba6bedf2-f21b-4823-bacc-4605a594b464 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:29.441031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ba6bedf2-f21b-4823-bacc-4605a594b464 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:29.464623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba6bedf2-f21b-4823-bacc-4605a594b464 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:29.465305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba6bedf2-f21b-4823-bacc-4605a594b464 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:29.465557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba6bedf2-f21b-4823-bacc-4605a594b464 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:29.466522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba6bedf2-f21b-4823-bacc-4605a594b464 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:29.467359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba6bedf2-f21b-4823-bacc-4605a594b464 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:29.469235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ba6bedf2-f21b-4823-bacc-4605a594b464 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:29.865284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ba6bedf2-f21b-4823-bacc-4605a594b464 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:29.881789 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ba6bedf2-f21b-4823-bacc-4605a594b464 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1314 microversion: 2.1 time: 0.466960 Aug 09 17:49:29.884281 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2652/5566] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:29 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:30.943194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f4ba3d2-180c-4a38-b780-0aed771da3a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:30.961893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5f4ba3d2-180c-4a38-b780-0aed771da3a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:30.997275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:31.001031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:31.013384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f4ba3d2-180c-4a38-b780-0aed771da3a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:31.014632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f4ba3d2-180c-4a38-b780-0aed771da3a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:31.015839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f4ba3d2-180c-4a38-b780-0aed771da3a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:31.023126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f4ba3d2-180c-4a38-b780-0aed771da3a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:31.024823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f4ba3d2-180c-4a38-b780-0aed771da3a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:31.028790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f4ba3d2-180c-4a38-b780-0aed771da3a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:31.633370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f4ba3d2-180c-4a38-b780-0aed771da3a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:31.659819 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f4ba3d2-180c-4a38-b780-0aed771da3a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1314 microversion: 2.1 time: 0.741893 Aug 09 17:49:31.669536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2915/5567] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:30 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:32.029721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d6377c74-b289-420e-893b-9c0ac4726366 req-2f12b6e0-598e-4a38-9c74-dae899797e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48027a66-2c47-4c7a-b2be-6da321db5749", "name": "network-vif-plugged", "status": "completed", "tag": "160df2a3-eb08-434a-8dec-09db075228ee"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:32.048947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:32.080592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d6377c74-b289-420e-893b-9c0ac4726366 req-2f12b6e0-598e-4a38-9c74-dae899797e23 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:32.083336 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d6377c74-b289-420e-893b-9c0ac4726366 req-2f12b6e0-598e-4a38-9c74-dae899797e23 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:32.086100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d6377c74-b289-420e-893b-9c0ac4726366 req-2f12b6e0-598e-4a38-9c74-dae899797e23 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:32.147874 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d6377c74-b289-420e-893b-9c0ac4726366 req-2f12b6e0-598e-4a38-9c74-dae899797e23 service nova] Creating event network-vif-plugged:160df2a3-eb08-434a-8dec-09db075228ee for instance 48027a66-2c47-4c7a-b2be-6da321db5749 on n-h2-845781-6 Aug 09 17:49:32.166153 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d6377c74-b289-420e-893b-9c0ac4726366 req-2f12b6e0-598e-4a38-9c74-dae899797e23 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145297 Aug 09 17:49:32.167517 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2653/5568] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:32.691138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1ad9561e-3c9a-432b-8cb3-2c5e29cd74bc tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:32.692716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1ad9561e-3c9a-432b-8cb3-2c5e29cd74bc tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:32.713940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ad9561e-3c9a-432b-8cb3-2c5e29cd74bc tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:32.717456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ad9561e-3c9a-432b-8cb3-2c5e29cd74bc tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:32.718386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ad9561e-3c9a-432b-8cb3-2c5e29cd74bc tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:32.719422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ad9561e-3c9a-432b-8cb3-2c5e29cd74bc tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:32.720229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ad9561e-3c9a-432b-8cb3-2c5e29cd74bc tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:32.720884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ad9561e-3c9a-432b-8cb3-2c5e29cd74bc tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:33.214547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1ad9561e-3c9a-432b-8cb3-2c5e29cd74bc tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:33.246814 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1ad9561e-3c9a-432b-8cb3-2c5e29cd74bc tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1314 microversion: 2.1 time: 0.564796 Aug 09 17:49:33.247453 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2916/5569] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:32 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:34.285255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-445e4e64-ee34-47e3-89fd-eee60524a142 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:34.287284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-445e4e64-ee34-47e3-89fd-eee60524a142 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:34.303497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445e4e64-ee34-47e3-89fd-eee60524a142 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:34.305427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445e4e64-ee34-47e3-89fd-eee60524a142 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:34.306546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445e4e64-ee34-47e3-89fd-eee60524a142 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:34.309013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445e4e64-ee34-47e3-89fd-eee60524a142 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:34.310200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445e4e64-ee34-47e3-89fd-eee60524a142 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:34.311271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445e4e64-ee34-47e3-89fd-eee60524a142 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:34.748191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-445e4e64-ee34-47e3-89fd-eee60524a142 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:34.764967 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-445e4e64-ee34-47e3-89fd-eee60524a142 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1498 microversion: 2.1 time: 0.490296 Aug 09 17:49:34.782987 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2654/5570] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:34 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1498 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:35.731659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-deffc75f-ded7-4511-9613-96a671c28525 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:35.732633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-deffc75f-ded7-4511-9613-96a671c28525 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:35.754695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deffc75f-ded7-4511-9613-96a671c28525 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:35.765015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deffc75f-ded7-4511-9613-96a671c28525 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:35.766255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deffc75f-ded7-4511-9613-96a671c28525 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:35.768089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deffc75f-ded7-4511-9613-96a671c28525 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:35.769255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deffc75f-ded7-4511-9613-96a671c28525 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:35.770411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deffc75f-ded7-4511-9613-96a671c28525 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:35.838897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-deffc75f-ded7-4511-9613-96a671c28525 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:49:36.154158 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-deffc75f-ded7-4511-9613-96a671c28525 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "DELETE /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 204 len: 0 microversion: 2.1 time: 0.424638 Aug 09 17:49:36.154158 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2917/5571] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:49:35 2022] DELETE /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:49:36.169443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-29dcd513-75f1-4de6-b5b2-7116bffe5b6a tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:36.175275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-29dcd513-75f1-4de6-b5b2-7116bffe5b6a tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:36.215845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29dcd513-75f1-4de6-b5b2-7116bffe5b6a tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:36.217549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29dcd513-75f1-4de6-b5b2-7116bffe5b6a tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:36.218538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29dcd513-75f1-4de6-b5b2-7116bffe5b6a tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:36.221835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29dcd513-75f1-4de6-b5b2-7116bffe5b6a tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:36.223044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29dcd513-75f1-4de6-b5b2-7116bffe5b6a tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:36.224051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-29dcd513-75f1-4de6-b5b2-7116bffe5b6a tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:36.567760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-29dcd513-75f1-4de6-b5b2-7116bffe5b6a tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:36.583081 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-29dcd513-75f1-4de6-b5b2-7116bffe5b6a tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1504 microversion: 2.1 time: 0.424539 Aug 09 17:49:36.584137 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2655/5572] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:36 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:37.622002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f36b18bd-b5eb-4be4-a12b-69a67592aef2 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:37.623512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f36b18bd-b5eb-4be4-a12b-69a67592aef2 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:37.640435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f36b18bd-b5eb-4be4-a12b-69a67592aef2 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:37.641119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f36b18bd-b5eb-4be4-a12b-69a67592aef2 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:37.641631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f36b18bd-b5eb-4be4-a12b-69a67592aef2 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:37.642825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f36b18bd-b5eb-4be4-a12b-69a67592aef2 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:37.643228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f36b18bd-b5eb-4be4-a12b-69a67592aef2 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:37.644227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f36b18bd-b5eb-4be4-a12b-69a67592aef2 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:37.879084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f36b18bd-b5eb-4be4-a12b-69a67592aef2 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:37.903305 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f36b18bd-b5eb-4be4-a12b-69a67592aef2 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1504 microversion: 2.1 time: 0.287878 Aug 09 17:49:37.908519 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2918/5573] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:37 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:38.544324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-1c6fd58c-30dd-4e2c-a4c9-17fae0574855 req-8b511c60-f75d-4fb1-aaba-0b9c4b126f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48027a66-2c47-4c7a-b2be-6da321db5749", "name": "network-vif-deleted", "tag": "160df2a3-eb08-434a-8dec-09db075228ee"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:38.558039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1c6fd58c-30dd-4e2c-a4c9-17fae0574855 req-8b511c60-f75d-4fb1-aaba-0b9c4b126f18 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:38.559021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1c6fd58c-30dd-4e2c-a4c9-17fae0574855 req-8b511c60-f75d-4fb1-aaba-0b9c4b126f18 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:38.560351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1c6fd58c-30dd-4e2c-a4c9-17fae0574855 req-8b511c60-f75d-4fb1-aaba-0b9c4b126f18 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:38.583538 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-1c6fd58c-30dd-4e2c-a4c9-17fae0574855 req-8b511c60-f75d-4fb1-aaba-0b9c4b126f18 service nova] Creating event network-vif-deleted:160df2a3-eb08-434a-8dec-09db075228ee for instance 48027a66-2c47-4c7a-b2be-6da321db5749 on n-h2-845781-6 Aug 09 17:49:38.592023 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-1c6fd58c-30dd-4e2c-a4c9-17fae0574855 req-8b511c60-f75d-4fb1-aaba-0b9c4b126f18 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053160 Aug 09 17:49:38.593639 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2656/5574] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:38.935999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:38.938338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:38.953730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:38.955146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:38.956324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:38.957905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:38.959256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:38.960407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:39.063991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:39.065001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:39.065972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:39.066965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lazy-loading 'fault' on Instance uuid 48027a66-2c47-4c7a-b2be-6da321db5749 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:49:39.140325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:39.153631 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-04ae4f67-f9cf-4a3e-a927-53bed92bc579 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 200 len: 1304 microversion: 2.1 time: 0.225540 Aug 09 17:49:39.164343 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2919/5575] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:38 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 1304 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:40.188056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:40.189436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: 48027a66-2c47-4c7a-b2be-6da321db5749] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:40.199202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:40.199842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:40.200525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:40.201601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:40.202190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:40.202712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:40.220654 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] HTTP exception thrown: Instance 48027a66-2c47-4c7a-b2be-6da321db5749 could not be found. Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Request method failure captured: Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 HTTP/1.1 Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p4bSDl15R3OxyW0U_CT-GTO8VfCoivyi-P9eqa3cWM3CvCDuExeVxQuGnyqfPoZr5ihiwv_yICYIV3ASM1HBp81nfn5tySoP3YpILb_E_yFzSqdpAFHkEF2MKOzD3B0nngD7fM6rwxF9L8yhAvXDHs-SDNOYTfdQhbL2zwqEhW6hk8 Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 6af2357b654547678fa8dcb676c95fbb Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesActionsTest-948952856 Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6af2357b654547678fa8dcb676c95fbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6af2357b654547678fa8dcb676c95fbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6af2357b654547678fa8dcb676c95fbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6af2357b654547678fa8dcb676c95fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesActionsTest-948952856 Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 6af2357b654547678fa8dcb676c95fbb Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesActionsTest-948952856 Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesActionsTest-948952856-project Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: e287e35124e54b548af734119ac3c4d4 Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesActionsTest-948952856-project Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 48027a66-2c47-4c7a-b2be-6da321db5749 could not be found. Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '48027a66-2c47-4c7a-b2be-6da321db5749'} Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48027a66-2c47-4c7a-b2be-6da321db5749 could not be found. Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48027a66-2c47-4c7a-b2be-6da321db5749 could not be found. Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:49:40.222789 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:49:40.236977 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:49:40.236977 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:49:40.236977 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:49:40.236977 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:49:40.236977 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:49:40.236977 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48027a66-2c47-4c7a-b2be-6da321db5749 could not be found. Aug 09 17:49:40.236977 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:49:40.236977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Returning 404 to user: Instance 48027a66-2c47-4c7a-b2be-6da321db5749 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:49:40.236977 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4ed4b662-ae9d-404d-9dc0-190a53048e49 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749" status: 404 len: 111 microversion: 2.1 time: 0.042046 Aug 09 17:49:40.236977 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2657/5576] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:40 2022] GET /compute/v2.1/servers/48027a66-2c47-4c7a-b2be-6da321db5749 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:49:40.423240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-351444295", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "5a50d42e-4d25-4f1a-8eb6-c42748e8f014"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:40.512797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] validate_networks() for [('5a50d42e-4d25-4f1a-8eb6-c42748e8f014', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:49:41.247659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:49:41.248332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:49:41.249729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:49:41.250426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:49:41.251511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:49:41.267093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:41.268439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:41.268897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:41.269999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:41.270187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:41.270187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:41.297789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Getting quotas for project 6af2357b654547678fa8dcb676c95fbb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:49:41.306096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Getting quotas for user e287e35124e54b548af734119ac3c4d4 and project 6af2357b654547678fa8dcb676c95fbb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:49:41.325569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:49:41.328740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:49:41.424536 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3dcc37a7-7a0d-4062-ab8b-172510b120b0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006142 Aug 09 17:49:41.428793 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2920/5577] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:49:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:49:41.438262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a22937c0-cead-471e-a2a2-8bf0cf49d078 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:41.440804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a22937c0-cead-471e-a2a2-8bf0cf49d078 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:41.527089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a22937c0-cead-471e-a2a2-8bf0cf49d078 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:41.566513 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a22937c0-cead-471e-a2a2-8bf0cf49d078 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1213 microversion: 2.1 time: 0.132091 Aug 09 17:49:41.573915 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2658/5578] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:41 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:42.599598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c8249b4-f149-4fda-b386-a6ca6112798b tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:42.611219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7c8249b4-f149-4fda-b386-a6ca6112798b tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:42.632983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c8249b4-f149-4fda-b386-a6ca6112798b tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:42.639188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c8249b4-f149-4fda-b386-a6ca6112798b tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:42.639883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c8249b4-f149-4fda-b386-a6ca6112798b tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:42.640848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c8249b4-f149-4fda-b386-a6ca6112798b tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:42.641620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c8249b4-f149-4fda-b386-a6ca6112798b tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:42.642135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c8249b4-f149-4fda-b386-a6ca6112798b tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:42.814861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7c8249b4-f149-4fda-b386-a6ca6112798b tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:42.824704 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7c8249b4-f149-4fda-b386-a6ca6112798b tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1209 microversion: 2.1 time: 0.233229 Aug 09 17:49:42.827998 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2921/5579] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:42 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1209 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:43.104221 n-d-845781-6 devstack@n-api.service[119432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:49:43.104723 n-d-845781-6 devstack@n-api.service[119432]: Tue Aug 9 17:49:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:49:43.853084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-559a38ab-6c25-4e2c-9341-33165fa19fa1 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:43.857756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-559a38ab-6c25-4e2c-9341-33165fa19fa1 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:43.889233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-559a38ab-6c25-4e2c-9341-33165fa19fa1 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:43.890388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-559a38ab-6c25-4e2c-9341-33165fa19fa1 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:43.899185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-559a38ab-6c25-4e2c-9341-33165fa19fa1 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:43.901178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-559a38ab-6c25-4e2c-9341-33165fa19fa1 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:43.902195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-559a38ab-6c25-4e2c-9341-33165fa19fa1 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:43.905619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-559a38ab-6c25-4e2c-9341-33165fa19fa1 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:44.634299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-559a38ab-6c25-4e2c-9341-33165fa19fa1 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:44.668801 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-559a38ab-6c25-4e2c-9341-33165fa19fa1 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1271 microversion: 2.1 time: 0.824361 Aug 09 17:49:44.670037 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2659/5580] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:43 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1271 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:45.746352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af00c074-7754-4722-95f2-730053c21c5f tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:45.747215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-af00c074-7754-4722-95f2-730053c21c5f tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:45.822384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af00c074-7754-4722-95f2-730053c21c5f tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:45.823325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af00c074-7754-4722-95f2-730053c21c5f tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:45.836791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af00c074-7754-4722-95f2-730053c21c5f tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:45.860187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af00c074-7754-4722-95f2-730053c21c5f tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:45.861327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af00c074-7754-4722-95f2-730053c21c5f tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:45.863475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af00c074-7754-4722-95f2-730053c21c5f tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:46.011567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-af00c074-7754-4722-95f2-730053c21c5f tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:46.045003 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-af00c074-7754-4722-95f2-730053c21c5f tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1271 microversion: 2.1 time: 0.315032 Aug 09 17:49:46.046776 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2922/5581] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:45 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1271 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:47.078915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e9b3a315-fc11-4ca7-a283-c87ade7081a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:47.080369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e9b3a315-fc11-4ca7-a283-c87ade7081a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:47.097476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9b3a315-fc11-4ca7-a283-c87ade7081a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:47.098656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9b3a315-fc11-4ca7-a283-c87ade7081a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:47.099381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9b3a315-fc11-4ca7-a283-c87ade7081a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:47.100423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9b3a315-fc11-4ca7-a283-c87ade7081a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:47.102663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9b3a315-fc11-4ca7-a283-c87ade7081a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:47.106754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e9b3a315-fc11-4ca7-a283-c87ade7081a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:47.550516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e9b3a315-fc11-4ca7-a283-c87ade7081a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:47.565091 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e9b3a315-fc11-4ca7-a283-c87ade7081a6 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1313 microversion: 2.1 time: 0.499456 Aug 09 17:49:47.572223 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2660/5582] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:47 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:48.179040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5e8e8ce1-4fa1-48e2-a3e9-b22da52b25b4 req-56237b68-ba37-4964-b3a9-5f7646d57107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3efa8b7-6ac8-4076-b985-d51943fc058c", "tag": "e4203e64-c819-450f-abf1-e22b6c55844c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:48.201801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5e8e8ce1-4fa1-48e2-a3e9-b22da52b25b4 req-56237b68-ba37-4964-b3a9-5f7646d57107 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:48.202248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5e8e8ce1-4fa1-48e2-a3e9-b22da52b25b4 req-56237b68-ba37-4964-b3a9-5f7646d57107 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:48.202772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5e8e8ce1-4fa1-48e2-a3e9-b22da52b25b4 req-56237b68-ba37-4964-b3a9-5f7646d57107 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:48.228583 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5e8e8ce1-4fa1-48e2-a3e9-b22da52b25b4 req-56237b68-ba37-4964-b3a9-5f7646d57107 service nova] Creating event network-changed:e4203e64-c819-450f-abf1-e22b6c55844c for instance c3efa8b7-6ac8-4076-b985-d51943fc058c on n-h2-845781-6 Aug 09 17:49:48.234556 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5e8e8ce1-4fa1-48e2-a3e9-b22da52b25b4 req-56237b68-ba37-4964-b3a9-5f7646d57107 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059225 Aug 09 17:49:48.235556 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2923/5583] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:48.590633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-94491c88-6711-4a33-834d-d9961f76e262 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:48.591454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-94491c88-6711-4a33-834d-d9961f76e262 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:48.600239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94491c88-6711-4a33-834d-d9961f76e262 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:48.600788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94491c88-6711-4a33-834d-d9961f76e262 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:48.602265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94491c88-6711-4a33-834d-d9961f76e262 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:48.603258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94491c88-6711-4a33-834d-d9961f76e262 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:48.604107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94491c88-6711-4a33-834d-d9961f76e262 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:48.604965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-94491c88-6711-4a33-834d-d9961f76e262 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:49.008563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-94491c88-6711-4a33-834d-d9961f76e262 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:49.020308 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-94491c88-6711-4a33-834d-d9961f76e262 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1313 microversion: 2.1 time: 0.434526 Aug 09 17:49:49.021438 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2661/5584] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:48 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:50.048051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4d994376-0a1d-40d7-be92-e7eed4dec183 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:50.049559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4d994376-0a1d-40d7-be92-e7eed4dec183 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:50.071157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d994376-0a1d-40d7-be92-e7eed4dec183 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:50.072174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d994376-0a1d-40d7-be92-e7eed4dec183 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:50.072819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d994376-0a1d-40d7-be92-e7eed4dec183 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:50.074609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d994376-0a1d-40d7-be92-e7eed4dec183 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:50.075347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d994376-0a1d-40d7-be92-e7eed4dec183 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:50.076605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d994376-0a1d-40d7-be92-e7eed4dec183 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:50.106169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:50.508588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4d994376-0a1d-40d7-be92-e7eed4dec183 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:50.539673 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4d994376-0a1d-40d7-be92-e7eed4dec183 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1313 microversion: 2.1 time: 0.495543 Aug 09 17:49:50.558311 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2924/5585] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:50 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:51.583965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3955ea51-154f-4981-a2af-621bdf8845c4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:51.591120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3955ea51-154f-4981-a2af-621bdf8845c4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:51.615015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:51.636266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3955ea51-154f-4981-a2af-621bdf8845c4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:51.640772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3955ea51-154f-4981-a2af-621bdf8845c4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:51.642057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3955ea51-154f-4981-a2af-621bdf8845c4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:51.645508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3955ea51-154f-4981-a2af-621bdf8845c4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:51.648649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3955ea51-154f-4981-a2af-621bdf8845c4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:51.650756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3955ea51-154f-4981-a2af-621bdf8845c4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:52.112089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3955ea51-154f-4981-a2af-621bdf8845c4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:52.126597 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3955ea51-154f-4981-a2af-621bdf8845c4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1313 microversion: 2.1 time: 0.551393 Aug 09 17:49:52.127247 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2662/5586] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:51 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1313 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:53.168670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c738620b-8a96-47f8-a687-a0c1db4e1752 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:53.170037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c738620b-8a96-47f8-a687-a0c1db4e1752 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:53.177397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:53.179091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:53.188487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c738620b-8a96-47f8-a687-a0c1db4e1752 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:53.189770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c738620b-8a96-47f8-a687-a0c1db4e1752 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:53.190603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c738620b-8a96-47f8-a687-a0c1db4e1752 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:53.191828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c738620b-8a96-47f8-a687-a0c1db4e1752 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:53.192600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c738620b-8a96-47f8-a687-a0c1db4e1752 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:53.193178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c738620b-8a96-47f8-a687-a0c1db4e1752 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:53.414584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c738620b-8a96-47f8-a687-a0c1db4e1752 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:53.424834 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c738620b-8a96-47f8-a687-a0c1db4e1752 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1313 microversion: 2.1 time: 0.279397 Aug 09 17:49:53.441381 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2925/5587] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:53 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:53.708213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e7c84913-3113-477e-ab14-c2c4cff8f740 req-9db35d33-c98f-4f53-b3f2-7e4153052f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3efa8b7-6ac8-4076-b985-d51943fc058c", "name": "network-vif-plugged", "status": "completed", "tag": "e4203e64-c819-450f-abf1-e22b6c55844c"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:49:53.738344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=32 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:53.748811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e7c84913-3113-477e-ab14-c2c4cff8f740 req-9db35d33-c98f-4f53-b3f2-7e4153052f01 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:53.749353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e7c84913-3113-477e-ab14-c2c4cff8f740 req-9db35d33-c98f-4f53-b3f2-7e4153052f01 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:53.750000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e7c84913-3113-477e-ab14-c2c4cff8f740 req-9db35d33-c98f-4f53-b3f2-7e4153052f01 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:53.776669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=68 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:53.828351 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e7c84913-3113-477e-ab14-c2c4cff8f740 req-9db35d33-c98f-4f53-b3f2-7e4153052f01 service nova] Creating event network-vif-plugged:e4203e64-c819-450f-abf1-e22b6c55844c for instance c3efa8b7-6ac8-4076-b985-d51943fc058c on n-h2-845781-6 Aug 09 17:49:53.850642 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e7c84913-3113-477e-ab14-c2c4cff8f740 req-9db35d33-c98f-4f53-b3f2-7e4153052f01 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148983 Aug 09 17:49:53.852403 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2663/5588] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:49:54.469872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dc9bf402-6f31-4b1e-b591-409b270f6c63 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:54.472127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dc9bf402-6f31-4b1e-b591-409b270f6c63 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:54.484862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc9bf402-6f31-4b1e-b591-409b270f6c63 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:54.486538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc9bf402-6f31-4b1e-b591-409b270f6c63 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:54.487619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc9bf402-6f31-4b1e-b591-409b270f6c63 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:54.489184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc9bf402-6f31-4b1e-b591-409b270f6c63 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:54.490319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc9bf402-6f31-4b1e-b591-409b270f6c63 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:54.491382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc9bf402-6f31-4b1e-b591-409b270f6c63 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:54.851104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dc9bf402-6f31-4b1e-b591-409b270f6c63 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:54.860501 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dc9bf402-6f31-4b1e-b591-409b270f6c63 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1313 microversion: 2.1 time: 0.397455 Aug 09 17:49:54.861517 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2926/5589] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:54 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:49:55.895587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1af9bac2-e83a-4b9d-a33b-043720d82c38 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:55.897054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1af9bac2-e83a-4b9d-a33b-043720d82c38 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:55.905491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1af9bac2-e83a-4b9d-a33b-043720d82c38 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:55.906286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1af9bac2-e83a-4b9d-a33b-043720d82c38 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:55.906903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1af9bac2-e83a-4b9d-a33b-043720d82c38 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:55.907862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1af9bac2-e83a-4b9d-a33b-043720d82c38 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:55.908503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1af9bac2-e83a-4b9d-a33b-043720d82c38 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:55.909110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1af9bac2-e83a-4b9d-a33b-043720d82c38 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:56.119225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1af9bac2-e83a-4b9d-a33b-043720d82c38 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:56.156949 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1af9bac2-e83a-4b9d-a33b-043720d82c38 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1498 microversion: 2.1 time: 0.265286 Aug 09 17:49:56.158497 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2664/5590] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:55 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1498 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:57.046141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-091d0ad0-f2c7-4e79-a0ce-22d8d1ba1236 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:57.051449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-091d0ad0-f2c7-4e79-a0ce-22d8d1ba1236 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:57.059051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:49:57.095294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-091d0ad0-f2c7-4e79-a0ce-22d8d1ba1236 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:57.103452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-091d0ad0-f2c7-4e79-a0ce-22d8d1ba1236 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:57.104779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-091d0ad0-f2c7-4e79-a0ce-22d8d1ba1236 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:57.106408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-091d0ad0-f2c7-4e79-a0ce-22d8d1ba1236 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:57.108929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-091d0ad0-f2c7-4e79-a0ce-22d8d1ba1236 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:57.110548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-091d0ad0-f2c7-4e79-a0ce-22d8d1ba1236 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:57.176111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-091d0ad0-f2c7-4e79-a0ce-22d8d1ba1236 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:49:57.399013 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-091d0ad0-f2c7-4e79-a0ce-22d8d1ba1236 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 204 len: 0 microversion: 2.1 time: 0.349818 Aug 09 17:49:57.403022 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2927/5591] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:49:57 2022] DELETE /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:49:57.418070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d204a31d-d0af-4e87-aa0e-fbf65ad80910 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:57.422747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d204a31d-d0af-4e87-aa0e-fbf65ad80910 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:57.449315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d204a31d-d0af-4e87-aa0e-fbf65ad80910 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:57.453331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d204a31d-d0af-4e87-aa0e-fbf65ad80910 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:57.454447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d204a31d-d0af-4e87-aa0e-fbf65ad80910 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:57.458221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d204a31d-d0af-4e87-aa0e-fbf65ad80910 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:57.459511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d204a31d-d0af-4e87-aa0e-fbf65ad80910 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:57.463286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d204a31d-d0af-4e87-aa0e-fbf65ad80910 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:57.847570 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d204a31d-d0af-4e87-aa0e-fbf65ad80910 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:57.882967 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d204a31d-d0af-4e87-aa0e-fbf65ad80910 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1504 microversion: 2.1 time: 0.469631 Aug 09 17:49:57.886216 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2665/5592] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:57 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:49:58.922570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f610baed-84f2-4834-a72d-186a81e9cc18 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:49:58.923287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f610baed-84f2-4834-a72d-186a81e9cc18 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:49:58.931491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f610baed-84f2-4834-a72d-186a81e9cc18 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:58.932039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f610baed-84f2-4834-a72d-186a81e9cc18 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:58.932498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f610baed-84f2-4834-a72d-186a81e9cc18 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:58.933255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f610baed-84f2-4834-a72d-186a81e9cc18 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:49:58.933730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f610baed-84f2-4834-a72d-186a81e9cc18 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:49:58.934173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f610baed-84f2-4834-a72d-186a81e9cc18 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:49:59.310521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f610baed-84f2-4834-a72d-186a81e9cc18 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:49:59.327679 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f610baed-84f2-4834-a72d-186a81e9cc18 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1504 microversion: 2.1 time: 0.408955 Aug 09 17:49:59.329115 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2928/5593] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:49:58 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:50:00.111481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a81404cf-be6f-424e-964a-83e752eb8b7a req-c29cf89c-b03e-4ebf-921c-0beec73761c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3efa8b7-6ac8-4076-b985-d51943fc058c", "name": "network-vif-deleted", "tag": "e4203e64-c819-450f-abf1-e22b6c55844c"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:00.125648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a81404cf-be6f-424e-964a-83e752eb8b7a req-c29cf89c-b03e-4ebf-921c-0beec73761c3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:00.126334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a81404cf-be6f-424e-964a-83e752eb8b7a req-c29cf89c-b03e-4ebf-921c-0beec73761c3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:00.126794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a81404cf-be6f-424e-964a-83e752eb8b7a req-c29cf89c-b03e-4ebf-921c-0beec73761c3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:00.145970 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a81404cf-be6f-424e-964a-83e752eb8b7a req-c29cf89c-b03e-4ebf-921c-0beec73761c3 service nova] Creating event network-vif-deleted:e4203e64-c819-450f-abf1-e22b6c55844c for instance c3efa8b7-6ac8-4076-b985-d51943fc058c on n-h2-845781-6 Aug 09 17:50:00.152632 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a81404cf-be6f-424e-964a-83e752eb8b7a req-c29cf89c-b03e-4ebf-921c-0beec73761c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045871 Aug 09 17:50:00.153629 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2666/5594] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:00.377281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:00.378769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:00.392250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:00.393625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:00.394479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:00.395850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:00.396862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:00.397629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:00.494702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:00.495576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:00.496313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:00.497019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lazy-loading 'fault' on Instance uuid c3efa8b7-6ac8-4076-b985-d51943fc058c {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:50:00.572783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e287e35124e54b548af734119ac3c4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af2357b654547678fa8dcb676c95fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:00.583395 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0211cc8a-7d30-4b9e-8b63-cc835b4060c0 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 200 len: 1303 microversion: 2.1 time: 0.216882 Aug 09 17:50:00.584064 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2929/5595] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:00 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 1303 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:01.607612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:01.611470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] [instance: c3efa8b7-6ac8-4076-b985-d51943fc058c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:01.626388 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:01.626845 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:01.627295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:01.628129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:01.628755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:01.629246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:01.649976 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] HTTP exception thrown: Instance c3efa8b7-6ac8-4076-b985-d51943fc058c could not be found. Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Request method failure captured: Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c HTTP/1.1 Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p4bSDl15R3OxyW0U_CT-GTO8VfCoivyi-P9eqa3cWM3CvCDuExeVxQuGnyqfPoZr5ihiwv_yICYIV3ASM1HBp81nfn5tySoP3YpILb_E_yFzSqdpAFHkEF2MKOzD3B0nngD7fM6rwxF9L8yhAvXDHs-SDNOYTfdQhbL2zwqEhW6hk8 Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 6af2357b654547678fa8dcb676c95fbb Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesActionsTest-948952856 Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6af2357b654547678fa8dcb676c95fbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6af2357b654547678fa8dcb676c95fbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6af2357b654547678fa8dcb676c95fbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6af2357b654547678fa8dcb676c95fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesActionsTest-948952856 Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 6af2357b654547678fa8dcb676c95fbb Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesActionsTest-948952856 Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesActionsTest-948952856-project Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: e287e35124e54b548af734119ac3c4d4 Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesActionsTest-948952856-project Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance c3efa8b7-6ac8-4076-b985-d51943fc058c could not be found. Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'c3efa8b7-6ac8-4076-b985-d51943fc058c'} Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3efa8b7-6ac8-4076-b985-d51943fc058c could not be found. Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3efa8b7-6ac8-4076-b985-d51943fc058c could not be found. Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:01.653934 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.661186 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:01.661186 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:01.661186 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:01.661186 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:50:01.661186 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:50:01.661186 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3efa8b7-6ac8-4076-b985-d51943fc058c could not be found. Aug 09 17:50:01.661186 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:50:01.661186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] Returning 404 to user: Instance c3efa8b7-6ac8-4076-b985-d51943fc058c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:50:01.661186 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a7ba9f13-c22e-4016-9a63-f5aead6a81e4 tempest-VolumesActionsTest-948952856 tempest-VolumesActionsTest-948952856-project] 10.222.0.93 "GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c" status: 404 len: 111 microversion: 2.1 time: 0.055890 Aug 09 17:50:01.661186 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2667/5596] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:01 2022] GET /compute/v2.1/servers/c3efa8b7-6ac8-4076-b985-d51943fc058c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:50:02.714522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cad1af35-5cb1-476e-9332-693ff174197a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:02.715348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cad1af35-5cb1-476e-9332-693ff174197a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:02.731770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cad1af35-5cb1-476e-9332-693ff174197a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:02.732461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cad1af35-5cb1-476e-9332-693ff174197a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:02.733029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cad1af35-5cb1-476e-9332-693ff174197a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:02.738069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cad1af35-5cb1-476e-9332-693ff174197a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:02.738722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cad1af35-5cb1-476e-9332-693ff174197a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:02.739607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cad1af35-5cb1-476e-9332-693ff174197a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:02.874043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-cad1af35-5cb1-476e-9332-693ff174197a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lazy-loading 'services' on Instance uuid 925758f3-e4b4-44d9-941d-d10ba53df59e {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:50:03.080163 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cad1af35-5cb1-476e-9332-693ff174197a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "DELETE /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/os-volume_attachments/a9c17985-4c37-4072-8b80-dcb51abae9e7" status: 202 len: 0 microversion: 2.1 time: 0.369665 Aug 09 17:50:03.084063 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2930/5597] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:50:02 2022] DELETE /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/os-volume_attachments/a9c17985-4c37-4072-8b80-dcb51abae9e7 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:50:13.675038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-01fbea32-d282-457d-9632-b8ed6079c777 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:13.700945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=9 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:13.700945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=17 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:13.741676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01fbea32-d282-457d-9632-b8ed6079c777 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:13.743671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01fbea32-d282-457d-9632-b8ed6079c777 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:13.752319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-01fbea32-d282-457d-9632-b8ed6079c777 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:13.845861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-01fbea32-d282-457d-9632-b8ed6079c777 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Going to try to stop instance {{(pid=119432) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 17:50:14.012356 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-01fbea32-d282-457d-9632-b8ed6079c777 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "POST /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/action" status: 202 len: 0 microversion: 2.1 time: 0.357373 Aug 09 17:50:14.027462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:14.028572 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2668/5598] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:50:13 2022] POST /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:50:14.028805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:14.057643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c7e592b9-76db-46ec-b87e-981861682c6f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:14.059705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c7e592b9-76db-46ec-b87e-981861682c6f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:14.093540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7e592b9-76db-46ec-b87e-981861682c6f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:14.093959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7e592b9-76db-46ec-b87e-981861682c6f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:14.096700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7e592b9-76db-46ec-b87e-981861682c6f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:14.097751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7e592b9-76db-46ec-b87e-981861682c6f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:14.098275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7e592b9-76db-46ec-b87e-981861682c6f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:14.101028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7e592b9-76db-46ec-b87e-981861682c6f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:14.513652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c7e592b9-76db-46ec-b87e-981861682c6f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:14.524659 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c7e592b9-76db-46ec-b87e-981861682c6f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1675 microversion: 2.1 time: 0.500801 Aug 09 17:50:14.525897 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2931/5599] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:14 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1675 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:15.580268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3d2059e1-e34b-4738-ba83-0405fd3c0dfb tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:15.587065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3d2059e1-e34b-4738-ba83-0405fd3c0dfb tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:15.621252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d2059e1-e34b-4738-ba83-0405fd3c0dfb tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:15.624514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d2059e1-e34b-4738-ba83-0405fd3c0dfb tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:15.628065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d2059e1-e34b-4738-ba83-0405fd3c0dfb tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:15.630960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d2059e1-e34b-4738-ba83-0405fd3c0dfb tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:15.634506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d2059e1-e34b-4738-ba83-0405fd3c0dfb tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:15.635748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d2059e1-e34b-4738-ba83-0405fd3c0dfb tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:17.764456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d2059e1-e34b-4738-ba83-0405fd3c0dfb tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:17.821323 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3d2059e1-e34b-4738-ba83-0405fd3c0dfb tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1675 microversion: 2.1 time: 2.256243 Aug 09 17:50:17.822385 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2669/5600] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:15 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1675 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:50:18.864920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb2d3adf-89cc-4012-83bb-74cd78189a97 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:18.865698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eb2d3adf-89cc-4012-83bb-74cd78189a97 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:18.880852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb2d3adf-89cc-4012-83bb-74cd78189a97 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:18.881791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb2d3adf-89cc-4012-83bb-74cd78189a97 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:18.883051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb2d3adf-89cc-4012-83bb-74cd78189a97 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:18.887302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb2d3adf-89cc-4012-83bb-74cd78189a97 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:18.889315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb2d3adf-89cc-4012-83bb-74cd78189a97 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:18.892416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb2d3adf-89cc-4012-83bb-74cd78189a97 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:19.459922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eb2d3adf-89cc-4012-83bb-74cd78189a97 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:19.473831 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eb2d3adf-89cc-4012-83bb-74cd78189a97 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1675 microversion: 2.1 time: 0.613057 Aug 09 17:50:19.479930 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2932/5601] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:18 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1675 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:20.521784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-502423fb-17e1-4470-9493-f915a91d9dec tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:20.523050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-502423fb-17e1-4470-9493-f915a91d9dec tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:20.541049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-502423fb-17e1-4470-9493-f915a91d9dec tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:20.544378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-502423fb-17e1-4470-9493-f915a91d9dec tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:20.548567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-502423fb-17e1-4470-9493-f915a91d9dec tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:20.549769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-502423fb-17e1-4470-9493-f915a91d9dec tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:20.550572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-502423fb-17e1-4470-9493-f915a91d9dec tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:20.551367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-502423fb-17e1-4470-9493-f915a91d9dec tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:21.636275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-502423fb-17e1-4470-9493-f915a91d9dec tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:21.648335 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-502423fb-17e1-4470-9493-f915a91d9dec tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1675 microversion: 2.1 time: 1.129356 Aug 09 17:50:21.649112 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2670/5602] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:20 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1675 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:22.678889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-092af5f2-f726-4661-9f7a-23c0045141c1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:22.681596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-092af5f2-f726-4661-9f7a-23c0045141c1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:22.715258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-092af5f2-f726-4661-9f7a-23c0045141c1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:22.716026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-092af5f2-f726-4661-9f7a-23c0045141c1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:22.716655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-092af5f2-f726-4661-9f7a-23c0045141c1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:22.717658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-092af5f2-f726-4661-9f7a-23c0045141c1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:22.718178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-092af5f2-f726-4661-9f7a-23c0045141c1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:22.718717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-092af5f2-f726-4661-9f7a-23c0045141c1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:23.147485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-092af5f2-f726-4661-9f7a-23c0045141c1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:23.169400 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-092af5f2-f726-4661-9f7a-23c0045141c1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1675 microversion: 2.1 time: 0.494357 Aug 09 17:50:23.190415 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2933/5603] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:22 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1675 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:50:24.214146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9b1123ac-6ca5-4ed4-a0bf-10a69f0596bf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:24.217126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9b1123ac-6ca5-4ed4-a0bf-10a69f0596bf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:24.242103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1123ac-6ca5-4ed4-a0bf-10a69f0596bf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:24.247111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1123ac-6ca5-4ed4-a0bf-10a69f0596bf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:24.249884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1123ac-6ca5-4ed4-a0bf-10a69f0596bf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:24.252057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1123ac-6ca5-4ed4-a0bf-10a69f0596bf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:24.255709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1123ac-6ca5-4ed4-a0bf-10a69f0596bf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:24.261620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9b1123ac-6ca5-4ed4-a0bf-10a69f0596bf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:25.070471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9b1123ac-6ca5-4ed4-a0bf-10a69f0596bf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:25.110972 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9b1123ac-6ca5-4ed4-a0bf-10a69f0596bf tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1675 microversion: 2.1 time: 0.915826 Aug 09 17:50:25.125066 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2671/5604] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:24 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1675 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:26.155454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d6c9ecde-69f3-4653-9c94-bda7de346fd7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:26.157307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d6c9ecde-69f3-4653-9c94-bda7de346fd7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:26.176440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6c9ecde-69f3-4653-9c94-bda7de346fd7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:26.182417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6c9ecde-69f3-4653-9c94-bda7de346fd7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:26.183291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6c9ecde-69f3-4653-9c94-bda7de346fd7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:26.185123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6c9ecde-69f3-4653-9c94-bda7de346fd7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:26.185886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6c9ecde-69f3-4653-9c94-bda7de346fd7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:26.186606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6c9ecde-69f3-4653-9c94-bda7de346fd7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:26.689298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d6c9ecde-69f3-4653-9c94-bda7de346fd7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:26.700806 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d6c9ecde-69f3-4653-9c94-bda7de346fd7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1652 microversion: 2.1 time: 0.551046 Aug 09 17:50:26.726122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-526df8a0-2cfc-4b70-8d0f-2f66cecebbc3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:26.732056 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2934/5605] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:26 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1652 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:50:26.736686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-526df8a0-2cfc-4b70-8d0f-2f66cecebbc3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:26.737458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-526df8a0-2cfc-4b70-8d0f-2f66cecebbc3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:26.738073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-526df8a0-2cfc-4b70-8d0f-2f66cecebbc3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:26.832398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-526df8a0-2cfc-4b70-8d0f-2f66cecebbc3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Going to try to start instance {{(pid=119432) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 17:50:27.125664 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-526df8a0-2cfc-4b70-8d0f-2f66cecebbc3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "POST /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/action" status: 202 len: 0 microversion: 2.1 time: 0.395524 Aug 09 17:50:27.137992 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2672/5606] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:50:26 2022] POST /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:50:27.145272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-248f30d6-0596-401a-a3ae-e7711972b11d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:27.146216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-248f30d6-0596-401a-a3ae-e7711972b11d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:27.157347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-248f30d6-0596-401a-a3ae-e7711972b11d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:27.163305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-248f30d6-0596-401a-a3ae-e7711972b11d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:27.164668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-248f30d6-0596-401a-a3ae-e7711972b11d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:27.165626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-248f30d6-0596-401a-a3ae-e7711972b11d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:27.166277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-248f30d6-0596-401a-a3ae-e7711972b11d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:27.168210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-248f30d6-0596-401a-a3ae-e7711972b11d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:28.436497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-248f30d6-0596-401a-a3ae-e7711972b11d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:28.448463 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-248f30d6-0596-401a-a3ae-e7711972b11d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1661 microversion: 2.1 time: 1.307591 Aug 09 17:50:28.461363 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2935/5607] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:27 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1661 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:29.536086 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0488de0a-924c-4a19-8ffb-48219bd40603 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:29.547300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0488de0a-924c-4a19-8ffb-48219bd40603 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:29.605246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0488de0a-924c-4a19-8ffb-48219bd40603 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:29.607068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0488de0a-924c-4a19-8ffb-48219bd40603 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:29.608385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0488de0a-924c-4a19-8ffb-48219bd40603 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:29.610290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0488de0a-924c-4a19-8ffb-48219bd40603 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:29.611366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0488de0a-924c-4a19-8ffb-48219bd40603 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:29.612266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0488de0a-924c-4a19-8ffb-48219bd40603 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:29.975443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1281493498", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:30.001211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0488de0a-924c-4a19-8ffb-48219bd40603 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:30.022620 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0488de0a-924c-4a19-8ffb-48219bd40603 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1661 microversion: 2.1 time: 0.550815 Aug 09 17:50:30.025955 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2673/5608] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:29 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1661 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:30.211580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:50:31.029118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:50:31.029865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:50:31.031292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:50:31.032471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:50:31.033535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:50:31.054224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-47a1f786-fbbc-49d7-9bf5-f8ba98d27c29 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:31.055656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-47a1f786-fbbc-49d7-9bf5-f8ba98d27c29 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:31.067829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47a1f786-fbbc-49d7-9bf5-f8ba98d27c29 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:31.072744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47a1f786-fbbc-49d7-9bf5-f8ba98d27c29 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:31.073029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:31.073806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47a1f786-fbbc-49d7-9bf5-f8ba98d27c29 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:31.074652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47a1f786-fbbc-49d7-9bf5-f8ba98d27c29 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:31.077392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47a1f786-fbbc-49d7-9bf5-f8ba98d27c29 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:31.086407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-47a1f786-fbbc-49d7-9bf5-f8ba98d27c29 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:31.087330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:31.088448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:31.090138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:31.091249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:31.092466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:31.183351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Getting quotas for project 868e962e356441e2a107b8782d0a8345. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:50:31.193355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Getting quotas for user a41ddc9a9d5b4639b761878ac32e1d87 and project 868e962e356441e2a107b8782d0a8345. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:50:31.217565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:50:31.222219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:50:31.330673 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-27456641-8fff-4393-ab66-7187a44f0820 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.367663 Aug 09 17:50:31.332237 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2936/5609] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:50:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:50:31.351307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6d880946-8ed5-4e13-8c8f-dce34349449f tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:31.355009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6d880946-8ed5-4e13-8c8f-dce34349449f tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:31.516232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6d880946-8ed5-4e13-8c8f-dce34349449f tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:31.532173 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6d880946-8ed5-4e13-8c8f-dce34349449f tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1215 microversion: 2.1 time: 0.191392 Aug 09 17:50:31.533438 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2937/5610] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:31 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:50:31.667591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-47a1f786-fbbc-49d7-9bf5-f8ba98d27c29 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:31.676798 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-47a1f786-fbbc-49d7-9bf5-f8ba98d27c29 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1665 microversion: 2.1 time: 0.627974 Aug 09 17:50:31.706180 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2674/5611] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:31 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1665 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:50:32.558180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5205d5a2-16b5-45cd-b820-c9c76cc7f289 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:32.560304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5205d5a2-16b5-45cd-b820-c9c76cc7f289 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:32.586809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5205d5a2-16b5-45cd-b820-c9c76cc7f289 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:32.589128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5205d5a2-16b5-45cd-b820-c9c76cc7f289 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:32.591414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5205d5a2-16b5-45cd-b820-c9c76cc7f289 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:32.593223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5205d5a2-16b5-45cd-b820-c9c76cc7f289 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:32.594413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5205d5a2-16b5-45cd-b820-c9c76cc7f289 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:32.595497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5205d5a2-16b5-45cd-b820-c9c76cc7f289 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:32.822177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5205d5a2-16b5-45cd-b820-c9c76cc7f289 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:32.833909 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5205d5a2-16b5-45cd-b820-c9c76cc7f289 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1211 microversion: 2.1 time: 0.282820 Aug 09 17:50:32.834617 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2938/5612] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:32 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1211 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:33.857904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-45cb86a6-7285-4852-9710-fa70dd89e509 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:33.858580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-45cb86a6-7285-4852-9710-fa70dd89e509 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:33.874877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45cb86a6-7285-4852-9710-fa70dd89e509 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:33.876296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45cb86a6-7285-4852-9710-fa70dd89e509 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:33.877664 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45cb86a6-7285-4852-9710-fa70dd89e509 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:33.879374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45cb86a6-7285-4852-9710-fa70dd89e509 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:33.883203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45cb86a6-7285-4852-9710-fa70dd89e509 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:33.884943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45cb86a6-7285-4852-9710-fa70dd89e509 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:34.088524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45cb86a6-7285-4852-9710-fa70dd89e509 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:34.114391 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-45cb86a6-7285-4852-9710-fa70dd89e509 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1273 microversion: 2.1 time: 0.261578 Aug 09 17:50:34.116454 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2675/5613] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:33 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:35.155980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9b69262b-6166-404f-80ea-2d61f1cace63 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:35.157483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9b69262b-6166-404f-80ea-2d61f1cace63 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:35.171656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b69262b-6166-404f-80ea-2d61f1cace63 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:35.176343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b69262b-6166-404f-80ea-2d61f1cace63 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:35.177294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b69262b-6166-404f-80ea-2d61f1cace63 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:35.178379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b69262b-6166-404f-80ea-2d61f1cace63 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:35.181047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b69262b-6166-404f-80ea-2d61f1cace63 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:35.183348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b69262b-6166-404f-80ea-2d61f1cace63 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:35.325334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9b69262b-6166-404f-80ea-2d61f1cace63 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:35.343247 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9b69262b-6166-404f-80ea-2d61f1cace63 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1273 microversion: 2.1 time: 0.192111 Aug 09 17:50:35.344263 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2939/5614] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:35 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:36.381921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5afcf209-c745-4102-bd9b-4ed1abe15f01 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:36.385783 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5afcf209-c745-4102-bd9b-4ed1abe15f01 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:36.431074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5afcf209-c745-4102-bd9b-4ed1abe15f01 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:36.437838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5afcf209-c745-4102-bd9b-4ed1abe15f01 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:36.439049 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5afcf209-c745-4102-bd9b-4ed1abe15f01 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:36.440747 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5afcf209-c745-4102-bd9b-4ed1abe15f01 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:36.441868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5afcf209-c745-4102-bd9b-4ed1abe15f01 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:36.447982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5afcf209-c745-4102-bd9b-4ed1abe15f01 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:37.203554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5afcf209-c745-4102-bd9b-4ed1abe15f01 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:37.220999 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5afcf209-c745-4102-bd9b-4ed1abe15f01 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1315 microversion: 2.1 time: 0.846403 Aug 09 17:50:37.235682 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2676/5615] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:36 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:50:38.262423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df1756a8-5398-4fd8-b354-1b4b6ea004ba tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:38.268261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df1756a8-5398-4fd8-b354-1b4b6ea004ba tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:38.301112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df1756a8-5398-4fd8-b354-1b4b6ea004ba tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:38.303667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df1756a8-5398-4fd8-b354-1b4b6ea004ba tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:38.306049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df1756a8-5398-4fd8-b354-1b4b6ea004ba tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:38.311229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df1756a8-5398-4fd8-b354-1b4b6ea004ba tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:38.312829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df1756a8-5398-4fd8-b354-1b4b6ea004ba tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:38.315412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df1756a8-5398-4fd8-b354-1b4b6ea004ba tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:38.823030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-df1756a8-5398-4fd8-b354-1b4b6ea004ba tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:38.844149 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df1756a8-5398-4fd8-b354-1b4b6ea004ba tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1315 microversion: 2.1 time: 0.583438 Aug 09 17:50:38.846045 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2940/5616] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:38 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:39.243603 n-d-845781-6 devstack@n-api.service[119432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:50:39.244352 n-d-845781-6 devstack@n-api.service[119432]: Tue Aug 9 17:50:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:50:39.432992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-fb8c4e20-4a93-4f8a-a202-c24b837c6a62 req-6d7cd70a-adfe-46fd-afaa-bb81567dcb2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a1e25d2-552d-4d8c-bd81-21b651315ae6", "tag": "acdaa3e7-e753-4fa5-a1b5-fb1ebb96ead9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:39.510307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fb8c4e20-4a93-4f8a-a202-c24b837c6a62 req-6d7cd70a-adfe-46fd-afaa-bb81567dcb2d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:39.511582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fb8c4e20-4a93-4f8a-a202-c24b837c6a62 req-6d7cd70a-adfe-46fd-afaa-bb81567dcb2d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:39.515669 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-fb8c4e20-4a93-4f8a-a202-c24b837c6a62 req-6d7cd70a-adfe-46fd-afaa-bb81567dcb2d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:39.575435 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-fb8c4e20-4a93-4f8a-a202-c24b837c6a62 req-6d7cd70a-adfe-46fd-afaa-bb81567dcb2d service nova] Creating event network-changed:acdaa3e7-e753-4fa5-a1b5-fb1ebb96ead9 for instance 8a1e25d2-552d-4d8c-bd81-21b651315ae6 on n-h2-845781-6 Aug 09 17:50:39.592843 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-fb8c4e20-4a93-4f8a-a202-c24b837c6a62 req-6d7cd70a-adfe-46fd-afaa-bb81567dcb2d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170420 Aug 09 17:50:39.595112 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2677/5617] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:39.896961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-72fbd24d-fbed-4637-9fd8-dc49ad4a17f2 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:39.903096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-72fbd24d-fbed-4637-9fd8-dc49ad4a17f2 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:39.947253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72fbd24d-fbed-4637-9fd8-dc49ad4a17f2 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:39.953815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72fbd24d-fbed-4637-9fd8-dc49ad4a17f2 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:39.955801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72fbd24d-fbed-4637-9fd8-dc49ad4a17f2 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:39.959096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72fbd24d-fbed-4637-9fd8-dc49ad4a17f2 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:39.962881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72fbd24d-fbed-4637-9fd8-dc49ad4a17f2 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:39.965647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72fbd24d-fbed-4637-9fd8-dc49ad4a17f2 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:40.655123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-72fbd24d-fbed-4637-9fd8-dc49ad4a17f2 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:40.678321 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-72fbd24d-fbed-4637-9fd8-dc49ad4a17f2 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1315 microversion: 2.1 time: 0.793213 Aug 09 17:50:40.680737 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2941/5618] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:39 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1315 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:41.717671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7ade1a0e-e92e-4d0b-8f93-87105f2219a4 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:41.721130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7ade1a0e-e92e-4d0b-8f93-87105f2219a4 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:41.761334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ade1a0e-e92e-4d0b-8f93-87105f2219a4 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:41.764936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ade1a0e-e92e-4d0b-8f93-87105f2219a4 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:41.769054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ade1a0e-e92e-4d0b-8f93-87105f2219a4 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:41.770577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ade1a0e-e92e-4d0b-8f93-87105f2219a4 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:41.771435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ade1a0e-e92e-4d0b-8f93-87105f2219a4 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:41.772286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7ade1a0e-e92e-4d0b-8f93-87105f2219a4 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:42.127367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7ade1a0e-e92e-4d0b-8f93-87105f2219a4 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:42.155052 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7ade1a0e-e92e-4d0b-8f93-87105f2219a4 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1315 microversion: 2.1 time: 0.454970 Aug 09 17:50:42.173375 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2678/5619] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:41 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:43.191662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09526d3b-5b38-4e09-b799-f192601b9e76 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:43.193203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09526d3b-5b38-4e09-b799-f192601b9e76 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:43.208576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:43.212967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:43.215499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09526d3b-5b38-4e09-b799-f192601b9e76 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:43.222737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09526d3b-5b38-4e09-b799-f192601b9e76 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:43.232713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09526d3b-5b38-4e09-b799-f192601b9e76 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:43.234677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09526d3b-5b38-4e09-b799-f192601b9e76 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:43.235396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09526d3b-5b38-4e09-b799-f192601b9e76 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:43.250392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09526d3b-5b38-4e09-b799-f192601b9e76 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:43.944093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-09526d3b-5b38-4e09-b799-f192601b9e76 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:43.958989 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09526d3b-5b38-4e09-b799-f192601b9e76 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1315 microversion: 2.1 time: 0.779814 Aug 09 17:50:43.960516 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2942/5620] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:43 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:44.603548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a58e3c2f-277e-4c7d-aa4b-1adbe5bcf90c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'create', calling method: .version_select at 0x7fbbca2f95e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1905898142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw9Ur3Hvq8Wv4YYduRq5ZmHU6y1HTFYShK1VgPNc8QlMhyx3J84LvRBI+icIV5ZqRBqljlSs0hHgvWnQ5nMtzP4dohAjq5v2aHD+dQovtgRFl/T7C7wCJxipRgLTgR3VA=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:44.616289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=23 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:44.645288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a58e3c2f-277e-4c7d-aa4b-1adbe5bcf90c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for project 060105d0d71644839935005af8ad1bda. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:50:44.661884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-a58e3c2f-277e-4c7d-aa4b-1adbe5bcf90c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for user a343f75165674844a2e9e46500fa01c0 and project 060105d0d71644839935005af8ad1bda. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:50:44.748932 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a58e3c2f-277e-4c7d-aa4b-1adbe5bcf90c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.737630 Aug 09 17:50:44.750323 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2679/5621] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:50:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:44.984391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3700b6c-5d39-48ac-9bd0-6d02b901e474 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:44.986673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3700b6c-5d39-48ac-9bd0-6d02b901e474 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:44.995460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:45.014557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3700b6c-5d39-48ac-9bd0-6d02b901e474 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:45.016116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3700b6c-5d39-48ac-9bd0-6d02b901e474 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:45.017152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3700b6c-5d39-48ac-9bd0-6d02b901e474 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:45.020740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3700b6c-5d39-48ac-9bd0-6d02b901e474 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:45.022830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3700b6c-5d39-48ac-9bd0-6d02b901e474 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:45.024367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3700b6c-5d39-48ac-9bd0-6d02b901e474 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:45.033159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=63 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:45.384364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e3700b6c-5d39-48ac-9bd0-6d02b901e474 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:45.426771 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3700b6c-5d39-48ac-9bd0-6d02b901e474 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1315 microversion: 2.1 time: 0.448089 Aug 09 17:50:45.444987 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2943/5622] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:44 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:46.476176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f012682-0b02-4838-ab65-a295a7212cdd tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:46.477662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8f012682-0b02-4838-ab65-a295a7212cdd tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:46.494828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f012682-0b02-4838-ab65-a295a7212cdd tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:46.495788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f012682-0b02-4838-ab65-a295a7212cdd tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:46.496525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f012682-0b02-4838-ab65-a295a7212cdd tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:46.497735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f012682-0b02-4838-ab65-a295a7212cdd tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:46.498582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f012682-0b02-4838-ab65-a295a7212cdd tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:46.499355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f012682-0b02-4838-ab65-a295a7212cdd tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:46.574245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:46.826789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8f012682-0b02-4838-ab65-a295a7212cdd tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:46.843221 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8f012682-0b02-4838-ab65-a295a7212cdd tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1315 microversion: 2.1 time: 0.379255 Aug 09 17:50:46.867674 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2680/5623] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:46 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:47.887238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ab81a4a3-f23c-4f7c-855b-4fae212ff420 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:47.902578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ab81a4a3-f23c-4f7c-855b-4fae212ff420 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:47.935340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab81a4a3-f23c-4f7c-855b-4fae212ff420 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:47.944967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab81a4a3-f23c-4f7c-855b-4fae212ff420 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:47.946509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab81a4a3-f23c-4f7c-855b-4fae212ff420 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:47.948303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab81a4a3-f23c-4f7c-855b-4fae212ff420 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:47.953250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab81a4a3-f23c-4f7c-855b-4fae212ff420 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:47.969498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ab81a4a3-f23c-4f7c-855b-4fae212ff420 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:48.223200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-8136a1ba-0b46-4bb8-92bd-3ec049c8b656 req-c6aa6e49-de25-4e70-b0c6-dfc3c8e5fdc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1e25d2-552d-4d8c-bd81-21b651315ae6", "name": "network-vif-plugged", "status": "completed", "tag": "acdaa3e7-e753-4fa5-a1b5-fb1ebb96ead9"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:48.260952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8136a1ba-0b46-4bb8-92bd-3ec049c8b656 req-c6aa6e49-de25-4e70-b0c6-dfc3c8e5fdc7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:48.265588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8136a1ba-0b46-4bb8-92bd-3ec049c8b656 req-c6aa6e49-de25-4e70-b0c6-dfc3c8e5fdc7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:48.266359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8136a1ba-0b46-4bb8-92bd-3ec049c8b656 req-c6aa6e49-de25-4e70-b0c6-dfc3c8e5fdc7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:48.294875 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-8136a1ba-0b46-4bb8-92bd-3ec049c8b656 req-c6aa6e49-de25-4e70-b0c6-dfc3c8e5fdc7 service nova] Creating event network-vif-plugged:acdaa3e7-e753-4fa5-a1b5-fb1ebb96ead9 for instance 8a1e25d2-552d-4d8c-bd81-21b651315ae6 on n-h2-845781-6 Aug 09 17:50:48.316002 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-8136a1ba-0b46-4bb8-92bd-3ec049c8b656 req-c6aa6e49-de25-4e70-b0c6-dfc3c8e5fdc7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102402 Aug 09 17:50:48.317622 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2681/5624] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:48.535568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ab81a4a3-f23c-4f7c-855b-4fae212ff420 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:48.565685 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ab81a4a3-f23c-4f7c-855b-4fae212ff420 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1315 microversion: 2.1 time: 0.687510 Aug 09 17:50:48.568073 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2944/5625] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:47 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:49.590744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-04689a43-3923-4ca0-9e88-4ec537e7bbc7 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:49.591956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-04689a43-3923-4ca0-9e88-4ec537e7bbc7 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:49.605847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04689a43-3923-4ca0-9e88-4ec537e7bbc7 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:49.608377 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04689a43-3923-4ca0-9e88-4ec537e7bbc7 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:49.609591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04689a43-3923-4ca0-9e88-4ec537e7bbc7 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:49.612826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04689a43-3923-4ca0-9e88-4ec537e7bbc7 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:49.615526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04689a43-3923-4ca0-9e88-4ec537e7bbc7 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:49.616832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04689a43-3923-4ca0-9e88-4ec537e7bbc7 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:50.077545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-04689a43-3923-4ca0-9e88-4ec537e7bbc7 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:50.117120 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-04689a43-3923-4ca0-9e88-4ec537e7bbc7 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1315 microversion: 2.1 time: 0.531446 Aug 09 17:50:50.123418 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2682/5626] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:49 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:51.154203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-96a9a560-3f61-4b49-b343-40174f07a557 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:51.155092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-96a9a560-3f61-4b49-b343-40174f07a557 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:51.170242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96a9a560-3f61-4b49-b343-40174f07a557 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:51.170731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96a9a560-3f61-4b49-b343-40174f07a557 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:51.171185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96a9a560-3f61-4b49-b343-40174f07a557 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:51.171956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96a9a560-3f61-4b49-b343-40174f07a557 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:51.172431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96a9a560-3f61-4b49-b343-40174f07a557 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:51.172876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96a9a560-3f61-4b49-b343-40174f07a557 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:51.805697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-96a9a560-3f61-4b49-b343-40174f07a557 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:51.818579 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-96a9a560-3f61-4b49-b343-40174f07a557 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1464 microversion: 2.1 time: 0.668204 Aug 09 17:50:51.819399 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2945/5627] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:51 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1464 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:50:51.887062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4edcf7d5-7f03-4783-8a88-51d480cddd4a tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:51.887911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4edcf7d5-7f03-4783-8a88-51d480cddd4a tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:51.896817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4edcf7d5-7f03-4783-8a88-51d480cddd4a tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:51.897660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4edcf7d5-7f03-4783-8a88-51d480cddd4a tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:51.899707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4edcf7d5-7f03-4783-8a88-51d480cddd4a tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:51.901454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4edcf7d5-7f03-4783-8a88-51d480cddd4a tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:51.902213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4edcf7d5-7f03-4783-8a88-51d480cddd4a tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:51.902855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4edcf7d5-7f03-4783-8a88-51d480cddd4a tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:51.947233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4edcf7d5-7f03-4783-8a88-51d480cddd4a tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:50:52.142052 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4edcf7d5-7f03-4783-8a88-51d480cddd4a tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 204 len: 0 microversion: 2.1 time: 0.259767 Aug 09 17:50:52.144022 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2683/5628] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:50:51 2022] DELETE /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:50:52.158980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e866076e-dfa6-4dda-99a3-8f913de8d344 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:52.161223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e866076e-dfa6-4dda-99a3-8f913de8d344 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:52.175150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e866076e-dfa6-4dda-99a3-8f913de8d344 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:52.176446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e866076e-dfa6-4dda-99a3-8f913de8d344 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:52.177810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e866076e-dfa6-4dda-99a3-8f913de8d344 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:52.179614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e866076e-dfa6-4dda-99a3-8f913de8d344 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:52.182730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e866076e-dfa6-4dda-99a3-8f913de8d344 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:52.183973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e866076e-dfa6-4dda-99a3-8f913de8d344 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:53.112041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e866076e-dfa6-4dda-99a3-8f913de8d344 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:53.142887 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e866076e-dfa6-4dda-99a3-8f913de8d344 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1470 microversion: 2.1 time: 0.991194 Aug 09 17:50:53.160923 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2946/5629] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:52 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1470 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:54.206479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72178a9c-7f05-476c-a3c5-1002b57e0620 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:54.210150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-72178a9c-7f05-476c-a3c5-1002b57e0620 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:54.247588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72178a9c-7f05-476c-a3c5-1002b57e0620 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:54.249761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72178a9c-7f05-476c-a3c5-1002b57e0620 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:54.255890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72178a9c-7f05-476c-a3c5-1002b57e0620 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:54.257848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72178a9c-7f05-476c-a3c5-1002b57e0620 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:54.261724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72178a9c-7f05-476c-a3c5-1002b57e0620 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:54.262324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72178a9c-7f05-476c-a3c5-1002b57e0620 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:54.702971 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:50:55.517305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-72178a9c-7f05-476c-a3c5-1002b57e0620 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:55.546992 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72178a9c-7f05-476c-a3c5-1002b57e0620 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1470 microversion: 2.1 time: 1.354684 Aug 09 17:50:55.548753 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2684/5630] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:54 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1470 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:56.357302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3dfa64d3-a8a6-4fe6-a529-5cac3a513eac req-6cb6683c-8850-48fa-994c-4d0f0fee3a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1e25d2-552d-4d8c-bd81-21b651315ae6", "name": "network-vif-deleted", "tag": "acdaa3e7-e753-4fa5-a1b5-fb1ebb96ead9"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:50:56.449884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3dfa64d3-a8a6-4fe6-a529-5cac3a513eac req-6cb6683c-8850-48fa-994c-4d0f0fee3a8e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:56.450763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3dfa64d3-a8a6-4fe6-a529-5cac3a513eac req-6cb6683c-8850-48fa-994c-4d0f0fee3a8e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:56.451570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3dfa64d3-a8a6-4fe6-a529-5cac3a513eac req-6cb6683c-8850-48fa-994c-4d0f0fee3a8e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:56.528174 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3dfa64d3-a8a6-4fe6-a529-5cac3a513eac req-6cb6683c-8850-48fa-994c-4d0f0fee3a8e service nova] Creating event network-vif-deleted:acdaa3e7-e753-4fa5-a1b5-fb1ebb96ead9 for instance 8a1e25d2-552d-4d8c-bd81-21b651315ae6 on n-h2-845781-6 Aug 09 17:50:56.554796 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3dfa64d3-a8a6-4fe6-a529-5cac3a513eac req-6cb6683c-8850-48fa-994c-4d0f0fee3a8e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224447 Aug 09 17:50:56.560037 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2947/5631] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:50:56.595183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:56.596398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:56.635812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:56.643095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:56.645855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:56.650737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:56.653964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:56.657807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:56.777148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:56.778497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:56.792720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:56.793440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lazy-loading 'fault' on Instance uuid 8a1e25d2-552d-4d8c-bd81-21b651315ae6 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:50:56.940138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41ddc9a9d5b4639b761878ac32e1d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '868e962e356441e2a107b8782d0a8345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:50:56.958497 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8b31c4ac-38bf-4fd1-81fb-41313f1dcbd3 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 200 len: 1305 microversion: 2.1 time: 0.370143 Aug 09 17:50:56.971418 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2685/5632] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:56 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 1305 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:50:58.000276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:50:58.001921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] [instance: 8a1e25d2-552d-4d8c-bd81-21b651315ae6] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:50:58.032956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:58.040046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:58.041242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:58.051042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:50:58.052411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:50:58.053450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:50:58.102966 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] HTTP exception thrown: Instance 8a1e25d2-552d-4d8c-bd81-21b651315ae6 could not be found. Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Request method failure captured: Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 HTTP/1.1 Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p5g6Tlk6EfOgy5xtgbZKU64VwyxPWzw_mP5gD9-E7CrHhQPXCjEMJ9ZuyRifh-nlbDEMEWrKIGzZZajaOas5kV045yVCLJKKdPfy0fIkwbdlLTzEsQ5UOT4f_3WGFA-WLzg0Qoe_AN9g_QA1eSdDnEVNq3THA25P0xkf-pv0StBI-A Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 868e962e356441e2a107b8782d0a8345 Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-VolumesNegativeTest-1472682408 Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_868e962e356441e2a107b8782d0a8345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/868e962e356441e2a107b8782d0a8345"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/868e962e356441e2a107b8782d0a8345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/868e962e356441e2a107b8782d0a8345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-VolumesNegativeTest-1472682408 Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 868e962e356441e2a107b8782d0a8345 Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-VolumesNegativeTest-1472682408 Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-VolumesNegativeTest-1472682408-project Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a41ddc9a9d5b4639b761878ac32e1d87 Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-VolumesNegativeTest-1472682408-project Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8a1e25d2-552d-4d8c-bd81-21b651315ae6 could not be found. Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8a1e25d2-552d-4d8c-bd81-21b651315ae6'} Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1e25d2-552d-4d8c-bd81-21b651315ae6 could not be found. Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1e25d2-552d-4d8c-bd81-21b651315ae6 could not be found. Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:50:58.106919 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:50:58.114183 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:50:58.114183 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:50:58.114183 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:50:58.114183 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:50:58.114183 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:50:58.114183 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1e25d2-552d-4d8c-bd81-21b651315ae6 could not be found. Aug 09 17:50:58.114183 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:50:58.116899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] Returning 404 to user: Instance 8a1e25d2-552d-4d8c-bd81-21b651315ae6 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:50:58.118894 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-907cbec4-d725-4af0-a59d-c0eded601a78 tempest-VolumesNegativeTest-1472682408 tempest-VolumesNegativeTest-1472682408-project] 10.222.0.93 "GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6" status: 404 len: 111 microversion: 2.1 time: 0.136285 Aug 09 17:50:58.120284 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2948/5633] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:50:57 2022] GET /compute/v2.1/servers/8a1e25d2-552d-4d8c-bd81-21b651315ae6 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:50:59.828325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1313412361", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "9713ae24-6c7d-42c0-a45a-031682bdccd4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1905898142", "security_groups": [{"name": "tempest-secgroup-smoke-5387739"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:51:00.260159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] validate_networks() for [('9713ae24-6c7d-42c0-a45a-031682bdccd4', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:51:01.745163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:51:01.748189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:51:01.749257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:51:01.750239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:51:01.751124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:51:01.840754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:01.851419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:01.852724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:01.854258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:01.873646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:01.874686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:02.011254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for project 060105d0d71644839935005af8ad1bda. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:51:02.045268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for user a343f75165674844a2e9e46500fa01c0 and project 060105d0d71644839935005af8ad1bda. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:51:02.122539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:51:02.125825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:51:02.214386 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-14ddf67c-c1a8-4a3f-af82-68be97610ff1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.394804 Aug 09 17:51:02.216068 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2686/5634] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:50:59 2022] POST /compute/v2.1/servers => generated 403 bytes in 2398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:51:02.234077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a121b17e-46e3-4cb4-bd6f-a95086dc8d02 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:02.235452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a121b17e-46e3-4cb4-bd6f-a95086dc8d02 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:02.358784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a121b17e-46e3-4cb4-bd6f-a95086dc8d02 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:02.372886 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a121b17e-46e3-4cb4-bd6f-a95086dc8d02 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1267 microversion: 2.1 time: 0.144797 Aug 09 17:51:02.376543 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2949/5635] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:02 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:03.415555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-684f7407-2bc5-44df-9866-0efe95e4b1bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:03.416208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-684f7407-2bc5-44df-9866-0efe95e4b1bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:03.529205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-684f7407-2bc5-44df-9866-0efe95e4b1bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:03.539075 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-684f7407-2bc5-44df-9866-0efe95e4b1bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1267 microversion: 2.1 time: 0.128646 Aug 09 17:51:03.543162 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2687/5636] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:03 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:04.572795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-753d0e22-9fd0-4d9d-bb2b-7643e864d059 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:04.582617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-753d0e22-9fd0-4d9d-bb2b-7643e864d059 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:04.627435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-753d0e22-9fd0-4d9d-bb2b-7643e864d059 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:04.634245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-753d0e22-9fd0-4d9d-bb2b-7643e864d059 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:04.636927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-753d0e22-9fd0-4d9d-bb2b-7643e864d059 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:04.650446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-753d0e22-9fd0-4d9d-bb2b-7643e864d059 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:04.651487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-753d0e22-9fd0-4d9d-bb2b-7643e864d059 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:04.653458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-753d0e22-9fd0-4d9d-bb2b-7643e864d059 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:05.068833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ea7892c-5c80-4695-a564-882a331034cd tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:05.086631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3ea7892c-5c80-4695-a564-882a331034cd tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:05.143341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ea7892c-5c80-4695-a564-882a331034cd tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:05.151399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ea7892c-5c80-4695-a564-882a331034cd tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:05.156435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ea7892c-5c80-4695-a564-882a331034cd tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:05.159176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ea7892c-5c80-4695-a564-882a331034cd tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:05.168551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ea7892c-5c80-4695-a564-882a331034cd tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:05.171595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ea7892c-5c80-4695-a564-882a331034cd tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:05.363871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-753d0e22-9fd0-4d9d-bb2b-7643e864d059 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:05.397652 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3ea7892c-5c80-4695-a564-882a331034cd tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.350539 Aug 09 17:51:05.416844 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2688/5637] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:51:05 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e/os-volume_attachments => generated 25 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:51:05.425199 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-753d0e22-9fd0-4d9d-bb2b-7643e864d059 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1319 microversion: 2.1 time: 0.859139 Aug 09 17:51:05.464043 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2950/5638] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:04 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1319 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:05.647479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3770400c-8b5a-4442-8981-c99e2c8d2e13 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:05.648458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3770400c-8b5a-4442-8981-c99e2c8d2e13 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:05.695063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3770400c-8b5a-4442-8981-c99e2c8d2e13 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:05.702299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3770400c-8b5a-4442-8981-c99e2c8d2e13 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:05.710427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3770400c-8b5a-4442-8981-c99e2c8d2e13 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:05.712229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3770400c-8b5a-4442-8981-c99e2c8d2e13 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:05.716173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3770400c-8b5a-4442-8981-c99e2c8d2e13 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:05.721724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3770400c-8b5a-4442-8981-c99e2c8d2e13 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:05.855357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3770400c-8b5a-4442-8981-c99e2c8d2e13 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:51:06.137845 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3770400c-8b5a-4442-8981-c99e2c8d2e13 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "DELETE /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 204 len: 0 microversion: 2.1 time: 0.494756 Aug 09 17:51:06.146566 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2689/5639] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:51:05 2022] DELETE /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:51:06.162246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f4352aa4-21fc-4484-80ac-e8d16e3a2b75 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:06.165141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f4352aa4-21fc-4484-80ac-e8d16e3a2b75 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:06.199240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4352aa4-21fc-4484-80ac-e8d16e3a2b75 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:06.219247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4352aa4-21fc-4484-80ac-e8d16e3a2b75 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:06.221764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4352aa4-21fc-4484-80ac-e8d16e3a2b75 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:06.233894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4352aa4-21fc-4484-80ac-e8d16e3a2b75 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:06.240996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4352aa4-21fc-4484-80ac-e8d16e3a2b75 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:06.241932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4352aa4-21fc-4484-80ac-e8d16e3a2b75 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:06.473011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2b380173-be3e-48ba-90e0-db264e56ef1f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:06.473988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2b380173-be3e-48ba-90e0-db264e56ef1f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:06.495600 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b380173-be3e-48ba-90e0-db264e56ef1f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:06.496489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b380173-be3e-48ba-90e0-db264e56ef1f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:06.497285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b380173-be3e-48ba-90e0-db264e56ef1f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:06.517185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b380173-be3e-48ba-90e0-db264e56ef1f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:06.518428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b380173-be3e-48ba-90e0-db264e56ef1f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:06.519186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2b380173-be3e-48ba-90e0-db264e56ef1f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:06.765048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2b380173-be3e-48ba-90e0-db264e56ef1f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:06.798275 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2b380173-be3e-48ba-90e0-db264e56ef1f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1325 microversion: 2.1 time: 0.336552 Aug 09 17:51:06.802312 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2690/5640] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:06 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1325 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:06.942540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f4352aa4-21fc-4484-80ac-e8d16e3a2b75 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:07.002380 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f4352aa4-21fc-4484-80ac-e8d16e3a2b75 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1671 microversion: 2.1 time: 0.852165 Aug 09 17:51:07.004887 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2951/5641] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:06 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1671 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:07.828835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-909fef4b-a658-473c-b3e9-2c95598dfa04 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:07.833808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-909fef4b-a658-473c-b3e9-2c95598dfa04 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:07.872617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-909fef4b-a658-473c-b3e9-2c95598dfa04 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:07.876794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-909fef4b-a658-473c-b3e9-2c95598dfa04 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:07.878945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-909fef4b-a658-473c-b3e9-2c95598dfa04 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:07.880717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-909fef4b-a658-473c-b3e9-2c95598dfa04 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:07.882687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-909fef4b-a658-473c-b3e9-2c95598dfa04 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:07.883409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-909fef4b-a658-473c-b3e9-2c95598dfa04 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:08.037106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99677fc0-741b-4f9d-9c07-945ad59ae29b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:08.040037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99677fc0-741b-4f9d-9c07-945ad59ae29b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:08.065734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99677fc0-741b-4f9d-9c07-945ad59ae29b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:08.073117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99677fc0-741b-4f9d-9c07-945ad59ae29b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:08.074286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99677fc0-741b-4f9d-9c07-945ad59ae29b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:08.075867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99677fc0-741b-4f9d-9c07-945ad59ae29b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:08.080872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99677fc0-741b-4f9d-9c07-945ad59ae29b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:08.082862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99677fc0-741b-4f9d-9c07-945ad59ae29b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:08.439575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-909fef4b-a658-473c-b3e9-2c95598dfa04 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:08.478462 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-909fef4b-a658-473c-b3e9-2c95598dfa04 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1390 microversion: 2.1 time: 0.656517 Aug 09 17:51:08.485074 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2691/5642] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:07 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1390 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:09.385780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99677fc0-741b-4f9d-9c07-945ad59ae29b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:09.442080 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99677fc0-741b-4f9d-9c07-945ad59ae29b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1671 microversion: 2.1 time: 1.417382 Aug 09 17:51:09.443616 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2952/5643] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:08 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1671 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:09.537644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e51406ec-3be4-409a-9427-ab570454564f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:09.541251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e51406ec-3be4-409a-9427-ab570454564f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:09.578238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51406ec-3be4-409a-9427-ab570454564f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:09.587593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51406ec-3be4-409a-9427-ab570454564f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:09.589635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51406ec-3be4-409a-9427-ab570454564f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:09.590598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51406ec-3be4-409a-9427-ab570454564f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:09.594270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51406ec-3be4-409a-9427-ab570454564f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:09.599036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e51406ec-3be4-409a-9427-ab570454564f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:10.488504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-16bb0dbe-7763-4c69-9508-53d629cfce60 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:10.493417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-16bb0dbe-7763-4c69-9508-53d629cfce60 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:10.521578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bb0dbe-7763-4c69-9508-53d629cfce60 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:10.527084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bb0dbe-7763-4c69-9508-53d629cfce60 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:10.533356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bb0dbe-7763-4c69-9508-53d629cfce60 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:10.536061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bb0dbe-7763-4c69-9508-53d629cfce60 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:10.537233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bb0dbe-7763-4c69-9508-53d629cfce60 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:10.538657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16bb0dbe-7763-4c69-9508-53d629cfce60 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:11.147142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e51406ec-3be4-409a-9427-ab570454564f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:11.178427 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e51406ec-3be4-409a-9427-ab570454564f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1390 microversion: 2.1 time: 1.664291 Aug 09 17:51:11.179379 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2692/5644] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:09 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1390 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:11.717657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16bb0dbe-7763-4c69-9508-53d629cfce60 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:11.784281 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-16bb0dbe-7763-4c69-9508-53d629cfce60 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1671 microversion: 2.1 time: 1.288808 Aug 09 17:51:11.801979 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2953/5645] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:10 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1671 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:11.902995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-310da118-f297-408e-82e2-97921252a868 req-a847ff5c-ad16-4561-9efd-1d673be526f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5665b6cd-9566-4f66-a66c-1f9d7c6398fd", "tag": "561503aa-9292-4576-9663-a94424f5925d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:51:11.963619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:11.987692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-310da118-f297-408e-82e2-97921252a868 req-a847ff5c-ad16-4561-9efd-1d673be526f7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:12.002557 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-310da118-f297-408e-82e2-97921252a868 req-a847ff5c-ad16-4561-9efd-1d673be526f7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:12.004956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-310da118-f297-408e-82e2-97921252a868 req-a847ff5c-ad16-4561-9efd-1d673be526f7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:12.082779 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-310da118-f297-408e-82e2-97921252a868 req-a847ff5c-ad16-4561-9efd-1d673be526f7 service nova] Creating event network-changed:561503aa-9292-4576-9663-a94424f5925d for instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd on n-h2-845781-6 Aug 09 17:51:12.106888 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-310da118-f297-408e-82e2-97921252a868 req-a847ff5c-ad16-4561-9efd-1d673be526f7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206715 Aug 09 17:51:12.108948 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2693/5646] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:51:12.259343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-801af501-440c-4da2-8fe9-a894f2dc9fb8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:12.261300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-801af501-440c-4da2-8fe9-a894f2dc9fb8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:12.306892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801af501-440c-4da2-8fe9-a894f2dc9fb8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:12.315471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801af501-440c-4da2-8fe9-a894f2dc9fb8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:12.322631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801af501-440c-4da2-8fe9-a894f2dc9fb8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:12.329453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801af501-440c-4da2-8fe9-a894f2dc9fb8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:12.331362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801af501-440c-4da2-8fe9-a894f2dc9fb8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:12.340599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-801af501-440c-4da2-8fe9-a894f2dc9fb8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:12.382426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:12.831511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bd9ea03b-c921-4cc1-86df-792932d4080f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:12.840384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bd9ea03b-c921-4cc1-86df-792932d4080f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:12.875825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9ea03b-c921-4cc1-86df-792932d4080f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:12.877566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9ea03b-c921-4cc1-86df-792932d4080f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:12.880295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9ea03b-c921-4cc1-86df-792932d4080f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:12.884848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9ea03b-c921-4cc1-86df-792932d4080f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:12.887345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9ea03b-c921-4cc1-86df-792932d4080f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:12.889508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd9ea03b-c921-4cc1-86df-792932d4080f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:13.169902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bd9ea03b-c921-4cc1-86df-792932d4080f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:13.211136 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bd9ea03b-c921-4cc1-86df-792932d4080f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1604 microversion: 2.1 time: 0.388616 Aug 09 17:51:13.218947 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2694/5647] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:12 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1604 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:13.232433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-801af501-440c-4da2-8fe9-a894f2dc9fb8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:13.270342 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-801af501-440c-4da2-8fe9-a894f2dc9fb8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1390 microversion: 2.1 time: 1.039007 Aug 09 17:51:13.285584 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2954/5648] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:12 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1390 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:14.261245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-143256c1-8753-48f4-baea-b2269505298b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:14.262212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-143256c1-8753-48f4-baea-b2269505298b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:14.268146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:14.298320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-143256c1-8753-48f4-baea-b2269505298b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:14.299682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-143256c1-8753-48f4-baea-b2269505298b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:14.300529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-143256c1-8753-48f4-baea-b2269505298b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:14.306136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-143256c1-8753-48f4-baea-b2269505298b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:14.307093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-143256c1-8753-48f4-baea-b2269505298b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:14.308801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-143256c1-8753-48f4-baea-b2269505298b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:14.316770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-832609ed-2e90-4e15-a134-9691ae296532 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:14.317989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-832609ed-2e90-4e15-a134-9691ae296532 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:14.337757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-832609ed-2e90-4e15-a134-9691ae296532 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:14.346650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-832609ed-2e90-4e15-a134-9691ae296532 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:14.349067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-832609ed-2e90-4e15-a134-9691ae296532 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:14.351304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-832609ed-2e90-4e15-a134-9691ae296532 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:14.353322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-832609ed-2e90-4e15-a134-9691ae296532 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:14.354621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-832609ed-2e90-4e15-a134-9691ae296532 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:14.930279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-143256c1-8753-48f4-baea-b2269505298b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:14.970380 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-143256c1-8753-48f4-baea-b2269505298b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1604 microversion: 2.1 time: 0.714184 Aug 09 17:51:15.012935 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2695/5649] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:14 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1604 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:15.070132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-832609ed-2e90-4e15-a134-9691ae296532 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:15.089213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=62 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:15.116486 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-832609ed-2e90-4e15-a134-9691ae296532 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1390 microversion: 2.1 time: 0.803632 Aug 09 17:51:15.130830 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2955/5650] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:14 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1390 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:16.019881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4efdd6dd-6605-4ab5-a516-90cf7cc8b71d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:16.021040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4efdd6dd-6605-4ab5-a516-90cf7cc8b71d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:16.047540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:16.087819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4efdd6dd-6605-4ab5-a516-90cf7cc8b71d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:16.092390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4efdd6dd-6605-4ab5-a516-90cf7cc8b71d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:16.095270 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4efdd6dd-6605-4ab5-a516-90cf7cc8b71d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:16.099343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4efdd6dd-6605-4ab5-a516-90cf7cc8b71d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:16.101372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4efdd6dd-6605-4ab5-a516-90cf7cc8b71d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:16.127947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4efdd6dd-6605-4ab5-a516-90cf7cc8b71d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:16.138712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e876661-2dcf-440b-90eb-c86188aae3ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:16.139430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8e876661-2dcf-440b-90eb-c86188aae3ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:16.142524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=28 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:16.176141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e876661-2dcf-440b-90eb-c86188aae3ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:16.176764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e876661-2dcf-440b-90eb-c86188aae3ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:16.178291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e876661-2dcf-440b-90eb-c86188aae3ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:16.179123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e876661-2dcf-440b-90eb-c86188aae3ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:16.179546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e876661-2dcf-440b-90eb-c86188aae3ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:16.180586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e876661-2dcf-440b-90eb-c86188aae3ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:16.302792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:16.500890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4efdd6dd-6605-4ab5-a516-90cf7cc8b71d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:16.563383 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4efdd6dd-6605-4ab5-a516-90cf7cc8b71d tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1604 microversion: 2.1 time: 0.553844 Aug 09 17:51:16.590380 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2696/5651] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:16 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1604 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:16.596352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8e876661-2dcf-440b-90eb-c86188aae3ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:16.612109 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e876661-2dcf-440b-90eb-c86188aae3ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1390 microversion: 2.1 time: 0.477700 Aug 09 17:51:16.636027 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2956/5652] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:16 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1390 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:16.875491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-f23215d1-cefe-4b08-b8d0-3fa2a99a20b7 req-47cbf326-3af5-4e27-8e88-5ffcb123cbee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925758f3-e4b4-44d9-941d-d10ba53df59e", "name": "network-vif-deleted", "tag": "9fc9d744-a71d-4de6-a351-dd88cd2f8459"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:51:16.945155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f23215d1-cefe-4b08-b8d0-3fa2a99a20b7 req-47cbf326-3af5-4e27-8e88-5ffcb123cbee service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:16.946503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f23215d1-cefe-4b08-b8d0-3fa2a99a20b7 req-47cbf326-3af5-4e27-8e88-5ffcb123cbee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:16.960337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f23215d1-cefe-4b08-b8d0-3fa2a99a20b7 req-47cbf326-3af5-4e27-8e88-5ffcb123cbee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:17.017591 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-f23215d1-cefe-4b08-b8d0-3fa2a99a20b7 req-47cbf326-3af5-4e27-8e88-5ffcb123cbee service nova] Creating event network-vif-deleted:9fc9d744-a71d-4de6-a351-dd88cd2f8459 for instance 925758f3-e4b4-44d9-941d-d10ba53df59e on n-h1-845781-6 Aug 09 17:51:17.047402 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-f23215d1-cefe-4b08-b8d0-3fa2a99a20b7 req-47cbf326-3af5-4e27-8e88-5ffcb123cbee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178684 Aug 09 17:51:17.054213 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2697/5653] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:51:17.628534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:17.653016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:17.658439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-369d9187-57b3-449c-8a4d-9188017d7989 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:17.668579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-369d9187-57b3-449c-8a4d-9188017d7989 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:17.706130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:17.707470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:17.711804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:17.715856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-369d9187-57b3-449c-8a4d-9188017d7989 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:17.716139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:17.717596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-369d9187-57b3-449c-8a4d-9188017d7989 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:17.719101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-369d9187-57b3-449c-8a4d-9188017d7989 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:17.719573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:17.721366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:17.722922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-369d9187-57b3-449c-8a4d-9188017d7989 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:17.727285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-369d9187-57b3-449c-8a4d-9188017d7989 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:17.729172 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-369d9187-57b3-449c-8a4d-9188017d7989 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:18.030429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:18.031753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:18.035192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:18.037587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lazy-loading 'fault' on Instance uuid 925758f3-e4b4-44d9-941d-d10ba53df59e {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:51:18.159447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:18.185864 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c7fedab9-ffa9-4195-b3f2-ebfceb9a9224 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 200 len: 1327 microversion: 2.1 time: 0.576249 Aug 09 17:51:18.187011 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2957/5654] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:17 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 1327 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:18.536353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-369d9187-57b3-449c-8a4d-9188017d7989 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:18.546018 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-369d9187-57b3-449c-8a4d-9188017d7989 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1390 microversion: 2.1 time: 0.914344 Aug 09 17:51:18.546740 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2698/5655] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:17 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1390 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:19.234680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:19.238052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:19.267945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:19.273626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:19.279550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:19.285980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:19.294047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:19.295108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:19.338827 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] HTTP exception thrown: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Request method failure captured: Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e HTTP/1.1 Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p2v6HTFCBqHT_PRF032zDn64is1pv2whWSV2XzAaFQhbmfcw4yaJwL5EX1TNB-INQchWk8vsL7gedvav_d6wJ7qMA866G4auOrHxCaTuCQj3nR-TuGp22RDPrsF-dijGJQ0wWLamUy6woxwe2f60tbwTgkqCjZwnWOsqCZ9fHRx2XM Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a1c8a42d2fc848d4a6badae1b1e0a387 Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '925758f3-e4b4-44d9-941d-d10ba53df59e'} Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:51:19.371189 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:51:19.379356 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:51:19.379356 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:51:19.379356 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:51:19.379356 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:51:19.379356 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:51:19.379356 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:51:19.379356 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:51:19.385101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Returning 404 to user: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:51:19.392625 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f768361d-8f05-413c-aab0-6e4b1c36f455 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 404 len: 111 microversion: 2.1 time: 0.170394 Aug 09 17:51:19.393964 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2958/5656] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:19 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:51:19.414834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-28fef727-6e1e-45fa-97a6-dc4ed6240f77 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '.version_select at 0x7fbbca604430>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:19.495115 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-28fef727-6e1e-45fa-97a6-dc4ed6240f77 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-593823927" status: 202 len: 0 microversion: 2.1 time: 0.088738 Aug 09 17:51:19.505613 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2699/5657] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 17:51:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-593823927 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:51:19.610283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-46c3280c-a6ff-4289-840f-69920f75d9f6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:19.611440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-46c3280c-a6ff-4289-840f-69920f75d9f6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:19.678932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46c3280c-a6ff-4289-840f-69920f75d9f6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:19.682403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46c3280c-a6ff-4289-840f-69920f75d9f6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:19.694604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46c3280c-a6ff-4289-840f-69920f75d9f6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:19.698125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46c3280c-a6ff-4289-840f-69920f75d9f6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:19.702113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46c3280c-a6ff-4289-840f-69920f75d9f6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:19.704315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-46c3280c-a6ff-4289-840f-69920f75d9f6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:20.504148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-46c3280c-a6ff-4289-840f-69920f75d9f6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:20.523878 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-46c3280c-a6ff-4289-840f-69920f75d9f6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1390 microversion: 2.1 time: 0.937255 Aug 09 17:51:20.542947 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2959/5658] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:19 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1390 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:20.724336 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:51:20.724574 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 17:51:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:51:21.578530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4cf0a3a7-3511-4f19-9d67-8975ca0ab4a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:21.606482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4cf0a3a7-3511-4f19-9d67-8975ca0ab4a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:21.681263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf0a3a7-3511-4f19-9d67-8975ca0ab4a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:21.682700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf0a3a7-3511-4f19-9d67-8975ca0ab4a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:21.699953 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf0a3a7-3511-4f19-9d67-8975ca0ab4a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:21.716698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf0a3a7-3511-4f19-9d67-8975ca0ab4a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:21.717522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf0a3a7-3511-4f19-9d67-8975ca0ab4a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:21.719711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4cf0a3a7-3511-4f19-9d67-8975ca0ab4a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:21.905655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9eff9bee-22fb-4ef0-b084-bb11bfe80d37 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Action: 'create', calling method: .version_select at 0x7fbbdca34040>, body: {"keypair": {"name": "tempest-keypair-1446274582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIadrOLKKmxz9+/mP69xk5N8D+HecbqWGJ50skbjowWsvt4/CF57d+LGfZ9IjBBSsTq1IeHIN21fLd54bMv/9/KIg+LQ3XRkOUPqNDXKDAVSBpx8dH2bAdiBn8xFqGotsg=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:51:21.926654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-9eff9bee-22fb-4ef0-b084-bb11bfe80d37 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Getting quotas for project 0c1b430bf48d450e88109a61dd2865df. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:51:21.933404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-9eff9bee-22fb-4ef0-b084-bb11bfe80d37 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Getting quotas for user a1c8a42d2fc848d4a6badae1b1e0a387 and project 0c1b430bf48d450e88109a61dd2865df. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:51:21.987724 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9eff9bee-22fb-4ef0-b084-bb11bfe80d37 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086521 Aug 09 17:51:21.995047 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2960/5659] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:51:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:51:22.334506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4cf0a3a7-3511-4f19-9d67-8975ca0ab4a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:22.352945 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4cf0a3a7-3511-4f19-9d67-8975ca0ab4a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1390 microversion: 2.1 time: 0.789172 Aug 09 17:51:22.372772 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2700/5660] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:21 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1390 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:23.382174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-113a73b0-3fd4-4a12-9cd5-dd05e4394a87 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:23.392139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-113a73b0-3fd4-4a12-9cd5-dd05e4394a87 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:23.417248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-113a73b0-3fd4-4a12-9cd5-dd05e4394a87 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:23.424128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-113a73b0-3fd4-4a12-9cd5-dd05e4394a87 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:23.425762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-113a73b0-3fd4-4a12-9cd5-dd05e4394a87 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:23.427161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-113a73b0-3fd4-4a12-9cd5-dd05e4394a87 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:23.434559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-113a73b0-3fd4-4a12-9cd5-dd05e4394a87 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:23.435918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-113a73b0-3fd4-4a12-9cd5-dd05e4394a87 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:24.369251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-113a73b0-3fd4-4a12-9cd5-dd05e4394a87 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:24.387243 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-113a73b0-3fd4-4a12-9cd5-dd05e4394a87 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1390 microversion: 2.1 time: 1.011713 Aug 09 17:51:24.389518 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2961/5661] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:23 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1390 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:25.152685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-16ef3faa-cd78-4c33-bbf9-82bf4d139d12 req-68616f79-6828-404b-a4ac-373a211f8c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5665b6cd-9566-4f66-a66c-1f9d7c6398fd", "name": "network-vif-plugged", "status": "completed", "tag": "561503aa-9292-4576-9663-a94424f5925d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:51:25.186648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-16ef3faa-cd78-4c33-bbf9-82bf4d139d12 req-68616f79-6828-404b-a4ac-373a211f8c7d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:25.189144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-16ef3faa-cd78-4c33-bbf9-82bf4d139d12 req-68616f79-6828-404b-a4ac-373a211f8c7d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:25.194623 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-16ef3faa-cd78-4c33-bbf9-82bf4d139d12 req-68616f79-6828-404b-a4ac-373a211f8c7d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:25.224638 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-16ef3faa-cd78-4c33-bbf9-82bf4d139d12 req-68616f79-6828-404b-a4ac-373a211f8c7d service nova] Creating event network-vif-plugged:561503aa-9292-4576-9663-a94424f5925d for instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd on n-h2-845781-6 Aug 09 17:51:25.244509 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-16ef3faa-cd78-4c33-bbf9-82bf4d139d12 req-68616f79-6828-404b-a4ac-373a211f8c7d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.641572 Aug 09 17:51:25.248888 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2701/5662] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:51:25.410776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f38efd3b-0021-4695-8119-3a4cfb3536bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:25.411666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f38efd3b-0021-4695-8119-3a4cfb3536bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:25.423252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f38efd3b-0021-4695-8119-3a4cfb3536bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:25.425724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f38efd3b-0021-4695-8119-3a4cfb3536bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:25.427937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f38efd3b-0021-4695-8119-3a4cfb3536bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:25.429115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f38efd3b-0021-4695-8119-3a4cfb3536bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:25.432111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f38efd3b-0021-4695-8119-3a4cfb3536bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:25.432900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f38efd3b-0021-4695-8119-3a4cfb3536bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:26.077693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f38efd3b-0021-4695-8119-3a4cfb3536bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:26.089257 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f38efd3b-0021-4695-8119-3a4cfb3536bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1390 microversion: 2.1 time: 0.682525 Aug 09 17:51:26.103564 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2962/5663] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:25 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1390 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:27.125527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6ee4bcc0-7c05-4292-b029-b4891fc52aa0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:27.127175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6ee4bcc0-7c05-4292-b029-b4891fc52aa0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:27.149053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee4bcc0-7c05-4292-b029-b4891fc52aa0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:27.149814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee4bcc0-7c05-4292-b029-b4891fc52aa0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:27.150594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee4bcc0-7c05-4292-b029-b4891fc52aa0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:27.152491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee4bcc0-7c05-4292-b029-b4891fc52aa0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:27.153711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee4bcc0-7c05-4292-b029-b4891fc52aa0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:27.156748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6ee4bcc0-7c05-4292-b029-b4891fc52aa0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:27.429398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6ee4bcc0-7c05-4292-b029-b4891fc52aa0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:27.459711 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6ee4bcc0-7c05-4292-b029-b4891fc52aa0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1561 microversion: 2.1 time: 0.349646 Aug 09 17:51:27.461830 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2702/5664] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:27 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1561 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:27.518949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9ae512fe-b53e-40a2-88c7-1c148e3fcfae tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:27.521995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9ae512fe-b53e-40a2-88c7-1c148e3fcfae tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:27.547080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae512fe-b53e-40a2-88c7-1c148e3fcfae tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:27.548670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae512fe-b53e-40a2-88c7-1c148e3fcfae tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:27.549888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae512fe-b53e-40a2-88c7-1c148e3fcfae tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:27.551941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae512fe-b53e-40a2-88c7-1c148e3fcfae tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:27.553284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae512fe-b53e-40a2-88c7-1c148e3fcfae tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:27.554487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ae512fe-b53e-40a2-88c7-1c148e3fcfae tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:28.091692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2121305964", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbce853b-2ef9-401c-86fd-3dd869f5aabb"}], "security_groups": [{"name": "tempest-securitygroup--71631249"}], "key_name": "tempest-keypair-1446274582", "user_data": "}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:51:28.286689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9ae512fe-b53e-40a2-88c7-1c148e3fcfae tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:28.314413 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9ae512fe-b53e-40a2-88c7-1c148e3fcfae tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1561 microversion: 2.1 time: 0.814753 Aug 09 17:51:28.315510 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2963/5665] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:27 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1561 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:28.480902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] validate_networks() for [('dbce853b-2ef9-401c-86fd-3dd869f5aabb', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:51:29.746920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:51:29.747998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:51:29.747998 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:51:29.748290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:51:29.748645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:51:29.770869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:29.771691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:29.772314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:29.773658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:29.774350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:29.775350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:29.845300 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Getting quotas for project 0c1b430bf48d450e88109a61dd2865df. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:51:29.855189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Getting quotas for user a1c8a42d2fc848d4a6badae1b1e0a387 and project 0c1b430bf48d450e88109a61dd2865df. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:51:29.893289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:51:29.910387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:51:30.025143 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-445092d6-ef6a-4ca8-b4d4-c04da620f84a tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.938687 Aug 09 17:51:30.035210 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2703/5666] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:51:28 2022] POST /compute/v2.1/servers => generated 400 bytes in 1951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:51:30.044875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50e825e7-aaa7-48a9-bf25-516133c81f71 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:30.058931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-50e825e7-aaa7-48a9-bf25-516133c81f71 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:30.403449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-50e825e7-aaa7-48a9-bf25-516133c81f71 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:30.418889 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-50e825e7-aaa7-48a9-bf25-516133c81f71 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1238 microversion: 2.1 time: 0.383861 Aug 09 17:51:30.425374 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2964/5667] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:30 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1238 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:31.466463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b56b6eb6-17fd-49e5-aded-cabf62b17132 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:31.467264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b56b6eb6-17fd-49e5-aded-cabf62b17132 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:31.690325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b56b6eb6-17fd-49e5-aded-cabf62b17132 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:31.721425 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b56b6eb6-17fd-49e5-aded-cabf62b17132 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1238 microversion: 2.1 time: 0.260729 Aug 09 17:51:31.790564 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2704/5668] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:31 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1238 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:32.778041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cf685d9b-8805-4b9c-a9c4-44775badac69 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:32.778678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cf685d9b-8805-4b9c-a9c4-44775badac69 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:32.851426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf685d9b-8805-4b9c-a9c4-44775badac69 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:32.855057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf685d9b-8805-4b9c-a9c4-44775badac69 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:32.857759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf685d9b-8805-4b9c-a9c4-44775badac69 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:32.859582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf685d9b-8805-4b9c-a9c4-44775badac69 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:32.862974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf685d9b-8805-4b9c-a9c4-44775badac69 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:32.863713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf685d9b-8805-4b9c-a9c4-44775badac69 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:33.968923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cf685d9b-8805-4b9c-a9c4-44775badac69 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:33.979572 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cf685d9b-8805-4b9c-a9c4-44775badac69 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1234 microversion: 2.1 time: 1.208395 Aug 09 17:51:33.981583 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2965/5669] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:32 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1234 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:35.017857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b22951aa-2d9e-4897-8772-9d014693e5e7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:35.020105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b22951aa-2d9e-4897-8772-9d014693e5e7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:35.031007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b22951aa-2d9e-4897-8772-9d014693e5e7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:35.031917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b22951aa-2d9e-4897-8772-9d014693e5e7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:35.032587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b22951aa-2d9e-4897-8772-9d014693e5e7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:35.034678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b22951aa-2d9e-4897-8772-9d014693e5e7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:35.035505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b22951aa-2d9e-4897-8772-9d014693e5e7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:35.036585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b22951aa-2d9e-4897-8772-9d014693e5e7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:35.367118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b22951aa-2d9e-4897-8772-9d014693e5e7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:35.405622 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b22951aa-2d9e-4897-8772-9d014693e5e7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1296 microversion: 2.1 time: 0.390801 Aug 09 17:51:35.423763 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2705/5670] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:35 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1296 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:35.584435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-754d1e4d-62e9-4c90-8858-e18a5591ea72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:35.586811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-754d1e4d-62e9-4c90-8858-e18a5591ea72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:35.607339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-754d1e4d-62e9-4c90-8858-e18a5591ea72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:35.608191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-754d1e4d-62e9-4c90-8858-e18a5591ea72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:35.609646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-754d1e4d-62e9-4c90-8858-e18a5591ea72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:35.610947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-754d1e4d-62e9-4c90-8858-e18a5591ea72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:35.613882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-754d1e4d-62e9-4c90-8858-e18a5591ea72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:35.617212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-754d1e4d-62e9-4c90-8858-e18a5591ea72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:36.089938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-754d1e4d-62e9-4c90-8858-e18a5591ea72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:36.193565 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-754d1e4d-62e9-4c90-8858-e18a5591ea72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1561 microversion: 2.1 time: 0.613647 Aug 09 17:51:36.193803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-09a3ef85-045b-4fa5-a95b-afb40005c6c4 req-9493629e-883b-431d-8ccd-2fb356c846ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5665b6cd-9566-4f66-a66c-1f9d7c6398fd", "tag": "561503aa-9292-4576-9663-a94424f5925d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:51:36.201291 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2966/5671] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:35 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1561 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:36.257770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-09a3ef85-045b-4fa5-a95b-afb40005c6c4 req-9493629e-883b-431d-8ccd-2fb356c846ec service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:36.260463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-09a3ef85-045b-4fa5-a95b-afb40005c6c4 req-9493629e-883b-431d-8ccd-2fb356c846ec service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:36.261709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-09a3ef85-045b-4fa5-a95b-afb40005c6c4 req-9493629e-883b-431d-8ccd-2fb356c846ec service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:36.336126 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-09a3ef85-045b-4fa5-a95b-afb40005c6c4 req-9493629e-883b-431d-8ccd-2fb356c846ec service nova] Creating event network-changed:561503aa-9292-4576-9663-a94424f5925d for instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd on n-h2-845781-6 Aug 09 17:51:36.399313 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-09a3ef85-045b-4fa5-a95b-afb40005c6c4 req-9493629e-883b-431d-8ccd-2fb356c846ec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.793179 Aug 09 17:51:36.416107 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2706/5672] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:51:36.464116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99349698-7b28-4e3d-a4bb-994ed8900c74 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:36.465333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99349698-7b28-4e3d-a4bb-994ed8900c74 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:36.490199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99349698-7b28-4e3d-a4bb-994ed8900c74 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:36.490896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99349698-7b28-4e3d-a4bb-994ed8900c74 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:36.491455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99349698-7b28-4e3d-a4bb-994ed8900c74 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:36.512872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99349698-7b28-4e3d-a4bb-994ed8900c74 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:36.513387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99349698-7b28-4e3d-a4bb-994ed8900c74 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:36.513845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99349698-7b28-4e3d-a4bb-994ed8900c74 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:36.718150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99349698-7b28-4e3d-a4bb-994ed8900c74 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:36.757140 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99349698-7b28-4e3d-a4bb-994ed8900c74 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1296 microversion: 2.1 time: 0.306028 Aug 09 17:51:36.758829 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2967/5673] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:36 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1296 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:37.790226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8e348ec6-e890-4e1d-be79-0a11bfafd6e8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:37.790945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8e348ec6-e890-4e1d-be79-0a11bfafd6e8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:37.806948 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e348ec6-e890-4e1d-be79-0a11bfafd6e8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:37.807615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e348ec6-e890-4e1d-be79-0a11bfafd6e8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:37.809878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e348ec6-e890-4e1d-be79-0a11bfafd6e8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:37.810674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e348ec6-e890-4e1d-be79-0a11bfafd6e8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:37.811250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e348ec6-e890-4e1d-be79-0a11bfafd6e8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:37.818117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8e348ec6-e890-4e1d-be79-0a11bfafd6e8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:38.027569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8e348ec6-e890-4e1d-be79-0a11bfafd6e8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:38.040212 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8e348ec6-e890-4e1d-be79-0a11bfafd6e8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1296 microversion: 2.1 time: 0.254059 Aug 09 17:51:38.044259 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2707/5674] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:37 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1296 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:39.083214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6017fa32-87ce-4fc0-aff6-6fdd1be0f8db tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:39.084732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6017fa32-87ce-4fc0-aff6-6fdd1be0f8db tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:39.094044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6017fa32-87ce-4fc0-aff6-6fdd1be0f8db tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:39.095066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6017fa32-87ce-4fc0-aff6-6fdd1be0f8db tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:39.095955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6017fa32-87ce-4fc0-aff6-6fdd1be0f8db tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:39.096954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6017fa32-87ce-4fc0-aff6-6fdd1be0f8db tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:39.097638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6017fa32-87ce-4fc0-aff6-6fdd1be0f8db tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:39.098271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6017fa32-87ce-4fc0-aff6-6fdd1be0f8db tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:39.220916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6017fa32-87ce-4fc0-aff6-6fdd1be0f8db tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:39.230348 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6017fa32-87ce-4fc0-aff6-6fdd1be0f8db tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1296 microversion: 2.1 time: 0.150968 Aug 09 17:51:39.231555 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2968/5675] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:39 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1296 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:40.267314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b9c027f9-fd10-47ad-bc11-96b83c852463 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:40.268707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b9c027f9-fd10-47ad-bc11-96b83c852463 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:40.273016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:40.291955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9c027f9-fd10-47ad-bc11-96b83c852463 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:40.292907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9c027f9-fd10-47ad-bc11-96b83c852463 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:40.293748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9c027f9-fd10-47ad-bc11-96b83c852463 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:40.295200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9c027f9-fd10-47ad-bc11-96b83c852463 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:40.296275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9c027f9-fd10-47ad-bc11-96b83c852463 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:40.297210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9c027f9-fd10-47ad-bc11-96b83c852463 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:41.270928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b9c027f9-fd10-47ad-bc11-96b83c852463 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:41.280943 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b9c027f9-fd10-47ad-bc11-96b83c852463 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1362 microversion: 2.1 time: 1.017384 Aug 09 17:51:41.291734 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2708/5676] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:40 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1362 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:42.314486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-edb21112-1600-4764-8bd7-83e10ce28adc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:42.315939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-edb21112-1600-4764-8bd7-83e10ce28adc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:42.328462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:42.341040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb21112-1600-4764-8bd7-83e10ce28adc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:42.343893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb21112-1600-4764-8bd7-83e10ce28adc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:42.344664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb21112-1600-4764-8bd7-83e10ce28adc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:42.350029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb21112-1600-4764-8bd7-83e10ce28adc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:42.350872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb21112-1600-4764-8bd7-83e10ce28adc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:42.354043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb21112-1600-4764-8bd7-83e10ce28adc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:43.054771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-0dd9f79d-5f65-4b47-a63b-a1acc2a8e802 req-dc725f3a-17ff-4a3f-b75e-fd6a385700e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8220c359-b3b9-4af6-a8fd-ee55fb0a933b", "tag": "92cc5489-7651-4ff7-9f3e-0f848c606d95"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:51:43.101331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:43.114226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0dd9f79d-5f65-4b47-a63b-a1acc2a8e802 req-dc725f3a-17ff-4a3f-b75e-fd6a385700e6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:43.116941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0dd9f79d-5f65-4b47-a63b-a1acc2a8e802 req-dc725f3a-17ff-4a3f-b75e-fd6a385700e6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:43.118052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0dd9f79d-5f65-4b47-a63b-a1acc2a8e802 req-dc725f3a-17ff-4a3f-b75e-fd6a385700e6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:43.151072 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-0dd9f79d-5f65-4b47-a63b-a1acc2a8e802 req-dc725f3a-17ff-4a3f-b75e-fd6a385700e6 service nova] Creating event network-changed:92cc5489-7651-4ff7-9f3e-0f848c606d95 for instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b on n-h1-845781-6 Aug 09 17:51:43.171233 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-0dd9f79d-5f65-4b47-a63b-a1acc2a8e802 req-dc725f3a-17ff-4a3f-b75e-fd6a385700e6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125116 Aug 09 17:51:43.189053 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2709/5677] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:51:43.565629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-edb21112-1600-4764-8bd7-83e10ce28adc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:43.591060 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-edb21112-1600-4764-8bd7-83e10ce28adc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1362 microversion: 2.1 time: 1.276587 Aug 09 17:51:43.592458 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2969/5678] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:42 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1362 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:44.618261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7958e2ae-48de-4979-874c-478ddfe739f1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:44.619024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7958e2ae-48de-4979-874c-478ddfe739f1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:44.642036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7958e2ae-48de-4979-874c-478ddfe739f1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:44.642782 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7958e2ae-48de-4979-874c-478ddfe739f1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:44.643456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7958e2ae-48de-4979-874c-478ddfe739f1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:44.644612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7958e2ae-48de-4979-874c-478ddfe739f1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:44.645256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7958e2ae-48de-4979-874c-478ddfe739f1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:44.645861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7958e2ae-48de-4979-874c-478ddfe739f1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:45.070426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7958e2ae-48de-4979-874c-478ddfe739f1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:45.081960 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7958e2ae-48de-4979-874c-478ddfe739f1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1362 microversion: 2.1 time: 0.470716 Aug 09 17:51:45.093198 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2710/5679] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:44 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1362 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:46.108404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-83a1341a-8703-4212-b47f-4c546f50ff5f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:46.109338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-83a1341a-8703-4212-b47f-4c546f50ff5f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:46.136649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a1341a-8703-4212-b47f-4c546f50ff5f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:46.140118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a1341a-8703-4212-b47f-4c546f50ff5f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:46.141102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a1341a-8703-4212-b47f-4c546f50ff5f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:46.142460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a1341a-8703-4212-b47f-4c546f50ff5f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:46.144952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a1341a-8703-4212-b47f-4c546f50ff5f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:46.146496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83a1341a-8703-4212-b47f-4c546f50ff5f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:46.155841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=72 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:46.903385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-83a1341a-8703-4212-b47f-4c546f50ff5f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:46.918007 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-83a1341a-8703-4212-b47f-4c546f50ff5f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1362 microversion: 2.1 time: 0.816703 Aug 09 17:51:46.918627 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2970/5680] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:46 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1362 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:47.953415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0bf7c986-772e-4a5a-b8db-610d1173eec8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:47.954835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0bf7c986-772e-4a5a-b8db-610d1173eec8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:47.968085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:47.973703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bf7c986-772e-4a5a-b8db-610d1173eec8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:47.986584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bf7c986-772e-4a5a-b8db-610d1173eec8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:47.988170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bf7c986-772e-4a5a-b8db-610d1173eec8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:47.990548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bf7c986-772e-4a5a-b8db-610d1173eec8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:47.992098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bf7c986-772e-4a5a-b8db-610d1173eec8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:47.995786 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bf7c986-772e-4a5a-b8db-610d1173eec8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:48.010281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=58 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:48.710910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0bf7c986-772e-4a5a-b8db-610d1173eec8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:48.737694 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0bf7c986-772e-4a5a-b8db-610d1173eec8 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1362 microversion: 2.1 time: 0.788375 Aug 09 17:51:48.747449 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2711/5681] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:47 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1362 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:49.774842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-237cd66a-859c-4f07-b5a9-a9c39187a76c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:49.776443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-237cd66a-859c-4f07-b5a9-a9c39187a76c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:49.788197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:51:49.790887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-237cd66a-859c-4f07-b5a9-a9c39187a76c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:49.796780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-237cd66a-859c-4f07-b5a9-a9c39187a76c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:49.797490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-237cd66a-859c-4f07-b5a9-a9c39187a76c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:49.798424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-237cd66a-859c-4f07-b5a9-a9c39187a76c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:49.799062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-237cd66a-859c-4f07-b5a9-a9c39187a76c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:49.800180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-237cd66a-859c-4f07-b5a9-a9c39187a76c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:50.478602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-237cd66a-859c-4f07-b5a9-a9c39187a76c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:50.495429 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-237cd66a-859c-4f07-b5a9-a9c39187a76c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1362 microversion: 2.1 time: 0.720760 Aug 09 17:51:50.498990 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2971/5682] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:49 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1362 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:51.539730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eecf0261-cac2-4750-80c2-5381bc571ee6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:51.540494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eecf0261-cac2-4750-80c2-5381bc571ee6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:51.551410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eecf0261-cac2-4750-80c2-5381bc571ee6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:51.551954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eecf0261-cac2-4750-80c2-5381bc571ee6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:51.552405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eecf0261-cac2-4750-80c2-5381bc571ee6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:51.553135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eecf0261-cac2-4750-80c2-5381bc571ee6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:51.553599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eecf0261-cac2-4750-80c2-5381bc571ee6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:51.554029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eecf0261-cac2-4750-80c2-5381bc571ee6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:51.815579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8ae7499f-8feb-49ce-b0fe-8c6faad9eb85 req-519c0fd8-e70f-48cb-bee9-34f6c55cb62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8220c359-b3b9-4af6-a8fd-ee55fb0a933b", "name": "network-vif-plugged", "status": "completed", "tag": "92cc5489-7651-4ff7-9f3e-0f848c606d95"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:51:51.838199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8ae7499f-8feb-49ce-b0fe-8c6faad9eb85 req-519c0fd8-e70f-48cb-bee9-34f6c55cb62b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:51.839973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8ae7499f-8feb-49ce-b0fe-8c6faad9eb85 req-519c0fd8-e70f-48cb-bee9-34f6c55cb62b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:51.840431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8ae7499f-8feb-49ce-b0fe-8c6faad9eb85 req-519c0fd8-e70f-48cb-bee9-34f6c55cb62b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:51.870344 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8ae7499f-8feb-49ce-b0fe-8c6faad9eb85 req-519c0fd8-e70f-48cb-bee9-34f6c55cb62b service nova] Creating event network-vif-plugged:92cc5489-7651-4ff7-9f3e-0f848c606d95 for instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b on n-h1-845781-6 Aug 09 17:51:51.893987 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8ae7499f-8feb-49ce-b0fe-8c6faad9eb85 req-519c0fd8-e70f-48cb-bee9-34f6c55cb62b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082773 Aug 09 17:51:51.894696 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2972/5683] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:51:51.995522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eecf0261-cac2-4750-80c2-5381bc571ee6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:52.011708 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eecf0261-cac2-4750-80c2-5381bc571ee6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1362 microversion: 2.1 time: 0.476467 Aug 09 17:51:52.012689 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2712/5684] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:51 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:51:52.896343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e500028-e3eb-4acb-bec4-a8fa72e1e790 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:51:52.904289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3e500028-e3eb-4acb-bec4-a8fa72e1e790 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:52.936233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e500028-e3eb-4acb-bec4-a8fa72e1e790 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:52.937824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e500028-e3eb-4acb-bec4-a8fa72e1e790 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:52.939021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e500028-e3eb-4acb-bec4-a8fa72e1e790 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:52.943345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e500028-e3eb-4acb-bec4-a8fa72e1e790 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:52.949282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e500028-e3eb-4acb-bec4-a8fa72e1e790 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:52.956751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e500028-e3eb-4acb-bec4-a8fa72e1e790 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:53.057671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-86a4f740-a87a-4a3e-9f7b-894efd910e44 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:53.059127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-86a4f740-a87a-4a3e-9f7b-894efd910e44 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:53.076509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86a4f740-a87a-4a3e-9f7b-894efd910e44 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:53.079331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86a4f740-a87a-4a3e-9f7b-894efd910e44 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:53.080184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86a4f740-a87a-4a3e-9f7b-894efd910e44 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:53.082673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86a4f740-a87a-4a3e-9f7b-894efd910e44 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:53.083916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86a4f740-a87a-4a3e-9f7b-894efd910e44 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:53.084622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-86a4f740-a87a-4a3e-9f7b-894efd910e44 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:53.099725 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e500028-e3eb-4acb-bec4-a8fa72e1e790 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd/action" status: 200 len: 24575 microversion: 2.1 time: 0.210380 Aug 09 17:51:53.114868 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2973/5685] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:51:52 2022] POST /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd/action => generated 24575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:51:53.744944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-86a4f740-a87a-4a3e-9f7b-894efd910e44 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:53.773420 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-86a4f740-a87a-4a3e-9f7b-894efd910e44 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1362 microversion: 2.1 time: 0.722479 Aug 09 17:51:53.795131 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2713/5686] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:53 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1362 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:54.831550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94d31611-27b1-45a4-9d09-ad9182be17b3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:54.833028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94d31611-27b1-45a4-9d09-ad9182be17b3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:54.849477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94d31611-27b1-45a4-9d09-ad9182be17b3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:54.850403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94d31611-27b1-45a4-9d09-ad9182be17b3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:54.851278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94d31611-27b1-45a4-9d09-ad9182be17b3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:54.852841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94d31611-27b1-45a4-9d09-ad9182be17b3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:54.856315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94d31611-27b1-45a4-9d09-ad9182be17b3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:54.857445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94d31611-27b1-45a4-9d09-ad9182be17b3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:55.506462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94d31611-27b1-45a4-9d09-ad9182be17b3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:51:55.522472 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94d31611-27b1-45a4-9d09-ad9182be17b3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1546 microversion: 2.1 time: 0.695027 Aug 09 17:51:55.523089 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2974/5687] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:54 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1546 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:51:55.562020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d26a34bb-dfcf-4527-ad1b-ff4ec1785014 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:55.563806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d26a34bb-dfcf-4527-ad1b-ff4ec1785014 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:55.586115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d26a34bb-dfcf-4527-ad1b-ff4ec1785014 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:55.587499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d26a34bb-dfcf-4527-ad1b-ff4ec1785014 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:55.588263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d26a34bb-dfcf-4527-ad1b-ff4ec1785014 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:55.589900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d26a34bb-dfcf-4527-ad1b-ff4ec1785014 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:55.591542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d26a34bb-dfcf-4527-ad1b-ff4ec1785014 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:55.592883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d26a34bb-dfcf-4527-ad1b-ff4ec1785014 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:55.869885 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d26a34bb-dfcf-4527-ad1b-ff4ec1785014 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.312915 Aug 09 17:51:55.871676 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2714/5688] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 17:51:55 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-interface => generated 284 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:51:58.558826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3691a8b5-ac71-4de2-9410-3227e3feadf4 req-e9c92edd-15fd-48cc-ae99-cfc92c1dd476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8220c359-b3b9-4af6-a8fd-ee55fb0a933b", "tag": "92cc5489-7651-4ff7-9f3e-0f848c606d95"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:51:58.593445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3691a8b5-ac71-4de2-9410-3227e3feadf4 req-e9c92edd-15fd-48cc-ae99-cfc92c1dd476 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:58.602633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3691a8b5-ac71-4de2-9410-3227e3feadf4 req-e9c92edd-15fd-48cc-ae99-cfc92c1dd476 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:58.620731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3691a8b5-ac71-4de2-9410-3227e3feadf4 req-e9c92edd-15fd-48cc-ae99-cfc92c1dd476 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:58.674218 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3691a8b5-ac71-4de2-9410-3227e3feadf4 req-e9c92edd-15fd-48cc-ae99-cfc92c1dd476 service nova] Creating event network-changed:92cc5489-7651-4ff7-9f3e-0f848c606d95 for instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b on n-h1-845781-6 Aug 09 17:51:58.729525 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3691a8b5-ac71-4de2-9410-3227e3feadf4 req-e9c92edd-15fd-48cc-ae99-cfc92c1dd476 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174179 Aug 09 17:51:58.745608 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2975/5689] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:51:59.520681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87642ab7-e95a-4d18-a802-695aaf12230a tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:51:59.524547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-87642ab7-e95a-4d18-a802-695aaf12230a tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:51:59.550939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87642ab7-e95a-4d18-a802-695aaf12230a tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:59.556068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87642ab7-e95a-4d18-a802-695aaf12230a tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:59.557409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87642ab7-e95a-4d18-a802-695aaf12230a tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:51:59.558692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87642ab7-e95a-4d18-a802-695aaf12230a tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:51:59.563075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87642ab7-e95a-4d18-a802-695aaf12230a tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:51:59.567787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87642ab7-e95a-4d18-a802-695aaf12230a tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:00.498183 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-87642ab7-e95a-4d18-a802-695aaf12230a tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1831 microversion: 2.1 time: 0.981691 Aug 09 17:52:00.499486 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2715/5690] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:51:59 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1831 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:00.528765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-022cbdd7-6b0f-4a06-8864-74389eac6c84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:00.531399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-022cbdd7-6b0f-4a06-8864-74389eac6c84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:00.553969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-022cbdd7-6b0f-4a06-8864-74389eac6c84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:00.554718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-022cbdd7-6b0f-4a06-8864-74389eac6c84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:00.556779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-022cbdd7-6b0f-4a06-8864-74389eac6c84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:00.559280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-022cbdd7-6b0f-4a06-8864-74389eac6c84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:00.560844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-022cbdd7-6b0f-4a06-8864-74389eac6c84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:00.562211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-022cbdd7-6b0f-4a06-8864-74389eac6c84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:01.260853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-022cbdd7-6b0f-4a06-8864-74389eac6c84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:01.275070 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-022cbdd7-6b0f-4a06-8864-74389eac6c84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1680 microversion: 2.1 time: 0.753926 Aug 09 17:52:01.281862 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2976/5691] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:00 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1680 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:01.431399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-99869167-4269-474c-bc8b-205b0106bb7f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:01.436039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-99869167-4269-474c-bc8b-205b0106bb7f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:01.461913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99869167-4269-474c-bc8b-205b0106bb7f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:01.466043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99869167-4269-474c-bc8b-205b0106bb7f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:01.469732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99869167-4269-474c-bc8b-205b0106bb7f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:01.470991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99869167-4269-474c-bc8b-205b0106bb7f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:01.472441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99869167-4269-474c-bc8b-205b0106bb7f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:01.473856 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-99869167-4269-474c-bc8b-205b0106bb7f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:01.574972 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-99869167-4269-474c-bc8b-205b0106bb7f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd/action" status: 200 len: 32640 microversion: 2.1 time: 0.148759 Aug 09 17:52:01.575706 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2716/5692] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:52:01 2022] POST /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd/action => generated 32640 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:52:01.810538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:01.811914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:01.820149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:01.823475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:01.824637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:01.826795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:01.827546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:01.830149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:01.965216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'de183bb4df1d4c8297d4a484c15f06f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86806e35e72c4b2683a85aea20a2f730', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:01.966522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] flavor_id is None. Assuming migration. {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 09 17:52:01.967331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 17:52:02.412043 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5b23f831-451a-43cf-8a16-e53257bbed1b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd/action" status: 202 len: 0 microversion: 2.1 time: 0.606337 Aug 09 17:52:02.420892 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2977/5693] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:52:01 2022] POST /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:52:02.425637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a27e245b-00c4-4d74-9209-35752cc13891 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:02.427008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a27e245b-00c4-4d74-9209-35752cc13891 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:02.457444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a27e245b-00c4-4d74-9209-35752cc13891 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:02.458926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a27e245b-00c4-4d74-9209-35752cc13891 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:02.459727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a27e245b-00c4-4d74-9209-35752cc13891 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:02.460951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a27e245b-00c4-4d74-9209-35752cc13891 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:02.462318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a27e245b-00c4-4d74-9209-35752cc13891 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:02.463118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a27e245b-00c4-4d74-9209-35752cc13891 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:02.939368 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a27e245b-00c4-4d74-9209-35752cc13891 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:02.959209 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a27e245b-00c4-4d74-9209-35752cc13891 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1689 microversion: 2.1 time: 0.538365 Aug 09 17:52:02.962832 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2717/5694] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:02 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1689 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:04.006002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ddfdc02c-068f-4759-8f7d-55c780dbcc52 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:04.006992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ddfdc02c-068f-4759-8f7d-55c780dbcc52 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:04.028143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ddfdc02c-068f-4759-8f7d-55c780dbcc52 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:04.029237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ddfdc02c-068f-4759-8f7d-55c780dbcc52 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:04.030181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ddfdc02c-068f-4759-8f7d-55c780dbcc52 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:04.031555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ddfdc02c-068f-4759-8f7d-55c780dbcc52 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:04.032568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ddfdc02c-068f-4759-8f7d-55c780dbcc52 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:04.033451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ddfdc02c-068f-4759-8f7d-55c780dbcc52 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:04.344986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ddfdc02c-068f-4759-8f7d-55c780dbcc52 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:04.369132 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ddfdc02c-068f-4759-8f7d-55c780dbcc52 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1689 microversion: 2.1 time: 0.370866 Aug 09 17:52:04.369766 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2978/5695] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:03 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1689 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:05.405100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1e4901ec-4b3c-4e91-9526-134d03fc2b08 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:05.411276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1e4901ec-4b3c-4e91-9526-134d03fc2b08 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:05.480311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e4901ec-4b3c-4e91-9526-134d03fc2b08 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:05.481187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e4901ec-4b3c-4e91-9526-134d03fc2b08 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:05.482311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e4901ec-4b3c-4e91-9526-134d03fc2b08 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:05.483596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e4901ec-4b3c-4e91-9526-134d03fc2b08 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:05.496986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e4901ec-4b3c-4e91-9526-134d03fc2b08 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:05.497840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e4901ec-4b3c-4e91-9526-134d03fc2b08 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:06.210067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1e4901ec-4b3c-4e91-9526-134d03fc2b08 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:06.228818 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1e4901ec-4b3c-4e91-9526-134d03fc2b08 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1689 microversion: 2.1 time: 0.835248 Aug 09 17:52:06.255666 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2718/5696] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:05 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1689 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:07.267368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e123bc4d-2a26-4625-8e03-4e2f5ea4b353 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:07.267368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e123bc4d-2a26-4625-8e03-4e2f5ea4b353 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:07.282528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e123bc4d-2a26-4625-8e03-4e2f5ea4b353 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:07.283232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e123bc4d-2a26-4625-8e03-4e2f5ea4b353 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:07.284104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e123bc4d-2a26-4625-8e03-4e2f5ea4b353 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:07.289268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e123bc4d-2a26-4625-8e03-4e2f5ea4b353 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:07.290576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e123bc4d-2a26-4625-8e03-4e2f5ea4b353 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:07.291435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e123bc4d-2a26-4625-8e03-4e2f5ea4b353 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:07.683804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e123bc4d-2a26-4625-8e03-4e2f5ea4b353 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:07.697257 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e123bc4d-2a26-4625-8e03-4e2f5ea4b353 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1689 microversion: 2.1 time: 0.432544 Aug 09 17:52:07.697950 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2979/5697] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:07 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1689 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:08.729878 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4f71a765-b7b2-4083-b5a1-401377adabee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:08.733989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4f71a765-b7b2-4083-b5a1-401377adabee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:08.768723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f71a765-b7b2-4083-b5a1-401377adabee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:08.769715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f71a765-b7b2-4083-b5a1-401377adabee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:08.772586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f71a765-b7b2-4083-b5a1-401377adabee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:08.782687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f71a765-b7b2-4083-b5a1-401377adabee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:08.783473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f71a765-b7b2-4083-b5a1-401377adabee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:08.784253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f71a765-b7b2-4083-b5a1-401377adabee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:09.059746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f71a765-b7b2-4083-b5a1-401377adabee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:09.071397 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4f71a765-b7b2-4083-b5a1-401377adabee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.349263 Aug 09 17:52:09.072638 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2719/5698] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:08 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:10.109012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-53891996-077f-4eaa-81aa-3a828b1bbe25 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:10.110522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-53891996-077f-4eaa-81aa-3a828b1bbe25 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:10.126672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53891996-077f-4eaa-81aa-3a828b1bbe25 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:10.127612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53891996-077f-4eaa-81aa-3a828b1bbe25 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:10.131181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53891996-077f-4eaa-81aa-3a828b1bbe25 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:10.132502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53891996-077f-4eaa-81aa-3a828b1bbe25 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:10.133910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53891996-077f-4eaa-81aa-3a828b1bbe25 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:10.135122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53891996-077f-4eaa-81aa-3a828b1bbe25 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:10.516629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-53891996-077f-4eaa-81aa-3a828b1bbe25 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:10.541214 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-53891996-077f-4eaa-81aa-3a828b1bbe25 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.436810 Aug 09 17:52:10.542262 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2980/5699] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:10 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:11.578697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7a19bbeb-f38f-4cfb-be92-d90e2395d3b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:11.583915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7a19bbeb-f38f-4cfb-be92-d90e2395d3b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:11.623006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a19bbeb-f38f-4cfb-be92-d90e2395d3b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:11.624443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a19bbeb-f38f-4cfb-be92-d90e2395d3b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:11.626432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a19bbeb-f38f-4cfb-be92-d90e2395d3b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:11.628103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a19bbeb-f38f-4cfb-be92-d90e2395d3b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:11.635062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a19bbeb-f38f-4cfb-be92-d90e2395d3b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:11.637133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7a19bbeb-f38f-4cfb-be92-d90e2395d3b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:11.968351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7a19bbeb-f38f-4cfb-be92-d90e2395d3b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:11.992537 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7a19bbeb-f38f-4cfb-be92-d90e2395d3b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.427105 Aug 09 17:52:11.993365 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2720/5700] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:11 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:13.021084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-49dc05a0-1cc2-46e6-b600-e9c39d68cee0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:13.027100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-49dc05a0-1cc2-46e6-b600-e9c39d68cee0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:13.043058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49dc05a0-1cc2-46e6-b600-e9c39d68cee0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:13.043574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49dc05a0-1cc2-46e6-b600-e9c39d68cee0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:13.044100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49dc05a0-1cc2-46e6-b600-e9c39d68cee0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:13.044852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49dc05a0-1cc2-46e6-b600-e9c39d68cee0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:13.045328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49dc05a0-1cc2-46e6-b600-e9c39d68cee0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:13.045771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-49dc05a0-1cc2-46e6-b600-e9c39d68cee0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:13.266137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-49dc05a0-1cc2-46e6-b600-e9c39d68cee0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:13.283720 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-49dc05a0-1cc2-46e6-b600-e9c39d68cee0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.270597 Aug 09 17:52:13.302034 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2981/5701] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:13 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:52:14.329645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eb33b89a-9927-4e2f-bc3d-7e707c589121 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:14.330903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eb33b89a-9927-4e2f-bc3d-7e707c589121 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:14.348070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb33b89a-9927-4e2f-bc3d-7e707c589121 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:14.348874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb33b89a-9927-4e2f-bc3d-7e707c589121 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:14.349556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb33b89a-9927-4e2f-bc3d-7e707c589121 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:14.351454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb33b89a-9927-4e2f-bc3d-7e707c589121 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:14.353679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb33b89a-9927-4e2f-bc3d-7e707c589121 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:14.354652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eb33b89a-9927-4e2f-bc3d-7e707c589121 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:14.743052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eb33b89a-9927-4e2f-bc3d-7e707c589121 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:14.751800 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eb33b89a-9927-4e2f-bc3d-7e707c589121 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.434889 Aug 09 17:52:14.763653 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2721/5702] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:14 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:15.793586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93380521-6d6c-43a2-be9c-d695dd7c242f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:15.794466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-93380521-6d6c-43a2-be9c-d695dd7c242f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:15.806462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93380521-6d6c-43a2-be9c-d695dd7c242f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:15.808136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93380521-6d6c-43a2-be9c-d695dd7c242f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:15.809679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93380521-6d6c-43a2-be9c-d695dd7c242f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:15.810986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93380521-6d6c-43a2-be9c-d695dd7c242f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:15.811816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93380521-6d6c-43a2-be9c-d695dd7c242f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:15.812831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93380521-6d6c-43a2-be9c-d695dd7c242f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:16.095925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-93380521-6d6c-43a2-be9c-d695dd7c242f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:16.122373 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-93380521-6d6c-43a2-be9c-d695dd7c242f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.336568 Aug 09 17:52:16.127163 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2982/5703] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:15 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:17.161328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aea1a37e-6784-45ea-a1bb-eec19eb1bf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:17.166931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-aea1a37e-6784-45ea-a1bb-eec19eb1bf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:17.181969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aea1a37e-6784-45ea-a1bb-eec19eb1bf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:17.182493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aea1a37e-6784-45ea-a1bb-eec19eb1bf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:17.182952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aea1a37e-6784-45ea-a1bb-eec19eb1bf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:17.183772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aea1a37e-6784-45ea-a1bb-eec19eb1bf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:17.184286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aea1a37e-6784-45ea-a1bb-eec19eb1bf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:17.184640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aea1a37e-6784-45ea-a1bb-eec19eb1bf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:17.515180 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-aea1a37e-6784-45ea-a1bb-eec19eb1bf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:17.529615 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aea1a37e-6784-45ea-a1bb-eec19eb1bf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.374827 Aug 09 17:52:17.532291 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2722/5704] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:17 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:18.564132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-20afcb2d-12d1-4ad4-a55a-ca0a25806053 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:18.566035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-20afcb2d-12d1-4ad4-a55a-ca0a25806053 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:18.574311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20afcb2d-12d1-4ad4-a55a-ca0a25806053 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:18.574911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20afcb2d-12d1-4ad4-a55a-ca0a25806053 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:18.575454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20afcb2d-12d1-4ad4-a55a-ca0a25806053 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:18.576585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20afcb2d-12d1-4ad4-a55a-ca0a25806053 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:18.577264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20afcb2d-12d1-4ad4-a55a-ca0a25806053 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:18.577689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20afcb2d-12d1-4ad4-a55a-ca0a25806053 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:18.581060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:52:18.826452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-20afcb2d-12d1-4ad4-a55a-ca0a25806053 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:18.839227 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-20afcb2d-12d1-4ad4-a55a-ca0a25806053 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.279162 Aug 09 17:52:18.840540 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2983/5705] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:18 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:19.885723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fa136531-5e0e-4e07-ba75-f42cf9b3645e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:19.887591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fa136531-5e0e-4e07-ba75-f42cf9b3645e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:19.893287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=24 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:52:19.908212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa136531-5e0e-4e07-ba75-f42cf9b3645e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:19.909515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa136531-5e0e-4e07-ba75-f42cf9b3645e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:19.911974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa136531-5e0e-4e07-ba75-f42cf9b3645e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:19.915662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa136531-5e0e-4e07-ba75-f42cf9b3645e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:19.917917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa136531-5e0e-4e07-ba75-f42cf9b3645e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:19.919428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fa136531-5e0e-4e07-ba75-f42cf9b3645e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:19.925412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=68 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:52:20.497541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fa136531-5e0e-4e07-ba75-f42cf9b3645e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:20.528197 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fa136531-5e0e-4e07-ba75-f42cf9b3645e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.645541 Aug 09 17:52:20.528197 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2723/5706] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:19 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:21.545961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a09d82b8-9eda-45ff-8546-877a1f2a7849 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:21.547195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a09d82b8-9eda-45ff-8546-877a1f2a7849 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:21.554642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=28 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:52:21.557040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a09d82b8-9eda-45ff-8546-877a1f2a7849 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:21.557730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a09d82b8-9eda-45ff-8546-877a1f2a7849 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:21.558428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a09d82b8-9eda-45ff-8546-877a1f2a7849 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:21.561122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a09d82b8-9eda-45ff-8546-877a1f2a7849 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:21.561775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a09d82b8-9eda-45ff-8546-877a1f2a7849 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:21.562388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a09d82b8-9eda-45ff-8546-877a1f2a7849 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:21.794440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a09d82b8-9eda-45ff-8546-877a1f2a7849 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:21.804443 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a09d82b8-9eda-45ff-8546-877a1f2a7849 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.263984 Aug 09 17:52:21.805193 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2984/5707] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:21 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:22.832835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0b695072-98bc-4979-9a12-6891389dcd8f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:22.833943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0b695072-98bc-4979-9a12-6891389dcd8f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:22.844700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b695072-98bc-4979-9a12-6891389dcd8f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:22.845505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b695072-98bc-4979-9a12-6891389dcd8f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:22.846179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b695072-98bc-4979-9a12-6891389dcd8f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:22.847213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b695072-98bc-4979-9a12-6891389dcd8f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:22.848627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b695072-98bc-4979-9a12-6891389dcd8f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:22.849471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b695072-98bc-4979-9a12-6891389dcd8f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:23.121370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0b695072-98bc-4979-9a12-6891389dcd8f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:23.139076 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0b695072-98bc-4979-9a12-6891389dcd8f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.313538 Aug 09 17:52:23.140314 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2724/5708] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:22 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:52:24.174650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19841106-e875-4d67-98ca-fe86bf5f52b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:24.178047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19841106-e875-4d67-98ca-fe86bf5f52b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:24.198869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19841106-e875-4d67-98ca-fe86bf5f52b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:24.200624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19841106-e875-4d67-98ca-fe86bf5f52b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:24.202595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19841106-e875-4d67-98ca-fe86bf5f52b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:24.204334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19841106-e875-4d67-98ca-fe86bf5f52b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:24.205904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19841106-e875-4d67-98ca-fe86bf5f52b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:24.206433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19841106-e875-4d67-98ca-fe86bf5f52b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:24.417109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-19841106-e875-4d67-98ca-fe86bf5f52b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:24.432659 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19841106-e875-4d67-98ca-fe86bf5f52b5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1694 microversion: 2.1 time: 0.269337 Aug 09 17:52:24.434180 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2985/5709] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:24 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1694 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:25.480183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-92b4e8d9-4025-4b53-98f8-5d6e837b5db5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:25.482239 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-92b4e8d9-4025-4b53-98f8-5d6e837b5db5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:25.508096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92b4e8d9-4025-4b53-98f8-5d6e837b5db5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:25.513225 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92b4e8d9-4025-4b53-98f8-5d6e837b5db5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:25.514056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92b4e8d9-4025-4b53-98f8-5d6e837b5db5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:25.515390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92b4e8d9-4025-4b53-98f8-5d6e837b5db5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:25.527726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92b4e8d9-4025-4b53-98f8-5d6e837b5db5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:25.527726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92b4e8d9-4025-4b53-98f8-5d6e837b5db5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:25.758072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8dd25a3f-8881-43ba-a980-29b4a447cf44 req-aca23f66-5473-42ec-ad96-9cdeacb1420c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5665b6cd-9566-4f66-a66c-1f9d7c6398fd", "name": "network-vif-unplugged", "status": "completed", "tag": "561503aa-9292-4576-9663-a94424f5925d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:25.800139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8dd25a3f-8881-43ba-a980-29b4a447cf44 req-aca23f66-5473-42ec-ad96-9cdeacb1420c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:25.801035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8dd25a3f-8881-43ba-a980-29b4a447cf44 req-aca23f66-5473-42ec-ad96-9cdeacb1420c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:25.801845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8dd25a3f-8881-43ba-a980-29b4a447cf44 req-aca23f66-5473-42ec-ad96-9cdeacb1420c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:25.861059 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8dd25a3f-8881-43ba-a980-29b4a447cf44 req-aca23f66-5473-42ec-ad96-9cdeacb1420c service nova] Creating event network-vif-unplugged:561503aa-9292-4576-9663-a94424f5925d for instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd on n-h1-845781-6 Aug 09 17:52:25.892451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-8dd25a3f-8881-43ba-a980-29b4a447cf44 req-aca23f66-5473-42ec-ad96-9cdeacb1420c service nova] Instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:52:25.907569 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8dd25a3f-8881-43ba-a980-29b4a447cf44 req-aca23f66-5473-42ec-ad96-9cdeacb1420c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157503 Aug 09 17:52:25.908892 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2986/5710] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:52:26.173416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-92b4e8d9-4025-4b53-98f8-5d6e837b5db5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:26.192768 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-92b4e8d9-4025-4b53-98f8-5d6e837b5db5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1693 microversion: 2.1 time: 0.719011 Aug 09 17:52:26.193396 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2725/5711] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:25 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1693 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:27.235496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38126e59-30f8-4080-a576-6a81d7ea126e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:27.237265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-38126e59-30f8-4080-a576-6a81d7ea126e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:27.252176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38126e59-30f8-4080-a576-6a81d7ea126e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:27.254198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38126e59-30f8-4080-a576-6a81d7ea126e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:27.255414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38126e59-30f8-4080-a576-6a81d7ea126e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:27.256745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38126e59-30f8-4080-a576-6a81d7ea126e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:27.257801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38126e59-30f8-4080-a576-6a81d7ea126e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:27.259437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38126e59-30f8-4080-a576-6a81d7ea126e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:27.585178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-38126e59-30f8-4080-a576-6a81d7ea126e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:27.600402 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-38126e59-30f8-4080-a576-6a81d7ea126e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1693 microversion: 2.1 time: 0.370186 Aug 09 17:52:27.619204 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2987/5712] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:27 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1693 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:27.965229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-c98676a0-381d-47db-b1ff-843936093832 req-59b2fa68-e3a3-4442-a87a-a779047048a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5665b6cd-9566-4f66-a66c-1f9d7c6398fd", "tag": "561503aa-9292-4576-9663-a94424f5925d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:28.002718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c98676a0-381d-47db-b1ff-843936093832 req-59b2fa68-e3a3-4442-a87a-a779047048a1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:28.003609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c98676a0-381d-47db-b1ff-843936093832 req-59b2fa68-e3a3-4442-a87a-a779047048a1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:28.020868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c98676a0-381d-47db-b1ff-843936093832 req-59b2fa68-e3a3-4442-a87a-a779047048a1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:28.069343 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-c98676a0-381d-47db-b1ff-843936093832 req-59b2fa68-e3a3-4442-a87a-a779047048a1 service nova] Creating event network-changed:561503aa-9292-4576-9663-a94424f5925d for instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd on n-h1-845781-6 Aug 09 17:52:28.082834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-c98676a0-381d-47db-b1ff-843936093832 req-59b2fa68-e3a3-4442-a87a-a779047048a1 service nova] Instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:52:28.110252 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-c98676a0-381d-47db-b1ff-843936093832 req-59b2fa68-e3a3-4442-a87a-a779047048a1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151416 Aug 09 17:52:28.112426 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2726/5713] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:52:28.639935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2706eecd-5c95-4b24-a1f3-8685fbbfcf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:28.641926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2706eecd-5c95-4b24-a1f3-8685fbbfcf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:28.654165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2706eecd-5c95-4b24-a1f3-8685fbbfcf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:28.654950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2706eecd-5c95-4b24-a1f3-8685fbbfcf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:28.656050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2706eecd-5c95-4b24-a1f3-8685fbbfcf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:28.657207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2706eecd-5c95-4b24-a1f3-8685fbbfcf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:28.658096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2706eecd-5c95-4b24-a1f3-8685fbbfcf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:28.658758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2706eecd-5c95-4b24-a1f3-8685fbbfcf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:28.938113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2706eecd-5c95-4b24-a1f3-8685fbbfcf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:28.950278 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2706eecd-5c95-4b24-a1f3-8685fbbfcf85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1691 microversion: 2.1 time: 0.322961 Aug 09 17:52:28.951264 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2988/5714] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:28 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1691 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:29.996012 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-98aae2b5-425f-445a-88b9-d87812b474d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:29.997223 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-98aae2b5-425f-445a-88b9-d87812b474d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:30.042611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aae2b5-425f-445a-88b9-d87812b474d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:30.043509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aae2b5-425f-445a-88b9-d87812b474d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:30.044518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aae2b5-425f-445a-88b9-d87812b474d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:30.050206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aae2b5-425f-445a-88b9-d87812b474d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:30.051066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aae2b5-425f-445a-88b9-d87812b474d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:30.051909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98aae2b5-425f-445a-88b9-d87812b474d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:30.542802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-98aae2b5-425f-445a-88b9-d87812b474d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:30.568449 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-98aae2b5-425f-445a-88b9-d87812b474d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1688 microversion: 2.1 time: 0.580582 Aug 09 17:52:30.569507 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2727/5715] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:29 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1688 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:52:30.590786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cafeb625-1455-464c-9583-d2a56f80cd22 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:30.591342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cafeb625-1455-464c-9583-d2a56f80cd22 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:30.601732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cafeb625-1455-464c-9583-d2a56f80cd22 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:30.603135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cafeb625-1455-464c-9583-d2a56f80cd22 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:30.603801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cafeb625-1455-464c-9583-d2a56f80cd22 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:30.604715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cafeb625-1455-464c-9583-d2a56f80cd22 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:30.605325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cafeb625-1455-464c-9583-d2a56f80cd22 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:30.605919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cafeb625-1455-464c-9583-d2a56f80cd22 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:30.701702 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cafeb625-1455-464c-9583-d2a56f80cd22 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd/action" status: 204 len: 0 microversion: 2.1 time: 0.114714 Aug 09 17:52:30.702779 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2989/5716] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:52:30 2022] POST /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd/action => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:52:30.712261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cb414f3b-ada6-42b1-9370-2bd9de92b4ff tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:30.713219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cb414f3b-ada6-42b1-9370-2bd9de92b4ff tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:30.720567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb414f3b-ada6-42b1-9370-2bd9de92b4ff tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:30.721323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb414f3b-ada6-42b1-9370-2bd9de92b4ff tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:30.721954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb414f3b-ada6-42b1-9370-2bd9de92b4ff tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:30.722996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb414f3b-ada6-42b1-9370-2bd9de92b4ff tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:30.723659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb414f3b-ada6-42b1-9370-2bd9de92b4ff tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:30.724262 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb414f3b-ada6-42b1-9370-2bd9de92b4ff tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:31.091400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cb414f3b-ada6-42b1-9370-2bd9de92b4ff tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:31.101881 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cb414f3b-ada6-42b1-9370-2bd9de92b4ff tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1688 microversion: 2.1 time: 0.392837 Aug 09 17:52:31.102964 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2728/5717] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:30 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1688 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:31.561922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9265a7ca-7375-4753-bed1-d3e11faa6907 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:31.562517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9265a7ca-7375-4753-bed1-d3e11faa6907 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:31.574542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9265a7ca-7375-4753-bed1-d3e11faa6907 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:31.577153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9265a7ca-7375-4753-bed1-d3e11faa6907 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:31.577860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9265a7ca-7375-4753-bed1-d3e11faa6907 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:31.578791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9265a7ca-7375-4753-bed1-d3e11faa6907 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:31.581066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9265a7ca-7375-4753-bed1-d3e11faa6907 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:31.585095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9265a7ca-7375-4753-bed1-d3e11faa6907 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:31.687571 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9265a7ca-7375-4753-bed1-d3e11faa6907 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/ips" status: 200 len: 143 microversion: 2.1 time: 0.496808 Aug 09 17:52:31.692565 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2990/5718] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:52:31 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/ips => generated 143 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:52:32.129333 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a5c30370-8bbe-42eb-b2a5-0ba3586ed871 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:32.132265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a5c30370-8bbe-42eb-b2a5-0ba3586ed871 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:32.171427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5c30370-8bbe-42eb-b2a5-0ba3586ed871 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:32.173332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5c30370-8bbe-42eb-b2a5-0ba3586ed871 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:32.177679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5c30370-8bbe-42eb-b2a5-0ba3586ed871 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:32.180192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5c30370-8bbe-42eb-b2a5-0ba3586ed871 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:32.181660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5c30370-8bbe-42eb-b2a5-0ba3586ed871 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:32.183914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a5c30370-8bbe-42eb-b2a5-0ba3586ed871 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:32.657755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a5c30370-8bbe-42eb-b2a5-0ba3586ed871 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:32.670497 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a5c30370-8bbe-42eb-b2a5-0ba3586ed871 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1688 microversion: 2.1 time: 0.546949 Aug 09 17:52:32.672032 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2729/5719] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:32 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1688 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:33.587400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6a5df555-ed84-4935-8e52-7b202374667b req-aff456f1-13b8-45be-a04d-be8c7202ae23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5665b6cd-9566-4f66-a66c-1f9d7c6398fd", "name": "network-vif-plugged", "status": "completed", "tag": "561503aa-9292-4576-9663-a94424f5925d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:33.617284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6a5df555-ed84-4935-8e52-7b202374667b req-aff456f1-13b8-45be-a04d-be8c7202ae23 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:33.618941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6a5df555-ed84-4935-8e52-7b202374667b req-aff456f1-13b8-45be-a04d-be8c7202ae23 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:33.619940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6a5df555-ed84-4935-8e52-7b202374667b req-aff456f1-13b8-45be-a04d-be8c7202ae23 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:33.647210 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6a5df555-ed84-4935-8e52-7b202374667b req-aff456f1-13b8-45be-a04d-be8c7202ae23 service nova] Creating event network-vif-plugged:561503aa-9292-4576-9663-a94424f5925d for instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd on n-h1-845781-6 Aug 09 17:52:33.661078 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6a5df555-ed84-4935-8e52-7b202374667b req-aff456f1-13b8-45be-a04d-be8c7202ae23 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078780 Aug 09 17:52:33.663748 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2991/5720] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:52:33.697668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d6bb8063-8aa2-414a-9d1e-9a883ab845ea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:33.698398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d6bb8063-8aa2-414a-9d1e-9a883ab845ea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:33.717653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6bb8063-8aa2-414a-9d1e-9a883ab845ea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:33.719379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6bb8063-8aa2-414a-9d1e-9a883ab845ea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:33.721271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6bb8063-8aa2-414a-9d1e-9a883ab845ea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:33.721892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6bb8063-8aa2-414a-9d1e-9a883ab845ea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:33.722426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6bb8063-8aa2-414a-9d1e-9a883ab845ea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:33.722885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d6bb8063-8aa2-414a-9d1e-9a883ab845ea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:34.088479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d6bb8063-8aa2-414a-9d1e-9a883ab845ea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:34.108781 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d6bb8063-8aa2-414a-9d1e-9a883ab845ea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1688 microversion: 2.1 time: 0.417232 Aug 09 17:52:34.116394 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2730/5721] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:33 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1688 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:34.612611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2f4a33fc-2965-4694-85eb-11aac38462d7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a30ff6d-0146-4a6a-bd1d-25741f2e115b"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:34.615546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2f4a33fc-2965-4694-85eb-11aac38462d7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:34.626139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f4a33fc-2965-4694-85eb-11aac38462d7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:34.626311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f4a33fc-2965-4694-85eb-11aac38462d7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:34.627620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f4a33fc-2965-4694-85eb-11aac38462d7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:34.628679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f4a33fc-2965-4694-85eb-11aac38462d7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:34.629375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f4a33fc-2965-4694-85eb-11aac38462d7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:34.629997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f4a33fc-2965-4694-85eb-11aac38462d7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:35.151366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-be060b2f-ab45-4e32-b6ba-32143acd9096 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:35.161117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-be060b2f-ab45-4e32-b6ba-32143acd9096 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:35.203997 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2f4a33fc-2965-4694-85eb-11aac38462d7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "POST /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.561218 Aug 09 17:52:35.209356 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2992/5722] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:52:34 2022] POST /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:52:35.268751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be060b2f-ab45-4e32-b6ba-32143acd9096 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:35.272696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be060b2f-ab45-4e32-b6ba-32143acd9096 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:35.273762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be060b2f-ab45-4e32-b6ba-32143acd9096 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:35.275718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be060b2f-ab45-4e32-b6ba-32143acd9096 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:35.276631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be060b2f-ab45-4e32-b6ba-32143acd9096 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:35.277290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be060b2f-ab45-4e32-b6ba-32143acd9096 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:35.643399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-be060b2f-ab45-4e32-b6ba-32143acd9096 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:35.662207 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-be060b2f-ab45-4e32-b6ba-32143acd9096 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1680 microversion: 2.1 time: 0.531207 Aug 09 17:52:35.676992 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2731/5723] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:35 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1680 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:44.594031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1132177694", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "2949390b-073d-43ce-bb56-f4ee486cbcc0"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:44.699504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] validate_networks() for [('2949390b-073d-43ce-bb56-f4ee486cbcc0', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:52:45.065624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:52:45.245485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:52:45.246032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:52:45.246637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:52:45.247155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:52:45.247717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:52:45.260572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:45.261227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:45.261774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:45.262802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:45.263379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:45.264024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:45.285429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Getting quotas for project 3f25245736b44c26a03b531dbc64484e. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:52:45.292288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Getting quotas for user 8e1766fa8dce47cda0957460c7f1d883 and project 3f25245736b44c26a03b531dbc64484e. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:52:45.309053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:52:45.311415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:52:45.362992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5b47e88f-4a1e-4622-b664-db6b12fa4def tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045758 Aug 09 17:52:45.364054 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2993/5724] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:52:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:52:45.386539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e1facda7-9275-409c-8964-65dfb60419f9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:45.388963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e1facda7-9275-409c-8964-65dfb60419f9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:45.396208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=17 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:52:45.480733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e1facda7-9275-409c-8964-65dfb60419f9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:45.494524 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e1facda7-9275-409c-8964-65dfb60419f9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1215 microversion: 2.1 time: 0.117084 Aug 09 17:52:45.496648 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2732/5725] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:45 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:52:46.539411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e122494f-3a97-480a-af3a-269aaf1cd0ea tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:46.542395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e122494f-3a97-480a-af3a-269aaf1cd0ea tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:46.574272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e122494f-3a97-480a-af3a-269aaf1cd0ea tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:46.576058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e122494f-3a97-480a-af3a-269aaf1cd0ea tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:46.583889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e122494f-3a97-480a-af3a-269aaf1cd0ea tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:46.585651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e122494f-3a97-480a-af3a-269aaf1cd0ea tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:46.587217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e122494f-3a97-480a-af3a-269aaf1cd0ea tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:46.588282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e122494f-3a97-480a-af3a-269aaf1cd0ea tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:46.774879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e122494f-3a97-480a-af3a-269aaf1cd0ea tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:46.800129 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e122494f-3a97-480a-af3a-269aaf1cd0ea tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1267 microversion: 2.1 time: 0.270602 Aug 09 17:52:46.805742 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2994/5726] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:46 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1267 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:47.845542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-42b9885c-6d41-4c97-9e53-4ba9a8e9749e tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:47.846372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-42b9885c-6d41-4c97-9e53-4ba9a8e9749e tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:47.858969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=51 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:52:47.862249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42b9885c-6d41-4c97-9e53-4ba9a8e9749e tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:47.862842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42b9885c-6d41-4c97-9e53-4ba9a8e9749e tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:47.863478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42b9885c-6d41-4c97-9e53-4ba9a8e9749e tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:47.864406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42b9885c-6d41-4c97-9e53-4ba9a8e9749e tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:47.865058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42b9885c-6d41-4c97-9e53-4ba9a8e9749e tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:47.865487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-42b9885c-6d41-4c97-9e53-4ba9a8e9749e tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:48.232947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-42b9885c-6d41-4c97-9e53-4ba9a8e9749e tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:48.242765 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-42b9885c-6d41-4c97-9e53-4ba9a8e9749e tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1315 microversion: 2.1 time: 0.401170 Aug 09 17:52:48.243731 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2733/5727] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:47 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:49.268854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d0d4847d-6a0e-4918-802f-b339813bd423 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:49.269587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d0d4847d-6a0e-4918-802f-b339813bd423 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:49.282883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d4847d-6a0e-4918-802f-b339813bd423 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:49.287381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d4847d-6a0e-4918-802f-b339813bd423 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:49.287890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d4847d-6a0e-4918-802f-b339813bd423 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:49.288738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d4847d-6a0e-4918-802f-b339813bd423 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:49.289225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d4847d-6a0e-4918-802f-b339813bd423 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:49.289646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0d4847d-6a0e-4918-802f-b339813bd423 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:49.525861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d0d4847d-6a0e-4918-802f-b339813bd423 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:49.536886 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d0d4847d-6a0e-4918-802f-b339813bd423 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1315 microversion: 2.1 time: 0.272133 Aug 09 17:52:49.538210 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2995/5728] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:49 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:49.558345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-6d76f8e2-036e-4617-a088-ea1fbeb051bb req-d1012223-b734-43b2-a651-be53c0774105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f0cf5c-7f46-43bc-b196-50f444710563", "tag": "7d0c9316-a5ae-46a7-a66a-eb36fb182ebf"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:49.604529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6d76f8e2-036e-4617-a088-ea1fbeb051bb req-d1012223-b734-43b2-a651-be53c0774105 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:49.605735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6d76f8e2-036e-4617-a088-ea1fbeb051bb req-d1012223-b734-43b2-a651-be53c0774105 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:49.606580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-6d76f8e2-036e-4617-a088-ea1fbeb051bb req-d1012223-b734-43b2-a651-be53c0774105 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:49.627526 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-6d76f8e2-036e-4617-a088-ea1fbeb051bb req-d1012223-b734-43b2-a651-be53c0774105 service nova] Creating event network-changed:7d0c9316-a5ae-46a7-a66a-eb36fb182ebf for instance 46f0cf5c-7f46-43bc-b196-50f444710563 on n-h2-845781-6 Aug 09 17:52:49.633705 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-6d76f8e2-036e-4617-a088-ea1fbeb051bb req-d1012223-b734-43b2-a651-be53c0774105 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108295 Aug 09 17:52:49.635203 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2734/5729] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:52:50.565200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26bd1757-8810-42b2-806e-02b40d39c08f tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:50.566656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-26bd1757-8810-42b2-806e-02b40d39c08f tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:50.593452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26bd1757-8810-42b2-806e-02b40d39c08f tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:50.595350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26bd1757-8810-42b2-806e-02b40d39c08f tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:50.595845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26bd1757-8810-42b2-806e-02b40d39c08f tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:50.605681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26bd1757-8810-42b2-806e-02b40d39c08f tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:50.605681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26bd1757-8810-42b2-806e-02b40d39c08f tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:50.606233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26bd1757-8810-42b2-806e-02b40d39c08f tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:50.645365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a2c0acd4-f4b0-4183-9d73-481cf19b2934 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:50.650889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a2c0acd4-f4b0-4183-9d73-481cf19b2934 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:50.678656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2c0acd4-f4b0-4183-9d73-481cf19b2934 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:50.679620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2c0acd4-f4b0-4183-9d73-481cf19b2934 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:50.680407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2c0acd4-f4b0-4183-9d73-481cf19b2934 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:50.682252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2c0acd4-f4b0-4183-9d73-481cf19b2934 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:50.683008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2c0acd4-f4b0-4183-9d73-481cf19b2934 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:50.683812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a2c0acd4-f4b0-4183-9d73-481cf19b2934 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:50.825299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-26bd1757-8810-42b2-806e-02b40d39c08f tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:50.834988 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-26bd1757-8810-42b2-806e-02b40d39c08f tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1315 microversion: 2.1 time: 0.277364 Aug 09 17:52:50.838420 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a2c0acd4-f4b0-4183-9d73-481cf19b2934 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209154 Aug 09 17:52:50.851796 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2735/5730] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:52:50 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:52:50.853152 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2996/5731] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:50 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:50.864959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-666de6a7-d7e0-4ced-b426-e263390d13d6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:50.866200 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-666de6a7-d7e0-4ced-b426-e263390d13d6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:50.884505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-666de6a7-d7e0-4ced-b426-e263390d13d6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:50.886218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-666de6a7-d7e0-4ced-b426-e263390d13d6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:50.887282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-666de6a7-d7e0-4ced-b426-e263390d13d6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:50.888881 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-666de6a7-d7e0-4ced-b426-e263390d13d6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:50.889981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-666de6a7-d7e0-4ced-b426-e263390d13d6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:50.892908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-666de6a7-d7e0-4ced-b426-e263390d13d6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:50.989368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-666de6a7-d7e0-4ced-b426-e263390d13d6 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments/8a30ff6d-0146-4a6a-bd1d-25741f2e115b" status: 200 len: 194 microversion: 2.1 time: 0.134246 Aug 09 17:52:51.000853 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2736/5732] 10.222.0.93 () {58 vars in 1413 bytes} [Tue Aug 9 17:52:50 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments/8a30ff6d-0146-4a6a-bd1d-25741f2e115b => generated 194 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:52:51.865233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-da7e030f-11bd-4f34-a606-d3a07d3384ca tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:51.866087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-da7e030f-11bd-4f34-a606-d3a07d3384ca tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:51.876901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:52:51.880490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da7e030f-11bd-4f34-a606-d3a07d3384ca tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:51.881324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da7e030f-11bd-4f34-a606-d3a07d3384ca tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:51.888846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da7e030f-11bd-4f34-a606-d3a07d3384ca tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:51.889901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da7e030f-11bd-4f34-a606-d3a07d3384ca tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:51.890525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da7e030f-11bd-4f34-a606-d3a07d3384ca tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:51.891111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-da7e030f-11bd-4f34-a606-d3a07d3384ca tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:52.230876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-da7e030f-11bd-4f34-a606-d3a07d3384ca tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:52.239886 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-da7e030f-11bd-4f34-a606-d3a07d3384ca tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1315 microversion: 2.1 time: 0.378509 Aug 09 17:52:52.242292 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2997/5733] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:51 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:52:53.270356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1c661775-156c-4f76-941e-c6c891b5c359 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:53.270356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1c661775-156c-4f76-941e-c6c891b5c359 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:53.281709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c661775-156c-4f76-941e-c6c891b5c359 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:53.282555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c661775-156c-4f76-941e-c6c891b5c359 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:53.283670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c661775-156c-4f76-941e-c6c891b5c359 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:53.284962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c661775-156c-4f76-941e-c6c891b5c359 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:53.285653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c661775-156c-4f76-941e-c6c891b5c359 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:53.286205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1c661775-156c-4f76-941e-c6c891b5c359 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:53.515328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1c661775-156c-4f76-941e-c6c891b5c359 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:53.529775 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1c661775-156c-4f76-941e-c6c891b5c359 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1315 microversion: 2.1 time: 0.267952 Aug 09 17:52:53.539715 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2737/5734] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:53 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:53.906697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e890ad6-e371-49e5-bc53-3e28eb766c05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e168028-735b-4680-9455-f94c1c69ce89"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:53.910727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e890ad6-e371-49e5-bc53-3e28eb766c05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:53.924144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e890ad6-e371-49e5-bc53-3e28eb766c05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:53.924884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e890ad6-e371-49e5-bc53-3e28eb766c05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:53.925668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e890ad6-e371-49e5-bc53-3e28eb766c05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:53.926777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e890ad6-e371-49e5-bc53-3e28eb766c05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:53.927446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e890ad6-e371-49e5-bc53-3e28eb766c05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:53.928126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e890ad6-e371-49e5-bc53-3e28eb766c05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:54.441842 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e890ad6-e371-49e5-bc53-3e28eb766c05 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "POST /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.541703 Aug 09 17:52:54.444909 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2998/5735] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:52:53 2022] POST /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:52:54.565174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3d02c815-bb52-4193-84d8-d93f9f5b3d93 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:54.569096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3d02c815-bb52-4193-84d8-d93f9f5b3d93 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:54.608587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d02c815-bb52-4193-84d8-d93f9f5b3d93 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:54.609738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d02c815-bb52-4193-84d8-d93f9f5b3d93 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:54.610537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d02c815-bb52-4193-84d8-d93f9f5b3d93 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:54.611869 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d02c815-bb52-4193-84d8-d93f9f5b3d93 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:54.630325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d02c815-bb52-4193-84d8-d93f9f5b3d93 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:54.631187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d02c815-bb52-4193-84d8-d93f9f5b3d93 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:55.162677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d02c815-bb52-4193-84d8-d93f9f5b3d93 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:55.189722 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3d02c815-bb52-4193-84d8-d93f9f5b3d93 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1315 microversion: 2.1 time: 0.636506 Aug 09 17:52:55.198907 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2738/5736] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:54 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:56.220974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-77db827c-bc06-4ef2-b795-5742738c8c0b tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:56.222584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-77db827c-bc06-4ef2-b795-5742738c8c0b tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:56.225989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:52:56.227549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:52:56.235034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77db827c-bc06-4ef2-b795-5742738c8c0b tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:56.235933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77db827c-bc06-4ef2-b795-5742738c8c0b tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:56.236657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77db827c-bc06-4ef2-b795-5742738c8c0b tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:56.237909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77db827c-bc06-4ef2-b795-5742738c8c0b tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:56.238566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77db827c-bc06-4ef2-b795-5742738c8c0b tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:56.239162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77db827c-bc06-4ef2-b795-5742738c8c0b tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:56.399058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-77db827c-bc06-4ef2-b795-5742738c8c0b tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:56.409193 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-77db827c-bc06-4ef2-b795-5742738c8c0b tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1315 microversion: 2.1 time: 0.193202 Aug 09 17:52:56.410355 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 2999/5737] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:56 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:52:56.617157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-0c2e9970-8064-4a2f-8484-3b157179cd26 req-687f1028-3c7d-4559-a001-6ad2e8efc071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f0cf5c-7f46-43bc-b196-50f444710563", "name": "network-vif-plugged", "status": "completed", "tag": "7d0c9316-a5ae-46a7-a66a-eb36fb182ebf"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:56.640807 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:52:56.658864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0c2e9970-8064-4a2f-8484-3b157179cd26 req-687f1028-3c7d-4559-a001-6ad2e8efc071 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:56.659280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0c2e9970-8064-4a2f-8484-3b157179cd26 req-687f1028-3c7d-4559-a001-6ad2e8efc071 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:56.659774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0c2e9970-8064-4a2f-8484-3b157179cd26 req-687f1028-3c7d-4559-a001-6ad2e8efc071 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:56.689714 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-0c2e9970-8064-4a2f-8484-3b157179cd26 req-687f1028-3c7d-4559-a001-6ad2e8efc071 service nova] Creating event network-vif-plugged:7d0c9316-a5ae-46a7-a66a-eb36fb182ebf for instance 46f0cf5c-7f46-43bc-b196-50f444710563 on n-h2-845781-6 Aug 09 17:52:56.700727 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-0c2e9970-8064-4a2f-8484-3b157179cd26 req-687f1028-3c7d-4559-a001-6ad2e8efc071 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091363 Aug 09 17:52:56.704579 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2739/5738] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:52:57.457927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-45a0fb13-4426-4788-b6fa-36d0703dd421 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:57.461544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-45a0fb13-4426-4788-b6fa-36d0703dd421 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:57.478711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0fb13-4426-4788-b6fa-36d0703dd421 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:57.481418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0fb13-4426-4788-b6fa-36d0703dd421 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:57.482661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0fb13-4426-4788-b6fa-36d0703dd421 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:57.485220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0fb13-4426-4788-b6fa-36d0703dd421 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:57.486463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0fb13-4426-4788-b6fa-36d0703dd421 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:57.487931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45a0fb13-4426-4788-b6fa-36d0703dd421 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:57.881695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-45a0fb13-4426-4788-b6fa-36d0703dd421 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:57.910408 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-45a0fb13-4426-4788-b6fa-36d0703dd421 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1315 microversion: 2.1 time: 0.460832 Aug 09 17:52:57.912458 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3000/5739] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:57 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:58.042437 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-75d6eb40-c20b-44c2-96bd-4c1d338b259f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:52:58.063473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-75d6eb40-c20b-44c2-96bd-4c1d338b259f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:58.099607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75d6eb40-c20b-44c2-96bd-4c1d338b259f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:58.100972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75d6eb40-c20b-44c2-96bd-4c1d338b259f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:58.102129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75d6eb40-c20b-44c2-96bd-4c1d338b259f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:58.105019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75d6eb40-c20b-44c2-96bd-4c1d338b259f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:58.106928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75d6eb40-c20b-44c2-96bd-4c1d338b259f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:58.109553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75d6eb40-c20b-44c2-96bd-4c1d338b259f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:58.237431 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-75d6eb40-c20b-44c2-96bd-4c1d338b259f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd/action" status: 200 len: 24543 microversion: 2.1 time: 0.220922 Aug 09 17:52:58.249042 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2740/5740] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:52:58 2022] POST /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd/action => generated 24543 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:52:58.951256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-00b4562f-2587-442e-9d43-06838781376c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:58.954453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-00b4562f-2587-442e-9d43-06838781376c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:58.975077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00b4562f-2587-442e-9d43-06838781376c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:58.984933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00b4562f-2587-442e-9d43-06838781376c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:58.986043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00b4562f-2587-442e-9d43-06838781376c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:58.988109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00b4562f-2587-442e-9d43-06838781376c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:58.990149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00b4562f-2587-442e-9d43-06838781376c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:58.992222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00b4562f-2587-442e-9d43-06838781376c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:59.390560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-00b4562f-2587-442e-9d43-06838781376c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:59.418330 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-00b4562f-2587-442e-9d43-06838781376c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1501 microversion: 2.1 time: 0.471837 Aug 09 17:52:59.420634 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3001/5741] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:58 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1501 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:52:59.470203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b7a0f492-6e2e-4fba-82d8-13418fb35818 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:52:59.471583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b7a0f492-6e2e-4fba-82d8-13418fb35818 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:52:59.505593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7a0f492-6e2e-4fba-82d8-13418fb35818 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:59.506427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7a0f492-6e2e-4fba-82d8-13418fb35818 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:59.509228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7a0f492-6e2e-4fba-82d8-13418fb35818 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:59.516693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7a0f492-6e2e-4fba-82d8-13418fb35818 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:52:59.517525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7a0f492-6e2e-4fba-82d8-13418fb35818 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:52:59.518298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b7a0f492-6e2e-4fba-82d8-13418fb35818 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:52:59.948334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b7a0f492-6e2e-4fba-82d8-13418fb35818 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:52:59.969912 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b7a0f492-6e2e-4fba-82d8-13418fb35818 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1501 microversion: 2.1 time: 0.510298 Aug 09 17:52:59.971591 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2741/5742] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:52:59 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1501 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:00.029671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3fc21947-a1c4-479b-8e8e-b95f1d7ce0cc tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:53:00.031073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3fc21947-a1c4-479b-8e8e-b95f1d7ce0cc tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:00.044931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fc21947-a1c4-479b-8e8e-b95f1d7ce0cc tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:00.045841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fc21947-a1c4-479b-8e8e-b95f1d7ce0cc tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:00.046795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fc21947-a1c4-479b-8e8e-b95f1d7ce0cc tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:00.048243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fc21947-a1c4-479b-8e8e-b95f1d7ce0cc tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:00.049241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fc21947-a1c4-479b-8e8e-b95f1d7ce0cc tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:00.050387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fc21947-a1c4-479b-8e8e-b95f1d7ce0cc tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:00.131930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-3fc21947-a1c4-479b-8e8e-b95f1d7ce0cc tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lazy-loading 'flavor' on Instance uuid 46f0cf5c-7f46-43bc-b196-50f444710563 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:53:00.279992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3fc21947-a1c4-479b-8e8e-b95f1d7ce0cc tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "POST /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563/action" status: 202 len: 0 microversion: 2.1 time: 0.265467 Aug 09 17:53:00.281983 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3002/5743] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:53:00 2022] POST /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:53:00.296719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-136c275e-5dd9-4c9f-b70e-339d37d3b2be tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:00.297955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-136c275e-5dd9-4c9f-b70e-339d37d3b2be tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:00.356825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-136c275e-5dd9-4c9f-b70e-339d37d3b2be tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:00.357757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-136c275e-5dd9-4c9f-b70e-339d37d3b2be tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:00.358549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-136c275e-5dd9-4c9f-b70e-339d37d3b2be tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:00.360390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-136c275e-5dd9-4c9f-b70e-339d37d3b2be tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:00.361509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-136c275e-5dd9-4c9f-b70e-339d37d3b2be tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:00.362299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-136c275e-5dd9-4c9f-b70e-339d37d3b2be tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:00.692102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-136c275e-5dd9-4c9f-b70e-339d37d3b2be tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:00.746118 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-136c275e-5dd9-4c9f-b70e-339d37d3b2be tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1509 microversion: 2.1 time: 0.457046 Aug 09 17:53:00.818284 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2742/5744] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:00 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1509 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:01.817120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8930ea1a-d4e4-4494-bb53-94d7239e9efa tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:01.819865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8930ea1a-d4e4-4494-bb53-94d7239e9efa tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:01.833732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8930ea1a-d4e4-4494-bb53-94d7239e9efa tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:01.835232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8930ea1a-d4e4-4494-bb53-94d7239e9efa tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:01.836400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8930ea1a-d4e4-4494-bb53-94d7239e9efa tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:01.838387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8930ea1a-d4e4-4494-bb53-94d7239e9efa tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:01.839244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8930ea1a-d4e4-4494-bb53-94d7239e9efa tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:01.840071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8930ea1a-d4e4-4494-bb53-94d7239e9efa tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:02.073524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8930ea1a-d4e4-4494-bb53-94d7239e9efa tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:02.102232 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8930ea1a-d4e4-4494-bb53-94d7239e9efa tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1492 microversion: 2.1 time: 0.299804 Aug 09 17:53:02.106114 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3003/5745] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:01 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1492 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:02.144538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-16ea24f2-48e0-4f14-8d08-acc4759193e9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:53:02.146516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-16ea24f2-48e0-4f14-8d08-acc4759193e9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:02.161231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16ea24f2-48e0-4f14-8d08-acc4759193e9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:02.162068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16ea24f2-48e0-4f14-8d08-acc4759193e9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:02.162988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16ea24f2-48e0-4f14-8d08-acc4759193e9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:02.165944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16ea24f2-48e0-4f14-8d08-acc4759193e9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:02.166947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16ea24f2-48e0-4f14-8d08-acc4759193e9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:02.167926 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16ea24f2-48e0-4f14-8d08-acc4759193e9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:02.299909 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-16ea24f2-48e0-4f14-8d08-acc4759193e9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "POST /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563/action" status: 202 len: 0 microversion: 2.1 time: 0.163026 Aug 09 17:53:02.301043 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2743/5746] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:53:02 2022] POST /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:53:02.318841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4ac1dc86-3893-41a5-9612-babb3d78b485 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:02.320712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4ac1dc86-3893-41a5-9612-babb3d78b485 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:02.338628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac1dc86-3893-41a5-9612-babb3d78b485 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:02.340108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac1dc86-3893-41a5-9612-babb3d78b485 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:02.341218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac1dc86-3893-41a5-9612-babb3d78b485 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:02.342882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac1dc86-3893-41a5-9612-babb3d78b485 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:02.344048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac1dc86-3893-41a5-9612-babb3d78b485 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:02.345048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac1dc86-3893-41a5-9612-babb3d78b485 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:02.681098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4ac1dc86-3893-41a5-9612-babb3d78b485 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:02.722440 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4ac1dc86-3893-41a5-9612-babb3d78b485 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1498 microversion: 2.1 time: 0.413179 Aug 09 17:53:02.723467 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3004/5747] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:02 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1498 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:03.769933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-53737aa2-4748-4a46-8005-ef2a350af315 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:03.772445 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-53737aa2-4748-4a46-8005-ef2a350af315 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:03.791030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53737aa2-4748-4a46-8005-ef2a350af315 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:03.792515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53737aa2-4748-4a46-8005-ef2a350af315 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:03.793898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53737aa2-4748-4a46-8005-ef2a350af315 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:03.795894 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53737aa2-4748-4a46-8005-ef2a350af315 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:03.797957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53737aa2-4748-4a46-8005-ef2a350af315 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:03.799166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53737aa2-4748-4a46-8005-ef2a350af315 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:04.058642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-53737aa2-4748-4a46-8005-ef2a350af315 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:04.068243 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-53737aa2-4748-4a46-8005-ef2a350af315 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1498 microversion: 2.1 time: 0.310507 Aug 09 17:53:04.070025 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2744/5748] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:03 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1498 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:04.621082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b56688f-723f-4f59-9edf-293c0e6e5ce1 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:04.622158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7b56688f-723f-4f59-9edf-293c0e6e5ce1 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:04.632004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b56688f-723f-4f59-9edf-293c0e6e5ce1 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:04.632830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b56688f-723f-4f59-9edf-293c0e6e5ce1 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:04.633653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b56688f-723f-4f59-9edf-293c0e6e5ce1 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:04.635066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b56688f-723f-4f59-9edf-293c0e6e5ce1 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:04.635717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b56688f-723f-4f59-9edf-293c0e6e5ce1 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:04.636518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b56688f-723f-4f59-9edf-293c0e6e5ce1 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:04.872253 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b56688f-723f-4f59-9edf-293c0e6e5ce1 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1831 microversion: 2.1 time: 0.256732 Aug 09 17:53:04.889274 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3005/5749] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:04 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1831 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:05.097788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d23e8f2b-5b00-4f9c-881c-5ebe44c1e6a9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:05.101441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d23e8f2b-5b00-4f9c-881c-5ebe44c1e6a9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:05.128346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d23e8f2b-5b00-4f9c-881c-5ebe44c1e6a9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:05.129406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d23e8f2b-5b00-4f9c-881c-5ebe44c1e6a9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:05.130407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d23e8f2b-5b00-4f9c-881c-5ebe44c1e6a9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:05.134165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d23e8f2b-5b00-4f9c-881c-5ebe44c1e6a9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:05.136242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d23e8f2b-5b00-4f9c-881c-5ebe44c1e6a9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:05.137360 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d23e8f2b-5b00-4f9c-881c-5ebe44c1e6a9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:05.482492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d23e8f2b-5b00-4f9c-881c-5ebe44c1e6a9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:05.527156 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d23e8f2b-5b00-4f9c-881c-5ebe44c1e6a9 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1501 microversion: 2.1 time: 0.438093 Aug 09 17:53:05.527807 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2745/5750] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:05 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1501 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:05.562631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3a01199-6056-4624-b6a8-fd4001a90113 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:53:05.563507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3a01199-6056-4624-b6a8-fd4001a90113 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:05.570513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a01199-6056-4624-b6a8-fd4001a90113 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:05.571901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a01199-6056-4624-b6a8-fd4001a90113 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:05.572613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a01199-6056-4624-b6a8-fd4001a90113 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:05.573567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a01199-6056-4624-b6a8-fd4001a90113 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:05.574296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a01199-6056-4624-b6a8-fd4001a90113 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:05.574727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3a01199-6056-4624-b6a8-fd4001a90113 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:05.603406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-e3a01199-6056-4624-b6a8-fd4001a90113 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lazy-loading 'flavor' on Instance uuid 46f0cf5c-7f46-43bc-b196-50f444710563 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:53:05.631585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:05.719347 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3a01199-6056-4624-b6a8-fd4001a90113 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "POST /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563/action" status: 202 len: 0 microversion: 2.1 time: 0.160955 Aug 09 17:53:05.720555 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3006/5751] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:53:05 2022] POST /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:53:05.736910 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6c945b5e-4f11-4abf-a9d7-bec3a1d90ca8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:05.737687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6c945b5e-4f11-4abf-a9d7-bec3a1d90ca8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:05.753045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c945b5e-4f11-4abf-a9d7-bec3a1d90ca8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:05.753698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c945b5e-4f11-4abf-a9d7-bec3a1d90ca8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:05.754880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c945b5e-4f11-4abf-a9d7-bec3a1d90ca8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:05.759691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c945b5e-4f11-4abf-a9d7-bec3a1d90ca8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:05.760286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c945b5e-4f11-4abf-a9d7-bec3a1d90ca8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:05.761004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6c945b5e-4f11-4abf-a9d7-bec3a1d90ca8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:06.015733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6c945b5e-4f11-4abf-a9d7-bec3a1d90ca8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:06.032885 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6c945b5e-4f11-4abf-a9d7-bec3a1d90ca8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1509 microversion: 2.1 time: 0.305139 Aug 09 17:53:06.034663 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2746/5752] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:05 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1509 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:07.029765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1ab2cc7e-6188-4f4d-b50e-d3e6e70a5833 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:07.030621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1ab2cc7e-6188-4f4d-b50e-d3e6e70a5833 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:07.039098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d1102791-483b-40b9-ab3a-8373eac6b699 req-01deddda-3da8-4348-9dbc-48f472243fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5665b6cd-9566-4f66-a66c-1f9d7c6398fd", "tag": "561503aa-9292-4576-9663-a94424f5925d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:53:07.066692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ab2cc7e-6188-4f4d-b50e-d3e6e70a5833 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:07.067446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ab2cc7e-6188-4f4d-b50e-d3e6e70a5833 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:07.073981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d1102791-483b-40b9-ab3a-8373eac6b699 req-01deddda-3da8-4348-9dbc-48f472243fca service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:07.074560 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d1102791-483b-40b9-ab3a-8373eac6b699 req-01deddda-3da8-4348-9dbc-48f472243fca service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:07.075137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d1102791-483b-40b9-ab3a-8373eac6b699 req-01deddda-3da8-4348-9dbc-48f472243fca service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:07.079167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ab2cc7e-6188-4f4d-b50e-d3e6e70a5833 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:07.080708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ab2cc7e-6188-4f4d-b50e-d3e6e70a5833 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:07.081536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ab2cc7e-6188-4f4d-b50e-d3e6e70a5833 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:07.082036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ab2cc7e-6188-4f4d-b50e-d3e6e70a5833 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:07.114924 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d1102791-483b-40b9-ab3a-8373eac6b699 req-01deddda-3da8-4348-9dbc-48f472243fca service nova] Creating event network-changed:561503aa-9292-4576-9663-a94424f5925d for instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd on n-h1-845781-6 Aug 09 17:53:07.141183 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d1102791-483b-40b9-ab3a-8373eac6b699 req-01deddda-3da8-4348-9dbc-48f472243fca service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106043 Aug 09 17:53:07.141829 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2747/5753] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:53:07.147421 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a3dff2c1-d4eb-4433-92f0-1d511f016f87 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:07.148162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a3dff2c1-d4eb-4433-92f0-1d511f016f87 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:07.154531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1ab2cc7e-6188-4f4d-b50e-d3e6e70a5833 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:53:07.168276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3dff2c1-d4eb-4433-92f0-1d511f016f87 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:07.171660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3dff2c1-d4eb-4433-92f0-1d511f016f87 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:07.176344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3dff2c1-d4eb-4433-92f0-1d511f016f87 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:07.177425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3dff2c1-d4eb-4433-92f0-1d511f016f87 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:07.178080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3dff2c1-d4eb-4433-92f0-1d511f016f87 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:07.178681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a3dff2c1-d4eb-4433-92f0-1d511f016f87 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:07.372741 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1ab2cc7e-6188-4f4d-b50e-d3e6e70a5833 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 204 len: 0 microversion: 2.1 time: 0.348258 Aug 09 17:53:07.374127 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3007/5754] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:53:07 2022] DELETE /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:53:07.393165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be716428-1e5c-48ae-b2cf-ff8f584c22ad tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:07.394661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-be716428-1e5c-48ae-b2cf-ff8f584c22ad tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:07.425795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be716428-1e5c-48ae-b2cf-ff8f584c22ad tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:07.426789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be716428-1e5c-48ae-b2cf-ff8f584c22ad tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:07.427264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be716428-1e5c-48ae-b2cf-ff8f584c22ad tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:07.433404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be716428-1e5c-48ae-b2cf-ff8f584c22ad tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:07.434008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be716428-1e5c-48ae-b2cf-ff8f584c22ad tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:07.434510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be716428-1e5c-48ae-b2cf-ff8f584c22ad tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:07.663257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be716428-1e5c-48ae-b2cf-ff8f584c22ad tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:07.670432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a3dff2c1-d4eb-4433-92f0-1d511f016f87 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:07.672966 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-be716428-1e5c-48ae-b2cf-ff8f584c22ad tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1686 microversion: 2.1 time: 0.292288 Aug 09 17:53:07.673995 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3008/5755] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:07 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1686 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:53:07.683603 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a3dff2c1-d4eb-4433-92f0-1d511f016f87 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1492 microversion: 2.1 time: 0.540272 Aug 09 17:53:07.688415 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2748/5756] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:07 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1492 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:07.707429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22384aee-9f08-4f21-80ef-cac9eef28400 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:53:07.708206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-22384aee-9f08-4f21-80ef-cac9eef28400 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:07.716214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22384aee-9f08-4f21-80ef-cac9eef28400 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:07.717054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22384aee-9f08-4f21-80ef-cac9eef28400 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:07.717647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22384aee-9f08-4f21-80ef-cac9eef28400 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:07.718538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22384aee-9f08-4f21-80ef-cac9eef28400 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:07.719356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22384aee-9f08-4f21-80ef-cac9eef28400 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:07.719941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22384aee-9f08-4f21-80ef-cac9eef28400 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:07.836231 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-22384aee-9f08-4f21-80ef-cac9eef28400 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "POST /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563/action" status: 202 len: 0 microversion: 2.1 time: 0.133333 Aug 09 17:53:07.842487 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3009/5757] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:53:07 2022] POST /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:53:07.850738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-885d989e-d388-49e5-9405-d1fcdac79212 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:07.851399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-885d989e-d388-49e5-9405-d1fcdac79212 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:07.868652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-885d989e-d388-49e5-9405-d1fcdac79212 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:07.868949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-885d989e-d388-49e5-9405-d1fcdac79212 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:07.869381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-885d989e-d388-49e5-9405-d1fcdac79212 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:07.883319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-885d989e-d388-49e5-9405-d1fcdac79212 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:07.884591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-885d989e-d388-49e5-9405-d1fcdac79212 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:07.885230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-885d989e-d388-49e5-9405-d1fcdac79212 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:08.219554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-885d989e-d388-49e5-9405-d1fcdac79212 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:08.231022 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-885d989e-d388-49e5-9405-d1fcdac79212 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1498 microversion: 2.1 time: 0.384407 Aug 09 17:53:08.231664 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2749/5758] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:07 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1498 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:53:08.714900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86707922-2a05-467c-9e79-707f25a84d37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:08.716312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-86707922-2a05-467c-9e79-707f25a84d37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:08.727154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86707922-2a05-467c-9e79-707f25a84d37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:08.728163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86707922-2a05-467c-9e79-707f25a84d37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:08.728790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86707922-2a05-467c-9e79-707f25a84d37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:08.729712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86707922-2a05-467c-9e79-707f25a84d37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:08.730357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86707922-2a05-467c-9e79-707f25a84d37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:08.730960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86707922-2a05-467c-9e79-707f25a84d37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:08.960469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86707922-2a05-467c-9e79-707f25a84d37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:08.971099 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86707922-2a05-467c-9e79-707f25a84d37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1686 microversion: 2.1 time: 0.262410 Aug 09 17:53:08.983667 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3010/5759] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:08 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1686 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:09.257541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f8d29b32-f374-40b8-ad91-ceedd88abd82 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:09.261602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f8d29b32-f374-40b8-ad91-ceedd88abd82 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:09.278801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8d29b32-f374-40b8-ad91-ceedd88abd82 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:09.282857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8d29b32-f374-40b8-ad91-ceedd88abd82 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:09.283547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8d29b32-f374-40b8-ad91-ceedd88abd82 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:09.285085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8d29b32-f374-40b8-ad91-ceedd88abd82 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:09.287990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8d29b32-f374-40b8-ad91-ceedd88abd82 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:09.288784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f8d29b32-f374-40b8-ad91-ceedd88abd82 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:09.721052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b9971252-9438-4131-bced-d31abaf0089e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:09.726128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b9971252-9438-4131-bced-d31abaf0089e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:09.749208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9971252-9438-4131-bced-d31abaf0089e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:09.753616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9971252-9438-4131-bced-d31abaf0089e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:09.756638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9971252-9438-4131-bced-d31abaf0089e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:09.760130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9971252-9438-4131-bced-d31abaf0089e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:09.760816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9971252-9438-4131-bced-d31abaf0089e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:09.763296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9971252-9438-4131-bced-d31abaf0089e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:09.832084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f8d29b32-f374-40b8-ad91-ceedd88abd82 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:09.848521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:09.851413 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f8d29b32-f374-40b8-ad91-ceedd88abd82 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1498 microversion: 2.1 time: 0.598221 Aug 09 17:53:09.853441 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2750/5760] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:09 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1498 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:09.866795 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b9971252-9438-4131-bced-d31abaf0089e tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.148450 Aug 09 17:53:09.868654 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3011/5761] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:53:09 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments => generated 371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:53:09.997874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f895bc59-3c83-407e-b451-67a1fb0c67eb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:09.998842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f895bc59-3c83-407e-b451-67a1fb0c67eb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:10.011487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f895bc59-3c83-407e-b451-67a1fb0c67eb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:10.012216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f895bc59-3c83-407e-b451-67a1fb0c67eb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:10.013009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f895bc59-3c83-407e-b451-67a1fb0c67eb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:10.013937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f895bc59-3c83-407e-b451-67a1fb0c67eb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:10.014567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f895bc59-3c83-407e-b451-67a1fb0c67eb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:10.015169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f895bc59-3c83-407e-b451-67a1fb0c67eb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:10.036499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88b3b4cc-86ce-4c6c-ad86-09e93edf8ca3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:10.037140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88b3b4cc-86ce-4c6c-ad86-09e93edf8ca3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:10.050137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b3b4cc-86ce-4c6c-ad86-09e93edf8ca3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:10.052215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b3b4cc-86ce-4c6c-ad86-09e93edf8ca3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:10.053664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b3b4cc-86ce-4c6c-ad86-09e93edf8ca3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:10.057354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b3b4cc-86ce-4c6c-ad86-09e93edf8ca3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:10.057675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b3b4cc-86ce-4c6c-ad86-09e93edf8ca3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:10.058156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b3b4cc-86ce-4c6c-ad86-09e93edf8ca3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:10.153437 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88b3b4cc-86ce-4c6c-ad86-09e93edf8ca3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments/8a30ff6d-0146-4a6a-bd1d-25741f2e115b" status: 200 len: 194 microversion: 2.1 time: 0.121666 Aug 09 17:53:10.159008 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3012/5762] 10.222.0.93 () {58 vars in 1413 bytes} [Tue Aug 9 17:53:10 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments/8a30ff6d-0146-4a6a-bd1d-25741f2e115b => generated 194 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:53:10.164691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-913b7646-4690-4069-ac28-01c04c21677f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:10.165732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-913b7646-4690-4069-ac28-01c04c21677f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:10.180374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913b7646-4690-4069-ac28-01c04c21677f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:10.181460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913b7646-4690-4069-ac28-01c04c21677f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:10.181915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913b7646-4690-4069-ac28-01c04c21677f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:10.182667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913b7646-4690-4069-ac28-01c04c21677f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:10.183141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913b7646-4690-4069-ac28-01c04c21677f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:10.183581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-913b7646-4690-4069-ac28-01c04c21677f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:10.477688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-913b7646-4690-4069-ac28-01c04c21677f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lazy-loading 'services' on Instance uuid 8220c359-b3b9-4af6-a8fd-ee55fb0a933b {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:53:10.525604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f895bc59-3c83-407e-b451-67a1fb0c67eb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:10.536751 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f895bc59-3c83-407e-b451-67a1fb0c67eb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 200 len: 1686 microversion: 2.1 time: 0.542507 Aug 09 17:53:10.552183 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2751/5763] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:09 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 1686 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:10.557968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ec68da4e-b797-41a7-8286-bff6ab0e4292 req-4a5546f9-7f59-4cd9-acf4-ace086f8e502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5665b6cd-9566-4f66-a66c-1f9d7c6398fd", "name": "network-vif-deleted", "tag": "561503aa-9292-4576-9663-a94424f5925d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:53:10.568573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ec68da4e-b797-41a7-8286-bff6ab0e4292 req-4a5546f9-7f59-4cd9-acf4-ace086f8e502 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:10.569185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ec68da4e-b797-41a7-8286-bff6ab0e4292 req-4a5546f9-7f59-4cd9-acf4-ace086f8e502 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:10.569777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ec68da4e-b797-41a7-8286-bff6ab0e4292 req-4a5546f9-7f59-4cd9-acf4-ace086f8e502 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:10.582833 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ec68da4e-b797-41a7-8286-bff6ab0e4292 req-4a5546f9-7f59-4cd9-acf4-ace086f8e502 service nova] Creating event network-vif-deleted:561503aa-9292-4576-9663-a94424f5925d for instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd on n-h1-845781-6 Aug 09 17:53:10.590242 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ec68da4e-b797-41a7-8286-bff6ab0e4292 req-4a5546f9-7f59-4cd9-acf4-ace086f8e502 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036563 Aug 09 17:53:10.591111 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2752/5764] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:53:10.682671 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-913b7646-4690-4069-ac28-01c04c21677f tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments/8a30ff6d-0146-4a6a-bd1d-25741f2e115b" status: 202 len: 0 microversion: 2.1 time: 0.521779 Aug 09 17:53:10.686836 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3013/5765] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:53:10 2022] DELETE /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments/8a30ff6d-0146-4a6a-bd1d-25741f2e115b => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:53:10.891469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e0a11ff-ffcd-4392-a841-c7232f74f58c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:10.892232 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0e0a11ff-ffcd-4392-a841-c7232f74f58c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:10.903904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0a11ff-ffcd-4392-a841-c7232f74f58c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:10.904641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0a11ff-ffcd-4392-a841-c7232f74f58c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:10.905244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0a11ff-ffcd-4392-a841-c7232f74f58c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:10.906241 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0a11ff-ffcd-4392-a841-c7232f74f58c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:10.906884 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0a11ff-ffcd-4392-a841-c7232f74f58c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:10.907479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e0a11ff-ffcd-4392-a841-c7232f74f58c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:11.140699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0e0a11ff-ffcd-4392-a841-c7232f74f58c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:11.150412 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e0a11ff-ffcd-4392-a841-c7232f74f58c tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1501 microversion: 2.1 time: 0.263079 Aug 09 17:53:11.157134 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2753/5766] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:10 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1501 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:11.185589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-190c010b-933b-483d-83e2-6938cc47b418 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:11.186342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-190c010b-933b-483d-83e2-6938cc47b418 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:11.193872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-190c010b-933b-483d-83e2-6938cc47b418 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:11.194768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-190c010b-933b-483d-83e2-6938cc47b418 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:11.195484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-190c010b-933b-483d-83e2-6938cc47b418 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:11.196655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-190c010b-933b-483d-83e2-6938cc47b418 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:11.197334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-190c010b-933b-483d-83e2-6938cc47b418 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:11.197928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-190c010b-933b-483d-83e2-6938cc47b418 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:11.261500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-190c010b-933b-483d-83e2-6938cc47b418 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:53:11.418271 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-190c010b-933b-483d-83e2-6938cc47b418 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 204 len: 0 microversion: 2.1 time: 0.236145 Aug 09 17:53:11.425313 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3014/5767] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:53:11 2022] DELETE /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:53:11.437994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5373a61c-ed22-4e8d-b3fe-766083bea106 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:11.441029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5373a61c-ed22-4e8d-b3fe-766083bea106 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:11.456465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5373a61c-ed22-4e8d-b3fe-766083bea106 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:11.458597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5373a61c-ed22-4e8d-b3fe-766083bea106 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:11.460066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5373a61c-ed22-4e8d-b3fe-766083bea106 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:11.463539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5373a61c-ed22-4e8d-b3fe-766083bea106 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:11.465515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5373a61c-ed22-4e8d-b3fe-766083bea106 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:11.468606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5373a61c-ed22-4e8d-b3fe-766083bea106 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:11.560904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:11.561908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 5665b6cd-9566-4f66-a66c-1f9d7c6398fd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:11.568590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:11.569357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:11.569987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:11.570888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:11.572543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:11.575263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:11.634987 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] HTTP exception thrown: Instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd could not be found. Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Request method failure captured: Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd HTTP/1.1 Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p5yR1vvXdoHF6Ye4OkNhkM0OM2jWQEtgxloVubvvpM1GvnEKWmLvq_LisffgRln3d8YjK5jNj034a5fZK1hfamQn32lQw79jkbHDA9No0pavvPRNmpI4Zrw53leLAXhgbg98UjYYgE3lTGBb7Ptu6pOydP_Ub-aqj0vIBjuHGJazf4 Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 060105d0d71644839935005af8ad1bda Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_060105d0d71644839935005af8ad1bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/060105d0d71644839935005af8ad1bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/060105d0d71644839935005af8ad1bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/060105d0d71644839935005af8ad1bda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 060105d0d71644839935005af8ad1bda Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestNetworkAdvancedServerOps-278625738-project Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a343f75165674844a2e9e46500fa01c0 Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestNetworkAdvancedServerOps-278625738-project Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd could not be found. Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '5665b6cd-9566-4f66-a66c-1f9d7c6398fd'} Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd could not be found. Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd could not be found. Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:11.666512 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:53:11.674184 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:11.674184 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:11.674184 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:53:11.674184 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:53:11.674184 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:53:11.674184 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:53:11.674184 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd could not be found. Aug 09 17:53:11.674184 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:11.674184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Returning 404 to user: Instance 5665b6cd-9566-4f66-a66c-1f9d7c6398fd could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:53:11.674184 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19b41fc6-f036-440b-bd27-b39463d0dd1e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd" status: 404 len: 111 microversion: 2.1 time: 0.112526 Aug 09 17:53:11.674184 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3015/5768] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:11 2022] GET /compute/v2.1/servers/5665b6cd-9566-4f66-a66c-1f9d7c6398fd => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:53:11.734069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5373a61c-ed22-4e8d-b3fe-766083bea106 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:11.743735 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5373a61c-ed22-4e8d-b3fe-766083bea106 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1507 microversion: 2.1 time: 0.313170 Aug 09 17:53:11.759278 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2754/5769] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:11 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:53:12.770382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d33c0e71-e56e-449d-95b0-56e94d65a1a8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:12.771027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d33c0e71-e56e-449d-95b0-56e94d65a1a8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:12.781506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d33c0e71-e56e-449d-95b0-56e94d65a1a8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:12.782012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d33c0e71-e56e-449d-95b0-56e94d65a1a8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:12.782461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d33c0e71-e56e-449d-95b0-56e94d65a1a8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:12.783208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d33c0e71-e56e-449d-95b0-56e94d65a1a8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:12.783688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d33c0e71-e56e-449d-95b0-56e94d65a1a8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:12.786107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d33c0e71-e56e-449d-95b0-56e94d65a1a8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:13.128285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d33c0e71-e56e-449d-95b0-56e94d65a1a8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:13.139192 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d33c0e71-e56e-449d-95b0-56e94d65a1a8 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1507 microversion: 2.1 time: 0.375027 Aug 09 17:53:13.139909 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3016/5770] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:12 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1507 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:14.162554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ecf2c39b-4f17-40cc-bd22-3bc0f61a6733 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:14.164390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ecf2c39b-4f17-40cc-bd22-3bc0f61a6733 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:14.177446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ecf2c39b-4f17-40cc-bd22-3bc0f61a6733 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:14.182361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ecf2c39b-4f17-40cc-bd22-3bc0f61a6733 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:14.185568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ecf2c39b-4f17-40cc-bd22-3bc0f61a6733 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:14.189532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ecf2c39b-4f17-40cc-bd22-3bc0f61a6733 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:14.190271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ecf2c39b-4f17-40cc-bd22-3bc0f61a6733 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:14.190937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ecf2c39b-4f17-40cc-bd22-3bc0f61a6733 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:15.022686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ecf2c39b-4f17-40cc-bd22-3bc0f61a6733 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:15.032363 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ecf2c39b-4f17-40cc-bd22-3bc0f61a6733 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1465 microversion: 2.1 time: 0.873504 Aug 09 17:53:15.033253 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2755/5771] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:14 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1465 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:15.246483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5febeb3a-456e-4f08-9320-c807e71ee395 req-87e78527-0205-43b0-b568-a3addf7b64d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f0cf5c-7f46-43bc-b196-50f444710563", "name": "network-vif-deleted", "tag": "7d0c9316-a5ae-46a7-a66a-eb36fb182ebf"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:53:15.350471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5febeb3a-456e-4f08-9320-c807e71ee395 req-87e78527-0205-43b0-b568-a3addf7b64d9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:15.351381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5febeb3a-456e-4f08-9320-c807e71ee395 req-87e78527-0205-43b0-b568-a3addf7b64d9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:15.362026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5febeb3a-456e-4f08-9320-c807e71ee395 req-87e78527-0205-43b0-b568-a3addf7b64d9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:15.437709 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5febeb3a-456e-4f08-9320-c807e71ee395 req-87e78527-0205-43b0-b568-a3addf7b64d9 service nova] Creating event network-vif-deleted:7d0c9316-a5ae-46a7-a66a-eb36fb182ebf for instance 46f0cf5c-7f46-43bc-b196-50f444710563 on n-h2-845781-6 Aug 09 17:53:15.465528 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5febeb3a-456e-4f08-9320-c807e71ee395 req-87e78527-0205-43b0-b568-a3addf7b64d9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222389 Aug 09 17:53:15.474915 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3017/5772] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:53:16.054769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:16.055419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:16.058868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=51 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:16.074811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:16.075698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:16.076334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:16.077296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:16.082840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:16.083652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:16.161218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:16.161717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:16.162156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:16.162620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lazy-loading 'fault' on Instance uuid 46f0cf5c-7f46-43bc-b196-50f444710563 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:53:16.289289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1766fa8dce47cda0957460c7f1d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f25245736b44c26a03b531dbc64484e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:16.321068 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4b7bb940-cdeb-4a0d-b8e9-e46b6ca60aa1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 200 len: 1305 microversion: 2.1 time: 0.270221 Aug 09 17:53:16.322221 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2756/5773] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:16 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 1305 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:53:17.385584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:17.387474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] [instance: 46f0cf5c-7f46-43bc-b196-50f444710563] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:17.402752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:17.405609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:17.407386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:17.408992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:17.410054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:17.411219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:17.450532 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] HTTP exception thrown: Instance 46f0cf5c-7f46-43bc-b196-50f444710563 could not be found. Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Request method failure captured: Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 HTTP/1.1 Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p7pcWXFgWxBBc4KkIEtljP136DBvIf3eHj1NJk7yx2qpP6IvwEiyfSI98laXV9Tw4HEVfROou2kU2howPxWroOkkv7cWyr1R0xwu9QhBcNQaSFe-qqnkL4XLmFUUCCecviG9YaYrrJj33TC_JDzoioA-Qj_E-bGkbNgpEGPY3sVcn0 Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 3f25245736b44c26a03b531dbc64484e Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestServerAdvancedOps-635645612 Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3f25245736b44c26a03b531dbc64484e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f25245736b44c26a03b531dbc64484e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f25245736b44c26a03b531dbc64484e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3f25245736b44c26a03b531dbc64484e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestServerAdvancedOps-635645612 Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 3f25245736b44c26a03b531dbc64484e Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestServerAdvancedOps-635645612 Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestServerAdvancedOps-635645612-project Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 8e1766fa8dce47cda0957460c7f1d883 Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestServerAdvancedOps-635645612-project Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 46f0cf5c-7f46-43bc-b196-50f444710563 could not be found. Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '46f0cf5c-7f46-43bc-b196-50f444710563'} Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f0cf5c-7f46-43bc-b196-50f444710563 could not be found. Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f0cf5c-7f46-43bc-b196-50f444710563 could not be found. Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:53:17.452627 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:17.456898 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:17.456898 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:53:17.456898 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:53:17.456898 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:53:17.456898 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:53:17.456898 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f0cf5c-7f46-43bc-b196-50f444710563 could not be found. Aug 09 17:53:17.456898 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:17.458300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] Returning 404 to user: Instance 46f0cf5c-7f46-43bc-b196-50f444710563 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:53:17.459428 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-261f4deb-7246-4fa3-a736-5b3dc933a0d1 tempest-TestServerAdvancedOps-635645612 tempest-TestServerAdvancedOps-635645612-project] 10.222.0.93 "GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563" status: 404 len: 111 microversion: 2.1 time: 0.119211 Aug 09 17:53:17.460490 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3018/5774] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:17 2022] GET /compute/v2.1/servers/46f0cf5c-7f46-43bc-b196-50f444710563 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:53:19.454645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7b9a6e36-77cc-4a3f-965f-e0dd66e89473 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '.version_select at 0x7fbbca5d6c10>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:19.487363 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7b9a6e36-77cc-4a3f-965f-e0dd66e89473 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1905898142" status: 202 len: 0 microversion: 2.1 time: 0.037515 Aug 09 17:53:19.488643 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2757/5775] 10.222.0.93 () {58 vars in 1284 bytes} [Tue Aug 9 17:53:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1905898142 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:53:19.531643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-759c6e1a-8324-41c8-90fb-51432126e046 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'create', calling method: .version_select at 0x7fbbca6a34c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1582999332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSDzy0Hu5bBSehYbOtn/+eNity5QJLBZLK0N71NbsjA1/Hmj94rOXgdX0bZ+7NGUVZxShqZt9cLYBNLXkKUND1PIlxPrt/BnCouT/ekltYRPRUshASKnMzNlkQwyF+f7w=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:53:19.592747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-759c6e1a-8324-41c8-90fb-51432126e046 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for project 060105d0d71644839935005af8ad1bda. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:53:19.605215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-759c6e1a-8324-41c8-90fb-51432126e046 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for user a343f75165674844a2e9e46500fa01c0 and project 060105d0d71644839935005af8ad1bda. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:53:19.640023 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-759c6e1a-8324-41c8-90fb-51432126e046 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.112228 Aug 09 17:53:19.645685 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3019/5776] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:53:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:53:20.356592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0494175b-0810-489a-b1c3-99d23eca16b7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:20.357163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0494175b-0810-489a-b1c3-99d23eca16b7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:20.377711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0494175b-0810-489a-b1c3-99d23eca16b7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:20.378231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0494175b-0810-489a-b1c3-99d23eca16b7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:20.378688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0494175b-0810-489a-b1c3-99d23eca16b7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:20.379435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0494175b-0810-489a-b1c3-99d23eca16b7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:20.379936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0494175b-0810-489a-b1c3-99d23eca16b7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:20.380382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0494175b-0810-489a-b1c3-99d23eca16b7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:20.430705 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0494175b-0810-489a-b1c3-99d23eca16b7 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments/4e168028-735b-4680-9455-f94c1c69ce89" status: 200 len: 194 microversion: 2.1 time: 0.077787 Aug 09 17:53:20.439098 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2758/5777] 10.222.0.93 () {58 vars in 1413 bytes} [Tue Aug 9 17:53:20 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments/4e168028-735b-4680-9455-f94c1c69ce89 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:53:20.442930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-92352f30-9c1e-4e68-b700-feba54d1bbb4 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:20.443454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-92352f30-9c1e-4e68-b700-feba54d1bbb4 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:20.455367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92352f30-9c1e-4e68-b700-feba54d1bbb4 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:20.456192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92352f30-9c1e-4e68-b700-feba54d1bbb4 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:20.456816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92352f30-9c1e-4e68-b700-feba54d1bbb4 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:20.457731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92352f30-9c1e-4e68-b700-feba54d1bbb4 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:20.458382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92352f30-9c1e-4e68-b700-feba54d1bbb4 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:20.458985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92352f30-9c1e-4e68-b700-feba54d1bbb4 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:20.490324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:20.601800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-92352f30-9c1e-4e68-b700-feba54d1bbb4 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lazy-loading 'services' on Instance uuid 8220c359-b3b9-4af6-a8fd-ee55fb0a933b {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:53:20.782220 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-92352f30-9c1e-4e68-b700-feba54d1bbb4 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments/4e168028-735b-4680-9455-f94c1c69ce89" status: 202 len: 0 microversion: 2.1 time: 0.343256 Aug 09 17:53:20.783545 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3020/5778] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 17:53:20 2022] DELETE /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments/4e168028-735b-4680-9455-f94c1c69ce89 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:53:30.467420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:30.470121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=40 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:30.498648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-325d144d-df43-4537-857f-b8d3d13a1b31 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:30.514016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-325d144d-df43-4537-857f-b8d3d13a1b31 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:30.534537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-325d144d-df43-4537-857f-b8d3d13a1b31 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:30.536344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-325d144d-df43-4537-857f-b8d3d13a1b31 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:30.541842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-325d144d-df43-4537-857f-b8d3d13a1b31 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:30.542726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-325d144d-df43-4537-857f-b8d3d13a1b31 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:30.543341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-325d144d-df43-4537-857f-b8d3d13a1b31 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:30.543944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-325d144d-df43-4537-857f-b8d3d13a1b31 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:30.624359 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-325d144d-df43-4537-857f-b8d3d13a1b31 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.166207 Aug 09 17:53:30.647973 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2759/5779] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:53:30 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments => generated 25 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:53:30.875415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a7264792-478f-449a-ab47-b51e409a1840 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:30.880531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a7264792-478f-449a-ab47-b51e409a1840 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:30.886561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:30.888795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:30.890243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=7,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:30.896360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7264792-478f-449a-ab47-b51e409a1840 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:30.898262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7264792-478f-449a-ab47-b51e409a1840 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:30.899253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7264792-478f-449a-ab47-b51e409a1840 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:30.900750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7264792-478f-449a-ab47-b51e409a1840 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:30.901743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7264792-478f-449a-ab47-b51e409a1840 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:30.902548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7264792-478f-449a-ab47-b51e409a1840 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:30.965952 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a7264792-478f-449a-ab47-b51e409a1840 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091769 Aug 09 17:53:30.972040 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3021/5780] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 17:53:30 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:53:31.045055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e50abd6a-5b97-494b-bccc-9702db7dcffc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:31.045954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e50abd6a-5b97-494b-bccc-9702db7dcffc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:31.052922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e50abd6a-5b97-494b-bccc-9702db7dcffc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:31.053855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e50abd6a-5b97-494b-bccc-9702db7dcffc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:31.054708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e50abd6a-5b97-494b-bccc-9702db7dcffc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:31.055817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e50abd6a-5b97-494b-bccc-9702db7dcffc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:31.056584 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e50abd6a-5b97-494b-bccc-9702db7dcffc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:31.057235 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e50abd6a-5b97-494b-bccc-9702db7dcffc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:31.093719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e50abd6a-5b97-494b-bccc-9702db7dcffc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:53:31.266460 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e50abd6a-5b97-494b-bccc-9702db7dcffc tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 204 len: 0 microversion: 2.1 time: 0.225564 Aug 09 17:53:31.275119 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2760/5781] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:53:31 2022] DELETE /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:53:31.279826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c509c96-e968-47bf-9c0c-3c1767f19b67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:31.280467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c509c96-e968-47bf-9c0c-3c1767f19b67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:31.288203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c509c96-e968-47bf-9c0c-3c1767f19b67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:31.288712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c509c96-e968-47bf-9c0c-3c1767f19b67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:31.291908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c509c96-e968-47bf-9c0c-3c1767f19b67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:31.292679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c509c96-e968-47bf-9c0c-3c1767f19b67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:31.293318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c509c96-e968-47bf-9c0c-3c1767f19b67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:31.295728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c509c96-e968-47bf-9c0c-3c1767f19b67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:31.795864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c509c96-e968-47bf-9c0c-3c1767f19b67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:31.808424 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c509c96-e968-47bf-9c0c-3c1767f19b67 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1670 microversion: 2.1 time: 0.532464 Aug 09 17:53:31.816550 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3022/5782] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:31 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1670 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:32.840979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6dfd9944-6662-468e-8694-818f15c3c57b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:32.841684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6dfd9944-6662-468e-8694-818f15c3c57b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:32.860674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfd9944-6662-468e-8694-818f15c3c57b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:32.862007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfd9944-6662-468e-8694-818f15c3c57b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:32.862792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfd9944-6662-468e-8694-818f15c3c57b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:32.868727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfd9944-6662-468e-8694-818f15c3c57b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:32.871944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfd9944-6662-468e-8694-818f15c3c57b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:32.872432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6dfd9944-6662-468e-8694-818f15c3c57b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:34.757469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6dfd9944-6662-468e-8694-818f15c3c57b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:34.765859 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6dfd9944-6662-468e-8694-818f15c3c57b tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1670 microversion: 2.1 time: 1.931697 Aug 09 17:53:34.770856 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2761/5783] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:32 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1670 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:35.120145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1275083079", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "32cd4d5d-e1e0-4ff9-9f1c-780bce78d295"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1582999332", "security_groups": [{"name": "tempest-secgroup-smoke-1413617037"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:53:35.687209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] validate_networks() for [('32cd4d5d-e1e0-4ff9-9f1c-780bce78d295', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:53:35.795735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-150183b5-b341-4126-a94c-6e667c65ac64 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:35.797189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-150183b5-b341-4126-a94c-6e667c65ac64 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:35.821028 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150183b5-b341-4126-a94c-6e667c65ac64 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:35.822164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150183b5-b341-4126-a94c-6e667c65ac64 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:35.823474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150183b5-b341-4126-a94c-6e667c65ac64 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:35.826556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150183b5-b341-4126-a94c-6e667c65ac64 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:35.827430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150183b5-b341-4126-a94c-6e667c65ac64 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:35.830707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-150183b5-b341-4126-a94c-6e667c65ac64 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:36.152956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-150183b5-b341-4126-a94c-6e667c65ac64 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:36.172368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-150183b5-b341-4126-a94c-6e667c65ac64 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1604 microversion: 2.1 time: 0.382780 Aug 09 17:53:36.176113 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2762/5784] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:35 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1604 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:37.195348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-64ad1c23-41c6-415b-9e4d-251e6b30e4a1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:37.196800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-64ad1c23-41c6-415b-9e4d-251e6b30e4a1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:37.218552 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64ad1c23-41c6-415b-9e4d-251e6b30e4a1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:37.219325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64ad1c23-41c6-415b-9e4d-251e6b30e4a1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:37.219980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64ad1c23-41c6-415b-9e4d-251e6b30e4a1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:37.221098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64ad1c23-41c6-415b-9e4d-251e6b30e4a1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:37.221756 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64ad1c23-41c6-415b-9e4d-251e6b30e4a1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:37.222367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-64ad1c23-41c6-415b-9e4d-251e6b30e4a1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:37.381638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-64ad1c23-41c6-415b-9e4d-251e6b30e4a1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8a42d2fc848d4a6badae1b1e0a387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1b430bf48d450e88109a61dd2865df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:37.398568 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-64ad1c23-41c6-415b-9e4d-251e6b30e4a1 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 200 len: 1604 microversion: 2.1 time: 0.207661 Aug 09 17:53:37.399816 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2763/5785] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:37 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 1604 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:37.497295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a97160a9-35bc-4b0d-ae0a-a92c4613f4ed req-1c6211e6-e974-45b2-aace-244248b14dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8220c359-b3b9-4af6-a8fd-ee55fb0a933b", "name": "network-vif-deleted", "tag": "92cc5489-7651-4ff7-9f3e-0f848c606d95"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:53:37.513465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a97160a9-35bc-4b0d-ae0a-a92c4613f4ed req-1c6211e6-e974-45b2-aace-244248b14dd2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:37.521583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a97160a9-35bc-4b0d-ae0a-a92c4613f4ed req-1c6211e6-e974-45b2-aace-244248b14dd2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:37.522372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a97160a9-35bc-4b0d-ae0a-a92c4613f4ed req-1c6211e6-e974-45b2-aace-244248b14dd2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:37.561999 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a97160a9-35bc-4b0d-ae0a-a92c4613f4ed req-1c6211e6-e974-45b2-aace-244248b14dd2 service nova] Creating event network-vif-deleted:92cc5489-7651-4ff7-9f3e-0f848c606d95 for instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b on n-h1-845781-6 Aug 09 17:53:37.569356 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a97160a9-35bc-4b0d-ae0a-a92c4613f4ed req-1c6211e6-e974-45b2-aace-244248b14dd2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076095 Aug 09 17:53:37.570265 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2764/5786] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:53:37.749767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:53:37.750438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:53:37.750743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:53:37.751342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:53:37.751954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:53:37.772631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:37.773450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:37.780075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:37.781324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:37.782013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:37.782647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:37.866280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for project 060105d0d71644839935005af8ad1bda. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:53:37.880712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for user a343f75165674844a2e9e46500fa01c0 and project 060105d0d71644839935005af8ad1bda. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:53:37.935125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:53:37.939557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:53:38.102897 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-39248095-206c-4b70-9231-1e2267f9dcc8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.987030 Aug 09 17:53:38.117767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-648d8a7b-374e-4ab7-b376-14b2312c2aa8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:38.118862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-648d8a7b-374e-4ab7-b376-14b2312c2aa8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:38.124188 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3023/5787] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:53:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 3009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:53:38.384247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-648d8a7b-374e-4ab7-b376-14b2312c2aa8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:38.406370 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-648d8a7b-374e-4ab7-b376-14b2312c2aa8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1267 microversion: 2.1 time: 0.293352 Aug 09 17:53:38.432498 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2765/5788] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:38 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1267 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:38.433385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:38.439181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:38.488187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:38.489439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:38.492424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:38.504255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:38.505600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:38.510104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:38.659648 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] HTTP exception thrown: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Request method failure captured: Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b HTTP/1.1 Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p2v6HTFCBqHT_PRF032zDn64is1pv2whWSV2XzAaFQhbmfcw4yaJwL5EX1TNB-INQchWk8vsL7gedvav_d6wJ7qMA866G4auOrHxCaTuCQj3nR-TuGp22RDPrsF-dijGJQ0wWLamUy6woxwe2f60tbwTgkqCjZwnWOsqCZ9fHRx2XM Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a1c8a42d2fc848d4a6badae1b1e0a387 Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8220c359-b3b9-4af6-a8fd-ee55fb0a933b'} Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:53:38.679426 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:38.683889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:38.683889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:53:38.683889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:53:38.683889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:53:38.683889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:53:38.683889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:38.683889 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:38.683889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Returning 404 to user: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:53:38.683889 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7a0fdc09-ace4-4fbc-8510-13af7fd011ed tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 404 len: 111 microversion: 2.1 time: 0.262874 Aug 09 17:53:38.694561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-101dfe91-0e15-4a20-ad02-984a294b706c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '.version_select at 0x7fbbca308ca0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:38.706858 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3024/5789] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:38 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 111 bytes in 288 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:53:38.752663 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-101dfe91-0e15-4a20-ad02-984a294b706c tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446274582" status: 202 len: 0 microversion: 2.1 time: 0.062096 Aug 09 17:53:38.753871 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2766/5790] 10.222.0.93 () {58 vars in 1221 bytes} [Tue Aug 9 17:53:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446274582 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:53:39.433073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1726480-a789-4931-872f-b9e1f1b57cda tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:39.434287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e1726480-a789-4931-872f-b9e1f1b57cda tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:39.761929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e1726480-a789-4931-872f-b9e1f1b57cda tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:39.790412 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1726480-a789-4931-872f-b9e1f1b57cda tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1267 microversion: 2.1 time: 0.363992 Aug 09 17:53:39.791336 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3025/5791] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:39 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1267 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:40.837393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-54474de5-baab-41dd-8132-0e11f1f41bbb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:40.838799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-54474de5-baab-41dd-8132-0e11f1f41bbb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:40.863404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54474de5-baab-41dd-8132-0e11f1f41bbb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:40.867351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54474de5-baab-41dd-8132-0e11f1f41bbb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:40.871763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54474de5-baab-41dd-8132-0e11f1f41bbb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:40.876814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54474de5-baab-41dd-8132-0e11f1f41bbb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:40.880211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54474de5-baab-41dd-8132-0e11f1f41bbb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:40.881122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-54474de5-baab-41dd-8132-0e11f1f41bbb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:41.201430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-54474de5-baab-41dd-8132-0e11f1f41bbb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:41.215559 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-54474de5-baab-41dd-8132-0e11f1f41bbb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1319 microversion: 2.1 time: 0.385449 Aug 09 17:53:41.220089 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2767/5792] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:40 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:42.254920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2d987e3b-2369-45c7-8374-8a30ed7ccc65 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:42.255652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2d987e3b-2369-45c7-8374-8a30ed7ccc65 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:42.273340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d987e3b-2369-45c7-8374-8a30ed7ccc65 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:42.273753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d987e3b-2369-45c7-8374-8a30ed7ccc65 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:42.274201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d987e3b-2369-45c7-8374-8a30ed7ccc65 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:42.274945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d987e3b-2369-45c7-8374-8a30ed7ccc65 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:42.275411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d987e3b-2369-45c7-8374-8a30ed7ccc65 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:42.275872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d987e3b-2369-45c7-8374-8a30ed7ccc65 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:42.465968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2d987e3b-2369-45c7-8374-8a30ed7ccc65 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:42.483081 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2d987e3b-2369-45c7-8374-8a30ed7ccc65 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1325 microversion: 2.1 time: 0.232833 Aug 09 17:53:42.501006 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3026/5793] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:42 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1325 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:43.529414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7579bceb-3786-4410-839f-fa5d3ffaa140 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:43.543400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7579bceb-3786-4410-839f-fa5d3ffaa140 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:43.601397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7579bceb-3786-4410-839f-fa5d3ffaa140 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:43.604112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7579bceb-3786-4410-839f-fa5d3ffaa140 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:43.604787 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7579bceb-3786-4410-839f-fa5d3ffaa140 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:43.606674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7579bceb-3786-4410-839f-fa5d3ffaa140 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:43.608864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7579bceb-3786-4410-839f-fa5d3ffaa140 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:43.609622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7579bceb-3786-4410-839f-fa5d3ffaa140 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:43.853448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7579bceb-3786-4410-839f-fa5d3ffaa140 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:43.873783 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7579bceb-3786-4410-839f-fa5d3ffaa140 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1325 microversion: 2.1 time: 0.359341 Aug 09 17:53:43.877089 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2768/5794] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:43 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1325 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:44.920443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d71bec60-d045-4f56-8cf2-ba7f24c0aea0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:44.921480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d71bec60-d045-4f56-8cf2-ba7f24c0aea0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:44.939798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71bec60-d045-4f56-8cf2-ba7f24c0aea0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:44.940531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71bec60-d045-4f56-8cf2-ba7f24c0aea0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:44.944417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71bec60-d045-4f56-8cf2-ba7f24c0aea0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:44.948485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71bec60-d045-4f56-8cf2-ba7f24c0aea0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:44.952880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71bec60-d045-4f56-8cf2-ba7f24c0aea0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:44.956782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d71bec60-d045-4f56-8cf2-ba7f24c0aea0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:45.725538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d71bec60-d045-4f56-8cf2-ba7f24c0aea0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:45.739991 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d71bec60-d045-4f56-8cf2-ba7f24c0aea0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1393 microversion: 2.1 time: 0.823785 Aug 09 17:53:45.745048 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3027/5795] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:44 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1393 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:46.765695 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5250c664-3bfd-4146-a0db-9cad3deb6381 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:46.775462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5250c664-3bfd-4146-a0db-9cad3deb6381 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:46.793762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5250c664-3bfd-4146-a0db-9cad3deb6381 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:46.797417 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5250c664-3bfd-4146-a0db-9cad3deb6381 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:46.798157 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5250c664-3bfd-4146-a0db-9cad3deb6381 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:46.799104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5250c664-3bfd-4146-a0db-9cad3deb6381 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:46.804179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5250c664-3bfd-4146-a0db-9cad3deb6381 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:46.805730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5250c664-3bfd-4146-a0db-9cad3deb6381 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:47.630342 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5250c664-3bfd-4146-a0db-9cad3deb6381 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:47.639763 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5250c664-3bfd-4146-a0db-9cad3deb6381 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1393 microversion: 2.1 time: 0.877994 Aug 09 17:53:47.653949 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2769/5796] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:46 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1393 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:53:48.039703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1dd5deed-a90b-43be-b39c-03188df7b22f req-50d35996-0d3a-4331-bdf6-27aa04d1ccd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3ac82a-2978-42ba-a133-a5db20652f5d", "tag": "b09f6bbd-ae75-4189-b58f-5b1f600d8c2b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:53:48.062557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:48.077422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1dd5deed-a90b-43be-b39c-03188df7b22f req-50d35996-0d3a-4331-bdf6-27aa04d1ccd4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:48.081776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1dd5deed-a90b-43be-b39c-03188df7b22f req-50d35996-0d3a-4331-bdf6-27aa04d1ccd4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:48.082390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1dd5deed-a90b-43be-b39c-03188df7b22f req-50d35996-0d3a-4331-bdf6-27aa04d1ccd4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:48.126221 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1dd5deed-a90b-43be-b39c-03188df7b22f req-50d35996-0d3a-4331-bdf6-27aa04d1ccd4 service nova] Creating event network-changed:b09f6bbd-ae75-4189-b58f-5b1f600d8c2b for instance af3ac82a-2978-42ba-a133-a5db20652f5d on n-h1-845781-6 Aug 09 17:53:48.158760 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1dd5deed-a90b-43be-b39c-03188df7b22f req-50d35996-0d3a-4331-bdf6-27aa04d1ccd4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105105 Aug 09 17:53:48.172376 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3028/5797] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:53:48.660424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-76823f0a-1c48-4566-a924-abc4b1df40a3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:48.661760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-76823f0a-1c48-4566-a924-abc4b1df40a3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:48.669406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:48.692303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76823f0a-1c48-4566-a924-abc4b1df40a3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:48.692830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76823f0a-1c48-4566-a924-abc4b1df40a3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:48.693288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76823f0a-1c48-4566-a924-abc4b1df40a3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:48.701755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76823f0a-1c48-4566-a924-abc4b1df40a3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:48.702290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76823f0a-1c48-4566-a924-abc4b1df40a3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:48.702754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-76823f0a-1c48-4566-a924-abc4b1df40a3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:49.395864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-76823f0a-1c48-4566-a924-abc4b1df40a3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:49.416647 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-76823f0a-1c48-4566-a924-abc4b1df40a3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1393 microversion: 2.1 time: 0.756128 Aug 09 17:53:49.417322 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2770/5798] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:48 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1393 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:50.441008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:53:50.484707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6212f144-5c7d-4f63-9bbc-9e5a1e5fd60b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:50.486162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6212f144-5c7d-4f63-9bbc-9e5a1e5fd60b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:50.525129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6212f144-5c7d-4f63-9bbc-9e5a1e5fd60b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:50.537587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6212f144-5c7d-4f63-9bbc-9e5a1e5fd60b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:50.546897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6212f144-5c7d-4f63-9bbc-9e5a1e5fd60b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:50.548702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6212f144-5c7d-4f63-9bbc-9e5a1e5fd60b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:50.560663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6212f144-5c7d-4f63-9bbc-9e5a1e5fd60b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:50.562451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6212f144-5c7d-4f63-9bbc-9e5a1e5fd60b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:51.805734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6212f144-5c7d-4f63-9bbc-9e5a1e5fd60b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:51.829792 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6212f144-5c7d-4f63-9bbc-9e5a1e5fd60b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1393 microversion: 2.1 time: 1.391273 Aug 09 17:53:51.841448 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3029/5799] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:50 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1393 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:52.873665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a6f128ab-93a7-4a02-bdb0-8700fdd30437 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:52.874393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a6f128ab-93a7-4a02-bdb0-8700fdd30437 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:52.897077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6f128ab-93a7-4a02-bdb0-8700fdd30437 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:52.897780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6f128ab-93a7-4a02-bdb0-8700fdd30437 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:52.898836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6f128ab-93a7-4a02-bdb0-8700fdd30437 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:52.902685 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6f128ab-93a7-4a02-bdb0-8700fdd30437 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:52.904624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6f128ab-93a7-4a02-bdb0-8700fdd30437 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:52.909168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a6f128ab-93a7-4a02-bdb0-8700fdd30437 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:54.583934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a6f128ab-93a7-4a02-bdb0-8700fdd30437 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:54.602464 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a6f128ab-93a7-4a02-bdb0-8700fdd30437 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1393 microversion: 2.1 time: 1.733830 Aug 09 17:53:54.612524 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2771/5800] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:52 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1393 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:53:55.631604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1569c01d-cdad-47ab-873a-6d63e876e0ee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:55.633314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1569c01d-cdad-47ab-873a-6d63e876e0ee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:55.662480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1569c01d-cdad-47ab-873a-6d63e876e0ee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:55.664439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1569c01d-cdad-47ab-873a-6d63e876e0ee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:55.671228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1569c01d-cdad-47ab-873a-6d63e876e0ee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:55.672123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1569c01d-cdad-47ab-873a-6d63e876e0ee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:55.672743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1569c01d-cdad-47ab-873a-6d63e876e0ee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:55.673191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1569c01d-cdad-47ab-873a-6d63e876e0ee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:56.058018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1569c01d-cdad-47ab-873a-6d63e876e0ee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:56.067694 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1569c01d-cdad-47ab-873a-6d63e876e0ee tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1393 microversion: 2.1 time: 0.440946 Aug 09 17:53:56.068716 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3030/5801] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:55 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1393 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:53:57.114136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bd4eac70-1f36-40a5-bf24-58148ea72231 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:57.114952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bd4eac70-1f36-40a5-bf24-58148ea72231 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:57.127218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd4eac70-1f36-40a5-bf24-58148ea72231 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:57.131054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd4eac70-1f36-40a5-bf24-58148ea72231 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:57.133238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd4eac70-1f36-40a5-bf24-58148ea72231 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:57.134464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd4eac70-1f36-40a5-bf24-58148ea72231 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:57.141440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd4eac70-1f36-40a5-bf24-58148ea72231 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:57.142284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bd4eac70-1f36-40a5-bf24-58148ea72231 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:57.954325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:57.954858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:57.964942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:57.965446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:57.965978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:57.973823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:57.974693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:57.975150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:58.026771 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] HTTP exception thrown: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Request method failure captured: Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b HTTP/1.1 Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p2v6HTFCBqHT_PRF032zDn64is1pv2whWSV2XzAaFQhbmfcw4yaJwL5EX1TNB-INQchWk8vsL7gedvav_d6wJ7qMA866G4auOrHxCaTuCQj3nR-TuGp22RDPrsF-dijGJQ0wWLamUy6woxwe2f60tbwTgkqCjZwnWOsqCZ9fHRx2XM Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a1c8a42d2fc848d4a6badae1b1e0a387 Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8220c359-b3b9-4af6-a8fd-ee55fb0a933b'} Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:53:58.029360 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:58.035867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Returning 404 to user: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:53:58.039925 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f8b66d27-1db6-4b7b-a98a-7c4f9ee89572 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 404 len: 111 microversion: 2.1 time: 0.087533 Aug 09 17:53:58.052431 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3031/5802] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:53:57 2022] DELETE /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:53:58.062487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:58.064261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 8220c359-b3b9-4af6-a8fd-ee55fb0a933b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:58.086259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:58.091846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:58.092908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:58.095219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:58.096061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:58.096788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:58.121653 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] HTTP exception thrown: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Request method failure captured: Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b HTTP/1.1 Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p2v6HTFCBqHT_PRF032zDn64is1pv2whWSV2XzAaFQhbmfcw4yaJwL5EX1TNB-INQchWk8vsL7gedvav_d6wJ7qMA866G4auOrHxCaTuCQj3nR-TuGp22RDPrsF-dijGJQ0wWLamUy6woxwe2f60tbwTgkqCjZwnWOsqCZ9fHRx2XM Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a1c8a42d2fc848d4a6badae1b1e0a387 Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8220c359-b3b9-4af6-a8fd-ee55fb0a933b'} Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:53:58.123938 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:58.127684 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:53:58.127684 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:53:58.127684 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:53:58.127684 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:53:58.127684 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:53:58.127684 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. Aug 09 17:53:58.127684 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:53:58.134154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Returning 404 to user: Instance 8220c359-b3b9-4af6-a8fd-ee55fb0a933b could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:53:58.135714 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-760c8065-3810-4515-9365-faf8e34225e3 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b" status: 404 len: 111 microversion: 2.1 time: 0.081284 Aug 09 17:53:58.140313 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3032/5803] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:58 2022] GET /compute/v2.1/servers/8220c359-b3b9-4af6-a8fd-ee55fb0a933b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:53:58.214362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bd4eac70-1f36-40a5-bf24-58148ea72231 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:58.266310 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bd4eac70-1f36-40a5-bf24-58148ea72231 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1393 microversion: 2.1 time: 1.158487 Aug 09 17:53:58.271791 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2772/5804] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:57 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1393 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:53:59.306119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ceace44c-dab6-4d03-abec-308b7aef988d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:53:59.312679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ceace44c-dab6-4d03-abec-308b7aef988d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:53:59.341442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ceace44c-dab6-4d03-abec-308b7aef988d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:59.343164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ceace44c-dab6-4d03-abec-308b7aef988d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:59.344431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ceace44c-dab6-4d03-abec-308b7aef988d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:59.346529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ceace44c-dab6-4d03-abec-308b7aef988d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:53:59.349254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ceace44c-dab6-4d03-abec-308b7aef988d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:53:59.350798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ceace44c-dab6-4d03-abec-308b7aef988d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:53:59.865061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ceace44c-dab6-4d03-abec-308b7aef988d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:53:59.892793 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ceace44c-dab6-4d03-abec-308b7aef988d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1393 microversion: 2.1 time: 0.594884 Aug 09 17:53:59.896223 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3033/5805] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:53:59 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1393 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:00.902069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-77e33ccb-f216-4f7d-a1e5-f144a52199c1 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:00.903695 n-d-845781-6 devstack@n-api.service[119432]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 17:54:00.903695 n-d-845781-6 devstack@n-api.service[119432]: warnings.warn(msg) Aug 09 17:54:00.905408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77e33ccb-f216-4f7d-a1e5-f144a52199c1 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:00.909263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77e33ccb-f216-4f7d-a1e5-f144a52199c1 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:00.910768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77e33ccb-f216-4f7d-a1e5-f144a52199c1 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:00.911928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77e33ccb-f216-4f7d-a1e5-f144a52199c1 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:00.915721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77e33ccb-f216-4f7d-a1e5-f144a52199c1 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:00.916394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77e33ccb-f216-4f7d-a1e5-f144a52199c1 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:00.919456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-78609a24-e176-4385-9a8a-d259ecc699ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:00.920883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-78609a24-e176-4385-9a8a-d259ecc699ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:00.924489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:00.928950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:00.952745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78609a24-e176-4385-9a8a-d259ecc699ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:00.957949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78609a24-e176-4385-9a8a-d259ecc699ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:00.958929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78609a24-e176-4385-9a8a-d259ecc699ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:00.960232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78609a24-e176-4385-9a8a-d259ecc699ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:00.961548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78609a24-e176-4385-9a8a-d259ecc699ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:00.962518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-78609a24-e176-4385-9a8a-d259ecc699ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:01.004897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:01.037607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=53 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:01.074392 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-77e33ccb-f216-4f7d-a1e5-f144a52199c1 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.624227 Aug 09 17:54:01.075754 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2773/5806] 10.222.0.93 () {58 vars in 1185 bytes} [Tue Aug 9 17:54:00 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:01.386653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2036182013", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "availability_zone": "nova:n-h1-845781-6", "networks": [{"uuid": "5d8b1c8b-de89-498f-9561-fe7d5f26f96b"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:01.453452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-78609a24-e176-4385-9a8a-d259ecc699ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:01.481551 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-78609a24-e176-4385-9a8a-d259ecc699ab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1393 microversion: 2.1 time: 0.566133 Aug 09 17:54:01.482655 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3034/5807] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:00 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1393 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:01.559605 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] validate_networks() for [('5d8b1c8b-de89-498f-9561-fe7d5f26f96b', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:54:02.517925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b4e8f213-e6d4-4674-a639-e986c4e060fc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:02.519071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4e8f213-e6d4-4674-a639-e986c4e060fc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:02.535042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8f213-e6d4-4674-a639-e986c4e060fc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:02.545231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8f213-e6d4-4674-a639-e986c4e060fc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:02.546903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8f213-e6d4-4674-a639-e986c4e060fc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:02.548010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8f213-e6d4-4674-a639-e986c4e060fc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:02.558498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8f213-e6d4-4674-a639-e986c4e060fc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:02.572298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8f213-e6d4-4674-a639-e986c4e060fc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:02.612426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:54:02.612942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:54:02.613594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:54:02.614123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:54:02.614648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:54:02.625485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:02.626258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:02.626904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:02.628495 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:02.629207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:02.629858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:02.684120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Getting quotas for project fbca5a4d51724a94909affa4bb8cc5b6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:54:02.698027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Getting quotas for user 458fbfd265da4df0897eb9a075e548fb and project fbca5a4d51724a94909affa4bb8cc5b6. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:54:02.747381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:54:02.751410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:54:02.960863 n-d-845781-6 devstack@n-api.service[119432]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [f16fc364-b9b3-4351-a431-d2fb5d977256] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 17:54:03.070853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b4e8f213-e6d4-4674-a639-e986c4e060fc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:03.091160 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b4e8f213-e6d4-4674-a639-e986c4e060fc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1393 microversion: 2.1 time: 0.577996 Aug 09 17:54:03.092864 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3035/5808] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:02 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1393 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:03.102874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a5b574e1-1e47-4eed-ac09-916591dae31a req-3dc50078-2b17-4c41-8e86-02112a79d8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3ac82a-2978-42ba-a133-a5db20652f5d", "name": "network-vif-plugged", "status": "completed", "tag": "b09f6bbd-ae75-4189-b58f-5b1f600d8c2b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:03.131951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a5b574e1-1e47-4eed-ac09-916591dae31a req-3dc50078-2b17-4c41-8e86-02112a79d8d4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:03.132917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a5b574e1-1e47-4eed-ac09-916591dae31a req-3dc50078-2b17-4c41-8e86-02112a79d8d4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:03.133659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a5b574e1-1e47-4eed-ac09-916591dae31a req-3dc50078-2b17-4c41-8e86-02112a79d8d4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:03.172422 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a5b574e1-1e47-4eed-ac09-916591dae31a req-3dc50078-2b17-4c41-8e86-02112a79d8d4 service nova] Creating event network-vif-plugged:b09f6bbd-ae75-4189-b58f-5b1f600d8c2b for instance af3ac82a-2978-42ba-a133-a5db20652f5d on n-h1-845781-6 Aug 09 17:54:03.179603 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a5b574e1-1e47-4eed-ac09-916591dae31a req-3dc50078-2b17-4c41-8e86-02112a79d8d4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084800 Aug 09 17:54:03.187119 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3036/5809] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:03.978095 n-d-845781-6 devstack@n-api.service[119432]: INFO oslo.messaging._drivers.impl_rabbit [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [f16fc364-b9b3-4351-a431-d2fb5d977256] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 54010. Aug 09 17:54:03.988368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dffd7de6-7bfb-4b26-a570-e75fb4b70297 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.606580 Aug 09 17:54:03.990248 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2774/5810] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:54:04.001591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2322692d-801c-4e7b-890e-14984440e546 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:04.005488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2322692d-801c-4e7b-890e-14984440e546 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:04.239747 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2322692d-801c-4e7b-890e-14984440e546 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1329 microversion: 2.1 time: 0.242641 Aug 09 17:54:04.241170 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3037/5811] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:03 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1329 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:04.247464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b65758d2-bdbf-4431-baaa-2c3d2563ee11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:04.248742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b65758d2-bdbf-4431-baaa-2c3d2563ee11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:04.257652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b65758d2-bdbf-4431-baaa-2c3d2563ee11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:04.258375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b65758d2-bdbf-4431-baaa-2c3d2563ee11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:04.258992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b65758d2-bdbf-4431-baaa-2c3d2563ee11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:04.260328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b65758d2-bdbf-4431-baaa-2c3d2563ee11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:04.260993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b65758d2-bdbf-4431-baaa-2c3d2563ee11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:04.261586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b65758d2-bdbf-4431-baaa-2c3d2563ee11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:04.282158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8af2d81c-36ba-4e12-a6d1-30fcc1de4972 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Action: 'create', calling method: .version_select at 0x7fbbca5d6a60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-205899550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEm2amZA9uSCyAu3p1uGwMdhJZrwHF7zRnZnpFDGib8X1F6FQCThrOXMf/A/b9FCiL85PKPrrBxs935zZqczzxpEtPomQfteMW0cHwxRJIErqfONxaMgogdCtEnJ5/19HQ=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:04.306124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8af2d81c-36ba-4e12-a6d1-30fcc1de4972 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Getting quotas for project 349a4820ebe9411aada660b43cceade9. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:54:04.313771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8af2d81c-36ba-4e12-a6d1-30fcc1de4972 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Getting quotas for user 61b265fe840b4375818c363ec32ff68e and project 349a4820ebe9411aada660b43cceade9. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:54:04.389502 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8af2d81c-36ba-4e12-a6d1-30fcc1de4972 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.386078 Aug 09 17:54:04.393241 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2775/5812] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:54:04 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:04.457053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b65758d2-bdbf-4431-baaa-2c3d2563ee11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:04.472304 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b65758d2-bdbf-4431-baaa-2c3d2563ee11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1393 microversion: 2.1 time: 0.229498 Aug 09 17:54:04.474835 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3038/5813] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:04 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1393 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:05.275529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:05.276361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:05.277542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e0a9898d-d4d7-425a-bca3-a31c6713fed9 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:05.278763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e0a9898d-d4d7-425a-bca3-a31c6713fed9 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:05.295369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:05.297288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:05.298350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:05.302164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:05.302879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:05.304046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0a9898d-d4d7-425a-bca3-a31c6713fed9 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:05.304831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:05.304950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0a9898d-d4d7-425a-bca3-a31c6713fed9 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:05.308071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0a9898d-d4d7-425a-bca3-a31c6713fed9 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:05.313599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0a9898d-d4d7-425a-bca3-a31c6713fed9 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:05.316563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0a9898d-d4d7-425a-bca3-a31c6713fed9 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:05.320672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e0a9898d-d4d7-425a-bca3-a31c6713fed9 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:05.368912 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] HTTP exception thrown: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Request method failure captured: Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e HTTP/1.1 Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p2v6HTFCBqHT_PRF032zDn64is1pv2whWSV2XzAaFQhbmfcw4yaJwL5EX1TNB-INQchWk8vsL7gedvav_d6wJ7qMA866G4auOrHxCaTuCQj3nR-TuGp22RDPrsF-dijGJQ0wWLamUy6woxwe2f60tbwTgkqCjZwnWOsqCZ9fHRx2XM Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a1c8a42d2fc848d4a6badae1b1e0a387 Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '925758f3-e4b4-44d9-941d-d10ba53df59e'} Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:54:05.371255 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:54:05.375305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:54:05.375305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:05.375305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:05.375305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:05.375305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:05.375305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:05.375305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:05.375305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:54:05.375305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:54:05.375305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:54:05.375305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:05.376481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Returning 404 to user: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:54:05.379446 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-480bf56a-0de7-4914-9897-f420f4c282e2 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "DELETE /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 404 len: 111 microversion: 2.1 time: 0.107993 Aug 09 17:54:05.380696 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3039/5814] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:54:05 2022] DELETE /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:54:05.391561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:05.392726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] [instance: 925758f3-e4b4-44d9-941d-d10ba53df59e] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:05.415950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:05.416953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:05.418884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:05.420546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:05.423438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:05.424289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:05.465064 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] HTTP exception thrown: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Request method failure captured: Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e HTTP/1.1 Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p2v6HTFCBqHT_PRF032zDn64is1pv2whWSV2XzAaFQhbmfcw4yaJwL5EX1TNB-INQchWk8vsL7gedvav_d6wJ7qMA866G4auOrHxCaTuCQj3nR-TuGp22RDPrsF-dijGJQ0wWLamUy6woxwe2f60tbwTgkqCjZwnWOsqCZ9fHRx2XM Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0c1b430bf48d450e88109a61dd2865df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 0c1b430bf48d450e88109a61dd2865df Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20019072 Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a1c8a42d2fc848d4a6badae1b1e0a387 Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-AttachVolumeTestJSON-20019072-project Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '925758f3-e4b4-44d9-941d-d10ba53df59e'} Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:05.467231 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:05.470762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:05.470762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:05.470762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:05.470762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:54:05.470762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:54:05.470762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. Aug 09 17:54:05.470762 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:05.473692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] Returning 404 to user: Instance 925758f3-e4b4-44d9-941d-d10ba53df59e could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:54:05.474880 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51e83527-767a-4366-bd42-73c57204d718 tempest-AttachVolumeTestJSON-20019072 tempest-AttachVolumeTestJSON-20019072-project] 10.222.0.93 "GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e" status: 404 len: 111 microversion: 2.1 time: 0.089941 Aug 09 17:54:05.476179 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3040/5815] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:05 2022] GET /compute/v2.1/servers/925758f3-e4b4-44d9-941d-d10ba53df59e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:54:05.509845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-90089424-241b-4d94-90f6-39db6cb84281 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:05.511372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-90089424-241b-4d94-90f6-39db6cb84281 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:05.531664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90089424-241b-4d94-90f6-39db6cb84281 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:05.533563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90089424-241b-4d94-90f6-39db6cb84281 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:05.535224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90089424-241b-4d94-90f6-39db6cb84281 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:05.536749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90089424-241b-4d94-90f6-39db6cb84281 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:05.538007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90089424-241b-4d94-90f6-39db6cb84281 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:05.539006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90089424-241b-4d94-90f6-39db6cb84281 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:05.577736 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e0a9898d-d4d7-425a-bca3-a31c6713fed9 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1346 microversion: 2.1 time: 0.306609 Aug 09 17:54:05.585062 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2776/5816] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:05 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1346 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:06.096065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-90089424-241b-4d94-90f6-39db6cb84281 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:06.105846 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-90089424-241b-4d94-90f6-39db6cb84281 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1566 microversion: 2.1 time: 0.601543 Aug 09 17:54:06.107798 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3041/5817] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:05 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1566 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:06.130399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7c2f6606-5f9d-4c6c-af06-47e7886e53d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:06.131034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7c2f6606-5f9d-4c6c-af06-47e7886e53d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:06.142914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2f6606-5f9d-4c6c-af06-47e7886e53d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:06.145521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2f6606-5f9d-4c6c-af06-47e7886e53d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:06.146094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2f6606-5f9d-4c6c-af06-47e7886e53d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:06.148469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2f6606-5f9d-4c6c-af06-47e7886e53d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:06.149296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2f6606-5f9d-4c6c-af06-47e7886e53d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:06.150177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c2f6606-5f9d-4c6c-af06-47e7886e53d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:06.631984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7c2f6606-5f9d-4c6c-af06-47e7886e53d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:06.638074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-61d19525-54d7-414c-a7db-26b69ddc7cf5 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:06.644252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61d19525-54d7-414c-a7db-26b69ddc7cf5 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:06.679505 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7c2f6606-5f9d-4c6c-af06-47e7886e53d3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1566 microversion: 2.1 time: 0.552835 Aug 09 17:54:06.686349 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2777/5818] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:06 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1566 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:06.690776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61d19525-54d7-414c-a7db-26b69ddc7cf5 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:06.692799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61d19525-54d7-414c-a7db-26b69ddc7cf5 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:06.694008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61d19525-54d7-414c-a7db-26b69ddc7cf5 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:06.696407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61d19525-54d7-414c-a7db-26b69ddc7cf5 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:06.698455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61d19525-54d7-414c-a7db-26b69ddc7cf5 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:06.699849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61d19525-54d7-414c-a7db-26b69ddc7cf5 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:07.008721 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-61d19525-54d7-414c-a7db-26b69ddc7cf5 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1434 microversion: 2.1 time: 0.382478 Aug 09 17:54:07.025517 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3042/5819] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:06 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1434 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:08.063966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-162bbc9a-8eb0-4948-9c30-7c46b65216c6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:08.068928 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-162bbc9a-8eb0-4948-9c30-7c46b65216c6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:08.095032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-162bbc9a-8eb0-4948-9c30-7c46b65216c6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:08.099840 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-162bbc9a-8eb0-4948-9c30-7c46b65216c6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:08.110092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-162bbc9a-8eb0-4948-9c30-7c46b65216c6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:08.111824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-162bbc9a-8eb0-4948-9c30-7c46b65216c6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:08.113419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-162bbc9a-8eb0-4948-9c30-7c46b65216c6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:08.115705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-162bbc9a-8eb0-4948-9c30-7c46b65216c6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:08.320305 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-162bbc9a-8eb0-4948-9c30-7c46b65216c6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1422 microversion: 2.1 time: 0.266252 Aug 09 17:54:08.335141 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2778/5820] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:08 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1422 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:08.878092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-73302343", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-205899550", "security_groups": [{"name": "tempest-secgroup-smoke-624683924"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "696f2278-5ef3-445c-b76d-9e03bae30f0f"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:09.349267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c9beef12-953a-49f3-b8f4-1b142b4b852d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:09.354706 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c9beef12-953a-49f3-b8f4-1b142b4b852d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:09.389755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9beef12-953a-49f3-b8f4-1b142b4b852d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:09.396267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9beef12-953a-49f3-b8f4-1b142b4b852d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:09.396993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9beef12-953a-49f3-b8f4-1b142b4b852d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:09.398058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9beef12-953a-49f3-b8f4-1b142b4b852d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:09.398753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9beef12-953a-49f3-b8f4-1b142b4b852d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:09.399483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c9beef12-953a-49f3-b8f4-1b142b4b852d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:09.554822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] validate_networks() for [('696f2278-5ef3-445c-b76d-9e03bae30f0f', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:54:10.181000 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c9beef12-953a-49f3-b8f4-1b142b4b852d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1464 microversion: 2.1 time: 0.836995 Aug 09 17:54:10.181722 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2779/5821] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:09 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1464 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:10.522704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Getting quotas for project 349a4820ebe9411aada660b43cceade9. Resources: dict_keys(['metadata_items']) {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:54:10.539204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Getting quotas for user 61b265fe840b4375818c363ec32ff68e and project 349a4820ebe9411aada660b43cceade9. Resources: dict_keys(['metadata_items']) {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:54:10.583317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:54:10.583860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:54:10.585958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:54:10.586546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:54:10.590864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:54:10.621007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:10.622143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:10.624291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:10.626586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:10.627781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:10.631694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:10.696092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Getting quotas for project 349a4820ebe9411aada660b43cceade9. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:54:10.711342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Getting quotas for user 61b265fe840b4375818c363ec32ff68e and project 349a4820ebe9411aada660b43cceade9. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:54:10.753407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:54:10.758344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:54:10.884906 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df6d43d4-8d0e-44c0-9b2f-fe1b7ddd9c7d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.023432 Aug 09 17:54:10.885996 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3043/5822] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:54:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:54:10.945011 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-566c5d7b-d6bf-490a-9363-529c9016289e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:10.949680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-566c5d7b-d6bf-490a-9363-529c9016289e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:11.076227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-566c5d7b-d6bf-490a-9363-529c9016289e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:11.098939 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-566c5d7b-d6bf-490a-9363-529c9016289e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1300 microversion: 2.1 time: 0.206098 Aug 09 17:54:11.099558 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2780/5823] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:10 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1300 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:11.209629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-485849e7-3c78-42a9-bbc9-49a4a290f1e3 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:11.211160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-485849e7-3c78-42a9-bbc9-49a4a290f1e3 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:11.240398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485849e7-3c78-42a9-bbc9-49a4a290f1e3 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:11.248707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485849e7-3c78-42a9-bbc9-49a4a290f1e3 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:11.249269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485849e7-3c78-42a9-bbc9-49a4a290f1e3 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:11.250046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485849e7-3c78-42a9-bbc9-49a4a290f1e3 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:11.250528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485849e7-3c78-42a9-bbc9-49a4a290f1e3 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:11.265011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-485849e7-3c78-42a9-bbc9-49a4a290f1e3 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:11.775039 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-485849e7-3c78-42a9-bbc9-49a4a290f1e3 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1464 microversion: 2.1 time: 0.570557 Aug 09 17:54:11.780712 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3044/5824] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:11 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1464 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:12.132721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-78b79570-7367-4125-98fc-1e2e20b7e769 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:12.134041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-78b79570-7367-4125-98fc-1e2e20b7e769 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:12.164855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78b79570-7367-4125-98fc-1e2e20b7e769 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:12.166400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78b79570-7367-4125-98fc-1e2e20b7e769 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:12.169279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78b79570-7367-4125-98fc-1e2e20b7e769 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:12.170464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78b79570-7367-4125-98fc-1e2e20b7e769 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:12.172816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78b79570-7367-4125-98fc-1e2e20b7e769 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:12.174275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-78b79570-7367-4125-98fc-1e2e20b7e769 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:12.376687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-78b79570-7367-4125-98fc-1e2e20b7e769 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:12.392724 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-78b79570-7367-4125-98fc-1e2e20b7e769 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1296 microversion: 2.1 time: 0.275089 Aug 09 17:54:12.409782 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2781/5825] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:12 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1296 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:12.805486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-90479435-e183-45e5-9ba0-b0d972eda1c8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:12.805979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-90479435-e183-45e5-9ba0-b0d972eda1c8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:12.821553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90479435-e183-45e5-9ba0-b0d972eda1c8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:12.824899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90479435-e183-45e5-9ba0-b0d972eda1c8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:12.825561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90479435-e183-45e5-9ba0-b0d972eda1c8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:12.826546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90479435-e183-45e5-9ba0-b0d972eda1c8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:12.829504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90479435-e183-45e5-9ba0-b0d972eda1c8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:12.831099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90479435-e183-45e5-9ba0-b0d972eda1c8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:13.230861 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-90479435-e183-45e5-9ba0-b0d972eda1c8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1464 microversion: 2.1 time: 0.429582 Aug 09 17:54:13.244011 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3045/5826] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:12 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1464 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:13.416914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-06b02c84-71dd-4531-a4d9-70880aca6bdf tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:13.418168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-06b02c84-71dd-4531-a4d9-70880aca6bdf tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:13.428825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:13.447005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06b02c84-71dd-4531-a4d9-70880aca6bdf tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:13.447648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06b02c84-71dd-4531-a4d9-70880aca6bdf tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:13.448343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06b02c84-71dd-4531-a4d9-70880aca6bdf tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:13.449395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06b02c84-71dd-4531-a4d9-70880aca6bdf tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:13.450069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06b02c84-71dd-4531-a4d9-70880aca6bdf tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:13.450690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-06b02c84-71dd-4531-a4d9-70880aca6bdf tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:13.780551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-06b02c84-71dd-4531-a4d9-70880aca6bdf tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:13.801894 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-06b02c84-71dd-4531-a4d9-70880aca6bdf tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1358 microversion: 2.1 time: 0.383833 Aug 09 17:54:13.803013 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2782/5827] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:13 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:14.071743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-076765bc-6b82-4d3a-b4a5-fb8005dbfcff req-23bb0be3-b40d-427d-8f6f-bb219f207c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26627f90-9b2d-4e76-a60f-4077a9859e6f", "tag": "9578aa29-78b4-4948-a9c9-7892914138eb"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:14.093352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-076765bc-6b82-4d3a-b4a5-fb8005dbfcff req-23bb0be3-b40d-427d-8f6f-bb219f207c1b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:14.094250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-076765bc-6b82-4d3a-b4a5-fb8005dbfcff req-23bb0be3-b40d-427d-8f6f-bb219f207c1b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:14.094864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-076765bc-6b82-4d3a-b4a5-fb8005dbfcff req-23bb0be3-b40d-427d-8f6f-bb219f207c1b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:14.156274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-076765bc-6b82-4d3a-b4a5-fb8005dbfcff req-23bb0be3-b40d-427d-8f6f-bb219f207c1b service nova] Creating event network-changed:9578aa29-78b4-4948-a9c9-7892914138eb for instance 26627f90-9b2d-4e76-a60f-4077a9859e6f on n-h1-845781-6 Aug 09 17:54:14.171875 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-076765bc-6b82-4d3a-b4a5-fb8005dbfcff req-23bb0be3-b40d-427d-8f6f-bb219f207c1b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110578 Aug 09 17:54:14.177978 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3046/5828] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:54:14.256134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-057f2cf0-4392-4806-a7bc-8cd91f236a39 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:14.256925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-057f2cf0-4392-4806-a7bc-8cd91f236a39 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:14.273562 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-057f2cf0-4392-4806-a7bc-8cd91f236a39 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:14.274105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-057f2cf0-4392-4806-a7bc-8cd91f236a39 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:14.275017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-057f2cf0-4392-4806-a7bc-8cd91f236a39 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:14.278501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-057f2cf0-4392-4806-a7bc-8cd91f236a39 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:14.278501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-057f2cf0-4392-4806-a7bc-8cd91f236a39 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:14.278501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-057f2cf0-4392-4806-a7bc-8cd91f236a39 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:14.655324 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-057f2cf0-4392-4806-a7bc-8cd91f236a39 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1464 microversion: 2.1 time: 0.403521 Aug 09 17:54:14.664667 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2783/5829] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:14 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1464 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:14.751207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cc85054f-6bba-4d61-ac04-752cdc663efa tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:14.752474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cc85054f-6bba-4d61-ac04-752cdc663efa tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:14.766187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc85054f-6bba-4d61-ac04-752cdc663efa tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:14.766994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc85054f-6bba-4d61-ac04-752cdc663efa tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:14.768191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc85054f-6bba-4d61-ac04-752cdc663efa tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:14.770410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc85054f-6bba-4d61-ac04-752cdc663efa tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:14.774583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc85054f-6bba-4d61-ac04-752cdc663efa tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:14.775306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc85054f-6bba-4d61-ac04-752cdc663efa tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:14.824102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8d21f16a-0b3a-4d2b-8389-8660119b1e89 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:14.824988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8d21f16a-0b3a-4d2b-8389-8660119b1e89 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:14.837409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d21f16a-0b3a-4d2b-8389-8660119b1e89 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:14.838192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d21f16a-0b3a-4d2b-8389-8660119b1e89 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:14.838811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d21f16a-0b3a-4d2b-8389-8660119b1e89 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:14.839775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d21f16a-0b3a-4d2b-8389-8660119b1e89 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:14.842372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d21f16a-0b3a-4d2b-8389-8660119b1e89 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:14.843084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d21f16a-0b3a-4d2b-8389-8660119b1e89 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:15.167284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8d21f16a-0b3a-4d2b-8389-8660119b1e89 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:15.192623 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8d21f16a-0b3a-4d2b-8389-8660119b1e89 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1358 microversion: 2.1 time: 0.372285 Aug 09 17:54:15.199291 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2784/5830] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:14 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1358 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:15.300853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cc85054f-6bba-4d61-ac04-752cdc663efa tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:15.315869 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cc85054f-6bba-4d61-ac04-752cdc663efa tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1566 microversion: 2.1 time: 0.566544 Aug 09 17:54:15.316314 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3047/5831] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:14 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1566 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:15.685960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-77fdc1f8-1cf6-4c0d-8f3e-8e4c93ca5de6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:15.686699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-77fdc1f8-1cf6-4c0d-8f3e-8e4c93ca5de6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:15.716273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77fdc1f8-1cf6-4c0d-8f3e-8e4c93ca5de6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:15.748029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77fdc1f8-1cf6-4c0d-8f3e-8e4c93ca5de6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:15.757008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77fdc1f8-1cf6-4c0d-8f3e-8e4c93ca5de6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:15.759823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77fdc1f8-1cf6-4c0d-8f3e-8e4c93ca5de6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:15.760521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77fdc1f8-1cf6-4c0d-8f3e-8e4c93ca5de6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:15.761137 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77fdc1f8-1cf6-4c0d-8f3e-8e4c93ca5de6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:16.134424 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-77fdc1f8-1cf6-4c0d-8f3e-8e4c93ca5de6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1464 microversion: 2.1 time: 0.452966 Aug 09 17:54:16.149852 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2785/5832] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:15 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1464 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:16.206098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ee164937-9ab0-4909-9f06-17a60dc0cdca req-4b6a03c7-4815-4f3f-bbcd-886ea655768a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3ac82a-2978-42ba-a133-a5db20652f5d", "tag": "b09f6bbd-ae75-4189-b58f-5b1f600d8c2b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:16.234886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-68f2dee4-d99a-401a-9103-216f76c930c0 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:16.237467 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-68f2dee4-d99a-401a-9103-216f76c930c0 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:16.237854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ee164937-9ab0-4909-9f06-17a60dc0cdca req-4b6a03c7-4815-4f3f-bbcd-886ea655768a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:16.238730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ee164937-9ab0-4909-9f06-17a60dc0cdca req-4b6a03c7-4815-4f3f-bbcd-886ea655768a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:16.238851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ee164937-9ab0-4909-9f06-17a60dc0cdca req-4b6a03c7-4815-4f3f-bbcd-886ea655768a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:16.244765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68f2dee4-d99a-401a-9103-216f76c930c0 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:16.245324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68f2dee4-d99a-401a-9103-216f76c930c0 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:16.245972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68f2dee4-d99a-401a-9103-216f76c930c0 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:16.246904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68f2dee4-d99a-401a-9103-216f76c930c0 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:16.247589 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68f2dee4-d99a-401a-9103-216f76c930c0 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:16.248230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68f2dee4-d99a-401a-9103-216f76c930c0 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:16.264346 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ee164937-9ab0-4909-9f06-17a60dc0cdca req-4b6a03c7-4815-4f3f-bbcd-886ea655768a service nova] Creating event network-changed:b09f6bbd-ae75-4189-b58f-5b1f600d8c2b for instance af3ac82a-2978-42ba-a133-a5db20652f5d on n-h1-845781-6 Aug 09 17:54:16.277734 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ee164937-9ab0-4909-9f06-17a60dc0cdca req-4b6a03c7-4815-4f3f-bbcd-886ea655768a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069911 Aug 09 17:54:16.278602 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3048/5833] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:16.512323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-68f2dee4-d99a-401a-9103-216f76c930c0 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:16.522464 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-68f2dee4-d99a-401a-9103-216f76c930c0 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1425 microversion: 2.1 time: 0.295360 Aug 09 17:54:16.536894 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2786/5834] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:16 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1425 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:17.161927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bddac156-a62a-40cf-a604-678217987506 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:17.162764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bddac156-a62a-40cf-a604-678217987506 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:17.176990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bddac156-a62a-40cf-a604-678217987506 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:17.177677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bddac156-a62a-40cf-a604-678217987506 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:17.179355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bddac156-a62a-40cf-a604-678217987506 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:17.180843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bddac156-a62a-40cf-a604-678217987506 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:17.182977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bddac156-a62a-40cf-a604-678217987506 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:17.183536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bddac156-a62a-40cf-a604-678217987506 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:17.537240 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bddac156-a62a-40cf-a604-678217987506 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1464 microversion: 2.1 time: 0.379527 Aug 09 17:54:17.539064 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3049/5835] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:17 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1464 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:17.546651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a660085a-521f-4abf-b703-4faf217de284 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:17.548204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a660085a-521f-4abf-b703-4faf217de284 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:17.556970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a660085a-521f-4abf-b703-4faf217de284 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:17.558990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a660085a-521f-4abf-b703-4faf217de284 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:17.559886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a660085a-521f-4abf-b703-4faf217de284 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:17.561190 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a660085a-521f-4abf-b703-4faf217de284 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:17.561865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a660085a-521f-4abf-b703-4faf217de284 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:17.562506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a660085a-521f-4abf-b703-4faf217de284 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:17.874457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bebaa2df-3f74-425d-aab8-a45b72cb4f4c tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Action: 'create', calling method: .version_select at 0x7fbbca50c5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2080673382"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:17.944577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a660085a-521f-4abf-b703-4faf217de284 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:17.958146 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a660085a-521f-4abf-b703-4faf217de284 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1425 microversion: 2.1 time: 0.411267 Aug 09 17:54:17.958830 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2787/5836] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:17 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1425 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:18.292381 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bebaa2df-3f74-425d-aab8-a45b72cb4f4c tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.624099 Aug 09 17:54:18.298185 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2b78bea1-30ce-4197-9e66-f92fa62db546 req-450419fe-fd7a-4844-bbdc-f6b8b3da0098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d27ba69-c70a-4b2d-bfd4-af446c3179d3", "tag": "f051bb0e-72a5-49dd-8a7d-2ba55c4860bb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:18.301998 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3050/5837] 10.222.0.93 () {60 vars in 1155 bytes} [Tue Aug 9 17:54:17 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 635 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 09 17:54:18.307387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2b6d996d-2014-4327-8578-730be8c5ffac tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbdc8c81f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:18.310120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2b78bea1-30ce-4197-9e66-f92fa62db546 req-450419fe-fd7a-4844-bbdc-f6b8b3da0098 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:18.310889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2b78bea1-30ce-4197-9e66-f92fa62db546 req-450419fe-fd7a-4844-bbdc-f6b8b3da0098 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:18.311827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2b78bea1-30ce-4197-9e66-f92fa62db546 req-450419fe-fd7a-4844-bbdc-f6b8b3da0098 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:18.327046 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2b78bea1-30ce-4197-9e66-f92fa62db546 req-450419fe-fd7a-4844-bbdc-f6b8b3da0098 service nova] Creating event network-changed:f051bb0e-72a5-49dd-8a7d-2ba55c4860bb for instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 on n-h2-845781-6 Aug 09 17:54:18.333534 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-2b78bea1-30ce-4197-9e66-f92fa62db546 req-450419fe-fd7a-4844-bbdc-f6b8b3da0098 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039963 Aug 09 17:54:18.334658 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2788/5838] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:54:18.389668 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2b6d996d-2014-4327-8578-730be8c5ffac tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de" status: 200 len: 345 microversion: 2.1 time: 0.086221 Aug 09 17:54:18.390239 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3051/5839] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:18 2022] GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de => generated 345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:18.564194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-20511317-8683-42ce-95e8-ad4737ac6cd7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:18.565568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-20511317-8683-42ce-95e8-ad4737ac6cd7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:18.573459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20511317-8683-42ce-95e8-ad4737ac6cd7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:18.574236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20511317-8683-42ce-95e8-ad4737ac6cd7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:18.574675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20511317-8683-42ce-95e8-ad4737ac6cd7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:18.575378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20511317-8683-42ce-95e8-ad4737ac6cd7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:18.575867 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20511317-8683-42ce-95e8-ad4737ac6cd7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:18.576650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-20511317-8683-42ce-95e8-ad4737ac6cd7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:18.743405 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-20511317-8683-42ce-95e8-ad4737ac6cd7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1464 microversion: 2.1 time: 0.183106 Aug 09 17:54:18.744532 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2789/5840] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:18 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:18.981215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75b377ee-2b94-49d0-9e82-6437dd1e0b7c tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:18.982697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75b377ee-2b94-49d0-9e82-6437dd1e0b7c tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:18.989235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b377ee-2b94-49d0-9e82-6437dd1e0b7c tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:18.989735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b377ee-2b94-49d0-9e82-6437dd1e0b7c tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:18.990293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b377ee-2b94-49d0-9e82-6437dd1e0b7c tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:18.990927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b377ee-2b94-49d0-9e82-6437dd1e0b7c tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:18.991676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b377ee-2b94-49d0-9e82-6437dd1e0b7c tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:18.993357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75b377ee-2b94-49d0-9e82-6437dd1e0b7c tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:19.248759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-75b377ee-2b94-49d0-9e82-6437dd1e0b7c tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:19.259564 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75b377ee-2b94-49d0-9e82-6437dd1e0b7c tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1425 microversion: 2.1 time: 0.282328 Aug 09 17:54:19.261536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3052/5841] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:18 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1425 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:19.404836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-649dfe4e-e3c3-47e0-b1ef-bc15c814947e tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca2a3550>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:19.465377 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-649dfe4e-e3c3-47e0-b1ef-bc15c814947e tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de" status: 200 len: 346 microversion: 2.1 time: 0.065114 Aug 09 17:54:19.466185 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2790/5842] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:19 2022] GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:54:19.479902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f1a6835c-385b-4b9e-bd86-cab7f0780b47 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Action: 'create', calling method: .version_select at 0x7fbbcb595550>, body: {"snapshot": {"volume_id": "ee3259dc-0ef0-4685-ac73-061d41c2c3de", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1360367024"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:19.671965 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f1a6835c-385b-4b9e-bd86-cab7f0780b47 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.196293 Aug 09 17:54:19.673840 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3053/5843] 10.222.0.93 () {60 vars in 1162 bytes} [Tue Aug 9 17:54:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:19.685106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c416f056-3dbe-405c-b367-e2063c84902e tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca2a3940>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:19.742269 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c416f056-3dbe-405c-b367-e2063c84902e tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13" status: 200 len: 287 microversion: 2.1 time: 0.059332 Aug 09 17:54:19.742927 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2791/5844] 10.222.0.93 () {58 vars in 1251 bytes} [Tue Aug 9 17:54:19 2022] GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:19.755969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fa12aaed-5895-49f5-8438-b2752d2f6df8 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca6b3b80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:19.765703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9320c1c9-425f-4744-8be3-f70358a88d62 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:19.766393 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9320c1c9-425f-4744-8be3-f70358a88d62 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:19.774410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9320c1c9-425f-4744-8be3-f70358a88d62 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:19.775136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9320c1c9-425f-4744-8be3-f70358a88d62 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:19.775905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9320c1c9-425f-4744-8be3-f70358a88d62 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:19.776771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9320c1c9-425f-4744-8be3-f70358a88d62 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:19.777384 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9320c1c9-425f-4744-8be3-f70358a88d62 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:19.778062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9320c1c9-425f-4744-8be3-f70358a88d62 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:19.816610 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fa12aaed-5895-49f5-8438-b2752d2f6df8 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.066181 Aug 09 17:54:19.818028 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3054/5845] 10.222.0.93 () {58 vars in 1140 bytes} [Tue Aug 9 17:54:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:19.829305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e467b9e-0972-4d36-8a56-01106a3ac59d tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbcad27ca0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:19.898144 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e467b9e-0972-4d36-8a56-01106a3ac59d tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13" status: 200 len: 287 microversion: 2.1 time: 0.073082 Aug 09 17:54:19.907060 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3055/5846] 10.222.0.93 () {58 vars in 1251 bytes} [Tue Aug 9 17:54:19 2022] GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:54:20.004407 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9320c1c9-425f-4744-8be3-f70358a88d62 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1464 microversion: 2.1 time: 0.242790 Aug 09 17:54:20.016369 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2792/5847] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:19 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1464 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:20.286199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87c68978-d51a-442c-bf0d-74282dd98a4e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:20.286820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87c68978-d51a-442c-bf0d-74282dd98a4e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:20.293662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87c68978-d51a-442c-bf0d-74282dd98a4e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:20.294148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87c68978-d51a-442c-bf0d-74282dd98a4e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:20.294586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87c68978-d51a-442c-bf0d-74282dd98a4e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:20.295491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87c68978-d51a-442c-bf0d-74282dd98a4e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:20.296157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87c68978-d51a-442c-bf0d-74282dd98a4e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:20.296590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87c68978-d51a-442c-bf0d-74282dd98a4e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:20.472248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5b02e585-d427-46a8-ab8c-e01d29e526d7 req-52228aee-cb9c-44e0-981d-1455b549cd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26627f90-9b2d-4e76-a60f-4077a9859e6f", "name": "network-vif-plugged", "status": "completed", "tag": "9578aa29-78b4-4948-a9c9-7892914138eb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:20.482997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87c68978-d51a-442c-bf0d-74282dd98a4e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:20.494218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5b02e585-d427-46a8-ab8c-e01d29e526d7 req-52228aee-cb9c-44e0-981d-1455b549cd6a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:20.494711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5b02e585-d427-46a8-ab8c-e01d29e526d7 req-52228aee-cb9c-44e0-981d-1455b549cd6a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:20.495211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5b02e585-d427-46a8-ab8c-e01d29e526d7 req-52228aee-cb9c-44e0-981d-1455b549cd6a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:20.505218 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87c68978-d51a-442c-bf0d-74282dd98a4e tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1425 microversion: 2.1 time: 0.212661 Aug 09 17:54:20.506999 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3056/5848] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:20 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1425 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:20.534161 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5b02e585-d427-46a8-ab8c-e01d29e526d7 req-52228aee-cb9c-44e0-981d-1455b549cd6a service nova] Creating event network-vif-plugged:9578aa29-78b4-4948-a9c9-7892914138eb for instance 26627f90-9b2d-4e76-a60f-4077a9859e6f on n-h1-845781-6 Aug 09 17:54:20.548890 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5b02e585-d427-46a8-ab8c-e01d29e526d7 req-52228aee-cb9c-44e0-981d-1455b549cd6a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078266 Aug 09 17:54:20.556039 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2793/5849] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:20.915970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1a8ac523-074c-4cb7-b06b-b672a50acf21 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca50c820>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:20.926724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:20.929361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:20.988868 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1a8ac523-074c-4cb7-b06b-b672a50acf21 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13" status: 200 len: 287 microversion: 2.1 time: 0.077892 Aug 09 17:54:20.989727 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3057/5850] 10.222.0.93 () {58 vars in 1251 bytes} [Tue Aug 9 17:54:20 2022] GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:54:21.027473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5617e217-eefc-4635-98c5-331312114073 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:21.028351 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5617e217-eefc-4635-98c5-331312114073 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:21.036956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5617e217-eefc-4635-98c5-331312114073 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:21.037492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5617e217-eefc-4635-98c5-331312114073 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:21.037919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5617e217-eefc-4635-98c5-331312114073 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:21.038624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5617e217-eefc-4635-98c5-331312114073 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:21.039090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5617e217-eefc-4635-98c5-331312114073 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:21.039505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5617e217-eefc-4635-98c5-331312114073 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:21.105379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=12 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:21.349688 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5617e217-eefc-4635-98c5-331312114073 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1464 microversion: 2.1 time: 0.327006 Aug 09 17:54:21.352092 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2794/5851] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:21 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1464 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:21.527788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-53571fc3-df09-412c-9a2e-45cc411d8346 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:21.529758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-53571fc3-df09-412c-9a2e-45cc411d8346 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:21.540426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53571fc3-df09-412c-9a2e-45cc411d8346 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:21.540929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53571fc3-df09-412c-9a2e-45cc411d8346 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:21.541371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53571fc3-df09-412c-9a2e-45cc411d8346 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:21.542086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53571fc3-df09-412c-9a2e-45cc411d8346 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:21.542539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53571fc3-df09-412c-9a2e-45cc411d8346 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:21.542970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53571fc3-df09-412c-9a2e-45cc411d8346 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:21.773849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-53571fc3-df09-412c-9a2e-45cc411d8346 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:21.792700 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-53571fc3-df09-412c-9a2e-45cc411d8346 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1425 microversion: 2.1 time: 0.270010 Aug 09 17:54:21.793493 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3058/5852] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:21 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1425 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:22.001595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ac3da36d-7cca-4b64-b52e-20fe0b5f5714 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca2a3d30>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:22.032831 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ac3da36d-7cca-4b64-b52e-20fe0b5f5714 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13" status: 200 len: 288 microversion: 2.1 time: 0.034503 Aug 09 17:54:22.033449 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2795/5853] 10.222.0.93 () {58 vars in 1251 bytes} [Tue Aug 9 17:54:21 2022] GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:22.044657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94f64172-cbc2-4838-abd1-a2448d2999b4 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbcb9614c0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:22.115768 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94f64172-cbc2-4838-abd1-a2448d2999b4 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "DELETE /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13" status: 202 len: 0 microversion: 2.1 time: 0.074853 Aug 09 17:54:22.116346 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3059/5854] 10.222.0.93 () {58 vars in 1254 bytes} [Tue Aug 9 17:54:22 2022] DELETE /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:54:22.124670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c3c6512c-3408-49ef-9f8c-1640da99a0c8 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca20c700>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:22.165246 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c3c6512c-3408-49ef-9f8c-1640da99a0c8 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13" status: 200 len: 287 microversion: 2.1 time: 0.044143 Aug 09 17:54:22.166337 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2796/5855] 10.222.0.93 () {58 vars in 1251 bytes} [Tue Aug 9 17:54:22 2022] GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:22.370235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8793b3cf-f02a-4ff9-87a4-afc9b98ee99d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:22.370865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8793b3cf-f02a-4ff9-87a4-afc9b98ee99d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:22.378028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8793b3cf-f02a-4ff9-87a4-afc9b98ee99d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:22.378561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8793b3cf-f02a-4ff9-87a4-afc9b98ee99d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:22.378970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8793b3cf-f02a-4ff9-87a4-afc9b98ee99d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:22.379779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8793b3cf-f02a-4ff9-87a4-afc9b98ee99d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:22.380293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8793b3cf-f02a-4ff9-87a4-afc9b98ee99d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:22.380664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8793b3cf-f02a-4ff9-87a4-afc9b98ee99d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:22.541703 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8793b3cf-f02a-4ff9-87a4-afc9b98ee99d tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1650 microversion: 2.1 time: 0.175055 Aug 09 17:54:22.547313 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3060/5856] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:22 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1650 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:22.563124 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cd26e60b-ed25-4e22-b7a9-0506b5cc20d6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:22.564282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cd26e60b-ed25-4e22-b7a9-0506b5cc20d6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:22.571448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd26e60b-ed25-4e22-b7a9-0506b5cc20d6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:22.571983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd26e60b-ed25-4e22-b7a9-0506b5cc20d6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:22.572653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd26e60b-ed25-4e22-b7a9-0506b5cc20d6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:22.573371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd26e60b-ed25-4e22-b7a9-0506b5cc20d6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:22.573824 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd26e60b-ed25-4e22-b7a9-0506b5cc20d6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:22.574257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd26e60b-ed25-4e22-b7a9-0506b5cc20d6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:22.707563 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cd26e60b-ed25-4e22-b7a9-0506b5cc20d6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1650 microversion: 2.1 time: 0.148304 Aug 09 17:54:22.708705 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2797/5857] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:22 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1650 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:22.728343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b5800aa1-691f-4b3d-8dcb-3247c97169bb tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:22.729448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b5800aa1-691f-4b3d-8dcb-3247c97169bb tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:22.736758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5800aa1-691f-4b3d-8dcb-3247c97169bb tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:22.737406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5800aa1-691f-4b3d-8dcb-3247c97169bb tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:22.737968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5800aa1-691f-4b3d-8dcb-3247c97169bb tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:22.738825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5800aa1-691f-4b3d-8dcb-3247c97169bb tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:22.739390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5800aa1-691f-4b3d-8dcb-3247c97169bb tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:22.739968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b5800aa1-691f-4b3d-8dcb-3247c97169bb tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:22.814751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-44fd0e16-0b72-4391-9169-428945d7c074 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:22.815544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-44fd0e16-0b72-4391-9169-428945d7c074 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:22.822218 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44fd0e16-0b72-4391-9169-428945d7c074 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:22.822720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44fd0e16-0b72-4391-9169-428945d7c074 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:22.823182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44fd0e16-0b72-4391-9169-428945d7c074 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:22.824102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44fd0e16-0b72-4391-9169-428945d7c074 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:22.824936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44fd0e16-0b72-4391-9169-428945d7c074 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:22.825684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44fd0e16-0b72-4391-9169-428945d7c074 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:22.848683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:22.907611 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b5800aa1-691f-4b3d-8dcb-3247c97169bb tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1650 microversion: 2.1 time: 0.182576 Aug 09 17:54:22.932369 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3061/5858] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:22 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1650 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:23.056733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-44fd0e16-0b72-4391-9169-428945d7c074 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:23.067452 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-44fd0e16-0b72-4391-9169-428945d7c074 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1425 microversion: 2.1 time: 0.257198 Aug 09 17:54:23.069420 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2798/5859] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:22 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1425 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:23.087328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-521445473", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "availability_zone": "nova:n-h2-845781-6", "networks": [{"uuid": "5d8b1c8b-de89-498f-9561-fe7d5f26f96b"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:23.165518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] validate_networks() for [('5d8b1c8b-de89-498f-9561-fe7d5f26f96b', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:54:23.181211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2df01aba-875f-491f-bfee-5c22915499cb tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca222430>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:23.230735 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2df01aba-875f-491f-bfee-5c22915499cb tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13" status: 200 len: 287 microversion: 2.1 time: 0.055688 Aug 09 17:54:23.231702 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2799/5860] 10.222.0.93 () {58 vars in 1251 bytes} [Tue Aug 9 17:54:23 2022] GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:23.236558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5cfdd611-c000-44b5-b3be-bc2797ef2fc1 req-384ee777-f025-488d-8631-8d3ba464d654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d27ba69-c70a-4b2d-bfd4-af446c3179d3", "name": "network-vif-plugged", "status": "completed", "tag": "f051bb0e-72a5-49dd-8a7d-2ba55c4860bb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:23.249431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5cfdd611-c000-44b5-b3be-bc2797ef2fc1 req-384ee777-f025-488d-8631-8d3ba464d654 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:23.250009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5cfdd611-c000-44b5-b3be-bc2797ef2fc1 req-384ee777-f025-488d-8631-8d3ba464d654 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:23.250804 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5cfdd611-c000-44b5-b3be-bc2797ef2fc1 req-384ee777-f025-488d-8631-8d3ba464d654 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:23.264734 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5cfdd611-c000-44b5-b3be-bc2797ef2fc1 req-384ee777-f025-488d-8631-8d3ba464d654 service nova] Creating event network-vif-plugged:f051bb0e-72a5-49dd-8a7d-2ba55c4860bb for instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 on n-h2-845781-6 Aug 09 17:54:23.273031 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5cfdd611-c000-44b5-b3be-bc2797ef2fc1 req-384ee777-f025-488d-8631-8d3ba464d654 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040032 Aug 09 17:54:23.274051 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2800/5861] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:23.838778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:54:23.839256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:54:23.839843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:54:23.840543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:54:23.841185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:54:23.850945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:23.851522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:23.852092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:23.852905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:23.853441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:23.854443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:23.876366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Getting quotas for project fbca5a4d51724a94909affa4bb8cc5b6. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:54:23.883384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Getting quotas for user 458fbfd265da4df0897eb9a075e548fb and project fbca5a4d51724a94909affa4bb8cc5b6. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:54:23.898012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:54:23.900880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:54:23.955352 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2787833f-a8d0-4f60-88b1-ef65a8007ee8 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872233 Aug 09 17:54:23.956387 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3062/5862] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:54:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:54:23.967741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2ce2efdc-8bb1-4512-ad89-1e7d52dbd22e tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:23.968443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2ce2efdc-8bb1-4512-ad89-1e7d52dbd22e tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:24.039294 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2ce2efdc-8bb1-4512-ad89-1e7d52dbd22e tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1328 microversion: 2.1 time: 0.075659 Aug 09 17:54:24.039943 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2801/5863] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:23 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1328 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:24.089522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b360649-6363-4dc5-abe9-e231b79c00ed tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:24.090222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b360649-6363-4dc5-abe9-e231b79c00ed tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:24.098418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b360649-6363-4dc5-abe9-e231b79c00ed tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:24.099027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b360649-6363-4dc5-abe9-e231b79c00ed tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:24.100180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b360649-6363-4dc5-abe9-e231b79c00ed tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:24.101047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b360649-6363-4dc5-abe9-e231b79c00ed tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:24.101827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b360649-6363-4dc5-abe9-e231b79c00ed tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:24.102334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b360649-6363-4dc5-abe9-e231b79c00ed tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:24.119943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:24.244665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0259e30c-8784-478a-a7cc-1b6eb368861a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca2793a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:24.258775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8b360649-6363-4dc5-abe9-e231b79c00ed tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:24.274363 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b360649-6363-4dc5-abe9-e231b79c00ed tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1425 microversion: 2.1 time: 0.189132 Aug 09 17:54:24.282461 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-0259e30c-8784-478a-a7cc-1b6eb368861a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] HTTP exception thrown: Snapshot 23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 could not be found. Aug 09 17:54:24.284427 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3063/5864] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:24 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1425 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0259e30c-8784-478a-a7cc-1b6eb368861a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Request method failure captured: Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 HTTP/1.1 Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p9JOhCw05I_yOaBGoHiUpSLP6v0Fj6BlK1A7VwHyFNL5p0Xlv57H7b6qzocqCiG-F7GMA0q1sq_qYr9MFKO5xGtG7kyzbdPZpqizRzX7FUfec6Q0w1OvHdUk-7MliLaI0P3tr9v7C2suwZav_Cb11iq6waSB5tW2YxiRB_IqhP445Q Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 3044bf50720d4440a5569f795c0f6e53 Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 3044bf50720d4440a5569f795c0f6e53 Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesSnapshotsTestJSON-1413866881-project Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 3d0edc7595f3402591fc6cbcd69a4050 Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1413866881-project Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: exception: Snapshot 23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 could not be found. Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '23cc029a-30a0-4ae5-9fa0-eea02f9e1c13'} Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 could not be found. (HTTP 404) (Request-ID: req-33281287-3fc1-4e9f-8357-0ad2b969e321) Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:54:24.290887 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 could not be found. Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 could not be found. Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 could not be found. Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0259e30c-8784-478a-a7cc-1b6eb368861a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Returning 404 to user: Snapshot 23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0259e30c-8784-478a-a7cc-1b6eb368861a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13" status: 404 len: 111 microversion: 2.1 time: 0.053288 Aug 09 17:54:24.298630 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2802/5865] 10.222.0.93 () {58 vars in 1251 bytes} [Tue Aug 9 17:54:24 2022] GET /compute/v2.1/os-snapshots/23cc029a-30a0-4ae5-9fa0-eea02f9e1c13 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:54:24.305024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b674d444-d16c-4607-9fae-d1e93b7d4650 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbcb74ef70>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:24.381186 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b674d444-d16c-4607-9fae-d1e93b7d4650 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de" status: 202 len: 0 microversion: 2.1 time: 0.079931 Aug 09 17:54:24.384975 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3064/5866] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:54:24 2022] DELETE /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:54:24.390252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1e77d9ed-c00f-4723-97a9-0baeb73db45a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbcb801280>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:24.446291 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1e77d9ed-c00f-4723-97a9-0baeb73db45a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de" status: 200 len: 345 microversion: 2.1 time: 0.059892 Aug 09 17:54:24.447261 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2803/5867] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:24 2022] GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:25.060909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-73104625-117f-4668-8379-d0a878d52f11 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:25.062249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-73104625-117f-4668-8379-d0a878d52f11 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:25.070087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73104625-117f-4668-8379-d0a878d52f11 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:25.070960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73104625-117f-4668-8379-d0a878d52f11 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:25.071673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73104625-117f-4668-8379-d0a878d52f11 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:25.073055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73104625-117f-4668-8379-d0a878d52f11 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:25.073376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73104625-117f-4668-8379-d0a878d52f11 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:25.074014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73104625-117f-4668-8379-d0a878d52f11 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:25.160261 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-73104625-117f-4668-8379-d0a878d52f11 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1415 microversion: 2.1 time: 0.103929 Aug 09 17:54:25.173660 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3065/5868] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:25 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1415 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:25.296720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cb7ba950-123b-4937-945b-a377e0708d55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:25.298020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cb7ba950-123b-4937-945b-a377e0708d55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:25.320156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb7ba950-123b-4937-945b-a377e0708d55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:25.321054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb7ba950-123b-4937-945b-a377e0708d55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:25.321714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb7ba950-123b-4937-945b-a377e0708d55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:25.322511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb7ba950-123b-4937-945b-a377e0708d55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:25.322990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb7ba950-123b-4937-945b-a377e0708d55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:25.323409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cb7ba950-123b-4937-945b-a377e0708d55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:25.461182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1bec6c40-c18b-4ae4-8524-0f983c357bc9 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbcb74e9d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:25.536448 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1bec6c40-c18b-4ae4-8524-0f983c357bc9 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de" status: 200 len: 345 microversion: 2.1 time: 0.079223 Aug 09 17:54:25.537203 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3066/5869] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:25 2022] GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:25.576298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cb7ba950-123b-4937-945b-a377e0708d55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:25.591836 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cb7ba950-123b-4937-945b-a377e0708d55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1604 microversion: 2.1 time: 0.298943 Aug 09 17:54:25.593669 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2804/5870] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:25 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1604 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:25.613861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e7d5544-46a1-4634-b4d7-b92705e0ce9d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:25.614755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1e7d5544-46a1-4634-b4d7-b92705e0ce9d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:25.621076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7d5544-46a1-4634-b4d7-b92705e0ce9d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:25.621792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7d5544-46a1-4634-b4d7-b92705e0ce9d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:25.622524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7d5544-46a1-4634-b4d7-b92705e0ce9d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:25.623579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7d5544-46a1-4634-b4d7-b92705e0ce9d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:25.624547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7d5544-46a1-4634-b4d7-b92705e0ce9d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:25.625267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e7d5544-46a1-4634-b4d7-b92705e0ce9d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:25.806361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1e7d5544-46a1-4634-b4d7-b92705e0ce9d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:25.815266 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e7d5544-46a1-4634-b4d7-b92705e0ce9d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1604 microversion: 2.1 time: 0.205260 Aug 09 17:54:25.817323 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3067/5871] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:25 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:25.843593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-781e6e25-880b-4482-8625-21ebf2b3ea55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:25.844273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-781e6e25-880b-4482-8625-21ebf2b3ea55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:25.864811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e6e25-880b-4482-8625-21ebf2b3ea55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:25.872204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e6e25-880b-4482-8625-21ebf2b3ea55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:25.872694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e6e25-880b-4482-8625-21ebf2b3ea55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:25.876690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e6e25-880b-4482-8625-21ebf2b3ea55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:25.877186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e6e25-880b-4482-8625-21ebf2b3ea55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:25.877626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-781e6e25-880b-4482-8625-21ebf2b3ea55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:26.184478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25b522ad-8ab6-407f-b127-94f5604d4b19 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:26.185860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-25b522ad-8ab6-407f-b127-94f5604d4b19 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:26.193675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b522ad-8ab6-407f-b127-94f5604d4b19 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:26.194553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b522ad-8ab6-407f-b127-94f5604d4b19 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:26.195328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b522ad-8ab6-407f-b127-94f5604d4b19 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:26.196434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b522ad-8ab6-407f-b127-94f5604d4b19 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:26.197167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b522ad-8ab6-407f-b127-94f5604d4b19 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:26.199201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b522ad-8ab6-407f-b127-94f5604d4b19 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:26.205633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-781e6e25-880b-4482-8625-21ebf2b3ea55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:26.217194 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-781e6e25-880b-4482-8625-21ebf2b3ea55 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1604 microversion: 2.1 time: 0.379355 Aug 09 17:54:26.232527 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2805/5872] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:25 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1604 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:26.445993 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-25b522ad-8ab6-407f-b127-94f5604d4b19 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1463 microversion: 2.1 time: 0.265099 Aug 09 17:54:26.447873 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3068/5873] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:26 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1463 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:26.550898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b7a64192-7fa7-47a0-abdb-96b8e79dd2b1 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca276c10>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:26.633849 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b7a64192-7fa7-47a0-abdb-96b8e79dd2b1 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de" status: 200 len: 345 microversion: 2.1 time: 0.086646 Aug 09 17:54:26.634750 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2806/5874] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:26 2022] GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de => generated 345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:27.092003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-69714540-de33-489a-a12a-83b34434d681 req-a13ff6be-b14c-4fb8-8e56-ae779ca4aa79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6dbd548-4990-4729-9e8c-c60ebb2156df", "tag": "2fcebfdc-c9b3-49cf-9a95-664dbe90508d"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:27.113445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-69714540-de33-489a-a12a-83b34434d681 req-a13ff6be-b14c-4fb8-8e56-ae779ca4aa79 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:27.114424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-69714540-de33-489a-a12a-83b34434d681 req-a13ff6be-b14c-4fb8-8e56-ae779ca4aa79 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:27.115022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-69714540-de33-489a-a12a-83b34434d681 req-a13ff6be-b14c-4fb8-8e56-ae779ca4aa79 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:27.150301 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-69714540-de33-489a-a12a-83b34434d681 req-a13ff6be-b14c-4fb8-8e56-ae779ca4aa79 service nova] Creating event network-changed:2fcebfdc-c9b3-49cf-9a95-664dbe90508d for instance c6dbd548-4990-4729-9e8c-c60ebb2156df on n-h2-845781-6 Aug 09 17:54:27.171169 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-69714540-de33-489a-a12a-83b34434d681 req-a13ff6be-b14c-4fb8-8e56-ae779ca4aa79 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213082 Aug 09 17:54:27.175871 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3069/5875] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:27.470253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e06284e0-4977-4b5c-86f8-558377573140 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:27.471510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e06284e0-4977-4b5c-86f8-558377573140 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:27.480130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e06284e0-4977-4b5c-86f8-558377573140 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:27.480934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e06284e0-4977-4b5c-86f8-558377573140 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:27.481541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e06284e0-4977-4b5c-86f8-558377573140 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:27.482635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e06284e0-4977-4b5c-86f8-558377573140 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:27.483258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e06284e0-4977-4b5c-86f8-558377573140 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:27.483924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e06284e0-4977-4b5c-86f8-558377573140 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:27.651685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b5af799-7f39-404d-88d6-f7e178427c74 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca538d30>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:27.687394 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-6b5af799-7f39-404d-88d6-f7e178427c74 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] HTTP exception thrown: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.690858 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e06284e0-4977-4b5c-86f8-558377573140 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1463 microversion: 2.1 time: 0.224793 Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b5af799-7f39-404d-88d6-f7e178427c74 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Request method failure captured: Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de HTTP/1.1 Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p9JOhCw05I_yOaBGoHiUpSLP6v0Fj6BlK1A7VwHyFNL5p0Xlv57H7b6qzocqCiG-F7GMA0q1sq_qYr9MFKO5xGtG7kyzbdPZpqizRzX7FUfec6Q0w1OvHdUk-7MliLaI0P3tr9v7C2suwZav_Cb11iq6waSB5tW2YxiRB_IqhP445Q Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 3044bf50720d4440a5569f795c0f6e53 Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 3044bf50720d4440a5569f795c0f6e53 Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-VolumesSnapshotsTestJSON-1413866881-project Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 3d0edc7595f3402591fc6cbcd69a4050 Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1413866881-project Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: exception: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'ee3259dc-0ef0-4685-ac73-061d41c2c3de'} Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. (HTTP 404) (Request-ID: req-13a089f0-3cbf-43fd-b9fa-d7832e23effc) Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:54:27.691988 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.696305 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.699108 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2807/5876] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:27 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1463 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:27.700873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b5af799-7f39-404d-88d6-f7e178427c74 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Returning 404 to user: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:54:27.701763 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b5af799-7f39-404d-88d6-f7e178427c74 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de" status: 404 len: 109 microversion: 2.1 time: 0.056213 Aug 09 17:54:27.702341 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3070/5877] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:27 2022] GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:54:27.714413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ca8d0a1-1804-43ad-bad4-868a5cc0b81a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca236f70>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:27.745615 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-3ca8d0a1-1804-43ad-bad4-868a5cc0b81a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] HTTP exception thrown: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ca8d0a1-1804-43ad-bad4-868a5cc0b81a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Request method failure captured: Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de HTTP/1.1 Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p9JOhCw05I_yOaBGoHiUpSLP6v0Fj6BlK1A7VwHyFNL5p0Xlv57H7b6qzocqCiG-F7GMA0q1sq_qYr9MFKO5xGtG7kyzbdPZpqizRzX7FUfec6Q0w1OvHdUk-7MliLaI0P3tr9v7C2suwZav_Cb11iq6waSB5tW2YxiRB_IqhP445Q Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 3044bf50720d4440a5569f795c0f6e53 Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 3044bf50720d4440a5569f795c0f6e53 Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-VolumesSnapshotsTestJSON-1413866881-project Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 3d0edc7595f3402591fc6cbcd69a4050 Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1413866881-project Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: method: Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: exception: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'ee3259dc-0ef0-4685-ac73-061d41c2c3de'} Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. (HTTP 404) (Request-ID: req-5a723a1e-7489-46e1-b58b-46effad4b340) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:54:27.747680 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ca8d0a1-1804-43ad-bad4-868a5cc0b81a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Returning 404 to user: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:54:27.752863 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3ca8d0a1-1804-43ad-bad4-868a5cc0b81a tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de" status: 404 len: 109 microversion: 2.1 time: 0.038878 Aug 09 17:54:27.755787 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2808/5878] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:54:27 2022] DELETE /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:54:27.759920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e81d7963-aa04-415a-bd14-ba194424d266 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Calling method '.version_select at 0x7fbbca662790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:27.795936 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-e81d7963-aa04-415a-bd14-ba194424d266 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] HTTP exception thrown: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e81d7963-aa04-415a-bd14-ba194424d266 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Request method failure captured: Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de HTTP/1.1 Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p9JOhCw05I_yOaBGoHiUpSLP6v0Fj6BlK1A7VwHyFNL5p0Xlv57H7b6qzocqCiG-F7GMA0q1sq_qYr9MFKO5xGtG7kyzbdPZpqizRzX7FUfec6Q0w1OvHdUk-7MliLaI0P3tr9v7C2suwZav_Cb11iq6waSB5tW2YxiRB_IqhP445Q Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 3044bf50720d4440a5569f795c0f6e53 Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3044bf50720d4440a5569f795c0f6e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 3044bf50720d4440a5569f795c0f6e53 Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1413866881 Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-VolumesSnapshotsTestJSON-1413866881-project Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 3d0edc7595f3402591fc6cbcd69a4050 Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1413866881-project Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: exception: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'ee3259dc-0ef0-4685-ac73-061d41c2c3de'} Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. (HTTP 404) (Request-ID: req-8a2f31a5-9900-42ec-a18c-c22838a0d054) Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:54:27.799123 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. Aug 09 17:54:27.803527 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:27.807799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e81d7963-aa04-415a-bd14-ba194424d266 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] Returning 404 to user: Volume ee3259dc-0ef0-4685-ac73-061d41c2c3de could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:54:27.808686 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e81d7963-aa04-415a-bd14-ba194424d266 tempest-VolumesSnapshotsTestJSON-1413866881 tempest-VolumesSnapshotsTestJSON-1413866881-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de" status: 404 len: 109 microversion: 2.1 time: 0.053999 Aug 09 17:54:27.809273 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3071/5879] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:27 2022] GET /compute/v2.1/os-volumes/ee3259dc-0ef0-4685-ac73-061d41c2c3de => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:54:28.648529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-8d73b777-f23a-4938-9d08-3e25ecc275c9 req-f64e7b17-81e7-4b4b-8a40-1f770cd8be97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d27ba69-c70a-4b2d-bfd4-af446c3179d3", "tag": "f051bb0e-72a5-49dd-8a7d-2ba55c4860bb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:28.664699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8d73b777-f23a-4938-9d08-3e25ecc275c9 req-f64e7b17-81e7-4b4b-8a40-1f770cd8be97 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:28.674956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8d73b777-f23a-4938-9d08-3e25ecc275c9 req-f64e7b17-81e7-4b4b-8a40-1f770cd8be97 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:28.674956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8d73b777-f23a-4938-9d08-3e25ecc275c9 req-f64e7b17-81e7-4b4b-8a40-1f770cd8be97 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:28.690934 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-8d73b777-f23a-4938-9d08-3e25ecc275c9 req-f64e7b17-81e7-4b4b-8a40-1f770cd8be97 service nova] Creating event network-changed:f051bb0e-72a5-49dd-8a7d-2ba55c4860bb for instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 on n-h2-845781-6 Aug 09 17:54:28.697658 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-8d73b777-f23a-4938-9d08-3e25ecc275c9 req-f64e7b17-81e7-4b4b-8a40-1f770cd8be97 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054694 Aug 09 17:54:28.698491 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2809/5880] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:28.717733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dc88e608-57e7-4713-ad1f-7470d9cb8a18 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:28.718473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dc88e608-57e7-4713-ad1f-7470d9cb8a18 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:28.731884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc88e608-57e7-4713-ad1f-7470d9cb8a18 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:28.732504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc88e608-57e7-4713-ad1f-7470d9cb8a18 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:28.732806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc88e608-57e7-4713-ad1f-7470d9cb8a18 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:28.733715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc88e608-57e7-4713-ad1f-7470d9cb8a18 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:28.734898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc88e608-57e7-4713-ad1f-7470d9cb8a18 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:28.735488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dc88e608-57e7-4713-ad1f-7470d9cb8a18 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:29.344566 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dc88e608-57e7-4713-ad1f-7470d9cb8a18 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1463 microversion: 2.1 time: 0.630762 Aug 09 17:54:29.345746 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3072/5881] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:28 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1463 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:30.093985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c31d7482-4ba3-490c-ab0a-f1afffd69117 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] Action: 'create', calling method: .version_select at 0x7fbbca1c9af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-586241893", "metadata": {"Type": "work"}}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:30.367547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1bf05d93-674c-4bde-af2e-4be11cc939ec tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:30.371678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1bf05d93-674c-4bde-af2e-4be11cc939ec tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:30.382903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf05d93-674c-4bde-af2e-4be11cc939ec tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:30.383409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf05d93-674c-4bde-af2e-4be11cc939ec tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:30.383916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf05d93-674c-4bde-af2e-4be11cc939ec tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:30.384758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf05d93-674c-4bde-af2e-4be11cc939ec tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:30.385226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf05d93-674c-4bde-af2e-4be11cc939ec tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:30.385659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1bf05d93-674c-4bde-af2e-4be11cc939ec tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:30.417605 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c31d7482-4ba3-490c-ab0a-f1afffd69117 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.456788 Aug 09 17:54:30.418468 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2810/5882] 10.222.0.93 () {60 vars in 1156 bytes} [Tue Aug 9 17:54:29 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 459 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 17:54:30.430865 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2bba3769-11d1-4de4-a527-121ab5b54159 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] Calling method '.version_select at 0x7fbbca287ee0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:30.506551 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2bba3769-11d1-4de4-a527-121ab5b54159 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4" status: 200 len: 352 microversion: 2.1 time: 0.079521 Aug 09 17:54:30.508345 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2811/5883] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:30 2022] GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:54:30.570332 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1bf05d93-674c-4bde-af2e-4be11cc939ec tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1463 microversion: 2.1 time: 0.206962 Aug 09 17:54:30.570962 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3073/5884] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:30 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1463 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:31.522762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-478ef22c-17cc-414d-899b-d412f35939b7 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] Calling method '.version_select at 0x7fbbca1c9040>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:31.576826 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-478ef22c-17cc-414d-899b-d412f35939b7 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4" status: 200 len: 353 microversion: 2.1 time: 0.058850 Aug 09 17:54:31.577334 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2812/5885] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:31 2022] GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:54:31.590317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e38b846-d40a-480a-81a6-4c4bccda91a8 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] Calling method '.version_select at 0x7fbbca662d30>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:31.596908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2edf0b07-4115-4c47-8b58-9180486d27cf tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:31.598294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2edf0b07-4115-4c47-8b58-9180486d27cf tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:31.602607 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:31.614291 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2edf0b07-4115-4c47-8b58-9180486d27cf tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:31.615182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2edf0b07-4115-4c47-8b58-9180486d27cf tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:31.616037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2edf0b07-4115-4c47-8b58-9180486d27cf tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:31.617337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2edf0b07-4115-4c47-8b58-9180486d27cf tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:31.618191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2edf0b07-4115-4c47-8b58-9180486d27cf tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:31.618988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2edf0b07-4115-4c47-8b58-9180486d27cf tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:31.642153 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e38b846-d40a-480a-81a6-4c4bccda91a8 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4" status: 200 len: 353 microversion: 2.1 time: 0.055834 Aug 09 17:54:31.643017 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3074/5886] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:31 2022] GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:31.657310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fcbc5add-1831-4226-bcb0-1a71c417e47e tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] Calling method '.version_select at 0x7fbbca6744c0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:31.759484 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fcbc5add-1831-4226-bcb0-1a71c417e47e tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4" status: 202 len: 0 microversion: 2.1 time: 0.106030 Aug 09 17:54:31.760340 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3075/5887] 10.222.0.93 () {58 vars in 1248 bytes} [Tue Aug 9 17:54:31 2022] DELETE /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:54:31.770163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4c9a3de4-1938-459f-8436-62e54207eff2 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] Calling method '.version_select at 0x7fbbca674160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:31.840429 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4c9a3de4-1938-459f-8436-62e54207eff2 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4" status: 200 len: 352 microversion: 2.1 time: 0.075058 Aug 09 17:54:31.841345 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3076/5888] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:31 2022] GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 => generated 352 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:31.848547 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2edf0b07-4115-4c47-8b58-9180486d27cf tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1463 microversion: 2.1 time: 0.258769 Aug 09 17:54:31.855679 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2813/5889] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:31 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1463 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:31.961269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b2f59b0b-76d9-4bb5-8a42-fa5d3c6fceaf tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:31.964934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b2f59b0b-76d9-4bb5-8a42-fa5d3c6fceaf tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:31.968213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:31.977533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2f59b0b-76d9-4bb5-8a42-fa5d3c6fceaf tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:31.977533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2f59b0b-76d9-4bb5-8a42-fa5d3c6fceaf tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:31.978790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2f59b0b-76d9-4bb5-8a42-fa5d3c6fceaf tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:31.980724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2f59b0b-76d9-4bb5-8a42-fa5d3c6fceaf tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:31.980891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2f59b0b-76d9-4bb5-8a42-fa5d3c6fceaf tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:31.982179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2f59b0b-76d9-4bb5-8a42-fa5d3c6fceaf tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:32.048814 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b2f59b0b-76d9-4bb5-8a42-fa5d3c6fceaf tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d/action" status: 200 len: 24566 microversion: 2.1 time: 0.093636 Aug 09 17:54:32.049670 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3077/5890] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:54:31 2022] POST /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d/action => generated 24566 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:54:32.855080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-454a079e-38db-40c8-ae9e-60ee1c2de0ae tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] Calling method '.version_select at 0x7fbbca1ce940>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:32.875274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b463dc8c-e26b-4343-be24-6235fe4e8eb6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:32.883306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b463dc8c-e26b-4343-be24-6235fe4e8eb6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:32.902244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463dc8c-e26b-4343-be24-6235fe4e8eb6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:32.902745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463dc8c-e26b-4343-be24-6235fe4e8eb6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:32.903188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463dc8c-e26b-4343-be24-6235fe4e8eb6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:32.903942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463dc8c-e26b-4343-be24-6235fe4e8eb6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:32.904567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463dc8c-e26b-4343-be24-6235fe4e8eb6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:32.904842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463dc8c-e26b-4343-be24-6235fe4e8eb6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:32.955417 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-454a079e-38db-40c8-ae9e-60ee1c2de0ae tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4" status: 200 len: 352 microversion: 2.1 time: 0.103702 Aug 09 17:54:32.956616 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2814/5891] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:32 2022] GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:33.092539 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b463dc8c-e26b-4343-be24-6235fe4e8eb6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1463 microversion: 2.1 time: 0.221345 Aug 09 17:54:33.094465 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3078/5892] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:32 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1463 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:33.182999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-f2476bb9-4c39-43b5-83b4-d3a0162610de req-706c0e4d-405c-49eb-a430-59f8955edbba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6dbd548-4990-4729-9e8c-c60ebb2156df", "name": "network-vif-plugged", "status": "completed", "tag": "2fcebfdc-c9b3-49cf-9a95-664dbe90508d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:33.207097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f2476bb9-4c39-43b5-83b4-d3a0162610de req-706c0e4d-405c-49eb-a430-59f8955edbba service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:33.207659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f2476bb9-4c39-43b5-83b4-d3a0162610de req-706c0e4d-405c-49eb-a430-59f8955edbba service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:33.208107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f2476bb9-4c39-43b5-83b4-d3a0162610de req-706c0e4d-405c-49eb-a430-59f8955edbba service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:33.223214 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-f2476bb9-4c39-43b5-83b4-d3a0162610de req-706c0e4d-405c-49eb-a430-59f8955edbba service nova] Creating event network-vif-plugged:2fcebfdc-c9b3-49cf-9a95-664dbe90508d for instance c6dbd548-4990-4729-9e8c-c60ebb2156df on n-h2-845781-6 Aug 09 17:54:33.231914 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-f2476bb9-4c39-43b5-83b4-d3a0162610de req-706c0e4d-405c-49eb-a430-59f8955edbba service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051655 Aug 09 17:54:33.233462 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2815/5893] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:54:33.970319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-adb5cfac-66b3-4348-9554-d7791d1a9465 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] Calling method '.version_select at 0x7fbbcb74e9d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:33.978109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:33.979277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:34.010062 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-adb5cfac-66b3-4348-9554-d7791d1a9465 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] HTTP exception thrown: Volume 563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 could not be found. Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-adb5cfac-66b3-4348-9554-d7791d1a9465 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] Request method failure captured: Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 HTTP/1.1 Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p9VCHAwTd0YPklGZ_8UB1kdCR46ubmQo3G2K-kpMFTdUXEE4cVkt1wXHueVLsKX_G13_fLd_1bmxptvQ_hFK1xON7fbnwjfNrRggzwJaCS7r_Oj4OHGDP1TP7vyGL4IpI8ZAn5N3pUiRmRwAyx44Dx7KkUNCz6MgDHNlOrcc6P8zK0 Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: d0bd50e8854042c9a756660f1b4b4492 Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-VolumesGetTestJSON-1744450740 Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d0bd50e8854042c9a756660f1b4b4492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d0bd50e8854042c9a756660f1b4b4492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d0bd50e8854042c9a756660f1b4b4492"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d0bd50e8854042c9a756660f1b4b4492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-VolumesGetTestJSON-1744450740 Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: d0bd50e8854042c9a756660f1b4b4492 Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-VolumesGetTestJSON-1744450740 Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-VolumesGetTestJSON-1744450740-project Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 44c082cee3dc43ba825f8036d65d76ac Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-VolumesGetTestJSON-1744450740-project Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: method: Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: exception: Volume 563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 could not be found. Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '563d33dc-fe06-4d19-9d8e-f9aeca39f0e4'} Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 could not be found. (HTTP 404) (Request-ID: req-a8642f8b-4131-4900-b5bc-b43aa0e3b68b) Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 17:54:34.012513 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 could not be found. Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 could not be found. Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 could not be found. Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-adb5cfac-66b3-4348-9554-d7791d1a9465 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] Returning 404 to user: Volume 563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:54:34.016311 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-adb5cfac-66b3-4348-9554-d7791d1a9465 tempest-VolumesGetTestJSON-1744450740 tempest-VolumesGetTestJSON-1744450740-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4" status: 404 len: 109 microversion: 2.1 time: 0.048163 Aug 09 17:54:34.023841 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3079/5894] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:33 2022] GET /compute/v2.1/os-volumes/563d33dc-fe06-4d19-9d8e-f9aeca39f0e4 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:54:34.113173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:34.118704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-58ce021d-49b6-4adb-9116-13d333caa4ae tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:34.120946 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-58ce021d-49b6-4adb-9116-13d333caa4ae tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:34.132692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58ce021d-49b6-4adb-9116-13d333caa4ae tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:34.133459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58ce021d-49b6-4adb-9116-13d333caa4ae tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:34.134135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58ce021d-49b6-4adb-9116-13d333caa4ae tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:34.135076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58ce021d-49b6-4adb-9116-13d333caa4ae tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:34.135775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58ce021d-49b6-4adb-9116-13d333caa4ae tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:34.136425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-58ce021d-49b6-4adb-9116-13d333caa4ae tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:34.304889 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-58ce021d-49b6-4adb-9116-13d333caa4ae tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1463 microversion: 2.1 time: 0.193453 Aug 09 17:54:34.305470 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2816/5895] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:34 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1463 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:35.340725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-22b881c6-278f-4c4f-9b76-9912f30970f7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:35.341488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-22b881c6-278f-4c4f-9b76-9912f30970f7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:35.359979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22b881c6-278f-4c4f-9b76-9912f30970f7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:35.360495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22b881c6-278f-4c4f-9b76-9912f30970f7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:35.360942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22b881c6-278f-4c4f-9b76-9912f30970f7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:35.361673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22b881c6-278f-4c4f-9b76-9912f30970f7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:35.362139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22b881c6-278f-4c4f-9b76-9912f30970f7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:35.362798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-22b881c6-278f-4c4f-9b76-9912f30970f7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:35.542280 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-22b881c6-278f-4c4f-9b76-9912f30970f7 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1648 microversion: 2.1 time: 0.215757 Aug 09 17:54:35.544197 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3080/5896] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:35 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1648 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:35.564724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-135e3807-59ab-4acc-8ab7-e85fbf03ff13 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:35.565341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-135e3807-59ab-4acc-8ab7-e85fbf03ff13 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:35.572676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-135e3807-59ab-4acc-8ab7-e85fbf03ff13 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:35.573179 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-135e3807-59ab-4acc-8ab7-e85fbf03ff13 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:35.573609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-135e3807-59ab-4acc-8ab7-e85fbf03ff13 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:35.574497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-135e3807-59ab-4acc-8ab7-e85fbf03ff13 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:35.575118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-135e3807-59ab-4acc-8ab7-e85fbf03ff13 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:35.575534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-135e3807-59ab-4acc-8ab7-e85fbf03ff13 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:35.741792 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-135e3807-59ab-4acc-8ab7-e85fbf03ff13 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1648 microversion: 2.1 time: 0.181195 Aug 09 17:54:35.744256 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2817/5897] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:35 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1648 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:35.766044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8f57c2d8-661b-4f74-8004-0b0accdfd3a6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:35.767072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8f57c2d8-661b-4f74-8004-0b0accdfd3a6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:35.775991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f57c2d8-661b-4f74-8004-0b0accdfd3a6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:35.777492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f57c2d8-661b-4f74-8004-0b0accdfd3a6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:35.778176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f57c2d8-661b-4f74-8004-0b0accdfd3a6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:35.779190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f57c2d8-661b-4f74-8004-0b0accdfd3a6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:35.780975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f57c2d8-661b-4f74-8004-0b0accdfd3a6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:35.781707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f57c2d8-661b-4f74-8004-0b0accdfd3a6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:35.942795 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8f57c2d8-661b-4f74-8004-0b0accdfd3a6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1648 microversion: 2.1 time: 0.183224 Aug 09 17:54:35.944153 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3081/5898] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:35 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1648 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:35.965666 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e7c975d3-f5a3-489a-b8a3-24e2298b1af6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:35.966436 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e7c975d3-f5a3-489a-b8a3-24e2298b1af6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:35.973409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7c975d3-f5a3-489a-b8a3-24e2298b1af6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:35.973914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7c975d3-f5a3-489a-b8a3-24e2298b1af6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:35.974343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7c975d3-f5a3-489a-b8a3-24e2298b1af6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:35.975056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7c975d3-f5a3-489a-b8a3-24e2298b1af6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:35.975753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7c975d3-f5a3-489a-b8a3-24e2298b1af6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:35.975994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e7c975d3-f5a3-489a-b8a3-24e2298b1af6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:36.003961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e7c975d3-f5a3-489a-b8a3-24e2298b1af6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:54:36.120787 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e7c975d3-f5a3-489a-b8a3-24e2298b1af6 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "DELETE /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 204 len: 0 microversion: 2.1 time: 0.158341 Aug 09 17:54:36.122517 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2818/5899] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:54:35 2022] DELETE /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:54:36.134611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-63e4aefe-a218-49ef-9eb9-22a77f792874 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:36.135894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-63e4aefe-a218-49ef-9eb9-22a77f792874 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:36.147959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63e4aefe-a218-49ef-9eb9-22a77f792874 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:36.148594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63e4aefe-a218-49ef-9eb9-22a77f792874 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:36.149046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63e4aefe-a218-49ef-9eb9-22a77f792874 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:36.149918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63e4aefe-a218-49ef-9eb9-22a77f792874 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:36.150378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63e4aefe-a218-49ef-9eb9-22a77f792874 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:36.151017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63e4aefe-a218-49ef-9eb9-22a77f792874 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:36.298911 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-63e4aefe-a218-49ef-9eb9-22a77f792874 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1654 microversion: 2.1 time: 0.171151 Aug 09 17:54:36.300090 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3082/5900] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:36 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1654 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:37.322541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f70d71e-025d-4c48-aab0-8cc9c9deef00 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:37.328237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8f70d71e-025d-4c48-aab0-8cc9c9deef00 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:37.335691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f70d71e-025d-4c48-aab0-8cc9c9deef00 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:37.336192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f70d71e-025d-4c48-aab0-8cc9c9deef00 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:37.336651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f70d71e-025d-4c48-aab0-8cc9c9deef00 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:37.337343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f70d71e-025d-4c48-aab0-8cc9c9deef00 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:37.337801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f70d71e-025d-4c48-aab0-8cc9c9deef00 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:37.338229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f70d71e-025d-4c48-aab0-8cc9c9deef00 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:37.485338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2c292cf1-31b4-424e-b9c1-3e87c422186d tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] Calling method '.version_select at 0x7fbbca662700>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:37.521247 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8f70d71e-025d-4c48-aab0-8cc9c9deef00 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1654 microversion: 2.1 time: 0.203236 Aug 09 17:54:37.522398 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2819/5901] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:37 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1654 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:37.543040 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2c292cf1-31b4-424e-b9c1-3e87c422186d tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/8f68fa8e-c498-47b4-8885-aaa75fd9ea0e" status: 200 len: 351 microversion: 2.1 time: 0.061972 Aug 09 17:54:37.551036 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3083/5902] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:37 2022] GET /compute/v2.1/os-volumes/8f68fa8e-c498-47b4-8885-aaa75fd9ea0e => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:54:38.198248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ea55e572-586e-41ce-912c-c2446996b791 req-51c83461-4e72-41fd-b58c-7b1b135477a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6dbd548-4990-4729-9e8c-c60ebb2156df", "name": "network-vif-deleted", "tag": "2fcebfdc-c9b3-49cf-9a95-664dbe90508d"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:38.216198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ea55e572-586e-41ce-912c-c2446996b791 req-51c83461-4e72-41fd-b58c-7b1b135477a2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:38.216932 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ea55e572-586e-41ce-912c-c2446996b791 req-51c83461-4e72-41fd-b58c-7b1b135477a2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:38.217572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ea55e572-586e-41ce-912c-c2446996b791 req-51c83461-4e72-41fd-b58c-7b1b135477a2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:38.241730 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ea55e572-586e-41ce-912c-c2446996b791 req-51c83461-4e72-41fd-b58c-7b1b135477a2 service nova] Creating event network-vif-deleted:2fcebfdc-c9b3-49cf-9a95-664dbe90508d for instance c6dbd548-4990-4729-9e8c-c60ebb2156df on n-h2-845781-6 Aug 09 17:54:38.248159 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ea55e572-586e-41ce-912c-c2446996b791 req-51c83461-4e72-41fd-b58c-7b1b135477a2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057195 Aug 09 17:54:38.250164 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2820/5903] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:38.547620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:38.549373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:38.559047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:38.559896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:38.560587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:38.562106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:38.562920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:38.563529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:38.639301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:38.640486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:38.640950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:38.641438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lazy-loading 'fault' on Instance uuid c6dbd548-4990-4729-9e8c-c60ebb2156df {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:54:38.717299 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c3a08a2-bccc-4d61-9499-33093d180654 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 200 len: 1453 microversion: 2.1 time: 0.175794 Aug 09 17:54:38.718333 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3084/5904] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:38 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:38.916753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-40244a8a-4d4c-4287-92d8-25af5749b90b tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] Calling method '.version_select at 0x7fbbca337dc0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:39.086090 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-40244a8a-4d4c-4287-92d8-25af5749b90b tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/f9765f68-0b6a-4103-b3d6-c4b2a57cb253" status: 200 len: 351 microversion: 2.1 time: 0.095468 Aug 09 17:54:39.086090 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2821/5905] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:38 2022] GET /compute/v2.1/os-volumes/f9765f68-0b6a-4103-b3d6-c4b2a57cb253 => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:39.739000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:39.740081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: c6dbd548-4990-4729-9e8c-c60ebb2156df] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:39.748135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:39.748709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:39.749224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:39.750179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:39.750808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:39.751487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:39.771772 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] HTTP exception thrown: Instance c6dbd548-4990-4729-9e8c-c60ebb2156df could not be found. Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Request method failure captured: Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df HTTP/1.1 Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p84N-PAcCDUVHhpQ1XTnJ9WNizrO_r55yJ0rJfOwhtiz5Ds-8de4isR_1UPGfOnMCDxlRx9uQTJtTEjuusCW1Kcow9WdrZUaJfSD-lp2MyFutPcqqb_OmdQsDPMIj81ywWVlZ68QhwdBddDHmCAe81r7b2tMOEjWvhXR4vWiulLTPA Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fbca5a4d51724a94909affa4bb8cc5b6 Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestServerMultinode-766607113 Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fbca5a4d51724a94909affa4bb8cc5b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fbca5a4d51724a94909affa4bb8cc5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fbca5a4d51724a94909affa4bb8cc5b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fbca5a4d51724a94909affa4bb8cc5b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestServerMultinode-766607113 Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fbca5a4d51724a94909affa4bb8cc5b6 Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestServerMultinode-766607113 Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestServerMultinode-766607113-project-admin Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 458fbfd265da4df0897eb9a075e548fb Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestServerMultinode-766607113-project-admin Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance c6dbd548-4990-4729-9e8c-c60ebb2156df could not be found. Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'c6dbd548-4990-4729-9e8c-c60ebb2156df'} Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6dbd548-4990-4729-9e8c-c60ebb2156df could not be found. Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6dbd548-4990-4729-9e8c-c60ebb2156df could not be found. Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:39.773721 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:39.787767 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:39.787767 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:39.787767 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:39.787767 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:54:39.787767 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:54:39.787767 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6dbd548-4990-4729-9e8c-c60ebb2156df could not be found. Aug 09 17:54:39.787767 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:39.787767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Returning 404 to user: Instance c6dbd548-4990-4729-9e8c-c60ebb2156df could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:54:39.787767 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-481ea3f8-7322-443e-baaa-1e4913461a32 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df" status: 404 len: 111 microversion: 2.1 time: 0.039736 Aug 09 17:54:39.787767 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3085/5906] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:39 2022] GET /compute/v2.1/servers/c6dbd548-4990-4729-9e8c-c60ebb2156df => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:54:39.788363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5bdc865a-dca3-48e5-a2b4-d8c7fd47773f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:39.788363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5bdc865a-dca3-48e5-a2b4-d8c7fd47773f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:39.798606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bdc865a-dca3-48e5-a2b4-d8c7fd47773f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:39.799103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bdc865a-dca3-48e5-a2b4-d8c7fd47773f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:39.799546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bdc865a-dca3-48e5-a2b4-d8c7fd47773f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:39.800282 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bdc865a-dca3-48e5-a2b4-d8c7fd47773f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:39.800738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bdc865a-dca3-48e5-a2b4-d8c7fd47773f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:39.801356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5bdc865a-dca3-48e5-a2b4-d8c7fd47773f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:39.844652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5bdc865a-dca3-48e5-a2b4-d8c7fd47773f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:54:40.231791 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5bdc865a-dca3-48e5-a2b4-d8c7fd47773f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "DELETE /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 204 len: 0 microversion: 2.1 time: 0.450148 Aug 09 17:54:40.237435 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2822/5907] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:54:39 2022] DELETE /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:54:40.245030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-45c88748-7606-4a4d-a170-e7b496a71350 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:40.245231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-45c88748-7606-4a4d-a170-e7b496a71350 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:40.252165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c88748-7606-4a4d-a170-e7b496a71350 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:40.252854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c88748-7606-4a4d-a170-e7b496a71350 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:40.253291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c88748-7606-4a4d-a170-e7b496a71350 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:40.253993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c88748-7606-4a4d-a170-e7b496a71350 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:40.254446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c88748-7606-4a4d-a170-e7b496a71350 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:40.254869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c88748-7606-4a4d-a170-e7b496a71350 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:40.403400 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-45c88748-7606-4a4d-a170-e7b496a71350 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1656 microversion: 2.1 time: 0.163405 Aug 09 17:54:40.404320 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3086/5908] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:40 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1656 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:40.453814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7e78d4b0-cafe-4911-a615-13a38a1fb917 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] Calling method '.version_select at 0x7fbbca2795e0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:40.508144 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7e78d4b0-cafe-4911-a615-13a38a1fb917 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/f6e50a82-8c4e-443e-a536-58ef2aec3da7" status: 200 len: 350 microversion: 2.1 time: 0.059045 Aug 09 17:54:40.515885 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2823/5909] 10.222.0.93 () {58 vars in 1245 bytes} [Tue Aug 9 17:54:40 2022] GET /compute/v2.1/os-volumes/f6e50a82-8c4e-443e-a536-58ef2aec3da7 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:40.522802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ed164ace-c99f-4ddf-8811-f51b81ef4af6 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] Calling method '.version_select at 0x7fbbcb7f7790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:40.610930 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ed164ace-c99f-4ddf-8811-f51b81ef4af6 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091997 Aug 09 17:54:40.615677 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3087/5910] 10.222.0.93 () {58 vars in 1134 bytes} [Tue Aug 9 17:54:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:40.626201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c935023c-1157-49aa-9bc3-22500b1d1a2c tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] Calling method '.version_select at 0x7fbbca3833a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:40.717458 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c935023c-1157-49aa-9bc3-22500b1d1a2c tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094505 Aug 09 17:54:40.717458 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2824/5911] 10.222.0.93 () {58 vars in 1149 bytes} [Tue Aug 9 17:54:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:40.731730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2558a0d4-0653-4e81-abc2-a884de3c2423 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] Calling method '.version_select at 0x7fbbca662670>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:40.819180 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2558a0d4-0653-4e81-abc2-a884de3c2423 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092196 Aug 09 17:54:40.820645 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3088/5912] 10.222.0.93 () {58 vars in 1134 bytes} [Tue Aug 9 17:54:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:40.833757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4604daa6-990f-49d4-a26f-a2def7443df9 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] Calling method '.version_select at 0x7fbbca390550>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:40.916340 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4604daa6-990f-49d4-a26f-a2def7443df9 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086363 Aug 09 17:54:40.917031 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2825/5913] 10.222.0.93 () {58 vars in 1167 bytes} [Tue Aug 9 17:54:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:40.931199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ebd2bcb1-1d84-498e-be68-6508d4289061 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] Calling method '.version_select at 0x7fbbca6629d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:41.020708 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ebd2bcb1-1d84-498e-be68-6508d4289061 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093317 Aug 09 17:54:41.021310 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3089/5914] 10.222.0.93 () {58 vars in 1170 bytes} [Tue Aug 9 17:54:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:41.035771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d6308314-1264-435d-ad67-27beaecb9ef1 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] Calling method '.version_select at 0x7fbbca222310>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:41.124442 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d6308314-1264-435d-ad67-27beaecb9ef1 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093045 Aug 09 17:54:41.125234 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2826/5915] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:54:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:41.138316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-596efcc8-5d69-4814-b67d-9054f6889df4 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] Calling method '.version_select at 0x7fbbca50c4c0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:41.230731 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-596efcc8-5d69-4814-b67d-9054f6889df4 tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.096235 Aug 09 17:54:41.231310 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3090/5916] 10.222.0.93 () {58 vars in 1188 bytes} [Tue Aug 9 17:54:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:41.245471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad707020-fb08-4929-a356-f66d44a7faaa tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] Calling method '.version_select at 0x7fbbca39ddc0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:41.331609 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad707020-fb08-4929-a356-f66d44a7faaa tempest-VolumesTestJSON-1451911067 tempest-VolumesTestJSON-1451911067-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091068 Aug 09 17:54:41.332987 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2827/5917] 10.222.0.93 () {58 vars in 1155 bytes} [Tue Aug 9 17:54:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:41.426420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f29df37-94e0-42fd-afb5-580aa2fcda49 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:41.427033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6f29df37-94e0-42fd-afb5-580aa2fcda49 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:41.433209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f29df37-94e0-42fd-afb5-580aa2fcda49 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:41.433982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f29df37-94e0-42fd-afb5-580aa2fcda49 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:41.434639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f29df37-94e0-42fd-afb5-580aa2fcda49 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:41.435574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f29df37-94e0-42fd-afb5-580aa2fcda49 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:41.436921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f29df37-94e0-42fd-afb5-580aa2fcda49 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:41.437568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f29df37-94e0-42fd-afb5-580aa2fcda49 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:41.614499 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6f29df37-94e0-42fd-afb5-580aa2fcda49 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1656 microversion: 2.1 time: 0.191812 Aug 09 17:54:41.615333 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3091/5918] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:41 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1656 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:42.605230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a58d46fd-0371-4849-9239-82cc7b44b29a req-40baeecd-4aaa-4dd0-8fb3-9dcdac000d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26627f90-9b2d-4e76-a60f-4077a9859e6f", "name": "network-vif-deleted", "tag": "9578aa29-78b4-4948-a9c9-7892914138eb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:42.617400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a58d46fd-0371-4849-9239-82cc7b44b29a req-40baeecd-4aaa-4dd0-8fb3-9dcdac000d84 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:42.618183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a58d46fd-0371-4849-9239-82cc7b44b29a req-40baeecd-4aaa-4dd0-8fb3-9dcdac000d84 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:42.618799 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a58d46fd-0371-4849-9239-82cc7b44b29a req-40baeecd-4aaa-4dd0-8fb3-9dcdac000d84 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:42.635455 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a58d46fd-0371-4849-9239-82cc7b44b29a req-40baeecd-4aaa-4dd0-8fb3-9dcdac000d84 service nova] Creating event network-vif-deleted:9578aa29-78b4-4948-a9c9-7892914138eb for instance 26627f90-9b2d-4e76-a60f-4077a9859e6f on n-h1-845781-6 Aug 09 17:54:42.637535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64aa24e4-2ff1-43aa-a5ef-611744235db4 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:42.638464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-64aa24e4-2ff1-43aa-a5ef-611744235db4 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:42.653416 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a58d46fd-0371-4849-9239-82cc7b44b29a req-40baeecd-4aaa-4dd0-8fb3-9dcdac000d84 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053025 Aug 09 17:54:42.662190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64aa24e4-2ff1-43aa-a5ef-611744235db4 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:42.662948 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2828/5919] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:54:42.663105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64aa24e4-2ff1-43aa-a5ef-611744235db4 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:42.664018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64aa24e4-2ff1-43aa-a5ef-611744235db4 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:42.665091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64aa24e4-2ff1-43aa-a5ef-611744235db4 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:42.666052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64aa24e4-2ff1-43aa-a5ef-611744235db4 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:42.666516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64aa24e4-2ff1-43aa-a5ef-611744235db4 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:42.798971 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-64aa24e4-2ff1-43aa-a5ef-611744235db4 tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 200 len: 1449 microversion: 2.1 time: 0.166220 Aug 09 17:54:42.799581 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3092/5920] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:42 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:43.009420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ff76cb48-baa0-4066-9af4-fac1c02ef35d tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:43.010815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ff76cb48-baa0-4066-9af4-fac1c02ef35d tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:43.018872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff76cb48-baa0-4066-9af4-fac1c02ef35d tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:43.019715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff76cb48-baa0-4066-9af4-fac1c02ef35d tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:43.020477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff76cb48-baa0-4066-9af4-fac1c02ef35d tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:43.021518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff76cb48-baa0-4066-9af4-fac1c02ef35d tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:43.022148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff76cb48-baa0-4066-9af4-fac1c02ef35d tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:43.022745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ff76cb48-baa0-4066-9af4-fac1c02ef35d tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:43.321983 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ff76cb48-baa0-4066-9af4-fac1c02ef35d tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1836 microversion: 2.1 time: 0.319047 Aug 09 17:54:43.323210 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2829/5921] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:43 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1836 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:43.362812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-900a7f8a-6579-449e-a9bc-7d2ea35d7e12 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:43.364115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-900a7f8a-6579-449e-a9bc-7d2ea35d7e12 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:43.372461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-900a7f8a-6579-449e-a9bc-7d2ea35d7e12 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:43.374084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-900a7f8a-6579-449e-a9bc-7d2ea35d7e12 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:43.374751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-900a7f8a-6579-449e-a9bc-7d2ea35d7e12 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:43.375717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-900a7f8a-6579-449e-a9bc-7d2ea35d7e12 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:43.376193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-900a7f8a-6579-449e-a9bc-7d2ea35d7e12 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:43.376636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-900a7f8a-6579-449e-a9bc-7d2ea35d7e12 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:43.557877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-900a7f8a-6579-449e-a9bc-7d2ea35d7e12 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:43.566755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-900a7f8a-6579-449e-a9bc-7d2ea35d7e12 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1685 microversion: 2.1 time: 0.208767 Aug 09 17:54:43.567921 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3093/5922] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:43 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1685 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:43.720056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e7adce7-898b-4f30-bf17-bbc778c24262 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:43.722512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0e7adce7-898b-4f30-bf17-bbc778c24262 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:43.731091 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e7adce7-898b-4f30-bf17-bbc778c24262 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:43.731591 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e7adce7-898b-4f30-bf17-bbc778c24262 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:43.732066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e7adce7-898b-4f30-bf17-bbc778c24262 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:43.732847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e7adce7-898b-4f30-bf17-bbc778c24262 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:43.733311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e7adce7-898b-4f30-bf17-bbc778c24262 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:43.733746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e7adce7-898b-4f30-bf17-bbc778c24262 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:43.800216 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e7adce7-898b-4f30-bf17-bbc778c24262 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d/action" status: 200 len: 32628 microversion: 2.1 time: 0.084882 Aug 09 17:54:43.802967 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2830/5923] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:54:43 2022] POST /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d/action => generated 32628 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:54:43.825059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:43.826040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] [instance: 26627f90-9b2d-4e76-a60f-4077a9859e6f] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:43.837749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:43.838942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:43.839798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:43.841081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:43.841949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:43.842555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:43.862972 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] HTTP exception thrown: Instance 26627f90-9b2d-4e76-a60f-4077a9859e6f could not be found. Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Request method failure captured: Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f HTTP/1.1 Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p84N-PAcCDUVHhpQ1XTnJ9WNizrO_r55yJ0rJfOwhtiz5Ds-8de4isR_1UPGfOnMCDxlRx9uQTJtTEjuusCW1Kcow9WdrZUaJfSD-lp2MyFutPcqqb_OmdQsDPMIj81ywWVlZ68QhwdBddDHmCAe81r7b2tMOEjWvhXR4vWiulLTPA Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: fbca5a4d51724a94909affa4bb8cc5b6 Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestServerMultinode-766607113 Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fbca5a4d51724a94909affa4bb8cc5b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fbca5a4d51724a94909affa4bb8cc5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fbca5a4d51724a94909affa4bb8cc5b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fbca5a4d51724a94909affa4bb8cc5b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestServerMultinode-766607113 Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: fbca5a4d51724a94909affa4bb8cc5b6 Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestServerMultinode-766607113 Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestServerMultinode-766607113-project-admin Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 458fbfd265da4df0897eb9a075e548fb Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestServerMultinode-766607113-project-admin Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 26627f90-9b2d-4e76-a60f-4077a9859e6f could not be found. Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '26627f90-9b2d-4e76-a60f-4077a9859e6f'} Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26627f90-9b2d-4e76-a60f-4077a9859e6f could not be found. Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26627f90-9b2d-4e76-a60f-4077a9859e6f could not be found. Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:54:43.865033 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:43.869323 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:54:43.869323 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:54:43.869323 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:54:43.869323 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:54:43.869323 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:54:43.869323 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26627f90-9b2d-4e76-a60f-4077a9859e6f could not be found. Aug 09 17:54:43.869323 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:54:43.870854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] Returning 404 to user: Instance 26627f90-9b2d-4e76-a60f-4077a9859e6f could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:54:43.871953 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7a252486-471d-4898-93d6-d31dc9a7b38f tempest-TestServerMultinode-766607113 tempest-TestServerMultinode-766607113-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f" status: 404 len: 111 microversion: 2.1 time: 0.053987 Aug 09 17:54:43.873034 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3094/5924] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:43 2022] GET /compute/v2.1/servers/26627f90-9b2d-4e76-a60f-4077a9859e6f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:54:44.046307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:54:44.047248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:44.063305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:44.064546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:44.065251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:44.067156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:44.067891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:44.071947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:44.092992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:44.156785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'de183bb4df1d4c8297d4a484c15f06f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86806e35e72c4b2683a85aea20a2f730', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:44.158820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] flavor_id is None. Assuming migration. {{(pid=119432) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 09 17:54:44.160524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119432) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 17:54:44.657666 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0feaa8c7-86b6-4e87-bb93-d47d91704b33 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d/action" status: 202 len: 0 microversion: 2.1 time: 0.615288 Aug 09 17:54:44.658802 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2831/5925] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:54:44 2022] POST /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:54:44.666746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67f43086-a79b-471c-b406-1cf90125499a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:44.667696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-67f43086-a79b-471c-b406-1cf90125499a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:44.686166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f43086-a79b-471c-b406-1cf90125499a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:44.687837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f43086-a79b-471c-b406-1cf90125499a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:44.688480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f43086-a79b-471c-b406-1cf90125499a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:44.690121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f43086-a79b-471c-b406-1cf90125499a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:44.694693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f43086-a79b-471c-b406-1cf90125499a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:44.696215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67f43086-a79b-471c-b406-1cf90125499a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:44.699723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:54:44.964341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-67f43086-a79b-471c-b406-1cf90125499a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:44.977622 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-67f43086-a79b-471c-b406-1cf90125499a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1694 microversion: 2.1 time: 0.314511 Aug 09 17:54:44.978765 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3095/5926] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:44 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1694 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:46.017514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-59cc6791-b8cc-42dd-a6ce-1542baf06199 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:46.020440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-59cc6791-b8cc-42dd-a6ce-1542baf06199 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:46.031036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59cc6791-b8cc-42dd-a6ce-1542baf06199 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:46.033485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59cc6791-b8cc-42dd-a6ce-1542baf06199 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:46.034298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59cc6791-b8cc-42dd-a6ce-1542baf06199 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:46.035498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59cc6791-b8cc-42dd-a6ce-1542baf06199 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:46.036889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59cc6791-b8cc-42dd-a6ce-1542baf06199 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:46.037599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-59cc6791-b8cc-42dd-a6ce-1542baf06199 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:46.654735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-59cc6791-b8cc-42dd-a6ce-1542baf06199 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:46.664075 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-59cc6791-b8cc-42dd-a6ce-1542baf06199 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1694 microversion: 2.1 time: 0.657818 Aug 09 17:54:46.665117 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2832/5927] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:46 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1694 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:47.688021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f4941ff2-0e3a-4134-93f8-943df2ed1d3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:47.689394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f4941ff2-0e3a-4134-93f8-943df2ed1d3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:47.711929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4941ff2-0e3a-4134-93f8-943df2ed1d3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:47.712700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4941ff2-0e3a-4134-93f8-943df2ed1d3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:47.717450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4941ff2-0e3a-4134-93f8-943df2ed1d3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:47.718814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4941ff2-0e3a-4134-93f8-943df2ed1d3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:47.726948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4941ff2-0e3a-4134-93f8-943df2ed1d3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:47.728067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f4941ff2-0e3a-4134-93f8-943df2ed1d3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:48.096780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f4941ff2-0e3a-4134-93f8-943df2ed1d3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:48.110378 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f4941ff2-0e3a-4134-93f8-943df2ed1d3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1694 microversion: 2.1 time: 0.427526 Aug 09 17:54:48.111958 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3096/5928] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:47 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1694 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:49.134911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c2f16c3c-511f-473c-a46c-08facdef7b7c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:49.135776 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c2f16c3c-511f-473c-a46c-08facdef7b7c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:49.154995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2f16c3c-511f-473c-a46c-08facdef7b7c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:49.157825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2f16c3c-511f-473c-a46c-08facdef7b7c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:49.158293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2f16c3c-511f-473c-a46c-08facdef7b7c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:49.159064 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2f16c3c-511f-473c-a46c-08facdef7b7c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:49.159581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2f16c3c-511f-473c-a46c-08facdef7b7c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:49.160075 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c2f16c3c-511f-473c-a46c-08facdef7b7c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:49.556211 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c2f16c3c-511f-473c-a46c-08facdef7b7c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:49.577835 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c2f16c3c-511f-473c-a46c-08facdef7b7c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.447859 Aug 09 17:54:49.578900 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2833/5929] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:49 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:54:50.607601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ee38f63a-809b-45e0-8906-661a34088548 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:50.609717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ee38f63a-809b-45e0-8906-661a34088548 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:50.617403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee38f63a-809b-45e0-8906-661a34088548 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:50.618109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee38f63a-809b-45e0-8906-661a34088548 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:50.618745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee38f63a-809b-45e0-8906-661a34088548 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:50.619656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee38f63a-809b-45e0-8906-661a34088548 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:50.620292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee38f63a-809b-45e0-8906-661a34088548 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:50.620724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee38f63a-809b-45e0-8906-661a34088548 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:50.842662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ee38f63a-809b-45e0-8906-661a34088548 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:50.852678 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ee38f63a-809b-45e0-8906-661a34088548 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.251256 Aug 09 17:54:50.874533 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3097/5930] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:50 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:51.896419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f0178a94-fb26-40f6-8ed7-9e36c9ab029a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:51.898383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f0178a94-fb26-40f6-8ed7-9e36c9ab029a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:51.910657 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0178a94-fb26-40f6-8ed7-9e36c9ab029a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:51.911158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0178a94-fb26-40f6-8ed7-9e36c9ab029a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:51.911599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0178a94-fb26-40f6-8ed7-9e36c9ab029a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:51.912532 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0178a94-fb26-40f6-8ed7-9e36c9ab029a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:51.913640 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0178a94-fb26-40f6-8ed7-9e36c9ab029a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:51.914268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f0178a94-fb26-40f6-8ed7-9e36c9ab029a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:52.323944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f0178a94-fb26-40f6-8ed7-9e36c9ab029a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:52.347168 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f0178a94-fb26-40f6-8ed7-9e36c9ab029a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.457416 Aug 09 17:54:52.353218 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2834/5931] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:51 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:53.368529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b86da8d-e15c-4167-9018-fe858e68e562 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:53.369819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b86da8d-e15c-4167-9018-fe858e68e562 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:53.382812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86da8d-e15c-4167-9018-fe858e68e562 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:53.385831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86da8d-e15c-4167-9018-fe858e68e562 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:53.386321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86da8d-e15c-4167-9018-fe858e68e562 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:53.387113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86da8d-e15c-4167-9018-fe858e68e562 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:53.387598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86da8d-e15c-4167-9018-fe858e68e562 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:53.391066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b86da8d-e15c-4167-9018-fe858e68e562 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:53.693673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8b86da8d-e15c-4167-9018-fe858e68e562 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:53.705726 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b86da8d-e15c-4167-9018-fe858e68e562 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.339118 Aug 09 17:54:53.709689 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3098/5932] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:53 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:54.735420 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-811be5fd-6ba5-49ba-9da8-7073fbe2a3fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:54.740622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-811be5fd-6ba5-49ba-9da8-7073fbe2a3fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:54.776599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-811be5fd-6ba5-49ba-9da8-7073fbe2a3fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:54.778713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-811be5fd-6ba5-49ba-9da8-7073fbe2a3fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:54.780315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-811be5fd-6ba5-49ba-9da8-7073fbe2a3fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:54.782165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-811be5fd-6ba5-49ba-9da8-7073fbe2a3fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:54.782902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-811be5fd-6ba5-49ba-9da8-7073fbe2a3fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:54.783611 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-811be5fd-6ba5-49ba-9da8-7073fbe2a3fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:55.093410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-811be5fd-6ba5-49ba-9da8-7073fbe2a3fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:55.102638 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-811be5fd-6ba5-49ba-9da8-7073fbe2a3fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.374742 Aug 09 17:54:55.103351 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2835/5933] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:54 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:56.129387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1249827b-da3d-4572-ba43-e440c41486dd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:56.131393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1249827b-da3d-4572-ba43-e440c41486dd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:56.145439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1249827b-da3d-4572-ba43-e440c41486dd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:56.151364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1249827b-da3d-4572-ba43-e440c41486dd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:56.151942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1249827b-da3d-4572-ba43-e440c41486dd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:56.153248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1249827b-da3d-4572-ba43-e440c41486dd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:56.153887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1249827b-da3d-4572-ba43-e440c41486dd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:56.154781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1249827b-da3d-4572-ba43-e440c41486dd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:56.374494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1249827b-da3d-4572-ba43-e440c41486dd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:56.384752 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1249827b-da3d-4572-ba43-e440c41486dd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.263706 Aug 09 17:54:56.386410 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3099/5934] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:56 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:57.423404 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5190d0f2-0204-4f75-8741-0dc977c636e6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:57.425364 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5190d0f2-0204-4f75-8741-0dc977c636e6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:57.433696 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5190d0f2-0204-4f75-8741-0dc977c636e6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:57.435224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5190d0f2-0204-4f75-8741-0dc977c636e6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:57.435891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5190d0f2-0204-4f75-8741-0dc977c636e6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:57.436791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5190d0f2-0204-4f75-8741-0dc977c636e6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:57.438403 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5190d0f2-0204-4f75-8741-0dc977c636e6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:57.439068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5190d0f2-0204-4f75-8741-0dc977c636e6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:57.665140 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5190d0f2-0204-4f75-8741-0dc977c636e6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:57.680494 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5190d0f2-0204-4f75-8741-0dc977c636e6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.263379 Aug 09 17:54:57.683975 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2836/5935] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:57 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:54:58.723075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94601480-bb98-4980-96e1-7213af00c467 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:54:58.723581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94601480-bb98-4980-96e1-7213af00c467 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:54:58.738102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94601480-bb98-4980-96e1-7213af00c467 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:58.738607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94601480-bb98-4980-96e1-7213af00c467 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:58.739058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94601480-bb98-4980-96e1-7213af00c467 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:58.739840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94601480-bb98-4980-96e1-7213af00c467 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:54:58.744534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94601480-bb98-4980-96e1-7213af00c467 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:54:58.747878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94601480-bb98-4980-96e1-7213af00c467 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:54:59.049678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94601480-bb98-4980-96e1-7213af00c467 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:54:59.062015 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94601480-bb98-4980-96e1-7213af00c467 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.343625 Aug 09 17:54:59.063361 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3100/5936] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:54:58 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:00.099689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e6b86563-bbc5-41c2-b0b5-e356dd7c1189 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:00.101191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e6b86563-bbc5-41c2-b0b5-e356dd7c1189 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:00.166582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6b86563-bbc5-41c2-b0b5-e356dd7c1189 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:00.179036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6b86563-bbc5-41c2-b0b5-e356dd7c1189 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:00.181004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6b86563-bbc5-41c2-b0b5-e356dd7c1189 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:00.186983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6b86563-bbc5-41c2-b0b5-e356dd7c1189 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:00.187957 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6b86563-bbc5-41c2-b0b5-e356dd7c1189 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:00.190176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e6b86563-bbc5-41c2-b0b5-e356dd7c1189 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:00.724949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e6b86563-bbc5-41c2-b0b5-e356dd7c1189 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:00.744973 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e6b86563-bbc5-41c2-b0b5-e356dd7c1189 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.660464 Aug 09 17:55:00.746280 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2837/5937] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:00 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:01.768730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4add3f4-5aee-4c11-a8fb-6e1d1196cc03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:01.770154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a4add3f4-5aee-4c11-a8fb-6e1d1196cc03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:01.792725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4add3f4-5aee-4c11-a8fb-6e1d1196cc03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:01.793375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4add3f4-5aee-4c11-a8fb-6e1d1196cc03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:01.793929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4add3f4-5aee-4c11-a8fb-6e1d1196cc03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:01.794793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4add3f4-5aee-4c11-a8fb-6e1d1196cc03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:01.795350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4add3f4-5aee-4c11-a8fb-6e1d1196cc03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:01.795961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4add3f4-5aee-4c11-a8fb-6e1d1196cc03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:02.675972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a4add3f4-5aee-4c11-a8fb-6e1d1196cc03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:02.690005 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4add3f4-5aee-4c11-a8fb-6e1d1196cc03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.926144 Aug 09 17:55:02.693867 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3101/5938] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:01 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:03.722424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7b7767fd-bd6e-4983-b041-5ededc091e66 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:03.724700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7b7767fd-bd6e-4983-b041-5ededc091e66 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:03.735568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:03.766264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7767fd-bd6e-4983-b041-5ededc091e66 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:03.773755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7767fd-bd6e-4983-b041-5ededc091e66 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:03.774464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7767fd-bd6e-4983-b041-5ededc091e66 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:03.775466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7767fd-bd6e-4983-b041-5ededc091e66 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:03.784473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7767fd-bd6e-4983-b041-5ededc091e66 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:03.790246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7b7767fd-bd6e-4983-b041-5ededc091e66 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:04.115912 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7b7767fd-bd6e-4983-b041-5ededc091e66 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:04.128012 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7b7767fd-bd6e-4983-b041-5ededc091e66 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.412368 Aug 09 17:55:04.130722 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2838/5939] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:03 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:05.169900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-35b20f31-3d7a-4b7c-a6f1-8c1ee5ff6ed0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:05.170704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-35b20f31-3d7a-4b7c-a6f1-8c1ee5ff6ed0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:05.173598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=40 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:05.181063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b20f31-3d7a-4b7c-a6f1-8c1ee5ff6ed0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:05.181868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b20f31-3d7a-4b7c-a6f1-8c1ee5ff6ed0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:05.182641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b20f31-3d7a-4b7c-a6f1-8c1ee5ff6ed0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:05.183851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b20f31-3d7a-4b7c-a6f1-8c1ee5ff6ed0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:05.184854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b20f31-3d7a-4b7c-a6f1-8c1ee5ff6ed0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:05.185585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35b20f31-3d7a-4b7c-a6f1-8c1ee5ff6ed0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:05.490936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-35b20f31-3d7a-4b7c-a6f1-8c1ee5ff6ed0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:05.517687 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-35b20f31-3d7a-4b7c-a6f1-8c1ee5ff6ed0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.353096 Aug 09 17:55:05.520442 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3102/5940] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:05 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:05.611119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-29063299-4b24-4d6c-83c3-fff9bd0f9f0a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Action: 'create', calling method: .version_select at 0x7fbbca5a9820>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-467149186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGhC15URQAOA0U0qHcTWnvvMgXgigBl4Qkc00Vwt++3hnt8dDLfEz4EBe7YlZf90GfJ25GirewVSh+uDC49UVLFIHo9Y7q1alSart8eR1peaQnUk3cAqNh0q9dIxdTqyg=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:05.656727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-29063299-4b24-4d6c-83c3-fff9bd0f9f0a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Getting quotas for project 10cf440736d44ffeb229c876d15675a4. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:55:05.677276 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-29063299-4b24-4d6c-83c3-fff9bd0f9f0a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Getting quotas for user 5b45f77241094ce9b09ff6c48edb868b and project 10cf440736d44ffeb229c876d15675a4. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:55:05.741176 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-29063299-4b24-4d6c-83c3-fff9bd0f9f0a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.149788 Aug 09 17:55:05.744817 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2839/5941] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:55:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:55:06.315995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-23747525-8caf-4936-bfd5-472824c24145 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:06.317473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-23747525-8caf-4936-bfd5-472824c24145 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:06.330859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23747525-8caf-4936-bfd5-472824c24145 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:06.331868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23747525-8caf-4936-bfd5-472824c24145 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:06.332571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23747525-8caf-4936-bfd5-472824c24145 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:06.334255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23747525-8caf-4936-bfd5-472824c24145 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:06.335822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23747525-8caf-4936-bfd5-472824c24145 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:06.336634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23747525-8caf-4936-bfd5-472824c24145 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:06.392261 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-23747525-8caf-4936-bfd5-472824c24145 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.089202 Aug 09 17:55:06.394129 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3103/5942] 10.222.0.93 () {58 vars in 1293 bytes} [Tue Aug 9 17:55:06 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3/os-server-password => generated 116 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:55:06.555224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-672566e6-b444-46d8-9d2f-244b4bde8f1a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:06.556005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-672566e6-b444-46d8-9d2f-244b4bde8f1a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:06.564815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-672566e6-b444-46d8-9d2f-244b4bde8f1a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:06.565430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-672566e6-b444-46d8-9d2f-244b4bde8f1a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:06.565966 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-672566e6-b444-46d8-9d2f-244b4bde8f1a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:06.566784 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-672566e6-b444-46d8-9d2f-244b4bde8f1a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:06.567537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-672566e6-b444-46d8-9d2f-244b4bde8f1a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:06.568129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-672566e6-b444-46d8-9d2f-244b4bde8f1a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:06.836260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-672566e6-b444-46d8-9d2f-244b4bde8f1a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:06.861632 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-672566e6-b444-46d8-9d2f-244b4bde8f1a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.308354 Aug 09 17:55:06.864050 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2840/5943] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:06 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:07.891553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a60fccae-53e2-4fc4-8259-f652b78a1194 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:07.892400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a60fccae-53e2-4fc4-8259-f652b78a1194 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:07.908625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a60fccae-53e2-4fc4-8259-f652b78a1194 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:07.909143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a60fccae-53e2-4fc4-8259-f652b78a1194 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:07.909593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a60fccae-53e2-4fc4-8259-f652b78a1194 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:07.911387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a60fccae-53e2-4fc4-8259-f652b78a1194 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:07.911937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a60fccae-53e2-4fc4-8259-f652b78a1194 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:07.913064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a60fccae-53e2-4fc4-8259-f652b78a1194 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:08.060689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-662995184", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3ae862d5-3caf-4faa-9110-eddfb05614b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-467149186", "security_groups": [{"name": "tempest-secgroup-smoke-1969426941"}], "networks": [{"uuid": "b597099b-5ee1-4275-b130-92cf98be4614"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:08.440031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] validate_networks() for [('b597099b-5ee1-4275-b130-92cf98be4614', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:55:08.513627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a60fccae-53e2-4fc4-8259-f652b78a1194 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:08.534436 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a60fccae-53e2-4fc4-8259-f652b78a1194 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.645935 Aug 09 17:55:08.535356 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3104/5944] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:07 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:09.347616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:55:09.349319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:55:09.350609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:55:09.351287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:55:09.352187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:55:09.381234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:09.382154 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:09.386104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:09.391037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:09.394165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:09.395416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:09.464868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Getting quotas for project 10cf440736d44ffeb229c876d15675a4. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:55:09.485188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Getting quotas for user 5b45f77241094ce9b09ff6c48edb868b and project 10cf440736d44ffeb229c876d15675a4. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:55:09.559749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-13dd79f3-9350-452d-b477-cbcb868bc6a1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:09.561492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-13dd79f3-9350-452d-b477-cbcb868bc6a1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:09.578441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13dd79f3-9350-452d-b477-cbcb868bc6a1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:09.579504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13dd79f3-9350-452d-b477-cbcb868bc6a1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:09.581251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13dd79f3-9350-452d-b477-cbcb868bc6a1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:09.583018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13dd79f3-9350-452d-b477-cbcb868bc6a1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:09.587821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13dd79f3-9350-452d-b477-cbcb868bc6a1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:09.590408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13dd79f3-9350-452d-b477-cbcb868bc6a1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:09.662109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:55:09.664679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ae862d5-3caf-4faa-9110-eddfb05614b4',volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:55:10.177726 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f399610a-9937-464f-9438-e821c0140c52 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.121100 Aug 09 17:55:10.189563 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2841/5945] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:55:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:55:10.201244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2c838903-507a-4c98-943e-ddcb9b7c22b1 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:10.203299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13dd79f3-9350-452d-b477-cbcb868bc6a1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:10.207121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2c838903-507a-4c98-943e-ddcb9b7c22b1 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:10.219356 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-13dd79f3-9350-452d-b477-cbcb868bc6a1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1699 microversion: 2.1 time: 0.660558 Aug 09 17:55:10.224473 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3105/5946] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:09 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1699 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:10.408811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2c838903-507a-4c98-943e-ddcb9b7c22b1 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:10.432077 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2c838903-507a-4c98-943e-ddcb9b7c22b1 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1097 microversion: 2.1 time: 0.238928 Aug 09 17:55:10.436059 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2842/5947] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:10 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1097 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:11.255856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ca29258-c539-48ac-8ff0-b76c9432b3be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:11.257281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2ca29258-c539-48ac-8ff0-b76c9432b3be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:11.273416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ca29258-c539-48ac-8ff0-b76c9432b3be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:11.274588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ca29258-c539-48ac-8ff0-b76c9432b3be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:11.275903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ca29258-c539-48ac-8ff0-b76c9432b3be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:11.278050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ca29258-c539-48ac-8ff0-b76c9432b3be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:11.280135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ca29258-c539-48ac-8ff0-b76c9432b3be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:11.281023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ca29258-c539-48ac-8ff0-b76c9432b3be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:11.475684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-55d17e94-f0bd-4cb2-b1b3-ab614dba7c45 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:11.476922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-55d17e94-f0bd-4cb2-b1b3-ab614dba7c45 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:11.494328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55d17e94-f0bd-4cb2-b1b3-ab614dba7c45 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:11.495026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55d17e94-f0bd-4cb2-b1b3-ab614dba7c45 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:11.496204 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55d17e94-f0bd-4cb2-b1b3-ab614dba7c45 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:11.497459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55d17e94-f0bd-4cb2-b1b3-ab614dba7c45 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:11.498350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55d17e94-f0bd-4cb2-b1b3-ab614dba7c45 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:11.505267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-55d17e94-f0bd-4cb2-b1b3-ab614dba7c45 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:11.656093 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-55d17e94-f0bd-4cb2-b1b3-ab614dba7c45 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:11.678010 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-55d17e94-f0bd-4cb2-b1b3-ab614dba7c45 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1147 microversion: 2.1 time: 0.207183 Aug 09 17:55:11.679306 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2843/5948] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:11 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1147 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:12.707459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d9a113cc-9c00-47ef-864f-a33c64b9696a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:12.709733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d9a113cc-9c00-47ef-864f-a33c64b9696a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:12.720247 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9a113cc-9c00-47ef-864f-a33c64b9696a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:12.721222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9a113cc-9c00-47ef-864f-a33c64b9696a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:12.722565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9a113cc-9c00-47ef-864f-a33c64b9696a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:12.723760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9a113cc-9c00-47ef-864f-a33c64b9696a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:12.724528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9a113cc-9c00-47ef-864f-a33c64b9696a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:12.725626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d9a113cc-9c00-47ef-864f-a33c64b9696a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:12.916748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d9a113cc-9c00-47ef-864f-a33c64b9696a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:12.930830 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d9a113cc-9c00-47ef-864f-a33c64b9696a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1213 microversion: 2.1 time: 0.233286 Aug 09 17:55:12.933301 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2844/5949] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:12 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1213 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:13.039123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2ca29258-c539-48ac-8ff0-b76c9432b3be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:13.051507 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ca29258-c539-48ac-8ff0-b76c9432b3be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1698 microversion: 2.1 time: 1.799802 Aug 09 17:55:13.053463 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3106/5950] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:11 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1698 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:13.898789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-0af2a9ec-f000-45f3-a5a9-32da9260ed1d req-8ea86fe3-633f-4356-9780-95a8348a323b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3ac82a-2978-42ba-a133-a5db20652f5d", "name": "network-vif-unplugged", "status": "completed", "tag": "b09f6bbd-ae75-4189-b58f-5b1f600d8c2b"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:13.926956 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0af2a9ec-f000-45f3-a5a9-32da9260ed1d req-8ea86fe3-633f-4356-9780-95a8348a323b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:13.927458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0af2a9ec-f000-45f3-a5a9-32da9260ed1d req-8ea86fe3-633f-4356-9780-95a8348a323b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:13.927944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-0af2a9ec-f000-45f3-a5a9-32da9260ed1d req-8ea86fe3-633f-4356-9780-95a8348a323b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:13.955150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f186acee-588b-4429-b715-daef1a087aea tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:13.955821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f186acee-588b-4429-b715-daef1a087aea tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:13.972023 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-0af2a9ec-f000-45f3-a5a9-32da9260ed1d req-8ea86fe3-633f-4356-9780-95a8348a323b service nova] Creating event network-vif-unplugged:b09f6bbd-ae75-4189-b58f-5b1f600d8c2b for instance af3ac82a-2978-42ba-a133-a5db20652f5d on n-h2-845781-6 Aug 09 17:55:13.981310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f186acee-588b-4429-b715-daef1a087aea tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:13.984395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f186acee-588b-4429-b715-daef1a087aea tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:13.984983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f186acee-588b-4429-b715-daef1a087aea tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:13.988494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f186acee-588b-4429-b715-daef1a087aea tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:13.990809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f186acee-588b-4429-b715-daef1a087aea tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:13.991282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f186acee-588b-4429-b715-daef1a087aea tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:13.998428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-0af2a9ec-f000-45f3-a5a9-32da9260ed1d req-8ea86fe3-633f-4356-9780-95a8348a323b service nova] Instance af3ac82a-2978-42ba-a133-a5db20652f5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:55:14.066743 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-0af2a9ec-f000-45f3-a5a9-32da9260ed1d req-8ea86fe3-633f-4356-9780-95a8348a323b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174098 Aug 09 17:55:14.070289 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2845/5951] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:55:14.100535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-31b24816-c167-4ea5-9c91-0a3380a89629 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:14.107830 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-31b24816-c167-4ea5-9c91-0a3380a89629 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:14.150518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b24816-c167-4ea5-9c91-0a3380a89629 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:14.151990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b24816-c167-4ea5-9c91-0a3380a89629 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:14.153034 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b24816-c167-4ea5-9c91-0a3380a89629 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:14.159517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b24816-c167-4ea5-9c91-0a3380a89629 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:14.161294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b24816-c167-4ea5-9c91-0a3380a89629 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:14.162334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-31b24816-c167-4ea5-9c91-0a3380a89629 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:14.188475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:14.243248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f186acee-588b-4429-b715-daef1a087aea tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:14.253449 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f186acee-588b-4429-b715-daef1a087aea tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1213 microversion: 2.1 time: 0.302205 Aug 09 17:55:14.254677 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3107/5952] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:13 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1213 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:14.900980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-31b24816-c167-4ea5-9c91-0a3380a89629 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:14.912003 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-31b24816-c167-4ea5-9c91-0a3380a89629 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1698 microversion: 2.1 time: 0.835751 Aug 09 17:55:14.920730 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2846/5953] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:14 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1698 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:15.277719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-37c34186-7f76-47d8-954b-603b64cde19c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:15.279334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-37c34186-7f76-47d8-954b-603b64cde19c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:15.288799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37c34186-7f76-47d8-954b-603b64cde19c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:15.289753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37c34186-7f76-47d8-954b-603b64cde19c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:15.290367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37c34186-7f76-47d8-954b-603b64cde19c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:15.291297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37c34186-7f76-47d8-954b-603b64cde19c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:15.292018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37c34186-7f76-47d8-954b-603b64cde19c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:15.292675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37c34186-7f76-47d8-954b-603b64cde19c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:15.328369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=76 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:15.942645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-675e61d5-9f7d-40f4-93cb-70fbc7089a0c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:15.962020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-37c34186-7f76-47d8-954b-603b64cde19c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:15.968941 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-675e61d5-9f7d-40f4-93cb-70fbc7089a0c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:16.006234 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-37c34186-7f76-47d8-954b-603b64cde19c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1281 microversion: 2.1 time: 0.718659 Aug 09 17:55:16.015495 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3108/5954] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:15 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1281 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:16.017748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675e61d5-9f7d-40f4-93cb-70fbc7089a0c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:16.025880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675e61d5-9f7d-40f4-93cb-70fbc7089a0c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:16.028709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675e61d5-9f7d-40f4-93cb-70fbc7089a0c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:16.033008 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675e61d5-9f7d-40f4-93cb-70fbc7089a0c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:16.036144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675e61d5-9f7d-40f4-93cb-70fbc7089a0c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:16.038410 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-675e61d5-9f7d-40f4-93cb-70fbc7089a0c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:16.142165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5aea8ef3-6c3e-4a4f-a780-b8655f26bf82 req-92e006ab-80b0-4552-abfd-eb06a67bc5aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3ac82a-2978-42ba-a133-a5db20652f5d", "tag": "b09f6bbd-ae75-4189-b58f-5b1f600d8c2b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:16.155419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5aea8ef3-6c3e-4a4f-a780-b8655f26bf82 req-92e006ab-80b0-4552-abfd-eb06a67bc5aa service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:16.156340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5aea8ef3-6c3e-4a4f-a780-b8655f26bf82 req-92e006ab-80b0-4552-abfd-eb06a67bc5aa service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:16.157145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5aea8ef3-6c3e-4a4f-a780-b8655f26bf82 req-92e006ab-80b0-4552-abfd-eb06a67bc5aa service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:16.185229 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5aea8ef3-6c3e-4a4f-a780-b8655f26bf82 req-92e006ab-80b0-4552-abfd-eb06a67bc5aa service nova] Creating event network-changed:b09f6bbd-ae75-4189-b58f-5b1f600d8c2b for instance af3ac82a-2978-42ba-a133-a5db20652f5d on n-h2-845781-6 Aug 09 17:55:16.197665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-5aea8ef3-6c3e-4a4f-a780-b8655f26bf82 req-92e006ab-80b0-4552-abfd-eb06a67bc5aa service nova] Instance af3ac82a-2978-42ba-a133-a5db20652f5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:55:16.212593 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5aea8ef3-6c3e-4a4f-a780-b8655f26bf82 req-92e006ab-80b0-4552-abfd-eb06a67bc5aa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077758 Aug 09 17:55:16.215508 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3109/5955] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:55:16.876573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-675e61d5-9f7d-40f4-93cb-70fbc7089a0c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:16.894394 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-675e61d5-9f7d-40f4-93cb-70fbc7089a0c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1698 microversion: 2.1 time: 0.959381 Aug 09 17:55:16.894988 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2847/5956] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:15 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1698 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:17.035146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26d3c6b5-6728-45d2-b2d4-c2b82f65942c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:17.036568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-26d3c6b5-6728-45d2-b2d4-c2b82f65942c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:17.056072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26d3c6b5-6728-45d2-b2d4-c2b82f65942c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:17.056650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26d3c6b5-6728-45d2-b2d4-c2b82f65942c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:17.057631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26d3c6b5-6728-45d2-b2d4-c2b82f65942c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:17.058350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26d3c6b5-6728-45d2-b2d4-c2b82f65942c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:17.058811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26d3c6b5-6728-45d2-b2d4-c2b82f65942c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:17.059246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26d3c6b5-6728-45d2-b2d4-c2b82f65942c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:17.917642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-87fd5249-4103-416d-84e3-96a619f92e74 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:17.918392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-87fd5249-4103-416d-84e3-96a619f92e74 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:17.933050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87fd5249-4103-416d-84e3-96a619f92e74 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:17.936115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87fd5249-4103-416d-84e3-96a619f92e74 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:17.936924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87fd5249-4103-416d-84e3-96a619f92e74 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:17.937872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87fd5249-4103-416d-84e3-96a619f92e74 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:17.939967 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87fd5249-4103-416d-84e3-96a619f92e74 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:17.940624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-87fd5249-4103-416d-84e3-96a619f92e74 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:18.024941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-26d3c6b5-6728-45d2-b2d4-c2b82f65942c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:18.036174 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-26d3c6b5-6728-45d2-b2d4-c2b82f65942c tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1281 microversion: 2.1 time: 1.005264 Aug 09 17:55:18.049176 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3110/5957] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:17 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1281 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:18.325548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-38bc53ab-7239-4bcd-97ab-40d06812c7dd req-d5c51a55-8249-4ac4-a23f-634b6ec6b229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6deeed13-eae8-4843-8d55-2b1ecf02b624", "tag": "df10f198-4b53-4454-b6a1-5f77d9a839de"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:18.361099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-38bc53ab-7239-4bcd-97ab-40d06812c7dd req-d5c51a55-8249-4ac4-a23f-634b6ec6b229 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:18.362342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-38bc53ab-7239-4bcd-97ab-40d06812c7dd req-d5c51a55-8249-4ac4-a23f-634b6ec6b229 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:18.363310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-38bc53ab-7239-4bcd-97ab-40d06812c7dd req-d5c51a55-8249-4ac4-a23f-634b6ec6b229 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:18.389095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-87fd5249-4103-416d-84e3-96a619f92e74 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:18.402439 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-38bc53ab-7239-4bcd-97ab-40d06812c7dd req-d5c51a55-8249-4ac4-a23f-634b6ec6b229 service nova] Creating event network-changed:df10f198-4b53-4454-b6a1-5f77d9a839de for instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 on n-h1-845781-6 Aug 09 17:55:18.409971 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-38bc53ab-7239-4bcd-97ab-40d06812c7dd req-d5c51a55-8249-4ac4-a23f-634b6ec6b229 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092123 Aug 09 17:55:18.413276 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3111/5958] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:55:18.434869 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-87fd5249-4103-416d-84e3-96a619f92e74 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1698 microversion: 2.1 time: 0.521682 Aug 09 17:55:18.453834 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2848/5959] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:17 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1698 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:19.064750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ba656000-9c0f-4a2e-b5d2-6af87fb78caf tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:19.065633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba656000-9c0f-4a2e-b5d2-6af87fb78caf tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:19.080978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba656000-9c0f-4a2e-b5d2-6af87fb78caf tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:19.081403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba656000-9c0f-4a2e-b5d2-6af87fb78caf tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:19.081859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba656000-9c0f-4a2e-b5d2-6af87fb78caf tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:19.082602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba656000-9c0f-4a2e-b5d2-6af87fb78caf tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:19.083067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba656000-9c0f-4a2e-b5d2-6af87fb78caf tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:19.083500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba656000-9c0f-4a2e-b5d2-6af87fb78caf tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:19.480248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-60089287-2b5a-4212-bcf5-1a784cde6804 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:19.481382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-60089287-2b5a-4212-bcf5-1a784cde6804 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:19.522205 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:19.525058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60089287-2b5a-4212-bcf5-1a784cde6804 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:19.541677 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60089287-2b5a-4212-bcf5-1a784cde6804 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:19.542625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60089287-2b5a-4212-bcf5-1a784cde6804 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:19.553094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60089287-2b5a-4212-bcf5-1a784cde6804 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:19.554512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60089287-2b5a-4212-bcf5-1a784cde6804 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:19.555748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-60089287-2b5a-4212-bcf5-1a784cde6804 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:19.694585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ba656000-9c0f-4a2e-b5d2-6af87fb78caf tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:19.755617 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ba656000-9c0f-4a2e-b5d2-6af87fb78caf tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1281 microversion: 2.1 time: 0.688927 Aug 09 17:55:19.771676 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3112/5960] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:19 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1281 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:20.053858 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-60089287-2b5a-4212-bcf5-1a784cde6804 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:20.063396 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-60089287-2b5a-4212-bcf5-1a784cde6804 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1696 microversion: 2.1 time: 0.591695 Aug 09 17:55:20.066016 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2849/5961] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:19 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1696 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:20.802940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8fc3c370-e6a6-4baa-9fe5-af0e6e55b0a8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:20.804157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8fc3c370-e6a6-4baa-9fe5-af0e6e55b0a8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:20.832968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fc3c370-e6a6-4baa-9fe5-af0e6e55b0a8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:20.833870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fc3c370-e6a6-4baa-9fe5-af0e6e55b0a8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:20.834693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fc3c370-e6a6-4baa-9fe5-af0e6e55b0a8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:20.841111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fc3c370-e6a6-4baa-9fe5-af0e6e55b0a8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:20.842543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fc3c370-e6a6-4baa-9fe5-af0e6e55b0a8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:20.848563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fc3c370-e6a6-4baa-9fe5-af0e6e55b0a8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:21.097700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=12 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:21.121441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-51cfdaf3-7015-45aa-8156-03152ef0543e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:21.122744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-51cfdaf3-7015-45aa-8156-03152ef0543e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:21.135459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51cfdaf3-7015-45aa-8156-03152ef0543e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:21.137356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51cfdaf3-7015-45aa-8156-03152ef0543e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:21.138427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51cfdaf3-7015-45aa-8156-03152ef0543e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:21.139596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51cfdaf3-7015-45aa-8156-03152ef0543e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:21.141144 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51cfdaf3-7015-45aa-8156-03152ef0543e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:21.142169 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-51cfdaf3-7015-45aa-8156-03152ef0543e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:21.407295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8fc3c370-e6a6-4baa-9fe5-af0e6e55b0a8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:21.435605 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8fc3c370-e6a6-4baa-9fe5-af0e6e55b0a8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1281 microversion: 2.1 time: 0.631372 Aug 09 17:55:21.448692 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3113/5962] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:20 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1281 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:21.493162 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-51cfdaf3-7015-45aa-8156-03152ef0543e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:21.514803 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-51cfdaf3-7015-45aa-8156-03152ef0543e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1693 microversion: 2.1 time: 0.418836 Aug 09 17:55:21.516713 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2850/5963] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:21 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1693 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:21.537294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-805523b2-9aa9-457a-bf82-1cf6dbea637f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:21.537860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-805523b2-9aa9-457a-bf82-1cf6dbea637f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:21.557730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805523b2-9aa9-457a-bf82-1cf6dbea637f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:21.558550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805523b2-9aa9-457a-bf82-1cf6dbea637f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:21.559169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805523b2-9aa9-457a-bf82-1cf6dbea637f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:21.560635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805523b2-9aa9-457a-bf82-1cf6dbea637f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:21.561288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805523b2-9aa9-457a-bf82-1cf6dbea637f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:21.567198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805523b2-9aa9-457a-bf82-1cf6dbea637f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:21.942233 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-805523b2-9aa9-457a-bf82-1cf6dbea637f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d/action" status: 202 len: 0 microversion: 2.1 time: 0.408062 Aug 09 17:55:21.957937 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3114/5964] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:55:21 2022] POST /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:55:21.962057 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-be13954f-78c1-4788-82eb-808bc0d6aba5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:21.962712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-be13954f-78c1-4788-82eb-808bc0d6aba5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:21.981038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be13954f-78c1-4788-82eb-808bc0d6aba5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:21.981555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be13954f-78c1-4788-82eb-808bc0d6aba5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:21.982013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be13954f-78c1-4788-82eb-808bc0d6aba5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:21.982759 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be13954f-78c1-4788-82eb-808bc0d6aba5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:21.983228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be13954f-78c1-4788-82eb-808bc0d6aba5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:21.983959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-be13954f-78c1-4788-82eb-808bc0d6aba5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:22.345629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-be13954f-78c1-4788-82eb-808bc0d6aba5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:22.357840 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-be13954f-78c1-4788-82eb-808bc0d6aba5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1692 microversion: 2.1 time: 0.405723 Aug 09 17:55:22.362663 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2851/5965] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:21 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1692 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:22.472133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-325e025f-9c99-4773-9f48-0aec7aa8fc14 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:22.476879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-325e025f-9c99-4773-9f48-0aec7aa8fc14 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:22.504576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325e025f-9c99-4773-9f48-0aec7aa8fc14 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:22.509514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325e025f-9c99-4773-9f48-0aec7aa8fc14 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:22.510867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325e025f-9c99-4773-9f48-0aec7aa8fc14 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:22.514073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325e025f-9c99-4773-9f48-0aec7aa8fc14 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:22.514784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325e025f-9c99-4773-9f48-0aec7aa8fc14 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:22.516202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-325e025f-9c99-4773-9f48-0aec7aa8fc14 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:22.767845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-325e025f-9c99-4773-9f48-0aec7aa8fc14 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:22.771896 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-325e025f-9c99-4773-9f48-0aec7aa8fc14 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1281 microversion: 2.1 time: 0.312219 Aug 09 17:55:22.773572 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3115/5966] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:22 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1281 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:23.091945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-837925399", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "96f457a8-8912-459c-a046-629892445d02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:23.260387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] validate_networks() for [('0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:55:23.389637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd4fa5f6-4b2f-47a6-8d84-74313dc2a605 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:23.390277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bd4fa5f6-4b2f-47a6-8d84-74313dc2a605 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:23.402718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd4fa5f6-4b2f-47a6-8d84-74313dc2a605 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:23.403441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd4fa5f6-4b2f-47a6-8d84-74313dc2a605 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:23.404331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd4fa5f6-4b2f-47a6-8d84-74313dc2a605 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:23.405440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd4fa5f6-4b2f-47a6-8d84-74313dc2a605 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:23.407454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd4fa5f6-4b2f-47a6-8d84-74313dc2a605 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:23.408246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd4fa5f6-4b2f-47a6-8d84-74313dc2a605 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:23.734847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bd4fa5f6-4b2f-47a6-8d84-74313dc2a605 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:23.749707 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bd4fa5f6-4b2f-47a6-8d84-74313dc2a605 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1692 microversion: 2.1 time: 0.366211 Aug 09 17:55:23.765312 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3116/5967] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:23 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1692 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:23.782242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6c3cd18c-dec9-4fff-8512-9630af473a68 req-9de12200-0c22-4a26-a7a6-f82968b27a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3ac82a-2978-42ba-a133-a5db20652f5d", "name": "network-vif-plugged", "status": "completed", "tag": "b09f6bbd-ae75-4189-b58f-5b1f600d8c2b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:23.803958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6c3cd18c-dec9-4fff-8512-9630af473a68 req-9de12200-0c22-4a26-a7a6-f82968b27a04 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:23.804766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6c3cd18c-dec9-4fff-8512-9630af473a68 req-9de12200-0c22-4a26-a7a6-f82968b27a04 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:23.805396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6c3cd18c-dec9-4fff-8512-9630af473a68 req-9de12200-0c22-4a26-a7a6-f82968b27a04 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:23.832752 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6c3cd18c-dec9-4fff-8512-9630af473a68 req-9de12200-0c22-4a26-a7a6-f82968b27a04 service nova] Creating event network-vif-plugged:b09f6bbd-ae75-4189-b58f-5b1f600d8c2b for instance af3ac82a-2978-42ba-a133-a5db20652f5d on n-h2-845781-6 Aug 09 17:55:23.846336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-6c3cd18c-dec9-4fff-8512-9630af473a68 req-9de12200-0c22-4a26-a7a6-f82968b27a04 service nova] Instance af3ac82a-2978-42ba-a133-a5db20652f5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:55:23.871810 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6c3cd18c-dec9-4fff-8512-9630af473a68 req-9de12200-0c22-4a26-a7a6-f82968b27a04 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104207 Aug 09 17:55:23.873271 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3117/5968] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:55:23.882132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94384c9d-3f44-4b3b-952e-a3aabe2071fc tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:23.883386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94384c9d-3f44-4b3b-952e-a3aabe2071fc tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:23.892573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94384c9d-3f44-4b3b-952e-a3aabe2071fc tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:23.893680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94384c9d-3f44-4b3b-952e-a3aabe2071fc tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:23.894348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94384c9d-3f44-4b3b-952e-a3aabe2071fc tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:23.895308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94384c9d-3f44-4b3b-952e-a3aabe2071fc tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:23.896271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94384c9d-3f44-4b3b-952e-a3aabe2071fc tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:23.896923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94384c9d-3f44-4b3b-952e-a3aabe2071fc tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:24.143871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94384c9d-3f44-4b3b-952e-a3aabe2071fc tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:24.154545 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94384c9d-3f44-4b3b-952e-a3aabe2071fc tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1269 microversion: 2.1 time: 0.279593 Aug 09 17:55:24.155165 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3118/5969] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:23 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1269 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:24.414258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:55:24.415482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:55:24.416712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:55:24.417326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:55:24.417949 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:55:24.433981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:24.434480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:24.434924 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:24.438497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:24.439265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:24.439791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:24.460024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:55:24.467987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for user 87590ee7f71345a8914b350c5999d974 and project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:55:24.564448 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:55:24.567462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96f457a8-8912-459c-a046-629892445d02',volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:55:24.784203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-98fe1136-9883-4666-b862-b9048248fbb2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:24.784990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-98fe1136-9883-4666-b862-b9048248fbb2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:24.792602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98fe1136-9883-4666-b862-b9048248fbb2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:24.793097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98fe1136-9883-4666-b862-b9048248fbb2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:24.793673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98fe1136-9883-4666-b862-b9048248fbb2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:24.794263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98fe1136-9883-4666-b862-b9048248fbb2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:24.794727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98fe1136-9883-4666-b862-b9048248fbb2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:24.795218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98fe1136-9883-4666-b862-b9048248fbb2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:24.799321 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-91fa4059-17cf-4ab4-9763-eaf61f58d488 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.712600 Aug 09 17:55:24.800314 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2852/5970] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:55:24.814120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-74bda3dc-c480-4c31-9a3c-a27efdb310cf tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:24.815153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-74bda3dc-c480-4c31-9a3c-a27efdb310cf tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:24.927068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-74bda3dc-c480-4c31-9a3c-a27efdb310cf tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:24.937495 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-74bda3dc-c480-4c31-9a3c-a27efdb310cf tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1056 microversion: 2.1 time: 0.127166 Aug 09 17:55:24.943608 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2853/5971] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:24 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1056 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:25.006602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-98fe1136-9883-4666-b862-b9048248fbb2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:25.016814 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-98fe1136-9883-4666-b862-b9048248fbb2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1692 microversion: 2.1 time: 0.236532 Aug 09 17:55:25.018680 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3119/5972] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:24 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1692 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:25.179499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-16220b5a-6cd9-4880-bc08-f108e9bd1a12 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:25.180453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-16220b5a-6cd9-4880-bc08-f108e9bd1a12 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:25.189487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16220b5a-6cd9-4880-bc08-f108e9bd1a12 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:25.190521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16220b5a-6cd9-4880-bc08-f108e9bd1a12 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:25.191230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16220b5a-6cd9-4880-bc08-f108e9bd1a12 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:25.192233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16220b5a-6cd9-4880-bc08-f108e9bd1a12 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:25.192958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16220b5a-6cd9-4880-bc08-f108e9bd1a12 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:25.193606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-16220b5a-6cd9-4880-bc08-f108e9bd1a12 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:25.371813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-16220b5a-6cd9-4880-bc08-f108e9bd1a12 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:25.383114 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-16220b5a-6cd9-4880-bc08-f108e9bd1a12 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1269 microversion: 2.1 time: 0.208210 Aug 09 17:55:25.383880 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2854/5973] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:25 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1269 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:25.956868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4f6b8fc6-27a9-4eda-b52b-3feddd48ec21 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:25.958430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4f6b8fc6-27a9-4eda-b52b-3feddd48ec21 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:25.966776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6b8fc6-27a9-4eda-b52b-3feddd48ec21 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:25.967331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6b8fc6-27a9-4eda-b52b-3feddd48ec21 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:25.968813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6b8fc6-27a9-4eda-b52b-3feddd48ec21 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:25.969654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6b8fc6-27a9-4eda-b52b-3feddd48ec21 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:25.970123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6b8fc6-27a9-4eda-b52b-3feddd48ec21 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:25.970556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f6b8fc6-27a9-4eda-b52b-3feddd48ec21 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:26.044136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-03e5f5bb-47bd-4cb0-adef-b8527b459c21 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:26.046104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-03e5f5bb-47bd-4cb0-adef-b8527b459c21 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:26.052936 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03e5f5bb-47bd-4cb0-adef-b8527b459c21 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:26.053780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03e5f5bb-47bd-4cb0-adef-b8527b459c21 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:26.054457 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03e5f5bb-47bd-4cb0-adef-b8527b459c21 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:26.055412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03e5f5bb-47bd-4cb0-adef-b8527b459c21 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:26.056682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03e5f5bb-47bd-4cb0-adef-b8527b459c21 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:26.057294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-03e5f5bb-47bd-4cb0-adef-b8527b459c21 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:26.113992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4f6b8fc6-27a9-4eda-b52b-3feddd48ec21 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:26.125519 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4f6b8fc6-27a9-4eda-b52b-3feddd48ec21 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1106 microversion: 2.1 time: 0.171887 Aug 09 17:55:26.126079 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3120/5974] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:25 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1106 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:26.238661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-03e5f5bb-47bd-4cb0-adef-b8527b459c21 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:26.249176 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-03e5f5bb-47bd-4cb0-adef-b8527b459c21 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1692 microversion: 2.1 time: 0.210514 Aug 09 17:55:26.250426 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2855/5975] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:26 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1692 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:26.406049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4bf0ebc1-519f-4c90-a985-6be4489b91ec tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:26.407172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4bf0ebc1-519f-4c90-a985-6be4489b91ec tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:26.424185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebc1-519f-4c90-a985-6be4489b91ec tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:26.424834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebc1-519f-4c90-a985-6be4489b91ec tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:26.425500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebc1-519f-4c90-a985-6be4489b91ec tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:26.426376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebc1-519f-4c90-a985-6be4489b91ec tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:26.427075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebc1-519f-4c90-a985-6be4489b91ec tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:26.427751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4bf0ebc1-519f-4c90-a985-6be4489b91ec tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:26.600346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4bf0ebc1-519f-4c90-a985-6be4489b91ec tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:26.618220 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4bf0ebc1-519f-4c90-a985-6be4489b91ec tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1269 microversion: 2.1 time: 0.215816 Aug 09 17:55:26.619847 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3121/5976] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:26 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1269 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:27.152290 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b2e8fb5b-ea39-4417-b877-23c2a1b60402 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:27.164510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b2e8fb5b-ea39-4417-b877-23c2a1b60402 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:27.188042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e8fb5b-ea39-4417-b877-23c2a1b60402 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:27.190076 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e8fb5b-ea39-4417-b877-23c2a1b60402 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:27.190899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e8fb5b-ea39-4417-b877-23c2a1b60402 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:27.194413 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e8fb5b-ea39-4417-b877-23c2a1b60402 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:27.197042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e8fb5b-ea39-4417-b877-23c2a1b60402 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:27.199166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b2e8fb5b-ea39-4417-b877-23c2a1b60402 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:27.270426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c93db989-7695-4f54-951d-d99921ddc7cb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:27.271278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c93db989-7695-4f54-951d-d99921ddc7cb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:27.282708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93db989-7695-4f54-951d-d99921ddc7cb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:27.283065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93db989-7695-4f54-951d-d99921ddc7cb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:27.283515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93db989-7695-4f54-951d-d99921ddc7cb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:27.289079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93db989-7695-4f54-951d-d99921ddc7cb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:27.289791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93db989-7695-4f54-951d-d99921ddc7cb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:27.290245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93db989-7695-4f54-951d-d99921ddc7cb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:27.433768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b2e8fb5b-ea39-4417-b877-23c2a1b60402 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:27.455032 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b2e8fb5b-ea39-4417-b877-23c2a1b60402 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1172 microversion: 2.1 time: 0.308461 Aug 09 17:55:27.455698 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2856/5977] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:27 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1172 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:27.554941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c93db989-7695-4f54-951d-d99921ddc7cb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:27.565337 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c93db989-7695-4f54-951d-d99921ddc7cb tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1692 microversion: 2.1 time: 0.298749 Aug 09 17:55:27.566549 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3122/5978] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:27 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1692 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:27.643234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-35fed50d-ac92-48d4-b4a1-d0a23bfe7340 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:27.644248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-35fed50d-ac92-48d4-b4a1-d0a23bfe7340 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:27.657781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35fed50d-ac92-48d4-b4a1-d0a23bfe7340 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:27.658716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35fed50d-ac92-48d4-b4a1-d0a23bfe7340 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:27.659390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35fed50d-ac92-48d4-b4a1-d0a23bfe7340 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:27.661370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35fed50d-ac92-48d4-b4a1-d0a23bfe7340 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:27.662033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35fed50d-ac92-48d4-b4a1-d0a23bfe7340 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:27.663904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35fed50d-ac92-48d4-b4a1-d0a23bfe7340 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:27.928147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-120d7a7f-30cb-40fe-931d-dc729c649e7b req-3a7e8f63-bc7e-4397-9ba1-c66ceb27b736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3ac82a-2978-42ba-a133-a5db20652f5d", "name": "network-vif-unplugged", "status": "completed", "tag": "b09f6bbd-ae75-4189-b58f-5b1f600d8c2b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:27.948452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-120d7a7f-30cb-40fe-931d-dc729c649e7b req-3a7e8f63-bc7e-4397-9ba1-c66ceb27b736 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:27.950036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-120d7a7f-30cb-40fe-931d-dc729c649e7b req-3a7e8f63-bc7e-4397-9ba1-c66ceb27b736 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:27.952051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-120d7a7f-30cb-40fe-931d-dc729c649e7b req-3a7e8f63-bc7e-4397-9ba1-c66ceb27b736 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:27.982508 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-120d7a7f-30cb-40fe-931d-dc729c649e7b req-3a7e8f63-bc7e-4397-9ba1-c66ceb27b736 service nova] Creating event network-vif-unplugged:b09f6bbd-ae75-4189-b58f-5b1f600d8c2b for instance af3ac82a-2978-42ba-a133-a5db20652f5d on n-h1-845781-6 Aug 09 17:55:27.990041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-120d7a7f-30cb-40fe-931d-dc729c649e7b req-3a7e8f63-bc7e-4397-9ba1-c66ceb27b736 service nova] Instance af3ac82a-2978-42ba-a133-a5db20652f5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:55:28.073883 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-120d7a7f-30cb-40fe-931d-dc729c649e7b req-3a7e8f63-bc7e-4397-9ba1-c66ceb27b736 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144861 Aug 09 17:55:28.078896 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3123/5979] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:55:28.144496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-35fed50d-ac92-48d4-b4a1-d0a23bfe7340 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:28.156144 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-35fed50d-ac92-48d4-b4a1-d0a23bfe7340 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1269 microversion: 2.1 time: 0.517382 Aug 09 17:55:28.156798 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2857/5980] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:27 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1269 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:28.481609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-baf358cc-81ba-4233-939b-06b8afd2ce3b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:28.482514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-baf358cc-81ba-4233-939b-06b8afd2ce3b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:28.502673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baf358cc-81ba-4233-939b-06b8afd2ce3b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:28.503680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baf358cc-81ba-4233-939b-06b8afd2ce3b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:28.504192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baf358cc-81ba-4233-939b-06b8afd2ce3b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:28.505187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baf358cc-81ba-4233-939b-06b8afd2ce3b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:28.505852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baf358cc-81ba-4233-939b-06b8afd2ce3b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:28.506288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baf358cc-81ba-4233-939b-06b8afd2ce3b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:28.563999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:28.586419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7bf634e3-8dde-4ac2-848b-f760789c33ec tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:28.586950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7bf634e3-8dde-4ac2-848b-f760789c33ec tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:28.604883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7bf634e3-8dde-4ac2-848b-f760789c33ec tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:28.604883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7bf634e3-8dde-4ac2-848b-f760789c33ec tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:28.604883 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7bf634e3-8dde-4ac2-848b-f760789c33ec tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:28.609349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7bf634e3-8dde-4ac2-848b-f760789c33ec tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:28.610167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7bf634e3-8dde-4ac2-848b-f760789c33ec tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:28.611170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7bf634e3-8dde-4ac2-848b-f760789c33ec tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:28.860442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7bf634e3-8dde-4ac2-848b-f760789c33ec tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:28.873886 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7bf634e3-8dde-4ac2-848b-f760789c33ec tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1692 microversion: 2.1 time: 0.290363 Aug 09 17:55:28.875429 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2858/5981] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:28 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1692 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:28.910335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-baf358cc-81ba-4233-939b-06b8afd2ce3b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:28.921871 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-baf358cc-81ba-4233-939b-06b8afd2ce3b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1214 microversion: 2.1 time: 0.445064 Aug 09 17:55:28.923992 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3124/5982] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:28 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1214 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:29.177395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-941521c6-e5b8-44bd-82ff-37234ae63ee6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:29.178765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-941521c6-e5b8-44bd-82ff-37234ae63ee6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:29.186047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-941521c6-e5b8-44bd-82ff-37234ae63ee6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:29.186861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-941521c6-e5b8-44bd-82ff-37234ae63ee6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:29.187478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-941521c6-e5b8-44bd-82ff-37234ae63ee6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:29.189362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-941521c6-e5b8-44bd-82ff-37234ae63ee6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:29.190163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-941521c6-e5b8-44bd-82ff-37234ae63ee6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:29.190794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-941521c6-e5b8-44bd-82ff-37234ae63ee6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:29.607854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-7fdd1b31-5389-468d-b72c-175571214c1b req-2e7ed541-8d68-497d-a7de-4270c52eb927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4", "tag": "03f36b88-bd5c-40cd-b6f7-a4aa82c51108"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:29.628904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7fdd1b31-5389-468d-b72c-175571214c1b req-2e7ed541-8d68-497d-a7de-4270c52eb927 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:29.629401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7fdd1b31-5389-468d-b72c-175571214c1b req-2e7ed541-8d68-497d-a7de-4270c52eb927 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:29.630110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7fdd1b31-5389-468d-b72c-175571214c1b req-2e7ed541-8d68-497d-a7de-4270c52eb927 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:29.638199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-941521c6-e5b8-44bd-82ff-37234ae63ee6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:29.650602 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-941521c6-e5b8-44bd-82ff-37234ae63ee6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1269 microversion: 2.1 time: 0.475016 Aug 09 17:55:29.650602 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2859/5983] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:29 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1269 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:29.674034 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-7fdd1b31-5389-468d-b72c-175571214c1b req-2e7ed541-8d68-497d-a7de-4270c52eb927 service nova] Creating event network-changed:03f36b88-bd5c-40cd-b6f7-a4aa82c51108 for instance c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 on n-h2-845781-6 Aug 09 17:55:29.683331 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-7fdd1b31-5389-468d-b72c-175571214c1b req-2e7ed541-8d68-497d-a7de-4270c52eb927 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079180 Aug 09 17:55:29.684249 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3125/5984] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:55:29.896877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-98a9b453-b061-4084-9004-3e9fb0396e07 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:29.897647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-98a9b453-b061-4084-9004-3e9fb0396e07 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:29.907921 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98a9b453-b061-4084-9004-3e9fb0396e07 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:29.908427 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98a9b453-b061-4084-9004-3e9fb0396e07 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:29.908874 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98a9b453-b061-4084-9004-3e9fb0396e07 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:29.909585 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98a9b453-b061-4084-9004-3e9fb0396e07 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:29.910051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98a9b453-b061-4084-9004-3e9fb0396e07 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:29.910488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-98a9b453-b061-4084-9004-3e9fb0396e07 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:29.947383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e11cee91-d492-4c4f-92bf-e7a1244ddbf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:29.948594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e11cee91-d492-4c4f-92bf-e7a1244ddbf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:29.960409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11cee91-d492-4c4f-92bf-e7a1244ddbf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:29.961522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11cee91-d492-4c4f-92bf-e7a1244ddbf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:29.962762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11cee91-d492-4c4f-92bf-e7a1244ddbf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:29.964626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11cee91-d492-4c4f-92bf-e7a1244ddbf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:29.965435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11cee91-d492-4c4f-92bf-e7a1244ddbf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:29.966089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11cee91-d492-4c4f-92bf-e7a1244ddbf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:30.226673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-98a9b453-b061-4084-9004-3e9fb0396e07 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:30.239780 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-98a9b453-b061-4084-9004-3e9fb0396e07 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1692 microversion: 2.1 time: 0.347680 Aug 09 17:55:30.242111 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2860/5985] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:29 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1692 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:30.478188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-22f65122-218e-4d42-965d-c66cf00f268f req-7bc0ea39-637f-4914-922e-5ec3177b56ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3ac82a-2978-42ba-a133-a5db20652f5d", "tag": "b09f6bbd-ae75-4189-b58f-5b1f600d8c2b"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:30.488428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-22f65122-218e-4d42-965d-c66cf00f268f req-7bc0ea39-637f-4914-922e-5ec3177b56ce service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:30.489198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-22f65122-218e-4d42-965d-c66cf00f268f req-7bc0ea39-637f-4914-922e-5ec3177b56ce service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:30.489835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-22f65122-218e-4d42-965d-c66cf00f268f req-7bc0ea39-637f-4914-922e-5ec3177b56ce service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:30.503185 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-22f65122-218e-4d42-965d-c66cf00f268f req-7bc0ea39-637f-4914-922e-5ec3177b56ce service nova] Creating event network-changed:b09f6bbd-ae75-4189-b58f-5b1f600d8c2b for instance af3ac82a-2978-42ba-a133-a5db20652f5d on n-h1-845781-6 Aug 09 17:55:30.509806 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [req-22f65122-218e-4d42-965d-c66cf00f268f req-7bc0ea39-637f-4914-922e-5ec3177b56ce service nova] Instance af3ac82a-2978-42ba-a133-a5db20652f5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119432) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 17:55:30.529433 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-22f65122-218e-4d42-965d-c66cf00f268f req-7bc0ea39-637f-4914-922e-5ec3177b56ce service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055689 Aug 09 17:55:30.533344 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2861/5986] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:55:30.674699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-79898d63-99a8-4b83-a1ba-c962343d9369 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:30.675411 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-79898d63-99a8-4b83-a1ba-c962343d9369 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:30.685098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e11cee91-d492-4c4f-92bf-e7a1244ddbf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:30.689359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79898d63-99a8-4b83-a1ba-c962343d9369 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:30.692068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79898d63-99a8-4b83-a1ba-c962343d9369 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:30.694593 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e11cee91-d492-4c4f-92bf-e7a1244ddbf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1214 microversion: 2.1 time: 0.752751 Aug 09 17:55:30.695174 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3126/5987] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:29 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1214 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:30.697260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79898d63-99a8-4b83-a1ba-c962343d9369 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:30.699774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79898d63-99a8-4b83-a1ba-c962343d9369 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:30.700534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79898d63-99a8-4b83-a1ba-c962343d9369 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:30.701209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-79898d63-99a8-4b83-a1ba-c962343d9369 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:30.987942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-79898d63-99a8-4b83-a1ba-c962343d9369 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:31.001644 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-79898d63-99a8-4b83-a1ba-c962343d9369 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1269 microversion: 2.1 time: 0.331352 Aug 09 17:55:31.004320 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2862/5988] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:30 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1269 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:31.263379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87e8edd0-8cee-46f0-ad39-6f1df2f250f1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:31.264320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87e8edd0-8cee-46f0-ad39-6f1df2f250f1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:31.271185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87e8edd0-8cee-46f0-ad39-6f1df2f250f1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:31.271707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87e8edd0-8cee-46f0-ad39-6f1df2f250f1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:31.272748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87e8edd0-8cee-46f0-ad39-6f1df2f250f1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:31.273468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87e8edd0-8cee-46f0-ad39-6f1df2f250f1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:31.274105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87e8edd0-8cee-46f0-ad39-6f1df2f250f1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:31.275213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87e8edd0-8cee-46f0-ad39-6f1df2f250f1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:31.717414 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-40a13a58-e325-43db-9d1a-4baa2c0b41e9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:31.718690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-40a13a58-e325-43db-9d1a-4baa2c0b41e9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:31.730450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40a13a58-e325-43db-9d1a-4baa2c0b41e9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:31.731717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40a13a58-e325-43db-9d1a-4baa2c0b41e9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:31.732741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40a13a58-e325-43db-9d1a-4baa2c0b41e9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:31.734283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40a13a58-e325-43db-9d1a-4baa2c0b41e9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:31.735399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40a13a58-e325-43db-9d1a-4baa2c0b41e9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:31.736212 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-40a13a58-e325-43db-9d1a-4baa2c0b41e9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:31.784837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87e8edd0-8cee-46f0-ad39-6f1df2f250f1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:31.797742 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87e8edd0-8cee-46f0-ad39-6f1df2f250f1 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1692 microversion: 2.1 time: 0.539172 Aug 09 17:55:31.798761 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3127/5989] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:31 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1692 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:31.960846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-40a13a58-e325-43db-9d1a-4baa2c0b41e9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:31.970659 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-40a13a58-e325-43db-9d1a-4baa2c0b41e9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1214 microversion: 2.1 time: 0.257146 Aug 09 17:55:31.983604 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2863/5990] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:31 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1214 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:32.026007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f075e4b-7f3d-480f-8b5b-bc70323dcbf8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:32.026874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f075e4b-7f3d-480f-8b5b-bc70323dcbf8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:32.035340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f075e4b-7f3d-480f-8b5b-bc70323dcbf8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:32.036145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f075e4b-7f3d-480f-8b5b-bc70323dcbf8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:32.036831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f075e4b-7f3d-480f-8b5b-bc70323dcbf8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:32.037885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f075e4b-7f3d-480f-8b5b-bc70323dcbf8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:32.038573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f075e4b-7f3d-480f-8b5b-bc70323dcbf8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:32.039945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f075e4b-7f3d-480f-8b5b-bc70323dcbf8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:32.377943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9f075e4b-7f3d-480f-8b5b-bc70323dcbf8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:32.387144 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f075e4b-7f3d-480f-8b5b-bc70323dcbf8 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1269 microversion: 2.1 time: 0.365175 Aug 09 17:55:32.388134 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3128/5991] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:32 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1269 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:32.822461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-869a1d5d-517e-4ab3-917f-eaafb3985298 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:32.828715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-869a1d5d-517e-4ab3-917f-eaafb3985298 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:32.845692 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869a1d5d-517e-4ab3-917f-eaafb3985298 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:32.846292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869a1d5d-517e-4ab3-917f-eaafb3985298 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:32.849714 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869a1d5d-517e-4ab3-917f-eaafb3985298 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:32.850979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869a1d5d-517e-4ab3-917f-eaafb3985298 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:32.851702 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869a1d5d-517e-4ab3-917f-eaafb3985298 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:32.852429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-869a1d5d-517e-4ab3-917f-eaafb3985298 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:32.991403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c1317ba4-da62-4a54-8067-f465ea8fa515 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:32.994339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c1317ba4-da62-4a54-8067-f465ea8fa515 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:33.005529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1317ba4-da62-4a54-8067-f465ea8fa515 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:33.009606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1317ba4-da62-4a54-8067-f465ea8fa515 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:33.010428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1317ba4-da62-4a54-8067-f465ea8fa515 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:33.012014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1317ba4-da62-4a54-8067-f465ea8fa515 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:33.014755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1317ba4-da62-4a54-8067-f465ea8fa515 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:33.015499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1317ba4-da62-4a54-8067-f465ea8fa515 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:33.077510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-869a1d5d-517e-4ab3-917f-eaafb3985298 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:33.080861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:33.091672 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-869a1d5d-517e-4ab3-917f-eaafb3985298 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1685 microversion: 2.1 time: 0.273134 Aug 09 17:55:33.109170 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2864/5992] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:32 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1685 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:33.277660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-67ab3902-0927-4f64-8de5-488567a96ff9 req-2bb030a5-8a98-478a-b0b7-6d817016caad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6deeed13-eae8-4843-8d55-2b1ecf02b624", "name": "network-vif-plugged", "status": "completed", "tag": "df10f198-4b53-4454-b6a1-5f77d9a839de"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:33.299918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-67ab3902-0927-4f64-8de5-488567a96ff9 req-2bb030a5-8a98-478a-b0b7-6d817016caad service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:33.300690 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-67ab3902-0927-4f64-8de5-488567a96ff9 req-2bb030a5-8a98-478a-b0b7-6d817016caad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:33.301312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-67ab3902-0927-4f64-8de5-488567a96ff9 req-2bb030a5-8a98-478a-b0b7-6d817016caad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:33.315650 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-67ab3902-0927-4f64-8de5-488567a96ff9 req-2bb030a5-8a98-478a-b0b7-6d817016caad service nova] Creating event network-vif-plugged:df10f198-4b53-4454-b6a1-5f77d9a839de for instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 on n-h1-845781-6 Aug 09 17:55:33.323501 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-67ab3902-0927-4f64-8de5-488567a96ff9 req-2bb030a5-8a98-478a-b0b7-6d817016caad service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051126 Aug 09 17:55:33.326518 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2865/5993] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:55:33.410522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3ca0d1bf-8f98-4588-b214-ad55db9567f6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:33.411228 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3ca0d1bf-8f98-4588-b214-ad55db9567f6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:33.418634 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:33.421023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ca0d1bf-8f98-4588-b214-ad55db9567f6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:33.421691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ca0d1bf-8f98-4588-b214-ad55db9567f6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:33.422295 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ca0d1bf-8f98-4588-b214-ad55db9567f6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:33.423183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ca0d1bf-8f98-4588-b214-ad55db9567f6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:33.424227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ca0d1bf-8f98-4588-b214-ad55db9567f6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:33.424818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3ca0d1bf-8f98-4588-b214-ad55db9567f6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:33.467721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c1317ba4-da62-4a54-8067-f465ea8fa515 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:33.483129 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c1317ba4-da62-4a54-8067-f465ea8fa515 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1214 microversion: 2.1 time: 0.495577 Aug 09 17:55:33.497230 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3129/5994] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:32 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1214 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:33.591430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3ca0d1bf-8f98-4588-b214-ad55db9567f6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:33.599668 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3ca0d1bf-8f98-4588-b214-ad55db9567f6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1269 microversion: 2.1 time: 0.193858 Aug 09 17:55:33.600590 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2866/5995] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:33 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1269 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:34.513396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c1ccb91e-97e2-48ea-818d-0935d899be0f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:34.514341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c1ccb91e-97e2-48ea-818d-0935d899be0f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:34.523060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1ccb91e-97e2-48ea-818d-0935d899be0f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:34.524140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1ccb91e-97e2-48ea-818d-0935d899be0f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:34.525098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1ccb91e-97e2-48ea-818d-0935d899be0f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:34.526003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1ccb91e-97e2-48ea-818d-0935d899be0f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:34.526637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1ccb91e-97e2-48ea-818d-0935d899be0f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:34.527100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1ccb91e-97e2-48ea-818d-0935d899be0f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:34.633903 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bc087a33-670b-42a4-b55c-6960418290f7 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:34.636036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bc087a33-670b-42a4-b55c-6960418290f7 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:34.641119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:34.651139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc087a33-670b-42a4-b55c-6960418290f7 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:34.652596 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc087a33-670b-42a4-b55c-6960418290f7 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:34.653629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc087a33-670b-42a4-b55c-6960418290f7 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:34.667455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc087a33-670b-42a4-b55c-6960418290f7 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:34.676507 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc087a33-670b-42a4-b55c-6960418290f7 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:34.679273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bc087a33-670b-42a4-b55c-6960418290f7 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:34.742714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c1ccb91e-97e2-48ea-818d-0935d899be0f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:34.754492 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c1ccb91e-97e2-48ea-818d-0935d899be0f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1202 microversion: 2.1 time: 0.248213 Aug 09 17:55:34.755860 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3130/5996] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:34 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1202 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:34.935675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:34.968954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bc087a33-670b-42a4-b55c-6960418290f7 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:34.977542 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bc087a33-670b-42a4-b55c-6960418290f7 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1269 microversion: 2.1 time: 0.359616 Aug 09 17:55:34.988277 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2867/5997] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:34 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1269 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:35.360763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1ddcb4e6-7966-4709-b263-bec53b65d1f5 req-db2b3f7d-35ac-4a63-9a9e-4ce64873e6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3ac82a-2978-42ba-a133-a5db20652f5d", "name": "network-vif-plugged", "status": "completed", "tag": "b09f6bbd-ae75-4189-b58f-5b1f600d8c2b"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:35.367567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=62 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:35.372998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ddcb4e6-7966-4709-b263-bec53b65d1f5 req-db2b3f7d-35ac-4a63-9a9e-4ce64873e6f7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:35.373549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ddcb4e6-7966-4709-b263-bec53b65d1f5 req-db2b3f7d-35ac-4a63-9a9e-4ce64873e6f7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:35.374023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ddcb4e6-7966-4709-b263-bec53b65d1f5 req-db2b3f7d-35ac-4a63-9a9e-4ce64873e6f7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:35.386297 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1ddcb4e6-7966-4709-b263-bec53b65d1f5 req-db2b3f7d-35ac-4a63-9a9e-4ce64873e6f7 service nova] Creating event network-vif-plugged:b09f6bbd-ae75-4189-b58f-5b1f600d8c2b for instance af3ac82a-2978-42ba-a133-a5db20652f5d on n-h1-845781-6 Aug 09 17:55:35.392326 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1ddcb4e6-7966-4709-b263-bec53b65d1f5 req-db2b3f7d-35ac-4a63-9a9e-4ce64873e6f7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035413 Aug 09 17:55:35.393513 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3131/5998] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:55:35.780961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9c314247-02f1-4c44-9087-854772828c92 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:35.782459 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9c314247-02f1-4c44-9087-854772828c92 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:35.792854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c314247-02f1-4c44-9087-854772828c92 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:35.793708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c314247-02f1-4c44-9087-854772828c92 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:35.794453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c314247-02f1-4c44-9087-854772828c92 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:35.796263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c314247-02f1-4c44-9087-854772828c92 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:35.796995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c314247-02f1-4c44-9087-854772828c92 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:35.797675 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9c314247-02f1-4c44-9087-854772828c92 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:36.000333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c061c7e8-0341-49c1-8140-60fe2000b1a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:36.000962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c061c7e8-0341-49c1-8140-60fe2000b1a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:36.009420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c061c7e8-0341-49c1-8140-60fe2000b1a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:36.010508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c061c7e8-0341-49c1-8140-60fe2000b1a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:36.011061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c061c7e8-0341-49c1-8140-60fe2000b1a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:36.012101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c061c7e8-0341-49c1-8140-60fe2000b1a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:36.012637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c061c7e8-0341-49c1-8140-60fe2000b1a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:36.013140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c061c7e8-0341-49c1-8140-60fe2000b1a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:36.112216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9c314247-02f1-4c44-9087-854772828c92 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:36.123006 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9c314247-02f1-4c44-9087-854772828c92 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1202 microversion: 2.1 time: 0.347210 Aug 09 17:55:36.123660 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2868/5999] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:35 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1202 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:36.218710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c061c7e8-0341-49c1-8140-60fe2000b1a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:36.231243 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c061c7e8-0341-49c1-8140-60fe2000b1a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1458 microversion: 2.1 time: 0.235225 Aug 09 17:55:36.232359 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3132/6000] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:35 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1458 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:36.252488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-634073d1-76cf-498e-9181-dc6389aa8746 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:36.252992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-634073d1-76cf-498e-9181-dc6389aa8746 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:36.260468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-634073d1-76cf-498e-9181-dc6389aa8746 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:36.260969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-634073d1-76cf-498e-9181-dc6389aa8746 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:36.261409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-634073d1-76cf-498e-9181-dc6389aa8746 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:36.262113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-634073d1-76cf-498e-9181-dc6389aa8746 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:36.262568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-634073d1-76cf-498e-9181-dc6389aa8746 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:36.262993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-634073d1-76cf-498e-9181-dc6389aa8746 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:36.427730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-634073d1-76cf-498e-9181-dc6389aa8746 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:36.435955 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-634073d1-76cf-498e-9181-dc6389aa8746 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1458 microversion: 2.1 time: 0.187388 Aug 09 17:55:36.436548 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2869/6001] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:36 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1458 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:37.160851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c9c84ed-40b0-4368-a859-32625f052d5f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:37.161598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c9c84ed-40b0-4368-a859-32625f052d5f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:37.171844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9c84ed-40b0-4368-a859-32625f052d5f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:37.172681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9c84ed-40b0-4368-a859-32625f052d5f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:37.173347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9c84ed-40b0-4368-a859-32625f052d5f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:37.174299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9c84ed-40b0-4368-a859-32625f052d5f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:37.174955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9c84ed-40b0-4368-a859-32625f052d5f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:37.176155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9c84ed-40b0-4368-a859-32625f052d5f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:37.336660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c9c84ed-40b0-4368-a859-32625f052d5f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:37.345433 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c9c84ed-40b0-4368-a859-32625f052d5f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1202 microversion: 2.1 time: 0.201799 Aug 09 17:55:37.346036 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3133/6002] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:37 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1202 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:38.367732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1f568b6d-095f-467d-8142-b1f46e05f92a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:38.368601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1f568b6d-095f-467d-8142-b1f46e05f92a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:38.377348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f568b6d-095f-467d-8142-b1f46e05f92a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:38.378103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f568b6d-095f-467d-8142-b1f46e05f92a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:38.378849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f568b6d-095f-467d-8142-b1f46e05f92a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:38.379715 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f568b6d-095f-467d-8142-b1f46e05f92a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:38.380268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f568b6d-095f-467d-8142-b1f46e05f92a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:38.381113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1f568b6d-095f-467d-8142-b1f46e05f92a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:38.529953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c6bc3a12-fb33-4e2b-aaa3-7a34dd40a2af req-2c406be0-5495-4cf2-8b66-007f7bcb8fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6deeed13-eae8-4843-8d55-2b1ecf02b624", "tag": "df10f198-4b53-4454-b6a1-5f77d9a839de"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:38.545386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c6bc3a12-fb33-4e2b-aaa3-7a34dd40a2af req-2c406be0-5495-4cf2-8b66-007f7bcb8fde service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:38.546321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c6bc3a12-fb33-4e2b-aaa3-7a34dd40a2af req-2c406be0-5495-4cf2-8b66-007f7bcb8fde service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:38.547095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c6bc3a12-fb33-4e2b-aaa3-7a34dd40a2af req-2c406be0-5495-4cf2-8b66-007f7bcb8fde service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:38.566450 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c6bc3a12-fb33-4e2b-aaa3-7a34dd40a2af req-2c406be0-5495-4cf2-8b66-007f7bcb8fde service nova] Creating event network-changed:df10f198-4b53-4454-b6a1-5f77d9a839de for instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 on n-h1-845781-6 Aug 09 17:55:38.575220 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c6bc3a12-fb33-4e2b-aaa3-7a34dd40a2af req-2c406be0-5495-4cf2-8b66-007f7bcb8fde service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052249 Aug 09 17:55:38.581706 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3134/6003] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:55:38.610222 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1f568b6d-095f-467d-8142-b1f46e05f92a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:38.632087 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1f568b6d-095f-467d-8142-b1f46e05f92a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1202 microversion: 2.1 time: 0.268238 Aug 09 17:55:38.634803 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2870/6004] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:38 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1202 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:39.663151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c41e2f7e-89d9-421f-9149-a05dd58c05e0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:39.667812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c41e2f7e-89d9-421f-9149-a05dd58c05e0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:39.683927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c41e2f7e-89d9-421f-9149-a05dd58c05e0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:39.684970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c41e2f7e-89d9-421f-9149-a05dd58c05e0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:39.686150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c41e2f7e-89d9-421f-9149-a05dd58c05e0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:39.687369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c41e2f7e-89d9-421f-9149-a05dd58c05e0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:39.688128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c41e2f7e-89d9-421f-9149-a05dd58c05e0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:39.688835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c41e2f7e-89d9-421f-9149-a05dd58c05e0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:40.094189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c41e2f7e-89d9-421f-9149-a05dd58c05e0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:40.103349 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c41e2f7e-89d9-421f-9149-a05dd58c05e0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1202 microversion: 2.1 time: 0.452343 Aug 09 17:55:40.114423 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3135/6005] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:39 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1202 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:40.475825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-1c6d74f1-e832-4cfb-9957-ee1bfed28ef6 req-c1309013-adb9-46f8-a6d7-4f0d1c66e020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6deeed13-eae8-4843-8d55-2b1ecf02b624", "tag": "df10f198-4b53-4454-b6a1-5f77d9a839de"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:40.493984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1c6d74f1-e832-4cfb-9957-ee1bfed28ef6 req-c1309013-adb9-46f8-a6d7-4f0d1c66e020 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:40.494853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1c6d74f1-e832-4cfb-9957-ee1bfed28ef6 req-c1309013-adb9-46f8-a6d7-4f0d1c66e020 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:40.495644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-1c6d74f1-e832-4cfb-9957-ee1bfed28ef6 req-c1309013-adb9-46f8-a6d7-4f0d1c66e020 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:40.508608 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-1c6d74f1-e832-4cfb-9957-ee1bfed28ef6 req-c1309013-adb9-46f8-a6d7-4f0d1c66e020 service nova] Creating event network-changed:df10f198-4b53-4454-b6a1-5f77d9a839de for instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 on n-h1-845781-6 Aug 09 17:55:40.513899 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-1c6d74f1-e832-4cfb-9957-ee1bfed28ef6 req-c1309013-adb9-46f8-a6d7-4f0d1c66e020 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042666 Aug 09 17:55:40.514655 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2871/6006] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:55:41.126038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88306c69-e284-4814-9210-5283b1223a58 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:41.127795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88306c69-e284-4814-9210-5283b1223a58 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:41.135396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88306c69-e284-4814-9210-5283b1223a58 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:41.136006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88306c69-e284-4814-9210-5283b1223a58 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:41.136521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88306c69-e284-4814-9210-5283b1223a58 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:41.137303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88306c69-e284-4814-9210-5283b1223a58 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:41.137837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88306c69-e284-4814-9210-5283b1223a58 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:41.138343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88306c69-e284-4814-9210-5283b1223a58 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:41.286019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-88306c69-e284-4814-9210-5283b1223a58 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:41.299067 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88306c69-e284-4814-9210-5283b1223a58 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1202 microversion: 2.1 time: 0.177414 Aug 09 17:55:41.307508 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3136/6007] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:41 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1202 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:42.322722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bf149b18-47d6-4dc4-80d8-1186a4f510e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:42.323503 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bf149b18-47d6-4dc4-80d8-1186a4f510e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:42.331068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf149b18-47d6-4dc4-80d8-1186a4f510e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:42.331068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf149b18-47d6-4dc4-80d8-1186a4f510e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:42.331068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf149b18-47d6-4dc4-80d8-1186a4f510e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:42.333261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf149b18-47d6-4dc4-80d8-1186a4f510e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:42.333744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf149b18-47d6-4dc4-80d8-1186a4f510e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:42.334287 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bf149b18-47d6-4dc4-80d8-1186a4f510e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:42.490534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bf149b18-47d6-4dc4-80d8-1186a4f510e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:42.499678 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bf149b18-47d6-4dc4-80d8-1186a4f510e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1202 microversion: 2.1 time: 0.182044 Aug 09 17:55:42.500490 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2872/6008] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:42 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1202 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:42.529028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-aaa28204-eae4-4b0c-af1e-5883b923e1ad req-b4571b41-bad3-46be-b292-47990b66297b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6deeed13-eae8-4843-8d55-2b1ecf02b624", "tag": "df10f198-4b53-4454-b6a1-5f77d9a839de"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:42.539485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aaa28204-eae4-4b0c-af1e-5883b923e1ad req-b4571b41-bad3-46be-b292-47990b66297b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:42.540015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aaa28204-eae4-4b0c-af1e-5883b923e1ad req-b4571b41-bad3-46be-b292-47990b66297b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:42.540534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aaa28204-eae4-4b0c-af1e-5883b923e1ad req-b4571b41-bad3-46be-b292-47990b66297b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:42.555849 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-aaa28204-eae4-4b0c-af1e-5883b923e1ad req-b4571b41-bad3-46be-b292-47990b66297b service nova] Creating event network-changed:df10f198-4b53-4454-b6a1-5f77d9a839de for instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 on n-h1-845781-6 Aug 09 17:55:42.561090 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-aaa28204-eae4-4b0c-af1e-5883b923e1ad req-b4571b41-bad3-46be-b292-47990b66297b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036563 Aug 09 17:55:42.562162 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3137/6009] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:55:43.403409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-c20992c3-3425-4359-9e1a-a8e2dd8b881d req-339a3926-1d34-483e-a023-d0876d5ce5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4", "name": "network-vif-plugged", "status": "completed", "tag": "03f36b88-bd5c-40cd-b6f7-a4aa82c51108"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:43.416103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c20992c3-3425-4359-9e1a-a8e2dd8b881d req-339a3926-1d34-483e-a023-d0876d5ce5de service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:43.416631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c20992c3-3425-4359-9e1a-a8e2dd8b881d req-339a3926-1d34-483e-a023-d0876d5ce5de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:43.417120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c20992c3-3425-4359-9e1a-a8e2dd8b881d req-339a3926-1d34-483e-a023-d0876d5ce5de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:43.430858 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-c20992c3-3425-4359-9e1a-a8e2dd8b881d req-339a3926-1d34-483e-a023-d0876d5ce5de service nova] Creating event network-vif-plugged:03f36b88-bd5c-40cd-b6f7-a4aa82c51108 for instance c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 on n-h2-845781-6 Aug 09 17:55:43.436705 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-c20992c3-3425-4359-9e1a-a8e2dd8b881d req-339a3926-1d34-483e-a023-d0876d5ce5de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037530 Aug 09 17:55:43.438286 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2873/6010] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:55:43.521969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fdbc26e9-2c67-4fea-9f3f-1c22c6dcfc2d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:43.522719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fdbc26e9-2c67-4fea-9f3f-1c22c6dcfc2d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:43.529372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdbc26e9-2c67-4fea-9f3f-1c22c6dcfc2d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:43.530562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdbc26e9-2c67-4fea-9f3f-1c22c6dcfc2d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:43.531172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdbc26e9-2c67-4fea-9f3f-1c22c6dcfc2d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:43.532080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdbc26e9-2c67-4fea-9f3f-1c22c6dcfc2d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:43.532740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdbc26e9-2c67-4fea-9f3f-1c22c6dcfc2d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:43.533338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdbc26e9-2c67-4fea-9f3f-1c22c6dcfc2d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:43.955742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fdbc26e9-2c67-4fea-9f3f-1c22c6dcfc2d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:43.964434 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fdbc26e9-2c67-4fea-9f3f-1c22c6dcfc2d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1202 microversion: 2.1 time: 0.446774 Aug 09 17:55:43.965016 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3138/6011] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:43 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1202 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:44.989402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-818c95f2-0926-461b-b317-e049baff1bfb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:44.990697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-818c95f2-0926-461b-b317-e049baff1bfb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:45.001743 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818c95f2-0926-461b-b317-e049baff1bfb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:45.006281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818c95f2-0926-461b-b317-e049baff1bfb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:45.006788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818c95f2-0926-461b-b317-e049baff1bfb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:45.007770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818c95f2-0926-461b-b317-e049baff1bfb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:45.008499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818c95f2-0926-461b-b317-e049baff1bfb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:45.009170 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-818c95f2-0926-461b-b317-e049baff1bfb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:45.155777 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-818c95f2-0926-461b-b317-e049baff1bfb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:45.168049 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-818c95f2-0926-461b-b317-e049baff1bfb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1388 microversion: 2.1 time: 0.180540 Aug 09 17:55:45.168885 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2874/6012] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:44 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1388 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:45.193201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a871c8bb-3766-44ba-9161-a0139e30b451 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:45.193927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a871c8bb-3766-44ba-9161-a0139e30b451 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:45.203902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a871c8bb-3766-44ba-9161-a0139e30b451 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:45.204939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a871c8bb-3766-44ba-9161-a0139e30b451 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:45.205679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a871c8bb-3766-44ba-9161-a0139e30b451 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:45.207398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a871c8bb-3766-44ba-9161-a0139e30b451 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:45.208649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a871c8bb-3766-44ba-9161-a0139e30b451 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:45.209113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a871c8bb-3766-44ba-9161-a0139e30b451 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:45.517412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a871c8bb-3766-44ba-9161-a0139e30b451 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:45.526920 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a871c8bb-3766-44ba-9161-a0139e30b451 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1388 microversion: 2.1 time: 0.340613 Aug 09 17:55:45.527770 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3139/6013] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:45 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1388 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:45.550698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5ae38eda-c1aa-495c-8a66-43a2a10da2d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:45.551614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5ae38eda-c1aa-495c-8a66-43a2a10da2d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:45.558707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ae38eda-c1aa-495c-8a66-43a2a10da2d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:45.559130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ae38eda-c1aa-495c-8a66-43a2a10da2d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:45.559563 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ae38eda-c1aa-495c-8a66-43a2a10da2d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:45.560474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ae38eda-c1aa-495c-8a66-43a2a10da2d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:45.561099 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ae38eda-c1aa-495c-8a66-43a2a10da2d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:45.561536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ae38eda-c1aa-495c-8a66-43a2a10da2d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:45.713888 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5ae38eda-c1aa-495c-8a66-43a2a10da2d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:45.722557 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5ae38eda-c1aa-495c-8a66-43a2a10da2d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1388 microversion: 2.1 time: 0.176251 Aug 09 17:55:45.723149 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2875/6014] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:45 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1388 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:45.744576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4a31bed-5ef8-4e66-82f1-e804c5147612 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:45.745074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a4a31bed-5ef8-4e66-82f1-e804c5147612 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:45.751525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-5ef8-4e66-82f1-e804c5147612 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:45.752066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-5ef8-4e66-82f1-e804c5147612 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:45.752672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-5ef8-4e66-82f1-e804c5147612 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:45.753362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-5ef8-4e66-82f1-e804c5147612 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:45.753816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-5ef8-4e66-82f1-e804c5147612 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:45.754241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4a31bed-5ef8-4e66-82f1-e804c5147612 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:45.782575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a4a31bed-5ef8-4e66-82f1-e804c5147612 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:55:45.891920 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4a31bed-5ef8-4e66-82f1-e804c5147612 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 204 len: 0 microversion: 2.1 time: 0.151256 Aug 09 17:55:45.893308 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3140/6015] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:55:45 2022] DELETE /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:55:45.904268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0b9a36c0-cff9-4b44-ace3-8c0ca783ff17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:45.905105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0b9a36c0-cff9-4b44-ace3-8c0ca783ff17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:45.921842 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b9a36c0-cff9-4b44-ace3-8c0ca783ff17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:45.923016 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b9a36c0-cff9-4b44-ace3-8c0ca783ff17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:45.924061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b9a36c0-cff9-4b44-ace3-8c0ca783ff17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:45.925224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b9a36c0-cff9-4b44-ace3-8c0ca783ff17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:45.926196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b9a36c0-cff9-4b44-ace3-8c0ca783ff17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:45.926994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0b9a36c0-cff9-4b44-ace3-8c0ca783ff17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:46.129505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0b9a36c0-cff9-4b44-ace3-8c0ca783ff17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:46.144810 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0b9a36c0-cff9-4b44-ace3-8c0ca783ff17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1394 microversion: 2.1 time: 0.245687 Aug 09 17:55:46.156007 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2876/6016] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:45 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1394 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:55:47.174068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c40e6de0-c383-40a6-95b5-76666d6246fb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:47.174960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c40e6de0-c383-40a6-95b5-76666d6246fb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:47.183430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c40e6de0-c383-40a6-95b5-76666d6246fb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:47.184726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c40e6de0-c383-40a6-95b5-76666d6246fb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:47.185232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c40e6de0-c383-40a6-95b5-76666d6246fb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:47.186192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c40e6de0-c383-40a6-95b5-76666d6246fb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:47.186872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c40e6de0-c383-40a6-95b5-76666d6246fb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:47.187378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c40e6de0-c383-40a6-95b5-76666d6246fb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:47.378033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c40e6de0-c383-40a6-95b5-76666d6246fb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:47.387728 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c40e6de0-c383-40a6-95b5-76666d6246fb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1394 microversion: 2.1 time: 0.223184 Aug 09 17:55:47.388254 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3141/6017] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:47 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1394 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:48.104151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-22e8a844-4d16-4bb1-a55c-22dc30a50f68 req-6b45c002-f643-446f-bce3-0c53eb9d373f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4", "name": "network-vif-deleted", "tag": "03f36b88-bd5c-40cd-b6f7-a4aa82c51108"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:48.122307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-22e8a844-4d16-4bb1-a55c-22dc30a50f68 req-6b45c002-f643-446f-bce3-0c53eb9d373f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:48.122833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-22e8a844-4d16-4bb1-a55c-22dc30a50f68 req-6b45c002-f643-446f-bce3-0c53eb9d373f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:48.123293 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-22e8a844-4d16-4bb1-a55c-22dc30a50f68 req-6b45c002-f643-446f-bce3-0c53eb9d373f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:48.150625 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-22e8a844-4d16-4bb1-a55c-22dc30a50f68 req-6b45c002-f643-446f-bce3-0c53eb9d373f service nova] Creating event network-vif-deleted:03f36b88-bd5c-40cd-b6f7-a4aa82c51108 for instance c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 on n-h2-845781-6 Aug 09 17:55:48.155650 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-22e8a844-4d16-4bb1-a55c-22dc30a50f68 req-6b45c002-f643-446f-bce3-0c53eb9d373f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054951 Aug 09 17:55:48.156632 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2877/6018] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:55:48.424632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5274d7e0-736d-49ff-9ba9-a6c8aa980798 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:48.425817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5274d7e0-736d-49ff-9ba9-a6c8aa980798 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:48.440430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5274d7e0-736d-49ff-9ba9-a6c8aa980798 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:48.442754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5274d7e0-736d-49ff-9ba9-a6c8aa980798 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:48.443291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5274d7e0-736d-49ff-9ba9-a6c8aa980798 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:48.446463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5274d7e0-736d-49ff-9ba9-a6c8aa980798 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:48.447971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5274d7e0-736d-49ff-9ba9-a6c8aa980798 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:48.448607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5274d7e0-736d-49ff-9ba9-a6c8aa980798 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:48.471732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:55:48.556695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5274d7e0-736d-49ff-9ba9-a6c8aa980798 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:48.570873 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5274d7e0-736d-49ff-9ba9-a6c8aa980798 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1187 microversion: 2.1 time: 0.153450 Aug 09 17:55:48.572351 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3142/6019] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:48 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1187 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:49.593820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1e6b8b9c-d5ed-483f-895b-235322b504ed tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:49.594531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1e6b8b9c-d5ed-483f-895b-235322b504ed tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:49.602127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e6b8b9c-d5ed-483f-895b-235322b504ed tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:49.602672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e6b8b9c-d5ed-483f-895b-235322b504ed tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:49.603122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e6b8b9c-d5ed-483f-895b-235322b504ed tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:49.604069 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e6b8b9c-d5ed-483f-895b-235322b504ed tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:49.604588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e6b8b9c-d5ed-483f-895b-235322b504ed tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:49.605026 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1e6b8b9c-d5ed-483f-895b-235322b504ed tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:49.675944 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1e6b8b9c-d5ed-483f-895b-235322b504ed tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:49.687220 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1e6b8b9c-d5ed-483f-895b-235322b504ed tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1187 microversion: 2.1 time: 0.098487 Aug 09 17:55:49.688648 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2878/6020] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:49 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:50.708575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-13ed7ac1-8c5b-41b4-82cc-9e06a84d15b0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:50.709307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-13ed7ac1-8c5b-41b4-82cc-9e06a84d15b0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:50.716986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13ed7ac1-8c5b-41b4-82cc-9e06a84d15b0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:50.717802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13ed7ac1-8c5b-41b4-82cc-9e06a84d15b0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:50.718449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13ed7ac1-8c5b-41b4-82cc-9e06a84d15b0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:50.719375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13ed7ac1-8c5b-41b4-82cc-9e06a84d15b0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:50.720057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13ed7ac1-8c5b-41b4-82cc-9e06a84d15b0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:50.720911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13ed7ac1-8c5b-41b4-82cc-9e06a84d15b0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:50.814885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13ed7ac1-8c5b-41b4-82cc-9e06a84d15b0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:50.824320 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-13ed7ac1-8c5b-41b4-82cc-9e06a84d15b0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1187 microversion: 2.1 time: 0.119666 Aug 09 17:55:50.838219 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3143/6021] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:50 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1187 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:51.845354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3d8626d2-9a20-4df4-84dd-42e3c01513c3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:51.845916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3d8626d2-9a20-4df4-84dd-42e3c01513c3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:51.863400 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8626d2-9a20-4df4-84dd-42e3c01513c3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:51.864007 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8626d2-9a20-4df4-84dd-42e3c01513c3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:51.864654 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8626d2-9a20-4df4-84dd-42e3c01513c3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:51.865389 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8626d2-9a20-4df4-84dd-42e3c01513c3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:51.866164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8626d2-9a20-4df4-84dd-42e3c01513c3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:51.866593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3d8626d2-9a20-4df4-84dd-42e3c01513c3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:51.953285 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3d8626d2-9a20-4df4-84dd-42e3c01513c3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:51.962137 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3d8626d2-9a20-4df4-84dd-42e3c01513c3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1187 microversion: 2.1 time: 0.120766 Aug 09 17:55:51.962915 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2879/6022] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:51 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1187 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:52.984215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:52.984997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:52.993009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:52.993518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:52.994008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:52.995882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:52.996110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:52.996622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:53.048173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:53.048672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:53.049149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:53.049682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lazy-loading 'fault' on Instance uuid c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:55:53.113496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:55:53.126768 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-56021c46-6c36-4f29-9838-68bca04f49da tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 200 len: 1146 microversion: 2.1 time: 0.146096 Aug 09 17:55:53.128139 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3144/6023] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:52 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 1146 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:55:54.153667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:55:54.154375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:54.165177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:54.166077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:54.166809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:54.168053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:54.168735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:54.169372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:54.189260 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 could not be found. Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 HTTP/1.1 Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 could not be found. Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': 'c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4'} Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 could not be found. Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 could not be found. Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:55:54.198059 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:55:54.202899 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:55:54.202899 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:55:54.202899 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:55:54.202899 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:55:54.202899 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:55:54.202899 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 could not be found. Aug 09 17:55:54.202899 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:55:54.205697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:55:54.208660 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f7c33e5b-c5b8-42b4-96a3-baf69f06595b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4" status: 404 len: 111 microversion: 2.1 time: 0.059790 Aug 09 17:55:54.212919 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2880/6024] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:55:54 2022] GET /compute/v2.1/servers/c7e4f6a8-6fe5-40da-a033-4b8d0255c3c4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:55:59.419567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-279591609", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "405ce292-f420-4970-ae87-896667bb6b25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:59.506729 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] validate_networks() for [('0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:55:59.599409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-761779a6-6147-43c5-a18c-1fbcd013a43a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:55:59.602364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-761779a6-6147-43c5-a18c-1fbcd013a43a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:55:59.608073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-761779a6-6147-43c5-a18c-1fbcd013a43a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:59.608567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-761779a6-6147-43c5-a18c-1fbcd013a43a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:59.609000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-761779a6-6147-43c5-a18c-1fbcd013a43a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:59.609704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-761779a6-6147-43c5-a18c-1fbcd013a43a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:55:59.610154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-761779a6-6147-43c5-a18c-1fbcd013a43a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:55:59.610578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-761779a6-6147-43c5-a18c-1fbcd013a43a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:55:59.678835 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-761779a6-6147-43c5-a18c-1fbcd013a43a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d/action" status: 200 len: 63246 microversion: 2.1 time: 0.307169 Aug 09 17:55:59.683027 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3145/6025] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:55:59 2022] POST /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d/action => generated 63246 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:56:00.170569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:56:00.172029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:56:00.172753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:56:00.173355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:56:00.174768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:56:00.186538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:00.187039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:00.187479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:00.188271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:00.188726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:00.189399 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:00.211264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:00.217988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for user 87590ee7f71345a8914b350c5999d974 and project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:00.283985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:56:00.287197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='405ce292-f420-4970-ae87-896667bb6b25',volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:56:00.436000 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3a2f4f46-f8ea-487b-ac09-6db35ada72d1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.020366 Aug 09 17:56:00.437797 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2881/6026] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:56:00.450928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0c22bba0-d510-4e0a-b1ff-143406452f0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:00.452464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0c22bba0-d510-4e0a-b1ff-143406452f0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:00.886834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0c22bba0-d510-4e0a-b1ff-143406452f0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:00.894267 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0c22bba0-d510-4e0a-b1ff-143406452f0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1056 microversion: 2.1 time: 0.448490 Aug 09 17:56:00.895304 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3146/6027] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:00 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1056 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:01.918494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-67c1c019-3a9c-40ab-b126-0b52409afdfa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:01.920281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-67c1c019-3a9c-40ab-b126-0b52409afdfa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:01.933431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67c1c019-3a9c-40ab-b126-0b52409afdfa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:01.945633 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67c1c019-3a9c-40ab-b126-0b52409afdfa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:01.946465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67c1c019-3a9c-40ab-b126-0b52409afdfa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:01.954734 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67c1c019-3a9c-40ab-b126-0b52409afdfa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:01.955539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67c1c019-3a9c-40ab-b126-0b52409afdfa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:01.956188 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67c1c019-3a9c-40ab-b126-0b52409afdfa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:02.047551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-67c1c019-3a9c-40ab-b126-0b52409afdfa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:02.058415 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-67c1c019-3a9c-40ab-b126-0b52409afdfa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1172 microversion: 2.1 time: 0.146700 Aug 09 17:56:02.059656 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2882/6028] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:01 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1172 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:03.081186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fc0399fe-a73a-453c-adb3-41db863e8161 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:03.082567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fc0399fe-a73a-453c-adb3-41db863e8161 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:03.098964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc0399fe-a73a-453c-adb3-41db863e8161 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:03.101248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc0399fe-a73a-453c-adb3-41db863e8161 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:03.102542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc0399fe-a73a-453c-adb3-41db863e8161 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:03.105405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc0399fe-a73a-453c-adb3-41db863e8161 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:03.106446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc0399fe-a73a-453c-adb3-41db863e8161 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:03.108045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc0399fe-a73a-453c-adb3-41db863e8161 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:03.350263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fc0399fe-a73a-453c-adb3-41db863e8161 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:03.361765 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fc0399fe-a73a-453c-adb3-41db863e8161 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1214 microversion: 2.1 time: 0.284889 Aug 09 17:56:03.376678 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3147/6029] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:03 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1214 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:03.424755 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-8597dab7-c9ec-49c8-b0f2-1284e65730e7 req-1f5871d9-0c0a-47dc-a611-0b6bc2daaecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acf4375-2d5f-41e5-bd20-65473e5fac2b", "tag": "969b444c-d34e-46bf-b0cd-121658fdd8b3"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:03.445203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:03.454866 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8597dab7-c9ec-49c8-b0f2-1284e65730e7 req-1f5871d9-0c0a-47dc-a611-0b6bc2daaecb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:03.456365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8597dab7-c9ec-49c8-b0f2-1284e65730e7 req-1f5871d9-0c0a-47dc-a611-0b6bc2daaecb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:03.458136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-8597dab7-c9ec-49c8-b0f2-1284e65730e7 req-1f5871d9-0c0a-47dc-a611-0b6bc2daaecb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:03.476797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=86 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:03.480636 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-8597dab7-c9ec-49c8-b0f2-1284e65730e7 req-1f5871d9-0c0a-47dc-a611-0b6bc2daaecb service nova] Creating event network-changed:969b444c-d34e-46bf-b0cd-121658fdd8b3 for instance 0acf4375-2d5f-41e5-bd20-65473e5fac2b on n-h2-845781-6 Aug 09 17:56:03.495858 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-8597dab7-c9ec-49c8-b0f2-1284e65730e7 req-1f5871d9-0c0a-47dc-a611-0b6bc2daaecb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081840 Aug 09 17:56:03.499748 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2883/6030] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:04.386119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6192e6e2-479b-49d7-a1fa-c540d21ccc2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:04.386741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6192e6e2-479b-49d7-a1fa-c540d21ccc2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:04.400223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6192e6e2-479b-49d7-a1fa-c540d21ccc2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:04.400738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6192e6e2-479b-49d7-a1fa-c540d21ccc2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:04.402218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6192e6e2-479b-49d7-a1fa-c540d21ccc2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:04.402983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6192e6e2-479b-49d7-a1fa-c540d21ccc2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:04.403357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6192e6e2-479b-49d7-a1fa-c540d21ccc2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:04.404954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6192e6e2-479b-49d7-a1fa-c540d21ccc2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:04.765090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6192e6e2-479b-49d7-a1fa-c540d21ccc2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:04.789005 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6192e6e2-479b-49d7-a1fa-c540d21ccc2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1214 microversion: 2.1 time: 0.406167 Aug 09 17:56:04.792533 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3148/6031] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:04 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1214 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:05.816303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4d0f4f6c-aff8-4f07-8e19-0d193f5bf26b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:05.817149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4d0f4f6c-aff8-4f07-8e19-0d193f5bf26b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:05.826801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0f4f6c-aff8-4f07-8e19-0d193f5bf26b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:05.826801 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0f4f6c-aff8-4f07-8e19-0d193f5bf26b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:05.827263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0f4f6c-aff8-4f07-8e19-0d193f5bf26b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:05.827744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0f4f6c-aff8-4f07-8e19-0d193f5bf26b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:05.828604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0f4f6c-aff8-4f07-8e19-0d193f5bf26b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:05.829197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4d0f4f6c-aff8-4f07-8e19-0d193f5bf26b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:06.191009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4d0f4f6c-aff8-4f07-8e19-0d193f5bf26b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:06.202413 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4d0f4f6c-aff8-4f07-8e19-0d193f5bf26b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1214 microversion: 2.1 time: 0.392116 Aug 09 17:56:06.203372 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2884/6032] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:05 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1214 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:06.262496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-313456d1-6eba-420f-91b4-9365c986b02b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:06.263741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-313456d1-6eba-420f-91b4-9365c986b02b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:06.266138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:06.272619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-313456d1-6eba-420f-91b4-9365c986b02b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:06.273389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-313456d1-6eba-420f-91b4-9365c986b02b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:06.273833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-313456d1-6eba-420f-91b4-9365c986b02b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:06.274640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-313456d1-6eba-420f-91b4-9365c986b02b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:06.275101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-313456d1-6eba-420f-91b4-9365c986b02b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:06.275727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-313456d1-6eba-420f-91b4-9365c986b02b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:06.515274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-313456d1-6eba-420f-91b4-9365c986b02b tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1836 microversion: 2.1 time: 0.538504 Aug 09 17:56:06.516116 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3149/6033] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:05 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1836 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:07.225746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-22b84c96-662f-42d0-937c-faec59f2a590 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:07.226483 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-22b84c96-662f-42d0-937c-faec59f2a590 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:07.242515 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22b84c96-662f-42d0-937c-faec59f2a590 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:07.243325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22b84c96-662f-42d0-937c-faec59f2a590 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:07.264105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22b84c96-662f-42d0-937c-faec59f2a590 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:07.265187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22b84c96-662f-42d0-937c-faec59f2a590 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:07.265785 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22b84c96-662f-42d0-937c-faec59f2a590 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:07.266332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-22b84c96-662f-42d0-937c-faec59f2a590 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:07.543992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-22b84c96-662f-42d0-937c-faec59f2a590 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:07.557280 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-22b84c96-662f-42d0-937c-faec59f2a590 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1214 microversion: 2.1 time: 0.336759 Aug 09 17:56:07.559595 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2885/6034] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:07 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1214 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:07.972283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38463d84-fb11-4f3b-bcfc-8a01998e4f11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:07.973546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-38463d84-fb11-4f3b-bcfc-8a01998e4f11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:07.977243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-f3a43522-7e3a-4e3c-b3ee-25ab2b5a22ef req-da8c6d6b-cb78-44ed-8233-5115313abddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3ac82a-2978-42ba-a133-a5db20652f5d", "tag": "b09f6bbd-ae75-4189-b58f-5b1f600d8c2b"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:07.981674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38463d84-fb11-4f3b-bcfc-8a01998e4f11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:07.982536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38463d84-fb11-4f3b-bcfc-8a01998e4f11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:07.983236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38463d84-fb11-4f3b-bcfc-8a01998e4f11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:07.984232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38463d84-fb11-4f3b-bcfc-8a01998e4f11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:07.984980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38463d84-fb11-4f3b-bcfc-8a01998e4f11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:07.985649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38463d84-fb11-4f3b-bcfc-8a01998e4f11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:07.987203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f3a43522-7e3a-4e3c-b3ee-25ab2b5a22ef req-da8c6d6b-cb78-44ed-8233-5115313abddd service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:07.987779 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f3a43522-7e3a-4e3c-b3ee-25ab2b5a22ef req-da8c6d6b-cb78-44ed-8233-5115313abddd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:07.988422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-f3a43522-7e3a-4e3c-b3ee-25ab2b5a22ef req-da8c6d6b-cb78-44ed-8233-5115313abddd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:08.014915 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-f3a43522-7e3a-4e3c-b3ee-25ab2b5a22ef req-da8c6d6b-cb78-44ed-8233-5115313abddd service nova] Creating event network-changed:b09f6bbd-ae75-4189-b58f-5b1f600d8c2b for instance af3ac82a-2978-42ba-a133-a5db20652f5d on n-h1-845781-6 Aug 09 17:56:08.017164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-38463d84-fb11-4f3b-bcfc-8a01998e4f11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:56:08.024499 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-f3a43522-7e3a-4e3c-b3ee-25ab2b5a22ef req-da8c6d6b-cb78-44ed-8233-5115313abddd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051787 Aug 09 17:56:08.025760 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2886/6035] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:56:08.195476 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-38463d84-fb11-4f3b-bcfc-8a01998e4f11 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "DELETE /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 204 len: 0 microversion: 2.1 time: 0.227081 Aug 09 17:56:08.200516 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3150/6036] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:56:07 2022] DELETE /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:56:08.218555 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-7c753522-01a9-43db-b285-f04fa59a119f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:08.220345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-7c753522-01a9-43db-b285-f04fa59a119f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:08.229812 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c753522-01a9-43db-b285-f04fa59a119f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:08.232601 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c753522-01a9-43db-b285-f04fa59a119f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:08.233648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c753522-01a9-43db-b285-f04fa59a119f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:08.234346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c753522-01a9-43db-b285-f04fa59a119f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:08.234810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c753522-01a9-43db-b285-f04fa59a119f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:08.235233 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-7c753522-01a9-43db-b285-f04fa59a119f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:08.579654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-864df517-9d8c-42b8-8fd7-aabbf628da78 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:08.581992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-864df517-9d8c-42b8-8fd7-aabbf628da78 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:08.593380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-864df517-9d8c-42b8-8fd7-aabbf628da78 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:08.594134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-864df517-9d8c-42b8-8fd7-aabbf628da78 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:08.596148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-864df517-9d8c-42b8-8fd7-aabbf628da78 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:08.598518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-864df517-9d8c-42b8-8fd7-aabbf628da78 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:08.600254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-864df517-9d8c-42b8-8fd7-aabbf628da78 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:08.600899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-864df517-9d8c-42b8-8fd7-aabbf628da78 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:08.885050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-7c753522-01a9-43db-b285-f04fa59a119f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:08.904311 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-7c753522-01a9-43db-b285-f04fa59a119f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1691 microversion: 2.1 time: 0.693618 Aug 09 17:56:08.909265 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2887/6037] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:08 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1691 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:09.221137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-864df517-9d8c-42b8-8fd7-aabbf628da78 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:09.231320 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-864df517-9d8c-42b8-8fd7-aabbf628da78 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1202 microversion: 2.1 time: 0.656210 Aug 09 17:56:09.247551 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3151/6038] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:08 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1202 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:09.945473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-05962686-0a46-4388-9f79-4bec33a59080 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:09.946687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-05962686-0a46-4388-9f79-4bec33a59080 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:09.967673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05962686-0a46-4388-9f79-4bec33a59080 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:09.968805 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05962686-0a46-4388-9f79-4bec33a59080 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:09.969815 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05962686-0a46-4388-9f79-4bec33a59080 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:09.971318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05962686-0a46-4388-9f79-4bec33a59080 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:09.973538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05962686-0a46-4388-9f79-4bec33a59080 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:09.975052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05962686-0a46-4388-9f79-4bec33a59080 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:10.201193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:10.226694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:10.262057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-899fe53d-c729-4a2c-8853-7732e74ea83f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:10.263169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-899fe53d-c729-4a2c-8853-7732e74ea83f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:10.288761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899fe53d-c729-4a2c-8853-7732e74ea83f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:10.291383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899fe53d-c729-4a2c-8853-7732e74ea83f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:10.292324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899fe53d-c729-4a2c-8853-7732e74ea83f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:10.293911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899fe53d-c729-4a2c-8853-7732e74ea83f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:10.294907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899fe53d-c729-4a2c-8853-7732e74ea83f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:10.296246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-899fe53d-c729-4a2c-8853-7732e74ea83f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:10.401735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-05962686-0a46-4388-9f79-4bec33a59080 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:10.420583 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-05962686-0a46-4388-9f79-4bec33a59080 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 200 len: 1572 microversion: 2.1 time: 0.492403 Aug 09 17:56:10.434935 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2888/6039] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:09 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 1572 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:10.531863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-899fe53d-c729-4a2c-8853-7732e74ea83f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:10.549364 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-899fe53d-c729-4a2c-8853-7732e74ea83f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1202 microversion: 2.1 time: 0.298227 Aug 09 17:56:10.550291 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3152/6040] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:10 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1202 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:10.728131 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-7ae72f47-cef2-4af8-a94f-b25eb01a62ae req-d836d18a-2e5d-41ff-978f-2356645dae81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3ac82a-2978-42ba-a133-a5db20652f5d", "name": "network-vif-deleted", "tag": "b09f6bbd-ae75-4189-b58f-5b1f600d8c2b"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:10.739046 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7ae72f47-cef2-4af8-a94f-b25eb01a62ae req-d836d18a-2e5d-41ff-978f-2356645dae81 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:10.740504 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7ae72f47-cef2-4af8-a94f-b25eb01a62ae req-d836d18a-2e5d-41ff-978f-2356645dae81 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:10.741178 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-7ae72f47-cef2-4af8-a94f-b25eb01a62ae req-d836d18a-2e5d-41ff-978f-2356645dae81 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:10.755007 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-7ae72f47-cef2-4af8-a94f-b25eb01a62ae req-d836d18a-2e5d-41ff-978f-2356645dae81 service nova] Creating event network-vif-deleted:b09f6bbd-ae75-4189-b58f-5b1f600d8c2b for instance af3ac82a-2978-42ba-a133-a5db20652f5d on n-h1-845781-6 Aug 09 17:56:10.760863 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-7ae72f47-cef2-4af8-a94f-b25eb01a62ae req-d836d18a-2e5d-41ff-978f-2356645dae81 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036951 Aug 09 17:56:10.761913 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2889/6041] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:11.448436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:11.449908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: af3ac82a-2978-42ba-a133-a5db20652f5d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:11.462897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:11.469171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:11.469670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:11.470469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:11.471305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:11.471777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:11.472894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:11.495057 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] HTTP exception thrown: Instance af3ac82a-2978-42ba-a133-a5db20652f5d could not be found. Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Request method failure captured: Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d HTTP/1.1 Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p5yR1vvXdoHF6Ye4OkNhkM0OM2jWQEtgxloVubvvpM1GvnEKWmLvq_LisffgRln3d8YjK5jNj034a5fZK1hfamQn32lQw79jkbHDA9No0pavvPRNmpI4Zrw53leLAXhgbg98UjYYgE3lTGBb7Ptu6pOydP_Ub-aqj0vIBjuHGJazf4 Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 060105d0d71644839935005af8ad1bda Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_060105d0d71644839935005af8ad1bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/060105d0d71644839935005af8ad1bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/060105d0d71644839935005af8ad1bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/060105d0d71644839935005af8ad1bda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 060105d0d71644839935005af8ad1bda Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestNetworkAdvancedServerOps-278625738-project Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a343f75165674844a2e9e46500fa01c0 Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestNetworkAdvancedServerOps-278625738-project Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance af3ac82a-2978-42ba-a133-a5db20652f5d could not be found. Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'af3ac82a-2978-42ba-a133-a5db20652f5d'} Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3ac82a-2978-42ba-a133-a5db20652f5d could not be found. Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3ac82a-2978-42ba-a133-a5db20652f5d could not be found. Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:56:11.497698 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:11.501537 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:56:11.501537 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:11.501537 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:11.501537 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:11.501537 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:56:11.501537 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:56:11.501537 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3ac82a-2978-42ba-a133-a5db20652f5d could not be found. Aug 09 17:56:11.501537 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:56:11.501537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Returning 404 to user: Instance af3ac82a-2978-42ba-a133-a5db20652f5d could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:56:11.501537 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fec07269-51d4-4164-b349-260b9803af85 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d" status: 404 len: 111 microversion: 2.1 time: 0.058814 Aug 09 17:56:11.501537 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3153/6042] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:11 2022] GET /compute/v2.1/servers/af3ac82a-2978-42ba-a133-a5db20652f5d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:56:11.570474 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-724cd64b-0b81-4578-9f7f-c40f86650e4f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:11.571186 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-724cd64b-0b81-4578-9f7f-c40f86650e4f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:11.588166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-724cd64b-0b81-4578-9f7f-c40f86650e4f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:11.588723 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-724cd64b-0b81-4578-9f7f-c40f86650e4f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:11.589933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-724cd64b-0b81-4578-9f7f-c40f86650e4f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:11.590725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-724cd64b-0b81-4578-9f7f-c40f86650e4f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:11.591245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-724cd64b-0b81-4578-9f7f-c40f86650e4f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:11.591722 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-724cd64b-0b81-4578-9f7f-c40f86650e4f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:11.879160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-724cd64b-0b81-4578-9f7f-c40f86650e4f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:11.907122 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-724cd64b-0b81-4578-9f7f-c40f86650e4f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1202 microversion: 2.1 time: 0.340997 Aug 09 17:56:11.909547 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2890/6043] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:11 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1202 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:12.940945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-448bf40b-2759-4f47-a8dc-0ca959bba4dd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:12.945868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-448bf40b-2759-4f47-a8dc-0ca959bba4dd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:12.963085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-448bf40b-2759-4f47-a8dc-0ca959bba4dd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:12.964397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-448bf40b-2759-4f47-a8dc-0ca959bba4dd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:12.965558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-448bf40b-2759-4f47-a8dc-0ca959bba4dd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:12.967020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-448bf40b-2759-4f47-a8dc-0ca959bba4dd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:12.968325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-448bf40b-2759-4f47-a8dc-0ca959bba4dd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:12.969274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-448bf40b-2759-4f47-a8dc-0ca959bba4dd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:13.266284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-448bf40b-2759-4f47-a8dc-0ca959bba4dd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:13.279007 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-448bf40b-2759-4f47-a8dc-0ca959bba4dd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1202 microversion: 2.1 time: 0.348720 Aug 09 17:56:13.281402 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3154/6044] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:12 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1202 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:14.303834 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cfaa6f2b-a931-4d2c-8f56-d733d03d16f7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:14.305080 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cfaa6f2b-a931-4d2c-8f56-d733d03d16f7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:14.322355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfaa6f2b-a931-4d2c-8f56-d733d03d16f7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:14.323603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfaa6f2b-a931-4d2c-8f56-d733d03d16f7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:14.324402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfaa6f2b-a931-4d2c-8f56-d733d03d16f7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:14.329594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfaa6f2b-a931-4d2c-8f56-d733d03d16f7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:14.330335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfaa6f2b-a931-4d2c-8f56-d733d03d16f7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:14.331078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cfaa6f2b-a931-4d2c-8f56-d733d03d16f7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:14.733885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cfaa6f2b-a931-4d2c-8f56-d733d03d16f7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:14.744916 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cfaa6f2b-a931-4d2c-8f56-d733d03d16f7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1202 microversion: 2.1 time: 0.446031 Aug 09 17:56:14.746449 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2891/6045] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:14 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1202 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:15.601016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ea914f4-3908-4fb8-8d19-d24c7676cf78 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:15.601619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ea914f4-3908-4fb8-8d19-d24c7676cf78 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:15.616761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-012c835b-65b6-4f85-9b31-dcca77503ee3 req-9ce5097a-abee-43dc-a6f5-00c274b0dc20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6deeed13-eae8-4843-8d55-2b1ecf02b624", "tag": "df10f198-4b53-4454-b6a1-5f77d9a839de"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:15.621553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea914f4-3908-4fb8-8d19-d24c7676cf78 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:15.622284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea914f4-3908-4fb8-8d19-d24c7676cf78 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:15.622999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea914f4-3908-4fb8-8d19-d24c7676cf78 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:15.624117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea914f4-3908-4fb8-8d19-d24c7676cf78 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:15.625175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea914f4-3908-4fb8-8d19-d24c7676cf78 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:15.625966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ea914f4-3908-4fb8-8d19-d24c7676cf78 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:15.673249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-012c835b-65b6-4f85-9b31-dcca77503ee3 req-9ce5097a-abee-43dc-a6f5-00c274b0dc20 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:15.673935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-012c835b-65b6-4f85-9b31-dcca77503ee3 req-9ce5097a-abee-43dc-a6f5-00c274b0dc20 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:15.677952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-012c835b-65b6-4f85-9b31-dcca77503ee3 req-9ce5097a-abee-43dc-a6f5-00c274b0dc20 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:15.685937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ea914f4-3908-4fb8-8d19-d24c7676cf78 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:56:15.722489 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-012c835b-65b6-4f85-9b31-dcca77503ee3 req-9ce5097a-abee-43dc-a6f5-00c274b0dc20 service nova] Creating event network-changed:df10f198-4b53-4454-b6a1-5f77d9a839de for instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 on n-h1-845781-6 Aug 09 17:56:15.736413 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-012c835b-65b6-4f85-9b31-dcca77503ee3 req-9ce5097a-abee-43dc-a6f5-00c274b0dc20 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126090 Aug 09 17:56:15.751979 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2892/6046] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:56:15.783359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4f21aae9-c5a3-4b6c-81e6-5f6a6ac6cff8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:15.784301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4f21aae9-c5a3-4b6c-81e6-5f6a6ac6cff8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:15.807002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f21aae9-c5a3-4b6c-81e6-5f6a6ac6cff8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:15.807990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f21aae9-c5a3-4b6c-81e6-5f6a6ac6cff8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:15.809375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f21aae9-c5a3-4b6c-81e6-5f6a6ac6cff8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:15.810727 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f21aae9-c5a3-4b6c-81e6-5f6a6ac6cff8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:15.813985 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f21aae9-c5a3-4b6c-81e6-5f6a6ac6cff8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:15.814545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4f21aae9-c5a3-4b6c-81e6-5f6a6ac6cff8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:15.931449 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ea914f4-3908-4fb8-8d19-d24c7676cf78 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 204 len: 0 microversion: 2.1 time: 0.333232 Aug 09 17:56:15.933358 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3155/6047] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:56:15 2022] DELETE /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:56:15.957582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25c65464-a91c-42f0-bc81-0ef59e4e1d8e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:15.959414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-25c65464-a91c-42f0-bc81-0ef59e4e1d8e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:15.994909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25c65464-a91c-42f0-bc81-0ef59e4e1d8e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:15.997566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25c65464-a91c-42f0-bc81-0ef59e4e1d8e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:16.008778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25c65464-a91c-42f0-bc81-0ef59e4e1d8e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:16.009995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25c65464-a91c-42f0-bc81-0ef59e4e1d8e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:16.010775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25c65464-a91c-42f0-bc81-0ef59e4e1d8e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:16.011571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25c65464-a91c-42f0-bc81-0ef59e4e1d8e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:16.338409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-25c65464-a91c-42f0-bc81-0ef59e4e1d8e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:16.350726 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-25c65464-a91c-42f0-bc81-0ef59e4e1d8e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1582 microversion: 2.1 time: 0.407210 Aug 09 17:56:16.351589 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3156/6048] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:15 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1582 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:16.831088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4f21aae9-c5a3-4b6c-81e6-5f6a6ac6cff8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:16.841977 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4f21aae9-c5a3-4b6c-81e6-5f6a6ac6cff8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1202 microversion: 2.1 time: 1.077009 Aug 09 17:56:16.858583 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2893/6049] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:15 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1202 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:17.396701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-534c7e85-3ea6-47d0-b758-ef4e66a84f9e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:17.407382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-534c7e85-3ea6-47d0-b758-ef4e66a84f9e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:17.423101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-534c7e85-3ea6-47d0-b758-ef4e66a84f9e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:17.423758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-534c7e85-3ea6-47d0-b758-ef4e66a84f9e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:17.424219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-534c7e85-3ea6-47d0-b758-ef4e66a84f9e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:17.424964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-534c7e85-3ea6-47d0-b758-ef4e66a84f9e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:17.425427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-534c7e85-3ea6-47d0-b758-ef4e66a84f9e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:17.425858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-534c7e85-3ea6-47d0-b758-ef4e66a84f9e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:17.431389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:17.873829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-de97c8af-7ab4-4748-a46d-461815dfed1d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:17.876551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-de97c8af-7ab4-4748-a46d-461815dfed1d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:17.918930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de97c8af-7ab4-4748-a46d-461815dfed1d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:17.919081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de97c8af-7ab4-4748-a46d-461815dfed1d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:17.919494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de97c8af-7ab4-4748-a46d-461815dfed1d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:17.920913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de97c8af-7ab4-4748-a46d-461815dfed1d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:17.921810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de97c8af-7ab4-4748-a46d-461815dfed1d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:17.922408 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-de97c8af-7ab4-4748-a46d-461815dfed1d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:18.153196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-534c7e85-3ea6-47d0-b758-ef4e66a84f9e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:18.162720 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-534c7e85-3ea6-47d0-b758-ef4e66a84f9e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1582 microversion: 2.1 time: 0.779068 Aug 09 17:56:18.168780 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3157/6050] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:17 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1582 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:18.313375 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-de97c8af-7ab4-4748-a46d-461815dfed1d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:18.328756 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-de97c8af-7ab4-4748-a46d-461815dfed1d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1202 microversion: 2.1 time: 0.464775 Aug 09 17:56:18.342202 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2894/6051] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:17 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1202 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:18.353905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43316e08-dbf2-42d9-9913-4a44c151bc84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '.version_select at 0x7fbbdc9ec5e0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:18.359866 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43316e08-dbf2-42d9-9913-4a44c151bc84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [49dc9fd5-bcbd-4fa9-bc72-49fff9e68c2b] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 17:56:19.195862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5e29a9c-f8dc-4b82-b52c-5df91e3566b6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:19.197089 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5e29a9c-f8dc-4b82-b52c-5df91e3566b6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:19.208595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e29a9c-f8dc-4b82-b52c-5df91e3566b6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:19.209429 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e29a9c-f8dc-4b82-b52c-5df91e3566b6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:19.210356 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e29a9c-f8dc-4b82-b52c-5df91e3566b6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:19.211826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e29a9c-f8dc-4b82-b52c-5df91e3566b6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:19.212958 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e29a9c-f8dc-4b82-b52c-5df91e3566b6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:19.213479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5e29a9c-f8dc-4b82-b52c-5df91e3566b6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:19.291917 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e5e29a9c-f8dc-4b82-b52c-5df91e3566b6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:19.300124 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5e29a9c-f8dc-4b82-b52c-5df91e3566b6 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1396 microversion: 2.1 time: 0.108886 Aug 09 17:56:19.300732 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2895/6052] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:19 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1396 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:19.351358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-05adb7ce-41dd-47a8-92d5-45fa9b7a64dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:19.352110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-05adb7ce-41dd-47a8-92d5-45fa9b7a64dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:19.360000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05adb7ce-41dd-47a8-92d5-45fa9b7a64dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:19.360614 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05adb7ce-41dd-47a8-92d5-45fa9b7a64dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:19.361141 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05adb7ce-41dd-47a8-92d5-45fa9b7a64dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:19.362087 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05adb7ce-41dd-47a8-92d5-45fa9b7a64dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:19.363202 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05adb7ce-41dd-47a8-92d5-45fa9b7a64dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:19.365039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-05adb7ce-41dd-47a8-92d5-45fa9b7a64dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:19.370820 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [None req-43316e08-dbf2-42d9-9913-4a44c151bc84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [49dc9fd5-bcbd-4fa9-bc72-49fff9e68c2b] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 56646. Aug 09 17:56:19.398232 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43316e08-dbf2-42d9-9913-4a44c151bc84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1582999332" status: 202 len: 0 microversion: 2.1 time: 1.047919 Aug 09 17:56:19.399165 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3158/6053] 10.222.0.93 () {58 vars in 1284 bytes} [Tue Aug 9 17:56:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1582999332 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:56:19.451610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19ff4480-ad3a-409a-953e-bc8da3512ef2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'create', calling method: .version_select at 0x7fbbca44e430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-846907744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFdEOZWcATZ5lSnPXMHsPZ8ofkb5FdYkeGur8AFrqZMq7LUYBu5c4b8ASUrHcot2rxqHtDaeVwtyaWdcHEAdxFljpVDjdINS42CqiO6q6bu5AmFlRVQmKH2SSAHAH4oow=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:19.478850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-19ff4480-ad3a-409a-953e-bc8da3512ef2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for project 060105d0d71644839935005af8ad1bda. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:19.487310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-19ff4480-ad3a-409a-953e-bc8da3512ef2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for user a343f75165674844a2e9e46500fa01c0 and project 060105d0d71644839935005af8ad1bda. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:19.525822 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19ff4480-ad3a-409a-953e-bc8da3512ef2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.084357 Aug 09 17:56:19.528465 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3159/6054] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:56:19 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:19.539152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4a12304f-95e7-45ac-a5d5-262e6451f045 req-e9732e1a-9cef-4e0c-9477-b6402041137d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6deeed13-eae8-4843-8d55-2b1ecf02b624", "name": "network-vif-deleted", "tag": "df10f198-4b53-4454-b6a1-5f77d9a839de"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:19.558555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4a12304f-95e7-45ac-a5d5-262e6451f045 req-e9732e1a-9cef-4e0c-9477-b6402041137d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:19.559457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4a12304f-95e7-45ac-a5d5-262e6451f045 req-e9732e1a-9cef-4e0c-9477-b6402041137d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:19.560293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4a12304f-95e7-45ac-a5d5-262e6451f045 req-e9732e1a-9cef-4e0c-9477-b6402041137d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:19.582766 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4a12304f-95e7-45ac-a5d5-262e6451f045 req-e9732e1a-9cef-4e0c-9477-b6402041137d service nova] Creating event network-vif-deleted:df10f198-4b53-4454-b6a1-5f77d9a839de for instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 on n-h1-845781-6 Aug 09 17:56:19.593916 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4a12304f-95e7-45ac-a5d5-262e6451f045 req-e9732e1a-9cef-4e0c-9477-b6402041137d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062949 Aug 09 17:56:19.596178 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3160/6055] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:19.756104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1ecbc09c-5b37-4102-a385-1e767902a486 req-fc294bda-617c-4363-b167-9d191bba73e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acf4375-2d5f-41e5-bd20-65473e5fac2b", "name": "network-vif-plugged", "status": "completed", "tag": "969b444c-d34e-46bf-b0cd-121658fdd8b3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:19.829738 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-05adb7ce-41dd-47a8-92d5-45fa9b7a64dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:19.838755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ecbc09c-5b37-4102-a385-1e767902a486 req-fc294bda-617c-4363-b167-9d191bba73e0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:19.839828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ecbc09c-5b37-4102-a385-1e767902a486 req-fc294bda-617c-4363-b167-9d191bba73e0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:19.841457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ecbc09c-5b37-4102-a385-1e767902a486 req-fc294bda-617c-4363-b167-9d191bba73e0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:19.848953 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-05adb7ce-41dd-47a8-92d5-45fa9b7a64dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1202 microversion: 2.1 time: 0.501538 Aug 09 17:56:19.855090 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2896/6056] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:19 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1202 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:19.927410 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1ecbc09c-5b37-4102-a385-1e767902a486 req-fc294bda-617c-4363-b167-9d191bba73e0 service nova] Creating event network-vif-plugged:969b444c-d34e-46bf-b0cd-121658fdd8b3 for instance 0acf4375-2d5f-41e5-bd20-65473e5fac2b on n-h2-845781-6 Aug 09 17:56:19.939414 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1ecbc09c-5b37-4102-a385-1e767902a486 req-fc294bda-617c-4363-b167-9d191bba73e0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200694 Aug 09 17:56:19.946008 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3161/6057] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:20.325362 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b6ddc848-3442-4a28-aae8-ad645ca1446a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:20.326893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b6ddc848-3442-4a28-aae8-ad645ca1446a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:20.334954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ddc848-3442-4a28-aae8-ad645ca1446a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:20.335868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ddc848-3442-4a28-aae8-ad645ca1446a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:20.336545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ddc848-3442-4a28-aae8-ad645ca1446a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:20.337548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ddc848-3442-4a28-aae8-ad645ca1446a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:20.338254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ddc848-3442-4a28-aae8-ad645ca1446a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:20.338904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b6ddc848-3442-4a28-aae8-ad645ca1446a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:20.426811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b6ddc848-3442-4a28-aae8-ad645ca1446a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:20.456455 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b6ddc848-3442-4a28-aae8-ad645ca1446a tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1228 microversion: 2.1 time: 0.135073 Aug 09 17:56:20.457850 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2897/6058] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:20 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1228 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:20.884963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e9a10994-1c15-4cb9-af4b-1f5007e81dbb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:20.889093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e9a10994-1c15-4cb9-af4b-1f5007e81dbb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:20.909963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a10994-1c15-4cb9-af4b-1f5007e81dbb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:20.912286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a10994-1c15-4cb9-af4b-1f5007e81dbb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:20.914993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a10994-1c15-4cb9-af4b-1f5007e81dbb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:20.916874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a10994-1c15-4cb9-af4b-1f5007e81dbb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:20.918170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a10994-1c15-4cb9-af4b-1f5007e81dbb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:20.919313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9a10994-1c15-4cb9-af4b-1f5007e81dbb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:21.484828 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c1b5c645-b589-46e4-a7dd-0d3a5456997e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:21.486175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c1b5c645-b589-46e4-a7dd-0d3a5456997e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:21.509534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1b5c645-b589-46e4-a7dd-0d3a5456997e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:21.510121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1b5c645-b589-46e4-a7dd-0d3a5456997e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:21.510719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1b5c645-b589-46e4-a7dd-0d3a5456997e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:21.511719 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1b5c645-b589-46e4-a7dd-0d3a5456997e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:21.512546 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1b5c645-b589-46e4-a7dd-0d3a5456997e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:21.523321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c1b5c645-b589-46e4-a7dd-0d3a5456997e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:21.524880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e9a10994-1c15-4cb9-af4b-1f5007e81dbb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:21.539151 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e9a10994-1c15-4cb9-af4b-1f5007e81dbb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1202 microversion: 2.1 time: 0.663737 Aug 09 17:56:21.540466 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3162/6059] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:20 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1202 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:21.671195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c1b5c645-b589-46e4-a7dd-0d3a5456997e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:21.684721 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c1b5c645-b589-46e4-a7dd-0d3a5456997e tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1228 microversion: 2.1 time: 0.204988 Aug 09 17:56:21.707868 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2898/6060] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:21 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1228 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:22.562102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3a7da40c-635f-4ba8-9b2b-22f9694565ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:22.563903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3a7da40c-635f-4ba8-9b2b-22f9694565ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:22.572469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a7da40c-635f-4ba8-9b2b-22f9694565ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:22.573821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a7da40c-635f-4ba8-9b2b-22f9694565ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:22.574533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a7da40c-635f-4ba8-9b2b-22f9694565ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:22.575913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a7da40c-635f-4ba8-9b2b-22f9694565ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:22.576618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a7da40c-635f-4ba8-9b2b-22f9694565ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:22.577292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a7da40c-635f-4ba8-9b2b-22f9694565ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:22.718691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-15d6a5a9-0a28-4ea0-a727-d84766b148a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:22.721168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-15d6a5a9-0a28-4ea0-a727-d84766b148a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:22.734230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15d6a5a9-0a28-4ea0-a727-d84766b148a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:22.735500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15d6a5a9-0a28-4ea0-a727-d84766b148a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:22.737431 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15d6a5a9-0a28-4ea0-a727-d84766b148a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:22.739713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15d6a5a9-0a28-4ea0-a727-d84766b148a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:22.740915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15d6a5a9-0a28-4ea0-a727-d84766b148a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:22.741959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-15d6a5a9-0a28-4ea0-a727-d84766b148a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:22.930942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3a7da40c-635f-4ba8-9b2b-22f9694565ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:22.939163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-15d6a5a9-0a28-4ea0-a727-d84766b148a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:22.945280 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3a7da40c-635f-4ba8-9b2b-22f9694565ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1388 microversion: 2.1 time: 0.387142 Aug 09 17:56:22.946316 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3163/6061] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:22 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1388 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:22.968352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a04555d-7e1c-4008-a6f5-c60962cc9753 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:22.969174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a04555d-7e1c-4008-a6f5-c60962cc9753 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:22.975193 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-15d6a5a9-0a28-4ea0-a727-d84766b148a5 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1228 microversion: 2.1 time: 0.263621 Aug 09 17:56:22.977464 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2899/6062] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:22 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1228 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:22.981276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a04555d-7e1c-4008-a6f5-c60962cc9753 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:22.982636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a04555d-7e1c-4008-a6f5-c60962cc9753 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:22.982990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a04555d-7e1c-4008-a6f5-c60962cc9753 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:22.984219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a04555d-7e1c-4008-a6f5-c60962cc9753 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:22.985072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a04555d-7e1c-4008-a6f5-c60962cc9753 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:22.986073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a04555d-7e1c-4008-a6f5-c60962cc9753 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:23.357161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a04555d-7e1c-4008-a6f5-c60962cc9753 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:23.376684 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a04555d-7e1c-4008-a6f5-c60962cc9753 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1388 microversion: 2.1 time: 0.411060 Aug 09 17:56:23.378433 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3164/6063] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:22 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1388 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:23.406491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b98f3c28-a142-4974-b96d-9889ca99ca29 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:23.407095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b98f3c28-a142-4974-b96d-9889ca99ca29 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:23.414701 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b98f3c28-a142-4974-b96d-9889ca99ca29 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:23.415481 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b98f3c28-a142-4974-b96d-9889ca99ca29 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:23.416149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b98f3c28-a142-4974-b96d-9889ca99ca29 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:23.417055 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b98f3c28-a142-4974-b96d-9889ca99ca29 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:23.417681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b98f3c28-a142-4974-b96d-9889ca99ca29 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:23.418273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b98f3c28-a142-4974-b96d-9889ca99ca29 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:23.726961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b98f3c28-a142-4974-b96d-9889ca99ca29 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:23.745895 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b98f3c28-a142-4974-b96d-9889ca99ca29 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1388 microversion: 2.1 time: 0.342584 Aug 09 17:56:23.765846 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2900/6064] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:23 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1388 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:23.771684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2fba6d87-5ca2-4cfb-a43f-8a1cdf5f9879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:23.772874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2fba6d87-5ca2-4cfb-a43f-8a1cdf5f9879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:23.781677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fba6d87-5ca2-4cfb-a43f-8a1cdf5f9879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:23.782473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fba6d87-5ca2-4cfb-a43f-8a1cdf5f9879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:23.783069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fba6d87-5ca2-4cfb-a43f-8a1cdf5f9879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:23.784239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fba6d87-5ca2-4cfb-a43f-8a1cdf5f9879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:23.784922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fba6d87-5ca2-4cfb-a43f-8a1cdf5f9879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:23.786192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fba6d87-5ca2-4cfb-a43f-8a1cdf5f9879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:23.818477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2fba6d87-5ca2-4cfb-a43f-8a1cdf5f9879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:56:23.965096 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2fba6d87-5ca2-4cfb-a43f-8a1cdf5f9879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 204 len: 0 microversion: 2.1 time: 0.196419 Aug 09 17:56:23.967358 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3165/6065] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:56:23 2022] DELETE /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:56:23.987177 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3029a661-ec2b-481f-93a6-30d6cfeb0620 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:23.989095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3029a661-ec2b-481f-93a6-30d6cfeb0620 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:23.998753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8660bf16-bd22-46e9-be09-bf1d3a7ab3c9 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:24.000335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8660bf16-bd22-46e9-be09-bf1d3a7ab3c9 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:24.009885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3029a661-ec2b-481f-93a6-30d6cfeb0620 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:24.011136 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3029a661-ec2b-481f-93a6-30d6cfeb0620 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:24.012227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3029a661-ec2b-481f-93a6-30d6cfeb0620 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:24.012445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8660bf16-bd22-46e9-be09-bf1d3a7ab3c9 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:24.013222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8660bf16-bd22-46e9-be09-bf1d3a7ab3c9 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:24.014583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3029a661-ec2b-481f-93a6-30d6cfeb0620 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:24.015151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8660bf16-bd22-46e9-be09-bf1d3a7ab3c9 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:24.015979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3029a661-ec2b-481f-93a6-30d6cfeb0620 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:24.016214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8660bf16-bd22-46e9-be09-bf1d3a7ab3c9 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:24.017564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3029a661-ec2b-481f-93a6-30d6cfeb0620 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:24.018023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8660bf16-bd22-46e9-be09-bf1d3a7ab3c9 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:24.021173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8660bf16-bd22-46e9-be09-bf1d3a7ab3c9 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:24.177825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8660bf16-bd22-46e9-be09-bf1d3a7ab3c9 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:24.193856 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8660bf16-bd22-46e9-be09-bf1d3a7ab3c9 tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1228 microversion: 2.1 time: 0.200217 Aug 09 17:56:24.197824 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3166/6066] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:23 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1228 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:24.348199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3029a661-ec2b-481f-93a6-30d6cfeb0620 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:24.376648 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3029a661-ec2b-481f-93a6-30d6cfeb0620 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1394 microversion: 2.1 time: 0.395989 Aug 09 17:56:24.378263 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2901/6067] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:23 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1394 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:25.218330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2fb09ccd-b23d-455f-8496-3e1bb92d9d8d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:25.219063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2fb09ccd-b23d-455f-8496-3e1bb92d9d8d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:25.236314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb09ccd-b23d-455f-8496-3e1bb92d9d8d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:25.238449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb09ccd-b23d-455f-8496-3e1bb92d9d8d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:25.241156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb09ccd-b23d-455f-8496-3e1bb92d9d8d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:25.242529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb09ccd-b23d-455f-8496-3e1bb92d9d8d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:25.243596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb09ccd-b23d-455f-8496-3e1bb92d9d8d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:25.256846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fb09ccd-b23d-455f-8496-3e1bb92d9d8d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:25.384576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2fb09ccd-b23d-455f-8496-3e1bb92d9d8d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b45f77241094ce9b09ff6c48edb868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10cf440736d44ffeb229c876d15675a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:25.403876 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8f88e08b-340b-4d77-b24f-34d83e454985 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:25.404757 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8f88e08b-340b-4d77-b24f-34d83e454985 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:25.405247 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2fb09ccd-b23d-455f-8496-3e1bb92d9d8d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 200 len: 1228 microversion: 2.1 time: 0.189236 Aug 09 17:56:25.408431 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3167/6068] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:25 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 1228 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:25.422003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f88e08b-340b-4d77-b24f-34d83e454985 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:25.428133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f88e08b-340b-4d77-b24f-34d83e454985 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:25.428790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f88e08b-340b-4d77-b24f-34d83e454985 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:25.429760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f88e08b-340b-4d77-b24f-34d83e454985 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:25.430390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f88e08b-340b-4d77-b24f-34d83e454985 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:25.430954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8f88e08b-340b-4d77-b24f-34d83e454985 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:25.478083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:25.854230 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8f88e08b-340b-4d77-b24f-34d83e454985 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:25.866683 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8f88e08b-340b-4d77-b24f-34d83e454985 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1394 microversion: 2.1 time: 0.469523 Aug 09 17:56:25.868112 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2902/6069] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:25 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1394 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:26.443666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:26.444684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] [instance: 6deeed13-eae8-4843-8d55-2b1ecf02b624] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:26.459695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:26.460545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:26.461175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:26.462135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:26.462786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:26.463379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:26.481777 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] HTTP exception thrown: Instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 could not be found. Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Request method failure captured: Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 HTTP/1.1 Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p6xRwDegIoa9qh3Je0_O0AorAFOwA1iBAzeyyJ9w65HKTlcnt67koSZVRd6hbk5yHddlo043w_-B0eEioGNyqs2Mq_fPdSho9re-hJdcXKX7_QRZpBhC4WRhVs0XNXCAMfwbw0YUbdnLL6HmN_7leh-BbYKtVk8PMN3n9w0YDYCrQA Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 10cf440736d44ffeb229c876d15675a4 Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestVolumeBackupRestore-19102047 Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10cf440736d44ffeb229c876d15675a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10cf440736d44ffeb229c876d15675a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10cf440736d44ffeb229c876d15675a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10cf440736d44ffeb229c876d15675a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestVolumeBackupRestore-19102047 Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 10cf440736d44ffeb229c876d15675a4 Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestVolumeBackupRestore-19102047 Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestVolumeBackupRestore-19102047-project Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 5b45f77241094ce9b09ff6c48edb868b Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestVolumeBackupRestore-19102047-project Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 could not be found. Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '6deeed13-eae8-4843-8d55-2b1ecf02b624'} Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 could not be found. Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 could not be found. Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:26.484367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:56:26.489637 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:26.489637 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:26.489637 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:26.489637 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:56:26.489637 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:56:26.489637 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 could not be found. Aug 09 17:56:26.489637 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:56:26.491592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Returning 404 to user: Instance 6deeed13-eae8-4843-8d55-2b1ecf02b624 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:56:26.493064 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0f020840-c198-419c-a1d1-08561a8b2d7d tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624" status: 404 len: 111 microversion: 2.1 time: 0.054186 Aug 09 17:56:26.497863 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3168/6070] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:26 2022] GET /compute/v2.1/servers/6deeed13-eae8-4843-8d55-2b1ecf02b624 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:56:26.590251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-62381d09-ef8e-49fc-bb7e-1187ed8eada2 req-e1b1ad96-537e-4c13-b7e6-decca7fec4cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acf4375-2d5f-41e5-bd20-65473e5fac2b", "name": "network-vif-deleted", "tag": "969b444c-d34e-46bf-b0cd-121658fdd8b3"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:26.627929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-62381d09-ef8e-49fc-bb7e-1187ed8eada2 req-e1b1ad96-537e-4c13-b7e6-decca7fec4cc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:26.628993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-62381d09-ef8e-49fc-bb7e-1187ed8eada2 req-e1b1ad96-537e-4c13-b7e6-decca7fec4cc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:26.629612 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-62381d09-ef8e-49fc-bb7e-1187ed8eada2 req-e1b1ad96-537e-4c13-b7e6-decca7fec4cc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:26.655222 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-62381d09-ef8e-49fc-bb7e-1187ed8eada2 req-e1b1ad96-537e-4c13-b7e6-decca7fec4cc service nova] Creating event network-vif-deleted:969b444c-d34e-46bf-b0cd-121658fdd8b3 for instance 0acf4375-2d5f-41e5-bd20-65473e5fac2b on n-h2-845781-6 Aug 09 17:56:26.680298 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-62381d09-ef8e-49fc-bb7e-1187ed8eada2 req-e1b1ad96-537e-4c13-b7e6-decca7fec4cc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093735 Aug 09 17:56:26.681895 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2903/6071] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:26.904318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1acc68be-cc85-444a-b807-9d0989c0391b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:26.907515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1acc68be-cc85-444a-b807-9d0989c0391b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:26.923168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1acc68be-cc85-444a-b807-9d0989c0391b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:26.925929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1acc68be-cc85-444a-b807-9d0989c0391b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:26.926917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1acc68be-cc85-444a-b807-9d0989c0391b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:26.927943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1acc68be-cc85-444a-b807-9d0989c0391b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:26.928631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1acc68be-cc85-444a-b807-9d0989c0391b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:26.929307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1acc68be-cc85-444a-b807-9d0989c0391b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:27.027969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1acc68be-cc85-444a-b807-9d0989c0391b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:27.039245 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1acc68be-cc85-444a-b807-9d0989c0391b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1187 microversion: 2.1 time: 0.138610 Aug 09 17:56:27.040930 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3169/6072] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:26 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1187 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:27.328173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f2ea2e33-8f9c-4a4a-97db-42bf30cc13ef tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] Calling method '.version_select at 0x7fbbca2793a0>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:27.385447 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f2ea2e33-8f9c-4a4a-97db-42bf30cc13ef tempest-TestVolumeBackupRestore-19102047 tempest-TestVolumeBackupRestore-19102047-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-467149186" status: 202 len: 0 microversion: 2.1 time: 0.076454 Aug 09 17:56:27.387009 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2904/6073] 10.222.0.93 () {58 vars in 1266 bytes} [Tue Aug 9 17:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-467149186 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:56:28.108897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a8907414-80e5-4295-8b2c-0de8647815c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:28.119858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a8907414-80e5-4295-8b2c-0de8647815c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:28.162473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8907414-80e5-4295-8b2c-0de8647815c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:28.165869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8907414-80e5-4295-8b2c-0de8647815c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:28.167724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8907414-80e5-4295-8b2c-0de8647815c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:28.168834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8907414-80e5-4295-8b2c-0de8647815c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:28.172409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8907414-80e5-4295-8b2c-0de8647815c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:28.173003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8907414-80e5-4295-8b2c-0de8647815c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:28.349668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a8907414-80e5-4295-8b2c-0de8647815c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:28.385303 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a8907414-80e5-4295-8b2c-0de8647815c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1187 microversion: 2.1 time: 0.306055 Aug 09 17:56:28.412816 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3170/6074] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:28 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1187 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:29.426686 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4c16f046-be87-4359-891d-5f02921955ab tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:29.428887 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4c16f046-be87-4359-891d-5f02921955ab tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:29.477791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c16f046-be87-4359-891d-5f02921955ab tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:29.478315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c16f046-be87-4359-891d-5f02921955ab tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:29.478765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c16f046-be87-4359-891d-5f02921955ab tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:29.479540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c16f046-be87-4359-891d-5f02921955ab tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:29.480052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c16f046-be87-4359-891d-5f02921955ab tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:29.480482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4c16f046-be87-4359-891d-5f02921955ab tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:29.817310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4c16f046-be87-4359-891d-5f02921955ab tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:29.931912 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4c16f046-be87-4359-891d-5f02921955ab tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1187 microversion: 2.1 time: 0.508323 Aug 09 17:56:29.949248 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2905/6075] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:29 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1187 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:30.969891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8585d861-3139-467c-95d0-1ad4edec638c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:30.971570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8585d861-3139-467c-95d0-1ad4edec638c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:30.987099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:31.024405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8585d861-3139-467c-95d0-1ad4edec638c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.027430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8585d861-3139-467c-95d0-1ad4edec638c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.028287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8585d861-3139-467c-95d0-1ad4edec638c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.029997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8585d861-3139-467c-95d0-1ad4edec638c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:31.034017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8585d861-3139-467c-95d0-1ad4edec638c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:31.037838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8585d861-3139-467c-95d0-1ad4edec638c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:31.247597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8585d861-3139-467c-95d0-1ad4edec638c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:31.261491 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8585d861-3139-467c-95d0-1ad4edec638c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1187 microversion: 2.1 time: 0.298886 Aug 09 17:56:31.262239 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3171/6076] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:30 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1187 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:32.282929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5ab8cca9-c5d2-4072-8534-ebce921c2479 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:32.283564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5ab8cca9-c5d2-4072-8534-ebce921c2479 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:32.302870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ab8cca9-c5d2-4072-8534-ebce921c2479 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:32.303373 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ab8cca9-c5d2-4072-8534-ebce921c2479 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:32.310310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ab8cca9-c5d2-4072-8534-ebce921c2479 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:32.311419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ab8cca9-c5d2-4072-8534-ebce921c2479 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:32.312551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ab8cca9-c5d2-4072-8534-ebce921c2479 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:32.313159 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5ab8cca9-c5d2-4072-8534-ebce921c2479 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:32.707484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5ab8cca9-c5d2-4072-8534-ebce921c2479 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:32.723970 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5ab8cca9-c5d2-4072-8534-ebce921c2479 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1187 microversion: 2.1 time: 0.443202 Aug 09 17:56:32.731277 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2906/6077] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:32 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1187 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:33.779214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-910ced3f-b371-4b24-86ac-eb1089d18386 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:33.781302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-910ced3f-b371-4b24-86ac-eb1089d18386 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:33.830279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-910ced3f-b371-4b24-86ac-eb1089d18386 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:33.831701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-910ced3f-b371-4b24-86ac-eb1089d18386 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:33.832430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-910ced3f-b371-4b24-86ac-eb1089d18386 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:33.833498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-910ced3f-b371-4b24-86ac-eb1089d18386 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:33.834218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-910ced3f-b371-4b24-86ac-eb1089d18386 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:33.834931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-910ced3f-b371-4b24-86ac-eb1089d18386 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:34.014981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-910ced3f-b371-4b24-86ac-eb1089d18386 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:34.032464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-497828978", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "fcd7d7c2-8f90-4518-a3c2-039f7a6cbf7f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-846907744", "security_groups": [{"name": "tempest-secgroup-smoke-1820023475"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:34.045392 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-910ced3f-b371-4b24-86ac-eb1089d18386 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1187 microversion: 2.1 time: 0.272841 Aug 09 17:56:34.048869 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3172/6078] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:33 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1187 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:34.359040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] validate_networks() for [('fcd7d7c2-8f90-4518-a3c2-039f7a6cbf7f', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:56:35.083603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5527fa3c-1738-405d-98b0-4e1f4900e9be tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:35.084778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5527fa3c-1738-405d-98b0-4e1f4900e9be tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:35.106174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5527fa3c-1738-405d-98b0-4e1f4900e9be tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.106688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5527fa3c-1738-405d-98b0-4e1f4900e9be tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.107163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5527fa3c-1738-405d-98b0-4e1f4900e9be tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.109435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5527fa3c-1738-405d-98b0-4e1f4900e9be tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.112901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5527fa3c-1738-405d-98b0-4e1f4900e9be tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.114845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5527fa3c-1738-405d-98b0-4e1f4900e9be tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.261065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5527fa3c-1738-405d-98b0-4e1f4900e9be tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:35.274857 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5527fa3c-1738-405d-98b0-4e1f4900e9be tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1187 microversion: 2.1 time: 0.196596 Aug 09 17:56:35.280790 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3173/6079] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:35 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1187 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:35.410015 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:56:35.411036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:56:35.411775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:56:35.412509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:56:35.413085 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:56:35.427110 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.428042 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.428951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.430454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:35.431334 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:35.436197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:35.463406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for project 060105d0d71644839935005af8ad1bda. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:56:35.470014 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for user a343f75165674844a2e9e46500fa01c0 and project 060105d0d71644839935005af8ad1bda. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:56:35.503496 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:56:35.513319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:56:35.596047 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-18771b66-021f-4748-8a09-3b6b15e7e086 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.564890 Aug 09 17:56:35.607792 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2907/6080] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:56:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:56:35.609572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2cc12708-58ec-4483-8ec9-4938ba631c33 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:35.610399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2cc12708-58ec-4483-8ec9-4938ba631c33 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:35.830402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2cc12708-58ec-4483-8ec9-4938ba631c33 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:35.844936 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2cc12708-58ec-4483-8ec9-4938ba631c33 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1265 microversion: 2.1 time: 0.233923 Aug 09 17:56:35.858801 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3174/6081] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:35 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:36.304111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e73a8ee8-0dd1-40e6-942f-b0569403c8cd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:36.304716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e73a8ee8-0dd1-40e6-942f-b0569403c8cd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:36.332536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:36.336832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e73a8ee8-0dd1-40e6-942f-b0569403c8cd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:36.337349 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e73a8ee8-0dd1-40e6-942f-b0569403c8cd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:36.337800 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e73a8ee8-0dd1-40e6-942f-b0569403c8cd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:36.340877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e73a8ee8-0dd1-40e6-942f-b0569403c8cd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:36.342827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e73a8ee8-0dd1-40e6-942f-b0569403c8cd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:36.344665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e73a8ee8-0dd1-40e6-942f-b0569403c8cd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:36.537731 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e73a8ee8-0dd1-40e6-942f-b0569403c8cd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:36.557573 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e73a8ee8-0dd1-40e6-942f-b0569403c8cd tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1187 microversion: 2.1 time: 0.258563 Aug 09 17:56:36.560168 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2908/6082] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:36 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1187 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:36.876826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-71b37d54-5feb-4425-88aa-c04361090d72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:36.878105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-71b37d54-5feb-4425-88aa-c04361090d72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:36.885377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:36.887014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71b37d54-5feb-4425-88aa-c04361090d72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:36.887559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71b37d54-5feb-4425-88aa-c04361090d72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:36.888099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71b37d54-5feb-4425-88aa-c04361090d72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:36.888863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71b37d54-5feb-4425-88aa-c04361090d72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:36.889356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71b37d54-5feb-4425-88aa-c04361090d72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:36.899222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71b37d54-5feb-4425-88aa-c04361090d72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:37.312634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-71b37d54-5feb-4425-88aa-c04361090d72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:37.338990 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-71b37d54-5feb-4425-88aa-c04361090d72 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1269 microversion: 2.1 time: 0.470068 Aug 09 17:56:37.343910 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3175/6083] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:36 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1269 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:37.581038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:37.582908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:37.642621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:37.643822 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:37.644827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:37.653019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:37.654156 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:37.654977 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:37.754906 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:37.756153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:37.757039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:37.758581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lazy-loading 'fault' on Instance uuid 0acf4375-2d5f-41e5-bd20-65473e5fac2b {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:56:37.958816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:37.971057 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-dcd49b19-bce9-45cd-b38a-b037cd73bc2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 200 len: 1146 microversion: 2.1 time: 0.392282 Aug 09 17:56:37.975136 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2909/6084] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:37 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 1146 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:38.383235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-679fcc7c-e7dd-4027-8330-854ffb01d220 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:38.384048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-679fcc7c-e7dd-4027-8330-854ffb01d220 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:38.408222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679fcc7c-e7dd-4027-8330-854ffb01d220 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:38.433788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679fcc7c-e7dd-4027-8330-854ffb01d220 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:38.434766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679fcc7c-e7dd-4027-8330-854ffb01d220 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:38.438412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679fcc7c-e7dd-4027-8330-854ffb01d220 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:38.441280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679fcc7c-e7dd-4027-8330-854ffb01d220 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:38.445745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-679fcc7c-e7dd-4027-8330-854ffb01d220 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:39.008096 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:39.013220 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 0acf4375-2d5f-41e5-bd20-65473e5fac2b] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:39.038924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-679fcc7c-e7dd-4027-8330-854ffb01d220 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:39.076382 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:39.098236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:39.103286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:39.108464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:39.109538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:39.116925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:39.132200 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-679fcc7c-e7dd-4027-8330-854ffb01d220 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1317 microversion: 2.1 time: 0.743940 Aug 09 17:56:39.142203 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3176/6085] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:38 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1317 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:39.187617 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 0acf4375-2d5f-41e5-bd20-65473e5fac2b could not be found. Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b HTTP/1.1 Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 0acf4375-2d5f-41e5-bd20-65473e5fac2b could not be found. Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '0acf4375-2d5f-41e5-bd20-65473e5fac2b'} Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acf4375-2d5f-41e5-bd20-65473e5fac2b could not be found. Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acf4375-2d5f-41e5-bd20-65473e5fac2b could not be found. Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:56:39.197983 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:56:39.202914 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:56:39.202914 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:56:39.202914 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:56:39.202914 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:56:39.202914 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:56:39.202914 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acf4375-2d5f-41e5-bd20-65473e5fac2b could not be found. Aug 09 17:56:39.202914 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:56:39.212273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 0acf4375-2d5f-41e5-bd20-65473e5fac2b could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:56:39.213471 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ad5b3a34-4d30-4f92-a89f-1baebee9375c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b" status: 404 len: 111 microversion: 2.1 time: 0.222954 Aug 09 17:56:39.215236 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2910/6086] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:38 2022] GET /compute/v2.1/servers/0acf4375-2d5f-41e5-bd20-65473e5fac2b => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:56:40.173270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1fb89c1c-2636-4505-b9aa-3558f4c6f4af tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:40.174842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1fb89c1c-2636-4505-b9aa-3558f4c6f4af tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:40.187959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fb89c1c-2636-4505-b9aa-3558f4c6f4af tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:40.188869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fb89c1c-2636-4505-b9aa-3558f4c6f4af tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:40.194076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fb89c1c-2636-4505-b9aa-3558f4c6f4af tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:40.195242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fb89c1c-2636-4505-b9aa-3558f4c6f4af tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:40.196001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fb89c1c-2636-4505-b9aa-3558f4c6f4af tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:40.196731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fb89c1c-2636-4505-b9aa-3558f4c6f4af tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:40.201856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:40.407519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1fb89c1c-2636-4505-b9aa-3558f4c6f4af tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:40.450208 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1fb89c1c-2636-4505-b9aa-3558f4c6f4af tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1323 microversion: 2.1 time: 0.284966 Aug 09 17:56:40.467670 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3177/6087] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:40 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1323 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:41.482637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f9ee9ba7-895e-4190-94db-c2ba053e508f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:41.483316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f9ee9ba7-895e-4190-94db-c2ba053e508f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:41.509986 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9ee9ba7-895e-4190-94db-c2ba053e508f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:41.510493 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9ee9ba7-895e-4190-94db-c2ba053e508f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:41.525326 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9ee9ba7-895e-4190-94db-c2ba053e508f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:41.526265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9ee9ba7-895e-4190-94db-c2ba053e508f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:41.526770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9ee9ba7-895e-4190-94db-c2ba053e508f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:41.527231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f9ee9ba7-895e-4190-94db-c2ba053e508f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:41.900264 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f9ee9ba7-895e-4190-94db-c2ba053e508f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:41.917703 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f9ee9ba7-895e-4190-94db-c2ba053e508f tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1391 microversion: 2.1 time: 0.438511 Aug 09 17:56:41.926908 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2911/6088] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:41 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1391 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:42.717318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3af42433-6c2d-41a1-af1d-d71d6c018465 req-db82c96e-53f5-4c69-afab-309029ec5dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e41f0940-9b79-4a5d-b5b2-ff17ebd830eb", "tag": "438993a2-95f0-4bb8-b636-a44aacb688e3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:42.758782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3af42433-6c2d-41a1-af1d-d71d6c018465 req-db82c96e-53f5-4c69-afab-309029ec5dde service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:42.759693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3af42433-6c2d-41a1-af1d-d71d6c018465 req-db82c96e-53f5-4c69-afab-309029ec5dde service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:42.760499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3af42433-6c2d-41a1-af1d-d71d6c018465 req-db82c96e-53f5-4c69-afab-309029ec5dde service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:42.801150 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3af42433-6c2d-41a1-af1d-d71d6c018465 req-db82c96e-53f5-4c69-afab-309029ec5dde service nova] Creating event network-changed:438993a2-95f0-4bb8-b636-a44aacb688e3 for instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb on n-h1-845781-6 Aug 09 17:56:42.828853 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3af42433-6c2d-41a1-af1d-d71d6c018465 req-db82c96e-53f5-4c69-afab-309029ec5dde service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341572 Aug 09 17:56:42.837169 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3178/6089] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:56:42.944880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-9a8a9c32-29ba-4b7b-a958-d73f8daa2731 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:42.951833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-9a8a9c32-29ba-4b7b-a958-d73f8daa2731 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:42.988329 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c32-29ba-4b7b-a958-d73f8daa2731 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:42.992648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c32-29ba-4b7b-a958-d73f8daa2731 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:42.993895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c32-29ba-4b7b-a958-d73f8daa2731 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:42.996849 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c32-29ba-4b7b-a958-d73f8daa2731 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:43.000338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c32-29ba-4b7b-a958-d73f8daa2731 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:43.009197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-9a8a9c32-29ba-4b7b-a958-d73f8daa2731 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:43.585564 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-9a8a9c32-29ba-4b7b-a958-d73f8daa2731 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:43.610394 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-9a8a9c32-29ba-4b7b-a958-d73f8daa2731 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1391 microversion: 2.1 time: 0.673529 Aug 09 17:56:43.633287 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2912/6090] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:42 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1391 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:44.649043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-228c9c71-05b7-412c-b30a-4305ed014c37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:44.662467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-228c9c71-05b7-412c-b30a-4305ed014c37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:44.691185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-228c9c71-05b7-412c-b30a-4305ed014c37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:44.691697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-228c9c71-05b7-412c-b30a-4305ed014c37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:44.692340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-228c9c71-05b7-412c-b30a-4305ed014c37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:44.693369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-228c9c71-05b7-412c-b30a-4305ed014c37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:44.697534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-228c9c71-05b7-412c-b30a-4305ed014c37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:44.698248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-228c9c71-05b7-412c-b30a-4305ed014c37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:45.069246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-228c9c71-05b7-412c-b30a-4305ed014c37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:45.078955 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-228c9c71-05b7-412c-b30a-4305ed014c37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1391 microversion: 2.1 time: 0.445863 Aug 09 17:56:45.084472 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3179/6091] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:44 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1391 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:46.112635 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-df30bdd6-582b-40e6-9317-b63491c6a42d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:46.123183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-df30bdd6-582b-40e6-9317-b63491c6a42d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:46.163432 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:46.167478 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:46.174855 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df30bdd6-582b-40e6-9317-b63491c6a42d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:46.176030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df30bdd6-582b-40e6-9317-b63491c6a42d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:46.177192 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df30bdd6-582b-40e6-9317-b63491c6a42d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:46.180084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df30bdd6-582b-40e6-9317-b63491c6a42d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:46.180951 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df30bdd6-582b-40e6-9317-b63491c6a42d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:46.181650 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-df30bdd6-582b-40e6-9317-b63491c6a42d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:46.546315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-df30bdd6-582b-40e6-9317-b63491c6a42d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:46.591327 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-df30bdd6-582b-40e6-9317-b63491c6a42d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1391 microversion: 2.1 time: 0.485425 Aug 09 17:56:46.592960 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2913/6092] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:46 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1391 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:47.485700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:47.596084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3ec0bb1b-f2c7-4d64-a398-4f3b3dfd3edc req-521da379-3eaa-4d6d-9856-5fe96d91be6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e41f0940-9b79-4a5d-b5b2-ff17ebd830eb", "name": "network-vif-plugged", "status": "completed", "tag": "438993a2-95f0-4bb8-b636-a44aacb688e3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:47.619114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ec0bb1b-f2c7-4d64-a398-4f3b3dfd3edc req-521da379-3eaa-4d6d-9856-5fe96d91be6b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:47.619661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ec0bb1b-f2c7-4d64-a398-4f3b3dfd3edc req-521da379-3eaa-4d6d-9856-5fe96d91be6b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:47.620160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3ec0bb1b-f2c7-4d64-a398-4f3b3dfd3edc req-521da379-3eaa-4d6d-9856-5fe96d91be6b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:47.635108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fec5383b-8bf6-4700-9caf-7544940dd211 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:47.636514 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fec5383b-8bf6-4700-9caf-7544940dd211 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:47.651478 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3ec0bb1b-f2c7-4d64-a398-4f3b3dfd3edc req-521da379-3eaa-4d6d-9856-5fe96d91be6b service nova] Creating event network-vif-plugged:438993a2-95f0-4bb8-b636-a44aacb688e3 for instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb on n-h1-845781-6 Aug 09 17:56:47.653641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fec5383b-8bf6-4700-9caf-7544940dd211 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:47.657289 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fec5383b-8bf6-4700-9caf-7544940dd211 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:47.657962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fec5383b-8bf6-4700-9caf-7544940dd211 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:47.658753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fec5383b-8bf6-4700-9caf-7544940dd211 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:47.659831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fec5383b-8bf6-4700-9caf-7544940dd211 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:47.663891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fec5383b-8bf6-4700-9caf-7544940dd211 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:47.664698 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3ec0bb1b-f2c7-4d64-a398-4f3b3dfd3edc req-521da379-3eaa-4d6d-9856-5fe96d91be6b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184715 Aug 09 17:56:47.666487 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3180/6093] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:56:47.997929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fec5383b-8bf6-4700-9caf-7544940dd211 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:48.024073 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fec5383b-8bf6-4700-9caf-7544940dd211 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1391 microversion: 2.1 time: 0.392523 Aug 09 17:56:48.029485 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2914/6094] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:47 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1391 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:49.047545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4cdb63bf-3ea5-4ff2-8342-2771ac34fb2d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:49.049206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4cdb63bf-3ea5-4ff2-8342-2771ac34fb2d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:49.068737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cdb63bf-3ea5-4ff2-8342-2771ac34fb2d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:49.072651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cdb63bf-3ea5-4ff2-8342-2771ac34fb2d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:49.074192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cdb63bf-3ea5-4ff2-8342-2771ac34fb2d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:49.077042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cdb63bf-3ea5-4ff2-8342-2771ac34fb2d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:49.077866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cdb63bf-3ea5-4ff2-8342-2771ac34fb2d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:49.084030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cdb63bf-3ea5-4ff2-8342-2771ac34fb2d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:49.570859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4cdb63bf-3ea5-4ff2-8342-2771ac34fb2d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:49.585647 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4cdb63bf-3ea5-4ff2-8342-2771ac34fb2d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1391 microversion: 2.1 time: 0.541578 Aug 09 17:56:49.587724 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3181/6095] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:49 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1391 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:56:50.607376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b3e77c30-de69-4834-a84a-0769daa0a831 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:50.608073 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b3e77c30-de69-4834-a84a-0769daa0a831 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:50.620031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3e77c30-de69-4834-a84a-0769daa0a831 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.620838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3e77c30-de69-4834-a84a-0769daa0a831 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.624968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3e77c30-de69-4834-a84a-0769daa0a831 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:50.625937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3e77c30-de69-4834-a84a-0769daa0a831 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:50.626665 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3e77c30-de69-4834-a84a-0769daa0a831 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:50.627322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b3e77c30-de69-4834-a84a-0769daa0a831 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:51.004781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b3e77c30-de69-4834-a84a-0769daa0a831 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:51.030206 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b3e77c30-de69-4834-a84a-0769daa0a831 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1563 microversion: 2.1 time: 0.426886 Aug 09 17:56:51.040706 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2915/6096] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:50 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1563 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:51.074309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09c25b38-82bf-4fc0-9b30-d20e3b430cbc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:51.074763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09c25b38-82bf-4fc0-9b30-d20e3b430cbc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:51.106958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09c25b38-82bf-4fc0-9b30-d20e3b430cbc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:51.107471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09c25b38-82bf-4fc0-9b30-d20e3b430cbc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:51.109935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09c25b38-82bf-4fc0-9b30-d20e3b430cbc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:51.111793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09c25b38-82bf-4fc0-9b30-d20e3b430cbc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:51.112480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09c25b38-82bf-4fc0-9b30-d20e3b430cbc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:51.113875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09c25b38-82bf-4fc0-9b30-d20e3b430cbc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:51.540172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-09c25b38-82bf-4fc0-9b30-d20e3b430cbc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:51.550424 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09c25b38-82bf-4fc0-9b30-d20e3b430cbc tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1563 microversion: 2.1 time: 0.480288 Aug 09 17:56:51.551703 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3182/6097] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:51 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1563 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:56:55.908473 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f722f8da-c18d-42f2-9222-23a90c393a2e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:56:55.909196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f722f8da-c18d-42f2-9222-23a90c393a2e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:56:55.930183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-7858d927-c0ed-404c-98b0-9e350d92b470 req-813b9694-a820-48ab-a63b-ffb63170ede7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e41f0940-9b79-4a5d-b5b2-ff17ebd830eb", "tag": "438993a2-95f0-4bb8-b636-a44aacb688e3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:56:55.938893 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f722f8da-c18d-42f2-9222-23a90c393a2e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:55.943038 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f722f8da-c18d-42f2-9222-23a90c393a2e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:55.946987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f722f8da-c18d-42f2-9222-23a90c393a2e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:55.948880 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f722f8da-c18d-42f2-9222-23a90c393a2e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:55.950885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f722f8da-c18d-42f2-9222-23a90c393a2e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:55.952833 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f722f8da-c18d-42f2-9222-23a90c393a2e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:55.960116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=66 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:56:55.964592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7858d927-c0ed-404c-98b0-9e350d92b470 req-813b9694-a820-48ab-a63b-ffb63170ede7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:56:55.972010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7858d927-c0ed-404c-98b0-9e350d92b470 req-813b9694-a820-48ab-a63b-ffb63170ede7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:56:55.973044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7858d927-c0ed-404c-98b0-9e350d92b470 req-813b9694-a820-48ab-a63b-ffb63170ede7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:56:56.018833 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-7858d927-c0ed-404c-98b0-9e350d92b470 req-813b9694-a820-48ab-a63b-ffb63170ede7 service nova] Creating event network-changed:438993a2-95f0-4bb8-b636-a44aacb688e3 for instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb on n-h1-845781-6 Aug 09 17:56:56.047293 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-7858d927-c0ed-404c-98b0-9e350d92b470 req-813b9694-a820-48ab-a63b-ffb63170ede7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120978 Aug 09 17:56:56.048714 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3183/6098] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:56:56.485583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f722f8da-c18d-42f2-9222-23a90c393a2e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:56:56.500331 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f722f8da-c18d-42f2-9222-23a90c393a2e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1563 microversion: 2.1 time: 0.595970 Aug 09 17:56:56.504846 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2916/6099] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:56:55 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1563 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:14.226091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1005480356", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d3829be8-e06c-4b80-a738-44cca624b0b1", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:14.235569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=17 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:14.236304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=28 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:14.320550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] validate_networks() for [('0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:57:15.197758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:57:15.199706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:57:15.200947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:57:15.201601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:57:15.202889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:57:15.220900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.221792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.222660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.224159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.224782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.225228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.245651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:57:15.252542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for user 87590ee7f71345a8914b350c5999d974 and project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:57:15.267819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:57:15.270011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d3829be8-e06c-4b80-a738-44cca624b0b1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:57:15.378972 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c0efb91-09a3-425a-b720-264f0a1b049d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.157111 Aug 09 17:57:15.386833 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3184/6100] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:57:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:57:15.396104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d122f761-63a6-464a-8769-29368058ff6d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:15.397708 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d122f761-63a6-464a-8769-29368058ff6d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:15.407047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=19 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:15.408588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=5 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:15.445619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-13d84ced-fad3-422f-b17f-c18789ff5014 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:15.449496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-13d84ced-fad3-422f-b17f-c18789ff5014 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:15.470171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d84ced-fad3-422f-b17f-c18789ff5014 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.470803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d84ced-fad3-422f-b17f-c18789ff5014 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.471441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d84ced-fad3-422f-b17f-c18789ff5014 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.472422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d84ced-fad3-422f-b17f-c18789ff5014 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:15.473815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d84ced-fad3-422f-b17f-c18789ff5014 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:15.474450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13d84ced-fad3-422f-b17f-c18789ff5014 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:15.501704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d122f761-63a6-464a-8769-29368058ff6d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:15.516170 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d122f761-63a6-464a-8769-29368058ff6d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1057 microversion: 2.1 time: 0.125247 Aug 09 17:57:15.532216 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2917/6101] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:15 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1057 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:15.539009 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-13d84ced-fad3-422f-b17f-c18789ff5014 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb/action" status: 200 len: 24575 microversion: 2.1 time: 0.099774 Aug 09 17:57:15.547517 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3185/6102] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:57:15 2022] POST /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb/action => generated 24575 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:57:16.539598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-53696916-5ade-4f08-a75c-cb2d753f45d9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:16.540323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-53696916-5ade-4f08-a75c-cb2d753f45d9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:16.549341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53696916-5ade-4f08-a75c-cb2d753f45d9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:16.550176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53696916-5ade-4f08-a75c-cb2d753f45d9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:16.550818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53696916-5ade-4f08-a75c-cb2d753f45d9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:16.551873 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53696916-5ade-4f08-a75c-cb2d753f45d9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:16.552545 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53696916-5ade-4f08-a75c-cb2d753f45d9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:16.553182 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-53696916-5ade-4f08-a75c-cb2d753f45d9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:16.648820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-53696916-5ade-4f08-a75c-cb2d753f45d9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:16.658741 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-53696916-5ade-4f08-a75c-cb2d753f45d9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1109 microversion: 2.1 time: 0.123761 Aug 09 17:57:16.659443 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2918/6103] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:16 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1109 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:17.685764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e0b72f06-1611-456a-a4a5-ee5ec5f540db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:17.686773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e0b72f06-1611-456a-a4a5-ee5ec5f540db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:17.709047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0b72f06-1611-456a-a4a5-ee5ec5f540db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:17.709625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0b72f06-1611-456a-a4a5-ee5ec5f540db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:17.710076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0b72f06-1611-456a-a4a5-ee5ec5f540db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:17.711020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0b72f06-1611-456a-a4a5-ee5ec5f540db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:17.711681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0b72f06-1611-456a-a4a5-ee5ec5f540db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:17.712281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0b72f06-1611-456a-a4a5-ee5ec5f540db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:17.794944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e0b72f06-1611-456a-a4a5-ee5ec5f540db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:17.805028 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e0b72f06-1611-456a-a4a5-ee5ec5f540db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1127 microversion: 2.1 time: 0.127371 Aug 09 17:57:17.820821 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3186/6104] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:17 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1127 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:18.826412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-84a8116b-83e5-4456-8885-286101a9c946 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:18.828901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-84a8116b-83e5-4456-8885-286101a9c946 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:18.841891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a8116b-83e5-4456-8885-286101a9c946 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:18.845168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a8116b-83e5-4456-8885-286101a9c946 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:18.845852 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a8116b-83e5-4456-8885-286101a9c946 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:18.846811 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a8116b-83e5-4456-8885-286101a9c946 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:18.848502 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a8116b-83e5-4456-8885-286101a9c946 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:18.849381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84a8116b-83e5-4456-8885-286101a9c946 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:19.137627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-84a8116b-83e5-4456-8885-286101a9c946 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:19.149968 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-84a8116b-83e5-4456-8885-286101a9c946 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.327360 Aug 09 17:57:19.150901 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2919/6105] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:18 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:19.490452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-714588c5-0504-4d7b-8401-adf09ace49ff req-2ac90d3f-5c67-450f-a519-e31dccec53cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5", "tag": "ef16d918-8f6c-4a67-bd10-90fb906c1496"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:19.527183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-714588c5-0504-4d7b-8401-adf09ace49ff req-2ac90d3f-5c67-450f-a519-e31dccec53cc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:19.527698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-714588c5-0504-4d7b-8401-adf09ace49ff req-2ac90d3f-5c67-450f-a519-e31dccec53cc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:19.529453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-714588c5-0504-4d7b-8401-adf09ace49ff req-2ac90d3f-5c67-450f-a519-e31dccec53cc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:19.544426 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-714588c5-0504-4d7b-8401-adf09ace49ff req-2ac90d3f-5c67-450f-a519-e31dccec53cc service nova] Creating event network-changed:ef16d918-8f6c-4a67-bd10-90fb906c1496 for instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 on n-h2-845781-6 Aug 09 17:57:19.551172 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-714588c5-0504-4d7b-8401-adf09ace49ff req-2ac90d3f-5c67-450f-a519-e31dccec53cc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064398 Aug 09 17:57:19.552374 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3187/6106] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:20.174970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b99c6da4-2fd3-4277-a4ec-cce19016f62f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:20.176538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b99c6da4-2fd3-4277-a4ec-cce19016f62f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:20.186544 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b99c6da4-2fd3-4277-a4ec-cce19016f62f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:20.187316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b99c6da4-2fd3-4277-a4ec-cce19016f62f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:20.188265 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b99c6da4-2fd3-4277-a4ec-cce19016f62f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:20.189112 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b99c6da4-2fd3-4277-a4ec-cce19016f62f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:20.189697 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b99c6da4-2fd3-4277-a4ec-cce19016f62f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:20.191725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b99c6da4-2fd3-4277-a4ec-cce19016f62f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:20.735183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b99c6da4-2fd3-4277-a4ec-cce19016f62f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:20.750052 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b99c6da4-2fd3-4277-a4ec-cce19016f62f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.579364 Aug 09 17:57:20.755723 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2920/6107] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:20 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:21.783400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f904fddd-efa6-4956-af9b-4de5337d2703 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:21.784344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f904fddd-efa6-4956-af9b-4de5337d2703 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:21.798386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f904fddd-efa6-4956-af9b-4de5337d2703 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:21.798892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f904fddd-efa6-4956-af9b-4de5337d2703 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:21.799398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f904fddd-efa6-4956-af9b-4de5337d2703 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:21.800545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f904fddd-efa6-4956-af9b-4de5337d2703 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:21.800985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f904fddd-efa6-4956-af9b-4de5337d2703 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:21.801405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f904fddd-efa6-4956-af9b-4de5337d2703 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:22.108056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f904fddd-efa6-4956-af9b-4de5337d2703 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:22.131707 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f904fddd-efa6-4956-af9b-4de5337d2703 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.357054 Aug 09 17:57:22.133114 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3188/6108] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:21 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:23.162693 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1f1b756-364f-4189-98cc-cbe47af72276 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:23.163952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f1f1b756-364f-4189-98cc-cbe47af72276 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:23.173482 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1f1b756-364f-4189-98cc-cbe47af72276 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:23.174768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1f1b756-364f-4189-98cc-cbe47af72276 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:23.175841 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1f1b756-364f-4189-98cc-cbe47af72276 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:23.177353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1f1b756-364f-4189-98cc-cbe47af72276 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:23.179194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1f1b756-364f-4189-98cc-cbe47af72276 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:23.179937 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1f1b756-364f-4189-98cc-cbe47af72276 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:23.495402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f1f1b756-364f-4189-98cc-cbe47af72276 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:23.510925 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f1f1b756-364f-4189-98cc-cbe47af72276 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.352916 Aug 09 17:57:23.519960 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2921/6109] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:23 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:24.538078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbb34100-341e-4cb2-ad76-41d59b00e05b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:24.539204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dbb34100-341e-4cb2-ad76-41d59b00e05b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:24.550691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb34100-341e-4cb2-ad76-41d59b00e05b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:24.551761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb34100-341e-4cb2-ad76-41d59b00e05b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:24.552361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb34100-341e-4cb2-ad76-41d59b00e05b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:24.553667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb34100-341e-4cb2-ad76-41d59b00e05b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:24.554200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb34100-341e-4cb2-ad76-41d59b00e05b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:24.555096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbb34100-341e-4cb2-ad76-41d59b00e05b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:24.822440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dbb34100-341e-4cb2-ad76-41d59b00e05b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:24.841566 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dbb34100-341e-4cb2-ad76-41d59b00e05b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.308277 Aug 09 17:57:24.846443 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3189/6110] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:24 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:25.871452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2d750637-0a12-4541-9d1a-dc13cd3f62fc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:25.872835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2d750637-0a12-4541-9d1a-dc13cd3f62fc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:25.883579 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:25.886017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d750637-0a12-4541-9d1a-dc13cd3f62fc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:25.886151 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d750637-0a12-4541-9d1a-dc13cd3f62fc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:25.886583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d750637-0a12-4541-9d1a-dc13cd3f62fc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:25.887323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d750637-0a12-4541-9d1a-dc13cd3f62fc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:25.887982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d750637-0a12-4541-9d1a-dc13cd3f62fc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:25.888676 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2d750637-0a12-4541-9d1a-dc13cd3f62fc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:26.056520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2d750637-0a12-4541-9d1a-dc13cd3f62fc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:26.066035 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2d750637-0a12-4541-9d1a-dc13cd3f62fc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.199526 Aug 09 17:57:26.083266 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2922/6111] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:25 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:26.737310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c33c8da-9565-4ff7-96a2-4db3633dc6be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:26.739413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c33c8da-9565-4ff7-96a2-4db3633dc6be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:26.743354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:26.744321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:26.751878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c33c8da-9565-4ff7-96a2-4db3633dc6be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:26.752834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c33c8da-9565-4ff7-96a2-4db3633dc6be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:26.753537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c33c8da-9565-4ff7-96a2-4db3633dc6be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:26.754515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c33c8da-9565-4ff7-96a2-4db3633dc6be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:26.755096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c33c8da-9565-4ff7-96a2-4db3633dc6be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:26.755822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c33c8da-9565-4ff7-96a2-4db3633dc6be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.038701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c33c8da-9565-4ff7-96a2-4db3633dc6be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:27.047931 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c33c8da-9565-4ff7-96a2-4db3633dc6be tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1681 microversion: 2.1 time: 0.314973 Aug 09 17:57:27.049670 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3190/6112] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:26 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1681 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:27.095471 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-85f8a259-c905-442e-852a-496df00290b6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:27.097088 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-85f8a259-c905-442e-852a-496df00290b6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:27.105975 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85f8a259-c905-442e-852a-496df00290b6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.106908 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85f8a259-c905-442e-852a-496df00290b6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.107772 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85f8a259-c905-442e-852a-496df00290b6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.108864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85f8a259-c905-442e-852a-496df00290b6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.109597 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85f8a259-c905-442e-852a-496df00290b6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.110520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85f8a259-c905-442e-852a-496df00290b6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.217229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-10a8004b-9659-4aef-8bb6-235563753c3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:27.219537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-10a8004b-9659-4aef-8bb6-235563753c3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:27.227449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a8004b-9659-4aef-8bb6-235563753c3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.228309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a8004b-9659-4aef-8bb6-235563753c3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.228980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a8004b-9659-4aef-8bb6-235563753c3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.230010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a8004b-9659-4aef-8bb6-235563753c3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.230739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a8004b-9659-4aef-8bb6-235563753c3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.231556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10a8004b-9659-4aef-8bb6-235563753c3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.287655 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-10a8004b-9659-4aef-8bb6-235563753c3b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb/action" status: 200 len: 32647 microversion: 2.1 time: 0.090729 Aug 09 17:57:27.289543 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3191/6113] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:57:27 2022] POST /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb/action => generated 32647 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:57:27.351003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-85f8a259-c905-442e-852a-496df00290b6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:27.359984 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-85f8a259-c905-442e-852a-496df00290b6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.269718 Aug 09 17:57:27.361172 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2923/6114] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:27 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:27.431850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8bc109ad-5715-4d5c-9551-5f32f7cfc2b0 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:27.432563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8bc109ad-5715-4d5c-9551-5f32f7cfc2b0 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:27.441168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc109ad-5715-4d5c-9551-5f32f7cfc2b0 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.441967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc109ad-5715-4d5c-9551-5f32f7cfc2b0 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.442585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc109ad-5715-4d5c-9551-5f32f7cfc2b0 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.443729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc109ad-5715-4d5c-9551-5f32f7cfc2b0 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.444367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc109ad-5715-4d5c-9551-5f32f7cfc2b0 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.444970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bc109ad-5715-4d5c-9551-5f32f7cfc2b0 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.623528 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8bc109ad-5715-4d5c-9551-5f32f7cfc2b0 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1832 microversion: 2.1 time: 0.195342 Aug 09 17:57:27.623528 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3192/6115] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:27 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1832 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:27.656588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f48578fc-aed3-47c3-bd7b-7e03ecdb9304 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:27.659369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f48578fc-aed3-47c3-bd7b-7e03ecdb9304 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:27.665848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f48578fc-aed3-47c3-bd7b-7e03ecdb9304 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.666704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f48578fc-aed3-47c3-bd7b-7e03ecdb9304 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.666704 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f48578fc-aed3-47c3-bd7b-7e03ecdb9304 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.667797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f48578fc-aed3-47c3-bd7b-7e03ecdb9304 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:27.668314 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f48578fc-aed3-47c3-bd7b-7e03ecdb9304 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:27.668542 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f48578fc-aed3-47c3-bd7b-7e03ecdb9304 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:27.696063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-f48578fc-aed3-47c3-bd7b-7e03ecdb9304 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lazy-loading 'flavor' on Instance uuid e41f0940-9b79-4a5d-b5b2-ff17ebd830eb {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:57:27.709763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f48578fc-aed3-47c3-bd7b-7e03ecdb9304 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Going to try to live migrate instance to another host {{(pid=119432) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 17:57:28.391841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc0028ed-853b-4274-9909-c3fcd5484303 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:28.393353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bc0028ed-853b-4274-9909-c3fcd5484303 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:28.402961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0028ed-853b-4274-9909-c3fcd5484303 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:28.403462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0028ed-853b-4274-9909-c3fcd5484303 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:28.403956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0028ed-853b-4274-9909-c3fcd5484303 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:28.404761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0028ed-853b-4274-9909-c3fcd5484303 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:28.406011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0028ed-853b-4274-9909-c3fcd5484303 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:28.406453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc0028ed-853b-4274-9909-c3fcd5484303 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:28.621872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bc0028ed-853b-4274-9909-c3fcd5484303 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:28.634524 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bc0028ed-853b-4274-9909-c3fcd5484303 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.255120 Aug 09 17:57:28.640001 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3193/6116] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:28 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:29.661341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44558cb5-8e91-4163-aacf-2f96dbce92ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:29.662123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-44558cb5-8e91-4163-aacf-2f96dbce92ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:29.669882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44558cb5-8e91-4163-aacf-2f96dbce92ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:29.670596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44558cb5-8e91-4163-aacf-2f96dbce92ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:29.671045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44558cb5-8e91-4163-aacf-2f96dbce92ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:29.671842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44558cb5-8e91-4163-aacf-2f96dbce92ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:29.672478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44558cb5-8e91-4163-aacf-2f96dbce92ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:29.673117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44558cb5-8e91-4163-aacf-2f96dbce92ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:29.982151 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f48578fc-aed3-47c3-bd7b-7e03ecdb9304 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb/action" status: 202 len: 0 microversion: 2.1 time: 2.329961 Aug 09 17:57:29.983162 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2924/6117] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:57:27 2022] POST /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb/action => generated 0 bytes in 2332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:57:30.005578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-67a563ac-7da7-4850-adc0-9cef3f774aea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:30.006242 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-67a563ac-7da7-4850-adc0-9cef3f774aea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:30.017953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-44558cb5-8e91-4163-aacf-2f96dbce92ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:30.025357 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-7da7-4850-adc0-9cef3f774aea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:30.025870 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-7da7-4850-adc0-9cef3f774aea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:30.026338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-7da7-4850-adc0-9cef3f774aea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:30.027104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-7da7-4850-adc0-9cef3f774aea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:30.027594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-7da7-4850-adc0-9cef3f774aea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:30.028071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-67a563ac-7da7-4850-adc0-9cef3f774aea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:30.040910 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-44558cb5-8e91-4163-aacf-2f96dbce92ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.383335 Aug 09 17:57:30.041939 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3194/6118] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:29 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:30.272161 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-67a563ac-7da7-4850-adc0-9cef3f774aea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:30.294332 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-67a563ac-7da7-4850-adc0-9cef3f774aea tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1691 microversion: 2.1 time: 0.302342 Aug 09 17:57:30.296158 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2925/6119] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:29 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:31.077898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5bbcfff2-08a3-4c09-aa18-8ddb3b019e4e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:31.079098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5bbcfff2-08a3-4c09-aa18-8ddb3b019e4e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:31.087009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbcfff2-08a3-4c09-aa18-8ddb3b019e4e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:31.087529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbcfff2-08a3-4c09-aa18-8ddb3b019e4e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:31.087977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbcfff2-08a3-4c09-aa18-8ddb3b019e4e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:31.088875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbcfff2-08a3-4c09-aa18-8ddb3b019e4e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:31.089329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbcfff2-08a3-4c09-aa18-8ddb3b019e4e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:31.104772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bbcfff2-08a3-4c09-aa18-8ddb3b019e4e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:31.342606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-aac88563-ab13-415f-bbbc-ff98e2ff2b03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:31.342606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-aac88563-ab13-415f-bbbc-ff98e2ff2b03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:31.367485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aac88563-ab13-415f-bbbc-ff98e2ff2b03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:31.368139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aac88563-ab13-415f-bbbc-ff98e2ff2b03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:31.369746 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aac88563-ab13-415f-bbbc-ff98e2ff2b03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:31.370817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aac88563-ab13-415f-bbbc-ff98e2ff2b03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:31.370939 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aac88563-ab13-415f-bbbc-ff98e2ff2b03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:31.371372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-aac88563-ab13-415f-bbbc-ff98e2ff2b03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:31.390262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5bbcfff2-08a3-4c09-aa18-8ddb3b019e4e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:31.400745 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5bbcfff2-08a3-4c09-aa18-8ddb3b019e4e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.327304 Aug 09 17:57:31.405462 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3195/6120] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:31 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:31.633688 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-aac88563-ab13-415f-bbbc-ff98e2ff2b03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:31.654661 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-aac88563-ab13-415f-bbbc-ff98e2ff2b03 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1691 microversion: 2.1 time: 0.322724 Aug 09 17:57:31.656321 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2926/6121] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:31 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1691 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:31.732917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5e07ff54-902c-4b1e-a4da-6b23bc02a527 req-e0a0ea5c-a39c-4af6-b081-9e779edaa663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e41f0940-9b79-4a5d-b5b2-ff17ebd830eb", "name": "network-vif-unplugged", "status": "completed", "tag": "438993a2-95f0-4bb8-b636-a44aacb688e3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:31.756605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5e07ff54-902c-4b1e-a4da-6b23bc02a527 req-e0a0ea5c-a39c-4af6-b081-9e779edaa663 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:31.757719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5e07ff54-902c-4b1e-a4da-6b23bc02a527 req-e0a0ea5c-a39c-4af6-b081-9e779edaa663 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:31.759292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5e07ff54-902c-4b1e-a4da-6b23bc02a527 req-e0a0ea5c-a39c-4af6-b081-9e779edaa663 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:31.784074 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5e07ff54-902c-4b1e-a4da-6b23bc02a527 req-e0a0ea5c-a39c-4af6-b081-9e779edaa663 service nova] Creating event network-vif-unplugged:438993a2-95f0-4bb8-b636-a44aacb688e3 for instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb on n-h1-845781-6 Aug 09 17:57:31.795907 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5e07ff54-902c-4b1e-a4da-6b23bc02a527 req-e0a0ea5c-a39c-4af6-b081-9e779edaa663 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068621 Aug 09 17:57:31.798381 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3196/6122] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:32.430551 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-055f5327-73a0-41a1-9285-01b353aaaf2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:32.431803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-055f5327-73a0-41a1-9285-01b353aaaf2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:32.440367 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-055f5327-73a0-41a1-9285-01b353aaaf2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:32.441284 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-055f5327-73a0-41a1-9285-01b353aaaf2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:32.442005 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-055f5327-73a0-41a1-9285-01b353aaaf2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:32.443070 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-055f5327-73a0-41a1-9285-01b353aaaf2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:32.443816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-055f5327-73a0-41a1-9285-01b353aaaf2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:32.444521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-055f5327-73a0-41a1-9285-01b353aaaf2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:32.679342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-94cbb0a0-ebfc-4813-bdf3-0b5f7afc5d7d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:32.680843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-94cbb0a0-ebfc-4813-bdf3-0b5f7afc5d7d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:32.691380 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-055f5327-73a0-41a1-9285-01b353aaaf2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:32.704129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94cbb0a0-ebfc-4813-bdf3-0b5f7afc5d7d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:32.704882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94cbb0a0-ebfc-4813-bdf3-0b5f7afc5d7d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:32.705516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94cbb0a0-ebfc-4813-bdf3-0b5f7afc5d7d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:32.706541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94cbb0a0-ebfc-4813-bdf3-0b5f7afc5d7d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:32.707682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94cbb0a0-ebfc-4813-bdf3-0b5f7afc5d7d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:32.708186 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-055f5327-73a0-41a1-9285-01b353aaaf2b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.280934 Aug 09 17:57:32.708499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-94cbb0a0-ebfc-4813-bdf3-0b5f7afc5d7d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:32.722563 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2927/6123] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:32 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:32.904407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-94cbb0a0-ebfc-4813-bdf3-0b5f7afc5d7d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:32.913838 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-94cbb0a0-ebfc-4813-bdf3-0b5f7afc5d7d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1691 microversion: 2.1 time: 0.239026 Aug 09 17:57:32.915030 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3197/6124] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:32 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:33.735827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4e3447fe-faed-4310-a7f6-d55d71e816e7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:33.736993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4e3447fe-faed-4310-a7f6-d55d71e816e7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:33.748679 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e3447fe-faed-4310-a7f6-d55d71e816e7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:33.749877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e3447fe-faed-4310-a7f6-d55d71e816e7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:33.750583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e3447fe-faed-4310-a7f6-d55d71e816e7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:33.753609 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e3447fe-faed-4310-a7f6-d55d71e816e7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:33.755303 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e3447fe-faed-4310-a7f6-d55d71e816e7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:33.755947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4e3447fe-faed-4310-a7f6-d55d71e816e7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:33.852776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5842a456-7afd-4653-a317-091b6da09c06 req-e4b7c626-a131-4d99-ad64-72ee11cb2390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e41f0940-9b79-4a5d-b5b2-ff17ebd830eb", "tag": "438993a2-95f0-4bb8-b636-a44aacb688e3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:33.879642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5842a456-7afd-4653-a317-091b6da09c06 req-e4b7c626-a131-4d99-ad64-72ee11cb2390 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:33.882825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5842a456-7afd-4653-a317-091b6da09c06 req-e4b7c626-a131-4d99-ad64-72ee11cb2390 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:33.884455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5842a456-7afd-4653-a317-091b6da09c06 req-e4b7c626-a131-4d99-ad64-72ee11cb2390 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:33.917046 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5842a456-7afd-4653-a317-091b6da09c06 req-e4b7c626-a131-4d99-ad64-72ee11cb2390 service nova] Creating event network-changed:438993a2-95f0-4bb8-b636-a44aacb688e3 for instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb on n-h1-845781-6 Aug 09 17:57:33.924392 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5842a456-7afd-4653-a317-091b6da09c06 req-e4b7c626-a131-4d99-ad64-72ee11cb2390 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080787 Aug 09 17:57:33.928497 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3198/6125] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:57:33.938416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-83b07978-b17a-413d-8cac-3399ed414d99 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:33.939437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-83b07978-b17a-413d-8cac-3399ed414d99 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:33.947259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83b07978-b17a-413d-8cac-3399ed414d99 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:33.948078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83b07978-b17a-413d-8cac-3399ed414d99 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:33.948776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83b07978-b17a-413d-8cac-3399ed414d99 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:33.950016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83b07978-b17a-413d-8cac-3399ed414d99 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:33.951323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83b07978-b17a-413d-8cac-3399ed414d99 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:33.952024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83b07978-b17a-413d-8cac-3399ed414d99 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:33.985103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4e3447fe-faed-4310-a7f6-d55d71e816e7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:34.029582 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4e3447fe-faed-4310-a7f6-d55d71e816e7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.302792 Aug 09 17:57:34.031006 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2928/6126] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:33 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:34.302278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-83b07978-b17a-413d-8cac-3399ed414d99 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:34.316212 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-83b07978-b17a-413d-8cac-3399ed414d99 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1691 microversion: 2.1 time: 0.381924 Aug 09 17:57:34.317539 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3199/6127] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:33 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1691 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:35.061402 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6444fed5-ddff-4e6e-9561-983955cb3696 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:35.062118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6444fed5-ddff-4e6e-9561-983955cb3696 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:35.069044 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6444fed5-ddff-4e6e-9561-983955cb3696 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:35.069668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6444fed5-ddff-4e6e-9561-983955cb3696 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:35.070253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6444fed5-ddff-4e6e-9561-983955cb3696 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:35.071066 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6444fed5-ddff-4e6e-9561-983955cb3696 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:35.071647 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6444fed5-ddff-4e6e-9561-983955cb3696 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:35.072194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6444fed5-ddff-4e6e-9561-983955cb3696 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:35.222905 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6444fed5-ddff-4e6e-9561-983955cb3696 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:35.231225 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6444fed5-ddff-4e6e-9561-983955cb3696 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1169 microversion: 2.1 time: 0.177257 Aug 09 17:57:35.232336 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2929/6128] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:35 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1169 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:35.344883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dcac6596-49d1-4b66-9587-30cf7fd25cc9 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:35.346725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dcac6596-49d1-4b66-9587-30cf7fd25cc9 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:35.354825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcac6596-49d1-4b66-9587-30cf7fd25cc9 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:35.355388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcac6596-49d1-4b66-9587-30cf7fd25cc9 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:35.355788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcac6596-49d1-4b66-9587-30cf7fd25cc9 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:35.356723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcac6596-49d1-4b66-9587-30cf7fd25cc9 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:35.357188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcac6596-49d1-4b66-9587-30cf7fd25cc9 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:35.357604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dcac6596-49d1-4b66-9587-30cf7fd25cc9 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:35.519929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dcac6596-49d1-4b66-9587-30cf7fd25cc9 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:35.529961 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dcac6596-49d1-4b66-9587-30cf7fd25cc9 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1691 microversion: 2.1 time: 0.189462 Aug 09 17:57:35.530553 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3200/6129] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:35 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1691 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:36.252616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-049cbba5-d722-4f38-8dc1-5a055f81f0df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:36.253238 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-049cbba5-d722-4f38-8dc1-5a055f81f0df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:36.260308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-049cbba5-d722-4f38-8dc1-5a055f81f0df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:36.260792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-049cbba5-d722-4f38-8dc1-5a055f81f0df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:36.261296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-049cbba5-d722-4f38-8dc1-5a055f81f0df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:36.261933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-049cbba5-d722-4f38-8dc1-5a055f81f0df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:36.262387 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-049cbba5-d722-4f38-8dc1-5a055f81f0df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:36.262818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-049cbba5-d722-4f38-8dc1-5a055f81f0df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:36.399929 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-049cbba5-d722-4f38-8dc1-5a055f81f0df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:36.408391 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-049cbba5-d722-4f38-8dc1-5a055f81f0df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1203 microversion: 2.1 time: 0.159652 Aug 09 17:57:36.409054 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2930/6130] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:36 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:36.553282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1dbe6f8-bef4-4eae-8b1e-4b11e9122183 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:36.553975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1dbe6f8-bef4-4eae-8b1e-4b11e9122183 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:36.561066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbe6f8-bef4-4eae-8b1e-4b11e9122183 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:36.561566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbe6f8-bef4-4eae-8b1e-4b11e9122183 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:36.562019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbe6f8-bef4-4eae-8b1e-4b11e9122183 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:36.562730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbe6f8-bef4-4eae-8b1e-4b11e9122183 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:36.563191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbe6f8-bef4-4eae-8b1e-4b11e9122183 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:36.563670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbe6f8-bef4-4eae-8b1e-4b11e9122183 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:36.704063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a1dbe6f8-bef4-4eae-8b1e-4b11e9122183 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:36.711871 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1dbe6f8-bef4-4eae-8b1e-4b11e9122183 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1691 microversion: 2.1 time: 0.162594 Aug 09 17:57:36.712484 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3201/6131] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:36 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:37.430456 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-12675bcb-a2c4-46e0-9b44-9b685b9d3b5d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:37.431116 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-12675bcb-a2c4-46e0-9b44-9b685b9d3b5d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:37.438558 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12675bcb-a2c4-46e0-9b44-9b685b9d3b5d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:37.439376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12675bcb-a2c4-46e0-9b44-9b685b9d3b5d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:37.439735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12675bcb-a2c4-46e0-9b44-9b685b9d3b5d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:37.440617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12675bcb-a2c4-46e0-9b44-9b685b9d3b5d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:37.441209 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12675bcb-a2c4-46e0-9b44-9b685b9d3b5d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:37.441642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-12675bcb-a2c4-46e0-9b44-9b685b9d3b5d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:37.615331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-12675bcb-a2c4-46e0-9b44-9b685b9d3b5d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:37.626429 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-12675bcb-a2c4-46e0-9b44-9b685b9d3b5d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1203 microversion: 2.1 time: 0.199842 Aug 09 17:57:37.627759 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2931/6132] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:37 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1203 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:37.735243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-208bea3f-7221-476e-8995-4344732b040c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:37.736202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-208bea3f-7221-476e-8995-4344732b040c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:37.747204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208bea3f-7221-476e-8995-4344732b040c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:37.747743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208bea3f-7221-476e-8995-4344732b040c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:37.749351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208bea3f-7221-476e-8995-4344732b040c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:37.750392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208bea3f-7221-476e-8995-4344732b040c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:37.751051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208bea3f-7221-476e-8995-4344732b040c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:37.751730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208bea3f-7221-476e-8995-4344732b040c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:38.022127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-208bea3f-7221-476e-8995-4344732b040c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:38.031103 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-208bea3f-7221-476e-8995-4344732b040c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1691 microversion: 2.1 time: 0.301188 Aug 09 17:57:38.032657 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3202/6133] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:37 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1691 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:38.648982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-27b591e5-dc21-4e61-8dab-c64fe90049eb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:38.649430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-27b591e5-dc21-4e61-8dab-c64fe90049eb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:38.659940 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27b591e5-dc21-4e61-8dab-c64fe90049eb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:38.660543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27b591e5-dc21-4e61-8dab-c64fe90049eb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:38.661071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27b591e5-dc21-4e61-8dab-c64fe90049eb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:38.661886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27b591e5-dc21-4e61-8dab-c64fe90049eb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:38.662588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27b591e5-dc21-4e61-8dab-c64fe90049eb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:38.663097 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-27b591e5-dc21-4e61-8dab-c64fe90049eb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:38.815401 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-27b591e5-dc21-4e61-8dab-c64fe90049eb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:38.819203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:38.824830 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-27b591e5-dc21-4e61-8dab-c64fe90049eb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1203 microversion: 2.1 time: 0.179730 Aug 09 17:57:38.825786 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2932/6134] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:38 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1203 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:39.054417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e0bcea95-4bda-46a6-8d4a-6e535655b06c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:39.055122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e0bcea95-4bda-46a6-8d4a-6e535655b06c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:39.062586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0bcea95-4bda-46a6-8d4a-6e535655b06c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:39.063346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0bcea95-4bda-46a6-8d4a-6e535655b06c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:39.063832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0bcea95-4bda-46a6-8d4a-6e535655b06c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:39.064551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0bcea95-4bda-46a6-8d4a-6e535655b06c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:39.065033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0bcea95-4bda-46a6-8d4a-6e535655b06c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:39.065992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e0bcea95-4bda-46a6-8d4a-6e535655b06c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:39.221034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e0bcea95-4bda-46a6-8d4a-6e535655b06c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:39.225027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:39.229970 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e0bcea95-4bda-46a6-8d4a-6e535655b06c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1691 microversion: 2.1 time: 0.179214 Aug 09 17:57:39.230441 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3203/6135] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:39 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:39.849166 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-35a59998-438a-4717-8fb3-0fa9609eba88 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:39.850480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-35a59998-438a-4717-8fb3-0fa9609eba88 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:39.859379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35a59998-438a-4717-8fb3-0fa9609eba88 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:39.859899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35a59998-438a-4717-8fb3-0fa9609eba88 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:39.860352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35a59998-438a-4717-8fb3-0fa9609eba88 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:39.861072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35a59998-438a-4717-8fb3-0fa9609eba88 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:39.861533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35a59998-438a-4717-8fb3-0fa9609eba88 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:39.861968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-35a59998-438a-4717-8fb3-0fa9609eba88 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:40.035961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-35a59998-438a-4717-8fb3-0fa9609eba88 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:40.045927 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-35a59998-438a-4717-8fb3-0fa9609eba88 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1203 microversion: 2.1 time: 0.201917 Aug 09 17:57:40.046561 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2933/6136] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:39 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1203 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:40.258613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4759532f-8500-4eb2-ba17-46b683d75036 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:40.260044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4759532f-8500-4eb2-ba17-46b683d75036 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:40.273586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4759532f-8500-4eb2-ba17-46b683d75036 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:40.274509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4759532f-8500-4eb2-ba17-46b683d75036 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:40.275320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4759532f-8500-4eb2-ba17-46b683d75036 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:40.276661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4759532f-8500-4eb2-ba17-46b683d75036 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:40.277529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4759532f-8500-4eb2-ba17-46b683d75036 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:40.278378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4759532f-8500-4eb2-ba17-46b683d75036 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:40.477475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4759532f-8500-4eb2-ba17-46b683d75036 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:40.485362 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4759532f-8500-4eb2-ba17-46b683d75036 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1681 microversion: 2.1 time: 0.235200 Aug 09 17:57:40.499325 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3204/6137] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:40 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:40.506571 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-92f908fd-89a0-47d7-ad06-485270f1b545 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:40.507440 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-92f908fd-89a0-47d7-ad06-485270f1b545 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:40.514788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f908fd-89a0-47d7-ad06-485270f1b545 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:40.515281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f908fd-89a0-47d7-ad06-485270f1b545 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:40.515748 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f908fd-89a0-47d7-ad06-485270f1b545 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:40.517369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f908fd-89a0-47d7-ad06-485270f1b545 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:40.517369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f908fd-89a0-47d7-ad06-485270f1b545 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:40.517711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-92f908fd-89a0-47d7-ad06-485270f1b545 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:40.744761 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-92f908fd-89a0-47d7-ad06-485270f1b545 tempest-TestNetworkAdvancedServerOps-1306195732 tempest-TestNetworkAdvancedServerOps-1306195732-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1832 microversion: 2.1 time: 0.241949 Aug 09 17:57:40.745365 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2934/6138] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:40 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1832 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:40.770407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-15697c5b-e79e-4a42-ade1-a7ed392cee31 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:40.771345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-15697c5b-e79e-4a42-ade1-a7ed392cee31 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:40.779788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15697c5b-e79e-4a42-ade1-a7ed392cee31 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:40.780642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15697c5b-e79e-4a42-ade1-a7ed392cee31 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:40.781357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15697c5b-e79e-4a42-ade1-a7ed392cee31 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:40.782510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15697c5b-e79e-4a42-ade1-a7ed392cee31 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:40.783343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15697c5b-e79e-4a42-ade1-a7ed392cee31 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:40.784140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-15697c5b-e79e-4a42-ade1-a7ed392cee31 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:40.940755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-15697c5b-e79e-4a42-ade1-a7ed392cee31 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:40.948454 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-15697c5b-e79e-4a42-ade1-a7ed392cee31 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1681 microversion: 2.1 time: 0.184975 Aug 09 17:57:40.949036 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3205/6139] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:40 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:41.049126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e2471560-ad09-44af-9f8c-40dde9e5d575 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:41.051331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e2471560-ad09-44af-9f8c-40dde9e5d575 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:41.058433 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2471560-ad09-44af-9f8c-40dde9e5d575 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:41.058919 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2471560-ad09-44af-9f8c-40dde9e5d575 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:41.059359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2471560-ad09-44af-9f8c-40dde9e5d575 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:41.060084 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2471560-ad09-44af-9f8c-40dde9e5d575 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:41.060538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2471560-ad09-44af-9f8c-40dde9e5d575 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:41.060964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e2471560-ad09-44af-9f8c-40dde9e5d575 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:41.066592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-827316bd-4376-41ac-9867-c81ff698e6a4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:41.067294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-827316bd-4376-41ac-9867-c81ff698e6a4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:41.074345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-827316bd-4376-41ac-9867-c81ff698e6a4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:41.075576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-827316bd-4376-41ac-9867-c81ff698e6a4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:41.076132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-827316bd-4376-41ac-9867-c81ff698e6a4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:41.077054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-827316bd-4376-41ac-9867-c81ff698e6a4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:41.077654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-827316bd-4376-41ac-9867-c81ff698e6a4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:41.078086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-827316bd-4376-41ac-9867-c81ff698e6a4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:41.118166 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e2471560-ad09-44af-9f8c-40dde9e5d575 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb/action" status: 200 len: 38664 microversion: 2.1 time: 0.072784 Aug 09 17:57:41.126155 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2935/6140] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:57:41 2022] POST /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb/action => generated 38664 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:57:41.226941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-827316bd-4376-41ac-9867-c81ff698e6a4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:41.234708 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-827316bd-4376-41ac-9867-c81ff698e6a4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1203 microversion: 2.1 time: 0.172143 Aug 09 17:57:41.235314 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3206/6141] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:41 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:42.263052 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b9def6aa-0f6b-48f3-a83f-cc5e3b2e3173 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:42.263682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b9def6aa-0f6b-48f3-a83f-cc5e3b2e3173 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:42.271458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9def6aa-0f6b-48f3-a83f-cc5e3b2e3173 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:42.271988 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9def6aa-0f6b-48f3-a83f-cc5e3b2e3173 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:42.272439 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9def6aa-0f6b-48f3-a83f-cc5e3b2e3173 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:42.273152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9def6aa-0f6b-48f3-a83f-cc5e3b2e3173 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:42.273617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9def6aa-0f6b-48f3-a83f-cc5e3b2e3173 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:42.274054 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b9def6aa-0f6b-48f3-a83f-cc5e3b2e3173 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:42.419335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b9def6aa-0f6b-48f3-a83f-cc5e3b2e3173 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:42.427291 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b9def6aa-0f6b-48f3-a83f-cc5e3b2e3173 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1203 microversion: 2.1 time: 0.169245 Aug 09 17:57:42.427910 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2936/6142] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:42 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:43.448560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4946f379-4211-406f-bff8-683e27f854f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:43.449283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4946f379-4211-406f-bff8-683e27f854f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:43.457013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4946f379-4211-406f-bff8-683e27f854f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:43.457500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4946f379-4211-406f-bff8-683e27f854f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:43.457938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4946f379-4211-406f-bff8-683e27f854f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:43.458637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4946f379-4211-406f-bff8-683e27f854f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:43.459087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4946f379-4211-406f-bff8-683e27f854f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:43.459508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4946f379-4211-406f-bff8-683e27f854f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:43.648116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4946f379-4211-406f-bff8-683e27f854f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:43.656615 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4946f379-4211-406f-bff8-683e27f854f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1203 microversion: 2.1 time: 0.211805 Aug 09 17:57:43.657355 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3207/6143] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:43 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1203 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:44.678798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eed9531a-3f39-46ca-bba6-9e8f67cb416e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:44.680312 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eed9531a-3f39-46ca-bba6-9e8f67cb416e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:44.690595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eed9531a-3f39-46ca-bba6-9e8f67cb416e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:44.691323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eed9531a-3f39-46ca-bba6-9e8f67cb416e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:44.692065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eed9531a-3f39-46ca-bba6-9e8f67cb416e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:44.693394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eed9531a-3f39-46ca-bba6-9e8f67cb416e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:44.694025 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eed9531a-3f39-46ca-bba6-9e8f67cb416e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:44.695050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eed9531a-3f39-46ca-bba6-9e8f67cb416e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:44.710560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4da23944-a963-4948-a046-245b4e73ae14 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:44.711213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4da23944-a963-4948-a046-245b4e73ae14 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:44.713807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:44.730448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4da23944-a963-4948-a046-245b4e73ae14 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:44.731504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4da23944-a963-4948-a046-245b4e73ae14 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:44.732015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4da23944-a963-4948-a046-245b4e73ae14 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:44.732741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4da23944-a963-4948-a046-245b4e73ae14 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:44.733202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4da23944-a963-4948-a046-245b4e73ae14 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:44.733632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4da23944-a963-4948-a046-245b4e73ae14 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:44.774058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4da23944-a963-4948-a046-245b4e73ae14 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:57:44.892015 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4da23944-a963-4948-a046-245b4e73ae14 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 204 len: 0 microversion: 2.1 time: 0.184386 Aug 09 17:57:44.892769 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3208/6144] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:57:44 2022] DELETE /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:57:44.900898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ff8d8106-4f58-453d-bf26-0da392399b1a req-aa37d9e6-bdcb-4a57-8e70-e15bd4986fce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e41f0940-9b79-4a5d-b5b2-ff17ebd830eb", "tag": "438993a2-95f0-4bb8-b636-a44aacb688e3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:44.908245 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eed9531a-3f39-46ca-bba6-9e8f67cb416e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:44.913473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ff8d8106-4f58-453d-bf26-0da392399b1a req-aa37d9e6-bdcb-4a57-8e70-e15bd4986fce service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:44.914326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ff8d8106-4f58-453d-bf26-0da392399b1a req-aa37d9e6-bdcb-4a57-8e70-e15bd4986fce service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:44.914986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ff8d8106-4f58-453d-bf26-0da392399b1a req-aa37d9e6-bdcb-4a57-8e70-e15bd4986fce service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:44.918029 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eed9531a-3f39-46ca-bba6-9e8f67cb416e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1203 microversion: 2.1 time: 0.243345 Aug 09 17:57:44.920028 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2937/6145] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:44 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1203 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:44.925274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-560a9f66-0e12-4cc1-b134-a018785628fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:44.926236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-560a9f66-0e12-4cc1-b134-a018785628fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:44.935365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560a9f66-0e12-4cc1-b134-a018785628fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:44.936316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560a9f66-0e12-4cc1-b134-a018785628fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:44.937047 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560a9f66-0e12-4cc1-b134-a018785628fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:44.938010 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560a9f66-0e12-4cc1-b134-a018785628fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:44.938699 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560a9f66-0e12-4cc1-b134-a018785628fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:44.939517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-560a9f66-0e12-4cc1-b134-a018785628fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:44.942227 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ff8d8106-4f58-453d-bf26-0da392399b1a req-aa37d9e6-bdcb-4a57-8e70-e15bd4986fce service nova] Creating event network-changed:438993a2-95f0-4bb8-b636-a44aacb688e3 for instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb on n-h2-845781-6 Aug 09 17:57:44.947755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ff8d8106-4f58-453d-bf26-0da392399b1a req-aa37d9e6-bdcb-4a57-8e70-e15bd4986fce service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053186 Aug 09 17:57:44.948481 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3209/6146] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:45.103850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-560a9f66-0e12-4cc1-b134-a018785628fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:45.114298 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-560a9f66-0e12-4cc1-b134-a018785628fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1687 microversion: 2.1 time: 0.192919 Aug 09 17:57:45.115480 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2938/6147] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:44 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:45.948889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8bfa1f1-da7a-4afa-8b8a-92a693f81911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:45.951281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f8bfa1f1-da7a-4afa-8b8a-92a693f81911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:45.964486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8bfa1f1-da7a-4afa-8b8a-92a693f81911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:45.966384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8bfa1f1-da7a-4afa-8b8a-92a693f81911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:45.967484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8bfa1f1-da7a-4afa-8b8a-92a693f81911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:45.969126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8bfa1f1-da7a-4afa-8b8a-92a693f81911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:45.970263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8bfa1f1-da7a-4afa-8b8a-92a693f81911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:45.971294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8bfa1f1-da7a-4afa-8b8a-92a693f81911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:46.068698 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5b6203e2-d10b-4ad4-9701-c58c198c54db req-dcc9e528-6e96-442b-b044-5888ceaf6ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5", "name": "network-vif-plugged", "status": "completed", "tag": "ef16d918-8f6c-4a67-bd10-90fb906c1496"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:46.087762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=49 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:57:46.102280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5b6203e2-d10b-4ad4-9701-c58c198c54db req-dcc9e528-6e96-442b-b044-5888ceaf6ada service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:46.103107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5b6203e2-d10b-4ad4-9701-c58c198c54db req-dcc9e528-6e96-442b-b044-5888ceaf6ada service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:46.104000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5b6203e2-d10b-4ad4-9701-c58c198c54db req-dcc9e528-6e96-442b-b044-5888ceaf6ada service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:46.131920 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5b6203e2-d10b-4ad4-9701-c58c198c54db req-dcc9e528-6e96-442b-b044-5888ceaf6ada service nova] Creating event network-vif-plugged:ef16d918-8f6c-4a67-bd10-90fb906c1496 for instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 on n-h2-845781-6 Aug 09 17:57:46.138716 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5b6203e2-d10b-4ad4-9701-c58c198c54db req-dcc9e528-6e96-442b-b044-5888ceaf6ada service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075899 Aug 09 17:57:46.140336 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2939/6148] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:57:46.148313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f5f10a36-c2c4-4694-9f82-43327968d95c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:46.149296 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f5f10a36-c2c4-4694-9f82-43327968d95c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:46.156700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5f10a36-c2c4-4694-9f82-43327968d95c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:46.157817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5f10a36-c2c4-4694-9f82-43327968d95c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:46.158511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5f10a36-c2c4-4694-9f82-43327968d95c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:46.160297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5f10a36-c2c4-4694-9f82-43327968d95c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:46.161060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5f10a36-c2c4-4694-9f82-43327968d95c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:46.161730 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f5f10a36-c2c4-4694-9f82-43327968d95c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:46.259958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f8bfa1f1-da7a-4afa-8b8a-92a693f81911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:46.276847 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f8bfa1f1-da7a-4afa-8b8a-92a693f81911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1203 microversion: 2.1 time: 0.334036 Aug 09 17:57:46.278487 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3210/6149] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:45 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1203 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:46.518078 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f5f10a36-c2c4-4694-9f82-43327968d95c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:46.527371 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f5f10a36-c2c4-4694-9f82-43327968d95c tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 200 len: 1569 microversion: 2.1 time: 0.384557 Aug 09 17:57:46.528812 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2940/6150] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:46 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 1569 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:46.712278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9e7c09ef-40ff-49fd-93d5-4721ce246bde req-e17a73a2-11c9-43a6-9729-4419f593ad06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e41f0940-9b79-4a5d-b5b2-ff17ebd830eb", "name": "network-vif-deleted", "tag": "438993a2-95f0-4bb8-b636-a44aacb688e3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:46.723458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e7c09ef-40ff-49fd-93d5-4721ce246bde req-e17a73a2-11c9-43a6-9729-4419f593ad06 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:46.724261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e7c09ef-40ff-49fd-93d5-4721ce246bde req-e17a73a2-11c9-43a6-9729-4419f593ad06 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:46.724706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e7c09ef-40ff-49fd-93d5-4721ce246bde req-e17a73a2-11c9-43a6-9729-4419f593ad06 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:46.737787 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9e7c09ef-40ff-49fd-93d5-4721ce246bde req-e17a73a2-11c9-43a6-9729-4419f593ad06 service nova] Creating event network-vif-deleted:438993a2-95f0-4bb8-b636-a44aacb688e3 for instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb on n-h2-845781-6 Aug 09 17:57:46.743559 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9e7c09ef-40ff-49fd-93d5-4721ce246bde req-e17a73a2-11c9-43a6-9729-4419f593ad06 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034771 Aug 09 17:57:46.744143 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3211/6151] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:57:47.301497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-030a1aaf-bea2-462d-80b0-78456ba81d84 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:47.302565 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-030a1aaf-bea2-462d-80b0-78456ba81d84 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:47.315207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-030a1aaf-bea2-462d-80b0-78456ba81d84 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:47.316447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-030a1aaf-bea2-462d-80b0-78456ba81d84 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:47.317189 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-030a1aaf-bea2-462d-80b0-78456ba81d84 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:47.318163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-030a1aaf-bea2-462d-80b0-78456ba81d84 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:47.318871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-030a1aaf-bea2-462d-80b0-78456ba81d84 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:47.319395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-030a1aaf-bea2-462d-80b0-78456ba81d84 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:47.545645 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-030a1aaf-bea2-462d-80b0-78456ba81d84 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:47.566682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:47.572526 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-030a1aaf-bea2-462d-80b0-78456ba81d84 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1203 microversion: 2.1 time: 0.276306 Aug 09 17:57:47.574955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: e41f0940-9b79-4a5d-b5b2-ff17ebd830eb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:47.581864 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2941/6152] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:47 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1203 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:47.592029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:47.593873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:47.595088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:47.598223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:47.600554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:47.601903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:47.626903 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] HTTP exception thrown: Instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb could not be found. Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Request method failure captured: Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb HTTP/1.1 Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p5yR1vvXdoHF6Ye4OkNhkM0OM2jWQEtgxloVubvvpM1GvnEKWmLvq_LisffgRln3d8YjK5jNj034a5fZK1hfamQn32lQw79jkbHDA9No0pavvPRNmpI4Zrw53leLAXhgbg98UjYYgE3lTGBb7Ptu6pOydP_Ub-aqj0vIBjuHGJazf4 Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 060105d0d71644839935005af8ad1bda Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_060105d0d71644839935005af8ad1bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/060105d0d71644839935005af8ad1bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/060105d0d71644839935005af8ad1bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/060105d0d71644839935005af8ad1bda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 060105d0d71644839935005af8ad1bda Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestNetworkAdvancedServerOps-278625738-project Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a343f75165674844a2e9e46500fa01c0 Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestNetworkAdvancedServerOps-278625738-project Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb could not be found. Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'e41f0940-9b79-4a5d-b5b2-ff17ebd830eb'} Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb could not be found. Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb could not be found. Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:57:47.632757 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:47.643169 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:57:47.643169 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:47.643169 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:47.643169 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:47.643169 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:57:47.643169 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:57:47.643169 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb could not be found. Aug 09 17:57:47.643169 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:57:47.643169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Returning 404 to user: Instance e41f0940-9b79-4a5d-b5b2-ff17ebd830eb could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:57:47.645651 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5af59188-2eff-41ec-a99a-88a4eb87d17d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb" status: 404 len: 111 microversion: 2.1 time: 0.087085 Aug 09 17:57:47.649722 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3212/6153] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:47 2022] GET /compute/v2.1/servers/e41f0940-9b79-4a5d-b5b2-ff17ebd830eb => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:57:48.622535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-14983413-4e2b-4044-aeef-984de712226d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:48.622535 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-14983413-4e2b-4044-aeef-984de712226d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:48.632454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14983413-4e2b-4044-aeef-984de712226d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.633143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14983413-4e2b-4044-aeef-984de712226d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.633797 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14983413-4e2b-4044-aeef-984de712226d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:48.635610 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14983413-4e2b-4044-aeef-984de712226d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.636737 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14983413-4e2b-4044-aeef-984de712226d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.637850 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-14983413-4e2b-4044-aeef-984de712226d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:48.867201 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-14983413-4e2b-4044-aeef-984de712226d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:48.877503 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-14983413-4e2b-4044-aeef-984de712226d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1389 microversion: 2.1 time: 0.266404 Aug 09 17:57:48.878118 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2942/6154] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:48 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1389 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:57:48.898514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-274ef36a-3c9e-4b74-a919-31cd4f0f3a72 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:48.899275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-274ef36a-3c9e-4b74-a919-31cd4f0f3a72 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:48.914369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-274ef36a-3c9e-4b74-a919-31cd4f0f3a72 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.914881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-274ef36a-3c9e-4b74-a919-31cd4f0f3a72 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.915325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-274ef36a-3c9e-4b74-a919-31cd4f0f3a72 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:48.916339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-274ef36a-3c9e-4b74-a919-31cd4f0f3a72 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:48.916570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-274ef36a-3c9e-4b74-a919-31cd4f0f3a72 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:48.917178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-274ef36a-3c9e-4b74-a919-31cd4f0f3a72 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:49.268402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-274ef36a-3c9e-4b74-a919-31cd4f0f3a72 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:49.279387 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-274ef36a-3c9e-4b74-a919-31cd4f0f3a72 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1389 microversion: 2.1 time: 0.384984 Aug 09 17:57:49.280241 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3213/6155] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:48 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1389 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:49.314092 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8c35d282-88aa-4df1-b068-1e550082d922 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:49.315422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8c35d282-88aa-4df1-b068-1e550082d922 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:49.325836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c35d282-88aa-4df1-b068-1e550082d922 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:49.326646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c35d282-88aa-4df1-b068-1e550082d922 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:49.327381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c35d282-88aa-4df1-b068-1e550082d922 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:49.328938 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c35d282-88aa-4df1-b068-1e550082d922 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:49.329764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c35d282-88aa-4df1-b068-1e550082d922 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:49.330520 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8c35d282-88aa-4df1-b068-1e550082d922 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:49.523341 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8c35d282-88aa-4df1-b068-1e550082d922 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:49.532473 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8c35d282-88aa-4df1-b068-1e550082d922 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1389 microversion: 2.1 time: 0.225654 Aug 09 17:57:49.533098 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2943/6156] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:49 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1389 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:49.633779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8ae412d5-ddb5-4e84-9743-a00a20f2b322 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:49.634810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ae412d5-ddb5-4e84-9743-a00a20f2b322 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:49.645179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae412d5-ddb5-4e84-9743-a00a20f2b322 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:49.646093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae412d5-ddb5-4e84-9743-a00a20f2b322 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:49.647182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae412d5-ddb5-4e84-9743-a00a20f2b322 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:49.648622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae412d5-ddb5-4e84-9743-a00a20f2b322 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:49.649559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae412d5-ddb5-4e84-9743-a00a20f2b322 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:49.650356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ae412d5-ddb5-4e84-9743-a00a20f2b322 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:49.701820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ae412d5-ddb5-4e84-9743-a00a20f2b322 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:57:49.985257 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8ae412d5-ddb5-4e84-9743-a00a20f2b322 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 204 len: 0 microversion: 2.1 time: 0.355187 Aug 09 17:57:49.986744 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3214/6157] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:57:49 2022] DELETE /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:57:49.999897 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-44be9f3f-31cd-4ad4-b01a-48f852819c02 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:50.002942 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-44be9f3f-31cd-4ad4-b01a-48f852819c02 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:50.016435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44be9f3f-31cd-4ad4-b01a-48f852819c02 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:50.017995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44be9f3f-31cd-4ad4-b01a-48f852819c02 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:50.019237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44be9f3f-31cd-4ad4-b01a-48f852819c02 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:50.021068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44be9f3f-31cd-4ad4-b01a-48f852819c02 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:50.022258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44be9f3f-31cd-4ad4-b01a-48f852819c02 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:50.023599 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-44be9f3f-31cd-4ad4-b01a-48f852819c02 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:50.359594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-44be9f3f-31cd-4ad4-b01a-48f852819c02 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:50.387019 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-44be9f3f-31cd-4ad4-b01a-48f852819c02 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1395 microversion: 2.1 time: 0.388967 Aug 09 17:57:50.387019 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2944/6158] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:49 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1395 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:51.426883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8013df02-dedc-4d32-bd6c-561e8f868f11 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:51.427489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8013df02-dedc-4d32-bd6c-561e8f868f11 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:51.434319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8013df02-dedc-4d32-bd6c-561e8f868f11 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:51.434810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8013df02-dedc-4d32-bd6c-561e8f868f11 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:51.435245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8013df02-dedc-4d32-bd6c-561e8f868f11 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:51.435982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8013df02-dedc-4d32-bd6c-561e8f868f11 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:51.436658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8013df02-dedc-4d32-bd6c-561e8f868f11 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:51.437093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8013df02-dedc-4d32-bd6c-561e8f868f11 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:51.682708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8013df02-dedc-4d32-bd6c-561e8f868f11 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:51.694662 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8013df02-dedc-4d32-bd6c-561e8f868f11 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1395 microversion: 2.1 time: 0.272603 Aug 09 17:57:51.695618 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3215/6159] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:51 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1395 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:52.309593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-00bf058c-97c9-42b7-8ecd-58cf3255746f req-161f0d6a-7192-4f87-8076-47adc33a8532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5", "name": "network-vif-deleted", "tag": "ef16d918-8f6c-4a67-bd10-90fb906c1496"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:52.323790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-00bf058c-97c9-42b7-8ecd-58cf3255746f req-161f0d6a-7192-4f87-8076-47adc33a8532 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:52.323790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-00bf058c-97c9-42b7-8ecd-58cf3255746f req-161f0d6a-7192-4f87-8076-47adc33a8532 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:52.323790 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-00bf058c-97c9-42b7-8ecd-58cf3255746f req-161f0d6a-7192-4f87-8076-47adc33a8532 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:52.328376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-945a70bb-a2e0-4fd8-8c60-550a537bd9e2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '.version_select at 0x7fbbca3d4dc0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:52.355187 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-00bf058c-97c9-42b7-8ecd-58cf3255746f req-161f0d6a-7192-4f87-8076-47adc33a8532 service nova] Creating event network-vif-deleted:ef16d918-8f6c-4a67-bd10-90fb906c1496 for instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 on n-h2-845781-6 Aug 09 17:57:52.362609 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-00bf058c-97c9-42b7-8ecd-58cf3255746f req-161f0d6a-7192-4f87-8076-47adc33a8532 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056823 Aug 09 17:57:52.363258 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2945/6160] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:57:52.371347 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-945a70bb-a2e0-4fd8-8c60-550a537bd9e2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-846907744" status: 202 len: 0 microversion: 2.1 time: 0.047230 Aug 09 17:57:52.372085 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3216/6161] 10.222.0.93 () {58 vars in 1281 bytes} [Tue Aug 9 17:57:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-846907744 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:57:52.411279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-39b1b67d-29be-45e3-8a66-0241e067d390 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'create', calling method: .version_select at 0x7fbbcbad3160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-28664677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHObUBgj+eXZ8yNDZJfx5qloUa2u4RUhUg3n6uGuYS9h9cH2b8RQfWhz0Wg9eVkuVms977Y96xguXG/OorFwX1bemDG5snuqb6L8byVk9HnrbXBgn///8tk+MBgF2iN1g=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:57:52.453040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-39b1b67d-29be-45e3-8a66-0241e067d390 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for project 060105d0d71644839935005af8ad1bda. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:57:52.459473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-39b1b67d-29be-45e3-8a66-0241e067d390 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for user a343f75165674844a2e9e46500fa01c0 and project 060105d0d71644839935005af8ad1bda. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:57:52.493526 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-39b1b67d-29be-45e3-8a66-0241e067d390 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.086426 Aug 09 17:57:52.495302 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3217/6162] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 17:57:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:57:52.727308 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f2d06271-9c92-4ff0-b0fe-e21cb405f733 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:52.728492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f2d06271-9c92-4ff0-b0fe-e21cb405f733 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:52.749775 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d06271-9c92-4ff0-b0fe-e21cb405f733 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:52.752381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d06271-9c92-4ff0-b0fe-e21cb405f733 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:52.753203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d06271-9c92-4ff0-b0fe-e21cb405f733 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:52.755464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d06271-9c92-4ff0-b0fe-e21cb405f733 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:52.756294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d06271-9c92-4ff0-b0fe-e21cb405f733 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:52.758310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f2d06271-9c92-4ff0-b0fe-e21cb405f733 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:52.914859 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f2d06271-9c92-4ff0-b0fe-e21cb405f733 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:52.926502 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f2d06271-9c92-4ff0-b0fe-e21cb405f733 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1188 microversion: 2.1 time: 0.213825 Aug 09 17:57:52.939653 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2946/6163] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:52 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1188 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:53.953977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-90c5a9e4-d2fc-4f39-a753-4bf26ea54243 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:53.955065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-90c5a9e4-d2fc-4f39-a753-4bf26ea54243 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:54.000523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90c5a9e4-d2fc-4f39-a753-4bf26ea54243 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:54.001553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90c5a9e4-d2fc-4f39-a753-4bf26ea54243 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:54.002424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90c5a9e4-d2fc-4f39-a753-4bf26ea54243 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:54.004013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90c5a9e4-d2fc-4f39-a753-4bf26ea54243 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:54.009586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90c5a9e4-d2fc-4f39-a753-4bf26ea54243 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:54.010406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90c5a9e4-d2fc-4f39-a753-4bf26ea54243 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:54.159223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-90c5a9e4-d2fc-4f39-a753-4bf26ea54243 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:54.167183 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-90c5a9e4-d2fc-4f39-a753-4bf26ea54243 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1188 microversion: 2.1 time: 0.222502 Aug 09 17:57:54.168257 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3218/6164] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:53 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1188 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:55.190304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0a337ca8-3eff-4dc8-b1da-3a1716aee2cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:55.191999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0a337ca8-3eff-4dc8-b1da-3a1716aee2cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:55.202383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a337ca8-3eff-4dc8-b1da-3a1716aee2cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:55.204062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a337ca8-3eff-4dc8-b1da-3a1716aee2cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:55.205004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a337ca8-3eff-4dc8-b1da-3a1716aee2cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:55.207056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a337ca8-3eff-4dc8-b1da-3a1716aee2cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:55.208613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a337ca8-3eff-4dc8-b1da-3a1716aee2cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:55.210540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a337ca8-3eff-4dc8-b1da-3a1716aee2cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:55.330340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0a337ca8-3eff-4dc8-b1da-3a1716aee2cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:55.355815 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0a337ca8-3eff-4dc8-b1da-3a1716aee2cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1188 microversion: 2.1 time: 0.169868 Aug 09 17:57:55.368094 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2947/6165] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:55 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1188 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:56.381649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3e9d7e4-3728-4144-9d9b-d9acc7218437 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:56.382996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3e9d7e4-3728-4144-9d9b-d9acc7218437 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:56.392604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e9d7e4-3728-4144-9d9b-d9acc7218437 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:56.393446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e9d7e4-3728-4144-9d9b-d9acc7218437 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:56.394353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e9d7e4-3728-4144-9d9b-d9acc7218437 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:56.395438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e9d7e4-3728-4144-9d9b-d9acc7218437 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:56.396458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e9d7e4-3728-4144-9d9b-d9acc7218437 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:56.396966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e9d7e4-3728-4144-9d9b-d9acc7218437 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:56.510843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f3e9d7e4-3728-4144-9d9b-d9acc7218437 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:56.530461 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3e9d7e4-3728-4144-9d9b-d9acc7218437 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1188 microversion: 2.1 time: 0.146876 Aug 09 17:57:56.531872 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3219/6166] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:56 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1188 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:57.558541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:57.559320 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:57.582511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:57.585275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:57.586344 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:57.595838 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:57.599219 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:57.600530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:57.705045 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:57.705857 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:57.707768 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:57.709224 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lazy-loading 'fault' on Instance uuid 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:57:57.863510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:57:57.891979 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e041974-3e71-4c97-9efa-994fbbdd55ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 200 len: 1193 microversion: 2.1 time: 0.339214 Aug 09 17:57:57.902693 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2948/6167] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:57 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 1193 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:57:58.926402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:57:58.927136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:57:58.937605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:58.938919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:58.939823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:58.941220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:57:58.942159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:57:58.943054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:57:58.966200 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 HTTP/1.1 Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5'} Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:57:58.968451 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:57:58.974418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:57:58.974418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:57:58.974418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:57:58.974418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:57:58.974418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:57:58.974418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:57:58.974418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:57:58.976317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:57:58.977376 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-93669e0b-39e6-424a-ac5f-678526cfa9db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 404 len: 111 microversion: 2.1 time: 0.055287 Aug 09 17:57:58.978137 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3220/6168] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:57:58 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:58:01.323914 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-726993335", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "2df8497d-9f51-40c0-94f2-54b3aefcd704"}], "key_name": "tempest-TestNetworkAdvancedServerOps-28664677", "security_groups": [{"name": "tempest-secgroup-smoke-493074926"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:01.559781 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] validate_networks() for [('2df8497d-9f51-40c0-94f2-54b3aefcd704', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:58:02.149370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:58:02.149820 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:58:02.150371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:58:02.150798 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:58:02.152004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:58:02.163561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:02.164176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:02.164624 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:02.165762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:02.166236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:02.166674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:02.193825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for project 060105d0d71644839935005af8ad1bda. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:58:02.200709 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Getting quotas for user a343f75165674844a2e9e46500fa01c0 and project 060105d0d71644839935005af8ad1bda. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:58:02.225760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:58:02.226462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:58:02.296519 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8d16ab6e-33dc-4f93-a95b-2952cd1cb9b2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.977755 Aug 09 17:58:02.303167 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2949/6169] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:58:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:58:02.308138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2cfae229-65c4-4cd8-8a32-9f69afc42719 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:02.308756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2cfae229-65c4-4cd8-8a32-9f69afc42719 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:02.435700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2cfae229-65c4-4cd8-8a32-9f69afc42719 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:02.449890 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2cfae229-65c4-4cd8-8a32-9f69afc42719 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1264 microversion: 2.1 time: 0.145524 Aug 09 17:58:02.453684 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3221/6170] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:02 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:03.418952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:03.419497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:03.437885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:03.438391 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:03.440602 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:03.443370 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:03.444435 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:03.444947 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:03.482859 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:58:03.483224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a5dbd93e-9265-4370-aa26-024acc09673d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:03.484034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a5dbd93e-9265-4370-aa26-024acc09673d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 HTTP/1.1 Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5'} Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:58:03.484639 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-422f84c4-757d-4bce-96a2-9bcc69e4a454 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 404 len: 111 microversion: 2.1 time: 0.073866 Aug 09 17:58:03.492526 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2950/6171] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:58:03 2022] DELETE /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:58:03.496601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5dbd93e-9265-4370-aa26-024acc09673d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:03.496601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5dbd93e-9265-4370-aa26-024acc09673d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:03.496601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5dbd93e-9265-4370-aa26-024acc09673d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:03.497002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5dbd93e-9265-4370-aa26-024acc09673d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:03.497474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5dbd93e-9265-4370-aa26-024acc09673d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:03.497911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5dbd93e-9265-4370-aa26-024acc09673d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:03.504274 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:03.504638 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:03.518196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:03.518703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:03.519231 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:03.520000 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:03.520460 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:03.520980 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:03.551918 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 HTTP/1.1 Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5'} Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:58:03.553843 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:58:03.558167 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:58:03.558167 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:58:03.558167 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:58:03.558167 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:58:03.558167 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:58:03.558167 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. Aug 09 17:58:03.558167 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:58:03.558167 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:58:03.558658 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c8c8edf5-fba7-4c1b-9520-0c49f61dadfe tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5" status: 404 len: 111 microversion: 2.1 time: 0.065316 Aug 09 17:58:03.566484 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2951/6172] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:03 2022] GET /compute/v2.1/servers/1fb3bc4d-910f-45de-a7b7-45c8b2c9d7e5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:58:03.585190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a5dbd93e-9265-4370-aa26-024acc09673d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:03.590757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:03.599957 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a5dbd93e-9265-4370-aa26-024acc09673d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1316 microversion: 2.1 time: 0.121221 Aug 09 17:58:03.612568 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3222/6173] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:03 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1316 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:04.635083 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-faeb21b9-7f92-41bd-b43f-2aa41596d73b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:04.639021 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-faeb21b9-7f92-41bd-b43f-2aa41596d73b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:04.659106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-faeb21b9-7f92-41bd-b43f-2aa41596d73b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:04.662725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-faeb21b9-7f92-41bd-b43f-2aa41596d73b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:04.663586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-faeb21b9-7f92-41bd-b43f-2aa41596d73b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:04.665724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-faeb21b9-7f92-41bd-b43f-2aa41596d73b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:04.668175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-faeb21b9-7f92-41bd-b43f-2aa41596d73b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:04.670020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-faeb21b9-7f92-41bd-b43f-2aa41596d73b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:04.875298 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-faeb21b9-7f92-41bd-b43f-2aa41596d73b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:04.880002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:04.893356 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-faeb21b9-7f92-41bd-b43f-2aa41596d73b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1322 microversion: 2.1 time: 0.275480 Aug 09 17:58:04.906630 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2952/6174] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:04 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:05.949198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-81f4a889-d2f6-49dc-979e-bf8a4088631b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:05.950146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-81f4a889-d2f6-49dc-979e-bf8a4088631b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:05.976687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81f4a889-d2f6-49dc-979e-bf8a4088631b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:05.977192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81f4a889-d2f6-49dc-979e-bf8a4088631b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:05.978119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81f4a889-d2f6-49dc-979e-bf8a4088631b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:05.978387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81f4a889-d2f6-49dc-979e-bf8a4088631b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:05.978803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81f4a889-d2f6-49dc-979e-bf8a4088631b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:05.979299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81f4a889-d2f6-49dc-979e-bf8a4088631b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:06.506076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81f4a889-d2f6-49dc-979e-bf8a4088631b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:06.514769 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-81f4a889-d2f6-49dc-979e-bf8a4088631b tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1389 microversion: 2.1 time: 0.569966 Aug 09 17:58:06.515676 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3223/6175] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:05 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1389 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:06.565422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-a633b54e-da16-44a9-a864-c394d098377f req-286c0133-c656-4566-80eb-5e068dee9cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380cdb00-065d-4575-8ef8-5b7785df5fa8", "tag": "b6759686-f390-435c-8776-87bfc88a176f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:06.585530 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a633b54e-da16-44a9-a864-c394d098377f req-286c0133-c656-4566-80eb-5e068dee9cb3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:06.586327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a633b54e-da16-44a9-a864-c394d098377f req-286c0133-c656-4566-80eb-5e068dee9cb3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:06.586970 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-a633b54e-da16-44a9-a864-c394d098377f req-286c0133-c656-4566-80eb-5e068dee9cb3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:06.602559 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-a633b54e-da16-44a9-a864-c394d098377f req-286c0133-c656-4566-80eb-5e068dee9cb3 service nova] Creating event network-changed:b6759686-f390-435c-8776-87bfc88a176f for instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 on n-h1-845781-6 Aug 09 17:58:06.609057 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-a633b54e-da16-44a9-a864-c394d098377f req-286c0133-c656-4566-80eb-5e068dee9cb3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048794 Aug 09 17:58:06.610301 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2953/6176] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:07.537264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9797c12d-13e4-4275-b0b7-c66b12b62e06 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:07.538088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9797c12d-13e4-4275-b0b7-c66b12b62e06 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:07.546593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9797c12d-13e4-4275-b0b7-c66b12b62e06 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:07.550652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9797c12d-13e4-4275-b0b7-c66b12b62e06 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:07.551650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9797c12d-13e4-4275-b0b7-c66b12b62e06 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:07.552657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9797c12d-13e4-4275-b0b7-c66b12b62e06 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:07.553716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9797c12d-13e4-4275-b0b7-c66b12b62e06 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:07.554559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9797c12d-13e4-4275-b0b7-c66b12b62e06 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:07.754602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9797c12d-13e4-4275-b0b7-c66b12b62e06 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:07.763274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9797c12d-13e4-4275-b0b7-c66b12b62e06 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1389 microversion: 2.1 time: 0.229966 Aug 09 17:58:07.763917 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3224/6177] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:07 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1389 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:08.797629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-77806643-6476-4434-b5b4-f7c772387c81 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:08.809397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-77806643-6476-4434-b5b4-f7c772387c81 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:08.830670 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77806643-6476-4434-b5b4-f7c772387c81 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:08.831476 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77806643-6476-4434-b5b4-f7c772387c81 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:08.832331 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77806643-6476-4434-b5b4-f7c772387c81 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:08.833618 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77806643-6476-4434-b5b4-f7c772387c81 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:08.834466 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77806643-6476-4434-b5b4-f7c772387c81 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:08.835257 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-77806643-6476-4434-b5b4-f7c772387c81 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:09.321684 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-77806643-6476-4434-b5b4-f7c772387c81 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:09.339436 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-77806643-6476-4434-b5b4-f7c772387c81 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1389 microversion: 2.1 time: 0.556168 Aug 09 17:58:09.341077 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2954/6178] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:08 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1389 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:10.362694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1a623b92-aa3a-4586-8be9-a794960453bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:10.363324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1a623b92-aa3a-4586-8be9-a794960453bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:10.374533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a623b92-aa3a-4586-8be9-a794960453bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:10.375170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a623b92-aa3a-4586-8be9-a794960453bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:10.375900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a623b92-aa3a-4586-8be9-a794960453bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:10.377086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a623b92-aa3a-4586-8be9-a794960453bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:10.377400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a623b92-aa3a-4586-8be9-a794960453bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:10.377842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a623b92-aa3a-4586-8be9-a794960453bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:10.637328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a623b92-aa3a-4586-8be9-a794960453bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:10.647408 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1a623b92-aa3a-4586-8be9-a794960453bd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1389 microversion: 2.1 time: 0.288404 Aug 09 17:58:10.649163 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3225/6179] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:10 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1389 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:11.493916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-5f6dcc07-60cf-4c2a-b9d2-c9c3a4e0acee req-222a60d0-3f7f-4402-955d-8ac7d6d602ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380cdb00-065d-4575-8ef8-5b7785df5fa8", "name": "network-vif-plugged", "status": "completed", "tag": "b6759686-f390-435c-8776-87bfc88a176f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:11.513652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5f6dcc07-60cf-4c2a-b9d2-c9c3a4e0acee req-222a60d0-3f7f-4402-955d-8ac7d6d602ac service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:11.514767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5f6dcc07-60cf-4c2a-b9d2-c9c3a4e0acee req-222a60d0-3f7f-4402-955d-8ac7d6d602ac service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:11.515469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-5f6dcc07-60cf-4c2a-b9d2-c9c3a4e0acee req-222a60d0-3f7f-4402-955d-8ac7d6d602ac service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:11.533110 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-5f6dcc07-60cf-4c2a-b9d2-c9c3a4e0acee req-222a60d0-3f7f-4402-955d-8ac7d6d602ac service nova] Creating event network-vif-plugged:b6759686-f390-435c-8776-87bfc88a176f for instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 on n-h1-845781-6 Aug 09 17:58:11.539854 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-5f6dcc07-60cf-4c2a-b9d2-c9c3a4e0acee req-222a60d0-3f7f-4402-955d-8ac7d6d602ac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051616 Aug 09 17:58:11.545592 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2955/6180] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:11.676875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b56080b2-53aa-4d7d-8227-f85cbde7c0cd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:11.679070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b56080b2-53aa-4d7d-8227-f85cbde7c0cd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:11.696387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56080b2-53aa-4d7d-8227-f85cbde7c0cd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:11.700179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56080b2-53aa-4d7d-8227-f85cbde7c0cd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:11.702105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56080b2-53aa-4d7d-8227-f85cbde7c0cd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:11.703929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56080b2-53aa-4d7d-8227-f85cbde7c0cd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:11.706583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56080b2-53aa-4d7d-8227-f85cbde7c0cd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:11.708514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b56080b2-53aa-4d7d-8227-f85cbde7c0cd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:11.943646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b56080b2-53aa-4d7d-8227-f85cbde7c0cd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:11.955448 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b56080b2-53aa-4d7d-8227-f85cbde7c0cd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1389 microversion: 2.1 time: 0.285204 Aug 09 17:58:11.956351 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3226/6181] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:11 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1389 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:12.974216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:12.975061 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:12.980641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-569b3a2b-4805-4fc6-8bc7-709c1e89d013 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:12.981681 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-569b3a2b-4805-4fc6-8bc7-709c1e89d013 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:12.989809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-569b3a2b-4805-4fc6-8bc7-709c1e89d013 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:12.990310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-569b3a2b-4805-4fc6-8bc7-709c1e89d013 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:12.990752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-569b3a2b-4805-4fc6-8bc7-709c1e89d013 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:12.991479 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-569b3a2b-4805-4fc6-8bc7-709c1e89d013 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:12.991979 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-569b3a2b-4805-4fc6-8bc7-709c1e89d013 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:12.992415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-569b3a2b-4805-4fc6-8bc7-709c1e89d013 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:13.200322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-569b3a2b-4805-4fc6-8bc7-709c1e89d013 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:13.211138 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-569b3a2b-4805-4fc6-8bc7-709c1e89d013 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1389 microversion: 2.1 time: 0.237729 Aug 09 17:58:13.212724 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2956/6182] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:12 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1389 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:14.254507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a080620-8f86-4be8-aea0-73443ff2c0d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:14.255557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9a080620-8f86-4be8-aea0-73443ff2c0d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:14.260009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:14.268643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a080620-8f86-4be8-aea0-73443ff2c0d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:14.273242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a080620-8f86-4be8-aea0-73443ff2c0d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:14.274202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a080620-8f86-4be8-aea0-73443ff2c0d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:14.277149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a080620-8f86-4be8-aea0-73443ff2c0d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:14.277149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a080620-8f86-4be8-aea0-73443ff2c0d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:14.277149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a080620-8f86-4be8-aea0-73443ff2c0d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:14.478928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9a080620-8f86-4be8-aea0-73443ff2c0d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:14.490179 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9a080620-8f86-4be8-aea0-73443ff2c0d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1561 microversion: 2.1 time: 0.247208 Aug 09 17:58:14.491319 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3227/6183] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:14 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1561 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:14.514374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e551776e-1eb5-41b7-b170-ae148d79855e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:14.515031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e551776e-1eb5-41b7-b170-ae148d79855e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:14.524306 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e551776e-1eb5-41b7-b170-ae148d79855e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:14.525158 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e551776e-1eb5-41b7-b170-ae148d79855e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:14.526150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e551776e-1eb5-41b7-b170-ae148d79855e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:14.527181 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e551776e-1eb5-41b7-b170-ae148d79855e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:14.527915 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e551776e-1eb5-41b7-b170-ae148d79855e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:14.528513 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e551776e-1eb5-41b7-b170-ae148d79855e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:14.744505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e551776e-1eb5-41b7-b170-ae148d79855e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:14.753542 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e551776e-1eb5-41b7-b170-ae148d79855e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1561 microversion: 2.1 time: 0.243746 Aug 09 17:58:14.756552 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2957/6184] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:14 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1561 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:17.168252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06af9e65-51a2-46db-9676-7069bcd7d5c2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:17.168866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-06af9e65-51a2-46db-9676-7069bcd7d5c2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:17.177659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:17.179221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06af9e65-51a2-46db-9676-7069bcd7d5c2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:17.179748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06af9e65-51a2-46db-9676-7069bcd7d5c2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:17.180405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06af9e65-51a2-46db-9676-7069bcd7d5c2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:17.181333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06af9e65-51a2-46db-9676-7069bcd7d5c2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:17.182564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06af9e65-51a2-46db-9676-7069bcd7d5c2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:17.183222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06af9e65-51a2-46db-9676-7069bcd7d5c2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:17.188175 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-592c79c7-4e80-4e41-92a1-c6bda1aa1159 req-ba5fa616-56b5-4d4a-8a51-1b23946f09ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380cdb00-065d-4575-8ef8-5b7785df5fa8", "tag": "b6759686-f390-435c-8776-87bfc88a176f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:17.208987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:17.236114 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-592c79c7-4e80-4e41-92a1-c6bda1aa1159 req-ba5fa616-56b5-4d4a-8a51-1b23946f09ef service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:17.237500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-592c79c7-4e80-4e41-92a1-c6bda1aa1159 req-ba5fa616-56b5-4d4a-8a51-1b23946f09ef service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:17.241673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-592c79c7-4e80-4e41-92a1-c6bda1aa1159 req-ba5fa616-56b5-4d4a-8a51-1b23946f09ef service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:17.274054 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-592c79c7-4e80-4e41-92a1-c6bda1aa1159 req-ba5fa616-56b5-4d4a-8a51-1b23946f09ef service nova] Creating event network-changed:b6759686-f390-435c-8776-87bfc88a176f for instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 on n-h1-845781-6 Aug 09 17:58:17.282920 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-592c79c7-4e80-4e41-92a1-c6bda1aa1159 req-ba5fa616-56b5-4d4a-8a51-1b23946f09ef service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105320 Aug 09 17:58:17.283617 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2958/6185] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:17.473268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-06af9e65-51a2-46db-9676-7069bcd7d5c2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:17.505228 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-06af9e65-51a2-46db-9676-7069bcd7d5c2 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1561 microversion: 2.1 time: 0.340580 Aug 09 17:58:17.512786 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3228/6186] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:17 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1561 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:31.724819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=24 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:31.725587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:31.730735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1725308836", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f5928a49-9020-4e1e-9a15-e2c1120fd004", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:31.802105 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] validate_networks() for [('0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:58:32.400770 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:58:32.401528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:58:32.402406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:58:32.403338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:58:32.404118 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:58:32.421707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:32.423024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:32.423853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:32.425271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:32.426395 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:32.427243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:32.460769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:58:32.470817 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for user 87590ee7f71345a8914b350c5999d974 and project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:58:32.566441 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:58:32.570106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5928a49-9020-4e1e-9a15-e2c1120fd004',volume_size=None,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:58:32.746146 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-addb9484-b8b2-4753-b83e-8a3139d7998f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023081 Aug 09 17:58:32.747067 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2959/6187] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:58:32.764945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44d93f9a-bdf9-4231-a3b8-ec27c2379a85 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:32.767456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-44d93f9a-bdf9-4231-a3b8-ec27c2379a85 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:32.790493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:32.791857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=36 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:32.860542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-44d93f9a-bdf9-4231-a3b8-ec27c2379a85 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:32.869128 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-44d93f9a-bdf9-4231-a3b8-ec27c2379a85 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1071 microversion: 2.1 time: 0.114149 Aug 09 17:58:32.870161 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3229/6188] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:32 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1071 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:33.902720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b446f528-d4de-45ef-b5ff-3008a9d1254d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:33.904758 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b446f528-d4de-45ef-b5ff-3008a9d1254d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:33.918210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b446f528-d4de-45ef-b5ff-3008a9d1254d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:33.919081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b446f528-d4de-45ef-b5ff-3008a9d1254d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:33.919829 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b446f528-d4de-45ef-b5ff-3008a9d1254d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:33.921031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b446f528-d4de-45ef-b5ff-3008a9d1254d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:33.921718 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b446f528-d4de-45ef-b5ff-3008a9d1254d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:33.922355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b446f528-d4de-45ef-b5ff-3008a9d1254d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:34.285465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b446f528-d4de-45ef-b5ff-3008a9d1254d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:34.306090 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b446f528-d4de-45ef-b5ff-3008a9d1254d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1177 microversion: 2.1 time: 0.416583 Aug 09 17:58:34.308097 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2960/6189] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:33 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1177 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:35.338633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e02f4df1-b3a5-4505-b528-0f5f7c16da0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:35.339883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e02f4df1-b3a5-4505-b528-0f5f7c16da0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:35.353387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e02f4df1-b3a5-4505-b528-0f5f7c16da0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:35.354787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e02f4df1-b3a5-4505-b528-0f5f7c16da0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:35.355946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e02f4df1-b3a5-4505-b528-0f5f7c16da0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:35.357215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e02f4df1-b3a5-4505-b528-0f5f7c16da0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:35.358051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e02f4df1-b3a5-4505-b528-0f5f7c16da0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:35.358731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e02f4df1-b3a5-4505-b528-0f5f7c16da0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:35.537035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e02f4df1-b3a5-4505-b528-0f5f7c16da0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:35.547586 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e02f4df1-b3a5-4505-b528-0f5f7c16da0a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1229 microversion: 2.1 time: 0.217045 Aug 09 17:58:35.548215 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3230/6190] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:35 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1229 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:35.772581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-d2189ad3-7c2b-4f5d-bdc2-485e7be1bf58 req-fd7d5861-daef-49aa-8d16-c083d280de50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb862d8-4474-4cf8-8f14-b262d2f0ab2c", "tag": "7e95bc7f-6a11-4099-9fa1-0a3f2bf13541"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:35.783397 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d2189ad3-7c2b-4f5d-bdc2-485e7be1bf58 req-fd7d5861-daef-49aa-8d16-c083d280de50 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:35.783934 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d2189ad3-7c2b-4f5d-bdc2-485e7be1bf58 req-fd7d5861-daef-49aa-8d16-c083d280de50 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:35.790525 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-d2189ad3-7c2b-4f5d-bdc2-485e7be1bf58 req-fd7d5861-daef-49aa-8d16-c083d280de50 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:35.806818 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-d2189ad3-7c2b-4f5d-bdc2-485e7be1bf58 req-fd7d5861-daef-49aa-8d16-c083d280de50 service nova] Creating event network-changed:7e95bc7f-6a11-4099-9fa1-0a3f2bf13541 for instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c on n-h2-845781-6 Aug 09 17:58:35.816139 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-d2189ad3-7c2b-4f5d-bdc2-485e7be1bf58 req-fd7d5861-daef-49aa-8d16-c083d280de50 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054672 Aug 09 17:58:35.817206 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2961/6191] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:36.010808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-909539300", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:36.321882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:58:36.573451 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-17dd617c-5c6d-42d8-abb7-71e516ae331f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:36.574653 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-17dd617c-5c6d-42d8-abb7-71e516ae331f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:36.583882 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17dd617c-5c6d-42d8-abb7-71e516ae331f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:36.585139 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17dd617c-5c6d-42d8-abb7-71e516ae331f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:36.585952 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17dd617c-5c6d-42d8-abb7-71e516ae331f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:36.587559 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17dd617c-5c6d-42d8-abb7-71e516ae331f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:36.588902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17dd617c-5c6d-42d8-abb7-71e516ae331f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:36.589540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-17dd617c-5c6d-42d8-abb7-71e516ae331f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:36.654983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:58:36.656668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:58:36.657545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:58:36.658321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:58:36.659042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:58:36.674831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:36.675415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:36.675903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:36.676645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:36.677119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:36.677554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:36.696951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Getting quotas for project 5404742174af495589dce537ae97080b. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:58:36.704355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Getting quotas for user 5173254713a54d4f8b5e3731c420f2a1 and project 5404742174af495589dce537ae97080b. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:58:36.720572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:58:36.722920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:58:36.771211 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-01cb17dc-fac5-453b-a066-7524ef700079 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765091 Aug 09 17:58:36.772969 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3231/6192] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:58:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 17:58:36.784273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5eb73369-57c2-4f6e-bfe0-1ed7f10fd207 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:36.785861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5eb73369-57c2-4f6e-bfe0-1ed7f10fd207 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:36.876024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5eb73369-57c2-4f6e-bfe0-1ed7f10fd207 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:36.884670 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5eb73369-57c2-4f6e-bfe0-1ed7f10fd207 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1213 microversion: 2.1 time: 0.104240 Aug 09 17:58:36.886234 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3232/6193] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:36 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:36.921033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-17dd617c-5c6d-42d8-abb7-71e516ae331f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:36.954072 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-17dd617c-5c6d-42d8-abb7-71e516ae331f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1229 microversion: 2.1 time: 0.386723 Aug 09 17:58:36.954947 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2962/6194] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:36 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1229 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:37.906479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-52e30a72-5139-4409-96a6-d84903853082 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:37.907208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-52e30a72-5139-4409-96a6-d84903853082 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:37.914265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52e30a72-5139-4409-96a6-d84903853082 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:37.914757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52e30a72-5139-4409-96a6-d84903853082 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:37.915226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52e30a72-5139-4409-96a6-d84903853082 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:37.915974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52e30a72-5139-4409-96a6-d84903853082 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:37.916428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52e30a72-5139-4409-96a6-d84903853082 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:37.916858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-52e30a72-5139-4409-96a6-d84903853082 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:37.977809 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-45929acf-b176-4b39-a708-2b489078a555 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:37.978586 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-45929acf-b176-4b39-a708-2b489078a555 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:37.992090 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45929acf-b176-4b39-a708-2b489078a555 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:37.993311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45929acf-b176-4b39-a708-2b489078a555 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:37.993311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45929acf-b176-4b39-a708-2b489078a555 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:37.994168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45929acf-b176-4b39-a708-2b489078a555 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:37.994668 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45929acf-b176-4b39-a708-2b489078a555 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:37.995355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45929acf-b176-4b39-a708-2b489078a555 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:38.165165 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45929acf-b176-4b39-a708-2b489078a555 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:38.175911 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-45929acf-b176-4b39-a708-2b489078a555 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1229 microversion: 2.1 time: 0.201759 Aug 09 17:58:38.177807 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2963/6195] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:37 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1229 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:38.185396 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-606d2747-9301-4fb4-ae26-ddad1dd72d4a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:38.189511 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-606d2747-9301-4fb4-ae26-ddad1dd72d4a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:38.201325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-606d2747-9301-4fb4-ae26-ddad1dd72d4a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:38.202366 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-606d2747-9301-4fb4-ae26-ddad1dd72d4a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:38.202990 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-606d2747-9301-4fb4-ae26-ddad1dd72d4a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:38.203992 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-606d2747-9301-4fb4-ae26-ddad1dd72d4a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:38.204644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-606d2747-9301-4fb4-ae26-ddad1dd72d4a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:38.205250 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-606d2747-9301-4fb4-ae26-ddad1dd72d4a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:38.271147 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-606d2747-9301-4fb4-ae26-ddad1dd72d4a tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8/action" status: 200 len: 24568 microversion: 2.1 time: 0.091334 Aug 09 17:58:38.271719 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2964/6196] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:58:38 2022] POST /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8/action => generated 24568 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:58:38.370033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-52e30a72-5139-4409-96a6-d84903853082 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:38.382076 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-52e30a72-5139-4409-96a6-d84903853082 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1265 microversion: 2.1 time: 0.479486 Aug 09 17:58:38.383022 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3233/6197] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:37 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1265 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:39.199120 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fbf75b9c-4aa1-4856-a3fc-d4ee9eecb196 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:39.200031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fbf75b9c-4aa1-4856-a3fc-d4ee9eecb196 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:39.207954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbf75b9c-4aa1-4856-a3fc-d4ee9eecb196 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:39.208454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbf75b9c-4aa1-4856-a3fc-d4ee9eecb196 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:39.208901 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbf75b9c-4aa1-4856-a3fc-d4ee9eecb196 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:39.209637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbf75b9c-4aa1-4856-a3fc-d4ee9eecb196 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:39.210104 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbf75b9c-4aa1-4856-a3fc-d4ee9eecb196 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:39.210538 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fbf75b9c-4aa1-4856-a3fc-d4ee9eecb196 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:39.411107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d9a2f08d-1f80-4169-a8f0-8e493e3be633 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:39.413638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d9a2f08d-1f80-4169-a8f0-8e493e3be633 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:39.433023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fbf75b9c-4aa1-4856-a3fc-d4ee9eecb196 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:39.439961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9a2f08d-1f80-4169-a8f0-8e493e3be633 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:39.441243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9a2f08d-1f80-4169-a8f0-8e493e3be633 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:39.445086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9a2f08d-1f80-4169-a8f0-8e493e3be633 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:39.447194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9a2f08d-1f80-4169-a8f0-8e493e3be633 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:39.453787 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fbf75b9c-4aa1-4856-a3fc-d4ee9eecb196 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1229 microversion: 2.1 time: 0.259182 Aug 09 17:58:39.455356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9a2f08d-1f80-4169-a8f0-8e493e3be633 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:39.456424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9a2f08d-1f80-4169-a8f0-8e493e3be633 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:39.462662 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2965/6198] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:39 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1229 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:39.774063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d9a2f08d-1f80-4169-a8f0-8e493e3be633 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:39.796103 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d9a2f08d-1f80-4169-a8f0-8e493e3be633 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1313 microversion: 2.1 time: 0.392736 Aug 09 17:58:39.804203 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3234/6199] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:39 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:40.224216 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-724010ff-9b19-4fb5-aff5-e9ef359f286c req-6ca1d6e1-dbcb-4e24-b579-a9f564143779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "075f55a1-49ee-447f-9a6f-08bc280d905a", "tag": "94eff5a8-0f93-4e54-a0a0-25167d443a83"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:40.242890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-724010ff-9b19-4fb5-aff5-e9ef359f286c req-6ca1d6e1-dbcb-4e24-b579-a9f564143779 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:40.243955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-724010ff-9b19-4fb5-aff5-e9ef359f286c req-6ca1d6e1-dbcb-4e24-b579-a9f564143779 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:40.244593 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-724010ff-9b19-4fb5-aff5-e9ef359f286c req-6ca1d6e1-dbcb-4e24-b579-a9f564143779 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:40.261143 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-724010ff-9b19-4fb5-aff5-e9ef359f286c req-6ca1d6e1-dbcb-4e24-b579-a9f564143779 service nova] Creating event network-changed:94eff5a8-0f93-4e54-a0a0-25167d443a83 for instance 075f55a1-49ee-447f-9a6f-08bc280d905a on n-h1-845781-6 Aug 09 17:58:40.269992 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-724010ff-9b19-4fb5-aff5-e9ef359f286c req-6ca1d6e1-dbcb-4e24-b579-a9f564143779 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051473 Aug 09 17:58:40.271100 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2966/6200] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:40.494646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-985e5083-7540-4577-94b3-eb9856b78527 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:40.495406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-985e5083-7540-4577-94b3-eb9856b78527 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:40.502834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-985e5083-7540-4577-94b3-eb9856b78527 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:40.503334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-985e5083-7540-4577-94b3-eb9856b78527 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:40.503871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-985e5083-7540-4577-94b3-eb9856b78527 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:40.504583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-985e5083-7540-4577-94b3-eb9856b78527 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:40.505046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-985e5083-7540-4577-94b3-eb9856b78527 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:40.505479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-985e5083-7540-4577-94b3-eb9856b78527 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:40.720969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-985e5083-7540-4577-94b3-eb9856b78527 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:40.730068 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-985e5083-7540-4577-94b3-eb9856b78527 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1217 microversion: 2.1 time: 0.239192 Aug 09 17:58:40.730668 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3235/6201] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:40 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1217 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:40.831825 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6109e55d-5414-442e-bf70-fc6de7169e79 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:40.832561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6109e55d-5414-442e-bf70-fc6de7169e79 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:40.840372 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6109e55d-5414-442e-bf70-fc6de7169e79 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:40.840862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6109e55d-5414-442e-bf70-fc6de7169e79 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:40.841374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6109e55d-5414-442e-bf70-fc6de7169e79 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:40.842081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6109e55d-5414-442e-bf70-fc6de7169e79 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:40.842536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6109e55d-5414-442e-bf70-fc6de7169e79 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:40.842959 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6109e55d-5414-442e-bf70-fc6de7169e79 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:40.988791 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6109e55d-5414-442e-bf70-fc6de7169e79 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:40.998066 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6109e55d-5414-442e-bf70-fc6de7169e79 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1313 microversion: 2.1 time: 0.171015 Aug 09 17:58:40.998644 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2967/6202] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:40 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:41.756613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5dd2c6db-027f-48d2-8c59-a1d62081a137 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:41.757396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5dd2c6db-027f-48d2-8c59-a1d62081a137 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:41.765797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dd2c6db-027f-48d2-8c59-a1d62081a137 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:41.766568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dd2c6db-027f-48d2-8c59-a1d62081a137 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:41.767077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dd2c6db-027f-48d2-8c59-a1d62081a137 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:41.767909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dd2c6db-027f-48d2-8c59-a1d62081a137 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:41.768482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dd2c6db-027f-48d2-8c59-a1d62081a137 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:41.768978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dd2c6db-027f-48d2-8c59-a1d62081a137 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:42.009365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5dd2c6db-027f-48d2-8c59-a1d62081a137 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:42.017583 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5dd2c6db-027f-48d2-8c59-a1d62081a137 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1217 microversion: 2.1 time: 0.265395 Aug 09 17:58:42.018369 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3236/6203] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:41 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1217 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:42.021374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4800f2d2-cb1c-41a1-90e6-0e24e79b9389 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:42.022031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4800f2d2-cb1c-41a1-90e6-0e24e79b9389 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:42.029340 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4800f2d2-cb1c-41a1-90e6-0e24e79b9389 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:42.029835 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4800f2d2-cb1c-41a1-90e6-0e24e79b9389 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:42.030280 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4800f2d2-cb1c-41a1-90e6-0e24e79b9389 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:42.030994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4800f2d2-cb1c-41a1-90e6-0e24e79b9389 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:42.031462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4800f2d2-cb1c-41a1-90e6-0e24e79b9389 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:42.031918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4800f2d2-cb1c-41a1-90e6-0e24e79b9389 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:42.184063 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4800f2d2-cb1c-41a1-90e6-0e24e79b9389 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:42.192139 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4800f2d2-cb1c-41a1-90e6-0e24e79b9389 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1313 microversion: 2.1 time: 0.175675 Aug 09 17:58:42.192739 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2968/6204] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:42 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:43.042823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2f842c5c-11a4-4eed-b52d-97552906696d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:43.043457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2f842c5c-11a4-4eed-b52d-97552906696d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:43.050965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f842c5c-11a4-4eed-b52d-97552906696d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:43.051464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f842c5c-11a4-4eed-b52d-97552906696d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:43.051939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f842c5c-11a4-4eed-b52d-97552906696d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:43.052653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f842c5c-11a4-4eed-b52d-97552906696d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:43.053112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f842c5c-11a4-4eed-b52d-97552906696d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:43.053546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f842c5c-11a4-4eed-b52d-97552906696d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:43.214153 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0f6a5856-aed6-47b6-afae-a624c5d1c81d tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:43.215115 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0f6a5856-aed6-47b6-afae-a624c5d1c81d tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:43.216933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:43.217604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:43.224023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2f842c5c-11a4-4eed-b52d-97552906696d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:43.225267 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f6a5856-aed6-47b6-afae-a624c5d1c81d tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:43.225766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f6a5856-aed6-47b6-afae-a624c5d1c81d tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:43.226207 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f6a5856-aed6-47b6-afae-a624c5d1c81d tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:43.227418 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f6a5856-aed6-47b6-afae-a624c5d1c81d tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:43.227900 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f6a5856-aed6-47b6-afae-a624c5d1c81d tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:43.228352 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0f6a5856-aed6-47b6-afae-a624c5d1c81d tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:43.233659 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2f842c5c-11a4-4eed-b52d-97552906696d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1217 microversion: 2.1 time: 0.197949 Aug 09 17:58:43.234269 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3237/6205] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:43 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:43.384619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0f6a5856-aed6-47b6-afae-a624c5d1c81d tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:43.393055 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0f6a5856-aed6-47b6-afae-a624c5d1c81d tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1313 microversion: 2.1 time: 0.183228 Aug 09 17:58:43.393665 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2969/6206] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:43 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:44.256504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5e8b000c-e782-4163-b95e-4bdd8d1aa127 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:44.257131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5e8b000c-e782-4163-b95e-4bdd8d1aa127 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:44.264871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e8b000c-e782-4163-b95e-4bdd8d1aa127 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:44.265363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e8b000c-e782-4163-b95e-4bdd8d1aa127 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:44.265805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e8b000c-e782-4163-b95e-4bdd8d1aa127 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:44.266513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e8b000c-e782-4163-b95e-4bdd8d1aa127 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:44.266970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e8b000c-e782-4163-b95e-4bdd8d1aa127 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:44.267395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e8b000c-e782-4163-b95e-4bdd8d1aa127 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:44.418039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-184a4cfa-ea74-4cc8-b886-691a50410fb3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:44.419127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-184a4cfa-ea74-4cc8-b886-691a50410fb3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:44.419598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5e8b000c-e782-4163-b95e-4bdd8d1aa127 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:44.430012 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5e8b000c-e782-4163-b95e-4bdd8d1aa127 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1217 microversion: 2.1 time: 0.176600 Aug 09 17:58:44.430297 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184a4cfa-ea74-4cc8-b886-691a50410fb3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:44.430568 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3238/6207] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:44 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:44.430861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184a4cfa-ea74-4cc8-b886-691a50410fb3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:44.431663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184a4cfa-ea74-4cc8-b886-691a50410fb3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:44.433148 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184a4cfa-ea74-4cc8-b886-691a50410fb3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:44.434002 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184a4cfa-ea74-4cc8-b886-691a50410fb3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:44.434771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-184a4cfa-ea74-4cc8-b886-691a50410fb3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:44.593252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-184a4cfa-ea74-4cc8-b886-691a50410fb3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:44.604124 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-184a4cfa-ea74-4cc8-b886-691a50410fb3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1313 microversion: 2.1 time: 0.193325 Aug 09 17:58:44.604934 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2970/6208] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:44 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:45.464538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e929ad2e-7b08-4a03-b974-611789b1cc19 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:45.465193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e929ad2e-7b08-4a03-b974-611789b1cc19 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:45.472010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e929ad2e-7b08-4a03-b974-611789b1cc19 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:45.472511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e929ad2e-7b08-4a03-b974-611789b1cc19 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:45.472964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e929ad2e-7b08-4a03-b974-611789b1cc19 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:45.473676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e929ad2e-7b08-4a03-b974-611789b1cc19 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:45.474130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e929ad2e-7b08-4a03-b974-611789b1cc19 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:45.474562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e929ad2e-7b08-4a03-b974-611789b1cc19 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:45.636712 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5a4509ee-82a0-49fd-9ec6-1e3308467cb5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:45.638832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5a4509ee-82a0-49fd-9ec6-1e3308467cb5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:45.646730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e929ad2e-7b08-4a03-b974-611789b1cc19 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:45.652273 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a4509ee-82a0-49fd-9ec6-1e3308467cb5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:45.653286 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a4509ee-82a0-49fd-9ec6-1e3308467cb5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:45.654319 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a4509ee-82a0-49fd-9ec6-1e3308467cb5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:45.655343 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a4509ee-82a0-49fd-9ec6-1e3308467cb5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:45.656193 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a4509ee-82a0-49fd-9ec6-1e3308467cb5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:45.656387 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e929ad2e-7b08-4a03-b974-611789b1cc19 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1217 microversion: 2.1 time: 0.196336 Aug 09 17:58:45.656875 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5a4509ee-82a0-49fd-9ec6-1e3308467cb5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:45.657190 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3239/6209] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:45 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1217 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:45.815279 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5a4509ee-82a0-49fd-9ec6-1e3308467cb5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:45.823906 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5a4509ee-82a0-49fd-9ec6-1e3308467cb5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1313 microversion: 2.1 time: 0.195061 Aug 09 17:58:45.824509 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2971/6210] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:45 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:46.687772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a8b85556-e931-495d-a116-4ab10c669c23 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:46.688397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a8b85556-e931-495d-a116-4ab10c669c23 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:46.691131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:46.697477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8b85556-e931-495d-a116-4ab10c669c23 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:46.697971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8b85556-e931-495d-a116-4ab10c669c23 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:46.698443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8b85556-e931-495d-a116-4ab10c669c23 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:46.699160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8b85556-e931-495d-a116-4ab10c669c23 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:46.699618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8b85556-e931-495d-a116-4ab10c669c23 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:46.700068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8b85556-e931-495d-a116-4ab10c669c23 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:46.848556 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2463e964-fc56-45d6-b2ff-af1440636e15 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:46.849194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2463e964-fc56-45d6-b2ff-af1440636e15 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:46.857152 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2463e964-fc56-45d6-b2ff-af1440636e15 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:46.857656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2463e964-fc56-45d6-b2ff-af1440636e15 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:46.858100 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2463e964-fc56-45d6-b2ff-af1440636e15 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:46.858810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2463e964-fc56-45d6-b2ff-af1440636e15 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:46.859310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2463e964-fc56-45d6-b2ff-af1440636e15 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:46.859766 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2463e964-fc56-45d6-b2ff-af1440636e15 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:46.868236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a8b85556-e931-495d-a116-4ab10c669c23 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:46.876034 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a8b85556-e931-495d-a116-4ab10c669c23 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1217 microversion: 2.1 time: 0.192045 Aug 09 17:58:46.876670 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3240/6211] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:46 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1217 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:47.034094 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2463e964-fc56-45d6-b2ff-af1440636e15 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:47.038508 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2463e964-fc56-45d6-b2ff-af1440636e15 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1313 microversion: 2.1 time: 0.196234 Aug 09 17:58:47.039677 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2972/6212] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:46 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:47.557899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3a01693f-f00e-4917-955d-12c4692d677f req-9e5eec84-c74d-4747-8b35-483d07ef831e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "075f55a1-49ee-447f-9a6f-08bc280d905a", "name": "network-vif-plugged", "status": "completed", "tag": "94eff5a8-0f93-4e54-a0a0-25167d443a83"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:47.563706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:47.571148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3a01693f-f00e-4917-955d-12c4692d677f req-9e5eec84-c74d-4747-8b35-483d07ef831e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:47.571832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3a01693f-f00e-4917-955d-12c4692d677f req-9e5eec84-c74d-4747-8b35-483d07ef831e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:47.572312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3a01693f-f00e-4917-955d-12c4692d677f req-9e5eec84-c74d-4747-8b35-483d07ef831e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:47.586289 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3a01693f-f00e-4917-955d-12c4692d677f req-9e5eec84-c74d-4747-8b35-483d07ef831e service nova] Creating event network-vif-plugged:94eff5a8-0f93-4e54-a0a0-25167d443a83 for instance 075f55a1-49ee-447f-9a6f-08bc280d905a on n-h1-845781-6 Aug 09 17:58:47.591766 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3a01693f-f00e-4917-955d-12c4692d677f req-9e5eec84-c74d-4747-8b35-483d07ef831e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038258 Aug 09 17:58:47.592404 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3241/6213] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:47.897048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e3fc4398-ec8b-4919-93b7-691489c795df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:47.897754 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e3fc4398-ec8b-4919-93b7-691489c795df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:47.905492 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3fc4398-ec8b-4919-93b7-691489c795df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:47.905984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3fc4398-ec8b-4919-93b7-691489c795df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:47.906424 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3fc4398-ec8b-4919-93b7-691489c795df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:47.907126 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3fc4398-ec8b-4919-93b7-691489c795df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:47.907573 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3fc4398-ec8b-4919-93b7-691489c795df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:47.908035 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e3fc4398-ec8b-4919-93b7-691489c795df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:48.055580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e3fc4398-ec8b-4919-93b7-691489c795df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:48.062006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6106113-ba7d-48fd-b4b5-f6f3cdf172c5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:48.062728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f6106113-ba7d-48fd-b4b5-f6f3cdf172c5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:48.063719 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e3fc4398-ec8b-4919-93b7-691489c795df tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1217 microversion: 2.1 time: 0.170662 Aug 09 17:58:48.064756 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2973/6214] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:47 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:48.069665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6106113-ba7d-48fd-b4b5-f6f3cdf172c5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:48.070237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6106113-ba7d-48fd-b4b5-f6f3cdf172c5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:48.070905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6106113-ba7d-48fd-b4b5-f6f3cdf172c5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:48.071618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6106113-ba7d-48fd-b4b5-f6f3cdf172c5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:48.072288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6106113-ba7d-48fd-b4b5-f6f3cdf172c5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:48.072921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6106113-ba7d-48fd-b4b5-f6f3cdf172c5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:48.228859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f6106113-ba7d-48fd-b4b5-f6f3cdf172c5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:48.236772 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f6106113-ba7d-48fd-b4b5-f6f3cdf172c5 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1313 microversion: 2.1 time: 0.179957 Aug 09 17:58:48.237370 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3242/6215] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:48 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:49.088350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4fbd8a44-1294-458a-8194-a96304b7e0d7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:49.088961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4fbd8a44-1294-458a-8194-a96304b7e0d7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:49.095294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fbd8a44-1294-458a-8194-a96304b7e0d7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.095813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fbd8a44-1294-458a-8194-a96304b7e0d7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.096261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fbd8a44-1294-458a-8194-a96304b7e0d7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.096973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fbd8a44-1294-458a-8194-a96304b7e0d7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.097469 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fbd8a44-1294-458a-8194-a96304b7e0d7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.097904 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4fbd8a44-1294-458a-8194-a96304b7e0d7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.120471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:49.124237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:49.131563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.132159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.133101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.133808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.134446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.134876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.225511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:58:49.226593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:58:49.226925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:58:49.227336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:58:49.227780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:58:49.309036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:49.316220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.316860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.317211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.318007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.318561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.319029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.350238 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-83d65b16-be68-47f8-9b9f-ae381c0926d5 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8/action" status: 202 len: 1136 microversion: 2.1 time: 0.234575 Aug 09 17:58:49.351676 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3243/6216] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:58:49 2022] POST /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8/action => generated 1136 bytes in 236 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 09 17:58:49.356700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8fec0b4f-e5e0-4728-b4b4-13e48582c4b3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:49.357331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8fec0b4f-e5e0-4728-b4b4-13e48582c4b3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:49.364421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fec0b4f-e5e0-4728-b4b4-13e48582c4b3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.365220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fec0b4f-e5e0-4728-b4b4-13e48582c4b3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.365980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fec0b4f-e5e0-4728-b4b4-13e48582c4b3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.367338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fec0b4f-e5e0-4728-b4b4-13e48582c4b3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.367846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fec0b4f-e5e0-4728-b4b4-13e48582c4b3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.368290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fec0b4f-e5e0-4728-b4b4-13e48582c4b3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.511489 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4fbd8a44-1294-458a-8194-a96304b7e0d7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:49.520989 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4fbd8a44-1294-458a-8194-a96304b7e0d7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1217 microversion: 2.1 time: 0.439197 Aug 09 17:58:49.521803 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2974/6217] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:49 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1217 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:49.530020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-447ab34e-afc3-4db9-a8f5-7e0b2ce73b83 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:49.530020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-447ab34e-afc3-4db9-a8f5-7e0b2ce73b83 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:49.534470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-447ab34e-afc3-4db9-a8f5-7e0b2ce73b83 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.535065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-447ab34e-afc3-4db9-a8f5-7e0b2ce73b83 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.535517 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-447ab34e-afc3-4db9-a8f5-7e0b2ce73b83 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.536277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-447ab34e-afc3-4db9-a8f5-7e0b2ce73b83 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.536744 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-447ab34e-afc3-4db9-a8f5-7e0b2ce73b83 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.537240 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-447ab34e-afc3-4db9-a8f5-7e0b2ce73b83 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.540159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8fec0b4f-e5e0-4728-b4b4-13e48582c4b3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:49.549419 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8fec0b4f-e5e0-4728-b4b4-13e48582c4b3 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1463 microversion: 2.1 time: 0.196616 Aug 09 17:58:49.550193 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3244/6218] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:49 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1463 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:49.576027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f28e1270-f511-4e0e-83ab-e33537cfdd01 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2aea68b7-598e-470f-a88f-2196b6c3ca3f", "device": "/dev/sdb"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:49.578491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f28e1270-f511-4e0e-83ab-e33537cfdd01 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:49.585133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f28e1270-f511-4e0e-83ab-e33537cfdd01 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.586178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f28e1270-f511-4e0e-83ab-e33537cfdd01 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.586627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f28e1270-f511-4e0e-83ab-e33537cfdd01 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.587895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f28e1270-f511-4e0e-83ab-e33537cfdd01 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:49.588365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f28e1270-f511-4e0e-83ab-e33537cfdd01 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:49.588802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f28e1270-f511-4e0e-83ab-e33537cfdd01 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:49.701972 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-447ab34e-afc3-4db9-a8f5-7e0b2ce73b83 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:49.713820 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-447ab34e-afc3-4db9-a8f5-7e0b2ce73b83 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.189971 Aug 09 17:58:49.714473 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2975/6219] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:49 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:49.861348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:49.894532 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f28e1270-f511-4e0e-83ab-e33537cfdd01 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "POST /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322055 Aug 09 17:58:49.895821 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3245/6220] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 17:58:49 2022] POST /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:58:50.284862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-ca7bed88-74b1-4f50-a8cd-11074b55d9a8 req-0ec5a5cd-0790-4b1b-9939-7f1cedacd1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb862d8-4474-4cf8-8f14-b262d2f0ab2c", "name": "network-vif-plugged", "status": "completed", "tag": "7e95bc7f-6a11-4099-9fa1-0a3f2bf13541"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:50.297227 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ca7bed88-74b1-4f50-a8cd-11074b55d9a8 req-0ec5a5cd-0790-4b1b-9939-7f1cedacd1c2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:50.297823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ca7bed88-74b1-4f50-a8cd-11074b55d9a8 req-0ec5a5cd-0790-4b1b-9939-7f1cedacd1c2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:50.298480 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-ca7bed88-74b1-4f50-a8cd-11074b55d9a8 req-0ec5a5cd-0790-4b1b-9939-7f1cedacd1c2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:50.317204 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-ca7bed88-74b1-4f50-a8cd-11074b55d9a8 req-0ec5a5cd-0790-4b1b-9939-7f1cedacd1c2 service nova] Creating event network-vif-plugged:7e95bc7f-6a11-4099-9fa1-0a3f2bf13541 for instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c on n-h2-845781-6 Aug 09 17:58:50.324020 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-ca7bed88-74b1-4f50-a8cd-11074b55d9a8 req-0ec5a5cd-0790-4b1b-9939-7f1cedacd1c2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042771 Aug 09 17:58:50.328768 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2976/6221] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:58:50.546586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-213f0b1c-7cf7-4543-90a2-c73335ea9c17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:50.547459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-213f0b1c-7cf7-4543-90a2-c73335ea9c17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:50.555233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-213f0b1c-7cf7-4543-90a2-c73335ea9c17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:50.556331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-213f0b1c-7cf7-4543-90a2-c73335ea9c17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:50.556868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-213f0b1c-7cf7-4543-90a2-c73335ea9c17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:50.557792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-213f0b1c-7cf7-4543-90a2-c73335ea9c17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:50.558612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-213f0b1c-7cf7-4543-90a2-c73335ea9c17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:50.559148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-213f0b1c-7cf7-4543-90a2-c73335ea9c17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:50.744271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-bac6b70e-3f21-4ad0-a889-810b1b4918fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:50.745567 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-bac6b70e-3f21-4ad0-a889-810b1b4918fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:50.754566 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bac6b70e-3f21-4ad0-a889-810b1b4918fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:50.755266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bac6b70e-3f21-4ad0-a889-810b1b4918fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:50.756108 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bac6b70e-3f21-4ad0-a889-810b1b4918fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:50.757899 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bac6b70e-3f21-4ad0-a889-810b1b4918fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:50.758613 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bac6b70e-3f21-4ad0-a889-810b1b4918fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:50.759174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-bac6b70e-3f21-4ad0-a889-810b1b4918fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:50.788699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-213f0b1c-7cf7-4543-90a2-c73335ea9c17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:50.797900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-213f0b1c-7cf7-4543-90a2-c73335ea9c17 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1217 microversion: 2.1 time: 0.257815 Aug 09 17:58:50.798692 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3246/6222] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:50 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1217 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:50.930033 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-bac6b70e-3f21-4ad0-a889-810b1b4918fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:50.943664 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-bac6b70e-3f21-4ad0-a889-810b1b4918fd tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.206442 Aug 09 17:58:50.944369 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2977/6223] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:50 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:51.818905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ce470e0a-08cf-4009-adbd-a154a4b0d20e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:51.820561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ce470e0a-08cf-4009-adbd-a154a4b0d20e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:51.830253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce470e0a-08cf-4009-adbd-a154a4b0d20e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:51.830936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce470e0a-08cf-4009-adbd-a154a4b0d20e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:51.831488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce470e0a-08cf-4009-adbd-a154a4b0d20e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:51.832361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce470e0a-08cf-4009-adbd-a154a4b0d20e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:51.832942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce470e0a-08cf-4009-adbd-a154a4b0d20e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:51.833654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce470e0a-08cf-4009-adbd-a154a4b0d20e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:51.976994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-18a4739a-c092-45ea-9e51-af4661ba8740 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:51.979498 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-18a4739a-c092-45ea-9e51-af4661ba8740 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:51.988464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18a4739a-c092-45ea-9e51-af4661ba8740 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:51.989753 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18a4739a-c092-45ea-9e51-af4661ba8740 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:51.990529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18a4739a-c092-45ea-9e51-af4661ba8740 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:51.991795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18a4739a-c092-45ea-9e51-af4661ba8740 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:51.992648 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18a4739a-c092-45ea-9e51-af4661ba8740 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:51.993328 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-18a4739a-c092-45ea-9e51-af4661ba8740 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:52.025353 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=100 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:58:52.073267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ce470e0a-08cf-4009-adbd-a154a4b0d20e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:52.082828 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ce470e0a-08cf-4009-adbd-a154a4b0d20e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1217 microversion: 2.1 time: 0.267747 Aug 09 17:58:52.084136 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3247/6224] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:51 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1217 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:52.224501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-18a4739a-c092-45ea-9e51-af4661ba8740 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:52.233267 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-18a4739a-c092-45ea-9e51-af4661ba8740 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.264019 Aug 09 17:58:52.233867 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2978/6225] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:51 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:53.110663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7cce354d-a2d3-48dd-a0d1-c9ca9e3e1647 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:53.111275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7cce354d-a2d3-48dd-a0d1-c9ca9e3e1647 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:53.120476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cce354d-a2d3-48dd-a0d1-c9ca9e3e1647 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.121004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cce354d-a2d3-48dd-a0d1-c9ca9e3e1647 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.121444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cce354d-a2d3-48dd-a0d1-c9ca9e3e1647 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.122157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cce354d-a2d3-48dd-a0d1-c9ca9e3e1647 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.122617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cce354d-a2d3-48dd-a0d1-c9ca9e3e1647 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.123050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cce354d-a2d3-48dd-a0d1-c9ca9e3e1647 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.258590 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-1a5ca8b9-28cf-4bb8-b2ac-e8ea9e39b85d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:53.260060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-1a5ca8b9-28cf-4bb8-b2ac-e8ea9e39b85d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:53.268246 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8b9-28cf-4bb8-b2ac-e8ea9e39b85d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.269142 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8b9-28cf-4bb8-b2ac-e8ea9e39b85d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.269691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8b9-28cf-4bb8-b2ac-e8ea9e39b85d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.270521 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8b9-28cf-4bb8-b2ac-e8ea9e39b85d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.271068 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8b9-28cf-4bb8-b2ac-e8ea9e39b85d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.271890 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8b9-28cf-4bb8-b2ac-e8ea9e39b85d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.315694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7cce354d-a2d3-48dd-a0d1-c9ca9e3e1647 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:53.324936 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7cce354d-a2d3-48dd-a0d1-c9ca9e3e1647 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1404 microversion: 2.1 time: 0.218250 Aug 09 17:58:53.325658 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3248/6226] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:53 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1404 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:53.347455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a5abdbcc-1cd9-4a24-9072-2c256245f0fa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:53.348214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a5abdbcc-1cd9-4a24-9072-2c256245f0fa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:53.355109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5abdbcc-1cd9-4a24-9072-2c256245f0fa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.355613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5abdbcc-1cd9-4a24-9072-2c256245f0fa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.356372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5abdbcc-1cd9-4a24-9072-2c256245f0fa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.357313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5abdbcc-1cd9-4a24-9072-2c256245f0fa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.357987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5abdbcc-1cd9-4a24-9072-2c256245f0fa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.358420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5abdbcc-1cd9-4a24-9072-2c256245f0fa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.457135 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-1a5ca8b9-28cf-4bb8-b2ac-e8ea9e39b85d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:53.466794 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-1a5ca8b9-28cf-4bb8-b2ac-e8ea9e39b85d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.214354 Aug 09 17:58:53.467654 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2979/6227] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:53 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:53.534984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a5abdbcc-1cd9-4a24-9072-2c256245f0fa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:53.544656 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a5abdbcc-1cd9-4a24-9072-2c256245f0fa tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1404 microversion: 2.1 time: 0.201319 Aug 09 17:58:53.545245 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3249/6228] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:53 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:53.565826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1963810697"}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:53.568203 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:53.575378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.575964 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.576415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.577122 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:53.577577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:53.578009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:53.692368 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.compute.api [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Attempting to quiesce instance before volume snapshot. Aug 09 17:58:53.788977 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.compute.api [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 09 17:58:53.884682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Creating snapshot from volume f5928a49-9020-4e1e-9a15-e2c1120fd004. {{(pid=119432) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 09 17:58:54.489254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88b615d5-b38d-468e-aaef-0fc4a2a303a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:54.490523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88b615d5-b38d-468e-aaef-0fc4a2a303a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:54.498312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b615d5-b38d-468e-aaef-0fc4a2a303a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:54.499044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b615d5-b38d-468e-aaef-0fc4a2a303a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:54.499895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b615d5-b38d-468e-aaef-0fc4a2a303a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:54.500835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b615d5-b38d-468e-aaef-0fc4a2a303a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:54.501496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b615d5-b38d-468e-aaef-0fc4a2a303a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:54.502104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88b615d5-b38d-468e-aaef-0fc4a2a303a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:54.672616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-88b615d5-b38d-468e-aaef-0fc4a2a303a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:54.682257 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88b615d5-b38d-468e-aaef-0fc4a2a303a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.196862 Aug 09 17:58:54.698220 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3250/6229] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:54 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:55.106803 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-72e2761c-d685-4162-ae0b-b51b282c1963 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "POST /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c/action" status: 202 len: 0 microversion: 2.1 time: 1.544844 Aug 09 17:58:55.107719 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2980/6230] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:58:53 2022] POST /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c/action => generated 0 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 17:58:55.757832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ecfa010d-9b15-4548-8fc8-5256c0ba1c7e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:55.759234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ecfa010d-9b15-4548-8fc8-5256c0ba1c7e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:55.769125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecfa010d-9b15-4548-8fc8-5256c0ba1c7e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:55.769810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecfa010d-9b15-4548-8fc8-5256c0ba1c7e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:55.770540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecfa010d-9b15-4548-8fc8-5256c0ba1c7e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:55.771282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecfa010d-9b15-4548-8fc8-5256c0ba1c7e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:55.771802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecfa010d-9b15-4548-8fc8-5256c0ba1c7e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:55.772234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ecfa010d-9b15-4548-8fc8-5256c0ba1c7e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:55.950579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ecfa010d-9b15-4548-8fc8-5256c0ba1c7e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:55.960482 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ecfa010d-9b15-4548-8fc8-5256c0ba1c7e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.253503 Aug 09 17:58:55.961204 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3251/6231] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:55 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:56.343484 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1193553607", "imageRef": "69ab06eb-aed8-4c43-8e38-3c86451b235f", "flavorRef": "452", "networks": [{"uuid": "0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a"}]}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:58:56.402524 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.network.neutron [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] validate_networks() for [('0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a', None, None, None, None, None)] {{(pid=119432) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:58:56.828415 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:58:56.828861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image limits 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:58:56.829394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:58:56.829827 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image pref 0:0:0 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:58:56.830263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.virt.hardware [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119432) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:58:56.848745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.849259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.849728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:56.850541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.851001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.851449 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:56.869780 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:58:56.875226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for user 87590ee7f71345a8914b350c5999d974 and project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:58:56.889378 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Going to run 1 instances... {{(pid=119432) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:58:56.892109 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3d19cb79-282f-4124-8634-ee0a05f0cdbd',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119432) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:58:56.972375 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5d48b451-6c47-4c53-b160-552b3912a748 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634035 Aug 09 17:58:56.973036 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2981/6232] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 17:58:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:58:56.981965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-18c6976a-9fa8-4e98-b8e6-885c4d428038 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:56.982743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-18c6976a-9fa8-4e98-b8e6-885c4d428038 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:56.985405 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d0b93789-b1d3-49d3-ae53-0642dc3b0711 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:56.986595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d0b93789-b1d3-49d3-ae53-0642dc3b0711 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:56.990197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18c6976a-9fa8-4e98-b8e6-885c4d428038 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.991515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18c6976a-9fa8-4e98-b8e6-885c4d428038 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.992230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18c6976a-9fa8-4e98-b8e6-885c4d428038 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:56.993232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18c6976a-9fa8-4e98-b8e6-885c4d428038 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:56.993813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18c6976a-9fa8-4e98-b8e6-885c4d428038 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:56.994961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18c6976a-9fa8-4e98-b8e6-885c4d428038 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:57.058226 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d0b93789-b1d3-49d3-ae53-0642dc3b0711 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:57.066064 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d0b93789-b1d3-49d3-ae53-0642dc3b0711 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1230 microversion: 2.1 time: 0.085103 Aug 09 17:58:57.066997 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2982/6233] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:56 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:57.166255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-18c6976a-9fa8-4e98-b8e6-885c4d428038 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:57.174204 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-18c6976a-9fa8-4e98-b8e6-885c4d428038 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.196085 Aug 09 17:58:57.174799 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3252/6234] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:56 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:58.087518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e5ce3f38-ca82-477a-b798-6252b7a64ce0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:58.088248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e5ce3f38-ca82-477a-b798-6252b7a64ce0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:58.095864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5ce3f38-ca82-477a-b798-6252b7a64ce0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:58.096374 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5ce3f38-ca82-477a-b798-6252b7a64ce0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:58.096823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5ce3f38-ca82-477a-b798-6252b7a64ce0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:58.097541 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5ce3f38-ca82-477a-b798-6252b7a64ce0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:58.098003 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5ce3f38-ca82-477a-b798-6252b7a64ce0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:58.098442 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e5ce3f38-ca82-477a-b798-6252b7a64ce0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:58.179321 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e5ce3f38-ca82-477a-b798-6252b7a64ce0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:58.194619 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e5ce3f38-ca82-477a-b798-6252b7a64ce0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1290 microversion: 2.1 time: 0.111004 Aug 09 17:58:58.195601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-409807c0-3342-483a-9cb9-4096a806ba37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:58.196138 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2983/6235] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:58 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1290 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:58.197051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-409807c0-3342-483a-9cb9-4096a806ba37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:58.207953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-409807c0-3342-483a-9cb9-4096a806ba37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:58.208466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-409807c0-3342-483a-9cb9-4096a806ba37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:58.208926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-409807c0-3342-483a-9cb9-4096a806ba37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:58.209669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-409807c0-3342-483a-9cb9-4096a806ba37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:58.217505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-409807c0-3342-483a-9cb9-4096a806ba37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:58.217978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-409807c0-3342-483a-9cb9-4096a806ba37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:58.475406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-409807c0-3342-483a-9cb9-4096a806ba37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:58.489459 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-409807c0-3342-483a-9cb9-4096a806ba37 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.298015 Aug 09 17:58:58.504664 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3253/6236] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:58 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:58:59.237616 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-cd34a1bf-6f73-4106-bd66-dc1f8d21154c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:59.239814 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-cd34a1bf-6f73-4106-bd66-dc1f8d21154c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:59.255913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd34a1bf-6f73-4106-bd66-dc1f8d21154c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:59.257848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd34a1bf-6f73-4106-bd66-dc1f8d21154c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:59.258961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd34a1bf-6f73-4106-bd66-dc1f8d21154c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:59.260762 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd34a1bf-6f73-4106-bd66-dc1f8d21154c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:59.261960 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd34a1bf-6f73-4106-bd66-dc1f8d21154c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:59.263072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-cd34a1bf-6f73-4106-bd66-dc1f8d21154c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:59.268958 n-d-845781-6 devstack@n-api.service[119432]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:58:59.276201 n-d-845781-6 devstack@n-api.service[119432]: Tue Aug 9 17:58:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff (ip 10.222.0.93) !!! Aug 09 17:58:59.517591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ba32dcb1-2c14-4cd6-a75c-eb128ba66db8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:58:59.518428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba32dcb1-2c14-4cd6-a75c-eb128ba66db8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:58:59.529556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba32dcb1-2c14-4cd6-a75c-eb128ba66db8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:59.530396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba32dcb1-2c14-4cd6-a75c-eb128ba66db8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:59.531161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba32dcb1-2c14-4cd6-a75c-eb128ba66db8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:59.532033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba32dcb1-2c14-4cd6-a75c-eb128ba66db8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:58:59.532605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba32dcb1-2c14-4cd6-a75c-eb128ba66db8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:58:59.533149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba32dcb1-2c14-4cd6-a75c-eb128ba66db8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:58:59.542155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-cd34a1bf-6f73-4106-bd66-dc1f8d21154c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:59.557466 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-cd34a1bf-6f73-4106-bd66-dc1f8d21154c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.327126 Aug 09 17:58:59.559518 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2984/6237] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:59 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:58:59.840224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ba32dcb1-2c14-4cd6-a75c-eb128ba66db8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:58:59.857969 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ba32dcb1-2c14-4cd6-a75c-eb128ba66db8 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.343619 Aug 09 17:58:59.859170 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3254/6238] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:58:59 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:00.229826 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-cf0e8255-82b7-45df-96cf-beb87fdf8cec req-6f42d5cf-8f0f-42da-867d-141ad6a46d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3598e1c5-4a62-48f8-9e17-273953d040ff", "tag": "9cb380cb-e49b-4f52-889f-300486f8f8e0"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:00.245656 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cf0e8255-82b7-45df-96cf-beb87fdf8cec req-6f42d5cf-8f0f-42da-867d-141ad6a46d6f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:00.260475 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cf0e8255-82b7-45df-96cf-beb87fdf8cec req-6f42d5cf-8f0f-42da-867d-141ad6a46d6f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:00.261324 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-cf0e8255-82b7-45df-96cf-beb87fdf8cec req-6f42d5cf-8f0f-42da-867d-141ad6a46d6f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:00.276473 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-cf0e8255-82b7-45df-96cf-beb87fdf8cec req-6f42d5cf-8f0f-42da-867d-141ad6a46d6f service nova] Creating event network-changed:9cb380cb-e49b-4f52-889f-300486f8f8e0 for instance 3598e1c5-4a62-48f8-9e17-273953d040ff on n-h1-845781-6 Aug 09 17:59:00.283905 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-cf0e8255-82b7-45df-96cf-beb87fdf8cec req-6f42d5cf-8f0f-42da-867d-141ad6a46d6f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059541 Aug 09 17:59:00.284820 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2985/6239] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:59:00.580211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-03673e0d-ed40-4ad5-bb2e-37b609f5f473 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:00.585687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-03673e0d-ed40-4ad5-bb2e-37b609f5f473 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:00.597891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03673e0d-ed40-4ad5-bb2e-37b609f5f473 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:00.598663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03673e0d-ed40-4ad5-bb2e-37b609f5f473 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:00.599416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03673e0d-ed40-4ad5-bb2e-37b609f5f473 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:00.599749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03673e0d-ed40-4ad5-bb2e-37b609f5f473 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:00.600762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03673e0d-ed40-4ad5-bb2e-37b609f5f473 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:00.601195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03673e0d-ed40-4ad5-bb2e-37b609f5f473 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:00.848538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-03673e0d-ed40-4ad5-bb2e-37b609f5f473 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:00.863199 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-03673e0d-ed40-4ad5-bb2e-37b609f5f473 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.286908 Aug 09 17:59:00.864111 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3255/6240] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:00 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:00.883655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8ef6b6c3-b953-4e8e-a8f5-14ee87250f84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:00.884499 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8ef6b6c3-b953-4e8e-a8f5-14ee87250f84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:00.891347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ef6b6c3-b953-4e8e-a8f5-14ee87250f84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:00.891976 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ef6b6c3-b953-4e8e-a8f5-14ee87250f84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:00.892516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ef6b6c3-b953-4e8e-a8f5-14ee87250f84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:00.893317 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ef6b6c3-b953-4e8e-a8f5-14ee87250f84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:00.893886 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ef6b6c3-b953-4e8e-a8f5-14ee87250f84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:00.894406 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8ef6b6c3-b953-4e8e-a8f5-14ee87250f84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:01.082210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8ef6b6c3-b953-4e8e-a8f5-14ee87250f84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:01.095369 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8ef6b6c3-b953-4e8e-a8f5-14ee87250f84 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.216664 Aug 09 17:59:01.099657 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2986/6241] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:00 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:01.884389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-038d5c5d-e914-4662-a1a9-313f64ce47a6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:01.885021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-038d5c5d-e914-4662-a1a9-313f64ce47a6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:01.893692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-038d5c5d-e914-4662-a1a9-313f64ce47a6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:01.894215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-038d5c5d-e914-4662-a1a9-313f64ce47a6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:01.894636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-038d5c5d-e914-4662-a1a9-313f64ce47a6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:01.895543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-038d5c5d-e914-4662-a1a9-313f64ce47a6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:01.896040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-038d5c5d-e914-4662-a1a9-313f64ce47a6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:01.896480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-038d5c5d-e914-4662-a1a9-313f64ce47a6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:02.127789 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3fb97ee9-bd71-41bb-af7d-e8e8e2850ec0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:02.130019 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3fb97ee9-bd71-41bb-af7d-e8e8e2850ec0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:02.130671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-038d5c5d-e914-4662-a1a9-313f64ce47a6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:02.152208 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:02.158603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fb97ee9-bd71-41bb-af7d-e8e8e2850ec0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:02.159450 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fb97ee9-bd71-41bb-af7d-e8e8e2850ec0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:02.162755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-038d5c5d-e914-4662-a1a9-313f64ce47a6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.282109 Aug 09 17:59:02.163831 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3256/6242] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:01 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:02.164572 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fb97ee9-bd71-41bb-af7d-e8e8e2850ec0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:02.165663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fb97ee9-bd71-41bb-af7d-e8e8e2850ec0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:02.166710 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fb97ee9-bd71-41bb-af7d-e8e8e2850ec0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:02.167332 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3fb97ee9-bd71-41bb-af7d-e8e8e2850ec0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:02.382423 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3fb97ee9-bd71-41bb-af7d-e8e8e2850ec0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:02.400710 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3fb97ee9-bd71-41bb-af7d-e8e8e2850ec0 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.283545 Aug 09 17:59:02.415730 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2987/6243] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:02 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:03.205902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-45c4844a-5b7b-4b10-a4d6-b9d20da45659 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:03.206675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-45c4844a-5b7b-4b10-a4d6-b9d20da45659 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:03.209802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:03.215446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c4844a-5b7b-4b10-a4d6-b9d20da45659 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:03.215975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c4844a-5b7b-4b10-a4d6-b9d20da45659 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:03.216410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c4844a-5b7b-4b10-a4d6-b9d20da45659 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:03.217351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c4844a-5b7b-4b10-a4d6-b9d20da45659 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:03.218068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c4844a-5b7b-4b10-a4d6-b9d20da45659 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:03.219314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45c4844a-5b7b-4b10-a4d6-b9d20da45659 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:03.424582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5acab701-5d2a-42f4-95c4-3a3a21b0e373 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:03.425305 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5acab701-5d2a-42f4-95c4-3a3a21b0e373 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:03.436355 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5acab701-5d2a-42f4-95c4-3a3a21b0e373 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:03.437107 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5acab701-5d2a-42f4-95c4-3a3a21b0e373 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:03.439196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5acab701-5d2a-42f4-95c4-3a3a21b0e373 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:03.440533 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5acab701-5d2a-42f4-95c4-3a3a21b0e373 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:03.441197 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5acab701-5d2a-42f4-95c4-3a3a21b0e373 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:03.441969 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5acab701-5d2a-42f4-95c4-3a3a21b0e373 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:03.465201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-45c4844a-5b7b-4b10-a4d6-b9d20da45659 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:03.476721 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-45c4844a-5b7b-4b10-a4d6-b9d20da45659 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.275415 Aug 09 17:59:03.477813 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3257/6244] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:03 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:03.691595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5acab701-5d2a-42f4-95c4-3a3a21b0e373 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:03.703971 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5acab701-5d2a-42f4-95c4-3a3a21b0e373 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.284318 Aug 09 17:59:03.707664 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2988/6245] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:03 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:04.512072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-241c2e4d-912d-499a-ac6a-c9b1d45f6d15 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:04.515439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-241c2e4d-912d-499a-ac6a-c9b1d45f6d15 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:04.528836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241c2e4d-912d-499a-ac6a-c9b1d45f6d15 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.529849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241c2e4d-912d-499a-ac6a-c9b1d45f6d15 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.530704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241c2e4d-912d-499a-ac6a-c9b1d45f6d15 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.535559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241c2e4d-912d-499a-ac6a-c9b1d45f6d15 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.535559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241c2e4d-912d-499a-ac6a-c9b1d45f6d15 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.535559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-241c2e4d-912d-499a-ac6a-c9b1d45f6d15 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.735164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8888c88f-875a-485f-b89d-e8b8619bb68e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:04.737452 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8888c88f-875a-485f-b89d-e8b8619bb68e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:04.762588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8888c88f-875a-485f-b89d-e8b8619bb68e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.772652 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8888c88f-875a-485f-b89d-e8b8619bb68e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.777963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8888c88f-875a-485f-b89d-e8b8619bb68e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:04.779795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8888c88f-875a-485f-b89d-e8b8619bb68e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:04.784065 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8888c88f-875a-485f-b89d-e8b8619bb68e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:04.785260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8888c88f-875a-485f-b89d-e8b8619bb68e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:05.070488 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8888c88f-875a-485f-b89d-e8b8619bb68e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:05.092149 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8888c88f-875a-485f-b89d-e8b8619bb68e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.363867 Aug 09 17:59:05.096824 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2989/6246] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:04 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:05.519980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-241c2e4d-912d-499a-ac6a-c9b1d45f6d15 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:05.535416 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-241c2e4d-912d-499a-ac6a-c9b1d45f6d15 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 1.035705 Aug 09 17:59:05.552160 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3258/6247] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:04 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:06.126765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-4228a395-b289-4ee0-9b2a-0a6aa8e710a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:06.130548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-4228a395-b289-4ee0-9b2a-0a6aa8e710a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:06.157050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4228a395-b289-4ee0-9b2a-0a6aa8e710a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:06.157997 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4228a395-b289-4ee0-9b2a-0a6aa8e710a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:06.158846 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4228a395-b289-4ee0-9b2a-0a6aa8e710a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:06.160251 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4228a395-b289-4ee0-9b2a-0a6aa8e710a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:06.161470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4228a395-b289-4ee0-9b2a-0a6aa8e710a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:06.163236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-4228a395-b289-4ee0-9b2a-0a6aa8e710a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:06.426330 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-4228a395-b289-4ee0-9b2a-0a6aa8e710a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:06.436000 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-4228a395-b289-4ee0-9b2a-0a6aa8e710a7 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1688 microversion: 2.1 time: 0.316885 Aug 09 17:59:06.436674 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2990/6248] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:06 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1688 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:06.567953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-367edfc6-72dd-4c5e-a2cc-96425d0896b9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:06.570452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-367edfc6-72dd-4c5e-a2cc-96425d0896b9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:06.585283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367edfc6-72dd-4c5e-a2cc-96425d0896b9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:06.586687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367edfc6-72dd-4c5e-a2cc-96425d0896b9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:06.587987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367edfc6-72dd-4c5e-a2cc-96425d0896b9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:06.590126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367edfc6-72dd-4c5e-a2cc-96425d0896b9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:06.591065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367edfc6-72dd-4c5e-a2cc-96425d0896b9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:06.592643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367edfc6-72dd-4c5e-a2cc-96425d0896b9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:06.828839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-367edfc6-72dd-4c5e-a2cc-96425d0896b9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:06.838181 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-367edfc6-72dd-4c5e-a2cc-96425d0896b9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.279095 Aug 09 17:59:06.838832 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3259/6249] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:06 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:07.469446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3f13d75e-321c-4b45-9749-0d8098cb4642 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:07.471749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3f13d75e-321c-4b45-9749-0d8098cb4642 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:07.477982 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:07.479705 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:07.509505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f13d75e-321c-4b45-9749-0d8098cb4642 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:07.510606 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f13d75e-321c-4b45-9749-0d8098cb4642 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:07.511523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f13d75e-321c-4b45-9749-0d8098cb4642 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:07.512989 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f13d75e-321c-4b45-9749-0d8098cb4642 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:07.514146 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f13d75e-321c-4b45-9749-0d8098cb4642 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:07.514955 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3f13d75e-321c-4b45-9749-0d8098cb4642 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:07.792255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3f13d75e-321c-4b45-9749-0d8098cb4642 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:07.808775 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3f13d75e-321c-4b45-9749-0d8098cb4642 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1706 microversion: 2.1 time: 0.350456 Aug 09 17:59:07.810830 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2991/6250] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:07 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1706 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:07.867565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-90013e5d-8fb4-4743-894e-9cc1d7e065ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:07.872880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-90013e5d-8fb4-4743-894e-9cc1d7e065ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:07.893624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90013e5d-8fb4-4743-894e-9cc1d7e065ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:07.894912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90013e5d-8fb4-4743-894e-9cc1d7e065ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:07.896135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90013e5d-8fb4-4743-894e-9cc1d7e065ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:07.897767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90013e5d-8fb4-4743-894e-9cc1d7e065ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:07.899994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90013e5d-8fb4-4743-894e-9cc1d7e065ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:07.901137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90013e5d-8fb4-4743-894e-9cc1d7e065ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:08.150179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-90013e5d-8fb4-4743-894e-9cc1d7e065ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:08.164374 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-90013e5d-8fb4-4743-894e-9cc1d7e065ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.304966 Aug 09 17:59:08.164995 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3260/6251] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:07 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:08.861961 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ddd209f4-1805-40bb-b8af-45b5e170b666 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:08.870621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ddd209f4-1805-40bb-b8af-45b5e170b666 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:08.905763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd209f4-1805-40bb-b8af-45b5e170b666 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:08.906733 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd209f4-1805-40bb-b8af-45b5e170b666 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:08.911113 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd209f4-1805-40bb-b8af-45b5e170b666 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:08.912632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd209f4-1805-40bb-b8af-45b5e170b666 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:08.913501 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd209f4-1805-40bb-b8af-45b5e170b666 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:08.914322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ddd209f4-1805-40bb-b8af-45b5e170b666 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:09.189260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f52964e0-bb36-43d8-ba64-bfcadff44566 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:09.194224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f52964e0-bb36-43d8-ba64-bfcadff44566 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:09.204105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52964e0-bb36-43d8-ba64-bfcadff44566 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:09.204743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52964e0-bb36-43d8-ba64-bfcadff44566 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:09.205456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52964e0-bb36-43d8-ba64-bfcadff44566 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:09.206614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52964e0-bb36-43d8-ba64-bfcadff44566 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:09.207318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52964e0-bb36-43d8-ba64-bfcadff44566 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:09.208079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f52964e0-bb36-43d8-ba64-bfcadff44566 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:09.275540 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ddd209f4-1805-40bb-b8af-45b5e170b666 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:09.293861 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ddd209f4-1805-40bb-b8af-45b5e170b666 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1694 microversion: 2.1 time: 0.439523 Aug 09 17:59:09.295333 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2992/6252] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:08 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1694 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:09.450044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f52964e0-bb36-43d8-ba64-bfcadff44566 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:09.463900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f52964e0-bb36-43d8-ba64-bfcadff44566 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.280292 Aug 09 17:59:09.465163 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3261/6253] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:09 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:10.079184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-85302202-6dbb-4a98-aec4-b8bab4ca9549 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:10.080468 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-85302202-6dbb-4a98-aec4-b8bab4ca9549 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:10.089506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85302202-6dbb-4a98-aec4-b8bab4ca9549 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.090678 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85302202-6dbb-4a98-aec4-b8bab4ca9549 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.091455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85302202-6dbb-4a98-aec4-b8bab4ca9549 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.092583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85302202-6dbb-4a98-aec4-b8bab4ca9549 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.093249 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85302202-6dbb-4a98-aec4-b8bab4ca9549 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.093909 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-85302202-6dbb-4a98-aec4-b8bab4ca9549 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.126778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-85302202-6dbb-4a98-aec4-b8bab4ca9549 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:59:10.193918 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:10.232702 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-85302202-6dbb-4a98-aec4-b8bab4ca9549 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 204 len: 0 microversion: 2.1 time: 0.304071 Aug 09 17:59:10.233276 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2993/6254] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:59:09 2022] DELETE /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:59:10.243144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d52f9bff-06f6-4ece-acad-ef4d6247ef1a tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:10.243829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d52f9bff-06f6-4ece-acad-ef4d6247ef1a tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:10.251106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d52f9bff-06f6-4ece-acad-ef4d6247ef1a tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.251597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d52f9bff-06f6-4ece-acad-ef4d6247ef1a tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.252303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d52f9bff-06f6-4ece-acad-ef4d6247ef1a tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.253277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d52f9bff-06f6-4ece-acad-ef4d6247ef1a tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.253818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d52f9bff-06f6-4ece-acad-ef4d6247ef1a tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.254348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d52f9bff-06f6-4ece-acad-ef4d6247ef1a tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.260170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:10.329660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e1956f53-46e8-4ef6-a223-c51e0e563fd6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:10.331173 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e1956f53-46e8-4ef6-a223-c51e0e563fd6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:10.344385 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1956f53-46e8-4ef6-a223-c51e0e563fd6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.345637 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1956f53-46e8-4ef6-a223-c51e0e563fd6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.346683 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1956f53-46e8-4ef6-a223-c51e0e563fd6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.350050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1956f53-46e8-4ef6-a223-c51e0e563fd6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.353672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1956f53-46e8-4ef6-a223-c51e0e563fd6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.353672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e1956f53-46e8-4ef6-a223-c51e0e563fd6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.526697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d52f9bff-06f6-4ece-acad-ef4d6247ef1a tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:10.536047 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d52f9bff-06f6-4ece-acad-ef4d6247ef1a tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1728 microversion: 2.1 time: 0.297130 Aug 09 17:59:10.548187 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3262/6255] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:10 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1728 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:10.556545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d5316b57-df64-4790-9822-6dfb9121afee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:10.557469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d5316b57-df64-4790-9822-6dfb9121afee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:10.564395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5316b57-df64-4790-9822-6dfb9121afee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.565181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5316b57-df64-4790-9822-6dfb9121afee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.565882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5316b57-df64-4790-9822-6dfb9121afee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.566866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5316b57-df64-4790-9822-6dfb9121afee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:10.567511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5316b57-df64-4790-9822-6dfb9121afee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:10.568125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5316b57-df64-4790-9822-6dfb9121afee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:10.586392 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e1956f53-46e8-4ef6-a223-c51e0e563fd6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:10.601452 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e1956f53-46e8-4ef6-a223-c51e0e563fd6 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1694 microversion: 2.1 time: 0.284787 Aug 09 17:59:10.616738 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2994/6256] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:10 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1694 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:10.761584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d5316b57-df64-4790-9822-6dfb9121afee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:10.786248 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d5316b57-df64-4790-9822-6dfb9121afee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.236726 Aug 09 17:59:10.789765 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3263/6257] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:10 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:11.561931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-d88d8437-5571-4db2-9c56-deb453f2dfd3 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:11.562735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-d88d8437-5571-4db2-9c56-deb453f2dfd3 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:11.570234 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d88d8437-5571-4db2-9c56-deb453f2dfd3 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:11.570752 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d88d8437-5571-4db2-9c56-deb453f2dfd3 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:11.571214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d88d8437-5571-4db2-9c56-deb453f2dfd3 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:11.571987 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d88d8437-5571-4db2-9c56-deb453f2dfd3 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:11.572625 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d88d8437-5571-4db2-9c56-deb453f2dfd3 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:11.573102 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-d88d8437-5571-4db2-9c56-deb453f2dfd3 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:11.628643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e00ac516-32f9-4f2f-9a1f-77c642894f16 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:11.629928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e00ac516-32f9-4f2f-9a1f-77c642894f16 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:11.636892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e00ac516-32f9-4f2f-9a1f-77c642894f16 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:11.637889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e00ac516-32f9-4f2f-9a1f-77c642894f16 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:11.638571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e00ac516-32f9-4f2f-9a1f-77c642894f16 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:11.639829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e00ac516-32f9-4f2f-9a1f-77c642894f16 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:11.641239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e00ac516-32f9-4f2f-9a1f-77c642894f16 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:11.641967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e00ac516-32f9-4f2f-9a1f-77c642894f16 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:11.919060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e00ac516-32f9-4f2f-9a1f-77c642894f16 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:11.932317 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e00ac516-32f9-4f2f-9a1f-77c642894f16 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1679 microversion: 2.1 time: 0.309319 Aug 09 17:59:11.949071 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3264/6258] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:11 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1679 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:11.955864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-23ef9a59-477f-49aa-8eae-efa7c7727115 req-cad45758-3ff5-4c95-a6cd-110bbfb44705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380cdb00-065d-4575-8ef8-5b7785df5fa8", "name": "network-vif-unplugged", "status": "completed", "tag": "b6759686-f390-435c-8776-87bfc88a176f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:11.993524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-23ef9a59-477f-49aa-8eae-efa7c7727115 req-cad45758-3ff5-4c95-a6cd-110bbfb44705 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:12.000572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-23ef9a59-477f-49aa-8eae-efa7c7727115 req-cad45758-3ff5-4c95-a6cd-110bbfb44705 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:12.001900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-23ef9a59-477f-49aa-8eae-efa7c7727115 req-cad45758-3ff5-4c95-a6cd-110bbfb44705 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:12.018210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-d88d8437-5571-4db2-9c56-deb453f2dfd3 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:12.027165 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-23ef9a59-477f-49aa-8eae-efa7c7727115 req-cad45758-3ff5-4c95-a6cd-110bbfb44705 service nova] Creating event network-vif-unplugged:b6759686-f390-435c-8776-87bfc88a176f for instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 on n-h1-845781-6 Aug 09 17:59:12.044661 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-d88d8437-5571-4db2-9c56-deb453f2dfd3 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1728 microversion: 2.1 time: 0.487075 Aug 09 17:59:12.049871 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-23ef9a59-477f-49aa-8eae-efa7c7727115 req-cad45758-3ff5-4c95-a6cd-110bbfb44705 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099091 Aug 09 17:59:12.051514 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3265/6259] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:59:12.064243 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2995/6260] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:11 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1728 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:12.069957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d421435-8a69-4733-89ac-3831073b92b2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:12.070998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0d421435-8a69-4733-89ac-3831073b92b2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:12.079080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d421435-8a69-4733-89ac-3831073b92b2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:12.079731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d421435-8a69-4733-89ac-3831073b92b2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:12.088940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d421435-8a69-4733-89ac-3831073b92b2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:12.088940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d421435-8a69-4733-89ac-3831073b92b2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:12.088940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d421435-8a69-4733-89ac-3831073b92b2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:12.088940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d421435-8a69-4733-89ac-3831073b92b2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:12.300389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0d421435-8a69-4733-89ac-3831073b92b2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:12.324530 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0d421435-8a69-4733-89ac-3831073b92b2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.270883 Aug 09 17:59:12.337120 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3266/6261] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:12 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:13.081147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0bc3929a-3fdf-4ead-800d-1a674ca11a3b tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:13.082117 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0bc3929a-3fdf-4ead-800d-1a674ca11a3b tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:13.091620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bc3929a-3fdf-4ead-800d-1a674ca11a3b tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:13.092316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bc3929a-3fdf-4ead-800d-1a674ca11a3b tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:13.092823 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bc3929a-3fdf-4ead-800d-1a674ca11a3b tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:13.093630 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bc3929a-3fdf-4ead-800d-1a674ca11a3b tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:13.094174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bc3929a-3fdf-4ead-800d-1a674ca11a3b tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:13.102210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0bc3929a-3fdf-4ead-800d-1a674ca11a3b tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:13.347889 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0bc3929a-3fdf-4ead-800d-1a674ca11a3b tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:13.348411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a85fbc36-dc4f-464b-bd99-279f2d40a66d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:13.350148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a85fbc36-dc4f-464b-bd99-279f2d40a66d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:13.366452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a85fbc36-dc4f-464b-bd99-279f2d40a66d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:13.372105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a85fbc36-dc4f-464b-bd99-279f2d40a66d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:13.375197 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0bc3929a-3fdf-4ead-800d-1a674ca11a3b tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1661 microversion: 2.1 time: 0.305002 Aug 09 17:59:13.376893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a85fbc36-dc4f-464b-bd99-279f2d40a66d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:13.382687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a85fbc36-dc4f-464b-bd99-279f2d40a66d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:13.383768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a85fbc36-dc4f-464b-bd99-279f2d40a66d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:13.385436 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2996/6262] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:13 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1661 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:13.392143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a85fbc36-dc4f-464b-bd99-279f2d40a66d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:13.768177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a85fbc36-dc4f-464b-bd99-279f2d40a66d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:13.800627 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a85fbc36-dc4f-464b-bd99-279f2d40a66d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.456395 Aug 09 17:59:13.812418 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3267/6263] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:13 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:13.880313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-bfa8e7e8-74a4-4248-94cf-5690f3ffb919 req-7687242c-6a30-44fd-bb14-0fb39f054737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d27ba69-c70a-4b2d-bfd4-af446c3179d3", "name": "network-vif-deleted", "tag": "f051bb0e-72a5-49dd-8a7d-2ba55c4860bb"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:13.936168 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-bfa8e7e8-74a4-4248-94cf-5690f3ffb919 req-7687242c-6a30-44fd-bb14-0fb39f054737 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:13.938338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-bfa8e7e8-74a4-4248-94cf-5690f3ffb919 req-7687242c-6a30-44fd-bb14-0fb39f054737 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:13.940213 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-bfa8e7e8-74a4-4248-94cf-5690f3ffb919 req-7687242c-6a30-44fd-bb14-0fb39f054737 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:13.968853 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-bfa8e7e8-74a4-4248-94cf-5690f3ffb919 req-7687242c-6a30-44fd-bb14-0fb39f054737 service nova] Creating event network-vif-deleted:f051bb0e-72a5-49dd-8a7d-2ba55c4860bb for instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 on n-h2-845781-6 Aug 09 17:59:13.986092 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-bfa8e7e8-74a4-4248-94cf-5690f3ffb919 req-7687242c-6a30-44fd-bb14-0fb39f054737 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115025 Aug 09 17:59:13.999003 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2997/6264] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:59:14.418810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:14.420202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:14.438908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:14.439754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:14.440401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:14.441302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:14.441957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:14.442397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:14.527705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:14.528199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:14.528856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:14.529513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lazy-loading 'fault' on Instance uuid 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:59:14.568398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-43dd9d70-f060-4f96-b777-c54a8654e6fb req-aaaba70e-29b0-40fb-85aa-5148df2cb77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380cdb00-065d-4575-8ef8-5b7785df5fa8", "name": "network-vif-plugged", "status": "completed", "tag": "b6759686-f390-435c-8776-87bfc88a176f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:14.612255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-43dd9d70-f060-4f96-b777-c54a8654e6fb req-aaaba70e-29b0-40fb-85aa-5148df2cb77d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:14.612819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-43dd9d70-f060-4f96-b777-c54a8654e6fb req-aaaba70e-29b0-40fb-85aa-5148df2cb77d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:14.615248 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-43dd9d70-f060-4f96-b777-c54a8654e6fb req-aaaba70e-29b0-40fb-85aa-5148df2cb77d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:14.636361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b265fe840b4375818c363ec32ff68e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '349a4820ebe9411aada660b43cceade9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:14.650154 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8190a7eb-19b4-4a4d-a7e1-a3fe634fbb2d tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 200 len: 1386 microversion: 2.1 time: 0.236907 Aug 09 17:59:14.663653 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3268/6265] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:14 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 1386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:14.663916 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-43dd9d70-f060-4f96-b777-c54a8654e6fb req-aaaba70e-29b0-40fb-85aa-5148df2cb77d service nova] Creating event network-vif-plugged:b6759686-f390-435c-8776-87bfc88a176f for instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 on n-h1-845781-6 Aug 09 17:59:14.665510 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-43dd9d70-f060-4f96-b777-c54a8654e6fb req-aaaba70e-29b0-40fb-85aa-5148df2cb77d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114594 Aug 09 17:59:14.667464 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2998/6266] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:59:14.839901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9af80660-3e41-4c5b-9567-0c2a20248c93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:14.840702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9af80660-3e41-4c5b-9567-0c2a20248c93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:14.855061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9af80660-3e41-4c5b-9567-0c2a20248c93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:14.855573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9af80660-3e41-4c5b-9567-0c2a20248c93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:14.856048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9af80660-3e41-4c5b-9567-0c2a20248c93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:14.858347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9af80660-3e41-4c5b-9567-0c2a20248c93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:14.859690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9af80660-3e41-4c5b-9567-0c2a20248c93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:14.860150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9af80660-3e41-4c5b-9567-0c2a20248c93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:15.085130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9af80660-3e41-4c5b-9567-0c2a20248c93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:15.096262 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9af80660-3e41-4c5b-9567-0c2a20248c93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.260788 Aug 09 17:59:15.109288 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3269/6267] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:14 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:15.675943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:15.678531 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:15.687256 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:15.688058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:15.688680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:15.690325 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:15.691543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:15.692327 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:15.730274 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] HTTP exception thrown: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Request method failure captured: Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 HTTP/1.1 Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p8mM5S6l9QlbhMlKUkOydDNwCzBnV2_9-gVJi8fYmmGdUvhTFaxG6VJLTtvwIBxYWEQNkqWZv0f4D92FTkDH_Kq_t5wZ7aSc6dz8bc3LuDKR9liGMDibr1s1TqFZHfzOkxe_lPs2Ao_3qcXD9ehuM_vdWwBjYCK92hjw1oViJkOCmc Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 349a4820ebe9411aada660b43cceade9 Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TestServerBasicOps-1061145961 Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_349a4820ebe9411aada660b43cceade9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/349a4820ebe9411aada660b43cceade9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/349a4820ebe9411aada660b43cceade9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/349a4820ebe9411aada660b43cceade9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TestServerBasicOps-1061145961 Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 349a4820ebe9411aada660b43cceade9 Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TestServerBasicOps-1061145961 Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TestServerBasicOps-1061145961-project Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 61b265fe840b4375818c363ec32ff68e Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TestServerBasicOps-1061145961-project Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9d27ba69-c70a-4b2d-bfd4-af446c3179d3'} Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:15.734138 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:15.740113 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:15.740113 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:15.740113 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:15.740113 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:59:15.740113 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:59:15.740113 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:15.740113 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:15.744071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Returning 404 to user: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:59:15.745331 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5b68ab0d-14c2-4087-9602-7e371c209279 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 404 len: 111 microversion: 2.1 time: 0.074216 Aug 09 17:59:15.746605 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 2999/6268] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:15 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:59:16.124203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ab49a4a-f03d-4737-8ec9-600923f252b1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:16.126390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7ab49a4a-f03d-4737-8ec9-600923f252b1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:16.137119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ab49a4a-f03d-4737-8ec9-600923f252b1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:16.138286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ab49a4a-f03d-4737-8ec9-600923f252b1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:16.139102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ab49a4a-f03d-4737-8ec9-600923f252b1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:16.140768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ab49a4a-f03d-4737-8ec9-600923f252b1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:16.141933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ab49a4a-f03d-4737-8ec9-600923f252b1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:16.143038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ab49a4a-f03d-4737-8ec9-600923f252b1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:16.467188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7ab49a4a-f03d-4737-8ec9-600923f252b1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:16.499941 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ab49a4a-f03d-4737-8ec9-600923f252b1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.383879 Aug 09 17:59:16.503680 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3270/6269] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:16 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:16.689689 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:16.690808 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:16.703671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:16.704933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:16.706077 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:16.707283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:16.708121 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:16.709338 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:16.736224 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] HTTP exception thrown: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Request method failure captured: Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 HTTP/1.1 Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p8mM5S6l9QlbhMlKUkOydDNwCzBnV2_9-gVJi8fYmmGdUvhTFaxG6VJLTtvwIBxYWEQNkqWZv0f4D92FTkDH_Kq_t5wZ7aSc6dz8bc3LuDKR9liGMDibr1s1TqFZHfzOkxe_lPs2Ao_3qcXD9ehuM_vdWwBjYCK92hjw1oViJkOCmc Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 349a4820ebe9411aada660b43cceade9 Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TestServerBasicOps-1061145961 Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_349a4820ebe9411aada660b43cceade9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/349a4820ebe9411aada660b43cceade9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/349a4820ebe9411aada660b43cceade9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/349a4820ebe9411aada660b43cceade9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TestServerBasicOps-1061145961 Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 349a4820ebe9411aada660b43cceade9 Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TestServerBasicOps-1061145961 Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TestServerBasicOps-1061145961-project Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 61b265fe840b4375818c363ec32ff68e Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TestServerBasicOps-1061145961-project Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '9d27ba69-c70a-4b2d-bfd4-af446c3179d3'} Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:59:16.740171 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Returning 404 to user: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-236c31fa-4d66-4513-9908-4753fd916857 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 404 len: 111 microversion: 2.1 time: 0.067146 Aug 09 17:59:16.748266 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3000/6270] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:59:16 2022] DELETE /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:59:16.753934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:16.754580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] [instance: 9d27ba69-c70a-4b2d-bfd4-af446c3179d3] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:16.762364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:16.763185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:16.763861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:16.765355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:16.766110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:16.766808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:16.787384 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] HTTP exception thrown: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Request method failure captured: Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 HTTP/1.1 Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p8mM5S6l9QlbhMlKUkOydDNwCzBnV2_9-gVJi8fYmmGdUvhTFaxG6VJLTtvwIBxYWEQNkqWZv0f4D92FTkDH_Kq_t5wZ7aSc6dz8bc3LuDKR9liGMDibr1s1TqFZHfzOkxe_lPs2Ao_3qcXD9ehuM_vdWwBjYCK92hjw1oViJkOCmc Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 349a4820ebe9411aada660b43cceade9 Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestServerBasicOps-1061145961 Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_349a4820ebe9411aada660b43cceade9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/349a4820ebe9411aada660b43cceade9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/349a4820ebe9411aada660b43cceade9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/349a4820ebe9411aada660b43cceade9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestServerBasicOps-1061145961 Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 349a4820ebe9411aada660b43cceade9 Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestServerBasicOps-1061145961 Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestServerBasicOps-1061145961-project Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 61b265fe840b4375818c363ec32ff68e Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestServerBasicOps-1061145961-project Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9d27ba69-c70a-4b2d-bfd4-af446c3179d3'} Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:16.790802 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:16.795910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:16.795910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:16.795910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:16.795910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:59:16.795910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:59:16.795910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. Aug 09 17:59:16.795910 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:16.795910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Returning 404 to user: Instance 9d27ba69-c70a-4b2d-bfd4-af446c3179d3 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:59:16.795910 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-627b82d9-ad84-429e-a935-0ab4ab5fe454 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3" status: 404 len: 111 microversion: 2.1 time: 0.045075 Aug 09 17:59:16.795910 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3271/6271] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:16 2022] GET /compute/v2.1/servers/9d27ba69-c70a-4b2d-bfd4-af446c3179d3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:59:17.085642 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fbe7a5a9-b737-4b9b-8727-127b2d8a5605 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] Calling method '.version_select at 0x7fbbca5a9820>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:17.130431 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fbe7a5a9-b737-4b9b-8727-127b2d8a5605 tempest-TestServerBasicOps-1061145961 tempest-TestServerBasicOps-1061145961-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-205899550" status: 202 len: 0 microversion: 2.1 time: 0.048195 Aug 09 17:59:17.132166 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3001/6272] 10.222.0.93 () {58 vars in 1251 bytes} [Tue Aug 9 17:59:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-205899550 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 17:59:17.527670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e81c7fa-f897-4cad-8007-3c03f9ecf103 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:17.529574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6e81c7fa-f897-4cad-8007-3c03f9ecf103 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:17.547884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e81c7fa-f897-4cad-8007-3c03f9ecf103 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:17.565597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e81c7fa-f897-4cad-8007-3c03f9ecf103 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:17.566814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e81c7fa-f897-4cad-8007-3c03f9ecf103 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:17.568859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e81c7fa-f897-4cad-8007-3c03f9ecf103 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:17.573321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e81c7fa-f897-4cad-8007-3c03f9ecf103 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:17.575563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e81c7fa-f897-4cad-8007-3c03f9ecf103 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:17.823879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e81c7fa-f897-4cad-8007-3c03f9ecf103 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:17.834059 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e81c7fa-f897-4cad-8007-3c03f9ecf103 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1342 microversion: 2.1 time: 0.314854 Aug 09 17:59:17.834990 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3272/6273] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:17 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1342 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:18.857968 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-5eb1079e-2608-48db-a5a1-794f9a1c4ad5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:18.861359 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-5eb1079e-2608-48db-a5a1-794f9a1c4ad5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:18.871774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5eb1079e-2608-48db-a5a1-794f9a1c4ad5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:18.872587 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5eb1079e-2608-48db-a5a1-794f9a1c4ad5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:18.873407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5eb1079e-2608-48db-a5a1-794f9a1c4ad5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:18.874735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5eb1079e-2608-48db-a5a1-794f9a1c4ad5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:18.875582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5eb1079e-2608-48db-a5a1-794f9a1c4ad5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:18.876749 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-5eb1079e-2608-48db-a5a1-794f9a1c4ad5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:19.422163 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-5eb1079e-2608-48db-a5a1-794f9a1c4ad5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:19.441619 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-5eb1079e-2608-48db-a5a1-794f9a1c4ad5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1388 microversion: 2.1 time: 0.589324 Aug 09 17:59:19.460450 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3002/6274] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:18 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1388 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:20.482560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-05e74390-90b9-4436-894f-b9351578eed1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:20.487685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-05e74390-90b9-4436-894f-b9351578eed1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:20.516048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e74390-90b9-4436-894f-b9351578eed1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:20.517028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e74390-90b9-4436-894f-b9351578eed1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:20.517958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e74390-90b9-4436-894f-b9351578eed1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:20.527915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e74390-90b9-4436-894f-b9351578eed1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:20.529753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e74390-90b9-4436-894f-b9351578eed1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:20.531041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05e74390-90b9-4436-894f-b9351578eed1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:20.947903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-05e74390-90b9-4436-894f-b9351578eed1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:20.989203 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-05e74390-90b9-4436-894f-b9351578eed1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1376 microversion: 2.1 time: 0.512179 Aug 09 17:59:21.009767 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3273/6275] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:20 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1376 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:22.029680 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-e318e861-279c-432b-a11f-fcb8b25a1175 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:22.040292 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-e318e861-279c-432b-a11f-fcb8b25a1175 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:22.062036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e318e861-279c-432b-a11f-fcb8b25a1175 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:22.063335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e318e861-279c-432b-a11f-fcb8b25a1175 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:22.064311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e318e861-279c-432b-a11f-fcb8b25a1175 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:22.065760 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e318e861-279c-432b-a11f-fcb8b25a1175 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:22.066717 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e318e861-279c-432b-a11f-fcb8b25a1175 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:22.068145 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-e318e861-279c-432b-a11f-fcb8b25a1175 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:22.547081 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-e318e861-279c-432b-a11f-fcb8b25a1175 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:22.578596 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-e318e861-279c-432b-a11f-fcb8b25a1175 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1376 microversion: 2.1 time: 0.556535 Aug 09 17:59:22.580041 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3003/6276] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:22 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1376 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:23.618894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a300385c-fb01-4477-88a6-96870f7e95cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:23.620307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a300385c-fb01-4477-88a6-96870f7e95cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:23.634691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a300385c-fb01-4477-88a6-96870f7e95cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:23.636038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a300385c-fb01-4477-88a6-96870f7e95cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:23.637244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a300385c-fb01-4477-88a6-96870f7e95cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:23.638559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a300385c-fb01-4477-88a6-96870f7e95cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:23.639526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a300385c-fb01-4477-88a6-96870f7e95cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:23.640343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a300385c-fb01-4477-88a6-96870f7e95cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:24.309508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a300385c-fb01-4477-88a6-96870f7e95cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:24.324801 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a300385c-fb01-4477-88a6-96870f7e95cc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1376 microversion: 2.1 time: 0.713513 Aug 09 17:59:24.327583 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3274/6277] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:23 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1376 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:25.362765 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2daceae5-0f6e-4401-809e-ef9d5c1c5b06 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:25.365621 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2daceae5-0f6e-4401-809e-ef9d5c1c5b06 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:25.390407 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2daceae5-0f6e-4401-809e-ef9d5c1c5b06 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:25.391422 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2daceae5-0f6e-4401-809e-ef9d5c1c5b06 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:25.401991 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2daceae5-0f6e-4401-809e-ef9d5c1c5b06 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:25.403288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2daceae5-0f6e-4401-809e-ef9d5c1c5b06 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:25.404074 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2daceae5-0f6e-4401-809e-ef9d5c1c5b06 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:25.404725 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2daceae5-0f6e-4401-809e-ef9d5c1c5b06 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:25.623304 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2daceae5-0f6e-4401-809e-ef9d5c1c5b06 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:25.631562 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2daceae5-0f6e-4401-809e-ef9d5c1c5b06 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1376 microversion: 2.1 time: 0.276117 Aug 09 17:59:25.632640 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3004/6278] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:25 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1376 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:26.653869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d718e56-e644-438c-99ce-1e36de18b201 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:26.654939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d718e56-e644-438c-99ce-1e36de18b201 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:26.663649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d718e56-e644-438c-99ce-1e36de18b201 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:26.665002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d718e56-e644-438c-99ce-1e36de18b201 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:26.665789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d718e56-e644-438c-99ce-1e36de18b201 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:26.666808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d718e56-e644-438c-99ce-1e36de18b201 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:26.667444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d718e56-e644-438c-99ce-1e36de18b201 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:26.668063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d718e56-e644-438c-99ce-1e36de18b201 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:26.986354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8d718e56-e644-438c-99ce-1e36de18b201 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:27.003565 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d718e56-e644-438c-99ce-1e36de18b201 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1376 microversion: 2.1 time: 0.353141 Aug 09 17:59:27.021048 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3275/6279] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:26 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1376 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:28.054741 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-279d8e04-90ed-4f65-9777-eb00b46ff253 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:28.064644 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-279d8e04-90ed-4f65-9777-eb00b46ff253 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:28.078632 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-279d8e04-90ed-4f65-9777-eb00b46ff253 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:28.080009 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-279d8e04-90ed-4f65-9777-eb00b46ff253 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:28.080788 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-279d8e04-90ed-4f65-9777-eb00b46ff253 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:28.099383 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-279d8e04-90ed-4f65-9777-eb00b46ff253 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:28.104793 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-279d8e04-90ed-4f65-9777-eb00b46ff253 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:28.106588 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-279d8e04-90ed-4f65-9777-eb00b46ff253 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:28.476663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-279d8e04-90ed-4f65-9777-eb00b46ff253 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:28.501570 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-279d8e04-90ed-4f65-9777-eb00b46ff253 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1376 microversion: 2.1 time: 0.465555 Aug 09 17:59:28.502721 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3005/6280] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:28 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1376 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:29.184993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6776b0aa-c0e8-46ae-b377-b68141e0e3a6 req-f559b59d-d236-440d-9a51-d75a82fffe83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3598e1c5-4a62-48f8-9e17-273953d040ff", "name": "network-vif-plugged", "status": "completed", "tag": "9cb380cb-e49b-4f52-889f-300486f8f8e0"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:29.211781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6776b0aa-c0e8-46ae-b377-b68141e0e3a6 req-f559b59d-d236-440d-9a51-d75a82fffe83 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:29.213620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6776b0aa-c0e8-46ae-b377-b68141e0e3a6 req-f559b59d-d236-440d-9a51-d75a82fffe83 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:29.216156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6776b0aa-c0e8-46ae-b377-b68141e0e3a6 req-f559b59d-d236-440d-9a51-d75a82fffe83 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:29.251060 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6776b0aa-c0e8-46ae-b377-b68141e0e3a6 req-f559b59d-d236-440d-9a51-d75a82fffe83 service nova] Creating event network-vif-plugged:9cb380cb-e49b-4f52-889f-300486f8f8e0 for instance 3598e1c5-4a62-48f8-9e17-273953d040ff on n-h1-845781-6 Aug 09 17:59:29.261708 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6776b0aa-c0e8-46ae-b377-b68141e0e3a6 req-f559b59d-d236-440d-9a51-d75a82fffe83 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085709 Aug 09 17:59:29.263450 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3276/6281] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:59:29.538839 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-eeada64e-752e-409e-970c-acaa991352ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:29.540735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-eeada64e-752e-409e-970c-acaa991352ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:29.551913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eeada64e-752e-409e-970c-acaa991352ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:29.552463 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eeada64e-752e-409e-970c-acaa991352ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:29.552930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eeada64e-752e-409e-970c-acaa991352ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:29.553726 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eeada64e-752e-409e-970c-acaa991352ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:29.554199 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eeada64e-752e-409e-970c-acaa991352ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:29.554631 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-eeada64e-752e-409e-970c-acaa991352ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:29.762728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-eeada64e-752e-409e-970c-acaa991352ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:29.785483 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-eeada64e-752e-409e-970c-acaa991352ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1376 microversion: 2.1 time: 0.252272 Aug 09 17:59:29.787649 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3006/6282] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:29 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1376 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:30.841849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f2fcf7db-f3d2-4d2f-9a3a-6ffdd618af1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:30.843327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f2fcf7db-f3d2-4d2f-9a3a-6ffdd618af1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:30.852723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2fcf7db-f3d2-4d2f-9a3a-6ffdd618af1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:30.853668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2fcf7db-f3d2-4d2f-9a3a-6ffdd618af1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:30.854396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2fcf7db-f3d2-4d2f-9a3a-6ffdd618af1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:30.855379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2fcf7db-f3d2-4d2f-9a3a-6ffdd618af1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:30.856346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2fcf7db-f3d2-4d2f-9a3a-6ffdd618af1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:30.857052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2fcf7db-f3d2-4d2f-9a3a-6ffdd618af1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:31.140168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f2fcf7db-f3d2-4d2f-9a3a-6ffdd618af1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:31.161404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f2fcf7db-f3d2-4d2f-9a3a-6ffdd618af1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1562 microversion: 2.1 time: 0.328347 Aug 09 17:59:31.163565 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3277/6283] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:30 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1562 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:31.215604 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-fdd44ca6-9ec6-44a6-86e2-e1cb84d337d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:31.217210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-fdd44ca6-9ec6-44a6-86e2-e1cb84d337d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:31.226594 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd44ca6-9ec6-44a6-86e2-e1cb84d337d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:31.227302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd44ca6-9ec6-44a6-86e2-e1cb84d337d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:31.227667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd44ca6-9ec6-44a6-86e2-e1cb84d337d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:31.228518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd44ca6-9ec6-44a6-86e2-e1cb84d337d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:31.229032 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd44ca6-9ec6-44a6-86e2-e1cb84d337d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:31.229497 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-fdd44ca6-9ec6-44a6-86e2-e1cb84d337d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:31.516862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-fdd44ca6-9ec6-44a6-86e2-e1cb84d337d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:31.533059 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-fdd44ca6-9ec6-44a6-86e2-e1cb84d337d6 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1562 microversion: 2.1 time: 0.324936 Aug 09 17:59:31.534373 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3007/6284] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:31 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1562 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:31.739973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e661b96a-bd8c-41ba-99e9-a57ddfa68c3c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:31.740685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e661b96a-bd8c-41ba-99e9-a57ddfa68c3c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:31.750583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e661b96a-bd8c-41ba-99e9-a57ddfa68c3c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:31.751439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e661b96a-bd8c-41ba-99e9-a57ddfa68c3c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:31.752279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e661b96a-bd8c-41ba-99e9-a57ddfa68c3c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:31.753393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e661b96a-bd8c-41ba-99e9-a57ddfa68c3c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:31.754218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e661b96a-bd8c-41ba-99e9-a57ddfa68c3c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:31.755183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e661b96a-bd8c-41ba-99e9-a57ddfa68c3c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:31.795905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e661b96a-bd8c-41ba-99e9-a57ddfa68c3c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:59:31.861591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:31.903992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e661b96a-bd8c-41ba-99e9-a57ddfa68c3c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 204 len: 0 microversion: 2.1 time: 0.169824 Aug 09 17:59:31.903992 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3278/6285] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:59:31 2022] DELETE /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:59:31.919275 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-776519fc-b210-4f7e-afbc-544ad58359e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:31.921060 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-776519fc-b210-4f7e-afbc-544ad58359e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:31.937773 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-776519fc-b210-4f7e-afbc-544ad58359e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:31.939549 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-776519fc-b210-4f7e-afbc-544ad58359e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:31.941455 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-776519fc-b210-4f7e-afbc-544ad58359e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:31.945554 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-776519fc-b210-4f7e-afbc-544ad58359e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:31.948512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-776519fc-b210-4f7e-afbc-544ad58359e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:31.949446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-776519fc-b210-4f7e-afbc-544ad58359e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:32.183816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-776519fc-b210-4f7e-afbc-544ad58359e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:32.201458 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-776519fc-b210-4f7e-afbc-544ad58359e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1568 microversion: 2.1 time: 0.289243 Aug 09 17:59:32.202708 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3008/6286] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:31 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1568 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:33.226548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c59c806a-448f-4003-bb19-152025215625 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:33.227539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c59c806a-448f-4003-bb19-152025215625 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:33.236356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c59c806a-448f-4003-bb19-152025215625 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:33.237105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c59c806a-448f-4003-bb19-152025215625 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:33.237583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c59c806a-448f-4003-bb19-152025215625 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:33.238333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c59c806a-448f-4003-bb19-152025215625 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:33.239298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c59c806a-448f-4003-bb19-152025215625 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:33.239827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c59c806a-448f-4003-bb19-152025215625 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:33.505753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c59c806a-448f-4003-bb19-152025215625 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:33.514868 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c59c806a-448f-4003-bb19-152025215625 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1568 microversion: 2.1 time: 0.293400 Aug 09 17:59:33.515836 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3279/6287] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:33 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1568 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:34.267778 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-e81f2814-1991-467e-ad08-e41aeff6d27d req-e4fa7a8a-d31a-4119-91e5-df6ec345b523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3598e1c5-4a62-48f8-9e17-273953d040ff", "name": "network-vif-deleted", "tag": "9cb380cb-e49b-4f52-889f-300486f8f8e0"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:34.277732 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:34.285127 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e81f2814-1991-467e-ad08-e41aeff6d27d req-e4fa7a8a-d31a-4119-91e5-df6ec345b523 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:34.286487 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e81f2814-1991-467e-ad08-e41aeff6d27d req-e4fa7a8a-d31a-4119-91e5-df6ec345b523 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:34.287050 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-e81f2814-1991-467e-ad08-e41aeff6d27d req-e4fa7a8a-d31a-4119-91e5-df6ec345b523 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:34.316297 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-e81f2814-1991-467e-ad08-e41aeff6d27d req-e4fa7a8a-d31a-4119-91e5-df6ec345b523 service nova] Creating event network-vif-deleted:9cb380cb-e49b-4f52-889f-300486f8f8e0 for instance 3598e1c5-4a62-48f8-9e17-273953d040ff on n-h1-845781-6 Aug 09 17:59:34.334562 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-e81f2814-1991-467e-ad08-e41aeff6d27d req-e4fa7a8a-d31a-4119-91e5-df6ec345b523 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071864 Aug 09 17:59:34.336379 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3009/6288] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:59:34.540885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4c59a199-6d7a-43a3-9149-c15e04bad1e1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:34.542301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4c59a199-6d7a-43a3-9149-c15e04bad1e1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:34.546673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:34.557454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c59a199-6d7a-43a3-9149-c15e04bad1e1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:34.557819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c59a199-6d7a-43a3-9149-c15e04bad1e1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:34.558275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c59a199-6d7a-43a3-9149-c15e04bad1e1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:34.559004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c59a199-6d7a-43a3-9149-c15e04bad1e1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:34.559472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c59a199-6d7a-43a3-9149-c15e04bad1e1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:34.559933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c59a199-6d7a-43a3-9149-c15e04bad1e1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:34.634595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4c59a199-6d7a-43a3-9149-c15e04bad1e1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:34.645865 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4c59a199-6d7a-43a3-9149-c15e04bad1e1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1361 microversion: 2.1 time: 0.110729 Aug 09 17:59:34.646707 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3280/6289] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:34 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1361 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:35.673739 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-641d0cee-a546-4629-8b80-d3e7b28ed997 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:35.675101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-641d0cee-a546-4629-8b80-d3e7b28ed997 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:35.689767 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-641d0cee-a546-4629-8b80-d3e7b28ed997 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:35.690673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-641d0cee-a546-4629-8b80-d3e7b28ed997 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:35.691995 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-641d0cee-a546-4629-8b80-d3e7b28ed997 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:35.693301 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-641d0cee-a546-4629-8b80-d3e7b28ed997 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:35.694259 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-641d0cee-a546-4629-8b80-d3e7b28ed997 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:35.695058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-641d0cee-a546-4629-8b80-d3e7b28ed997 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:35.807027 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-641d0cee-a546-4629-8b80-d3e7b28ed997 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:35.823315 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-641d0cee-a546-4629-8b80-d3e7b28ed997 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1361 microversion: 2.1 time: 0.157478 Aug 09 17:59:35.824604 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3010/6290] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:35 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:36.851525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e34e1171-848a-4a31-8717-3adf524b1f0d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:36.853458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e34e1171-848a-4a31-8717-3adf524b1f0d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:36.865471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e34e1171-848a-4a31-8717-3adf524b1f0d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:36.866028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e34e1171-848a-4a31-8717-3adf524b1f0d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:36.866906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e34e1171-848a-4a31-8717-3adf524b1f0d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:36.868219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e34e1171-848a-4a31-8717-3adf524b1f0d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:36.868890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e34e1171-848a-4a31-8717-3adf524b1f0d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:36.869511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e34e1171-848a-4a31-8717-3adf524b1f0d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:36.978002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e34e1171-848a-4a31-8717-3adf524b1f0d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:36.990949 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e34e1171-848a-4a31-8717-3adf524b1f0d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1361 microversion: 2.1 time: 0.145065 Aug 09 17:59:36.992012 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3281/6291] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:36 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:38.026443 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0a2fa673-821e-4034-bc0c-206b77c44568 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:38.027272 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0a2fa673-821e-4034-bc0c-206b77c44568 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:38.034428 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a2fa673-821e-4034-bc0c-206b77c44568 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:38.036470 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a2fa673-821e-4034-bc0c-206b77c44568 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:38.037217 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a2fa673-821e-4034-bc0c-206b77c44568 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:38.037973 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a2fa673-821e-4034-bc0c-206b77c44568 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:38.038628 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a2fa673-821e-4034-bc0c-206b77c44568 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:38.039254 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-0a2fa673-821e-4034-bc0c-206b77c44568 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:38.131922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0a2fa673-821e-4034-bc0c-206b77c44568 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:38.147350 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0a2fa673-821e-4034-bc0c-206b77c44568 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1361 microversion: 2.1 time: 0.124618 Aug 09 17:59:38.148737 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3011/6292] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:38 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1361 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:39.181982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af220802-1354-442b-a0dc-ed41e901a516 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:39.183233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-af220802-1354-442b-a0dc-ed41e901a516 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:39.194861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af220802-1354-442b-a0dc-ed41e901a516 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:39.195724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af220802-1354-442b-a0dc-ed41e901a516 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:39.196527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af220802-1354-442b-a0dc-ed41e901a516 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:39.197552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af220802-1354-442b-a0dc-ed41e901a516 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:39.198244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af220802-1354-442b-a0dc-ed41e901a516 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:39.199356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af220802-1354-442b-a0dc-ed41e901a516 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:39.310796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-af220802-1354-442b-a0dc-ed41e901a516 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:39.321618 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-af220802-1354-442b-a0dc-ed41e901a516 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1361 microversion: 2.1 time: 0.145885 Aug 09 17:59:39.337732 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3282/6293] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:39 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:40.351813 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:40.354898 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:40.373281 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:40.373872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:40.374271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:40.380461 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:40.380917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ed5473c-080b-47bf-a5dc-d58f3a47e4e3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:40.381663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:40.382999 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:40.384790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7ed5473c-080b-47bf-a5dc-d58f3a47e4e3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:40.400108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed5473c-080b-47bf-a5dc-d58f3a47e4e3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:40.401195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed5473c-080b-47bf-a5dc-d58f3a47e4e3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:40.402162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed5473c-080b-47bf-a5dc-d58f3a47e4e3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:40.403347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed5473c-080b-47bf-a5dc-d58f3a47e4e3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:40.404300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed5473c-080b-47bf-a5dc-d58f3a47e4e3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:40.405459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed5473c-080b-47bf-a5dc-d58f3a47e4e3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:40.428365 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=83 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:59:40.470363 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:40.471527 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:40.472622 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:40.473659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lazy-loading 'fault' on Instance uuid 3598e1c5-4a62-48f8-9e17-273953d040ff {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:59:40.534578 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:40.550109 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-936b24eb-b554-4c58-b16c-cf9d49fb5cbc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 200 len: 1366 microversion: 2.1 time: 0.207979 Aug 09 17:59:40.551944 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3012/6294] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:40 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:40.558334 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ed5473c-080b-47bf-a5dc-d58f3a47e4e3 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "POST /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8/action" status: 200 len: 24565 microversion: 2.1 time: 0.184794 Aug 09 17:59:40.560304 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3283/6295] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 17:59:40 2022] POST /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8/action => generated 24565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 17:59:41.587583 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:41.588490 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:41.596796 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:41.598095 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:41.598582 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:41.599346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:41.599868 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:41.600323 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:41.617702 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: request: GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff HTTP/1.1 Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '3598e1c5-4a62-48f8-9e17-273953d040ff'} Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:41.619663 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:41.630935 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:41.630935 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:41.630935 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:41.630935 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:59:41.630935 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:59:41.630935 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:41.630935 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:41.630935 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:59:41.630935 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8fa5f96c-c80e-4bfe-b1eb-d66752f259ef tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 404 len: 111 microversion: 2.1 time: 0.038306 Aug 09 17:59:41.630935 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3013/6296] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:41 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:59:46.144004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-209acb81-d45b-4f69-824d-0ff3d0d26bf7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:46.145677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-209acb81-d45b-4f69-824d-0ff3d0d26bf7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:46.164917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209acb81-d45b-4f69-824d-0ff3d0d26bf7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:46.165827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209acb81-d45b-4f69-824d-0ff3d0d26bf7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:46.166638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209acb81-d45b-4f69-824d-0ff3d0d26bf7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:46.168071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209acb81-d45b-4f69-824d-0ff3d0d26bf7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:46.168881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209acb81-d45b-4f69-824d-0ff3d0d26bf7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:46.169741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209acb81-d45b-4f69-824d-0ff3d0d26bf7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:46.224824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-209acb81-d45b-4f69-824d-0ff3d0d26bf7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:59:46.353606 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-209acb81-d45b-4f69-824d-0ff3d0d26bf7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 204 len: 0 microversion: 2.1 time: 0.220769 Aug 09 17:59:46.354579 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3284/6297] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:59:46 2022] DELETE /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:59:46.367394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2dff4887-5aaf-435d-9319-1568d0d51124 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:46.368508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2dff4887-5aaf-435d-9319-1568d0d51124 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:46.379133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dff4887-5aaf-435d-9319-1568d0d51124 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:46.379916 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dff4887-5aaf-435d-9319-1568d0d51124 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:46.380522 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dff4887-5aaf-435d-9319-1568d0d51124 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:46.381575 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dff4887-5aaf-435d-9319-1568d0d51124 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:46.382626 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dff4887-5aaf-435d-9319-1568d0d51124 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:46.383425 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2dff4887-5aaf-435d-9319-1568d0d51124 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:46.565030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-2dff4887-5aaf-435d-9319-1568d0d51124 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:46.574555 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2dff4887-5aaf-435d-9319-1568d0d51124 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1410 microversion: 2.1 time: 0.214066 Aug 09 17:59:46.575318 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3014/6298] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:46 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1410 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:47.606427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-02d670ab-1136-4e47-92ab-67bf77c6022c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:47.607356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-02d670ab-1136-4e47-92ab-67bf77c6022c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:47.619195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d670ab-1136-4e47-92ab-67bf77c6022c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:47.619736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d670ab-1136-4e47-92ab-67bf77c6022c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:47.620175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d670ab-1136-4e47-92ab-67bf77c6022c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:47.621134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d670ab-1136-4e47-92ab-67bf77c6022c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:47.621596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d670ab-1136-4e47-92ab-67bf77c6022c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:47.622051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02d670ab-1136-4e47-92ab-67bf77c6022c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:47.826086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-02d670ab-1136-4e47-92ab-67bf77c6022c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:47.837297 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-02d670ab-1136-4e47-92ab-67bf77c6022c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1410 microversion: 2.1 time: 0.235351 Aug 09 17:59:47.838262 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3285/6299] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:47 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1410 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:48.870569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-93b45600-cfc9-41bb-8cfa-1b1d6424d7bf req-a4e50460-5f84-4ebb-a21c-071e31613f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb862d8-4474-4cf8-8f14-b262d2f0ab2c", "name": "network-vif-deleted", "tag": "7e95bc7f-6a11-4099-9fa1-0a3f2bf13541"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:48.871665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1928f11e-cb1e-4bb3-a27f-eb46df14abee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:48.874105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1928f11e-cb1e-4bb3-a27f-eb46df14abee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:48.888900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1928f11e-cb1e-4bb3-a27f-eb46df14abee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:48.896687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-93b45600-cfc9-41bb-8cfa-1b1d6424d7bf req-a4e50460-5f84-4ebb-a21c-071e31613f9d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:48.898195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-93b45600-cfc9-41bb-8cfa-1b1d6424d7bf req-a4e50460-5f84-4ebb-a21c-071e31613f9d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:48.899100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1928f11e-cb1e-4bb3-a27f-eb46df14abee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:48.899898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1928f11e-cb1e-4bb3-a27f-eb46df14abee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:48.901087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1928f11e-cb1e-4bb3-a27f-eb46df14abee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:48.901863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1928f11e-cb1e-4bb3-a27f-eb46df14abee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:48.902252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-93b45600-cfc9-41bb-8cfa-1b1d6424d7bf req-a4e50460-5f84-4ebb-a21c-071e31613f9d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:48.902656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1928f11e-cb1e-4bb3-a27f-eb46df14abee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:48.944266 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-93b45600-cfc9-41bb-8cfa-1b1d6424d7bf req-a4e50460-5f84-4ebb-a21c-071e31613f9d service nova] Creating event network-vif-deleted:7e95bc7f-6a11-4099-9fa1-0a3f2bf13541 for instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c on n-h2-845781-6 Aug 09 17:59:48.969141 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-93b45600-cfc9-41bb-8cfa-1b1d6424d7bf req-a4e50460-5f84-4ebb-a21c-071e31613f9d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.434949 Aug 09 17:59:48.973051 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3015/6300] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:59:49.031055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1928f11e-cb1e-4bb3-a27f-eb46df14abee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:49.049412 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1928f11e-cb1e-4bb3-a27f-eb46df14abee tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1202 microversion: 2.1 time: 0.184280 Aug 09 17:59:49.051785 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3286/6301] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:48 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1202 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:50.072059 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-b470e724-1f79-4106-8f62-d45ad871d51c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:50.072802 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-b470e724-1f79-4106-8f62-d45ad871d51c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:50.080619 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b470e724-1f79-4106-8f62-d45ad871d51c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:50.081130 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b470e724-1f79-4106-8f62-d45ad871d51c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:50.081636 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b470e724-1f79-4106-8f62-d45ad871d51c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:50.082398 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b470e724-1f79-4106-8f62-d45ad871d51c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:50.082872 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b470e724-1f79-4106-8f62-d45ad871d51c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:50.083316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-b470e724-1f79-4106-8f62-d45ad871d51c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:50.177505 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-b470e724-1f79-4106-8f62-d45ad871d51c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:50.186885 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-b470e724-1f79-4106-8f62-d45ad871d51c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1202 microversion: 2.1 time: 0.119415 Aug 09 17:59:50.187513 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3016/6302] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:50 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1202 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:51.215344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d697f9cc-1424-4766-884f-d72d14125d54 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:51.217180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d697f9cc-1424-4766-884f-d72d14125d54 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:51.231586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d697f9cc-1424-4766-884f-d72d14125d54 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:51.232635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d697f9cc-1424-4766-884f-d72d14125d54 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:51.233531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d697f9cc-1424-4766-884f-d72d14125d54 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:51.235224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d697f9cc-1424-4766-884f-d72d14125d54 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:51.236195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d697f9cc-1424-4766-884f-d72d14125d54 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:51.237498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d697f9cc-1424-4766-884f-d72d14125d54 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:51.341359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d697f9cc-1424-4766-884f-d72d14125d54 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:51.360887 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d697f9cc-1424-4766-884f-d72d14125d54 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1202 microversion: 2.1 time: 0.152716 Aug 09 17:59:51.362942 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3287/6303] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:51 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:52.386771 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ee418af7-4e96-4dc4-9dd7-531aeec815dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:52.387500 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ee418af7-4e96-4dc4-9dd7-531aeec815dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:52.416691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee418af7-4e96-4dc4-9dd7-531aeec815dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:52.418659 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee418af7-4e96-4dc4-9dd7-531aeec815dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:52.419816 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee418af7-4e96-4dc4-9dd7-531aeec815dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:52.421580 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee418af7-4e96-4dc4-9dd7-531aeec815dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:52.422974 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee418af7-4e96-4dc4-9dd7-531aeec815dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:52.424147 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ee418af7-4e96-4dc4-9dd7-531aeec815dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:52.529183 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-ee418af7-4e96-4dc4-9dd7-531aeec815dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:52.545392 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ee418af7-4e96-4dc4-9dd7-531aeec815dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1202 microversion: 2.1 time: 0.163371 Aug 09 17:59:52.560063 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3017/6304] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:52 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1202 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:53.462252 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-9de12592-43f5-482e-9535-21cdd5ff9d74 req-856159bf-7208-461c-8bae-5ba22a65af83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "380cdb00-065d-4575-8ef8-5b7785df5fa8", "tag": "b6759686-f390-435c-8776-87bfc88a176f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:53.466132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e545b3fe-b00e-442c-b7d6-2042c48f2370 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:53.467928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e545b3fe-b00e-442c-b7d6-2042c48f2370 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:53.488771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e545b3fe-b00e-442c-b7d6-2042c48f2370 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:53.492047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e545b3fe-b00e-442c-b7d6-2042c48f2370 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:53.492800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e545b3fe-b00e-442c-b7d6-2042c48f2370 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:53.494387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e545b3fe-b00e-442c-b7d6-2042c48f2370 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:53.497236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9de12592-43f5-482e-9535-21cdd5ff9d74 req-856159bf-7208-461c-8bae-5ba22a65af83 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:53.498225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e545b3fe-b00e-442c-b7d6-2042c48f2370 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:53.498978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e545b3fe-b00e-442c-b7d6-2042c48f2370 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:53.505674 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9de12592-43f5-482e-9535-21cdd5ff9d74 req-856159bf-7208-461c-8bae-5ba22a65af83 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:53.506537 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-9de12592-43f5-482e-9535-21cdd5ff9d74 req-856159bf-7208-461c-8bae-5ba22a65af83 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:53.547198 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-9de12592-43f5-482e-9535-21cdd5ff9d74 req-856159bf-7208-461c-8bae-5ba22a65af83 service nova] Creating event network-changed:b6759686-f390-435c-8776-87bfc88a176f for instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 on n-h1-845781-6 Aug 09 17:59:53.564430 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-9de12592-43f5-482e-9535-21cdd5ff9d74 req-856159bf-7208-461c-8bae-5ba22a65af83 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108210 Aug 09 17:59:53.570425 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3018/6305] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:59:53.590072 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3473132d-9e0f-400b-bf1b-4fdf959023ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:53.593008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e545b3fe-b00e-442c-b7d6-2042c48f2370 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:59:53.595553 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3473132d-9e0f-400b-bf1b-4fdf959023ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:53.631694 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3473132d-9e0f-400b-bf1b-4fdf959023ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:53.633037 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3473132d-9e0f-400b-bf1b-4fdf959023ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:53.634221 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3473132d-9e0f-400b-bf1b-4fdf959023ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:53.635853 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3473132d-9e0f-400b-bf1b-4fdf959023ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:53.636930 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3473132d-9e0f-400b-bf1b-4fdf959023ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:53.639031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3473132d-9e0f-400b-bf1b-4fdf959023ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:53.793668 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e545b3fe-b00e-442c-b7d6-2042c48f2370 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "DELETE /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 204 len: 0 microversion: 2.1 time: 0.343358 Aug 09 17:59:53.794309 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3288/6306] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:59:53 2022] DELETE /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 17:59:53.814972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ed01457-d9fc-4c9f-932e-3dda56382e05 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:53.817826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7ed01457-d9fc-4c9f-932e-3dda56382e05 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:53.833263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed01457-d9fc-4c9f-932e-3dda56382e05 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:53.834496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed01457-d9fc-4c9f-932e-3dda56382e05 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:53.835507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed01457-d9fc-4c9f-932e-3dda56382e05 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:53.836678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed01457-d9fc-4c9f-932e-3dda56382e05 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:53.837803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed01457-d9fc-4c9f-932e-3dda56382e05 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:53.838432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed01457-d9fc-4c9f-932e-3dda56382e05 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:53.856416 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-3473132d-9e0f-400b-bf1b-4fdf959023ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:53.885990 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3473132d-9e0f-400b-bf1b-4fdf959023ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1202 microversion: 2.1 time: 0.312829 Aug 09 17:59:53.900734 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3019/6307] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:53 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1202 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:54.055366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7ed01457-d9fc-4c9f-932e-3dda56382e05 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:54.066481 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ed01457-d9fc-4c9f-932e-3dda56382e05 tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1685 microversion: 2.1 time: 0.255295 Aug 09 17:59:54.068371 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3289/6308] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:53 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1685 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:59:54.910847 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:54.912494 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:54.921512 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:54.922485 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:54.923155 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:54.924409 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:54.926106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:54.928271 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:55.030836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:55.031347 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:55.031871 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:55.032354 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lazy-loading 'fault' on Instance uuid 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:59:55.097086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67091e08-63a3-43c8-b817-1685a47d7dba tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:55.101082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-67091e08-63a3-43c8-b817-1685a47d7dba tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:55.155304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67091e08-63a3-43c8-b817-1685a47d7dba tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:55.156023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67091e08-63a3-43c8-b817-1685a47d7dba tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:55.170357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67091e08-63a3-43c8-b817-1685a47d7dba tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:55.178402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67091e08-63a3-43c8-b817-1685a47d7dba tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:55.181880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67091e08-63a3-43c8-b817-1685a47d7dba tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:55.183143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67091e08-63a3-43c8-b817-1685a47d7dba tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:55.209491 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:55.227044 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-04e9c814-527d-4624-842f-747776efe08c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 200 len: 1161 microversion: 2.1 time: 0.322057 Aug 09 17:59:55.233006 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3020/6309] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:54 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 1161 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:55.481382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-67091e08-63a3-43c8-b817-1685a47d7dba tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:55.491372 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-67091e08-63a3-43c8-b817-1685a47d7dba tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1685 microversion: 2.1 time: 0.405286 Aug 09 17:59:55.507694 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3290/6310] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:55 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1685 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:56.148922 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-973b4e1a-2a46-43be-b1e0-f9790b1025ef req-69768e42-83cb-4361-8b38-67763a3ff201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "380cdb00-065d-4575-8ef8-5b7785df5fa8", "name": "network-vif-deleted", "tag": "b6759686-f390-435c-8776-87bfc88a176f"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:59:56.161043 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-973b4e1a-2a46-43be-b1e0-f9790b1025ef req-69768e42-83cb-4361-8b38-67763a3ff201 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:56.161687 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-973b4e1a-2a46-43be-b1e0-f9790b1025ef req-69768e42-83cb-4361-8b38-67763a3ff201 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:56.162477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-973b4e1a-2a46-43be-b1e0-f9790b1025ef req-69768e42-83cb-4361-8b38-67763a3ff201 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:56.182321 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-973b4e1a-2a46-43be-b1e0-f9790b1025ef req-69768e42-83cb-4361-8b38-67763a3ff201 service nova] Creating event network-vif-deleted:b6759686-f390-435c-8776-87bfc88a176f for instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 on n-h1-845781-6 Aug 09 17:59:56.188312 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-973b4e1a-2a46-43be-b1e0-f9790b1025ef req-69768e42-83cb-4361-8b38-67763a3ff201 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043513 Aug 09 17:59:56.192826 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3021/6311] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 17:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:59:56.260976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:56.261831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:56.270144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:56.270783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:56.271314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:56.272154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:56.272703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:56.273222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:56.289651 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c HTTP/1.1 Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8eb862d8-4474-4cf8-8f14-b262d2f0ab2c'} Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:56.291545 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:56.296781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:56.296781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:56.296781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:56.296781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:59:56.296781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:59:56.296781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 17:59:56.296781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:56.296781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:59:56.298609 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b80a2422-fdd0-4004-819a-524c8461a2db tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 404 len: 111 microversion: 2.1 time: 0.042282 Aug 09 17:59:56.300421 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3291/6312] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:56 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:59:56.524358 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:56.525598 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:56.537516 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:56.538345 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:56.539004 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:56.541920 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:56.542711 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:56.543371 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:56.610029 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:56.611595 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:56.612818 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:56.614164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lazy-loading 'fault' on Instance uuid 380cdb00-065d-4575-8ef8-5b7785df5fa8 {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:59:56.705543 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a343f75165674844a2e9e46500fa01c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060105d0d71644839935005af8ad1bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:59:56.722575 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-f1a8b0bf-da0a-45e5-b775-1fb0f1178e1d tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 200 len: 1354 microversion: 2.1 time: 0.202293 Aug 09 17:59:56.724302 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3022/6313] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:56 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 1354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:59:57.753850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:57.754893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] [instance: 380cdb00-065d-4575-8ef8-5b7785df5fa8] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:57.764447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:57.765189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:57.765861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:57.767037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:57.767795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:57.768958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:57.788626 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] HTTP exception thrown: Instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 could not be found. Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Request method failure captured: Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 HTTP/1.1 Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p5yR1vvXdoHF6Ye4OkNhkM0OM2jWQEtgxloVubvvpM1GvnEKWmLvq_LisffgRln3d8YjK5jNj034a5fZK1hfamQn32lQw79jkbHDA9No0pavvPRNmpI4Zrw53leLAXhgbg98UjYYgE3lTGBb7Ptu6pOydP_Ub-aqj0vIBjuHGJazf4 Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 060105d0d71644839935005af8ad1bda Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_060105d0d71644839935005af8ad1bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/060105d0d71644839935005af8ad1bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/060105d0d71644839935005af8ad1bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/060105d0d71644839935005af8ad1bda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 060105d0d71644839935005af8ad1bda Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-278625738 Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestNetworkAdvancedServerOps-278625738-project Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a343f75165674844a2e9e46500fa01c0 Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestNetworkAdvancedServerOps-278625738-project Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 could not be found. Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '380cdb00-065d-4575-8ef8-5b7785df5fa8'} Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 could not be found. Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 could not be found. Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:57.791942 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:57.799397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:57.799397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:57.799397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:57.799397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:57.799397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:59:57.799397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:59:57.799397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 could not be found. Aug 09 17:59:57.799397 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:57.801860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Returning 404 to user: Instance 380cdb00-065d-4575-8ef8-5b7785df5fa8 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:59:57.802817 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5b6cf676-c323-4cd6-81aa-bb1c632d4d3e tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8" status: 404 len: 111 microversion: 2.1 time: 0.053517 Aug 09 17:59:57.803503 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3292/6314] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:57 2022] GET /compute/v2.1/servers/380cdb00-065d-4575-8ef8-5b7785df5fa8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:59:58.573101 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:58.574864 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:58.587561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:58.588728 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:58.589707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:58.592283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:58.593561 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:58.594465 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:58.619485 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff HTTP/1.1 Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '3598e1c5-4a62-48f8-9e17-273953d040ff'} Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:59:58.623862 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:59:58.632572 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:58.632572 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:58.632572 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:58.632572 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:58.632572 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:58.632572 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:58.632572 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:58.632572 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:59:58.632572 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:59:58.632572 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:58.632572 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:58.637646 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:59:58.639354 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-2464326e-29d9-4437-b254-e4f04c56d0b8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 404 len: 111 microversion: 2.1 time: 0.073282 Aug 09 17:59:58.640922 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3023/6315] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:59:58 2022] DELETE /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:59:58.669471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:58.670822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 3598e1c5-4a62-48f8-9e17-273953d040ff] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:58.682095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:58.683086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:58.684046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:58.685404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:58.686664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:58.687764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:58.722815 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff HTTP/1.1 Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '3598e1c5-4a62-48f8-9e17-273953d040ff'} Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:58.726607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:58.736358 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:58.736358 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:58.736358 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:58.736358 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:59:58.736358 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:59:58.736358 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. Aug 09 17:59:58.736358 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 17:59:58.742259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 3598e1c5-4a62-48f8-9e17-273953d040ff could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:59:58.742259 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8de8b881-1a37-4c5c-bdb9-1dd03f0b1777 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff" status: 404 len: 111 microversion: 2.1 time: 0.093107 Aug 09 17:59:58.743033 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3293/6316] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:58 2022] GET /compute/v2.1/servers/3598e1c5-4a62-48f8-9e17-273953d040ff => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:59:59.817263 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:59.818523 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:59.831713 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:59.835381 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:59.835534 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:59.836315 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:59.836792 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:59.839769 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:59.867914 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.wsgi [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: request: DELETE /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c HTTP/1.1 Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: Accept: application/json Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: Accept-Encoding: identity Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: Connection: close Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: Content-Length: 0 Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: Content-Type: application/json Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: Host: 10.222.0.93 Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: Openstack-System-Scope: None Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: User-Agent: python-urllib3/1.26.11 Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Id: None Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Domain-Name: None Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Identity-Status: Confirmed Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Is-Admin-Project: True Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Id: default Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Domain-Name: Default Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Role: reader,member Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Roles: reader,member Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Id: default Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-User-Domain-Name: Default Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: method: > Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: exception: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: action_args: {'id': '8eb862d8-4474-4cf8-8f14-b262d2f0ab2c'} Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:59:59.871672 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: ERROR nova.api.openstack.wsgi Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. {{(pid=119432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:59:59.876649 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ca1ac94a-c9cf-4f04-8241-4f5ab35eb9f3 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 404 len: 111 microversion: 2.1 time: 0.061826 Aug 09 17:59:59.883902 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3024/6317] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 17:59:59 2022] DELETE /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:59:59.903668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:59:59.904766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:59:59.936875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:59.941749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:59.943187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:59.951871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:59:59.957625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:59:59.958547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:59:59.997285 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c HTTP/1.1 Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8eb862d8-4474-4cf8-8f14-b262d2f0ab2c'} Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:00.001495 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:00:00.013121 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:00.013121 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:00.013121 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:00.013121 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:00:00.013121 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:00:00.013121 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. Aug 09 18:00:00.013121 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:00:00.013121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 8eb862d8-4474-4cf8-8f14-b262d2f0ab2c could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:00:00.013121 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e53e38c0-3928-4977-bb81-15dc8866c032 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c" status: 404 len: 111 microversion: 2.1 time: 0.124640 Aug 09 18:00:00.013121 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3294/6318] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 17:59:59 2022] GET /compute/v2.1/servers/8eb862d8-4474-4cf8-8f14-b262d2f0ab2c => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:00:00.151376 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-ab10fe95-70d2-46e9-80ad-8a657118dfdb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Action: 'create', calling method: .version_select at 0x7fbbcb73f9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-502915138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMANX/csNDywvte3kER/DFYuCTZTPUCDN/GbLsm2Y2uFt+FD+nZAWOv06eZHITfKAGa19+fSRe2+ylEw0TyHgFmR9kGlKz0NOcyT/HvSFVgawksj3iEtcHfZB55vXikj8A=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:00.190736 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ab10fe95-70d2-46e9-80ad-8a657118dfdb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for project 1c9fd65e58494f1195c0214732d873d3. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:00:00.203024 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-ab10fe95-70d2-46e9-80ad-8a657118dfdb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for user 87590ee7f71345a8914b350c5999d974 and project 1c9fd65e58494f1195c0214732d873d3. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:00:00.255455 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-ab10fe95-70d2-46e9-80ad-8a657118dfdb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.113389 Aug 09 18:00:00.267717 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3025/6319] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:00:00 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:03.931188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e7dd177-82de-4022-bfc6-f73ebb0f9aab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] Calling method '.version_select at 0x7fbbca560dc0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:03.967399 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e7dd177-82de-4022-bfc6-f73ebb0f9aab tempest-TestNetworkAdvancedServerOps-278625738 tempest-TestNetworkAdvancedServerOps-278625738-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-28664677" status: 202 len: 0 microversion: 2.1 time: 0.040182 Aug 09 18:00:03.972698 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3295/6320] 10.222.0.93 () {58 vars in 1278 bytes} [Tue Aug 9 18:00:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-28664677 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:00:08.657581 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-16540d1d-c9e8-40bd-b3b5-3bff2f4e888f tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Action: 'create', calling method: .version_select at 0x7fbbcaebbdc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1692144490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvCo6HqV55ukulvJYrRlwRHqN9EAK0ed4Yr+MkpJRfeKsAvP06rTXansMeqFfPYpRSPJu4UZuciDdiF3XhmjyLXNYg1IGMd2kOL3NA9h/rH+sxCmP9KoZpPHdoDyuQgDw=="}} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:08.667981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:08.686412 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-16540d1d-c9e8-40bd-b3b5-3bff2f4e888f tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Getting quotas for project c6ca8c6d12ff405ba78d24f194ebfbbb. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:00:08.694390 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.quota [None req-16540d1d-c9e8-40bd-b3b5-3bff2f4e888f tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Getting quotas for user e13314961e5349ddbaa3de9a92389740 and project c6ca8c6d12ff405ba78d24f194ebfbbb. Resources: {'key_pairs'} {{(pid=119432) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:00:08.730252 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-16540d1d-c9e8-40bd-b3b5-3bff2f4e888f tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.353413 Aug 09 18:00:08.731047 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3026/6321] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:00:08 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:19.505286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:19.507942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:19.516623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1985737170-access_point-816114771", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "42d0d334-e442-401e-abbd-96f343b76b34"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1692144490", "security_groups": [{"name": "tempest-secgroup_access--1646764472"}, {"name": "tempest-secgroup_general--1770746507"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:19.762318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] validate_networks() for [('42d0d334-e442-401e-abbd-96f343b76b34', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:00:19.914277 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c923e614-63cf-4b15-9eaf-afd0ac8aa408 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:19.915253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c923e614-63cf-4b15-9eaf-afd0ac8aa408 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:19.920006 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=59 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:19.921803 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=8 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:19.924426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:19.939954 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c923e614-63cf-4b15-9eaf-afd0ac8aa408 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:19.943030 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c923e614-63cf-4b15-9eaf-afd0ac8aa408 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:19.944547 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c923e614-63cf-4b15-9eaf-afd0ac8aa408 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:19.947023 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c923e614-63cf-4b15-9eaf-afd0ac8aa408 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:19.948335 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c923e614-63cf-4b15-9eaf-afd0ac8aa408 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:19.949444 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c923e614-63cf-4b15-9eaf-afd0ac8aa408 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.104062 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-c923e614-63cf-4b15-9eaf-afd0ac8aa408 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lazy-loading 'services' on Instance uuid 075f55a1-49ee-447f-9a6f-08bc280d905a {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:00:20.222304 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c923e614-63cf-4b15-9eaf-afd0ac8aa408 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a/os-volume_attachments/2aea68b7-598e-470f-a88f-2196b6c3ca3f" status: 202 len: 0 microversion: 2.1 time: 0.314523 Aug 09 18:00:20.224348 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3027/6322] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 18:00:19 2022] DELETE /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a/os-volume_attachments/2aea68b7-598e-470f-a88f-2196b6c3ca3f => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:00:20.567071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:00:20.567852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:00:20.568741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:00:20.569507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:00:20.570277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:00:20.593607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.594520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.595991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.598338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:20.599353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:20.600357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:20.639334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Getting quotas for project c6ca8c6d12ff405ba78d24f194ebfbbb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:00:20.646098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Getting quotas for user e13314961e5349ddbaa3de9a92389740 and project c6ca8c6d12ff405ba78d24f194ebfbbb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:00:20.662862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:00:20.665439 n-d-845781-6 devstack@n-api.service[119431]: WARNING nova.utils [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1985737170-access_point-816114771 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1985737170-ac Aug 09 18:00:20.666331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:00:20.739359 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-70b4ef39-1bf6-448c-852a-4f33f91509e7 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.232092 Aug 09 18:00:20.740147 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3296/6323] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:00:19 2022] POST /compute/v2.1/servers => generated 458 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:00:20.754164 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-56ac7bbf-38ce-480e-8528-110880970d6b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:20.754819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-56ac7bbf-38ce-480e-8528-110880970d6b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:20.831031 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-56ac7bbf-38ce-480e-8528-110880970d6b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:20.844097 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-56ac7bbf-38ce-480e-8528-110880970d6b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1294 microversion: 2.1 time: 0.095564 Aug 09 18:00:20.846797 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3028/6324] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:20 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:21.866525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5572af75-e184-46cb-9b04-fa9b90b28b87 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:21.868853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5572af75-e184-46cb-9b04-fa9b90b28b87 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:21.896966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5572af75-e184-46cb-9b04-fa9b90b28b87 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:21.897857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5572af75-e184-46cb-9b04-fa9b90b28b87 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:21.898543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5572af75-e184-46cb-9b04-fa9b90b28b87 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:21.899652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5572af75-e184-46cb-9b04-fa9b90b28b87 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:21.909128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5572af75-e184-46cb-9b04-fa9b90b28b87 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:21.909946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5572af75-e184-46cb-9b04-fa9b90b28b87 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:22.063009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5572af75-e184-46cb-9b04-fa9b90b28b87 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:22.077179 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5572af75-e184-46cb-9b04-fa9b90b28b87 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1290 microversion: 2.1 time: 0.214724 Aug 09 18:00:22.080101 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3297/6325] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:21 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1290 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:23.112426 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-994f82b6-5eef-4987-ba4b-9a06d2871356 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:23.113603 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-994f82b6-5eef-4987-ba4b-9a06d2871356 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:23.143150 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-994f82b6-5eef-4987-ba4b-9a06d2871356 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:23.156550 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-994f82b6-5eef-4987-ba4b-9a06d2871356 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:23.157260 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-994f82b6-5eef-4987-ba4b-9a06d2871356 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:23.158671 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-994f82b6-5eef-4987-ba4b-9a06d2871356 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:23.159261 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-994f82b6-5eef-4987-ba4b-9a06d2871356 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:23.160243 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-994f82b6-5eef-4987-ba4b-9a06d2871356 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:23.272877 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-994f82b6-5eef-4987-ba4b-9a06d2871356 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:23.293094 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-994f82b6-5eef-4987-ba4b-9a06d2871356 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1352 microversion: 2.1 time: 0.188707 Aug 09 18:00:23.294155 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3029/6326] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:23 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1352 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:24.318307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c34ea222-4ecb-4e6d-8787-b27da111e694 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:24.319104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c34ea222-4ecb-4e6d-8787-b27da111e694 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:24.346156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c34ea222-4ecb-4e6d-8787-b27da111e694 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:24.346705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c34ea222-4ecb-4e6d-8787-b27da111e694 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:24.347218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c34ea222-4ecb-4e6d-8787-b27da111e694 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:24.354073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c34ea222-4ecb-4e6d-8787-b27da111e694 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:24.354666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c34ea222-4ecb-4e6d-8787-b27da111e694 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:24.361398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c34ea222-4ecb-4e6d-8787-b27da111e694 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:24.619048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c34ea222-4ecb-4e6d-8787-b27da111e694 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:24.635153 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c34ea222-4ecb-4e6d-8787-b27da111e694 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1472 microversion: 2.1 time: 0.320678 Aug 09 18:00:24.637647 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3298/6327] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:24 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1472 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:25.233529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-c58742d7-6b6c-400d-b39e-eab2d3a72b44 req-7c3db78c-f09c-4d78-99d7-733cb7695294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6754133-c763-45e8-b470-3f97081aa609", "tag": "00433ca9-1703-4039-b1b1-9c203f121a0e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:25.249379 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c58742d7-6b6c-400d-b39e-eab2d3a72b44 req-7c3db78c-f09c-4d78-99d7-733cb7695294 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:25.250106 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c58742d7-6b6c-400d-b39e-eab2d3a72b44 req-7c3db78c-f09c-4d78-99d7-733cb7695294 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:25.250577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c58742d7-6b6c-400d-b39e-eab2d3a72b44 req-7c3db78c-f09c-4d78-99d7-733cb7695294 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:25.270423 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-c58742d7-6b6c-400d-b39e-eab2d3a72b44 req-7c3db78c-f09c-4d78-99d7-733cb7695294 service nova] Creating event network-changed:00433ca9-1703-4039-b1b1-9c203f121a0e for instance f6754133-c763-45e8-b470-3f97081aa609 on n-h2-845781-6 Aug 09 18:00:25.278469 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-c58742d7-6b6c-400d-b39e-eab2d3a72b44 req-7c3db78c-f09c-4d78-99d7-733cb7695294 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048401 Aug 09 18:00:25.279276 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3030/6328] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:00:25.677959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dff3c311-c673-4423-95fc-e91b616c4126 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:25.681182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dff3c311-c673-4423-95fc-e91b616c4126 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:25.698314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff3c311-c673-4423-95fc-e91b616c4126 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:25.699729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff3c311-c673-4423-95fc-e91b616c4126 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:25.701024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff3c311-c673-4423-95fc-e91b616c4126 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:25.702722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff3c311-c673-4423-95fc-e91b616c4126 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:25.704041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff3c311-c673-4423-95fc-e91b616c4126 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:25.706028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dff3c311-c673-4423-95fc-e91b616c4126 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:25.997781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dff3c311-c673-4423-95fc-e91b616c4126 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:26.006389 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dff3c311-c673-4423-95fc-e91b616c4126 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1472 microversion: 2.1 time: 0.338084 Aug 09 18:00:26.019880 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3299/6329] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:25 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1472 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:27.025569 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-3950a667-537e-4737-8373-3850639edc80 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:27.026615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3950a667-537e-4737-8373-3850639edc80 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:27.035545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-77449e60-d194-4afb-b32e-10c9bbd61876 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:27.038375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-77449e60-d194-4afb-b32e-10c9bbd61876 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:27.039707 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3950a667-537e-4737-8373-3850639edc80 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:27.040577 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3950a667-537e-4737-8373-3850639edc80 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:27.041661 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3950a667-537e-4737-8373-3850639edc80 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:27.042927 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3950a667-537e-4737-8373-3850639edc80 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:27.044299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3950a667-537e-4737-8373-3850639edc80 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:27.045430 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-3950a667-537e-4737-8373-3850639edc80 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:27.054928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77449e60-d194-4afb-b32e-10c9bbd61876 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:27.056234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77449e60-d194-4afb-b32e-10c9bbd61876 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:27.056953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77449e60-d194-4afb-b32e-10c9bbd61876 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:27.058119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77449e60-d194-4afb-b32e-10c9bbd61876 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:27.058852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77449e60-d194-4afb-b32e-10c9bbd61876 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:27.059931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77449e60-d194-4afb-b32e-10c9bbd61876 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:27.101703 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-3950a667-537e-4737-8373-3850639edc80 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Going to try to terminate instance {{(pid=119432) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:00:27.246574 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-3950a667-537e-4737-8373-3850639edc80 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 204 len: 0 microversion: 2.1 time: 0.230278 Aug 09 18:00:27.247663 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3031/6330] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:00:27 2022] DELETE /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:00:27.263761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-8b9c2fd1-864d-4e5c-b6c8-364c61265e86 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:27.265350 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-8b9c2fd1-864d-4e5c-b6c8-364c61265e86 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:27.279196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-77449e60-d194-4afb-b32e-10c9bbd61876 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:27.288965 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b9c2fd1-864d-4e5c-b6c8-364c61265e86 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:27.289854 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b9c2fd1-864d-4e5c-b6c8-364c61265e86 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:27.290673 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b9c2fd1-864d-4e5c-b6c8-364c61265e86 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:27.292346 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b9c2fd1-864d-4e5c-b6c8-364c61265e86 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:27.293191 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b9c2fd1-864d-4e5c-b6c8-364c61265e86 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:27.294196 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-8b9c2fd1-864d-4e5c-b6c8-364c61265e86 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:27.308620 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-77449e60-d194-4afb-b32e-10c9bbd61876 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1472 microversion: 2.1 time: 0.281635 Aug 09 18:00:27.317013 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3300/6331] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:27 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:27.597160 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-8b9c2fd1-864d-4e5c-b6c8-364c61265e86 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:27.627772 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-8b9c2fd1-864d-4e5c-b6c8-364c61265e86 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1469 microversion: 2.1 time: 0.374352 Aug 09 18:00:27.629457 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3032/6332] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:27 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:28.365230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fbebc7ff-4d4d-407d-ae5a-7d56ad344bcd tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:28.366078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fbebc7ff-4d4d-407d-ae5a-7d56ad344bcd tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:28.373595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbebc7ff-4d4d-407d-ae5a-7d56ad344bcd tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:28.374108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbebc7ff-4d4d-407d-ae5a-7d56ad344bcd tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:28.374558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbebc7ff-4d4d-407d-ae5a-7d56ad344bcd tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:28.375269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbebc7ff-4d4d-407d-ae5a-7d56ad344bcd tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:28.375782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbebc7ff-4d4d-407d-ae5a-7d56ad344bcd tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:28.376217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fbebc7ff-4d4d-407d-ae5a-7d56ad344bcd tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:28.539866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fbebc7ff-4d4d-407d-ae5a-7d56ad344bcd tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:28.550589 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fbebc7ff-4d4d-407d-ae5a-7d56ad344bcd tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1472 microversion: 2.1 time: 0.189578 Aug 09 18:00:28.551875 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3301/6333] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:28 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:28.654548 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-886708ad-088f-4d6c-a6e9-664d50f6886f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:28.656568 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-886708ad-088f-4d6c-a6e9-664d50f6886f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:28.669774 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-886708ad-088f-4d6c-a6e9-664d50f6886f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:28.671111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-886708ad-088f-4d6c-a6e9-664d50f6886f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:28.672048 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-886708ad-088f-4d6c-a6e9-664d50f6886f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:28.673931 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-886708ad-088f-4d6c-a6e9-664d50f6886f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:28.674892 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-886708ad-088f-4d6c-a6e9-664d50f6886f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:28.675819 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-886708ad-088f-4d6c-a6e9-664d50f6886f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:28.878902 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-886708ad-088f-4d6c-a6e9-664d50f6886f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:28.887937 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-886708ad-088f-4d6c-a6e9-664d50f6886f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1469 microversion: 2.1 time: 0.238573 Aug 09 18:00:28.889265 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3033/6334] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:28 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1469 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:29.572655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cbce3ccd-66cc-49c6-b1e5-64713dfc5757 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:29.573304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cbce3ccd-66cc-49c6-b1e5-64713dfc5757 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:29.581054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbce3ccd-66cc-49c6-b1e5-64713dfc5757 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:29.581570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbce3ccd-66cc-49c6-b1e5-64713dfc5757 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:29.582036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbce3ccd-66cc-49c6-b1e5-64713dfc5757 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:29.582789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbce3ccd-66cc-49c6-b1e5-64713dfc5757 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:29.583262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbce3ccd-66cc-49c6-b1e5-64713dfc5757 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:29.583733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cbce3ccd-66cc-49c6-b1e5-64713dfc5757 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:29.645318 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2a5760a4-0a3b-4975-ab71-50d0f19d0f64 req-e30f4d09-b50d-41fc-8b0a-cdc7626d27a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "075f55a1-49ee-447f-9a6f-08bc280d905a", "name": "network-vif-deleted", "tag": "94eff5a8-0f93-4e54-a0a0-25167d443a83"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:29.670925 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2a5760a4-0a3b-4975-ab71-50d0f19d0f64 req-e30f4d09-b50d-41fc-8b0a-cdc7626d27a1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:29.675361 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2a5760a4-0a3b-4975-ab71-50d0f19d0f64 req-e30f4d09-b50d-41fc-8b0a-cdc7626d27a1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:29.678058 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2a5760a4-0a3b-4975-ab71-50d0f19d0f64 req-e30f4d09-b50d-41fc-8b0a-cdc7626d27a1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:29.702177 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2a5760a4-0a3b-4975-ab71-50d0f19d0f64 req-e30f4d09-b50d-41fc-8b0a-cdc7626d27a1 service nova] Creating event network-vif-deleted:94eff5a8-0f93-4e54-a0a0-25167d443a83 for instance 075f55a1-49ee-447f-9a6f-08bc280d905a on n-h1-845781-6 Aug 09 18:00:29.710483 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-2a5760a4-0a3b-4975-ab71-50d0f19d0f64 req-e30f4d09-b50d-41fc-8b0a-cdc7626d27a1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068867 Aug 09 18:00:29.713745 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3034/6335] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:29.869510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cbce3ccd-66cc-49c6-b1e5-64713dfc5757 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:29.881338 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cbce3ccd-66cc-49c6-b1e5-64713dfc5757 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1472 microversion: 2.1 time: 0.311996 Aug 09 18:00:29.882019 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3302/6336] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:29 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1472 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:29.910794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:29.911735 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:29.919933 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:29.920627 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:29.921187 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:29.922020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:29.923311 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:29.923885 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:29.969529 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:29.970067 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:29.970810 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:29.971229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.objects.instance [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lazy-loading 'fault' on Instance uuid 075f55a1-49ee-447f-9a6f-08bc280d905a {{(pid=119432) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:00:30.029129 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5173254713a54d4f8b5e3731c420f2a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5404742174af495589dce537ae97080b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:30.038511 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-6a611e5e-a219-4f68-927a-b6a7ec6e4b3f tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 200 len: 1303 microversion: 2.1 time: 0.132129 Aug 09 18:00:30.039412 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3035/6337] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:29 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:30.703153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0d68aa06-201b-419c-bf9c-191d86e901eb req-a533c563-f2e9-4f70-a94a-5486170b5785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6754133-c763-45e8-b470-3f97081aa609", "name": "network-vif-plugged", "status": "completed", "tag": "00433ca9-1703-4039-b1b1-9c203f121a0e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:30.715930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:30.717967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:30.728392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0d68aa06-201b-419c-bf9c-191d86e901eb req-a533c563-f2e9-4f70-a94a-5486170b5785 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:30.729432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0d68aa06-201b-419c-bf9c-191d86e901eb req-a533c563-f2e9-4f70-a94a-5486170b5785 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:30.730110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0d68aa06-201b-419c-bf9c-191d86e901eb req-a533c563-f2e9-4f70-a94a-5486170b5785 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:30.748594 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0d68aa06-201b-419c-bf9c-191d86e901eb req-a533c563-f2e9-4f70-a94a-5486170b5785 service nova] Creating event network-vif-plugged:00433ca9-1703-4039-b1b1-9c203f121a0e for instance f6754133-c763-45e8-b470-3f97081aa609 on n-h2-845781-6 Aug 09 18:00:30.758800 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0d68aa06-201b-419c-bf9c-191d86e901eb req-a533c563-f2e9-4f70-a94a-5486170b5785 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060565 Aug 09 18:00:30.760682 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3303/6338] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:30.911745 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-839beb34-a100-4361-8b60-cc446c2bb523 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:30.913641 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-839beb34-a100-4361-8b60-cc446c2bb523 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:30.920322 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell0:SELECT=2 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:30.928691 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-839beb34-a100-4361-8b60-cc446c2bb523 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:30.929672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-839beb34-a100-4361-8b60-cc446c2bb523 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:30.930506 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-839beb34-a100-4361-8b60-cc446c2bb523 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:30.932313 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-839beb34-a100-4361-8b60-cc446c2bb523 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:30.933229 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-839beb34-a100-4361-8b60-cc446c2bb523 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:30.934268 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-839beb34-a100-4361-8b60-cc446c2bb523 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:31.070933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:31.072437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] [instance: 075f55a1-49ee-447f-9a6f-08bc280d905a] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:31.088398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:31.089712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:31.090708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:31.092217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:31.093259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:31.095375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:31.122226 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] HTTP exception thrown: Instance 075f55a1-49ee-447f-9a6f-08bc280d905a could not be found. Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Request method failure captured: Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a HTTP/1.1 Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qBJUQWKv1xT3k5H0Gh5Cgl2HPcbDJrPNIhWuN6nwOro1MrYVd7LJ5an0jJ4z00l-jk4TAqsqp0lbFuCQ3uP2bTFCnXRZ0kC2oJM7nZ4NcxFIXM4wo7sm6jWT1e9vvftNiZzF0Uwg0k4E_S8jyxaYeUmOTIZq_U7WuJ4tSVH5DwtBb4 Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 5404742174af495589dce537ae97080b Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-VolumesBackupsTest-1408734368 Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5404742174af495589dce537ae97080b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5404742174af495589dce537ae97080b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5404742174af495589dce537ae97080b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5404742174af495589dce537ae97080b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-VolumesBackupsTest-1408734368 Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 5404742174af495589dce537ae97080b Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-VolumesBackupsTest-1408734368 Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-VolumesBackupsTest-1408734368-project Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 5173254713a54d4f8b5e3731c420f2a1 Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-VolumesBackupsTest-1408734368-project Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 075f55a1-49ee-447f-9a6f-08bc280d905a could not be found. Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '075f55a1-49ee-447f-9a6f-08bc280d905a'} Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 075f55a1-49ee-447f-9a6f-08bc280d905a could not be found. Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 075f55a1-49ee-447f-9a6f-08bc280d905a could not be found. Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:00:31.124435 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:00:31.131425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:00:31.131425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:00:31.131425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:00:31.131425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:00:31.131425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:00:31.131425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 075f55a1-49ee-447f-9a6f-08bc280d905a could not be found. Aug 09 18:00:31.131425 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:00:31.133982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] Returning 404 to user: Instance 075f55a1-49ee-447f-9a6f-08bc280d905a could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:00:31.135754 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fdee6983-ab9f-477a-8eab-1928077130e4 tempest-VolumesBackupsTest-1408734368 tempest-VolumesBackupsTest-1408734368-project] 10.222.0.93 "GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a" status: 404 len: 111 microversion: 2.1 time: 0.074937 Aug 09 18:00:31.140285 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3304/6339] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:31 2022] GET /compute/v2.1/servers/075f55a1-49ee-447f-9a6f-08bc280d905a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:00:31.145981 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-839beb34-a100-4361-8b60-cc446c2bb523 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:31.164207 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-839beb34-a100-4361-8b60-cc446c2bb523 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1472 microversion: 2.1 time: 0.258769 Aug 09 18:00:31.165402 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3036/6340] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:30 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:31.752281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-95974897", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-502915138", "security_groups": [{"name": "tempest-secgroup-smoke-119401263"}], "block_device_mapping_v2": [{"uuid": "0431365f-28c1-4110-8c83-595cd23f306f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:31.940005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] validate_networks() for [('0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:00:32.191258 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c922c424-09e6-4172-80ec-633c7fc1017b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:32.192458 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c922c424-09e6-4172-80ec-633c7fc1017b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:32.206651 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c922c424-09e6-4172-80ec-633c7fc1017b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.207592 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c922c424-09e6-4172-80ec-633c7fc1017b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.208477 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c922c424-09e6-4172-80ec-633c7fc1017b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:32.210001 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c922c424-09e6-4172-80ec-633c7fc1017b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.211133 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c922c424-09e6-4172-80ec-633c7fc1017b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.211950 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c922c424-09e6-4172-80ec-633c7fc1017b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:32.469510 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-c922c424-09e6-4172-80ec-633c7fc1017b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:32.484032 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c922c424-09e6-4172-80ec-633c7fc1017b tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1643 microversion: 2.1 time: 0.299442 Aug 09 18:00:32.486202 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3037/6341] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:32 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1643 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:32.501154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:00:32.501625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:00:32.502120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:00:32.502531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:00:32.503274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:00:32.510036 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-84eb536d-4033-4d71-8466-4ba0623f5d23 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:32.511348 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-84eb536d-4033-4d71-8466-4ba0623f5d23 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:32.515470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.516229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.517330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:32.518768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.519331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.520173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:32.523861 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84eb536d-4033-4d71-8466-4ba0623f5d23 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.525174 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84eb536d-4033-4d71-8466-4ba0623f5d23 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.526040 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84eb536d-4033-4d71-8466-4ba0623f5d23 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:32.527615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84eb536d-4033-4d71-8466-4ba0623f5d23 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.528848 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84eb536d-4033-4d71-8466-4ba0623f5d23 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.529836 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-84eb536d-4033-4d71-8466-4ba0623f5d23 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:32.545352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:00:32.552297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for user 87590ee7f71345a8914b350c5999d974 and project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:00:32.646269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:00:32.652833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0431365f-28c1-4110-8c83-595cd23f306f',volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:00:32.741123 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-84eb536d-4033-4d71-8466-4ba0623f5d23 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:32.749482 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-84eb536d-4033-4d71-8466-4ba0623f5d23 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1643 microversion: 2.1 time: 0.246361 Aug 09 18:00:32.750060 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3038/6342] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:32 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1643 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:32.770236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-c5d8f04e-5ef8-40e5-996e-f2cb9b8dacb3 tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:32.771194 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-c5d8f04e-5ef8-40e5-996e-f2cb9b8dacb3 tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:32.778017 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5d8f04e-5ef8-40e5-996e-f2cb9b8dacb3 tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.778658 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5d8f04e-5ef8-40e5-996e-f2cb9b8dacb3 tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.779119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5d8f04e-5ef8-40e5-996e-f2cb9b8dacb3 tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:32.780662 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5d8f04e-5ef8-40e5-996e-f2cb9b8dacb3 tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:32.781176 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5d8f04e-5ef8-40e5-996e-f2cb9b8dacb3 tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:32.782149 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-c5d8f04e-5ef8-40e5-996e-f2cb9b8dacb3 tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:32.865364 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-18374226-2098-4377-a2bd-a2f2c417833d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.117859 Aug 09 18:00:32.867103 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3305/6343] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:00:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:00:32.889553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9df3e8c6-289f-4683-9afc-4e3e5ecc4234 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:32.890627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9df3e8c6-289f-4683-9afc-4e3e5ecc4234 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:32.989272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9df3e8c6-289f-4683-9afc-4e3e5ecc4234 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:33.002769 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9df3e8c6-289f-4683-9afc-4e3e5ecc4234 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1092 microversion: 2.1 time: 0.122409 Aug 09 18:00:33.015897 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3306/6344] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:32 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1092 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:33.173826 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-c5d8f04e-5ef8-40e5-996e-f2cb9b8dacb3 tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1794 microversion: 2.1 time: 0.407339 Aug 09 18:00:33.180222 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3039/6345] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:32 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1794 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:34.039447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e92715e-3d8d-4ab1-a22c-3c7fcf5d47c9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:34.040831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6e92715e-3d8d-4ab1-a22c-3c7fcf5d47c9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:34.058944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e92715e-3d8d-4ab1-a22c-3c7fcf5d47c9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:34.062358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e92715e-3d8d-4ab1-a22c-3c7fcf5d47c9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:34.063863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e92715e-3d8d-4ab1-a22c-3c7fcf5d47c9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:34.066738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e92715e-3d8d-4ab1-a22c-3c7fcf5d47c9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:34.068279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e92715e-3d8d-4ab1-a22c-3c7fcf5d47c9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:34.070926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e92715e-3d8d-4ab1-a22c-3c7fcf5d47c9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:34.157333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e92715e-3d8d-4ab1-a22c-3c7fcf5d47c9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:34.165698 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e92715e-3d8d-4ab1-a22c-3c7fcf5d47c9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1190 microversion: 2.1 time: 0.130457 Aug 09 18:00:34.181152 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3307/6346] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:34 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1190 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:35.189206 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-337bd9b4-690d-442e-b9b4-78946294f06d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:35.190536 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-337bd9b4-690d-442e-b9b4-78946294f06d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:35.199667 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-337bd9b4-690d-442e-b9b4-78946294f06d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:35.200518 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-337bd9b4-690d-442e-b9b4-78946294f06d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:35.201294 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-337bd9b4-690d-442e-b9b4-78946294f06d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:35.202237 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-337bd9b4-690d-442e-b9b4-78946294f06d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:35.202911 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-337bd9b4-690d-442e-b9b4-78946294f06d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:35.204103 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-337bd9b4-690d-442e-b9b4-78946294f06d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:35.349184 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-337bd9b4-690d-442e-b9b4-78946294f06d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:35.374927 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-337bd9b4-690d-442e-b9b4-78946294f06d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1208 microversion: 2.1 time: 0.189237 Aug 09 18:00:35.378495 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3040/6347] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:35 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1208 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:36.399530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f5044423-3af6-409c-aa7a-695dc9fc86e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:36.400207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f5044423-3af6-409c-aa7a-695dc9fc86e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:36.413312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5044423-3af6-409c-aa7a-695dc9fc86e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:36.414067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5044423-3af6-409c-aa7a-695dc9fc86e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:36.414699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5044423-3af6-409c-aa7a-695dc9fc86e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:36.419752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5044423-3af6-409c-aa7a-695dc9fc86e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:36.420519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5044423-3af6-409c-aa7a-695dc9fc86e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:36.421398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5044423-3af6-409c-aa7a-695dc9fc86e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:36.531751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f5044423-3af6-409c-aa7a-695dc9fc86e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:36.540340 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f5044423-3af6-409c-aa7a-695dc9fc86e5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1208 microversion: 2.1 time: 0.145690 Aug 09 18:00:36.540988 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3308/6348] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:36 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1208 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:37.127528 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-2fe694d2-eb55-4845-af77-3983c7462dc0 req-822b2121-f5e5-4406-b1bb-89d9b526a65f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6754133-c763-45e8-b470-3f97081aa609", "tag": "00433ca9-1703-4039-b1b1-9c203f121a0e"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:37.154210 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2fe694d2-eb55-4845-af77-3983c7462dc0 req-822b2121-f5e5-4406-b1bb-89d9b526a65f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:37.155051 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2fe694d2-eb55-4845-af77-3983c7462dc0 req-822b2121-f5e5-4406-b1bb-89d9b526a65f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:37.155764 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-2fe694d2-eb55-4845-af77-3983c7462dc0 req-822b2121-f5e5-4406-b1bb-89d9b526a65f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:37.179345 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-2fe694d2-eb55-4845-af77-3983c7462dc0 req-822b2121-f5e5-4406-b1bb-89d9b526a65f service nova] Creating event network-changed:00433ca9-1703-4039-b1b1-9c203f121a0e for instance f6754133-c763-45e8-b470-3f97081aa609 on n-h2-845781-6 Aug 09 18:00:37.189141 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-2fe694d2-eb55-4845-af77-3983c7462dc0 req-822b2121-f5e5-4406-b1bb-89d9b526a65f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067061 Aug 09 18:00:37.191336 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3041/6349] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:37.563595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-60aa73ed-f96b-45cb-9e02-8eece9994bf2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:37.566161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-60aa73ed-f96b-45cb-9e02-8eece9994bf2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:37.633134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60aa73ed-f96b-45cb-9e02-8eece9994bf2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:37.635562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60aa73ed-f96b-45cb-9e02-8eece9994bf2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:37.638582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60aa73ed-f96b-45cb-9e02-8eece9994bf2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:37.645343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60aa73ed-f96b-45cb-9e02-8eece9994bf2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:37.647492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60aa73ed-f96b-45cb-9e02-8eece9994bf2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:37.650770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60aa73ed-f96b-45cb-9e02-8eece9994bf2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:38.685949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-60aa73ed-f96b-45cb-9e02-8eece9994bf2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:38.696933 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-60aa73ed-f96b-45cb-9e02-8eece9994bf2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1275 microversion: 2.1 time: 1.139466 Aug 09 18:00:38.698188 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3309/6350] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:37 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1275 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:39.533629 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-973e9ae5-34f3-4034-894d-121099356f92 req-e9570e36-6931-468b-963e-c777b9847618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf", "tag": "022f8d09-7680-47d3-bfda-f5504c672286"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:39.555794 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-973e9ae5-34f3-4034-894d-121099356f92 req-e9570e36-6931-468b-963e-c777b9847618 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:39.556307 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-973e9ae5-34f3-4034-894d-121099356f92 req-e9570e36-6931-468b-963e-c777b9847618 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:39.556761 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-973e9ae5-34f3-4034-894d-121099356f92 req-e9570e36-6931-468b-963e-c777b9847618 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:39.583030 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-973e9ae5-34f3-4034-894d-121099356f92 req-e9570e36-6931-468b-963e-c777b9847618 service nova] Creating event network-changed:022f8d09-7680-47d3-bfda-f5504c672286 for instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf on n-h1-845781-6 Aug 09 18:00:39.597871 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-973e9ae5-34f3-4034-894d-121099356f92 req-e9570e36-6931-468b-963e-c777b9847618 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067508 Aug 09 18:00:39.600178 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3042/6351] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:39.729223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f778819-5db4-4bb9-911f-68eac438b7ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:39.730795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6f778819-5db4-4bb9-911f-68eac438b7ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:39.747083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f778819-5db4-4bb9-911f-68eac438b7ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:39.748928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f778819-5db4-4bb9-911f-68eac438b7ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:39.752875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f778819-5db4-4bb9-911f-68eac438b7ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:39.756060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f778819-5db4-4bb9-911f-68eac438b7ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:39.757851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f778819-5db4-4bb9-911f-68eac438b7ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:39.770095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f778819-5db4-4bb9-911f-68eac438b7ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:40.010556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6f778819-5db4-4bb9-911f-68eac438b7ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:40.020673 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6f778819-5db4-4bb9-911f-68eac438b7ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1275 microversion: 2.1 time: 0.299252 Aug 09 18:00:40.022049 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3310/6352] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:39 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:41.044266 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-75b897be-0aad-44b3-8a53-a052a7ccae2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:41.044831 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-75b897be-0aad-44b3-8a53-a052a7ccae2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:41.059721 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75b897be-0aad-44b3-8a53-a052a7ccae2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:41.060724 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75b897be-0aad-44b3-8a53-a052a7ccae2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:41.061299 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75b897be-0aad-44b3-8a53-a052a7ccae2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:41.062056 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75b897be-0aad-44b3-8a53-a052a7ccae2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:41.063454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75b897be-0aad-44b3-8a53-a052a7ccae2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:41.064119 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-75b897be-0aad-44b3-8a53-a052a7ccae2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:41.243907 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-75b897be-0aad-44b3-8a53-a052a7ccae2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:41.254984 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-75b897be-0aad-44b3-8a53-a052a7ccae2a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1275 microversion: 2.1 time: 0.215578 Aug 09 18:00:41.259099 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3043/6353] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:41 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:42.286982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f979f161-90ff-4eb7-946f-4d1b9d68b40f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:42.287741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f979f161-90ff-4eb7-946f-4d1b9d68b40f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:42.300603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f979f161-90ff-4eb7-946f-4d1b9d68b40f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:42.301208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f979f161-90ff-4eb7-946f-4d1b9d68b40f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:42.301725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f979f161-90ff-4eb7-946f-4d1b9d68b40f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:42.302459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f979f161-90ff-4eb7-946f-4d1b9d68b40f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:42.302918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f979f161-90ff-4eb7-946f-4d1b9d68b40f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:42.303349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f979f161-90ff-4eb7-946f-4d1b9d68b40f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:42.491299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f979f161-90ff-4eb7-946f-4d1b9d68b40f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:42.506623 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f979f161-90ff-4eb7-946f-4d1b9d68b40f tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1263 microversion: 2.1 time: 0.223060 Aug 09 18:00:42.507736 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3311/6354] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:42 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1263 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:43.530615 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-95c7d513-bb23-4edd-9881-34023f26ef00 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:43.531302 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-95c7d513-bb23-4edd-9881-34023f26ef00 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:43.540098 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95c7d513-bb23-4edd-9881-34023f26ef00 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:43.540617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95c7d513-bb23-4edd-9881-34023f26ef00 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:43.541337 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95c7d513-bb23-4edd-9881-34023f26ef00 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:43.542111 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95c7d513-bb23-4edd-9881-34023f26ef00 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:43.542660 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95c7d513-bb23-4edd-9881-34023f26ef00 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:43.543143 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-95c7d513-bb23-4edd-9881-34023f26ef00 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:43.565963 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:43.710464 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-95c7d513-bb23-4edd-9881-34023f26ef00 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:43.718289 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-95c7d513-bb23-4edd-9881-34023f26ef00 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1263 microversion: 2.1 time: 0.191868 Aug 09 18:00:43.718933 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3044/6355] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:43 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:44.743374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b0dbaee6-3c0d-4499-961b-c1ae69f3f3f1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:44.743374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b0dbaee6-3c0d-4499-961b-c1ae69f3f3f1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:44.747453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:44.748301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:44.756159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0dbaee6-3c0d-4499-961b-c1ae69f3f3f1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:44.756672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0dbaee6-3c0d-4499-961b-c1ae69f3f3f1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:44.757106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0dbaee6-3c0d-4499-961b-c1ae69f3f3f1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:44.757822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0dbaee6-3c0d-4499-961b-c1ae69f3f3f1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:44.758282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0dbaee6-3c0d-4499-961b-c1ae69f3f3f1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:44.758719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0dbaee6-3c0d-4499-961b-c1ae69f3f3f1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:44.925729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b0dbaee6-3c0d-4499-961b-c1ae69f3f3f1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:44.935703 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b0dbaee6-3c0d-4499-961b-c1ae69f3f3f1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1263 microversion: 2.1 time: 0.197305 Aug 09 18:00:44.939882 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3312/6356] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:44 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1263 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:45.962394 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-45014c6b-3b53-4016-b513-3e2fae25495b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:45.963013 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-45014c6b-3b53-4016-b513-3e2fae25495b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:45.970316 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45014c6b-3b53-4016-b513-3e2fae25495b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:45.970832 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45014c6b-3b53-4016-b513-3e2fae25495b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:45.971283 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45014c6b-3b53-4016-b513-3e2fae25495b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:45.972039 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45014c6b-3b53-4016-b513-3e2fae25495b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:45.972508 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45014c6b-3b53-4016-b513-3e2fae25495b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:45.972945 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-45014c6b-3b53-4016-b513-3e2fae25495b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:46.142996 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-45014c6b-3b53-4016-b513-3e2fae25495b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:46.156534 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-45014c6b-3b53-4016-b513-3e2fae25495b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1263 microversion: 2.1 time: 0.197196 Aug 09 18:00:46.167658 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3045/6357] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:45 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1263 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:47.185551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-40655325-9d07-49f3-ac88-eff9bb5dfc14 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:47.186538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-40655325-9d07-49f3-ac88-eff9bb5dfc14 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:47.195237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40655325-9d07-49f3-ac88-eff9bb5dfc14 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:47.195958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40655325-9d07-49f3-ac88-eff9bb5dfc14 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:47.196576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40655325-9d07-49f3-ac88-eff9bb5dfc14 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:47.197399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40655325-9d07-49f3-ac88-eff9bb5dfc14 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:47.197884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40655325-9d07-49f3-ac88-eff9bb5dfc14 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:47.198328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40655325-9d07-49f3-ac88-eff9bb5dfc14 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:47.370358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-40655325-9d07-49f3-ac88-eff9bb5dfc14 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:47.379965 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-40655325-9d07-49f3-ac88-eff9bb5dfc14 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1263 microversion: 2.1 time: 0.200849 Aug 09 18:00:47.392011 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3313/6358] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:47 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1263 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:48.405509 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-19b64fd6-03da-414f-beeb-bec0b86d97ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:48.406672 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-19b64fd6-03da-414f-beeb-bec0b86d97ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:48.414198 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19b64fd6-03da-414f-beeb-bec0b86d97ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:48.414716 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19b64fd6-03da-414f-beeb-bec0b86d97ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:48.415214 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19b64fd6-03da-414f-beeb-bec0b86d97ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:48.416041 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19b64fd6-03da-414f-beeb-bec0b86d97ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:48.416519 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19b64fd6-03da-414f-beeb-bec0b86d97ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:48.416994 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-19b64fd6-03da-414f-beeb-bec0b86d97ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:48.620255 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-19b64fd6-03da-414f-beeb-bec0b86d97ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:48.629636 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-19b64fd6-03da-414f-beeb-bec0b86d97ce tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1263 microversion: 2.1 time: 0.229468 Aug 09 18:00:48.630606 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3046/6359] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:48 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1263 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:49.652075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-380d490a-00df-4f1a-9242-cac5e983cadb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:49.653017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-380d490a-00df-4f1a-9242-cac5e983cadb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:49.656254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:49.665050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-380d490a-00df-4f1a-9242-cac5e983cadb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:49.665776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-380d490a-00df-4f1a-9242-cac5e983cadb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:49.666579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-380d490a-00df-4f1a-9242-cac5e983cadb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:49.667615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-380d490a-00df-4f1a-9242-cac5e983cadb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:49.668470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-380d490a-00df-4f1a-9242-cac5e983cadb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:49.669018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-380d490a-00df-4f1a-9242-cac5e983cadb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:49.673121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=87 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:49.867841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-380d490a-00df-4f1a-9242-cac5e983cadb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:49.877654 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-380d490a-00df-4f1a-9242-cac5e983cadb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1263 microversion: 2.1 time: 0.230298 Aug 09 18:00:49.878410 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3314/6360] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:49 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1263 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:50.904053 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-a45ab118-9a8b-44b0-81d9-7f76c7a8b15d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:50.905620 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-a45ab118-9a8b-44b0-81d9-7f76c7a8b15d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:50.908763 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:00:50.915071 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45ab118-9a8b-44b0-81d9-7f76c7a8b15d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:50.915700 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45ab118-9a8b-44b0-81d9-7f76c7a8b15d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:50.916419 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45ab118-9a8b-44b0-81d9-7f76c7a8b15d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:50.917244 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45ab118-9a8b-44b0-81d9-7f76c7a8b15d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:50.917837 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45ab118-9a8b-44b0-81d9-7f76c7a8b15d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:50.918369 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-a45ab118-9a8b-44b0-81d9-7f76c7a8b15d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:51.097891 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-a45ab118-9a8b-44b0-81d9-7f76c7a8b15d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:51.112302 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-a45ab118-9a8b-44b0-81d9-7f76c7a8b15d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1263 microversion: 2.1 time: 0.211668 Aug 09 18:00:51.113439 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3047/6361] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:50 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1263 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:52.138012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ae4744ee-f40a-4649-9840-e670c1fcc8ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:52.138848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ae4744ee-f40a-4649-9840-e670c1fcc8ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:52.146797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae4744ee-f40a-4649-9840-e670c1fcc8ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:52.147313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae4744ee-f40a-4649-9840-e670c1fcc8ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:52.147768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae4744ee-f40a-4649-9840-e670c1fcc8ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:52.148480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae4744ee-f40a-4649-9840-e670c1fcc8ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:52.148931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae4744ee-f40a-4649-9840-e670c1fcc8ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:52.149355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ae4744ee-f40a-4649-9840-e670c1fcc8ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:52.343826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ae4744ee-f40a-4649-9840-e670c1fcc8ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:52.357968 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ae4744ee-f40a-4649-9840-e670c1fcc8ac tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1263 microversion: 2.1 time: 0.224915 Aug 09 18:00:52.360461 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3315/6362] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:52 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1263 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:52.428795 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-c1815b33-8094-4f53-9abe-f4cc24e31c78 req-7f7868fa-2cf9-4c64-b754-d60a9f0c2ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf", "name": "network-vif-plugged", "status": "completed", "tag": "022f8d09-7680-47d3-bfda-f5504c672286"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:52.446454 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c1815b33-8094-4f53-9abe-f4cc24e31c78 req-7f7868fa-2cf9-4c64-b754-d60a9f0c2ea8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:52.447751 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c1815b33-8094-4f53-9abe-f4cc24e31c78 req-7f7868fa-2cf9-4c64-b754-d60a9f0c2ea8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:52.448895 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-c1815b33-8094-4f53-9abe-f4cc24e31c78 req-7f7868fa-2cf9-4c64-b754-d60a9f0c2ea8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:52.469631 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-c1815b33-8094-4f53-9abe-f4cc24e31c78 req-7f7868fa-2cf9-4c64-b754-d60a9f0c2ea8 service nova] Creating event network-vif-plugged:022f8d09-7680-47d3-bfda-f5504c672286 for instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf on n-h1-845781-6 Aug 09 18:00:52.477409 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-c1815b33-8094-4f53-9abe-f4cc24e31c78 req-7f7868fa-2cf9-4c64-b754-d60a9f0c2ea8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054992 Aug 09 18:00:52.478759 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3048/6363] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:00:53.386165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f021b1ad-f0e9-4272-a2cb-15292c7d5c39 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:53.387317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f021b1ad-f0e9-4272-a2cb-15292c7d5c39 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:53.395402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f021b1ad-f0e9-4272-a2cb-15292c7d5c39 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:53.395925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f021b1ad-f0e9-4272-a2cb-15292c7d5c39 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:53.396366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f021b1ad-f0e9-4272-a2cb-15292c7d5c39 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:53.397080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f021b1ad-f0e9-4272-a2cb-15292c7d5c39 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:53.397538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f021b1ad-f0e9-4272-a2cb-15292c7d5c39 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:53.397969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f021b1ad-f0e9-4272-a2cb-15292c7d5c39 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:53.565523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f021b1ad-f0e9-4272-a2cb-15292c7d5c39 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:53.576874 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f021b1ad-f0e9-4272-a2cb-15292c7d5c39 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1263 microversion: 2.1 time: 0.194670 Aug 09 18:00:53.578098 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3316/6364] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:53 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1263 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:54.608446 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-68258cc3-9834-4dc7-805a-bd1e9aa4a939 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:54.609253 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-68258cc3-9834-4dc7-805a-bd1e9aa4a939 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:54.616020 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68258cc3-9834-4dc7-805a-bd1e9aa4a939 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:54.616539 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68258cc3-9834-4dc7-805a-bd1e9aa4a939 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:54.616993 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68258cc3-9834-4dc7-805a-bd1e9aa4a939 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:54.617720 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68258cc3-9834-4dc7-805a-bd1e9aa4a939 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:54.618195 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68258cc3-9834-4dc7-805a-bd1e9aa4a939 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:54.618639 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-68258cc3-9834-4dc7-805a-bd1e9aa4a939 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:54.806134 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-68258cc3-9834-4dc7-805a-bd1e9aa4a939 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:54.817302 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-68258cc3-9834-4dc7-805a-bd1e9aa4a939 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1449 microversion: 2.1 time: 0.214215 Aug 09 18:00:54.818025 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3049/6365] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:54 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1449 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:00:54.839296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-edb26581-ac1c-4370-b5e0-b835acc7b799 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:00:54.840050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-edb26581-ac1c-4370-b5e0-b835acc7b799 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:00:54.847729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb26581-ac1c-4370-b5e0-b835acc7b799 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:54.848237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb26581-ac1c-4370-b5e0-b835acc7b799 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:54.848682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb26581-ac1c-4370-b5e0-b835acc7b799 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:54.849393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb26581-ac1c-4370-b5e0-b835acc7b799 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:54.849855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb26581-ac1c-4370-b5e0-b835acc7b799 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:54.850407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-edb26581-ac1c-4370-b5e0-b835acc7b799 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:55.016033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-edb26581-ac1c-4370-b5e0-b835acc7b799 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:00:55.024411 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-edb26581-ac1c-4370-b5e0-b835acc7b799 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1449 microversion: 2.1 time: 0.189050 Aug 09 18:00:55.025002 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3317/6366] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:00:54 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1449 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:00:57.114453 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [req-503a3ce8-b6cb-4461-b960-819685c17cfe req-e98f717e-cd52-4d1d-87e8-23c53f74da87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf", "tag": "022f8d09-7680-47d3-bfda-f5504c672286"}]} {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:00:57.126079 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-503a3ce8-b6cb-4461-b960-819685c17cfe req-e98f717e-cd52-4d1d-87e8-23c53f74da87 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:00:57.126682 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-503a3ce8-b6cb-4461-b960-819685c17cfe req-e98f717e-cd52-4d1d-87e8-23c53f74da87 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:00:57.127236 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [req-503a3ce8-b6cb-4461-b960-819685c17cfe req-e98f717e-cd52-4d1d-87e8-23c53f74da87 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:00:57.142814 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.compute.server_external_events [req-503a3ce8-b6cb-4461-b960-819685c17cfe req-e98f717e-cd52-4d1d-87e8-23c53f74da87 service nova] Creating event network-changed:022f8d09-7680-47d3-bfda-f5504c672286 for instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf on n-h1-845781-6 Aug 09 18:00:57.148652 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [req-503a3ce8-b6cb-4461-b960-819685c17cfe req-e98f717e-cd52-4d1d-87e8-23c53f74da87 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038050 Aug 09 18:00:57.149495 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3050/6367] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:18.881505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1873843175", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "804043c8-1417-414b-a93d-ecf5e0e40d1a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1692144490", "security_groups": []}, "os:scheduler_hints": {"different_host": ["f6754133-c763-45e8-b470-3f97081aa609"]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:18.928179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=7 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:18.929267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=23 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:19.543100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] validate_networks() for [('804043c8-1417-414b-a93d-ecf5e0e40d1a', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:01:20.235095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:01:20.236144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:01:20.237761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:01:20.238201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:01:20.238633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:01:20.257175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:20.258093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:20.259766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:20.261797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:20.262864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:20.264261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:20.287779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Getting quotas for project c6ca8c6d12ff405ba78d24f194ebfbbb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:01:20.295329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Getting quotas for user e13314961e5349ddbaa3de9a92389740 and project c6ca8c6d12ff405ba78d24f194ebfbbb. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:01:20.314777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:01:20.317384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:01:20.390250 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-65eadaa1-6f52-4124-973d-3ba70207f581 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.515900 Aug 09 18:01:20.391753 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3318/6368] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:01:18 2022] POST /compute/v2.1/servers => generated 361 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:01:20.402913 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_api:SELECT=7 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:20.416462 n-d-845781-6 devstack@n-api.service[119432]: DEBUG dbcounter [-] [119432] Writing DB stats nova_cell1:SELECT=30 {{(pid=119432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:20.438984 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-0e070cbb-33eb-4aa7-a4a2-c24c42a7c6ea tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:20.444655 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-0e070cbb-33eb-4aa7-a4a2-c24c42a7c6ea tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:20.899310 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.policy [None req-0e070cbb-33eb-4aa7-a4a2-c24c42a7c6ea tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119432) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:20.910704 n-d-845781-6 devstack@n-api.service[119432]: INFO nova.api.openstack.requestlog [None req-0e070cbb-33eb-4aa7-a4a2-c24c42a7c6ea tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af" status: 200 len: 1242 microversion: 2.1 time: 0.511548 Aug 09 18:01:20.918035 n-d-845781-6 devstack@n-api.service[119432]: [pid: 119432|app: 0|req: 3051/6369] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:20 2022] GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af => generated 1242 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:21.939668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4ea78f9-fedd-4dc1-8d4c-ad6c6c7b02b0 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:21.942418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c4ea78f9-fedd-4dc1-8d4c-ad6c6c7b02b0 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:21.957408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4ea78f9-fedd-4dc1-8d4c-ad6c6c7b02b0 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:21.959693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4ea78f9-fedd-4dc1-8d4c-ad6c6c7b02b0 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:21.960468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4ea78f9-fedd-4dc1-8d4c-ad6c6c7b02b0 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:21.961523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4ea78f9-fedd-4dc1-8d4c-ad6c6c7b02b0 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:21.962311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4ea78f9-fedd-4dc1-8d4c-ad6c6c7b02b0 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:21.963000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4ea78f9-fedd-4dc1-8d4c-ad6c6c7b02b0 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:22.056577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c4ea78f9-fedd-4dc1-8d4c-ad6c6c7b02b0 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:01:22.068121 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c4ea78f9-fedd-4dc1-8d4c-ad6c6c7b02b0 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af" status: 200 len: 1302 microversion: 2.1 time: 0.134959 Aug 09 18:01:22.081277 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3319/6370] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:01:21 2022] GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af => generated 1302 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:01:23.098288 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.api.openstack.wsgi [None req-349f2afb-b75a-443f-8731-3512e919c057 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:01:23.100447 n-d-845781-6 devstack@n-api.service[119432]: DEBUG nova.compute.api [None req-349f2afb-b75a-443f-8731-3512e919c057 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Fetching instance by UUID {{(pid=119432) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:01:23.124943 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-349f2afb-b75a-443f-8731-3512e919c057 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:23.125962 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-349f2afb-b75a-443f-8731-3512e919c057 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:23.129434 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-349f2afb-b75a-443f-8731-3512e919c057 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:23.160617 n-d-845781-6 devstack@n-api.service[119432]: DEBUG oslo_concurrency.lockutils [None req-349f2afb-b75a-443f-8731-3512e919c057 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:23.192091 n-d-845781-6 devstack@n-api.service[119432]: Traceback (most recent call last): Aug 09 18:01:23.192548 n-d-845781-6 devstack@n-api.service[119432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 09 18:01:23.192548 n-d-845781-6 devstack@n-api.service[119432]: timer() Aug 09 18:01:23.192824 n-d-845781-6 devstack@n-api.service[119432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 09 18:01:23.192824 n-d-845781-6 devstack@n-api.service[119432]: cb(*args, **kw) Aug 09 18:01:23.193081 n-d-845781-6 devstack@n-api.service[119432]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Aug 09 18:01:23.193081 n-d-845781-6 devstack@n-api.service[119432]: waiter.switch() Aug 09 18:01:23.193328 n-d-845781-6 devstack@n-api.service[119432]: greenlet.error: cannot switch to a different thread Aug 09 18:01:24.582909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ba5d9406-f052-4406-bb6e-d46f7ecd8abd req-7f9f2321-7cfc-4797-8115-bdeafea2d6be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b331c4-11f7-411d-9d81-688a988542af", "tag": "f3e7d984-80e1-43e8-aded-1c465009ea8f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:24.596549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ba5d9406-f052-4406-bb6e-d46f7ecd8abd req-7f9f2321-7cfc-4797-8115-bdeafea2d6be service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:24.597238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ba5d9406-f052-4406-bb6e-d46f7ecd8abd req-7f9f2321-7cfc-4797-8115-bdeafea2d6be service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:24.597947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ba5d9406-f052-4406-bb6e-d46f7ecd8abd req-7f9f2321-7cfc-4797-8115-bdeafea2d6be service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:24.617974 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ba5d9406-f052-4406-bb6e-d46f7ecd8abd req-7f9f2321-7cfc-4797-8115-bdeafea2d6be service nova] Creating event network-changed:f3e7d984-80e1-43e8-aded-1c465009ea8f for instance d0b331c4-11f7-411d-9d81-688a988542af on n-h1-845781-6 Aug 09 18:01:24.625152 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ba5d9406-f052-4406-bb6e-d46f7ecd8abd req-7f9f2321-7cfc-4797-8115-bdeafea2d6be service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127470 Aug 09 18:01:24.625638 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3320/6371] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:01:30.630075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:30.631620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:01:30.636801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d3dc2363-0e1b-4fe2-9a6e-5aea86c1ddf2 req-3c395990-87df-4578-8dd3-d13117130e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b331c4-11f7-411d-9d81-688a988542af", "name": "network-vif-plugged", "status": "completed", "tag": "f3e7d984-80e1-43e8-aded-1c465009ea8f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:01:30.654890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d3dc2363-0e1b-4fe2-9a6e-5aea86c1ddf2 req-3c395990-87df-4578-8dd3-d13117130e66 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:01:30.655393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d3dc2363-0e1b-4fe2-9a6e-5aea86c1ddf2 req-3c395990-87df-4578-8dd3-d13117130e66 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:01:30.655868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d3dc2363-0e1b-4fe2-9a6e-5aea86c1ddf2 req-3c395990-87df-4578-8dd3-d13117130e66 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:01:30.670459 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d3dc2363-0e1b-4fe2-9a6e-5aea86c1ddf2 req-3c395990-87df-4578-8dd3-d13117130e66 service nova] Creating event network-vif-plugged:f3e7d984-80e1-43e8-aded-1c465009ea8f for instance d0b331c4-11f7-411d-9d81-688a988542af on n-h1-845781-6 Aug 09 18:01:30.677387 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d3dc2363-0e1b-4fe2-9a6e-5aea86c1ddf2 req-3c395990-87df-4578-8dd3-d13117130e66 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048925 Aug 09 18:01:30.678673 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3321/6372] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:02:23.155505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69d0633b-8d69-4f58-a022-527e23d51a12 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:23.160317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-69d0633b-8d69-4f58-a022-527e23d51a12 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:23.162838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:23.163763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:02:23.170621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69d0633b-8d69-4f58-a022-527e23d51a12 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.170960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69d0633b-8d69-4f58-a022-527e23d51a12 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.171319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69d0633b-8d69-4f58-a022-527e23d51a12 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.172081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69d0633b-8d69-4f58-a022-527e23d51a12 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.173481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69d0633b-8d69-4f58-a022-527e23d51a12 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.173481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69d0633b-8d69-4f58-a022-527e23d51a12 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.265567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-69d0633b-8d69-4f58-a022-527e23d51a12 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:23.273276 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69d0633b-8d69-4f58-a022-527e23d51a12 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af" status: 200 len: 1472 microversion: 2.1 time: 0.122320 Aug 09 18:02:23.273980 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3322/6373] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:23 2022] GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af => generated 1472 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:02:23.294426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bf4f33ed-510e-4529-a998-7de01b62c668 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:23.295207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bf4f33ed-510e-4529-a998-7de01b62c668 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:23.304097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf4f33ed-510e-4529-a998-7de01b62c668 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.304701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf4f33ed-510e-4529-a998-7de01b62c668 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.305213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf4f33ed-510e-4529-a998-7de01b62c668 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.306005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf4f33ed-510e-4529-a998-7de01b62c668 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.306523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf4f33ed-510e-4529-a998-7de01b62c668 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.307061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bf4f33ed-510e-4529-a998-7de01b62c668 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.398327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bf4f33ed-510e-4529-a998-7de01b62c668 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:23.406633 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bf4f33ed-510e-4529-a998-7de01b62c668 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af" status: 200 len: 1472 microversion: 2.1 time: 0.116631 Aug 09 18:02:23.407817 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3323/6374] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:23 2022] GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af => generated 1472 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:02:23.428721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-56c70831-58e8-40ca-b6a2-c639e933906e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:23.429294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-56c70831-58e8-40ca-b6a2-c639e933906e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:23.436488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56c70831-58e8-40ca-b6a2-c639e933906e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.437336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56c70831-58e8-40ca-b6a2-c639e933906e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.437496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56c70831-58e8-40ca-b6a2-c639e933906e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.438131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56c70831-58e8-40ca-b6a2-c639e933906e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.438603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56c70831-58e8-40ca-b6a2-c639e933906e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.439042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56c70831-58e8-40ca-b6a2-c639e933906e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.532945 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-56c70831-58e8-40ca-b6a2-c639e933906e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af" status: 200 len: 1623 microversion: 2.1 time: 0.108286 Aug 09 18:02:23.533532 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3324/6375] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:23 2022] GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af => generated 1623 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:02:23.553753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-009567d6-c8a9-4b41-ae59-7af78c219d1e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:23.554338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-009567d6-c8a9-4b41-ae59-7af78c219d1e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:23.561236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-009567d6-c8a9-4b41-ae59-7af78c219d1e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.563108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-009567d6-c8a9-4b41-ae59-7af78c219d1e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.563108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-009567d6-c8a9-4b41-ae59-7af78c219d1e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.563108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-009567d6-c8a9-4b41-ae59-7af78c219d1e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.563453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-009567d6-c8a9-4b41-ae59-7af78c219d1e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.563814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-009567d6-c8a9-4b41-ae59-7af78c219d1e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.731502 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-009567d6-c8a9-4b41-ae59-7af78c219d1e tempest-TestSecurityGroupsBasicOps-967351975 tempest-TestSecurityGroupsBasicOps-967351975-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1913 microversion: 2.1 time: 0.181581 Aug 09 18:02:23.732438 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3325/6376] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:23 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1913 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:02:23.805259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb270211-1134-454a-a269-cf4943cacb3e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:23.805769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb270211-1134-454a-a269-cf4943cacb3e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:23.812531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb270211-1134-454a-a269-cf4943cacb3e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.813081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb270211-1134-454a-a269-cf4943cacb3e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.813465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb270211-1134-454a-a269-cf4943cacb3e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.814182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb270211-1134-454a-a269-cf4943cacb3e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.814645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb270211-1134-454a-a269-cf4943cacb3e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.815082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb270211-1134-454a-a269-cf4943cacb3e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.844113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb270211-1134-454a-a269-cf4943cacb3e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:02:23.932670 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb270211-1134-454a-a269-cf4943cacb3e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af" status: 204 len: 0 microversion: 2.1 time: 0.130459 Aug 09 18:02:23.933817 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3326/6377] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:02:23 2022] DELETE /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:02:23.942875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b463118c-45d8-4c69-bbf8-efb23a8a66d1 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:23.943644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b463118c-45d8-4c69-bbf8-efb23a8a66d1 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:23.953115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463118c-45d8-4c69-bbf8-efb23a8a66d1 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.953622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463118c-45d8-4c69-bbf8-efb23a8a66d1 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.954088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463118c-45d8-4c69-bbf8-efb23a8a66d1 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:23.954789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463118c-45d8-4c69-bbf8-efb23a8a66d1 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:23.955255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463118c-45d8-4c69-bbf8-efb23a8a66d1 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:23.955704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b463118c-45d8-4c69-bbf8-efb23a8a66d1 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:24.042091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b463118c-45d8-4c69-bbf8-efb23a8a66d1 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:24.050048 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b463118c-45d8-4c69-bbf8-efb23a8a66d1 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af" status: 200 len: 1478 microversion: 2.1 time: 0.111398 Aug 09 18:02:24.050649 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3327/6378] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:23 2022] GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af => generated 1478 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:02:25.072986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8947a246-ca59-458d-9062-cabbe61e6bed tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:25.073636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8947a246-ca59-458d-9062-cabbe61e6bed tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:25.081580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8947a246-ca59-458d-9062-cabbe61e6bed tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:25.082135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8947a246-ca59-458d-9062-cabbe61e6bed tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:25.082573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8947a246-ca59-458d-9062-cabbe61e6bed tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:25.083281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8947a246-ca59-458d-9062-cabbe61e6bed tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:25.083764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8947a246-ca59-458d-9062-cabbe61e6bed tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:25.084192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8947a246-ca59-458d-9062-cabbe61e6bed tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:25.170181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8947a246-ca59-458d-9062-cabbe61e6bed tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:25.179690 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8947a246-ca59-458d-9062-cabbe61e6bed tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af" status: 200 len: 1478 microversion: 2.1 time: 0.111125 Aug 09 18:02:25.180417 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3328/6379] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:25 2022] GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af => generated 1478 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:02:25.921708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6a8f5bf7-cefa-4fb1-97ef-0e864572500d req-be554083-15fb-4d4e-8704-4c870662830e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b331c4-11f7-411d-9d81-688a988542af", "name": "network-vif-deleted", "tag": "f3e7d984-80e1-43e8-aded-1c465009ea8f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:25.934204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6a8f5bf7-cefa-4fb1-97ef-0e864572500d req-be554083-15fb-4d4e-8704-4c870662830e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:25.934728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6a8f5bf7-cefa-4fb1-97ef-0e864572500d req-be554083-15fb-4d4e-8704-4c870662830e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:25.944501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6a8f5bf7-cefa-4fb1-97ef-0e864572500d req-be554083-15fb-4d4e-8704-4c870662830e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:25.959411 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6a8f5bf7-cefa-4fb1-97ef-0e864572500d req-be554083-15fb-4d4e-8704-4c870662830e service nova] Creating event network-vif-deleted:f3e7d984-80e1-43e8-aded-1c465009ea8f for instance d0b331c4-11f7-411d-9d81-688a988542af on n-h1-845781-6 Aug 09 18:02:25.965664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6a8f5bf7-cefa-4fb1-97ef-0e864572500d req-be554083-15fb-4d4e-8704-4c870662830e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047483 Aug 09 18:02:25.966506 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3329/6380] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:02:26.206026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:26.207944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:26.215453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:26.216014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:26.216454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:26.217162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:26.217658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:26.218070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:26.254156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:26.254641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:26.255080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:26.255573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lazy-loading 'fault' on Instance uuid d0b331c4-11f7-411d-9d81-688a988542af {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:02:26.300382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:26.321931 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-be09a61e-5422-4afb-81cc-c9fbd6b3c473 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af" status: 200 len: 1332 microversion: 2.1 time: 0.121452 Aug 09 18:02:26.327680 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3330/6381] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:26 2022] GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:02:27.345458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:27.346145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: d0b331c4-11f7-411d-9d81-688a988542af] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:27.352762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:27.353360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:27.354400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:27.355219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:27.355705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:27.356138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:27.370270 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] HTTP exception thrown: Instance d0b331c4-11f7-411d-9d81-688a988542af could not be found. Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Request method failure captured: Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af HTTP/1.1 Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qCmnEv27HeikTngdx3v2YVJGoMJl9dVV1fjq12-ioqLOb5TGPvmgPoKwUhEzsUVUNSHdReaMJ1MnAL69uSfX7Zev-BkHyE7XKAqoXdzGIWb3Tas1VU9MWqot5UntaakGrhm9T37kQD6j3y7SiEtK8DgV9z2hYNcRq57TnE2_BlfOgw Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: c6ca8c6d12ff405ba78d24f194ebfbbb Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1985737170 Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c6ca8c6d12ff405ba78d24f194ebfbbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6ca8c6d12ff405ba78d24f194ebfbbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6ca8c6d12ff405ba78d24f194ebfbbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c6ca8c6d12ff405ba78d24f194ebfbbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1985737170 Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: c6ca8c6d12ff405ba78d24f194ebfbbb Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1985737170 Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestSecurityGroupsBasicOps-1985737170-project Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e13314961e5349ddbaa3de9a92389740 Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1985737170-project Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance d0b331c4-11f7-411d-9d81-688a988542af could not be found. Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'd0b331c4-11f7-411d-9d81-688a988542af'} Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b331c4-11f7-411d-9d81-688a988542af could not be found. Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b331c4-11f7-411d-9d81-688a988542af could not be found. Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:02:27.371962 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:02:27.377554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:02:27.377554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:02:27.377554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:02:27.377554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:02:27.377554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:02:27.377554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:02:27.377554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b331c4-11f7-411d-9d81-688a988542af could not be found. Aug 09 18:02:27.377554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:02:27.377554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Returning 404 to user: Instance d0b331c4-11f7-411d-9d81-688a988542af could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:02:27.377554 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43764ed4-2ce0-451e-95c6-5a76f8a43a9d tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af" status: 404 len: 111 microversion: 2.1 time: 0.031984 Aug 09 18:02:27.377554 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3331/6382] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:27 2022] GET /compute/v2.1/servers/d0b331c4-11f7-411d-9d81-688a988542af => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:02:32.404710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a1424af-0dfa-4d8e-ae50-36e8523a3c8a tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:32.405498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a1424af-0dfa-4d8e-ae50-36e8523a3c8a tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:32.412477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a1424af-0dfa-4d8e-ae50-36e8523a3c8a tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:32.413441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a1424af-0dfa-4d8e-ae50-36e8523a3c8a tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:32.413996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a1424af-0dfa-4d8e-ae50-36e8523a3c8a tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:32.414829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a1424af-0dfa-4d8e-ae50-36e8523a3c8a tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:32.415410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a1424af-0dfa-4d8e-ae50-36e8523a3c8a tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:32.416682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a1424af-0dfa-4d8e-ae50-36e8523a3c8a tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:32.447425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a1424af-0dfa-4d8e-ae50-36e8523a3c8a tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:02:32.548583 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a1424af-0dfa-4d8e-ae50-36e8523a3c8a tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 204 len: 0 microversion: 2.1 time: 0.148531 Aug 09 18:02:32.549305 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3332/6383] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:02:32 2022] DELETE /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:02:32.559117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-05e9879d-8427-4956-9dcd-0d73500bcea0 req-62362189-ce41-457f-bac2-2f7a5c8f505e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6754133-c763-45e8-b470-3f97081aa609", "tag": "00433ca9-1703-4039-b1b1-9c203f121a0e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:32.570376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-05e9879d-8427-4956-9dcd-0d73500bcea0 req-62362189-ce41-457f-bac2-2f7a5c8f505e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:32.571049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-05e9879d-8427-4956-9dcd-0d73500bcea0 req-62362189-ce41-457f-bac2-2f7a5c8f505e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:32.571611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-05e9879d-8427-4956-9dcd-0d73500bcea0 req-62362189-ce41-457f-bac2-2f7a5c8f505e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:32.585737 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-05e9879d-8427-4956-9dcd-0d73500bcea0 req-62362189-ce41-457f-bac2-2f7a5c8f505e service nova] Creating event network-changed:00433ca9-1703-4039-b1b1-9c203f121a0e for instance f6754133-c763-45e8-b470-3f97081aa609 on n-h2-845781-6 Aug 09 18:02:32.595193 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-05e9879d-8427-4956-9dcd-0d73500bcea0 req-62362189-ce41-457f-bac2-2f7a5c8f505e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040432 Aug 09 18:02:32.596237 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3333/6384] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:02:32.606171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7848588f-654a-4240-8624-676a5231a6b5 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:32.606896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7848588f-654a-4240-8624-676a5231a6b5 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:32.613989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7848588f-654a-4240-8624-676a5231a6b5 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:32.614845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7848588f-654a-4240-8624-676a5231a6b5 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:32.615129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7848588f-654a-4240-8624-676a5231a6b5 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:32.616126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7848588f-654a-4240-8624-676a5231a6b5 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:32.616765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7848588f-654a-4240-8624-676a5231a6b5 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:32.617402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7848588f-654a-4240-8624-676a5231a6b5 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:32.775783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7848588f-654a-4240-8624-676a5231a6b5 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:32.789131 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7848588f-654a-4240-8624-676a5231a6b5 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1768 microversion: 2.1 time: 0.187930 Aug 09 18:02:32.789734 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3334/6385] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:32 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1768 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:02:33.813195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af85fd97-3784-4f4b-aff5-d203eeaa418e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:33.813967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-af85fd97-3784-4f4b-aff5-d203eeaa418e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:33.821417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af85fd97-3784-4f4b-aff5-d203eeaa418e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:33.821956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af85fd97-3784-4f4b-aff5-d203eeaa418e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:33.822406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af85fd97-3784-4f4b-aff5-d203eeaa418e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:33.823123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af85fd97-3784-4f4b-aff5-d203eeaa418e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:33.823586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af85fd97-3784-4f4b-aff5-d203eeaa418e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:33.824155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af85fd97-3784-4f4b-aff5-d203eeaa418e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:34.064515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-af85fd97-3784-4f4b-aff5-d203eeaa418e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13314961e5349ddbaa3de9a92389740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ca8c6d12ff405ba78d24f194ebfbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:02:34.076722 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-af85fd97-3784-4f4b-aff5-d203eeaa418e tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 200 len: 1768 microversion: 2.1 time: 0.267547 Aug 09 18:02:34.078421 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3335/6386] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:33 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 1768 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:02:34.609801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e4e772b6-3f9a-44d6-9812-6091511665d6 req-8d25d0e7-7dd3-4f50-b5e8-58d77a70e9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6754133-c763-45e8-b470-3f97081aa609", "name": "network-vif-deleted", "tag": "00433ca9-1703-4039-b1b1-9c203f121a0e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:02:34.620627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e4e772b6-3f9a-44d6-9812-6091511665d6 req-8d25d0e7-7dd3-4f50-b5e8-58d77a70e9c9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:34.621381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e4e772b6-3f9a-44d6-9812-6091511665d6 req-8d25d0e7-7dd3-4f50-b5e8-58d77a70e9c9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:34.621927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e4e772b6-3f9a-44d6-9812-6091511665d6 req-8d25d0e7-7dd3-4f50-b5e8-58d77a70e9c9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:34.633829 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e4e772b6-3f9a-44d6-9812-6091511665d6 req-8d25d0e7-7dd3-4f50-b5e8-58d77a70e9c9 service nova] Creating event network-vif-deleted:00433ca9-1703-4039-b1b1-9c203f121a0e for instance f6754133-c763-45e8-b470-3f97081aa609 on n-h2-845781-6 Aug 09 18:02:34.639328 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e4e772b6-3f9a-44d6-9812-6091511665d6 req-8d25d0e7-7dd3-4f50-b5e8-58d77a70e9c9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087528 Aug 09 18:02:34.639974 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3336/6387] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:02:35.100604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:35.101234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [instance: f6754133-c763-45e8-b470-3f97081aa609] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:02:35.108068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:35.108565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:35.109003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:35.109704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:02:35.110169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:02:35.110598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:02:35.132626 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] HTTP exception thrown: Instance f6754133-c763-45e8-b470-3f97081aa609 could not be found. Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Request method failure captured: Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 HTTP/1.1 Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qCmnEv27HeikTngdx3v2YVJGoMJl9dVV1fjq12-ioqLOb5TGPvmgPoKwUhEzsUVUNSHdReaMJ1MnAL69uSfX7Zev-BkHyE7XKAqoXdzGIWb3Tas1VU9MWqot5UntaakGrhm9T37kQD6j3y7SiEtK8DgV9z2hYNcRq57TnE2_BlfOgw Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: c6ca8c6d12ff405ba78d24f194ebfbbb Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1985737170 Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c6ca8c6d12ff405ba78d24f194ebfbbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6ca8c6d12ff405ba78d24f194ebfbbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c6ca8c6d12ff405ba78d24f194ebfbbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c6ca8c6d12ff405ba78d24f194ebfbbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1985737170 Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: c6ca8c6d12ff405ba78d24f194ebfbbb Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1985737170 Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestSecurityGroupsBasicOps-1985737170-project Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: e13314961e5349ddbaa3de9a92389740 Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1985737170-project Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance f6754133-c763-45e8-b470-3f97081aa609 could not be found. Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'f6754133-c763-45e8-b470-3f97081aa609'} Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6754133-c763-45e8-b470-3f97081aa609 could not be found. Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6754133-c763-45e8-b470-3f97081aa609 could not be found. Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:02:35.134338 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:02:35.140206 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:02:35.140206 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:02:35.140206 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:02:35.140206 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:02:35.140206 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:02:35.140206 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:02:35.140206 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6754133-c763-45e8-b470-3f97081aa609 could not be found. Aug 09 18:02:35.140206 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:02:35.140206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Returning 404 to user: Instance f6754133-c763-45e8-b470-3f97081aa609 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:02:35.140206 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-536f265b-644d-45a3-9fa4-cde2623b0b86 tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609" status: 404 len: 111 microversion: 2.1 time: 0.040666 Aug 09 18:02:35.140206 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3337/6388] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:02:35 2022] GET /compute/v2.1/servers/f6754133-c763-45e8-b470-3f97081aa609 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:02:38.950107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b48b9722-502a-4c04-b355-2cb990e1902c tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] Calling method '.version_select at 0x7fbbca4a3f70>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:02:38.959833 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b48b9722-502a-4c04-b355-2cb990e1902c tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [49dc9fd5-bcbd-4fa9-bc72-49fff9e68c2b] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:02:39.967986 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [None req-b48b9722-502a-4c04-b355-2cb990e1902c tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] [49dc9fd5-bcbd-4fa9-bc72-49fff9e68c2b] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 33782. Aug 09 18:02:39.988320 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b48b9722-502a-4c04-b355-2cb990e1902c tempest-TestSecurityGroupsBasicOps-1985737170 tempest-TestSecurityGroupsBasicOps-1985737170-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1692144490" status: 202 len: 0 microversion: 2.1 time: 1.046532 Aug 09 18:02:39.988912 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3338/6389] 10.222.0.93 () {58 vars in 1278 bytes} [Tue Aug 9 18:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1692144490 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:03:02.077474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:02.078259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:02.082802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7da64cdf-2542-43bc-b635-2a538283dad2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:02.083372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7da64cdf-2542-43bc-b635-2a538283dad2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:02.091558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da64cdf-2542-43bc-b635-2a538283dad2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:02.092199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da64cdf-2542-43bc-b635-2a538283dad2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:02.092535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da64cdf-2542-43bc-b635-2a538283dad2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:02.093239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da64cdf-2542-43bc-b635-2a538283dad2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:02.093698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da64cdf-2542-43bc-b635-2a538283dad2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:02.094127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da64cdf-2542-43bc-b635-2a538283dad2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:02.122605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7da64cdf-2542-43bc-b635-2a538283dad2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:03:02.207068 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7da64cdf-2542-43bc-b635-2a538283dad2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 204 len: 0 microversion: 2.1 time: 0.131099 Aug 09 18:03:02.209511 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3339/6390] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:03:02 2022] DELETE /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:03:02.218315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6cd09f38-bc44-4e94-b8cd-22961c321456 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:02.219339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6cd09f38-bc44-4e94-b8cd-22961c321456 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:02.227902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd09f38-bc44-4e94-b8cd-22961c321456 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:02.228397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd09f38-bc44-4e94-b8cd-22961c321456 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:02.228834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd09f38-bc44-4e94-b8cd-22961c321456 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:02.229542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd09f38-bc44-4e94-b8cd-22961c321456 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:02.229990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd09f38-bc44-4e94-b8cd-22961c321456 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:02.230415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd09f38-bc44-4e94-b8cd-22961c321456 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:02.365242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6cd09f38-bc44-4e94-b8cd-22961c321456 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:02.374064 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6cd09f38-bc44-4e94-b8cd-22961c321456 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1574 microversion: 2.1 time: 0.160038 Aug 09 18:03:02.374991 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3340/6391] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:02 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:03.394990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09a4342d-a9e1-4d43-909c-751869bbc7a0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:03.396051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09a4342d-a9e1-4d43-909c-751869bbc7a0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:03.404416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a4342d-a9e1-4d43-909c-751869bbc7a0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:03.404917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a4342d-a9e1-4d43-909c-751869bbc7a0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:03.405370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a4342d-a9e1-4d43-909c-751869bbc7a0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:03.406091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a4342d-a9e1-4d43-909c-751869bbc7a0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:03.406558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a4342d-a9e1-4d43-909c-751869bbc7a0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:03.407050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09a4342d-a9e1-4d43-909c-751869bbc7a0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:03.557974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-09a4342d-a9e1-4d43-909c-751869bbc7a0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:03.565854 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09a4342d-a9e1-4d43-909c-751869bbc7a0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1574 microversion: 2.1 time: 0.174769 Aug 09 18:03:03.566649 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3341/6392] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:03 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:04.588612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d822766b-7596-4322-bf5f-4245963a5852 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:04.589306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d822766b-7596-4322-bf5f-4245963a5852 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:04.596546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d822766b-7596-4322-bf5f-4245963a5852 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:04.597262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d822766b-7596-4322-bf5f-4245963a5852 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:04.597824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d822766b-7596-4322-bf5f-4245963a5852 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:04.598659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d822766b-7596-4322-bf5f-4245963a5852 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:04.599218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d822766b-7596-4322-bf5f-4245963a5852 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:04.599777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d822766b-7596-4322-bf5f-4245963a5852 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:04.696217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d822766b-7596-4322-bf5f-4245963a5852 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:04.706342 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d822766b-7596-4322-bf5f-4245963a5852 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1507 microversion: 2.1 time: 0.122269 Aug 09 18:03:04.709537 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3342/6393] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:04 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1507 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:04.973775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9abe374f-fa10-4a3a-852e-1678b45ec012 req-71ec2883-1e9e-45f3-b92d-b13a4ddbeef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf", "name": "network-vif-deleted", "tag": "022f8d09-7680-47d3-bfda-f5504c672286"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:04.986772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9abe374f-fa10-4a3a-852e-1678b45ec012 req-71ec2883-1e9e-45f3-b92d-b13a4ddbeef4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:04.987272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9abe374f-fa10-4a3a-852e-1678b45ec012 req-71ec2883-1e9e-45f3-b92d-b13a4ddbeef4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:04.987745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9abe374f-fa10-4a3a-852e-1678b45ec012 req-71ec2883-1e9e-45f3-b92d-b13a4ddbeef4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:05.002990 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9abe374f-fa10-4a3a-852e-1678b45ec012 req-71ec2883-1e9e-45f3-b92d-b13a4ddbeef4 service nova] Creating event network-vif-deleted:022f8d09-7680-47d3-bfda-f5504c672286 for instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf on n-h1-845781-6 Aug 09 18:03:05.018731 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9abe374f-fa10-4a3a-852e-1678b45ec012 req-71ec2883-1e9e-45f3-b92d-b13a4ddbeef4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047839 Aug 09 18:03:05.022366 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3343/6394] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:05.730192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bcffd01b-c54c-4c31-865e-cb00e5d9512d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:05.731306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bcffd01b-c54c-4c31-865e-cb00e5d9512d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:05.751729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcffd01b-c54c-4c31-865e-cb00e5d9512d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:05.752229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcffd01b-c54c-4c31-865e-cb00e5d9512d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:05.752672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcffd01b-c54c-4c31-865e-cb00e5d9512d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:05.753390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcffd01b-c54c-4c31-865e-cb00e5d9512d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:05.753844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcffd01b-c54c-4c31-865e-cb00e5d9512d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:05.754271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bcffd01b-c54c-4c31-865e-cb00e5d9512d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:05.854210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bcffd01b-c54c-4c31-865e-cb00e5d9512d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:05.869953 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bcffd01b-c54c-4c31-865e-cb00e5d9512d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1223 microversion: 2.1 time: 0.144610 Aug 09 18:03:05.879010 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3344/6395] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:05 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1223 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:06.892479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-856881d7-bf0a-449d-907d-0906ffcd81dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:06.893162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-856881d7-bf0a-449d-907d-0906ffcd81dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:06.900682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856881d7-bf0a-449d-907d-0906ffcd81dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:06.901176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856881d7-bf0a-449d-907d-0906ffcd81dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:06.901692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856881d7-bf0a-449d-907d-0906ffcd81dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:06.902319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856881d7-bf0a-449d-907d-0906ffcd81dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:06.902773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856881d7-bf0a-449d-907d-0906ffcd81dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:06.903329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-856881d7-bf0a-449d-907d-0906ffcd81dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:06.969714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-856881d7-bf0a-449d-907d-0906ffcd81dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:06.980044 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-856881d7-bf0a-449d-907d-0906ffcd81dc tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1223 microversion: 2.1 time: 0.091398 Aug 09 18:03:06.980804 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3345/6396] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:06 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:08.000306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-48d34108-a525-4154-b54e-06c6c7dcb62b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:08.001051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-48d34108-a525-4154-b54e-06c6c7dcb62b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:08.008741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48d34108-a525-4154-b54e-06c6c7dcb62b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:08.009358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48d34108-a525-4154-b54e-06c6c7dcb62b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:08.009907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48d34108-a525-4154-b54e-06c6c7dcb62b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:08.010720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48d34108-a525-4154-b54e-06c6c7dcb62b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:08.011285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48d34108-a525-4154-b54e-06c6c7dcb62b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:08.011920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-48d34108-a525-4154-b54e-06c6c7dcb62b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:08.093666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-48d34108-a525-4154-b54e-06c6c7dcb62b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:08.102477 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-48d34108-a525-4154-b54e-06c6c7dcb62b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1223 microversion: 2.1 time: 0.105533 Aug 09 18:03:08.103192 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3346/6397] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:07 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:09.123003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8562d43a-ba91-479a-b587-e9e3302b81ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:09.123689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8562d43a-ba91-479a-b587-e9e3302b81ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:09.131248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8562d43a-ba91-479a-b587-e9e3302b81ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:09.131775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8562d43a-ba91-479a-b587-e9e3302b81ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:09.132228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8562d43a-ba91-479a-b587-e9e3302b81ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:09.132985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8562d43a-ba91-479a-b587-e9e3302b81ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:09.133446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8562d43a-ba91-479a-b587-e9e3302b81ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:09.133885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8562d43a-ba91-479a-b587-e9e3302b81ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:09.205392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8562d43a-ba91-479a-b587-e9e3302b81ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:09.216171 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8562d43a-ba91-479a-b587-e9e3302b81ad tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 200 len: 1223 microversion: 2.1 time: 0.096921 Aug 09 18:03:09.217268 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3347/6398] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:09 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:10.239808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:10.241104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:10.248058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:10.248544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:10.248984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:10.249681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:10.250135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:10.250560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:10.265356 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf HTTP/1.1 Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf'} Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:03:10.267052 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:03:10.272771 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:03:10.272771 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:03:10.272771 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:03:10.272771 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:03:10.272771 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:03:10.272771 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:03:10.272771 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:03:10.272771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:03:10.272771 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9a9f0644-0636-416a-aa04-48ce817139ea tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 404 len: 111 microversion: 2.1 time: 0.032934 Aug 09 18:03:10.272771 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3348/6399] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:10 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:03:10.373583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-144973988", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-502915138", "security_groups": [{"name": "tempest-secgroup-smoke-119401263"}], "block_device_mapping_v2": [{"uuid": "0431365f-28c1-4110-8c83-595cd23f306f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:10.500565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] validate_networks() for [('0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:03:11.020462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:03:11.020900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:03:11.021580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:03:11.022009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:03:11.022435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:03:11.035357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:11.035893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:11.036346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:11.037088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:11.037554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:11.038143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:11.059296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:03:11.065185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for user 87590ee7f71345a8914b350c5999d974 and project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:03:11.129832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:03:11.131991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0431365f-28c1-4110-8c83-595cd23f306f',volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:03:11.268998 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b8b76e2-f646-4d54-b0d4-e3ac39f1dd35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.899669 Aug 09 18:03:11.271698 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3349/6400] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:03:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:03:11.280272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4573fada-8a74-40e5-b1f7-2b3e8c8d2ea0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:11.280895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4573fada-8a74-40e5-b1f7-2b3e8c8d2ea0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:11.340832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4573fada-8a74-40e5-b1f7-2b3e8c8d2ea0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:11.349152 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4573fada-8a74-40e5-b1f7-2b3e8c8d2ea0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1093 microversion: 2.1 time: 0.072578 Aug 09 18:03:11.350959 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3350/6401] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:11 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:12.370440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-877af757-767d-445f-9f75-4664beaf3879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:12.371136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-877af757-767d-445f-9f75-4664beaf3879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:12.379259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-877af757-767d-445f-9f75-4664beaf3879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:12.379881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-877af757-767d-445f-9f75-4664beaf3879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:12.380406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-877af757-767d-445f-9f75-4664beaf3879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:12.381210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-877af757-767d-445f-9f75-4664beaf3879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:12.381753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-877af757-767d-445f-9f75-4664beaf3879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:12.382257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-877af757-767d-445f-9f75-4664beaf3879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:12.453429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-877af757-767d-445f-9f75-4664beaf3879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:12.462175 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-877af757-767d-445f-9f75-4664beaf3879 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1191 microversion: 2.1 time: 0.095644 Aug 09 18:03:12.463536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3351/6402] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:12 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:13.484979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a9d8a8bd-b785-4028-9a9a-0a0d8964c500 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:13.485602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a9d8a8bd-b785-4028-9a9a-0a0d8964c500 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:13.495035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9d8a8bd-b785-4028-9a9a-0a0d8964c500 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:13.495810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9d8a8bd-b785-4028-9a9a-0a0d8964c500 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:13.496431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9d8a8bd-b785-4028-9a9a-0a0d8964c500 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:13.497361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9d8a8bd-b785-4028-9a9a-0a0d8964c500 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:13.498027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9d8a8bd-b785-4028-9a9a-0a0d8964c500 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:13.498668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a9d8a8bd-b785-4028-9a9a-0a0d8964c500 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:13.596416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a9d8a8bd-b785-4028-9a9a-0a0d8964c500 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:13.607756 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a9d8a8bd-b785-4028-9a9a-0a0d8964c500 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1209 microversion: 2.1 time: 0.126549 Aug 09 18:03:13.620570 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3352/6403] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:13 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1209 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:14.528302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-169fca87-4a2f-4268-a680-2aea018b5d8b req-44a00a13-5c67-4524-bba6-7900128ed2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "673d28e7-9ff3-49d3-92ec-69b20c4c3c3d", "tag": "ba5a631d-2557-484d-a0ac-7ce9c92ca81a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:14.543989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-169fca87-4a2f-4268-a680-2aea018b5d8b req-44a00a13-5c67-4524-bba6-7900128ed2b0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:14.544744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-169fca87-4a2f-4268-a680-2aea018b5d8b req-44a00a13-5c67-4524-bba6-7900128ed2b0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:14.545371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-169fca87-4a2f-4268-a680-2aea018b5d8b req-44a00a13-5c67-4524-bba6-7900128ed2b0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:14.559600 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-169fca87-4a2f-4268-a680-2aea018b5d8b req-44a00a13-5c67-4524-bba6-7900128ed2b0 service nova] Creating event network-changed:ba5a631d-2557-484d-a0ac-7ce9c92ca81a for instance 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d on n-h2-845781-6 Aug 09 18:03:14.565446 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-169fca87-4a2f-4268-a680-2aea018b5d8b req-44a00a13-5c67-4524-bba6-7900128ed2b0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041798 Aug 09 18:03:14.566516 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3353/6404] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:14.631529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-743876f7-f3b9-42e6-91c5-2dc25e792474 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:14.633211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-743876f7-f3b9-42e6-91c5-2dc25e792474 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:14.640606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-743876f7-f3b9-42e6-91c5-2dc25e792474 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:14.641579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-743876f7-f3b9-42e6-91c5-2dc25e792474 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:14.642365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-743876f7-f3b9-42e6-91c5-2dc25e792474 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:14.643257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-743876f7-f3b9-42e6-91c5-2dc25e792474 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:14.644030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-743876f7-f3b9-42e6-91c5-2dc25e792474 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:14.644637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-743876f7-f3b9-42e6-91c5-2dc25e792474 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:14.927934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-743876f7-f3b9-42e6-91c5-2dc25e792474 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:14.940785 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-743876f7-f3b9-42e6-91c5-2dc25e792474 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1276 microversion: 2.1 time: 0.311783 Aug 09 18:03:14.944080 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3354/6405] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:14 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1276 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:15.968121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-502ae442-6352-4a2a-bb7b-b4f955a5fdd0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:15.968783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-502ae442-6352-4a2a-bb7b-b4f955a5fdd0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:15.975798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-502ae442-6352-4a2a-bb7b-b4f955a5fdd0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:15.976891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-502ae442-6352-4a2a-bb7b-b4f955a5fdd0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:15.977347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-502ae442-6352-4a2a-bb7b-b4f955a5fdd0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:15.978075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-502ae442-6352-4a2a-bb7b-b4f955a5fdd0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:15.978544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-502ae442-6352-4a2a-bb7b-b4f955a5fdd0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:15.978976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-502ae442-6352-4a2a-bb7b-b4f955a5fdd0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:16.140459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-502ae442-6352-4a2a-bb7b-b4f955a5fdd0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:16.151568 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-502ae442-6352-4a2a-bb7b-b4f955a5fdd0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1276 microversion: 2.1 time: 0.187165 Aug 09 18:03:16.152655 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3355/6406] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:15 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:17.173765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1fcb8831-976d-4f23-8e31-93ef459683de tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:17.174516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1fcb8831-976d-4f23-8e31-93ef459683de tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:17.184651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fcb8831-976d-4f23-8e31-93ef459683de tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:17.185478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fcb8831-976d-4f23-8e31-93ef459683de tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:17.185996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fcb8831-976d-4f23-8e31-93ef459683de tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:17.186822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fcb8831-976d-4f23-8e31-93ef459683de tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:17.187391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fcb8831-976d-4f23-8e31-93ef459683de tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:17.187957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1fcb8831-976d-4f23-8e31-93ef459683de tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:17.339059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1fcb8831-976d-4f23-8e31-93ef459683de tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:17.355788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1fcb8831-976d-4f23-8e31-93ef459683de tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1276 microversion: 2.1 time: 0.186145 Aug 09 18:03:17.356874 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3356/6407] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:17 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:18.378727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-106bf145-341e-4bf0-91e5-ee688bae9531 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:18.379385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-106bf145-341e-4bf0-91e5-ee688bae9531 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:18.386976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-106bf145-341e-4bf0-91e5-ee688bae9531 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:18.387463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-106bf145-341e-4bf0-91e5-ee688bae9531 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:18.387938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-106bf145-341e-4bf0-91e5-ee688bae9531 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:18.388885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-106bf145-341e-4bf0-91e5-ee688bae9531 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:18.392600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-106bf145-341e-4bf0-91e5-ee688bae9531 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:18.392600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-106bf145-341e-4bf0-91e5-ee688bae9531 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:18.412181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:18.535932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-106bf145-341e-4bf0-91e5-ee688bae9531 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:18.543709 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-106bf145-341e-4bf0-91e5-ee688bae9531 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1264 microversion: 2.1 time: 0.169190 Aug 09 18:03:18.544312 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3357/6408] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:18 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:19.564891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-deaec160-f78b-4490-b24a-1f1e2ab45fa0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:19.565624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-deaec160-f78b-4490-b24a-1f1e2ab45fa0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:19.573601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deaec160-f78b-4490-b24a-1f1e2ab45fa0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:19.574174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deaec160-f78b-4490-b24a-1f1e2ab45fa0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:19.574629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deaec160-f78b-4490-b24a-1f1e2ab45fa0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:19.575495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deaec160-f78b-4490-b24a-1f1e2ab45fa0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:19.575994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deaec160-f78b-4490-b24a-1f1e2ab45fa0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:19.576430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-deaec160-f78b-4490-b24a-1f1e2ab45fa0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:19.717377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-deaec160-f78b-4490-b24a-1f1e2ab45fa0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:19.725242 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-deaec160-f78b-4490-b24a-1f1e2ab45fa0 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1264 microversion: 2.1 time: 0.164190 Aug 09 18:03:19.725832 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3358/6409] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:19 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:20.747055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fec906bc-9534-41a3-9aed-3ae4b75d09ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:20.747775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fec906bc-9534-41a3-9aed-3ae4b75d09ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:20.754501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec906bc-9534-41a3-9aed-3ae4b75d09ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:20.754995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec906bc-9534-41a3-9aed-3ae4b75d09ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:20.755426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec906bc-9534-41a3-9aed-3ae4b75d09ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:20.756146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec906bc-9534-41a3-9aed-3ae4b75d09ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:20.756601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec906bc-9534-41a3-9aed-3ae4b75d09ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:20.757105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fec906bc-9534-41a3-9aed-3ae4b75d09ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:20.893685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fec906bc-9534-41a3-9aed-3ae4b75d09ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:20.901475 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fec906bc-9534-41a3-9aed-3ae4b75d09ae tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1264 microversion: 2.1 time: 0.158252 Aug 09 18:03:20.902072 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3359/6410] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:20 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:21.928633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8fe32e75-940b-4709-a22a-e70c5b7f7532 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:21.929466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8fe32e75-940b-4709-a22a-e70c5b7f7532 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:21.932112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:21.932981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:21.943463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fe32e75-940b-4709-a22a-e70c5b7f7532 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:21.944082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fe32e75-940b-4709-a22a-e70c5b7f7532 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:21.944552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fe32e75-940b-4709-a22a-e70c5b7f7532 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:21.945901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fe32e75-940b-4709-a22a-e70c5b7f7532 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:21.946382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fe32e75-940b-4709-a22a-e70c5b7f7532 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:21.946801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fe32e75-940b-4709-a22a-e70c5b7f7532 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:22.094332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8fe32e75-940b-4709-a22a-e70c5b7f7532 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:22.102653 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8fe32e75-940b-4709-a22a-e70c5b7f7532 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1264 microversion: 2.1 time: 0.182304 Aug 09 18:03:22.103259 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3360/6411] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:21 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:03:23.123691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6a17daab-c500-4c08-87ae-3b74ec017274 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:23.124314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6a17daab-c500-4c08-87ae-3b74ec017274 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:23.131813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a17daab-c500-4c08-87ae-3b74ec017274 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:23.132863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a17daab-c500-4c08-87ae-3b74ec017274 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:23.133317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a17daab-c500-4c08-87ae-3b74ec017274 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:23.134032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a17daab-c500-4c08-87ae-3b74ec017274 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:23.134495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a17daab-c500-4c08-87ae-3b74ec017274 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:23.134930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a17daab-c500-4c08-87ae-3b74ec017274 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:23.271839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6a17daab-c500-4c08-87ae-3b74ec017274 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:23.279479 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6a17daab-c500-4c08-87ae-3b74ec017274 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1264 microversion: 2.1 time: 0.160060 Aug 09 18:03:23.280088 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3361/6412] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:23 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:24.303713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-945b8dd3-9b0f-4319-84f5-4d81dddf45f2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:24.304440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-945b8dd3-9b0f-4319-84f5-4d81dddf45f2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:24.311312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-945b8dd3-9b0f-4319-84f5-4d81dddf45f2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:24.311846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-945b8dd3-9b0f-4319-84f5-4d81dddf45f2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:24.312297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-945b8dd3-9b0f-4319-84f5-4d81dddf45f2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:24.313003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-945b8dd3-9b0f-4319-84f5-4d81dddf45f2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:24.313516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-945b8dd3-9b0f-4319-84f5-4d81dddf45f2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:24.313951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-945b8dd3-9b0f-4319-84f5-4d81dddf45f2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:24.456251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-945b8dd3-9b0f-4319-84f5-4d81dddf45f2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:24.465143 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-945b8dd3-9b0f-4319-84f5-4d81dddf45f2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1264 microversion: 2.1 time: 0.165364 Aug 09 18:03:24.465776 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3362/6413] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:24 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:25.486378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4fabb7ed-bf32-4f23-90c2-1cb1c8ec9a64 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:25.487095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4fabb7ed-bf32-4f23-90c2-1cb1c8ec9a64 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:25.493936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fabb7ed-bf32-4f23-90c2-1cb1c8ec9a64 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:25.494423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fabb7ed-bf32-4f23-90c2-1cb1c8ec9a64 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:25.494873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fabb7ed-bf32-4f23-90c2-1cb1c8ec9a64 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:25.495579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fabb7ed-bf32-4f23-90c2-1cb1c8ec9a64 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:25.496076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fabb7ed-bf32-4f23-90c2-1cb1c8ec9a64 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:25.496512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fabb7ed-bf32-4f23-90c2-1cb1c8ec9a64 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:25.635923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4fabb7ed-bf32-4f23-90c2-1cb1c8ec9a64 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:25.643742 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4fabb7ed-bf32-4f23-90c2-1cb1c8ec9a64 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1264 microversion: 2.1 time: 0.161330 Aug 09 18:03:25.644633 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3363/6414] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:25 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:26.664734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a92c83f-dfc9-4631-b57c-e8174a7e8592 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:26.665476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a92c83f-dfc9-4631-b57c-e8174a7e8592 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:26.672806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a92c83f-dfc9-4631-b57c-e8174a7e8592 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:26.673297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a92c83f-dfc9-4631-b57c-e8174a7e8592 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:26.673739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a92c83f-dfc9-4631-b57c-e8174a7e8592 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:26.674452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a92c83f-dfc9-4631-b57c-e8174a7e8592 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:26.674906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a92c83f-dfc9-4631-b57c-e8174a7e8592 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:26.675340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a92c83f-dfc9-4631-b57c-e8174a7e8592 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:26.832838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a92c83f-dfc9-4631-b57c-e8174a7e8592 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:26.840551 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a92c83f-dfc9-4631-b57c-e8174a7e8592 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1264 microversion: 2.1 time: 0.179758 Aug 09 18:03:26.841720 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3364/6415] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:26 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:27.862198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df5cfda0-9454-42c0-937f-fef3ff30be71 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:27.862930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df5cfda0-9454-42c0-937f-fef3ff30be71 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:27.870781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df5cfda0-9454-42c0-937f-fef3ff30be71 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:27.871368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df5cfda0-9454-42c0-937f-fef3ff30be71 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:27.871912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df5cfda0-9454-42c0-937f-fef3ff30be71 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:27.872691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df5cfda0-9454-42c0-937f-fef3ff30be71 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:27.873225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df5cfda0-9454-42c0-937f-fef3ff30be71 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:27.873721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df5cfda0-9454-42c0-937f-fef3ff30be71 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:28.058849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-df5cfda0-9454-42c0-937f-fef3ff30be71 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:28.071619 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df5cfda0-9454-42c0-937f-fef3ff30be71 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1264 microversion: 2.1 time: 0.213281 Aug 09 18:03:28.072447 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3365/6416] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:27 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:29.093689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-976d4b4d-86a1-4cde-b1ab-527b9667e867 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:29.094316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-976d4b4d-86a1-4cde-b1ab-527b9667e867 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:29.102574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-976d4b4d-86a1-4cde-b1ab-527b9667e867 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:29.103097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-976d4b4d-86a1-4cde-b1ab-527b9667e867 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:29.103541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-976d4b4d-86a1-4cde-b1ab-527b9667e867 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:29.104277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-976d4b4d-86a1-4cde-b1ab-527b9667e867 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:29.104865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-976d4b4d-86a1-4cde-b1ab-527b9667e867 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:29.105430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-976d4b4d-86a1-4cde-b1ab-527b9667e867 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:29.256508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-976d4b4d-86a1-4cde-b1ab-527b9667e867 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:29.264512 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-976d4b4d-86a1-4cde-b1ab-527b9667e867 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1264 microversion: 2.1 time: 0.174728 Aug 09 18:03:29.265210 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3366/6417] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:29 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:29.729351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b47ccb1f-e9f8-4d94-9653-435deda0bc74 req-f0877b33-c859-4263-a1c8-370f804c87e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673d28e7-9ff3-49d3-92ec-69b20c4c3c3d", "name": "network-vif-plugged", "status": "completed", "tag": "ba5a631d-2557-484d-a0ac-7ce9c92ca81a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:29.739192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b47ccb1f-e9f8-4d94-9653-435deda0bc74 req-f0877b33-c859-4263-a1c8-370f804c87e5 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:29.739716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b47ccb1f-e9f8-4d94-9653-435deda0bc74 req-f0877b33-c859-4263-a1c8-370f804c87e5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:29.740230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b47ccb1f-e9f8-4d94-9653-435deda0bc74 req-f0877b33-c859-4263-a1c8-370f804c87e5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:29.752009 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b47ccb1f-e9f8-4d94-9653-435deda0bc74 req-f0877b33-c859-4263-a1c8-370f804c87e5 service nova] Creating event network-vif-plugged:ba5a631d-2557-484d-a0ac-7ce9c92ca81a for instance 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d on n-h2-845781-6 Aug 09 18:03:29.757834 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b47ccb1f-e9f8-4d94-9653-435deda0bc74 req-f0877b33-c859-4263-a1c8-370f804c87e5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087423 Aug 09 18:03:29.758463 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3367/6418] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:03:30.285880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c9783d0f-77f9-4cc8-9f8c-9bdcd6f66ceb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:30.286595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c9783d0f-77f9-4cc8-9f8c-9bdcd6f66ceb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:30.294091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9783d0f-77f9-4cc8-9f8c-9bdcd6f66ceb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:30.294585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9783d0f-77f9-4cc8-9f8c-9bdcd6f66ceb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:30.295030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9783d0f-77f9-4cc8-9f8c-9bdcd6f66ceb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:30.295758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9783d0f-77f9-4cc8-9f8c-9bdcd6f66ceb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:30.296217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9783d0f-77f9-4cc8-9f8c-9bdcd6f66ceb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:30.296650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9783d0f-77f9-4cc8-9f8c-9bdcd6f66ceb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:30.432629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c9783d0f-77f9-4cc8-9f8c-9bdcd6f66ceb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:30.442412 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c9783d0f-77f9-4cc8-9f8c-9bdcd6f66ceb tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1264 microversion: 2.1 time: 0.160769 Aug 09 18:03:30.443029 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3368/6419] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:30 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:31.464083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e4f608e-c61e-461c-a0ab-34db2c8fc301 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:31.464748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e4f608e-c61e-461c-a0ab-34db2c8fc301 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:31.471934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4f608e-c61e-461c-a0ab-34db2c8fc301 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:31.472456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4f608e-c61e-461c-a0ab-34db2c8fc301 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:31.472904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4f608e-c61e-461c-a0ab-34db2c8fc301 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:31.473652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4f608e-c61e-461c-a0ab-34db2c8fc301 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:31.474158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4f608e-c61e-461c-a0ab-34db2c8fc301 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:31.474613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4f608e-c61e-461c-a0ab-34db2c8fc301 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:31.613135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e4f608e-c61e-461c-a0ab-34db2c8fc301 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:31.621514 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e4f608e-c61e-461c-a0ab-34db2c8fc301 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1450 microversion: 2.1 time: 0.161738 Aug 09 18:03:31.632748 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3369/6420] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:31 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:31.641748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1b4973d6-c92c-446a-ab19-7ba34134948d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:03:31.642378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1b4973d6-c92c-446a-ab19-7ba34134948d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:03:31.648644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b4973d6-c92c-446a-ab19-7ba34134948d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:31.649209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b4973d6-c92c-446a-ab19-7ba34134948d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:31.649601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b4973d6-c92c-446a-ab19-7ba34134948d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:31.650312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b4973d6-c92c-446a-ab19-7ba34134948d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:31.650848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b4973d6-c92c-446a-ab19-7ba34134948d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:31.651287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1b4973d6-c92c-446a-ab19-7ba34134948d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:31.794438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1b4973d6-c92c-446a-ab19-7ba34134948d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:03:31.802876 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1b4973d6-c92c-446a-ab19-7ba34134948d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1450 microversion: 2.1 time: 0.165022 Aug 09 18:03:31.803480 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3370/6421] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:03:31 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:03:33.702571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1ab6b93e-53c0-42f7-a8ba-0ca247e486cb req-30d7cd9a-406a-4558-afb4-4684111b61cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "673d28e7-9ff3-49d3-92ec-69b20c4c3c3d", "tag": "ba5a631d-2557-484d-a0ac-7ce9c92ca81a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:03:33.702571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:03:33.702571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ab6b93e-53c0-42f7-a8ba-0ca247e486cb req-30d7cd9a-406a-4558-afb4-4684111b61cd service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:03:33.702571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ab6b93e-53c0-42f7-a8ba-0ca247e486cb req-30d7cd9a-406a-4558-afb4-4684111b61cd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:03:33.702571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1ab6b93e-53c0-42f7-a8ba-0ca247e486cb req-30d7cd9a-406a-4558-afb4-4684111b61cd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:03:33.702571 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1ab6b93e-53c0-42f7-a8ba-0ca247e486cb req-30d7cd9a-406a-4558-afb4-4684111b61cd service nova] Creating event network-changed:ba5a631d-2557-484d-a0ac-7ce9c92ca81a for instance 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d on n-h2-845781-6 Aug 09 18:03:33.702571 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1ab6b93e-53c0-42f7-a8ba-0ca247e486cb req-30d7cd9a-406a-4558-afb4-4684111b61cd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049261 Aug 09 18:03:33.702571 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3371/6422] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:05:22.972042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=78 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:22.976736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2046274224", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-502915138", "security_groups": [{"name": "tempest-secgroup-smoke-119401263"}], "block_device_mapping_v2": [{"uuid": "d396339c-ae4e-4d29-b3bd-d2e7fefcd132", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:23.092260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] validate_networks() for [('0271d1b7-d6da-4a3e-b8ff-6c4ce9a2ef7a', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:05:23.470789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:05:23.471239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:05:23.471751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:05:23.472164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:05:23.472577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:05:23.481780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:23.482261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:23.482698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:23.483422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:23.483895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:23.484324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:23.502170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:05:23.507463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Getting quotas for user 87590ee7f71345a8914b350c5999d974 and project 1c9fd65e58494f1195c0214732d873d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:05:23.564733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:05:23.566963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d396339c-ae4e-4d29-b3bd-d2e7fefcd132',volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:05:23.696431 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-680244d5-932c-4c20-b42a-ebb2910a311c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727119 Aug 09 18:05:23.697077 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3372/6423] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:05:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:05:23.708666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d077e41-6911-4cc7-b055-474bfdc9906d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:23.709289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0d077e41-6911-4cc7-b055-474bfdc9906d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:23.764114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0d077e41-6911-4cc7-b055-474bfdc9906d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:23.772447 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0d077e41-6911-4cc7-b055-474bfdc9906d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1094 microversion: 2.1 time: 0.068341 Aug 09 18:05:23.777166 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3373/6424] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:23 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:24.793111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-036c8e0f-a8c3-4615-8d79-f62b47cb088c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:24.793808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-036c8e0f-a8c3-4615-8d79-f62b47cb088c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:24.803097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-036c8e0f-a8c3-4615-8d79-f62b47cb088c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:24.803710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-036c8e0f-a8c3-4615-8d79-f62b47cb088c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:24.804167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-036c8e0f-a8c3-4615-8d79-f62b47cb088c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:24.804884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-036c8e0f-a8c3-4615-8d79-f62b47cb088c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:24.805351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-036c8e0f-a8c3-4615-8d79-f62b47cb088c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:24.805784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-036c8e0f-a8c3-4615-8d79-f62b47cb088c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:24.875051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-036c8e0f-a8c3-4615-8d79-f62b47cb088c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:24.883679 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-036c8e0f-a8c3-4615-8d79-f62b47cb088c tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1200 microversion: 2.1 time: 0.094489 Aug 09 18:05:24.884485 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3374/6425] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:24 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1200 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:25.904957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e96e19aa-799a-49cb-9e4d-9c2aaa75f049 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:25.905718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e96e19aa-799a-49cb-9e4d-9c2aaa75f049 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:25.917020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e96e19aa-799a-49cb-9e4d-9c2aaa75f049 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:25.917456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e96e19aa-799a-49cb-9e4d-9c2aaa75f049 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:25.917909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e96e19aa-799a-49cb-9e4d-9c2aaa75f049 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:25.918643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e96e19aa-799a-49cb-9e4d-9c2aaa75f049 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:25.919107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e96e19aa-799a-49cb-9e4d-9c2aaa75f049 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:25.919544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e96e19aa-799a-49cb-9e4d-9c2aaa75f049 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:26.081421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e96e19aa-799a-49cb-9e4d-9c2aaa75f049 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:26.090630 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e96e19aa-799a-49cb-9e4d-9c2aaa75f049 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1277 microversion: 2.1 time: 0.189609 Aug 09 18:05:26.091450 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3375/6426] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:25 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:26.209927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e523426e-e101-4b7d-bd88-2b5d16fbd340 req-e8c330e0-7695-429a-a769-2b07b47f507d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c319c464-b21c-4fca-95c1-22785c2d1744", "tag": "105d5a51-4f40-4e83-87e6-a3ce4020b7fd"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:26.227820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e523426e-e101-4b7d-bd88-2b5d16fbd340 req-e8c330e0-7695-429a-a769-2b07b47f507d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:26.228304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e523426e-e101-4b7d-bd88-2b5d16fbd340 req-e8c330e0-7695-429a-a769-2b07b47f507d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:26.229483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e523426e-e101-4b7d-bd88-2b5d16fbd340 req-e8c330e0-7695-429a-a769-2b07b47f507d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:26.244853 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e523426e-e101-4b7d-bd88-2b5d16fbd340 req-e8c330e0-7695-429a-a769-2b07b47f507d service nova] Creating event network-changed:105d5a51-4f40-4e83-87e6-a3ce4020b7fd for instance c319c464-b21c-4fca-95c1-22785c2d1744 on n-h1-845781-6 Aug 09 18:05:26.251383 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e523426e-e101-4b7d-bd88-2b5d16fbd340 req-e8c330e0-7695-429a-a769-2b07b47f507d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050390 Aug 09 18:05:26.252055 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3376/6427] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:05:27.113028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2850f895-d330-4af6-af3a-136a2e74c5c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:27.114328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2850f895-d330-4af6-af3a-136a2e74c5c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:27.122034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2850f895-d330-4af6-af3a-136a2e74c5c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:27.122882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2850f895-d330-4af6-af3a-136a2e74c5c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:27.123726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2850f895-d330-4af6-af3a-136a2e74c5c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:27.124791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2850f895-d330-4af6-af3a-136a2e74c5c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:27.125599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2850f895-d330-4af6-af3a-136a2e74c5c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:27.126232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2850f895-d330-4af6-af3a-136a2e74c5c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:27.360364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2850f895-d330-4af6-af3a-136a2e74c5c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:27.369337 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2850f895-d330-4af6-af3a-136a2e74c5c8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1277 microversion: 2.1 time: 0.260625 Aug 09 18:05:27.375486 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3377/6428] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:27 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:28.391602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f27ce461-7d79-4fcd-a21b-4f1fb0c26968 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:28.392194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f27ce461-7d79-4fcd-a21b-4f1fb0c26968 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:28.399065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ce461-7d79-4fcd-a21b-4f1fb0c26968 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:28.399557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ce461-7d79-4fcd-a21b-4f1fb0c26968 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:28.400032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ce461-7d79-4fcd-a21b-4f1fb0c26968 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:28.400736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ce461-7d79-4fcd-a21b-4f1fb0c26968 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:28.401192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ce461-7d79-4fcd-a21b-4f1fb0c26968 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:28.401627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ce461-7d79-4fcd-a21b-4f1fb0c26968 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:28.542138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f27ce461-7d79-4fcd-a21b-4f1fb0c26968 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:28.549866 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f27ce461-7d79-4fcd-a21b-4f1fb0c26968 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1277 microversion: 2.1 time: 0.162310 Aug 09 18:05:28.550666 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3378/6429] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:28 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:29.571093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2edd1a78-ac21-478e-970b-a0dade13a144 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:29.571751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2edd1a78-ac21-478e-970b-a0dade13a144 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:29.578305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edd1a78-ac21-478e-970b-a0dade13a144 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:29.578802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edd1a78-ac21-478e-970b-a0dade13a144 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:29.579517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edd1a78-ac21-478e-970b-a0dade13a144 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:29.580580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edd1a78-ac21-478e-970b-a0dade13a144 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:29.581054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edd1a78-ac21-478e-970b-a0dade13a144 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:29.581491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2edd1a78-ac21-478e-970b-a0dade13a144 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:29.723935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2edd1a78-ac21-478e-970b-a0dade13a144 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:29.732761 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2edd1a78-ac21-478e-970b-a0dade13a144 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1277 microversion: 2.1 time: 0.166359 Aug 09 18:05:29.733348 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3379/6430] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:29 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:30.757051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-24230281-26b0-45ea-bc7c-0eeffb786f18 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:30.757850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-24230281-26b0-45ea-bc7c-0eeffb786f18 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:30.766616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24230281-26b0-45ea-bc7c-0eeffb786f18 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:30.767114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24230281-26b0-45ea-bc7c-0eeffb786f18 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:30.767571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24230281-26b0-45ea-bc7c-0eeffb786f18 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:30.768658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24230281-26b0-45ea-bc7c-0eeffb786f18 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:30.769271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24230281-26b0-45ea-bc7c-0eeffb786f18 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:30.769712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24230281-26b0-45ea-bc7c-0eeffb786f18 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:30.910454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-24230281-26b0-45ea-bc7c-0eeffb786f18 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:30.919054 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-24230281-26b0-45ea-bc7c-0eeffb786f18 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1265 microversion: 2.1 time: 0.168248 Aug 09 18:05:30.919672 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3380/6431] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:30 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:31.940888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9484da4b-5e4a-4bd0-a9b2-e59df2ec0820 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:31.941622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9484da4b-5e4a-4bd0-a9b2-e59df2ec0820 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:31.950515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9484da4b-5e4a-4bd0-a9b2-e59df2ec0820 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:31.951053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9484da4b-5e4a-4bd0-a9b2-e59df2ec0820 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:31.951532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9484da4b-5e4a-4bd0-a9b2-e59df2ec0820 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:31.952351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9484da4b-5e4a-4bd0-a9b2-e59df2ec0820 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:31.952860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9484da4b-5e4a-4bd0-a9b2-e59df2ec0820 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:31.953342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9484da4b-5e4a-4bd0-a9b2-e59df2ec0820 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:32.119482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9484da4b-5e4a-4bd0-a9b2-e59df2ec0820 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:32.127961 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9484da4b-5e4a-4bd0-a9b2-e59df2ec0820 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1265 microversion: 2.1 time: 0.191688 Aug 09 18:05:32.128532 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3381/6432] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:31 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:33.150343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bb942e6c-94c1-4bae-b773-886d42fdac1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:33.151023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bb942e6c-94c1-4bae-b773-886d42fdac1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:33.157889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb942e6c-94c1-4bae-b773-886d42fdac1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:33.158378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb942e6c-94c1-4bae-b773-886d42fdac1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:33.158850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb942e6c-94c1-4bae-b773-886d42fdac1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:33.159557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb942e6c-94c1-4bae-b773-886d42fdac1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:33.160593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb942e6c-94c1-4bae-b773-886d42fdac1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:33.160966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb942e6c-94c1-4bae-b773-886d42fdac1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:33.314095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bb942e6c-94c1-4bae-b773-886d42fdac1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:33.322766 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bb942e6c-94c1-4bae-b773-886d42fdac1e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1265 microversion: 2.1 time: 0.176220 Aug 09 18:05:33.323412 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3382/6433] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:33 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:34.344299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-293a4cf6-b89e-461c-b5b7-634d23bffdf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:34.344890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-293a4cf6-b89e-461c-b5b7-634d23bffdf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:34.346750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:34.347442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:34.354163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-293a4cf6-b89e-461c-b5b7-634d23bffdf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:34.354644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-293a4cf6-b89e-461c-b5b7-634d23bffdf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:34.355080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-293a4cf6-b89e-461c-b5b7-634d23bffdf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:34.355798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-293a4cf6-b89e-461c-b5b7-634d23bffdf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:34.356251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-293a4cf6-b89e-461c-b5b7-634d23bffdf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:34.356674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-293a4cf6-b89e-461c-b5b7-634d23bffdf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:34.487038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-293a4cf6-b89e-461c-b5b7-634d23bffdf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:34.495171 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-293a4cf6-b89e-461c-b5b7-634d23bffdf1 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1265 microversion: 2.1 time: 0.154859 Aug 09 18:05:34.495772 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3383/6434] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:34 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:35.516361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4effaad0-8f50-40ee-b201-a23ed3bedf35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:35.516983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4effaad0-8f50-40ee-b201-a23ed3bedf35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:35.524469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4effaad0-8f50-40ee-b201-a23ed3bedf35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:35.524957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4effaad0-8f50-40ee-b201-a23ed3bedf35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:35.525399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4effaad0-8f50-40ee-b201-a23ed3bedf35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:35.526090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4effaad0-8f50-40ee-b201-a23ed3bedf35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:35.526554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4effaad0-8f50-40ee-b201-a23ed3bedf35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:35.526980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4effaad0-8f50-40ee-b201-a23ed3bedf35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:35.661862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4effaad0-8f50-40ee-b201-a23ed3bedf35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:35.669397 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4effaad0-8f50-40ee-b201-a23ed3bedf35 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1265 microversion: 2.1 time: 0.156942 Aug 09 18:05:35.669982 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3384/6435] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:35 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:36.690728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3dad37ec-9abb-47e6-ab5a-931832cd6538 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:36.691405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3dad37ec-9abb-47e6-ab5a-931832cd6538 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:36.698259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dad37ec-9abb-47e6-ab5a-931832cd6538 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:36.698752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dad37ec-9abb-47e6-ab5a-931832cd6538 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:36.699201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dad37ec-9abb-47e6-ab5a-931832cd6538 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:36.699937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dad37ec-9abb-47e6-ab5a-931832cd6538 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:36.700401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dad37ec-9abb-47e6-ab5a-931832cd6538 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:36.700837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3dad37ec-9abb-47e6-ab5a-931832cd6538 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:36.841881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3dad37ec-9abb-47e6-ab5a-931832cd6538 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:36.850293 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3dad37ec-9abb-47e6-ab5a-931832cd6538 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1265 microversion: 2.1 time: 0.163420 Aug 09 18:05:36.850900 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3385/6436] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:36 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:37.871061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-367b117e-e95c-4d5c-af96-cc311e366c4a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:37.871823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-367b117e-e95c-4d5c-af96-cc311e366c4a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:37.879585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367b117e-e95c-4d5c-af96-cc311e366c4a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:37.880624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367b117e-e95c-4d5c-af96-cc311e366c4a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:37.881084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367b117e-e95c-4d5c-af96-cc311e366c4a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:37.881805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367b117e-e95c-4d5c-af96-cc311e366c4a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:37.882789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367b117e-e95c-4d5c-af96-cc311e366c4a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:37.883312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367b117e-e95c-4d5c-af96-cc311e366c4a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:38.018799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-367b117e-e95c-4d5c-af96-cc311e366c4a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:38.031732 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-367b117e-e95c-4d5c-af96-cc311e366c4a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1265 microversion: 2.1 time: 0.165051 Aug 09 18:05:38.033533 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3386/6437] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:37 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:39.053498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c8334dec-2266-433f-a897-a745b0331ae4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:39.054104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c8334dec-2266-433f-a897-a745b0331ae4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:39.060848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8334dec-2266-433f-a897-a745b0331ae4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:39.061336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8334dec-2266-433f-a897-a745b0331ae4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:39.061776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8334dec-2266-433f-a897-a745b0331ae4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:39.062469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8334dec-2266-433f-a897-a745b0331ae4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:39.062922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8334dec-2266-433f-a897-a745b0331ae4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:39.063350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8334dec-2266-433f-a897-a745b0331ae4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:39.197651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c8334dec-2266-433f-a897-a745b0331ae4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:39.205756 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c8334dec-2266-433f-a897-a745b0331ae4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1265 microversion: 2.1 time: 0.156822 Aug 09 18:05:39.206352 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3387/6438] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:39 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:39.853786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-15752c5c-4aed-428d-a425-14f6987bda31 req-469d39e7-c627-4ff0-8c11-2e19b72e5494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c319c464-b21c-4fca-95c1-22785c2d1744", "name": "network-vif-plugged", "status": "completed", "tag": "105d5a51-4f40-4e83-87e6-a3ce4020b7fd"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:39.863087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-15752c5c-4aed-428d-a425-14f6987bda31 req-469d39e7-c627-4ff0-8c11-2e19b72e5494 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:39.863749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-15752c5c-4aed-428d-a425-14f6987bda31 req-469d39e7-c627-4ff0-8c11-2e19b72e5494 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:39.864173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-15752c5c-4aed-428d-a425-14f6987bda31 req-469d39e7-c627-4ff0-8c11-2e19b72e5494 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:39.877854 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-15752c5c-4aed-428d-a425-14f6987bda31 req-469d39e7-c627-4ff0-8c11-2e19b72e5494 service nova] Creating event network-vif-plugged:105d5a51-4f40-4e83-87e6-a3ce4020b7fd for instance c319c464-b21c-4fca-95c1-22785c2d1744 on n-h1-845781-6 Aug 09 18:05:39.883694 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-15752c5c-4aed-428d-a425-14f6987bda31 req-469d39e7-c627-4ff0-8c11-2e19b72e5494 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033576 Aug 09 18:05:39.884343 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3388/6439] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:05:40.227021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-00c295e9-74de-497d-84e0-21649b75bb25 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:40.227664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-00c295e9-74de-497d-84e0-21649b75bb25 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:40.234621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c295e9-74de-497d-84e0-21649b75bb25 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:40.235103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c295e9-74de-497d-84e0-21649b75bb25 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:40.235540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c295e9-74de-497d-84e0-21649b75bb25 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:40.236252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c295e9-74de-497d-84e0-21649b75bb25 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:40.236712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c295e9-74de-497d-84e0-21649b75bb25 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:40.237138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00c295e9-74de-497d-84e0-21649b75bb25 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:40.369430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-00c295e9-74de-497d-84e0-21649b75bb25 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:40.378060 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-00c295e9-74de-497d-84e0-21649b75bb25 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1265 microversion: 2.1 time: 0.154446 Aug 09 18:05:40.379239 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3389/6440] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:40 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:41.400095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4105b865-0387-49ca-ad19-ababf283404d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:41.400723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4105b865-0387-49ca-ad19-ababf283404d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:41.407474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4105b865-0387-49ca-ad19-ababf283404d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:41.407990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4105b865-0387-49ca-ad19-ababf283404d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:41.408424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4105b865-0387-49ca-ad19-ababf283404d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:41.409112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4105b865-0387-49ca-ad19-ababf283404d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:41.409565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4105b865-0387-49ca-ad19-ababf283404d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:41.409990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4105b865-0387-49ca-ad19-ababf283404d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:41.552735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4105b865-0387-49ca-ad19-ababf283404d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:41.560470 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4105b865-0387-49ca-ad19-ababf283404d tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1452 microversion: 2.1 time: 0.164918 Aug 09 18:05:41.561051 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3390/6441] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:41 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:05:41.580644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a517b3da-ee1c-45e5-ba32-b5c503201a55 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:05:41.581252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a517b3da-ee1c-45e5-ba32-b5c503201a55 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:05:41.587523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a517b3da-ee1c-45e5-ba32-b5c503201a55 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:41.588038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a517b3da-ee1c-45e5-ba32-b5c503201a55 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:41.588482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a517b3da-ee1c-45e5-ba32-b5c503201a55 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:41.589176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a517b3da-ee1c-45e5-ba32-b5c503201a55 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:41.589633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a517b3da-ee1c-45e5-ba32-b5c503201a55 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:41.590061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a517b3da-ee1c-45e5-ba32-b5c503201a55 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:41.608099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:05:41.725909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a517b3da-ee1c-45e5-ba32-b5c503201a55 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:05:41.733487 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a517b3da-ee1c-45e5-ba32-b5c503201a55 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1452 microversion: 2.1 time: 0.156677 Aug 09 18:05:41.734057 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3391/6442] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:05:41 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:05:43.311126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b73c768c-4faa-47d0-b89b-307f786f04d2 req-58664096-ffdc-420a-a281-1bfb2155d5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c319c464-b21c-4fca-95c1-22785c2d1744", "tag": "105d5a51-4f40-4e83-87e6-a3ce4020b7fd"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:05:43.322365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b73c768c-4faa-47d0-b89b-307f786f04d2 req-58664096-ffdc-420a-a281-1bfb2155d5d3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:05:43.322844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b73c768c-4faa-47d0-b89b-307f786f04d2 req-58664096-ffdc-420a-a281-1bfb2155d5d3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:05:43.323291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b73c768c-4faa-47d0-b89b-307f786f04d2 req-58664096-ffdc-420a-a281-1bfb2155d5d3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:05:43.335344 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b73c768c-4faa-47d0-b89b-307f786f04d2 req-58664096-ffdc-420a-a281-1bfb2155d5d3 service nova] Creating event network-changed:105d5a51-4f40-4e83-87e6-a3ce4020b7fd for instance c319c464-b21c-4fca-95c1-22785c2d1744 on n-h1-845781-6 Aug 09 18:05:43.340511 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b73c768c-4faa-47d0-b89b-307f786f04d2 req-58664096-ffdc-420a-a281-1bfb2155d5d3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033223 Aug 09 18:05:43.341135 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3392/6443] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:07:23.120027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:07:23.120933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:07:23.125999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-20b35cc6-ef7e-480f-b996-c770ba9e9f7e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:23.126586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-20b35cc6-ef7e-480f-b996-c770ba9e9f7e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:23.134385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20b35cc6-ef7e-480f-b996-c770ba9e9f7e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:23.134889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20b35cc6-ef7e-480f-b996-c770ba9e9f7e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:23.135336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20b35cc6-ef7e-480f-b996-c770ba9e9f7e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:23.136085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20b35cc6-ef7e-480f-b996-c770ba9e9f7e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:23.136544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20b35cc6-ef7e-480f-b996-c770ba9e9f7e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:23.136975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20b35cc6-ef7e-480f-b996-c770ba9e9f7e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:23.164080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-20b35cc6-ef7e-480f-b996-c770ba9e9f7e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:07:23.247277 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-20b35cc6-ef7e-480f-b996-c770ba9e9f7e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 204 len: 0 microversion: 2.1 time: 0.130357 Aug 09 18:07:23.247803 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3393/6444] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:07:23 2022] DELETE /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:07:23.253004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a1999d2d-4885-4f6c-b0b2-53a8f56d497b req-eec513f3-d380-4c34-b048-a7d2fc7655a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c319c464-b21c-4fca-95c1-22785c2d1744", "tag": "105d5a51-4f40-4e83-87e6-a3ce4020b7fd"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:07:23.262676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a1999d2d-4885-4f6c-b0b2-53a8f56d497b req-eec513f3-d380-4c34-b048-a7d2fc7655a0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:23.263161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a1999d2d-4885-4f6c-b0b2-53a8f56d497b req-eec513f3-d380-4c34-b048-a7d2fc7655a0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:23.263598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a1999d2d-4885-4f6c-b0b2-53a8f56d497b req-eec513f3-d380-4c34-b048-a7d2fc7655a0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:23.274792 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a1999d2d-4885-4f6c-b0b2-53a8f56d497b req-eec513f3-d380-4c34-b048-a7d2fc7655a0 service nova] Creating event network-changed:105d5a51-4f40-4e83-87e6-a3ce4020b7fd for instance c319c464-b21c-4fca-95c1-22785c2d1744 on n-h1-845781-6 Aug 09 18:07:23.280591 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a1999d2d-4885-4f6c-b0b2-53a8f56d497b req-eec513f3-d380-4c34-b048-a7d2fc7655a0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031215 Aug 09 18:07:23.281219 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3394/6445] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:07:23.286536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a5f5599-24a3-48df-9763-a7f59cd51541 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:23.287250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a5f5599-24a3-48df-9763-a7f59cd51541 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:23.294428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a5f5599-24a3-48df-9763-a7f59cd51541 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:23.295050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a5f5599-24a3-48df-9763-a7f59cd51541 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:23.295501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a5f5599-24a3-48df-9763-a7f59cd51541 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:23.296224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a5f5599-24a3-48df-9763-a7f59cd51541 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:23.296725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a5f5599-24a3-48df-9763-a7f59cd51541 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:23.297155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a5f5599-24a3-48df-9763-a7f59cd51541 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:23.567849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a5f5599-24a3-48df-9763-a7f59cd51541 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:23.576096 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a5f5599-24a3-48df-9763-a7f59cd51541 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1577 microversion: 2.1 time: 0.293967 Aug 09 18:07:23.576677 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3395/6446] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:23 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1577 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:24.598516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-16462d3b-212f-4c73-9444-26b012c90678 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:24.599188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-16462d3b-212f-4c73-9444-26b012c90678 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:24.606754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16462d3b-212f-4c73-9444-26b012c90678 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:24.607253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16462d3b-212f-4c73-9444-26b012c90678 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:24.607726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16462d3b-212f-4c73-9444-26b012c90678 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:24.608455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16462d3b-212f-4c73-9444-26b012c90678 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:24.609036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16462d3b-212f-4c73-9444-26b012c90678 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:24.609488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16462d3b-212f-4c73-9444-26b012c90678 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:24.748513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16462d3b-212f-4c73-9444-26b012c90678 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:24.756237 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-16462d3b-212f-4c73-9444-26b012c90678 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1577 microversion: 2.1 time: 0.161639 Aug 09 18:07:24.756824 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3396/6447] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:24 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:25.779861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-143f66dd-0b58-4f5c-a8b5-d87435119be8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:25.780521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-143f66dd-0b58-4f5c-a8b5-d87435119be8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:25.787617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-143f66dd-0b58-4f5c-a8b5-d87435119be8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:25.788160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-143f66dd-0b58-4f5c-a8b5-d87435119be8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:25.788603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-143f66dd-0b58-4f5c-a8b5-d87435119be8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:25.789322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-143f66dd-0b58-4f5c-a8b5-d87435119be8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:25.789790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-143f66dd-0b58-4f5c-a8b5-d87435119be8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:25.790215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-143f66dd-0b58-4f5c-a8b5-d87435119be8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:25.879254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-143f66dd-0b58-4f5c-a8b5-d87435119be8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:25.888241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-143f66dd-0b58-4f5c-a8b5-d87435119be8 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1391 microversion: 2.1 time: 0.113309 Aug 09 18:07:25.888839 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3397/6448] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:25 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1391 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:25.893366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9e297ed6-fe05-434d-a52b-823d0440e3d0 req-d1fb2003-3f77-47ec-9907-874215b24272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c319c464-b21c-4fca-95c1-22785c2d1744", "name": "network-vif-deleted", "tag": "105d5a51-4f40-4e83-87e6-a3ce4020b7fd"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:07:25.903242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e297ed6-fe05-434d-a52b-823d0440e3d0 req-d1fb2003-3f77-47ec-9907-874215b24272 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:25.903743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e297ed6-fe05-434d-a52b-823d0440e3d0 req-d1fb2003-3f77-47ec-9907-874215b24272 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:25.904178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9e297ed6-fe05-434d-a52b-823d0440e3d0 req-d1fb2003-3f77-47ec-9907-874215b24272 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:25.918834 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9e297ed6-fe05-434d-a52b-823d0440e3d0 req-d1fb2003-3f77-47ec-9907-874215b24272 service nova] Creating event network-vif-deleted:105d5a51-4f40-4e83-87e6-a3ce4020b7fd for instance c319c464-b21c-4fca-95c1-22785c2d1744 on n-h1-845781-6 Aug 09 18:07:25.923833 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9e297ed6-fe05-434d-a52b-823d0440e3d0 req-d1fb2003-3f77-47ec-9907-874215b24272 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033845 Aug 09 18:07:25.924434 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3398/6449] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:07:26.912003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efa5f57d-0144-4e43-b701-5049a1d2918a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:26.912720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-efa5f57d-0144-4e43-b701-5049a1d2918a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:26.919858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efa5f57d-0144-4e43-b701-5049a1d2918a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:26.920358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efa5f57d-0144-4e43-b701-5049a1d2918a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:26.920809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efa5f57d-0144-4e43-b701-5049a1d2918a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:26.921516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efa5f57d-0144-4e43-b701-5049a1d2918a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:26.921981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efa5f57d-0144-4e43-b701-5049a1d2918a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:26.922418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efa5f57d-0144-4e43-b701-5049a1d2918a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:26.997129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-efa5f57d-0144-4e43-b701-5049a1d2918a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:27.004813 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-efa5f57d-0144-4e43-b701-5049a1d2918a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1225 microversion: 2.1 time: 0.098102 Aug 09 18:07:27.005526 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3399/6450] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:26 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:28.026153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-39a2c08e-ef37-42da-a89d-2724879b6a7a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:28.027567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-39a2c08e-ef37-42da-a89d-2724879b6a7a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:28.035003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39a2c08e-ef37-42da-a89d-2724879b6a7a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:28.035505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39a2c08e-ef37-42da-a89d-2724879b6a7a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:28.035971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39a2c08e-ef37-42da-a89d-2724879b6a7a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:28.036867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39a2c08e-ef37-42da-a89d-2724879b6a7a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:28.037332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39a2c08e-ef37-42da-a89d-2724879b6a7a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:28.037769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39a2c08e-ef37-42da-a89d-2724879b6a7a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:28.136114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-39a2c08e-ef37-42da-a89d-2724879b6a7a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:28.145779 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-39a2c08e-ef37-42da-a89d-2724879b6a7a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1225 microversion: 2.1 time: 0.123694 Aug 09 18:07:28.146587 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3400/6451] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:28 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:29.167468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7da9f267-d87a-4543-b328-47c3ca0f2ab7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:29.167998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7da9f267-d87a-4543-b328-47c3ca0f2ab7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:29.176247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da9f267-d87a-4543-b328-47c3ca0f2ab7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:29.176895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da9f267-d87a-4543-b328-47c3ca0f2ab7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:29.177441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da9f267-d87a-4543-b328-47c3ca0f2ab7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:29.178227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da9f267-d87a-4543-b328-47c3ca0f2ab7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:29.178787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da9f267-d87a-4543-b328-47c3ca0f2ab7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:29.179295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da9f267-d87a-4543-b328-47c3ca0f2ab7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:29.246657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7da9f267-d87a-4543-b328-47c3ca0f2ab7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:29.255059 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7da9f267-d87a-4543-b328-47c3ca0f2ab7 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1225 microversion: 2.1 time: 0.092348 Aug 09 18:07:29.255947 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3401/6452] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:29 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:30.277419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:30.278057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:30.284981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:30.285466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:30.285896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:30.286585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:30.287033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:30.287457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:30.317747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:30.318233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:30.318678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:30.319135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lazy-loading 'fault' on Instance uuid c319c464-b21c-4fca-95c1-22785c2d1744 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:07:30.361625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:30.369666 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e95f8d7-9af0-412f-9a3f-c085b49afec5 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 200 len: 1230 microversion: 2.1 time: 0.096764 Aug 09 18:07:30.370247 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3402/6453] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:30 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:31.390636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:31.391263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: c319c464-b21c-4fca-95c1-22785c2d1744] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:31.398175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:31.398670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:31.399117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:31.399855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:31.400321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:31.401247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:31.415302 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance c319c464-b21c-4fca-95c1-22785c2d1744 could not be found. Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 HTTP/1.1 Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance c319c464-b21c-4fca-95c1-22785c2d1744 could not be found. Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'c319c464-b21c-4fca-95c1-22785c2d1744'} Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c319c464-b21c-4fca-95c1-22785c2d1744 could not be found. Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c319c464-b21c-4fca-95c1-22785c2d1744 could not be found. Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:07:31.417749 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:31.421367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:31.421367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:07:31.421367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:07:31.421367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:07:31.421367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:07:31.421367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c319c464-b21c-4fca-95c1-22785c2d1744 could not be found. Aug 09 18:07:31.421367 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:31.421367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance c319c464-b21c-4fca-95c1-22785c2d1744 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:07:31.421367 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd5eee15-6bd9-4930-8c6f-0108ef452b93 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744" status: 404 len: 111 microversion: 2.1 time: 0.032576 Aug 09 18:07:31.421367 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3403/6454] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:31 2022] GET /compute/v2.1/servers/c319c464-b21c-4fca-95c1-22785c2d1744 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:07:37.656513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2d751dcc-bcbf-4e8f-8af0-26cf55f291f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:37.657694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2d751dcc-bcbf-4e8f-8af0-26cf55f291f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:37.665964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d751dcc-bcbf-4e8f-8af0-26cf55f291f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:37.667194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d751dcc-bcbf-4e8f-8af0-26cf55f291f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:37.667663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d751dcc-bcbf-4e8f-8af0-26cf55f291f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:37.668554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d751dcc-bcbf-4e8f-8af0-26cf55f291f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:37.669024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d751dcc-bcbf-4e8f-8af0-26cf55f291f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:37.669463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d751dcc-bcbf-4e8f-8af0-26cf55f291f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:37.696494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2d751dcc-bcbf-4e8f-8af0-26cf55f291f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:07:37.786144 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2d751dcc-bcbf-4e8f-8af0-26cf55f291f9 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 204 len: 0 microversion: 2.1 time: 0.133663 Aug 09 18:07:37.787575 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3404/6455] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:07:37 2022] DELETE /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:07:37.859236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-08773d3f-1033-446e-b6d0-8440f3566443 req-ac169999-0a85-4bf9-9185-741e029baaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "673d28e7-9ff3-49d3-92ec-69b20c4c3c3d", "tag": "ba5a631d-2557-484d-a0ac-7ce9c92ca81a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:07:37.869014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-08773d3f-1033-446e-b6d0-8440f3566443 req-ac169999-0a85-4bf9-9185-741e029baaf4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:37.875374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-08773d3f-1033-446e-b6d0-8440f3566443 req-ac169999-0a85-4bf9-9185-741e029baaf4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:37.875971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-08773d3f-1033-446e-b6d0-8440f3566443 req-ac169999-0a85-4bf9-9185-741e029baaf4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:37.887912 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-08773d3f-1033-446e-b6d0-8440f3566443 req-ac169999-0a85-4bf9-9185-741e029baaf4 service nova] Creating event network-changed:ba5a631d-2557-484d-a0ac-7ce9c92ca81a for instance 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d on n-h2-845781-6 Aug 09 18:07:37.893165 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-08773d3f-1033-446e-b6d0-8440f3566443 req-ac169999-0a85-4bf9-9185-741e029baaf4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103977 Aug 09 18:07:37.893828 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3405/6456] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:07:37.899471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-af6e9757-4cb7-44e3-b38c-8ad6f3c08a04 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:37.900401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-af6e9757-4cb7-44e3-b38c-8ad6f3c08a04 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:37.907944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af6e9757-4cb7-44e3-b38c-8ad6f3c08a04 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:37.908509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af6e9757-4cb7-44e3-b38c-8ad6f3c08a04 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:37.909027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af6e9757-4cb7-44e3-b38c-8ad6f3c08a04 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:37.909896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af6e9757-4cb7-44e3-b38c-8ad6f3c08a04 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:37.910440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af6e9757-4cb7-44e3-b38c-8ad6f3c08a04 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:37.910953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-af6e9757-4cb7-44e3-b38c-8ad6f3c08a04 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:38.059770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-af6e9757-4cb7-44e3-b38c-8ad6f3c08a04 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:38.068050 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-af6e9757-4cb7-44e3-b38c-8ad6f3c08a04 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1575 microversion: 2.1 time: 0.172827 Aug 09 18:07:38.068574 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3406/6457] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:37 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:07:39.089587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9ad0dfeb-7534-470b-8c25-b8aff4daff05 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:39.090274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9ad0dfeb-7534-470b-8c25-b8aff4daff05 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:39.097069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ad0dfeb-7534-470b-8c25-b8aff4daff05 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:39.097578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ad0dfeb-7534-470b-8c25-b8aff4daff05 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:39.098034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ad0dfeb-7534-470b-8c25-b8aff4daff05 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:39.098740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ad0dfeb-7534-470b-8c25-b8aff4daff05 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:39.099205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ad0dfeb-7534-470b-8c25-b8aff4daff05 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:39.099649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9ad0dfeb-7534-470b-8c25-b8aff4daff05 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:39.233784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9ad0dfeb-7534-470b-8c25-b8aff4daff05 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:39.241607 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9ad0dfeb-7534-470b-8c25-b8aff4daff05 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1575 microversion: 2.1 time: 0.156104 Aug 09 18:07:39.242192 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3407/6458] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:39 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:39.874749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6ae032bd-d4bd-4b41-8ba2-861e918194d6 req-07d4954b-bed3-460d-be34-3a2f56d65b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673d28e7-9ff3-49d3-92ec-69b20c4c3c3d", "name": "network-vif-deleted", "tag": "ba5a631d-2557-484d-a0ac-7ce9c92ca81a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:07:39.886371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6ae032bd-d4bd-4b41-8ba2-861e918194d6 req-07d4954b-bed3-460d-be34-3a2f56d65b3b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:39.886857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6ae032bd-d4bd-4b41-8ba2-861e918194d6 req-07d4954b-bed3-460d-be34-3a2f56d65b3b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:39.887300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6ae032bd-d4bd-4b41-8ba2-861e918194d6 req-07d4954b-bed3-460d-be34-3a2f56d65b3b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:39.899081 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6ae032bd-d4bd-4b41-8ba2-861e918194d6 req-07d4954b-bed3-460d-be34-3a2f56d65b3b service nova] Creating event network-vif-deleted:ba5a631d-2557-484d-a0ac-7ce9c92ca81a for instance 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d on n-h2-845781-6 Aug 09 18:07:39.904297 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6ae032bd-d4bd-4b41-8ba2-861e918194d6 req-07d4954b-bed3-460d-be34-3a2f56d65b3b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093508 Aug 09 18:07:39.904913 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3408/6459] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:07:40.263176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6616da55-1069-46e7-9275-f2cf3cce24d2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:40.263904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6616da55-1069-46e7-9275-f2cf3cce24d2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:40.270982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6616da55-1069-46e7-9275-f2cf3cce24d2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:40.271472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6616da55-1069-46e7-9275-f2cf3cce24d2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:40.271947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6616da55-1069-46e7-9275-f2cf3cce24d2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:40.272650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6616da55-1069-46e7-9275-f2cf3cce24d2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:40.273108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6616da55-1069-46e7-9275-f2cf3cce24d2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:40.273539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6616da55-1069-46e7-9275-f2cf3cce24d2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:40.277652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:07:40.341250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6616da55-1069-46e7-9275-f2cf3cce24d2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:40.349350 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6616da55-1069-46e7-9275-f2cf3cce24d2 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1224 microversion: 2.1 time: 0.090434 Aug 09 18:07:40.349934 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3409/6460] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:40 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:41.374592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ca49232-549c-407b-9377-5e65a980b109 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:41.375229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ca49232-549c-407b-9377-5e65a980b109 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:41.382291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca49232-549c-407b-9377-5e65a980b109 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:41.382785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca49232-549c-407b-9377-5e65a980b109 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:41.383224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca49232-549c-407b-9377-5e65a980b109 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:41.383971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca49232-549c-407b-9377-5e65a980b109 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:41.384427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca49232-549c-407b-9377-5e65a980b109 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:41.384856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ca49232-549c-407b-9377-5e65a980b109 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:41.457340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5ca49232-549c-407b-9377-5e65a980b109 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:41.465847 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ca49232-549c-407b-9377-5e65a980b109 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1224 microversion: 2.1 time: 0.095209 Aug 09 18:07:41.478646 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3410/6461] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:41 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:42.486636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67771549-dabc-4ed5-a956-cbad550869e4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:42.487249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-67771549-dabc-4ed5-a956-cbad550869e4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:42.494835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67771549-dabc-4ed5-a956-cbad550869e4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:42.495332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67771549-dabc-4ed5-a956-cbad550869e4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:42.495814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67771549-dabc-4ed5-a956-cbad550869e4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:42.496552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67771549-dabc-4ed5-a956-cbad550869e4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:42.497129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67771549-dabc-4ed5-a956-cbad550869e4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:42.497560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67771549-dabc-4ed5-a956-cbad550869e4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:42.567057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-67771549-dabc-4ed5-a956-cbad550869e4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:42.574907 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-67771549-dabc-4ed5-a956-cbad550869e4 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1224 microversion: 2.1 time: 0.092321 Aug 09 18:07:42.575583 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3411/6462] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:42 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:43.596589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1717a5d-6004-4f78-bfa6-2284f9a5b46e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:43.597242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1717a5d-6004-4f78-bfa6-2284f9a5b46e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:43.604276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1717a5d-6004-4f78-bfa6-2284f9a5b46e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:43.604766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1717a5d-6004-4f78-bfa6-2284f9a5b46e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:43.605212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1717a5d-6004-4f78-bfa6-2284f9a5b46e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:43.605952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1717a5d-6004-4f78-bfa6-2284f9a5b46e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:43.606432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1717a5d-6004-4f78-bfa6-2284f9a5b46e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:43.606850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1717a5d-6004-4f78-bfa6-2284f9a5b46e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:43.670124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a1717a5d-6004-4f78-bfa6-2284f9a5b46e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87590ee7f71345a8914b350c5999d974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9fd65e58494f1195c0214732d873d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:07:43.678000 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1717a5d-6004-4f78-bfa6-2284f9a5b46e tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 200 len: 1224 microversion: 2.1 time: 0.085442 Aug 09 18:07:43.678582 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3412/6463] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:43 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:07:44.700848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:44.701894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:44.709247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:44.709740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:44.710203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:44.710902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:44.711363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:44.711835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:44.725721 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d could not be found. Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d HTTP/1.1 Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d could not be found. Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '673d28e7-9ff3-49d3-92ec-69b20c4c3c3d'} Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d could not be found. Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d could not be found. Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:07:44.727376 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:44.731952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:44.731952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:07:44.731952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:07:44.731952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:07:44.731952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:07:44.731952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d could not be found. Aug 09 18:07:44.731952 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:44.731952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 673d28e7-9ff3-49d3-92ec-69b20c4c3c3d could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:07:44.731952 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c4edc9a7-4b18-4e69-8251-21f1a84fa911 tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d" status: 404 len: 111 microversion: 2.1 time: 0.032689 Aug 09 18:07:44.731952 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3413/6464] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:44 2022] GET /compute/v2.1/servers/673d28e7-9ff3-49d3-92ec-69b20c4c3c3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:07:45.179607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:45.180141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:45.186565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:45.187056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:45.187503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:45.188235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:45.188696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:45.189129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:45.202529 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf HTTP/1.1 Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf'} Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:07:45.204427 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a8e75818-54e3-4769-9040-ebd94a3ba09b tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 404 len: 111 microversion: 2.1 time: 0.030305 Aug 09 18:07:45.207501 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3414/6465] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:07:45 2022] DELETE /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:07:45.214455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:45.215066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [instance: 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:07:45.221018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:45.221505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:45.221947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:45.222643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:07:45.223101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:07:45.223541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:07:45.238267 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] HTTP exception thrown: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Request method failure captured: Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf HTTP/1.1 Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8p95iWfDXaGb3losPcdqYvj6SLeqvg0ZOLJ9uIMfehzBaPGvLxiYnA8ldUNFjp9siL4PkjVMBIgmN2kFS2V6wrTBakNhPpvnTZTr3_xGIi0waBCkVRExhw94sCGtKXPbGVLLCbc5DOykMdqQMsPnW2Mr21PpMbWO4kSmEIcECR_oEtk Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1c9fd65e58494f1195c0214732d873d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 1c9fd65e58494f1195c0214732d873d3 Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestVolumeBootPattern-1647139077 Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 87590ee7f71345a8914b350c5999d974 Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestVolumeBootPattern-1647139077-project Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf'} Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:07:45.239679 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:45.242953 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:07:45.242953 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:07:45.242953 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:07:45.242953 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:07:45.242953 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:07:45.242953 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. Aug 09 18:07:45.242953 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:07:45.242953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Returning 404 to user: Instance 36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:07:45.242953 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-607f1083-eed7-4b81-aff1-b98a1658690a tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf" status: 404 len: 111 microversion: 2.1 time: 0.030366 Aug 09 18:07:45.242953 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3415/6466] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:07:45 2022] GET /compute/v2.1/servers/36fd40fa-c9ed-4562-97b6-3aac8dcd0fdf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:07:48.666153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c402af46-d7cf-48ea-aa08-7a0f6060b2ec tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] Calling method '.version_select at 0x7fbbca5a1b80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:07:48.671076 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c402af46-d7cf-48ea-aa08-7a0f6060b2ec tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [49dc9fd5-bcbd-4fa9-bc72-49fff9e68c2b] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:07:49.679307 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [None req-c402af46-d7cf-48ea-aa08-7a0f6060b2ec tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] [49dc9fd5-bcbd-4fa9-bc72-49fff9e68c2b] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 36312. Aug 09 18:07:49.699759 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c402af46-d7cf-48ea-aa08-7a0f6060b2ec tempest-TestVolumeBootPattern-1647139077 tempest-TestVolumeBootPattern-1647139077-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-502915138" status: 202 len: 0 microversion: 2.1 time: 1.037634 Aug 09 18:07:49.700357 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3416/6467] 10.222.0.93 () {58 vars in 1260 bytes} [Tue Aug 9 18:07:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-502915138 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:08:00.924046 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:08:00.924811 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 18:08:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:08:08.060223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=28 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:08.061217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:08.176452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-917426389", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:08.229824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] validate_networks() for None {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:08:08.420504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:08:08.420933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:08:08.421418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:08:08.421856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:08:08.422291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:08:08.431948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:08.432437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:08.432882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:08.433615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:08.434075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:08.434508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:08.451553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Getting quotas for project 78a4a4b10cba4037bac479e8efa6163b. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:08:08.457198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Getting quotas for user 6d3f92bb24aa44e98fbdbde01ab27977 and project 78a4a4b10cba4037bac479e8efa6163b. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:08:08.469486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:08:08.471786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:08:08.516902 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c2c8a137-179c-4ff2-adfd-5d672d7673c5 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.458328 Aug 09 18:08:08.517583 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3417/6468] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:08:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:08:08.529884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8fd5e642-5841-482b-9ac0-7b15dbc8b58e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:08.530519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8fd5e642-5841-482b-9ac0-7b15dbc8b58e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:08.585138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8fd5e642-5841-482b-9ac0-7b15dbc8b58e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3f92bb24aa44e98fbdbde01ab27977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4a4b10cba4037bac479e8efa6163b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:08.592177 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8fd5e642-5841-482b-9ac0-7b15dbc8b58e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 200 len: 1221 microversion: 2.1 time: 0.066279 Aug 09 18:08:08.592768 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3418/6469] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:08 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 1221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:09.614074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7429fe6a-1bb9-424a-a475-ddbcb8d02b40 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:09.616067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7429fe6a-1bb9-424a-a475-ddbcb8d02b40 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:09.624852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7429fe6a-1bb9-424a-a475-ddbcb8d02b40 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:09.625596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7429fe6a-1bb9-424a-a475-ddbcb8d02b40 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:09.626227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7429fe6a-1bb9-424a-a475-ddbcb8d02b40 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:09.627129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7429fe6a-1bb9-424a-a475-ddbcb8d02b40 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:09.627782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7429fe6a-1bb9-424a-a475-ddbcb8d02b40 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:09.628372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7429fe6a-1bb9-424a-a475-ddbcb8d02b40 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:09.723243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7429fe6a-1bb9-424a-a475-ddbcb8d02b40 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3f92bb24aa44e98fbdbde01ab27977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4a4b10cba4037bac479e8efa6163b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:09.731068 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7429fe6a-1bb9-424a-a475-ddbcb8d02b40 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 200 len: 1281 microversion: 2.1 time: 0.121245 Aug 09 18:08:09.731671 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3419/6470] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:09 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 1281 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:10.753745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07ea9659-5c54-4677-b9e8-4c6f498c0283 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:10.754456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07ea9659-5c54-4677-b9e8-4c6f498c0283 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:10.767842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ea9659-5c54-4677-b9e8-4c6f498c0283 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:10.768351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ea9659-5c54-4677-b9e8-4c6f498c0283 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:10.768803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ea9659-5c54-4677-b9e8-4c6f498c0283 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:10.769533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ea9659-5c54-4677-b9e8-4c6f498c0283 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:10.770169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ea9659-5c54-4677-b9e8-4c6f498c0283 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:10.770609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07ea9659-5c54-4677-b9e8-4c6f498c0283 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:11.009971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-07ea9659-5c54-4677-b9e8-4c6f498c0283 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3f92bb24aa44e98fbdbde01ab27977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4a4b10cba4037bac479e8efa6163b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:11.017543 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07ea9659-5c54-4677-b9e8-4c6f498c0283 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 200 len: 1321 microversion: 2.1 time: 0.267860 Aug 09 18:08:11.018133 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3420/6471] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:10 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:11.147757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-39532152-7f6a-4834-8534-3e26ec7dd35c req-3d9c4c61-4357-48a4-958d-7260563a3bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88067fa1-7a16-41ec-8c02-9fc694925556", "tag": "a3f11922-53ee-45d6-a9c8-e7581e4b5e69"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:11.158342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-39532152-7f6a-4834-8534-3e26ec7dd35c req-3d9c4c61-4357-48a4-958d-7260563a3bad service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:11.158840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-39532152-7f6a-4834-8534-3e26ec7dd35c req-3d9c4c61-4357-48a4-958d-7260563a3bad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:11.159282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-39532152-7f6a-4834-8534-3e26ec7dd35c req-3d9c4c61-4357-48a4-958d-7260563a3bad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:11.178276 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-39532152-7f6a-4834-8534-3e26ec7dd35c req-3d9c4c61-4357-48a4-958d-7260563a3bad service nova] Creating event network-changed:a3f11922-53ee-45d6-a9c8-e7581e4b5e69 for instance 88067fa1-7a16-41ec-8c02-9fc694925556 on n-h1-845781-6 Aug 09 18:08:11.184133 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-39532152-7f6a-4834-8534-3e26ec7dd35c req-3d9c4c61-4357-48a4-958d-7260563a3bad service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040312 Aug 09 18:08:11.184940 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3421/6472] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:12.039801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-708444aa-588f-40bd-b8b8-13b9d91e5be9 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:12.040537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-708444aa-588f-40bd-b8b8-13b9d91e5be9 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:12.046753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-708444aa-588f-40bd-b8b8-13b9d91e5be9 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:12.047244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-708444aa-588f-40bd-b8b8-13b9d91e5be9 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:12.047713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-708444aa-588f-40bd-b8b8-13b9d91e5be9 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:12.048412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-708444aa-588f-40bd-b8b8-13b9d91e5be9 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:12.048864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-708444aa-588f-40bd-b8b8-13b9d91e5be9 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:12.049293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-708444aa-588f-40bd-b8b8-13b9d91e5be9 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:12.181684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-708444aa-588f-40bd-b8b8-13b9d91e5be9 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3f92bb24aa44e98fbdbde01ab27977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4a4b10cba4037bac479e8efa6163b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:12.189638 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-708444aa-588f-40bd-b8b8-13b9d91e5be9 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 200 len: 1321 microversion: 2.1 time: 0.154840 Aug 09 18:08:12.190250 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3422/6473] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:12 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:13.210853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-47a6e1d8-3abe-4666-be07-fe5b732db316 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:13.211530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-47a6e1d8-3abe-4666-be07-fe5b732db316 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:13.218898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47a6e1d8-3abe-4666-be07-fe5b732db316 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:13.219389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47a6e1d8-3abe-4666-be07-fe5b732db316 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:13.219883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47a6e1d8-3abe-4666-be07-fe5b732db316 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:13.220591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47a6e1d8-3abe-4666-be07-fe5b732db316 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:13.221055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47a6e1d8-3abe-4666-be07-fe5b732db316 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:13.221492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47a6e1d8-3abe-4666-be07-fe5b732db316 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:13.355339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-47a6e1d8-3abe-4666-be07-fe5b732db316 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3f92bb24aa44e98fbdbde01ab27977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4a4b10cba4037bac479e8efa6163b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:13.363132 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-47a6e1d8-3abe-4666-be07-fe5b732db316 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 200 len: 1321 microversion: 2.1 time: 0.156335 Aug 09 18:08:13.363745 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3423/6474] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:13 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:14.384504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-68be6b68-2251-4850-8b20-01810f59f6fc tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:14.385129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-68be6b68-2251-4850-8b20-01810f59f6fc tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:14.391927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68be6b68-2251-4850-8b20-01810f59f6fc tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:14.392423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68be6b68-2251-4850-8b20-01810f59f6fc tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:14.392872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68be6b68-2251-4850-8b20-01810f59f6fc tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:14.393578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68be6b68-2251-4850-8b20-01810f59f6fc tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:14.394043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68be6b68-2251-4850-8b20-01810f59f6fc tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:14.394476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-68be6b68-2251-4850-8b20-01810f59f6fc tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:14.532450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-68be6b68-2251-4850-8b20-01810f59f6fc tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3f92bb24aa44e98fbdbde01ab27977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4a4b10cba4037bac479e8efa6163b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:14.540935 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-68be6b68-2251-4850-8b20-01810f59f6fc tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 200 len: 1321 microversion: 2.1 time: 0.160290 Aug 09 18:08:14.542174 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3424/6475] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:14 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:15.562548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-10e7899f-9747-4d07-8ecf-ab1ece1ed58d tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:15.563185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-10e7899f-9747-4d07-8ecf-ab1ece1ed58d tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:15.570148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10e7899f-9747-4d07-8ecf-ab1ece1ed58d tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:15.570641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10e7899f-9747-4d07-8ecf-ab1ece1ed58d tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:15.571089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10e7899f-9747-4d07-8ecf-ab1ece1ed58d tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:15.571850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10e7899f-9747-4d07-8ecf-ab1ece1ed58d tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:15.572323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10e7899f-9747-4d07-8ecf-ab1ece1ed58d tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:15.572745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10e7899f-9747-4d07-8ecf-ab1ece1ed58d tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:15.704277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-10e7899f-9747-4d07-8ecf-ab1ece1ed58d tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3f92bb24aa44e98fbdbde01ab27977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4a4b10cba4037bac479e8efa6163b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:15.711820 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-10e7899f-9747-4d07-8ecf-ab1ece1ed58d tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 200 len: 1321 microversion: 2.1 time: 0.153187 Aug 09 18:08:15.712904 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3425/6476] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:15 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:16.470908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3fb359fb-882c-47b3-8d6a-538c9820f80f req-f3fef6d3-5d2b-425e-8b05-a5c7d6b39902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88067fa1-7a16-41ec-8c02-9fc694925556", "name": "network-vif-plugged", "status": "completed", "tag": "a3f11922-53ee-45d6-a9c8-e7581e4b5e69"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:16.481633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3fb359fb-882c-47b3-8d6a-538c9820f80f req-f3fef6d3-5d2b-425e-8b05-a5c7d6b39902 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:16.482775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3fb359fb-882c-47b3-8d6a-538c9820f80f req-f3fef6d3-5d2b-425e-8b05-a5c7d6b39902 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:16.483221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3fb359fb-882c-47b3-8d6a-538c9820f80f req-f3fef6d3-5d2b-425e-8b05-a5c7d6b39902 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:16.494647 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3fb359fb-882c-47b3-8d6a-538c9820f80f req-f3fef6d3-5d2b-425e-8b05-a5c7d6b39902 service nova] Creating event network-vif-plugged:a3f11922-53ee-45d6-a9c8-e7581e4b5e69 for instance 88067fa1-7a16-41ec-8c02-9fc694925556 on n-h1-845781-6 Aug 09 18:08:16.499895 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3fb359fb-882c-47b3-8d6a-538c9820f80f req-f3fef6d3-5d2b-425e-8b05-a5c7d6b39902 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032735 Aug 09 18:08:16.500510 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3426/6477] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:16.733435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ee69118-a0da-4597-86de-a6685cd1e69c tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:16.734149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ee69118-a0da-4597-86de-a6685cd1e69c tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:16.741251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee69118-a0da-4597-86de-a6685cd1e69c tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:16.741746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee69118-a0da-4597-86de-a6685cd1e69c tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:16.742199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee69118-a0da-4597-86de-a6685cd1e69c tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:16.742903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee69118-a0da-4597-86de-a6685cd1e69c tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:16.743367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee69118-a0da-4597-86de-a6685cd1e69c tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:16.743846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ee69118-a0da-4597-86de-a6685cd1e69c tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:16.879437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5ee69118-a0da-4597-86de-a6685cd1e69c tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3f92bb24aa44e98fbdbde01ab27977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4a4b10cba4037bac479e8efa6163b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:16.888441 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ee69118-a0da-4597-86de-a6685cd1e69c tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 200 len: 1321 microversion: 2.1 time: 0.159377 Aug 09 18:08:16.889030 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3427/6478] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:16 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:17.910220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c00ba9d9-71c4-473f-bd13-da04b2791a22 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:17.911838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c00ba9d9-71c4-473f-bd13-da04b2791a22 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:17.919968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c00ba9d9-71c4-473f-bd13-da04b2791a22 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:17.920496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c00ba9d9-71c4-473f-bd13-da04b2791a22 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:17.920936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c00ba9d9-71c4-473f-bd13-da04b2791a22 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:17.922642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c00ba9d9-71c4-473f-bd13-da04b2791a22 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:17.923102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c00ba9d9-71c4-473f-bd13-da04b2791a22 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:17.923568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c00ba9d9-71c4-473f-bd13-da04b2791a22 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.061225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c00ba9d9-71c4-473f-bd13-da04b2791a22 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3f92bb24aa44e98fbdbde01ab27977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4a4b10cba4037bac479e8efa6163b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:18.068892 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c00ba9d9-71c4-473f-bd13-da04b2791a22 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 200 len: 1471 microversion: 2.1 time: 0.163218 Aug 09 18:08:18.069473 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3428/6479] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:17 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:18.138975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3bf33853-9c5c-4daa-9bcc-21c1b7c5a8a2 tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Calling method '.version_select at 0x7fbbca674940>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:18.205192 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3bf33853-9c5c-4daa-9bcc-21c1b7c5a8a2 tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/ad5518bd1f484be0b2ae611e7d8aec88" status: 200 len: 371 microversion: 2.1 time: 0.117888 Aug 09 18:08:18.205778 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3429/6480] 10.222.0.93 () {58 vars in 1242 bytes} [Tue Aug 9 18:08:18 2022] GET /compute/v2.1/os-quota-sets/ad5518bd1f484be0b2ae611e7d8aec88 => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:18.218253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86250814-8e58-4a1f-9d52-396d0a806838 tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-568625201", "id": 287780545, "os-flavor-access:is_public": "True"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:18.221137 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:08:18.221137 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 18:08:18.236981 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86250814-8e58-4a1f-9d52-396d0a806838 tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.022435 Aug 09 18:08:18.237568 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3430/6481] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:08:18 2022] POST /compute/v2.1/flavors => generated 434 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:08:18.248774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "287780545"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:18.250966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:18.256737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.257235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.257673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.258409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.259388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.259861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.436127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1063e2eb1a9241c38cbeefaec2726509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5518bd1f484be0b2ae611e7d8aec88', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:18.441634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:18.443505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-568625201 {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 18:08:18.451744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.452229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.452669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.453401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.453856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.454538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.475803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Getting quotas for project 78a4a4b10cba4037bac479e8efa6163b. Resources: {'ram', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:08:18.480873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Getting quotas for user 6d3f92bb24aa44e98fbdbde01ab27977 and project 78a4a4b10cba4037bac479e8efa6163b. Resources: {'ram', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:08:18.492763 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.compute.api [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] ram quota exceeded for ad5518bd1f484be0b2ae611e7d8aec88, tried to resize instance. Aug 09 18:08:18.493999 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Request method failure captured: Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556/action HTTP/1.1 Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 38 Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qKHOjUA6irzYuf6vhnQCyokEUJQbkV7j3o2CfmTa4rl4OQuSYmbMhzR2E6ao6nBZY-X3WbO84iwF2pdV2kWNxGExE0h3ACH3jL13F-w2ePbtWzscwhaQOphvqwnP8X5tbLc1iTxknta3vwafHoRIzsiMk0Rr2Y94IthT8Eu5Pf6b14 Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ad5518bd1f484be0b2ae611e7d8aec88 Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1378595322 Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad5518bd1f484be0b2ae611e7d8aec88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad5518bd1f484be0b2ae611e7d8aec88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad5518bd1f484be0b2ae611e7d8aec88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad5518bd1f484be0b2ae611e7d8aec88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1378595322 Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ad5518bd1f484be0b2ae611e7d8aec88 Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1378595322 Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersAdminNegativeTestJSON-1378595322-project-admin Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1063e2eb1a9241c38cbeefaec2726509 Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1378595322-project-admin Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: {"resize": {"flavorRef": "287780545"}} Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '88067fa1-7a16-41ec-8c02-9fc694925556', 'body': {'resize': {'flavorRef': '287780545'}}} Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:08:18.499337 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c3b195bf-db9d-4bf1-987d-2b3808df455c tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556/action" status: 403 len: 118 microversion: 2.1 time: 0.255624 Aug 09 18:08:18.503045 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3431/6482] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:08:18 2022] POST /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556/action => generated 118 bytes in 257 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:08:18.510177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4b11cc92-b013-4082-994a-b1719eee28cc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:18.510943 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:08:18.510943 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 18:08:18.528643 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4b11cc92-b013-4082-994a-b1719eee28cc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/287780545" status: 202 len: 0 microversion: 2.1 time: 0.022415 Aug 09 18:08:18.529256 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3432/6483] 10.222.0.93 () {58 vars in 1158 bytes} [Tue Aug 9 18:08:18 2022] DELETE /compute/v2.1/flavors/287780545 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:08:18.537111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3a8d3e79-dd80-40b5-a44f-beb5907cfd98 tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:18.557878 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3a8d3e79-dd80-40b5-a44f-beb5907cfd98 tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024328 Aug 09 18:08:18.558452 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3433/6484] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 18:08:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:18.577341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3bc685e6-4fdb-4680-a049-1cfd0d42124e tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Calling method '.version_select at 0x7fbbcbb70a60>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:18.641715 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3bc685e6-4fdb-4680-a049-1cfd0d42124e tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/ad5518bd1f484be0b2ae611e7d8aec88" status: 200 len: 371 microversion: 2.1 time: 0.067772 Aug 09 18:08:18.642297 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3434/6485] 10.222.0.93 () {58 vars in 1242 bytes} [Tue Aug 9 18:08:18 2022] GET /compute/v2.1/os-quota-sets/ad5518bd1f484be0b2ae611e7d8aec88 => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:18.653767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-91286476-08fb-4167-85e5-1595995e1c82 tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1920276301", "id": 1337082932, "os-flavor-access:is_public": "True"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:18.656622 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:08:18.656622 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 18:08:18.672731 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-91286476-08fb-4167-85e5-1595995e1c82 tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022951 Aug 09 18:08:18.673585 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3435/6486] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:08:18 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:18.684605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1337082932"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:18.686805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:18.693181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.693669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.694104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.694789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.695240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.695693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.722690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1063e2eb1a9241c38cbeefaec2726509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5518bd1f484be0b2ae611e7d8aec88', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:18.728999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1920276301 {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 18:08:18.735255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.735763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.736204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.736924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.737377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.737803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.757407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Getting quotas for project 78a4a4b10cba4037bac479e8efa6163b. Resources: {'ram', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:08:18.762658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Getting quotas for user 6d3f92bb24aa44e98fbdbde01ab27977 and project 78a4a4b10cba4037bac479e8efa6163b. Resources: {'ram', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:08:18.775504 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.compute.api [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] cores quota exceeded for ad5518bd1f484be0b2ae611e7d8aec88, tried to resize instance. Aug 09 18:08:18.775683 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Request method failure captured: Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556/action HTTP/1.1 Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 39 Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qKHOjUA6irzYuf6vhnQCyokEUJQbkV7j3o2CfmTa4rl4OQuSYmbMhzR2E6ao6nBZY-X3WbO84iwF2pdV2kWNxGExE0h3ACH3jL13F-w2ePbtWzscwhaQOphvqwnP8X5tbLc1iTxknta3vwafHoRIzsiMk0Rr2Y94IthT8Eu5Pf6b14 Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ad5518bd1f484be0b2ae611e7d8aec88 Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1378595322 Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Role: admin,reader,member Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: admin,reader,member Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ad5518bd1f484be0b2ae611e7d8aec88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad5518bd1f484be0b2ae611e7d8aec88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ad5518bd1f484be0b2ae611e7d8aec88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ad5518bd1f484be0b2ae611e7d8aec88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1378595322 Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ad5518bd1f484be0b2ae611e7d8aec88 Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1378595322 Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersAdminNegativeTestJSON-1378595322-project-admin Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1063e2eb1a9241c38cbeefaec2726509 Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1378595322-project-admin Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: {"resize": {"flavorRef": "1337082932"}} Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '88067fa1-7a16-41ec-8c02-9fc694925556', 'body': {'resize': {'flavorRef': '1337082932'}}} Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:08:18.777872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4641d065-a0e8-4100-a398-e18f686146dc tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556/action" status: 403 len: 113 microversion: 2.1 time: 0.098403 Aug 09 18:08:18.781990 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3436/6487] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:08:18 2022] POST /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556/action => generated 113 bytes in 100 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:08:18.787829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c11b34a8-794d-406b-8d29-b1b92085b66d tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:18.788588 n-d-845781-6 devstack@n-api.service[119431]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 18:08:18.788588 n-d-845781-6 devstack@n-api.service[119431]: warnings.warn(msg) Aug 09 18:08:18.805481 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c11b34a8-794d-406b-8d29-b1b92085b66d tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1337082932" status: 202 len: 0 microversion: 2.1 time: 0.021111 Aug 09 18:08:18.806082 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3437/6488] 10.222.0.93 () {58 vars in 1161 bytes} [Tue Aug 9 18:08:18 2022] DELETE /compute/v2.1/flavors/1337082932 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:08:18.813921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a94cdbaa-5235-4ece-8d91-6113e093e5ae tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:18.836340 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a94cdbaa-5235-4ece-8d91-6113e093e5ae tempest-ServersAdminNegativeTestJSON-1378595322 tempest-ServersAdminNegativeTestJSON-1378595322-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025762 Aug 09 18:08:18.837460 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3438/6489] 10.222.0.93 () {58 vars in 1146 bytes} [Tue Aug 9 18:08:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:18.861372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fe297c1e-99af-48f0-b87b-19c782a6e8d8 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:18.861791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fe297c1e-99af-48f0-b87b-19c782a6e8d8 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:18.864704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:18.868639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe297c1e-99af-48f0-b87b-19c782a6e8d8 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.869119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe297c1e-99af-48f0-b87b-19c782a6e8d8 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.869554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe297c1e-99af-48f0-b87b-19c782a6e8d8 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.870245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe297c1e-99af-48f0-b87b-19c782a6e8d8 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.870698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe297c1e-99af-48f0-b87b-19c782a6e8d8 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.871120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe297c1e-99af-48f0-b87b-19c782a6e8d8 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.896747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fe297c1e-99af-48f0-b87b-19c782a6e8d8 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:08:18.977206 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fe297c1e-99af-48f0-b87b-19c782a6e8d8 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "DELETE /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 204 len: 0 microversion: 2.1 time: 0.120177 Aug 09 18:08:18.978903 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3439/6490] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:08:18 2022] DELETE /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:08:18.986481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a11d2be-cdb0-4c9a-9372-6360a37fb86e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:18.987231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a11d2be-cdb0-4c9a-9372-6360a37fb86e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:18.993267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a11d2be-cdb0-4c9a-9372-6360a37fb86e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.993752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a11d2be-cdb0-4c9a-9372-6360a37fb86e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.994192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a11d2be-cdb0-4c9a-9372-6360a37fb86e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:18.994887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a11d2be-cdb0-4c9a-9372-6360a37fb86e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:18.995344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a11d2be-cdb0-4c9a-9372-6360a37fb86e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:18.995820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a11d2be-cdb0-4c9a-9372-6360a37fb86e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:19.014749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:19.130090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a11d2be-cdb0-4c9a-9372-6360a37fb86e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3f92bb24aa44e98fbdbde01ab27977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4a4b10cba4037bac479e8efa6163b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:19.138232 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a11d2be-cdb0-4c9a-9372-6360a37fb86e tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 200 len: 1477 microversion: 2.1 time: 0.155812 Aug 09 18:08:19.138800 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3440/6491] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:18 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:20.159795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c9ea1a3-9056-4468-8eaf-e06f7e88f659 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:20.160469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c9ea1a3-9056-4468-8eaf-e06f7e88f659 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:20.167712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9ea1a3-9056-4468-8eaf-e06f7e88f659 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:20.168205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9ea1a3-9056-4468-8eaf-e06f7e88f659 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:20.168670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9ea1a3-9056-4468-8eaf-e06f7e88f659 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:20.169380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9ea1a3-9056-4468-8eaf-e06f7e88f659 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:20.169840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9ea1a3-9056-4468-8eaf-e06f7e88f659 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:20.170471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c9ea1a3-9056-4468-8eaf-e06f7e88f659 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:20.301472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c9ea1a3-9056-4468-8eaf-e06f7e88f659 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3f92bb24aa44e98fbdbde01ab27977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4a4b10cba4037bac479e8efa6163b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:20.309507 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c9ea1a3-9056-4468-8eaf-e06f7e88f659 tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 200 len: 1477 microversion: 2.1 time: 0.153835 Aug 09 18:08:20.310079 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3441/6492] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:20 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:20.811956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3a687f68-c0dc-40ed-9c1d-42b8b4110b1e req-212b8ce5-f7f2-4fb2-bc6f-1220c11d0a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88067fa1-7a16-41ec-8c02-9fc694925556", "name": "network-vif-deleted", "tag": "a3f11922-53ee-45d6-a9c8-e7581e4b5e69"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:20.822108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3a687f68-c0dc-40ed-9c1d-42b8b4110b1e req-212b8ce5-f7f2-4fb2-bc6f-1220c11d0a7e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:20.822673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3a687f68-c0dc-40ed-9c1d-42b8b4110b1e req-212b8ce5-f7f2-4fb2-bc6f-1220c11d0a7e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:20.823110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3a687f68-c0dc-40ed-9c1d-42b8b4110b1e req-212b8ce5-f7f2-4fb2-bc6f-1220c11d0a7e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:20.837228 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3a687f68-c0dc-40ed-9c1d-42b8b4110b1e req-212b8ce5-f7f2-4fb2-bc6f-1220c11d0a7e service nova] Creating event network-vif-deleted:a3f11922-53ee-45d6-a9c8-e7581e4b5e69 for instance 88067fa1-7a16-41ec-8c02-9fc694925556 on n-h1-845781-6 Aug 09 18:08:20.842662 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3a687f68-c0dc-40ed-9c1d-42b8b4110b1e req-212b8ce5-f7f2-4fb2-bc6f-1220c11d0a7e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034455 Aug 09 18:08:20.843667 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3442/6493] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:21.332686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:21.333320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] [instance: 88067fa1-7a16-41ec-8c02-9fc694925556] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:21.340493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:21.340986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:21.341426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:21.342117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:21.342569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:21.342993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:21.356111 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] HTTP exception thrown: Instance 88067fa1-7a16-41ec-8c02-9fc694925556 could not be found. Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Request method failure captured: Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 HTTP/1.1 Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qKH5vsUU6_SFK3Yp9hZhA77xc7tF-YziRN8TFjjlDzhTsBX3xgy1o7a2mmhhJ3awfFK8f9lh-uPwl8XFQTCIUocHGPHF5RMeTv147OXOkSpgT3YtZbgC-u9X4xlCCPTMRdfSGpWTQvD97WkrIvMl6Q1i-OYopGwFaa41rhi1wYklPg Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 78a4a4b10cba4037bac479e8efa6163b Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1047721042 Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_78a4a4b10cba4037bac479e8efa6163b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/78a4a4b10cba4037bac479e8efa6163b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/78a4a4b10cba4037bac479e8efa6163b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/78a4a4b10cba4037bac479e8efa6163b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1047721042 Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 78a4a4b10cba4037bac479e8efa6163b Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1047721042 Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersAdminNegativeTestJSON-1047721042-project Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6d3f92bb24aa44e98fbdbde01ab27977 Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1047721042-project Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 88067fa1-7a16-41ec-8c02-9fc694925556 could not be found. Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '88067fa1-7a16-41ec-8c02-9fc694925556'} Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88067fa1-7a16-41ec-8c02-9fc694925556 could not be found. Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88067fa1-7a16-41ec-8c02-9fc694925556 could not be found. Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:21.357734 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:08:21.361890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:21.361890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:08:21.361890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:08:21.361890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:08:21.361890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:08:21.361890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:08:21.361890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88067fa1-7a16-41ec-8c02-9fc694925556 could not be found. Aug 09 18:08:21.361890 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:08:21.361890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] Returning 404 to user: Instance 88067fa1-7a16-41ec-8c02-9fc694925556 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:08:21.361890 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86742024-77dd-400d-bdd6-47f0259c6dcb tempest-ServersAdminNegativeTestJSON-1047721042 tempest-ServersAdminNegativeTestJSON-1047721042-project] 10.222.0.93 "GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556" status: 404 len: 111 microversion: 2.1 time: 0.032094 Aug 09 18:08:21.361890 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3443/6494] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:21 2022] GET /compute/v2.1/servers/88067fa1-7a16-41ec-8c02-9fc694925556 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:08:27.750772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1853801549", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "45bceaff-1ba3-4962-b098-0d3450aa2225"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:27.804090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] validate_networks() for [('45bceaff-1ba3-4962-b098-0d3450aa2225', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:08:28.192907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:08:28.193327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:08:28.193802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:08:28.194208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:08:28.194624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:08:28.203442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:28.203957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:28.204652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:28.205404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:28.205856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:28.206280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:28.222554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Getting quotas for project 47faad24cabc4e79b283ecd9f0cf732a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:08:28.228320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Getting quotas for user 9babaf0cddd1422ba2d6190c5b5fd019 and project 47faad24cabc4e79b283ecd9f0cf732a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:08:28.241573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:08:28.244559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:08:28.288098 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b6de1b2-a9b6-47f0-a512-50a59a3ce99c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652377 Aug 09 18:08:28.295021 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3444/6495] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:08:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:08:28.300073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c42a9d5b-c052-4d72-9abd-7943f0123c66 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:28.300729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c42a9d5b-c052-4d72-9abd-7943f0123c66 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:28.359557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c42a9d5b-c052-4d72-9abd-7943f0123c66 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:28.367141 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c42a9d5b-c052-4d72-9abd-7943f0123c66 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1215 microversion: 2.1 time: 0.070983 Aug 09 18:08:28.367864 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3445/6496] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:28 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:29.389114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-072e264c-5f2b-4763-aaf6-19432c2c9c9f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:29.389746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-072e264c-5f2b-4763-aaf6-19432c2c9c9f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:29.398530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-072e264c-5f2b-4763-aaf6-19432c2c9c9f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:29.399569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-072e264c-5f2b-4763-aaf6-19432c2c9c9f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:29.400314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-072e264c-5f2b-4763-aaf6-19432c2c9c9f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:29.401164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-072e264c-5f2b-4763-aaf6-19432c2c9c9f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:29.401845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-072e264c-5f2b-4763-aaf6-19432c2c9c9f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:29.402504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-072e264c-5f2b-4763-aaf6-19432c2c9c9f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:29.494850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-072e264c-5f2b-4763-aaf6-19432c2c9c9f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:29.503492 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-072e264c-5f2b-4763-aaf6-19432c2c9c9f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1285 microversion: 2.1 time: 0.118677 Aug 09 18:08:29.504715 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3446/6497] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:29 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:30.525084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c739f22c-53cc-4716-ab9f-5054d7c1a0d5 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:30.526248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c739f22c-53cc-4716-ab9f-5054d7c1a0d5 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:30.533719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c739f22c-53cc-4716-ab9f-5054d7c1a0d5 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:30.534252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c739f22c-53cc-4716-ab9f-5054d7c1a0d5 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:30.534696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c739f22c-53cc-4716-ab9f-5054d7c1a0d5 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:30.535415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c739f22c-53cc-4716-ab9f-5054d7c1a0d5 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:30.536245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c739f22c-53cc-4716-ab9f-5054d7c1a0d5 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:30.536341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c739f22c-53cc-4716-ab9f-5054d7c1a0d5 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:30.795295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c739f22c-53cc-4716-ab9f-5054d7c1a0d5 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:30.811274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c739f22c-53cc-4716-ab9f-5054d7c1a0d5 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1315 microversion: 2.1 time: 0.289340 Aug 09 18:08:30.827916 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3447/6498] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:30 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:30.908226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-79dd2741-9f61-4421-a69a-26074d5b55f3 req-54ba28db-5ee4-4715-9d68-75c9419cf91b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd0938f-814a-4e96-888e-317c44617ef9", "tag": "59e61a45-2d8b-4db7-834a-c4e46538092a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:30.924166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-79dd2741-9f61-4421-a69a-26074d5b55f3 req-54ba28db-5ee4-4715-9d68-75c9419cf91b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:30.924965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-79dd2741-9f61-4421-a69a-26074d5b55f3 req-54ba28db-5ee4-4715-9d68-75c9419cf91b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:30.925632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-79dd2741-9f61-4421-a69a-26074d5b55f3 req-54ba28db-5ee4-4715-9d68-75c9419cf91b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:30.941319 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-79dd2741-9f61-4421-a69a-26074d5b55f3 req-54ba28db-5ee4-4715-9d68-75c9419cf91b service nova] Creating event network-changed:59e61a45-2d8b-4db7-834a-c4e46538092a for instance 9bd0938f-814a-4e96-888e-317c44617ef9 on n-h1-845781-6 Aug 09 18:08:30.946652 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-79dd2741-9f61-4421-a69a-26074d5b55f3 req-54ba28db-5ee4-4715-9d68-75c9419cf91b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042460 Aug 09 18:08:30.947275 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3448/6499] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:31.847975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3d5ca24-0526-46a1-9175-f12672db8660 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:31.848749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c3d5ca24-0526-46a1-9175-f12672db8660 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:31.855095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d5ca24-0526-46a1-9175-f12672db8660 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:31.855585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d5ca24-0526-46a1-9175-f12672db8660 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:31.856055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d5ca24-0526-46a1-9175-f12672db8660 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:31.856763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d5ca24-0526-46a1-9175-f12672db8660 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:31.857222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d5ca24-0526-46a1-9175-f12672db8660 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:31.857658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d5ca24-0526-46a1-9175-f12672db8660 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:31.992254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c3d5ca24-0526-46a1-9175-f12672db8660 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:31.999718 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c3d5ca24-0526-46a1-9175-f12672db8660 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1315 microversion: 2.1 time: 0.157058 Aug 09 18:08:32.000287 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3449/6500] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:31 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:33.020704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1c794f97-7cf7-4554-92fc-cf4fe06c8964 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:33.021342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1c794f97-7cf7-4554-92fc-cf4fe06c8964 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:33.028537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c794f97-7cf7-4554-92fc-cf4fe06c8964 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:33.029035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c794f97-7cf7-4554-92fc-cf4fe06c8964 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:33.029486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c794f97-7cf7-4554-92fc-cf4fe06c8964 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:33.030201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c794f97-7cf7-4554-92fc-cf4fe06c8964 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:33.030667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c794f97-7cf7-4554-92fc-cf4fe06c8964 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:33.031100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c794f97-7cf7-4554-92fc-cf4fe06c8964 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:33.164106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1c794f97-7cf7-4554-92fc-cf4fe06c8964 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:33.172791 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1c794f97-7cf7-4554-92fc-cf4fe06c8964 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1315 microversion: 2.1 time: 0.155932 Aug 09 18:08:33.186637 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3450/6501] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:33 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:34.194338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d6e99dbf-b701-4fb4-a133-70c282dee085 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:34.194998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d6e99dbf-b701-4fb4-a133-70c282dee085 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:34.205921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6e99dbf-b701-4fb4-a133-70c282dee085 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:34.206445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6e99dbf-b701-4fb4-a133-70c282dee085 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:34.207012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6e99dbf-b701-4fb4-a133-70c282dee085 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:34.207758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6e99dbf-b701-4fb4-a133-70c282dee085 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:34.208219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6e99dbf-b701-4fb4-a133-70c282dee085 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:34.208650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d6e99dbf-b701-4fb4-a133-70c282dee085 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:34.344395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d6e99dbf-b701-4fb4-a133-70c282dee085 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:34.352480 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d6e99dbf-b701-4fb4-a133-70c282dee085 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1315 microversion: 2.1 time: 0.161978 Aug 09 18:08:34.353390 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3451/6502] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:34 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:35.373900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ad57ca0d-d570-454e-bba9-3fad0366411b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:35.374526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ad57ca0d-d570-454e-bba9-3fad0366411b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:35.381542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad57ca0d-d570-454e-bba9-3fad0366411b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:35.382051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad57ca0d-d570-454e-bba9-3fad0366411b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:35.382500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad57ca0d-d570-454e-bba9-3fad0366411b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:35.383223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad57ca0d-d570-454e-bba9-3fad0366411b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:35.384393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad57ca0d-d570-454e-bba9-3fad0366411b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:35.384836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad57ca0d-d570-454e-bba9-3fad0366411b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:35.516704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ad57ca0d-d570-454e-bba9-3fad0366411b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:35.524289 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ad57ca0d-d570-454e-bba9-3fad0366411b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1315 microversion: 2.1 time: 0.154168 Aug 09 18:08:35.524876 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3452/6503] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:35 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:36.556125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8dd217ce-c9eb-4d93-b700-168c946efe5c req-16c5f9e9-31ca-4d44-bc42-7ed1b114b182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd0938f-814a-4e96-888e-317c44617ef9", "name": "network-vif-plugged", "status": "completed", "tag": "59e61a45-2d8b-4db7-834a-c4e46538092a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:36.566913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8dd217ce-c9eb-4d93-b700-168c946efe5c req-16c5f9e9-31ca-4d44-bc42-7ed1b114b182 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:36.567397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8dd217ce-c9eb-4d93-b700-168c946efe5c req-16c5f9e9-31ca-4d44-bc42-7ed1b114b182 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:36.567938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8dd217ce-c9eb-4d93-b700-168c946efe5c req-16c5f9e9-31ca-4d44-bc42-7ed1b114b182 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:36.581030 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8dd217ce-c9eb-4d93-b700-168c946efe5c req-16c5f9e9-31ca-4d44-bc42-7ed1b114b182 service nova] Creating event network-vif-plugged:59e61a45-2d8b-4db7-834a-c4e46538092a for instance 9bd0938f-814a-4e96-888e-317c44617ef9 on n-h1-845781-6 Aug 09 18:08:36.586274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8dd217ce-c9eb-4d93-b700-168c946efe5c req-16c5f9e9-31ca-4d44-bc42-7ed1b114b182 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094328 Aug 09 18:08:36.586836 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3453/6504] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:08:36.592257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c0d4d217-58d2-49ca-ab5c-289d6219548b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:36.592958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c0d4d217-58d2-49ca-ab5c-289d6219548b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:36.599126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d4d217-58d2-49ca-ab5c-289d6219548b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:36.599613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d4d217-58d2-49ca-ab5c-289d6219548b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:36.600092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d4d217-58d2-49ca-ab5c-289d6219548b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:36.600790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d4d217-58d2-49ca-ab5c-289d6219548b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:36.601885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d4d217-58d2-49ca-ab5c-289d6219548b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:36.602306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d4d217-58d2-49ca-ab5c-289d6219548b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:36.804664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c0d4d217-58d2-49ca-ab5c-289d6219548b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:36.813093 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c0d4d217-58d2-49ca-ab5c-289d6219548b tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1315 microversion: 2.1 time: 0.225048 Aug 09 18:08:36.813672 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3454/6505] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:36 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:37.834809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21ce8cb6-c995-47f9-95be-536b5b057106 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:37.835424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-21ce8cb6-c995-47f9-95be-536b5b057106 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:37.843364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21ce8cb6-c995-47f9-95be-536b5b057106 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:37.843882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21ce8cb6-c995-47f9-95be-536b5b057106 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:37.844327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21ce8cb6-c995-47f9-95be-536b5b057106 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:37.845018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21ce8cb6-c995-47f9-95be-536b5b057106 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:37.845473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21ce8cb6-c995-47f9-95be-536b5b057106 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:37.845898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21ce8cb6-c995-47f9-95be-536b5b057106 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:37.997330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-21ce8cb6-c995-47f9-95be-536b5b057106 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:38.005846 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-21ce8cb6-c995-47f9-95be-536b5b057106 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1315 microversion: 2.1 time: 0.174871 Aug 09 18:08:38.006651 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3455/6506] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:37 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:39.027243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fdf7ad95-1b86-4d5a-900a-4105a17d3f89 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:39.027934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fdf7ad95-1b86-4d5a-900a-4105a17d3f89 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:39.029896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:39.030601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=20 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:39.037708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdf7ad95-1b86-4d5a-900a-4105a17d3f89 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:39.038202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdf7ad95-1b86-4d5a-900a-4105a17d3f89 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:39.038651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdf7ad95-1b86-4d5a-900a-4105a17d3f89 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:39.039615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdf7ad95-1b86-4d5a-900a-4105a17d3f89 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:39.040104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdf7ad95-1b86-4d5a-900a-4105a17d3f89 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:39.040543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fdf7ad95-1b86-4d5a-900a-4105a17d3f89 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:39.172058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fdf7ad95-1b86-4d5a-900a-4105a17d3f89 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:39.181009 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fdf7ad95-1b86-4d5a-900a-4105a17d3f89 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1503 microversion: 2.1 time: 0.157093 Aug 09 18:08:39.181596 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3456/6507] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:39 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:39.200630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:08:39.203206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:39.209432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:39.209922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:39.210398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:39.211092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:39.211557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:39.212011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:39.241097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:39.248613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Old instance type m1.heat2, new instance type m1.heat {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 18:08:39.255517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:08:39.255987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:08:39.256471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:08:39.256883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:08:39.257294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:08:39.319683 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-671a1e05-2646-43a3-90fd-7b360a26b95c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "POST /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9/action" status: 202 len: 0 microversion: 2.1 time: 0.122586 Aug 09 18:08:39.320463 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3457/6508] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:08:39 2022] POST /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:08:39.328119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efafdf3f-29ee-4754-bfbf-4caaee1248ec tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:39.328742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-efafdf3f-29ee-4754-bfbf-4caaee1248ec tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:39.335052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efafdf3f-29ee-4754-bfbf-4caaee1248ec tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:39.335546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efafdf3f-29ee-4754-bfbf-4caaee1248ec tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:39.336029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efafdf3f-29ee-4754-bfbf-4caaee1248ec tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:39.336778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efafdf3f-29ee-4754-bfbf-4caaee1248ec tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:39.337238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efafdf3f-29ee-4754-bfbf-4caaee1248ec tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:39.337671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efafdf3f-29ee-4754-bfbf-4caaee1248ec tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:39.475069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-efafdf3f-29ee-4754-bfbf-4caaee1248ec tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:39.483224 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-efafdf3f-29ee-4754-bfbf-4caaee1248ec tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1512 microversion: 2.1 time: 0.158780 Aug 09 18:08:39.483850 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3458/6509] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:39 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:40.503591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-931f6cf3-3fcc-447f-818b-28f37adc3311 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:40.504241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-931f6cf3-3fcc-447f-818b-28f37adc3311 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:40.511746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-931f6cf3-3fcc-447f-818b-28f37adc3311 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:40.512230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-931f6cf3-3fcc-447f-818b-28f37adc3311 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:40.512668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-931f6cf3-3fcc-447f-818b-28f37adc3311 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:40.513367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-931f6cf3-3fcc-447f-818b-28f37adc3311 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:40.513825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-931f6cf3-3fcc-447f-818b-28f37adc3311 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:40.514249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-931f6cf3-3fcc-447f-818b-28f37adc3311 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:40.651519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-931f6cf3-3fcc-447f-818b-28f37adc3311 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:40.660017 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-931f6cf3-3fcc-447f-818b-28f37adc3311 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1512 microversion: 2.1 time: 0.160237 Aug 09 18:08:40.660544 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3459/6510] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:40 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:41.682671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2e7f918-9f96-4cf9-9186-a54e6fcff5dc tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:41.683313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2e7f918-9f96-4cf9-9186-a54e6fcff5dc tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:41.690115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e7f918-9f96-4cf9-9186-a54e6fcff5dc tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:41.690604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e7f918-9f96-4cf9-9186-a54e6fcff5dc tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:41.691049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e7f918-9f96-4cf9-9186-a54e6fcff5dc tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:41.691777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e7f918-9f96-4cf9-9186-a54e6fcff5dc tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:41.692243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e7f918-9f96-4cf9-9186-a54e6fcff5dc tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:41.692676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2e7f918-9f96-4cf9-9186-a54e6fcff5dc tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:41.696756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:41.829526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d2e7f918-9f96-4cf9-9186-a54e6fcff5dc tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:41.837645 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d2e7f918-9f96-4cf9-9186-a54e6fcff5dc tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.159619 Aug 09 18:08:41.838228 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3460/6511] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:41 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:42.858214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2955cd3a-45a7-4766-8258-8c6ced8b27d1 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:42.858835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2955cd3a-45a7-4766-8258-8c6ced8b27d1 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:42.866040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2955cd3a-45a7-4766-8258-8c6ced8b27d1 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:42.866540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2955cd3a-45a7-4766-8258-8c6ced8b27d1 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:42.866985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2955cd3a-45a7-4766-8258-8c6ced8b27d1 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:42.868299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2955cd3a-45a7-4766-8258-8c6ced8b27d1 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:42.868764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2955cd3a-45a7-4766-8258-8c6ced8b27d1 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:42.869241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2955cd3a-45a7-4766-8258-8c6ced8b27d1 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:43.001855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2955cd3a-45a7-4766-8258-8c6ced8b27d1 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:43.009423 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2955cd3a-45a7-4766-8258-8c6ced8b27d1 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.155124 Aug 09 18:08:43.010005 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3461/6512] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:42 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:44.031219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c0828754-b578-4fa6-8c14-454683ce6b9d tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:44.031931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c0828754-b578-4fa6-8c14-454683ce6b9d tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:44.038708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0828754-b578-4fa6-8c14-454683ce6b9d tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:44.039136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0828754-b578-4fa6-8c14-454683ce6b9d tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:44.039614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0828754-b578-4fa6-8c14-454683ce6b9d tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:44.040322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0828754-b578-4fa6-8c14-454683ce6b9d tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:44.040776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0828754-b578-4fa6-8c14-454683ce6b9d tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:44.041202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0828754-b578-4fa6-8c14-454683ce6b9d tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:44.174263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c0828754-b578-4fa6-8c14-454683ce6b9d tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:44.183287 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c0828754-b578-4fa6-8c14-454683ce6b9d tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.155944 Aug 09 18:08:44.183924 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3462/6513] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:44 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:45.205051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-39161a18-a132-4282-89ba-b13a44c7c819 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:45.205694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-39161a18-a132-4282-89ba-b13a44c7c819 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:45.213749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39161a18-a132-4282-89ba-b13a44c7c819 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:45.214248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39161a18-a132-4282-89ba-b13a44c7c819 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:45.214712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39161a18-a132-4282-89ba-b13a44c7c819 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:45.215425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39161a18-a132-4282-89ba-b13a44c7c819 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:45.215914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39161a18-a132-4282-89ba-b13a44c7c819 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:45.216352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-39161a18-a132-4282-89ba-b13a44c7c819 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:45.347806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-39161a18-a132-4282-89ba-b13a44c7c819 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:45.355469 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-39161a18-a132-4282-89ba-b13a44c7c819 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.154605 Aug 09 18:08:45.356102 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3463/6514] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:45 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:46.376497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-998f3371-dbdc-428d-b19a-944d16f44a85 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:46.377189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-998f3371-dbdc-428d-b19a-944d16f44a85 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:46.383947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-998f3371-dbdc-428d-b19a-944d16f44a85 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:46.384443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-998f3371-dbdc-428d-b19a-944d16f44a85 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:46.384891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-998f3371-dbdc-428d-b19a-944d16f44a85 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:46.385595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-998f3371-dbdc-428d-b19a-944d16f44a85 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:46.386057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-998f3371-dbdc-428d-b19a-944d16f44a85 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:46.386493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-998f3371-dbdc-428d-b19a-944d16f44a85 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:46.520101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-998f3371-dbdc-428d-b19a-944d16f44a85 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:46.528105 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-998f3371-dbdc-428d-b19a-944d16f44a85 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.155522 Aug 09 18:08:46.528692 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3464/6515] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:46 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:47.550087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c17490fe-0c10-46a7-94ba-2149ec735954 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:47.550738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c17490fe-0c10-46a7-94ba-2149ec735954 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:47.557720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c17490fe-0c10-46a7-94ba-2149ec735954 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:47.558214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c17490fe-0c10-46a7-94ba-2149ec735954 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:47.558661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c17490fe-0c10-46a7-94ba-2149ec735954 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:47.559366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c17490fe-0c10-46a7-94ba-2149ec735954 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:47.559858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c17490fe-0c10-46a7-94ba-2149ec735954 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:47.560293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c17490fe-0c10-46a7-94ba-2149ec735954 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:47.690825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c17490fe-0c10-46a7-94ba-2149ec735954 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:47.698893 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c17490fe-0c10-46a7-94ba-2149ec735954 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.152793 Aug 09 18:08:47.699473 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3465/6516] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:47 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:08:48.721243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6dd2d4b3-93d8-456b-b839-1e40ea40dfa6 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:48.721952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6dd2d4b3-93d8-456b-b839-1e40ea40dfa6 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:48.728892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4b3-93d8-456b-b839-1e40ea40dfa6 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:48.729385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4b3-93d8-456b-b839-1e40ea40dfa6 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:48.729821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4b3-93d8-456b-b839-1e40ea40dfa6 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:48.730521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4b3-93d8-456b-b839-1e40ea40dfa6 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:48.730977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4b3-93d8-456b-b839-1e40ea40dfa6 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:48.731402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4b3-93d8-456b-b839-1e40ea40dfa6 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:48.868681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6dd2d4b3-93d8-456b-b839-1e40ea40dfa6 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:48.876326 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6dd2d4b3-93d8-456b-b839-1e40ea40dfa6 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.158983 Aug 09 18:08:48.876903 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3466/6517] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:48 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:49.898175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b2eebfe2-8339-4a12-a9c5-78e26e4c6356 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:49.899530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b2eebfe2-8339-4a12-a9c5-78e26e4c6356 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:49.902420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:08:49.907933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2eebfe2-8339-4a12-a9c5-78e26e4c6356 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:49.908435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2eebfe2-8339-4a12-a9c5-78e26e4c6356 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:49.908882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2eebfe2-8339-4a12-a9c5-78e26e4c6356 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:49.909623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2eebfe2-8339-4a12-a9c5-78e26e4c6356 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:49.910086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2eebfe2-8339-4a12-a9c5-78e26e4c6356 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:49.910524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2eebfe2-8339-4a12-a9c5-78e26e4c6356 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:50.044436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b2eebfe2-8339-4a12-a9c5-78e26e4c6356 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:50.052081 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b2eebfe2-8339-4a12-a9c5-78e26e4c6356 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.157969 Aug 09 18:08:50.052669 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3467/6518] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:49 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:51.073952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c10bc51-6179-404d-b341-63d507b8dbda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:51.074567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c10bc51-6179-404d-b341-63d507b8dbda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:51.081908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c10bc51-6179-404d-b341-63d507b8dbda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:51.082399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c10bc51-6179-404d-b341-63d507b8dbda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:51.082840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c10bc51-6179-404d-b341-63d507b8dbda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:51.083537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c10bc51-6179-404d-b341-63d507b8dbda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:51.084052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c10bc51-6179-404d-b341-63d507b8dbda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:51.084480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c10bc51-6179-404d-b341-63d507b8dbda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:51.217968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5c10bc51-6179-404d-b341-63d507b8dbda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:51.225756 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c10bc51-6179-404d-b341-63d507b8dbda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.156151 Aug 09 18:08:51.226341 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3468/6519] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:51 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:52.247023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99d79a93-438c-48fa-89cf-97afbe213155 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:52.247745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99d79a93-438c-48fa-89cf-97afbe213155 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:52.254687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99d79a93-438c-48fa-89cf-97afbe213155 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:52.255177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99d79a93-438c-48fa-89cf-97afbe213155 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:52.255636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99d79a93-438c-48fa-89cf-97afbe213155 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:52.256360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99d79a93-438c-48fa-89cf-97afbe213155 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:52.256823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99d79a93-438c-48fa-89cf-97afbe213155 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:52.257257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99d79a93-438c-48fa-89cf-97afbe213155 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:52.392548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99d79a93-438c-48fa-89cf-97afbe213155 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:52.400704 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99d79a93-438c-48fa-89cf-97afbe213155 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.158242 Aug 09 18:08:52.401292 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3469/6520] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:52 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:53.421252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ed28046-d269-491e-ac9f-7836c2c23bad tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:53.421906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7ed28046-d269-491e-ac9f-7836c2c23bad tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:53.428802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed28046-d269-491e-ac9f-7836c2c23bad tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:53.429303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed28046-d269-491e-ac9f-7836c2c23bad tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:53.430331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed28046-d269-491e-ac9f-7836c2c23bad tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:53.431045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed28046-d269-491e-ac9f-7836c2c23bad tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:53.431512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed28046-d269-491e-ac9f-7836c2c23bad tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:53.432055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ed28046-d269-491e-ac9f-7836c2c23bad tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:53.566002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7ed28046-d269-491e-ac9f-7836c2c23bad tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:53.573706 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ed28046-d269-491e-ac9f-7836c2c23bad tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.156430 Aug 09 18:08:53.574289 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3470/6521] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:53 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:54.594874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-85b7ffc9-c6ca-4a1f-8f8e-2b371bb3d9e3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:54.595592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-85b7ffc9-c6ca-4a1f-8f8e-2b371bb3d9e3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:54.602456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85b7ffc9-c6ca-4a1f-8f8e-2b371bb3d9e3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:54.602980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85b7ffc9-c6ca-4a1f-8f8e-2b371bb3d9e3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:54.603429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85b7ffc9-c6ca-4a1f-8f8e-2b371bb3d9e3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:54.604165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85b7ffc9-c6ca-4a1f-8f8e-2b371bb3d9e3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:54.604627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85b7ffc9-c6ca-4a1f-8f8e-2b371bb3d9e3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:54.605079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85b7ffc9-c6ca-4a1f-8f8e-2b371bb3d9e3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:54.738503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-85b7ffc9-c6ca-4a1f-8f8e-2b371bb3d9e3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:54.746703 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-85b7ffc9-c6ca-4a1f-8f8e-2b371bb3d9e3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.155835 Aug 09 18:08:54.747276 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3471/6522] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:54 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:55.768413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a81f1b92-e6fe-405c-8d27-b9288d261791 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:55.769095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a81f1b92-e6fe-405c-8d27-b9288d261791 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:55.776995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81f1b92-e6fe-405c-8d27-b9288d261791 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:55.777480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81f1b92-e6fe-405c-8d27-b9288d261791 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:55.777919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81f1b92-e6fe-405c-8d27-b9288d261791 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:55.778622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81f1b92-e6fe-405c-8d27-b9288d261791 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:55.779075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81f1b92-e6fe-405c-8d27-b9288d261791 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:55.779502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81f1b92-e6fe-405c-8d27-b9288d261791 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:55.926365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a81f1b92-e6fe-405c-8d27-b9288d261791 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:55.935151 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a81f1b92-e6fe-405c-8d27-b9288d261791 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.170722 Aug 09 18:08:55.935765 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3472/6523] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:55 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:56.959006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b4e8ac90-8f48-4dcb-9170-5071221eaa31 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:56.959681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4e8ac90-8f48-4dcb-9170-5071221eaa31 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:56.966738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8ac90-8f48-4dcb-9170-5071221eaa31 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:56.967253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8ac90-8f48-4dcb-9170-5071221eaa31 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:56.967742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8ac90-8f48-4dcb-9170-5071221eaa31 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:56.968600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8ac90-8f48-4dcb-9170-5071221eaa31 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:56.969165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8ac90-8f48-4dcb-9170-5071221eaa31 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:56.969743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4e8ac90-8f48-4dcb-9170-5071221eaa31 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:57.098805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b4e8ac90-8f48-4dcb-9170-5071221eaa31 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:57.107082 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b4e8ac90-8f48-4dcb-9170-5071221eaa31 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.152519 Aug 09 18:08:57.107677 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3473/6524] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:56 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:58.128131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e8cc07e0-c7ee-4775-95d4-18a999b53a70 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:58.128757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e8cc07e0-c7ee-4775-95d4-18a999b53a70 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:58.135597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8cc07e0-c7ee-4775-95d4-18a999b53a70 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:58.136142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8cc07e0-c7ee-4775-95d4-18a999b53a70 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:58.136617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8cc07e0-c7ee-4775-95d4-18a999b53a70 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:58.137329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8cc07e0-c7ee-4775-95d4-18a999b53a70 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:58.137796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8cc07e0-c7ee-4775-95d4-18a999b53a70 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:58.138229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8cc07e0-c7ee-4775-95d4-18a999b53a70 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:58.279018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e8cc07e0-c7ee-4775-95d4-18a999b53a70 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:58.286686 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e8cc07e0-c7ee-4775-95d4-18a999b53a70 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.162633 Aug 09 18:08:58.287269 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3474/6525] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:58 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:08:59.308840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fb4bcbf0-de7c-4f94-b577-28c86d913324 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:08:59.309475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fb4bcbf0-de7c-4f94-b577-28c86d913324 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:08:59.316363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb4bcbf0-de7c-4f94-b577-28c86d913324 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:59.316852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb4bcbf0-de7c-4f94-b577-28c86d913324 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:59.317313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb4bcbf0-de7c-4f94-b577-28c86d913324 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:59.318012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb4bcbf0-de7c-4f94-b577-28c86d913324 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:08:59.318463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb4bcbf0-de7c-4f94-b577-28c86d913324 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:08:59.318918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb4bcbf0-de7c-4f94-b577-28c86d913324 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:08:59.449093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fb4bcbf0-de7c-4f94-b577-28c86d913324 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:08:59.458567 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fb4bcbf0-de7c-4f94-b577-28c86d913324 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.154259 Aug 09 18:08:59.459162 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3475/6526] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:08:59 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:00.479113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1f3b253-c7f2-405e-84bf-2b7701343306 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:00.479804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e1f3b253-c7f2-405e-84bf-2b7701343306 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:00.486613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1f3b253-c7f2-405e-84bf-2b7701343306 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:00.487097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1f3b253-c7f2-405e-84bf-2b7701343306 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:00.487536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1f3b253-c7f2-405e-84bf-2b7701343306 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:00.488252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1f3b253-c7f2-405e-84bf-2b7701343306 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:00.488707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1f3b253-c7f2-405e-84bf-2b7701343306 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:00.489134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1f3b253-c7f2-405e-84bf-2b7701343306 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:00.623182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e1f3b253-c7f2-405e-84bf-2b7701343306 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:00.626702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:00.631743 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1f3b253-c7f2-405e-84bf-2b7701343306 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.156508 Aug 09 18:09:00.632341 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3476/6527] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:00 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:01.653938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-60570531-9a19-4f98-9738-9a816e44bbc4 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:01.654643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-60570531-9a19-4f98-9738-9a816e44bbc4 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:01.661321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60570531-9a19-4f98-9738-9a816e44bbc4 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:01.661804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60570531-9a19-4f98-9738-9a816e44bbc4 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:01.662237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60570531-9a19-4f98-9738-9a816e44bbc4 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:01.662932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60570531-9a19-4f98-9738-9a816e44bbc4 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:01.663382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60570531-9a19-4f98-9738-9a816e44bbc4 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:01.664339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60570531-9a19-4f98-9738-9a816e44bbc4 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:01.797295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-60570531-9a19-4f98-9738-9a816e44bbc4 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:01.805374 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-60570531-9a19-4f98-9738-9a816e44bbc4 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.155658 Aug 09 18:09:01.805954 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3477/6528] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:01 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:02.827132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aabe5454-a29a-4563-8ea0-35a651a4810a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:02.827840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aabe5454-a29a-4563-8ea0-35a651a4810a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:02.836041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aabe5454-a29a-4563-8ea0-35a651a4810a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:02.836629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aabe5454-a29a-4563-8ea0-35a651a4810a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:02.837098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aabe5454-a29a-4563-8ea0-35a651a4810a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:02.837824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aabe5454-a29a-4563-8ea0-35a651a4810a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:02.838283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aabe5454-a29a-4563-8ea0-35a651a4810a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:02.838718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aabe5454-a29a-4563-8ea0-35a651a4810a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:02.978025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aabe5454-a29a-4563-8ea0-35a651a4810a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:02.985635 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aabe5454-a29a-4563-8ea0-35a651a4810a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.162375 Aug 09 18:09:02.986226 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3478/6529] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:02 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:04.006532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c873cd8-14f7-4d97-9512-6773fdeb72cb tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:04.007178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c873cd8-14f7-4d97-9512-6773fdeb72cb tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:04.014222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c873cd8-14f7-4d97-9512-6773fdeb72cb tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:04.014714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c873cd8-14f7-4d97-9512-6773fdeb72cb tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:04.015165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c873cd8-14f7-4d97-9512-6773fdeb72cb tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:04.015892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c873cd8-14f7-4d97-9512-6773fdeb72cb tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:04.016363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c873cd8-14f7-4d97-9512-6773fdeb72cb tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:04.016800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c873cd8-14f7-4d97-9512-6773fdeb72cb tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:04.150906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c873cd8-14f7-4d97-9512-6773fdeb72cb tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:04.158473 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c873cd8-14f7-4d97-9512-6773fdeb72cb tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.155968 Aug 09 18:09:04.159057 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3479/6530] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:04 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:05.182077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-123f0104-eaa8-4a25-9764-78c153860ec3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:05.183073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-123f0104-eaa8-4a25-9764-78c153860ec3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:05.190332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-123f0104-eaa8-4a25-9764-78c153860ec3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:05.190828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-123f0104-eaa8-4a25-9764-78c153860ec3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:05.191275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-123f0104-eaa8-4a25-9764-78c153860ec3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:05.192012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-123f0104-eaa8-4a25-9764-78c153860ec3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:05.192478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-123f0104-eaa8-4a25-9764-78c153860ec3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:05.192912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-123f0104-eaa8-4a25-9764-78c153860ec3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:05.321570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-123f0104-eaa8-4a25-9764-78c153860ec3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:05.329073 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-123f0104-eaa8-4a25-9764-78c153860ec3 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.153063 Aug 09 18:09:05.329917 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3480/6531] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:05 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:06.349234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a57e3f9e-1488-4c15-a124-6440bd15ac28 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:06.349892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a57e3f9e-1488-4c15-a124-6440bd15ac28 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:06.357181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a57e3f9e-1488-4c15-a124-6440bd15ac28 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:06.357667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a57e3f9e-1488-4c15-a124-6440bd15ac28 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:06.358109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a57e3f9e-1488-4c15-a124-6440bd15ac28 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:06.358796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a57e3f9e-1488-4c15-a124-6440bd15ac28 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:06.359249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a57e3f9e-1488-4c15-a124-6440bd15ac28 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:06.359698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a57e3f9e-1488-4c15-a124-6440bd15ac28 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:06.494056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a57e3f9e-1488-4c15-a124-6440bd15ac28 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:06.501749 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a57e3f9e-1488-4c15-a124-6440bd15ac28 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.156417 Aug 09 18:09:06.502321 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3481/6532] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:06 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:07.522295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-08e36a91-2987-45f6-a9e2-0e7809e2722a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:07.522910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-08e36a91-2987-45f6-a9e2-0e7809e2722a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:07.535854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08e36a91-2987-45f6-a9e2-0e7809e2722a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:07.536355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08e36a91-2987-45f6-a9e2-0e7809e2722a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:07.536801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08e36a91-2987-45f6-a9e2-0e7809e2722a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:07.537627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08e36a91-2987-45f6-a9e2-0e7809e2722a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:07.538211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08e36a91-2987-45f6-a9e2-0e7809e2722a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:07.538843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08e36a91-2987-45f6-a9e2-0e7809e2722a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:07.671737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-08e36a91-2987-45f6-a9e2-0e7809e2722a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:07.679229 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-08e36a91-2987-45f6-a9e2-0e7809e2722a tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1517 microversion: 2.1 time: 0.160805 Aug 09 18:09:07.680400 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3482/6533] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:07 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:08.707015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-02df0199-2586-4f32-9817-c5442d438f88 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:08.707919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-02df0199-2586-4f32-9817-c5442d438f88 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:08.714867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02df0199-2586-4f32-9817-c5442d438f88 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:08.715435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02df0199-2586-4f32-9817-c5442d438f88 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:08.715954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02df0199-2586-4f32-9817-c5442d438f88 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:08.716723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02df0199-2586-4f32-9817-c5442d438f88 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:08.717252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02df0199-2586-4f32-9817-c5442d438f88 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:08.717875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02df0199-2586-4f32-9817-c5442d438f88 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:08.876886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-02df0199-2586-4f32-9817-c5442d438f88 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:08.885406 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-02df0199-2586-4f32-9817-c5442d438f88 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1516 microversion: 2.1 time: 0.182792 Aug 09 18:09:08.886033 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3483/6534] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:08 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:08.934184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2adc9ffa-d0f2-46b4-bf32-fe8317777035 req-4da8f8c0-242c-4969-8c5a-28be7132411c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd0938f-814a-4e96-888e-317c44617ef9", "name": "network-vif-unplugged", "status": "completed", "tag": "59e61a45-2d8b-4db7-834a-c4e46538092a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:08.945896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2adc9ffa-d0f2-46b4-bf32-fe8317777035 req-4da8f8c0-242c-4969-8c5a-28be7132411c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:08.946629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2adc9ffa-d0f2-46b4-bf32-fe8317777035 req-4da8f8c0-242c-4969-8c5a-28be7132411c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:08.947392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2adc9ffa-d0f2-46b4-bf32-fe8317777035 req-4da8f8c0-242c-4969-8c5a-28be7132411c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:08.964155 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2adc9ffa-d0f2-46b4-bf32-fe8317777035 req-4da8f8c0-242c-4969-8c5a-28be7132411c service nova] Creating event network-vif-unplugged:59e61a45-2d8b-4db7-834a-c4e46538092a for instance 9bd0938f-814a-4e96-888e-317c44617ef9 on n-h2-845781-6 Aug 09 18:09:08.971380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-2adc9ffa-d0f2-46b4-bf32-fe8317777035 req-4da8f8c0-242c-4969-8c5a-28be7132411c service nova] Instance 9bd0938f-814a-4e96-888e-317c44617ef9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:09:08.984343 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2adc9ffa-d0f2-46b4-bf32-fe8317777035 req-4da8f8c0-242c-4969-8c5a-28be7132411c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054039 Aug 09 18:09:08.985617 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3484/6535] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:09.907757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d45b6f0-49c5-48be-9295-18197eafed5c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:09.908459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5d45b6f0-49c5-48be-9295-18197eafed5c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:09.915810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d45b6f0-49c5-48be-9295-18197eafed5c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:09.916305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d45b6f0-49c5-48be-9295-18197eafed5c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:09.916750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d45b6f0-49c5-48be-9295-18197eafed5c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:09.917457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d45b6f0-49c5-48be-9295-18197eafed5c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:09.917918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d45b6f0-49c5-48be-9295-18197eafed5c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:09.918348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d45b6f0-49c5-48be-9295-18197eafed5c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:10.053626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5d45b6f0-49c5-48be-9295-18197eafed5c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:10.061899 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5d45b6f0-49c5-48be-9295-18197eafed5c tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1514 microversion: 2.1 time: 0.158437 Aug 09 18:09:10.062479 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3485/6536] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:09 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:11.011970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-253b81f8-930f-47a5-8868-f8b52fdac1c9 req-f3c246e3-dfae-4f8b-8639-1babd53b207a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd0938f-814a-4e96-888e-317c44617ef9", "tag": "59e61a45-2d8b-4db7-834a-c4e46538092a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:11.022304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-253b81f8-930f-47a5-8868-f8b52fdac1c9 req-f3c246e3-dfae-4f8b-8639-1babd53b207a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:11.022786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-253b81f8-930f-47a5-8868-f8b52fdac1c9 req-f3c246e3-dfae-4f8b-8639-1babd53b207a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:11.023803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-253b81f8-930f-47a5-8868-f8b52fdac1c9 req-f3c246e3-dfae-4f8b-8639-1babd53b207a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:11.035574 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-253b81f8-930f-47a5-8868-f8b52fdac1c9 req-f3c246e3-dfae-4f8b-8639-1babd53b207a service nova] Creating event network-changed:59e61a45-2d8b-4db7-834a-c4e46538092a for instance 9bd0938f-814a-4e96-888e-317c44617ef9 on n-h2-845781-6 Aug 09 18:09:11.040981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-253b81f8-930f-47a5-8868-f8b52fdac1c9 req-f3c246e3-dfae-4f8b-8639-1babd53b207a service nova] Instance 9bd0938f-814a-4e96-888e-317c44617ef9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:09:11.052464 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-253b81f8-930f-47a5-8868-f8b52fdac1c9 req-f3c246e3-dfae-4f8b-8639-1babd53b207a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044784 Aug 09 18:09:11.053083 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3486/6537] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:09:11.083171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b6bd0f9-449e-4746-83c4-1ea46357c121 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:11.083930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b6bd0f9-449e-4746-83c4-1ea46357c121 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:11.090432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b6bd0f9-449e-4746-83c4-1ea46357c121 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:11.090914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b6bd0f9-449e-4746-83c4-1ea46357c121 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:11.091353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b6bd0f9-449e-4746-83c4-1ea46357c121 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:11.092081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b6bd0f9-449e-4746-83c4-1ea46357c121 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:11.092539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b6bd0f9-449e-4746-83c4-1ea46357c121 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:11.092966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b6bd0f9-449e-4746-83c4-1ea46357c121 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:11.310040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8b6bd0f9-449e-4746-83c4-1ea46357c121 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:11.322426 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b6bd0f9-449e-4746-83c4-1ea46357c121 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1514 microversion: 2.1 time: 0.243685 Aug 09 18:09:11.323530 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3487/6538] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:11 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:12.344624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c8e9ab8e-c57c-47ae-bc02-355fd246e5d7 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:12.345288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c8e9ab8e-c57c-47ae-bc02-355fd246e5d7 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:12.352270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ab8e-c57c-47ae-bc02-355fd246e5d7 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:12.352763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ab8e-c57c-47ae-bc02-355fd246e5d7 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:12.353208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ab8e-c57c-47ae-bc02-355fd246e5d7 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:12.353911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ab8e-c57c-47ae-bc02-355fd246e5d7 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:12.354379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ab8e-c57c-47ae-bc02-355fd246e5d7 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:12.354824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8e9ab8e-c57c-47ae-bc02-355fd246e5d7 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:12.485308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c8e9ab8e-c57c-47ae-bc02-355fd246e5d7 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:12.492791 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c8e9ab8e-c57c-47ae-bc02-355fd246e5d7 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1511 microversion: 2.1 time: 0.152146 Aug 09 18:09:12.493376 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3488/6539] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:12 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:12.512967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-40a52125-b3e7-47a0-aef1-db34eede0f96 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:12.513469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-40a52125-b3e7-47a0-aef1-db34eede0f96 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:12.520548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40a52125-b3e7-47a0-aef1-db34eede0f96 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:12.521204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40a52125-b3e7-47a0-aef1-db34eede0f96 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:12.521461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40a52125-b3e7-47a0-aef1-db34eede0f96 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:12.522158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40a52125-b3e7-47a0-aef1-db34eede0f96 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:12.522611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40a52125-b3e7-47a0-aef1-db34eede0f96 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:12.523603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40a52125-b3e7-47a0-aef1-db34eede0f96 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:12.549426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-40a52125-b3e7-47a0-aef1-db34eede0f96 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:09:12.605882 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.compute.api [None req-40a52125-b3e7-47a0-aef1-db34eede0f96 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Found an unconfirmed migration during delete, id: 16, status: finished Aug 09 18:09:14.394482 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-40a52125-b3e7-47a0-aef1-db34eede0f96 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 204 len: 0 microversion: 2.1 time: 1.884833 Aug 09 18:09:14.395185 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3489/6540] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:09:12 2022] DELETE /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 0 bytes in 1886 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:09:14.404037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fe952492-ba0d-4f7b-b846-a0074c057fda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:14.404730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fe952492-ba0d-4f7b-b846-a0074c057fda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:14.410667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe952492-ba0d-4f7b-b846-a0074c057fda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:14.411150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe952492-ba0d-4f7b-b846-a0074c057fda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:14.411583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe952492-ba0d-4f7b-b846-a0074c057fda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:14.412291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe952492-ba0d-4f7b-b846-a0074c057fda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:14.412743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe952492-ba0d-4f7b-b846-a0074c057fda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:14.413168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe952492-ba0d-4f7b-b846-a0074c057fda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:14.551069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fe952492-ba0d-4f7b-b846-a0074c057fda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:14.558739 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fe952492-ba0d-4f7b-b846-a0074c057fda tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1503 microversion: 2.1 time: 0.158760 Aug 09 18:09:14.559770 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3490/6541] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:14 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:15.362720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-50bfbff0-314c-486c-ba27-16c1a1ee7ed7 req-56a1e704-35d8-4304-a958-2f06843cda2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd0938f-814a-4e96-888e-317c44617ef9", "name": "network-vif-plugged", "status": "completed", "tag": "59e61a45-2d8b-4db7-834a-c4e46538092a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:15.374750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-50bfbff0-314c-486c-ba27-16c1a1ee7ed7 req-56a1e704-35d8-4304-a958-2f06843cda2f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:15.375958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-50bfbff0-314c-486c-ba27-16c1a1ee7ed7 req-56a1e704-35d8-4304-a958-2f06843cda2f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:15.376346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-50bfbff0-314c-486c-ba27-16c1a1ee7ed7 req-56a1e704-35d8-4304-a958-2f06843cda2f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:15.388291 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-50bfbff0-314c-486c-ba27-16c1a1ee7ed7 req-56a1e704-35d8-4304-a958-2f06843cda2f service nova] Creating event network-vif-plugged:59e61a45-2d8b-4db7-834a-c4e46538092a for instance 9bd0938f-814a-4e96-888e-317c44617ef9 on n-h2-845781-6 Aug 09 18:09:15.394087 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-50bfbff0-314c-486c-ba27-16c1a1ee7ed7 req-56a1e704-35d8-4304-a958-2f06843cda2f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034365 Aug 09 18:09:15.394716 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3491/6542] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:09:15.580994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-189f14cd-7f61-45d2-bb36-ff2e2193a654 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:15.581608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-189f14cd-7f61-45d2-bb36-ff2e2193a654 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:15.588481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f14cd-7f61-45d2-bb36-ff2e2193a654 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:15.588962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f14cd-7f61-45d2-bb36-ff2e2193a654 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:15.589397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f14cd-7f61-45d2-bb36-ff2e2193a654 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:15.590084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f14cd-7f61-45d2-bb36-ff2e2193a654 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:15.590537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f14cd-7f61-45d2-bb36-ff2e2193a654 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:15.590962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-189f14cd-7f61-45d2-bb36-ff2e2193a654 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:15.609872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:15.736271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-189f14cd-7f61-45d2-bb36-ff2e2193a654 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9babaf0cddd1422ba2d6190c5b5fd019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47faad24cabc4e79b283ecd9f0cf732a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:15.743961 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-189f14cd-7f61-45d2-bb36-ff2e2193a654 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 200 len: 1503 microversion: 2.1 time: 0.167564 Aug 09 18:09:15.744551 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3492/6543] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:15 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:16.226861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-7586f4fb-691b-43c3-a9c8-ea4effcce646 req-d1f24cb6-4020-47c3-bf33-868043cf1d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd0938f-814a-4e96-888e-317c44617ef9", "name": "network-vif-deleted", "tag": "59e61a45-2d8b-4db7-834a-c4e46538092a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:16.238652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7586f4fb-691b-43c3-a9c8-ea4effcce646 req-d1f24cb6-4020-47c3-bf33-868043cf1d70 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:16.239141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7586f4fb-691b-43c3-a9c8-ea4effcce646 req-d1f24cb6-4020-47c3-bf33-868043cf1d70 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:16.239617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7586f4fb-691b-43c3-a9c8-ea4effcce646 req-d1f24cb6-4020-47c3-bf33-868043cf1d70 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:16.252651 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-7586f4fb-691b-43c3-a9c8-ea4effcce646 req-d1f24cb6-4020-47c3-bf33-868043cf1d70 service nova] Creating event network-vif-deleted:59e61a45-2d8b-4db7-834a-c4e46538092a for instance 9bd0938f-814a-4e96-888e-317c44617ef9 on n-h2-845781-6 Aug 09 18:09:16.259004 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-7586f4fb-691b-43c3-a9c8-ea4effcce646 req-d1f24cb6-4020-47c3-bf33-868043cf1d70 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036416 Aug 09 18:09:16.263275 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3493/6544] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:16.765959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:16.766673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:16.773183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:16.773672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:16.774123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:16.774826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:16.775292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:16.775752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:16.789724 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] HTTP exception thrown: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Request method failure captured: Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 HTTP/1.1 Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qKbkY8wC_nmijKKIqe8KRH8IBgBjH3od5m60YG9k6u6OIDsokpzCzzRbFpqHDFP4LOVV6usVILzyDMlXZKvR4JUep6w6ep-nf5h8sHVftUpf7TeUAavUYWYc6uuyxigfSKL10lEzUSRTHCQ9q3AD7LD9HGbYCxudu55e4kVx5Dfjno Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 47faad24cabc4e79b283ecd9f0cf732a Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-221716978 Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-221716978 Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 47faad24cabc4e79b283ecd9f0cf732a Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-221716978 Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-221716978-project Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9babaf0cddd1422ba2d6190c5b5fd019 Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-221716978-project Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9bd0938f-814a-4e96-888e-317c44617ef9'} Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:16.791382 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.795418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.795418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:16.795418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:16.795418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:09:16.795418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:09:16.795418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.795418 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.795418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Returning 404 to user: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:09:16.795418 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-846253ab-a4f2-4f1b-a863-fc04b114867f tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 404 len: 111 microversion: 2.1 time: 0.031695 Aug 09 18:09:16.795418 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3494/6545] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:16 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:09:16.808969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:16.809487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:16.815341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:16.815903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:16.816339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:16.817016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:16.817468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:16.817893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:16.831384 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] HTTP exception thrown: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Request method failure captured: Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 HTTP/1.1 Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qKbkY8wC_nmijKKIqe8KRH8IBgBjH3od5m60YG9k6u6OIDsokpzCzzRbFpqHDFP4LOVV6usVILzyDMlXZKvR4JUep6w6ep-nf5h8sHVftUpf7TeUAavUYWYc6uuyxigfSKL10lEzUSRTHCQ9q3AD7LD9HGbYCxudu55e4kVx5Dfjno Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 47faad24cabc4e79b283ecd9f0cf732a Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-221716978 Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-221716978 Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 47faad24cabc4e79b283ecd9f0cf732a Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-221716978 Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-221716978-project Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9babaf0cddd1422ba2d6190c5b5fd019 Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-221716978-project Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9bd0938f-814a-4e96-888e-317c44617ef9'} Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:09:16.832982 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Returning 404 to user: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d098460c-a879-4fe7-af65-ac64d9709b81 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 404 len: 111 microversion: 2.1 time: 0.029136 Aug 09 18:09:16.839927 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3495/6546] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:09:16 2022] DELETE /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:09:16.845203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:16.845807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] [instance: 9bd0938f-814a-4e96-888e-317c44617ef9] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:16.851970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:16.852446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:16.852879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:16.853554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:16.854003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:16.854424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:16.868339 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] HTTP exception thrown: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Request method failure captured: Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 HTTP/1.1 Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qKbkY8wC_nmijKKIqe8KRH8IBgBjH3od5m60YG9k6u6OIDsokpzCzzRbFpqHDFP4LOVV6usVILzyDMlXZKvR4JUep6w6ep-nf5h8sHVftUpf7TeUAavUYWYc6uuyxigfSKL10lEzUSRTHCQ9q3AD7LD9HGbYCxudu55e4kVx5Dfjno Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 47faad24cabc4e79b283ecd9f0cf732a Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-DeleteServersTestJSON-221716978 Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/47faad24cabc4e79b283ecd9f0cf732a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-DeleteServersTestJSON-221716978 Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 47faad24cabc4e79b283ecd9f0cf732a Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-DeleteServersTestJSON-221716978 Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-DeleteServersTestJSON-221716978-project Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9babaf0cddd1422ba2d6190c5b5fd019 Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-DeleteServersTestJSON-221716978-project Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '9bd0938f-814a-4e96-888e-317c44617ef9'} Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:09:16.869872 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.873287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:09:16.873287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:09:16.873287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:09:16.873287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:09:16.873287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:09:16.873287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. Aug 09 18:09:16.873287 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:09:16.873287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] Returning 404 to user: Instance 9bd0938f-814a-4e96-888e-317c44617ef9 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:09:16.873287 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-41fefeca-8ce6-4b4b-b5a2-825e762c00f9 tempest-DeleteServersTestJSON-221716978 tempest-DeleteServersTestJSON-221716978-project] 10.222.0.93 "GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9" status: 404 len: 111 microversion: 2.1 time: 0.029510 Aug 09 18:09:16.873287 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3496/6547] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:16 2022] GET /compute/v2.1/servers/9bd0938f-814a-4e96-888e-317c44617ef9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:09:25.612707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-691193262", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ab2289b6-b3a8-41bb-ab58-d5af284afed7"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:25.625661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:25.673335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] validate_networks() for [('ab2289b6-b3a8-41bb-ab58-d5af284afed7', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:09:26.075324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:09:26.075783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:09:26.076264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:09:26.076682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:09:26.077101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:09:26.086731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:26.087223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:26.087706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:26.088466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:26.088924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:26.089356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:26.107517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Getting quotas for project ba29e2102601496da3b00716657eba3e. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:09:26.113196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Getting quotas for user 256bf06bd13a46a58000a88c99a4eb2b and project ba29e2102601496da3b00716657eba3e. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:09:26.125688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:09:26.128005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:09:26.172597 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-25af2df4-c96b-4857-9d96-13e9f6789f29 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703253 Aug 09 18:09:26.173246 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3497/6548] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:09:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:09:26.184150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4666f4a-966e-4474-95d0-eec54090850f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:26.184774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c4666f4a-966e-4474-95d0-eec54090850f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:26.244130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c4666f4a-966e-4474-95d0-eec54090850f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:26.251155 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c4666f4a-966e-4474-95d0-eec54090850f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1217 microversion: 2.1 time: 0.070806 Aug 09 18:09:26.251756 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3498/6549] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:26 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:27.275862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c767ed8a-324d-46d4-ac39-bc733c1f0edd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:27.277381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c767ed8a-324d-46d4-ac39-bc733c1f0edd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:27.297603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c767ed8a-324d-46d4-ac39-bc733c1f0edd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:27.301328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c767ed8a-324d-46d4-ac39-bc733c1f0edd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:27.303746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c767ed8a-324d-46d4-ac39-bc733c1f0edd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:27.304700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c767ed8a-324d-46d4-ac39-bc733c1f0edd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:27.305185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c767ed8a-324d-46d4-ac39-bc733c1f0edd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:27.305624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c767ed8a-324d-46d4-ac39-bc733c1f0edd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:27.380216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c767ed8a-324d-46d4-ac39-bc733c1f0edd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:27.393306 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c767ed8a-324d-46d4-ac39-bc733c1f0edd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1275 microversion: 2.1 time: 0.125470 Aug 09 18:09:27.393921 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3499/6550] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:27 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:28.416288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c74c315-2afe-47e6-bde4-52905660fa4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:28.417292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3c74c315-2afe-47e6-bde4-52905660fa4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:28.424786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c74c315-2afe-47e6-bde4-52905660fa4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:28.425544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c74c315-2afe-47e6-bde4-52905660fa4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:28.425989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c74c315-2afe-47e6-bde4-52905660fa4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:28.426706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c74c315-2afe-47e6-bde4-52905660fa4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:28.427326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c74c315-2afe-47e6-bde4-52905660fa4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:28.427815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c74c315-2afe-47e6-bde4-52905660fa4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:28.580223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3c74c315-2afe-47e6-bde4-52905660fa4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:28.592399 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3c74c315-2afe-47e6-bde4-52905660fa4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1317 microversion: 2.1 time: 0.180286 Aug 09 18:09:28.593401 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3500/6551] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:28 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:28.612244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-bc45dbb0-67e4-4464-b6b1-c3cbf57c0b15 req-036bc6ed-8683-4bf0-b41e-ac9f669225b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da54cb0-fcac-4d52-b44d-4de1c6811adc", "tag": "b008d86f-e165-472d-ba5b-6b61915ece47"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:28.624536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bc45dbb0-67e4-4464-b6b1-c3cbf57c0b15 req-036bc6ed-8683-4bf0-b41e-ac9f669225b3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:28.625271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bc45dbb0-67e4-4464-b6b1-c3cbf57c0b15 req-036bc6ed-8683-4bf0-b41e-ac9f669225b3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:28.625939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-bc45dbb0-67e4-4464-b6b1-c3cbf57c0b15 req-036bc6ed-8683-4bf0-b41e-ac9f669225b3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:28.640141 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-bc45dbb0-67e4-4464-b6b1-c3cbf57c0b15 req-036bc6ed-8683-4bf0-b41e-ac9f669225b3 service nova] Creating event network-changed:b008d86f-e165-472d-ba5b-6b61915ece47 for instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc on n-h2-845781-6 Aug 09 18:09:28.645641 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-bc45dbb0-67e4-4464-b6b1-c3cbf57c0b15 req-036bc6ed-8683-4bf0-b41e-ac9f669225b3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050492 Aug 09 18:09:28.646483 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3501/6552] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:09:29.614952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0c749809-fe5c-458c-b14f-67dd1daaf1b3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:29.617045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0c749809-fe5c-458c-b14f-67dd1daaf1b3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:29.624195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c749809-fe5c-458c-b14f-67dd1daaf1b3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:29.624695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c749809-fe5c-458c-b14f-67dd1daaf1b3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:29.625144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c749809-fe5c-458c-b14f-67dd1daaf1b3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:29.625954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c749809-fe5c-458c-b14f-67dd1daaf1b3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:29.626426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c749809-fe5c-458c-b14f-67dd1daaf1b3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:29.626861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c749809-fe5c-458c-b14f-67dd1daaf1b3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:29.760692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0c749809-fe5c-458c-b14f-67dd1daaf1b3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:29.768442 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0c749809-fe5c-458c-b14f-67dd1daaf1b3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1317 microversion: 2.1 time: 0.158229 Aug 09 18:09:29.769029 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3502/6553] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:29 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:30.789727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a29180d9-24ec-4584-92f9-0b277f2f8954 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:30.790344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a29180d9-24ec-4584-92f9-0b277f2f8954 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:30.797496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a29180d9-24ec-4584-92f9-0b277f2f8954 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:30.798006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a29180d9-24ec-4584-92f9-0b277f2f8954 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:30.798432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a29180d9-24ec-4584-92f9-0b277f2f8954 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:30.799130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a29180d9-24ec-4584-92f9-0b277f2f8954 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:30.799591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a29180d9-24ec-4584-92f9-0b277f2f8954 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:30.800054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a29180d9-24ec-4584-92f9-0b277f2f8954 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:30.930175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a29180d9-24ec-4584-92f9-0b277f2f8954 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:30.937676 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a29180d9-24ec-4584-92f9-0b277f2f8954 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1317 microversion: 2.1 time: 0.152549 Aug 09 18:09:30.938258 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3503/6554] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:30 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:31.958816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-051bac56-543a-42a1-90fa-08abacc0a052 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:31.959441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-051bac56-543a-42a1-90fa-08abacc0a052 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:31.966312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051bac56-543a-42a1-90fa-08abacc0a052 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:31.966775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051bac56-543a-42a1-90fa-08abacc0a052 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:31.967444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051bac56-543a-42a1-90fa-08abacc0a052 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:31.968721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051bac56-543a-42a1-90fa-08abacc0a052 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:31.968721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051bac56-543a-42a1-90fa-08abacc0a052 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:31.968892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-051bac56-543a-42a1-90fa-08abacc0a052 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:32.103993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-051bac56-543a-42a1-90fa-08abacc0a052 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:32.111498 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-051bac56-543a-42a1-90fa-08abacc0a052 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1317 microversion: 2.1 time: 0.156893 Aug 09 18:09:32.112109 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3504/6555] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:31 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:33.132548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-425e5a54-2126-48f8-82eb-d8260d852343 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:33.133215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-425e5a54-2126-48f8-82eb-d8260d852343 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:33.141212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425e5a54-2126-48f8-82eb-d8260d852343 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:33.141709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425e5a54-2126-48f8-82eb-d8260d852343 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:33.142158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425e5a54-2126-48f8-82eb-d8260d852343 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:33.142862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425e5a54-2126-48f8-82eb-d8260d852343 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:33.143427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425e5a54-2126-48f8-82eb-d8260d852343 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:33.143978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425e5a54-2126-48f8-82eb-d8260d852343 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:33.278916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-425e5a54-2126-48f8-82eb-d8260d852343 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:33.286857 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-425e5a54-2126-48f8-82eb-d8260d852343 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1317 microversion: 2.1 time: 0.158318 Aug 09 18:09:33.287514 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3505/6556] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:33 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:33.400444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3dd3acab-1a22-4c5f-91d6-5ae86d2d1428 req-73074980-faa6-4507-b913-9af4f4c597fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da54cb0-fcac-4d52-b44d-4de1c6811adc", "name": "network-vif-plugged", "status": "completed", "tag": "b008d86f-e165-472d-ba5b-6b61915ece47"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:33.411246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3dd3acab-1a22-4c5f-91d6-5ae86d2d1428 req-73074980-faa6-4507-b913-9af4f4c597fa service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:33.411774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3dd3acab-1a22-4c5f-91d6-5ae86d2d1428 req-73074980-faa6-4507-b913-9af4f4c597fa service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:33.412320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3dd3acab-1a22-4c5f-91d6-5ae86d2d1428 req-73074980-faa6-4507-b913-9af4f4c597fa service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:33.424252 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3dd3acab-1a22-4c5f-91d6-5ae86d2d1428 req-73074980-faa6-4507-b913-9af4f4c597fa service nova] Creating event network-vif-plugged:b008d86f-e165-472d-ba5b-6b61915ece47 for instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc on n-h2-845781-6 Aug 09 18:09:33.430160 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3dd3acab-1a22-4c5f-91d6-5ae86d2d1428 req-73074980-faa6-4507-b913-9af4f4c597fa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033999 Aug 09 18:09:33.430783 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3506/6557] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:09:34.309166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3601d34-d9e0-4c46-bfbb-adb3e46ceffa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:34.309871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b3601d34-d9e0-4c46-bfbb-adb3e46ceffa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:34.317142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3601d34-d9e0-4c46-bfbb-adb3e46ceffa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:34.317447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3601d34-d9e0-4c46-bfbb-adb3e46ceffa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:34.317893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3601d34-d9e0-4c46-bfbb-adb3e46ceffa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:34.318595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3601d34-d9e0-4c46-bfbb-adb3e46ceffa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:34.319054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3601d34-d9e0-4c46-bfbb-adb3e46ceffa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:34.319511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b3601d34-d9e0-4c46-bfbb-adb3e46ceffa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:34.453226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b3601d34-d9e0-4c46-bfbb-adb3e46ceffa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:34.461697 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b3601d34-d9e0-4c46-bfbb-adb3e46ceffa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1317 microversion: 2.1 time: 0.156757 Aug 09 18:09:34.462278 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3507/6558] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:34 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:35.481313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0de6560a-1f01-44e7-8c2a-fc533fe7dff5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:35.481914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0de6560a-1f01-44e7-8c2a-fc533fe7dff5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:35.488768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0de6560a-1f01-44e7-8c2a-fc533fe7dff5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:35.489486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0de6560a-1f01-44e7-8c2a-fc533fe7dff5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:35.489931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0de6560a-1f01-44e7-8c2a-fc533fe7dff5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:35.490631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0de6560a-1f01-44e7-8c2a-fc533fe7dff5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:35.491079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0de6560a-1f01-44e7-8c2a-fc533fe7dff5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:35.491510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0de6560a-1f01-44e7-8c2a-fc533fe7dff5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:35.625085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0de6560a-1f01-44e7-8c2a-fc533fe7dff5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:35.633138 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0de6560a-1f01-44e7-8c2a-fc533fe7dff5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1508 microversion: 2.1 time: 0.155828 Aug 09 18:09:35.633719 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3508/6559] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:35 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:35.653405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51101133-6c1a-4ec6-af82-dcf0999b3443 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:35.653506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-51101133-6c1a-4ec6-af82-dcf0999b3443 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:35.659974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51101133-6c1a-4ec6-af82-dcf0999b3443 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:35.660457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51101133-6c1a-4ec6-af82-dcf0999b3443 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:35.660897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51101133-6c1a-4ec6-af82-dcf0999b3443 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:35.661593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51101133-6c1a-4ec6-af82-dcf0999b3443 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:35.662048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51101133-6c1a-4ec6-af82-dcf0999b3443 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:35.662480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51101133-6c1a-4ec6-af82-dcf0999b3443 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:35.795309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-51101133-6c1a-4ec6-af82-dcf0999b3443 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:35.803128 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51101133-6c1a-4ec6-af82-dcf0999b3443 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1508 microversion: 2.1 time: 0.153934 Aug 09 18:09:35.804330 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3509/6560] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:35 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:35.825598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6773a508-393f-45fb-8128-2eac94013580 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:35.828073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6773a508-393f-45fb-8128-2eac94013580 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:35.834162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6773a508-393f-45fb-8128-2eac94013580 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:35.834644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6773a508-393f-45fb-8128-2eac94013580 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:35.835601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6773a508-393f-45fb-8128-2eac94013580 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:35.836373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6773a508-393f-45fb-8128-2eac94013580 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:35.836820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6773a508-393f-45fb-8128-2eac94013580 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:35.837246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6773a508-393f-45fb-8128-2eac94013580 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:35.906153 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6773a508-393f-45fb-8128-2eac94013580 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "PUT /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1080 microversion: 2.1 time: 0.084220 Aug 09 18:09:35.906804 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3510/6561] 10.222.0.93 () {60 vars in 1256 bytes} [Tue Aug 9 18:09:35 2022] PUT /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1080 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:35.924544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0224eec3-97a8-4237-9a34-3e836098094d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:35.925159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0224eec3-97a8-4237-9a34-3e836098094d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:35.931221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0224eec3-97a8-4237-9a34-3e836098094d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:35.931750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0224eec3-97a8-4237-9a34-3e836098094d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:35.932191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0224eec3-97a8-4237-9a34-3e836098094d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:35.932914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0224eec3-97a8-4237-9a34-3e836098094d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:35.933370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0224eec3-97a8-4237-9a34-3e836098094d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:35.933794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0224eec3-97a8-4237-9a34-3e836098094d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:36.067362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0224eec3-97a8-4237-9a34-3e836098094d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:36.074944 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0224eec3-97a8-4237-9a34-3e836098094d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1506 microversion: 2.1 time: 0.154661 Aug 09 18:09:36.075527 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3511/6562] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:35 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:36.095254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-13110551-a0da-470e-9c17-75955be0ac34 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:36.095901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-13110551-a0da-470e-9c17-75955be0ac34 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:36.097772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:36.104088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13110551-a0da-470e-9c17-75955be0ac34 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:36.104588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13110551-a0da-470e-9c17-75955be0ac34 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:36.105029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13110551-a0da-470e-9c17-75955be0ac34 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:36.105735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13110551-a0da-470e-9c17-75955be0ac34 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:36.106203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13110551-a0da-470e-9c17-75955be0ac34 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:36.106631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-13110551-a0da-470e-9c17-75955be0ac34 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:36.236712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-13110551-a0da-470e-9c17-75955be0ac34 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:36.244413 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-13110551-a0da-470e-9c17-75955be0ac34 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1506 microversion: 2.1 time: 0.152822 Aug 09 18:09:36.245018 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3512/6563] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:36 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:36.266725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:09:36.269091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:36.270936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:36.278364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:36.278867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:36.279307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:36.280035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:36.280496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:36.280925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:36.310691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:36.316712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Old instance type m1.heat2, new instance type m1.heat {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 18:09:36.323872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:09:36.324298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:09:36.324782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:09:36.325193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:09:36.325617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:09:36.341316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:36.388449 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f2c1e9f-8d60-43e2-9e0a-a4dd4fc076e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "POST /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc/action" status: 202 len: 0 microversion: 2.1 time: 0.125553 Aug 09 18:09:36.389074 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3513/6564] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:09:36 2022] POST /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:09:36.397036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efacdddd-5f41-4d66-93d9-421b056313c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:36.398227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-efacdddd-5f41-4d66-93d9-421b056313c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:36.404745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacdddd-5f41-4d66-93d9-421b056313c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:36.405237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacdddd-5f41-4d66-93d9-421b056313c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:36.405683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacdddd-5f41-4d66-93d9-421b056313c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:36.406476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacdddd-5f41-4d66-93d9-421b056313c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:36.406937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacdddd-5f41-4d66-93d9-421b056313c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:36.407370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efacdddd-5f41-4d66-93d9-421b056313c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:36.552228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-efacdddd-5f41-4d66-93d9-421b056313c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:36.560736 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-efacdddd-5f41-4d66-93d9-421b056313c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1517 microversion: 2.1 time: 0.167036 Aug 09 18:09:36.560930 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3514/6565] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:36 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:37.581458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e50eb6c2-36e1-4dfb-a783-225b26a44313 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:37.582243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e50eb6c2-36e1-4dfb-a783-225b26a44313 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:37.589766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e50eb6c2-36e1-4dfb-a783-225b26a44313 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:37.590263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e50eb6c2-36e1-4dfb-a783-225b26a44313 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:37.590705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e50eb6c2-36e1-4dfb-a783-225b26a44313 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:37.591407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e50eb6c2-36e1-4dfb-a783-225b26a44313 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:37.592004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e50eb6c2-36e1-4dfb-a783-225b26a44313 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:37.592451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e50eb6c2-36e1-4dfb-a783-225b26a44313 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:37.734234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e50eb6c2-36e1-4dfb-a783-225b26a44313 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:37.742344 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e50eb6c2-36e1-4dfb-a783-225b26a44313 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1517 microversion: 2.1 time: 0.164979 Aug 09 18:09:37.743022 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3515/6566] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:37 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:38.763203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f22eaedc-9e07-4468-a73a-8ad25e05ed42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:38.763885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f22eaedc-9e07-4468-a73a-8ad25e05ed42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:38.770700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f22eaedc-9e07-4468-a73a-8ad25e05ed42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:38.771180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f22eaedc-9e07-4468-a73a-8ad25e05ed42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:38.771612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f22eaedc-9e07-4468-a73a-8ad25e05ed42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:38.772328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f22eaedc-9e07-4468-a73a-8ad25e05ed42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:38.772777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f22eaedc-9e07-4468-a73a-8ad25e05ed42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:38.773201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f22eaedc-9e07-4468-a73a-8ad25e05ed42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:38.915328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f22eaedc-9e07-4468-a73a-8ad25e05ed42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:38.922992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f22eaedc-9e07-4468-a73a-8ad25e05ed42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.163720 Aug 09 18:09:38.923601 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3516/6567] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:38 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:39.944499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c91f856d-aa7c-4bd2-9240-3a3b2122805f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:39.945131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c91f856d-aa7c-4bd2-9240-3a3b2122805f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:39.952254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c91f856d-aa7c-4bd2-9240-3a3b2122805f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:39.952758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c91f856d-aa7c-4bd2-9240-3a3b2122805f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:39.953214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c91f856d-aa7c-4bd2-9240-3a3b2122805f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:39.953923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c91f856d-aa7c-4bd2-9240-3a3b2122805f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:39.954383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c91f856d-aa7c-4bd2-9240-3a3b2122805f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:39.955072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c91f856d-aa7c-4bd2-9240-3a3b2122805f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:40.094686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c91f856d-aa7c-4bd2-9240-3a3b2122805f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:40.102867 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c91f856d-aa7c-4bd2-9240-3a3b2122805f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.162544 Aug 09 18:09:40.103686 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3517/6568] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:39 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:41.123666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6bcf8be9-c3ea-4de1-a07a-8896aa298b1f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:41.124329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6bcf8be9-c3ea-4de1-a07a-8896aa298b1f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:41.131205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bcf8be9-c3ea-4de1-a07a-8896aa298b1f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:41.132387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bcf8be9-c3ea-4de1-a07a-8896aa298b1f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:41.132827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bcf8be9-c3ea-4de1-a07a-8896aa298b1f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:41.133523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bcf8be9-c3ea-4de1-a07a-8896aa298b1f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:41.133975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bcf8be9-c3ea-4de1-a07a-8896aa298b1f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:41.134401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bcf8be9-c3ea-4de1-a07a-8896aa298b1f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:41.265717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6bcf8be9-c3ea-4de1-a07a-8896aa298b1f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:41.273404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6bcf8be9-c3ea-4de1-a07a-8896aa298b1f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.153646 Aug 09 18:09:41.273991 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3518/6569] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:41 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:42.294757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06e54184-7cf9-4629-80b0-62de0471fd56 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:42.295459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-06e54184-7cf9-4629-80b0-62de0471fd56 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:42.302330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e54184-7cf9-4629-80b0-62de0471fd56 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:42.302820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e54184-7cf9-4629-80b0-62de0471fd56 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:42.303268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e54184-7cf9-4629-80b0-62de0471fd56 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:42.304005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e54184-7cf9-4629-80b0-62de0471fd56 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:42.304467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e54184-7cf9-4629-80b0-62de0471fd56 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:42.305539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e54184-7cf9-4629-80b0-62de0471fd56 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:42.443088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-06e54184-7cf9-4629-80b0-62de0471fd56 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:42.450883 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-06e54184-7cf9-4629-80b0-62de0471fd56 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.160065 Aug 09 18:09:42.451457 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3519/6570] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:42 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:43.472803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38b040e4-768c-4b12-8219-ec4506b23c59 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:43.473512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-38b040e4-768c-4b12-8219-ec4506b23c59 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:43.480801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38b040e4-768c-4b12-8219-ec4506b23c59 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:43.481298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38b040e4-768c-4b12-8219-ec4506b23c59 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:43.481742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38b040e4-768c-4b12-8219-ec4506b23c59 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:43.482455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38b040e4-768c-4b12-8219-ec4506b23c59 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:43.482911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38b040e4-768c-4b12-8219-ec4506b23c59 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:43.483342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38b040e4-768c-4b12-8219-ec4506b23c59 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:43.629155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-38b040e4-768c-4b12-8219-ec4506b23c59 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:43.638029 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-38b040e4-768c-4b12-8219-ec4506b23c59 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.169424 Aug 09 18:09:43.638635 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3520/6571] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:43 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:44.659413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f1d48c1-5f62-448c-8896-776c2da4e5eb tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:44.660153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5f1d48c1-5f62-448c-8896-776c2da4e5eb tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:44.667020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f1d48c1-5f62-448c-8896-776c2da4e5eb tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:44.667506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f1d48c1-5f62-448c-8896-776c2da4e5eb tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:44.667977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f1d48c1-5f62-448c-8896-776c2da4e5eb tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:44.668680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f1d48c1-5f62-448c-8896-776c2da4e5eb tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:44.669248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f1d48c1-5f62-448c-8896-776c2da4e5eb tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:44.669682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f1d48c1-5f62-448c-8896-776c2da4e5eb tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:44.807184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f1d48c1-5f62-448c-8896-776c2da4e5eb tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:44.815092 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f1d48c1-5f62-448c-8896-776c2da4e5eb tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.159779 Aug 09 18:09:44.815709 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3521/6572] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:44 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:45.836823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-02a8a281-5cf8-4005-aa67-86bc0b511e80 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:45.837464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-02a8a281-5cf8-4005-aa67-86bc0b511e80 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:45.844455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02a8a281-5cf8-4005-aa67-86bc0b511e80 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:45.844940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02a8a281-5cf8-4005-aa67-86bc0b511e80 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:45.845380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02a8a281-5cf8-4005-aa67-86bc0b511e80 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:45.846113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02a8a281-5cf8-4005-aa67-86bc0b511e80 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:45.846573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02a8a281-5cf8-4005-aa67-86bc0b511e80 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:45.847003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02a8a281-5cf8-4005-aa67-86bc0b511e80 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:45.996036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-02a8a281-5cf8-4005-aa67-86bc0b511e80 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:46.004512 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-02a8a281-5cf8-4005-aa67-86bc0b511e80 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.171567 Aug 09 18:09:46.005277 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3522/6573] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:45 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:47.027187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6cd18b8f-1f54-4153-9c43-9f35f64c330f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:47.027854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6cd18b8f-1f54-4153-9c43-9f35f64c330f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:47.035020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd18b8f-1f54-4153-9c43-9f35f64c330f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:47.035545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd18b8f-1f54-4153-9c43-9f35f64c330f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:47.036022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd18b8f-1f54-4153-9c43-9f35f64c330f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:47.036730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd18b8f-1f54-4153-9c43-9f35f64c330f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:47.037189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd18b8f-1f54-4153-9c43-9f35f64c330f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:47.037626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cd18b8f-1f54-4153-9c43-9f35f64c330f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:47.174478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6cd18b8f-1f54-4153-9c43-9f35f64c330f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:47.182443 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6cd18b8f-1f54-4153-9c43-9f35f64c330f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.159833 Aug 09 18:09:47.183165 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3523/6574] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:47 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:09:48.206336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8da2facd-abab-4f82-8216-ac88fdfbd655 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:48.207024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8da2facd-abab-4f82-8216-ac88fdfbd655 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:48.216643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8da2facd-abab-4f82-8216-ac88fdfbd655 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:48.217485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8da2facd-abab-4f82-8216-ac88fdfbd655 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:48.218221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8da2facd-abab-4f82-8216-ac88fdfbd655 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:48.219171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8da2facd-abab-4f82-8216-ac88fdfbd655 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:48.219788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8da2facd-abab-4f82-8216-ac88fdfbd655 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:48.220561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8da2facd-abab-4f82-8216-ac88fdfbd655 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:48.394407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8da2facd-abab-4f82-8216-ac88fdfbd655 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:48.403241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8da2facd-abab-4f82-8216-ac88fdfbd655 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.202654 Aug 09 18:09:48.403881 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3524/6575] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:48 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:49.424657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4dd293dd-c636-49e5-9ed7-c170efbc5536 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:49.425307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4dd293dd-c636-49e5-9ed7-c170efbc5536 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:49.433006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd293dd-c636-49e5-9ed7-c170efbc5536 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:49.433507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd293dd-c636-49e5-9ed7-c170efbc5536 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:49.434341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd293dd-c636-49e5-9ed7-c170efbc5536 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:49.435652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd293dd-c636-49e5-9ed7-c170efbc5536 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:49.436474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd293dd-c636-49e5-9ed7-c170efbc5536 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:49.437262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4dd293dd-c636-49e5-9ed7-c170efbc5536 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:49.620076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4dd293dd-c636-49e5-9ed7-c170efbc5536 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:49.628245 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4dd293dd-c636-49e5-9ed7-c170efbc5536 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.207569 Aug 09 18:09:49.628861 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3525/6576] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:49 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:50.650739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-61499107-2196-4c53-b1e5-65e6b2e4e983 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:50.651423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61499107-2196-4c53-b1e5-65e6b2e4e983 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:50.658336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61499107-2196-4c53-b1e5-65e6b2e4e983 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:50.658824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61499107-2196-4c53-b1e5-65e6b2e4e983 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:50.659263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61499107-2196-4c53-b1e5-65e6b2e4e983 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:50.660009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61499107-2196-4c53-b1e5-65e6b2e4e983 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:50.660464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61499107-2196-4c53-b1e5-65e6b2e4e983 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:50.660894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61499107-2196-4c53-b1e5-65e6b2e4e983 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:50.801232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-61499107-2196-4c53-b1e5-65e6b2e4e983 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:50.809378 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-61499107-2196-4c53-b1e5-65e6b2e4e983 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.163212 Aug 09 18:09:50.809966 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3526/6577] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:50 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:51.831009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8528bb56-8b2c-4e9f-a505-1b52ee86431c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:51.831747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8528bb56-8b2c-4e9f-a505-1b52ee86431c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:51.839166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8528bb56-8b2c-4e9f-a505-1b52ee86431c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:51.839685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8528bb56-8b2c-4e9f-a505-1b52ee86431c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:51.840132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8528bb56-8b2c-4e9f-a505-1b52ee86431c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:51.840843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8528bb56-8b2c-4e9f-a505-1b52ee86431c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:51.841298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8528bb56-8b2c-4e9f-a505-1b52ee86431c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:51.841729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8528bb56-8b2c-4e9f-a505-1b52ee86431c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:51.987659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8528bb56-8b2c-4e9f-a505-1b52ee86431c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:51.995679 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8528bb56-8b2c-4e9f-a505-1b52ee86431c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.168876 Aug 09 18:09:51.996396 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3527/6578] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:51 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:53.018986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-76a778b7-d3fe-4ce0-a6fe-fb4e9e38cbc6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:53.019758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-76a778b7-d3fe-4ce0-a6fe-fb4e9e38cbc6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:53.027170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76a778b7-d3fe-4ce0-a6fe-fb4e9e38cbc6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:53.027695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76a778b7-d3fe-4ce0-a6fe-fb4e9e38cbc6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:53.028144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76a778b7-d3fe-4ce0-a6fe-fb4e9e38cbc6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:53.028875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76a778b7-d3fe-4ce0-a6fe-fb4e9e38cbc6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:53.029332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76a778b7-d3fe-4ce0-a6fe-fb4e9e38cbc6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:53.029765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76a778b7-d3fe-4ce0-a6fe-fb4e9e38cbc6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:53.168756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-76a778b7-d3fe-4ce0-a6fe-fb4e9e38cbc6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:53.176562 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-76a778b7-d3fe-4ce0-a6fe-fb4e9e38cbc6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.161859 Aug 09 18:09:53.177152 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3528/6579] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:53 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:54.197698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-96ddecb7-84cd-4c28-83d7-0f1920f79de3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:54.198342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-96ddecb7-84cd-4c28-83d7-0f1920f79de3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:54.206102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96ddecb7-84cd-4c28-83d7-0f1920f79de3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:54.206601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96ddecb7-84cd-4c28-83d7-0f1920f79de3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:54.207049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96ddecb7-84cd-4c28-83d7-0f1920f79de3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:54.207811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96ddecb7-84cd-4c28-83d7-0f1920f79de3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:54.208274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96ddecb7-84cd-4c28-83d7-0f1920f79de3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:54.208714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96ddecb7-84cd-4c28-83d7-0f1920f79de3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:54.229529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:54.362379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-96ddecb7-84cd-4c28-83d7-0f1920f79de3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:54.370260 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-96ddecb7-84cd-4c28-83d7-0f1920f79de3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.176651 Aug 09 18:09:54.370843 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3529/6580] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:54 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:55.392215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-80787672-e6cf-4bfc-aa3f-2aa19039103b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:55.392860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-80787672-e6cf-4bfc-aa3f-2aa19039103b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:55.399658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80787672-e6cf-4bfc-aa3f-2aa19039103b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:55.400148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80787672-e6cf-4bfc-aa3f-2aa19039103b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:55.400585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80787672-e6cf-4bfc-aa3f-2aa19039103b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:55.401280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80787672-e6cf-4bfc-aa3f-2aa19039103b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:55.401729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80787672-e6cf-4bfc-aa3f-2aa19039103b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:55.402155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-80787672-e6cf-4bfc-aa3f-2aa19039103b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:55.535957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-80787672-e6cf-4bfc-aa3f-2aa19039103b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:55.544573 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-80787672-e6cf-4bfc-aa3f-2aa19039103b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.156383 Aug 09 18:09:55.545167 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3530/6581] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:55 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:56.565392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3344990e-f1b6-417a-8792-a90982c3b28a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:56.566098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3344990e-f1b6-417a-8792-a90982c3b28a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:56.568710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:09:56.574534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3344990e-f1b6-417a-8792-a90982c3b28a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:56.575019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3344990e-f1b6-417a-8792-a90982c3b28a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:56.575449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3344990e-f1b6-417a-8792-a90982c3b28a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:56.576177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3344990e-f1b6-417a-8792-a90982c3b28a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:56.576630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3344990e-f1b6-417a-8792-a90982c3b28a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:56.577055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3344990e-f1b6-417a-8792-a90982c3b28a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:56.719391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3344990e-f1b6-417a-8792-a90982c3b28a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:56.727036 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3344990e-f1b6-417a-8792-a90982c3b28a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.165570 Aug 09 18:09:56.727651 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3531/6582] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:56 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:57.748390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-84238234-4e1e-40e5-935b-5d070985f242 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:57.749064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-84238234-4e1e-40e5-935b-5d070985f242 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:57.756471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84238234-4e1e-40e5-935b-5d070985f242 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:57.756966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84238234-4e1e-40e5-935b-5d070985f242 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:57.757965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84238234-4e1e-40e5-935b-5d070985f242 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:57.758695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84238234-4e1e-40e5-935b-5d070985f242 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:57.759155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84238234-4e1e-40e5-935b-5d070985f242 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:57.759588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84238234-4e1e-40e5-935b-5d070985f242 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:57.892875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-84238234-4e1e-40e5-935b-5d070985f242 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:57.900567 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-84238234-4e1e-40e5-935b-5d070985f242 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.156158 Aug 09 18:09:57.901147 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3532/6583] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:57 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:09:58.921406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b8157d86-63ba-41a4-88e9-c597bb694038 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:09:58.922066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b8157d86-63ba-41a4-88e9-c597bb694038 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:09:58.928984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8157d86-63ba-41a4-88e9-c597bb694038 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:58.929476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8157d86-63ba-41a4-88e9-c597bb694038 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:58.929925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8157d86-63ba-41a4-88e9-c597bb694038 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:58.930632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8157d86-63ba-41a4-88e9-c597bb694038 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:09:58.931091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8157d86-63ba-41a4-88e9-c597bb694038 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:09:58.931529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8157d86-63ba-41a4-88e9-c597bb694038 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:09:59.065786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b8157d86-63ba-41a4-88e9-c597bb694038 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:09:59.074253 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b8157d86-63ba-41a4-88e9-c597bb694038 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.156754 Aug 09 18:09:59.074848 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3533/6584] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:09:58 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:00.094776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b00fec9c-4b90-41b5-9354-b804cfaf9946 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:00.095416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b00fec9c-4b90-41b5-9354-b804cfaf9946 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:00.102353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b00fec9c-4b90-41b5-9354-b804cfaf9946 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:00.102851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b00fec9c-4b90-41b5-9354-b804cfaf9946 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:00.103307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b00fec9c-4b90-41b5-9354-b804cfaf9946 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:00.104084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b00fec9c-4b90-41b5-9354-b804cfaf9946 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:00.104548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b00fec9c-4b90-41b5-9354-b804cfaf9946 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:00.104978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b00fec9c-4b90-41b5-9354-b804cfaf9946 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:00.244998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b00fec9c-4b90-41b5-9354-b804cfaf9946 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:00.253365 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b00fec9c-4b90-41b5-9354-b804cfaf9946 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.162591 Aug 09 18:10:00.253990 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3534/6585] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:00 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:01.276204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-922670d5-4b78-49f7-8b6c-83c40b6eb512 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:01.276909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-922670d5-4b78-49f7-8b6c-83c40b6eb512 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:01.284444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-922670d5-4b78-49f7-8b6c-83c40b6eb512 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:01.284945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-922670d5-4b78-49f7-8b6c-83c40b6eb512 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:01.285392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-922670d5-4b78-49f7-8b6c-83c40b6eb512 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:01.286112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-922670d5-4b78-49f7-8b6c-83c40b6eb512 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:01.286576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-922670d5-4b78-49f7-8b6c-83c40b6eb512 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:01.287014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-922670d5-4b78-49f7-8b6c-83c40b6eb512 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:01.421973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-922670d5-4b78-49f7-8b6c-83c40b6eb512 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:01.429788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-922670d5-4b78-49f7-8b6c-83c40b6eb512 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.158350 Aug 09 18:10:01.430370 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3535/6586] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:01 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:02.450727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5853cacc-edcb-4b46-bcc8-c484554d92e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:02.451513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5853cacc-edcb-4b46-bcc8-c484554d92e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:02.459391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5853cacc-edcb-4b46-bcc8-c484554d92e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:02.459918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5853cacc-edcb-4b46-bcc8-c484554d92e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:02.460369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5853cacc-edcb-4b46-bcc8-c484554d92e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:02.461108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5853cacc-edcb-4b46-bcc8-c484554d92e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:02.461566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5853cacc-edcb-4b46-bcc8-c484554d92e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:02.461999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5853cacc-edcb-4b46-bcc8-c484554d92e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:02.596977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5853cacc-edcb-4b46-bcc8-c484554d92e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:02.605096 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5853cacc-edcb-4b46-bcc8-c484554d92e5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.158442 Aug 09 18:10:02.605673 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3536/6587] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:02 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:03.626740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd5b1492-a0ea-4d44-8dfd-b4c006f150b7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:03.627439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd5b1492-a0ea-4d44-8dfd-b4c006f150b7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:03.635125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5b1492-a0ea-4d44-8dfd-b4c006f150b7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:03.635747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5b1492-a0ea-4d44-8dfd-b4c006f150b7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:03.636198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5b1492-a0ea-4d44-8dfd-b4c006f150b7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:03.637067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5b1492-a0ea-4d44-8dfd-b4c006f150b7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:03.637694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5b1492-a0ea-4d44-8dfd-b4c006f150b7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:03.638136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5b1492-a0ea-4d44-8dfd-b4c006f150b7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:03.778453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd5b1492-a0ea-4d44-8dfd-b4c006f150b7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:03.786299 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd5b1492-a0ea-4d44-8dfd-b4c006f150b7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.163423 Aug 09 18:10:03.786887 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3537/6588] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:03 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:04.809921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b121f47a-91d9-4840-ad67-b4310eaa7d83 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:04.810581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b121f47a-91d9-4840-ad67-b4310eaa7d83 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:04.817557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121f47a-91d9-4840-ad67-b4310eaa7d83 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:04.818049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121f47a-91d9-4840-ad67-b4310eaa7d83 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:04.818492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121f47a-91d9-4840-ad67-b4310eaa7d83 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:04.819200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121f47a-91d9-4840-ad67-b4310eaa7d83 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:04.819694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121f47a-91d9-4840-ad67-b4310eaa7d83 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:04.820128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b121f47a-91d9-4840-ad67-b4310eaa7d83 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:04.960705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b121f47a-91d9-4840-ad67-b4310eaa7d83 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:04.968755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b121f47a-91d9-4840-ad67-b4310eaa7d83 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1522 microversion: 2.1 time: 0.162688 Aug 09 18:10:04.969405 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3538/6589] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:04 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:05.589394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3e7e21ed-30c0-4414-b4c3-4ea7e0985af4 req-b3c601d6-601f-4366-8ea3-1654833bf0fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da54cb0-fcac-4d52-b44d-4de1c6811adc", "name": "network-vif-unplugged", "status": "completed", "tag": "b008d86f-e165-472d-ba5b-6b61915ece47"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:05.602744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3e7e21ed-30c0-4414-b4c3-4ea7e0985af4 req-b3c601d6-601f-4366-8ea3-1654833bf0fc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:05.603248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3e7e21ed-30c0-4414-b4c3-4ea7e0985af4 req-b3c601d6-601f-4366-8ea3-1654833bf0fc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:05.603874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3e7e21ed-30c0-4414-b4c3-4ea7e0985af4 req-b3c601d6-601f-4366-8ea3-1654833bf0fc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:05.616271 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3e7e21ed-30c0-4414-b4c3-4ea7e0985af4 req-b3c601d6-601f-4366-8ea3-1654833bf0fc service nova] Creating event network-vif-unplugged:b008d86f-e165-472d-ba5b-6b61915ece47 for instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc on n-h1-845781-6 Aug 09 18:10:05.622484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-3e7e21ed-30c0-4414-b4c3-4ea7e0985af4 req-b3c601d6-601f-4366-8ea3-1654833bf0fc service nova] Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:10:05.634607 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3e7e21ed-30c0-4414-b4c3-4ea7e0985af4 req-b3c601d6-601f-4366-8ea3-1654833bf0fc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050419 Aug 09 18:10:05.635218 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3539/6590] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:10:05.989474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bff3baed-9b63-4b23-b4d2-ea2dbb8310fa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:05.990299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bff3baed-9b63-4b23-b4d2-ea2dbb8310fa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:05.998647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bff3baed-9b63-4b23-b4d2-ea2dbb8310fa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:05.999143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bff3baed-9b63-4b23-b4d2-ea2dbb8310fa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:05.999584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bff3baed-9b63-4b23-b4d2-ea2dbb8310fa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:06.000326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bff3baed-9b63-4b23-b4d2-ea2dbb8310fa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:06.000785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bff3baed-9b63-4b23-b4d2-ea2dbb8310fa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:06.001208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bff3baed-9b63-4b23-b4d2-ea2dbb8310fa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:06.242812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bff3baed-9b63-4b23-b4d2-ea2dbb8310fa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:06.250515 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bff3baed-9b63-4b23-b4d2-ea2dbb8310fa tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1521 microversion: 2.1 time: 0.265323 Aug 09 18:10:06.251089 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3540/6591] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:05 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:07.272461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fc09be97-931a-436b-8d3e-e067f0f9ec70 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:07.273798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fc09be97-931a-436b-8d3e-e067f0f9ec70 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:07.281083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc09be97-931a-436b-8d3e-e067f0f9ec70 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:07.281591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc09be97-931a-436b-8d3e-e067f0f9ec70 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:07.282028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc09be97-931a-436b-8d3e-e067f0f9ec70 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:07.282738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc09be97-931a-436b-8d3e-e067f0f9ec70 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:07.283192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc09be97-931a-436b-8d3e-e067f0f9ec70 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:07.283620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fc09be97-931a-436b-8d3e-e067f0f9ec70 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:07.444244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fc09be97-931a-436b-8d3e-e067f0f9ec70 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:07.453339 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fc09be97-931a-436b-8d3e-e067f0f9ec70 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1519 microversion: 2.1 time: 0.184749 Aug 09 18:10:07.453939 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3541/6592] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:07 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:07.660591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-555d5ed9-2b5d-45b9-b509-cd3a34a0425d req-df358e41-377c-436f-a045-04b69c060f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da54cb0-fcac-4d52-b44d-4de1c6811adc", "tag": "b008d86f-e165-472d-ba5b-6b61915ece47"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:07.670525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-555d5ed9-2b5d-45b9-b509-cd3a34a0425d req-df358e41-377c-436f-a045-04b69c060f6f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:07.671008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-555d5ed9-2b5d-45b9-b509-cd3a34a0425d req-df358e41-377c-436f-a045-04b69c060f6f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:07.671442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-555d5ed9-2b5d-45b9-b509-cd3a34a0425d req-df358e41-377c-436f-a045-04b69c060f6f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:07.684661 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-555d5ed9-2b5d-45b9-b509-cd3a34a0425d req-df358e41-377c-436f-a045-04b69c060f6f service nova] Creating event network-changed:b008d86f-e165-472d-ba5b-6b61915ece47 for instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc on n-h1-845781-6 Aug 09 18:10:07.690653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-555d5ed9-2b5d-45b9-b509-cd3a34a0425d req-df358e41-377c-436f-a045-04b69c060f6f service nova] Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:10:07.701867 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-555d5ed9-2b5d-45b9-b509-cd3a34a0425d req-df358e41-377c-436f-a045-04b69c060f6f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044953 Aug 09 18:10:07.702573 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3542/6593] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:10:08.476277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-35c46e84-b0ed-4c92-9a5c-c5debbbe6359 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:08.476971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-35c46e84-b0ed-4c92-9a5c-c5debbbe6359 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:08.483304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c46e84-b0ed-4c92-9a5c-c5debbbe6359 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:08.483838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c46e84-b0ed-4c92-9a5c-c5debbbe6359 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:08.484302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c46e84-b0ed-4c92-9a5c-c5debbbe6359 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:08.484995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c46e84-b0ed-4c92-9a5c-c5debbbe6359 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:08.485578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c46e84-b0ed-4c92-9a5c-c5debbbe6359 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:08.486010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c46e84-b0ed-4c92-9a5c-c5debbbe6359 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:08.628869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-35c46e84-b0ed-4c92-9a5c-c5debbbe6359 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:08.637632 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-35c46e84-b0ed-4c92-9a5c-c5debbbe6359 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1516 microversion: 2.1 time: 0.166675 Aug 09 18:10:08.638234 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3543/6594] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:08 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:08.658497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4b7bee18-e8d5-468e-9c58-b28f17faf95d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:08.659124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4b7bee18-e8d5-468e-9c58-b28f17faf95d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:08.665497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b7bee18-e8d5-468e-9c58-b28f17faf95d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:08.665997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b7bee18-e8d5-468e-9c58-b28f17faf95d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:08.666441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b7bee18-e8d5-468e-9c58-b28f17faf95d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:08.667189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b7bee18-e8d5-468e-9c58-b28f17faf95d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:08.667672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b7bee18-e8d5-468e-9c58-b28f17faf95d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:08.668113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4b7bee18-e8d5-468e-9c58-b28f17faf95d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:08.734315 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4b7bee18-e8d5-468e-9c58-b28f17faf95d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "POST /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc/action" status: 204 len: 0 microversion: 2.1 time: 0.079588 Aug 09 18:10:08.735006 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3544/6595] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:10:08 2022] POST /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:10:08.743964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a80a2f20-129f-4b6d-9d6a-77d8b53d54a2 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:08.744809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a80a2f20-129f-4b6d-9d6a-77d8b53d54a2 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:08.752286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80a2f20-129f-4b6d-9d6a-77d8b53d54a2 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:08.752776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80a2f20-129f-4b6d-9d6a-77d8b53d54a2 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:08.753291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80a2f20-129f-4b6d-9d6a-77d8b53d54a2 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:08.753991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80a2f20-129f-4b6d-9d6a-77d8b53d54a2 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:08.754478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80a2f20-129f-4b6d-9d6a-77d8b53d54a2 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:08.754878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a80a2f20-129f-4b6d-9d6a-77d8b53d54a2 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:08.908906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a80a2f20-129f-4b6d-9d6a-77d8b53d54a2 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:08.911648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:08.919477 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a80a2f20-129f-4b6d-9d6a-77d8b53d54a2 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1516 microversion: 2.1 time: 0.179748 Aug 09 18:10:08.921787 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3545/6596] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:08 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:09.945095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b2b50d3-6d9c-4608-a8a8-168d187c340c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:09.945748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b2b50d3-6d9c-4608-a8a8-168d187c340c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:09.954044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b2b50d3-6d9c-4608-a8a8-168d187c340c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:09.954532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b2b50d3-6d9c-4608-a8a8-168d187c340c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:09.955228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b2b50d3-6d9c-4608-a8a8-168d187c340c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:09.955973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b2b50d3-6d9c-4608-a8a8-168d187c340c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:09.956438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b2b50d3-6d9c-4608-a8a8-168d187c340c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:09.956868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b2b50d3-6d9c-4608-a8a8-168d187c340c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:10.096310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8b2b50d3-6d9c-4608-a8a8-168d187c340c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:10.103975 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b2b50d3-6d9c-4608-a8a8-168d187c340c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1516 microversion: 2.1 time: 0.164287 Aug 09 18:10:10.104555 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3546/6597] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:09 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:10.956541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-54e1f5ad-cadb-4fd4-a5c3-08716aaae49f req-b8ec7ef2-c610-4c88-a164-da68a252cc9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da54cb0-fcac-4d52-b44d-4de1c6811adc", "name": "network-vif-plugged", "status": "completed", "tag": "b008d86f-e165-472d-ba5b-6b61915ece47"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:10.968778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-54e1f5ad-cadb-4fd4-a5c3-08716aaae49f req-b8ec7ef2-c610-4c88-a164-da68a252cc9a service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:10.969356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-54e1f5ad-cadb-4fd4-a5c3-08716aaae49f req-b8ec7ef2-c610-4c88-a164-da68a252cc9a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:10.969872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-54e1f5ad-cadb-4fd4-a5c3-08716aaae49f req-b8ec7ef2-c610-4c88-a164-da68a252cc9a service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:10.983023 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-54e1f5ad-cadb-4fd4-a5c3-08716aaae49f req-b8ec7ef2-c610-4c88-a164-da68a252cc9a service nova] Creating event network-vif-plugged:b008d86f-e165-472d-ba5b-6b61915ece47 for instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc on n-h1-845781-6 Aug 09 18:10:10.988259 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-54e1f5ad-cadb-4fd4-a5c3-08716aaae49f req-b8ec7ef2-c610-4c88-a164-da68a252cc9a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037386 Aug 09 18:10:10.988886 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3547/6598] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:10:11.125796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d0ef3971-c728-4fdd-bb31-60238868b07e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:11.126510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d0ef3971-c728-4fdd-bb31-60238868b07e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:11.133327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0ef3971-c728-4fdd-bb31-60238868b07e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:11.133876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0ef3971-c728-4fdd-bb31-60238868b07e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:11.134319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0ef3971-c728-4fdd-bb31-60238868b07e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:11.135020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0ef3971-c728-4fdd-bb31-60238868b07e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:11.135488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0ef3971-c728-4fdd-bb31-60238868b07e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:11.135942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0ef3971-c728-4fdd-bb31-60238868b07e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:11.268025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d0ef3971-c728-4fdd-bb31-60238868b07e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:11.276049 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d0ef3971-c728-4fdd-bb31-60238868b07e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1508 microversion: 2.1 time: 0.154780 Aug 09 18:10:11.276636 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3548/6599] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:11 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:11.296104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-286755ab-244a-4e9e-a069-4a6c4b31c80b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:11.296657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-286755ab-244a-4e9e-a069-4a6c4b31c80b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:11.302469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-286755ab-244a-4e9e-a069-4a6c4b31c80b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:11.302955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-286755ab-244a-4e9e-a069-4a6c4b31c80b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:11.303396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-286755ab-244a-4e9e-a069-4a6c4b31c80b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:11.304121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-286755ab-244a-4e9e-a069-4a6c4b31c80b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:11.304581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-286755ab-244a-4e9e-a069-4a6c4b31c80b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:11.305015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-286755ab-244a-4e9e-a069-4a6c4b31c80b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:11.434785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-286755ab-244a-4e9e-a069-4a6c4b31c80b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:11.442343 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-286755ab-244a-4e9e-a069-4a6c4b31c80b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1508 microversion: 2.1 time: 0.149925 Aug 09 18:10:11.442917 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3549/6600] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:11 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:11.466491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3d9e621f-fbf9-467d-a99d-c69b29e6c358 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Action: 'create', calling method: .version_select at 0x7fbbdc8bc160>, body: {"keypair": {"name": "tempest-keypair-1390400743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4bjaT8YuyRvlfY1iyoJ5N8cjgaSWm8TmDZrsDZLdUbQLbqylk21T5qXYRq4uN5hYfSeSwWSxfwac+/XF4q7+ASfvMaiD9csos/O61dgd322xRCnNeTPykubZ4iJtUyhA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:11.482078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-3d9e621f-fbf9-467d-a99d-c69b29e6c358 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Getting quotas for project ba29e2102601496da3b00716657eba3e. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:10:11.487333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-3d9e621f-fbf9-467d-a99d-c69b29e6c358 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Getting quotas for user 256bf06bd13a46a58000a88c99a4eb2b and project ba29e2102601496da3b00716657eba3e. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:10:11.513557 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3d9e621f-fbf9-467d-a99d-c69b29e6c358 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050719 Aug 09 18:10:11.514317 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3550/6601] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:10:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:10:12.730236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1a1f85a6-5312-4a3f-b97e-acf5ec3d7101 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:12.730916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1a1f85a6-5312-4a3f-b97e-acf5ec3d7101 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:12.738816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1f85a6-5312-4a3f-b97e-acf5ec3d7101 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:12.739315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1f85a6-5312-4a3f-b97e-acf5ec3d7101 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:12.739788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1f85a6-5312-4a3f-b97e-acf5ec3d7101 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:12.740492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1f85a6-5312-4a3f-b97e-acf5ec3d7101 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:12.740954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1f85a6-5312-4a3f-b97e-acf5ec3d7101 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:12.741425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a1f85a6-5312-4a3f-b97e-acf5ec3d7101 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:12.873070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a1f85a6-5312-4a3f-b97e-acf5ec3d7101 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:12.880888 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1a1f85a6-5312-4a3f-b97e-acf5ec3d7101 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 200 len: 1508 microversion: 2.1 time: 0.155189 Aug 09 18:10:12.881446 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3551/6602] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:12 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:12.901500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-96fb42d6-1c9b-452d-9a37-09ba63e01a77 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:12.901994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-96fb42d6-1c9b-452d-9a37-09ba63e01a77 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:12.908041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96fb42d6-1c9b-452d-9a37-09ba63e01a77 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:12.908528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96fb42d6-1c9b-452d-9a37-09ba63e01a77 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:12.908963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96fb42d6-1c9b-452d-9a37-09ba63e01a77 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:12.909696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96fb42d6-1c9b-452d-9a37-09ba63e01a77 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:12.910148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96fb42d6-1c9b-452d-9a37-09ba63e01a77 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:12.910568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96fb42d6-1c9b-452d-9a37-09ba63e01a77 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:12.938040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-96fb42d6-1c9b-452d-9a37-09ba63e01a77 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:10:13.019153 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-96fb42d6-1c9b-452d-9a37-09ba63e01a77 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 204 len: 0 microversion: 2.1 time: 0.121456 Aug 09 18:10:13.020064 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3552/6603] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:10:12 2022] DELETE /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:10:13.080837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1973103383", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "ab2289b6-b3a8-41bb-ab58-d5af284afed7"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:13.136373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] validate_networks() for [('ab2289b6-b3a8-41bb-ab58-d5af284afed7', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:10:13.517538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:10:13.518019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:10:13.518494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:10:13.518901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:10:13.519316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:10:13.528202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:13.528674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:13.529107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:13.529825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:13.530273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:13.530695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:13.548107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Getting quotas for project ba29e2102601496da3b00716657eba3e. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:10:13.553387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Getting quotas for user 256bf06bd13a46a58000a88c99a4eb2b and project ba29e2102601496da3b00716657eba3e. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:10:13.566210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:10:13.568617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:10:13.613931 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3302e26-a834-4eff-bce2-1eee4b9fb468 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537615 Aug 09 18:10:13.614502 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3553/6604] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:10:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:10:13.625511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-155fb77c-c4f9-470d-a6f6-09a307de37f1 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:13.626537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-155fb77c-c4f9-470d-a6f6-09a307de37f1 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:13.680995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-155fb77c-c4f9-470d-a6f6-09a307de37f1 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:13.687770 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-155fb77c-c4f9-470d-a6f6-09a307de37f1 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1218 microversion: 2.1 time: 0.066000 Aug 09 18:10:13.688375 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3554/6605] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:13 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:14.708892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c874f75d-59ec-4a19-a2c9-4ce9e3131650 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:14.709565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c874f75d-59ec-4a19-a2c9-4ce9e3131650 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:14.716908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c874f75d-59ec-4a19-a2c9-4ce9e3131650 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:14.717405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c874f75d-59ec-4a19-a2c9-4ce9e3131650 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:14.717845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c874f75d-59ec-4a19-a2c9-4ce9e3131650 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:14.718547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c874f75d-59ec-4a19-a2c9-4ce9e3131650 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:14.719004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c874f75d-59ec-4a19-a2c9-4ce9e3131650 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:14.719434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c874f75d-59ec-4a19-a2c9-4ce9e3131650 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:14.805880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c874f75d-59ec-4a19-a2c9-4ce9e3131650 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:14.814577 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c874f75d-59ec-4a19-a2c9-4ce9e3131650 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1270 microversion: 2.1 time: 0.109812 Aug 09 18:10:14.819770 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3555/6606] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:14 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:15.260919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ad3e501e-c511-4be9-b3dc-1aea63629d23 req-49f4dbf7-52c4-4934-b724-cb2e1f946735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da54cb0-fcac-4d52-b44d-4de1c6811adc", "name": "network-vif-deleted", "tag": "b008d86f-e165-472d-ba5b-6b61915ece47"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:15.277349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ad3e501e-c511-4be9-b3dc-1aea63629d23 req-49f4dbf7-52c4-4934-b724-cb2e1f946735 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:15.279034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ad3e501e-c511-4be9-b3dc-1aea63629d23 req-49f4dbf7-52c4-4934-b724-cb2e1f946735 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:15.279583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ad3e501e-c511-4be9-b3dc-1aea63629d23 req-49f4dbf7-52c4-4934-b724-cb2e1f946735 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:15.293479 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ad3e501e-c511-4be9-b3dc-1aea63629d23 req-49f4dbf7-52c4-4934-b724-cb2e1f946735 service nova] Creating event network-vif-deleted:b008d86f-e165-472d-ba5b-6b61915ece47 for instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc on n-h1-845781-6 Aug 09 18:10:15.299262 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ad3e501e-c511-4be9-b3dc-1aea63629d23 req-49f4dbf7-52c4-4934-b724-cb2e1f946735 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047661 Aug 09 18:10:15.300285 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3556/6607] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:10:15.839579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fa37e3c6-c187-424b-8a5d-e400e6c2ba0f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:15.841800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fa37e3c6-c187-424b-8a5d-e400e6c2ba0f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:15.848486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa37e3c6-c187-424b-8a5d-e400e6c2ba0f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:15.849242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa37e3c6-c187-424b-8a5d-e400e6c2ba0f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:15.849680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa37e3c6-c187-424b-8a5d-e400e6c2ba0f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:15.851210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa37e3c6-c187-424b-8a5d-e400e6c2ba0f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:15.851732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa37e3c6-c187-424b-8a5d-e400e6c2ba0f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:15.852173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fa37e3c6-c187-424b-8a5d-e400e6c2ba0f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:15.992960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fa37e3c6-c187-424b-8a5d-e400e6c2ba0f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:16.000879 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fa37e3c6-c187-424b-8a5d-e400e6c2ba0f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1318 microversion: 2.1 time: 0.166633 Aug 09 18:10:16.001472 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3557/6608] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:15 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:16.273397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c016be80-439f-4cdd-ba85-6fb0d8d8a35f req-d362cda2-ef06-4497-b608-c20871d966b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61fd8aae-73d8-4bc3-b48a-59733b9a4e91", "tag": "16294a20-67cf-46ac-9a5a-6dfb2050bb39"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:16.283541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c016be80-439f-4cdd-ba85-6fb0d8d8a35f req-d362cda2-ef06-4497-b608-c20871d966b8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:16.284066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c016be80-439f-4cdd-ba85-6fb0d8d8a35f req-d362cda2-ef06-4497-b608-c20871d966b8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:16.284507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c016be80-439f-4cdd-ba85-6fb0d8d8a35f req-d362cda2-ef06-4497-b608-c20871d966b8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:16.297684 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c016be80-439f-4cdd-ba85-6fb0d8d8a35f req-d362cda2-ef06-4497-b608-c20871d966b8 service nova] Creating event network-changed:16294a20-67cf-46ac-9a5a-6dfb2050bb39 for instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 on n-h1-845781-6 Aug 09 18:10:16.302621 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c016be80-439f-4cdd-ba85-6fb0d8d8a35f req-d362cda2-ef06-4497-b608-c20871d966b8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033989 Aug 09 18:10:16.303242 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3558/6609] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:10:17.023535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88e4474c-bd71-4577-aada-4d7df4d51969 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:17.024200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88e4474c-bd71-4577-aada-4d7df4d51969 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:17.030431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e4474c-bd71-4577-aada-4d7df4d51969 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:17.030915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e4474c-bd71-4577-aada-4d7df4d51969 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:17.031356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e4474c-bd71-4577-aada-4d7df4d51969 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:17.032076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e4474c-bd71-4577-aada-4d7df4d51969 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:17.032532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e4474c-bd71-4577-aada-4d7df4d51969 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:17.032954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88e4474c-bd71-4577-aada-4d7df4d51969 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:17.172382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-88e4474c-bd71-4577-aada-4d7df4d51969 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:17.180772 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88e4474c-bd71-4577-aada-4d7df4d51969 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1318 microversion: 2.1 time: 0.163196 Aug 09 18:10:17.181361 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3559/6610] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:17 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:18.201652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a81d878c-8727-4d22-bb1c-6bfb252271d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:18.202509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a81d878c-8727-4d22-bb1c-6bfb252271d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:18.209618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81d878c-8727-4d22-bb1c-6bfb252271d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:18.210672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81d878c-8727-4d22-bb1c-6bfb252271d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:18.211120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81d878c-8727-4d22-bb1c-6bfb252271d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:18.211852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81d878c-8727-4d22-bb1c-6bfb252271d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:18.212305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81d878c-8727-4d22-bb1c-6bfb252271d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:18.212730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a81d878c-8727-4d22-bb1c-6bfb252271d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:18.346611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a81d878c-8727-4d22-bb1c-6bfb252271d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:18.354115 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a81d878c-8727-4d22-bb1c-6bfb252271d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1318 microversion: 2.1 time: 0.156406 Aug 09 18:10:18.354685 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3560/6611] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:18 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:19.374946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-713a50eb-8a23-4085-a4ba-b6cb34c64e25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:19.375603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-713a50eb-8a23-4085-a4ba-b6cb34c64e25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:19.383750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-713a50eb-8a23-4085-a4ba-b6cb34c64e25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:19.384250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-713a50eb-8a23-4085-a4ba-b6cb34c64e25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:19.384721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-713a50eb-8a23-4085-a4ba-b6cb34c64e25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:19.385469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-713a50eb-8a23-4085-a4ba-b6cb34c64e25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:19.385928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-713a50eb-8a23-4085-a4ba-b6cb34c64e25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:19.386364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-713a50eb-8a23-4085-a4ba-b6cb34c64e25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:19.523722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-713a50eb-8a23-4085-a4ba-b6cb34c64e25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:19.531404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-713a50eb-8a23-4085-a4ba-b6cb34c64e25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1318 microversion: 2.1 time: 0.160504 Aug 09 18:10:19.532027 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3561/6612] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:19 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:20.552034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-23f0d4a6-8014-4c62-abfa-8a5c142af795 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:20.552707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-23f0d4a6-8014-4c62-abfa-8a5c142af795 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:20.560604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23f0d4a6-8014-4c62-abfa-8a5c142af795 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:20.561101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23f0d4a6-8014-4c62-abfa-8a5c142af795 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:20.561539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23f0d4a6-8014-4c62-abfa-8a5c142af795 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:20.562243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23f0d4a6-8014-4c62-abfa-8a5c142af795 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:20.563316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23f0d4a6-8014-4c62-abfa-8a5c142af795 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:20.563316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23f0d4a6-8014-4c62-abfa-8a5c142af795 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:20.700444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-23f0d4a6-8014-4c62-abfa-8a5c142af795 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:20.708285 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-23f0d4a6-8014-4c62-abfa-8a5c142af795 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1318 microversion: 2.1 time: 0.160228 Aug 09 18:10:20.708864 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3562/6613] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:20 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:21.006152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d55ba3a5-cfde-4a26-ad57-23861cc86efb req-31b11d7b-6f5c-4d32-bccc-b57d1e3c3837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fd8aae-73d8-4bc3-b48a-59733b9a4e91", "name": "network-vif-plugged", "status": "completed", "tag": "16294a20-67cf-46ac-9a5a-6dfb2050bb39"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:21.016794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d55ba3a5-cfde-4a26-ad57-23861cc86efb req-31b11d7b-6f5c-4d32-bccc-b57d1e3c3837 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:21.017382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d55ba3a5-cfde-4a26-ad57-23861cc86efb req-31b11d7b-6f5c-4d32-bccc-b57d1e3c3837 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:21.017872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d55ba3a5-cfde-4a26-ad57-23861cc86efb req-31b11d7b-6f5c-4d32-bccc-b57d1e3c3837 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:21.030652 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d55ba3a5-cfde-4a26-ad57-23861cc86efb req-31b11d7b-6f5c-4d32-bccc-b57d1e3c3837 service nova] Creating event network-vif-plugged:16294a20-67cf-46ac-9a5a-6dfb2050bb39 for instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 on n-h1-845781-6 Aug 09 18:10:21.035862 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d55ba3a5-cfde-4a26-ad57-23861cc86efb req-31b11d7b-6f5c-4d32-bccc-b57d1e3c3837 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033692 Aug 09 18:10:21.036470 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3563/6614] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:10:21.729445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-16c209f6-2a17-4719-b298-b6f638c93961 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:21.730158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-16c209f6-2a17-4719-b298-b6f638c93961 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:21.737428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16c209f6-2a17-4719-b298-b6f638c93961 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:21.737929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16c209f6-2a17-4719-b298-b6f638c93961 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:21.738371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16c209f6-2a17-4719-b298-b6f638c93961 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:21.739079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16c209f6-2a17-4719-b298-b6f638c93961 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:21.739535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16c209f6-2a17-4719-b298-b6f638c93961 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:21.739990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16c209f6-2a17-4719-b298-b6f638c93961 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:21.879934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16c209f6-2a17-4719-b298-b6f638c93961 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:21.888646 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-16c209f6-2a17-4719-b298-b6f638c93961 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1318 microversion: 2.1 time: 0.163554 Aug 09 18:10:21.889306 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3564/6615] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:21 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:22.910323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-59c2decb-7e1f-44fb-9e56-b39f458dd471 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:22.911015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-59c2decb-7e1f-44fb-9e56-b39f458dd471 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:22.913828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:22.919173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59c2decb-7e1f-44fb-9e56-b39f458dd471 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:22.919687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59c2decb-7e1f-44fb-9e56-b39f458dd471 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:22.920128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59c2decb-7e1f-44fb-9e56-b39f458dd471 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:22.920863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59c2decb-7e1f-44fb-9e56-b39f458dd471 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:22.921320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59c2decb-7e1f-44fb-9e56-b39f458dd471 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:22.921751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59c2decb-7e1f-44fb-9e56-b39f458dd471 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:23.071155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-59c2decb-7e1f-44fb-9e56-b39f458dd471 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:23.078954 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-59c2decb-7e1f-44fb-9e56-b39f458dd471 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1509 microversion: 2.1 time: 0.172549 Aug 09 18:10:23.079536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3565/6616] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:22 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:23.099568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-35c76d2a-269a-4869-b57a-e25642333f4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:23.100214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-35c76d2a-269a-4869-b57a-e25642333f4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:23.106833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c76d2a-269a-4869-b57a-e25642333f4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:23.107342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c76d2a-269a-4869-b57a-e25642333f4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:23.107805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c76d2a-269a-4869-b57a-e25642333f4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:23.108510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c76d2a-269a-4869-b57a-e25642333f4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:23.108961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c76d2a-269a-4869-b57a-e25642333f4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:23.109388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35c76d2a-269a-4869-b57a-e25642333f4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:23.113593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:23.252499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-35c76d2a-269a-4869-b57a-e25642333f4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:23.260539 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-35c76d2a-269a-4869-b57a-e25642333f4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1509 microversion: 2.1 time: 0.164578 Aug 09 18:10:23.261140 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3566/6617] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:23 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:23.281079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:23.283381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:23.290204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:23.290697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:23.291143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:23.291892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:23.292349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:23.292779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:23.321691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:23.327816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Old instance type m1.heat2, new instance type m1.heat {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 18:10:23.334620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:10:23.335547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:10:23.336064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:10:23.336480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:10:23.336902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:10:23.403928 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e23744a8-d358-423b-a8fa-bc49e85d3668 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "POST /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91/action" status: 202 len: 0 microversion: 2.1 time: 0.126719 Aug 09 18:10:23.404561 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3567/6618] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:10:23 2022] POST /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:10:23.412642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ff4af5c0-96ee-4883-a1d1-01c849ae820e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:23.413641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ff4af5c0-96ee-4883-a1d1-01c849ae820e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:23.419492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff4af5c0-96ee-4883-a1d1-01c849ae820e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:23.420045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff4af5c0-96ee-4883-a1d1-01c849ae820e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:23.420558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff4af5c0-96ee-4883-a1d1-01c849ae820e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:23.421196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff4af5c0-96ee-4883-a1d1-01c849ae820e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:23.421658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff4af5c0-96ee-4883-a1d1-01c849ae820e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:23.422088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ff4af5c0-96ee-4883-a1d1-01c849ae820e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:23.537308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:23.572310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ff4af5c0-96ee-4883-a1d1-01c849ae820e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:23.580506 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ff4af5c0-96ee-4883-a1d1-01c849ae820e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1516 microversion: 2.1 time: 0.171414 Aug 09 18:10:23.581098 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3568/6619] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:23 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:24.603247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ad408286-9e1f-4b59-a1d6-51508aa6a085 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:24.603959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ad408286-9e1f-4b59-a1d6-51508aa6a085 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:24.605853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:24.612135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad408286-9e1f-4b59-a1d6-51508aa6a085 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:24.612631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad408286-9e1f-4b59-a1d6-51508aa6a085 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:24.613075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad408286-9e1f-4b59-a1d6-51508aa6a085 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:24.613790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad408286-9e1f-4b59-a1d6-51508aa6a085 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:24.614246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad408286-9e1f-4b59-a1d6-51508aa6a085 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:24.614677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ad408286-9e1f-4b59-a1d6-51508aa6a085 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:24.782121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ad408286-9e1f-4b59-a1d6-51508aa6a085 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:24.792431 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ad408286-9e1f-4b59-a1d6-51508aa6a085 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1516 microversion: 2.1 time: 0.193774 Aug 09 18:10:24.792966 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3569/6620] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:24 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:25.822010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-599b07e5-5c4f-4339-acfa-7872a0739eb8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:25.823361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-599b07e5-5c4f-4339-acfa-7872a0739eb8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:25.833743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-599b07e5-5c4f-4339-acfa-7872a0739eb8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:25.834440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-599b07e5-5c4f-4339-acfa-7872a0739eb8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:25.835682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-599b07e5-5c4f-4339-acfa-7872a0739eb8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:25.836497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-599b07e5-5c4f-4339-acfa-7872a0739eb8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:25.837170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-599b07e5-5c4f-4339-acfa-7872a0739eb8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:25.837660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-599b07e5-5c4f-4339-acfa-7872a0739eb8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:26.012922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-599b07e5-5c4f-4339-acfa-7872a0739eb8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:26.023261 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-599b07e5-5c4f-4339-acfa-7872a0739eb8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.208287 Aug 09 18:10:26.024513 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3570/6621] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:25 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:27.050701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-894dbc39-768a-4b0d-a3dd-7976db100256 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:27.051332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-894dbc39-768a-4b0d-a3dd-7976db100256 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:27.059041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-894dbc39-768a-4b0d-a3dd-7976db100256 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:27.059539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-894dbc39-768a-4b0d-a3dd-7976db100256 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:27.060017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-894dbc39-768a-4b0d-a3dd-7976db100256 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:27.060742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-894dbc39-768a-4b0d-a3dd-7976db100256 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:27.061200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-894dbc39-768a-4b0d-a3dd-7976db100256 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:27.061630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-894dbc39-768a-4b0d-a3dd-7976db100256 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:27.206672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-894dbc39-768a-4b0d-a3dd-7976db100256 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:27.214657 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-894dbc39-768a-4b0d-a3dd-7976db100256 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.168119 Aug 09 18:10:27.215247 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3571/6622] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:27 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:28.237297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-59f81228-1d2d-42a1-ab11-6a28c33db51d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:28.237982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-59f81228-1d2d-42a1-ab11-6a28c33db51d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:28.245146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59f81228-1d2d-42a1-ab11-6a28c33db51d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:28.245631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59f81228-1d2d-42a1-ab11-6a28c33db51d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:28.246067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59f81228-1d2d-42a1-ab11-6a28c33db51d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:28.246770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59f81228-1d2d-42a1-ab11-6a28c33db51d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:28.247228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59f81228-1d2d-42a1-ab11-6a28c33db51d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:28.247669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59f81228-1d2d-42a1-ab11-6a28c33db51d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:28.398173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-59f81228-1d2d-42a1-ab11-6a28c33db51d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:28.406413 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-59f81228-1d2d-42a1-ab11-6a28c33db51d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.173611 Aug 09 18:10:28.407115 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3572/6623] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:28 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:29.440731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4cb95e8b-db69-4e8b-8f20-2f495d91ab7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:29.441363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4cb95e8b-db69-4e8b-8f20-2f495d91ab7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:29.448488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cb95e8b-db69-4e8b-8f20-2f495d91ab7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:29.449077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cb95e8b-db69-4e8b-8f20-2f495d91ab7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:29.449529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cb95e8b-db69-4e8b-8f20-2f495d91ab7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:29.450246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cb95e8b-db69-4e8b-8f20-2f495d91ab7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:29.450698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cb95e8b-db69-4e8b-8f20-2f495d91ab7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:29.451129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4cb95e8b-db69-4e8b-8f20-2f495d91ab7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:29.597452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4cb95e8b-db69-4e8b-8f20-2f495d91ab7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:29.606390 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4cb95e8b-db69-4e8b-8f20-2f495d91ab7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.169660 Aug 09 18:10:29.606986 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3573/6624] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:29 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:30.633135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1c21251e-97d3-4a16-a8fa-eb8d6e17c785 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:30.633819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1c21251e-97d3-4a16-a8fa-eb8d6e17c785 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:30.640983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c21251e-97d3-4a16-a8fa-eb8d6e17c785 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:30.641474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c21251e-97d3-4a16-a8fa-eb8d6e17c785 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:30.641918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c21251e-97d3-4a16-a8fa-eb8d6e17c785 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:30.642628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c21251e-97d3-4a16-a8fa-eb8d6e17c785 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:30.643086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c21251e-97d3-4a16-a8fa-eb8d6e17c785 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:30.643544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c21251e-97d3-4a16-a8fa-eb8d6e17c785 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:30.797367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1c21251e-97d3-4a16-a8fa-eb8d6e17c785 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:30.808434 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1c21251e-97d3-4a16-a8fa-eb8d6e17c785 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.179905 Aug 09 18:10:30.809029 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3574/6625] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:30 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:31.830457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-44a571ad-17aa-4fda-9aba-1c6dd03e2b00 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:31.831134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-44a571ad-17aa-4fda-9aba-1c6dd03e2b00 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:31.838349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44a571ad-17aa-4fda-9aba-1c6dd03e2b00 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:31.838836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44a571ad-17aa-4fda-9aba-1c6dd03e2b00 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:31.839269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44a571ad-17aa-4fda-9aba-1c6dd03e2b00 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:31.840018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44a571ad-17aa-4fda-9aba-1c6dd03e2b00 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:31.840469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44a571ad-17aa-4fda-9aba-1c6dd03e2b00 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:31.840891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-44a571ad-17aa-4fda-9aba-1c6dd03e2b00 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:31.993633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-44a571ad-17aa-4fda-9aba-1c6dd03e2b00 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:32.001750 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-44a571ad-17aa-4fda-9aba-1c6dd03e2b00 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.175425 Aug 09 18:10:32.002331 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3575/6626] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:31 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:33.023094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ef7fe512-a14b-4068-8eb2-7916f0c3b90e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:33.023875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ef7fe512-a14b-4068-8eb2-7916f0c3b90e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:33.030846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef7fe512-a14b-4068-8eb2-7916f0c3b90e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:33.031336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef7fe512-a14b-4068-8eb2-7916f0c3b90e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:33.031839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef7fe512-a14b-4068-8eb2-7916f0c3b90e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:33.032544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef7fe512-a14b-4068-8eb2-7916f0c3b90e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:33.033004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef7fe512-a14b-4068-8eb2-7916f0c3b90e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:33.033438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef7fe512-a14b-4068-8eb2-7916f0c3b90e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:33.164034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ef7fe512-a14b-4068-8eb2-7916f0c3b90e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:33.171577 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ef7fe512-a14b-4068-8eb2-7916f0c3b90e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.152955 Aug 09 18:10:33.172175 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3576/6627] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:33 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:34.192524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b77b2e2e-c6b7-4689-96eb-97fff81e517f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:34.193448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b77b2e2e-c6b7-4689-96eb-97fff81e517f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:34.200297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77b2e2e-c6b7-4689-96eb-97fff81e517f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:34.200787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77b2e2e-c6b7-4689-96eb-97fff81e517f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:34.201239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77b2e2e-c6b7-4689-96eb-97fff81e517f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:34.201993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77b2e2e-c6b7-4689-96eb-97fff81e517f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:34.202553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77b2e2e-c6b7-4689-96eb-97fff81e517f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:34.202888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b77b2e2e-c6b7-4689-96eb-97fff81e517f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:34.344922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b77b2e2e-c6b7-4689-96eb-97fff81e517f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:34.353180 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b77b2e2e-c6b7-4689-96eb-97fff81e517f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.164530 Aug 09 18:10:34.353764 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3577/6628] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:34 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:35.374682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d8451501-4fe1-4211-b262-626a97b846f8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:35.375308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d8451501-4fe1-4211-b262-626a97b846f8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:35.382822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8451501-4fe1-4211-b262-626a97b846f8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:35.383315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8451501-4fe1-4211-b262-626a97b846f8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:35.383810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8451501-4fe1-4211-b262-626a97b846f8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:35.384509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8451501-4fe1-4211-b262-626a97b846f8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:35.384970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8451501-4fe1-4211-b262-626a97b846f8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:35.385403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8451501-4fe1-4211-b262-626a97b846f8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:35.518602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d8451501-4fe1-4211-b262-626a97b846f8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:35.526147 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d8451501-4fe1-4211-b262-626a97b846f8 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.155483 Aug 09 18:10:35.526727 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3578/6629] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:35 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:36.548030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f15d567-848f-4d13-af17-675d84cffb4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:36.548640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f15d567-848f-4d13-af17-675d84cffb4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:36.555636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f15d567-848f-4d13-af17-675d84cffb4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:36.556142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f15d567-848f-4d13-af17-675d84cffb4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:36.556582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f15d567-848f-4d13-af17-675d84cffb4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:36.557286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f15d567-848f-4d13-af17-675d84cffb4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:36.557741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f15d567-848f-4d13-af17-675d84cffb4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:36.558171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f15d567-848f-4d13-af17-675d84cffb4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:36.704032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9f15d567-848f-4d13-af17-675d84cffb4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:36.712814 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f15d567-848f-4d13-af17-675d84cffb4b tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.168716 Aug 09 18:10:36.713736 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3579/6630] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:36 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:37.734506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1937cc38-8b63-4a71-b1a2-425240e70b42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:37.735130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1937cc38-8b63-4a71-b1a2-425240e70b42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:37.742819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1937cc38-8b63-4a71-b1a2-425240e70b42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:37.743308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1937cc38-8b63-4a71-b1a2-425240e70b42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:37.743787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1937cc38-8b63-4a71-b1a2-425240e70b42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:37.744491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1937cc38-8b63-4a71-b1a2-425240e70b42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:37.744955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1937cc38-8b63-4a71-b1a2-425240e70b42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:37.745391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1937cc38-8b63-4a71-b1a2-425240e70b42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:37.880882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1937cc38-8b63-4a71-b1a2-425240e70b42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:37.888623 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1937cc38-8b63-4a71-b1a2-425240e70b42 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.158147 Aug 09 18:10:37.889214 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3580/6631] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:37 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:38.909598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1899f3fe-ca18-461a-a5ad-35858e89798a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:38.910287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1899f3fe-ca18-461a-a5ad-35858e89798a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:38.917485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1899f3fe-ca18-461a-a5ad-35858e89798a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:38.917979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1899f3fe-ca18-461a-a5ad-35858e89798a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:38.918419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1899f3fe-ca18-461a-a5ad-35858e89798a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:38.919123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1899f3fe-ca18-461a-a5ad-35858e89798a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:38.919617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1899f3fe-ca18-461a-a5ad-35858e89798a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:38.920067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1899f3fe-ca18-461a-a5ad-35858e89798a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:38.938968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:39.058042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1899f3fe-ca18-461a-a5ad-35858e89798a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:39.065533 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1899f3fe-ca18-461a-a5ad-35858e89798a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.159852 Aug 09 18:10:39.066108 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3581/6632] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:38 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:40.086774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dafe7b33-3e92-48f0-9a81-e9cac567e115 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:40.087406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dafe7b33-3e92-48f0-9a81-e9cac567e115 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:40.094278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dafe7b33-3e92-48f0-9a81-e9cac567e115 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:40.094803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dafe7b33-3e92-48f0-9a81-e9cac567e115 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:40.095247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dafe7b33-3e92-48f0-9a81-e9cac567e115 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:40.095998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dafe7b33-3e92-48f0-9a81-e9cac567e115 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:40.096451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dafe7b33-3e92-48f0-9a81-e9cac567e115 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:40.096881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dafe7b33-3e92-48f0-9a81-e9cac567e115 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:40.233024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dafe7b33-3e92-48f0-9a81-e9cac567e115 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:40.240704 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dafe7b33-3e92-48f0-9a81-e9cac567e115 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.157957 Aug 09 18:10:40.244152 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3582/6633] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:40 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:41.264024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26c29290-e32b-487a-b03e-bcf3d4ff7e7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:41.264659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-26c29290-e32b-487a-b03e-bcf3d4ff7e7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:41.271802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26c29290-e32b-487a-b03e-bcf3d4ff7e7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:41.272303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26c29290-e32b-487a-b03e-bcf3d4ff7e7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:41.272747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26c29290-e32b-487a-b03e-bcf3d4ff7e7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:41.273456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26c29290-e32b-487a-b03e-bcf3d4ff7e7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:41.273915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26c29290-e32b-487a-b03e-bcf3d4ff7e7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:41.274345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26c29290-e32b-487a-b03e-bcf3d4ff7e7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:41.410385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-26c29290-e32b-487a-b03e-bcf3d4ff7e7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:41.418582 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-26c29290-e32b-487a-b03e-bcf3d4ff7e7e tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.158493 Aug 09 18:10:41.419166 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3583/6634] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:41 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:42.440018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-885d7954-b6c9-4417-8a9a-c9a2fba1ceef tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:42.440710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-885d7954-b6c9-4417-8a9a-c9a2fba1ceef tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:42.450194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885d7954-b6c9-4417-8a9a-c9a2fba1ceef tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:42.451076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885d7954-b6c9-4417-8a9a-c9a2fba1ceef tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:42.451908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885d7954-b6c9-4417-8a9a-c9a2fba1ceef tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:42.453254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885d7954-b6c9-4417-8a9a-c9a2fba1ceef tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:42.454413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885d7954-b6c9-4417-8a9a-c9a2fba1ceef tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:42.456135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-885d7954-b6c9-4417-8a9a-c9a2fba1ceef tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:42.595139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-885d7954-b6c9-4417-8a9a-c9a2fba1ceef tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:42.605761 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-885d7954-b6c9-4417-8a9a-c9a2fba1ceef tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.169602 Aug 09 18:10:42.606362 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3584/6635] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:42 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:43.626673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-35267607-f92a-4d36-a05f-160fbd383c25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:43.627360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-35267607-f92a-4d36-a05f-160fbd383c25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:43.634835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35267607-f92a-4d36-a05f-160fbd383c25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:43.635317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35267607-f92a-4d36-a05f-160fbd383c25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:43.635793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35267607-f92a-4d36-a05f-160fbd383c25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:43.636481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35267607-f92a-4d36-a05f-160fbd383c25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:43.636938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35267607-f92a-4d36-a05f-160fbd383c25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:43.637366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35267607-f92a-4d36-a05f-160fbd383c25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:43.774042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-35267607-f92a-4d36-a05f-160fbd383c25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:43.781688 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-35267607-f92a-4d36-a05f-160fbd383c25 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.159022 Aug 09 18:10:43.782259 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3585/6636] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:43 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:44.802122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-897ddeba-abb7-4844-94c2-f70a275695e6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:44.802743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-897ddeba-abb7-4844-94c2-f70a275695e6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:44.810218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-897ddeba-abb7-4844-94c2-f70a275695e6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:44.810706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-897ddeba-abb7-4844-94c2-f70a275695e6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:44.811153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-897ddeba-abb7-4844-94c2-f70a275695e6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:44.811885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-897ddeba-abb7-4844-94c2-f70a275695e6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:44.812400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-897ddeba-abb7-4844-94c2-f70a275695e6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:44.812775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-897ddeba-abb7-4844-94c2-f70a275695e6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:44.946709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-897ddeba-abb7-4844-94c2-f70a275695e6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:44.954332 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-897ddeba-abb7-4844-94c2-f70a275695e6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.156115 Aug 09 18:10:44.955156 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3586/6637] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:44 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:45.975216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19f65add-3683-4696-9da5-9fe3695e7d1d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:45.975910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19f65add-3683-4696-9da5-9fe3695e7d1d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:45.982824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f65add-3683-4696-9da5-9fe3695e7d1d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:45.983306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f65add-3683-4696-9da5-9fe3695e7d1d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:45.984197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f65add-3683-4696-9da5-9fe3695e7d1d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:45.984476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f65add-3683-4696-9da5-9fe3695e7d1d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:45.984937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f65add-3683-4696-9da5-9fe3695e7d1d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:45.985369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19f65add-3683-4696-9da5-9fe3695e7d1d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:46.118897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-19f65add-3683-4696-9da5-9fe3695e7d1d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:46.126523 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19f65add-3683-4696-9da5-9fe3695e7d1d tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.155196 Aug 09 18:10:46.127099 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3587/6638] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:45 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:47.147960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0bf4e1f8-ca33-4540-9bda-798534281d92 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:47.148597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0bf4e1f8-ca33-4540-9bda-798534281d92 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:47.155377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bf4e1f8-ca33-4540-9bda-798534281d92 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:47.155893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bf4e1f8-ca33-4540-9bda-798534281d92 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:47.156336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bf4e1f8-ca33-4540-9bda-798534281d92 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:47.157025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bf4e1f8-ca33-4540-9bda-798534281d92 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:47.157480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bf4e1f8-ca33-4540-9bda-798534281d92 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:47.157905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bf4e1f8-ca33-4540-9bda-798534281d92 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:47.288755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0bf4e1f8-ca33-4540-9bda-798534281d92 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:47.296283 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0bf4e1f8-ca33-4540-9bda-798534281d92 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.152267 Aug 09 18:10:47.296863 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3588/6639] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:47 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:48.317646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8206d795-9d09-402b-bef4-958e0aa35172 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:48.318308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8206d795-9d09-402b-bef4-958e0aa35172 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:48.325198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8206d795-9d09-402b-bef4-958e0aa35172 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:48.325682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8206d795-9d09-402b-bef4-958e0aa35172 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:48.326115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8206d795-9d09-402b-bef4-958e0aa35172 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:48.326802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8206d795-9d09-402b-bef4-958e0aa35172 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:48.327252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8206d795-9d09-402b-bef4-958e0aa35172 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:48.327698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8206d795-9d09-402b-bef4-958e0aa35172 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:48.464553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8206d795-9d09-402b-bef4-958e0aa35172 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:48.471953 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8206d795-9d09-402b-bef4-958e0aa35172 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.158172 Aug 09 18:10:48.472523 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3589/6640] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:48 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:49.493034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b8f71033-c932-4622-8f3e-9f72c25c66c4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:49.493706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b8f71033-c932-4622-8f3e-9f72c25c66c4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:49.500742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8f71033-c932-4622-8f3e-9f72c25c66c4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:49.501234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8f71033-c932-4622-8f3e-9f72c25c66c4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:49.501678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8f71033-c932-4622-8f3e-9f72c25c66c4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:49.502390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8f71033-c932-4622-8f3e-9f72c25c66c4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:49.502837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8f71033-c932-4622-8f3e-9f72c25c66c4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:49.503267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8f71033-c932-4622-8f3e-9f72c25c66c4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:49.635728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b8f71033-c932-4622-8f3e-9f72c25c66c4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:49.643264 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b8f71033-c932-4622-8f3e-9f72c25c66c4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.154166 Aug 09 18:10:49.643880 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3590/6641] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:49 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:50.664766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2e783d1c-4c08-47b3-8ef6-1aa4068362cd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:50.665425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2e783d1c-4c08-47b3-8ef6-1aa4068362cd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:50.672305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e783d1c-4c08-47b3-8ef6-1aa4068362cd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:50.672792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e783d1c-4c08-47b3-8ef6-1aa4068362cd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:50.673236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e783d1c-4c08-47b3-8ef6-1aa4068362cd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:50.673940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e783d1c-4c08-47b3-8ef6-1aa4068362cd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:50.674403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e783d1c-4c08-47b3-8ef6-1aa4068362cd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:50.674837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e783d1c-4c08-47b3-8ef6-1aa4068362cd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:50.815795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2e783d1c-4c08-47b3-8ef6-1aa4068362cd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:50.823922 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2e783d1c-4c08-47b3-8ef6-1aa4068362cd tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.163131 Aug 09 18:10:50.824510 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3591/6642] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:50 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:51.844893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4d86b090-086e-45bf-acf2-92ff1ff70d5a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:51.845510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4d86b090-086e-45bf-acf2-92ff1ff70d5a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:51.852500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d86b090-086e-45bf-acf2-92ff1ff70d5a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:51.852991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d86b090-086e-45bf-acf2-92ff1ff70d5a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:51.853439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d86b090-086e-45bf-acf2-92ff1ff70d5a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:51.854135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d86b090-086e-45bf-acf2-92ff1ff70d5a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:51.854595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d86b090-086e-45bf-acf2-92ff1ff70d5a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:51.855026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d86b090-086e-45bf-acf2-92ff1ff70d5a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:51.989882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4d86b090-086e-45bf-acf2-92ff1ff70d5a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:51.998033 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4d86b090-086e-45bf-acf2-92ff1ff70d5a tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1521 microversion: 2.1 time: 0.157031 Aug 09 18:10:51.998609 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3592/6643] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:51 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:53.011799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d895b273-bec6-4bc1-ada2-cf49292329dd req-f9b1afd0-f1c6-4bca-b076-c654f49b34b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fd8aae-73d8-4bc3-b48a-59733b9a4e91", "name": "network-vif-unplugged", "status": "completed", "tag": "16294a20-67cf-46ac-9a5a-6dfb2050bb39"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:53.024299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=60 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:53.026798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d895b273-bec6-4bc1-ada2-cf49292329dd req-f9b1afd0-f1c6-4bca-b076-c654f49b34b2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:53.027403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d895b273-bec6-4bc1-ada2-cf49292329dd req-f9b1afd0-f1c6-4bca-b076-c654f49b34b2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:53.028024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d895b273-bec6-4bc1-ada2-cf49292329dd req-f9b1afd0-f1c6-4bca-b076-c654f49b34b2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:53.042388 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d895b273-bec6-4bc1-ada2-cf49292329dd req-f9b1afd0-f1c6-4bca-b076-c654f49b34b2 service nova] Creating event network-vif-unplugged:16294a20-67cf-46ac-9a5a-6dfb2050bb39 for instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 on n-h2-845781-6 Aug 09 18:10:53.048240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-d895b273-bec6-4bc1-ada2-cf49292329dd req-f9b1afd0-f1c6-4bca-b076-c654f49b34b2 service nova] Instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:10:53.062346 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d895b273-bec6-4bc1-ada2-cf49292329dd req-f9b1afd0-f1c6-4bca-b076-c654f49b34b2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053847 Aug 09 18:10:53.062788 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3593/6644] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:10:53.069547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f65408e8-1231-4c44-8789-949dc60b2ae3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:53.070266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f65408e8-1231-4c44-8789-949dc60b2ae3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:53.076624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f65408e8-1231-4c44-8789-949dc60b2ae3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:53.077164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f65408e8-1231-4c44-8789-949dc60b2ae3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:53.077601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f65408e8-1231-4c44-8789-949dc60b2ae3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:53.078317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f65408e8-1231-4c44-8789-949dc60b2ae3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:53.078776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f65408e8-1231-4c44-8789-949dc60b2ae3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:53.079214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f65408e8-1231-4c44-8789-949dc60b2ae3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:53.216941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f65408e8-1231-4c44-8789-949dc60b2ae3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:53.225129 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f65408e8-1231-4c44-8789-949dc60b2ae3 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1520 microversion: 2.1 time: 0.160848 Aug 09 18:10:53.225574 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3594/6645] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:53 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:54.246258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2e465777-b723-42f9-a7f5-f3aaae42142f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:54.246951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2e465777-b723-42f9-a7f5-f3aaae42142f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:54.253786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e465777-b723-42f9-a7f5-f3aaae42142f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:54.254265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e465777-b723-42f9-a7f5-f3aaae42142f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:54.254707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e465777-b723-42f9-a7f5-f3aaae42142f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:54.255389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e465777-b723-42f9-a7f5-f3aaae42142f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:54.255867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e465777-b723-42f9-a7f5-f3aaae42142f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:54.256800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e465777-b723-42f9-a7f5-f3aaae42142f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:54.390082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2e465777-b723-42f9-a7f5-f3aaae42142f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:54.398222 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2e465777-b723-42f9-a7f5-f3aaae42142f tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1518 microversion: 2.1 time: 0.155876 Aug 09 18:10:54.398814 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3595/6646] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:54 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:55.091911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b04c88ed-db6b-4fe1-a036-2c4128cc43c4 req-86b7ff4b-e1c1-47d5-bbb0-414c2c58cfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61fd8aae-73d8-4bc3-b48a-59733b9a4e91", "tag": "16294a20-67cf-46ac-9a5a-6dfb2050bb39"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:55.101876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b04c88ed-db6b-4fe1-a036-2c4128cc43c4 req-86b7ff4b-e1c1-47d5-bbb0-414c2c58cfe6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:55.102349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b04c88ed-db6b-4fe1-a036-2c4128cc43c4 req-86b7ff4b-e1c1-47d5-bbb0-414c2c58cfe6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:55.102775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b04c88ed-db6b-4fe1-a036-2c4128cc43c4 req-86b7ff4b-e1c1-47d5-bbb0-414c2c58cfe6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:55.114830 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b04c88ed-db6b-4fe1-a036-2c4128cc43c4 req-86b7ff4b-e1c1-47d5-bbb0-414c2c58cfe6 service nova] Creating event network-changed:16294a20-67cf-46ac-9a5a-6dfb2050bb39 for instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 on n-h2-845781-6 Aug 09 18:10:55.121072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-b04c88ed-db6b-4fe1-a036-2c4128cc43c4 req-86b7ff4b-e1c1-47d5-bbb0-414c2c58cfe6 service nova] Instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:10:55.131728 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b04c88ed-db6b-4fe1-a036-2c4128cc43c4 req-86b7ff4b-e1c1-47d5-bbb0-414c2c58cfe6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043524 Aug 09 18:10:55.132339 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3596/6647] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:10:55.421377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e110f93b-d876-4ade-8f2c-70add2c12230 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:55.422124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e110f93b-d876-4ade-8f2c-70add2c12230 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:55.428651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e110f93b-d876-4ade-8f2c-70add2c12230 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:55.429192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e110f93b-d876-4ade-8f2c-70add2c12230 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:55.429667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e110f93b-d876-4ade-8f2c-70add2c12230 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:55.430382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e110f93b-d876-4ade-8f2c-70add2c12230 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:55.430844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e110f93b-d876-4ade-8f2c-70add2c12230 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:55.431277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e110f93b-d876-4ade-8f2c-70add2c12230 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:55.590000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e110f93b-d876-4ade-8f2c-70add2c12230 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:55.598243 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e110f93b-d876-4ade-8f2c-70add2c12230 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1515 microversion: 2.1 time: 0.181973 Aug 09 18:10:55.599339 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3597/6648] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:55 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:55.620280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-62425889-f0ce-4c93-97ad-f26a35918ad7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:55.620942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-62425889-f0ce-4c93-97ad-f26a35918ad7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:55.628232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62425889-f0ce-4c93-97ad-f26a35918ad7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:55.628866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62425889-f0ce-4c93-97ad-f26a35918ad7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:55.629411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62425889-f0ce-4c93-97ad-f26a35918ad7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:55.630229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62425889-f0ce-4c93-97ad-f26a35918ad7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:55.630784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62425889-f0ce-4c93-97ad-f26a35918ad7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:55.631846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62425889-f0ce-4c93-97ad-f26a35918ad7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:55.662664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:10:55.696208 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-62425889-f0ce-4c93-97ad-f26a35918ad7 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "POST /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91/action" status: 204 len: 0 microversion: 2.1 time: 0.079828 Aug 09 18:10:55.697231 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3598/6649] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:10:55 2022] POST /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:10:55.709148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fb5cb9f1-6f62-4195-91e7-499f452e27d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:55.711932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fb5cb9f1-6f62-4195-91e7-499f452e27d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:55.718638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb5cb9f1-6f62-4195-91e7-499f452e27d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:55.719385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb5cb9f1-6f62-4195-91e7-499f452e27d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:55.719749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb5cb9f1-6f62-4195-91e7-499f452e27d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:55.720523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb5cb9f1-6f62-4195-91e7-499f452e27d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:55.721291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb5cb9f1-6f62-4195-91e7-499f452e27d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:55.721530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb5cb9f1-6f62-4195-91e7-499f452e27d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:55.952366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fb5cb9f1-6f62-4195-91e7-499f452e27d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:55.965510 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fb5cb9f1-6f62-4195-91e7-499f452e27d5 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1515 microversion: 2.1 time: 0.261470 Aug 09 18:10:55.966568 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3599/6650] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:55 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:10:56.986836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b0ad6888-9392-4632-b5f4-8c9fdf4a05c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:56.987555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b0ad6888-9392-4632-b5f4-8c9fdf4a05c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:56.995456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ad6888-9392-4632-b5f4-8c9fdf4a05c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:56.995977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ad6888-9392-4632-b5f4-8c9fdf4a05c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:56.996445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ad6888-9392-4632-b5f4-8c9fdf4a05c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:56.997157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ad6888-9392-4632-b5f4-8c9fdf4a05c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:56.997593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ad6888-9392-4632-b5f4-8c9fdf4a05c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:56.998019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ad6888-9392-4632-b5f4-8c9fdf4a05c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:57.130045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b0ad6888-9392-4632-b5f4-8c9fdf4a05c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:57.138135 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b0ad6888-9392-4632-b5f4-8c9fdf4a05c6 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1515 microversion: 2.1 time: 0.155185 Aug 09 18:10:57.138707 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3600/6651] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:56 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:57.769824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4e74c250-cb07-4b24-b54f-959207a55b30 req-e615b976-8514-4a15-8b38-17432d9a60cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fd8aae-73d8-4bc3-b48a-59733b9a4e91", "name": "network-vif-plugged", "status": "completed", "tag": "16294a20-67cf-46ac-9a5a-6dfb2050bb39"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:10:57.784509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4e74c250-cb07-4b24-b54f-959207a55b30 req-e615b976-8514-4a15-8b38-17432d9a60cd service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:57.785009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4e74c250-cb07-4b24-b54f-959207a55b30 req-e615b976-8514-4a15-8b38-17432d9a60cd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:57.785459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4e74c250-cb07-4b24-b54f-959207a55b30 req-e615b976-8514-4a15-8b38-17432d9a60cd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:57.798490 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4e74c250-cb07-4b24-b54f-959207a55b30 req-e615b976-8514-4a15-8b38-17432d9a60cd service nova] Creating event network-vif-plugged:16294a20-67cf-46ac-9a5a-6dfb2050bb39 for instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 on n-h2-845781-6 Aug 09 18:10:57.804681 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4e74c250-cb07-4b24-b54f-959207a55b30 req-e615b976-8514-4a15-8b38-17432d9a60cd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040909 Aug 09 18:10:57.805372 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3601/6652] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:10:58.161112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb38af97-abba-4bca-a294-0ca1686d9899 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:58.161755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eb38af97-abba-4bca-a294-0ca1686d9899 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:58.168380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb38af97-abba-4bca-a294-0ca1686d9899 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:58.168864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb38af97-abba-4bca-a294-0ca1686d9899 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:58.169298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb38af97-abba-4bca-a294-0ca1686d9899 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:58.169982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb38af97-abba-4bca-a294-0ca1686d9899 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:58.170434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb38af97-abba-4bca-a294-0ca1686d9899 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:58.170854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb38af97-abba-4bca-a294-0ca1686d9899 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:58.308704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eb38af97-abba-4bca-a294-0ca1686d9899 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:58.316265 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eb38af97-abba-4bca-a294-0ca1686d9899 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1507 microversion: 2.1 time: 0.160357 Aug 09 18:10:58.316841 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3602/6653] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:58 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:58.336788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b0ea4b2a-f522-4e70-9cdc-40db4e9a82da tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:58.337399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b0ea4b2a-f522-4e70-9cdc-40db4e9a82da tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:58.343173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea4b2a-f522-4e70-9cdc-40db4e9a82da tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:58.343682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea4b2a-f522-4e70-9cdc-40db4e9a82da tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:58.344130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea4b2a-f522-4e70-9cdc-40db4e9a82da tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:58.344823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea4b2a-f522-4e70-9cdc-40db4e9a82da tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:58.345281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea4b2a-f522-4e70-9cdc-40db4e9a82da tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:58.345712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b0ea4b2a-f522-4e70-9cdc-40db4e9a82da tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:58.474314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b0ea4b2a-f522-4e70-9cdc-40db4e9a82da tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:58.482578 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b0ea4b2a-f522-4e70-9cdc-40db4e9a82da tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1507 microversion: 2.1 time: 0.149852 Aug 09 18:10:58.483166 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3603/6654] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:58 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:58.508313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8a3450b3-1c6c-4331-9dfc-1c8a5e204a39 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:58.508936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8a3450b3-1c6c-4331-9dfc-1c8a5e204a39 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:58.514957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3450b3-1c6c-4331-9dfc-1c8a5e204a39 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:58.515443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3450b3-1c6c-4331-9dfc-1c8a5e204a39 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:58.515922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3450b3-1c6c-4331-9dfc-1c8a5e204a39 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:58.516614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3450b3-1c6c-4331-9dfc-1c8a5e204a39 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:58.517072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3450b3-1c6c-4331-9dfc-1c8a5e204a39 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:58.517500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3450b3-1c6c-4331-9dfc-1c8a5e204a39 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:58.987884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8a3450b3-1c6c-4331-9dfc-1c8a5e204a39 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:58.995609 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8a3450b3-1c6c-4331-9dfc-1c8a5e204a39 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1507 microversion: 2.1 time: 0.491188 Aug 09 18:10:58.996217 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3604/6655] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:58 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1507 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:10:59.015323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a809fa8e-d596-4461-9741-67593473780c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:59.015857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a809fa8e-d596-4461-9741-67593473780c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:59.022371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a809fa8e-d596-4461-9741-67593473780c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:59.022859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a809fa8e-d596-4461-9741-67593473780c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:59.023303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a809fa8e-d596-4461-9741-67593473780c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:59.024052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a809fa8e-d596-4461-9741-67593473780c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:59.024519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a809fa8e-d596-4461-9741-67593473780c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:59.024951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a809fa8e-d596-4461-9741-67593473780c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:59.049883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a809fa8e-d596-4461-9741-67593473780c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:10:59.126763 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a809fa8e-d596-4461-9741-67593473780c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "DELETE /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 204 len: 0 microversion: 2.1 time: 0.114757 Aug 09 18:10:59.131975 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3605/6656] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:10:59 2022] DELETE /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:10:59.145083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c0ad296c-f0e2-46b2-9bd2-4a6e67e07d82 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:59.145675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c0ad296c-f0e2-46b2-9bd2-4a6e67e07d82 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:59.151791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0ad296c-f0e2-46b2-9bd2-4a6e67e07d82 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:59.152240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0ad296c-f0e2-46b2-9bd2-4a6e67e07d82 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:59.157488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0ad296c-f0e2-46b2-9bd2-4a6e67e07d82 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:59.157488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0ad296c-f0e2-46b2-9bd2-4a6e67e07d82 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:59.157488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0ad296c-f0e2-46b2-9bd2-4a6e67e07d82 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:59.157488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0ad296c-f0e2-46b2-9bd2-4a6e67e07d82 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:59.180912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c0ad296c-f0e2-46b2-9bd2-4a6e67e07d82 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:10:59.226308 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.compute.api [None req-c0ad296c-f0e2-46b2-9bd2-4a6e67e07d82 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Instance is already in deleting state, ignoring this request Aug 09 18:10:59.227148 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c0ad296c-f0e2-46b2-9bd2-4a6e67e07d82 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "DELETE /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 204 len: 0 microversion: 2.1 time: 0.086288 Aug 09 18:10:59.227744 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3606/6657] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:10:59 2022] DELETE /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:10:59.235460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-324f31d2-0338-4720-8eae-a01c784da4b4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:10:59.236100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-324f31d2-0338-4720-8eae-a01c784da4b4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:10:59.242346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-324f31d2-0338-4720-8eae-a01c784da4b4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:59.242836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-324f31d2-0338-4720-8eae-a01c784da4b4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:59.243280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-324f31d2-0338-4720-8eae-a01c784da4b4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:59.244006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-324f31d2-0338-4720-8eae-a01c784da4b4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:10:59.244467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-324f31d2-0338-4720-8eae-a01c784da4b4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:10:59.244899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-324f31d2-0338-4720-8eae-a01c784da4b4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:10:59.373800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-324f31d2-0338-4720-8eae-a01c784da4b4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:10:59.381848 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-324f31d2-0338-4720-8eae-a01c784da4b4 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1513 microversion: 2.1 time: 0.149508 Aug 09 18:10:59.382431 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3607/6658] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:10:59 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:11:00.403159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-797ab863-d11b-4eed-8ff1-a93d06bfea5c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:00.403864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-797ab863-d11b-4eed-8ff1-a93d06bfea5c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:00.411249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-797ab863-d11b-4eed-8ff1-a93d06bfea5c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:00.411763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-797ab863-d11b-4eed-8ff1-a93d06bfea5c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:00.412210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-797ab863-d11b-4eed-8ff1-a93d06bfea5c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:00.412914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-797ab863-d11b-4eed-8ff1-a93d06bfea5c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:00.413371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-797ab863-d11b-4eed-8ff1-a93d06bfea5c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:00.413802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-797ab863-d11b-4eed-8ff1-a93d06bfea5c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:00.556266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-797ab863-d11b-4eed-8ff1-a93d06bfea5c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256bf06bd13a46a58000a88c99a4eb2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba29e2102601496da3b00716657eba3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:00.570537 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-797ab863-d11b-4eed-8ff1-a93d06bfea5c tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 200 len: 1513 microversion: 2.1 time: 0.170915 Aug 09 18:11:00.571653 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3608/6659] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:00 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:11:00.980120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e1f37127-3291-40cd-aa92-eabecf5ea0c9 req-c7ef0268-925f-4979-9c6d-77ee0565f147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fd8aae-73d8-4bc3-b48a-59733b9a4e91", "name": "network-vif-deleted", "tag": "16294a20-67cf-46ac-9a5a-6dfb2050bb39"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:11:00.991173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e1f37127-3291-40cd-aa92-eabecf5ea0c9 req-c7ef0268-925f-4979-9c6d-77ee0565f147 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:00.991589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e1f37127-3291-40cd-aa92-eabecf5ea0c9 req-c7ef0268-925f-4979-9c6d-77ee0565f147 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:00.992044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e1f37127-3291-40cd-aa92-eabecf5ea0c9 req-c7ef0268-925f-4979-9c6d-77ee0565f147 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:01.006352 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e1f37127-3291-40cd-aa92-eabecf5ea0c9 req-c7ef0268-925f-4979-9c6d-77ee0565f147 service nova] Creating event network-vif-deleted:16294a20-67cf-46ac-9a5a-6dfb2050bb39 for instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 on n-h2-845781-6 Aug 09 18:11:01.012545 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e1f37127-3291-40cd-aa92-eabecf5ea0c9 req-c7ef0268-925f-4979-9c6d-77ee0565f147 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036093 Aug 09 18:11:01.013340 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3609/6660] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:11:01.593612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:01.594327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 61fd8aae-73d8-4bc3-b48a-59733b9a4e91] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:01.601410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:01.601838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:01.602283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:01.602977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:01.603437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:01.603894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:01.617358 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] HTTP exception thrown: Instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 could not be found. Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Request method failure captured: Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 HTTP/1.1 Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qLV3GpPqxSbhfw7-WUXARvVh8Zo-L63ElGoI_1xBc7ZpmzInGpVSTzR8jIJMga7AI3o9-BJ5zc_u3LsntSwQLGb40jCfqCKhNRM6ah4i2RoFCzj-4Z-t3MWSWo7VHOrbSgzmM0bVf7xpCOn-sOLcPkobQMcCQobWpFBi_VEYTMohv0 Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ba29e2102601496da3b00716657eba3e Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerDiskConfigTestJSON-989505381 Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ba29e2102601496da3b00716657eba3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ba29e2102601496da3b00716657eba3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ba29e2102601496da3b00716657eba3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ba29e2102601496da3b00716657eba3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerDiskConfigTestJSON-989505381 Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ba29e2102601496da3b00716657eba3e Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-989505381 Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerDiskConfigTestJSON-989505381-project Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 256bf06bd13a46a58000a88c99a4eb2b Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerDiskConfigTestJSON-989505381-project Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 could not be found. Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '61fd8aae-73d8-4bc3-b48a-59733b9a4e91'} Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 could not be found. Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 could not be found. Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:11:01.619017 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:01.623510 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:11:01.623510 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:11:01.623510 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:11:01.623510 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:11:01.623510 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:11:01.623510 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 could not be found. Aug 09 18:11:01.623510 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:01.623510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Returning 404 to user: Instance 61fd8aae-73d8-4bc3-b48a-59733b9a4e91 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:11:01.623510 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-805b2d91-d852-4911-afa1-d47ef4142016 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91" status: 404 len: 111 microversion: 2.1 time: 0.032272 Aug 09 18:11:01.623510 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3610/6661] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:01 2022] GET /compute/v2.1/servers/61fd8aae-73d8-4bc3-b48a-59733b9a4e91 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:11:01.629028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0237e9a5-34b5-4056-8759-930a80d9ef31 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '.version_select at 0x7fbbcbb13160>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:01.650092 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0237e9a5-34b5-4056-8759-930a80d9ef31 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390400743" status: 202 len: 0 microversion: 2.1 time: 0.024554 Aug 09 18:11:01.650661 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3611/6662] 10.222.0.93 () {58 vars in 1221 bytes} [Tue Aug 9 18:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390400743 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:11:02.269240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:02.269785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:02.279862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:02.280365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:02.280808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:02.281526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:02.281988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:02.282424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:02.296212 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] HTTP exception thrown: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Request method failure captured: Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc HTTP/1.1 Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qLV3GpPqxSbhfw7-WUXARvVh8Zo-L63ElGoI_1xBc7ZpmzInGpVSTzR8jIJMga7AI3o9-BJ5zc_u3LsntSwQLGb40jCfqCKhNRM6ah4i2RoFCzj-4Z-t3MWSWo7VHOrbSgzmM0bVf7xpCOn-sOLcPkobQMcCQobWpFBi_VEYTMohv0 Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ba29e2102601496da3b00716657eba3e Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerDiskConfigTestJSON-989505381 Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ba29e2102601496da3b00716657eba3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ba29e2102601496da3b00716657eba3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ba29e2102601496da3b00716657eba3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ba29e2102601496da3b00716657eba3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerDiskConfigTestJSON-989505381 Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ba29e2102601496da3b00716657eba3e Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-989505381 Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerDiskConfigTestJSON-989505381-project Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 256bf06bd13a46a58000a88c99a4eb2b Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerDiskConfigTestJSON-989505381-project Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '5da54cb0-fcac-4d52-b44d-4de1c6811adc'} Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:11:02.297804 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Returning 404 to user: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4fbbc3d2-72a8-4194-abe2-9e25aac0af30 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 404 len: 111 microversion: 2.1 time: 0.034148 Aug 09 18:11:02.302117 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3612/6663] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:11:02 2022] DELETE /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:11:02.308592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:02.309217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] [instance: 5da54cb0-fcac-4d52-b44d-4de1c6811adc] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:02.315591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:02.316093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:02.316537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:02.317286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:02.317812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:02.318179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:02.332684 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] HTTP exception thrown: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Request method failure captured: Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc HTTP/1.1 Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qLV3GpPqxSbhfw7-WUXARvVh8Zo-L63ElGoI_1xBc7ZpmzInGpVSTzR8jIJMga7AI3o9-BJ5zc_u3LsntSwQLGb40jCfqCKhNRM6ah4i2RoFCzj-4Z-t3MWSWo7VHOrbSgzmM0bVf7xpCOn-sOLcPkobQMcCQobWpFBi_VEYTMohv0 Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: ba29e2102601496da3b00716657eba3e Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerDiskConfigTestJSON-989505381 Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ba29e2102601496da3b00716657eba3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ba29e2102601496da3b00716657eba3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ba29e2102601496da3b00716657eba3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ba29e2102601496da3b00716657eba3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerDiskConfigTestJSON-989505381 Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: ba29e2102601496da3b00716657eba3e Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-989505381 Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerDiskConfigTestJSON-989505381-project Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 256bf06bd13a46a58000a88c99a4eb2b Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerDiskConfigTestJSON-989505381-project Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '5da54cb0-fcac-4d52-b44d-4de1c6811adc'} Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:11:02.334333 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:02.338164 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:11:02.338164 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:11:02.338164 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:11:02.338164 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:11:02.338164 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:11:02.338164 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. Aug 09 18:11:02.338164 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:11:02.338164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] Returning 404 to user: Instance 5da54cb0-fcac-4d52-b44d-4de1c6811adc could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:11:02.338164 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e194627a-03f7-4d04-bf6c-6dc4dc91acc0 tempest-ServerDiskConfigTestJSON-989505381 tempest-ServerDiskConfigTestJSON-989505381-project] 10.222.0.93 "GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc" status: 404 len: 111 microversion: 2.1 time: 0.030983 Aug 09 18:11:02.338164 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3613/6664] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:02 2022] GET /compute/v2.1/servers/5da54cb0-fcac-4d52-b44d-4de1c6811adc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:11:11.148844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1f88ce1b-c544-4b90-9780-98a8e0119837 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'create', calling method: .version_select at 0x7fbbcbb25c10>, body: {"keypair": {"name": "tempest-keypair-291065013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHonKGVFjE/gqCgiKmJRU5pIWR8sscC6jZeRyZUOEOI3atExRLcK454RqqObdhLMDMMNeD1KhDhA9ZA1qRLWE3J4jnfVn8q8rP/KwGGduH9GOEhVpvzFlgNvJq3hsYLcQw=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:11:11.168308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-1f88ce1b-c544-4b90-9780-98a8e0119837 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for project 003c8358132b49d18aafbc868de8ac24. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:11:11.174577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-1f88ce1b-c544-4b90-9780-98a8e0119837 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for user a99b8e16341944698d60f7dde11a2f59 and project 003c8358132b49d18aafbc868de8ac24. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:11:11.211541 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1f88ce1b-c544-4b90-9780-98a8e0119837 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.221172 Aug 09 18:11:11.213328 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3614/6665] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:11:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:11:12.871888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:11:12.877186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2034631997", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8745fc1d-7b31-4237-bfbd-afc627b10e4c"}], "security_groups": [{"name": "tempest-securitygroup--1856683196"}], "key_name": "tempest-keypair-291065013", "user_data": "}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:11:12.993527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] validate_networks() for [('8745fc1d-7b31-4237-bfbd-afc627b10e4c', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:11:13.520329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:11:13.520836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:11:13.522050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:11:13.522753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:11:13.523285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:11:13.533236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:13.533754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:13.534192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:13.534925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:13.535445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:13.535910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:13.554283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:11:13.560713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for user a99b8e16341944698d60f7dde11a2f59 and project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:11:13.574299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:11:13.576457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:11:13.626908 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-209d7fd1-f946-4b5f-9f6c-49efe73cd6da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.756629 Aug 09 18:11:13.627981 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3615/6666] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:11:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:11:13.641025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2be7387-96c9-40e9-a192-564adced0ee8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:13.641979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2be7387-96c9-40e9-a192-564adced0ee8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:13.706516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d2be7387-96c9-40e9-a192-564adced0ee8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:13.718528 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d2be7387-96c9-40e9-a192-564adced0ee8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1238 microversion: 2.1 time: 0.082531 Aug 09 18:11:13.719428 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3616/6667] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:13 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:11:14.743567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c35e906a-e2da-4fce-bed6-11b715e22689 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:14.744488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c35e906a-e2da-4fce-bed6-11b715e22689 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:14.752449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c35e906a-e2da-4fce-bed6-11b715e22689 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:14.752920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c35e906a-e2da-4fce-bed6-11b715e22689 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:14.753370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c35e906a-e2da-4fce-bed6-11b715e22689 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:14.754112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c35e906a-e2da-4fce-bed6-11b715e22689 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:14.754579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c35e906a-e2da-4fce-bed6-11b715e22689 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:14.756184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c35e906a-e2da-4fce-bed6-11b715e22689 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:14.842697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c35e906a-e2da-4fce-bed6-11b715e22689 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:14.860454 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c35e906a-e2da-4fce-bed6-11b715e22689 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1290 microversion: 2.1 time: 0.121772 Aug 09 18:11:14.861882 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3617/6668] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:14 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1290 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:11:15.885744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d57ff1d2-2446-45df-8c13-da65adbd8c11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:15.886669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d57ff1d2-2446-45df-8c13-da65adbd8c11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:15.896995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d57ff1d2-2446-45df-8c13-da65adbd8c11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:15.897634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d57ff1d2-2446-45df-8c13-da65adbd8c11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:15.898097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d57ff1d2-2446-45df-8c13-da65adbd8c11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:15.898875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d57ff1d2-2446-45df-8c13-da65adbd8c11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:15.899375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d57ff1d2-2446-45df-8c13-da65adbd8c11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:15.899841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d57ff1d2-2446-45df-8c13-da65adbd8c11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:16.095889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d57ff1d2-2446-45df-8c13-da65adbd8c11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:16.104164 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d57ff1d2-2446-45df-8c13-da65adbd8c11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1364 microversion: 2.1 time: 0.225221 Aug 09 18:11:16.104885 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3618/6669] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:15 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:11:16.432618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-01ba7d2b-f195-4aee-b3f5-3e93f455c5b6 req-952ff578-0ff3-4a3e-9807-550568a36e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b428af97-8e47-43b6-9a3c-35457461d986", "tag": "60279fe9-73ac-445e-8bb7-788119e042da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:11:16.443644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-01ba7d2b-f195-4aee-b3f5-3e93f455c5b6 req-952ff578-0ff3-4a3e-9807-550568a36e24 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:16.444589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-01ba7d2b-f195-4aee-b3f5-3e93f455c5b6 req-952ff578-0ff3-4a3e-9807-550568a36e24 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:16.445089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-01ba7d2b-f195-4aee-b3f5-3e93f455c5b6 req-952ff578-0ff3-4a3e-9807-550568a36e24 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:16.457485 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-01ba7d2b-f195-4aee-b3f5-3e93f455c5b6 req-952ff578-0ff3-4a3e-9807-550568a36e24 service nova] Creating event network-changed:60279fe9-73ac-445e-8bb7-788119e042da for instance b428af97-8e47-43b6-9a3c-35457461d986 on n-h2-845781-6 Aug 09 18:11:16.464751 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-01ba7d2b-f195-4aee-b3f5-3e93f455c5b6 req-952ff578-0ff3-4a3e-9807-550568a36e24 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034584 Aug 09 18:11:16.464751 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3619/6670] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:11:17.127739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06d51029-bf48-4e11-85c3-f669fa00f7e1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:17.128445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-06d51029-bf48-4e11-85c3-f669fa00f7e1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:17.136234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06d51029-bf48-4e11-85c3-f669fa00f7e1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:17.136726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06d51029-bf48-4e11-85c3-f669fa00f7e1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:17.137166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06d51029-bf48-4e11-85c3-f669fa00f7e1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:17.137865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06d51029-bf48-4e11-85c3-f669fa00f7e1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:17.138320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06d51029-bf48-4e11-85c3-f669fa00f7e1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:17.138747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06d51029-bf48-4e11-85c3-f669fa00f7e1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:17.276929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-06d51029-bf48-4e11-85c3-f669fa00f7e1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:17.284547 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-06d51029-bf48-4e11-85c3-f669fa00f7e1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1364 microversion: 2.1 time: 0.161062 Aug 09 18:11:17.285137 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3620/6671] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:17 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:11:18.306176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6e6c8160-7a25-4304-98c1-d56bea90b3e3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:18.306880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6e6c8160-7a25-4304-98c1-d56bea90b3e3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:18.315966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e6c8160-7a25-4304-98c1-d56bea90b3e3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:18.316520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e6c8160-7a25-4304-98c1-d56bea90b3e3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:18.317020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e6c8160-7a25-4304-98c1-d56bea90b3e3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:18.317981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e6c8160-7a25-4304-98c1-d56bea90b3e3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:18.319035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e6c8160-7a25-4304-98c1-d56bea90b3e3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:18.319645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6e6c8160-7a25-4304-98c1-d56bea90b3e3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:18.461596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6e6c8160-7a25-4304-98c1-d56bea90b3e3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:18.469372 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6e6c8160-7a25-4304-98c1-d56bea90b3e3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1364 microversion: 2.1 time: 0.167630 Aug 09 18:11:18.469970 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3621/6672] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:18 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:11:19.489312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8583f436-27e6-4345-94f3-1bcb37c572a6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:19.490471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8583f436-27e6-4345-94f3-1bcb37c572a6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:19.497423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8583f436-27e6-4345-94f3-1bcb37c572a6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:19.497914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8583f436-27e6-4345-94f3-1bcb37c572a6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:19.498353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8583f436-27e6-4345-94f3-1bcb37c572a6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:19.499054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8583f436-27e6-4345-94f3-1bcb37c572a6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:19.499505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8583f436-27e6-4345-94f3-1bcb37c572a6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:19.499956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8583f436-27e6-4345-94f3-1bcb37c572a6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:19.637663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8583f436-27e6-4345-94f3-1bcb37c572a6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:19.645521 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8583f436-27e6-4345-94f3-1bcb37c572a6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1364 microversion: 2.1 time: 0.160088 Aug 09 18:11:19.646459 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3622/6673] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:19 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:11:20.666791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f56efd69-0e41-4c75-a45a-392be1604b44 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:20.667485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f56efd69-0e41-4c75-a45a-392be1604b44 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:20.674560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f56efd69-0e41-4c75-a45a-392be1604b44 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:20.675054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f56efd69-0e41-4c75-a45a-392be1604b44 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:20.675499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f56efd69-0e41-4c75-a45a-392be1604b44 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:20.676258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f56efd69-0e41-4c75-a45a-392be1604b44 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:20.676725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f56efd69-0e41-4c75-a45a-392be1604b44 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:20.677161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f56efd69-0e41-4c75-a45a-392be1604b44 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:20.821665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f56efd69-0e41-4c75-a45a-392be1604b44 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:20.829463 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f56efd69-0e41-4c75-a45a-392be1604b44 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1364 microversion: 2.1 time: 0.167270 Aug 09 18:11:20.830063 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3623/6674] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:20 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:11:21.844203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-232cb352-3691-4009-9a85-a9af0af39da6 req-ec2953e6-27c0-496d-8d9c-12ef623d10c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b428af97-8e47-43b6-9a3c-35457461d986", "name": "network-vif-plugged", "status": "completed", "tag": "60279fe9-73ac-445e-8bb7-788119e042da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:11:21.855012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-232cb352-3691-4009-9a85-a9af0af39da6 req-ec2953e6-27c0-496d-8d9c-12ef623d10c3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:21.855505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-232cb352-3691-4009-9a85-a9af0af39da6 req-ec2953e6-27c0-496d-8d9c-12ef623d10c3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:21.855969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-232cb352-3691-4009-9a85-a9af0af39da6 req-ec2953e6-27c0-496d-8d9c-12ef623d10c3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:21.869275 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-232cb352-3691-4009-9a85-a9af0af39da6 req-ec2953e6-27c0-496d-8d9c-12ef623d10c3 service nova] Creating event network-vif-plugged:60279fe9-73ac-445e-8bb7-788119e042da for instance b428af97-8e47-43b6-9a3c-35457461d986 on n-h2-845781-6 Aug 09 18:11:21.875002 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-232cb352-3691-4009-9a85-a9af0af39da6 req-ec2953e6-27c0-496d-8d9c-12ef623d10c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034781 Aug 09 18:11:21.875653 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3624/6675] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:11:21.881665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c707b3a6-20e9-4998-ae90-17f493e52577 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:21.882475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c707b3a6-20e9-4998-ae90-17f493e52577 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:21.886396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:11:21.890954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c707b3a6-20e9-4998-ae90-17f493e52577 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:21.891433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c707b3a6-20e9-4998-ae90-17f493e52577 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:21.895130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c707b3a6-20e9-4998-ae90-17f493e52577 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:21.895130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c707b3a6-20e9-4998-ae90-17f493e52577 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:21.895130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c707b3a6-20e9-4998-ae90-17f493e52577 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:21.895130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c707b3a6-20e9-4998-ae90-17f493e52577 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:22.075000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c707b3a6-20e9-4998-ae90-17f493e52577 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:22.084591 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c707b3a6-20e9-4998-ae90-17f493e52577 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1364 microversion: 2.1 time: 0.207087 Aug 09 18:11:22.085207 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3625/6676] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:21 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:11:23.107734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5072634a-26b6-4845-b9da-5825426e5c15 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:23.108352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5072634a-26b6-4845-b9da-5825426e5c15 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:23.115729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5072634a-26b6-4845-b9da-5825426e5c15 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:23.116223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5072634a-26b6-4845-b9da-5825426e5c15 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:23.116668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5072634a-26b6-4845-b9da-5825426e5c15 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:23.117397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5072634a-26b6-4845-b9da-5825426e5c15 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:23.118074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5072634a-26b6-4845-b9da-5825426e5c15 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:23.119805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5072634a-26b6-4845-b9da-5825426e5c15 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:23.260526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5072634a-26b6-4845-b9da-5825426e5c15 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:11:23.268442 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5072634a-26b6-4845-b9da-5825426e5c15 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1550 microversion: 2.1 time: 0.164640 Aug 09 18:11:23.269037 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3626/6677] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:11:23 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1550 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:11:23.289834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3e8510eb-10d3-4e30-ad16-c3fae1a2b2e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:11:23.290632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3e8510eb-10d3-4e30-ad16-c3fae1a2b2e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:11:23.298186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8510eb-10d3-4e30-ad16-c3fae1a2b2e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:23.298731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8510eb-10d3-4e30-ad16-c3fae1a2b2e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:23.299181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8510eb-10d3-4e30-ad16-c3fae1a2b2e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:23.299937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8510eb-10d3-4e30-ad16-c3fae1a2b2e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:23.300405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8510eb-10d3-4e30-ad16-c3fae1a2b2e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:23.300842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3e8510eb-10d3-4e30-ad16-c3fae1a2b2e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:23.391542 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3e8510eb-10d3-4e30-ad16-c3fae1a2b2e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106112 Aug 09 18:11:23.392188 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3627/6678] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 18:11:23 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:11:24.415331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:11:24.417570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:11:24.424109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6dc89559-4359-45a3-bb46-0aba98ab48b8 req-c7c3930e-a1bb-47f2-b99b-d4b97eef523f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b428af97-8e47-43b6-9a3c-35457461d986", "tag": "60279fe9-73ac-445e-8bb7-788119e042da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:11:24.434541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6dc89559-4359-45a3-bb46-0aba98ab48b8 req-c7c3930e-a1bb-47f2-b99b-d4b97eef523f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:11:24.435136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6dc89559-4359-45a3-bb46-0aba98ab48b8 req-c7c3930e-a1bb-47f2-b99b-d4b97eef523f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:11:24.435666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6dc89559-4359-45a3-bb46-0aba98ab48b8 req-c7c3930e-a1bb-47f2-b99b-d4b97eef523f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:11:24.451564 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6dc89559-4359-45a3-bb46-0aba98ab48b8 req-c7c3930e-a1bb-47f2-b99b-d4b97eef523f service nova] Creating event network-changed:60279fe9-73ac-445e-8bb7-788119e042da for instance b428af97-8e47-43b6-9a3c-35457461d986 on n-h2-845781-6 Aug 09 18:11:24.457543 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6dc89559-4359-45a3-bb46-0aba98ab48b8 req-c7c3930e-a1bb-47f2-b99b-d4b97eef523f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042608 Aug 09 18:11:24.458188 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3628/6679] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:12:00.336377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87384775-5891-4b0a-90e1-6b181ed5dfe6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:00.337118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87384775-5891-4b0a-90e1-6b181ed5dfe6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:00.339273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=7 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:12:00.340122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=60 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:12:00.345989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87384775-5891-4b0a-90e1-6b181ed5dfe6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:00.346483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87384775-5891-4b0a-90e1-6b181ed5dfe6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:00.346927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87384775-5891-4b0a-90e1-6b181ed5dfe6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:00.347652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87384775-5891-4b0a-90e1-6b181ed5dfe6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:00.348120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87384775-5891-4b0a-90e1-6b181ed5dfe6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:00.348553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87384775-5891-4b0a-90e1-6b181ed5dfe6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:00.484699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87384775-5891-4b0a-90e1-6b181ed5dfe6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:00.492253 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87384775-5891-4b0a-90e1-6b181ed5dfe6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1669 microversion: 2.1 time: 0.161462 Aug 09 18:12:00.492820 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3629/6680] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:00 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:00.512883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-557617b1-4158-4a99-b44d-8cd2e5f9a52a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:00.513498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-557617b1-4158-4a99-b44d-8cd2e5f9a52a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:00.519188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-557617b1-4158-4a99-b44d-8cd2e5f9a52a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:00.519696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-557617b1-4158-4a99-b44d-8cd2e5f9a52a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:00.520142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-557617b1-4158-4a99-b44d-8cd2e5f9a52a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:00.521439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-557617b1-4158-4a99-b44d-8cd2e5f9a52a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:00.521896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-557617b1-4158-4a99-b44d-8cd2e5f9a52a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:00.522322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-557617b1-4158-4a99-b44d-8cd2e5f9a52a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:00.652725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-557617b1-4158-4a99-b44d-8cd2e5f9a52a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:00.660316 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-557617b1-4158-4a99-b44d-8cd2e5f9a52a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1669 microversion: 2.1 time: 0.150995 Aug 09 18:12:00.660916 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3630/6681] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:00 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:00.681401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6bdcfbd-0e98-4475-be3d-4f09ea07bb9d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:00.682004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f6bdcfbd-0e98-4475-be3d-4f09ea07bb9d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:00.688036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfbd-0e98-4475-be3d-4f09ea07bb9d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:00.688517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfbd-0e98-4475-be3d-4f09ea07bb9d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:00.688955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfbd-0e98-4475-be3d-4f09ea07bb9d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:00.689642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfbd-0e98-4475-be3d-4f09ea07bb9d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:00.690098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfbd-0e98-4475-be3d-4f09ea07bb9d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:00.690521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6bdcfbd-0e98-4475-be3d-4f09ea07bb9d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:00.821480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f6bdcfbd-0e98-4475-be3d-4f09ea07bb9d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:00.829069 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f6bdcfbd-0e98-4475-be3d-4f09ea07bb9d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1669 microversion: 2.1 time: 0.151374 Aug 09 18:12:00.829649 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3631/6682] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:00 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:00.848874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:00.851018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:00.857095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:00.857586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:00.858033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:00.858733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:00.859199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:00.859647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:00.888343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:00.894351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Old instance type m1.heat2, new instance type m1.heat {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 18:12:00.900767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:12:00.901197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:12:00.901682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:12:00.902098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:12:00.902516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:12:00.966843 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d025688c-d401-4a30-8a35-c715368c1ada tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986/action" status: 202 len: 0 microversion: 2.1 time: 0.121697 Aug 09 18:12:00.967722 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3632/6683] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:12:00 2022] POST /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:12:00.975782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-725dd8b6-a512-4097-92e9-4a955ad0f5da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:00.976408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-725dd8b6-a512-4097-92e9-4a955ad0f5da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:00.982715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725dd8b6-a512-4097-92e9-4a955ad0f5da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:00.983212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725dd8b6-a512-4097-92e9-4a955ad0f5da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:00.983756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725dd8b6-a512-4097-92e9-4a955ad0f5da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:00.984470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725dd8b6-a512-4097-92e9-4a955ad0f5da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:00.984938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725dd8b6-a512-4097-92e9-4a955ad0f5da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:00.985372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-725dd8b6-a512-4097-92e9-4a955ad0f5da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:01.133069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-725dd8b6-a512-4097-92e9-4a955ad0f5da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:01.141000 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-725dd8b6-a512-4097-92e9-4a955ad0f5da tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1678 microversion: 2.1 time: 0.169338 Aug 09 18:12:01.141523 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3633/6684] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:00 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:02.162050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4d969ba-04f0-45ba-b010-8d5231bb00ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:02.162726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c4d969ba-04f0-45ba-b010-8d5231bb00ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:02.170081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4d969ba-04f0-45ba-b010-8d5231bb00ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:02.170606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4d969ba-04f0-45ba-b010-8d5231bb00ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:02.171029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4d969ba-04f0-45ba-b010-8d5231bb00ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:02.171757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4d969ba-04f0-45ba-b010-8d5231bb00ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:02.172215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4d969ba-04f0-45ba-b010-8d5231bb00ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:02.172641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4d969ba-04f0-45ba-b010-8d5231bb00ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:02.311853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c4d969ba-04f0-45ba-b010-8d5231bb00ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:02.319959 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c4d969ba-04f0-45ba-b010-8d5231bb00ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1678 microversion: 2.1 time: 0.162444 Aug 09 18:12:02.320569 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3634/6685] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:02 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:03.341891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cf2c6847-6029-4cca-9e19-64e3ffe52a64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:03.342558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cf2c6847-6029-4cca-9e19-64e3ffe52a64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:03.349492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf2c6847-6029-4cca-9e19-64e3ffe52a64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:03.350099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf2c6847-6029-4cca-9e19-64e3ffe52a64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:03.350429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf2c6847-6029-4cca-9e19-64e3ffe52a64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:03.351129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf2c6847-6029-4cca-9e19-64e3ffe52a64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:03.351593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf2c6847-6029-4cca-9e19-64e3ffe52a64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:03.352127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cf2c6847-6029-4cca-9e19-64e3ffe52a64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:03.489827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cf2c6847-6029-4cca-9e19-64e3ffe52a64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:03.497388 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cf2c6847-6029-4cca-9e19-64e3ffe52a64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.159379 Aug 09 18:12:03.497965 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3635/6686] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:03 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:04.518804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d62942dc-c811-4a0a-a275-befa83bff1a8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:04.519494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d62942dc-c811-4a0a-a275-befa83bff1a8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:04.526698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d62942dc-c811-4a0a-a275-befa83bff1a8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:04.527171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d62942dc-c811-4a0a-a275-befa83bff1a8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:04.527646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d62942dc-c811-4a0a-a275-befa83bff1a8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:04.528344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d62942dc-c811-4a0a-a275-befa83bff1a8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:04.528795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d62942dc-c811-4a0a-a275-befa83bff1a8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:04.529213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d62942dc-c811-4a0a-a275-befa83bff1a8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:04.658869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d62942dc-c811-4a0a-a275-befa83bff1a8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:04.666428 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d62942dc-c811-4a0a-a275-befa83bff1a8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.151500 Aug 09 18:12:04.667004 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3636/6687] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:04 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:05.688930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1ddb4b16-ddb2-45b4-bdfe-8646fb5e4d67 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:05.689645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1ddb4b16-ddb2-45b4-bdfe-8646fb5e4d67 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:05.696409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ddb4b16-ddb2-45b4-bdfe-8646fb5e4d67 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:05.696894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ddb4b16-ddb2-45b4-bdfe-8646fb5e4d67 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:05.697335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ddb4b16-ddb2-45b4-bdfe-8646fb5e4d67 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:05.698089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ddb4b16-ddb2-45b4-bdfe-8646fb5e4d67 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:05.698490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ddb4b16-ddb2-45b4-bdfe-8646fb5e4d67 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:05.698916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ddb4b16-ddb2-45b4-bdfe-8646fb5e4d67 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:05.836431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1ddb4b16-ddb2-45b4-bdfe-8646fb5e4d67 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:05.844071 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1ddb4b16-ddb2-45b4-bdfe-8646fb5e4d67 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.159085 Aug 09 18:12:05.844652 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3637/6688] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:05 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:06.866416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a574a585-0082-49a7-9380-d4bc0bd93687 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:06.867159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a574a585-0082-49a7-9380-d4bc0bd93687 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:06.875377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a574a585-0082-49a7-9380-d4bc0bd93687 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:06.875988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a574a585-0082-49a7-9380-d4bc0bd93687 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:06.876510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a574a585-0082-49a7-9380-d4bc0bd93687 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:06.877393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a574a585-0082-49a7-9380-d4bc0bd93687 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:06.877963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a574a585-0082-49a7-9380-d4bc0bd93687 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:06.878484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a574a585-0082-49a7-9380-d4bc0bd93687 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:07.013750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a574a585-0082-49a7-9380-d4bc0bd93687 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:07.021300 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a574a585-0082-49a7-9380-d4bc0bd93687 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.160281 Aug 09 18:12:07.021877 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3638/6689] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:06 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:08.042452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e83dbfc1-aa89-4afc-a527-a6871f465027 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:08.043062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e83dbfc1-aa89-4afc-a527-a6871f465027 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:08.050119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e83dbfc1-aa89-4afc-a527-a6871f465027 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:08.050628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e83dbfc1-aa89-4afc-a527-a6871f465027 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:08.051066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e83dbfc1-aa89-4afc-a527-a6871f465027 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:08.051842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e83dbfc1-aa89-4afc-a527-a6871f465027 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:08.052295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e83dbfc1-aa89-4afc-a527-a6871f465027 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:08.052722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e83dbfc1-aa89-4afc-a527-a6871f465027 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:08.188174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e83dbfc1-aa89-4afc-a527-a6871f465027 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:08.197347 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e83dbfc1-aa89-4afc-a527-a6871f465027 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.158806 Aug 09 18:12:08.197940 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3639/6690] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:08 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:09.218944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06a5a843-eebc-430f-b17d-9248758106a0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:09.219768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-06a5a843-eebc-430f-b17d-9248758106a0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:09.227261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a5a843-eebc-430f-b17d-9248758106a0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:09.227809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a5a843-eebc-430f-b17d-9248758106a0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:09.228258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a5a843-eebc-430f-b17d-9248758106a0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:09.228986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a5a843-eebc-430f-b17d-9248758106a0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:09.229436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a5a843-eebc-430f-b17d-9248758106a0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:09.229897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a5a843-eebc-430f-b17d-9248758106a0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:09.378383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-06a5a843-eebc-430f-b17d-9248758106a0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:09.386915 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-06a5a843-eebc-430f-b17d-9248758106a0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.172191 Aug 09 18:12:09.387534 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3640/6691] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:09 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:10.408435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f1fa6970-738e-4535-9bdc-8bd3445ccb00 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:10.409154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f1fa6970-738e-4535-9bdc-8bd3445ccb00 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:10.416010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1fa6970-738e-4535-9bdc-8bd3445ccb00 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:10.416493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1fa6970-738e-4535-9bdc-8bd3445ccb00 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:10.416927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1fa6970-738e-4535-9bdc-8bd3445ccb00 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:10.417621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1fa6970-738e-4535-9bdc-8bd3445ccb00 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:10.418067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1fa6970-738e-4535-9bdc-8bd3445ccb00 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:10.418493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1fa6970-738e-4535-9bdc-8bd3445ccb00 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:10.553790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f1fa6970-738e-4535-9bdc-8bd3445ccb00 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:10.562540 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f1fa6970-738e-4535-9bdc-8bd3445ccb00 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.157967 Aug 09 18:12:10.563135 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3641/6692] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:10 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:11.584556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8fd22add-5246-4590-adeb-848afe3d7f8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:11.585202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8fd22add-5246-4590-adeb-848afe3d7f8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:11.592052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd22add-5246-4590-adeb-848afe3d7f8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:11.592539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd22add-5246-4590-adeb-848afe3d7f8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:11.592978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd22add-5246-4590-adeb-848afe3d7f8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:11.593667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd22add-5246-4590-adeb-848afe3d7f8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:11.594120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd22add-5246-4590-adeb-848afe3d7f8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:11.594547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fd22add-5246-4590-adeb-848afe3d7f8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:11.737910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8fd22add-5246-4590-adeb-848afe3d7f8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:11.746441 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8fd22add-5246-4590-adeb-848afe3d7f8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.166111 Aug 09 18:12:11.747040 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3642/6693] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:11 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:12.767676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a5457b1e-67c2-442c-8bd3-dfd850b1eaca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:12.768499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a5457b1e-67c2-442c-8bd3-dfd850b1eaca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:12.775526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5457b1e-67c2-442c-8bd3-dfd850b1eaca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:12.776055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5457b1e-67c2-442c-8bd3-dfd850b1eaca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:12.776501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5457b1e-67c2-442c-8bd3-dfd850b1eaca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:12.777240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5457b1e-67c2-442c-8bd3-dfd850b1eaca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:12.777711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5457b1e-67c2-442c-8bd3-dfd850b1eaca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:12.778147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5457b1e-67c2-442c-8bd3-dfd850b1eaca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:12.915963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a5457b1e-67c2-442c-8bd3-dfd850b1eaca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:12.923711 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a5457b1e-67c2-442c-8bd3-dfd850b1eaca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.160008 Aug 09 18:12:12.924303 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3643/6694] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:12 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:13.945564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0dde08cf-796d-4d59-9c2f-84215d2dd69e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:13.946207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0dde08cf-796d-4d59-9c2f-84215d2dd69e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:13.953276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dde08cf-796d-4d59-9c2f-84215d2dd69e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:13.953763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dde08cf-796d-4d59-9c2f-84215d2dd69e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:13.954199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dde08cf-796d-4d59-9c2f-84215d2dd69e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:13.954897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dde08cf-796d-4d59-9c2f-84215d2dd69e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:13.955346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dde08cf-796d-4d59-9c2f-84215d2dd69e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:13.956063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0dde08cf-796d-4d59-9c2f-84215d2dd69e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:13.960301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:12:14.092453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0dde08cf-796d-4d59-9c2f-84215d2dd69e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:14.100702 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0dde08cf-796d-4d59-9c2f-84215d2dd69e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.159106 Aug 09 18:12:14.101284 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3644/6695] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:13 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:15.123543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f742279e-1a91-4069-8d16-422db4b505ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:15.124039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f742279e-1a91-4069-8d16-422db4b505ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:15.132553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f742279e-1a91-4069-8d16-422db4b505ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:15.133047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f742279e-1a91-4069-8d16-422db4b505ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:15.133486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f742279e-1a91-4069-8d16-422db4b505ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:15.134192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f742279e-1a91-4069-8d16-422db4b505ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:15.134647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f742279e-1a91-4069-8d16-422db4b505ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:15.135073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f742279e-1a91-4069-8d16-422db4b505ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:15.295577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f742279e-1a91-4069-8d16-422db4b505ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:15.308755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f742279e-1a91-4069-8d16-422db4b505ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.190169 Aug 09 18:12:15.310016 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3645/6696] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:15 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:16.337969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-548887b4-abb2-4960-af1b-4bc7df46bd03 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:16.338660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-548887b4-abb2-4960-af1b-4bc7df46bd03 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:16.345839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548887b4-abb2-4960-af1b-4bc7df46bd03 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:16.346326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548887b4-abb2-4960-af1b-4bc7df46bd03 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:16.346762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548887b4-abb2-4960-af1b-4bc7df46bd03 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:16.347460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548887b4-abb2-4960-af1b-4bc7df46bd03 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:16.347940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548887b4-abb2-4960-af1b-4bc7df46bd03 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:16.348941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-548887b4-abb2-4960-af1b-4bc7df46bd03 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:16.482634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-548887b4-abb2-4960-af1b-4bc7df46bd03 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:16.499204 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-548887b4-abb2-4960-af1b-4bc7df46bd03 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.164967 Aug 09 18:12:16.499845 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3646/6697] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:16 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:17.521117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-72cf766d-baea-4a18-be19-33689e0e30c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:17.521850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-72cf766d-baea-4a18-be19-33689e0e30c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:17.528823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cf766d-baea-4a18-be19-33689e0e30c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:17.529322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cf766d-baea-4a18-be19-33689e0e30c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:17.529765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cf766d-baea-4a18-be19-33689e0e30c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:17.530473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cf766d-baea-4a18-be19-33689e0e30c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:17.530934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cf766d-baea-4a18-be19-33689e0e30c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:17.531367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72cf766d-baea-4a18-be19-33689e0e30c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:17.671893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-72cf766d-baea-4a18-be19-33689e0e30c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:17.682963 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-72cf766d-baea-4a18-be19-33689e0e30c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.166244 Aug 09 18:12:17.683761 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3647/6698] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:17 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:18.704705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d732ec0-d81f-4ccf-925f-fe7f6b237cc3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:18.705573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5d732ec0-d81f-4ccf-925f-fe7f6b237cc3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:18.713206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d732ec0-d81f-4ccf-925f-fe7f6b237cc3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:18.713691 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d732ec0-d81f-4ccf-925f-fe7f6b237cc3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:18.714132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d732ec0-d81f-4ccf-925f-fe7f6b237cc3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:18.714837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d732ec0-d81f-4ccf-925f-fe7f6b237cc3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:18.715285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d732ec0-d81f-4ccf-925f-fe7f6b237cc3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:18.715735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d732ec0-d81f-4ccf-925f-fe7f6b237cc3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:18.883035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5d732ec0-d81f-4ccf-925f-fe7f6b237cc3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:18.891578 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5d732ec0-d81f-4ccf-925f-fe7f6b237cc3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1683 microversion: 2.1 time: 0.190452 Aug 09 18:12:18.892289 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3648/6699] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:18 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:19.915857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-950361d8-af68-4ee5-91c7-617b2b3a195b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:19.916561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-950361d8-af68-4ee5-91c7-617b2b3a195b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:19.924990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-950361d8-af68-4ee5-91c7-617b2b3a195b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:19.925495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-950361d8-af68-4ee5-91c7-617b2b3a195b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:19.926033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-950361d8-af68-4ee5-91c7-617b2b3a195b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:19.926643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-950361d8-af68-4ee5-91c7-617b2b3a195b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:19.927101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-950361d8-af68-4ee5-91c7-617b2b3a195b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:19.927522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-950361d8-af68-4ee5-91c7-617b2b3a195b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:20.071902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-950361d8-af68-4ee5-91c7-617b2b3a195b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:20.080006 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-950361d8-af68-4ee5-91c7-617b2b3a195b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1682 microversion: 2.1 time: 0.168086 Aug 09 18:12:20.080605 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3649/6700] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:19 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:20.396896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-7b653544-0607-476a-b18b-893e1e9c3d73 req-b3dbcc40-5e30-499f-8d06-d65cc7061c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b428af97-8e47-43b6-9a3c-35457461d986", "name": "network-vif-unplugged", "status": "completed", "tag": "60279fe9-73ac-445e-8bb7-788119e042da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:20.407041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7b653544-0607-476a-b18b-893e1e9c3d73 req-b3dbcc40-5e30-499f-8d06-d65cc7061c0e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:20.408035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7b653544-0607-476a-b18b-893e1e9c3d73 req-b3dbcc40-5e30-499f-8d06-d65cc7061c0e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:20.408402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7b653544-0607-476a-b18b-893e1e9c3d73 req-b3dbcc40-5e30-499f-8d06-d65cc7061c0e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:20.421776 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-7b653544-0607-476a-b18b-893e1e9c3d73 req-b3dbcc40-5e30-499f-8d06-d65cc7061c0e service nova] Creating event network-vif-unplugged:60279fe9-73ac-445e-8bb7-788119e042da for instance b428af97-8e47-43b6-9a3c-35457461d986 on n-h1-845781-6 Aug 09 18:12:20.428148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-7b653544-0607-476a-b18b-893e1e9c3d73 req-b3dbcc40-5e30-499f-8d06-d65cc7061c0e service nova] Instance b428af97-8e47-43b6-9a3c-35457461d986 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:12:20.439245 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-7b653544-0607-476a-b18b-893e1e9c3d73 req-b3dbcc40-5e30-499f-8d06-d65cc7061c0e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046067 Aug 09 18:12:20.439916 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3650/6701] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:12:21.103928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d3e9a51-9aa5-4d6b-b6b9-d93d4d41475b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:21.104627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d3e9a51-9aa5-4d6b-b6b9-d93d4d41475b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:21.110826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d3e9a51-9aa5-4d6b-b6b9-d93d4d41475b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:21.111322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d3e9a51-9aa5-4d6b-b6b9-d93d4d41475b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:21.111783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d3e9a51-9aa5-4d6b-b6b9-d93d4d41475b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:21.112483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d3e9a51-9aa5-4d6b-b6b9-d93d4d41475b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:21.112937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d3e9a51-9aa5-4d6b-b6b9-d93d4d41475b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:21.113362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d3e9a51-9aa5-4d6b-b6b9-d93d4d41475b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:21.248823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8d3e9a51-9aa5-4d6b-b6b9-d93d4d41475b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:21.257046 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d3e9a51-9aa5-4d6b-b6b9-d93d4d41475b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1682 microversion: 2.1 time: 0.159284 Aug 09 18:12:21.270787 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3651/6702] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:21 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:12:22.277779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6da8a52-4abe-47a4-8b24-c85cc15d782d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:22.278462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f6da8a52-4abe-47a4-8b24-c85cc15d782d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:22.285253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6da8a52-4abe-47a4-8b24-c85cc15d782d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:22.286271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6da8a52-4abe-47a4-8b24-c85cc15d782d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:22.286710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6da8a52-4abe-47a4-8b24-c85cc15d782d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:22.287395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6da8a52-4abe-47a4-8b24-c85cc15d782d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:22.287875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6da8a52-4abe-47a4-8b24-c85cc15d782d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:22.288300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6da8a52-4abe-47a4-8b24-c85cc15d782d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:22.418478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f6da8a52-4abe-47a4-8b24-c85cc15d782d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:22.426079 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f6da8a52-4abe-47a4-8b24-c85cc15d782d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1680 microversion: 2.1 time: 0.152303 Aug 09 18:12:22.426658 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3652/6703] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:22 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:22.471339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2365da72-130d-4c7b-a515-02e41475c176 req-5b8b3458-cdbb-4b43-ad9c-e03d67ba5ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b428af97-8e47-43b6-9a3c-35457461d986", "tag": "60279fe9-73ac-445e-8bb7-788119e042da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:22.481156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2365da72-130d-4c7b-a515-02e41475c176 req-5b8b3458-cdbb-4b43-ad9c-e03d67ba5ebf service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:22.481641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2365da72-130d-4c7b-a515-02e41475c176 req-5b8b3458-cdbb-4b43-ad9c-e03d67ba5ebf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:22.482078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2365da72-130d-4c7b-a515-02e41475c176 req-5b8b3458-cdbb-4b43-ad9c-e03d67ba5ebf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:22.493502 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2365da72-130d-4c7b-a515-02e41475c176 req-5b8b3458-cdbb-4b43-ad9c-e03d67ba5ebf service nova] Creating event network-changed:60279fe9-73ac-445e-8bb7-788119e042da for instance b428af97-8e47-43b6-9a3c-35457461d986 on n-h1-845781-6 Aug 09 18:12:22.498935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-2365da72-130d-4c7b-a515-02e41475c176 req-5b8b3458-cdbb-4b43-ad9c-e03d67ba5ebf service nova] Instance b428af97-8e47-43b6-9a3c-35457461d986 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:12:22.509674 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2365da72-130d-4c7b-a515-02e41475c176 req-5b8b3458-cdbb-4b43-ad9c-e03d67ba5ebf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041965 Aug 09 18:12:22.510471 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3653/6704] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:12:23.447759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75f554f3-8158-49ea-9aca-3d93305cdc5f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:23.448451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75f554f3-8158-49ea-9aca-3d93305cdc5f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:23.455563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f554f3-8158-49ea-9aca-3d93305cdc5f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:23.456342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f554f3-8158-49ea-9aca-3d93305cdc5f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:23.456780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f554f3-8158-49ea-9aca-3d93305cdc5f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:23.457479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f554f3-8158-49ea-9aca-3d93305cdc5f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:23.457934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f554f3-8158-49ea-9aca-3d93305cdc5f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:23.458362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f554f3-8158-49ea-9aca-3d93305cdc5f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:23.672569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-75f554f3-8158-49ea-9aca-3d93305cdc5f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:23.680685 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75f554f3-8158-49ea-9aca-3d93305cdc5f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1677 microversion: 2.1 time: 0.237259 Aug 09 18:12:23.681369 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3654/6705] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:23 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1677 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:23.703128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e421a38-55a5-45af-b135-54849f2976ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:23.703974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1e421a38-55a5-45af-b135-54849f2976ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:23.710898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e421a38-55a5-45af-b135-54849f2976ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:23.711397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e421a38-55a5-45af-b135-54849f2976ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:23.711900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e421a38-55a5-45af-b135-54849f2976ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:23.712613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e421a38-55a5-45af-b135-54849f2976ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:23.713242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e421a38-55a5-45af-b135-54849f2976ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:23.713676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e421a38-55a5-45af-b135-54849f2976ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:23.785270 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e421a38-55a5-45af-b135-54849f2976ce tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986/action" status: 204 len: 0 microversion: 2.1 time: 0.085253 Aug 09 18:12:23.786623 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3655/6706] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:12:23 2022] POST /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:12:23.796755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-348a70fb-5d5d-4027-b55a-cae98af33d56 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:23.797678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-348a70fb-5d5d-4027-b55a-cae98af33d56 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:23.806300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-348a70fb-5d5d-4027-b55a-cae98af33d56 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:23.806875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-348a70fb-5d5d-4027-b55a-cae98af33d56 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:23.807641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-348a70fb-5d5d-4027-b55a-cae98af33d56 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:23.808246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-348a70fb-5d5d-4027-b55a-cae98af33d56 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:23.808748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-348a70fb-5d5d-4027-b55a-cae98af33d56 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:23.809186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-348a70fb-5d5d-4027-b55a-cae98af33d56 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:23.948899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-348a70fb-5d5d-4027-b55a-cae98af33d56 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:23.957768 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-348a70fb-5d5d-4027-b55a-cae98af33d56 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1677 microversion: 2.1 time: 0.166216 Aug 09 18:12:23.958460 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3656/6707] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:23 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:24.978870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8a5d2b55-f3ac-4ef7-bbb9-47e33b09f690 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:24.979754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8a5d2b55-f3ac-4ef7-bbb9-47e33b09f690 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:24.987528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5d2b55-f3ac-4ef7-bbb9-47e33b09f690 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:24.988084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5d2b55-f3ac-4ef7-bbb9-47e33b09f690 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:24.989162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5d2b55-f3ac-4ef7-bbb9-47e33b09f690 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:24.989999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5d2b55-f3ac-4ef7-bbb9-47e33b09f690 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:24.990476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5d2b55-f3ac-4ef7-bbb9-47e33b09f690 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:24.990910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a5d2b55-f3ac-4ef7-bbb9-47e33b09f690 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:25.132676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8a5d2b55-f3ac-4ef7-bbb9-47e33b09f690 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:25.140487 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8a5d2b55-f3ac-4ef7-bbb9-47e33b09f690 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1669 microversion: 2.1 time: 0.165532 Aug 09 18:12:25.141060 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3657/6708] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:24 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:25.161386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3b09b740-3733-49b5-a3c3-8f2446b01e07 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:25.162012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3b09b740-3733-49b5-a3c3-8f2446b01e07 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:25.167945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b09b740-3733-49b5-a3c3-8f2446b01e07 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:25.168445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b09b740-3733-49b5-a3c3-8f2446b01e07 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:25.168892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b09b740-3733-49b5-a3c3-8f2446b01e07 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:25.169590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b09b740-3733-49b5-a3c3-8f2446b01e07 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:25.170056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b09b740-3733-49b5-a3c3-8f2446b01e07 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:25.170487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b09b740-3733-49b5-a3c3-8f2446b01e07 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:25.303936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3b09b740-3733-49b5-a3c3-8f2446b01e07 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:25.311867 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3b09b740-3733-49b5-a3c3-8f2446b01e07 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1669 microversion: 2.1 time: 0.154690 Aug 09 18:12:25.312457 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3658/6709] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:25 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:25.332993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-08c31b81-a719-49e8-bb32-edb17b106957 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:25.333531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-08c31b81-a719-49e8-bb32-edb17b106957 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:25.339794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08c31b81-a719-49e8-bb32-edb17b106957 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:25.340291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08c31b81-a719-49e8-bb32-edb17b106957 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:25.340754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08c31b81-a719-49e8-bb32-edb17b106957 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:25.341465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08c31b81-a719-49e8-bb32-edb17b106957 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:25.341927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08c31b81-a719-49e8-bb32-edb17b106957 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:25.342358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08c31b81-a719-49e8-bb32-edb17b106957 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:25.481473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-08c31b81-a719-49e8-bb32-edb17b106957 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:25.489335 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-08c31b81-a719-49e8-bb32-edb17b106957 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1669 microversion: 2.1 time: 0.161016 Aug 09 18:12:25.489926 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3659/6710] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:25 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:25.509355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b4ba7756-488c-4117-9650-9f8b48326495 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:25.509858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4ba7756-488c-4117-9650-9f8b48326495 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:25.515919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4ba7756-488c-4117-9650-9f8b48326495 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:25.516410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4ba7756-488c-4117-9650-9f8b48326495 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:25.516854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4ba7756-488c-4117-9650-9f8b48326495 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:25.517556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4ba7756-488c-4117-9650-9f8b48326495 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:25.518013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4ba7756-488c-4117-9650-9f8b48326495 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:25.518446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4ba7756-488c-4117-9650-9f8b48326495 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:25.534554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:12:25.548833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4ba7756-488c-4117-9650-9f8b48326495 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:12:25.634198 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b4ba7756-488c-4117-9650-9f8b48326495 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 204 len: 0 microversion: 2.1 time: 0.128490 Aug 09 18:12:25.634908 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3660/6711] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:12:25 2022] DELETE /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:12:25.643375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e5de4a9a-9843-4d88-8da6-ef4235c42b55 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:25.644362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e5de4a9a-9843-4d88-8da6-ef4235c42b55 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:25.651171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5de4a9a-9843-4d88-8da6-ef4235c42b55 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:25.651788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5de4a9a-9843-4d88-8da6-ef4235c42b55 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:25.652312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5de4a9a-9843-4d88-8da6-ef4235c42b55 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:25.653086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5de4a9a-9843-4d88-8da6-ef4235c42b55 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:25.654160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5de4a9a-9843-4d88-8da6-ef4235c42b55 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:25.654592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5de4a9a-9843-4d88-8da6-ef4235c42b55 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:25.797674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e5de4a9a-9843-4d88-8da6-ef4235c42b55 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:25.805404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e5de4a9a-9843-4d88-8da6-ef4235c42b55 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1675 microversion: 2.1 time: 0.166149 Aug 09 18:12:25.805990 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3661/6712] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:25 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:25.810777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-00ae8b50-2d3a-45f9-abfb-ef9f6ac7ca59 req-b60d7701-2078-4228-82a3-f23a1e7affbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b428af97-8e47-43b6-9a3c-35457461d986", "name": "network-vif-plugged", "status": "completed", "tag": "60279fe9-73ac-445e-8bb7-788119e042da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:25.820966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-00ae8b50-2d3a-45f9-abfb-ef9f6ac7ca59 req-b60d7701-2078-4228-82a3-f23a1e7affbe service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:25.821439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-00ae8b50-2d3a-45f9-abfb-ef9f6ac7ca59 req-b60d7701-2078-4228-82a3-f23a1e7affbe service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:25.821865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-00ae8b50-2d3a-45f9-abfb-ef9f6ac7ca59 req-b60d7701-2078-4228-82a3-f23a1e7affbe service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:25.834043 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-00ae8b50-2d3a-45f9-abfb-ef9f6ac7ca59 req-b60d7701-2078-4228-82a3-f23a1e7affbe service nova] Creating event network-vif-plugged:60279fe9-73ac-445e-8bb7-788119e042da for instance b428af97-8e47-43b6-9a3c-35457461d986 on n-h1-845781-6 Aug 09 18:12:25.839093 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-00ae8b50-2d3a-45f9-abfb-ef9f6ac7ca59 req-b60d7701-2078-4228-82a3-f23a1e7affbe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031914 Aug 09 18:12:25.839721 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3662/6713] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:12:26.827942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6c113293-6dea-4300-bb4d-59dc76e90453 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:26.829249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6c113293-6dea-4300-bb4d-59dc76e90453 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:26.836395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c113293-6dea-4300-bb4d-59dc76e90453 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:26.836883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c113293-6dea-4300-bb4d-59dc76e90453 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:26.837325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c113293-6dea-4300-bb4d-59dc76e90453 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:26.838022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c113293-6dea-4300-bb4d-59dc76e90453 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:26.838492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c113293-6dea-4300-bb4d-59dc76e90453 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:26.838913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6c113293-6dea-4300-bb4d-59dc76e90453 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:26.968497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6c113293-6dea-4300-bb4d-59dc76e90453 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:26.976227 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6c113293-6dea-4300-bb4d-59dc76e90453 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1675 microversion: 2.1 time: 0.152557 Aug 09 18:12:26.976812 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3663/6714] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:26 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:27.894548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-413d1ef0-b9a2-447b-8f29-b79e207c532d req-eaf90027-c4ac-4120-bf1d-673e28d053fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b428af97-8e47-43b6-9a3c-35457461d986", "name": "network-vif-deleted", "tag": "60279fe9-73ac-445e-8bb7-788119e042da"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:27.920363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-413d1ef0-b9a2-447b-8f29-b79e207c532d req-eaf90027-c4ac-4120-bf1d-673e28d053fd service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:27.920998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-413d1ef0-b9a2-447b-8f29-b79e207c532d req-eaf90027-c4ac-4120-bf1d-673e28d053fd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:27.921565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-413d1ef0-b9a2-447b-8f29-b79e207c532d req-eaf90027-c4ac-4120-bf1d-673e28d053fd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:27.934551 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-413d1ef0-b9a2-447b-8f29-b79e207c532d req-eaf90027-c4ac-4120-bf1d-673e28d053fd service nova] Creating event network-vif-deleted:60279fe9-73ac-445e-8bb7-788119e042da for instance b428af97-8e47-43b6-9a3c-35457461d986 on n-h1-845781-6 Aug 09 18:12:27.939732 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-413d1ef0-b9a2-447b-8f29-b79e207c532d req-eaf90027-c4ac-4120-bf1d-673e28d053fd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049081 Aug 09 18:12:27.940613 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3664/6715] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:12:28.000161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:28.001019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:28.008526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:28.009272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:28.009821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:28.010796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:28.011348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:28.011907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:28.048904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:28.049401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:28.049832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:28.050300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lazy-loading 'fault' on Instance uuid b428af97-8e47-43b6-9a3c-35457461d986 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:12:28.099729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:28.108237 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1cf00780-da1c-4230-89d3-eecf64700606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 200 len: 1328 microversion: 2.1 time: 0.112500 Aug 09 18:12:28.108825 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3665/6716] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:27 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 1328 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:29.130869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:29.131494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:29.138351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:29.138703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:29.139205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:29.139936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:29.140480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:29.140833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:29.154165 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 HTTP/1.1 Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b428af97-8e47-43b6-9a3c-35457461d986'} Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:29.155866 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:12:29.159725 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:29.159725 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:29.159725 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:29.159725 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:12:29.159725 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:12:29.159725 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:12:29.159725 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:12:29.159725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:12:29.159725 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e4ed0d4-8bc5-4f4e-bbf5-04877db8ee05 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 404 len: 111 microversion: 2.1 time: 0.031157 Aug 09 18:12:29.159725 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3666/6717] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:29 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:12:29.173666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:29.174364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:29.181254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:29.181752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:29.182281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:29.182997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:29.183463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:29.183931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:29.199665 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 HTTP/1.1 Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b428af97-8e47-43b6-9a3c-35457461d986'} Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:12:29.201211 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:12:29.205035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:12:29.205035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:12:29.205035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:12:29.205035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:12:29.205035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:12:29.205035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:12:29.205035 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:12:29.205035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:12:29.205035 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9f75c798-4571-48f6-bed2-11208882a8d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 404 len: 111 microversion: 2.1 time: 0.032867 Aug 09 18:12:29.205035 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3667/6718] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:29 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:12:29.252490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1473761341", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "8745fc1d-7b31-4237-bfbd-afc627b10e4c"}], "security_groups": [{"name": "tempest-securitygroup--1856683196"}], "key_name": "tempest-keypair-291065013", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:29.365989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] validate_networks() for [('8745fc1d-7b31-4237-bfbd-afc627b10e4c', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:12:29.739865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:12:29.740289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:12:29.740784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:12:29.741176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:12:29.741586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:12:29.750419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:29.750896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:29.751331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:29.752081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:29.752536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:29.752964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:29.769509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:12:29.772236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:12:29.776681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for user a99b8e16341944698d60f7dde11a2f59 and project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:12:29.795132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:12:29.797499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:12:29.844825 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f7bdf459-cb62-481f-bb4e-78a62e93dc9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.596327 Aug 09 18:12:29.845480 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3668/6719] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:12:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:12:29.856705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-178b616b-5342-4c94-9143-a560611d34ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:29.857321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-178b616b-5342-4c94-9143-a560611d34ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:29.922379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-178b616b-5342-4c94-9143-a560611d34ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:29.929962 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-178b616b-5342-4c94-9143-a560611d34ff tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1238 microversion: 2.1 time: 0.076982 Aug 09 18:12:29.930536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3669/6720] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:29 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:30.950697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d83edb02-8f30-484e-8a3f-5c6b3d31b998 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:30.951429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d83edb02-8f30-484e-8a3f-5c6b3d31b998 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:30.964181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d83edb02-8f30-484e-8a3f-5c6b3d31b998 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:30.965088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d83edb02-8f30-484e-8a3f-5c6b3d31b998 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:30.965929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d83edb02-8f30-484e-8a3f-5c6b3d31b998 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:30.967166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d83edb02-8f30-484e-8a3f-5c6b3d31b998 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:30.967763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d83edb02-8f30-484e-8a3f-5c6b3d31b998 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:30.968621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d83edb02-8f30-484e-8a3f-5c6b3d31b998 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:31.038051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d83edb02-8f30-484e-8a3f-5c6b3d31b998 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:31.046233 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d83edb02-8f30-484e-8a3f-5c6b3d31b998 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1296 microversion: 2.1 time: 0.099346 Aug 09 18:12:31.046762 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3670/6721] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:30 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:32.068861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-245e5965-14c3-4999-bc63-69c5cd6f69a7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:32.069701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-245e5965-14c3-4999-bc63-69c5cd6f69a7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:32.076969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-245e5965-14c3-4999-bc63-69c5cd6f69a7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:32.077489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-245e5965-14c3-4999-bc63-69c5cd6f69a7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:32.077930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-245e5965-14c3-4999-bc63-69c5cd6f69a7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:32.078632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-245e5965-14c3-4999-bc63-69c5cd6f69a7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:32.079164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-245e5965-14c3-4999-bc63-69c5cd6f69a7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:32.079594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-245e5965-14c3-4999-bc63-69c5cd6f69a7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:32.226017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-245e5965-14c3-4999-bc63-69c5cd6f69a7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:32.234345 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-245e5965-14c3-4999-bc63-69c5cd6f69a7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1364 microversion: 2.1 time: 0.169938 Aug 09 18:12:32.235256 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3671/6722] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:32 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:32.241242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-17b3a73f-a539-4ff4-b2f5-aa298483b072 req-41d0d08b-bfe3-465a-a9e6-4ff17e3f2e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b869c24-dfc9-4029-96a1-e395665325de", "tag": "746fbb94-0998-498e-8dc4-2f65b2fba424"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:32.251185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-17b3a73f-a539-4ff4-b2f5-aa298483b072 req-41d0d08b-bfe3-465a-a9e6-4ff17e3f2e24 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:32.251697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-17b3a73f-a539-4ff4-b2f5-aa298483b072 req-41d0d08b-bfe3-465a-a9e6-4ff17e3f2e24 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:32.252240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-17b3a73f-a539-4ff4-b2f5-aa298483b072 req-41d0d08b-bfe3-465a-a9e6-4ff17e3f2e24 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:32.264433 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-17b3a73f-a539-4ff4-b2f5-aa298483b072 req-41d0d08b-bfe3-465a-a9e6-4ff17e3f2e24 service nova] Creating event network-changed:746fbb94-0998-498e-8dc4-2f65b2fba424 for instance 2b869c24-dfc9-4029-96a1-e395665325de on n-h2-845781-6 Aug 09 18:12:32.269500 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-17b3a73f-a539-4ff4-b2f5-aa298483b072 req-41d0d08b-bfe3-465a-a9e6-4ff17e3f2e24 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 Aug 09 18:12:32.270206 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3672/6723] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:12:33.258582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-576aa821-ac4d-460d-946a-ca64f58b14e9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:33.259355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-576aa821-ac4d-460d-946a-ca64f58b14e9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:33.265661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-576aa821-ac4d-460d-946a-ca64f58b14e9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:33.266154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-576aa821-ac4d-460d-946a-ca64f58b14e9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:33.266604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-576aa821-ac4d-460d-946a-ca64f58b14e9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:33.267309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-576aa821-ac4d-460d-946a-ca64f58b14e9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:33.267799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-576aa821-ac4d-460d-946a-ca64f58b14e9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:33.268235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-576aa821-ac4d-460d-946a-ca64f58b14e9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:33.399787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-576aa821-ac4d-460d-946a-ca64f58b14e9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:33.407512 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-576aa821-ac4d-460d-946a-ca64f58b14e9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1364 microversion: 2.1 time: 0.154636 Aug 09 18:12:33.408127 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3673/6724] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:33 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:34.429621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dfc81593-2c3d-4380-96d7-2bb95e53044e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:34.430409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dfc81593-2c3d-4380-96d7-2bb95e53044e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:34.437536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dfc81593-2c3d-4380-96d7-2bb95e53044e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:34.438032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dfc81593-2c3d-4380-96d7-2bb95e53044e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:34.438481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dfc81593-2c3d-4380-96d7-2bb95e53044e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:34.439199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dfc81593-2c3d-4380-96d7-2bb95e53044e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:34.439683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dfc81593-2c3d-4380-96d7-2bb95e53044e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:34.440124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dfc81593-2c3d-4380-96d7-2bb95e53044e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:34.575485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dfc81593-2c3d-4380-96d7-2bb95e53044e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:34.583231 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dfc81593-2c3d-4380-96d7-2bb95e53044e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1364 microversion: 2.1 time: 0.158023 Aug 09 18:12:34.583831 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3674/6725] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:34 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:35.603563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3b99828b-e3ea-4c31-a830-b79ced4613d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:35.604260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3b99828b-e3ea-4c31-a830-b79ced4613d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:35.611237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b99828b-e3ea-4c31-a830-b79ced4613d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:35.611764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b99828b-e3ea-4c31-a830-b79ced4613d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:35.612207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b99828b-e3ea-4c31-a830-b79ced4613d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:35.612900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b99828b-e3ea-4c31-a830-b79ced4613d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:35.613354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b99828b-e3ea-4c31-a830-b79ced4613d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:35.613781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b99828b-e3ea-4c31-a830-b79ced4613d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:35.746055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3b99828b-e3ea-4c31-a830-b79ced4613d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:35.753465 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3b99828b-e3ea-4c31-a830-b79ced4613d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1364 microversion: 2.1 time: 0.153774 Aug 09 18:12:35.754544 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3675/6726] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:35 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:36.129966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-34fc0e63-28f5-44a1-985c-0bda3edc9f27 req-75c64050-50fb-402c-854e-87f86b37f4ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b869c24-dfc9-4029-96a1-e395665325de", "name": "network-vif-plugged", "status": "completed", "tag": "746fbb94-0998-498e-8dc4-2f65b2fba424"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:36.139886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-34fc0e63-28f5-44a1-985c-0bda3edc9f27 req-75c64050-50fb-402c-854e-87f86b37f4ee service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:36.140352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-34fc0e63-28f5-44a1-985c-0bda3edc9f27 req-75c64050-50fb-402c-854e-87f86b37f4ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:36.140790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-34fc0e63-28f5-44a1-985c-0bda3edc9f27 req-75c64050-50fb-402c-854e-87f86b37f4ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:36.152030 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-34fc0e63-28f5-44a1-985c-0bda3edc9f27 req-75c64050-50fb-402c-854e-87f86b37f4ee service nova] Creating event network-vif-plugged:746fbb94-0998-498e-8dc4-2f65b2fba424 for instance 2b869c24-dfc9-4029-96a1-e395665325de on n-h2-845781-6 Aug 09 18:12:36.156824 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-34fc0e63-28f5-44a1-985c-0bda3edc9f27 req-75c64050-50fb-402c-854e-87f86b37f4ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031198 Aug 09 18:12:36.157430 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3676/6727] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:12:36.776991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93a056bb-bceb-4484-b6b4-a13c32e83f91 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:36.777682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-93a056bb-bceb-4484-b6b4-a13c32e83f91 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:36.784034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a056bb-bceb-4484-b6b4-a13c32e83f91 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:36.784516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a056bb-bceb-4484-b6b4-a13c32e83f91 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:36.784951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a056bb-bceb-4484-b6b4-a13c32e83f91 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:36.786211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a056bb-bceb-4484-b6b4-a13c32e83f91 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:36.786660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a056bb-bceb-4484-b6b4-a13c32e83f91 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:36.787258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93a056bb-bceb-4484-b6b4-a13c32e83f91 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:36.920180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-93a056bb-bceb-4484-b6b4-a13c32e83f91 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:36.927640 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-93a056bb-bceb-4484-b6b4-a13c32e83f91 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1364 microversion: 2.1 time: 0.155708 Aug 09 18:12:36.928212 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3677/6728] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:36 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:37.948385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-451f2f58-a857-4087-ad2e-b228cda6d96c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:37.949054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-451f2f58-a857-4087-ad2e-b228cda6d96c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:37.955888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-451f2f58-a857-4087-ad2e-b228cda6d96c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:37.956637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-451f2f58-a857-4087-ad2e-b228cda6d96c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:37.957083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-451f2f58-a857-4087-ad2e-b228cda6d96c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:37.957781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-451f2f58-a857-4087-ad2e-b228cda6d96c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:37.958242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-451f2f58-a857-4087-ad2e-b228cda6d96c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:37.958678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-451f2f58-a857-4087-ad2e-b228cda6d96c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:38.095743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-451f2f58-a857-4087-ad2e-b228cda6d96c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:12:38.104022 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-451f2f58-a857-4087-ad2e-b228cda6d96c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1550 microversion: 2.1 time: 0.159512 Aug 09 18:12:38.104600 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3678/6729] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:12:37 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:12:38.124122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d3410192-2b09-4d35-8143-233e0851b780 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:12:38.124647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d3410192-2b09-4d35-8143-233e0851b780 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:12:38.130493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3410192-2b09-4d35-8143-233e0851b780 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:38.130975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3410192-2b09-4d35-8143-233e0851b780 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:38.131410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3410192-2b09-4d35-8143-233e0851b780 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:38.132127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3410192-2b09-4d35-8143-233e0851b780 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:38.132577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3410192-2b09-4d35-8143-233e0851b780 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:38.133003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3410192-2b09-4d35-8143-233e0851b780 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:38.210869 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d3410192-2b09-4d35-8143-233e0851b780 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090350 Aug 09 18:12:38.211579 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3679/6730] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 18:12:38 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:12:39.542542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-853bc1e4-11d5-4d26-8568-0ddfa9f6bd41 req-696c0d53-1cbc-4294-a7b4-17fcbf9b0e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b869c24-dfc9-4029-96a1-e395665325de", "tag": "746fbb94-0998-498e-8dc4-2f65b2fba424"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:12:39.552103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-853bc1e4-11d5-4d26-8568-0ddfa9f6bd41 req-696c0d53-1cbc-4294-a7b4-17fcbf9b0e96 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:12:39.552589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-853bc1e4-11d5-4d26-8568-0ddfa9f6bd41 req-696c0d53-1cbc-4294-a7b4-17fcbf9b0e96 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:12:39.553020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-853bc1e4-11d5-4d26-8568-0ddfa9f6bd41 req-696c0d53-1cbc-4294-a7b4-17fcbf9b0e96 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:12:39.564646 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-853bc1e4-11d5-4d26-8568-0ddfa9f6bd41 req-696c0d53-1cbc-4294-a7b4-17fcbf9b0e96 service nova] Creating event network-changed:746fbb94-0998-498e-8dc4-2f65b2fba424 for instance 2b869c24-dfc9-4029-96a1-e395665325de on n-h2-845781-6 Aug 09 18:12:39.569847 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-853bc1e4-11d5-4d26-8568-0ddfa9f6bd41 req-696c0d53-1cbc-4294-a7b4-17fcbf9b0e96 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092942 Aug 09 18:12:39.570454 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3680/6731] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:13:12.684020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d9aaac69-4983-4bee-966c-3fc6549f2fd6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:12.686236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:12.686937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:12.687917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:12.688660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:12.696839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9aaac69-4983-4bee-966c-3fc6549f2fd6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:12.697331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9aaac69-4983-4bee-966c-3fc6549f2fd6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:12.697772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d9aaac69-4983-4bee-966c-3fc6549f2fd6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:12.724139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d9aaac69-4983-4bee-966c-3fc6549f2fd6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Going to try to stop instance {{(pid=119431) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 18:13:12.767518 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d9aaac69-4983-4bee-966c-3fc6549f2fd6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de/action" status: 202 len: 0 microversion: 2.1 time: 0.088003 Aug 09 18:13:12.768331 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3681/6732] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:13:12 2022] POST /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:13:12.777900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8c901b6-b232-46a6-b259-f50047d66f37 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:12.778620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f8c901b6-b232-46a6-b259-f50047d66f37 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:12.785999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c901b6-b232-46a6-b259-f50047d66f37 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:12.786507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c901b6-b232-46a6-b259-f50047d66f37 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:12.786956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c901b6-b232-46a6-b259-f50047d66f37 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:12.787708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c901b6-b232-46a6-b259-f50047d66f37 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:12.788335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c901b6-b232-46a6-b259-f50047d66f37 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:12.788595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c901b6-b232-46a6-b259-f50047d66f37 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:12.947649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f8c901b6-b232-46a6-b259-f50047d66f37 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:12.955431 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f8c901b6-b232-46a6-b259-f50047d66f37 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1679 microversion: 2.1 time: 0.181746 Aug 09 18:13:12.956052 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3682/6733] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:12 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:13.979134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c15bcdb1-f815-4460-8b83-08dc3629f8e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:13.979832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c15bcdb1-f815-4460-8b83-08dc3629f8e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:13.987064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c15bcdb1-f815-4460-8b83-08dc3629f8e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:13.987592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c15bcdb1-f815-4460-8b83-08dc3629f8e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:13.988563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c15bcdb1-f815-4460-8b83-08dc3629f8e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:13.989267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c15bcdb1-f815-4460-8b83-08dc3629f8e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:13.989727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c15bcdb1-f815-4460-8b83-08dc3629f8e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:13.990155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c15bcdb1-f815-4460-8b83-08dc3629f8e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:14.123736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c15bcdb1-f815-4460-8b83-08dc3629f8e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:14.131582 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c15bcdb1-f815-4460-8b83-08dc3629f8e7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1679 microversion: 2.1 time: 0.157430 Aug 09 18:13:14.132192 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3683/6734] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:13 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:15.154677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0d00062a-4550-4219-a23a-7c8015e117b9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:15.155590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0d00062a-4550-4219-a23a-7c8015e117b9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:15.163658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d00062a-4550-4219-a23a-7c8015e117b9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:15.164152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d00062a-4550-4219-a23a-7c8015e117b9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:15.164599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d00062a-4550-4219-a23a-7c8015e117b9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:15.165300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d00062a-4550-4219-a23a-7c8015e117b9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:15.165748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d00062a-4550-4219-a23a-7c8015e117b9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:15.166170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0d00062a-4550-4219-a23a-7c8015e117b9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:15.316890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0d00062a-4550-4219-a23a-7c8015e117b9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:15.324679 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0d00062a-4550-4219-a23a-7c8015e117b9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1679 microversion: 2.1 time: 0.174640 Aug 09 18:13:15.325266 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3684/6735] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:15 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:13:16.345335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c1e168f7-b7ce-43cc-b8a5-e50ef56db521 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:16.346058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c1e168f7-b7ce-43cc-b8a5-e50ef56db521 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:16.353857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e168f7-b7ce-43cc-b8a5-e50ef56db521 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:16.354359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e168f7-b7ce-43cc-b8a5-e50ef56db521 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:16.354814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e168f7-b7ce-43cc-b8a5-e50ef56db521 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:16.355582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e168f7-b7ce-43cc-b8a5-e50ef56db521 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:16.356055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e168f7-b7ce-43cc-b8a5-e50ef56db521 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:16.356478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1e168f7-b7ce-43cc-b8a5-e50ef56db521 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:16.489642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c1e168f7-b7ce-43cc-b8a5-e50ef56db521 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:16.499954 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c1e168f7-b7ce-43cc-b8a5-e50ef56db521 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1679 microversion: 2.1 time: 0.158322 Aug 09 18:13:16.500802 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3685/6736] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:16 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:17.522896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2f631e7e-ae03-4171-b178-9f123a55654a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:17.523851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2f631e7e-ae03-4171-b178-9f123a55654a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:17.530859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f631e7e-ae03-4171-b178-9f123a55654a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:17.531412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f631e7e-ae03-4171-b178-9f123a55654a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:17.531888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f631e7e-ae03-4171-b178-9f123a55654a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:17.532630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f631e7e-ae03-4171-b178-9f123a55654a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:17.533086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f631e7e-ae03-4171-b178-9f123a55654a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:17.533520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f631e7e-ae03-4171-b178-9f123a55654a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:17.711242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2f631e7e-ae03-4171-b178-9f123a55654a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:17.719388 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2f631e7e-ae03-4171-b178-9f123a55654a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1679 microversion: 2.1 time: 0.200374 Aug 09 18:13:17.720027 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3686/6737] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:17 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:13:18.743377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c55c3ac4-1c62-4aad-9833-2a9a209c0987 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:18.744183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c55c3ac4-1c62-4aad-9833-2a9a209c0987 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:18.751443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c55c3ac4-1c62-4aad-9833-2a9a209c0987 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:18.751980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c55c3ac4-1c62-4aad-9833-2a9a209c0987 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:18.752419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c55c3ac4-1c62-4aad-9833-2a9a209c0987 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:18.753757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c55c3ac4-1c62-4aad-9833-2a9a209c0987 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:18.754284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c55c3ac4-1c62-4aad-9833-2a9a209c0987 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:18.754717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c55c3ac4-1c62-4aad-9833-2a9a209c0987 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:18.900055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c55c3ac4-1c62-4aad-9833-2a9a209c0987 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:18.910245 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c55c3ac4-1c62-4aad-9833-2a9a209c0987 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1679 microversion: 2.1 time: 0.170193 Aug 09 18:13:18.910851 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3687/6738] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:18 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:19.931371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9a26471f-3ab3-4924-ae02-d80a79aeaea0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:19.932138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9a26471f-3ab3-4924-ae02-d80a79aeaea0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:19.939267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a26471f-3ab3-4924-ae02-d80a79aeaea0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:19.939810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a26471f-3ab3-4924-ae02-d80a79aeaea0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:19.940250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a26471f-3ab3-4924-ae02-d80a79aeaea0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:19.941457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a26471f-3ab3-4924-ae02-d80a79aeaea0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:19.941910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a26471f-3ab3-4924-ae02-d80a79aeaea0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:19.942334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9a26471f-3ab3-4924-ae02-d80a79aeaea0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:20.103258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9a26471f-3ab3-4924-ae02-d80a79aeaea0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:20.111192 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9a26471f-3ab3-4924-ae02-d80a79aeaea0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1679 microversion: 2.1 time: 0.184130 Aug 09 18:13:20.111810 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3688/6739] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:19 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:21.134084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-61dec1b6-4bab-44c3-bd22-0c7c7cd04484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:21.134722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61dec1b6-4bab-44c3-bd22-0c7c7cd04484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:21.141697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61dec1b6-4bab-44c3-bd22-0c7c7cd04484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:21.142224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61dec1b6-4bab-44c3-bd22-0c7c7cd04484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:21.142709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61dec1b6-4bab-44c3-bd22-0c7c7cd04484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:21.143451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61dec1b6-4bab-44c3-bd22-0c7c7cd04484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:21.144685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61dec1b6-4bab-44c3-bd22-0c7c7cd04484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:21.145117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61dec1b6-4bab-44c3-bd22-0c7c7cd04484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:21.287009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-61dec1b6-4bab-44c3-bd22-0c7c7cd04484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:21.295197 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-61dec1b6-4bab-44c3-bd22-0c7c7cd04484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1679 microversion: 2.1 time: 0.165067 Aug 09 18:13:21.295821 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3689/6740] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:21 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:22.321530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6d48c294-546b-4f0c-8563-c75c0ab16d28 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:22.322230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6d48c294-546b-4f0c-8563-c75c0ab16d28 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:22.333631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d48c294-546b-4f0c-8563-c75c0ab16d28 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:22.334461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d48c294-546b-4f0c-8563-c75c0ab16d28 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:22.335236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d48c294-546b-4f0c-8563-c75c0ab16d28 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:22.336411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d48c294-546b-4f0c-8563-c75c0ab16d28 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:22.337133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d48c294-546b-4f0c-8563-c75c0ab16d28 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:22.337822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d48c294-546b-4f0c-8563-c75c0ab16d28 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:22.502771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6d48c294-546b-4f0c-8563-c75c0ab16d28 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:22.510847 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6d48c294-546b-4f0c-8563-c75c0ab16d28 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1679 microversion: 2.1 time: 0.195264 Aug 09 18:13:22.511470 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3690/6741] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:22 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:23.531760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd2172fb-f0d9-472c-af7f-dcd1c8f021b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:23.532458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd2172fb-f0d9-472c-af7f-dcd1c8f021b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:23.540018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2172fb-f0d9-472c-af7f-dcd1c8f021b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:23.540504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2172fb-f0d9-472c-af7f-dcd1c8f021b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:23.540940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2172fb-f0d9-472c-af7f-dcd1c8f021b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:23.541631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2172fb-f0d9-472c-af7f-dcd1c8f021b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:23.542080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2172fb-f0d9-472c-af7f-dcd1c8f021b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:23.542499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd2172fb-f0d9-472c-af7f-dcd1c8f021b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:23.690830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd2172fb-f0d9-472c-af7f-dcd1c8f021b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:23.699315 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd2172fb-f0d9-472c-af7f-dcd1c8f021b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1656 microversion: 2.1 time: 0.171296 Aug 09 18:13:23.700046 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3691/6742] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:23 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1656 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:23.722175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:23.724603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:23.731050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:23.731541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:23.732009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:23.732726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:23.733181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:23.733614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:23.765701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:23.773186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Old instance type m1.heat2, new instance type m1.heat {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 18:13:23.783053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:13:23.783376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:13:23.783909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:13:23.784961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:13:23.785395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:13:23.854071 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8f205d2f-8601-4797-976b-1375a119ab2a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de/action" status: 202 len: 0 microversion: 2.1 time: 0.136403 Aug 09 18:13:23.855175 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3692/6743] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:13:23 2022] POST /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:13:23.867584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be1af9f6-3c67-43ed-97f1-cd531b937d42 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:23.868165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-be1af9f6-3c67-43ed-97f1-cd531b937d42 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:23.874966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1af9f6-3c67-43ed-97f1-cd531b937d42 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:23.875465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1af9f6-3c67-43ed-97f1-cd531b937d42 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:23.875928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1af9f6-3c67-43ed-97f1-cd531b937d42 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:23.876733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1af9f6-3c67-43ed-97f1-cd531b937d42 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:23.877318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1af9f6-3c67-43ed-97f1-cd531b937d42 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:23.877750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1af9f6-3c67-43ed-97f1-cd531b937d42 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:24.024364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be1af9f6-3c67-43ed-97f1-cd531b937d42 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:24.032391 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-be1af9f6-3c67-43ed-97f1-cd531b937d42 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1679 microversion: 2.1 time: 0.172344 Aug 09 18:13:24.033293 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3693/6744] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:23 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:25.054599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-717c756d-ba2c-4df9-90f4-f20b32f4309f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:25.055270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-717c756d-ba2c-4df9-90f4-f20b32f4309f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:25.062210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-717c756d-ba2c-4df9-90f4-f20b32f4309f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:25.062701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-717c756d-ba2c-4df9-90f4-f20b32f4309f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:25.063148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-717c756d-ba2c-4df9-90f4-f20b32f4309f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:25.063887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-717c756d-ba2c-4df9-90f4-f20b32f4309f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:25.064352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-717c756d-ba2c-4df9-90f4-f20b32f4309f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:25.064785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-717c756d-ba2c-4df9-90f4-f20b32f4309f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:25.207658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-717c756d-ba2c-4df9-90f4-f20b32f4309f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:25.215422 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-717c756d-ba2c-4df9-90f4-f20b32f4309f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1679 microversion: 2.1 time: 0.165336 Aug 09 18:13:25.216038 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3694/6745] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:25 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:26.237768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8c8eb8e-850a-498f-9b57-bfe79a3918b0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:26.238521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f8c8eb8e-850a-498f-9b57-bfe79a3918b0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:26.245393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c8eb8e-850a-498f-9b57-bfe79a3918b0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:26.245878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c8eb8e-850a-498f-9b57-bfe79a3918b0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:26.246318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c8eb8e-850a-498f-9b57-bfe79a3918b0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:26.247027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c8eb8e-850a-498f-9b57-bfe79a3918b0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:26.247483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c8eb8e-850a-498f-9b57-bfe79a3918b0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:26.247940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8c8eb8e-850a-498f-9b57-bfe79a3918b0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:26.252190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:26.384864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f8c8eb8e-850a-498f-9b57-bfe79a3918b0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:26.392677 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f8c8eb8e-850a-498f-9b57-bfe79a3918b0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1684 microversion: 2.1 time: 0.159301 Aug 09 18:13:26.393266 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3695/6746] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:26 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:27.414965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-615280e5-70f7-42e5-bfea-1ac2701b3c38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:27.415611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-615280e5-70f7-42e5-bfea-1ac2701b3c38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:27.422344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-615280e5-70f7-42e5-bfea-1ac2701b3c38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:27.422894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-615280e5-70f7-42e5-bfea-1ac2701b3c38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:27.423409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-615280e5-70f7-42e5-bfea-1ac2701b3c38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:27.424141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-615280e5-70f7-42e5-bfea-1ac2701b3c38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:27.424598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-615280e5-70f7-42e5-bfea-1ac2701b3c38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:27.425666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-615280e5-70f7-42e5-bfea-1ac2701b3c38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:27.560141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-615280e5-70f7-42e5-bfea-1ac2701b3c38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:27.568918 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-615280e5-70f7-42e5-bfea-1ac2701b3c38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1684 microversion: 2.1 time: 0.157998 Aug 09 18:13:27.569500 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3696/6747] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:27 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:13:28.539106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-164c7f32-9ae2-4f4d-bd11-210514bb2f43 req-aff86182-954f-42c1-b812-19d25efc6f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b869c24-dfc9-4029-96a1-e395665325de", "name": "network-vif-unplugged", "status": "completed", "tag": "746fbb94-0998-498e-8dc4-2f65b2fba424"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:28.549055 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-164c7f32-9ae2-4f4d-bd11-210514bb2f43 req-aff86182-954f-42c1-b812-19d25efc6f35 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:28.549615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-164c7f32-9ae2-4f4d-bd11-210514bb2f43 req-aff86182-954f-42c1-b812-19d25efc6f35 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:28.550003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-164c7f32-9ae2-4f4d-bd11-210514bb2f43 req-aff86182-954f-42c1-b812-19d25efc6f35 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:28.562109 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-164c7f32-9ae2-4f4d-bd11-210514bb2f43 req-aff86182-954f-42c1-b812-19d25efc6f35 service nova] Creating event network-vif-unplugged:746fbb94-0998-498e-8dc4-2f65b2fba424 for instance 2b869c24-dfc9-4029-96a1-e395665325de on n-h1-845781-6 Aug 09 18:13:28.567611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-164c7f32-9ae2-4f4d-bd11-210514bb2f43 req-aff86182-954f-42c1-b812-19d25efc6f35 service nova] Instance 2b869c24-dfc9-4029-96a1-e395665325de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:13:28.579541 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-164c7f32-9ae2-4f4d-bd11-210514bb2f43 req-aff86182-954f-42c1-b812-19d25efc6f35 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102809 Aug 09 18:13:28.580538 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3697/6748] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:13:28.590605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8ee107df-9dc9-4401-a849-7172079d9f87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:28.591352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8ee107df-9dc9-4401-a849-7172079d9f87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:28.598246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ee107df-9dc9-4401-a849-7172079d9f87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:28.598745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ee107df-9dc9-4401-a849-7172079d9f87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:28.599191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ee107df-9dc9-4401-a849-7172079d9f87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:28.599925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ee107df-9dc9-4401-a849-7172079d9f87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:28.600386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ee107df-9dc9-4401-a849-7172079d9f87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:28.600816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8ee107df-9dc9-4401-a849-7172079d9f87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:28.742290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8ee107df-9dc9-4401-a849-7172079d9f87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:28.749964 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8ee107df-9dc9-4401-a849-7172079d9f87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1683 microversion: 2.1 time: 0.163503 Aug 09 18:13:28.750539 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3698/6749] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:28 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:29.775143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b64b2f8f-885d-4a42-8f2f-d63eca83747a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:29.775796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b64b2f8f-885d-4a42-8f2f-d63eca83747a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:29.782824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64b2f8f-885d-4a42-8f2f-d63eca83747a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:29.783320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64b2f8f-885d-4a42-8f2f-d63eca83747a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:29.783845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64b2f8f-885d-4a42-8f2f-d63eca83747a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:29.784563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64b2f8f-885d-4a42-8f2f-d63eca83747a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:29.785024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64b2f8f-885d-4a42-8f2f-d63eca83747a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:29.785609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b64b2f8f-885d-4a42-8f2f-d63eca83747a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:29.932393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b64b2f8f-885d-4a42-8f2f-d63eca83747a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:29.939992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b64b2f8f-885d-4a42-8f2f-d63eca83747a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1681 microversion: 2.1 time: 0.170199 Aug 09 18:13:29.941150 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3699/6750] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:29 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:30.595995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-84892655-c9c7-43f4-a4d8-3339e3d6dec0 req-c693187d-0d44-4462-bf93-d2cd75c4ae34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b869c24-dfc9-4029-96a1-e395665325de", "tag": "746fbb94-0998-498e-8dc4-2f65b2fba424"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:30.606339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-84892655-c9c7-43f4-a4d8-3339e3d6dec0 req-c693187d-0d44-4462-bf93-d2cd75c4ae34 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:30.606817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-84892655-c9c7-43f4-a4d8-3339e3d6dec0 req-c693187d-0d44-4462-bf93-d2cd75c4ae34 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:30.607247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-84892655-c9c7-43f4-a4d8-3339e3d6dec0 req-c693187d-0d44-4462-bf93-d2cd75c4ae34 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:30.619057 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-84892655-c9c7-43f4-a4d8-3339e3d6dec0 req-c693187d-0d44-4462-bf93-d2cd75c4ae34 service nova] Creating event network-changed:746fbb94-0998-498e-8dc4-2f65b2fba424 for instance 2b869c24-dfc9-4029-96a1-e395665325de on n-h1-845781-6 Aug 09 18:13:30.624827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-84892655-c9c7-43f4-a4d8-3339e3d6dec0 req-c693187d-0d44-4462-bf93-d2cd75c4ae34 service nova] Instance 2b869c24-dfc9-4029-96a1-e395665325de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:13:30.635677 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-84892655-c9c7-43f4-a4d8-3339e3d6dec0 req-c693187d-0d44-4462-bf93-d2cd75c4ae34 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043326 Aug 09 18:13:30.636307 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3700/6751] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:13:30.964523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87768c4c-3860-4f68-9ce0-0742236fe203 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:30.965499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87768c4c-3860-4f68-9ce0-0742236fe203 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:30.971707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87768c4c-3860-4f68-9ce0-0742236fe203 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:30.972213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87768c4c-3860-4f68-9ce0-0742236fe203 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:30.972665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87768c4c-3860-4f68-9ce0-0742236fe203 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:30.973375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87768c4c-3860-4f68-9ce0-0742236fe203 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:30.973833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87768c4c-3860-4f68-9ce0-0742236fe203 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:30.974267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87768c4c-3860-4f68-9ce0-0742236fe203 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:31.118002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87768c4c-3860-4f68-9ce0-0742236fe203 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:31.126018 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87768c4c-3860-4f68-9ce0-0742236fe203 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1677 microversion: 2.1 time: 0.166909 Aug 09 18:13:31.126616 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3701/6752] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:30 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:31.146337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-208a742b-a16d-46f9-9fd8-35bd2173472a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:31.146879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-208a742b-a16d-46f9-9fd8-35bd2173472a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:31.155060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208a742b-a16d-46f9-9fd8-35bd2173472a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:31.155671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208a742b-a16d-46f9-9fd8-35bd2173472a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:31.156164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208a742b-a16d-46f9-9fd8-35bd2173472a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:31.157090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208a742b-a16d-46f9-9fd8-35bd2173472a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:31.157630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208a742b-a16d-46f9-9fd8-35bd2173472a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:31.158036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-208a742b-a16d-46f9-9fd8-35bd2173472a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:31.235195 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-208a742b-a16d-46f9-9fd8-35bd2173472a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de/action" status: 204 len: 0 microversion: 2.1 time: 0.092451 Aug 09 18:13:31.237181 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3702/6753] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:13:31 2022] POST /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de/action => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:13:31.247948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2eb5ae0-8c0d-41b6-8761-1882fea13211 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:31.248615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2eb5ae0-8c0d-41b6-8761-1882fea13211 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:31.255680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2eb5ae0-8c0d-41b6-8761-1882fea13211 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:31.256821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2eb5ae0-8c0d-41b6-8761-1882fea13211 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:31.256821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2eb5ae0-8c0d-41b6-8761-1882fea13211 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:31.257390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2eb5ae0-8c0d-41b6-8761-1882fea13211 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:31.258077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2eb5ae0-8c0d-41b6-8761-1882fea13211 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:31.258423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2eb5ae0-8c0d-41b6-8761-1882fea13211 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:31.498516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d2eb5ae0-8c0d-41b6-8761-1882fea13211 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:31.506611 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d2eb5ae0-8c0d-41b6-8761-1882fea13211 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1677 microversion: 2.1 time: 0.265085 Aug 09 18:13:31.507607 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3703/6754] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:31 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1677 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:32.528688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d06943d-dc98-4648-a006-7e5bb25ffc58 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:32.529309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d06943d-dc98-4648-a006-7e5bb25ffc58 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:32.536994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d06943d-dc98-4648-a006-7e5bb25ffc58 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:32.537488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d06943d-dc98-4648-a006-7e5bb25ffc58 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:32.537922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d06943d-dc98-4648-a006-7e5bb25ffc58 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:32.538622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d06943d-dc98-4648-a006-7e5bb25ffc58 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:32.539074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d06943d-dc98-4648-a006-7e5bb25ffc58 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:32.539499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d06943d-dc98-4648-a006-7e5bb25ffc58 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:32.679931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8d06943d-dc98-4648-a006-7e5bb25ffc58 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:32.687805 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d06943d-dc98-4648-a006-7e5bb25ffc58 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1656 microversion: 2.1 time: 0.163065 Aug 09 18:13:32.688351 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3704/6755] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:32 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:13:32.713561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b9492abb-f085-47f6-ba32-528d019066f0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:32.714739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b9492abb-f085-47f6-ba32-528d019066f0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:32.726170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9492abb-f085-47f6-ba32-528d019066f0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:32.726858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9492abb-f085-47f6-ba32-528d019066f0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:32.727451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9492abb-f085-47f6-ba32-528d019066f0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:32.728669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9492abb-f085-47f6-ba32-528d019066f0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:32.729295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9492abb-f085-47f6-ba32-528d019066f0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:32.729936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9492abb-f085-47f6-ba32-528d019066f0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:32.884121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b9492abb-f085-47f6-ba32-528d019066f0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:32.891851 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b9492abb-f085-47f6-ba32-528d019066f0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1656 microversion: 2.1 time: 0.186426 Aug 09 18:13:32.892437 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3705/6756] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:32 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1656 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:32.914695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-43c2ac61-649b-47ee-9853-832c8d72c85f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:32.925106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43c2ac61-649b-47ee-9853-832c8d72c85f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:32.925636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43c2ac61-649b-47ee-9853-832c8d72c85f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:32.926075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-43c2ac61-649b-47ee-9853-832c8d72c85f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:32.949373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-43c2ac61-649b-47ee-9853-832c8d72c85f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Going to try to start instance {{(pid=119431) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 18:13:33.001473 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-43c2ac61-649b-47ee-9853-832c8d72c85f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de/action" status: 202 len: 0 microversion: 2.1 time: 0.090612 Aug 09 18:13:33.002153 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3706/6757] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:13:32 2022] POST /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:13:33.010886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd292ec4-1db8-4f19-bde7-39142987cb51 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:33.011602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fd292ec4-1db8-4f19-bde7-39142987cb51 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:33.017933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd292ec4-1db8-4f19-bde7-39142987cb51 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:33.019197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd292ec4-1db8-4f19-bde7-39142987cb51 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:33.019420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd292ec4-1db8-4f19-bde7-39142987cb51 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:33.020183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd292ec4-1db8-4f19-bde7-39142987cb51 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:33.020651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd292ec4-1db8-4f19-bde7-39142987cb51 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:33.021084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd292ec4-1db8-4f19-bde7-39142987cb51 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:33.176353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fd292ec4-1db8-4f19-bde7-39142987cb51 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:33.184635 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fd292ec4-1db8-4f19-bde7-39142987cb51 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1665 microversion: 2.1 time: 0.177930 Aug 09 18:13:33.185500 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3707/6758] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:33 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:34.210477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3914306f-912d-4b85-bc19-bd4e13de7418 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:34.211741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3914306f-912d-4b85-bc19-bd4e13de7418 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:34.220016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3914306f-912d-4b85-bc19-bd4e13de7418 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:34.220585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3914306f-912d-4b85-bc19-bd4e13de7418 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:34.221063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3914306f-912d-4b85-bc19-bd4e13de7418 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:34.222318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3914306f-912d-4b85-bc19-bd4e13de7418 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:34.222778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3914306f-912d-4b85-bc19-bd4e13de7418 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:34.223205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3914306f-912d-4b85-bc19-bd4e13de7418 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:34.356767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3914306f-912d-4b85-bc19-bd4e13de7418 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:34.364428 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3914306f-912d-4b85-bc19-bd4e13de7418 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1669 microversion: 2.1 time: 0.161718 Aug 09 18:13:34.365014 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3708/6759] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:34 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:13:34.385018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d5fa6b6-d01d-47bf-b1b1-76e0c004e598 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:34.385526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7d5fa6b6-d01d-47bf-b1b1-76e0c004e598 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:34.391494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d5fa6b6-d01d-47bf-b1b1-76e0c004e598 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:34.392018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d5fa6b6-d01d-47bf-b1b1-76e0c004e598 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:34.392469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d5fa6b6-d01d-47bf-b1b1-76e0c004e598 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:34.393175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d5fa6b6-d01d-47bf-b1b1-76e0c004e598 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:34.394175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d5fa6b6-d01d-47bf-b1b1-76e0c004e598 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:34.394612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d5fa6b6-d01d-47bf-b1b1-76e0c004e598 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:34.420268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7d5fa6b6-d01d-47bf-b1b1-76e0c004e598 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:13:34.445372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:34.499845 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7d5fa6b6-d01d-47bf-b1b1-76e0c004e598 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 204 len: 0 microversion: 2.1 time: 0.118469 Aug 09 18:13:34.500530 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3709/6760] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:13:34 2022] DELETE /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:13:34.513386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e48a4c16-7cda-4220-aeed-23c3d7dc1ab7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:34.514090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e48a4c16-7cda-4220-aeed-23c3d7dc1ab7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:34.520747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e48a4c16-7cda-4220-aeed-23c3d7dc1ab7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:34.521238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e48a4c16-7cda-4220-aeed-23c3d7dc1ab7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:34.521684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e48a4c16-7cda-4220-aeed-23c3d7dc1ab7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:34.522380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e48a4c16-7cda-4220-aeed-23c3d7dc1ab7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:34.522845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e48a4c16-7cda-4220-aeed-23c3d7dc1ab7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:34.523276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e48a4c16-7cda-4220-aeed-23c3d7dc1ab7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:34.661121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e48a4c16-7cda-4220-aeed-23c3d7dc1ab7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:34.668794 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e48a4c16-7cda-4220-aeed-23c3d7dc1ab7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1675 microversion: 2.1 time: 0.163185 Aug 09 18:13:34.669373 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3710/6761] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:34 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:35.690673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-937a971d-ac46-4982-8403-72f0a2ed3b8d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:35.691350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-937a971d-ac46-4982-8403-72f0a2ed3b8d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:35.698766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-937a971d-ac46-4982-8403-72f0a2ed3b8d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:35.699254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-937a971d-ac46-4982-8403-72f0a2ed3b8d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:35.699717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-937a971d-ac46-4982-8403-72f0a2ed3b8d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:35.700442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-937a971d-ac46-4982-8403-72f0a2ed3b8d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:35.700896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-937a971d-ac46-4982-8403-72f0a2ed3b8d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:35.701333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-937a971d-ac46-4982-8403-72f0a2ed3b8d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:35.836253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-937a971d-ac46-4982-8403-72f0a2ed3b8d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:35.843750 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-937a971d-ac46-4982-8403-72f0a2ed3b8d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1675 microversion: 2.1 time: 0.157528 Aug 09 18:13:35.844523 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3711/6762] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:35 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:36.060291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8cdd0a3e-e408-49ae-902b-588875344edc req-09494361-1873-4b70-9b64-021ffc73fcb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b869c24-dfc9-4029-96a1-e395665325de", "name": "network-vif-plugged", "status": "completed", "tag": "746fbb94-0998-498e-8dc4-2f65b2fba424"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:36.071560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8cdd0a3e-e408-49ae-902b-588875344edc req-09494361-1873-4b70-9b64-021ffc73fcb7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:36.072327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8cdd0a3e-e408-49ae-902b-588875344edc req-09494361-1873-4b70-9b64-021ffc73fcb7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:36.072837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8cdd0a3e-e408-49ae-902b-588875344edc req-09494361-1873-4b70-9b64-021ffc73fcb7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:36.085498 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8cdd0a3e-e408-49ae-902b-588875344edc req-09494361-1873-4b70-9b64-021ffc73fcb7 service nova] Creating event network-vif-plugged:746fbb94-0998-498e-8dc4-2f65b2fba424 for instance 2b869c24-dfc9-4029-96a1-e395665325de on n-h1-845781-6 Aug 09 18:13:36.090656 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8cdd0a3e-e408-49ae-902b-588875344edc req-09494361-1873-4b70-9b64-021ffc73fcb7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095607 Aug 09 18:13:36.091268 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3712/6763] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:13:36.802152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1759362e-f597-42d0-8d85-5c8c7511946e req-757b57bd-04b5-42dd-b4e4-f3e4b3dce47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b869c24-dfc9-4029-96a1-e395665325de", "name": "network-vif-deleted", "tag": "746fbb94-0998-498e-8dc4-2f65b2fba424"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:36.822964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1759362e-f597-42d0-8d85-5c8c7511946e req-757b57bd-04b5-42dd-b4e4-f3e4b3dce47c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:36.823597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1759362e-f597-42d0-8d85-5c8c7511946e req-757b57bd-04b5-42dd-b4e4-f3e4b3dce47c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:36.824844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1759362e-f597-42d0-8d85-5c8c7511946e req-757b57bd-04b5-42dd-b4e4-f3e4b3dce47c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:36.840172 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1759362e-f597-42d0-8d85-5c8c7511946e req-757b57bd-04b5-42dd-b4e4-f3e4b3dce47c service nova] Creating event network-vif-deleted:746fbb94-0998-498e-8dc4-2f65b2fba424 for instance 2b869c24-dfc9-4029-96a1-e395665325de on n-h1-845781-6 Aug 09 18:13:36.844850 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1759362e-f597-42d0-8d85-5c8c7511946e req-757b57bd-04b5-42dd-b4e4-f3e4b3dce47c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047736 Aug 09 18:13:36.845469 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3713/6764] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:13:36.865011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c233d9f-1388-41d6-8857-e4f8d579ce41 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:36.865730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c233d9f-1388-41d6-8857-e4f8d579ce41 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:36.872548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c233d9f-1388-41d6-8857-e4f8d579ce41 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:36.873676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c233d9f-1388-41d6-8857-e4f8d579ce41 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:36.873676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c233d9f-1388-41d6-8857-e4f8d579ce41 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:36.874184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c233d9f-1388-41d6-8857-e4f8d579ce41 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:36.874647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c233d9f-1388-41d6-8857-e4f8d579ce41 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:36.875080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c233d9f-1388-41d6-8857-e4f8d579ce41 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:36.950772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5c233d9f-1388-41d6-8857-e4f8d579ce41 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:36.960838 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c233d9f-1388-41d6-8857-e4f8d579ce41 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 200 len: 1323 microversion: 2.1 time: 0.099560 Aug 09 18:13:36.961630 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3714/6765] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:36 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 1323 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:37.982129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:37.982743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:37.989819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:37.990703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:37.991171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:37.992067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:37.992579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:37.993017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:38.007745 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de HTTP/1.1 Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '2b869c24-dfc9-4029-96a1-e395665325de'} Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:13:38.009258 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:13:38.014241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:13:38.014241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:13:38.014241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:13:38.014241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:13:38.014241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:13:38.014241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:13:38.014241 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:13:38.014241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:13:38.014241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0983e130-a67a-482e-a53c-6293cb5e4108 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 404 len: 111 microversion: 2.1 time: 0.032685 Aug 09 18:13:38.014241 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3715/6766] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:37 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:13:38.028555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:38.029465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:38.035503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:38.036029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:38.036517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:38.038364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:38.038364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:38.038364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:38.053260 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de HTTP/1.1 Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '2b869c24-dfc9-4029-96a1-e395665325de'} Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:13:38.054857 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:13:38.059257 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:13:38.059257 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:13:38.059257 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:13:38.059257 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:13:38.059257 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:13:38.059257 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:13:38.059257 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:13:38.059257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:13:38.059257 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-06e4cc63-66a2-43b4-b980-4914779f8f20 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 404 len: 111 microversion: 2.1 time: 0.032414 Aug 09 18:13:38.059257 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3716/6767] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:38 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:13:38.106081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-948158156", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "8745fc1d-7b31-4237-bfbd-afc627b10e4c"}], "security_groups": [{"name": "tempest-securitygroup--1856683196"}], "key_name": "tempest-keypair-291065013", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:38.215637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] validate_networks() for [('8745fc1d-7b31-4237-bfbd-afc627b10e4c', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:13:38.650212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:13:38.650641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:13:38.651119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:13:38.651537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:13:38.651976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:13:38.661432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:38.661918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:38.662360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:38.663087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:38.663544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:38.663997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:38.681314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:13:38.686553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for user a99b8e16341944698d60f7dde11a2f59 and project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:13:38.698909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:13:38.701285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:13:38.728350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:38.749756 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d4604b5b-a67d-4c03-bd87-4101d2acc07d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.647509 Aug 09 18:13:38.750420 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3717/6768] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:13:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:13:38.761117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4b2d71ad-7609-4293-bf4f-b38aa655eb1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:38.761750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4b2d71ad-7609-4293-bf4f-b38aa655eb1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:38.817747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4b2d71ad-7609-4293-bf4f-b38aa655eb1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:38.827610 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4b2d71ad-7609-4293-bf4f-b38aa655eb1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1237 microversion: 2.1 time: 0.070189 Aug 09 18:13:38.828222 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3718/6769] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:38 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:39.849625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-10d1eaf2-9ed5-4ffe-9a6f-4f3648347606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:39.850372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-10d1eaf2-9ed5-4ffe-9a6f-4f3648347606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:39.857209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10d1eaf2-9ed5-4ffe-9a6f-4f3648347606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:39.857701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10d1eaf2-9ed5-4ffe-9a6f-4f3648347606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:39.858137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10d1eaf2-9ed5-4ffe-9a6f-4f3648347606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:39.858929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10d1eaf2-9ed5-4ffe-9a6f-4f3648347606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:39.859288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10d1eaf2-9ed5-4ffe-9a6f-4f3648347606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:39.859741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10d1eaf2-9ed5-4ffe-9a6f-4f3648347606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:39.946472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-10d1eaf2-9ed5-4ffe-9a6f-4f3648347606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:39.954809 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-10d1eaf2-9ed5-4ffe-9a6f-4f3648347606 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1295 microversion: 2.1 time: 0.109007 Aug 09 18:13:39.955510 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3719/6770] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:39 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1295 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:40.976649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e215fd9-0768-4bf0-abb8-7a28e097235a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:40.977271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8e215fd9-0768-4bf0-abb8-7a28e097235a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:40.984364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e215fd9-0768-4bf0-abb8-7a28e097235a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:40.984860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e215fd9-0768-4bf0-abb8-7a28e097235a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:40.985307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e215fd9-0768-4bf0-abb8-7a28e097235a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:40.986012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e215fd9-0768-4bf0-abb8-7a28e097235a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:40.986478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e215fd9-0768-4bf0-abb8-7a28e097235a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:40.986914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e215fd9-0768-4bf0-abb8-7a28e097235a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:41.241653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8e215fd9-0768-4bf0-abb8-7a28e097235a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:41.249978 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e215fd9-0768-4bf0-abb8-7a28e097235a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1363 microversion: 2.1 time: 0.277048 Aug 09 18:13:41.250577 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3720/6771] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:40 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:41.255753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fb0af982-60e1-4dee-9256-3b20033cc941 req-a84bcaad-19ff-4e9e-8e34-4e50f891fae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c1612b4-3717-4154-b61f-f9a3743d78fb", "tag": "29a9475d-a8a7-4560-9e4a-c60ff40bf02f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:41.265351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fb0af982-60e1-4dee-9256-3b20033cc941 req-a84bcaad-19ff-4e9e-8e34-4e50f891fae7 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:41.265846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fb0af982-60e1-4dee-9256-3b20033cc941 req-a84bcaad-19ff-4e9e-8e34-4e50f891fae7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:41.266288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fb0af982-60e1-4dee-9256-3b20033cc941 req-a84bcaad-19ff-4e9e-8e34-4e50f891fae7 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:41.278601 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fb0af982-60e1-4dee-9256-3b20033cc941 req-a84bcaad-19ff-4e9e-8e34-4e50f891fae7 service nova] Creating event network-changed:29a9475d-a8a7-4560-9e4a-c60ff40bf02f for instance 1c1612b4-3717-4154-b61f-f9a3743d78fb on n-h2-845781-6 Aug 09 18:13:41.284347 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fb0af982-60e1-4dee-9256-3b20033cc941 req-a84bcaad-19ff-4e9e-8e34-4e50f891fae7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032500 Aug 09 18:13:41.285445 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3721/6772] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:13:42.272732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-82adb9e6-89f9-4b87-8fac-1c249d183bfb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:42.273437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-82adb9e6-89f9-4b87-8fac-1c249d183bfb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:42.280541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82adb9e6-89f9-4b87-8fac-1c249d183bfb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:42.281031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82adb9e6-89f9-4b87-8fac-1c249d183bfb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:42.281471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82adb9e6-89f9-4b87-8fac-1c249d183bfb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:42.282163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82adb9e6-89f9-4b87-8fac-1c249d183bfb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:42.282618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82adb9e6-89f9-4b87-8fac-1c249d183bfb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:42.283047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82adb9e6-89f9-4b87-8fac-1c249d183bfb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:42.505774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-82adb9e6-89f9-4b87-8fac-1c249d183bfb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:42.513868 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-82adb9e6-89f9-4b87-8fac-1c249d183bfb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1363 microversion: 2.1 time: 0.245372 Aug 09 18:13:42.514817 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3722/6773] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:42 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:43.538200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2ee70c80-7755-4472-be1c-94bc7befa484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:43.540227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2ee70c80-7755-4472-be1c-94bc7befa484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:43.545980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ee70c80-7755-4472-be1c-94bc7befa484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:43.546467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ee70c80-7755-4472-be1c-94bc7befa484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:43.546908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ee70c80-7755-4472-be1c-94bc7befa484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:43.547604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ee70c80-7755-4472-be1c-94bc7befa484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:43.548088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ee70c80-7755-4472-be1c-94bc7befa484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:43.548519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2ee70c80-7755-4472-be1c-94bc7befa484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:43.679175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2ee70c80-7755-4472-be1c-94bc7befa484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:43.686702 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2ee70c80-7755-4472-be1c-94bc7befa484 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1363 microversion: 2.1 time: 0.152432 Aug 09 18:13:43.687280 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3723/6774] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:43 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:44.708218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-26f92087-70b6-452a-b759-098c6e57da6a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:44.708920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-26f92087-70b6-452a-b759-098c6e57da6a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:44.715860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26f92087-70b6-452a-b759-098c6e57da6a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:44.716349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26f92087-70b6-452a-b759-098c6e57da6a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:44.716781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26f92087-70b6-452a-b759-098c6e57da6a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:44.717511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26f92087-70b6-452a-b759-098c6e57da6a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:44.717924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26f92087-70b6-452a-b759-098c6e57da6a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:44.718344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-26f92087-70b6-452a-b759-098c6e57da6a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:44.851002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-26f92087-70b6-452a-b759-098c6e57da6a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:44.858557 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-26f92087-70b6-452a-b759-098c6e57da6a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1363 microversion: 2.1 time: 0.155122 Aug 09 18:13:44.859137 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3724/6775] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:44 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:45.884599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-563be559-737a-4c0f-8c7b-52f20d9eb244 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:45.885256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-563be559-737a-4c0f-8c7b-52f20d9eb244 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:45.892230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-563be559-737a-4c0f-8c7b-52f20d9eb244 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:45.892723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-563be559-737a-4c0f-8c7b-52f20d9eb244 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:45.893796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-563be559-737a-4c0f-8c7b-52f20d9eb244 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:45.894514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-563be559-737a-4c0f-8c7b-52f20d9eb244 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:45.894977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-563be559-737a-4c0f-8c7b-52f20d9eb244 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:45.895416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-563be559-737a-4c0f-8c7b-52f20d9eb244 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:46.029130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-563be559-737a-4c0f-8c7b-52f20d9eb244 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:46.036785 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-563be559-737a-4c0f-8c7b-52f20d9eb244 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1363 microversion: 2.1 time: 0.155992 Aug 09 18:13:46.037305 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3725/6776] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:45 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:46.405990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a2b98367-846d-4117-a063-4614333550cf req-bc6214b5-af0c-40da-95f1-eede5acda03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1612b4-3717-4154-b61f-f9a3743d78fb", "name": "network-vif-plugged", "status": "completed", "tag": "29a9475d-a8a7-4560-9e4a-c60ff40bf02f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:46.415975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a2b98367-846d-4117-a063-4614333550cf req-bc6214b5-af0c-40da-95f1-eede5acda03f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:46.416456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a2b98367-846d-4117-a063-4614333550cf req-bc6214b5-af0c-40da-95f1-eede5acda03f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:46.416888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a2b98367-846d-4117-a063-4614333550cf req-bc6214b5-af0c-40da-95f1-eede5acda03f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:46.428749 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a2b98367-846d-4117-a063-4614333550cf req-bc6214b5-af0c-40da-95f1-eede5acda03f service nova] Creating event network-vif-plugged:29a9475d-a8a7-4560-9e4a-c60ff40bf02f for instance 1c1612b4-3717-4154-b61f-f9a3743d78fb on n-h2-845781-6 Aug 09 18:13:46.433804 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a2b98367-846d-4117-a063-4614333550cf req-bc6214b5-af0c-40da-95f1-eede5acda03f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031722 Aug 09 18:13:46.434469 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3726/6777] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:13:47.058663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4ec42c8-7910-45df-a926-5da4c8fcb5d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:47.059362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a4ec42c8-7910-45df-a926-5da4c8fcb5d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:47.065545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4ec42c8-7910-45df-a926-5da4c8fcb5d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:47.066025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4ec42c8-7910-45df-a926-5da4c8fcb5d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:47.066458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4ec42c8-7910-45df-a926-5da4c8fcb5d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:47.067143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4ec42c8-7910-45df-a926-5da4c8fcb5d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:47.067591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4ec42c8-7910-45df-a926-5da4c8fcb5d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:47.068043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4ec42c8-7910-45df-a926-5da4c8fcb5d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:47.198317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a4ec42c8-7910-45df-a926-5da4c8fcb5d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:47.206611 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4ec42c8-7910-45df-a926-5da4c8fcb5d9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1363 microversion: 2.1 time: 0.153019 Aug 09 18:13:47.207452 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3727/6778] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:47 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:48.228053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-962e08d7-425d-4a2e-bba2-3626098d3b38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:48.228724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-962e08d7-425d-4a2e-bba2-3626098d3b38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:48.235465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-962e08d7-425d-4a2e-bba2-3626098d3b38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:48.235991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-962e08d7-425d-4a2e-bba2-3626098d3b38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:48.236430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-962e08d7-425d-4a2e-bba2-3626098d3b38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:48.237714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-962e08d7-425d-4a2e-bba2-3626098d3b38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:48.238169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-962e08d7-425d-4a2e-bba2-3626098d3b38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:48.238669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-962e08d7-425d-4a2e-bba2-3626098d3b38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:48.373485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-962e08d7-425d-4a2e-bba2-3626098d3b38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:13:48.380992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-962e08d7-425d-4a2e-bba2-3626098d3b38 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1549 microversion: 2.1 time: 0.156810 Aug 09 18:13:48.381609 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3728/6779] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:13:48 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:13:48.401458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-63865b8f-5900-4bcc-b098-03afc7ac269c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:13:48.401957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-63865b8f-5900-4bcc-b098-03afc7ac269c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:13:48.407699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63865b8f-5900-4bcc-b098-03afc7ac269c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:48.408194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63865b8f-5900-4bcc-b098-03afc7ac269c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:48.408640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63865b8f-5900-4bcc-b098-03afc7ac269c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:48.409841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63865b8f-5900-4bcc-b098-03afc7ac269c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:48.410305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63865b8f-5900-4bcc-b098-03afc7ac269c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:48.410753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63865b8f-5900-4bcc-b098-03afc7ac269c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:48.487739 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-63865b8f-5900-4bcc-b098-03afc7ac269c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089264 Aug 09 18:13:48.488351 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3729/6780] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 18:13:48 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:13:49.797134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:49.798495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:13:49.804160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-630ab9f3-9d9d-42d3-a1ef-b04f9da9db83 req-4057ffc0-9eb2-451e-be62-a97bd60f486e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c1612b4-3717-4154-b61f-f9a3743d78fb", "tag": "29a9475d-a8a7-4560-9e4a-c60ff40bf02f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:13:49.814878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-630ab9f3-9d9d-42d3-a1ef-b04f9da9db83 req-4057ffc0-9eb2-451e-be62-a97bd60f486e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:13:49.815463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-630ab9f3-9d9d-42d3-a1ef-b04f9da9db83 req-4057ffc0-9eb2-451e-be62-a97bd60f486e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:13:49.815995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-630ab9f3-9d9d-42d3-a1ef-b04f9da9db83 req-4057ffc0-9eb2-451e-be62-a97bd60f486e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:13:49.827540 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-630ab9f3-9d9d-42d3-a1ef-b04f9da9db83 req-4057ffc0-9eb2-451e-be62-a97bd60f486e service nova] Creating event network-changed:29a9475d-a8a7-4560-9e4a-c60ff40bf02f for instance 1c1612b4-3717-4154-b61f-f9a3743d78fb on n-h2-845781-6 Aug 09 18:13:49.833139 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-630ab9f3-9d9d-42d3-a1ef-b04f9da9db83 req-4057ffc0-9eb2-451e-be62-a97bd60f486e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036620 Aug 09 18:13:49.833751 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3730/6781] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:14:20.010371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=28 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:14:20.011226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:14:20.015689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:14:20.018489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:20.026183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:20.026665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:20.027106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:20.027831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:20.028290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:20.028722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:20.059997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:20.065831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Old instance type m1.heat2, new instance type m1.heat {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 18:14:20.072071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:14:20.072499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:14:20.072981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:14:20.073400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:14:20.073816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:14:20.134944 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3be4277f-b2b2-4326-92bb-8e34f518d56d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb/action" status: 202 len: 0 microversion: 2.1 time: 0.126744 Aug 09 18:14:20.135555 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3731/6782] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:14:20 2022] POST /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:14:20.144057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a3033b94-ab5d-4874-a128-15f93ffb4623 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:20.144706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a3033b94-ab5d-4874-a128-15f93ffb4623 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:20.151089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3033b94-ab5d-4874-a128-15f93ffb4623 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:20.151653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3033b94-ab5d-4874-a128-15f93ffb4623 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:20.153174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3033b94-ab5d-4874-a128-15f93ffb4623 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:20.153174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3033b94-ab5d-4874-a128-15f93ffb4623 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:20.153402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3033b94-ab5d-4874-a128-15f93ffb4623 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:20.153733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3033b94-ab5d-4874-a128-15f93ffb4623 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:20.297483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a3033b94-ab5d-4874-a128-15f93ffb4623 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:20.306315 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a3033b94-ab5d-4874-a128-15f93ffb4623 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1677 microversion: 2.1 time: 0.165614 Aug 09 18:14:20.315738 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3732/6783] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:20 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:21.326693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ca2fba95-3276-456e-9f2a-1517098016f2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:21.327696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ca2fba95-3276-456e-9f2a-1517098016f2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:21.335046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca2fba95-3276-456e-9f2a-1517098016f2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:21.335541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca2fba95-3276-456e-9f2a-1517098016f2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:21.336013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca2fba95-3276-456e-9f2a-1517098016f2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:21.336716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca2fba95-3276-456e-9f2a-1517098016f2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:21.337169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca2fba95-3276-456e-9f2a-1517098016f2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:21.337598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ca2fba95-3276-456e-9f2a-1517098016f2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:21.467444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ca2fba95-3276-456e-9f2a-1517098016f2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:21.475298 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ca2fba95-3276-456e-9f2a-1517098016f2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1677 microversion: 2.1 time: 0.152734 Aug 09 18:14:21.475906 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3733/6784] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:21 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:14:22.496389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dba34da9-9845-495c-a074-456df2f2316d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:22.497053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dba34da9-9845-495c-a074-456df2f2316d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:22.503984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dba34da9-9845-495c-a074-456df2f2316d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:22.504477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dba34da9-9845-495c-a074-456df2f2316d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:22.504918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dba34da9-9845-495c-a074-456df2f2316d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:22.505608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dba34da9-9845-495c-a074-456df2f2316d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:22.506068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dba34da9-9845-495c-a074-456df2f2316d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:22.506491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dba34da9-9845-495c-a074-456df2f2316d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:22.644659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dba34da9-9845-495c-a074-456df2f2316d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:22.652223 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dba34da9-9845-495c-a074-456df2f2316d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1682 microversion: 2.1 time: 0.159896 Aug 09 18:14:22.652828 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3734/6785] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:22 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:23.673392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-37db5dd7-3ab9-495f-87d8-12f43d1a95db tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:23.674086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-37db5dd7-3ab9-495f-87d8-12f43d1a95db tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:23.680921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37db5dd7-3ab9-495f-87d8-12f43d1a95db tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:23.681407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37db5dd7-3ab9-495f-87d8-12f43d1a95db tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:23.681852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37db5dd7-3ab9-495f-87d8-12f43d1a95db tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:23.682543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37db5dd7-3ab9-495f-87d8-12f43d1a95db tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:23.683003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37db5dd7-3ab9-495f-87d8-12f43d1a95db tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:23.683465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37db5dd7-3ab9-495f-87d8-12f43d1a95db tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:23.815595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-37db5dd7-3ab9-495f-87d8-12f43d1a95db tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:23.823255 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-37db5dd7-3ab9-495f-87d8-12f43d1a95db tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1682 microversion: 2.1 time: 0.153727 Aug 09 18:14:23.823860 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3735/6786] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:23 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:24.845326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-943f5ef9-512b-4489-b7b8-013057fdd58f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:24.846533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-943f5ef9-512b-4489-b7b8-013057fdd58f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:24.853780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-943f5ef9-512b-4489-b7b8-013057fdd58f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:24.854272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-943f5ef9-512b-4489-b7b8-013057fdd58f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:24.854748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-943f5ef9-512b-4489-b7b8-013057fdd58f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:24.855452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-943f5ef9-512b-4489-b7b8-013057fdd58f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:24.855936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-943f5ef9-512b-4489-b7b8-013057fdd58f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:24.856367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-943f5ef9-512b-4489-b7b8-013057fdd58f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:24.990479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-943f5ef9-512b-4489-b7b8-013057fdd58f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:24.997994 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-943f5ef9-512b-4489-b7b8-013057fdd58f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1682 microversion: 2.1 time: 0.156543 Aug 09 18:14:24.998569 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3736/6787] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:24 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:26.020445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb447407-3816-4502-984c-bbbccf3e7b89 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:26.021129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eb447407-3816-4502-984c-bbbccf3e7b89 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:26.028120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb447407-3816-4502-984c-bbbccf3e7b89 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:26.028638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb447407-3816-4502-984c-bbbccf3e7b89 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:26.029081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb447407-3816-4502-984c-bbbccf3e7b89 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:26.029801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb447407-3816-4502-984c-bbbccf3e7b89 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:26.030335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb447407-3816-4502-984c-bbbccf3e7b89 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:26.030772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb447407-3816-4502-984c-bbbccf3e7b89 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:26.166209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eb447407-3816-4502-984c-bbbccf3e7b89 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:26.174254 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eb447407-3816-4502-984c-bbbccf3e7b89 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1682 microversion: 2.1 time: 0.158021 Aug 09 18:14:26.174836 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3737/6788] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:26 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:27.195282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-85aef4c7-9469-4987-8d96-aad22b529765 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:27.195942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-85aef4c7-9469-4987-8d96-aad22b529765 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:27.202473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85aef4c7-9469-4987-8d96-aad22b529765 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:27.202973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85aef4c7-9469-4987-8d96-aad22b529765 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:27.203518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85aef4c7-9469-4987-8d96-aad22b529765 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:27.204409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85aef4c7-9469-4987-8d96-aad22b529765 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:27.205644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85aef4c7-9469-4987-8d96-aad22b529765 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:27.206201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-85aef4c7-9469-4987-8d96-aad22b529765 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:27.339869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-85aef4c7-9469-4987-8d96-aad22b529765 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:27.347656 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-85aef4c7-9469-4987-8d96-aad22b529765 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1682 microversion: 2.1 time: 0.156475 Aug 09 18:14:27.348256 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3738/6789] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:27 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:28.368018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-76e31497-21f5-400f-ba38-ec6cfe38f5e0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:28.368684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-76e31497-21f5-400f-ba38-ec6cfe38f5e0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:28.375534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76e31497-21f5-400f-ba38-ec6cfe38f5e0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:28.376069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76e31497-21f5-400f-ba38-ec6cfe38f5e0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:28.376517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76e31497-21f5-400f-ba38-ec6cfe38f5e0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:28.377217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76e31497-21f5-400f-ba38-ec6cfe38f5e0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:28.377676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76e31497-21f5-400f-ba38-ec6cfe38f5e0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:28.378107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76e31497-21f5-400f-ba38-ec6cfe38f5e0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:28.517036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-76e31497-21f5-400f-ba38-ec6cfe38f5e0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:28.525123 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-76e31497-21f5-400f-ba38-ec6cfe38f5e0 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1682 microversion: 2.1 time: 0.161045 Aug 09 18:14:28.525707 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3739/6790] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:28 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:29.546950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ffe515a5-3754-4331-8040-b530fa980991 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:29.547591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ffe515a5-3754-4331-8040-b530fa980991 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:29.554832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffe515a5-3754-4331-8040-b530fa980991 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:29.555315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffe515a5-3754-4331-8040-b530fa980991 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:29.555814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffe515a5-3754-4331-8040-b530fa980991 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:29.556509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffe515a5-3754-4331-8040-b530fa980991 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:29.556964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffe515a5-3754-4331-8040-b530fa980991 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:29.557390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ffe515a5-3754-4331-8040-b530fa980991 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:29.689701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ffe515a5-3754-4331-8040-b530fa980991 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:29.697244 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ffe515a5-3754-4331-8040-b530fa980991 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1682 microversion: 2.1 time: 0.154311 Aug 09 18:14:29.697821 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3740/6791] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:29 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:30.718221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ace7e6df-d69a-4e20-8598-13fe96ae1fe8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:30.718999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ace7e6df-d69a-4e20-8598-13fe96ae1fe8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:30.726016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ace7e6df-d69a-4e20-8598-13fe96ae1fe8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:30.726509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ace7e6df-d69a-4e20-8598-13fe96ae1fe8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:30.726944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ace7e6df-d69a-4e20-8598-13fe96ae1fe8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:30.727696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ace7e6df-d69a-4e20-8598-13fe96ae1fe8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:30.728148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ace7e6df-d69a-4e20-8598-13fe96ae1fe8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:30.728575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ace7e6df-d69a-4e20-8598-13fe96ae1fe8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:30.941434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ace7e6df-d69a-4e20-8598-13fe96ae1fe8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:30.948899 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ace7e6df-d69a-4e20-8598-13fe96ae1fe8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1682 microversion: 2.1 time: 0.234493 Aug 09 18:14:30.949494 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3741/6792] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:30 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:31.970627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e282c889-fd23-44a8-9f98-925c4016c81a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:31.971306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e282c889-fd23-44a8-9f98-925c4016c81a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:31.978176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e282c889-fd23-44a8-9f98-925c4016c81a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:31.978667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e282c889-fd23-44a8-9f98-925c4016c81a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:31.979112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e282c889-fd23-44a8-9f98-925c4016c81a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:31.979835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e282c889-fd23-44a8-9f98-925c4016c81a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:31.980297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e282c889-fd23-44a8-9f98-925c4016c81a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:31.980729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e282c889-fd23-44a8-9f98-925c4016c81a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:32.113309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e282c889-fd23-44a8-9f98-925c4016c81a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:32.121270 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e282c889-fd23-44a8-9f98-925c4016c81a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1682 microversion: 2.1 time: 0.154575 Aug 09 18:14:32.121848 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3742/6793] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:31 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:33.143606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-63609dd7-6de4-4655-8558-f933074d9ac1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:33.144271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-63609dd7-6de4-4655-8558-f933074d9ac1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:33.151033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63609dd7-6de4-4655-8558-f933074d9ac1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:33.151524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63609dd7-6de4-4655-8558-f933074d9ac1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:33.152002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63609dd7-6de4-4655-8558-f933074d9ac1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:33.152703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63609dd7-6de4-4655-8558-f933074d9ac1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:33.153164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63609dd7-6de4-4655-8558-f933074d9ac1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:33.153592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63609dd7-6de4-4655-8558-f933074d9ac1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:33.290626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-63609dd7-6de4-4655-8558-f933074d9ac1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:33.298236 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-63609dd7-6de4-4655-8558-f933074d9ac1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1682 microversion: 2.1 time: 0.158914 Aug 09 18:14:33.299479 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3743/6794] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:33 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:34.323067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-95010a9f-89cb-4bb4-88e8-56646dda7f2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:34.323975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-95010a9f-89cb-4bb4-88e8-56646dda7f2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:34.330785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95010a9f-89cb-4bb4-88e8-56646dda7f2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:34.331280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95010a9f-89cb-4bb4-88e8-56646dda7f2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:34.331754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95010a9f-89cb-4bb4-88e8-56646dda7f2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:34.332473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95010a9f-89cb-4bb4-88e8-56646dda7f2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:34.333176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95010a9f-89cb-4bb4-88e8-56646dda7f2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:34.333641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95010a9f-89cb-4bb4-88e8-56646dda7f2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:34.471152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-95010a9f-89cb-4bb4-88e8-56646dda7f2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:34.479585 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-95010a9f-89cb-4bb4-88e8-56646dda7f2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1681 microversion: 2.1 time: 0.160629 Aug 09 18:14:34.480208 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3744/6795] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:34 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:34.484706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0e6ef68b-ea3e-493b-817b-4cb5e3d65335 req-bcb14765-3c72-4750-84ba-b8839d7882f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1612b4-3717-4154-b61f-f9a3743d78fb", "name": "network-vif-unplugged", "status": "completed", "tag": "29a9475d-a8a7-4560-9e4a-c60ff40bf02f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:14:34.494458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0e6ef68b-ea3e-493b-817b-4cb5e3d65335 req-bcb14765-3c72-4750-84ba-b8839d7882f2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:34.494929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0e6ef68b-ea3e-493b-817b-4cb5e3d65335 req-bcb14765-3c72-4750-84ba-b8839d7882f2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:34.495358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0e6ef68b-ea3e-493b-817b-4cb5e3d65335 req-bcb14765-3c72-4750-84ba-b8839d7882f2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:34.507619 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0e6ef68b-ea3e-493b-817b-4cb5e3d65335 req-bcb14765-3c72-4750-84ba-b8839d7882f2 service nova] Creating event network-vif-unplugged:29a9475d-a8a7-4560-9e4a-c60ff40bf02f for instance 1c1612b4-3717-4154-b61f-f9a3743d78fb on n-h1-845781-6 Aug 09 18:14:34.512929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-0e6ef68b-ea3e-493b-817b-4cb5e3d65335 req-bcb14765-3c72-4750-84ba-b8839d7882f2 service nova] Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:14:34.524555 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0e6ef68b-ea3e-493b-817b-4cb5e3d65335 req-bcb14765-3c72-4750-84ba-b8839d7882f2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043181 Aug 09 18:14:34.525404 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3745/6796] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:14:35.502631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-425835d2-c827-4aa2-a73f-e9eb97709b9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:35.503506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-425835d2-c827-4aa2-a73f-e9eb97709b9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:35.509936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425835d2-c827-4aa2-a73f-e9eb97709b9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:35.510499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425835d2-c827-4aa2-a73f-e9eb97709b9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:35.510947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425835d2-c827-4aa2-a73f-e9eb97709b9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:35.511746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425835d2-c827-4aa2-a73f-e9eb97709b9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:35.512214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425835d2-c827-4aa2-a73f-e9eb97709b9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:35.512648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-425835d2-c827-4aa2-a73f-e9eb97709b9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:35.530681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:14:35.656823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-425835d2-c827-4aa2-a73f-e9eb97709b9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:35.665190 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-425835d2-c827-4aa2-a73f-e9eb97709b9c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1681 microversion: 2.1 time: 0.167769 Aug 09 18:14:35.666083 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3746/6797] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:35 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:36.686895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-faeeab63-6f0a-4e77-8720-d147bc426930 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:36.687542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-faeeab63-6f0a-4e77-8720-d147bc426930 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:36.694922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faeeab63-6f0a-4e77-8720-d147bc426930 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:36.695418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faeeab63-6f0a-4e77-8720-d147bc426930 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:36.695995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faeeab63-6f0a-4e77-8720-d147bc426930 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:36.696705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faeeab63-6f0a-4e77-8720-d147bc426930 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:36.697177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faeeab63-6f0a-4e77-8720-d147bc426930 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:36.697610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faeeab63-6f0a-4e77-8720-d147bc426930 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:36.829069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-faeeab63-6f0a-4e77-8720-d147bc426930 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:36.836988 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-faeeab63-6f0a-4e77-8720-d147bc426930 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1679 microversion: 2.1 time: 0.154350 Aug 09 18:14:36.837565 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3747/6798] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:36 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:36.867236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-dd4fae7a-08e7-4112-ac4c-0f475ee7c746 req-3ff7b774-5809-47f2-9af0-bc729787c717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c1612b4-3717-4154-b61f-f9a3743d78fb", "tag": "29a9475d-a8a7-4560-9e4a-c60ff40bf02f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:14:36.876394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dd4fae7a-08e7-4112-ac4c-0f475ee7c746 req-3ff7b774-5809-47f2-9af0-bc729787c717 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:36.877417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dd4fae7a-08e7-4112-ac4c-0f475ee7c746 req-3ff7b774-5809-47f2-9af0-bc729787c717 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:36.877846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dd4fae7a-08e7-4112-ac4c-0f475ee7c746 req-3ff7b774-5809-47f2-9af0-bc729787c717 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:36.889602 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-dd4fae7a-08e7-4112-ac4c-0f475ee7c746 req-3ff7b774-5809-47f2-9af0-bc729787c717 service nova] Creating event network-changed:29a9475d-a8a7-4560-9e4a-c60ff40bf02f for instance 1c1612b4-3717-4154-b61f-f9a3743d78fb on n-h1-845781-6 Aug 09 18:14:36.895335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-dd4fae7a-08e7-4112-ac4c-0f475ee7c746 req-3ff7b774-5809-47f2-9af0-bc729787c717 service nova] Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:14:36.906363 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-dd4fae7a-08e7-4112-ac4c-0f475ee7c746 req-3ff7b774-5809-47f2-9af0-bc729787c717 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043370 Aug 09 18:14:36.907032 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3748/6799] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:14:37.860253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9c8d8ea4-d7c1-4bbc-94f3-4e6c7b2e1549 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:37.860956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9c8d8ea4-d7c1-4bbc-94f3-4e6c7b2e1549 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:37.867200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8d8ea4-d7c1-4bbc-94f3-4e6c7b2e1549 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:37.867725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8d8ea4-d7c1-4bbc-94f3-4e6c7b2e1549 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:37.868166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8d8ea4-d7c1-4bbc-94f3-4e6c7b2e1549 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:37.868862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8d8ea4-d7c1-4bbc-94f3-4e6c7b2e1549 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:37.869315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8d8ea4-d7c1-4bbc-94f3-4e6c7b2e1549 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:37.869743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9c8d8ea4-d7c1-4bbc-94f3-4e6c7b2e1549 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:38.017182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9c8d8ea4-d7c1-4bbc-94f3-4e6c7b2e1549 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:38.025241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9c8d8ea4-d7c1-4bbc-94f3-4e6c7b2e1549 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1676 microversion: 2.1 time: 0.170146 Aug 09 18:14:38.025815 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3749/6800] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:37 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:38.045079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:14:38.045540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:38.051876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:38.052356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:38.052789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:38.053476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:38.053930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:38.054384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:38.094207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:38.094680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:38.095112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:38.095863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:38.096314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:38.096740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:38.117086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:14:38.122154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for user a99b8e16341944698d60f7dde11a2f59 and project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:14:38.221641 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a35acaf3-b347-46b4-a18e-c7cddd998c40 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb/action" status: 202 len: 0 microversion: 2.1 time: 0.180247 Aug 09 18:14:38.222312 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3750/6801] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:14:38 2022] POST /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:14:38.230622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e5ae16fa-fe73-416d-a2b1-8ee17a52a03a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:38.231320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e5ae16fa-fe73-416d-a2b1-8ee17a52a03a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:38.238915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ae16fa-fe73-416d-a2b1-8ee17a52a03a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:38.239544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ae16fa-fe73-416d-a2b1-8ee17a52a03a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:38.240077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ae16fa-fe73-416d-a2b1-8ee17a52a03a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:38.240936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ae16fa-fe73-416d-a2b1-8ee17a52a03a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:38.241559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ae16fa-fe73-416d-a2b1-8ee17a52a03a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:38.241986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e5ae16fa-fe73-416d-a2b1-8ee17a52a03a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:38.387548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e5ae16fa-fe73-416d-a2b1-8ee17a52a03a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:38.395404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e5ae16fa-fe73-416d-a2b1-8ee17a52a03a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1675 microversion: 2.1 time: 0.168713 Aug 09 18:14:38.396042 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3751/6802] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:38 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:39.417461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7fdaa2e-963e-4fd6-9631-ba447e95379e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:39.418139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b7fdaa2e-963e-4fd6-9631-ba447e95379e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:39.425651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa2e-963e-4fd6-9631-ba447e95379e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:39.426137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa2e-963e-4fd6-9631-ba447e95379e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:39.426574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa2e-963e-4fd6-9631-ba447e95379e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:39.427265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa2e-963e-4fd6-9631-ba447e95379e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:39.427761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa2e-963e-4fd6-9631-ba447e95379e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:39.428191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7fdaa2e-963e-4fd6-9631-ba447e95379e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:39.558807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b7fdaa2e-963e-4fd6-9631-ba447e95379e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:39.566369 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7fdaa2e-963e-4fd6-9631-ba447e95379e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1675 microversion: 2.1 time: 0.153101 Aug 09 18:14:39.566937 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3752/6803] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:39 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:40.587525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6f8396c-e60a-48f9-b52d-668e71f69046 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:40.588247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b6f8396c-e60a-48f9-b52d-668e71f69046 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:40.595243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f8396c-e60a-48f9-b52d-668e71f69046 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:40.596366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f8396c-e60a-48f9-b52d-668e71f69046 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:40.596822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f8396c-e60a-48f9-b52d-668e71f69046 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:40.597528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f8396c-e60a-48f9-b52d-668e71f69046 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:40.599239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f8396c-e60a-48f9-b52d-668e71f69046 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:40.599239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f8396c-e60a-48f9-b52d-668e71f69046 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:40.744338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b6f8396c-e60a-48f9-b52d-668e71f69046 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:40.752785 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6f8396c-e60a-48f9-b52d-668e71f69046 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1675 microversion: 2.1 time: 0.169226 Aug 09 18:14:40.753667 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3753/6804] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:40 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:41.727118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-19b65129-d5eb-4857-b6a6-bd8faa6aeb06 req-3a5af86b-309f-45cf-97ac-cc811087e7bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c1612b4-3717-4154-b61f-f9a3743d78fb", "tag": "29a9475d-a8a7-4560-9e4a-c60ff40bf02f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:14:41.744109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-19b65129-d5eb-4857-b6a6-bd8faa6aeb06 req-3a5af86b-309f-45cf-97ac-cc811087e7bf service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:41.744586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-19b65129-d5eb-4857-b6a6-bd8faa6aeb06 req-3a5af86b-309f-45cf-97ac-cc811087e7bf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:41.745250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-19b65129-d5eb-4857-b6a6-bd8faa6aeb06 req-3a5af86b-309f-45cf-97ac-cc811087e7bf service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:41.758473 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-19b65129-d5eb-4857-b6a6-bd8faa6aeb06 req-3a5af86b-309f-45cf-97ac-cc811087e7bf service nova] Creating event network-changed:29a9475d-a8a7-4560-9e4a-c60ff40bf02f for instance 1c1612b4-3717-4154-b61f-f9a3743d78fb on n-h2-845781-6 Aug 09 18:14:41.765184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-19b65129-d5eb-4857-b6a6-bd8faa6aeb06 req-3a5af86b-309f-45cf-97ac-cc811087e7bf service nova] Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:14:41.775768 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-19b65129-d5eb-4857-b6a6-bd8faa6aeb06 req-3a5af86b-309f-45cf-97ac-cc811087e7bf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052313 Aug 09 18:14:41.776393 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3754/6805] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:14:41.781375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cedffcc3-aa7a-4065-810f-71c58b8ef58c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:41.782077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cedffcc3-aa7a-4065-810f-71c58b8ef58c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:41.789901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cedffcc3-aa7a-4065-810f-71c58b8ef58c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:41.790389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cedffcc3-aa7a-4065-810f-71c58b8ef58c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:41.791014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cedffcc3-aa7a-4065-810f-71c58b8ef58c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:41.791899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cedffcc3-aa7a-4065-810f-71c58b8ef58c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:41.792498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cedffcc3-aa7a-4065-810f-71c58b8ef58c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:41.792928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cedffcc3-aa7a-4065-810f-71c58b8ef58c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:42.040509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cedffcc3-aa7a-4065-810f-71c58b8ef58c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:42.049051 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cedffcc3-aa7a-4065-810f-71c58b8ef58c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1675 microversion: 2.1 time: 0.271470 Aug 09 18:14:42.049728 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3755/6806] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:41 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1675 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:14:43.070577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f41ccc4b-740f-4301-80c3-342b25baf424 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:43.071915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f41ccc4b-740f-4301-80c3-342b25baf424 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:43.078946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f41ccc4b-740f-4301-80c3-342b25baf424 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:43.079427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f41ccc4b-740f-4301-80c3-342b25baf424 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:43.079886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f41ccc4b-740f-4301-80c3-342b25baf424 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:43.080581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f41ccc4b-740f-4301-80c3-342b25baf424 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:43.081038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f41ccc4b-740f-4301-80c3-342b25baf424 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:43.081629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f41ccc4b-740f-4301-80c3-342b25baf424 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:43.213248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f41ccc4b-740f-4301-80c3-342b25baf424 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:43.221367 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f41ccc4b-740f-4301-80c3-342b25baf424 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1675 microversion: 2.1 time: 0.154779 Aug 09 18:14:43.221948 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3756/6807] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:43 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:44.243146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f5f2947e-469f-4a72-9268-736099121cd3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:44.243817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f5f2947e-469f-4a72-9268-736099121cd3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:44.250497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2947e-469f-4a72-9268-736099121cd3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:44.250975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2947e-469f-4a72-9268-736099121cd3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:44.251415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2947e-469f-4a72-9268-736099121cd3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:44.252715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2947e-469f-4a72-9268-736099121cd3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:44.253998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2947e-469f-4a72-9268-736099121cd3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:44.253998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5f2947e-469f-4a72-9268-736099121cd3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:44.400808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f5f2947e-469f-4a72-9268-736099121cd3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:44.408921 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f5f2947e-469f-4a72-9268-736099121cd3 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1668 microversion: 2.1 time: 0.169735 Aug 09 18:14:44.409497 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3757/6808] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:44 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1668 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:44.429208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc312920-9a0c-4bab-a167-2a36212e7ec7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:44.429886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bc312920-9a0c-4bab-a167-2a36212e7ec7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:44.435720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc312920-9a0c-4bab-a167-2a36212e7ec7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:44.436212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc312920-9a0c-4bab-a167-2a36212e7ec7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:44.436654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc312920-9a0c-4bab-a167-2a36212e7ec7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:44.437355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc312920-9a0c-4bab-a167-2a36212e7ec7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:44.437806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc312920-9a0c-4bab-a167-2a36212e7ec7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:44.438232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc312920-9a0c-4bab-a167-2a36212e7ec7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:44.830197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bc312920-9a0c-4bab-a167-2a36212e7ec7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:44.837992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bc312920-9a0c-4bab-a167-2a36212e7ec7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1668 microversion: 2.1 time: 0.412444 Aug 09 18:14:44.838768 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3758/6809] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:44 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1668 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:44.858707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a04f3bf-d5cb-48ac-8f87-87caae1e4d54 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:44.859217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a04f3bf-d5cb-48ac-8f87-87caae1e4d54 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:44.865472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a04f3bf-d5cb-48ac-8f87-87caae1e4d54 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:44.865963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a04f3bf-d5cb-48ac-8f87-87caae1e4d54 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:44.866404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a04f3bf-d5cb-48ac-8f87-87caae1e4d54 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:44.867098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a04f3bf-d5cb-48ac-8f87-87caae1e4d54 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:44.867560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a04f3bf-d5cb-48ac-8f87-87caae1e4d54 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:44.868012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a04f3bf-d5cb-48ac-8f87-87caae1e4d54 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:45.002681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4a04f3bf-d5cb-48ac-8f87-87caae1e4d54 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:45.010490 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a04f3bf-d5cb-48ac-8f87-87caae1e4d54 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1668 microversion: 2.1 time: 0.155718 Aug 09 18:14:45.011138 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3759/6810] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:44 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:45.031114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-772f8cad-9183-460a-b6de-a05af0e1631b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:45.031740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-772f8cad-9183-460a-b6de-a05af0e1631b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:45.038418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772f8cad-9183-460a-b6de-a05af0e1631b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:45.038909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772f8cad-9183-460a-b6de-a05af0e1631b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:45.039354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772f8cad-9183-460a-b6de-a05af0e1631b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:45.040095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772f8cad-9183-460a-b6de-a05af0e1631b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:45.040553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772f8cad-9183-460a-b6de-a05af0e1631b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:45.040981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-772f8cad-9183-460a-b6de-a05af0e1631b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:45.065625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-772f8cad-9183-460a-b6de-a05af0e1631b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:14:45.068614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:14:45.142811 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-772f8cad-9183-460a-b6de-a05af0e1631b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 204 len: 0 microversion: 2.1 time: 0.114641 Aug 09 18:14:45.143504 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3760/6811] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:14:45 2022] DELETE /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:14:45.152315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d8fb16e5-b77f-4cfd-b60d-e49bbd2b9069 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:45.153020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d8fb16e5-b77f-4cfd-b60d-e49bbd2b9069 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:45.159087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8fb16e5-b77f-4cfd-b60d-e49bbd2b9069 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:45.159581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8fb16e5-b77f-4cfd-b60d-e49bbd2b9069 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:45.160060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8fb16e5-b77f-4cfd-b60d-e49bbd2b9069 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:45.160762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8fb16e5-b77f-4cfd-b60d-e49bbd2b9069 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:45.161222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8fb16e5-b77f-4cfd-b60d-e49bbd2b9069 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:45.161656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d8fb16e5-b77f-4cfd-b60d-e49bbd2b9069 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:45.296078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d8fb16e5-b77f-4cfd-b60d-e49bbd2b9069 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:45.303651 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d8fb16e5-b77f-4cfd-b60d-e49bbd2b9069 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1674 microversion: 2.1 time: 0.155396 Aug 09 18:14:45.304231 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3761/6812] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:45 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:46.325267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8cb4c60d-3c5b-433b-ac4c-5182e8a3e708 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:46.325906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8cb4c60d-3c5b-433b-ac4c-5182e8a3e708 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:46.333584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cb4c60d-3c5b-433b-ac4c-5182e8a3e708 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:46.334071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cb4c60d-3c5b-433b-ac4c-5182e8a3e708 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:46.334508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cb4c60d-3c5b-433b-ac4c-5182e8a3e708 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:46.335204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cb4c60d-3c5b-433b-ac4c-5182e8a3e708 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:46.335687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cb4c60d-3c5b-433b-ac4c-5182e8a3e708 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:46.336117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cb4c60d-3c5b-433b-ac4c-5182e8a3e708 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:46.500494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8cb4c60d-3c5b-433b-ac4c-5182e8a3e708 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:46.507305 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8cb4c60d-3c5b-433b-ac4c-5182e8a3e708 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1674 microversion: 2.1 time: 0.185910 Aug 09 18:14:46.507977 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3762/6813] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:46 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:46.661034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-592d92e8-bc6f-4e1d-805e-c79389792abf req-89058783-5592-42f6-9461-b1c54a34b916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1612b4-3717-4154-b61f-f9a3743d78fb", "name": "network-vif-plugged", "status": "completed", "tag": "29a9475d-a8a7-4560-9e4a-c60ff40bf02f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:14:46.673257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-592d92e8-bc6f-4e1d-805e-c79389792abf req-89058783-5592-42f6-9461-b1c54a34b916 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:46.673852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-592d92e8-bc6f-4e1d-805e-c79389792abf req-89058783-5592-42f6-9461-b1c54a34b916 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:46.674301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-592d92e8-bc6f-4e1d-805e-c79389792abf req-89058783-5592-42f6-9461-b1c54a34b916 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:46.691779 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-592d92e8-bc6f-4e1d-805e-c79389792abf req-89058783-5592-42f6-9461-b1c54a34b916 service nova] Creating event network-vif-plugged:29a9475d-a8a7-4560-9e4a-c60ff40bf02f for instance 1c1612b4-3717-4154-b61f-f9a3743d78fb on n-h2-845781-6 Aug 09 18:14:46.698802 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-592d92e8-bc6f-4e1d-805e-c79389792abf req-89058783-5592-42f6-9461-b1c54a34b916 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042122 Aug 09 18:14:46.699588 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3763/6814] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:14:47.531062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-068f3033-1907-4a07-a127-046e29d65324 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:47.532616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-068f3033-1907-4a07-a127-046e29d65324 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:47.539618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-068f3033-1907-4a07-a127-046e29d65324 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:47.540157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-068f3033-1907-4a07-a127-046e29d65324 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:47.540605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-068f3033-1907-4a07-a127-046e29d65324 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:47.541333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-068f3033-1907-4a07-a127-046e29d65324 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:47.541799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-068f3033-1907-4a07-a127-046e29d65324 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:47.542235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-068f3033-1907-4a07-a127-046e29d65324 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:47.635757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-068f3033-1907-4a07-a127-046e29d65324 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:47.643517 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-068f3033-1907-4a07-a127-046e29d65324 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 200 len: 1606 microversion: 2.1 time: 0.118219 Aug 09 18:14:47.644260 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3764/6815] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:47 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 1606 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:47.747525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a922dddd-e48d-4dd3-8a6c-d5457d534a68 req-18e28fbe-5f8b-4b19-81a7-d80940e32b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c1612b4-3717-4154-b61f-f9a3743d78fb", "name": "network-vif-deleted", "tag": "29a9475d-a8a7-4560-9e4a-c60ff40bf02f"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:14:47.760280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a922dddd-e48d-4dd3-8a6c-d5457d534a68 req-18e28fbe-5f8b-4b19-81a7-d80940e32b0f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:47.760777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a922dddd-e48d-4dd3-8a6c-d5457d534a68 req-18e28fbe-5f8b-4b19-81a7-d80940e32b0f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:47.761221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a922dddd-e48d-4dd3-8a6c-d5457d534a68 req-18e28fbe-5f8b-4b19-81a7-d80940e32b0f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:47.775264 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a922dddd-e48d-4dd3-8a6c-d5457d534a68 req-18e28fbe-5f8b-4b19-81a7-d80940e32b0f service nova] Creating event network-vif-deleted:29a9475d-a8a7-4560-9e4a-c60ff40bf02f for instance 1c1612b4-3717-4154-b61f-f9a3743d78fb on n-h2-845781-6 Aug 09 18:14:47.780578 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a922dddd-e48d-4dd3-8a6c-d5457d534a68 req-18e28fbe-5f8b-4b19-81a7-d80940e32b0f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036976 Aug 09 18:14:47.781189 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3765/6816] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:14:48.666089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:48.666827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:48.668734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:14:48.675703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:48.676203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:48.676649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:48.677359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:48.677821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:48.678251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:48.695315 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb HTTP/1.1 Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1c1612b4-3717-4154-b61f-f9a3743d78fb'} Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:14:48.697071 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:14:48.702773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:14:48.702773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:14:48.702773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:14:48.702773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:14:48.702773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:14:48.702773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:14:48.702773 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:14:48.702773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:14:48.702773 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07890182-c708-440f-ab86-c563b965278c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 404 len: 111 microversion: 2.1 time: 0.037269 Aug 09 18:14:48.702773 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3766/6817] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:48 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:14:48.717182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:48.717808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:48.724145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:48.724641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:48.725078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:48.725789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:48.726245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:48.726673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:48.741271 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb HTTP/1.1 Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1c1612b4-3717-4154-b61f-f9a3743d78fb'} Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:14:48.742868 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:14:48.756632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:14:48.756632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:14:48.756632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:14:48.756632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:14:48.756632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:14:48.756632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:14:48.756632 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:14:48.756632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:14:48.756632 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0318101a-1c3f-4b73-a843-24a213424265 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 404 len: 111 microversion: 2.1 time: 0.031885 Aug 09 18:14:48.756632 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3767/6818] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:48 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:14:48.817231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-995032001", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "8745fc1d-7b31-4237-bfbd-afc627b10e4c"}], "security_groups": [{"name": "tempest-securitygroup--1856683196"}], "key_name": "tempest-keypair-291065013", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:14:48.825745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:14:48.937207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] validate_networks() for [('8745fc1d-7b31-4237-bfbd-afc627b10e4c', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:14:49.346831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:14:49.347269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:14:49.347798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:14:49.348233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:14:49.348658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:14:49.358322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:49.358824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:49.359337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:49.360112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:49.360581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:49.361052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:49.379156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:14:49.384725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for user a99b8e16341944698d60f7dde11a2f59 and project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:14:49.399051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:14:49.401535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:14:49.452539 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f74d4208-8295-493b-8578-39d71ad936a4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.639739 Aug 09 18:14:49.453222 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3768/6819] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:14:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:14:49.465146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21464a80-b827-4d89-967e-49f25326e9f9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:49.465774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-21464a80-b827-4d89-967e-49f25326e9f9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:49.522700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-21464a80-b827-4d89-967e-49f25326e9f9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:49.529853 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-21464a80-b827-4d89-967e-49f25326e9f9 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1237 microversion: 2.1 time: 0.068558 Aug 09 18:14:49.530431 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3769/6820] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:49 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:50.550903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-01adb737-dd5b-45da-8d3b-b8e05620aec2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:50.551610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-01adb737-dd5b-45da-8d3b-b8e05620aec2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:50.560504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01adb737-dd5b-45da-8d3b-b8e05620aec2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:50.561926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01adb737-dd5b-45da-8d3b-b8e05620aec2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:50.562377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01adb737-dd5b-45da-8d3b-b8e05620aec2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:50.563100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01adb737-dd5b-45da-8d3b-b8e05620aec2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:50.563779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01adb737-dd5b-45da-8d3b-b8e05620aec2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:50.564242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-01adb737-dd5b-45da-8d3b-b8e05620aec2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:50.636089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-01adb737-dd5b-45da-8d3b-b8e05620aec2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:50.644580 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-01adb737-dd5b-45da-8d3b-b8e05620aec2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1297 microversion: 2.1 time: 0.097787 Aug 09 18:14:50.645153 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3770/6821] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:50 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:51.682258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cec77b5e-052c-459a-8eea-ad9c2218d972 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:51.682913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cec77b5e-052c-459a-8eea-ad9c2218d972 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:51.690711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cec77b5e-052c-459a-8eea-ad9c2218d972 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:51.691204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cec77b5e-052c-459a-8eea-ad9c2218d972 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:51.691655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cec77b5e-052c-459a-8eea-ad9c2218d972 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:51.692373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cec77b5e-052c-459a-8eea-ad9c2218d972 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:51.692827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cec77b5e-052c-459a-8eea-ad9c2218d972 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:51.693258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cec77b5e-052c-459a-8eea-ad9c2218d972 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:51.840626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cec77b5e-052c-459a-8eea-ad9c2218d972 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:51.848837 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cec77b5e-052c-459a-8eea-ad9c2218d972 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1363 microversion: 2.1 time: 0.170554 Aug 09 18:14:51.849515 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3771/6822] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:51 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:51.973777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-91f43d70-80a3-4bf8-8846-e993a82ea6d1 req-d8e3fb4d-afad-4174-a919-bcd1b0589047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c4e444-2b23-4c8d-a239-4909c5d025cd", "tag": "8d5852a6-1948-442a-a464-b3b66ed71e5c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:14:51.983914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-91f43d70-80a3-4bf8-8846-e993a82ea6d1 req-d8e3fb4d-afad-4174-a919-bcd1b0589047 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:51.984397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-91f43d70-80a3-4bf8-8846-e993a82ea6d1 req-d8e3fb4d-afad-4174-a919-bcd1b0589047 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:51.985501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-91f43d70-80a3-4bf8-8846-e993a82ea6d1 req-d8e3fb4d-afad-4174-a919-bcd1b0589047 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:51.999912 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-91f43d70-80a3-4bf8-8846-e993a82ea6d1 req-d8e3fb4d-afad-4174-a919-bcd1b0589047 service nova] Creating event network-changed:8d5852a6-1948-442a-a464-b3b66ed71e5c for instance 89c4e444-2b23-4c8d-a239-4909c5d025cd on n-h1-845781-6 Aug 09 18:14:52.005033 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-91f43d70-80a3-4bf8-8846-e993a82ea6d1 req-d8e3fb4d-afad-4174-a919-bcd1b0589047 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035833 Aug 09 18:14:52.005646 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3772/6823] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:14:52.875107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-59dc7f5b-cbe9-4977-ba1a-ed9f01037c04 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:52.875866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-59dc7f5b-cbe9-4977-ba1a-ed9f01037c04 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:52.882158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59dc7f5b-cbe9-4977-ba1a-ed9f01037c04 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:52.882651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59dc7f5b-cbe9-4977-ba1a-ed9f01037c04 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:52.883090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59dc7f5b-cbe9-4977-ba1a-ed9f01037c04 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:52.883841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59dc7f5b-cbe9-4977-ba1a-ed9f01037c04 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:52.884294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59dc7f5b-cbe9-4977-ba1a-ed9f01037c04 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:52.884716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-59dc7f5b-cbe9-4977-ba1a-ed9f01037c04 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:53.022314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-59dc7f5b-cbe9-4977-ba1a-ed9f01037c04 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:53.029836 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-59dc7f5b-cbe9-4977-ba1a-ed9f01037c04 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1363 microversion: 2.1 time: 0.159944 Aug 09 18:14:53.030415 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3773/6824] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:52 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:54.051401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f7b08697-805a-498f-9a7c-3b88389a0f95 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:54.052077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f7b08697-805a-498f-9a7c-3b88389a0f95 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:54.059072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7b08697-805a-498f-9a7c-3b88389a0f95 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:54.059577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7b08697-805a-498f-9a7c-3b88389a0f95 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:54.060054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7b08697-805a-498f-9a7c-3b88389a0f95 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:54.060771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7b08697-805a-498f-9a7c-3b88389a0f95 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:54.061240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7b08697-805a-498f-9a7c-3b88389a0f95 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:54.061681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f7b08697-805a-498f-9a7c-3b88389a0f95 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:54.194708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f7b08697-805a-498f-9a7c-3b88389a0f95 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:54.202322 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f7b08697-805a-498f-9a7c-3b88389a0f95 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1363 microversion: 2.1 time: 0.155437 Aug 09 18:14:54.202893 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3774/6825] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:54 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:55.225026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-501e83e3-5beb-4d9d-9571-6269e89b73e8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:55.225705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-501e83e3-5beb-4d9d-9571-6269e89b73e8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:55.232700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-501e83e3-5beb-4d9d-9571-6269e89b73e8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:55.233198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-501e83e3-5beb-4d9d-9571-6269e89b73e8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:55.233644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-501e83e3-5beb-4d9d-9571-6269e89b73e8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:55.234352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-501e83e3-5beb-4d9d-9571-6269e89b73e8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:55.234817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-501e83e3-5beb-4d9d-9571-6269e89b73e8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:55.235244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-501e83e3-5beb-4d9d-9571-6269e89b73e8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:55.373095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-501e83e3-5beb-4d9d-9571-6269e89b73e8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:55.381254 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-501e83e3-5beb-4d9d-9571-6269e89b73e8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1363 microversion: 2.1 time: 0.160180 Aug 09 18:14:55.381829 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3775/6826] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:55 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:56.401745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2e45fdce-4f27-4676-8393-6edd57669a2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:56.402382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2e45fdce-4f27-4676-8393-6edd57669a2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:56.409387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e45fdce-4f27-4676-8393-6edd57669a2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:56.409885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e45fdce-4f27-4676-8393-6edd57669a2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:56.410444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e45fdce-4f27-4676-8393-6edd57669a2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:56.411161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e45fdce-4f27-4676-8393-6edd57669a2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:56.411645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e45fdce-4f27-4676-8393-6edd57669a2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:56.412079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2e45fdce-4f27-4676-8393-6edd57669a2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:56.546306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2e45fdce-4f27-4676-8393-6edd57669a2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:56.554024 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2e45fdce-4f27-4676-8393-6edd57669a2e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1363 microversion: 2.1 time: 0.156253 Aug 09 18:14:56.554541 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3776/6827] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:56 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:57.576125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a0a04fbc-2f4f-4fdc-92d5-14abc9e7788d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:57.576777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a0a04fbc-2f4f-4fdc-92d5-14abc9e7788d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:57.583602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0a04fbc-2f4f-4fdc-92d5-14abc9e7788d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:57.584121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0a04fbc-2f4f-4fdc-92d5-14abc9e7788d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:57.584563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0a04fbc-2f4f-4fdc-92d5-14abc9e7788d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:57.585279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0a04fbc-2f4f-4fdc-92d5-14abc9e7788d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:57.585740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0a04fbc-2f4f-4fdc-92d5-14abc9e7788d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:57.586169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a0a04fbc-2f4f-4fdc-92d5-14abc9e7788d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:57.724376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a0a04fbc-2f4f-4fdc-92d5-14abc9e7788d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:57.731975 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a0a04fbc-2f4f-4fdc-92d5-14abc9e7788d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1363 microversion: 2.1 time: 0.159953 Aug 09 18:14:57.732541 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3777/6828] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:57 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:58.294054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4bd22ccb-79f2-4a58-9fb6-fc9ccdaed724 req-7f130fc9-cf33-4a8c-aa6e-c8fa561aaaba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c4e444-2b23-4c8d-a239-4909c5d025cd", "name": "network-vif-plugged", "status": "completed", "tag": "8d5852a6-1948-442a-a464-b3b66ed71e5c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:14:58.304202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4bd22ccb-79f2-4a58-9fb6-fc9ccdaed724 req-7f130fc9-cf33-4a8c-aa6e-c8fa561aaaba service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:58.304694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4bd22ccb-79f2-4a58-9fb6-fc9ccdaed724 req-7f130fc9-cf33-4a8c-aa6e-c8fa561aaaba service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:58.305135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4bd22ccb-79f2-4a58-9fb6-fc9ccdaed724 req-7f130fc9-cf33-4a8c-aa6e-c8fa561aaaba service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:58.316523 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4bd22ccb-79f2-4a58-9fb6-fc9ccdaed724 req-7f130fc9-cf33-4a8c-aa6e-c8fa561aaaba service nova] Creating event network-vif-plugged:8d5852a6-1948-442a-a464-b3b66ed71e5c for instance 89c4e444-2b23-4c8d-a239-4909c5d025cd on n-h1-845781-6 Aug 09 18:14:58.321564 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4bd22ccb-79f2-4a58-9fb6-fc9ccdaed724 req-7f130fc9-cf33-4a8c-aa6e-c8fa561aaaba service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031552 Aug 09 18:14:58.322168 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3778/6829] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:14:58.755561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9e9d8eed-882b-4e15-a2cb-e33350b149d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:58.756335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9e9d8eed-882b-4e15-a2cb-e33350b149d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:58.763279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9d8eed-882b-4e15-a2cb-e33350b149d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:58.764154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9d8eed-882b-4e15-a2cb-e33350b149d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:58.764829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9d8eed-882b-4e15-a2cb-e33350b149d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:58.765951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9d8eed-882b-4e15-a2cb-e33350b149d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:58.766676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9d8eed-882b-4e15-a2cb-e33350b149d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:58.768041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9d8eed-882b-4e15-a2cb-e33350b149d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:58.923702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9e9d8eed-882b-4e15-a2cb-e33350b149d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:14:58.931498 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9e9d8eed-882b-4e15-a2cb-e33350b149d7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1363 microversion: 2.1 time: 0.181693 Aug 09 18:14:58.932113 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3779/6830] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:58 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:14:59.954099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-049dd01e-3036-4685-a7df-dd62ac29cd7e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:14:59.955238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-049dd01e-3036-4685-a7df-dd62ac29cd7e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:14:59.957411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:14:59.958574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:14:59.965449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-049dd01e-3036-4685-a7df-dd62ac29cd7e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:59.965950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-049dd01e-3036-4685-a7df-dd62ac29cd7e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:59.966394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-049dd01e-3036-4685-a7df-dd62ac29cd7e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:14:59.967109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-049dd01e-3036-4685-a7df-dd62ac29cd7e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:14:59.967604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-049dd01e-3036-4685-a7df-dd62ac29cd7e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:14:59.968066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-049dd01e-3036-4685-a7df-dd62ac29cd7e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:00.113190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-049dd01e-3036-4685-a7df-dd62ac29cd7e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:00.120944 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-049dd01e-3036-4685-a7df-dd62ac29cd7e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1549 microversion: 2.1 time: 0.170963 Aug 09 18:15:00.121552 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3780/6831] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:14:59 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:15:00.143100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11ff90de-758b-4eb7-a818-f4fba4c45665 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:00.143648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-11ff90de-758b-4eb7-a818-f4fba4c45665 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:00.149891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ff90de-758b-4eb7-a818-f4fba4c45665 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:00.150419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ff90de-758b-4eb7-a818-f4fba4c45665 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:00.150871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ff90de-758b-4eb7-a818-f4fba4c45665 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:00.151585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ff90de-758b-4eb7-a818-f4fba4c45665 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:00.152153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ff90de-758b-4eb7-a818-f4fba4c45665 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:00.152593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ff90de-758b-4eb7-a818-f4fba4c45665 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:00.169400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:00.232788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11ff90de-758b-4eb7-a818-f4fba4c45665 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094164 Aug 09 18:15:00.233399 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3781/6832] 10.222.0.93 () {58 vars in 1275 bytes} [Tue Aug 9 18:15:00 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:15:01.189636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-070adbfb-4778-491c-9409-6a15a3b2ae02 req-eeb5bda9-0e66-44b4-8426-d7f9145ebe28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c4e444-2b23-4c8d-a239-4909c5d025cd", "tag": "8d5852a6-1948-442a-a464-b3b66ed71e5c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:01.202479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-070adbfb-4778-491c-9409-6a15a3b2ae02 req-eeb5bda9-0e66-44b4-8426-d7f9145ebe28 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:01.203029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-070adbfb-4778-491c-9409-6a15a3b2ae02 req-eeb5bda9-0e66-44b4-8426-d7f9145ebe28 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:01.203571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-070adbfb-4778-491c-9409-6a15a3b2ae02 req-eeb5bda9-0e66-44b4-8426-d7f9145ebe28 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:01.216969 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-070adbfb-4778-491c-9409-6a15a3b2ae02 req-eeb5bda9-0e66-44b4-8426-d7f9145ebe28 service nova] Creating event network-changed:8d5852a6-1948-442a-a464-b3b66ed71e5c for instance 89c4e444-2b23-4c8d-a239-4909c5d025cd on n-h1-845781-6 Aug 09 18:15:01.222735 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-070adbfb-4778-491c-9409-6a15a3b2ae02 req-eeb5bda9-0e66-44b4-8426-d7f9145ebe28 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037657 Aug 09 18:15:01.223344 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3782/6833] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:15:43.336189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:43.336967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:43.341237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d202add3-435d-44dc-bd68-63d5beeeaf82 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:43.341957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d202add3-435d-44dc-bd68-63d5beeeaf82 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:43.350340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d202add3-435d-44dc-bd68-63d5beeeaf82 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:43.350831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d202add3-435d-44dc-bd68-63d5beeeaf82 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:43.351299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d202add3-435d-44dc-bd68-63d5beeeaf82 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:43.352032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d202add3-435d-44dc-bd68-63d5beeeaf82 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:43.352494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d202add3-435d-44dc-bd68-63d5beeeaf82 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:43.352928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d202add3-435d-44dc-bd68-63d5beeeaf82 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:43.492838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d202add3-435d-44dc-bd68-63d5beeeaf82 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:43.500490 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d202add3-435d-44dc-bd68-63d5beeeaf82 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1668 microversion: 2.1 time: 0.166926 Aug 09 18:15:43.501083 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3783/6834] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:43 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:15:43.520669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-97106e81-e0ea-48c5-9c00-eb6cfc2c8009 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bced9066-daa9-48d5-80ac-c1d4abfe052c"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:43.523021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-97106e81-e0ea-48c5-9c00-eb6cfc2c8009 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:43.528916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97106e81-e0ea-48c5-9c00-eb6cfc2c8009 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:43.529412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97106e81-e0ea-48c5-9c00-eb6cfc2c8009 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:43.529862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97106e81-e0ea-48c5-9c00-eb6cfc2c8009 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:43.530565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97106e81-e0ea-48c5-9c00-eb6cfc2c8009 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:43.531026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97106e81-e0ea-48c5-9c00-eb6cfc2c8009 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:43.531465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97106e81-e0ea-48c5-9c00-eb6cfc2c8009 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:43.766762 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-97106e81-e0ea-48c5-9c00-eb6cfc2c8009 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250174 Aug 09 18:15:43.768100 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3784/6835] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 18:15:43 2022] POST /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:15:54.476740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:54.477522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:15:54.482266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:15:54.484751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:54.492980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:54.493475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:54.493918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:54.494622 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:54.495081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:54.495516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:54.525258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:54.531307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Old instance type m1.heat2, new instance type m1.heat {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 18:15:54.538151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:15:54.538577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:15:54.539053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:15:54.539463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:15:54.539901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:15:54.602139 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-20646dbc-5c76-441f-b79b-a32bd762fc87 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd/action" status: 202 len: 0 microversion: 2.1 time: 0.127193 Aug 09 18:15:54.602751 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3785/6836] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:15:54 2022] POST /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:15:54.611560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-add09510-5972-4792-9628-ef659f47a61a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:54.612142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-add09510-5972-4792-9628-ef659f47a61a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:54.618223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add09510-5972-4792-9628-ef659f47a61a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:54.618674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add09510-5972-4792-9628-ef659f47a61a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:54.619488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add09510-5972-4792-9628-ef659f47a61a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:54.619956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add09510-5972-4792-9628-ef659f47a61a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:54.620644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add09510-5972-4792-9628-ef659f47a61a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:54.621183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-add09510-5972-4792-9628-ef659f47a61a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:54.770703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-add09510-5972-4792-9628-ef659f47a61a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:54.779287 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-add09510-5972-4792-9628-ef659f47a61a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1723 microversion: 2.1 time: 0.172391 Aug 09 18:15:54.779933 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3786/6837] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:54 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:15:55.801193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b21cc761-001f-4bc9-8e1f-9b332af8ce8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:55.801852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b21cc761-001f-4bc9-8e1f-9b332af8ce8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:55.809535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b21cc761-001f-4bc9-8e1f-9b332af8ce8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:55.810053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b21cc761-001f-4bc9-8e1f-9b332af8ce8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:55.810565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b21cc761-001f-4bc9-8e1f-9b332af8ce8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:55.811316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b21cc761-001f-4bc9-8e1f-9b332af8ce8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:55.812353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b21cc761-001f-4bc9-8e1f-9b332af8ce8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:55.812803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b21cc761-001f-4bc9-8e1f-9b332af8ce8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:55.955453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b21cc761-001f-4bc9-8e1f-9b332af8ce8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:55.963965 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b21cc761-001f-4bc9-8e1f-9b332af8ce8b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1723 microversion: 2.1 time: 0.167331 Aug 09 18:15:55.964549 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3787/6838] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:55 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:15:56.985909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd556cfd-9d43-4a37-9e14-8827af0f5865 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:56.986607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bd556cfd-9d43-4a37-9e14-8827af0f5865 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:56.993224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd556cfd-9d43-4a37-9e14-8827af0f5865 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:56.993695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd556cfd-9d43-4a37-9e14-8827af0f5865 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:56.994131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd556cfd-9d43-4a37-9e14-8827af0f5865 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:56.994826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd556cfd-9d43-4a37-9e14-8827af0f5865 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:56.995280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd556cfd-9d43-4a37-9e14-8827af0f5865 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:56.995733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd556cfd-9d43-4a37-9e14-8827af0f5865 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:57.124944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bd556cfd-9d43-4a37-9e14-8827af0f5865 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:57.133594 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bd556cfd-9d43-4a37-9e14-8827af0f5865 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.151539 Aug 09 18:15:57.134176 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3788/6839] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:56 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:15:58.154594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-84af2163-3e2a-478b-a624-7080e034fdcc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:58.155231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-84af2163-3e2a-478b-a624-7080e034fdcc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:58.162496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84af2163-3e2a-478b-a624-7080e034fdcc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:58.162985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84af2163-3e2a-478b-a624-7080e034fdcc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:58.163435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84af2163-3e2a-478b-a624-7080e034fdcc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:58.164164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84af2163-3e2a-478b-a624-7080e034fdcc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:58.164629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84af2163-3e2a-478b-a624-7080e034fdcc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:58.165068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84af2163-3e2a-478b-a624-7080e034fdcc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:58.301893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-84af2163-3e2a-478b-a624-7080e034fdcc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:58.309929 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-84af2163-3e2a-478b-a624-7080e034fdcc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.159389 Aug 09 18:15:58.310505 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3789/6840] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:58 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:15:59.330763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ee3f4a28-001d-4000-9444-1ddb18ba8468 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:15:59.331500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ee3f4a28-001d-4000-9444-1ddb18ba8468 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:15:59.339167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee3f4a28-001d-4000-9444-1ddb18ba8468 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:59.339829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee3f4a28-001d-4000-9444-1ddb18ba8468 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:59.340273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee3f4a28-001d-4000-9444-1ddb18ba8468 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:59.340976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee3f4a28-001d-4000-9444-1ddb18ba8468 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:15:59.341430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee3f4a28-001d-4000-9444-1ddb18ba8468 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:15:59.341860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ee3f4a28-001d-4000-9444-1ddb18ba8468 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:15:59.471049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ee3f4a28-001d-4000-9444-1ddb18ba8468 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:15:59.478942 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ee3f4a28-001d-4000-9444-1ddb18ba8468 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.152382 Aug 09 18:15:59.479509 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3790/6841] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:15:59 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:00.501932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-95b2acce-311a-41fe-93da-01f0ff5b2608 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:00.502589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-95b2acce-311a-41fe-93da-01f0ff5b2608 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:00.509347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b2acce-311a-41fe-93da-01f0ff5b2608 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:00.509834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b2acce-311a-41fe-93da-01f0ff5b2608 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:00.510275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b2acce-311a-41fe-93da-01f0ff5b2608 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:00.510971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b2acce-311a-41fe-93da-01f0ff5b2608 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:00.511427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b2acce-311a-41fe-93da-01f0ff5b2608 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:00.511881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b2acce-311a-41fe-93da-01f0ff5b2608 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:00.640537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-95b2acce-311a-41fe-93da-01f0ff5b2608 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:00.648630 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-95b2acce-311a-41fe-93da-01f0ff5b2608 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.151341 Aug 09 18:16:00.649207 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3791/6842] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:00 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:01.669637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f483b306-d051-4fbd-bbc0-0fea5f1ffbb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:01.670276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f483b306-d051-4fbd-bbc0-0fea5f1ffbb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:01.677158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f483b306-d051-4fbd-bbc0-0fea5f1ffbb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:01.677651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f483b306-d051-4fbd-bbc0-0fea5f1ffbb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:01.678097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f483b306-d051-4fbd-bbc0-0fea5f1ffbb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:01.678801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f483b306-d051-4fbd-bbc0-0fea5f1ffbb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:01.679262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f483b306-d051-4fbd-bbc0-0fea5f1ffbb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:01.679728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f483b306-d051-4fbd-bbc0-0fea5f1ffbb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:01.818981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f483b306-d051-4fbd-bbc0-0fea5f1ffbb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:01.827287 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f483b306-d051-4fbd-bbc0-0fea5f1ffbb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.161660 Aug 09 18:16:01.827891 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3792/6843] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:01 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:02.850391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a50a352e-7eb9-47e1-bba1-95e3cb214784 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:02.851074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a50a352e-7eb9-47e1-bba1-95e3cb214784 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:02.858198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a50a352e-7eb9-47e1-bba1-95e3cb214784 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:02.858697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a50a352e-7eb9-47e1-bba1-95e3cb214784 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:02.859146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a50a352e-7eb9-47e1-bba1-95e3cb214784 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:02.859883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a50a352e-7eb9-47e1-bba1-95e3cb214784 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:02.860346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a50a352e-7eb9-47e1-bba1-95e3cb214784 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:02.860784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a50a352e-7eb9-47e1-bba1-95e3cb214784 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:02.994800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a50a352e-7eb9-47e1-bba1-95e3cb214784 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:03.002974 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a50a352e-7eb9-47e1-bba1-95e3cb214784 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.156625 Aug 09 18:16:03.003547 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3793/6844] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:02 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:04.023795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d115172e-8163-413a-b391-364513f00b11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:04.024458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d115172e-8163-413a-b391-364513f00b11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:04.031302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d115172e-8163-413a-b391-364513f00b11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:04.031841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d115172e-8163-413a-b391-364513f00b11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:04.032784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d115172e-8163-413a-b391-364513f00b11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:04.033500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d115172e-8163-413a-b391-364513f00b11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:04.033964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d115172e-8163-413a-b391-364513f00b11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:04.034435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d115172e-8163-413a-b391-364513f00b11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:04.170361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d115172e-8163-413a-b391-364513f00b11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:04.179272 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d115172e-8163-413a-b391-364513f00b11 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.159396 Aug 09 18:16:04.179876 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3794/6845] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:04 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:05.200187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c873d72b-176f-41a1-9aac-b760ced07d8f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:05.200833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c873d72b-176f-41a1-9aac-b760ced07d8f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:05.208136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c873d72b-176f-41a1-9aac-b760ced07d8f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:05.208640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c873d72b-176f-41a1-9aac-b760ced07d8f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:05.209351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c873d72b-176f-41a1-9aac-b760ced07d8f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:05.210061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c873d72b-176f-41a1-9aac-b760ced07d8f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:05.210529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c873d72b-176f-41a1-9aac-b760ced07d8f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:05.210968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c873d72b-176f-41a1-9aac-b760ced07d8f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:05.360327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c873d72b-176f-41a1-9aac-b760ced07d8f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:05.369196 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c873d72b-176f-41a1-9aac-b760ced07d8f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.172983 Aug 09 18:16:05.369778 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3795/6846] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:05 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:06.390146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c7e4b1a-b3d4-4982-9a8b-856f670efb3b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:06.390757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7c7e4b1a-b3d4-4982-9a8b-856f670efb3b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:06.398336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b1a-b3d4-4982-9a8b-856f670efb3b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:06.398832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b1a-b3d4-4982-9a8b-856f670efb3b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:06.399275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b1a-b3d4-4982-9a8b-856f670efb3b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:06.400026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b1a-b3d4-4982-9a8b-856f670efb3b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:06.400499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b1a-b3d4-4982-9a8b-856f670efb3b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:06.401044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b1a-b3d4-4982-9a8b-856f670efb3b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:06.532137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7c7e4b1a-b3d4-4982-9a8b-856f670efb3b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:06.540236 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7c7e4b1a-b3d4-4982-9a8b-856f670efb3b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.154052 Aug 09 18:16:06.540855 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3796/6847] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:06 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:07.561811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f5a046e5-a72c-4b38-9b4c-28d8859af722 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:07.562436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f5a046e5-a72c-4b38-9b4c-28d8859af722 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:07.569499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a046e5-a72c-4b38-9b4c-28d8859af722 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:07.569996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a046e5-a72c-4b38-9b4c-28d8859af722 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:07.570447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a046e5-a72c-4b38-9b4c-28d8859af722 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:07.571160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a046e5-a72c-4b38-9b4c-28d8859af722 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:07.571650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a046e5-a72c-4b38-9b4c-28d8859af722 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:07.572091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5a046e5-a72c-4b38-9b4c-28d8859af722 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:07.708095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f5a046e5-a72c-4b38-9b4c-28d8859af722 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:07.716719 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f5a046e5-a72c-4b38-9b4c-28d8859af722 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.158884 Aug 09 18:16:07.717313 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3797/6848] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:07 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:08.738841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8db35b16-9628-4498-a3e1-b1a3eb6d9a35 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:08.739514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8db35b16-9628-4498-a3e1-b1a3eb6d9a35 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:08.745909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8db35b16-9628-4498-a3e1-b1a3eb6d9a35 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:08.746401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8db35b16-9628-4498-a3e1-b1a3eb6d9a35 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:08.746839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8db35b16-9628-4498-a3e1-b1a3eb6d9a35 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:08.747536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8db35b16-9628-4498-a3e1-b1a3eb6d9a35 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:08.748021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8db35b16-9628-4498-a3e1-b1a3eb6d9a35 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:08.748450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8db35b16-9628-4498-a3e1-b1a3eb6d9a35 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:08.885535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8db35b16-9628-4498-a3e1-b1a3eb6d9a35 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:08.893962 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8db35b16-9628-4498-a3e1-b1a3eb6d9a35 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.159913 Aug 09 18:16:08.894575 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3798/6849] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:08 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:09.915828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ac99c8a-5c7d-4916-9a3c-13a0caa694c1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:09.916473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ac99c8a-5c7d-4916-9a3c-13a0caa694c1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:09.924005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ac99c8a-5c7d-4916-9a3c-13a0caa694c1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:09.924502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ac99c8a-5c7d-4916-9a3c-13a0caa694c1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:09.924954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ac99c8a-5c7d-4916-9a3c-13a0caa694c1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:09.925678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ac99c8a-5c7d-4916-9a3c-13a0caa694c1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:09.926144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ac99c8a-5c7d-4916-9a3c-13a0caa694c1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:09.926588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ac99c8a-5c7d-4916-9a3c-13a0caa694c1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:10.074100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5ac99c8a-5c7d-4916-9a3c-13a0caa694c1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:10.083384 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ac99c8a-5c7d-4916-9a3c-13a0caa694c1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1728 microversion: 2.1 time: 0.171447 Aug 09 18:16:10.084200 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3799/6850] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:09 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:11.155070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec6a24b6-fc0e-4105-884c-789e97164aca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:11.155733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ec6a24b6-fc0e-4105-884c-789e97164aca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:11.161946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec6a24b6-fc0e-4105-884c-789e97164aca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:11.162461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec6a24b6-fc0e-4105-884c-789e97164aca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:11.162911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec6a24b6-fc0e-4105-884c-789e97164aca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:11.163676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec6a24b6-fc0e-4105-884c-789e97164aca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:11.164109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec6a24b6-fc0e-4105-884c-789e97164aca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:11.164550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec6a24b6-fc0e-4105-884c-789e97164aca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:11.168579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:11.385753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ec6a24b6-fc0e-4105-884c-789e97164aca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:11.394488 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ec6a24b6-fc0e-4105-884c-789e97164aca tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1727 microversion: 2.1 time: 0.293431 Aug 09 18:16:11.395080 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3800/6851] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:11 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1727 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:11.667090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-34471804-91f0-4935-81a8-2d000056e102 req-c33d7863-4b4c-44fb-b2e1-5e7743bfe00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c4e444-2b23-4c8d-a239-4909c5d025cd", "name": "network-vif-unplugged", "status": "completed", "tag": "8d5852a6-1948-442a-a464-b3b66ed71e5c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:11.677032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-34471804-91f0-4935-81a8-2d000056e102 req-c33d7863-4b4c-44fb-b2e1-5e7743bfe00c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:11.677686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-34471804-91f0-4935-81a8-2d000056e102 req-c33d7863-4b4c-44fb-b2e1-5e7743bfe00c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:11.678206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-34471804-91f0-4935-81a8-2d000056e102 req-c33d7863-4b4c-44fb-b2e1-5e7743bfe00c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:11.690859 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-34471804-91f0-4935-81a8-2d000056e102 req-c33d7863-4b4c-44fb-b2e1-5e7743bfe00c service nova] Creating event network-vif-unplugged:8d5852a6-1948-442a-a464-b3b66ed71e5c for instance 89c4e444-2b23-4c8d-a239-4909c5d025cd on n-h2-845781-6 Aug 09 18:16:11.696232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-34471804-91f0-4935-81a8-2d000056e102 req-c33d7863-4b4c-44fb-b2e1-5e7743bfe00c service nova] Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:16:11.707844 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-34471804-91f0-4935-81a8-2d000056e102 req-c33d7863-4b4c-44fb-b2e1-5e7743bfe00c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044513 Aug 09 18:16:11.708512 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3801/6852] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:16:12.417880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0618a242-3632-4321-a635-43e00577e2c8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:12.418642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0618a242-3632-4321-a635-43e00577e2c8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:12.426014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0618a242-3632-4321-a635-43e00577e2c8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:12.426511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0618a242-3632-4321-a635-43e00577e2c8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:12.426947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0618a242-3632-4321-a635-43e00577e2c8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:12.427686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0618a242-3632-4321-a635-43e00577e2c8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:12.428181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0618a242-3632-4321-a635-43e00577e2c8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:12.429012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0618a242-3632-4321-a635-43e00577e2c8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:12.632506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0618a242-3632-4321-a635-43e00577e2c8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:12.640714 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0618a242-3632-4321-a635-43e00577e2c8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1727 microversion: 2.1 time: 0.228039 Aug 09 18:16:12.641321 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3802/6853] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:12 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1727 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:13.664007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d4efa45-3991-4d37-81f0-57a13cb5a743 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:13.664640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1d4efa45-3991-4d37-81f0-57a13cb5a743 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:13.671397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d4efa45-3991-4d37-81f0-57a13cb5a743 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:13.671939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d4efa45-3991-4d37-81f0-57a13cb5a743 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:13.672380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d4efa45-3991-4d37-81f0-57a13cb5a743 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:13.673673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d4efa45-3991-4d37-81f0-57a13cb5a743 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:13.674200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d4efa45-3991-4d37-81f0-57a13cb5a743 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:13.674629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d4efa45-3991-4d37-81f0-57a13cb5a743 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:13.817421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1d4efa45-3991-4d37-81f0-57a13cb5a743 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:13.825543 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1d4efa45-3991-4d37-81f0-57a13cb5a743 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1725 microversion: 2.1 time: 0.165538 Aug 09 18:16:13.826118 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3803/6854] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:13 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:13.843111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3167343a-a58a-44dd-b500-78e4daae3edf req-cc326e32-ce74-40f2-881a-ebd04ad88bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c4e444-2b23-4c8d-a239-4909c5d025cd", "tag": "8d5852a6-1948-442a-a464-b3b66ed71e5c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:13.853365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3167343a-a58a-44dd-b500-78e4daae3edf req-cc326e32-ce74-40f2-881a-ebd04ad88bde service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:13.853850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3167343a-a58a-44dd-b500-78e4daae3edf req-cc326e32-ce74-40f2-881a-ebd04ad88bde service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:13.854290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3167343a-a58a-44dd-b500-78e4daae3edf req-cc326e32-ce74-40f2-881a-ebd04ad88bde service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:13.866666 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3167343a-a58a-44dd-b500-78e4daae3edf req-cc326e32-ce74-40f2-881a-ebd04ad88bde service nova] Creating event network-changed:8d5852a6-1948-442a-a464-b3b66ed71e5c for instance 89c4e444-2b23-4c8d-a239-4909c5d025cd on n-h2-845781-6 Aug 09 18:16:13.872240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-3167343a-a58a-44dd-b500-78e4daae3edf req-cc326e32-ce74-40f2-881a-ebd04ad88bde service nova] Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:16:13.883823 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3167343a-a58a-44dd-b500-78e4daae3edf req-cc326e32-ce74-40f2-881a-ebd04ad88bde service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056470 Aug 09 18:16:13.884644 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3804/6855] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:16:14.848537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75198ffc-fa49-452a-b308-123a8955355b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:14.849406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75198ffc-fa49-452a-b308-123a8955355b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:14.855819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75198ffc-fa49-452a-b308-123a8955355b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:14.856353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75198ffc-fa49-452a-b308-123a8955355b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:14.856799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75198ffc-fa49-452a-b308-123a8955355b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:14.857511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75198ffc-fa49-452a-b308-123a8955355b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:14.857979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75198ffc-fa49-452a-b308-123a8955355b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:14.858415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75198ffc-fa49-452a-b308-123a8955355b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:15.006940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-75198ffc-fa49-452a-b308-123a8955355b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:15.015899 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75198ffc-fa49-452a-b308-123a8955355b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1725 microversion: 2.1 time: 0.172445 Aug 09 18:16:15.016650 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3805/6856] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:14 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:16.037415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-09b60bf4-84d9-43aa-9b18-767e876c3dbb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:16.038051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-09b60bf4-84d9-43aa-9b18-767e876c3dbb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:16.045578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b60bf4-84d9-43aa-9b18-767e876c3dbb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:16.046096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b60bf4-84d9-43aa-9b18-767e876c3dbb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:16.046542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b60bf4-84d9-43aa-9b18-767e876c3dbb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:16.047273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b60bf4-84d9-43aa-9b18-767e876c3dbb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:16.047770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b60bf4-84d9-43aa-9b18-767e876c3dbb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:16.048205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-09b60bf4-84d9-43aa-9b18-767e876c3dbb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:16.188078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-09b60bf4-84d9-43aa-9b18-767e876c3dbb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:16.196795 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-09b60bf4-84d9-43aa-9b18-767e876c3dbb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1725 microversion: 2.1 time: 0.163615 Aug 09 18:16:16.197685 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3806/6857] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:16 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:17.219159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cecfa5cd-464f-478f-8a82-3dcea2646199 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:17.220520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cecfa5cd-464f-478f-8a82-3dcea2646199 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:17.227380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecfa5cd-464f-478f-8a82-3dcea2646199 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:17.227902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecfa5cd-464f-478f-8a82-3dcea2646199 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:17.228339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecfa5cd-464f-478f-8a82-3dcea2646199 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:17.229043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecfa5cd-464f-478f-8a82-3dcea2646199 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:17.229497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecfa5cd-464f-478f-8a82-3dcea2646199 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:17.229925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cecfa5cd-464f-478f-8a82-3dcea2646199 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:17.369890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cecfa5cd-464f-478f-8a82-3dcea2646199 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:17.379000 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cecfa5cd-464f-478f-8a82-3dcea2646199 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1725 microversion: 2.1 time: 0.163850 Aug 09 18:16:17.379598 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3807/6858] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:17 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:18.400804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7fe4f327-5996-4803-ad58-5efd31ed5178 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:18.401473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7fe4f327-5996-4803-ad58-5efd31ed5178 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:18.408991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fe4f327-5996-4803-ad58-5efd31ed5178 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:18.409502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fe4f327-5996-4803-ad58-5efd31ed5178 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:18.409932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fe4f327-5996-4803-ad58-5efd31ed5178 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:18.410633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fe4f327-5996-4803-ad58-5efd31ed5178 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:18.411093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fe4f327-5996-4803-ad58-5efd31ed5178 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:18.411526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fe4f327-5996-4803-ad58-5efd31ed5178 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:18.542684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7fe4f327-5996-4803-ad58-5efd31ed5178 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:18.550805 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7fe4f327-5996-4803-ad58-5efd31ed5178 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1725 microversion: 2.1 time: 0.154022 Aug 09 18:16:18.551384 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3808/6859] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:18 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:19.572099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7458030c-834f-44ac-af5e-c6dba6991622 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:19.572709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7458030c-834f-44ac-af5e-c6dba6991622 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:19.579546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7458030c-834f-44ac-af5e-c6dba6991622 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:19.580070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7458030c-834f-44ac-af5e-c6dba6991622 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:19.580515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7458030c-834f-44ac-af5e-c6dba6991622 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:19.581217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7458030c-834f-44ac-af5e-c6dba6991622 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:19.581681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7458030c-834f-44ac-af5e-c6dba6991622 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:19.582116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7458030c-834f-44ac-af5e-c6dba6991622 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:19.714577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7458030c-834f-44ac-af5e-c6dba6991622 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:19.723355 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7458030c-834f-44ac-af5e-c6dba6991622 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1725 microversion: 2.1 time: 0.155336 Aug 09 18:16:19.723976 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3809/6860] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:19 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:20.745271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a48d9593-9b4f-43f9-ad31-b84144226dd4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:20.745945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a48d9593-9b4f-43f9-ad31-b84144226dd4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:20.753464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a48d9593-9b4f-43f9-ad31-b84144226dd4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:20.753957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a48d9593-9b4f-43f9-ad31-b84144226dd4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:20.754401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a48d9593-9b4f-43f9-ad31-b84144226dd4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:20.755112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a48d9593-9b4f-43f9-ad31-b84144226dd4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:20.755576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a48d9593-9b4f-43f9-ad31-b84144226dd4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:20.756044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a48d9593-9b4f-43f9-ad31-b84144226dd4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:20.765420 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:16:20.770709 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 18:16:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd (ip 10.222.0.93) !!! Aug 09 18:16:20.890883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a48d9593-9b4f-43f9-ad31-b84144226dd4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:20.899110 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a48d9593-9b4f-43f9-ad31-b84144226dd4 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1725 microversion: 2.1 time: 0.157757 Aug 09 18:16:20.899716 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3810/6861] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:20 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:21.920699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-96620e24-e695-403d-be45-110da5ce72b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:21.921415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-96620e24-e695-403d-be45-110da5ce72b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:21.928941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96620e24-e695-403d-be45-110da5ce72b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:21.929427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96620e24-e695-403d-be45-110da5ce72b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:21.929866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96620e24-e695-403d-be45-110da5ce72b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:21.930563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96620e24-e695-403d-be45-110da5ce72b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:21.931018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96620e24-e695-403d-be45-110da5ce72b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:21.931448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96620e24-e695-403d-be45-110da5ce72b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:22.408442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-96620e24-e695-403d-be45-110da5ce72b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:22.416624 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-96620e24-e695-403d-be45-110da5ce72b1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1725 microversion: 2.1 time: 0.499865 Aug 09 18:16:22.417212 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3811/6862] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:21 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1725 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:23.437671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e6edb66-0cf2-4d9f-8758-14cab132b53a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:23.438327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8e6edb66-0cf2-4d9f-8758-14cab132b53a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:23.445242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e6edb66-0cf2-4d9f-8758-14cab132b53a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:23.445734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e6edb66-0cf2-4d9f-8758-14cab132b53a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:23.446177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e6edb66-0cf2-4d9f-8758-14cab132b53a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:23.446874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e6edb66-0cf2-4d9f-8758-14cab132b53a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:23.447337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e6edb66-0cf2-4d9f-8758-14cab132b53a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:23.447800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8e6edb66-0cf2-4d9f-8758-14cab132b53a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:23.579103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8e6edb66-0cf2-4d9f-8758-14cab132b53a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:23.587478 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e6edb66-0cf2-4d9f-8758-14cab132b53a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1725 microversion: 2.1 time: 0.153793 Aug 09 18:16:23.588081 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3812/6863] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:23 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:24.609256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f40ce97-2cdb-4f5b-aafb-2d6d0f7e09c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:24.609889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5f40ce97-2cdb-4f5b-aafb-2d6d0f7e09c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:24.613114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=61 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:24.619220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f40ce97-2cdb-4f5b-aafb-2d6d0f7e09c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.619751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f40ce97-2cdb-4f5b-aafb-2d6d0f7e09c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.620198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f40ce97-2cdb-4f5b-aafb-2d6d0f7e09c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.620916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f40ce97-2cdb-4f5b-aafb-2d6d0f7e09c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.621382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f40ce97-2cdb-4f5b-aafb-2d6d0f7e09c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.621823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f40ce97-2cdb-4f5b-aafb-2d6d0f7e09c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.755050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f40ce97-2cdb-4f5b-aafb-2d6d0f7e09c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:24.763083 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f40ce97-2cdb-4f5b-aafb-2d6d0f7e09c2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1722 microversion: 2.1 time: 0.157878 Aug 09 18:16:24.763673 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3813/6864] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:24 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:24.783213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:24.783811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:24.789795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.790283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.790720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.791422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.791899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.792328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.829696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.830181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.830623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.831341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.831831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:24.832260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:24.857169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:16:24.863101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Getting quotas for user a99b8e16341944698d60f7dde11a2f59 and project 003c8358132b49d18aafbc868de8ac24. Resources: {'ram', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:16:24.953669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:24.980895 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7937c33-3f4f-4323-8a9a-530256982132 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "POST /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd/action" status: 202 len: 0 microversion: 2.1 time: 0.201304 Aug 09 18:16:24.981538 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3814/6865] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:16:24 2022] POST /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:16:24.990965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3b1de937-44d5-46a6-a11b-916daca3fe9f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:24.991720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3b1de937-44d5-46a6-a11b-916daca3fe9f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:24.999428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b1de937-44d5-46a6-a11b-916daca3fe9f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:24.999999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b1de937-44d5-46a6-a11b-916daca3fe9f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:25.000494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b1de937-44d5-46a6-a11b-916daca3fe9f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:25.001350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b1de937-44d5-46a6-a11b-916daca3fe9f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:25.001978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b1de937-44d5-46a6-a11b-916daca3fe9f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:25.002414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3b1de937-44d5-46a6-a11b-916daca3fe9f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:25.217549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3b1de937-44d5-46a6-a11b-916daca3fe9f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:25.229092 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3b1de937-44d5-46a6-a11b-916daca3fe9f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.242489 Aug 09 18:16:25.229686 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3815/6866] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:24 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:26.250466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f21cde84-1f76-4ab8-bd30-f021ab69122d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:26.251138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f21cde84-1f76-4ab8-bd30-f021ab69122d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:26.258160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f21cde84-1f76-4ab8-bd30-f021ab69122d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:26.258649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f21cde84-1f76-4ab8-bd30-f021ab69122d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:26.259088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f21cde84-1f76-4ab8-bd30-f021ab69122d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:26.259818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f21cde84-1f76-4ab8-bd30-f021ab69122d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:26.260282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f21cde84-1f76-4ab8-bd30-f021ab69122d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:26.260716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f21cde84-1f76-4ab8-bd30-f021ab69122d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:26.396739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f21cde84-1f76-4ab8-bd30-f021ab69122d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:26.404962 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f21cde84-1f76-4ab8-bd30-f021ab69122d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.158427 Aug 09 18:16:26.405549 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3816/6867] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:26 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:27.091219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-36b54d96-fac2-42bb-b87e-78a74a110ac6 req-1af93b64-6a1c-45db-adcf-2abdbcda0359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c4e444-2b23-4c8d-a239-4909c5d025cd", "name": "network-vif-plugged", "status": "completed", "tag": "8d5852a6-1948-442a-a464-b3b66ed71e5c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:27.101397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-36b54d96-fac2-42bb-b87e-78a74a110ac6 req-1af93b64-6a1c-45db-adcf-2abdbcda0359 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:27.101876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-36b54d96-fac2-42bb-b87e-78a74a110ac6 req-1af93b64-6a1c-45db-adcf-2abdbcda0359 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:27.102304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-36b54d96-fac2-42bb-b87e-78a74a110ac6 req-1af93b64-6a1c-45db-adcf-2abdbcda0359 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:27.114786 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-36b54d96-fac2-42bb-b87e-78a74a110ac6 req-1af93b64-6a1c-45db-adcf-2abdbcda0359 service nova] Creating event network-vif-plugged:8d5852a6-1948-442a-a464-b3b66ed71e5c for instance 89c4e444-2b23-4c8d-a239-4909c5d025cd on n-h2-845781-6 Aug 09 18:16:27.120209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-36b54d96-fac2-42bb-b87e-78a74a110ac6 req-1af93b64-6a1c-45db-adcf-2abdbcda0359 service nova] Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:16:27.131020 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-36b54d96-fac2-42bb-b87e-78a74a110ac6 req-1af93b64-6a1c-45db-adcf-2abdbcda0359 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043726 Aug 09 18:16:27.131656 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3817/6868] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:16:27.428014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb267879-edd0-4894-a9bf-f581d57cc092 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:27.428722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb267879-edd0-4894-a9bf-f581d57cc092 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:27.435079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb267879-edd0-4894-a9bf-f581d57cc092 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:27.435574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb267879-edd0-4894-a9bf-f581d57cc092 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:27.436101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb267879-edd0-4894-a9bf-f581d57cc092 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:27.436800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb267879-edd0-4894-a9bf-f581d57cc092 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:27.437258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb267879-edd0-4894-a9bf-f581d57cc092 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:27.437711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb267879-edd0-4894-a9bf-f581d57cc092 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:27.579356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cb267879-edd0-4894-a9bf-f581d57cc092 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:27.588171 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb267879-edd0-4894-a9bf-f581d57cc092 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.165414 Aug 09 18:16:27.588757 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3818/6869] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:27 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:28.610769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86704dd3-37ff-4743-ac64-314e2db75fb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:28.611396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-86704dd3-37ff-4743-ac64-314e2db75fb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:28.618446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86704dd3-37ff-4743-ac64-314e2db75fb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:28.618991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86704dd3-37ff-4743-ac64-314e2db75fb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:28.619435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86704dd3-37ff-4743-ac64-314e2db75fb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:28.620194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86704dd3-37ff-4743-ac64-314e2db75fb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:28.620661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86704dd3-37ff-4743-ac64-314e2db75fb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:28.621099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86704dd3-37ff-4743-ac64-314e2db75fb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:28.757704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86704dd3-37ff-4743-ac64-314e2db75fb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:28.770603 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86704dd3-37ff-4743-ac64-314e2db75fb7 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.164389 Aug 09 18:16:28.771708 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3819/6870] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:28 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:29.792628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8500d0b4-0a0e-4746-88f4-02f75740bb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:29.793262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8500d0b4-0a0e-4746-88f4-02f75740bb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:29.800063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8500d0b4-0a0e-4746-88f4-02f75740bb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:29.800562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8500d0b4-0a0e-4746-88f4-02f75740bb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:29.801008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8500d0b4-0a0e-4746-88f4-02f75740bb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:29.801717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8500d0b4-0a0e-4746-88f4-02f75740bb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:29.802185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8500d0b4-0a0e-4746-88f4-02f75740bb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:29.802621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8500d0b4-0a0e-4746-88f4-02f75740bb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:29.936886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8500d0b4-0a0e-4746-88f4-02f75740bb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:29.945204 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8500d0b4-0a0e-4746-88f4-02f75740bb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.156548 Aug 09 18:16:29.945807 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3820/6871] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:29 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:30.190090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a38ae37a-1357-4950-9ba1-5033127c37f1 req-29ba33f4-ec3d-4644-8e54-6f86b3c3d22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c4e444-2b23-4c8d-a239-4909c5d025cd", "name": "network-vif-unplugged", "status": "completed", "tag": "8d5852a6-1948-442a-a464-b3b66ed71e5c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:30.200652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a38ae37a-1357-4950-9ba1-5033127c37f1 req-29ba33f4-ec3d-4644-8e54-6f86b3c3d22e service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:30.201262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a38ae37a-1357-4950-9ba1-5033127c37f1 req-29ba33f4-ec3d-4644-8e54-6f86b3c3d22e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:30.201900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a38ae37a-1357-4950-9ba1-5033127c37f1 req-29ba33f4-ec3d-4644-8e54-6f86b3c3d22e service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:30.216586 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a38ae37a-1357-4950-9ba1-5033127c37f1 req-29ba33f4-ec3d-4644-8e54-6f86b3c3d22e service nova] Creating event network-vif-unplugged:8d5852a6-1948-442a-a464-b3b66ed71e5c for instance 89c4e444-2b23-4c8d-a239-4909c5d025cd on n-h1-845781-6 Aug 09 18:16:30.222276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-a38ae37a-1357-4950-9ba1-5033127c37f1 req-29ba33f4-ec3d-4644-8e54-6f86b3c3d22e service nova] Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:16:30.234882 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a38ae37a-1357-4950-9ba1-5033127c37f1 req-29ba33f4-ec3d-4644-8e54-6f86b3c3d22e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047868 Aug 09 18:16:30.235575 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3821/6872] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:16:30.969235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3976f1e8-e8be-4024-a027-27a3241ffe3e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:30.971199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3976f1e8-e8be-4024-a027-27a3241ffe3e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:30.978731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3976f1e8-e8be-4024-a027-27a3241ffe3e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:30.979228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3976f1e8-e8be-4024-a027-27a3241ffe3e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:30.979698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3976f1e8-e8be-4024-a027-27a3241ffe3e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:30.980480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3976f1e8-e8be-4024-a027-27a3241ffe3e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:30.980875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3976f1e8-e8be-4024-a027-27a3241ffe3e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:30.981307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3976f1e8-e8be-4024-a027-27a3241ffe3e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:31.121661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3976f1e8-e8be-4024-a027-27a3241ffe3e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:31.129789 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3976f1e8-e8be-4024-a027-27a3241ffe3e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.164881 Aug 09 18:16:31.130374 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3822/6873] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:30 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:32.150516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7e1ef7af-a429-484b-9560-4369c3af7a27 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:32.151181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7e1ef7af-a429-484b-9560-4369c3af7a27 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:32.157988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e1ef7af-a429-484b-9560-4369c3af7a27 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:32.158472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e1ef7af-a429-484b-9560-4369c3af7a27 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:32.158912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e1ef7af-a429-484b-9560-4369c3af7a27 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:32.159607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e1ef7af-a429-484b-9560-4369c3af7a27 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:32.160085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e1ef7af-a429-484b-9560-4369c3af7a27 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:32.160513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7e1ef7af-a429-484b-9560-4369c3af7a27 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:32.306100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7e1ef7af-a429-484b-9560-4369c3af7a27 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:32.315933 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7e1ef7af-a429-484b-9560-4369c3af7a27 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.169400 Aug 09 18:16:32.316521 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3823/6874] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:32 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:32.321024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0efb3fa5-084e-41b2-94c3-c8eecbfce140 req-5ac02c36-ccbd-4b5d-9f36-7284c8adc153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c4e444-2b23-4c8d-a239-4909c5d025cd", "tag": "8d5852a6-1948-442a-a464-b3b66ed71e5c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:32.331100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0efb3fa5-084e-41b2-94c3-c8eecbfce140 req-5ac02c36-ccbd-4b5d-9f36-7284c8adc153 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:32.331593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0efb3fa5-084e-41b2-94c3-c8eecbfce140 req-5ac02c36-ccbd-4b5d-9f36-7284c8adc153 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:32.332065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0efb3fa5-084e-41b2-94c3-c8eecbfce140 req-5ac02c36-ccbd-4b5d-9f36-7284c8adc153 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:32.346406 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0efb3fa5-084e-41b2-94c3-c8eecbfce140 req-5ac02c36-ccbd-4b5d-9f36-7284c8adc153 service nova] Creating event network-changed:8d5852a6-1948-442a-a464-b3b66ed71e5c for instance 89c4e444-2b23-4c8d-a239-4909c5d025cd on n-h1-845781-6 Aug 09 18:16:32.351985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-0efb3fa5-084e-41b2-94c3-c8eecbfce140 req-5ac02c36-ccbd-4b5d-9f36-7284c8adc153 service nova] Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:16:32.363261 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0efb3fa5-084e-41b2-94c3-c8eecbfce140 req-5ac02c36-ccbd-4b5d-9f36-7284c8adc153 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045577 Aug 09 18:16:32.363918 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3824/6875] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:16:33.339405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bacbb4f5-06c0-40c1-89d6-79b34ce04940 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:33.340307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bacbb4f5-06c0-40c1-89d6-79b34ce04940 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:33.347376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bacbb4f5-06c0-40c1-89d6-79b34ce04940 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:33.347900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bacbb4f5-06c0-40c1-89d6-79b34ce04940 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:33.348346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bacbb4f5-06c0-40c1-89d6-79b34ce04940 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:33.349059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bacbb4f5-06c0-40c1-89d6-79b34ce04940 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:33.349517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bacbb4f5-06c0-40c1-89d6-79b34ce04940 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:33.350097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bacbb4f5-06c0-40c1-89d6-79b34ce04940 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:33.490914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bacbb4f5-06c0-40c1-89d6-79b34ce04940 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:33.499270 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bacbb4f5-06c0-40c1-89d6-79b34ce04940 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.165260 Aug 09 18:16:33.499810 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3825/6876] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:33 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:16:34.520598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f27ffe53-321a-4e25-8784-fe8bcac5f769 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:34.521235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f27ffe53-321a-4e25-8784-fe8bcac5f769 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:34.528187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ffe53-321a-4e25-8784-fe8bcac5f769 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:34.528685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ffe53-321a-4e25-8784-fe8bcac5f769 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:34.529135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ffe53-321a-4e25-8784-fe8bcac5f769 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:34.529841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ffe53-321a-4e25-8784-fe8bcac5f769 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:34.530310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ffe53-321a-4e25-8784-fe8bcac5f769 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:34.530747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f27ffe53-321a-4e25-8784-fe8bcac5f769 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:34.672050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f27ffe53-321a-4e25-8784-fe8bcac5f769 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:34.680869 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f27ffe53-321a-4e25-8784-fe8bcac5f769 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.164319 Aug 09 18:16:34.681452 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3826/6877] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:34 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:35.702019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d2ab420-9fb7-431c-af28-acb565f1c27e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:35.703351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d2ab420-9fb7-431c-af28-acb565f1c27e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:35.706195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:35.713242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d2ab420-9fb7-431c-af28-acb565f1c27e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:35.713750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d2ab420-9fb7-431c-af28-acb565f1c27e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:35.714201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d2ab420-9fb7-431c-af28-acb565f1c27e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:35.714935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d2ab420-9fb7-431c-af28-acb565f1c27e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:35.715406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d2ab420-9fb7-431c-af28-acb565f1c27e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:35.715873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d2ab420-9fb7-431c-af28-acb565f1c27e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:35.856075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8d2ab420-9fb7-431c-af28-acb565f1c27e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:35.864990 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d2ab420-9fb7-431c-af28-acb565f1c27e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.166927 Aug 09 18:16:35.865707 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3827/6878] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:35 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:36.886371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4d448162-2fd2-436d-b0f1-8e1cf8f89953 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:36.887042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4d448162-2fd2-436d-b0f1-8e1cf8f89953 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:36.894794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d448162-2fd2-436d-b0f1-8e1cf8f89953 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:36.895298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d448162-2fd2-436d-b0f1-8e1cf8f89953 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:36.895775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d448162-2fd2-436d-b0f1-8e1cf8f89953 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:36.896500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d448162-2fd2-436d-b0f1-8e1cf8f89953 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:36.896967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d448162-2fd2-436d-b0f1-8e1cf8f89953 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:36.897404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d448162-2fd2-436d-b0f1-8e1cf8f89953 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:37.034121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4d448162-2fd2-436d-b0f1-8e1cf8f89953 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:37.042241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4d448162-2fd2-436d-b0f1-8e1cf8f89953 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.159729 Aug 09 18:16:37.042750 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3828/6879] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:36 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:38.062883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1c30930b-0a88-499c-8248-a41b6b5e5e6c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:38.064169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1c30930b-0a88-499c-8248-a41b6b5e5e6c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:38.071238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c30930b-0a88-499c-8248-a41b6b5e5e6c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:38.071892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c30930b-0a88-499c-8248-a41b6b5e5e6c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:38.072369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c30930b-0a88-499c-8248-a41b6b5e5e6c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:38.073198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c30930b-0a88-499c-8248-a41b6b5e5e6c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:38.073671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c30930b-0a88-499c-8248-a41b6b5e5e6c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:38.074110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1c30930b-0a88-499c-8248-a41b6b5e5e6c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:38.207387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1c30930b-0a88-499c-8248-a41b6b5e5e6c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:38.216788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1c30930b-0a88-499c-8248-a41b6b5e5e6c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.157498 Aug 09 18:16:38.217024 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3829/6880] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:38 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:39.238834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f2c3b7f-d9a4-4ee2-88a0-173d2e6a2d1a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:39.239437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f2c3b7f-d9a4-4ee2-88a0-173d2e6a2d1a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:39.246323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c3b7f-d9a4-4ee2-88a0-173d2e6a2d1a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:39.246812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c3b7f-d9a4-4ee2-88a0-173d2e6a2d1a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:39.247252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c3b7f-d9a4-4ee2-88a0-173d2e6a2d1a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:39.247981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c3b7f-d9a4-4ee2-88a0-173d2e6a2d1a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:39.248440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c3b7f-d9a4-4ee2-88a0-173d2e6a2d1a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:39.248875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f2c3b7f-d9a4-4ee2-88a0-173d2e6a2d1a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:39.386124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f2c3b7f-d9a4-4ee2-88a0-173d2e6a2d1a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:39.394153 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f2c3b7f-d9a4-4ee2-88a0-173d2e6a2d1a tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.159923 Aug 09 18:16:39.394733 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3830/6881] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:39 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:40.416132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-00bc4831-3193-4468-aadc-aa25a14310a2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:40.417202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-00bc4831-3193-4468-aadc-aa25a14310a2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:40.424265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00bc4831-3193-4468-aadc-aa25a14310a2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:40.424762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00bc4831-3193-4468-aadc-aa25a14310a2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:40.425209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00bc4831-3193-4468-aadc-aa25a14310a2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:40.425922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00bc4831-3193-4468-aadc-aa25a14310a2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:40.426389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00bc4831-3193-4468-aadc-aa25a14310a2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:40.426825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00bc4831-3193-4468-aadc-aa25a14310a2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:40.559221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-00bc4831-3193-4468-aadc-aa25a14310a2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:40.568471 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-00bc4831-3193-4468-aadc-aa25a14310a2 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.156271 Aug 09 18:16:40.569144 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3831/6882] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:40 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:41.589843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f207c6bc-cb88-4315-9458-c89ae4cbdb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:41.590489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f207c6bc-cb88-4315-9458-c89ae4cbdb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:41.597613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f207c6bc-cb88-4315-9458-c89ae4cbdb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:41.598115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f207c6bc-cb88-4315-9458-c89ae4cbdb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:41.598559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f207c6bc-cb88-4315-9458-c89ae4cbdb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:41.599283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f207c6bc-cb88-4315-9458-c89ae4cbdb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:41.599775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f207c6bc-cb88-4315-9458-c89ae4cbdb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:41.600209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f207c6bc-cb88-4315-9458-c89ae4cbdb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:41.604415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:41.734075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f207c6bc-cb88-4315-9458-c89ae4cbdb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:41.743089 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f207c6bc-cb88-4315-9458-c89ae4cbdb4c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.157174 Aug 09 18:16:41.743817 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3832/6883] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:41 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:42.766848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c30ea1b5-6bf7-4f6e-b924-e70f7958ec7b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:42.767551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c30ea1b5-6bf7-4f6e-b924-e70f7958ec7b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:42.774806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c30ea1b5-6bf7-4f6e-b924-e70f7958ec7b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:42.775308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c30ea1b5-6bf7-4f6e-b924-e70f7958ec7b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:42.775776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c30ea1b5-6bf7-4f6e-b924-e70f7958ec7b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:42.776489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c30ea1b5-6bf7-4f6e-b924-e70f7958ec7b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:42.776950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c30ea1b5-6bf7-4f6e-b924-e70f7958ec7b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:42.777414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c30ea1b5-6bf7-4f6e-b924-e70f7958ec7b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:42.916618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c30ea1b5-6bf7-4f6e-b924-e70f7958ec7b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:42.925093 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c30ea1b5-6bf7-4f6e-b924-e70f7958ec7b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1721 microversion: 2.1 time: 0.162716 Aug 09 18:16:42.925685 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3833/6884] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:42 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:43.946811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ba7054db-4d20-4082-8bdb-caac85167adc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:43.947473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba7054db-4d20-4082-8bdb-caac85167adc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:43.954680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7054db-4d20-4082-8bdb-caac85167adc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:43.955177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7054db-4d20-4082-8bdb-caac85167adc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:43.955641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7054db-4d20-4082-8bdb-caac85167adc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:43.956351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7054db-4d20-4082-8bdb-caac85167adc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:43.956816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7054db-4d20-4082-8bdb-caac85167adc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:43.957259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba7054db-4d20-4082-8bdb-caac85167adc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.099496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ba7054db-4d20-4082-8bdb-caac85167adc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:44.107578 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ba7054db-4d20-4082-8bdb-caac85167adc tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1714 microversion: 2.1 time: 0.164755 Aug 09 18:16:44.108174 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3834/6885] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:43 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:44.127173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8ac196c-c414-454d-b82b-34a5d078a6eb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:44.127817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f8ac196c-c414-454d-b82b-34a5d078a6eb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:44.133539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8ac196c-c414-454d-b82b-34a5d078a6eb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.134061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8ac196c-c414-454d-b82b-34a5d078a6eb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.134500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8ac196c-c414-454d-b82b-34a5d078a6eb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.135191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8ac196c-c414-454d-b82b-34a5d078a6eb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.135668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8ac196c-c414-454d-b82b-34a5d078a6eb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.136106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8ac196c-c414-454d-b82b-34a5d078a6eb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.271502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f8ac196c-c414-454d-b82b-34a5d078a6eb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:44.279729 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f8ac196c-c414-454d-b82b-34a5d078a6eb tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1714 microversion: 2.1 time: 0.156060 Aug 09 18:16:44.280321 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3835/6886] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:44 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:44.299769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-308b50f1-b68b-4b7b-b4a4-181ca61e294e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:44.300325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-308b50f1-b68b-4b7b-b4a4-181ca61e294e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:44.306243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-308b50f1-b68b-4b7b-b4a4-181ca61e294e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.306736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-308b50f1-b68b-4b7b-b4a4-181ca61e294e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.307183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-308b50f1-b68b-4b7b-b4a4-181ca61e294e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.307912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-308b50f1-b68b-4b7b-b4a4-181ca61e294e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.308371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-308b50f1-b68b-4b7b-b4a4-181ca61e294e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.308804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-308b50f1-b68b-4b7b-b4a4-181ca61e294e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.444044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-308b50f1-b68b-4b7b-b4a4-181ca61e294e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:44.452194 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-308b50f1-b68b-4b7b-b4a4-181ca61e294e tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1714 microversion: 2.1 time: 0.156139 Aug 09 18:16:44.452777 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3836/6887] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:44 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:44.472909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-569fd830-f948-40b5-ae8a-1dc25d12422f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:44.473412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-569fd830-f948-40b5-ae8a-1dc25d12422f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:44.479606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569fd830-f948-40b5-ae8a-1dc25d12422f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.480129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569fd830-f948-40b5-ae8a-1dc25d12422f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.480566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569fd830-f948-40b5-ae8a-1dc25d12422f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.481269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569fd830-f948-40b5-ae8a-1dc25d12422f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.481723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569fd830-f948-40b5-ae8a-1dc25d12422f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.482148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-569fd830-f948-40b5-ae8a-1dc25d12422f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.509270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-569fd830-f948-40b5-ae8a-1dc25d12422f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:16:44.586115 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-569fd830-f948-40b5-ae8a-1dc25d12422f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "DELETE /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 204 len: 0 microversion: 2.1 time: 0.116650 Aug 09 18:16:44.587068 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3837/6888] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:16:44 2022] DELETE /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:16:44.595932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4973b404-efcd-4a7a-ad9b-215d55ff6f1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:44.596683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4973b404-efcd-4a7a-ad9b-215d55ff6f1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:44.602753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4973b404-efcd-4a7a-ad9b-215d55ff6f1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.603245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4973b404-efcd-4a7a-ad9b-215d55ff6f1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.603729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4973b404-efcd-4a7a-ad9b-215d55ff6f1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.604434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4973b404-efcd-4a7a-ad9b-215d55ff6f1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:44.604896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4973b404-efcd-4a7a-ad9b-215d55ff6f1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:44.605329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4973b404-efcd-4a7a-ad9b-215d55ff6f1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:44.738333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4973b404-efcd-4a7a-ad9b-215d55ff6f1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:44.746506 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4973b404-efcd-4a7a-ad9b-215d55ff6f1f tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1720 microversion: 2.1 time: 0.154859 Aug 09 18:16:44.747087 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3838/6889] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:44 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:45.768917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ef94455b-d2b2-4b94-93e9-1f30987bac64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:45.769581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ef94455b-d2b2-4b94-93e9-1f30987bac64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:45.776533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef94455b-d2b2-4b94-93e9-1f30987bac64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:45.777030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef94455b-d2b2-4b94-93e9-1f30987bac64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:45.777476 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef94455b-d2b2-4b94-93e9-1f30987bac64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:45.778174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef94455b-d2b2-4b94-93e9-1f30987bac64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:45.778636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef94455b-d2b2-4b94-93e9-1f30987bac64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:45.779068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef94455b-d2b2-4b94-93e9-1f30987bac64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:45.921109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ef94455b-d2b2-4b94-93e9-1f30987bac64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:45.929252 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ef94455b-d2b2-4b94-93e9-1f30987bac64 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1720 microversion: 2.1 time: 0.164883 Aug 09 18:16:45.929821 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3839/6890] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:45 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:46.952820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-779469c6-2f17-4168-b893-0e4cd069772d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:46.955093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-779469c6-2f17-4168-b893-0e4cd069772d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:46.962999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779469c6-2f17-4168-b893-0e4cd069772d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:46.963780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779469c6-2f17-4168-b893-0e4cd069772d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:46.964234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779469c6-2f17-4168-b893-0e4cd069772d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:46.964965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779469c6-2f17-4168-b893-0e4cd069772d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:46.965434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779469c6-2f17-4168-b893-0e4cd069772d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:46.965870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-779469c6-2f17-4168-b893-0e4cd069772d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:47.037629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-779469c6-2f17-4168-b893-0e4cd069772d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:47.046909 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-779469c6-2f17-4168-b893-0e4cd069772d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1652 microversion: 2.1 time: 0.100074 Aug 09 18:16:47.047737 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3840/6891] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:46 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1652 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:47.482987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e5b625d0-b154-40a4-8f01-fd4e476602ff req-6cd2e0a2-73c7-4b0c-92f6-97fac898d892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c4e444-2b23-4c8d-a239-4909c5d025cd", "name": "network-vif-deleted", "tag": "8d5852a6-1948-442a-a464-b3b66ed71e5c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:16:47.494251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e5b625d0-b154-40a4-8f01-fd4e476602ff req-6cd2e0a2-73c7-4b0c-92f6-97fac898d892 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:47.494729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e5b625d0-b154-40a4-8f01-fd4e476602ff req-6cd2e0a2-73c7-4b0c-92f6-97fac898d892 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:47.495163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e5b625d0-b154-40a4-8f01-fd4e476602ff req-6cd2e0a2-73c7-4b0c-92f6-97fac898d892 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:47.507517 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e5b625d0-b154-40a4-8f01-fd4e476602ff req-6cd2e0a2-73c7-4b0c-92f6-97fac898d892 service nova] Creating event network-vif-deleted:8d5852a6-1948-442a-a464-b3b66ed71e5c for instance 89c4e444-2b23-4c8d-a239-4909c5d025cd on n-h1-845781-6 Aug 09 18:16:47.512835 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e5b625d0-b154-40a4-8f01-fd4e476602ff req-6cd2e0a2-73c7-4b0c-92f6-97fac898d892 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033188 Aug 09 18:16:47.515899 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3841/6892] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:16:48.082315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e70ed838-b9f6-4f95-8403-8d2abce4359c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:48.082964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e70ed838-b9f6-4f95-8403-8d2abce4359c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:48.089706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e70ed838-b9f6-4f95-8403-8d2abce4359c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:48.090208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e70ed838-b9f6-4f95-8403-8d2abce4359c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:48.090660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e70ed838-b9f6-4f95-8403-8d2abce4359c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:48.091381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e70ed838-b9f6-4f95-8403-8d2abce4359c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:48.092012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e70ed838-b9f6-4f95-8403-8d2abce4359c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:48.092450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e70ed838-b9f6-4f95-8403-8d2abce4359c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:48.171131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e70ed838-b9f6-4f95-8403-8d2abce4359c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:48.180660 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e70ed838-b9f6-4f95-8403-8d2abce4359c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1368 microversion: 2.1 time: 0.104263 Aug 09 18:16:48.181348 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3842/6893] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:48 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:49.202277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f51d6c0f-8dcd-4f7d-a9e7-cc2de6c0ab39 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:49.202906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f51d6c0f-8dcd-4f7d-a9e7-cc2de6c0ab39 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:49.210723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51d6c0f-8dcd-4f7d-a9e7-cc2de6c0ab39 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:49.211218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51d6c0f-8dcd-4f7d-a9e7-cc2de6c0ab39 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:49.211679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51d6c0f-8dcd-4f7d-a9e7-cc2de6c0ab39 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:49.212393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51d6c0f-8dcd-4f7d-a9e7-cc2de6c0ab39 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:49.212867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51d6c0f-8dcd-4f7d-a9e7-cc2de6c0ab39 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:49.213289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f51d6c0f-8dcd-4f7d-a9e7-cc2de6c0ab39 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:49.285847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f51d6c0f-8dcd-4f7d-a9e7-cc2de6c0ab39 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:49.294980 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f51d6c0f-8dcd-4f7d-a9e7-cc2de6c0ab39 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1368 microversion: 2.1 time: 0.097037 Aug 09 18:16:49.295579 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3843/6894] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:49 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:50.316469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be65831e-772c-4187-b11e-d9b131a6aab8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:50.317086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-be65831e-772c-4187-b11e-d9b131a6aab8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:50.323937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be65831e-772c-4187-b11e-d9b131a6aab8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:50.324431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be65831e-772c-4187-b11e-d9b131a6aab8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:50.324880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be65831e-772c-4187-b11e-d9b131a6aab8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:50.325584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be65831e-772c-4187-b11e-d9b131a6aab8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:50.326102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be65831e-772c-4187-b11e-d9b131a6aab8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:50.326532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be65831e-772c-4187-b11e-d9b131a6aab8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:50.391900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be65831e-772c-4187-b11e-d9b131a6aab8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:50.400244 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-be65831e-772c-4187-b11e-d9b131a6aab8 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1368 microversion: 2.1 time: 0.087756 Aug 09 18:16:50.400842 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3844/6895] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:50 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:51.421659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-efd9100f-daae-4c08-9412-35002522307c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:51.423062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-efd9100f-daae-4c08-9412-35002522307c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:51.430389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efd9100f-daae-4c08-9412-35002522307c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:51.430890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efd9100f-daae-4c08-9412-35002522307c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:51.431345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efd9100f-daae-4c08-9412-35002522307c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:51.432096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efd9100f-daae-4c08-9412-35002522307c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:51.432565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efd9100f-daae-4c08-9412-35002522307c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:51.433004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-efd9100f-daae-4c08-9412-35002522307c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:51.500788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-efd9100f-daae-4c08-9412-35002522307c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a99b8e16341944698d60f7dde11a2f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003c8358132b49d18aafbc868de8ac24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:16:51.510395 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-efd9100f-daae-4c08-9412-35002522307c tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 200 len: 1368 microversion: 2.1 time: 0.092391 Aug 09 18:16:51.510924 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3845/6896] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:51 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:16:52.531878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:52.533014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:52.539804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:52.540309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:52.540760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:52.541483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:52.541946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:52.542382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:52.557677 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd HTTP/1.1 Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '89c4e444-2b23-4c8d-a239-4909c5d025cd'} Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:52.559396 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:52.565061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:52.565061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:52.565061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:52.565061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:16:52.565061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:16:52.565061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:52.565061 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:52.565061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:16:52.565061 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1442756b-8d62-4319-b4ab-6c81ce9f816d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 404 len: 111 microversion: 2.1 time: 0.033316 Aug 09 18:16:52.565061 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3846/6897] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:52 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:16:52.625983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:52.628262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:52.634437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:52.634944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:52.635396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:52.636148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:52.636614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:52.637053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:52.651146 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd/os-volume_attachments HTTP/1.1 Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': '89c4e444-2b23-4c8d-a239-4909c5d025cd'} Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:16:52.652818 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4378cec3-4f9c-414e-99ee-8fa14c4da146 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032408 Aug 09 18:16:52.657777 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3847/6898] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:16:52 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:16:56.007075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.007714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:56.011659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:56.017263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.017757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.018201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.018911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.019373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.019841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.036132 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd HTTP/1.1 Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '89c4e444-2b23-4c8d-a239-4909c5d025cd'} Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:16:56.037778 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-103ea431-c1f3-411d-8e11-5b289c986ba1 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "DELETE /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 404 len: 111 microversion: 2.1 time: 0.036528 Aug 09 18:16:56.041781 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3848/6899] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:16:56 2022] DELETE /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:16:56.048426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.049047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 89c4e444-2b23-4c8d-a239-4909c5d025cd] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:56.055180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.056231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.056231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.056849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.057312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.057745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.073717 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd HTTP/1.1 Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '89c4e444-2b23-4c8d-a239-4909c5d025cd'} Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.075438 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.080635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.080635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.080635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.080635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:16:56.080635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:16:56.080635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. Aug 09 18:16:56.080635 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.080635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 89c4e444-2b23-4c8d-a239-4909c5d025cd could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:16:56.080635 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19eaaee3-ea8f-41a2-baac-ef7d2bf8093b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd" status: 404 len: 111 microversion: 2.1 time: 0.032914 Aug 09 18:16:56.080635 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3849/6900] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:56 2022] GET /compute/v2.1/servers/89c4e444-2b23-4c8d-a239-4909c5d025cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:16:56.086201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.086727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:56.093440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.093947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.094400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.095124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.095585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.096086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.111642 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb HTTP/1.1 Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1c1612b4-3717-4154-b61f-f9a3743d78fb'} Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:16:56.113278 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:16:56.117641 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f6ffedd3-5a7d-4670-a13f-a82d3cfd8bee tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 404 len: 111 microversion: 2.1 time: 0.032788 Aug 09 18:16:56.118752 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3850/6901] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:16:56 2022] DELETE /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:16:56.124207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.124868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 1c1612b4-3717-4154-b61f-f9a3743d78fb] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:56.132544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.133052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.133505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.134248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.134716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.135155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.140455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:16:56.152154 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb HTTP/1.1 Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '1c1612b4-3717-4154-b61f-f9a3743d78fb'} Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.153805 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.158088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.158088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.158088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.158088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:16:56.158088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:16:56.158088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. Aug 09 18:16:56.158088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.158088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 1c1612b4-3717-4154-b61f-f9a3743d78fb could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:16:56.158088 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b15e1be-96ff-4716-a731-3b840065d2f6 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb" status: 404 len: 111 microversion: 2.1 time: 0.035558 Aug 09 18:16:56.158088 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3851/6902] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:56 2022] GET /compute/v2.1/servers/1c1612b4-3717-4154-b61f-f9a3743d78fb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:16:56.164309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.164827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:56.171588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.172107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.173071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.173797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.174257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.174692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.193141 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de HTTP/1.1 Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '2b869c24-dfc9-4029-96a1-e395665325de'} Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:16:56.194774 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b8fddf1b-bec0-4460-9951-63f868340057 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 404 len: 111 microversion: 2.1 time: 0.036206 Aug 09 18:16:56.200515 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3852/6903] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:16:56 2022] DELETE /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:16:56.206474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.207127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: 2b869c24-dfc9-4029-96a1-e395665325de] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:56.213931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.214763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.214976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.216023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.216657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.217028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.238553 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de HTTP/1.1 Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '2b869c24-dfc9-4029-96a1-e395665325de'} Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.240166 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.244728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.244728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.244728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.244728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:16:56.244728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:16:56.244728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. Aug 09 18:16:56.244728 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.244728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance 2b869c24-dfc9-4029-96a1-e395665325de could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:16:56.244728 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8a04d731-aa36-458b-b77e-afdbdf238436 tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de" status: 404 len: 111 microversion: 2.1 time: 0.040606 Aug 09 18:16:56.244728 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3853/6904] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:56 2022] GET /compute/v2.1/servers/2b869c24-dfc9-4029-96a1-e395665325de => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:16:56.250327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.251359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:56.257659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.258204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.258662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.259382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.259880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.260323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.278555 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 HTTP/1.1 Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b428af97-8e47-43b6-9a3c-35457461d986'} Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:16:56.280215 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dbde3f6d-de0f-43ae-a215-c2f5c749f7aa tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 404 len: 111 microversion: 2.1 time: 0.035237 Aug 09 18:16:56.283995 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3854/6905] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:16:56 2022] DELETE /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:16:56.290834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.291391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] [instance: b428af97-8e47-43b6-9a3c-35457461d986] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:16:56.298439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.298947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.299403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.300187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:16:56.300655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:16:56.301103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:16:56.316186 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] HTTP exception thrown: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Request method failure captured: Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 HTTP/1.1 Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qM-pb-b24YSIjLgpWU9CGd3-HlArqVM-pOniBQhpn5trG6Yk095EDQ_WSf5NzkHAmjLeFo6MsS1LqvN-fZWy-TUwrryJG7aUqayjr7lEQMuiSQtezHLcfv8m2c8tztn6tkoILWv_6FXbuwjqGhEAk5whBNo8xZEf8HeushSGz7p79U Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_003c8358132b49d18aafbc868de8ac24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/003c8358132b49d18aafbc868de8ac24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 003c8358132b49d18aafbc868de8ac24 Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServerActionsTestJSON-167178109 Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: a99b8e16341944698d60f7dde11a2f59 Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServerActionsTestJSON-167178109-project Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b428af97-8e47-43b6-9a3c-35457461d986'} Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:16:56.317769 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.322811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:16:56.322811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:16:56.322811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:16:56.322811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:16:56.322811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:16:56.322811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. Aug 09 18:16:56.322811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:16:56.322811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Returning 404 to user: Instance b428af97-8e47-43b6-9a3c-35457461d986 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:16:56.322811 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3c80e81b-a884-40a8-8adb-8d120d3a2d2d tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986" status: 404 len: 111 microversion: 2.1 time: 0.032738 Aug 09 18:16:56.322811 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3855/6906] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:16:56 2022] GET /compute/v2.1/servers/b428af97-8e47-43b6-9a3c-35457461d986 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:16:56.328854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7ee1bbc-1185-47f2-ad29-7c913446754b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] Calling method '.version_select at 0x7fbbcb8bb790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:16:56.353874 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7ee1bbc-1185-47f2-ad29-7c913446754b tempest-ServerActionsTestJSON-167178109 tempest-ServerActionsTestJSON-167178109-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-291065013" status: 202 len: 0 microversion: 2.1 time: 0.029266 Aug 09 18:16:56.354472 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3856/6907] 10.222.0.93 () {58 vars in 1218 bytes} [Tue Aug 9 18:16:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-291065013 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:17:06.183385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-392516509", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "9176eb61-4f5a-4a52-aa17-303767cd71aa"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:06.246181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] validate_networks() for [('9176eb61-4f5a-4a52-aa17-303767cd71aa', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:17:06.305844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:06.663716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:17:06.664157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:17:06.664642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:17:06.665063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:17:06.665658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:17:06.677049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:06.677559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:06.678022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:06.678784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:06.679244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:06.679755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:06.700579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Getting quotas for project 22b562b86c314b21a6d637f987c15cfc. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:17:06.706895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Getting quotas for user 6c3c503decdf48c7be7abc921a1dee8c and project 22b562b86c314b21a6d637f987c15cfc. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:17:06.721765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:17:06.724126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:17:06.774599 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d5ec6c0-530f-4d08-bb9e-47518230a0b9 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727722 Aug 09 18:17:06.775591 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3857/6908] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:17:06.797655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-328611fa-d19f-4d81-b057-d5b82fda040c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:06.798770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-328611fa-d19f-4d81-b057-d5b82fda040c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:06.871053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-328611fa-d19f-4d81-b057-d5b82fda040c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:06.879796 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-328611fa-d19f-4d81-b057-d5b82fda040c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1216 microversion: 2.1 time: 0.087797 Aug 09 18:17:06.880488 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3858/6909] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:06 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1216 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:07.902492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f6d043c0-d7ce-4b79-96b7-b1bda334a57f tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:07.903470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f6d043c0-d7ce-4b79-96b7-b1bda334a57f tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:07.981215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f6d043c0-d7ce-4b79-96b7-b1bda334a57f tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:07.988645 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f6d043c0-d7ce-4b79-96b7-b1bda334a57f tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1216 microversion: 2.1 time: 0.091489 Aug 09 18:17:07.989239 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3859/6910] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:07 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1216 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:09.010955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-baa9ef94-e3b6-4638-8aef-878782b31561 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:09.011600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-baa9ef94-e3b6-4638-8aef-878782b31561 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:09.098386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-baa9ef94-e3b6-4638-8aef-878782b31561 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:09.109085 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-baa9ef94-e3b6-4638-8aef-878782b31561 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1216 microversion: 2.1 time: 0.101998 Aug 09 18:17:09.123164 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3860/6911] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:09 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1216 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:10.129566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74039363-8d6d-4eb3-b4fd-ed05d04b90e5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:10.130191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-74039363-8d6d-4eb3-b4fd-ed05d04b90e5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:10.185985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-74039363-8d6d-4eb3-b4fd-ed05d04b90e5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:10.193503 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-74039363-8d6d-4eb3-b4fd-ed05d04b90e5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1216 microversion: 2.1 time: 0.068033 Aug 09 18:17:10.194069 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3861/6912] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:10 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:11.215034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d6ada53-a9d8-498f-8a27-23dbd1083195 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:11.216068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7d6ada53-a9d8-498f-8a27-23dbd1083195 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:11.224349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d6ada53-a9d8-498f-8a27-23dbd1083195 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:11.224846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d6ada53-a9d8-498f-8a27-23dbd1083195 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:11.225305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d6ada53-a9d8-498f-8a27-23dbd1083195 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:11.226026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d6ada53-a9d8-498f-8a27-23dbd1083195 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:11.226496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d6ada53-a9d8-498f-8a27-23dbd1083195 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:11.226927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d6ada53-a9d8-498f-8a27-23dbd1083195 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:11.296152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7d6ada53-a9d8-498f-8a27-23dbd1083195 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:11.305646 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7d6ada53-a9d8-498f-8a27-23dbd1083195 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1220 microversion: 2.1 time: 0.094523 Aug 09 18:17:11.306248 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3862/6913] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:11 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:12.327301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8bd9d85b-7c1b-40ba-a27c-f2046c715661 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:12.327987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8bd9d85b-7c1b-40ba-a27c-f2046c715661 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:12.337687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bd9d85b-7c1b-40ba-a27c-f2046c715661 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:12.338191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bd9d85b-7c1b-40ba-a27c-f2046c715661 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:12.338639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bd9d85b-7c1b-40ba-a27c-f2046c715661 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:12.339362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bd9d85b-7c1b-40ba-a27c-f2046c715661 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:12.339858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bd9d85b-7c1b-40ba-a27c-f2046c715661 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:12.340286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bd9d85b-7c1b-40ba-a27c-f2046c715661 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:12.411380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8bd9d85b-7c1b-40ba-a27c-f2046c715661 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:12.422244 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8bd9d85b-7c1b-40ba-a27c-f2046c715661 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1274 microversion: 2.1 time: 0.099143 Aug 09 18:17:12.422244 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3863/6914] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:12 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:13.395362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-aee8fbb9-3289-494d-bc3a-31472ba3c038 req-449564dd-436d-4333-973a-08d60f93cd35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d595543-4084-42f6-9e74-41be83d38bc2", "tag": "0b74fdaf-77a5-40db-b329-5452001644e3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:13.413857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aee8fbb9-3289-494d-bc3a-31472ba3c038 req-449564dd-436d-4333-973a-08d60f93cd35 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:13.414478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aee8fbb9-3289-494d-bc3a-31472ba3c038 req-449564dd-436d-4333-973a-08d60f93cd35 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:13.414998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aee8fbb9-3289-494d-bc3a-31472ba3c038 req-449564dd-436d-4333-973a-08d60f93cd35 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:13.434225 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-aee8fbb9-3289-494d-bc3a-31472ba3c038 req-449564dd-436d-4333-973a-08d60f93cd35 service nova] Creating event network-changed:0b74fdaf-77a5-40db-b329-5452001644e3 for instance 8d595543-4084-42f6-9e74-41be83d38bc2 on n-h1-845781-6 Aug 09 18:17:13.441726 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-aee8fbb9-3289-494d-bc3a-31472ba3c038 req-449564dd-436d-4333-973a-08d60f93cd35 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050435 Aug 09 18:17:13.442513 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3864/6915] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:17:13.448228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a367be18-d93c-4ff2-baf0-25a4d243450c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:13.448961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a367be18-d93c-4ff2-baf0-25a4d243450c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:13.456323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a367be18-d93c-4ff2-baf0-25a4d243450c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:13.457184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a367be18-d93c-4ff2-baf0-25a4d243450c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:13.457689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a367be18-d93c-4ff2-baf0-25a4d243450c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:13.458483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a367be18-d93c-4ff2-baf0-25a4d243450c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:13.459155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a367be18-d93c-4ff2-baf0-25a4d243450c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:13.459656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a367be18-d93c-4ff2-baf0-25a4d243450c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:13.601511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a367be18-d93c-4ff2-baf0-25a4d243450c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:13.609395 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a367be18-d93c-4ff2-baf0-25a4d243450c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1316 microversion: 2.1 time: 0.165576 Aug 09 18:17:13.609983 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3865/6916] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:13 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:14.629546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0933ee0a-0da2-4245-a7af-5d69a3c4f528 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:14.630186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0933ee0a-0da2-4245-a7af-5d69a3c4f528 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:14.636978 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0933ee0a-0da2-4245-a7af-5d69a3c4f528 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:14.637463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0933ee0a-0da2-4245-a7af-5d69a3c4f528 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:14.637899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0933ee0a-0da2-4245-a7af-5d69a3c4f528 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:14.638587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0933ee0a-0da2-4245-a7af-5d69a3c4f528 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:14.639041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0933ee0a-0da2-4245-a7af-5d69a3c4f528 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:14.639473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0933ee0a-0da2-4245-a7af-5d69a3c4f528 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:14.769064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0933ee0a-0da2-4245-a7af-5d69a3c4f528 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:14.776706 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0933ee0a-0da2-4245-a7af-5d69a3c4f528 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1316 microversion: 2.1 time: 0.151078 Aug 09 18:17:14.777281 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3866/6917] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:14 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:15.797945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11a4fda9-92ba-4587-bacc-db36348f3d0a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:15.798580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-11a4fda9-92ba-4587-bacc-db36348f3d0a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:15.805567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11a4fda9-92ba-4587-bacc-db36348f3d0a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:15.806066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11a4fda9-92ba-4587-bacc-db36348f3d0a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:15.806517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11a4fda9-92ba-4587-bacc-db36348f3d0a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:15.807227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11a4fda9-92ba-4587-bacc-db36348f3d0a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:15.807727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11a4fda9-92ba-4587-bacc-db36348f3d0a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:15.808165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11a4fda9-92ba-4587-bacc-db36348f3d0a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:15.945277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-11a4fda9-92ba-4587-bacc-db36348f3d0a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:15.952929 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11a4fda9-92ba-4587-bacc-db36348f3d0a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1316 microversion: 2.1 time: 0.159498 Aug 09 18:17:15.953515 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3867/6918] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:15 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:16.974015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-154adb91-c6c6-401a-9f05-b63f70e4c27a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:16.974714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-154adb91-c6c6-401a-9f05-b63f70e4c27a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:16.976757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:16.983200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154adb91-c6c6-401a-9f05-b63f70e4c27a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:16.983752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154adb91-c6c6-401a-9f05-b63f70e4c27a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:16.984196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154adb91-c6c6-401a-9f05-b63f70e4c27a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:16.985420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154adb91-c6c6-401a-9f05-b63f70e4c27a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:16.985884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154adb91-c6c6-401a-9f05-b63f70e4c27a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:16.986318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-154adb91-c6c6-401a-9f05-b63f70e4c27a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:17.125934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-154adb91-c6c6-401a-9f05-b63f70e4c27a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:17.133439 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-154adb91-c6c6-401a-9f05-b63f70e4c27a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1316 microversion: 2.1 time: 0.163392 Aug 09 18:17:17.134014 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3868/6919] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:16 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:18.154276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5fbe7153-9d5f-440e-84e5-385234a75464 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:18.155550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5fbe7153-9d5f-440e-84e5-385234a75464 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:18.162712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fbe7153-9d5f-440e-84e5-385234a75464 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:18.163193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fbe7153-9d5f-440e-84e5-385234a75464 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:18.163648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fbe7153-9d5f-440e-84e5-385234a75464 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:18.164349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fbe7153-9d5f-440e-84e5-385234a75464 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:18.164805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fbe7153-9d5f-440e-84e5-385234a75464 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:18.165231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5fbe7153-9d5f-440e-84e5-385234a75464 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:18.300412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5fbe7153-9d5f-440e-84e5-385234a75464 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:18.308275 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5fbe7153-9d5f-440e-84e5-385234a75464 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1316 microversion: 2.1 time: 0.158231 Aug 09 18:17:18.308871 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3869/6920] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:18 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:19.036805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-26be80dd-27b1-4b19-beb6-3a06117e6d6d req-c8fe3ca4-04b6-4cef-a6b6-0a4a853be195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d595543-4084-42f6-9e74-41be83d38bc2", "name": "network-vif-plugged", "status": "completed", "tag": "0b74fdaf-77a5-40db-b329-5452001644e3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:19.048512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-26be80dd-27b1-4b19-beb6-3a06117e6d6d req-c8fe3ca4-04b6-4cef-a6b6-0a4a853be195 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:19.049010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-26be80dd-27b1-4b19-beb6-3a06117e6d6d req-c8fe3ca4-04b6-4cef-a6b6-0a4a853be195 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:19.049518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-26be80dd-27b1-4b19-beb6-3a06117e6d6d req-c8fe3ca4-04b6-4cef-a6b6-0a4a853be195 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:19.061880 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-26be80dd-27b1-4b19-beb6-3a06117e6d6d req-c8fe3ca4-04b6-4cef-a6b6-0a4a853be195 service nova] Creating event network-vif-plugged:0b74fdaf-77a5-40db-b329-5452001644e3 for instance 8d595543-4084-42f6-9e74-41be83d38bc2 on n-h1-845781-6 Aug 09 18:17:19.067100 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-26be80dd-27b1-4b19-beb6-3a06117e6d6d req-c8fe3ca4-04b6-4cef-a6b6-0a4a853be195 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034358 Aug 09 18:17:19.067746 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3870/6921] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:17:19.331279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ce2b0814-9a01-4a9f-a4c9-02db7c15229a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:19.332112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ce2b0814-9a01-4a9f-a4c9-02db7c15229a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:19.338583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce2b0814-9a01-4a9f-a4c9-02db7c15229a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:19.339069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce2b0814-9a01-4a9f-a4c9-02db7c15229a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:19.339510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce2b0814-9a01-4a9f-a4c9-02db7c15229a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:19.340234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce2b0814-9a01-4a9f-a4c9-02db7c15229a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:19.340690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce2b0814-9a01-4a9f-a4c9-02db7c15229a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:19.341120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce2b0814-9a01-4a9f-a4c9-02db7c15229a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:19.474188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ce2b0814-9a01-4a9f-a4c9-02db7c15229a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:19.481914 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ce2b0814-9a01-4a9f-a4c9-02db7c15229a tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1316 microversion: 2.1 time: 0.156230 Aug 09 18:17:19.482494 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3871/6922] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:19 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:20.503933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-757890ec-df79-42ed-82c0-6c31f4ec08bc tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:20.504603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-757890ec-df79-42ed-82c0-6c31f4ec08bc tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:20.506563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=14 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:20.512817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-757890ec-df79-42ed-82c0-6c31f4ec08bc tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:20.513316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-757890ec-df79-42ed-82c0-6c31f4ec08bc tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:20.513768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-757890ec-df79-42ed-82c0-6c31f4ec08bc tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:20.514475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-757890ec-df79-42ed-82c0-6c31f4ec08bc tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:20.514937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-757890ec-df79-42ed-82c0-6c31f4ec08bc tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:20.515375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-757890ec-df79-42ed-82c0-6c31f4ec08bc tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:20.649811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-757890ec-df79-42ed-82c0-6c31f4ec08bc tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:20.657342 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-757890ec-df79-42ed-82c0-6c31f4ec08bc tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1504 microversion: 2.1 time: 0.157980 Aug 09 18:17:20.657947 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3872/6923] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:20 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:20.717009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-685003109", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "9176eb61-4f5a-4a52-aa17-303767cd71aa"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:20.771413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] validate_networks() for [('9176eb61-4f5a-4a52-aa17-303767cd71aa', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:17:21.153128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:17:21.153559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:17:21.154043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:17:21.154461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:17:21.154880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:17:21.164794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:21.165286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:21.165732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:21.166468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:21.166931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:21.167364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:21.184896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Getting quotas for project 22b562b86c314b21a6d637f987c15cfc. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:17:21.190232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Getting quotas for user 6c3c503decdf48c7be7abc921a1dee8c and project 22b562b86c314b21a6d637f987c15cfc. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:17:21.203013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:17:21.205353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:17:21.250917 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-00ba8b52-b7f5-44a8-aaa1-b78c5a7c25e6 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537761 Aug 09 18:17:21.251576 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3873/6924] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:17:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:17:21.261991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-05560b50-8cd7-4991-98de-f8c588e8af94 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:21.262615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-05560b50-8cd7-4991-98de-f8c588e8af94 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:21.317985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-05560b50-8cd7-4991-98de-f8c588e8af94 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:21.324700 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-05560b50-8cd7-4991-98de-f8c588e8af94 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 200 len: 1216 microversion: 2.1 time: 0.066471 Aug 09 18:17:21.325269 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3874/6925] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:21 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 1216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:22.345629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-414b9a50-0883-4b0d-811b-cc4065824f15 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:22.346576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-414b9a50-0883-4b0d-811b-cc4065824f15 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:22.354379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-414b9a50-0883-4b0d-811b-cc4065824f15 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:22.354882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-414b9a50-0883-4b0d-811b-cc4065824f15 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:22.355331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-414b9a50-0883-4b0d-811b-cc4065824f15 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:22.356080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-414b9a50-0883-4b0d-811b-cc4065824f15 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:22.356543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-414b9a50-0883-4b0d-811b-cc4065824f15 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:22.357155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-414b9a50-0883-4b0d-811b-cc4065824f15 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:22.431557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-414b9a50-0883-4b0d-811b-cc4065824f15 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:22.440117 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-414b9a50-0883-4b0d-811b-cc4065824f15 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 200 len: 1274 microversion: 2.1 time: 0.098433 Aug 09 18:17:22.440898 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3875/6926] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:22 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:23.461751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-81bebf85-72d8-4357-8ebd-688e5405fe57 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:23.463423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-81bebf85-72d8-4357-8ebd-688e5405fe57 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:23.471494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81bebf85-72d8-4357-8ebd-688e5405fe57 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:23.472376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81bebf85-72d8-4357-8ebd-688e5405fe57 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:23.472928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81bebf85-72d8-4357-8ebd-688e5405fe57 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:23.473660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81bebf85-72d8-4357-8ebd-688e5405fe57 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:23.474115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81bebf85-72d8-4357-8ebd-688e5405fe57 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:23.474555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-81bebf85-72d8-4357-8ebd-688e5405fe57 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:23.783554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-81bebf85-72d8-4357-8ebd-688e5405fe57 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:23.792073 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-81bebf85-72d8-4357-8ebd-688e5405fe57 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 200 len: 1316 microversion: 2.1 time: 0.335112 Aug 09 18:17:23.792677 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3876/6927] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:23 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:23.800598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d9820368-69e5-413e-8edf-0adb8d5f4699 req-0f17c9ad-baef-451e-84c6-00b89148e875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f1152f-c8d3-4c13-b931-4175d39b17d7", "tag": "205566e6-f351-4fb1-b83a-31fdcdf9f988"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:23.811378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d9820368-69e5-413e-8edf-0adb8d5f4699 req-0f17c9ad-baef-451e-84c6-00b89148e875 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:23.811892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d9820368-69e5-413e-8edf-0adb8d5f4699 req-0f17c9ad-baef-451e-84c6-00b89148e875 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:23.812402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d9820368-69e5-413e-8edf-0adb8d5f4699 req-0f17c9ad-baef-451e-84c6-00b89148e875 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:23.825552 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d9820368-69e5-413e-8edf-0adb8d5f4699 req-0f17c9ad-baef-451e-84c6-00b89148e875 service nova] Creating event network-changed:205566e6-f351-4fb1-b83a-31fdcdf9f988 for instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 on n-h2-845781-6 Aug 09 18:17:23.838255 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d9820368-69e5-413e-8edf-0adb8d5f4699 req-0f17c9ad-baef-451e-84c6-00b89148e875 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037289 Aug 09 18:17:23.838924 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3877/6928] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:17:24.814559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ebf80a87-a612-4edf-b802-8affc024aecd tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:24.815291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ebf80a87-a612-4edf-b802-8affc024aecd tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:24.817286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:24.822800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebf80a87-a612-4edf-b802-8affc024aecd tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:24.823291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebf80a87-a612-4edf-b802-8affc024aecd tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:24.823761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebf80a87-a612-4edf-b802-8affc024aecd tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:24.824467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebf80a87-a612-4edf-b802-8affc024aecd tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:24.824924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebf80a87-a612-4edf-b802-8affc024aecd tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:24.825355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebf80a87-a612-4edf-b802-8affc024aecd tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:24.962612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ebf80a87-a612-4edf-b802-8affc024aecd tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:24.971027 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ebf80a87-a612-4edf-b802-8affc024aecd tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 200 len: 1316 microversion: 2.1 time: 0.161550 Aug 09 18:17:24.971618 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3878/6929] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:24 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:25.991977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a598946d-bd62-42cd-b0b2-30d26f69bbf3 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:25.992647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a598946d-bd62-42cd-b0b2-30d26f69bbf3 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:25.999606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a598946d-bd62-42cd-b0b2-30d26f69bbf3 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:26.000780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a598946d-bd62-42cd-b0b2-30d26f69bbf3 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:26.001231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a598946d-bd62-42cd-b0b2-30d26f69bbf3 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:26.001947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a598946d-bd62-42cd-b0b2-30d26f69bbf3 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:26.002414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a598946d-bd62-42cd-b0b2-30d26f69bbf3 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:26.002854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a598946d-bd62-42cd-b0b2-30d26f69bbf3 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:26.131432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a598946d-bd62-42cd-b0b2-30d26f69bbf3 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:26.138927 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a598946d-bd62-42cd-b0b2-30d26f69bbf3 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 200 len: 1316 microversion: 2.1 time: 0.150912 Aug 09 18:17:26.139499 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3879/6930] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:25 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:27.159252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b9f0f0d-8540-4eed-a909-6dccbb86f8e4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:27.159937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b9f0f0d-8540-4eed-a909-6dccbb86f8e4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:27.166444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b9f0f0d-8540-4eed-a909-6dccbb86f8e4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:27.166928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b9f0f0d-8540-4eed-a909-6dccbb86f8e4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:27.167367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b9f0f0d-8540-4eed-a909-6dccbb86f8e4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:27.168096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b9f0f0d-8540-4eed-a909-6dccbb86f8e4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:27.168552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b9f0f0d-8540-4eed-a909-6dccbb86f8e4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:27.168975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8b9f0f0d-8540-4eed-a909-6dccbb86f8e4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:27.321323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8b9f0f0d-8540-4eed-a909-6dccbb86f8e4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:27.331129 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b9f0f0d-8540-4eed-a909-6dccbb86f8e4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 200 len: 1316 microversion: 2.1 time: 0.176457 Aug 09 18:17:27.331738 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3880/6931] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:27 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:28.352519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4731998-0e05-42fe-b45c-59069aded7f1 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:28.353366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a4731998-0e05-42fe-b45c-59069aded7f1 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:28.360049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731998-0e05-42fe-b45c-59069aded7f1 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:28.360535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731998-0e05-42fe-b45c-59069aded7f1 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:28.360968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731998-0e05-42fe-b45c-59069aded7f1 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:28.361662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731998-0e05-42fe-b45c-59069aded7f1 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:28.362113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731998-0e05-42fe-b45c-59069aded7f1 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:28.362599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731998-0e05-42fe-b45c-59069aded7f1 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:28.493037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a4731998-0e05-42fe-b45c-59069aded7f1 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:28.496524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:28.501322 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4731998-0e05-42fe-b45c-59069aded7f1 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 200 len: 1316 microversion: 2.1 time: 0.152770 Aug 09 18:17:28.501891 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3881/6932] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:28 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:29.285575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-faed8261-2ab6-4a1d-97e8-b8f376751d02 req-150ef07e-4c15-4195-a7f0-07081b682517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f1152f-c8d3-4c13-b931-4175d39b17d7", "name": "network-vif-plugged", "status": "completed", "tag": "205566e6-f351-4fb1-b83a-31fdcdf9f988"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:29.296542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-faed8261-2ab6-4a1d-97e8-b8f376751d02 req-150ef07e-4c15-4195-a7f0-07081b682517 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:29.297525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-faed8261-2ab6-4a1d-97e8-b8f376751d02 req-150ef07e-4c15-4195-a7f0-07081b682517 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:29.297957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-faed8261-2ab6-4a1d-97e8-b8f376751d02 req-150ef07e-4c15-4195-a7f0-07081b682517 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:29.311798 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-faed8261-2ab6-4a1d-97e8-b8f376751d02 req-150ef07e-4c15-4195-a7f0-07081b682517 service nova] Creating event network-vif-plugged:205566e6-f351-4fb1-b83a-31fdcdf9f988 for instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 on n-h2-845781-6 Aug 09 18:17:29.317575 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-faed8261-2ab6-4a1d-97e8-b8f376751d02 req-150ef07e-4c15-4195-a7f0-07081b682517 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035931 Aug 09 18:17:29.318194 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3882/6933] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:17:29.522976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-12d200e9-c2d7-4935-8c64-37dc5fc02bc0 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:29.523720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-12d200e9-c2d7-4935-8c64-37dc5fc02bc0 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:29.530527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12d200e9-c2d7-4935-8c64-37dc5fc02bc0 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:29.531512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12d200e9-c2d7-4935-8c64-37dc5fc02bc0 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:29.531994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12d200e9-c2d7-4935-8c64-37dc5fc02bc0 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:29.532690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12d200e9-c2d7-4935-8c64-37dc5fc02bc0 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:29.533151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12d200e9-c2d7-4935-8c64-37dc5fc02bc0 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:29.533587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-12d200e9-c2d7-4935-8c64-37dc5fc02bc0 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:29.666027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-12d200e9-c2d7-4935-8c64-37dc5fc02bc0 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:29.674163 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-12d200e9-c2d7-4935-8c64-37dc5fc02bc0 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 200 len: 1316 microversion: 2.1 time: 0.156097 Aug 09 18:17:29.674747 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3883/6934] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:29 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:30.694933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ec9013fe-c4d5-4b77-b8a6-a73cbd4ae5c4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:30.695723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ec9013fe-c4d5-4b77-b8a6-a73cbd4ae5c4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:30.702634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec9013fe-c4d5-4b77-b8a6-a73cbd4ae5c4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:30.703128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec9013fe-c4d5-4b77-b8a6-a73cbd4ae5c4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:30.703577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec9013fe-c4d5-4b77-b8a6-a73cbd4ae5c4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:30.704317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec9013fe-c4d5-4b77-b8a6-a73cbd4ae5c4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:30.704774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec9013fe-c4d5-4b77-b8a6-a73cbd4ae5c4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:30.705211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ec9013fe-c4d5-4b77-b8a6-a73cbd4ae5c4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:30.835889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ec9013fe-c4d5-4b77-b8a6-a73cbd4ae5c4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:30.843448 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ec9013fe-c4d5-4b77-b8a6-a73cbd4ae5c4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 200 len: 1505 microversion: 2.1 time: 0.152589 Aug 09 18:17:30.844528 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3884/6935] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:30 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:30.864308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b4aac1ea-b489-4db9-837d-2635afe929fa tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:30.864818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4aac1ea-b489-4db9-837d-2635afe929fa tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:30.870620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4aac1ea-b489-4db9-837d-2635afe929fa tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:30.871111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4aac1ea-b489-4db9-837d-2635afe929fa tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:30.871556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4aac1ea-b489-4db9-837d-2635afe929fa tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:30.872283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4aac1ea-b489-4db9-837d-2635afe929fa tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:30.872739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4aac1ea-b489-4db9-837d-2635afe929fa tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:30.873172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4aac1ea-b489-4db9-837d-2635afe929fa tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:30.897481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4aac1ea-b489-4db9-837d-2635afe929fa tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:17:30.975037 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b4aac1ea-b489-4db9-837d-2635afe929fa tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "DELETE /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 204 len: 0 microversion: 2.1 time: 0.114054 Aug 09 18:17:30.975742 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3885/6936] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:17:30 2022] DELETE /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:17:30.984835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cc582e72-effa-423d-bb36-a4759fdb5d67 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:30.985543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cc582e72-effa-423d-bb36-a4759fdb5d67 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:30.991442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc582e72-effa-423d-bb36-a4759fdb5d67 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:30.991964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc582e72-effa-423d-bb36-a4759fdb5d67 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:30.992402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc582e72-effa-423d-bb36-a4759fdb5d67 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:30.993096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc582e72-effa-423d-bb36-a4759fdb5d67 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:30.993550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc582e72-effa-423d-bb36-a4759fdb5d67 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:30.993976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cc582e72-effa-423d-bb36-a4759fdb5d67 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:31.127791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cc582e72-effa-423d-bb36-a4759fdb5d67 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:31.135568 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cc582e72-effa-423d-bb36-a4759fdb5d67 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 200 len: 1511 microversion: 2.1 time: 0.155500 Aug 09 18:17:31.136194 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3886/6937] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:30 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:32.156240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2653e8ed-97ac-43b4-ad4a-38eca95bf233 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:32.156907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2653e8ed-97ac-43b4-ad4a-38eca95bf233 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:32.159078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:32.160012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:32.166590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2653e8ed-97ac-43b4-ad4a-38eca95bf233 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:32.167080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2653e8ed-97ac-43b4-ad4a-38eca95bf233 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:32.167525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2653e8ed-97ac-43b4-ad4a-38eca95bf233 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:32.168263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2653e8ed-97ac-43b4-ad4a-38eca95bf233 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:32.168723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2653e8ed-97ac-43b4-ad4a-38eca95bf233 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:32.169154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2653e8ed-97ac-43b4-ad4a-38eca95bf233 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:32.369382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2653e8ed-97ac-43b4-ad4a-38eca95bf233 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:32.377169 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2653e8ed-97ac-43b4-ad4a-38eca95bf233 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 200 len: 1511 microversion: 2.1 time: 0.224712 Aug 09 18:17:32.377839 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3887/6938] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:32 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:32.758791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4fa51fd8-afb3-4160-86ea-8f9e8a80011f req-c4b7b86e-9cea-4987-a7d7-eb621fd887ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f1152f-c8d3-4c13-b931-4175d39b17d7", "name": "network-vif-deleted", "tag": "205566e6-f351-4fb1-b83a-31fdcdf9f988"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:32.783377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4fa51fd8-afb3-4160-86ea-8f9e8a80011f req-c4b7b86e-9cea-4987-a7d7-eb621fd887ee service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:32.784233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4fa51fd8-afb3-4160-86ea-8f9e8a80011f req-c4b7b86e-9cea-4987-a7d7-eb621fd887ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:32.784879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4fa51fd8-afb3-4160-86ea-8f9e8a80011f req-c4b7b86e-9cea-4987-a7d7-eb621fd887ee service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:32.802436 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4fa51fd8-afb3-4160-86ea-8f9e8a80011f req-c4b7b86e-9cea-4987-a7d7-eb621fd887ee service nova] Creating event network-vif-deleted:205566e6-f351-4fb1-b83a-31fdcdf9f988 for instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 on n-h2-845781-6 Aug 09 18:17:32.808297 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4fa51fd8-afb3-4160-86ea-8f9e8a80011f req-c4b7b86e-9cea-4987-a7d7-eb621fd887ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053217 Aug 09 18:17:32.809245 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3888/6939] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:17:33.400505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:33.401146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:33.407352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.407898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.408351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:33.409056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.409520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.409954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:33.423310 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] HTTP exception thrown: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Request method failure captured: Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 HTTP/1.1 Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qShipT99CkaDJW1CkK0IaoiQiGh5dTVcOz9auImbFjqK5D5fAFPvijCl8midDrkueP8UmX-hxSm0PNzpr6DIUFALOVRTQf-cOk0SLrbaKGWXVzz767lm3KFkqRj0Ip_Q6f4LnGzRBKpN0JFUT84pDXDRuNGkUnEEBfEi0ojdkRYuKM Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6c3c503decdf48c7be7abc921a1dee8c Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '02f1152f-c8d3-4c13-b931-4175d39b17d7'} Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:33.425024 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:33.429811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:33.429811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:33.429811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:33.429811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:17:33.429811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:17:33.429811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:33.429811 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:33.429811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Returning 404 to user: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:17:33.429811 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-384a292c-eb06-4e6f-9c42-fd57a1eac709 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 404 len: 111 microversion: 2.1 time: 0.031190 Aug 09 18:17:33.429811 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3889/6940] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:33 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:17:33.435403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3fd2d6ab-7fab-4ab8-aebf-4a78bb2f647c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:33.436040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3fd2d6ab-7fab-4ab8-aebf-4a78bb2f647c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:33.442330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fd2d6ab-7fab-4ab8-aebf-4a78bb2f647c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.442860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fd2d6ab-7fab-4ab8-aebf-4a78bb2f647c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.443301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fd2d6ab-7fab-4ab8-aebf-4a78bb2f647c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:33.444021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fd2d6ab-7fab-4ab8-aebf-4a78bb2f647c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.444486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fd2d6ab-7fab-4ab8-aebf-4a78bb2f647c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.444911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fd2d6ab-7fab-4ab8-aebf-4a78bb2f647c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:33.578933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3fd2d6ab-7fab-4ab8-aebf-4a78bb2f647c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:33.587245 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3fd2d6ab-7fab-4ab8-aebf-4a78bb2f647c tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1504 microversion: 2.1 time: 0.155571 Aug 09 18:17:33.587847 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3890/6941] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:33 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:33.606778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b5471ef-caa5-44be-8435-06889144c03b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:33.609080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8b5471ef-caa5-44be-8435-06889144c03b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: b6c9a8bf-8a36-4b05-bf5a-e768724d70ab] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:33.615010 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-8b5471ef-caa5-44be-8435-06889144c03b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] HTTP exception thrown: Instance b6c9a8bf-8a36-4b05-bf5a-e768724d70ab could not be found. Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b5471ef-caa5-44be-8435-06889144c03b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Request method failure captured: Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/b6c9a8bf-8a36-4b05-bf5a-e768724d70ab/action HTTP/1.1 Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 32 Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qShipT99CkaDJW1CkK0IaoiQiGh5dTVcOz9auImbFjqK5D5fAFPvijCl8midDrkueP8UmX-hxSm0PNzpr6DIUFALOVRTQf-cOk0SLrbaKGWXVzz767lm3KFkqRj0Ip_Q6f4LnGzRBKpN0JFUT84pDXDRuNGkUnEEBfEi0ojdkRYuKM Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6c3c503decdf48c7be7abc921a1dee8c Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: {"resize": {"flavorRef": "452"}} Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b6c9a8bf-8a36-4b05-bf5a-e768724d70ab could not be found. Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b6c9a8bf-8a36-4b05-bf5a-e768724d70ab', 'body': {'resize': {'flavorRef': '452'}}} Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c9a8bf-8a36-4b05-bf5a-e768724d70ab could not be found. Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:17:33.616609 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c9a8bf-8a36-4b05-bf5a-e768724d70ab could not be found. Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c9a8bf-8a36-4b05-bf5a-e768724d70ab could not be found. Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8b5471ef-caa5-44be-8435-06889144c03b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Returning 404 to user: Instance b6c9a8bf-8a36-4b05-bf5a-e768724d70ab could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8b5471ef-caa5-44be-8435-06889144c03b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "POST /compute/v2.1/servers/b6c9a8bf-8a36-4b05-bf5a-e768724d70ab/action" status: 404 len: 111 microversion: 2.1 time: 0.015039 Aug 09 18:17:33.622119 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3891/6942] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:17:33 2022] POST /compute/v2.1/servers/b6c9a8bf-8a36-4b05-bf5a-e768724d70ab/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:17:33.626820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0f52a69e-3e89-47b1-ad58-a50713fe20a2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:33.627443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0f52a69e-3e89-47b1-ad58-a50713fe20a2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:33.634182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f52a69e-3e89-47b1-ad58-a50713fe20a2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.634672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f52a69e-3e89-47b1-ad58-a50713fe20a2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.635150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f52a69e-3e89-47b1-ad58-a50713fe20a2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:33.635854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f52a69e-3e89-47b1-ad58-a50713fe20a2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.636316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f52a69e-3e89-47b1-ad58-a50713fe20a2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.636748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0f52a69e-3e89-47b1-ad58-a50713fe20a2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:33.770204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0f52a69e-3e89-47b1-ad58-a50713fe20a2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:33.777830 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0f52a69e-3e89-47b1-ad58-a50713fe20a2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1504 microversion: 2.1 time: 0.155125 Aug 09 18:17:33.778398 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3892/6943] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:33 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:17:33.798686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-930809dc-426f-4809-a180-1cf5733c52f2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:33.799299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-930809dc-426f-4809-a180-1cf5733c52f2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:33.805449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-930809dc-426f-4809-a180-1cf5733c52f2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.805936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-930809dc-426f-4809-a180-1cf5733c52f2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.806375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-930809dc-426f-4809-a180-1cf5733c52f2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:33.807064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-930809dc-426f-4809-a180-1cf5733c52f2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.807517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-930809dc-426f-4809-a180-1cf5733c52f2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.807976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-930809dc-426f-4809-a180-1cf5733c52f2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:33.938454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-930809dc-426f-4809-a180-1cf5733c52f2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:33.946056 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-930809dc-426f-4809-a180-1cf5733c52f2 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1504 microversion: 2.1 time: 0.151698 Aug 09 18:17:33.946622 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3893/6944] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:33 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:33.966183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "6b09812c-b660-4774-a9d4-12f24187434f"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:33.968386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:33.974793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.975275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.975796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:33.976491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:33.976941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:33.977365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.008372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:34.013972 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] HTTP exception thrown: Flavor 6b09812c-b660-4774-a9d4-12f24187434f could not be found. Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Request method failure captured: Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2/action HTTP/1.1 Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 65 Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qShipT99CkaDJW1CkK0IaoiQiGh5dTVcOz9auImbFjqK5D5fAFPvijCl8midDrkueP8UmX-hxSm0PNzpr6DIUFALOVRTQf-cOk0SLrbaKGWXVzz767lm3KFkqRj0Ip_Q6f4LnGzRBKpN0JFUT84pDXDRuNGkUnEEBfEi0ojdkRYuKM Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6c3c503decdf48c7be7abc921a1dee8c Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: {"resize": {"flavorRef": "6b09812c-b660-4774-a9d4-12f24187434f"}} Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: exception: Flavor 6b09812c-b660-4774-a9d4-12f24187434f could not be found. Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8d595543-4084-42f6-9e74-41be83d38bc2', 'body': {'resize': {'flavorRef': '6b09812c-b660-4774-a9d4-12f24187434f'}}} Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 18:17:34.040098 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 6b09812c-b660-4774-a9d4-12f24187434f could not be found. Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 6b09812c-b660-4774-a9d4-12f24187434f could not be found. Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 6b09812c-b660-4774-a9d4-12f24187434f could not be found. Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Returning 400 to user: Flavor 6b09812c-b660-4774-a9d4-12f24187434f could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b27f38ad-a573-4e7b-a779-0d0007ca2c02 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "POST /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2/action" status: 400 len: 107 microversion: 2.1 time: 0.079385 Aug 09 18:17:34.044088 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3894/6945] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:17:33 2022] POST /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2/action => generated 107 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 18:17:34.050777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a7e3bb96-c63e-448b-8e66-db6bd127e336 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:34.051399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a7e3bb96-c63e-448b-8e66-db6bd127e336 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:34.057386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7e3bb96-c63e-448b-8e66-db6bd127e336 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.057881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7e3bb96-c63e-448b-8e66-db6bd127e336 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.058358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7e3bb96-c63e-448b-8e66-db6bd127e336 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.059065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7e3bb96-c63e-448b-8e66-db6bd127e336 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.059529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7e3bb96-c63e-448b-8e66-db6bd127e336 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.059994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a7e3bb96-c63e-448b-8e66-db6bd127e336 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.195155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a7e3bb96-c63e-448b-8e66-db6bd127e336 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:34.202777 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a7e3bb96-c63e-448b-8e66-db6bd127e336 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1504 microversion: 2.1 time: 0.156416 Aug 09 18:17:34.203488 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3895/6946] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:34 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:34.225822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3ea26f3b-bfe4-4344-be9e-01c186e91867 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:34.226402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3ea26f3b-bfe4-4344-be9e-01c186e91867 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:34.232492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ea26f3b-bfe4-4344-be9e-01c186e91867 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.232986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ea26f3b-bfe4-4344-be9e-01c186e91867 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.233433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ea26f3b-bfe4-4344-be9e-01c186e91867 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.234134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ea26f3b-bfe4-4344-be9e-01c186e91867 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.234634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ea26f3b-bfe4-4344-be9e-01c186e91867 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.235097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ea26f3b-bfe4-4344-be9e-01c186e91867 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.388048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3ea26f3b-bfe4-4344-be9e-01c186e91867 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:34.396167 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3ea26f3b-bfe4-4344-be9e-01c186e91867 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1504 microversion: 2.1 time: 0.174676 Aug 09 18:17:34.396748 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3896/6947] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:34 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:34.416589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6113956-633e-4a2e-9e2b-63531ff8259b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6113956-633e-4a2e-9e2b-63531ff8259b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Request method failure captured: Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: request: POST /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2/action HTTP/1.1 Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 29 Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qShipT99CkaDJW1CkK0IaoiQiGh5dTVcOz9auImbFjqK5D5fAFPvijCl8midDrkueP8UmX-hxSm0PNzpr6DIUFALOVRTQf-cOk0SLrbaKGWXVzz767lm3KFkqRj0Ip_Q6f4LnGzRBKpN0JFUT84pDXDRuNGkUnEEBfEi0ojdkRYuKM Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6c3c503decdf48c7be7abc921a1dee8c Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: {"resize": {"flavorRef": ""}} Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8d595543-4084-42f6-9e74-41be83d38bc2', 'body': {'resize': {'flavorRef': ''}}} Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise error Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi '' Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.420199 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:34.424934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.424934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.424934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:34.424934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:34.424934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 18:17:34.424934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 18:17:34.424934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 09 18:17:34.424934 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.424934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6113956-633e-4a2e-9e2b-63531ff8259b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:17:34.424934 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e6113956-633e-4a2e-9e2b-63531ff8259b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "POST /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2/action" status: 400 len: 113 microversion: 2.1 time: 0.008775 Aug 09 18:17:34.424934 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3897/6948] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:17:34 2022] POST /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 18:17:34.430300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f581bd9-b7f2-4ce5-9879-0e4536a77ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:34.430919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5f581bd9-b7f2-4ce5-9879-0e4536a77ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:34.437986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f581bd9-b7f2-4ce5-9879-0e4536a77ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.438492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f581bd9-b7f2-4ce5-9879-0e4536a77ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.438924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f581bd9-b7f2-4ce5-9879-0e4536a77ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.439638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f581bd9-b7f2-4ce5-9879-0e4536a77ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.440103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f581bd9-b7f2-4ce5-9879-0e4536a77ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.440537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f581bd9-b7f2-4ce5-9879-0e4536a77ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.572096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f581bd9-b7f2-4ce5-9879-0e4536a77ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:34.580321 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f581bd9-b7f2-4ce5-9879-0e4536a77ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1504 microversion: 2.1 time: 0.153834 Aug 09 18:17:34.580891 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3898/6949] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:34 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:34.603369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:34.603916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:34.609818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.610309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.611009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.611557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.611922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.612355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.625991 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] HTTP exception thrown: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Request method failure captured: Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 HTTP/1.1 Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qShipT99CkaDJW1CkK0IaoiQiGh5dTVcOz9auImbFjqK5D5fAFPvijCl8midDrkueP8UmX-hxSm0PNzpr6DIUFALOVRTQf-cOk0SLrbaKGWXVzz767lm3KFkqRj0Ip_Q6f4LnGzRBKpN0JFUT84pDXDRuNGkUnEEBfEi0ojdkRYuKM Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6c3c503decdf48c7be7abc921a1dee8c Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '02f1152f-c8d3-4c13-b931-4175d39b17d7'} Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:17:34.628101 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Returning 404 to user: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dbd9d3d8-2969-4ef5-9c58-394600cc4ca4 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "DELETE /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 404 len: 111 microversion: 2.1 time: 0.029919 Aug 09 18:17:34.632281 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3899/6950] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:17:34 2022] DELETE /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:17:34.638623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:34.639250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 02f1152f-c8d3-4c13-b931-4175d39b17d7] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:34.645890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.646381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.646820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.647517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.648008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.648439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.662463 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] HTTP exception thrown: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Request method failure captured: Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 HTTP/1.1 Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qShipT99CkaDJW1CkK0IaoiQiGh5dTVcOz9auImbFjqK5D5fAFPvijCl8midDrkueP8UmX-hxSm0PNzpr6DIUFALOVRTQf-cOk0SLrbaKGWXVzz767lm3KFkqRj0Ip_Q6f4LnGzRBKpN0JFUT84pDXDRuNGkUnEEBfEi0ojdkRYuKM Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6c3c503decdf48c7be7abc921a1dee8c Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '02f1152f-c8d3-4c13-b931-4175d39b17d7'} Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:34.664070 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.668640 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:34.668640 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:34.668640 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:34.668640 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:17:34.668640 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:17:34.668640 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. Aug 09 18:17:34.668640 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:34.668640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Returning 404 to user: Instance 02f1152f-c8d3-4c13-b931-4175d39b17d7 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:17:34.668640 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c8a7c27b-38ff-4a5e-91d9-19321d2483d8 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7" status: 404 len: 111 microversion: 2.1 time: 0.030798 Aug 09 18:17:34.668640 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3900/6951] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:34 2022] GET /compute/v2.1/servers/02f1152f-c8d3-4c13-b931-4175d39b17d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:17:34.673666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-60fc1f62-da42-479b-80ed-c3fe48e147a5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:34.674166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-60fc1f62-da42-479b-80ed-c3fe48e147a5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:34.679992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60fc1f62-da42-479b-80ed-c3fe48e147a5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.680477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60fc1f62-da42-479b-80ed-c3fe48e147a5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.680919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60fc1f62-da42-479b-80ed-c3fe48e147a5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.681616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60fc1f62-da42-479b-80ed-c3fe48e147a5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.682079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60fc1f62-da42-479b-80ed-c3fe48e147a5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.682509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-60fc1f62-da42-479b-80ed-c3fe48e147a5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.708288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-60fc1f62-da42-479b-80ed-c3fe48e147a5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:17:34.734320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:17:34.791651 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-60fc1f62-da42-479b-80ed-c3fe48e147a5 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 204 len: 0 microversion: 2.1 time: 0.121221 Aug 09 18:17:34.792526 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3901/6952] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:17:34 2022] DELETE /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:17:34.800737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a2735f07-4f7a-41be-9367-6b892988c22b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:34.801453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a2735f07-4f7a-41be-9367-6b892988c22b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:34.807374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2735f07-4f7a-41be-9367-6b892988c22b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.807955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2735f07-4f7a-41be-9367-6b892988c22b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.808404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2735f07-4f7a-41be-9367-6b892988c22b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.809107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2735f07-4f7a-41be-9367-6b892988c22b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:34.809570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2735f07-4f7a-41be-9367-6b892988c22b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:34.810012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a2735f07-4f7a-41be-9367-6b892988c22b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:34.947604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a2735f07-4f7a-41be-9367-6b892988c22b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:34.955825 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a2735f07-4f7a-41be-9367-6b892988c22b tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1510 microversion: 2.1 time: 0.159173 Aug 09 18:17:34.956398 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3902/6953] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:34 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:35.977179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8bf211ac-7f3f-4da6-a9ce-d3959efe9791 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:35.977921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8bf211ac-7f3f-4da6-a9ce-d3959efe9791 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:35.984677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf211ac-7f3f-4da6-a9ce-d3959efe9791 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:35.985173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf211ac-7f3f-4da6-a9ce-d3959efe9791 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:35.985621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf211ac-7f3f-4da6-a9ce-d3959efe9791 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:35.986329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf211ac-7f3f-4da6-a9ce-d3959efe9791 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:35.986792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf211ac-7f3f-4da6-a9ce-d3959efe9791 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:35.987237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bf211ac-7f3f-4da6-a9ce-d3959efe9791 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:36.121793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8bf211ac-7f3f-4da6-a9ce-d3959efe9791 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:36.130049 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8bf211ac-7f3f-4da6-a9ce-d3959efe9791 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1510 microversion: 2.1 time: 0.156788 Aug 09 18:17:36.130629 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3903/6954] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:35 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:37.009641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-966b62eb-f4e2-4ed3-895c-14494fc764a7 req-c8cc3361-5dc0-4c2f-bc7d-f853deb2adbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d595543-4084-42f6-9e74-41be83d38bc2", "name": "network-vif-deleted", "tag": "0b74fdaf-77a5-40db-b329-5452001644e3"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:17:37.021229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-966b62eb-f4e2-4ed3-895c-14494fc764a7 req-c8cc3361-5dc0-4c2f-bc7d-f853deb2adbb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:37.021719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-966b62eb-f4e2-4ed3-895c-14494fc764a7 req-c8cc3361-5dc0-4c2f-bc7d-f853deb2adbb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:37.022378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-966b62eb-f4e2-4ed3-895c-14494fc764a7 req-c8cc3361-5dc0-4c2f-bc7d-f853deb2adbb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:37.034504 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-966b62eb-f4e2-4ed3-895c-14494fc764a7 req-c8cc3361-5dc0-4c2f-bc7d-f853deb2adbb service nova] Creating event network-vif-deleted:0b74fdaf-77a5-40db-b329-5452001644e3 for instance 8d595543-4084-42f6-9e74-41be83d38bc2 on n-h1-845781-6 Aug 09 18:17:37.039805 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-966b62eb-f4e2-4ed3-895c-14494fc764a7 req-c8cc3361-5dc0-4c2f-bc7d-f853deb2adbb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034025 Aug 09 18:17:37.040845 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3904/6955] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:17:37.154352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:37.155341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:37.162905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:37.163752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:37.164208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:37.164951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:37.165421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:37.165858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:37.201619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:37.202116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:37.202572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:37.203047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lazy-loading 'fault' on Instance uuid 8d595543-4084-42f6-9e74-41be83d38bc2 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:17:37.248140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3c503decdf48c7be7abc921a1dee8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b562b86c314b21a6d637f987c15cfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:17:37.255831 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-42ac9404-cc81-4e02-87c6-7c0c75694437 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 200 len: 1306 microversion: 2.1 time: 0.108220 Aug 09 18:17:37.256415 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3905/6956] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:37 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:17:38.277301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:17:38.278008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] [instance: 8d595543-4084-42f6-9e74-41be83d38bc2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:17:38.284769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:38.285252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:38.285692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:38.286387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:17:38.286839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:17:38.287265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:17:38.300855 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] HTTP exception thrown: Instance 8d595543-4084-42f6-9e74-41be83d38bc2 could not be found. Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Request method failure captured: Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 HTTP/1.1 Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qShipT99CkaDJW1CkK0IaoiQiGh5dTVcOz9auImbFjqK5D5fAFPvijCl8midDrkueP8UmX-hxSm0PNzpr6DIUFALOVRTQf-cOk0SLrbaKGWXVzz767lm3KFkqRj0Ip_Q6f4LnGzRBKpN0JFUT84pDXDRuNGkUnEEBfEi0ojdkRYuKM Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/22b562b86c314b21a6d637f987c15cfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 22b562b86c314b21a6d637f987c15cfc Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-ServersNegativeTestJSON-112960707 Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 6c3c503decdf48c7be7abc921a1dee8c Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-ServersNegativeTestJSON-112960707-project Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 8d595543-4084-42f6-9e74-41be83d38bc2 could not be found. Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '8d595543-4084-42f6-9e74-41be83d38bc2'} Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d595543-4084-42f6-9e74-41be83d38bc2 could not be found. Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d595543-4084-42f6-9e74-41be83d38bc2 could not be found. Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:17:38.302528 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:38.306881 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:17:38.306881 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:17:38.306881 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:17:38.306881 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:17:38.306881 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:17:38.306881 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d595543-4084-42f6-9e74-41be83d38bc2 could not be found. Aug 09 18:17:38.306881 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:17:38.306881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] Returning 404 to user: Instance 8d595543-4084-42f6-9e74-41be83d38bc2 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:17:38.306881 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-06a8e745-9465-40ec-b3f1-53a947cca552 tempest-ServersNegativeTestJSON-112960707 tempest-ServersNegativeTestJSON-112960707-project] 10.222.0.93 "GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2" status: 404 len: 111 microversion: 2.1 time: 0.030553 Aug 09 18:17:38.306881 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3906/6957] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:17:38 2022] GET /compute/v2.1/servers/8d595543-4084-42f6-9e74-41be83d38bc2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:18:12.050260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:12.051076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:12.238479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fb915a8a-4eba-472d-ba61-3923cd8aa403 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Action: 'create', calling method: .version_select at 0x7fbbcb746670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1665347927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ4/7L/ZHWUd1cXL7vgVa05/GjlNyRuHMZmiHTotpz8sRZWbRoCC+I0oTLeNFyYat80MBntiKnpix8vzt4KEkAVMICwqSUxjI9xv0/qL/56cMeXY3WufU6WnNRDIMDgsw=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:12.254497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-fb915a8a-4eba-472d-ba61-3923cd8aa403 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for project 37479c7fa67644d0bf9c04ba87987961. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:18:12.260036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-fb915a8a-4eba-472d-ba61-3923cd8aa403 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for user 9ef040a2072d493ba849c258c9be9d50 and project 37479c7fa67644d0bf9c04ba87987961. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:18:12.286959 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fb915a8a-4eba-472d-ba61-3923cd8aa403 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.242892 Aug 09 18:18:12.287581 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3907/6958] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:18:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:18:12.341929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1099052147", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1665347927", "networks": [{"uuid": "257930bc-ffda-4ac0-a871-e1412cfd2184"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:12.397263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] validate_networks() for [('257930bc-ffda-4ac0-a871-e1412cfd2184', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:18:12.794129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:18:12.794597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:18:12.795087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:18:12.795581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:18:12.796036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:18:12.805464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:12.805955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:12.806402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:12.807144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:12.807609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:12.808081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:12.825273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for project 37479c7fa67644d0bf9c04ba87987961. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:18:12.830627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for user 9ef040a2072d493ba849c258c9be9d50 and project 37479c7fa67644d0bf9c04ba87987961. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:18:12.843186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:18:12.846036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:18:12.892425 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8bddccb3-5b5d-483c-a2bd-78f7657c31e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554592 Aug 09 18:18:12.893275 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3908/6959] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:18:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:18:12.903735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c2305bb-99fa-4463-8acb-28604ba8cadd tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:12.904370 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c2305bb-99fa-4463-8acb-28604ba8cadd tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:12.960909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5c2305bb-99fa-4463-8acb-28604ba8cadd tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:12.968679 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c2305bb-99fa-4463-8acb-28604ba8cadd tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1263 microversion: 2.1 time: 0.068789 Aug 09 18:18:12.969896 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3909/6960] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:12 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:13.990358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7c2920ba-93b9-4dad-8153-c26035e2b918 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:13.991608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7c2920ba-93b9-4dad-8153-c26035e2b918 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:13.999377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c2920ba-93b9-4dad-8153-c26035e2b918 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:14.000175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c2920ba-93b9-4dad-8153-c26035e2b918 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:14.001359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c2920ba-93b9-4dad-8153-c26035e2b918 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:14.002244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c2920ba-93b9-4dad-8153-c26035e2b918 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:14.002872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c2920ba-93b9-4dad-8153-c26035e2b918 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:14.003472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7c2920ba-93b9-4dad-8153-c26035e2b918 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:14.077661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7c2920ba-93b9-4dad-8153-c26035e2b918 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:14.087502 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7c2920ba-93b9-4dad-8153-c26035e2b918 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1323 microversion: 2.1 time: 0.100508 Aug 09 18:18:14.088641 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3910/6961] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:13 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1323 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:15.111765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ecade80-1fc4-4eb8-9a77-48f19466c23f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:15.112499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ecade80-1fc4-4eb8-9a77-48f19466c23f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:15.120714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ecade80-1fc4-4eb8-9a77-48f19466c23f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:15.122825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ecade80-1fc4-4eb8-9a77-48f19466c23f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:15.123290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ecade80-1fc4-4eb8-9a77-48f19466c23f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:15.124086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ecade80-1fc4-4eb8-9a77-48f19466c23f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:15.124563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ecade80-1fc4-4eb8-9a77-48f19466c23f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:15.125001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ecade80-1fc4-4eb8-9a77-48f19466c23f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:15.301939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5ecade80-1fc4-4eb8-9a77-48f19466c23f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:15.310951 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ecade80-1fc4-4eb8-9a77-48f19466c23f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1363 microversion: 2.1 time: 0.203985 Aug 09 18:18:15.312441 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3911/6962] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:15 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:15.832625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fd237ef3-9aca-44e4-838c-8700873e6370 req-9b1100d7-9b81-4a0f-9a8d-c7bf13dc9669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc038f46-3b68-4e22-9eb3-32263a5013ad", "tag": "cba56df9-88ce-4ea4-8027-c760be0a3bf5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:15.847917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fd237ef3-9aca-44e4-838c-8700873e6370 req-9b1100d7-9b81-4a0f-9a8d-c7bf13dc9669 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:15.848520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fd237ef3-9aca-44e4-838c-8700873e6370 req-9b1100d7-9b81-4a0f-9a8d-c7bf13dc9669 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:15.849048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fd237ef3-9aca-44e4-838c-8700873e6370 req-9b1100d7-9b81-4a0f-9a8d-c7bf13dc9669 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:15.862885 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fd237ef3-9aca-44e4-838c-8700873e6370 req-9b1100d7-9b81-4a0f-9a8d-c7bf13dc9669 service nova] Creating event network-changed:cba56df9-88ce-4ea4-8027-c760be0a3bf5 for instance dc038f46-3b68-4e22-9eb3-32263a5013ad on n-h1-845781-6 Aug 09 18:18:15.868864 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fd237ef3-9aca-44e4-838c-8700873e6370 req-9b1100d7-9b81-4a0f-9a8d-c7bf13dc9669 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040885 Aug 09 18:18:15.869570 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3912/6963] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:18:16.334923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-61674924-60ed-4965-917e-fdf91e1f53a1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:16.335672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61674924-60ed-4965-917e-fdf91e1f53a1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:16.342165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61674924-60ed-4965-917e-fdf91e1f53a1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:16.342648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61674924-60ed-4965-917e-fdf91e1f53a1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:16.343086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61674924-60ed-4965-917e-fdf91e1f53a1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:16.343814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61674924-60ed-4965-917e-fdf91e1f53a1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:16.344266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61674924-60ed-4965-917e-fdf91e1f53a1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:16.344706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61674924-60ed-4965-917e-fdf91e1f53a1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:16.478916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-61674924-60ed-4965-917e-fdf91e1f53a1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:16.487043 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-61674924-60ed-4965-917e-fdf91e1f53a1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1363 microversion: 2.1 time: 0.157273 Aug 09 18:18:16.487619 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3913/6964] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:16 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:17.509736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-366e2861-a2a5-4a95-b1f3-7d53c6506980 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:17.511823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-366e2861-a2a5-4a95-b1f3-7d53c6506980 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:17.520720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366e2861-a2a5-4a95-b1f3-7d53c6506980 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:17.521505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366e2861-a2a5-4a95-b1f3-7d53c6506980 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:17.522112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366e2861-a2a5-4a95-b1f3-7d53c6506980 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:17.523084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366e2861-a2a5-4a95-b1f3-7d53c6506980 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:17.523735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366e2861-a2a5-4a95-b1f3-7d53c6506980 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:17.524328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-366e2861-a2a5-4a95-b1f3-7d53c6506980 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:17.675480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-366e2861-a2a5-4a95-b1f3-7d53c6506980 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:17.683464 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-366e2861-a2a5-4a95-b1f3-7d53c6506980 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1363 microversion: 2.1 time: 0.178878 Aug 09 18:18:17.684444 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3914/6965] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:17 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:18.705406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7148f554-e17b-490c-98da-dad94fdfbab9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:18.706081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7148f554-e17b-490c-98da-dad94fdfbab9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:18.713068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7148f554-e17b-490c-98da-dad94fdfbab9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:18.713602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7148f554-e17b-490c-98da-dad94fdfbab9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:18.713975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7148f554-e17b-490c-98da-dad94fdfbab9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:18.714677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7148f554-e17b-490c-98da-dad94fdfbab9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:18.715214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7148f554-e17b-490c-98da-dad94fdfbab9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:18.715566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7148f554-e17b-490c-98da-dad94fdfbab9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:18.848544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7148f554-e17b-490c-98da-dad94fdfbab9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:18.856151 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7148f554-e17b-490c-98da-dad94fdfbab9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1363 microversion: 2.1 time: 0.155122 Aug 09 18:18:18.856744 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3915/6966] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:18 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:19.877740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e9b2df63-7a17-47e5-b3ba-138bdb9ab158 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:19.879097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e9b2df63-7a17-47e5-b3ba-138bdb9ab158 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:19.885888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9b2df63-7a17-47e5-b3ba-138bdb9ab158 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:19.886381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9b2df63-7a17-47e5-b3ba-138bdb9ab158 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:19.886827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9b2df63-7a17-47e5-b3ba-138bdb9ab158 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:19.887529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9b2df63-7a17-47e5-b3ba-138bdb9ab158 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:19.888019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9b2df63-7a17-47e5-b3ba-138bdb9ab158 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:19.888444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e9b2df63-7a17-47e5-b3ba-138bdb9ab158 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:20.026238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e9b2df63-7a17-47e5-b3ba-138bdb9ab158 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:20.033754 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e9b2df63-7a17-47e5-b3ba-138bdb9ab158 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1363 microversion: 2.1 time: 0.160687 Aug 09 18:18:20.034324 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3916/6967] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:19 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:21.054652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-96c1c342-3a59-4b31-91af-c3f786caadc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:21.055281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-96c1c342-3a59-4b31-91af-c3f786caadc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:21.062106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96c1c342-3a59-4b31-91af-c3f786caadc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:21.062587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96c1c342-3a59-4b31-91af-c3f786caadc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:21.063023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96c1c342-3a59-4b31-91af-c3f786caadc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:21.064354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96c1c342-3a59-4b31-91af-c3f786caadc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:21.064807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96c1c342-3a59-4b31-91af-c3f786caadc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:21.065236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96c1c342-3a59-4b31-91af-c3f786caadc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:21.198555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-96c1c342-3a59-4b31-91af-c3f786caadc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:21.207027 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-96c1c342-3a59-4b31-91af-c3f786caadc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1363 microversion: 2.1 time: 0.156216 Aug 09 18:18:21.207663 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3917/6968] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:21 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:21.330384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e081f2be-f4fb-465a-ac40-84c540a7cae7 req-34b32a87-62ce-417a-b331-6d22787d88c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc038f46-3b68-4e22-9eb3-32263a5013ad", "name": "network-vif-plugged", "status": "completed", "tag": "cba56df9-88ce-4ea4-8027-c760be0a3bf5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:21.340605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e081f2be-f4fb-465a-ac40-84c540a7cae7 req-34b32a87-62ce-417a-b331-6d22787d88c1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:21.341091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e081f2be-f4fb-465a-ac40-84c540a7cae7 req-34b32a87-62ce-417a-b331-6d22787d88c1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:21.341566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e081f2be-f4fb-465a-ac40-84c540a7cae7 req-34b32a87-62ce-417a-b331-6d22787d88c1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:21.353440 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e081f2be-f4fb-465a-ac40-84c540a7cae7 req-34b32a87-62ce-417a-b331-6d22787d88c1 service nova] Creating event network-vif-plugged:cba56df9-88ce-4ea4-8027-c760be0a3bf5 for instance dc038f46-3b68-4e22-9eb3-32263a5013ad on n-h1-845781-6 Aug 09 18:18:21.358450 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e081f2be-f4fb-465a-ac40-84c540a7cae7 req-34b32a87-62ce-417a-b331-6d22787d88c1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031939 Aug 09 18:18:21.359250 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3918/6969] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:18:22.230681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-97182dee-3388-48f7-8b63-3f2e091f72e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:22.231396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-97182dee-3388-48f7-8b63-3f2e091f72e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:22.238218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97182dee-3388-48f7-8b63-3f2e091f72e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:22.238718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97182dee-3388-48f7-8b63-3f2e091f72e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:22.239169 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97182dee-3388-48f7-8b63-3f2e091f72e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:22.239951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97182dee-3388-48f7-8b63-3f2e091f72e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:22.240416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97182dee-3388-48f7-8b63-3f2e091f72e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:22.240879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97182dee-3388-48f7-8b63-3f2e091f72e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:22.374684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-97182dee-3388-48f7-8b63-3f2e091f72e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:22.382629 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-97182dee-3388-48f7-8b63-3f2e091f72e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1363 microversion: 2.1 time: 0.157328 Aug 09 18:18:22.383209 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3919/6970] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:22 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:23.404219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dbe3286d-e579-48eb-b995-17a183248bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:23.404798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dbe3286d-e579-48eb-b995-17a183248bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:23.406729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:23.407984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:23.414852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbe3286d-e579-48eb-b995-17a183248bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:23.415344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbe3286d-e579-48eb-b995-17a183248bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:23.415827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbe3286d-e579-48eb-b995-17a183248bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:23.416534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbe3286d-e579-48eb-b995-17a183248bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:23.416998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbe3286d-e579-48eb-b995-17a183248bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:23.417434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-dbe3286d-e579-48eb-b995-17a183248bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:23.554832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dbe3286d-e579-48eb-b995-17a183248bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:23.562643 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dbe3286d-e579-48eb-b995-17a183248bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1554 microversion: 2.1 time: 0.162385 Aug 09 18:18:23.563267 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3920/6971] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:23 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:23.581969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-719303bf-2d5b-4877-80ef-c48170d9bfe6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:23.582563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-719303bf-2d5b-4877-80ef-c48170d9bfe6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:23.588670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-719303bf-2d5b-4877-80ef-c48170d9bfe6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:23.589153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-719303bf-2d5b-4877-80ef-c48170d9bfe6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:23.589592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-719303bf-2d5b-4877-80ef-c48170d9bfe6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:23.590278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-719303bf-2d5b-4877-80ef-c48170d9bfe6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:23.590734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-719303bf-2d5b-4877-80ef-c48170d9bfe6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:23.591159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-719303bf-2d5b-4877-80ef-c48170d9bfe6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:23.721265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-719303bf-2d5b-4877-80ef-c48170d9bfe6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:23.728907 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-719303bf-2d5b-4877-80ef-c48170d9bfe6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1554 microversion: 2.1 time: 0.150561 Aug 09 18:18:23.729478 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3921/6972] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:23 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:25.355578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6a2620ad-6baa-4d35-8f55-769cf5c5154f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45c09d7d-3636-4991-a808-c9a642dbb095"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:25.358019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6a2620ad-6baa-4d35-8f55-769cf5c5154f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:25.364966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a2620ad-6baa-4d35-8f55-769cf5c5154f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:25.365489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a2620ad-6baa-4d35-8f55-769cf5c5154f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:25.365934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a2620ad-6baa-4d35-8f55-769cf5c5154f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:25.366641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a2620ad-6baa-4d35-8f55-769cf5c5154f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:25.367106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a2620ad-6baa-4d35-8f55-769cf5c5154f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:25.367540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a2620ad-6baa-4d35-8f55-769cf5c5154f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:25.610973 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6a2620ad-6baa-4d35-8f55-769cf5c5154f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "POST /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258665 Aug 09 18:18:25.611551 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3922/6973] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 18:18:25 2022] POST /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:18:36.319362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:36.320294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:36.324453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0bcdb18d-2196-420c-bfa0-509a5fa9b13d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:36.325052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0bcdb18d-2196-420c-bfa0-509a5fa9b13d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:36.333237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcdb18d-2196-420c-bfa0-509a5fa9b13d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:36.333723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcdb18d-2196-420c-bfa0-509a5fa9b13d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:36.334171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcdb18d-2196-420c-bfa0-509a5fa9b13d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:36.334876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcdb18d-2196-420c-bfa0-509a5fa9b13d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:36.335340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcdb18d-2196-420c-bfa0-509a5fa9b13d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:36.335812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0bcdb18d-2196-420c-bfa0-509a5fa9b13d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:36.415576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-0bcdb18d-2196-420c-bfa0-509a5fa9b13d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lazy-loading 'services' on Instance uuid dc038f46-3b68-4e22-9eb3-32263a5013ad {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:18:36.488315 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0bcdb18d-2196-420c-bfa0-509a5fa9b13d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments/45c09d7d-3636-4991-a808-c9a642dbb095" status: 202 len: 0 microversion: 2.1 time: 0.170810 Aug 09 18:18:36.488927 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3923/6974] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 18:18:36 2022] DELETE /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments/45c09d7d-3636-4991-a808-c9a642dbb095 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:18:36.499307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-281ddfde-1e53-49ab-a21e-8c4c59dea9d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:36.503142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-281ddfde-1e53-49ab-a21e-8c4c59dea9d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:36.509580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-281ddfde-1e53-49ab-a21e-8c4c59dea9d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:36.510072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-281ddfde-1e53-49ab-a21e-8c4c59dea9d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:36.510543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-281ddfde-1e53-49ab-a21e-8c4c59dea9d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:36.511214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-281ddfde-1e53-49ab-a21e-8c4c59dea9d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:36.511688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-281ddfde-1e53-49ab-a21e-8c4c59dea9d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:36.512115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-281ddfde-1e53-49ab-a21e-8c4c59dea9d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:36.542028 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-281ddfde-1e53-49ab-a21e-8c4c59dea9d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048545 Aug 09 18:18:36.542600 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3924/6975] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:18:36 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:18:37.555448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2882cdf2-6337-4993-b44a-761fe7db225f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:37.557833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2882cdf2-6337-4993-b44a-761fe7db225f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:37.565529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2882cdf2-6337-4993-b44a-761fe7db225f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:37.566026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2882cdf2-6337-4993-b44a-761fe7db225f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:37.566472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2882cdf2-6337-4993-b44a-761fe7db225f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:37.567191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2882cdf2-6337-4993-b44a-761fe7db225f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:37.567696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2882cdf2-6337-4993-b44a-761fe7db225f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:37.568184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2882cdf2-6337-4993-b44a-761fe7db225f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:37.603100 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2882cdf2-6337-4993-b44a-761fe7db225f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051993 Aug 09 18:18:37.603758 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3925/6976] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:18:37 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:18:38.616027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d30a5453-05b6-4518-bac8-551aee0694f5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:38.618296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d30a5453-05b6-4518-bac8-551aee0694f5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:38.626314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30a5453-05b6-4518-bac8-551aee0694f5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:38.626845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30a5453-05b6-4518-bac8-551aee0694f5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:38.627295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30a5453-05b6-4518-bac8-551aee0694f5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:38.628051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30a5453-05b6-4518-bac8-551aee0694f5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:38.628520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30a5453-05b6-4518-bac8-551aee0694f5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:38.628954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d30a5453-05b6-4518-bac8-551aee0694f5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:38.664750 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d30a5453-05b6-4518-bac8-551aee0694f5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052620 Aug 09 18:18:38.665128 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3926/6977] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:18:38 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:18:39.677519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4c0e96a4-ec9d-42b5-b6a5-f15dd2be7bd9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:39.679702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4c0e96a4-ec9d-42b5-b6a5-f15dd2be7bd9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:39.686513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c0e96a4-ec9d-42b5-b6a5-f15dd2be7bd9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:39.686997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c0e96a4-ec9d-42b5-b6a5-f15dd2be7bd9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:39.687439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c0e96a4-ec9d-42b5-b6a5-f15dd2be7bd9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:39.688790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c0e96a4-ec9d-42b5-b6a5-f15dd2be7bd9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:39.689187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c0e96a4-ec9d-42b5-b6a5-f15dd2be7bd9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:39.689615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c0e96a4-ec9d-42b5-b6a5-f15dd2be7bd9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:39.719866 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4c0e96a4-ec9d-42b5-b6a5-f15dd2be7bd9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046370 Aug 09 18:18:39.720652 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3927/6978] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:18:39 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:18:40.732295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f61f7913-b2a7-4056-8195-1b680ff84137 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:40.734533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f61f7913-b2a7-4056-8195-1b680ff84137 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:40.741566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f61f7913-b2a7-4056-8195-1b680ff84137 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:40.742060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f61f7913-b2a7-4056-8195-1b680ff84137 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:40.742500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f61f7913-b2a7-4056-8195-1b680ff84137 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:40.743213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f61f7913-b2a7-4056-8195-1b680ff84137 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:40.743693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f61f7913-b2a7-4056-8195-1b680ff84137 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:40.744124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f61f7913-b2a7-4056-8195-1b680ff84137 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:40.779820 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f61f7913-b2a7-4056-8195-1b680ff84137 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051351 Aug 09 18:18:40.785156 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3928/6979] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:18:40 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:18:41.792022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a3104e33-8540-4a86-96bd-54f9be70dfd2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:41.794249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a3104e33-8540-4a86-96bd-54f9be70dfd2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:41.801808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3104e33-8540-4a86-96bd-54f9be70dfd2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:41.802301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3104e33-8540-4a86-96bd-54f9be70dfd2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:41.802745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3104e33-8540-4a86-96bd-54f9be70dfd2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:41.803458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3104e33-8540-4a86-96bd-54f9be70dfd2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:41.803955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3104e33-8540-4a86-96bd-54f9be70dfd2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:41.804398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a3104e33-8540-4a86-96bd-54f9be70dfd2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:41.838493 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a3104e33-8540-4a86-96bd-54f9be70dfd2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050432 Aug 09 18:18:41.839082 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3929/6980] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:18:41 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:18:41.849737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:41.850239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:41.856352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:41.856845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:41.857288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:41.858024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:41.858483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:41.858913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:41.939590 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] HTTP exception thrown: Instance dc038f46-3b68-4e22-9eb3-32263a5013ad is not attached to volume 45c09d7d-3636-4991-a808-c9a642dbb095 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Request method failure captured: Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments/45c09d7d-3636-4991-a808-c9a642dbb095 HTTP/1.1 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qTeAOI0ljX9Dza8YcPY_MyYcL1ZfnNPnOlkEa8iK3R-Xj2PApqLodFLgG3lJrkUiO1Yzyw7jzMLp4yn21J1_ccpwl7X3G8ebbcDniUfRtKt8hjfaXUQNsSxYa860MCzaTw4Pg-ZRO40HYPKXWAd9Ll-_bxvNVj-RyK-vOdIE5ywxbs Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9ef040a2072d493ba849c258c9be9d50 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance dc038f46-3b68-4e22-9eb3-32263a5013ad is not attached to volume 45c09d7d-3636-4991-a808-c9a642dbb095 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': 'dc038f46-3b68-4e22-9eb3-32263a5013ad', 'id': '45c09d7d-3636-4991-a808-c9a642dbb095'} Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 45c09d7d-3636-4991-a808-c9a642dbb095. Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc038f46-3b68-4e22-9eb3-32263a5013ad is not attached to volume 45c09d7d-3636-4991-a808-c9a642dbb095 Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:18:41.946419 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:18:41.950465 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:18:41.950465 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:18:41.950465 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc038f46-3b68-4e22-9eb3-32263a5013ad is not attached to volume 45c09d7d-3636-4991-a808-c9a642dbb095 Aug 09 18:18:41.950465 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:18:41.950465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Returning 404 to user: Instance dc038f46-3b68-4e22-9eb3-32263a5013ad is not attached to volume 45c09d7d-3636-4991-a808-c9a642dbb095 {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:18:41.950465 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9626a807-f1fa-4ea9-b218-0308de8ed702 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments/45c09d7d-3636-4991-a808-c9a642dbb095" status: 404 len: 154 microversion: 2.1 time: 0.102178 Aug 09 18:18:41.950465 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3930/6981] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 18:18:41 2022] DELETE /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad/os-volume_attachments/45c09d7d-3636-4991-a808-c9a642dbb095 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:18:45.297362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-77d6e54e-b9ee-403c-bc1a-5a48a7faad1f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:45.297981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-77d6e54e-b9ee-403c-bc1a-5a48a7faad1f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:45.306402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77d6e54e-b9ee-403c-bc1a-5a48a7faad1f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:45.306973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77d6e54e-b9ee-403c-bc1a-5a48a7faad1f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:45.307450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77d6e54e-b9ee-403c-bc1a-5a48a7faad1f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:45.308218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77d6e54e-b9ee-403c-bc1a-5a48a7faad1f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:45.308681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77d6e54e-b9ee-403c-bc1a-5a48a7faad1f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:45.309113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77d6e54e-b9ee-403c-bc1a-5a48a7faad1f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:45.343188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-77d6e54e-b9ee-403c-bc1a-5a48a7faad1f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:18:45.433636 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-77d6e54e-b9ee-403c-bc1a-5a48a7faad1f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 204 len: 0 microversion: 2.1 time: 0.135416 Aug 09 18:18:45.433636 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3931/6982] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:18:45 2022] DELETE /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:18:45.440829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d623eaf-55d5-43bb-ba53-9fe97314d230 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:45.441536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7d623eaf-55d5-43bb-ba53-9fe97314d230 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:45.447935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d623eaf-55d5-43bb-ba53-9fe97314d230 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:45.448440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d623eaf-55d5-43bb-ba53-9fe97314d230 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:45.448863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d623eaf-55d5-43bb-ba53-9fe97314d230 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:45.449562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d623eaf-55d5-43bb-ba53-9fe97314d230 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:45.450016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d623eaf-55d5-43bb-ba53-9fe97314d230 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:45.450436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d623eaf-55d5-43bb-ba53-9fe97314d230 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:45.606145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7d623eaf-55d5-43bb-ba53-9fe97314d230 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:45.614558 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7d623eaf-55d5-43bb-ba53-9fe97314d230 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1560 microversion: 2.1 time: 0.179311 Aug 09 18:18:45.615066 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3932/6983] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:45 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:46.635974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b4bf0440-e633-4fde-be06-a96f244890b6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:46.636651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4bf0440-e633-4fde-be06-a96f244890b6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:46.643805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4bf0440-e633-4fde-be06-a96f244890b6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:46.644309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4bf0440-e633-4fde-be06-a96f244890b6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:46.644752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4bf0440-e633-4fde-be06-a96f244890b6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:46.645465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4bf0440-e633-4fde-be06-a96f244890b6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:46.645923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4bf0440-e633-4fde-be06-a96f244890b6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:46.646353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4bf0440-e633-4fde-be06-a96f244890b6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:46.780917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b4bf0440-e633-4fde-be06-a96f244890b6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:46.789149 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b4bf0440-e633-4fde-be06-a96f244890b6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1560 microversion: 2.1 time: 0.157215 Aug 09 18:18:46.789732 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3933/6984] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:46 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:47.684332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-dfc7e122-bf63-4356-9e14-efdb22b50696 req-85b2d630-9bda-4b83-bf0c-986169d715de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc038f46-3b68-4e22-9eb3-32263a5013ad", "name": "network-vif-deleted", "tag": "cba56df9-88ce-4ea4-8027-c760be0a3bf5"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:47.697360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dfc7e122-bf63-4356-9e14-efdb22b50696 req-85b2d630-9bda-4b83-bf0c-986169d715de service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:47.698144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dfc7e122-bf63-4356-9e14-efdb22b50696 req-85b2d630-9bda-4b83-bf0c-986169d715de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:47.698757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-dfc7e122-bf63-4356-9e14-efdb22b50696 req-85b2d630-9bda-4b83-bf0c-986169d715de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:47.713086 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-dfc7e122-bf63-4356-9e14-efdb22b50696 req-85b2d630-9bda-4b83-bf0c-986169d715de service nova] Creating event network-vif-deleted:cba56df9-88ce-4ea4-8027-c760be0a3bf5 for instance dc038f46-3b68-4e22-9eb3-32263a5013ad on n-h1-845781-6 Aug 09 18:18:47.718889 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-dfc7e122-bf63-4356-9e14-efdb22b50696 req-85b2d630-9bda-4b83-bf0c-986169d715de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101538 Aug 09 18:18:47.720226 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3934/6985] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:18:47.811604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:47.812346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:47.818846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:47.819264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:47.819741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:47.820450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:47.820905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:47.821338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:47.855006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:47.855488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:47.855972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:47.856437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lazy-loading 'fault' on Instance uuid dc038f46-3b68-4e22-9eb3-32263a5013ad {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:18:47.901749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:47.910183 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb26f432-3722-4c69-9c8e-d374e9e8501b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 200 len: 1353 microversion: 2.1 time: 0.102972 Aug 09 18:18:47.910768 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3935/6986] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:47 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 1353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:48.930861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:48.931672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: dc038f46-3b68-4e22-9eb3-32263a5013ad] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:48.938894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:48.939388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:48.939866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:48.940572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:48.941025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:48.941454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:48.955997 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] HTTP exception thrown: Instance dc038f46-3b68-4e22-9eb3-32263a5013ad could not be found. Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Request method failure captured: Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad HTTP/1.1 Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qTeAOI0ljX9Dza8YcPY_MyYcL1ZfnNPnOlkEa8iK3R-Xj2PApqLodFLgG3lJrkUiO1Yzyw7jzMLp4yn21J1_ccpwl7X3G8ebbcDniUfRtKt8hjfaXUQNsSxYa860MCzaTw4Pg-ZRO40HYPKXWAd9Ll-_bxvNVj-RyK-vOdIE5ywxbs Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9ef040a2072d493ba849c258c9be9d50 Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance dc038f46-3b68-4e22-9eb3-32263a5013ad could not be found. Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'dc038f46-3b68-4e22-9eb3-32263a5013ad'} Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc038f46-3b68-4e22-9eb3-32263a5013ad could not be found. Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc038f46-3b68-4e22-9eb3-32263a5013ad could not be found. Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:18:48.957678 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:18:48.962813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:18:48.962813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:18:48.962813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:18:48.962813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:18:48.962813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:18:48.962813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:18:48.962813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc038f46-3b68-4e22-9eb3-32263a5013ad could not be found. Aug 09 18:18:48.962813 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:18:48.962813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Returning 404 to user: Instance dc038f46-3b68-4e22-9eb3-32263a5013ad could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:18:48.962813 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19b30eb5-239f-44ff-b375-f292b99ac4a7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad" status: 404 len: 111 microversion: 2.1 time: 0.032319 Aug 09 18:18:48.962813 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3936/6987] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:48 2022] GET /compute/v2.1/servers/dc038f46-3b68-4e22-9eb3-32263a5013ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:18:48.967997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3a74f62-b9c5-4a5c-b4ca-4a574d0a3a56 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '.version_select at 0x7fbbcbe170d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:48.996339 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3a74f62-b9c5-4a5c-b4ca-4a574d0a3a56 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1665347927" status: 202 len: 0 microversion: 2.1 time: 0.031892 Aug 09 18:18:48.997077 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3937/6988] 10.222.0.93 () {58 vars in 1278 bytes} [Tue Aug 9 18:18:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1665347927 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:18:49.013909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8e42bb10-b85b-40f5-bc29-d701197955e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Action: 'create', calling method: .version_select at 0x7fbbcbc2d8b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1690634586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE26/zlh5H+XVLEopGx5J6HhdaEHmqHhmNvh3aw+QqhOneD/0aGl/Qk8Ohhu+4ncSvclWP0Ud/C3vVEswU+IgBoIBOd7D/6QBN0A2uuuHpglCrKUstpVfaRYEI8DJ3Hczw=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:49.032849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8e42bb10-b85b-40f5-bc29-d701197955e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for project 37479c7fa67644d0bf9c04ba87987961. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:18:49.038299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-8e42bb10-b85b-40f5-bc29-d701197955e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for user 9ef040a2072d493ba849c258c9be9d50 and project 37479c7fa67644d0bf9c04ba87987961. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:18:49.061402 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8e42bb10-b85b-40f5-bc29-d701197955e6 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051444 Aug 09 18:18:49.062007 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3938/6989] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:18:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:18:49.111416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1088552145", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1690634586", "networks": [{"uuid": "257930bc-ffda-4ac0-a871-e1412cfd2184"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:49.163265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] validate_networks() for [('257930bc-ffda-4ac0-a871-e1412cfd2184', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:18:49.576712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:18:49.577215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:18:49.577723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:18:49.578141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:18:49.579209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:18:49.588500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:49.588991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:49.589435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:49.590181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:49.590636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:49.591071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:49.608367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for project 37479c7fa67644d0bf9c04ba87987961. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:18:49.613712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for user 9ef040a2072d493ba849c258c9be9d50 and project 37479c7fa67644d0bf9c04ba87987961. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:18:49.626527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:18:49.628852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:18:49.673867 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fb71e31f-5286-4943-9e1f-9380b0b927b8 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566973 Aug 09 18:18:49.674528 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3939/6990] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:18:49.684822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ada11d11-f9ca-4b1f-9963-3e3df064ef9d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:49.685444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ada11d11-f9ca-4b1f-9963-3e3df064ef9d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:49.743252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ada11d11-f9ca-4b1f-9963-3e3df064ef9d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:49.750784 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ada11d11-f9ca-4b1f-9963-3e3df064ef9d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1263 microversion: 2.1 time: 0.069003 Aug 09 18:18:49.751368 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3940/6991] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:49 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:50.772857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-95b9b504-11b1-436d-80b6-10e6dc3dd937 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:50.773740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-95b9b504-11b1-436d-80b6-10e6dc3dd937 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:50.781300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b9b504-11b1-436d-80b6-10e6dc3dd937 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:50.782160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b9b504-11b1-436d-80b6-10e6dc3dd937 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:50.782839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b9b504-11b1-436d-80b6-10e6dc3dd937 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:50.784097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b9b504-11b1-436d-80b6-10e6dc3dd937 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:50.785034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b9b504-11b1-436d-80b6-10e6dc3dd937 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:50.785534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95b9b504-11b1-436d-80b6-10e6dc3dd937 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:50.853996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-95b9b504-11b1-436d-80b6-10e6dc3dd937 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:50.857638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:18:50.863337 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-95b9b504-11b1-436d-80b6-10e6dc3dd937 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1321 microversion: 2.1 time: 0.094453 Aug 09 18:18:50.863971 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3941/6992] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:50 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1321 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:51.885673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f10d5dc4-9f18-411e-aa53-a207ca1664d9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:51.886339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f10d5dc4-9f18-411e-aa53-a207ca1664d9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:51.895921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10d5dc4-9f18-411e-aa53-a207ca1664d9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:51.896500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10d5dc4-9f18-411e-aa53-a207ca1664d9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:51.897009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10d5dc4-9f18-411e-aa53-a207ca1664d9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:51.897739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10d5dc4-9f18-411e-aa53-a207ca1664d9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:51.898209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10d5dc4-9f18-411e-aa53-a207ca1664d9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:51.898653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f10d5dc4-9f18-411e-aa53-a207ca1664d9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:52.049977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f10d5dc4-9f18-411e-aa53-a207ca1664d9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:52.057856 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f10d5dc4-9f18-411e-aa53-a207ca1664d9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1363 microversion: 2.1 time: 0.176117 Aug 09 18:18:52.072384 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3942/6993] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:51 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:52.072384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4a6c4445-ce5a-4de4-9473-102e9006e3db req-7d7e89cc-9f66-4349-b4fc-fb0d8a3615a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "497e29d9-7fcd-473b-9d68-f3be03290004", "tag": "d46bce39-2d36-4c0d-abc5-d5fa78ac6606"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:52.075897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4a6c4445-ce5a-4de4-9473-102e9006e3db req-7d7e89cc-9f66-4349-b4fc-fb0d8a3615a2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:52.076484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4a6c4445-ce5a-4de4-9473-102e9006e3db req-7d7e89cc-9f66-4349-b4fc-fb0d8a3615a2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:52.076990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4a6c4445-ce5a-4de4-9473-102e9006e3db req-7d7e89cc-9f66-4349-b4fc-fb0d8a3615a2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:52.090114 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4a6c4445-ce5a-4de4-9473-102e9006e3db req-7d7e89cc-9f66-4349-b4fc-fb0d8a3615a2 service nova] Creating event network-changed:d46bce39-2d36-4c0d-abc5-d5fa78ac6606 for instance 497e29d9-7fcd-473b-9d68-f3be03290004 on n-h1-845781-6 Aug 09 18:18:52.095765 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4a6c4445-ce5a-4de4-9473-102e9006e3db req-7d7e89cc-9f66-4349-b4fc-fb0d8a3615a2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035567 Aug 09 18:18:52.096693 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3943/6994] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:18:53.081531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e95f8fb1-462c-4566-a8bc-98e9cce424c5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:53.082171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e95f8fb1-462c-4566-a8bc-98e9cce424c5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:53.088858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e95f8fb1-462c-4566-a8bc-98e9cce424c5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:53.089766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e95f8fb1-462c-4566-a8bc-98e9cce424c5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:53.089766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e95f8fb1-462c-4566-a8bc-98e9cce424c5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:53.090487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e95f8fb1-462c-4566-a8bc-98e9cce424c5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:53.090939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e95f8fb1-462c-4566-a8bc-98e9cce424c5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:53.091371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e95f8fb1-462c-4566-a8bc-98e9cce424c5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:53.230928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e95f8fb1-462c-4566-a8bc-98e9cce424c5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:53.238559 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e95f8fb1-462c-4566-a8bc-98e9cce424c5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1363 microversion: 2.1 time: 0.162740 Aug 09 18:18:53.239138 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3944/6995] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:53 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:54.259291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a6d17f20-9e5c-473a-bf88-1f2bda36a343 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:54.260037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a6d17f20-9e5c-473a-bf88-1f2bda36a343 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:54.267226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6d17f20-9e5c-473a-bf88-1f2bda36a343 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:54.267763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6d17f20-9e5c-473a-bf88-1f2bda36a343 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:54.268218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6d17f20-9e5c-473a-bf88-1f2bda36a343 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:54.268948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6d17f20-9e5c-473a-bf88-1f2bda36a343 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:54.269413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6d17f20-9e5c-473a-bf88-1f2bda36a343 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:54.269854 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6d17f20-9e5c-473a-bf88-1f2bda36a343 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:54.410450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a6d17f20-9e5c-473a-bf88-1f2bda36a343 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:54.420614 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a6d17f20-9e5c-473a-bf88-1f2bda36a343 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1363 microversion: 2.1 time: 0.165221 Aug 09 18:18:54.421209 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3945/6996] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:54 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:55.445464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4f099458-abe2-4133-a3d8-1824c8b27620 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:55.446660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4f099458-abe2-4133-a3d8-1824c8b27620 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:55.456665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f099458-abe2-4133-a3d8-1824c8b27620 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:55.457180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f099458-abe2-4133-a3d8-1824c8b27620 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:55.457639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f099458-abe2-4133-a3d8-1824c8b27620 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:55.458424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f099458-abe2-4133-a3d8-1824c8b27620 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:55.458870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f099458-abe2-4133-a3d8-1824c8b27620 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:55.459269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f099458-abe2-4133-a3d8-1824c8b27620 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:55.606544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4f099458-abe2-4133-a3d8-1824c8b27620 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:55.614244 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4f099458-abe2-4133-a3d8-1824c8b27620 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1363 microversion: 2.1 time: 0.176477 Aug 09 18:18:55.614830 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3946/6997] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:55 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:18:56.635327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-baee61d4-412a-4c18-a1ae-9ca23fbf2112 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:56.636046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-baee61d4-412a-4c18-a1ae-9ca23fbf2112 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:56.643975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baee61d4-412a-4c18-a1ae-9ca23fbf2112 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:56.644517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baee61d4-412a-4c18-a1ae-9ca23fbf2112 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:56.644971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baee61d4-412a-4c18-a1ae-9ca23fbf2112 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:56.657629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baee61d4-412a-4c18-a1ae-9ca23fbf2112 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:56.658175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baee61d4-412a-4c18-a1ae-9ca23fbf2112 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:56.658627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-baee61d4-412a-4c18-a1ae-9ca23fbf2112 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:56.804189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-baee61d4-412a-4c18-a1ae-9ca23fbf2112 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:56.811707 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-baee61d4-412a-4c18-a1ae-9ca23fbf2112 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1363 microversion: 2.1 time: 0.180450 Aug 09 18:18:56.812284 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3947/6998] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:56 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:57.488362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4c69a998-4429-4f91-b835-8464de2ffe53 req-7caa67b5-89cb-4354-806c-0911f0b94eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497e29d9-7fcd-473b-9d68-f3be03290004", "name": "network-vif-plugged", "status": "completed", "tag": "d46bce39-2d36-4c0d-abc5-d5fa78ac6606"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:18:57.497993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4c69a998-4429-4f91-b835-8464de2ffe53 req-7caa67b5-89cb-4354-806c-0911f0b94eda service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:57.498489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4c69a998-4429-4f91-b835-8464de2ffe53 req-7caa67b5-89cb-4354-806c-0911f0b94eda service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:57.498932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4c69a998-4429-4f91-b835-8464de2ffe53 req-7caa67b5-89cb-4354-806c-0911f0b94eda service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:57.511130 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4c69a998-4429-4f91-b835-8464de2ffe53 req-7caa67b5-89cb-4354-806c-0911f0b94eda service nova] Creating event network-vif-plugged:d46bce39-2d36-4c0d-abc5-d5fa78ac6606 for instance 497e29d9-7fcd-473b-9d68-f3be03290004 on n-h1-845781-6 Aug 09 18:18:57.516043 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4c69a998-4429-4f91-b835-8464de2ffe53 req-7caa67b5-89cb-4354-806c-0911f0b94eda service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087927 Aug 09 18:18:57.516638 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3948/6999] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:18:57.835118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1946aa7e-b50a-45f0-8a59-f175b6dbfa21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:57.835877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1946aa7e-b50a-45f0-8a59-f175b6dbfa21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:57.842758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1946aa7e-b50a-45f0-8a59-f175b6dbfa21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:57.843250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1946aa7e-b50a-45f0-8a59-f175b6dbfa21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:57.843720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1946aa7e-b50a-45f0-8a59-f175b6dbfa21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:57.844942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1946aa7e-b50a-45f0-8a59-f175b6dbfa21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:57.845393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1946aa7e-b50a-45f0-8a59-f175b6dbfa21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:57.845821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1946aa7e-b50a-45f0-8a59-f175b6dbfa21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:58.007668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1946aa7e-b50a-45f0-8a59-f175b6dbfa21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:58.016644 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1946aa7e-b50a-45f0-8a59-f175b6dbfa21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1363 microversion: 2.1 time: 0.186722 Aug 09 18:18:58.017596 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3949/7000] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:57 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:59.039251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7135fe65-e607-4d80-9c03-9d83fee81b65 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:59.039975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7135fe65-e607-4d80-9c03-9d83fee81b65 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:59.046700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7135fe65-e607-4d80-9c03-9d83fee81b65 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:59.047822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7135fe65-e607-4d80-9c03-9d83fee81b65 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:59.048278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7135fe65-e607-4d80-9c03-9d83fee81b65 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:59.048989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7135fe65-e607-4d80-9c03-9d83fee81b65 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:59.049449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7135fe65-e607-4d80-9c03-9d83fee81b65 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:59.049879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7135fe65-e607-4d80-9c03-9d83fee81b65 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:59.197316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7135fe65-e607-4d80-9c03-9d83fee81b65 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:59.206014 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7135fe65-e607-4d80-9c03-9d83fee81b65 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1554 microversion: 2.1 time: 0.170764 Aug 09 18:18:59.206634 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3950/7001] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:59 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:18:59.227421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38871939-24ea-4d3f-9b88-c00af37f7b85 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:18:59.228167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-38871939-24ea-4d3f-9b88-c00af37f7b85 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:18:59.235578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38871939-24ea-4d3f-9b88-c00af37f7b85 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:59.236184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38871939-24ea-4d3f-9b88-c00af37f7b85 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:59.236674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38871939-24ea-4d3f-9b88-c00af37f7b85 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:59.237440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38871939-24ea-4d3f-9b88-c00af37f7b85 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:18:59.237980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38871939-24ea-4d3f-9b88-c00af37f7b85 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:18:59.238510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-38871939-24ea-4d3f-9b88-c00af37f7b85 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:18:59.381238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-38871939-24ea-4d3f-9b88-c00af37f7b85 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:18:59.389447 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-38871939-24ea-4d3f-9b88-c00af37f7b85 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1554 microversion: 2.1 time: 0.166216 Aug 09 18:18:59.390046 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3951/7002] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:18:59 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:00.935617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d3a94c82-d0ce-43e2-85bf-51673a58bdc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a79b78e-b575-4c10-a8a5-eb698d61b348"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:00.938316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d3a94c82-d0ce-43e2-85bf-51673a58bdc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:00.940460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:00.941151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:00.948411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3a94c82-d0ce-43e2-85bf-51673a58bdc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:00.948907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3a94c82-d0ce-43e2-85bf-51673a58bdc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:00.949350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3a94c82-d0ce-43e2-85bf-51673a58bdc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:00.950071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3a94c82-d0ce-43e2-85bf-51673a58bdc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:00.950543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3a94c82-d0ce-43e2-85bf-51673a58bdc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:00.950964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d3a94c82-d0ce-43e2-85bf-51673a58bdc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:01.204429 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d3a94c82-d0ce-43e2-85bf-51673a58bdc5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "POST /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271936 Aug 09 18:19:01.205068 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3952/7003] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 18:19:00 2022] POST /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:11.943244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-70f13db3-8719-4609-8586-ba87a473953e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:11.943993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-70f13db3-8719-4609-8586-ba87a473953e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:11.947155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:11.948543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:11.956390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70f13db3-8719-4609-8586-ba87a473953e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:11.956915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70f13db3-8719-4609-8586-ba87a473953e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:11.957353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70f13db3-8719-4609-8586-ba87a473953e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:11.958068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70f13db3-8719-4609-8586-ba87a473953e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:11.958522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70f13db3-8719-4609-8586-ba87a473953e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:11.958952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70f13db3-8719-4609-8586-ba87a473953e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:12.049204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-70f13db3-8719-4609-8586-ba87a473953e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lazy-loading 'services' on Instance uuid 497e29d9-7fcd-473b-9d68-f3be03290004 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:19:12.133114 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-70f13db3-8719-4609-8586-ba87a473953e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments/1a79b78e-b575-4c10-a8a5-eb698d61b348" status: 202 len: 0 microversion: 2.1 time: 0.193735 Aug 09 18:19:12.133918 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3953/7004] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 18:19:11 2022] DELETE /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments/1a79b78e-b575-4c10-a8a5-eb698d61b348 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:19:12.145848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93b2422d-1c3f-46a0-a776-406362e1a1c2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:12.148438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-93b2422d-1c3f-46a0-a776-406362e1a1c2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:12.155315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b2422d-1c3f-46a0-a776-406362e1a1c2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:12.156107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b2422d-1c3f-46a0-a776-406362e1a1c2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:12.156687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b2422d-1c3f-46a0-a776-406362e1a1c2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:12.157713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b2422d-1c3f-46a0-a776-406362e1a1c2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:12.158391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b2422d-1c3f-46a0-a776-406362e1a1c2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:12.159034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93b2422d-1c3f-46a0-a776-406362e1a1c2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:12.195300 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-93b2422d-1c3f-46a0-a776-406362e1a1c2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056079 Aug 09 18:19:12.195939 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3954/7005] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:12 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:19:13.211241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-28bb6262-716a-43cf-bdf6-368bb67dde9a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:13.214233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-28bb6262-716a-43cf-bdf6-368bb67dde9a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:13.221700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28bb6262-716a-43cf-bdf6-368bb67dde9a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:13.222449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28bb6262-716a-43cf-bdf6-368bb67dde9a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:13.222901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28bb6262-716a-43cf-bdf6-368bb67dde9a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:13.223656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28bb6262-716a-43cf-bdf6-368bb67dde9a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:13.224112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28bb6262-716a-43cf-bdf6-368bb67dde9a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:13.224557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28bb6262-716a-43cf-bdf6-368bb67dde9a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:13.260265 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-28bb6262-716a-43cf-bdf6-368bb67dde9a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055063 Aug 09 18:19:13.260863 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3955/7006] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:13 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:19:14.272734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-474f960b-e717-4767-858f-feb9c8dcd3b2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:14.275024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-474f960b-e717-4767-858f-feb9c8dcd3b2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:14.282049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-474f960b-e717-4767-858f-feb9c8dcd3b2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:14.282547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-474f960b-e717-4767-858f-feb9c8dcd3b2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:14.282995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-474f960b-e717-4767-858f-feb9c8dcd3b2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:14.283781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-474f960b-e717-4767-858f-feb9c8dcd3b2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:14.284236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-474f960b-e717-4767-858f-feb9c8dcd3b2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:14.284668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-474f960b-e717-4767-858f-feb9c8dcd3b2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:14.317865 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-474f960b-e717-4767-858f-feb9c8dcd3b2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049132 Aug 09 18:19:14.318450 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3956/7007] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:14 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:15.331077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-03ddc487-94d3-47bc-a42c-b4c7b7e0061f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:15.333287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-03ddc487-94d3-47bc-a42c-b4c7b7e0061f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:15.340922 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03ddc487-94d3-47bc-a42c-b4c7b7e0061f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:15.341427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03ddc487-94d3-47bc-a42c-b4c7b7e0061f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:15.341878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03ddc487-94d3-47bc-a42c-b4c7b7e0061f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:15.342595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03ddc487-94d3-47bc-a42c-b4c7b7e0061f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:15.343056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03ddc487-94d3-47bc-a42c-b4c7b7e0061f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:15.343495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03ddc487-94d3-47bc-a42c-b4c7b7e0061f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:15.377854 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-03ddc487-94d3-47bc-a42c-b4c7b7e0061f tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051547 Aug 09 18:19:15.378463 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3957/7008] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:15 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:16.390373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-517296f5-492c-45c1-a4f7-302539aa7197 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:16.393220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-517296f5-492c-45c1-a4f7-302539aa7197 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:16.400382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-517296f5-492c-45c1-a4f7-302539aa7197 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:16.400879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-517296f5-492c-45c1-a4f7-302539aa7197 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:16.401329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-517296f5-492c-45c1-a4f7-302539aa7197 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:16.402041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-517296f5-492c-45c1-a4f7-302539aa7197 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:16.402508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-517296f5-492c-45c1-a4f7-302539aa7197 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:16.402942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-517296f5-492c-45c1-a4f7-302539aa7197 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:16.434411 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-517296f5-492c-45c1-a4f7-302539aa7197 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048074 Aug 09 18:19:16.435007 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3958/7009] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:16 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:17.449783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bfdc8108-cb1a-4267-b596-c41d7fe76bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:17.449783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bfdc8108-cb1a-4267-b596-c41d7fe76bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:17.456614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfdc8108-cb1a-4267-b596-c41d7fe76bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:17.457115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfdc8108-cb1a-4267-b596-c41d7fe76bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:17.457558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfdc8108-cb1a-4267-b596-c41d7fe76bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:17.458290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfdc8108-cb1a-4267-b596-c41d7fe76bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:17.458748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfdc8108-cb1a-4267-b596-c41d7fe76bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:17.459178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bfdc8108-cb1a-4267-b596-c41d7fe76bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:17.493910 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bfdc8108-cb1a-4267-b596-c41d7fe76bdb tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051205 Aug 09 18:19:17.494517 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3959/7010] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:17 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:19:17.505356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:17.505868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:17.512262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:17.512755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:17.513195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:17.513924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:17.514373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:17.514805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:17.596330 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] HTTP exception thrown: Instance 497e29d9-7fcd-473b-9d68-f3be03290004 is not attached to volume 1a79b78e-b575-4c10-a8a5-eb698d61b348 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Request method failure captured: Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments/1a79b78e-b575-4c10-a8a5-eb698d61b348 HTTP/1.1 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qTeAOI0ljX9Dza8YcPY_MyYcL1ZfnNPnOlkEa8iK3R-Xj2PApqLodFLgG3lJrkUiO1Yzyw7jzMLp4yn21J1_ccpwl7X3G8ebbcDniUfRtKt8hjfaXUQNsSxYa860MCzaTw4Pg-ZRO40HYPKXWAd9Ll-_bxvNVj-RyK-vOdIE5ywxbs Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9ef040a2072d493ba849c258c9be9d50 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 497e29d9-7fcd-473b-9d68-f3be03290004 is not attached to volume 1a79b78e-b575-4c10-a8a5-eb698d61b348 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': '497e29d9-7fcd-473b-9d68-f3be03290004', 'id': '1a79b78e-b575-4c10-a8a5-eb698d61b348'} Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1a79b78e-b575-4c10-a8a5-eb698d61b348. Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497e29d9-7fcd-473b-9d68-f3be03290004 is not attached to volume 1a79b78e-b575-4c10-a8a5-eb698d61b348 Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:19:17.597927 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:19:17.602147 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:19:17.602147 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:19:17.602147 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497e29d9-7fcd-473b-9d68-f3be03290004 is not attached to volume 1a79b78e-b575-4c10-a8a5-eb698d61b348 Aug 09 18:19:17.602147 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:17.602147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Returning 404 to user: Instance 497e29d9-7fcd-473b-9d68-f3be03290004 is not attached to volume 1a79b78e-b575-4c10-a8a5-eb698d61b348 {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:19:17.602147 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-69eed559-b10d-4a21-ba6f-c8867729c52e tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments/1a79b78e-b575-4c10-a8a5-eb698d61b348" status: 404 len: 154 microversion: 2.1 time: 0.098321 Aug 09 18:19:17.602147 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3960/7011] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 18:19:17 2022] DELETE /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004/os-volume_attachments/1a79b78e-b575-4c10-a8a5-eb698d61b348 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 18:19:20.950130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-412eb308-44a9-43dd-b7d7-73d0bc52e17c tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:20.950814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-412eb308-44a9-43dd-b7d7-73d0bc52e17c tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:20.959517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412eb308-44a9-43dd-b7d7-73d0bc52e17c tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:20.960050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412eb308-44a9-43dd-b7d7-73d0bc52e17c tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:20.960557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412eb308-44a9-43dd-b7d7-73d0bc52e17c tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:20.961335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412eb308-44a9-43dd-b7d7-73d0bc52e17c tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:20.961825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412eb308-44a9-43dd-b7d7-73d0bc52e17c tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:20.962514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-412eb308-44a9-43dd-b7d7-73d0bc52e17c tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:20.989848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-412eb308-44a9-43dd-b7d7-73d0bc52e17c tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:19:21.079138 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-412eb308-44a9-43dd-b7d7-73d0bc52e17c tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 204 len: 0 microversion: 2.1 time: 0.132486 Aug 09 18:19:21.079907 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3961/7012] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:19:20 2022] DELETE /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:19:21.088835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-33d16bd3-82cb-4359-ab41-4a20ed4f19f0 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:21.089482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-33d16bd3-82cb-4359-ab41-4a20ed4f19f0 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:21.095991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d16bd3-82cb-4359-ab41-4a20ed4f19f0 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:21.096482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d16bd3-82cb-4359-ab41-4a20ed4f19f0 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:21.096936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d16bd3-82cb-4359-ab41-4a20ed4f19f0 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:21.097652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d16bd3-82cb-4359-ab41-4a20ed4f19f0 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:21.098129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d16bd3-82cb-4359-ab41-4a20ed4f19f0 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:21.098562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33d16bd3-82cb-4359-ab41-4a20ed4f19f0 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:21.240317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-33d16bd3-82cb-4359-ab41-4a20ed4f19f0 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:21.248186 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-33d16bd3-82cb-4359-ab41-4a20ed4f19f0 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1560 microversion: 2.1 time: 0.163929 Aug 09 18:19:21.248762 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3962/7013] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:21 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:22.270137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8cffbeea-8a84-4cac-bfc5-0d38b287b016 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:22.270814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8cffbeea-8a84-4cac-bfc5-0d38b287b016 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:22.277943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cffbeea-8a84-4cac-bfc5-0d38b287b016 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:22.278432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cffbeea-8a84-4cac-bfc5-0d38b287b016 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:22.278872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cffbeea-8a84-4cac-bfc5-0d38b287b016 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:22.279574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cffbeea-8a84-4cac-bfc5-0d38b287b016 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:22.280051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cffbeea-8a84-4cac-bfc5-0d38b287b016 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:22.280481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8cffbeea-8a84-4cac-bfc5-0d38b287b016 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:22.412315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8cffbeea-8a84-4cac-bfc5-0d38b287b016 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:22.419954 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8cffbeea-8a84-4cac-bfc5-0d38b287b016 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1560 microversion: 2.1 time: 0.154267 Aug 09 18:19:22.420536 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3963/7014] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:22 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:23.275249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fe2bbbf8-420b-442f-87a7-35fb436f6ff9 req-503cc4cd-7b68-4b1a-a4e4-d818aca21aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497e29d9-7fcd-473b-9d68-f3be03290004", "name": "network-vif-deleted", "tag": "d46bce39-2d36-4c0d-abc5-d5fa78ac6606"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:23.289443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fe2bbbf8-420b-442f-87a7-35fb436f6ff9 req-503cc4cd-7b68-4b1a-a4e4-d818aca21aa3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:23.289987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fe2bbbf8-420b-442f-87a7-35fb436f6ff9 req-503cc4cd-7b68-4b1a-a4e4-d818aca21aa3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:23.290436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fe2bbbf8-420b-442f-87a7-35fb436f6ff9 req-503cc4cd-7b68-4b1a-a4e4-d818aca21aa3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:23.306455 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fe2bbbf8-420b-442f-87a7-35fb436f6ff9 req-503cc4cd-7b68-4b1a-a4e4-d818aca21aa3 service nova] Creating event network-vif-deleted:d46bce39-2d36-4c0d-abc5-d5fa78ac6606 for instance 497e29d9-7fcd-473b-9d68-f3be03290004 on n-h1-845781-6 Aug 09 18:19:23.313404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fe2bbbf8-420b-442f-87a7-35fb436f6ff9 req-503cc4cd-7b68-4b1a-a4e4-d818aca21aa3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040285 Aug 09 18:19:23.314966 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3964/7015] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:19:23.442043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:23.442714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:23.449051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:23.449542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:23.449989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:23.450698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:23.451167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:23.451603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:23.484733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:23.485143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:23.485593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:23.486058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lazy-loading 'fault' on Instance uuid 497e29d9-7fcd-473b-9d68-f3be03290004 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:19:23.530528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:23.538368 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3870f25f-0209-4abb-841b-cd1b2efedd83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 200 len: 1353 microversion: 2.1 time: 0.101400 Aug 09 18:19:23.538961 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3965/7016] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:23 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 1353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:24.559535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:24.560271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: 497e29d9-7fcd-473b-9d68-f3be03290004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:24.567516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:24.568180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:24.568629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:24.569353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:24.569806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:24.570248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:24.585197 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] HTTP exception thrown: Instance 497e29d9-7fcd-473b-9d68-f3be03290004 could not be found. Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Request method failure captured: Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 HTTP/1.1 Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qTeAOI0ljX9Dza8YcPY_MyYcL1ZfnNPnOlkEa8iK3R-Xj2PApqLodFLgG3lJrkUiO1Yzyw7jzMLp4yn21J1_ccpwl7X3G8ebbcDniUfRtKt8hjfaXUQNsSxYa860MCzaTw4Pg-ZRO40HYPKXWAd9Ll-_bxvNVj-RyK-vOdIE5ywxbs Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9ef040a2072d493ba849c258c9be9d50 Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 497e29d9-7fcd-473b-9d68-f3be03290004 could not be found. Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '497e29d9-7fcd-473b-9d68-f3be03290004'} Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497e29d9-7fcd-473b-9d68-f3be03290004 could not be found. Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497e29d9-7fcd-473b-9d68-f3be03290004 could not be found. Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:24.586897 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:19:24.590967 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:24.590967 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:19:24.590967 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:19:24.590967 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:19:24.590967 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:19:24.590967 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:19:24.590967 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497e29d9-7fcd-473b-9d68-f3be03290004 could not be found. Aug 09 18:19:24.590967 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:24.590967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Returning 404 to user: Instance 497e29d9-7fcd-473b-9d68-f3be03290004 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:19:24.590967 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c72fae6e-7d15-4935-9daa-972bab6a8f80 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004" status: 404 len: 111 microversion: 2.1 time: 0.033086 Aug 09 18:19:24.590967 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3966/7017] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:24 2022] GET /compute/v2.1/servers/497e29d9-7fcd-473b-9d68-f3be03290004 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:19:24.598419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f754a41-d9ee-4b90-aa52-57b26b7e03b5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '.version_select at 0x7fbbcb48f9d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:24.618953 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f754a41-d9ee-4b90-aa52-57b26b7e03b5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1690634586" status: 202 len: 0 microversion: 2.1 time: 0.025278 Aug 09 18:19:24.619534 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3967/7018] 10.222.0.93 () {58 vars in 1278 bytes} [Tue Aug 9 18:19:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1690634586 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:19:24.635303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-47c0a580-4976-4bf1-b096-e475e2975361 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Action: 'create', calling method: .version_select at 0x7fbbd81295e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-11264783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClFh+M4hbIvaW2ilr1uD3UdKxbAEXeoIGHSqTQNFXMHhECQIXnQRBGDJAKx5Xre/px1UCU58OHbNDRRMM6xSJSoaCRBe0L4/pudpgIU0kHrpfPAZ2oOH18URjWTdyhIvA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:24.652725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-47c0a580-4976-4bf1-b096-e475e2975361 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for project 37479c7fa67644d0bf9c04ba87987961. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:19:24.658532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-47c0a580-4976-4bf1-b096-e475e2975361 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for user 9ef040a2072d493ba849c258c9be9d50 and project 37479c7fa67644d0bf9c04ba87987961. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:19:24.682472 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-47c0a580-4976-4bf1-b096-e475e2975361 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051265 Aug 09 18:19:24.683099 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3968/7019] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:19:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:24.742827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1351161173", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-11264783", "networks": [{"uuid": "257930bc-ffda-4ac0-a871-e1412cfd2184"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:24.806095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] validate_networks() for [('257930bc-ffda-4ac0-a871-e1412cfd2184', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:19:25.179180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:19:25.179609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:19:25.180115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:19:25.180528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:19:25.180942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:19:25.189668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:25.190147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:25.190581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:25.191305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:25.191793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:25.192219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:25.209654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for project 37479c7fa67644d0bf9c04ba87987961. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:19:25.215078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Getting quotas for user 9ef040a2072d493ba849c258c9be9d50 and project 37479c7fa67644d0bf9c04ba87987961. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:19:25.229101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:19:25.231842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:19:25.283142 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e11fa9ba-3af2-49a9-ada1-a7f8563426d2 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546299 Aug 09 18:19:25.283826 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3969/7020] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:19:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:19:25.294298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74c72b41-bf81-46c4-bb7b-d839c11462d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:25.294939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-74c72b41-bf81-46c4-bb7b-d839c11462d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:25.349697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-74c72b41-bf81-46c4-bb7b-d839c11462d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:25.356597 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-74c72b41-bf81-46c4-bb7b-d839c11462d1 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1261 microversion: 2.1 time: 0.066181 Aug 09 18:19:25.357173 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3970/7021] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:25 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1261 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:26.377634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-658021d6-e54f-4ff7-9e84-06469cf849a5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:26.379043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-658021d6-e54f-4ff7-9e84-06469cf849a5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:26.388068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-658021d6-e54f-4ff7-9e84-06469cf849a5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:26.388566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-658021d6-e54f-4ff7-9e84-06469cf849a5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:26.389014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-658021d6-e54f-4ff7-9e84-06469cf849a5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:26.389781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-658021d6-e54f-4ff7-9e84-06469cf849a5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:26.390241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-658021d6-e54f-4ff7-9e84-06469cf849a5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:26.390721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-658021d6-e54f-4ff7-9e84-06469cf849a5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:26.459498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-658021d6-e54f-4ff7-9e84-06469cf849a5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:26.463838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:26.469283 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-658021d6-e54f-4ff7-9e84-06469cf849a5 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1331 microversion: 2.1 time: 0.095303 Aug 09 18:19:26.470267 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3971/7022] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:26 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:27.491640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7cf06411-b1dc-41d6-91aa-2aba66bf5b84 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:27.492436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7cf06411-b1dc-41d6-91aa-2aba66bf5b84 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:27.499641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf06411-b1dc-41d6-91aa-2aba66bf5b84 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:27.500801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf06411-b1dc-41d6-91aa-2aba66bf5b84 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:27.501329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf06411-b1dc-41d6-91aa-2aba66bf5b84 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:27.502090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf06411-b1dc-41d6-91aa-2aba66bf5b84 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:27.502668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf06411-b1dc-41d6-91aa-2aba66bf5b84 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:27.503149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf06411-b1dc-41d6-91aa-2aba66bf5b84 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:27.655118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7cf06411-b1dc-41d6-91aa-2aba66bf5b84 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:27.664438 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7cf06411-b1dc-41d6-91aa-2aba66bf5b84 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1361 microversion: 2.1 time: 0.176939 Aug 09 18:19:27.665364 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3972/7023] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:27 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:27.677063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-cbf59a2d-7a9c-412b-a7ab-3e57b5a6e46a req-09221e96-74bd-4737-84b0-44747e1b0618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d35ef1f8-26a9-475c-91be-359554c89ac2", "tag": "8be887a7-ba01-4257-be77-cc41912eda35"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:27.689006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cbf59a2d-7a9c-412b-a7ab-3e57b5a6e46a req-09221e96-74bd-4737-84b0-44747e1b0618 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:27.689582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cbf59a2d-7a9c-412b-a7ab-3e57b5a6e46a req-09221e96-74bd-4737-84b0-44747e1b0618 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:27.690020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cbf59a2d-7a9c-412b-a7ab-3e57b5a6e46a req-09221e96-74bd-4737-84b0-44747e1b0618 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:27.702652 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-cbf59a2d-7a9c-412b-a7ab-3e57b5a6e46a req-09221e96-74bd-4737-84b0-44747e1b0618 service nova] Creating event network-changed:8be887a7-ba01-4257-be77-cc41912eda35 for instance d35ef1f8-26a9-475c-91be-359554c89ac2 on n-h1-845781-6 Aug 09 18:19:27.707908 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-cbf59a2d-7a9c-412b-a7ab-3e57b5a6e46a req-09221e96-74bd-4737-84b0-44747e1b0618 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041131 Aug 09 18:19:27.708521 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3973/7024] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:19:28.688328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1ca672f9-8166-4724-847a-516de895d3e3 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:28.688953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1ca672f9-8166-4724-847a-516de895d3e3 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:28.695291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ca672f9-8166-4724-847a-516de895d3e3 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:28.695802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ca672f9-8166-4724-847a-516de895d3e3 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:28.696240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ca672f9-8166-4724-847a-516de895d3e3 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:28.696924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ca672f9-8166-4724-847a-516de895d3e3 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:28.697379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ca672f9-8166-4724-847a-516de895d3e3 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:28.697794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1ca672f9-8166-4724-847a-516de895d3e3 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:28.832087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1ca672f9-8166-4724-847a-516de895d3e3 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:28.839999 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1ca672f9-8166-4724-847a-516de895d3e3 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1361 microversion: 2.1 time: 0.156914 Aug 09 18:19:28.840566 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3974/7025] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:28 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:29.861746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1e8732e9-e406-4f7f-aa81-48b1c17d7f5a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:29.862412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1e8732e9-e406-4f7f-aa81-48b1c17d7f5a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:29.869571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e8732e9-e406-4f7f-aa81-48b1c17d7f5a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:29.870064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e8732e9-e406-4f7f-aa81-48b1c17d7f5a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:29.870558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e8732e9-e406-4f7f-aa81-48b1c17d7f5a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:29.871221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e8732e9-e406-4f7f-aa81-48b1c17d7f5a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:29.871709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e8732e9-e406-4f7f-aa81-48b1c17d7f5a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:29.872152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1e8732e9-e406-4f7f-aa81-48b1c17d7f5a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:30.010986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1e8732e9-e406-4f7f-aa81-48b1c17d7f5a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:30.018866 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1e8732e9-e406-4f7f-aa81-48b1c17d7f5a tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1361 microversion: 2.1 time: 0.161544 Aug 09 18:19:30.019448 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3975/7026] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:29 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:31.039959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bce08b9a-33ec-4137-9aa1-a09c7bee20a9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:31.040637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bce08b9a-33ec-4137-9aa1-a09c7bee20a9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:31.047420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bce08b9a-33ec-4137-9aa1-a09c7bee20a9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:31.047946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bce08b9a-33ec-4137-9aa1-a09c7bee20a9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:31.048397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bce08b9a-33ec-4137-9aa1-a09c7bee20a9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:31.049113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bce08b9a-33ec-4137-9aa1-a09c7bee20a9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:31.049575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bce08b9a-33ec-4137-9aa1-a09c7bee20a9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:31.050011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bce08b9a-33ec-4137-9aa1-a09c7bee20a9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:31.181886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bce08b9a-33ec-4137-9aa1-a09c7bee20a9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:31.189939 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bce08b9a-33ec-4137-9aa1-a09c7bee20a9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1361 microversion: 2.1 time: 0.154269 Aug 09 18:19:31.190517 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3976/7027] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:31 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:32.218700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a01afb7c-dfec-47db-90cd-425462346367 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:32.219330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a01afb7c-dfec-47db-90cd-425462346367 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:32.226273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01afb7c-dfec-47db-90cd-425462346367 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:32.226762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01afb7c-dfec-47db-90cd-425462346367 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:32.227206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01afb7c-dfec-47db-90cd-425462346367 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:32.227942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01afb7c-dfec-47db-90cd-425462346367 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:32.228458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01afb7c-dfec-47db-90cd-425462346367 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:32.228839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01afb7c-dfec-47db-90cd-425462346367 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:32.365261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a01afb7c-dfec-47db-90cd-425462346367 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:32.372804 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a01afb7c-dfec-47db-90cd-425462346367 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1361 microversion: 2.1 time: 0.158030 Aug 09 18:19:32.373378 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3977/7028] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:32 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:33.394127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b470806-7015-4b0d-900a-6b2cb9ef0d70 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:33.394766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b470806-7015-4b0d-900a-6b2cb9ef0d70 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:33.401795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b470806-7015-4b0d-900a-6b2cb9ef0d70 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:33.402291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b470806-7015-4b0d-900a-6b2cb9ef0d70 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:33.402737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b470806-7015-4b0d-900a-6b2cb9ef0d70 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:33.403447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b470806-7015-4b0d-900a-6b2cb9ef0d70 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:33.403943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b470806-7015-4b0d-900a-6b2cb9ef0d70 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:33.404382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b470806-7015-4b0d-900a-6b2cb9ef0d70 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:33.538265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6b470806-7015-4b0d-900a-6b2cb9ef0d70 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:33.547138 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b470806-7015-4b0d-900a-6b2cb9ef0d70 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1361 microversion: 2.1 time: 0.157094 Aug 09 18:19:33.547752 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3978/7029] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:33 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:33.577228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8af1610d-94e3-4b6e-b0f6-c3a451feb88c req-8e01da94-1974-4b9d-a183-4b6f35694f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d35ef1f8-26a9-475c-91be-359554c89ac2", "name": "network-vif-plugged", "status": "completed", "tag": "8be887a7-ba01-4257-be77-cc41912eda35"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:33.589679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8af1610d-94e3-4b6e-b0f6-c3a451feb88c req-8e01da94-1974-4b9d-a183-4b6f35694f34 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:33.590180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8af1610d-94e3-4b6e-b0f6-c3a451feb88c req-8e01da94-1974-4b9d-a183-4b6f35694f34 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:33.590825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8af1610d-94e3-4b6e-b0f6-c3a451feb88c req-8e01da94-1974-4b9d-a183-4b6f35694f34 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:33.605624 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8af1610d-94e3-4b6e-b0f6-c3a451feb88c req-8e01da94-1974-4b9d-a183-4b6f35694f34 service nova] Creating event network-vif-plugged:8be887a7-ba01-4257-be77-cc41912eda35 for instance d35ef1f8-26a9-475c-91be-359554c89ac2 on n-h1-845781-6 Aug 09 18:19:33.610697 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8af1610d-94e3-4b6e-b0f6-c3a451feb88c req-8e01da94-1974-4b9d-a183-4b6f35694f34 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038066 Aug 09 18:19:33.611310 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3979/7030] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:34.568523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-33783c2e-00ee-42bf-8c5a-ffebaddc8405 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:34.569231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-33783c2e-00ee-42bf-8c5a-ffebaddc8405 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:34.576468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33783c2e-00ee-42bf-8c5a-ffebaddc8405 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:34.576960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33783c2e-00ee-42bf-8c5a-ffebaddc8405 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:34.577407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33783c2e-00ee-42bf-8c5a-ffebaddc8405 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:34.578805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33783c2e-00ee-42bf-8c5a-ffebaddc8405 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:34.579250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33783c2e-00ee-42bf-8c5a-ffebaddc8405 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:34.579720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-33783c2e-00ee-42bf-8c5a-ffebaddc8405 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:34.719187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-33783c2e-00ee-42bf-8c5a-ffebaddc8405 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:34.726734 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-33783c2e-00ee-42bf-8c5a-ffebaddc8405 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1361 microversion: 2.1 time: 0.162477 Aug 09 18:19:34.727312 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3980/7031] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:34 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:35.746905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-223781c8-18ad-4efa-b1dd-3e6f94bba6f7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:35.747582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-223781c8-18ad-4efa-b1dd-3e6f94bba6f7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:35.749595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:35.750334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:35.757016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-223781c8-18ad-4efa-b1dd-3e6f94bba6f7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:35.757504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-223781c8-18ad-4efa-b1dd-3e6f94bba6f7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:35.757946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-223781c8-18ad-4efa-b1dd-3e6f94bba6f7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:35.758640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-223781c8-18ad-4efa-b1dd-3e6f94bba6f7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:35.759101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-223781c8-18ad-4efa-b1dd-3e6f94bba6f7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:35.759528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-223781c8-18ad-4efa-b1dd-3e6f94bba6f7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:35.894072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-223781c8-18ad-4efa-b1dd-3e6f94bba6f7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:35.901775 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-223781c8-18ad-4efa-b1dd-3e6f94bba6f7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1552 microversion: 2.1 time: 0.158750 Aug 09 18:19:35.902349 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3981/7032] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:35 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:35.923196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-594a999a-ca75-401a-9992-204a85465e81 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:35.923857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-594a999a-ca75-401a-9992-204a85465e81 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:35.929887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-594a999a-ca75-401a-9992-204a85465e81 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:35.930391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-594a999a-ca75-401a-9992-204a85465e81 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:35.930835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-594a999a-ca75-401a-9992-204a85465e81 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:35.931542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-594a999a-ca75-401a-9992-204a85465e81 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:35.932034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-594a999a-ca75-401a-9992-204a85465e81 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:35.932464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-594a999a-ca75-401a-9992-204a85465e81 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:36.064551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-594a999a-ca75-401a-9992-204a85465e81 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:36.072177 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-594a999a-ca75-401a-9992-204a85465e81 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1552 microversion: 2.1 time: 0.152957 Aug 09 18:19:36.072763 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3982/7033] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:35 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:37.579502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2fcb32c4-cbe8-41be-ba2d-53210d920cb4 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6871c49-c9cf-462f-9694-9e36e95c2338"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:19:37.581934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2fcb32c4-cbe8-41be-ba2d-53210d920cb4 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:37.585774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:37.590033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fcb32c4-cbe8-41be-ba2d-53210d920cb4 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:37.590525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fcb32c4-cbe8-41be-ba2d-53210d920cb4 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:37.590973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fcb32c4-cbe8-41be-ba2d-53210d920cb4 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:37.591703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fcb32c4-cbe8-41be-ba2d-53210d920cb4 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:37.592171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fcb32c4-cbe8-41be-ba2d-53210d920cb4 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:37.592742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2fcb32c4-cbe8-41be-ba2d-53210d920cb4 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:37.841362 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2fcb32c4-cbe8-41be-ba2d-53210d920cb4 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "POST /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266208 Aug 09 18:19:37.841982 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3983/7034] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 18:19:37 2022] POST /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:48.549866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2339ec80-a339-4763-a538-d2473a87c5ab tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:48.550507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2339ec80-a339-4763-a538-d2473a87c5ab tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:48.553550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:19:48.559121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2339ec80-a339-4763-a538-d2473a87c5ab tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:48.559605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2339ec80-a339-4763-a538-d2473a87c5ab tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:48.560065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2339ec80-a339-4763-a538-d2473a87c5ab tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:48.560765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2339ec80-a339-4763-a538-d2473a87c5ab tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:48.561214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2339ec80-a339-4763-a538-d2473a87c5ab tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:48.561646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2339ec80-a339-4763-a538-d2473a87c5ab tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:48.643638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-2339ec80-a339-4763-a538-d2473a87c5ab tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lazy-loading 'services' on Instance uuid d35ef1f8-26a9-475c-91be-359554c89ac2 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:19:48.717098 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2339ec80-a339-4763-a538-d2473a87c5ab tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments/a6871c49-c9cf-462f-9694-9e36e95c2338" status: 202 len: 0 microversion: 2.1 time: 0.171975 Aug 09 18:19:48.717784 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3984/7035] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 18:19:48 2022] DELETE /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments/a6871c49-c9cf-462f-9694-9e36e95c2338 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:19:48.726782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ef475ef1-c1c6-4aca-ab8a-91e6519d7ff9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:48.729266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ef475ef1-c1c6-4aca-ab8a-91e6519d7ff9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:48.736177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef475ef1-c1c6-4aca-ab8a-91e6519d7ff9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:48.736698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef475ef1-c1c6-4aca-ab8a-91e6519d7ff9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:48.737145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef475ef1-c1c6-4aca-ab8a-91e6519d7ff9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:48.737881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef475ef1-c1c6-4aca-ab8a-91e6519d7ff9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:48.738339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef475ef1-c1c6-4aca-ab8a-91e6519d7ff9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:48.738809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef475ef1-c1c6-4aca-ab8a-91e6519d7ff9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:48.770642 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ef475ef1-c1c6-4aca-ab8a-91e6519d7ff9 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048140 Aug 09 18:19:48.771226 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3985/7036] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:48 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:49.783530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e313e401-87b6-4733-90c5-3ca2065ecb83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:49.786697 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e313e401-87b6-4733-90c5-3ca2065ecb83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:49.794010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e313e401-87b6-4733-90c5-3ca2065ecb83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:49.794533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e313e401-87b6-4733-90c5-3ca2065ecb83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:49.794972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e313e401-87b6-4733-90c5-3ca2065ecb83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:49.795701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e313e401-87b6-4733-90c5-3ca2065ecb83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:49.796154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e313e401-87b6-4733-90c5-3ca2065ecb83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:49.796582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e313e401-87b6-4733-90c5-3ca2065ecb83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:49.828623 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e313e401-87b6-4733-90c5-3ca2065ecb83 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049858 Aug 09 18:19:49.829430 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3986/7037] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:49 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:50.841552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8fb6c760-15f2-4416-8ec3-fe0591d6997b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:50.843664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8fb6c760-15f2-4416-8ec3-fe0591d6997b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:50.851381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fb6c760-15f2-4416-8ec3-fe0591d6997b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:50.851911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fb6c760-15f2-4416-8ec3-fe0591d6997b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:50.852359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fb6c760-15f2-4416-8ec3-fe0591d6997b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:50.853075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fb6c760-15f2-4416-8ec3-fe0591d6997b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:50.853530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fb6c760-15f2-4416-8ec3-fe0591d6997b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:50.853956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8fb6c760-15f2-4416-8ec3-fe0591d6997b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:50.884719 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8fb6c760-15f2-4416-8ec3-fe0591d6997b tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047633 Aug 09 18:19:50.885302 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3987/7038] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:50 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:51.897752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d550a33-07b9-405f-8344-76a962d950de tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:51.900000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9d550a33-07b9-405f-8344-76a962d950de tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:51.907587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d550a33-07b9-405f-8344-76a962d950de tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:51.908117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d550a33-07b9-405f-8344-76a962d950de tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:51.908566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d550a33-07b9-405f-8344-76a962d950de tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:51.909287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d550a33-07b9-405f-8344-76a962d950de tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:51.909754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d550a33-07b9-405f-8344-76a962d950de tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:51.910189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d550a33-07b9-405f-8344-76a962d950de tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:51.942147 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9d550a33-07b9-405f-8344-76a962d950de tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048626 Aug 09 18:19:51.942729 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3988/7039] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:51 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:52.954526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f2deb024-43f0-49c0-ad3d-9c6972d50b02 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:52.956792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f2deb024-43f0-49c0-ad3d-9c6972d50b02 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:52.964115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2deb024-43f0-49c0-ad3d-9c6972d50b02 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:52.964608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2deb024-43f0-49c0-ad3d-9c6972d50b02 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:52.965052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2deb024-43f0-49c0-ad3d-9c6972d50b02 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:52.965777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2deb024-43f0-49c0-ad3d-9c6972d50b02 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:52.966224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2deb024-43f0-49c0-ad3d-9c6972d50b02 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:52.966656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f2deb024-43f0-49c0-ad3d-9c6972d50b02 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:52.997133 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f2deb024-43f0-49c0-ad3d-9c6972d50b02 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046630 Aug 09 18:19:52.997716 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3989/7040] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:52 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:19:54.009544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99cd764a-ff48-452b-890a-1da0fbcb6c32 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:54.011760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99cd764a-ff48-452b-890a-1da0fbcb6c32 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:54.018541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99cd764a-ff48-452b-890a-1da0fbcb6c32 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:54.019030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99cd764a-ff48-452b-890a-1da0fbcb6c32 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:54.019470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99cd764a-ff48-452b-890a-1da0fbcb6c32 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:54.020207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99cd764a-ff48-452b-890a-1da0fbcb6c32 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:54.020671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99cd764a-ff48-452b-890a-1da0fbcb6c32 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:54.021105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99cd764a-ff48-452b-890a-1da0fbcb6c32 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:54.050006 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99cd764a-ff48-452b-890a-1da0fbcb6c32 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044419 Aug 09 18:19:54.050477 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3990/7041] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:19:54 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:19:54.060443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:54.060937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:54.067238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:54.067758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:54.068205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:54.068904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:54.069359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:54.069790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:54.146817 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] HTTP exception thrown: Instance d35ef1f8-26a9-475c-91be-359554c89ac2 is not attached to volume a6871c49-c9cf-462f-9694-9e36e95c2338 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Request method failure captured: Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments/a6871c49-c9cf-462f-9694-9e36e95c2338 HTTP/1.1 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qTeAOI0ljX9Dza8YcPY_MyYcL1ZfnNPnOlkEa8iK3R-Xj2PApqLodFLgG3lJrkUiO1Yzyw7jzMLp4yn21J1_ccpwl7X3G8ebbcDniUfRtKt8hjfaXUQNsSxYa860MCzaTw4Pg-ZRO40HYPKXWAd9Ll-_bxvNVj-RyK-vOdIE5ywxbs Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9ef040a2072d493ba849c258c9be9d50 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance d35ef1f8-26a9-475c-91be-359554c89ac2 is not attached to volume a6871c49-c9cf-462f-9694-9e36e95c2338 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': 'd35ef1f8-26a9-475c-91be-359554c89ac2', 'id': 'a6871c49-c9cf-462f-9694-9e36e95c2338'} Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a6871c49-c9cf-462f-9694-9e36e95c2338. Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d35ef1f8-26a9-475c-91be-359554c89ac2 is not attached to volume a6871c49-c9cf-462f-9694-9e36e95c2338 Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:19:54.148479 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:19:54.153002 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:19:54.153002 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:19:54.153002 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d35ef1f8-26a9-475c-91be-359554c89ac2 is not attached to volume a6871c49-c9cf-462f-9694-9e36e95c2338 Aug 09 18:19:54.153002 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:19:54.153002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Returning 404 to user: Instance d35ef1f8-26a9-475c-91be-359554c89ac2 is not attached to volume a6871c49-c9cf-462f-9694-9e36e95c2338 {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:19:54.153002 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2cb3ae46-9794-4585-aa2e-bcd5fccf3680 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments/a6871c49-c9cf-462f-9694-9e36e95c2338" status: 404 len: 154 microversion: 2.1 time: 0.093213 Aug 09 18:19:54.153002 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3991/7042] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 18:19:54 2022] DELETE /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2/os-volume_attachments/a6871c49-c9cf-462f-9694-9e36e95c2338 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:19:57.494483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-35d0fe16-3003-46a9-9caa-5e04c1e52b07 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:57.495187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-35d0fe16-3003-46a9-9caa-5e04c1e52b07 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:57.504182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35d0fe16-3003-46a9-9caa-5e04c1e52b07 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:57.505286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35d0fe16-3003-46a9-9caa-5e04c1e52b07 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:57.506244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35d0fe16-3003-46a9-9caa-5e04c1e52b07 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:57.507695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35d0fe16-3003-46a9-9caa-5e04c1e52b07 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:57.508525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35d0fe16-3003-46a9-9caa-5e04c1e52b07 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:57.509301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-35d0fe16-3003-46a9-9caa-5e04c1e52b07 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:57.539489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-35d0fe16-3003-46a9-9caa-5e04c1e52b07 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:19:57.622384 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-35d0fe16-3003-46a9-9caa-5e04c1e52b07 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 204 len: 0 microversion: 2.1 time: 0.131593 Aug 09 18:19:57.622980 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3992/7043] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:19:57 2022] DELETE /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:19:57.633599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5dcc2f78-d373-4fcf-a846-d338101fbf21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:57.634360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5dcc2f78-d373-4fcf-a846-d338101fbf21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:57.640920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dcc2f78-d373-4fcf-a846-d338101fbf21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:57.641410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dcc2f78-d373-4fcf-a846-d338101fbf21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:57.641864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dcc2f78-d373-4fcf-a846-d338101fbf21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:57.642583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dcc2f78-d373-4fcf-a846-d338101fbf21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:57.643042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dcc2f78-d373-4fcf-a846-d338101fbf21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:57.643478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5dcc2f78-d373-4fcf-a846-d338101fbf21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:57.787366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5dcc2f78-d373-4fcf-a846-d338101fbf21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:57.795664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5dcc2f78-d373-4fcf-a846-d338101fbf21 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1558 microversion: 2.1 time: 0.166517 Aug 09 18:19:57.796400 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3993/7044] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:57 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:19:58.817587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bdc94e56-a81b-4238-ad5b-992db30cd54d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:58.818194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bdc94e56-a81b-4238-ad5b-992db30cd54d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:58.825208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdc94e56-a81b-4238-ad5b-992db30cd54d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:58.825696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdc94e56-a81b-4238-ad5b-992db30cd54d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:58.826145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdc94e56-a81b-4238-ad5b-992db30cd54d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:58.826845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdc94e56-a81b-4238-ad5b-992db30cd54d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:58.827307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdc94e56-a81b-4238-ad5b-992db30cd54d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:19:58.827778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdc94e56-a81b-4238-ad5b-992db30cd54d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:19:58.962627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bdc94e56-a81b-4238-ad5b-992db30cd54d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:19:58.970475 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bdc94e56-a81b-4238-ad5b-992db30cd54d tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1558 microversion: 2.1 time: 0.156823 Aug 09 18:19:58.971056 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3994/7045] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:58 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:19:59.991111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-675503b2-a4d9-486e-b25c-10300ca6d8c7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:19:59.992265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-675503b2-a4d9-486e-b25c-10300ca6d8c7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:19:59.999186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675503b2-a4d9-486e-b25c-10300ca6d8c7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:19:59.999934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675503b2-a4d9-486e-b25c-10300ca6d8c7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:00.000224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675503b2-a4d9-486e-b25c-10300ca6d8c7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:00.001395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675503b2-a4d9-486e-b25c-10300ca6d8c7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:00.001944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675503b2-a4d9-486e-b25c-10300ca6d8c7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:00.002454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-675503b2-a4d9-486e-b25c-10300ca6d8c7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:00.082687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-675503b2-a4d9-486e-b25c-10300ca6d8c7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ef040a2072d493ba849c258c9be9d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37479c7fa67644d0bf9c04ba87987961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:00.091516 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-675503b2-a4d9-486e-b25c-10300ca6d8c7 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 200 len: 1516 microversion: 2.1 time: 0.104134 Aug 09 18:20:00.106665 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3995/7046] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:19:59 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 1516 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:00.140234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-89c8814b-c543-420d-b647-86bee42dd966 req-aca08c4d-c69d-4bf5-9b4d-0acd033b33d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d35ef1f8-26a9-475c-91be-359554c89ac2", "name": "network-vif-deleted", "tag": "8be887a7-ba01-4257-be77-cc41912eda35"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:00.151052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-89c8814b-c543-420d-b647-86bee42dd966 req-aca08c4d-c69d-4bf5-9b4d-0acd033b33d4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:00.152128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-89c8814b-c543-420d-b647-86bee42dd966 req-aca08c4d-c69d-4bf5-9b4d-0acd033b33d4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:00.152777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-89c8814b-c543-420d-b647-86bee42dd966 req-aca08c4d-c69d-4bf5-9b4d-0acd033b33d4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:00.167922 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-89c8814b-c543-420d-b647-86bee42dd966 req-aca08c4d-c69d-4bf5-9b4d-0acd033b33d4 service nova] Creating event network-vif-deleted:8be887a7-ba01-4257-be77-cc41912eda35 for instance d35ef1f8-26a9-475c-91be-359554c89ac2 on n-h1-845781-6 Aug 09 18:20:00.174793 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-89c8814b-c543-420d-b647-86bee42dd966 req-aca08c4d-c69d-4bf5-9b4d-0acd033b33d4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037476 Aug 09 18:20:00.175794 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3996/7047] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:20:01.115006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:01.115734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] [instance: d35ef1f8-26a9-475c-91be-359554c89ac2] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:01.122805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:01.123289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:01.123756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:01.124457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:01.125163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:01.125344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:01.139442 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] HTTP exception thrown: Instance d35ef1f8-26a9-475c-91be-359554c89ac2 could not be found. Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Request method failure captured: Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 HTTP/1.1 Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qTeAOI0ljX9Dza8YcPY_MyYcL1ZfnNPnOlkEa8iK3R-Xj2PApqLodFLgG3lJrkUiO1Yzyw7jzMLp4yn21J1_ccpwl7X3G8ebbcDniUfRtKt8hjfaXUQNsSxYa860MCzaTw4Pg-ZRO40HYPKXWAd9Ll-_bxvNVj-RyK-vOdIE5ywxbs Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37479c7fa67644d0bf9c04ba87987961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 37479c7fa67644d0bf9c04ba87987961 Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2109364467 Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 9ef040a2072d493ba849c258c9be9d50 Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestEncryptedCinderVolumes-2109364467-project Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance d35ef1f8-26a9-475c-91be-359554c89ac2 could not be found. Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'd35ef1f8-26a9-475c-91be-359554c89ac2'} Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d35ef1f8-26a9-475c-91be-359554c89ac2 could not be found. Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d35ef1f8-26a9-475c-91be-359554c89ac2 could not be found. Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:20:01.141162 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:20:01.146554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:20:01.146554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:20:01.146554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:20:01.146554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:20:01.146554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:20:01.146554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:20:01.146554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d35ef1f8-26a9-475c-91be-359554c89ac2 could not be found. Aug 09 18:20:01.146554 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:20:01.146554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Returning 404 to user: Instance d35ef1f8-26a9-475c-91be-359554c89ac2 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:20:01.146554 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c3d9c2b7-8596-446c-bd9b-4f69de6196df tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2" status: 404 len: 111 microversion: 2.1 time: 0.032965 Aug 09 18:20:01.146554 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3997/7048] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:01 2022] GET /compute/v2.1/servers/d35ef1f8-26a9-475c-91be-359554c89ac2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:20:01.151383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-16b72f97-4e01-4ac1-a5aa-7c81ba5cc491 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] Calling method '.version_select at 0x7fbbcb67ab80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:01.171597 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-16b72f97-4e01-4ac1-a5aa-7c81ba5cc491 tempest-TestEncryptedCinderVolumes-2109364467 tempest-TestEncryptedCinderVolumes-2109364467-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-11264783" status: 202 len: 0 microversion: 2.1 time: 0.023707 Aug 09 18:20:01.172171 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3998/7049] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 18:20:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-11264783 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:20:27.953555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:27.954343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:27.959541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-38134329-b92d-44cd-823b-84f34e4cadb6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'create', calling method: .version_select at 0x7fbbca62dee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1857371955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuDM7DjWs6Xe18zP9fgsrA2mT7Xim1YrAM5gzr7NQHOk3iDH4HLiUMe/assEdEc0TGaIqJgoQ6hOTAE3iGzBvZkTpCeP7tpk7t+9ZoNJ74HQd+45OAAfiiRybyOpD5Plw=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:27.984384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-38134329-b92d-44cd-823b-84f34e4cadb6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Getting quotas for project 7b5be7db51a74cd6989217c54c986970. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:20:27.990236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-38134329-b92d-44cd-823b-84f34e4cadb6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Getting quotas for user f960eb217f0c41a6ba6c0e5c0241b200 and project 7b5be7db51a74cd6989217c54c986970. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:20:28.013667 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-38134329-b92d-44cd-823b-84f34e4cadb6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062219 Aug 09 18:20:28.014786 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 3999/7050] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:20:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:20:28.066658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-647803121", "imageRef": "1ff817c9-1ada-4d75-b0d6-6e07b83765db", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1857371955", "networks": [{"uuid": "54deb255-723b-4e52-b516-e87baf1800ff"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:28.118792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] validate_networks() for [('54deb255-723b-4e52-b516-e87baf1800ff', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:20:28.504746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:20:28.505176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:20:28.505663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:20:28.506081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:20:28.506677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:20:28.519027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:28.519510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:28.519985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:28.520709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:28.521163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:28.521594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:28.539262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Getting quotas for project 7b5be7db51a74cd6989217c54c986970. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:20:28.544565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Getting quotas for user f960eb217f0c41a6ba6c0e5c0241b200 and project 7b5be7db51a74cd6989217c54c986970. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:20:28.557313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:20:28.559446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1ff817c9-1ada-4d75-b0d6-6e07b83765db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:20:28.604992 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-17cf3d5f-8bcb-4860-8e7f-62a316761aca tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542326 Aug 09 18:20:28.605649 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4000/7051] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:20:28.616438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7e306961-cf3c-4e0a-a703-bd94755f6c58 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:28.617054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7e306961-cf3c-4e0a-a703-bd94755f6c58 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:28.677077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7e306961-cf3c-4e0a-a703-bd94755f6c58 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:28.683944 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7e306961-cf3c-4e0a-a703-bd94755f6c58 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1258 microversion: 2.1 time: 0.071171 Aug 09 18:20:28.684525 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4001/7052] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:28 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:29.703867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4c282a7b-026f-4b1f-981e-103d84221923 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:29.704561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4c282a7b-026f-4b1f-981e-103d84221923 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:29.712901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c282a7b-026f-4b1f-981e-103d84221923 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:29.713514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c282a7b-026f-4b1f-981e-103d84221923 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:29.714073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c282a7b-026f-4b1f-981e-103d84221923 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:29.714785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c282a7b-026f-4b1f-981e-103d84221923 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:29.715249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c282a7b-026f-4b1f-981e-103d84221923 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:29.715702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4c282a7b-026f-4b1f-981e-103d84221923 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:29.788280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4c282a7b-026f-4b1f-981e-103d84221923 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:29.796906 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4c282a7b-026f-4b1f-981e-103d84221923 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1318 microversion: 2.1 time: 0.096965 Aug 09 18:20:29.797821 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4002/7053] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:29 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1318 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:30.818800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b52e18a2-aeed-4f6f-93eb-6c0bfe96017e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:30.819483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b52e18a2-aeed-4f6f-93eb-6c0bfe96017e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:30.826604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b52e18a2-aeed-4f6f-93eb-6c0bfe96017e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:30.827354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b52e18a2-aeed-4f6f-93eb-6c0bfe96017e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:30.828035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b52e18a2-aeed-4f6f-93eb-6c0bfe96017e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:30.828754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b52e18a2-aeed-4f6f-93eb-6c0bfe96017e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:30.829213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b52e18a2-aeed-4f6f-93eb-6c0bfe96017e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:30.829645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b52e18a2-aeed-4f6f-93eb-6c0bfe96017e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:30.978219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b52e18a2-aeed-4f6f-93eb-6c0bfe96017e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:30.986218 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b52e18a2-aeed-4f6f-93eb-6c0bfe96017e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.171831 Aug 09 18:20:30.987008 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4003/7054] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:30 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:32.008285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-36a3d04c-3b52-4408-a9fd-48bce6d2e6c6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:32.010827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-36a3d04c-3b52-4408-a9fd-48bce6d2e6c6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:32.020067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a3d04c-3b52-4408-a9fd-48bce6d2e6c6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:32.020573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a3d04c-3b52-4408-a9fd-48bce6d2e6c6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:32.021017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a3d04c-3b52-4408-a9fd-48bce6d2e6c6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:32.021737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a3d04c-3b52-4408-a9fd-48bce6d2e6c6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:32.022198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a3d04c-3b52-4408-a9fd-48bce6d2e6c6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:32.022632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-36a3d04c-3b52-4408-a9fd-48bce6d2e6c6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:32.168569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-36a3d04c-3b52-4408-a9fd-48bce6d2e6c6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:32.177566 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-36a3d04c-3b52-4408-a9fd-48bce6d2e6c6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.174125 Aug 09 18:20:32.178173 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4004/7055] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:32 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:33.199924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-92f11b2a-592d-4633-8429-f42197fa3a65 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:33.200584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-92f11b2a-592d-4633-8429-f42197fa3a65 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:33.208044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f11b2a-592d-4633-8429-f42197fa3a65 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:33.208549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f11b2a-592d-4633-8429-f42197fa3a65 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:33.208997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f11b2a-592d-4633-8429-f42197fa3a65 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:33.214821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f11b2a-592d-4633-8429-f42197fa3a65 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:33.215336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f11b2a-592d-4633-8429-f42197fa3a65 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:33.215816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92f11b2a-592d-4633-8429-f42197fa3a65 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:33.358010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-92f11b2a-592d-4633-8429-f42197fa3a65 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:33.366597 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-92f11b2a-592d-4633-8429-f42197fa3a65 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.170537 Aug 09 18:20:33.367297 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4005/7056] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:33 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:34.389101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a5df3dd-5c40-45af-813f-1dabfea6fcc0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:34.389805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a5df3dd-5c40-45af-813f-1dabfea6fcc0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:34.397886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a5df3dd-5c40-45af-813f-1dabfea6fcc0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:34.398470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a5df3dd-5c40-45af-813f-1dabfea6fcc0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:34.398991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a5df3dd-5c40-45af-813f-1dabfea6fcc0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:34.399759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a5df3dd-5c40-45af-813f-1dabfea6fcc0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:34.400219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a5df3dd-5c40-45af-813f-1dabfea6fcc0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:34.400656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a5df3dd-5c40-45af-813f-1dabfea6fcc0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:34.543014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a5df3dd-5c40-45af-813f-1dabfea6fcc0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:34.551125 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a5df3dd-5c40-45af-813f-1dabfea6fcc0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.165969 Aug 09 18:20:34.552040 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4006/7057] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:34 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:35.573583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-859be816-92c4-4d3b-8812-5066747cb03e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:35.574382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-859be816-92c4-4d3b-8812-5066747cb03e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:35.581602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-859be816-92c4-4d3b-8812-5066747cb03e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:35.582095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-859be816-92c4-4d3b-8812-5066747cb03e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:35.582535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-859be816-92c4-4d3b-8812-5066747cb03e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:35.583241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-859be816-92c4-4d3b-8812-5066747cb03e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:35.583724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-859be816-92c4-4d3b-8812-5066747cb03e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:35.584153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-859be816-92c4-4d3b-8812-5066747cb03e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:35.803609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-859be816-92c4-4d3b-8812-5066747cb03e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:35.814255 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-859be816-92c4-4d3b-8812-5066747cb03e tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.244585 Aug 09 18:20:35.814933 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4007/7058] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:35 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:36.836721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9e9dd4ed-2b9c-4914-a4de-8504cb90449d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:36.838447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9e9dd4ed-2b9c-4914-a4de-8504cb90449d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:36.846669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9dd4ed-2b9c-4914-a4de-8504cb90449d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:36.847451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9dd4ed-2b9c-4914-a4de-8504cb90449d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:36.847929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9dd4ed-2b9c-4914-a4de-8504cb90449d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:36.848658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9dd4ed-2b9c-4914-a4de-8504cb90449d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:36.849155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9dd4ed-2b9c-4914-a4de-8504cb90449d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:36.849780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9e9dd4ed-2b9c-4914-a4de-8504cb90449d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:36.997138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9e9dd4ed-2b9c-4914-a4de-8504cb90449d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:37.010900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9e9dd4ed-2b9c-4914-a4de-8504cb90449d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.178940 Aug 09 18:20:37.011708 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4008/7059] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:36 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:20:38.033578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4806ac22-3281-4b32-8809-30e8b2dfee72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:38.035877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4806ac22-3281-4b32-8809-30e8b2dfee72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:38.044129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4806ac22-3281-4b32-8809-30e8b2dfee72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:38.044571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4806ac22-3281-4b32-8809-30e8b2dfee72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:38.045024 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4806ac22-3281-4b32-8809-30e8b2dfee72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:38.047289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4806ac22-3281-4b32-8809-30e8b2dfee72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:38.047289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4806ac22-3281-4b32-8809-30e8b2dfee72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:38.047289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4806ac22-3281-4b32-8809-30e8b2dfee72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:38.186685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4806ac22-3281-4b32-8809-30e8b2dfee72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:38.195224 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4806ac22-3281-4b32-8809-30e8b2dfee72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.166614 Aug 09 18:20:38.195995 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4009/7060] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:38 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:38.241825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d70292d8-407d-4dff-8b26-7410805d18e6 req-d94f363d-0e73-4c40-a4be-7f754d830747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe869a65-216b-4646-a12d-17d4c5a1ba24", "tag": "402e8e68-5ede-4728-9398-89ff9a8b022e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:38.252988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d70292d8-407d-4dff-8b26-7410805d18e6 req-d94f363d-0e73-4c40-a4be-7f754d830747 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:38.260473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d70292d8-407d-4dff-8b26-7410805d18e6 req-d94f363d-0e73-4c40-a4be-7f754d830747 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:38.261254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d70292d8-407d-4dff-8b26-7410805d18e6 req-d94f363d-0e73-4c40-a4be-7f754d830747 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:38.273715 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d70292d8-407d-4dff-8b26-7410805d18e6 req-d94f363d-0e73-4c40-a4be-7f754d830747 service nova] Creating event network-changed:402e8e68-5ede-4728-9398-89ff9a8b022e for instance fe869a65-216b-4646-a12d-17d4c5a1ba24 on n-h1-845781-6 Aug 09 18:20:38.278665 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d70292d8-407d-4dff-8b26-7410805d18e6 req-d94f363d-0e73-4c40-a4be-7f754d830747 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040963 Aug 09 18:20:38.279278 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4010/7061] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:20:39.221720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:39.222510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:39.227660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-98b39ee0-457d-4863-bd27-6c3d3e70b750 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:39.228376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-98b39ee0-457d-4863-bd27-6c3d3e70b750 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:39.235862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98b39ee0-457d-4863-bd27-6c3d3e70b750 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:39.236426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98b39ee0-457d-4863-bd27-6c3d3e70b750 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:39.236871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98b39ee0-457d-4863-bd27-6c3d3e70b750 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:39.237631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98b39ee0-457d-4863-bd27-6c3d3e70b750 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:39.238174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98b39ee0-457d-4863-bd27-6c3d3e70b750 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:39.238614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-98b39ee0-457d-4863-bd27-6c3d3e70b750 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:39.373395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-98b39ee0-457d-4863-bd27-6c3d3e70b750 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:39.381562 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-98b39ee0-457d-4863-bd27-6c3d3e70b750 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.160912 Aug 09 18:20:39.382156 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4011/7062] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:39 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:40.403043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6cdf9b5b-ef46-4119-80fd-8ec63f990ecb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:40.403732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6cdf9b5b-ef46-4119-80fd-8ec63f990ecb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:40.410603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cdf9b5b-ef46-4119-80fd-8ec63f990ecb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:40.411088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cdf9b5b-ef46-4119-80fd-8ec63f990ecb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:40.411529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cdf9b5b-ef46-4119-80fd-8ec63f990ecb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:40.412250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cdf9b5b-ef46-4119-80fd-8ec63f990ecb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:40.412706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cdf9b5b-ef46-4119-80fd-8ec63f990ecb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:40.413133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6cdf9b5b-ef46-4119-80fd-8ec63f990ecb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:40.561837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6cdf9b5b-ef46-4119-80fd-8ec63f990ecb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:40.569462 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6cdf9b5b-ef46-4119-80fd-8ec63f990ecb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.170479 Aug 09 18:20:40.570051 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4012/7063] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:40 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:41.590013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-292d0346-0f52-485a-bf1c-9e25ac2c9e04 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:41.590707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-292d0346-0f52-485a-bf1c-9e25ac2c9e04 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:41.597678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292d0346-0f52-485a-bf1c-9e25ac2c9e04 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:41.598172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292d0346-0f52-485a-bf1c-9e25ac2c9e04 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:41.598619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292d0346-0f52-485a-bf1c-9e25ac2c9e04 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:41.599325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292d0346-0f52-485a-bf1c-9e25ac2c9e04 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:41.599835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292d0346-0f52-485a-bf1c-9e25ac2c9e04 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:41.600337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-292d0346-0f52-485a-bf1c-9e25ac2c9e04 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:41.736725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-292d0346-0f52-485a-bf1c-9e25ac2c9e04 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:41.744424 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-292d0346-0f52-485a-bf1c-9e25ac2c9e04 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.158615 Aug 09 18:20:41.745022 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4013/7064] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:41 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:42.765412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a2283ad-bf60-4138-a7c6-39ff0080568c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:42.766095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a2283ad-bf60-4138-a7c6-39ff0080568c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:42.773032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a2283ad-bf60-4138-a7c6-39ff0080568c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:42.773516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a2283ad-bf60-4138-a7c6-39ff0080568c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:42.773955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a2283ad-bf60-4138-a7c6-39ff0080568c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:42.774656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a2283ad-bf60-4138-a7c6-39ff0080568c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:42.775106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a2283ad-bf60-4138-a7c6-39ff0080568c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:42.775525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a2283ad-bf60-4138-a7c6-39ff0080568c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:42.914418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a2283ad-bf60-4138-a7c6-39ff0080568c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:42.922039 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a2283ad-bf60-4138-a7c6-39ff0080568c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.160493 Aug 09 18:20:42.922619 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4014/7065] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:42 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:43.837876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-17984ed4-a50b-4b49-8149-8d706acc1cb1 req-256f2314-89e9-4eb4-9da5-cd4a8b483dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe869a65-216b-4646-a12d-17d4c5a1ba24", "name": "network-vif-plugged", "status": "completed", "tag": "402e8e68-5ede-4728-9398-89ff9a8b022e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:43.848917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-17984ed4-a50b-4b49-8149-8d706acc1cb1 req-256f2314-89e9-4eb4-9da5-cd4a8b483dec service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:43.849411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-17984ed4-a50b-4b49-8149-8d706acc1cb1 req-256f2314-89e9-4eb4-9da5-cd4a8b483dec service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:43.849847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-17984ed4-a50b-4b49-8149-8d706acc1cb1 req-256f2314-89e9-4eb4-9da5-cd4a8b483dec service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:43.862039 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-17984ed4-a50b-4b49-8149-8d706acc1cb1 req-256f2314-89e9-4eb4-9da5-cd4a8b483dec service nova] Creating event network-vif-plugged:402e8e68-5ede-4728-9398-89ff9a8b022e for instance fe869a65-216b-4646-a12d-17d4c5a1ba24 on n-h1-845781-6 Aug 09 18:20:43.867192 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-17984ed4-a50b-4b49-8149-8d706acc1cb1 req-256f2314-89e9-4eb4-9da5-cd4a8b483dec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033246 Aug 09 18:20:43.867849 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4015/7066] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:20:43.944320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f145c3da-278a-4fbb-9dae-b44a2e13dcfb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:43.944962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f145c3da-278a-4fbb-9dae-b44a2e13dcfb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:43.951764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f145c3da-278a-4fbb-9dae-b44a2e13dcfb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:43.952329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f145c3da-278a-4fbb-9dae-b44a2e13dcfb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:43.952781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f145c3da-278a-4fbb-9dae-b44a2e13dcfb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:43.953587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f145c3da-278a-4fbb-9dae-b44a2e13dcfb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:43.954179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f145c3da-278a-4fbb-9dae-b44a2e13dcfb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:43.954684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f145c3da-278a-4fbb-9dae-b44a2e13dcfb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:44.086299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f145c3da-278a-4fbb-9dae-b44a2e13dcfb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:44.094265 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f145c3da-278a-4fbb-9dae-b44a2e13dcfb tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.155410 Aug 09 18:20:44.094849 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4016/7067] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:43 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:45.114576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b7ad0563-05ac-4ca1-9ec5-afff445a4534 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:45.115321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b7ad0563-05ac-4ca1-9ec5-afff445a4534 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:45.122178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ad0563-05ac-4ca1-9ec5-afff445a4534 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:45.122672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ad0563-05ac-4ca1-9ec5-afff445a4534 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:45.123121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ad0563-05ac-4ca1-9ec5-afff445a4534 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:45.123862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ad0563-05ac-4ca1-9ec5-afff445a4534 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:45.124330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ad0563-05ac-4ca1-9ec5-afff445a4534 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:45.124789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b7ad0563-05ac-4ca1-9ec5-afff445a4534 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:45.265114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b7ad0563-05ac-4ca1-9ec5-afff445a4534 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:45.273489 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b7ad0563-05ac-4ca1-9ec5-afff445a4534 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1358 microversion: 2.1 time: 0.162903 Aug 09 18:20:45.274090 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4017/7068] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:45 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:46.294374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e051ab74-1846-4a8d-bb2a-4e8a977600a1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:46.295054 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e051ab74-1846-4a8d-bb2a-4e8a977600a1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:46.302070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e051ab74-1846-4a8d-bb2a-4e8a977600a1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:46.302568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e051ab74-1846-4a8d-bb2a-4e8a977600a1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:46.303014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e051ab74-1846-4a8d-bb2a-4e8a977600a1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:46.303747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e051ab74-1846-4a8d-bb2a-4e8a977600a1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:46.304211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e051ab74-1846-4a8d-bb2a-4e8a977600a1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:46.304643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e051ab74-1846-4a8d-bb2a-4e8a977600a1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:46.435808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e051ab74-1846-4a8d-bb2a-4e8a977600a1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:46.443359 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e051ab74-1846-4a8d-bb2a-4e8a977600a1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1547 microversion: 2.1 time: 0.153384 Aug 09 18:20:46.443978 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4018/7069] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:46 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:46.463280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64cbdd97-a1ba-4149-8f3f-402158483a3d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:46.464187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-64cbdd97-a1ba-4149-8f3f-402158483a3d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:46.469948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cbdd97-a1ba-4149-8f3f-402158483a3d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:46.470459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cbdd97-a1ba-4149-8f3f-402158483a3d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:46.471555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cbdd97-a1ba-4149-8f3f-402158483a3d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:46.472283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cbdd97-a1ba-4149-8f3f-402158483a3d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:46.472743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cbdd97-a1ba-4149-8f3f-402158483a3d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:46.473176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64cbdd97-a1ba-4149-8f3f-402158483a3d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:46.491380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:20:46.604341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-64cbdd97-a1ba-4149-8f3f-402158483a3d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:46.612153 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-64cbdd97-a1ba-4149-8f3f-402158483a3d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1547 microversion: 2.1 time: 0.152418 Aug 09 18:20:46.612734 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4019/7070] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:46 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:46.631535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0abddc5c-42a3-462b-8e95-3ab37a06b9a9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:46.636095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0abddc5c-42a3-462b-8e95-3ab37a06b9a9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:46.636874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0abddc5c-42a3-462b-8e95-3ab37a06b9a9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Searching by: {'deleted': False, 'project_id': '7b5be7db51a74cd6989217c54c986970'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 18:20:46.642037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abddc5c-42a3-462b-8e95-3ab37a06b9a9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:46.642521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abddc5c-42a3-462b-8e95-3ab37a06b9a9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:46.643653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abddc5c-42a3-462b-8e95-3ab37a06b9a9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:46.644376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abddc5c-42a3-462b-8e95-3ab37a06b9a9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:46.644833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abddc5c-42a3-462b-8e95-3ab37a06b9a9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:46.645263 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0abddc5c-42a3-462b-8e95-3ab37a06b9a9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:46.672174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-0abddc5c-42a3-462b-8e95-3ab37a06b9a9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 18:20:46.701121 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0abddc5c-42a3-462b-8e95-3ab37a06b9a9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.073045 Aug 09 18:20:46.701724 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4020/7071] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 18:20:46 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:20:46.713239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ce06640d-9ae0-4268-9f49-1e557aa75309 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:20:46.714189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ce06640d-9ae0-4268-9f49-1e557aa75309 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:46.719840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce06640d-9ae0-4268-9f49-1e557aa75309 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:46.720327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce06640d-9ae0-4268-9f49-1e557aa75309 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:46.720813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce06640d-9ae0-4268-9f49-1e557aa75309 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:46.721509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce06640d-9ae0-4268-9f49-1e557aa75309 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:46.721966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce06640d-9ae0-4268-9f49-1e557aa75309 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:46.722398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce06640d-9ae0-4268-9f49-1e557aa75309 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:46.856630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ce06640d-9ae0-4268-9f49-1e557aa75309 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:20:46.865163 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ce06640d-9ae0-4268-9f49-1e557aa75309 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1547 microversion: 2.1 time: 0.155522 Aug 09 18:20:46.865747 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4021/7072] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:20:46 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:20:48.412131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f933333a-7359-48ff-85aa-00ddf3650a2b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f25a146-3514-4ef6-a7cb-f2ef69a7a926"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:20:48.414475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f933333a-7359-48ff-85aa-00ddf3650a2b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:20:48.421402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f933333a-7359-48ff-85aa-00ddf3650a2b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:48.421910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f933333a-7359-48ff-85aa-00ddf3650a2b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:48.422403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f933333a-7359-48ff-85aa-00ddf3650a2b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:48.423071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f933333a-7359-48ff-85aa-00ddf3650a2b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:20:48.423522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f933333a-7359-48ff-85aa-00ddf3650a2b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:20:48.424510 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f933333a-7359-48ff-85aa-00ddf3650a2b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:20:48.687580 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f933333a-7359-48ff-85aa-00ddf3650a2b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279380 Aug 09 18:20:48.688328 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4022/7073] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 18:20:48 2022] POST /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:21:01.718525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:01.719314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:01.720293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:21:01.724961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-70311673-e953-441a-954b-35ad30f146da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:01.725672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-70311673-e953-441a-954b-35ad30f146da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:01.735333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70311673-e953-441a-954b-35ad30f146da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:01.735867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70311673-e953-441a-954b-35ad30f146da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:01.736317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70311673-e953-441a-954b-35ad30f146da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:01.737014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70311673-e953-441a-954b-35ad30f146da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:01.737471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70311673-e953-441a-954b-35ad30f146da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:01.737906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-70311673-e953-441a-954b-35ad30f146da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:01.868936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-70311673-e953-441a-954b-35ad30f146da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:01.877730 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-70311673-e953-441a-954b-35ad30f146da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1593 microversion: 2.1 time: 0.160679 Aug 09 18:21:01.878328 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4023/7074] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:01 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:21:04.058640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9d898ca4-e73d-4558-aa68-3b68c78bab2f req-24b97c0b-6705-4698-a372-16e3709cd9bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe869a65-216b-4646-a12d-17d4c5a1ba24", "tag": "402e8e68-5ede-4728-9398-89ff9a8b022e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:21:04.069981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9d898ca4-e73d-4558-aa68-3b68c78bab2f req-24b97c0b-6705-4698-a372-16e3709cd9bc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:04.070556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9d898ca4-e73d-4558-aa68-3b68c78bab2f req-24b97c0b-6705-4698-a372-16e3709cd9bc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:04.071270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9d898ca4-e73d-4558-aa68-3b68c78bab2f req-24b97c0b-6705-4698-a372-16e3709cd9bc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:04.088817 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9d898ca4-e73d-4558-aa68-3b68c78bab2f req-24b97c0b-6705-4698-a372-16e3709cd9bc service nova] Creating event network-changed:402e8e68-5ede-4728-9398-89ff9a8b022e for instance fe869a65-216b-4646-a12d-17d4c5a1ba24 on n-h1-845781-6 Aug 09 18:21:04.094509 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9d898ca4-e73d-4558-aa68-3b68c78bab2f req-24b97c0b-6705-4698-a372-16e3709cd9bc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189200 Aug 09 18:21:04.096343 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4024/7075] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:21:05.207499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66bc76bd-e5e3-4466-81fa-6141123df964 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1373195594"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:21:05.208252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-66bc76bd-e5e3-4466-81fa-6141123df964 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:05.214843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bc76bd-e5e3-4466-81fa-6141123df964 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:05.215326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bc76bd-e5e3-4466-81fa-6141123df964 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:05.215798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bc76bd-e5e3-4466-81fa-6141123df964 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:05.216504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bc76bd-e5e3-4466-81fa-6141123df964 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:05.216961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bc76bd-e5e3-4466-81fa-6141123df964 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:05.217408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66bc76bd-e5e3-4466-81fa-6141123df964 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:05.363007 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.network.security_group_api [None req-66bc76bd-e5e3-4466-81fa-6141123df964 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Adding security group 5f251bd2-fe4a-46ea-b024-abdb184f2dd9 to port 402e8e68-5ede-4728-9398-89ff9a8b022e Aug 09 18:21:05.728669 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66bc76bd-e5e3-4466-81fa-6141123df964 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/action" status: 202 len: 0 microversion: 2.1 time: 0.526230 Aug 09 18:21:05.729600 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4025/7076] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:21:05 2022] POST /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:21:05.740838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-96d3a546-e222-4018-9c0e-14c75fdd8424 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:21:05.741936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-96d3a546-e222-4018-9c0e-14c75fdd8424 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:21:05.749049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96d3a546-e222-4018-9c0e-14c75fdd8424 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:05.749546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96d3a546-e222-4018-9c0e-14c75fdd8424 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:05.749988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96d3a546-e222-4018-9c0e-14c75fdd8424 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:05.750714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96d3a546-e222-4018-9c0e-14c75fdd8424 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:05.751800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96d3a546-e222-4018-9c0e-14c75fdd8424 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:05.752242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-96d3a546-e222-4018-9c0e-14c75fdd8424 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:05.973186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-96d3a546-e222-4018-9c0e-14c75fdd8424 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:21:05.982439 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-96d3a546-e222-4018-9c0e-14c75fdd8424 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1759 microversion: 2.1 time: 0.245543 Aug 09 18:21:05.983043 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4026/7077] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:21:05 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1759 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:21:06.115415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b0a190c1-fa4c-497b-837e-cce680759f8b req-27469a05-29eb-44e7-9c9f-bf796e7a7f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe869a65-216b-4646-a12d-17d4c5a1ba24", "tag": "402e8e68-5ede-4728-9398-89ff9a8b022e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:21:06.125557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b0a190c1-fa4c-497b-837e-cce680759f8b req-27469a05-29eb-44e7-9c9f-bf796e7a7f4f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:21:06.126058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b0a190c1-fa4c-497b-837e-cce680759f8b req-27469a05-29eb-44e7-9c9f-bf796e7a7f4f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:21:06.126489 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b0a190c1-fa4c-497b-837e-cce680759f8b req-27469a05-29eb-44e7-9c9f-bf796e7a7f4f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:21:06.139327 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b0a190c1-fa4c-497b-837e-cce680759f8b req-27469a05-29eb-44e7-9c9f-bf796e7a7f4f service nova] Creating event network-changed:402e8e68-5ede-4728-9398-89ff9a8b022e for instance fe869a65-216b-4646-a12d-17d4c5a1ba24 on n-h1-845781-6 Aug 09 18:21:06.145310 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b0a190c1-fa4c-497b-837e-cce680759f8b req-27469a05-29eb-44e7-9c9f-bf796e7a7f4f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033683 Aug 09 18:21:06.145941 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4027/7078] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:22:49.014341 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e0ed10f-39e6-43ca-a71e-0dc84cc0a1d8] AMQP server on 10.222.0.93:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 09 18:22:49.015583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:49.016358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=20 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:22:49.021705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2b765cd6-c1b0-4f81-b038-a291b93f5f82 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:22:49.024163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2b765cd6-c1b0-4f81-b038-a291b93f5f82 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:49.035792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b765cd6-c1b0-4f81-b038-a291b93f5f82 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:49.036291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b765cd6-c1b0-4f81-b038-a291b93f5f82 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:49.036731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b765cd6-c1b0-4f81-b038-a291b93f5f82 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:49.037522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b765cd6-c1b0-4f81-b038-a291b93f5f82 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:49.037909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b765cd6-c1b0-4f81-b038-a291b93f5f82 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:49.038392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b765cd6-c1b0-4f81-b038-a291b93f5f82 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:49.129586 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2b765cd6-c1b0-4f81-b038-a291b93f5f82 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/action" status: 202 len: 0 microversion: 2.1 time: 0.116822 Aug 09 18:22:49.130401 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4028/7079] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:22:49 2022] POST /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:22:49.139553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1f73fca0-c50e-4e88-986d-3705333153ef tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:49.140300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1f73fca0-c50e-4e88-986d-3705333153ef tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:49.151388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f73fca0-c50e-4e88-986d-3705333153ef tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:49.152193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f73fca0-c50e-4e88-986d-3705333153ef tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:49.152887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f73fca0-c50e-4e88-986d-3705333153ef tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:49.154062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f73fca0-c50e-4e88-986d-3705333153ef tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:49.154790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f73fca0-c50e-4e88-986d-3705333153ef tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:49.155472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f73fca0-c50e-4e88-986d-3705333153ef tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:49.469385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1f73fca0-c50e-4e88-986d-3705333153ef tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:49.479117 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1f73fca0-c50e-4e88-986d-3705333153ef tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1761 microversion: 2.1 time: 0.343905 Aug 09 18:22:49.479747 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4029/7080] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:49 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1761 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:22:50.501541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e7b80c5-9dff-4d28-9e81-a205347b05ba tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:22:50.502516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e7b80c5-9dff-4d28-9e81-a205347b05ba tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:22:50.512083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e7b80c5-9dff-4d28-9e81-a205347b05ba tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:50.512083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e7b80c5-9dff-4d28-9e81-a205347b05ba tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:50.512408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e7b80c5-9dff-4d28-9e81-a205347b05ba tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:50.513698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e7b80c5-9dff-4d28-9e81-a205347b05ba tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:22:50.513698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e7b80c5-9dff-4d28-9e81-a205347b05ba tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:22:50.514032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e7b80c5-9dff-4d28-9e81-a205347b05ba tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:22:50.535144 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e0ed10f-39e6-43ca-a71e-0dc84cc0a1d8] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 39268. Aug 09 18:22:50.688951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4e7b80c5-9dff-4d28-9e81-a205347b05ba tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:22:50.698585 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e7b80c5-9dff-4d28-9e81-a205347b05ba tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1759 microversion: 2.1 time: 0.200943 Aug 09 18:22:50.699192 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4030/7081] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:22:50 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1759 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:23:00.944845 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:23:00.945923 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 18:23:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:24:06.692112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=6 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:06.692887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:06.696875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4208c13d-aa2a-4c02-9d9e-bbcd50ace2f6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1373195594"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:06.697438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4208c13d-aa2a-4c02-9d9e-bbcd50ace2f6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:06.705855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4208c13d-aa2a-4c02-9d9e-bbcd50ace2f6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:06.706358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4208c13d-aa2a-4c02-9d9e-bbcd50ace2f6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:06.706812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4208c13d-aa2a-4c02-9d9e-bbcd50ace2f6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:06.707529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4208c13d-aa2a-4c02-9d9e-bbcd50ace2f6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:06.708015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4208c13d-aa2a-4c02-9d9e-bbcd50ace2f6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:06.708457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4208c13d-aa2a-4c02-9d9e-bbcd50ace2f6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:06.849889 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.network.security_group_api [None req-4208c13d-aa2a-4c02-9d9e-bbcd50ace2f6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Removing security group 5f251bd2-fe4a-46ea-b024-abdb184f2dd9 from port 402e8e68-5ede-4728-9398-89ff9a8b022e Aug 09 18:24:07.154717 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4208c13d-aa2a-4c02-9d9e-bbcd50ace2f6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/action" status: 202 len: 0 microversion: 2.1 time: 0.464045 Aug 09 18:24:07.154717 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4031/7082] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:24:06 2022] POST /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:24:07.164796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a0fc3fd7-76a2-4a7a-9140-7321a3f617f9 req-90cace20-5a32-4184-b70b-0331354d991d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe869a65-216b-4646-a12d-17d4c5a1ba24", "tag": "402e8e68-5ede-4728-9398-89ff9a8b022e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:07.176163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a0fc3fd7-76a2-4a7a-9140-7321a3f617f9 req-90cace20-5a32-4184-b70b-0331354d991d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:07.176647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a0fc3fd7-76a2-4a7a-9140-7321a3f617f9 req-90cace20-5a32-4184-b70b-0331354d991d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:07.177092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a0fc3fd7-76a2-4a7a-9140-7321a3f617f9 req-90cace20-5a32-4184-b70b-0331354d991d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:07.189026 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a0fc3fd7-76a2-4a7a-9140-7321a3f617f9 req-90cace20-5a32-4184-b70b-0331354d991d service nova] Creating event network-changed:402e8e68-5ede-4728-9398-89ff9a8b022e for instance fe869a65-216b-4646-a12d-17d4c5a1ba24 on n-h1-845781-6 Aug 09 18:24:07.194806 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a0fc3fd7-76a2-4a7a-9140-7321a3f617f9 req-90cace20-5a32-4184-b70b-0331354d991d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033808 Aug 09 18:24:07.196018 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4032/7083] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:24:08.656583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eca30529-3816-4f31-92fd-0e550a428d0d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:08.657249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eca30529-3816-4f31-92fd-0e550a428d0d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:08.663713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eca30529-3816-4f31-92fd-0e550a428d0d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:08.664214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eca30529-3816-4f31-92fd-0e550a428d0d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:08.664664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eca30529-3816-4f31-92fd-0e550a428d0d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:08.665378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eca30529-3816-4f31-92fd-0e550a428d0d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:08.665841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eca30529-3816-4f31-92fd-0e550a428d0d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:08.666789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eca30529-3816-4f31-92fd-0e550a428d0d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:08.755179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-eca30529-3816-4f31-92fd-0e550a428d0d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lazy-loading 'services' on Instance uuid fe869a65-216b-4646-a12d-17d4c5a1ba24 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:24:08.843291 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eca30529-3816-4f31-92fd-0e550a428d0d tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments/8f25a146-3514-4ef6-a7cb-f2ef69a7a926" status: 202 len: 0 microversion: 2.1 time: 0.191907 Aug 09 18:24:08.844466 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4033/7084] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 18:24:08 2022] DELETE /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments/8f25a146-3514-4ef6-a7cb-f2ef69a7a926 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:24:08.852765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6a1cfcb9-ca65-4f79-b91b-36a93c6ba0d5 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:08.855982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6a1cfcb9-ca65-4f79-b91b-36a93c6ba0d5 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:08.862873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1cfcb9-ca65-4f79-b91b-36a93c6ba0d5 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:08.863536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1cfcb9-ca65-4f79-b91b-36a93c6ba0d5 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:08.864281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1cfcb9-ca65-4f79-b91b-36a93c6ba0d5 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:08.865083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1cfcb9-ca65-4f79-b91b-36a93c6ba0d5 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:08.865680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1cfcb9-ca65-4f79-b91b-36a93c6ba0d5 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:08.866605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1cfcb9-ca65-4f79-b91b-36a93c6ba0d5 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:08.903907 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6a1cfcb9-ca65-4f79-b91b-36a93c6ba0d5 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055336 Aug 09 18:24:08.904907 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4034/7085] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:24:08 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:24:09.212211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-881be4d4-effc-440e-b4e8-39560d6d55c3 req-924d9a82-8b81-4488-9ec3-7d6891cb64cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe869a65-216b-4646-a12d-17d4c5a1ba24", "tag": "402e8e68-5ede-4728-9398-89ff9a8b022e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:09.224327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-881be4d4-effc-440e-b4e8-39560d6d55c3 req-924d9a82-8b81-4488-9ec3-7d6891cb64cb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:09.224582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-881be4d4-effc-440e-b4e8-39560d6d55c3 req-924d9a82-8b81-4488-9ec3-7d6891cb64cb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:09.225141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-881be4d4-effc-440e-b4e8-39560d6d55c3 req-924d9a82-8b81-4488-9ec3-7d6891cb64cb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:09.238379 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-881be4d4-effc-440e-b4e8-39560d6d55c3 req-924d9a82-8b81-4488-9ec3-7d6891cb64cb service nova] Creating event network-changed:402e8e68-5ede-4728-9398-89ff9a8b022e for instance fe869a65-216b-4646-a12d-17d4c5a1ba24 on n-h1-845781-6 Aug 09 18:24:09.244166 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-881be4d4-effc-440e-b4e8-39560d6d55c3 req-924d9a82-8b81-4488-9ec3-7d6891cb64cb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036346 Aug 09 18:24:09.245154 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4035/7086] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:24:09.919901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-72e4d8f6-9881-4624-867d-0d8cb437a93f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:09.925357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-72e4d8f6-9881-4624-867d-0d8cb437a93f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:09.948046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72e4d8f6-9881-4624-867d-0d8cb437a93f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:09.949383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72e4d8f6-9881-4624-867d-0d8cb437a93f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:09.950340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72e4d8f6-9881-4624-867d-0d8cb437a93f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:09.951807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72e4d8f6-9881-4624-867d-0d8cb437a93f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:09.952973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72e4d8f6-9881-4624-867d-0d8cb437a93f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:09.953891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-72e4d8f6-9881-4624-867d-0d8cb437a93f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:09.994547 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-72e4d8f6-9881-4624-867d-0d8cb437a93f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080793 Aug 09 18:24:09.996606 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4036/7087] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:24:09 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:24:11.007663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-03b213af-16d6-4cec-acab-40bc2223ee9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:11.009862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-03b213af-16d6-4cec-acab-40bc2223ee9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:11.017053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03b213af-16d6-4cec-acab-40bc2223ee9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:11.017538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03b213af-16d6-4cec-acab-40bc2223ee9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:11.017988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03b213af-16d6-4cec-acab-40bc2223ee9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:11.018706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03b213af-16d6-4cec-acab-40bc2223ee9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:11.019161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03b213af-16d6-4cec-acab-40bc2223ee9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:11.019588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-03b213af-16d6-4cec-acab-40bc2223ee9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:11.052766 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-03b213af-16d6-4cec-acab-40bc2223ee9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049018 Aug 09 18:24:11.053268 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4037/7088] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:24:11 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:24:12.065424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6535006e-7de5-4f73-8416-4f7f04e8efda tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:12.067540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6535006e-7de5-4f73-8416-4f7f04e8efda tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:12.075212 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6535006e-7de5-4f73-8416-4f7f04e8efda tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:12.075739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6535006e-7de5-4f73-8416-4f7f04e8efda tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:12.076196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6535006e-7de5-4f73-8416-4f7f04e8efda tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:12.076920 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6535006e-7de5-4f73-8416-4f7f04e8efda tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:12.077383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6535006e-7de5-4f73-8416-4f7f04e8efda tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:12.077821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6535006e-7de5-4f73-8416-4f7f04e8efda tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:12.113406 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6535006e-7de5-4f73-8416-4f7f04e8efda tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052093 Aug 09 18:24:12.117769 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4038/7089] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:24:12 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:24:13.125909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1036ac21-9e28-4d92-98c1-7846b1006105 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:13.128148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1036ac21-9e28-4d92-98c1-7846b1006105 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:13.135894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1036ac21-9e28-4d92-98c1-7846b1006105 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:13.136398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1036ac21-9e28-4d92-98c1-7846b1006105 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:13.136840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1036ac21-9e28-4d92-98c1-7846b1006105 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:13.137587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1036ac21-9e28-4d92-98c1-7846b1006105 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:13.138077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1036ac21-9e28-4d92-98c1-7846b1006105 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:13.138569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1036ac21-9e28-4d92-98c1-7846b1006105 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:13.173325 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1036ac21-9e28-4d92-98c1-7846b1006105 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051371 Aug 09 18:24:13.173797 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4039/7090] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:24:13 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:24:14.186558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-61f158fd-53c4-407c-912a-b335a7e01211 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:14.188728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-61f158fd-53c4-407c-912a-b335a7e01211 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:14.195895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f158fd-53c4-407c-912a-b335a7e01211 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:14.196384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f158fd-53c4-407c-912a-b335a7e01211 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:14.196818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f158fd-53c4-407c-912a-b335a7e01211 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:14.197525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f158fd-53c4-407c-912a-b335a7e01211 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:14.197975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f158fd-53c4-407c-912a-b335a7e01211 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:14.198400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-61f158fd-53c4-407c-912a-b335a7e01211 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:14.231618 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-61f158fd-53c4-407c-912a-b335a7e01211 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049642 Aug 09 18:24:14.232343 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4040/7091] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:24:14 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:24:14.242586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:14.243091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:14.249712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:14.250208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:14.250662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:14.251375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:14.251933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:14.257825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:14.334781 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] HTTP exception thrown: Instance fe869a65-216b-4646-a12d-17d4c5a1ba24 is not attached to volume 8f25a146-3514-4ef6-a7cb-f2ef69a7a926 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Request method failure captured: Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments/8f25a146-3514-4ef6-a7cb-f2ef69a7a926 HTTP/1.1 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qVdrpEwRAeuR_j4IS2j7B62lG7_B4iYuln6Z5hN0oZ3bVshsK7VgfkXcjBfxWfJfv-aRi9V4R3evTmdY7Y4p79akAld91--m63VZYgC852aOf49JpSGJjKew3v55MhriOaQLxTTQn_h-qrCDTtXGdfBjId21qP04bAbCuO3i2BKhKI Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 7b5be7db51a74cd6989217c54c986970 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7b5be7db51a74cd6989217c54c986970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 7b5be7db51a74cd6989217c54c986970 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestMinimumBasicScenario-1283421594-project Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: f960eb217f0c41a6ba6c0e5c0241b200 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestMinimumBasicScenario-1283421594-project Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fe869a65-216b-4646-a12d-17d4c5a1ba24 is not attached to volume 8f25a146-3514-4ef6-a7cb-f2ef69a7a926 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': 'fe869a65-216b-4646-a12d-17d4c5a1ba24', 'id': '8f25a146-3514-4ef6-a7cb-f2ef69a7a926'} Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8f25a146-3514-4ef6-a7cb-f2ef69a7a926. Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe869a65-216b-4646-a12d-17d4c5a1ba24 is not attached to volume 8f25a146-3514-4ef6-a7cb-f2ef69a7a926 Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:24:14.336474 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:24:14.340677 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:24:14.340677 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:24:14.340677 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe869a65-216b-4646-a12d-17d4c5a1ba24 is not attached to volume 8f25a146-3514-4ef6-a7cb-f2ef69a7a926 Aug 09 18:24:14.340677 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:24:14.340677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Returning 404 to user: Instance fe869a65-216b-4646-a12d-17d4c5a1ba24 is not attached to volume 8f25a146-3514-4ef6-a7cb-f2ef69a7a926 {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:24:14.340677 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75012322-90f6-4dab-beae-49f08a259717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments/8f25a146-3514-4ef6-a7cb-f2ef69a7a926" status: 404 len: 154 microversion: 2.1 time: 0.099241 Aug 09 18:24:14.340677 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4041/7092] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 18:24:14 2022] DELETE /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24/os-volume_attachments/8f25a146-3514-4ef6-a7cb-f2ef69a7a926 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:24:17.639353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d31b375f-fe8f-49ec-93f7-f222e5223868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:17.640157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d31b375f-fe8f-49ec-93f7-f222e5223868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:17.647414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d31b375f-fe8f-49ec-93f7-f222e5223868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:17.647954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d31b375f-fe8f-49ec-93f7-f222e5223868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:17.648521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d31b375f-fe8f-49ec-93f7-f222e5223868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:17.649536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d31b375f-fe8f-49ec-93f7-f222e5223868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:17.650287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d31b375f-fe8f-49ec-93f7-f222e5223868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:17.650823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d31b375f-fe8f-49ec-93f7-f222e5223868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:17.678658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d31b375f-fe8f-49ec-93f7-f222e5223868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:24:17.755123 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d31b375f-fe8f-49ec-93f7-f222e5223868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 204 len: 0 microversion: 2.1 time: 0.119093 Aug 09 18:24:17.756490 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4042/7093] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:24:17 2022] DELETE /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:24:17.765870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c2e6b831-126e-48d6-852e-686e19a80627 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:17.766632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c2e6b831-126e-48d6-852e-686e19a80627 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:17.774779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2e6b831-126e-48d6-852e-686e19a80627 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:17.775281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2e6b831-126e-48d6-852e-686e19a80627 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:17.775834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2e6b831-126e-48d6-852e-686e19a80627 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:17.776750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2e6b831-126e-48d6-852e-686e19a80627 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:17.777261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2e6b831-126e-48d6-852e-686e19a80627 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:17.777667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c2e6b831-126e-48d6-852e-686e19a80627 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:17.917543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c2e6b831-126e-48d6-852e-686e19a80627 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:17.925385 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c2e6b831-126e-48d6-852e-686e19a80627 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1553 microversion: 2.1 time: 0.163767 Aug 09 18:24:17.925963 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4043/7094] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:17 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:18.946694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-891d71db-1f2f-47fd-80e8-cddcca799b81 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:18.947439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-891d71db-1f2f-47fd-80e8-cddcca799b81 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:18.954970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-891d71db-1f2f-47fd-80e8-cddcca799b81 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:18.955463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-891d71db-1f2f-47fd-80e8-cddcca799b81 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:18.955942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-891d71db-1f2f-47fd-80e8-cddcca799b81 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:18.956656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-891d71db-1f2f-47fd-80e8-cddcca799b81 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:18.957108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-891d71db-1f2f-47fd-80e8-cddcca799b81 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:18.957559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-891d71db-1f2f-47fd-80e8-cddcca799b81 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:19.092538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-891d71db-1f2f-47fd-80e8-cddcca799b81 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:19.101244 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-891d71db-1f2f-47fd-80e8-cddcca799b81 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1553 microversion: 2.1 time: 0.158334 Aug 09 18:24:19.101832 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4044/7095] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:18 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:20.124406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6bc3893c-3b51-4f6f-98ad-e42e2f995c72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:20.125141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6bc3893c-3b51-4f6f-98ad-e42e2f995c72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:20.132384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bc3893c-3b51-4f6f-98ad-e42e2f995c72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:20.133134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bc3893c-3b51-4f6f-98ad-e42e2f995c72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:20.133581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bc3893c-3b51-4f6f-98ad-e42e2f995c72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:20.134291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bc3893c-3b51-4f6f-98ad-e42e2f995c72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:20.134800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bc3893c-3b51-4f6f-98ad-e42e2f995c72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:20.135242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6bc3893c-3b51-4f6f-98ad-e42e2f995c72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:20.208325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6bc3893c-3b51-4f6f-98ad-e42e2f995c72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:20.216638 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6bc3893c-3b51-4f6f-98ad-e42e2f995c72 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 200 len: 1511 microversion: 2.1 time: 0.096883 Aug 09 18:24:20.217317 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4045/7096] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:20 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 1511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:20.282429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-65167ca0-4d86-4ab2-90b2-82c51c476ee2 req-7fb7553a-a0ff-4527-8629-24d1b2a7a610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe869a65-216b-4646-a12d-17d4c5a1ba24", "name": "network-vif-deleted", "tag": "402e8e68-5ede-4728-9398-89ff9a8b022e"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:20.291958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-65167ca0-4d86-4ab2-90b2-82c51c476ee2 req-7fb7553a-a0ff-4527-8629-24d1b2a7a610 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:20.292443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-65167ca0-4d86-4ab2-90b2-82c51c476ee2 req-7fb7553a-a0ff-4527-8629-24d1b2a7a610 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:20.292877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-65167ca0-4d86-4ab2-90b2-82c51c476ee2 req-7fb7553a-a0ff-4527-8629-24d1b2a7a610 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:20.303562 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-65167ca0-4d86-4ab2-90b2-82c51c476ee2 req-7fb7553a-a0ff-4527-8629-24d1b2a7a610 service nova] Creating event network-vif-deleted:402e8e68-5ede-4728-9398-89ff9a8b022e for instance fe869a65-216b-4646-a12d-17d4c5a1ba24 on n-h1-845781-6 Aug 09 18:24:20.308414 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-65167ca0-4d86-4ab2-90b2-82c51c476ee2 req-7fb7553a-a0ff-4527-8629-24d1b2a7a610 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089769 Aug 09 18:24:20.309004 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4046/7097] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:24:21.240872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:21.241609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: fe869a65-216b-4646-a12d-17d4c5a1ba24] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:21.248466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:21.248973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:21.249423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:21.250129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:21.250595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:21.251035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:21.266560 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] HTTP exception thrown: Instance fe869a65-216b-4646-a12d-17d4c5a1ba24 could not be found. Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Request method failure captured: Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 HTTP/1.1 Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qVdrpEwRAeuR_j4IS2j7B62lG7_B4iYuln6Z5hN0oZ3bVshsK7VgfkXcjBfxWfJfv-aRi9V4R3evTmdY7Y4p79akAld91--m63VZYgC852aOf49JpSGJjKew3v55MhriOaQLxTTQn_h-qrCDTtXGdfBjId21qP04bAbCuO3i2BKhKI Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 7b5be7db51a74cd6989217c54c986970 Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7b5be7db51a74cd6989217c54c986970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 7b5be7db51a74cd6989217c54c986970 Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestMinimumBasicScenario-1283421594-project Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: f960eb217f0c41a6ba6c0e5c0241b200 Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestMinimumBasicScenario-1283421594-project Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance fe869a65-216b-4646-a12d-17d4c5a1ba24 could not be found. Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'fe869a65-216b-4646-a12d-17d4c5a1ba24'} Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe869a65-216b-4646-a12d-17d4c5a1ba24 could not be found. Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe869a65-216b-4646-a12d-17d4c5a1ba24 could not be found. Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:24:21.268288 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:24:21.276423 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:24:21.276423 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:24:21.276423 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:24:21.276423 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:24:21.276423 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:24:21.276423 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe869a65-216b-4646-a12d-17d4c5a1ba24 could not be found. Aug 09 18:24:21.276423 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:24:21.276423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Returning 404 to user: Instance fe869a65-216b-4646-a12d-17d4c5a1ba24 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:24:21.276423 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6dcf15e-6e42-4d35-aaae-315cd60b5e60 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24" status: 404 len: 111 microversion: 2.1 time: 0.034842 Aug 09 18:24:21.276423 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4047/7098] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:21 2022] GET /compute/v2.1/servers/fe869a65-216b-4646-a12d-17d4c5a1ba24 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:24:21.279838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8125ed52-ca40-439d-b373-e133f9a6d17a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '.version_select at 0x7fbbcaf73790>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:21.300986 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8125ed52-ca40-439d-b373-e133f9a6d17a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1857371955" status: 202 len: 0 microversion: 2.1 time: 0.024843 Aug 09 18:24:21.301578 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4048/7099] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 18:24:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1857371955 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:24:30.511573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d6f9f3cf-2522-46f8-8981-c2d52bc43ef8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'create', calling method: .version_select at 0x7fbbca5a19d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1102372919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMFDLdLQTRWDBMUNdlfUx4LF4TecKFrjCu23IOPmPlwIODcHykShgvdeO7CcqWsNC7vBjXjsYjllrqUwfEWM6Qz1obqH3eTzrjfGfbyy7wAI9iFhNdjeBqRQ6xU/V7nIw=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:30.530915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-d6f9f3cf-2522-46f8-8981-c2d52bc43ef8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Getting quotas for project 7b5be7db51a74cd6989217c54c986970. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:24:30.536094 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-d6f9f3cf-2522-46f8-8981-c2d52bc43ef8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Getting quotas for user f960eb217f0c41a6ba6c0e5c0241b200 and project 7b5be7db51a74cd6989217c54c986970. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:24:30.560454 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d6f9f3cf-2522-46f8-8981-c2d52bc43ef8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054533 Aug 09 18:24:30.561074 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4049/7100] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:24:30 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:24:30.610618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1196975059", "imageRef": "549b4e67-84b9-461d-be3c-b8c26d2a0d00", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1102372919", "networks": [{"uuid": "54deb255-723b-4e52-b516-e87baf1800ff"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:30.661365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] validate_networks() for [('54deb255-723b-4e52-b516-e87baf1800ff', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:24:31.114656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:24:31.115081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:24:31.115558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:24:31.115998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:24:31.116408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:24:31.125320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:31.125799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:31.126234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:31.126955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:31.127406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:31.127861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:31.135563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:31.148725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Getting quotas for project 7b5be7db51a74cd6989217c54c986970. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:24:31.155401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Getting quotas for user f960eb217f0c41a6ba6c0e5c0241b200 and project 7b5be7db51a74cd6989217c54c986970. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:24:31.169790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:24:31.172079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='549b4e67-84b9-461d-be3c-b8c26d2a0d00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:24:31.219420 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d696a664-8be0-466c-8408-6c6591391556 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612583 Aug 09 18:24:31.220113 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4050/7101] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:24:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:24:31.232037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aa9bae3b-1385-4e06-b466-c1c2e4fa3d62 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:31.232667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aa9bae3b-1385-4e06-b466-c1c2e4fa3d62 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:31.288397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aa9bae3b-1385-4e06-b466-c1c2e4fa3d62 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:31.296068 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aa9bae3b-1385-4e06-b466-c1c2e4fa3d62 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1259 microversion: 2.1 time: 0.068432 Aug 09 18:24:31.296763 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4051/7102] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:31 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:32.316543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67880e8b-52ea-497a-96df-2f4acda679f9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:32.317190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-67880e8b-52ea-497a-96df-2f4acda679f9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:32.373573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-67880e8b-52ea-497a-96df-2f4acda679f9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:32.380329 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-67880e8b-52ea-497a-96df-2f4acda679f9 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1259 microversion: 2.1 time: 0.067562 Aug 09 18:24:32.380888 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4052/7103] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:32 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:33.401275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1062d3cd-7879-4033-b846-363287398b9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:33.402043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1062d3cd-7879-4033-b846-363287398b9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:33.460731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1062d3cd-7879-4033-b846-363287398b9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:33.468103 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1062d3cd-7879-4033-b846-363287398b9c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1259 microversion: 2.1 time: 0.070651 Aug 09 18:24:33.468952 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4053/7104] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:33 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:34.488810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6bb00d17-eb93-45a4-a8ad-33741bbc4758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:34.489460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6bb00d17-eb93-45a4-a8ad-33741bbc4758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:34.544846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6bb00d17-eb93-45a4-a8ad-33741bbc4758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:34.552148 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6bb00d17-eb93-45a4-a8ad-33741bbc4758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1259 microversion: 2.1 time: 0.067160 Aug 09 18:24:34.552739 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4054/7105] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:34 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:35.571983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-480bb339-7c56-41a9-8c15-b1cd0f43a356 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:35.572663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-480bb339-7c56-41a9-8c15-b1cd0f43a356 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:35.579479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bb339-7c56-41a9-8c15-b1cd0f43a356 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:35.579996 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bb339-7c56-41a9-8c15-b1cd0f43a356 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:35.580433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bb339-7c56-41a9-8c15-b1cd0f43a356 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:35.581129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bb339-7c56-41a9-8c15-b1cd0f43a356 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:35.581584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bb339-7c56-41a9-8c15-b1cd0f43a356 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:35.582012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-480bb339-7c56-41a9-8c15-b1cd0f43a356 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:35.645659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-480bb339-7c56-41a9-8c15-b1cd0f43a356 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:35.653898 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-480bb339-7c56-41a9-8c15-b1cd0f43a356 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1263 microversion: 2.1 time: 0.085731 Aug 09 18:24:35.654489 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4055/7106] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:35 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1263 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:36.675404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3119f070-d1f4-4e8d-a803-352572a58ad0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:36.676211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3119f070-d1f4-4e8d-a803-352572a58ad0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:36.688213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3119f070-d1f4-4e8d-a803-352572a58ad0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:36.691008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3119f070-d1f4-4e8d-a803-352572a58ad0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:36.692874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3119f070-d1f4-4e8d-a803-352572a58ad0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:36.693933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3119f070-d1f4-4e8d-a803-352572a58ad0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:36.695695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3119f070-d1f4-4e8d-a803-352572a58ad0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:36.696469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3119f070-d1f4-4e8d-a803-352572a58ad0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:36.932841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3119f070-d1f4-4e8d-a803-352572a58ad0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:36.942151 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3119f070-d1f4-4e8d-a803-352572a58ad0 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1317 microversion: 2.1 time: 0.270784 Aug 09 18:24:36.948068 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4056/7107] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:36 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:37.978923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2b255017-2e50-492b-b8c9-62d767625b22 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:37.979654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2b255017-2e50-492b-b8c9-62d767625b22 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:37.982674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:37.990095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b255017-2e50-492b-b8c9-62d767625b22 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:37.990730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b255017-2e50-492b-b8c9-62d767625b22 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:37.991178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b255017-2e50-492b-b8c9-62d767625b22 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:37.991931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b255017-2e50-492b-b8c9-62d767625b22 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:37.992403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b255017-2e50-492b-b8c9-62d767625b22 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:37.992838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b255017-2e50-492b-b8c9-62d767625b22 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:38.151331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2b255017-2e50-492b-b8c9-62d767625b22 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:38.159179 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2b255017-2e50-492b-b8c9-62d767625b22 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.184165 Aug 09 18:24:38.159785 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4057/7108] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:37 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:39.182072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5e6859e6-2570-4d12-a09e-76c9659f4219 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:39.183051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5e6859e6-2570-4d12-a09e-76c9659f4219 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:39.190519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6859e6-2570-4d12-a09e-76c9659f4219 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:39.191111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6859e6-2570-4d12-a09e-76c9659f4219 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:39.191679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6859e6-2570-4d12-a09e-76c9659f4219 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:39.192478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6859e6-2570-4d12-a09e-76c9659f4219 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:39.193015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6859e6-2570-4d12-a09e-76c9659f4219 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:39.193704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5e6859e6-2570-4d12-a09e-76c9659f4219 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:39.370750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5e6859e6-2570-4d12-a09e-76c9659f4219 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:39.389203 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5e6859e6-2570-4d12-a09e-76c9659f4219 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.211941 Aug 09 18:24:39.396378 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4058/7109] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:39 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:40.414122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0b0e34f5-52b8-4f5a-9837-c68b0625c779 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:40.414836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0b0e34f5-52b8-4f5a-9837-c68b0625c779 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:40.423960 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b0e34f5-52b8-4f5a-9837-c68b0625c779 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:40.424530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b0e34f5-52b8-4f5a-9837-c68b0625c779 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:40.425058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b0e34f5-52b8-4f5a-9837-c68b0625c779 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:40.425871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b0e34f5-52b8-4f5a-9837-c68b0625c779 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:40.426298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b0e34f5-52b8-4f5a-9837-c68b0625c779 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:40.426717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0b0e34f5-52b8-4f5a-9837-c68b0625c779 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:40.573079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0b0e34f5-52b8-4f5a-9837-c68b0625c779 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:40.582409 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0b0e34f5-52b8-4f5a-9837-c68b0625c779 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.172941 Aug 09 18:24:40.583659 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4059/7110] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:40 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:41.604846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-536bb0d9-8713-46aa-b742-5f154c178657 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:41.605573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-536bb0d9-8713-46aa-b742-5f154c178657 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:41.607345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:41.613644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536bb0d9-8713-46aa-b742-5f154c178657 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:41.614136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536bb0d9-8713-46aa-b742-5f154c178657 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:41.614578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536bb0d9-8713-46aa-b742-5f154c178657 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:41.615283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536bb0d9-8713-46aa-b742-5f154c178657 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:41.615769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536bb0d9-8713-46aa-b742-5f154c178657 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:41.616200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-536bb0d9-8713-46aa-b742-5f154c178657 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:41.782789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-536bb0d9-8713-46aa-b742-5f154c178657 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:41.794705 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-536bb0d9-8713-46aa-b742-5f154c178657 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.194210 Aug 09 18:24:41.795487 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4060/7111] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:41 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:42.816251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-564de1dd-0ebc-4778-b600-5f2345ad5717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:42.817074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-564de1dd-0ebc-4778-b600-5f2345ad5717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:42.824624 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-564de1dd-0ebc-4778-b600-5f2345ad5717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:42.825129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-564de1dd-0ebc-4778-b600-5f2345ad5717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:42.825578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-564de1dd-0ebc-4778-b600-5f2345ad5717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:42.826299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-564de1dd-0ebc-4778-b600-5f2345ad5717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:42.826758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-564de1dd-0ebc-4778-b600-5f2345ad5717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:42.827197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-564de1dd-0ebc-4778-b600-5f2345ad5717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:42.978995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-564de1dd-0ebc-4778-b600-5f2345ad5717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:42.986980 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-564de1dd-0ebc-4778-b600-5f2345ad5717 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.174632 Aug 09 18:24:42.987861 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4061/7112] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:42 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:44.008791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c9fc34e2-5b2f-451d-99e0-aa5f79eb54da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:44.009517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c9fc34e2-5b2f-451d-99e0-aa5f79eb54da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:44.016576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9fc34e2-5b2f-451d-99e0-aa5f79eb54da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:44.017080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9fc34e2-5b2f-451d-99e0-aa5f79eb54da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:44.017526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9fc34e2-5b2f-451d-99e0-aa5f79eb54da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:44.018241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9fc34e2-5b2f-451d-99e0-aa5f79eb54da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:44.018737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9fc34e2-5b2f-451d-99e0-aa5f79eb54da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:44.019206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c9fc34e2-5b2f-451d-99e0-aa5f79eb54da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:44.162408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c9fc34e2-5b2f-451d-99e0-aa5f79eb54da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:44.170537 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c9fc34e2-5b2f-451d-99e0-aa5f79eb54da tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.165977 Aug 09 18:24:44.171173 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4062/7113] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:44 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:44.923265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-84dff604-8f3f-4196-86fc-edf37f10d461 req-360e9a72-39e4-44ac-9471-36a54a8edacb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa97f80-5614-4c19-b15e-ed39d0209004", "tag": "920e45f6-4bd5-42f6-b711-d560926d3d9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:44.929804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=18 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:44.942974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-84dff604-8f3f-4196-86fc-edf37f10d461 req-360e9a72-39e4-44ac-9471-36a54a8edacb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:44.943520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-84dff604-8f3f-4196-86fc-edf37f10d461 req-360e9a72-39e4-44ac-9471-36a54a8edacb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:44.944171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-84dff604-8f3f-4196-86fc-edf37f10d461 req-360e9a72-39e4-44ac-9471-36a54a8edacb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:44.957483 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-84dff604-8f3f-4196-86fc-edf37f10d461 req-360e9a72-39e4-44ac-9471-36a54a8edacb service nova] Creating event network-changed:920e45f6-4bd5-42f6-b711-d560926d3d9a for instance bfa97f80-5614-4c19-b15e-ed39d0209004 on n-h2-845781-6 Aug 09 18:24:44.963578 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-84dff604-8f3f-4196-86fc-edf37f10d461 req-360e9a72-39e4-44ac-9471-36a54a8edacb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044108 Aug 09 18:24:44.964225 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4063/7114] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:24:45.193057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c27facc-f5a3-41fe-9c2d-3b7d6f761b52 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:45.193850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c27facc-f5a3-41fe-9c2d-3b7d6f761b52 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:45.202254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c27facc-f5a3-41fe-9c2d-3b7d6f761b52 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:45.202757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c27facc-f5a3-41fe-9c2d-3b7d6f761b52 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:45.203201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c27facc-f5a3-41fe-9c2d-3b7d6f761b52 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:45.203945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c27facc-f5a3-41fe-9c2d-3b7d6f761b52 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:45.204399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c27facc-f5a3-41fe-9c2d-3b7d6f761b52 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:45.204825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c27facc-f5a3-41fe-9c2d-3b7d6f761b52 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:45.432633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c27facc-f5a3-41fe-9c2d-3b7d6f761b52 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:45.440638 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c27facc-f5a3-41fe-9c2d-3b7d6f761b52 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.252178 Aug 09 18:24:45.441245 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4064/7115] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:45 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:46.463443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c93c1200-1f2e-40c7-8de1-a9a21a61997b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:46.464323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c93c1200-1f2e-40c7-8de1-a9a21a61997b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:46.471682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93c1200-1f2e-40c7-8de1-a9a21a61997b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:46.472186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93c1200-1f2e-40c7-8de1-a9a21a61997b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:46.472634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93c1200-1f2e-40c7-8de1-a9a21a61997b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:46.473353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93c1200-1f2e-40c7-8de1-a9a21a61997b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:46.473819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93c1200-1f2e-40c7-8de1-a9a21a61997b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:46.474256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c93c1200-1f2e-40c7-8de1-a9a21a61997b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:46.701818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c93c1200-1f2e-40c7-8de1-a9a21a61997b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:46.710050 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c93c1200-1f2e-40c7-8de1-a9a21a61997b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.251376 Aug 09 18:24:46.710859 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4065/7116] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:46 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:47.737179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c898b2a-88aa-4b0c-a73a-c36bd1ae9920 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:47.737876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c898b2a-88aa-4b0c-a73a-c36bd1ae9920 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:47.745071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c898b2a-88aa-4b0c-a73a-c36bd1ae9920 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:47.745551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c898b2a-88aa-4b0c-a73a-c36bd1ae9920 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:47.745990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c898b2a-88aa-4b0c-a73a-c36bd1ae9920 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:47.746678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c898b2a-88aa-4b0c-a73a-c36bd1ae9920 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:47.747132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c898b2a-88aa-4b0c-a73a-c36bd1ae9920 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:47.747555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c898b2a-88aa-4b0c-a73a-c36bd1ae9920 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:47.886327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5c898b2a-88aa-4b0c-a73a-c36bd1ae9920 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:47.893906 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c898b2a-88aa-4b0c-a73a-c36bd1ae9920 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.160600 Aug 09 18:24:47.894492 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4066/7117] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:47 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:48.914610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a66b0b6-3ef1-46b3-a5d9-98403648c067 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:48.915354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a66b0b6-3ef1-46b3-a5d9-98403648c067 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:48.922725 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a66b0b6-3ef1-46b3-a5d9-98403648c067 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:48.923202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a66b0b6-3ef1-46b3-a5d9-98403648c067 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:48.923656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a66b0b6-3ef1-46b3-a5d9-98403648c067 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:48.924353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a66b0b6-3ef1-46b3-a5d9-98403648c067 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:48.924809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a66b0b6-3ef1-46b3-a5d9-98403648c067 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:48.925233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a66b0b6-3ef1-46b3-a5d9-98403648c067 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:49.062344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4a66b0b6-3ef1-46b3-a5d9-98403648c067 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:49.069848 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a66b0b6-3ef1-46b3-a5d9-98403648c067 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.159214 Aug 09 18:24:49.070437 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4067/7118] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:48 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:50.090418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f5bb0bc6-0215-4943-b499-8ed781851efa tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:50.091079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f5bb0bc6-0215-4943-b499-8ed781851efa tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:50.098445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5bb0bc6-0215-4943-b499-8ed781851efa tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:50.098941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5bb0bc6-0215-4943-b499-8ed781851efa tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:50.099385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5bb0bc6-0215-4943-b499-8ed781851efa tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:50.100104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5bb0bc6-0215-4943-b499-8ed781851efa tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:50.100560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5bb0bc6-0215-4943-b499-8ed781851efa tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:50.100989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f5bb0bc6-0215-4943-b499-8ed781851efa tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:50.238241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f5bb0bc6-0215-4943-b499-8ed781851efa tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:50.246965 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f5bb0bc6-0215-4943-b499-8ed781851efa tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.160380 Aug 09 18:24:50.247566 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4068/7119] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:50 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:51.268914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11ac9f60-b30f-4444-a1a3-57627863c762 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:51.269613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-11ac9f60-b30f-4444-a1a3-57627863c762 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:51.276198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ac9f60-b30f-4444-a1a3-57627863c762 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:51.276693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ac9f60-b30f-4444-a1a3-57627863c762 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:51.277137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ac9f60-b30f-4444-a1a3-57627863c762 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:51.277845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ac9f60-b30f-4444-a1a3-57627863c762 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:51.278305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ac9f60-b30f-4444-a1a3-57627863c762 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:51.278738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11ac9f60-b30f-4444-a1a3-57627863c762 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:51.412242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-11ac9f60-b30f-4444-a1a3-57627863c762 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:51.420044 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11ac9f60-b30f-4444-a1a3-57627863c762 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.155159 Aug 09 18:24:51.420642 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4069/7120] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:51 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:24:51.481576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-051ba81a-de45-4ded-b9f3-264e150f3a9e req-91d8cf9c-0cc4-40e7-97f6-9648f286c91d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa97f80-5614-4c19-b15e-ed39d0209004", "name": "network-vif-plugged", "status": "completed", "tag": "920e45f6-4bd5-42f6-b711-d560926d3d9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:51.491061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-051ba81a-de45-4ded-b9f3-264e150f3a9e req-91d8cf9c-0cc4-40e7-97f6-9648f286c91d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:51.491540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-051ba81a-de45-4ded-b9f3-264e150f3a9e req-91d8cf9c-0cc4-40e7-97f6-9648f286c91d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:51.492008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-051ba81a-de45-4ded-b9f3-264e150f3a9e req-91d8cf9c-0cc4-40e7-97f6-9648f286c91d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:51.503134 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-051ba81a-de45-4ded-b9f3-264e150f3a9e req-91d8cf9c-0cc4-40e7-97f6-9648f286c91d service nova] Creating event network-vif-plugged:920e45f6-4bd5-42f6-b711-d560926d3d9a for instance bfa97f80-5614-4c19-b15e-ed39d0209004 on n-h2-845781-6 Aug 09 18:24:51.508398 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-051ba81a-de45-4ded-b9f3-264e150f3a9e req-91d8cf9c-0cc4-40e7-97f6-9648f286c91d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086465 Aug 09 18:24:51.508906 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4070/7121] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:24:52.441977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6f5a305-f789-488d-aa85-716d73eade08 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:52.442667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b6f5a305-f789-488d-aa85-716d73eade08 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:52.449884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f5a305-f789-488d-aa85-716d73eade08 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:52.450374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f5a305-f789-488d-aa85-716d73eade08 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:52.450818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f5a305-f789-488d-aa85-716d73eade08 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:52.451517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f5a305-f789-488d-aa85-716d73eade08 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:52.452011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f5a305-f789-488d-aa85-716d73eade08 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:52.452444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f5a305-f789-488d-aa85-716d73eade08 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:52.589467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b6f5a305-f789-488d-aa85-716d73eade08 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:52.597519 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6f5a305-f789-488d-aa85-716d73eade08 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1359 microversion: 2.1 time: 0.159793 Aug 09 18:24:52.598107 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4071/7122] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:52 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:53.618954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0179f6da-47ed-4e63-876f-07bd2328b278 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:53.619650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0179f6da-47ed-4e63-876f-07bd2328b278 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:53.627117 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0179f6da-47ed-4e63-876f-07bd2328b278 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:53.627600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0179f6da-47ed-4e63-876f-07bd2328b278 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:53.628079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0179f6da-47ed-4e63-876f-07bd2328b278 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:53.628771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0179f6da-47ed-4e63-876f-07bd2328b278 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:53.629220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0179f6da-47ed-4e63-876f-07bd2328b278 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:53.629643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0179f6da-47ed-4e63-876f-07bd2328b278 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:53.765371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0179f6da-47ed-4e63-876f-07bd2328b278 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:53.770371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:24:53.775897 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0179f6da-47ed-4e63-876f-07bd2328b278 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1548 microversion: 2.1 time: 0.160784 Aug 09 18:24:53.777037 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4072/7123] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:53 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:53.799526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-262c28f9-b450-43f7-8b01-30d1fa27b1d1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:53.800326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-262c28f9-b450-43f7-8b01-30d1fa27b1d1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:53.806746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-262c28f9-b450-43f7-8b01-30d1fa27b1d1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:53.807299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-262c28f9-b450-43f7-8b01-30d1fa27b1d1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:53.807774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-262c28f9-b450-43f7-8b01-30d1fa27b1d1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:53.808480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-262c28f9-b450-43f7-8b01-30d1fa27b1d1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:53.808934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-262c28f9-b450-43f7-8b01-30d1fa27b1d1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:53.809367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-262c28f9-b450-43f7-8b01-30d1fa27b1d1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:53.942010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-262c28f9-b450-43f7-8b01-30d1fa27b1d1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:53.950281 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-262c28f9-b450-43f7-8b01-30d1fa27b1d1 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1548 microversion: 2.1 time: 0.155476 Aug 09 18:24:53.950867 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4073/7124] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:53 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:53.970385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ccf7a84-3b9f-48ae-beea-c561472ea146 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:53.975091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7ccf7a84-3b9f-48ae-beea-c561472ea146 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:53.975895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7ccf7a84-3b9f-48ae-beea-c561472ea146 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Searching by: {'deleted': False, 'project_id': '7b5be7db51a74cd6989217c54c986970'} {{(pid=119431) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 18:24:53.981170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ccf7a84-3b9f-48ae-beea-c561472ea146 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:53.981656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ccf7a84-3b9f-48ae-beea-c561472ea146 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:53.982110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ccf7a84-3b9f-48ae-beea-c561472ea146 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:53.982872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ccf7a84-3b9f-48ae-beea-c561472ea146 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:53.983333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ccf7a84-3b9f-48ae-beea-c561472ea146 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:53.983794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ccf7a84-3b9f-48ae-beea-c561472ea146 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:54.007235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.multi_cell_list [None req-7ccf7a84-3b9f-48ae-beea-c561472ea146 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 18:24:54.035070 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ccf7a84-3b9f-48ae-beea-c561472ea146 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068463 Aug 09 18:24:54.035586 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4074/7125] 10.222.0.93 () {58 vars in 1125 bytes} [Tue Aug 9 18:24:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:24:54.046538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-234161dc-6afb-4924-9309-cd4da50984d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:24:54.047160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-234161dc-6afb-4924-9309-cd4da50984d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:54.053005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234161dc-6afb-4924-9309-cd4da50984d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:54.053503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234161dc-6afb-4924-9309-cd4da50984d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:54.053953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234161dc-6afb-4924-9309-cd4da50984d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:54.054653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234161dc-6afb-4924-9309-cd4da50984d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:54.055112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234161dc-6afb-4924-9309-cd4da50984d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:54.055547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-234161dc-6afb-4924-9309-cd4da50984d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:54.189764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-234161dc-6afb-4924-9309-cd4da50984d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:24:54.197340 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-234161dc-6afb-4924-9309-cd4da50984d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1548 microversion: 2.1 time: 0.154373 Aug 09 18:24:54.197970 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4075/7126] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:24:54 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:24:56.781478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-54539b51-d96b-41c3-8d46-777990a75995 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7505000f-a4dd-4e82-ab3c-4f527e456551"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:24:56.784048 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-54539b51-d96b-41c3-8d46-777990a75995 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:24:56.791134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54539b51-d96b-41c3-8d46-777990a75995 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:56.792187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54539b51-d96b-41c3-8d46-777990a75995 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:56.792629 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54539b51-d96b-41c3-8d46-777990a75995 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:56.793355 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54539b51-d96b-41c3-8d46-777990a75995 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:24:56.793830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54539b51-d96b-41c3-8d46-777990a75995 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:24:56.794255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-54539b51-d96b-41c3-8d46-777990a75995 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:24:57.038044 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-54539b51-d96b-41c3-8d46-777990a75995 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260845 Aug 09 18:24:57.038694 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4076/7127] 10.222.0.93 () {60 vars in 1323 bytes} [Tue Aug 9 18:24:56 2022] POST /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:25:07.856977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:07.857829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=39 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:07.859199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:07.863256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4f41ec8e-80c3-4196-82da-5176b750bb42 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:07.864064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4f41ec8e-80c3-4196-82da-5176b750bb42 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:07.873974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f41ec8e-80c3-4196-82da-5176b750bb42 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:07.874479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f41ec8e-80c3-4196-82da-5176b750bb42 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:07.874921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f41ec8e-80c3-4196-82da-5176b750bb42 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:07.875664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f41ec8e-80c3-4196-82da-5176b750bb42 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:07.876130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f41ec8e-80c3-4196-82da-5176b750bb42 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:07.876563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f41ec8e-80c3-4196-82da-5176b750bb42 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:08.032329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4f41ec8e-80c3-4196-82da-5176b750bb42 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:08.041330 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4f41ec8e-80c3-4196-82da-5176b750bb42 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1594 microversion: 2.1 time: 0.186287 Aug 09 18:25:08.042467 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4077/7128] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:07 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1594 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:09.960089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-97fb0d9b-d8f2-4e04-82d5-edbdce9c2293 req-dc9bee97-4ae4-454d-b1ba-5a958bb114e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa97f80-5614-4c19-b15e-ed39d0209004", "tag": "920e45f6-4bd5-42f6-b711-d560926d3d9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:09.980811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97fb0d9b-d8f2-4e04-82d5-edbdce9c2293 req-dc9bee97-4ae4-454d-b1ba-5a958bb114e1 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:09.982343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97fb0d9b-d8f2-4e04-82d5-edbdce9c2293 req-dc9bee97-4ae4-454d-b1ba-5a958bb114e1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:09.983775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-97fb0d9b-d8f2-4e04-82d5-edbdce9c2293 req-dc9bee97-4ae4-454d-b1ba-5a958bb114e1 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:10.002138 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-97fb0d9b-d8f2-4e04-82d5-edbdce9c2293 req-dc9bee97-4ae4-454d-b1ba-5a958bb114e1 service nova] Creating event network-changed:920e45f6-4bd5-42f6-b711-d560926d3d9a for instance bfa97f80-5614-4c19-b15e-ed39d0209004 on n-h2-845781-6 Aug 09 18:25:10.008466 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-97fb0d9b-d8f2-4e04-82d5-edbdce9c2293 req-dc9bee97-4ae4-454d-b1ba-5a958bb114e1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054526 Aug 09 18:25:10.009314 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4078/7129] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:25:11.861847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c71c97b6-efab-4904-aba8-238f4120173a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-590413616"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:11.863092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c71c97b6-efab-4904-aba8-238f4120173a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:11.870220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71c97b6-efab-4904-aba8-238f4120173a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:11.870727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71c97b6-efab-4904-aba8-238f4120173a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:11.871176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71c97b6-efab-4904-aba8-238f4120173a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:11.871941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71c97b6-efab-4904-aba8-238f4120173a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:11.872408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71c97b6-efab-4904-aba8-238f4120173a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:11.872845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c71c97b6-efab-4904-aba8-238f4120173a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:12.017702 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.network.security_group_api [None req-c71c97b6-efab-4904-aba8-238f4120173a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Adding security group 1a1ca960-31e9-48b3-972a-1a9d38630927 to port 920e45f6-4bd5-42f6-b711-d560926d3d9a Aug 09 18:25:12.428467 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c71c97b6-efab-4904-aba8-238f4120173a tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/action" status: 202 len: 0 microversion: 2.1 time: 0.572609 Aug 09 18:25:12.430077 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4079/7130] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:25:11 2022] POST /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:25:12.442590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-17be21fe-b13e-4be9-a291-3f7896a966ae tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:12.444237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-17be21fe-b13e-4be9-a291-3f7896a966ae tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:12.452859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17be21fe-b13e-4be9-a291-3f7896a966ae tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:12.453891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17be21fe-b13e-4be9-a291-3f7896a966ae tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:12.454745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17be21fe-b13e-4be9-a291-3f7896a966ae tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:12.455973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17be21fe-b13e-4be9-a291-3f7896a966ae tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:12.456702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17be21fe-b13e-4be9-a291-3f7896a966ae tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:12.457361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-17be21fe-b13e-4be9-a291-3f7896a966ae tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:12.659440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-17be21fe-b13e-4be9-a291-3f7896a966ae tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:12.670990 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-17be21fe-b13e-4be9-a291-3f7896a966ae tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1758 microversion: 2.1 time: 0.234724 Aug 09 18:25:12.671791 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4080/7131] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:12 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1758 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:12.677941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-4f81d04d-ec22-47f8-b693-3714f7572a7b req-2543fe9d-d844-4cb6-a573-165280fd9c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa97f80-5614-4c19-b15e-ed39d0209004", "tag": "920e45f6-4bd5-42f6-b711-d560926d3d9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:12.688350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4f81d04d-ec22-47f8-b693-3714f7572a7b req-2543fe9d-d844-4cb6-a573-165280fd9c91 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:12.688827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4f81d04d-ec22-47f8-b693-3714f7572a7b req-2543fe9d-d844-4cb6-a573-165280fd9c91 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:12.689550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-4f81d04d-ec22-47f8-b693-3714f7572a7b req-2543fe9d-d844-4cb6-a573-165280fd9c91 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:12.719195 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-4f81d04d-ec22-47f8-b693-3714f7572a7b req-2543fe9d-d844-4cb6-a573-165280fd9c91 service nova] Creating event network-changed:920e45f6-4bd5-42f6-b711-d560926d3d9a for instance bfa97f80-5614-4c19-b15e-ed39d0209004 on n-h2-845781-6 Aug 09 18:25:12.733851 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-4f81d04d-ec22-47f8-b693-3714f7572a7b req-2543fe9d-d844-4cb6-a573-165280fd9c91 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058381 Aug 09 18:25:12.734445 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4081/7132] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:25:28.135137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:28.136461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=20 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:28.191441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2d58f098-5b6b-47c3-9002-25cdfb2ce2f3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:25:28.193953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2d58f098-5b6b-47c3-9002-25cdfb2ce2f3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:28.201179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d58f098-5b6b-47c3-9002-25cdfb2ce2f3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:28.201674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d58f098-5b6b-47c3-9002-25cdfb2ce2f3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:28.202144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d58f098-5b6b-47c3-9002-25cdfb2ce2f3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:28.202871 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d58f098-5b6b-47c3-9002-25cdfb2ce2f3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:28.203333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d58f098-5b6b-47c3-9002-25cdfb2ce2f3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:28.203799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d58f098-5b6b-47c3-9002-25cdfb2ce2f3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:28.283467 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2d58f098-5b6b-47c3-9002-25cdfb2ce2f3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/action" status: 202 len: 0 microversion: 2.1 time: 0.150189 Aug 09 18:25:28.284148 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4082/7133] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:25:28 2022] POST /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:25:28.298910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-630d2490-9589-4af4-b112-e69583ef32a6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:28.300173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-630d2490-9589-4af4-b112-e69583ef32a6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:28.310486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-630d2490-9589-4af4-b112-e69583ef32a6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:28.310984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-630d2490-9589-4af4-b112-e69583ef32a6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:28.311424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-630d2490-9589-4af4-b112-e69583ef32a6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:28.312210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-630d2490-9589-4af4-b112-e69583ef32a6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:28.312674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-630d2490-9589-4af4-b112-e69583ef32a6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:28.313105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-630d2490-9589-4af4-b112-e69583ef32a6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:28.602153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-630d2490-9589-4af4-b112-e69583ef32a6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:28.610734 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-630d2490-9589-4af4-b112-e69583ef32a6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1750 microversion: 2.1 time: 0.320350 Aug 09 18:25:28.611335 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4083/7134] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:28 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1750 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:29.633490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d53c6c78-a78a-4dc0-806f-c0d6436525e4 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:29.634385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d53c6c78-a78a-4dc0-806f-c0d6436525e4 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:29.641646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d53c6c78-a78a-4dc0-806f-c0d6436525e4 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:29.642261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d53c6c78-a78a-4dc0-806f-c0d6436525e4 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:29.642831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d53c6c78-a78a-4dc0-806f-c0d6436525e4 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:29.643515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d53c6c78-a78a-4dc0-806f-c0d6436525e4 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:29.644066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d53c6c78-a78a-4dc0-806f-c0d6436525e4 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:29.644504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d53c6c78-a78a-4dc0-806f-c0d6436525e4 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:29.825912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d53c6c78-a78a-4dc0-806f-c0d6436525e4 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:29.835013 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d53c6c78-a78a-4dc0-806f-c0d6436525e4 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.205296 Aug 09 18:25:29.835656 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4084/7135] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:29 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:30.868441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-16862ce5-e3fe-44e7-b0d2-356272410763 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:30.869278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-16862ce5-e3fe-44e7-b0d2-356272410763 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:30.876889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16862ce5-e3fe-44e7-b0d2-356272410763 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:30.877389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16862ce5-e3fe-44e7-b0d2-356272410763 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:30.877835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16862ce5-e3fe-44e7-b0d2-356272410763 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:30.878569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16862ce5-e3fe-44e7-b0d2-356272410763 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:30.879029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16862ce5-e3fe-44e7-b0d2-356272410763 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:30.879462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-16862ce5-e3fe-44e7-b0d2-356272410763 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:31.047360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-16862ce5-e3fe-44e7-b0d2-356272410763 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:31.055496 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-16862ce5-e3fe-44e7-b0d2-356272410763 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.191277 Aug 09 18:25:31.056102 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4085/7136] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:30 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:32.077670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4be97160-432f-4eef-966f-bb12a585e8ec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:32.078405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4be97160-432f-4eef-966f-bb12a585e8ec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:32.085836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be97160-432f-4eef-966f-bb12a585e8ec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:32.086333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be97160-432f-4eef-966f-bb12a585e8ec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:32.086777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be97160-432f-4eef-966f-bb12a585e8ec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:32.087495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be97160-432f-4eef-966f-bb12a585e8ec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:32.087984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be97160-432f-4eef-966f-bb12a585e8ec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:32.089008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4be97160-432f-4eef-966f-bb12a585e8ec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:32.256533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4be97160-432f-4eef-966f-bb12a585e8ec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:32.267036 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4be97160-432f-4eef-966f-bb12a585e8ec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.193321 Aug 09 18:25:32.267652 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4086/7137] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:32 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:33.289118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86447410-0c1c-4c8f-bb19-374ab5a6194c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:33.289848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-86447410-0c1c-4c8f-bb19-374ab5a6194c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:33.296927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86447410-0c1c-4c8f-bb19-374ab5a6194c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:33.297422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86447410-0c1c-4c8f-bb19-374ab5a6194c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:33.297868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86447410-0c1c-4c8f-bb19-374ab5a6194c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:33.298583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86447410-0c1c-4c8f-bb19-374ab5a6194c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:33.299040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86447410-0c1c-4c8f-bb19-374ab5a6194c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:33.299504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86447410-0c1c-4c8f-bb19-374ab5a6194c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:33.464022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86447410-0c1c-4c8f-bb19-374ab5a6194c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:33.472728 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86447410-0c1c-4c8f-bb19-374ab5a6194c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.187542 Aug 09 18:25:33.473314 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4087/7138] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:33 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:34.494152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e9a4611-ca45-48a5-b3d4-45b95dda226f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:34.495393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e9a4611-ca45-48a5-b3d4-45b95dda226f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:34.502465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9a4611-ca45-48a5-b3d4-45b95dda226f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:34.502933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9a4611-ca45-48a5-b3d4-45b95dda226f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:34.503384 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9a4611-ca45-48a5-b3d4-45b95dda226f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:34.504112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9a4611-ca45-48a5-b3d4-45b95dda226f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:34.504568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9a4611-ca45-48a5-b3d4-45b95dda226f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:34.505000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e9a4611-ca45-48a5-b3d4-45b95dda226f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:34.659479 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e9a4611-ca45-48a5-b3d4-45b95dda226f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:34.668162 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e9a4611-ca45-48a5-b3d4-45b95dda226f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.178052 Aug 09 18:25:34.668735 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4088/7139] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:34 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:35.689344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cb81e505-2e29-46ba-90b5-12c238a632d3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:35.690043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cb81e505-2e29-46ba-90b5-12c238a632d3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:35.697023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb81e505-2e29-46ba-90b5-12c238a632d3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:35.698172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb81e505-2e29-46ba-90b5-12c238a632d3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:35.698628 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb81e505-2e29-46ba-90b5-12c238a632d3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:35.699342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb81e505-2e29-46ba-90b5-12c238a632d3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:35.699839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb81e505-2e29-46ba-90b5-12c238a632d3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:35.700275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cb81e505-2e29-46ba-90b5-12c238a632d3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:35.848257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cb81e505-2e29-46ba-90b5-12c238a632d3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:35.856797 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cb81e505-2e29-46ba-90b5-12c238a632d3 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.171415 Aug 09 18:25:35.857374 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4089/7140] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:35 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:36.879591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-97780a10-6adf-45a2-98df-1a51cf416fec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:36.880415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-97780a10-6adf-45a2-98df-1a51cf416fec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:36.887935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97780a10-6adf-45a2-98df-1a51cf416fec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:36.888425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97780a10-6adf-45a2-98df-1a51cf416fec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:36.889358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97780a10-6adf-45a2-98df-1a51cf416fec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:36.889577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97780a10-6adf-45a2-98df-1a51cf416fec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:36.890037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97780a10-6adf-45a2-98df-1a51cf416fec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:36.890464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-97780a10-6adf-45a2-98df-1a51cf416fec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:37.041085 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-97780a10-6adf-45a2-98df-1a51cf416fec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:37.049120 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-97780a10-6adf-45a2-98df-1a51cf416fec tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.173517 Aug 09 18:25:37.049692 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4090/7141] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:36 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:38.074080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b98863d-73a5-4e42-9de5-b8e4e7fbde9f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:38.074773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b98863d-73a5-4e42-9de5-b8e4e7fbde9f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:38.083679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b98863d-73a5-4e42-9de5-b8e4e7fbde9f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:38.084179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b98863d-73a5-4e42-9de5-b8e4e7fbde9f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:38.084617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b98863d-73a5-4e42-9de5-b8e4e7fbde9f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:38.085359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b98863d-73a5-4e42-9de5-b8e4e7fbde9f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:38.085784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b98863d-73a5-4e42-9de5-b8e4e7fbde9f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:38.086217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b98863d-73a5-4e42-9de5-b8e4e7fbde9f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:38.243037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6b98863d-73a5-4e42-9de5-b8e4e7fbde9f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:38.251780 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b98863d-73a5-4e42-9de5-b8e4e7fbde9f tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.184764 Aug 09 18:25:38.252376 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4091/7142] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:38 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:25:39.273520 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0c7cc419-4b8e-4186-b18e-eda0de54e4d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:39.274186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0c7cc419-4b8e-4186-b18e-eda0de54e4d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:39.281179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c7cc419-4b8e-4186-b18e-eda0de54e4d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:39.281671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c7cc419-4b8e-4186-b18e-eda0de54e4d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:39.282108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c7cc419-4b8e-4186-b18e-eda0de54e4d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:39.282824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c7cc419-4b8e-4186-b18e-eda0de54e4d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:39.283293 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c7cc419-4b8e-4186-b18e-eda0de54e4d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:39.283729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0c7cc419-4b8e-4186-b18e-eda0de54e4d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:39.443596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0c7cc419-4b8e-4186-b18e-eda0de54e4d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:39.452401 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0c7cc419-4b8e-4186-b18e-eda0de54e4d2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.182737 Aug 09 18:25:39.453000 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4092/7143] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:39 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:40.474176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3d6cc65-7680-494b-8af5-e3bb6dd55164 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:40.474858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3d6cc65-7680-494b-8af5-e3bb6dd55164 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:40.482182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3d6cc65-7680-494b-8af5-e3bb6dd55164 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:40.482662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3d6cc65-7680-494b-8af5-e3bb6dd55164 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:40.483101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3d6cc65-7680-494b-8af5-e3bb6dd55164 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:40.483909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3d6cc65-7680-494b-8af5-e3bb6dd55164 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:40.484276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3d6cc65-7680-494b-8af5-e3bb6dd55164 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:40.484700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3d6cc65-7680-494b-8af5-e3bb6dd55164 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:40.641763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e3d6cc65-7680-494b-8af5-e3bb6dd55164 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:40.650468 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3d6cc65-7680-494b-8af5-e3bb6dd55164 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.180382 Aug 09 18:25:40.650985 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4093/7144] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:40 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:41.671894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a0b4ff8-f121-4b6a-8df9-892445187f6c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:41.672602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a0b4ff8-f121-4b6a-8df9-892445187f6c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:41.679985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a0b4ff8-f121-4b6a-8df9-892445187f6c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:41.680484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a0b4ff8-f121-4b6a-8df9-892445187f6c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:41.680932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a0b4ff8-f121-4b6a-8df9-892445187f6c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:41.681644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a0b4ff8-f121-4b6a-8df9-892445187f6c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:41.682590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a0b4ff8-f121-4b6a-8df9-892445187f6c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:41.683026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a0b4ff8-f121-4b6a-8df9-892445187f6c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:41.836575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a0b4ff8-f121-4b6a-8df9-892445187f6c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:41.845164 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a0b4ff8-f121-4b6a-8df9-892445187f6c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.176891 Aug 09 18:25:41.845757 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4094/7145] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:41 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:42.866984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1b64844-8471-426c-8f09-ceb2795c6fff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:42.867656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1b64844-8471-426c-8f09-ceb2795c6fff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:42.874989 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1b64844-8471-426c-8f09-ceb2795c6fff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:42.875499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1b64844-8471-426c-8f09-ceb2795c6fff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:42.875966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1b64844-8471-426c-8f09-ceb2795c6fff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:42.876659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1b64844-8471-426c-8f09-ceb2795c6fff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:42.877111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1b64844-8471-426c-8f09-ceb2795c6fff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:42.877538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1b64844-8471-426c-8f09-ceb2795c6fff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:43.023710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a1b64844-8471-426c-8f09-ceb2795c6fff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:43.032284 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1b64844-8471-426c-8f09-ceb2795c6fff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.169122 Aug 09 18:25:43.032875 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4095/7146] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:42 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:44.053342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fd9d0639-90a9-4b66-9bda-00044bb68436 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:44.054013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fd9d0639-90a9-4b66-9bda-00044bb68436 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:44.061533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9d0639-90a9-4b66-9bda-00044bb68436 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:44.062033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9d0639-90a9-4b66-9bda-00044bb68436 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:44.062475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9d0639-90a9-4b66-9bda-00044bb68436 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:44.063186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9d0639-90a9-4b66-9bda-00044bb68436 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:44.063666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9d0639-90a9-4b66-9bda-00044bb68436 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:44.064106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fd9d0639-90a9-4b66-9bda-00044bb68436 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:44.212603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fd9d0639-90a9-4b66-9bda-00044bb68436 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:44.221073 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fd9d0639-90a9-4b66-9bda-00044bb68436 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1755 microversion: 2.1 time: 0.171762 Aug 09 18:25:44.221651 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4096/7147] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:44 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:25:45.242753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-02329123-369a-4bc5-9ba7-219e323c6744 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:25:45.243425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-02329123-369a-4bc5-9ba7-219e323c6744 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:25:45.250601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02329123-369a-4bc5-9ba7-219e323c6744 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:45.251093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02329123-369a-4bc5-9ba7-219e323c6744 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:45.251540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02329123-369a-4bc5-9ba7-219e323c6744 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:45.252273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02329123-369a-4bc5-9ba7-219e323c6744 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:25:45.252735 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02329123-369a-4bc5-9ba7-219e323c6744 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:25:45.253168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-02329123-369a-4bc5-9ba7-219e323c6744 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:25:45.272517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:25:45.406979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-02329123-369a-4bc5-9ba7-219e323c6744 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:25:45.415534 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-02329123-369a-4bc5-9ba7-219e323c6744 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1758 microversion: 2.1 time: 0.176612 Aug 09 18:25:45.416180 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4097/7148] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:25:45 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:17.471388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bb70ec43-ea73-4b39-b9e6-710b3522e57c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-590413616"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:17.472133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bb70ec43-ea73-4b39-b9e6-710b3522e57c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:17.474079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=32 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:17.474890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:17.480780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb70ec43-ea73-4b39-b9e6-710b3522e57c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:17.481271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb70ec43-ea73-4b39-b9e6-710b3522e57c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:17.481711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb70ec43-ea73-4b39-b9e6-710b3522e57c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:17.482473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb70ec43-ea73-4b39-b9e6-710b3522e57c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:17.482961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb70ec43-ea73-4b39-b9e6-710b3522e57c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:17.483389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bb70ec43-ea73-4b39-b9e6-710b3522e57c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:17.637960 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.network.security_group_api [None req-bb70ec43-ea73-4b39-b9e6-710b3522e57c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Removing security group 1a1ca960-31e9-48b3-972a-1a9d38630927 from port 920e45f6-4bd5-42f6-b711-d560926d3d9a Aug 09 18:26:17.964251 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bb70ec43-ea73-4b39-b9e6-710b3522e57c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "POST /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/action" status: 202 len: 0 microversion: 2.1 time: 0.497185 Aug 09 18:26:17.969281 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4098/7149] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:26:17 2022] POST /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:26:18.040433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-aa0a7dde-9dfe-4582-a386-bfa5714c87d8 req-d3405ada-4511-4629-ab77-71173a32b240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa97f80-5614-4c19-b15e-ed39d0209004", "tag": "920e45f6-4bd5-42f6-b711-d560926d3d9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:18.053159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aa0a7dde-9dfe-4582-a386-bfa5714c87d8 req-d3405ada-4511-4629-ab77-71173a32b240 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:18.053984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aa0a7dde-9dfe-4582-a386-bfa5714c87d8 req-d3405ada-4511-4629-ab77-71173a32b240 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:18.055047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-aa0a7dde-9dfe-4582-a386-bfa5714c87d8 req-d3405ada-4511-4629-ab77-71173a32b240 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:18.071544 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-aa0a7dde-9dfe-4582-a386-bfa5714c87d8 req-d3405ada-4511-4629-ab77-71173a32b240 service nova] Creating event network-changed:920e45f6-4bd5-42f6-b711-d560926d3d9a for instance bfa97f80-5614-4c19-b15e-ed39d0209004 on n-h2-845781-6 Aug 09 18:26:18.078446 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-aa0a7dde-9dfe-4582-a386-bfa5714c87d8 req-d3405ada-4511-4629-ab77-71173a32b240 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107346 Aug 09 18:26:18.079879 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4099/7150] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:19.547779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d949032e-0473-4899-aa3b-7063909be868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:19.548482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d949032e-0473-4899-aa3b-7063909be868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:19.555693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d949032e-0473-4899-aa3b-7063909be868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:19.556185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d949032e-0473-4899-aa3b-7063909be868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:19.556626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d949032e-0473-4899-aa3b-7063909be868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:19.558065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d949032e-0473-4899-aa3b-7063909be868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:19.558065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d949032e-0473-4899-aa3b-7063909be868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:19.558490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d949032e-0473-4899-aa3b-7063909be868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:19.641294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-d949032e-0473-4899-aa3b-7063909be868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lazy-loading 'services' on Instance uuid bfa97f80-5614-4c19-b15e-ed39d0209004 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:26:19.723272 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d949032e-0473-4899-aa3b-7063909be868 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments/7505000f-a4dd-4e82-ab3c-4f527e456551" status: 202 len: 0 microversion: 2.1 time: 0.179496 Aug 09 18:26:19.724025 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4100/7151] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 18:26:19 2022] DELETE /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments/7505000f-a4dd-4e82-ab3c-4f527e456551 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:26:19.735527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c7c0e3ec-2c4e-4959-96e6-ccfd798a10f0 req-35faa9bc-cb02-4de0-9440-ee71f447db8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa97f80-5614-4c19-b15e-ed39d0209004", "tag": "920e45f6-4bd5-42f6-b711-d560926d3d9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:19.745377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c7c0e3ec-2c4e-4959-96e6-ccfd798a10f0 req-35faa9bc-cb02-4de0-9440-ee71f447db8b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:19.745941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c7c0e3ec-2c4e-4959-96e6-ccfd798a10f0 req-35faa9bc-cb02-4de0-9440-ee71f447db8b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:19.746453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c7c0e3ec-2c4e-4959-96e6-ccfd798a10f0 req-35faa9bc-cb02-4de0-9440-ee71f447db8b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:19.758823 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c7c0e3ec-2c4e-4959-96e6-ccfd798a10f0 req-35faa9bc-cb02-4de0-9440-ee71f447db8b service nova] Creating event network-changed:920e45f6-4bd5-42f6-b711-d560926d3d9a for instance bfa97f80-5614-4c19-b15e-ed39d0209004 on n-h2-845781-6 Aug 09 18:26:19.764765 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c7c0e3ec-2c4e-4959-96e6-ccfd798a10f0 req-35faa9bc-cb02-4de0-9440-ee71f447db8b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038784 Aug 09 18:26:19.765462 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4101/7152] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:19.771313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-07e60cc7-f0a0-4a10-85b7-1ca8c7b77bf6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:19.774279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-07e60cc7-f0a0-4a10-85b7-1ca8c7b77bf6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:19.781395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e60cc7-f0a0-4a10-85b7-1ca8c7b77bf6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:19.782091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e60cc7-f0a0-4a10-85b7-1ca8c7b77bf6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:19.782530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e60cc7-f0a0-4a10-85b7-1ca8c7b77bf6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:19.783237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e60cc7-f0a0-4a10-85b7-1ca8c7b77bf6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:19.783713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e60cc7-f0a0-4a10-85b7-1ca8c7b77bf6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:19.784200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-07e60cc7-f0a0-4a10-85b7-1ca8c7b77bf6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:19.819454 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-07e60cc7-f0a0-4a10-85b7-1ca8c7b77bf6 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052444 Aug 09 18:26:19.824702 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4102/7153] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:26:19 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:20.832844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd738053-26cd-42f5-b764-2f5e6ba167ea tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:20.835246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bd738053-26cd-42f5-b764-2f5e6ba167ea tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:20.841929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd738053-26cd-42f5-b764-2f5e6ba167ea tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:20.842449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd738053-26cd-42f5-b764-2f5e6ba167ea tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:20.842892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd738053-26cd-42f5-b764-2f5e6ba167ea tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:20.843586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd738053-26cd-42f5-b764-2f5e6ba167ea tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:20.844076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd738053-26cd-42f5-b764-2f5e6ba167ea tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:20.844586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bd738053-26cd-42f5-b764-2f5e6ba167ea tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:20.874998 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bd738053-26cd-42f5-b764-2f5e6ba167ea tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046325 Aug 09 18:26:20.875582 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4103/7154] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:26:20 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:26:21.887318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2c297d6b-e6bd-4cfc-89a7-307a8a2391dd tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:21.889748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2c297d6b-e6bd-4cfc-89a7-307a8a2391dd tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:21.896780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c297d6b-e6bd-4cfc-89a7-307a8a2391dd tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:21.897272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c297d6b-e6bd-4cfc-89a7-307a8a2391dd tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:21.897715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c297d6b-e6bd-4cfc-89a7-307a8a2391dd tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:21.898426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c297d6b-e6bd-4cfc-89a7-307a8a2391dd tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:21.898919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c297d6b-e6bd-4cfc-89a7-307a8a2391dd tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:21.899354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2c297d6b-e6bd-4cfc-89a7-307a8a2391dd tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:21.930666 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2c297d6b-e6bd-4cfc-89a7-307a8a2391dd tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047313 Aug 09 18:26:21.931245 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4104/7155] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:26:21 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:26:22.942870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-005dfb08-f7a2-4f71-a373-e256a1e7d758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:22.944966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-005dfb08-f7a2-4f71-a373-e256a1e7d758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:22.952409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-005dfb08-f7a2-4f71-a373-e256a1e7d758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:22.952892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-005dfb08-f7a2-4f71-a373-e256a1e7d758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:22.953341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-005dfb08-f7a2-4f71-a373-e256a1e7d758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:22.954039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-005dfb08-f7a2-4f71-a373-e256a1e7d758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:22.954501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-005dfb08-f7a2-4f71-a373-e256a1e7d758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:22.954930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-005dfb08-f7a2-4f71-a373-e256a1e7d758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:22.985201 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-005dfb08-f7a2-4f71-a373-e256a1e7d758 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046540 Aug 09 18:26:22.985784 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4105/7156] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:26:22 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:26:23.997611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-345e17e0-c85b-49f9-bf9c-726608d45c2c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:23.999878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-345e17e0-c85b-49f9-bf9c-726608d45c2c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:24.006751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-345e17e0-c85b-49f9-bf9c-726608d45c2c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:24.007244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-345e17e0-c85b-49f9-bf9c-726608d45c2c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:24.007703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-345e17e0-c85b-49f9-bf9c-726608d45c2c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:24.008431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-345e17e0-c85b-49f9-bf9c-726608d45c2c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:24.008884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-345e17e0-c85b-49f9-bf9c-726608d45c2c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:24.009309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-345e17e0-c85b-49f9-bf9c-726608d45c2c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:24.042548 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-345e17e0-c85b-49f9-bf9c-726608d45c2c tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048847 Aug 09 18:26:24.043043 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4106/7157] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:26:23 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:26:25.054947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-55efeb62-9fb2-4529-850d-a36e359ea6f8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:25.057084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-55efeb62-9fb2-4529-850d-a36e359ea6f8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:25.063879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55efeb62-9fb2-4529-850d-a36e359ea6f8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:25.064369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55efeb62-9fb2-4529-850d-a36e359ea6f8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:25.064810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55efeb62-9fb2-4529-850d-a36e359ea6f8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:25.065501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55efeb62-9fb2-4529-850d-a36e359ea6f8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:25.065957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55efeb62-9fb2-4529-850d-a36e359ea6f8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:25.066389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-55efeb62-9fb2-4529-850d-a36e359ea6f8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:25.094041 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-55efeb62-9fb2-4529-850d-a36e359ea6f8 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043185 Aug 09 18:26:25.094599 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4107/7158] 10.222.0.93 () {58 vars in 1302 bytes} [Tue Aug 9 18:26:25 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 18:26:25.104859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:25.105354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:25.112011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:25.112390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:25.112829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:25.113524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:25.113977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:25.114404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:25.187989 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] HTTP exception thrown: Instance bfa97f80-5614-4c19-b15e-ed39d0209004 is not attached to volume 7505000f-a4dd-4e82-ab3c-4f527e456551 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Request method failure captured: Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: request: DELETE /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments/7505000f-a4dd-4e82-ab3c-4f527e456551 HTTP/1.1 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qVdrpEwRAeuR_j4IS2j7B62lG7_B4iYuln6Z5hN0oZ3bVshsK7VgfkXcjBfxWfJfv-aRi9V4R3evTmdY7Y4p79akAld91--m63VZYgC852aOf49JpSGJjKew3v55MhriOaQLxTTQn_h-qrCDTtXGdfBjId21qP04bAbCuO3i2BKhKI Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 7b5be7db51a74cd6989217c54c986970 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7b5be7db51a74cd6989217c54c986970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 7b5be7db51a74cd6989217c54c986970 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestMinimumBasicScenario-1283421594-project Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: f960eb217f0c41a6ba6c0e5c0241b200 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestMinimumBasicScenario-1283421594-project Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance bfa97f80-5614-4c19-b15e-ed39d0209004 is not attached to volume 7505000f-a4dd-4e82-ab3c-4f527e456551 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'server_id': 'bfa97f80-5614-4c19-b15e-ed39d0209004', 'id': '7505000f-a4dd-4e82-ab3c-4f527e456551'} Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7505000f-a4dd-4e82-ab3c-4f527e456551. Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa97f80-5614-4c19-b15e-ed39d0209004 is not attached to volume 7505000f-a4dd-4e82-ab3c-4f527e456551 Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:25.189607 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:25.195616 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:26:25.195616 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:26:25.195616 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa97f80-5614-4c19-b15e-ed39d0209004 is not attached to volume 7505000f-a4dd-4e82-ab3c-4f527e456551 Aug 09 18:26:25.195616 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:26:25.195616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Returning 404 to user: Instance bfa97f80-5614-4c19-b15e-ed39d0209004 is not attached to volume 7505000f-a4dd-4e82-ab3c-4f527e456551 {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:26:25.195616 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-25b551ad-b4df-4af1-9106-c139652f4799 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments/7505000f-a4dd-4e82-ab3c-4f527e456551" status: 404 len: 154 microversion: 2.1 time: 0.089857 Aug 09 18:26:25.195616 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4108/7159] 10.222.0.93 () {58 vars in 1416 bytes} [Tue Aug 9 18:26:25 2022] DELETE /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004/os-volume_attachments/7505000f-a4dd-4e82-ab3c-4f527e456551 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:26:28.440356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ba469e15-9c2c-480f-b235-c162bf02980b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:28.440994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba469e15-9c2c-480f-b235-c162bf02980b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:28.447894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba469e15-9c2c-480f-b235-c162bf02980b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:28.448424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba469e15-9c2c-480f-b235-c162bf02980b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:28.448901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba469e15-9c2c-480f-b235-c162bf02980b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:28.449602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba469e15-9c2c-480f-b235-c162bf02980b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:28.450114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba469e15-9c2c-480f-b235-c162bf02980b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:28.450541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba469e15-9c2c-480f-b235-c162bf02980b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:28.477401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba469e15-9c2c-480f-b235-c162bf02980b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:26:28.557870 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ba469e15-9c2c-480f-b235-c162bf02980b tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 204 len: 0 microversion: 2.1 time: 0.120934 Aug 09 18:26:28.559098 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4109/7160] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:26:28 2022] DELETE /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:26:28.569730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d695c88-3a61-47f9-bab5-f4c585e845ff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:28.570436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9d695c88-3a61-47f9-bab5-f4c585e845ff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:28.577380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d695c88-3a61-47f9-bab5-f4c585e845ff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:28.577895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d695c88-3a61-47f9-bab5-f4c585e845ff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:28.578330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d695c88-3a61-47f9-bab5-f4c585e845ff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:28.579037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d695c88-3a61-47f9-bab5-f4c585e845ff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:28.579485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d695c88-3a61-47f9-bab5-f4c585e845ff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:28.579941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d695c88-3a61-47f9-bab5-f4c585e845ff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:28.718731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9d695c88-3a61-47f9-bab5-f4c585e845ff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:28.726699 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9d695c88-3a61-47f9-bab5-f4c585e845ff tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1554 microversion: 2.1 time: 0.161744 Aug 09 18:26:28.727295 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4110/7161] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:28 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:29.748653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-84654395-d415-43e4-a522-f565b7d69083 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:29.749319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-84654395-d415-43e4-a522-f565b7d69083 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:29.756492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84654395-d415-43e4-a522-f565b7d69083 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:29.756987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84654395-d415-43e4-a522-f565b7d69083 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:29.757429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84654395-d415-43e4-a522-f565b7d69083 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:29.758130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84654395-d415-43e4-a522-f565b7d69083 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:29.758594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84654395-d415-43e4-a522-f565b7d69083 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:29.759026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84654395-d415-43e4-a522-f565b7d69083 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:29.900569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-84654395-d415-43e4-a522-f565b7d69083 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:29.909107 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-84654395-d415-43e4-a522-f565b7d69083 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1554 microversion: 2.1 time: 0.165040 Aug 09 18:26:29.909698 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4111/7162] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:29 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:30.905749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ca41158a-b63a-4c27-a697-ae5d4d890f23 req-a655a7f7-ba18-4da4-9493-23c095672541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa97f80-5614-4c19-b15e-ed39d0209004", "name": "network-vif-deleted", "tag": "920e45f6-4bd5-42f6-b711-d560926d3d9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:30.923620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ca41158a-b63a-4c27-a697-ae5d4d890f23 req-a655a7f7-ba18-4da4-9493-23c095672541 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:30.925707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ca41158a-b63a-4c27-a697-ae5d4d890f23 req-a655a7f7-ba18-4da4-9493-23c095672541 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:30.925707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ca41158a-b63a-4c27-a697-ae5d4d890f23 req-a655a7f7-ba18-4da4-9493-23c095672541 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:30.936298 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ca41158a-b63a-4c27-a697-ae5d4d890f23 req-a655a7f7-ba18-4da4-9493-23c095672541 service nova] Creating event network-vif-deleted:920e45f6-4bd5-42f6-b711-d560926d3d9a for instance bfa97f80-5614-4c19-b15e-ed39d0209004 on n-h2-845781-6 Aug 09 18:26:30.940950 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ca41158a-b63a-4c27-a697-ae5d4d890f23 req-a655a7f7-ba18-4da4-9493-23c095672541 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039913 Aug 09 18:26:30.941566 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4112/7163] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:30.946702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b4141c94-3f68-44ac-b0b0-c056d4a6ce13 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:30.947408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b4141c94-3f68-44ac-b0b0-c056d4a6ce13 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:30.954954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4141c94-3f68-44ac-b0b0-c056d4a6ce13 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:30.955474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4141c94-3f68-44ac-b0b0-c056d4a6ce13 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:30.955949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4141c94-3f68-44ac-b0b0-c056d4a6ce13 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:30.956669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4141c94-3f68-44ac-b0b0-c056d4a6ce13 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:30.957133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4141c94-3f68-44ac-b0b0-c056d4a6ce13 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:30.957565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b4141c94-3f68-44ac-b0b0-c056d4a6ce13 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:31.024009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b4141c94-3f68-44ac-b0b0-c056d4a6ce13 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f960eb217f0c41a6ba6c0e5c0241b200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5be7db51a74cd6989217c54c986970', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:31.033450 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b4141c94-3f68-44ac-b0b0-c056d4a6ce13 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 200 len: 1344 microversion: 2.1 time: 0.090662 Aug 09 18:26:31.034051 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4113/7164] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:30 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 1344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:26:32.054843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:32.055535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] [instance: bfa97f80-5614-4c19-b15e-ed39d0209004] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:32.062977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:32.063464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:32.063929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:32.064623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:32.065075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:32.065502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:32.078734 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] HTTP exception thrown: Instance bfa97f80-5614-4c19-b15e-ed39d0209004 could not be found. Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Request method failure captured: Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 HTTP/1.1 Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qVdrpEwRAeuR_j4IS2j7B62lG7_B4iYuln6Z5hN0oZ3bVshsK7VgfkXcjBfxWfJfv-aRi9V4R3evTmdY7Y4p79akAld91--m63VZYgC852aOf49JpSGJjKew3v55MhriOaQLxTTQn_h-qrCDTtXGdfBjId21qP04bAbCuO3i2BKhKI Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 7b5be7db51a74cd6989217c54c986970 Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7b5be7db51a74cd6989217c54c986970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7b5be7db51a74cd6989217c54c986970"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 7b5be7db51a74cd6989217c54c986970 Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1283421594 Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestMinimumBasicScenario-1283421594-project Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: f960eb217f0c41a6ba6c0e5c0241b200 Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestMinimumBasicScenario-1283421594-project Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance bfa97f80-5614-4c19-b15e-ed39d0209004 could not be found. Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'bfa97f80-5614-4c19-b15e-ed39d0209004'} Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa97f80-5614-4c19-b15e-ed39d0209004 could not be found. Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa97f80-5614-4c19-b15e-ed39d0209004 could not be found. Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:26:32.080543 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:26:32.085335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:26:32.085335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:26:32.085335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:26:32.085335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:26:32.085335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:26:32.085335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa97f80-5614-4c19-b15e-ed39d0209004 could not be found. Aug 09 18:26:32.085335 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:26:32.085335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Returning 404 to user: Instance bfa97f80-5614-4c19-b15e-ed39d0209004 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:26:32.085335 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-932661ca-6b86-4bdc-8f8b-8ba966b3eee2 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004" status: 404 len: 111 microversion: 2.1 time: 0.031211 Aug 09 18:26:32.085335 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4114/7165] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:32 2022] GET /compute/v2.1/servers/bfa97f80-5614-4c19-b15e-ed39d0209004 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:26:32.090242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-62980cd2-e164-41b9-a515-83aacb40e403 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] Calling method '.version_select at 0x7fbbcb50a1f0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:32.110560 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-62980cd2-e164-41b9-a515-83aacb40e403 tempest-TestMinimumBasicScenario-1283421594 tempest-TestMinimumBasicScenario-1283421594-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1102372919" status: 202 len: 0 microversion: 2.1 time: 0.023747 Aug 09 18:26:32.111134 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4115/7166] 10.222.0.93 () {58 vars in 1272 bytes} [Tue Aug 9 18:26:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1102372919 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:26:41.197034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-634ecb51-5e02-4180-a15f-bb46e6a0f3f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'create', calling method: .version_select at 0x7fbbdc9eca60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1565043610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzvzzGRXQprCEN0yDpY+/rkXZCLtAh+yHS++EU4q1Ze/Ap9lj/MKW0s/ALxUuA18H8Oip32qMox7nLqU+qOnJYrkVzOMW9ERPEoqyjetydS6hgZcP7N23wa84OSjU4mQA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:41.213956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-634ecb51-5e02-4180-a15f-bb46e6a0f3f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:26:41.220180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-634ecb51-5e02-4180-a15f-bb46e6a0f3f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for user 8c34712ceeb54491889acff0f8f2eddd and project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:26:41.245681 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-634ecb51-5e02-4180-a15f-bb46e6a0f3f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.214515 Aug 09 18:26:41.246291 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4116/7167] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:26:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:26:47.158662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:47.164764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-984943459", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "b1505f05-54ea-469e-9975-d214d5ae0c68"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1565043610", "security_groups": [{"name": "tempest-secgroup-smoke-403433190"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:47.291720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] validate_networks() for [('b1505f05-54ea-469e-9975-d214d5ae0c68', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:26:47.479993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:47.684493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:26:47.685013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:26:47.685564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:26:47.686716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:26:47.687063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:26:47.695919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:47.696401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:47.696962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:47.697688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:47.698144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:47.698579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:47.715613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:26:47.722258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for user 8c34712ceeb54491889acff0f8f2eddd and project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:26:47.737414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:26:47.740179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:26:47.787942 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-41a3fc9b-00dd-46df-bc06-5a74b657da81 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.630627 Aug 09 18:26:47.788607 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4117/7168] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:26:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:26:47.800200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fa87aaae-80eb-487c-9c71-2a88547af835 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:47.800823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fa87aaae-80eb-487c-9c71-2a88547af835 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:47.860377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fa87aaae-80eb-487c-9c71-2a88547af835 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:47.868509 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fa87aaae-80eb-487c-9c71-2a88547af835 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1266 microversion: 2.1 time: 0.072165 Aug 09 18:26:47.869480 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4118/7169] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:47 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:48.891957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-76ba6d2c-f79a-436c-ac43-ffbde6419a0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:48.892633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-76ba6d2c-f79a-436c-ac43-ffbde6419a0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:48.900025 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76ba6d2c-f79a-436c-ac43-ffbde6419a0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:48.900530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76ba6d2c-f79a-436c-ac43-ffbde6419a0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:48.900982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76ba6d2c-f79a-436c-ac43-ffbde6419a0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:48.901710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76ba6d2c-f79a-436c-ac43-ffbde6419a0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:48.902171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76ba6d2c-f79a-436c-ac43-ffbde6419a0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:48.902612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-76ba6d2c-f79a-436c-ac43-ffbde6419a0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:48.982959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-76ba6d2c-f79a-436c-ac43-ffbde6419a0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:48.991412 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-76ba6d2c-f79a-436c-ac43-ffbde6419a0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1318 microversion: 2.1 time: 0.105178 Aug 09 18:26:48.999595 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4119/7170] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:48 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1318 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:50.013278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1d89d50c-b4d4-4956-9e6b-64cf22bd48cc tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:50.014067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1d89d50c-b4d4-4956-9e6b-64cf22bd48cc tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:50.021187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d89d50c-b4d4-4956-9e6b-64cf22bd48cc tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:50.021689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d89d50c-b4d4-4956-9e6b-64cf22bd48cc tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:50.022215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d89d50c-b4d4-4956-9e6b-64cf22bd48cc tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:50.026707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d89d50c-b4d4-4956-9e6b-64cf22bd48cc tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:50.026707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d89d50c-b4d4-4956-9e6b-64cf22bd48cc tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:50.026707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1d89d50c-b4d4-4956-9e6b-64cf22bd48cc tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:50.173600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1d89d50c-b4d4-4956-9e6b-64cf22bd48cc tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:50.181155 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1d89d50c-b4d4-4956-9e6b-64cf22bd48cc tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1391 microversion: 2.1 time: 0.171961 Aug 09 18:26:50.181742 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4120/7171] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:50 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:50.468516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-53ec31ea-9bbd-447d-8530-21716db653b2 req-ee73ea83-1465-4db7-be01-f1338b1c0566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da8cb00-60d0-4995-be9d-e47e87944dbf", "tag": "da3460e8-278a-4d46-85c8-b14fbbf59162"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:50.479832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-53ec31ea-9bbd-447d-8530-21716db653b2 req-ee73ea83-1465-4db7-be01-f1338b1c0566 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:50.480314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-53ec31ea-9bbd-447d-8530-21716db653b2 req-ee73ea83-1465-4db7-be01-f1338b1c0566 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:50.480957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-53ec31ea-9bbd-447d-8530-21716db653b2 req-ee73ea83-1465-4db7-be01-f1338b1c0566 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:50.493569 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-53ec31ea-9bbd-447d-8530-21716db653b2 req-ee73ea83-1465-4db7-be01-f1338b1c0566 service nova] Creating event network-changed:da3460e8-278a-4d46-85c8-b14fbbf59162 for instance 6da8cb00-60d0-4995-be9d-e47e87944dbf on n-h1-845781-6 Aug 09 18:26:50.498862 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-53ec31ea-9bbd-447d-8530-21716db653b2 req-ee73ea83-1465-4db7-be01-f1338b1c0566 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033751 Aug 09 18:26:50.499708 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4121/7172] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:51.205372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d81e9ff-ab39-4c97-a626-39c64cd2f10b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:51.206050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7d81e9ff-ab39-4c97-a626-39c64cd2f10b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:51.212232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d81e9ff-ab39-4c97-a626-39c64cd2f10b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:51.212715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d81e9ff-ab39-4c97-a626-39c64cd2f10b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:51.213153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d81e9ff-ab39-4c97-a626-39c64cd2f10b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:51.213843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d81e9ff-ab39-4c97-a626-39c64cd2f10b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:51.214290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d81e9ff-ab39-4c97-a626-39c64cd2f10b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:51.214714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d81e9ff-ab39-4c97-a626-39c64cd2f10b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:51.349587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7d81e9ff-ab39-4c97-a626-39c64cd2f10b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:51.357382 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7d81e9ff-ab39-4c97-a626-39c64cd2f10b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1391 microversion: 2.1 time: 0.157189 Aug 09 18:26:51.358619 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4122/7173] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:51 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:52.379126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c06158ab-7ea7-4836-8c85-bf8c7b8e6332 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:52.379814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c06158ab-7ea7-4836-8c85-bf8c7b8e6332 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:52.388453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c06158ab-7ea7-4836-8c85-bf8c7b8e6332 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:52.389097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c06158ab-7ea7-4836-8c85-bf8c7b8e6332 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:52.389709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c06158ab-7ea7-4836-8c85-bf8c7b8e6332 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:52.390554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c06158ab-7ea7-4836-8c85-bf8c7b8e6332 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:52.391027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c06158ab-7ea7-4836-8c85-bf8c7b8e6332 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:52.391461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c06158ab-7ea7-4836-8c85-bf8c7b8e6332 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:52.528857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c06158ab-7ea7-4836-8c85-bf8c7b8e6332 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:52.537093 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c06158ab-7ea7-4836-8c85-bf8c7b8e6332 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1391 microversion: 2.1 time: 0.161878 Aug 09 18:26:52.537733 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4123/7174] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:52 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:53.560361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4d153ef1-e23f-4b7e-9a1d-7f9ae7e3e977 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:53.561537 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4d153ef1-e23f-4b7e-9a1d-7f9ae7e3e977 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:53.568424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d153ef1-e23f-4b7e-9a1d-7f9ae7e3e977 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:53.568913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d153ef1-e23f-4b7e-9a1d-7f9ae7e3e977 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:53.569358 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d153ef1-e23f-4b7e-9a1d-7f9ae7e3e977 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:53.570057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d153ef1-e23f-4b7e-9a1d-7f9ae7e3e977 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:53.570518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d153ef1-e23f-4b7e-9a1d-7f9ae7e3e977 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:53.570953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d153ef1-e23f-4b7e-9a1d-7f9ae7e3e977 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:53.707176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4d153ef1-e23f-4b7e-9a1d-7f9ae7e3e977 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:53.714825 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4d153ef1-e23f-4b7e-9a1d-7f9ae7e3e977 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1391 microversion: 2.1 time: 0.158576 Aug 09 18:26:53.715418 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4124/7175] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:53 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:54.736019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-28a1fe16-c255-4fe7-9d1b-9e6a6e5f2478 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:54.736698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-28a1fe16-c255-4fe7-9d1b-9e6a6e5f2478 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:54.743491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1fe16-c255-4fe7-9d1b-9e6a6e5f2478 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:54.744016 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1fe16-c255-4fe7-9d1b-9e6a6e5f2478 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:54.744459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1fe16-c255-4fe7-9d1b-9e6a6e5f2478 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:54.745158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1fe16-c255-4fe7-9d1b-9e6a6e5f2478 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:54.745617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1fe16-c255-4fe7-9d1b-9e6a6e5f2478 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:54.746050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28a1fe16-c255-4fe7-9d1b-9e6a6e5f2478 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:54.880119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28a1fe16-c255-4fe7-9d1b-9e6a6e5f2478 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:54.887686 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-28a1fe16-c255-4fe7-9d1b-9e6a6e5f2478 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1391 microversion: 2.1 time: 0.155599 Aug 09 18:26:54.888284 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4125/7176] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:54 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:55.442239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6b3489e2-2ec3-40e4-a433-e369c2df8d79 req-0d727e5d-826f-4a5e-9c76-4b61637ac6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da8cb00-60d0-4995-be9d-e47e87944dbf", "name": "network-vif-plugged", "status": "completed", "tag": "da3460e8-278a-4d46-85c8-b14fbbf59162"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:55.452995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6b3489e2-2ec3-40e4-a433-e369c2df8d79 req-0d727e5d-826f-4a5e-9c76-4b61637ac6f2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:55.453490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6b3489e2-2ec3-40e4-a433-e369c2df8d79 req-0d727e5d-826f-4a5e-9c76-4b61637ac6f2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:55.453930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6b3489e2-2ec3-40e4-a433-e369c2df8d79 req-0d727e5d-826f-4a5e-9c76-4b61637ac6f2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:55.469027 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6b3489e2-2ec3-40e4-a433-e369c2df8d79 req-0d727e5d-826f-4a5e-9c76-4b61637ac6f2 service nova] Creating event network-vif-plugged:da3460e8-278a-4d46-85c8-b14fbbf59162 for instance 6da8cb00-60d0-4995-be9d-e47e87944dbf on n-h1-845781-6 Aug 09 18:26:55.474239 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6b3489e2-2ec3-40e4-a433-e369c2df8d79 req-0d727e5d-826f-4a5e-9c76-4b61637ac6f2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035730 Aug 09 18:26:55.475044 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4126/7177] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:26:55.911481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b1965988-0b81-43c4-a014-cba331212d80 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:55.912255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b1965988-0b81-43c4-a014-cba331212d80 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:55.919097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1965988-0b81-43c4-a014-cba331212d80 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:55.919594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1965988-0b81-43c4-a014-cba331212d80 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:55.920069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1965988-0b81-43c4-a014-cba331212d80 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:55.920784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1965988-0b81-43c4-a014-cba331212d80 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:55.921247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1965988-0b81-43c4-a014-cba331212d80 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:55.921681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b1965988-0b81-43c4-a014-cba331212d80 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:56.312737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b1965988-0b81-43c4-a014-cba331212d80 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:56.320277 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b1965988-0b81-43c4-a014-cba331212d80 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1391 microversion: 2.1 time: 0.414205 Aug 09 18:26:56.320856 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4127/7178] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:55 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1391 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:57.341780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d7b44eda-e98b-4dd2-8ea2-04414adf0ba4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:57.342953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d7b44eda-e98b-4dd2-8ea2-04414adf0ba4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:57.350431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7b44eda-e98b-4dd2-8ea2-04414adf0ba4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:57.350935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7b44eda-e98b-4dd2-8ea2-04414adf0ba4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:57.351404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7b44eda-e98b-4dd2-8ea2-04414adf0ba4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:57.352143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7b44eda-e98b-4dd2-8ea2-04414adf0ba4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:57.352609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7b44eda-e98b-4dd2-8ea2-04414adf0ba4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:57.353044 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7b44eda-e98b-4dd2-8ea2-04414adf0ba4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:57.483246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d7b44eda-e98b-4dd2-8ea2-04414adf0ba4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:57.490682 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d7b44eda-e98b-4dd2-8ea2-04414adf0ba4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1562 microversion: 2.1 time: 0.153113 Aug 09 18:26:57.491253 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4128/7179] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:57 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:57.510530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c99e36c8-091d-4b4f-99cc-9a5f794a0adf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:57.511190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c99e36c8-091d-4b4f-99cc-9a5f794a0adf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:57.517345 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c99e36c8-091d-4b4f-99cc-9a5f794a0adf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:57.517822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c99e36c8-091d-4b4f-99cc-9a5f794a0adf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:57.518256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c99e36c8-091d-4b4f-99cc-9a5f794a0adf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:57.518934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c99e36c8-091d-4b4f-99cc-9a5f794a0adf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:57.519381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c99e36c8-091d-4b4f-99cc-9a5f794a0adf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:57.519847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c99e36c8-091d-4b4f-99cc-9a5f794a0adf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:57.661468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c99e36c8-091d-4b4f-99cc-9a5f794a0adf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:57.669113 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c99e36c8-091d-4b4f-99cc-9a5f794a0adf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1562 microversion: 2.1 time: 0.162095 Aug 09 18:26:57.669695 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4129/7180] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:57 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:59.278757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2f7cb135-5cf8-4fb6-af29-c77fe7a2eeaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:26:59.279447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2f7cb135-5cf8-4fb6-af29-c77fe7a2eeaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:26:59.281612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:59.282448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:26:59.289732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f7cb135-5cf8-4fb6-af29-c77fe7a2eeaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:59.290231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f7cb135-5cf8-4fb6-af29-c77fe7a2eeaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:59.290674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f7cb135-5cf8-4fb6-af29-c77fe7a2eeaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:59.291381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f7cb135-5cf8-4fb6-af29-c77fe7a2eeaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:59.291908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f7cb135-5cf8-4fb6-af29-c77fe7a2eeaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:59.292333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f7cb135-5cf8-4fb6-af29-c77fe7a2eeaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:59.433225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2f7cb135-5cf8-4fb6-af29-c77fe7a2eeaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:26:59.441401 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2f7cb135-5cf8-4fb6-af29-c77fe7a2eeaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1562 microversion: 2.1 time: 0.167094 Aug 09 18:26:59.441991 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4130/7181] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:26:59 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:26:59.446752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d4b6957f-9bb7-4bb6-aac3-01944d13cb22 req-28595e64-998e-4fb4-91e0-5d06265634a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da8cb00-60d0-4995-be9d-e47e87944dbf", "tag": "da3460e8-278a-4d46-85c8-b14fbbf59162"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:26:59.456951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d4b6957f-9bb7-4bb6-aac3-01944d13cb22 req-28595e64-998e-4fb4-91e0-5d06265634a6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:26:59.457565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d4b6957f-9bb7-4bb6-aac3-01944d13cb22 req-28595e64-998e-4fb4-91e0-5d06265634a6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:26:59.458011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d4b6957f-9bb7-4bb6-aac3-01944d13cb22 req-28595e64-998e-4fb4-91e0-5d06265634a6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:26:59.469578 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d4b6957f-9bb7-4bb6-aac3-01944d13cb22 req-28595e64-998e-4fb4-91e0-5d06265634a6 service nova] Creating event network-changed:da3460e8-278a-4d46-85c8-b14fbbf59162 for instance 6da8cb00-60d0-4995-be9d-e47e87944dbf on n-h1-845781-6 Aug 09 18:26:59.474877 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d4b6957f-9bb7-4bb6-aac3-01944d13cb22 req-28595e64-998e-4fb4-91e0-5d06265634a6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031533 Aug 09 18:26:59.475664 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4131/7182] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:27:24.738259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-291d4f8a-b5a8-4633-9c31-b82772087632 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:24.740539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-291d4f8a-b5a8-4633-9c31-b82772087632 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:24.743297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:27:24.743966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=68 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:27:24.750460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-291d4f8a-b5a8-4633-9c31-b82772087632 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:24.750942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-291d4f8a-b5a8-4633-9c31-b82772087632 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:24.751382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-291d4f8a-b5a8-4633-9c31-b82772087632 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:24.752102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-291d4f8a-b5a8-4633-9c31-b82772087632 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:24.752552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-291d4f8a-b5a8-4633-9c31-b82772087632 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:24.752977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-291d4f8a-b5a8-4633-9c31-b82772087632 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:24.810744 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-291d4f8a-b5a8-4633-9c31-b82772087632 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf/action" status: 200 len: 24566 microversion: 2.1 time: 0.076739 Aug 09 18:27:24.812080 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4132/7183] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:27:24 2022] POST /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf/action => generated 24566 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:27:35.896535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f9f79e1d-0f4f-49fe-970b-daea3d9043d5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:35.897194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f9f79e1d-0f4f-49fe-970b-daea3d9043d5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:35.899515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:27:35.900206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:27:35.907380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f79e1d-0f4f-49fe-970b-daea3d9043d5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:35.907899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f79e1d-0f4f-49fe-970b-daea3d9043d5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:35.908341 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f79e1d-0f4f-49fe-970b-daea3d9043d5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:35.909217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f79e1d-0f4f-49fe-970b-daea3d9043d5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:35.909897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f79e1d-0f4f-49fe-970b-daea3d9043d5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:35.909897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f79e1d-0f4f-49fe-970b-daea3d9043d5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:35.977874 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f9f79e1d-0f4f-49fe-970b-daea3d9043d5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.086126 Aug 09 18:27:35.978537 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4133/7184] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:27:35 2022] POST /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:27:35.987394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b9bae48c-617a-4031-8ed6-b5675465c5e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:35.988134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b9bae48c-617a-4031-8ed6-b5675465c5e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:35.994218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9bae48c-617a-4031-8ed6-b5675465c5e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:35.994738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9bae48c-617a-4031-8ed6-b5675465c5e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:35.995164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9bae48c-617a-4031-8ed6-b5675465c5e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:35.995975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9bae48c-617a-4031-8ed6-b5675465c5e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:35.996466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9bae48c-617a-4031-8ed6-b5675465c5e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:35.996861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9bae48c-617a-4031-8ed6-b5675465c5e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:36.132437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b9bae48c-617a-4031-8ed6-b5675465c5e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:36.141030 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b9bae48c-617a-4031-8ed6-b5675465c5e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1685 microversion: 2.1 time: 0.157902 Aug 09 18:27:36.141816 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4134/7185] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:35 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:37.162827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-236d0315-d563-4c21-8e44-19235edd384b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:37.163517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-236d0315-d563-4c21-8e44-19235edd384b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:37.170266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-236d0315-d563-4c21-8e44-19235edd384b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:37.170751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-236d0315-d563-4c21-8e44-19235edd384b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:37.171193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-236d0315-d563-4c21-8e44-19235edd384b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:37.171908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-236d0315-d563-4c21-8e44-19235edd384b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:37.172356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-236d0315-d563-4c21-8e44-19235edd384b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:37.172787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-236d0315-d563-4c21-8e44-19235edd384b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:37.313419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-236d0315-d563-4c21-8e44-19235edd384b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:37.320913 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-236d0315-d563-4c21-8e44-19235edd384b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1665 microversion: 2.1 time: 0.162012 Aug 09 18:27:37.321478 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4135/7186] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:37 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:27:38.412976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d5f8ac54-95e0-4ae3-904e-a8f4409eb26e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:38.415118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d5f8ac54-95e0-4ae3-904e-a8f4409eb26e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:38.422821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5f8ac54-95e0-4ae3-904e-a8f4409eb26e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:38.423308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5f8ac54-95e0-4ae3-904e-a8f4409eb26e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:38.423779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5f8ac54-95e0-4ae3-904e-a8f4409eb26e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:38.424480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5f8ac54-95e0-4ae3-904e-a8f4409eb26e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:38.424939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5f8ac54-95e0-4ae3-904e-a8f4409eb26e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:38.425373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5f8ac54-95e0-4ae3-904e-a8f4409eb26e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:38.489106 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d5f8ac54-95e0-4ae3-904e-a8f4409eb26e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf/action" status: 200 len: 32642 microversion: 2.1 time: 0.079918 Aug 09 18:27:38.490011 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4136/7187] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:27:38 2022] POST /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf/action => generated 32642 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:27:38.502034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-21e71dcf-571e-4279-b74a-0435555c1031 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:38.502663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-21e71dcf-571e-4279-b74a-0435555c1031 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:38.509715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e71dcf-571e-4279-b74a-0435555c1031 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:38.510195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e71dcf-571e-4279-b74a-0435555c1031 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:38.510636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e71dcf-571e-4279-b74a-0435555c1031 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:38.511331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e71dcf-571e-4279-b74a-0435555c1031 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:38.511835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e71dcf-571e-4279-b74a-0435555c1031 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:38.512270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-21e71dcf-571e-4279-b74a-0435555c1031 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:38.581151 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-21e71dcf-571e-4279-b74a-0435555c1031 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.083203 Aug 09 18:27:38.581801 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4137/7188] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:27:38 2022] POST /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:27:38.590767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6d894fe5-2a0c-4a85-90eb-66aa133c6d63 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:38.591469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6d894fe5-2a0c-4a85-90eb-66aa133c6d63 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:38.598621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d894fe5-2a0c-4a85-90eb-66aa133c6d63 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:38.599115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d894fe5-2a0c-4a85-90eb-66aa133c6d63 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:38.599554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d894fe5-2a0c-4a85-90eb-66aa133c6d63 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:38.600298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d894fe5-2a0c-4a85-90eb-66aa133c6d63 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:38.600753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d894fe5-2a0c-4a85-90eb-66aa133c6d63 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:38.601210 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d894fe5-2a0c-4a85-90eb-66aa133c6d63 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:38.743958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6d894fe5-2a0c-4a85-90eb-66aa133c6d63 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:38.752011 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6d894fe5-2a0c-4a85-90eb-66aa133c6d63 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1672 microversion: 2.1 time: 0.165431 Aug 09 18:27:38.752358 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4138/7189] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:38 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:27:39.774574 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cddebbae-8369-4903-9348-872d58f8d3c6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:39.775244 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cddebbae-8369-4903-9348-872d58f8d3c6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:39.782727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cddebbae-8369-4903-9348-872d58f8d3c6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:39.783214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cddebbae-8369-4903-9348-872d58f8d3c6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:39.783677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cddebbae-8369-4903-9348-872d58f8d3c6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:39.784385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cddebbae-8369-4903-9348-872d58f8d3c6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:39.784845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cddebbae-8369-4903-9348-872d58f8d3c6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:39.785281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cddebbae-8369-4903-9348-872d58f8d3c6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:39.919150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cddebbae-8369-4903-9348-872d58f8d3c6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:39.927643 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cddebbae-8369-4903-9348-872d58f8d3c6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1680 microversion: 2.1 time: 0.157078 Aug 09 18:27:39.928391 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4139/7190] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:39 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:27:40.022105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d0c41191-5f93-42d7-98ea-9f7c68c1e7c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:40.024490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d0c41191-5f93-42d7-98ea-9f7c68c1e7c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:40.030481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0c41191-5f93-42d7-98ea-9f7c68c1e7c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:40.030965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0c41191-5f93-42d7-98ea-9f7c68c1e7c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:40.031923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0c41191-5f93-42d7-98ea-9f7c68c1e7c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:40.032613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0c41191-5f93-42d7-98ea-9f7c68c1e7c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:40.033068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0c41191-5f93-42d7-98ea-9f7c68c1e7c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:40.033488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0c41191-5f93-42d7-98ea-9f7c68c1e7c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:40.097096 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d0c41191-5f93-42d7-98ea-9f7c68c1e7c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf/action" status: 200 len: 38366 microversion: 2.1 time: 0.078471 Aug 09 18:27:40.097771 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4140/7191] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:27:40 2022] POST /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf/action => generated 38366 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:27:41.091190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a93e285-6f3d-4d19-9ebc-fd380d407216 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:41.091830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a93e285-6f3d-4d19-9ebc-fd380d407216 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:41.099819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a93e285-6f3d-4d19-9ebc-fd380d407216 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:41.100338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a93e285-6f3d-4d19-9ebc-fd380d407216 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:41.100753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a93e285-6f3d-4d19-9ebc-fd380d407216 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:41.101453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a93e285-6f3d-4d19-9ebc-fd380d407216 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:41.101906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a93e285-6f3d-4d19-9ebc-fd380d407216 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:41.102329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4a93e285-6f3d-4d19-9ebc-fd380d407216 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:41.129441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a93e285-6f3d-4d19-9ebc-fd380d407216 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:27:41.211218 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a93e285-6f3d-4d19-9ebc-fd380d407216 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 204 len: 0 microversion: 2.1 time: 0.123974 Aug 09 18:27:41.214968 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4141/7192] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:27:41 2022] DELETE /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:27:41.220971 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fc8ef66d-1b47-4882-8e6d-d9354fe577b8 req-3adc3f55-8bfd-462a-b534-c713d53b11f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da8cb00-60d0-4995-be9d-e47e87944dbf", "tag": "da3460e8-278a-4d46-85c8-b14fbbf59162"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:41.230814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fc8ef66d-1b47-4882-8e6d-d9354fe577b8 req-3adc3f55-8bfd-462a-b534-c713d53b11f6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:41.231297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fc8ef66d-1b47-4882-8e6d-d9354fe577b8 req-3adc3f55-8bfd-462a-b534-c713d53b11f6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:41.231796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fc8ef66d-1b47-4882-8e6d-d9354fe577b8 req-3adc3f55-8bfd-462a-b534-c713d53b11f6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:41.246642 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fc8ef66d-1b47-4882-8e6d-d9354fe577b8 req-3adc3f55-8bfd-462a-b534-c713d53b11f6 service nova] Creating event network-changed:da3460e8-278a-4d46-85c8-b14fbbf59162 for instance 6da8cb00-60d0-4995-be9d-e47e87944dbf on n-h1-845781-6 Aug 09 18:27:41.251619 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fc8ef66d-1b47-4882-8e6d-d9354fe577b8 req-3adc3f55-8bfd-462a-b534-c713d53b11f6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038388 Aug 09 18:27:41.252249 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4142/7193] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:27:41.257240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-20af3d4e-4f7b-46eb-b7fb-d6e9475952a3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:41.257945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-20af3d4e-4f7b-46eb-b7fb-d6e9475952a3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:41.264299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20af3d4e-4f7b-46eb-b7fb-d6e9475952a3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:41.264790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20af3d4e-4f7b-46eb-b7fb-d6e9475952a3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:41.265240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20af3d4e-4f7b-46eb-b7fb-d6e9475952a3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:41.266002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20af3d4e-4f7b-46eb-b7fb-d6e9475952a3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:41.266466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20af3d4e-4f7b-46eb-b7fb-d6e9475952a3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:41.266901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20af3d4e-4f7b-46eb-b7fb-d6e9475952a3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:41.410342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-20af3d4e-4f7b-46eb-b7fb-d6e9475952a3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:41.418342 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-20af3d4e-4f7b-46eb-b7fb-d6e9475952a3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1686 microversion: 2.1 time: 0.164814 Aug 09 18:27:41.418759 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4143/7194] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:41 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:42.441607 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a856219e-10cf-4c19-8291-d8ed74236136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:42.442285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a856219e-10cf-4c19-8291-d8ed74236136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:42.449049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a856219e-10cf-4c19-8291-d8ed74236136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:42.449542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a856219e-10cf-4c19-8291-d8ed74236136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:42.449991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a856219e-10cf-4c19-8291-d8ed74236136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:42.450686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a856219e-10cf-4c19-8291-d8ed74236136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:42.451148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a856219e-10cf-4c19-8291-d8ed74236136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:42.451578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a856219e-10cf-4c19-8291-d8ed74236136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:42.582609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a856219e-10cf-4c19-8291-d8ed74236136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:42.590452 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a856219e-10cf-4c19-8291-d8ed74236136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1686 microversion: 2.1 time: 0.153544 Aug 09 18:27:42.591043 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4144/7195] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:42 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:27:43.439014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0200cbe8-cc49-4ed2-8110-5d6b1d3914cc req-e23a9c33-c11d-4268-97ca-1e089828422f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da8cb00-60d0-4995-be9d-e47e87944dbf", "name": "network-vif-deleted", "tag": "da3460e8-278a-4d46-85c8-b14fbbf59162"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:43.450706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0200cbe8-cc49-4ed2-8110-5d6b1d3914cc req-e23a9c33-c11d-4268-97ca-1e089828422f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:43.451335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0200cbe8-cc49-4ed2-8110-5d6b1d3914cc req-e23a9c33-c11d-4268-97ca-1e089828422f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:43.451831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0200cbe8-cc49-4ed2-8110-5d6b1d3914cc req-e23a9c33-c11d-4268-97ca-1e089828422f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:43.464097 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0200cbe8-cc49-4ed2-8110-5d6b1d3914cc req-e23a9c33-c11d-4268-97ca-1e089828422f service nova] Creating event network-vif-deleted:da3460e8-278a-4d46-85c8-b14fbbf59162 for instance 6da8cb00-60d0-4995-be9d-e47e87944dbf on n-h1-845781-6 Aug 09 18:27:43.469857 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0200cbe8-cc49-4ed2-8110-5d6b1d3914cc req-e23a9c33-c11d-4268-97ca-1e089828422f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035094 Aug 09 18:27:43.470463 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4145/7196] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:27:43.612848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:43.613475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:43.619780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:43.620266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:43.620696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:43.621383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:43.621836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:43.622258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:43.654342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:43.654748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:43.655199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:43.655724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lazy-loading 'fault' on Instance uuid 6da8cb00-60d0-4995-be9d-e47e87944dbf {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:27:43.699238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:43.707745 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd44ae10-a029-4a9a-ae6d-1393065a3caf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 200 len: 1356 microversion: 2.1 time: 0.099199 Aug 09 18:27:43.708346 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4146/7197] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:43 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:44.728955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:44.729713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 6da8cb00-60d0-4995-be9d-e47e87944dbf] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:44.736517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:44.737011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:44.737458 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:44.738158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:44.738618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:44.739051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:44.752170 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] HTTP exception thrown: Instance 6da8cb00-60d0-4995-be9d-e47e87944dbf could not be found. Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Request method failure captured: Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf HTTP/1.1 Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qbgQVBZovfKtIvw9tWoOSB5InWZd_5SeMZ1Ca-duEVIHXZ_7xzj1ryt6jeanOuQC_1Qth95PjmzO64kWCTB2FZ6iGuFDP2iC8izCzBFo6pSl2i-h8UuuVg_uY5ygbafuEk4pjthQS-RG6ZhqGUZT6Sxuzr3d2Rt6qENN5e0NwE1Sa0 Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 186a3a4a5e7a43fa8cc168e96f28994a Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 186a3a4a5e7a43fa8cc168e96f28994a Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestNetworkAdvancedServerOps-2008998050-project Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 8c34712ceeb54491889acff0f8f2eddd Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2008998050-project Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 6da8cb00-60d0-4995-be9d-e47e87944dbf could not be found. Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '6da8cb00-60d0-4995-be9d-e47e87944dbf'} Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da8cb00-60d0-4995-be9d-e47e87944dbf could not be found. Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da8cb00-60d0-4995-be9d-e47e87944dbf could not be found. Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:27:44.753836 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:27:44.758759 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:27:44.758759 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:27:44.758759 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:27:44.758759 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:27:44.758759 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:27:44.758759 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:27:44.758759 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da8cb00-60d0-4995-be9d-e47e87944dbf could not be found. Aug 09 18:27:44.758759 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:27:44.758759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Returning 404 to user: Instance 6da8cb00-60d0-4995-be9d-e47e87944dbf could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:27:44.758759 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-358508cb-92a1-42c4-ab44-191740bc2a4e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf" status: 404 len: 111 microversion: 2.1 time: 0.030308 Aug 09 18:27:44.758759 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4147/7198] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:44 2022] GET /compute/v2.1/servers/6da8cb00-60d0-4995-be9d-e47e87944dbf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:27:48.116889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b3c43679-42d4-467f-ad3f-abc2de5ad8bd tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '.version_select at 0x7fbbca44eb80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:48.144422 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b3c43679-42d4-467f-ad3f-abc2de5ad8bd tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1565043610" status: 202 len: 0 microversion: 2.1 time: 0.031100 Aug 09 18:27:48.145389 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4148/7199] 10.222.0.93 () {58 vars in 1284 bytes} [Tue Aug 9 18:27:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1565043610 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:27:48.173609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e3476f5-8aaa-4abc-b38b-234cc502dd36 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'create', calling method: .version_select at 0x7fbbca4c4160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-43211818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJZFIONq3rnMdwaa3vcLBv3Rc5AdiR9qzvHRjq7d+VZzGULaGmfQxTshaCs0S3+FjHd9ilikLih1AN/Rx8E3x9d+9PZtrlIF7X/V5xKOBJSagD6ysTru+fvBL+FhGVPww=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:48.190816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-4e3476f5-8aaa-4abc-b38b-234cc502dd36 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:27:48.195917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-4e3476f5-8aaa-4abc-b38b-234cc502dd36 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for user 8c34712ceeb54491889acff0f8f2eddd and project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:27:48.219295 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e3476f5-8aaa-4abc-b38b-234cc502dd36 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049541 Aug 09 18:27:48.220112 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4149/7200] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:27:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:27:53.988209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-754970122", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "8112d27d-fc18-4698-a803-d3f62ad93c5c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-43211818", "security_groups": [{"name": "tempest-secgroup-smoke-690032757"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:54.247309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] validate_networks() for [('8112d27d-fc18-4698-a803-d3f62ad93c5c', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:27:54.682350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:27:54.684323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:27:54.685023 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:27:54.685777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:27:54.686451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:27:54.698269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:54.699100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:54.699672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:54.700512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:54.701067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:54.701610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:54.710398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:27:54.725231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:27:54.732302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for user 8c34712ceeb54491889acff0f8f2eddd and project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:27:54.748795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:27:54.751789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:27:54.827667 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-92bad7ae-6746-455d-8125-8bfe0844d325 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.843188 Aug 09 18:27:54.836029 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4150/7201] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:27:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:27:54.842305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a0c9507f-64f2-437c-9eec-c90cb636afa3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:54.842305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a0c9507f-64f2-437c-9eec-c90cb636afa3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:54.902006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a0c9507f-64f2-437c-9eec-c90cb636afa3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:54.911608 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a0c9507f-64f2-437c-9eec-c90cb636afa3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1264 microversion: 2.1 time: 0.074286 Aug 09 18:27:54.912799 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4151/7202] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:54 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1264 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:55.937491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8c10795b-da92-4f37-84b0-e242d64921b1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:55.938948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8c10795b-da92-4f37-84b0-e242d64921b1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:55.950743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c10795b-da92-4f37-84b0-e242d64921b1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:55.951656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c10795b-da92-4f37-84b0-e242d64921b1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:55.953557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c10795b-da92-4f37-84b0-e242d64921b1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:55.954452 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c10795b-da92-4f37-84b0-e242d64921b1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:55.955079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c10795b-da92-4f37-84b0-e242d64921b1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:55.955949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8c10795b-da92-4f37-84b0-e242d64921b1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:56.084046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8c10795b-da92-4f37-84b0-e242d64921b1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:56.096539 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8c10795b-da92-4f37-84b0-e242d64921b1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1324 microversion: 2.1 time: 0.164552 Aug 09 18:27:56.097537 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4152/7203] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:55 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1324 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:57.117369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-be1f5c9e-81c1-4f5f-b514-dbabfa4b0cb7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:57.118673 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-be1f5c9e-81c1-4f5f-b514-dbabfa4b0cb7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:57.125575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1f5c9e-81c1-4f5f-b514-dbabfa4b0cb7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:57.126056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1f5c9e-81c1-4f5f-b514-dbabfa4b0cb7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:57.126492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1f5c9e-81c1-4f5f-b514-dbabfa4b0cb7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:57.127197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1f5c9e-81c1-4f5f-b514-dbabfa4b0cb7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:57.127672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1f5c9e-81c1-4f5f-b514-dbabfa4b0cb7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:57.128099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-be1f5c9e-81c1-4f5f-b514-dbabfa4b0cb7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:57.375524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-be1f5c9e-81c1-4f5f-b514-dbabfa4b0cb7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:57.383433 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-be1f5c9e-81c1-4f5f-b514-dbabfa4b0cb7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1389 microversion: 2.1 time: 0.270074 Aug 09 18:27:57.384221 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4153/7204] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:57 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1389 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:27:57.509509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-9dc5cb2c-de9e-4716-9082-1b6f4cb4afbd req-68608e11-01e6-4697-9a9f-9f07d23652dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86266ed9-46bb-4703-b742-a6e7851acb9b", "tag": "f6450bcb-2a9d-4367-a031-c4e612e7be9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:27:57.523318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9dc5cb2c-de9e-4716-9082-1b6f4cb4afbd req-68608e11-01e6-4697-9a9f-9f07d23652dd service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:57.524073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9dc5cb2c-de9e-4716-9082-1b6f4cb4afbd req-68608e11-01e6-4697-9a9f-9f07d23652dd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:57.524703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-9dc5cb2c-de9e-4716-9082-1b6f4cb4afbd req-68608e11-01e6-4697-9a9f-9f07d23652dd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:57.537725 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-9dc5cb2c-de9e-4716-9082-1b6f4cb4afbd req-68608e11-01e6-4697-9a9f-9f07d23652dd service nova] Creating event network-changed:f6450bcb-2a9d-4367-a031-c4e612e7be9a for instance 86266ed9-46bb-4703-b742-a6e7851acb9b on n-h2-845781-6 Aug 09 18:27:57.543210 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-9dc5cb2c-de9e-4716-9082-1b6f4cb4afbd req-68608e11-01e6-4697-9a9f-9f07d23652dd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037489 Aug 09 18:27:57.543849 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4154/7205] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:27:58.404816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8a3667ee-d53f-4f2e-aa44-d1c1d2a4c04a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:58.405526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8a3667ee-d53f-4f2e-aa44-d1c1d2a4c04a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:58.412695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3667ee-d53f-4f2e-aa44-d1c1d2a4c04a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:58.413186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3667ee-d53f-4f2e-aa44-d1c1d2a4c04a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:58.413630 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3667ee-d53f-4f2e-aa44-d1c1d2a4c04a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:58.414325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3667ee-d53f-4f2e-aa44-d1c1d2a4c04a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:58.414790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3667ee-d53f-4f2e-aa44-d1c1d2a4c04a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:58.415219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a3667ee-d53f-4f2e-aa44-d1c1d2a4c04a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:58.556533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8a3667ee-d53f-4f2e-aa44-d1c1d2a4c04a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:58.564379 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8a3667ee-d53f-4f2e-aa44-d1c1d2a4c04a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1389 microversion: 2.1 time: 0.164059 Aug 09 18:27:58.564989 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4155/7206] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:58 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:27:59.584653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e11a06db-a8ac-4725-9275-6d7ba9185b2a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:27:59.585309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e11a06db-a8ac-4725-9275-6d7ba9185b2a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:27:59.592183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11a06db-a8ac-4725-9275-6d7ba9185b2a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:59.593320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11a06db-a8ac-4725-9275-6d7ba9185b2a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:59.593769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11a06db-a8ac-4725-9275-6d7ba9185b2a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:59.594491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11a06db-a8ac-4725-9275-6d7ba9185b2a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:27:59.594935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11a06db-a8ac-4725-9275-6d7ba9185b2a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:27:59.595373 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e11a06db-a8ac-4725-9275-6d7ba9185b2a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:27:59.731545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e11a06db-a8ac-4725-9275-6d7ba9185b2a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:27:59.739214 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e11a06db-a8ac-4725-9275-6d7ba9185b2a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1389 microversion: 2.1 time: 0.158453 Aug 09 18:27:59.739837 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4156/7207] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:27:59 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:00.760018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-42e56256-5381-461b-8973-db013fa223c3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:00.760668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-42e56256-5381-461b-8973-db013fa223c3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:00.767513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e56256-5381-461b-8973-db013fa223c3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:00.768031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e56256-5381-461b-8973-db013fa223c3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:00.768480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e56256-5381-461b-8973-db013fa223c3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:00.769196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e56256-5381-461b-8973-db013fa223c3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:00.769656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e56256-5381-461b-8973-db013fa223c3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:00.770092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-42e56256-5381-461b-8973-db013fa223c3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:00.908353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-42e56256-5381-461b-8973-db013fa223c3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:00.916018 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-42e56256-5381-461b-8973-db013fa223c3 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1389 microversion: 2.1 time: 0.159989 Aug 09 18:28:00.916608 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4157/7208] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:00 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:01.938411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c62c3c11-f49f-4c6b-a65b-f828274686df tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:01.939171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c62c3c11-f49f-4c6b-a65b-f828274686df tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:01.946070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62c3c11-f49f-4c6b-a65b-f828274686df tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:01.946562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62c3c11-f49f-4c6b-a65b-f828274686df tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:01.947027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62c3c11-f49f-4c6b-a65b-f828274686df tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:01.947762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62c3c11-f49f-4c6b-a65b-f828274686df tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:01.948227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62c3c11-f49f-4c6b-a65b-f828274686df tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:01.948656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c62c3c11-f49f-4c6b-a65b-f828274686df tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:02.085455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c62c3c11-f49f-4c6b-a65b-f828274686df tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:02.093071 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c62c3c11-f49f-4c6b-a65b-f828274686df tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1389 microversion: 2.1 time: 0.159345 Aug 09 18:28:02.093705 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4158/7209] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:01 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:02.225077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-68d26308-5be5-417f-8f4d-aa6b2b02a2b0 req-463d033f-2dcb-417f-88f3-6d5e9dfa64f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86266ed9-46bb-4703-b742-a6e7851acb9b", "name": "network-vif-plugged", "status": "completed", "tag": "f6450bcb-2a9d-4367-a031-c4e612e7be9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:28:02.235466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-68d26308-5be5-417f-8f4d-aa6b2b02a2b0 req-463d033f-2dcb-417f-88f3-6d5e9dfa64f6 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:02.236004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-68d26308-5be5-417f-8f4d-aa6b2b02a2b0 req-463d033f-2dcb-417f-88f3-6d5e9dfa64f6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:02.236446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-68d26308-5be5-417f-8f4d-aa6b2b02a2b0 req-463d033f-2dcb-417f-88f3-6d5e9dfa64f6 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:02.247923 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-68d26308-5be5-417f-8f4d-aa6b2b02a2b0 req-463d033f-2dcb-417f-88f3-6d5e9dfa64f6 service nova] Creating event network-vif-plugged:f6450bcb-2a9d-4367-a031-c4e612e7be9a for instance 86266ed9-46bb-4703-b742-a6e7851acb9b on n-h2-845781-6 Aug 09 18:28:02.252907 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-68d26308-5be5-417f-8f4d-aa6b2b02a2b0 req-463d033f-2dcb-417f-88f3-6d5e9dfa64f6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 Aug 09 18:28:02.253920 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4159/7210] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:28:03.115383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-84b46825-ca57-46b8-b958-53f29a34093a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:03.116137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-84b46825-ca57-46b8-b958-53f29a34093a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:03.122317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b46825-ca57-46b8-b958-53f29a34093a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:03.122802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b46825-ca57-46b8-b958-53f29a34093a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:03.123248 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b46825-ca57-46b8-b958-53f29a34093a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:03.124449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b46825-ca57-46b8-b958-53f29a34093a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:03.124927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b46825-ca57-46b8-b958-53f29a34093a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:03.125332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-84b46825-ca57-46b8-b958-53f29a34093a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:03.257103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-84b46825-ca57-46b8-b958-53f29a34093a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:03.265213 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-84b46825-ca57-46b8-b958-53f29a34093a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1389 microversion: 2.1 time: 0.154953 Aug 09 18:28:03.265789 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4160/7211] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:03 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:04.287083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-403bd680-d750-4264-a959-112cbd2f7c0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:04.287730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-403bd680-d750-4264-a959-112cbd2f7c0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:04.294548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-403bd680-d750-4264-a959-112cbd2f7c0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:04.295045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-403bd680-d750-4264-a959-112cbd2f7c0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:04.295490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-403bd680-d750-4264-a959-112cbd2f7c0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:04.296240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-403bd680-d750-4264-a959-112cbd2f7c0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:04.296705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-403bd680-d750-4264-a959-112cbd2f7c0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:04.297143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-403bd680-d750-4264-a959-112cbd2f7c0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:04.430674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-403bd680-d750-4264-a959-112cbd2f7c0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:04.439129 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-403bd680-d750-4264-a959-112cbd2f7c0b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1561 microversion: 2.1 time: 0.155955 Aug 09 18:28:04.439739 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4161/7212] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:04 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:04.459617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5ae9d695-ec08-42cc-a2d5-c3fb0dde6565 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:04.460266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5ae9d695-ec08-42cc-a2d5-c3fb0dde6565 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:04.466157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae9d695-ec08-42cc-a2d5-c3fb0dde6565 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:04.466654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae9d695-ec08-42cc-a2d5-c3fb0dde6565 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:04.467104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae9d695-ec08-42cc-a2d5-c3fb0dde6565 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:04.467838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae9d695-ec08-42cc-a2d5-c3fb0dde6565 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:04.468301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae9d695-ec08-42cc-a2d5-c3fb0dde6565 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:04.468736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5ae9d695-ec08-42cc-a2d5-c3fb0dde6565 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:04.599965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5ae9d695-ec08-42cc-a2d5-c3fb0dde6565 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:04.607964 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5ae9d695-ec08-42cc-a2d5-c3fb0dde6565 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1561 microversion: 2.1 time: 0.151976 Aug 09 18:28:04.608551 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4162/7213] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:04 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:06.531236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-850d5488-594b-48f6-b738-981e860c2600 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:06.531948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-850d5488-594b-48f6-b738-981e860c2600 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:06.535067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:06.535888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:06.537742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:06.542774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-850d5488-594b-48f6-b738-981e860c2600 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:06.543276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-850d5488-594b-48f6-b738-981e860c2600 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:06.543756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-850d5488-594b-48f6-b738-981e860c2600 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:06.544493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-850d5488-594b-48f6-b738-981e860c2600 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:06.544967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-850d5488-594b-48f6-b738-981e860c2600 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:06.545411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-850d5488-594b-48f6-b738-981e860c2600 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:06.691134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-850d5488-594b-48f6-b738-981e860c2600 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:06.698926 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-850d5488-594b-48f6-b738-981e860c2600 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1561 microversion: 2.1 time: 0.172240 Aug 09 18:28:06.699647 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4163/7214] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:06 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:06.712515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-7c6b0b41-ddde-445b-a03a-d0f197026d71 req-7ba2420e-ad53-44c1-a318-73261a3c6c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86266ed9-46bb-4703-b742-a6e7851acb9b", "tag": "f6450bcb-2a9d-4367-a031-c4e612e7be9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:28:06.722397 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7c6b0b41-ddde-445b-a03a-d0f197026d71 req-7ba2420e-ad53-44c1-a318-73261a3c6c22 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:06.724472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7c6b0b41-ddde-445b-a03a-d0f197026d71 req-7ba2420e-ad53-44c1-a318-73261a3c6c22 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:06.724472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7c6b0b41-ddde-445b-a03a-d0f197026d71 req-7ba2420e-ad53-44c1-a318-73261a3c6c22 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:06.734931 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-7c6b0b41-ddde-445b-a03a-d0f197026d71 req-7ba2420e-ad53-44c1-a318-73261a3c6c22 service nova] Creating event network-changed:f6450bcb-2a9d-4367-a031-c4e612e7be9a for instance 86266ed9-46bb-4703-b742-a6e7851acb9b on n-h2-845781-6 Aug 09 18:28:06.740108 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-7c6b0b41-ddde-445b-a03a-d0f197026d71 req-7ba2420e-ad53-44c1-a318-73261a3c6c22 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031110 Aug 09 18:28:06.741080 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4164/7215] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:28:27.949980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:27.950821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=66 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:27.955440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c0872230-35c1-4ec1-8932-488753fe6ed7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:28:27.957743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c0872230-35c1-4ec1-8932-488753fe6ed7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:27.964695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0872230-35c1-4ec1-8932-488753fe6ed7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:27.965181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0872230-35c1-4ec1-8932-488753fe6ed7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:27.966109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0872230-35c1-4ec1-8932-488753fe6ed7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:27.966808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0872230-35c1-4ec1-8932-488753fe6ed7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:27.967261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0872230-35c1-4ec1-8932-488753fe6ed7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:27.967715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0872230-35c1-4ec1-8932-488753fe6ed7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:28.019026 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c0872230-35c1-4ec1-8932-488753fe6ed7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b/action" status: 200 len: 24571 microversion: 2.1 time: 0.071050 Aug 09 18:28:28.019957 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4165/7216] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:28:27 2022] POST /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:28:39.075415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4d039b63-1252-4ffe-9dfb-7f4e194e8bea tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:28:39.077717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4d039b63-1252-4ffe-9dfb-7f4e194e8bea tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:39.080726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:39.081393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:39.088643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d039b63-1252-4ffe-9dfb-7f4e194e8bea tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:39.089138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d039b63-1252-4ffe-9dfb-7f4e194e8bea tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:39.089587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d039b63-1252-4ffe-9dfb-7f4e194e8bea tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:39.090785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d039b63-1252-4ffe-9dfb-7f4e194e8bea tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:39.091249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d039b63-1252-4ffe-9dfb-7f4e194e8bea tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:39.091714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d039b63-1252-4ffe-9dfb-7f4e194e8bea tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:39.170530 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4d039b63-1252-4ffe-9dfb-7f4e194e8bea tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b/action" status: 202 len: 0 microversion: 2.1 time: 0.099166 Aug 09 18:28:39.171340 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4166/7217] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:28:39 2022] POST /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:28:39.180245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2b6bd866-7ecd-4e98-baab-f8693403e087 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:39.180958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2b6bd866-7ecd-4e98-baab-f8693403e087 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:39.187604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b6bd866-7ecd-4e98-baab-f8693403e087 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:39.188207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b6bd866-7ecd-4e98-baab-f8693403e087 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:39.188751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b6bd866-7ecd-4e98-baab-f8693403e087 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:39.189625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b6bd866-7ecd-4e98-baab-f8693403e087 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:39.190091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b6bd866-7ecd-4e98-baab-f8693403e087 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:39.190534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2b6bd866-7ecd-4e98-baab-f8693403e087 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:39.410156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2b6bd866-7ecd-4e98-baab-f8693403e087 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:39.417694 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2b6bd866-7ecd-4e98-baab-f8693403e087 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1671 microversion: 2.1 time: 0.241639 Aug 09 18:28:39.418339 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4167/7218] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:39 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1671 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:40.440429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f9554403-d28f-40bd-bccf-de1fc4eabe41 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:40.441114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f9554403-d28f-40bd-bccf-de1fc4eabe41 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:40.447861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9554403-d28f-40bd-bccf-de1fc4eabe41 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:40.448351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9554403-d28f-40bd-bccf-de1fc4eabe41 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:40.448789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9554403-d28f-40bd-bccf-de1fc4eabe41 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:40.449484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9554403-d28f-40bd-bccf-de1fc4eabe41 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:40.449944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9554403-d28f-40bd-bccf-de1fc4eabe41 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:40.450371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9554403-d28f-40bd-bccf-de1fc4eabe41 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:40.582522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f9554403-d28f-40bd-bccf-de1fc4eabe41 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:40.590543 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f9554403-d28f-40bd-bccf-de1fc4eabe41 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.153558 Aug 09 18:28:40.591115 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4168/7219] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:40 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:41.611849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-126a788d-618d-4205-82fe-97b9388cf094 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:41.612536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-126a788d-618d-4205-82fe-97b9388cf094 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:41.619310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126a788d-618d-4205-82fe-97b9388cf094 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:41.619835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126a788d-618d-4205-82fe-97b9388cf094 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:41.620283 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126a788d-618d-4205-82fe-97b9388cf094 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:41.621007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126a788d-618d-4205-82fe-97b9388cf094 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:41.621471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126a788d-618d-4205-82fe-97b9388cf094 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:41.621904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-126a788d-618d-4205-82fe-97b9388cf094 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:41.753517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-126a788d-618d-4205-82fe-97b9388cf094 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:41.761008 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-126a788d-618d-4205-82fe-97b9388cf094 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.153164 Aug 09 18:28:41.762096 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4169/7220] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:41 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:42.783115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1672c355-c6d9-49d1-b96b-a6ca36c14735 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:42.783825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1672c355-c6d9-49d1-b96b-a6ca36c14735 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:42.790677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1672c355-c6d9-49d1-b96b-a6ca36c14735 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:42.791155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1672c355-c6d9-49d1-b96b-a6ca36c14735 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:42.791591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1672c355-c6d9-49d1-b96b-a6ca36c14735 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:42.792310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1672c355-c6d9-49d1-b96b-a6ca36c14735 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:42.793361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1672c355-c6d9-49d1-b96b-a6ca36c14735 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:42.793793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1672c355-c6d9-49d1-b96b-a6ca36c14735 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:42.929219 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1672c355-c6d9-49d1-b96b-a6ca36c14735 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:42.936688 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1672c355-c6d9-49d1-b96b-a6ca36c14735 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.157445 Aug 09 18:28:42.937269 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4170/7221] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:42 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:43.958015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-62d3c17e-aed8-4a9d-99af-7ef2bb864400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:43.958692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-62d3c17e-aed8-4a9d-99af-7ef2bb864400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:43.965595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62d3c17e-aed8-4a9d-99af-7ef2bb864400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:43.966083 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62d3c17e-aed8-4a9d-99af-7ef2bb864400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:43.966569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62d3c17e-aed8-4a9d-99af-7ef2bb864400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:43.967268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62d3c17e-aed8-4a9d-99af-7ef2bb864400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:43.967759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62d3c17e-aed8-4a9d-99af-7ef2bb864400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:43.968194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-62d3c17e-aed8-4a9d-99af-7ef2bb864400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:44.100595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-62d3c17e-aed8-4a9d-99af-7ef2bb864400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:44.108706 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-62d3c17e-aed8-4a9d-99af-7ef2bb864400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.154624 Aug 09 18:28:44.109284 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4171/7222] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:43 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:45.130325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-58b595b4-8403-4bc8-882f-52fe3f5a7340 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:45.131046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-58b595b4-8403-4bc8-882f-52fe3f5a7340 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:45.138437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b595b4-8403-4bc8-882f-52fe3f5a7340 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:45.138925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b595b4-8403-4bc8-882f-52fe3f5a7340 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:45.139369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b595b4-8403-4bc8-882f-52fe3f5a7340 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:45.140110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b595b4-8403-4bc8-882f-52fe3f5a7340 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:45.140564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b595b4-8403-4bc8-882f-52fe3f5a7340 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:45.140995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58b595b4-8403-4bc8-882f-52fe3f5a7340 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:45.284828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-58b595b4-8403-4bc8-882f-52fe3f5a7340 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:45.292351 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-58b595b4-8403-4bc8-882f-52fe3f5a7340 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.165890 Aug 09 18:28:45.293427 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4172/7223] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:45 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:46.313770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2f476eca-69e6-4ad2-9e6f-c45781f70b43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:46.314632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2f476eca-69e6-4ad2-9e6f-c45781f70b43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:46.322161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f476eca-69e6-4ad2-9e6f-c45781f70b43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:46.322661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f476eca-69e6-4ad2-9e6f-c45781f70b43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:46.323170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f476eca-69e6-4ad2-9e6f-c45781f70b43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:46.324382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f476eca-69e6-4ad2-9e6f-c45781f70b43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:46.325551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f476eca-69e6-4ad2-9e6f-c45781f70b43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:46.325990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f476eca-69e6-4ad2-9e6f-c45781f70b43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:46.461643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2f476eca-69e6-4ad2-9e6f-c45781f70b43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:46.469540 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2f476eca-69e6-4ad2-9e6f-c45781f70b43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.159531 Aug 09 18:28:46.470112 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4173/7224] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:46 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:47.490484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b29976f4-d575-48e8-8fe2-a78612fd50cf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:47.491170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b29976f4-d575-48e8-8fe2-a78612fd50cf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:47.497901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b29976f4-d575-48e8-8fe2-a78612fd50cf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:47.498388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b29976f4-d575-48e8-8fe2-a78612fd50cf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:47.498832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b29976f4-d575-48e8-8fe2-a78612fd50cf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:47.499523 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b29976f4-d575-48e8-8fe2-a78612fd50cf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:47.500009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b29976f4-d575-48e8-8fe2-a78612fd50cf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:47.500439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b29976f4-d575-48e8-8fe2-a78612fd50cf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:47.634444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b29976f4-d575-48e8-8fe2-a78612fd50cf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:47.642540 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b29976f4-d575-48e8-8fe2-a78612fd50cf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.156023 Aug 09 18:28:47.643113 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4174/7225] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:47 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:48.664945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-93eab453-5a2c-4f95-baa4-8dcbd563a144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:48.665700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-93eab453-5a2c-4f95-baa4-8dcbd563a144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:48.672485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93eab453-5a2c-4f95-baa4-8dcbd563a144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:48.672985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93eab453-5a2c-4f95-baa4-8dcbd563a144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:48.673425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93eab453-5a2c-4f95-baa4-8dcbd563a144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:48.674123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93eab453-5a2c-4f95-baa4-8dcbd563a144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:48.674576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93eab453-5a2c-4f95-baa4-8dcbd563a144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:48.675017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-93eab453-5a2c-4f95-baa4-8dcbd563a144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:48.819721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-93eab453-5a2c-4f95-baa4-8dcbd563a144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:48.827218 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-93eab453-5a2c-4f95-baa4-8dcbd563a144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.166231 Aug 09 18:28:48.827911 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4175/7226] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:48 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:49.849391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-855879ad-b111-43b5-9240-3578aea3f074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:49.850011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-855879ad-b111-43b5-9240-3578aea3f074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:49.857781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-855879ad-b111-43b5-9240-3578aea3f074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:49.858288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-855879ad-b111-43b5-9240-3578aea3f074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:49.858727 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-855879ad-b111-43b5-9240-3578aea3f074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:49.859460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-855879ad-b111-43b5-9240-3578aea3f074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:49.859940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-855879ad-b111-43b5-9240-3578aea3f074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:49.860374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-855879ad-b111-43b5-9240-3578aea3f074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:49.994546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-855879ad-b111-43b5-9240-3578aea3f074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:50.002880 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-855879ad-b111-43b5-9240-3578aea3f074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.157385 Aug 09 18:28:50.003466 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4176/7227] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:49 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:51.026406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b31f9b68-ec43-462b-94f6-13093cfb50a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:51.027071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b31f9b68-ec43-462b-94f6-13093cfb50a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:51.033954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b31f9b68-ec43-462b-94f6-13093cfb50a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:51.034441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b31f9b68-ec43-462b-94f6-13093cfb50a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:51.034882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b31f9b68-ec43-462b-94f6-13093cfb50a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:51.035650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b31f9b68-ec43-462b-94f6-13093cfb50a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:51.036081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b31f9b68-ec43-462b-94f6-13093cfb50a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:51.036514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b31f9b68-ec43-462b-94f6-13093cfb50a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:51.173079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b31f9b68-ec43-462b-94f6-13093cfb50a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:51.180545 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b31f9b68-ec43-462b-94f6-13093cfb50a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.158072 Aug 09 18:28:51.181125 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4177/7228] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:51 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:52.202853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3a24cf29-26a9-4b69-8377-9e2ac5b54fa6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:52.203569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3a24cf29-26a9-4b69-8377-9e2ac5b54fa6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:52.210369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a24cf29-26a9-4b69-8377-9e2ac5b54fa6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:52.210864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a24cf29-26a9-4b69-8377-9e2ac5b54fa6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:52.211309 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a24cf29-26a9-4b69-8377-9e2ac5b54fa6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:52.212033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a24cf29-26a9-4b69-8377-9e2ac5b54fa6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:52.212495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a24cf29-26a9-4b69-8377-9e2ac5b54fa6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:52.212932 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a24cf29-26a9-4b69-8377-9e2ac5b54fa6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:52.350224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3a24cf29-26a9-4b69-8377-9e2ac5b54fa6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:52.357780 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3a24cf29-26a9-4b69-8377-9e2ac5b54fa6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.159383 Aug 09 18:28:52.358364 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4178/7229] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:52 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:53.378792 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-50d24725-3b18-4d7c-961a-76ac759922d6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:53.379470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-50d24725-3b18-4d7c-961a-76ac759922d6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:53.392432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d24725-3b18-4d7c-961a-76ac759922d6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:53.392819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d24725-3b18-4d7c-961a-76ac759922d6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:53.393269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d24725-3b18-4d7c-961a-76ac759922d6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:53.393999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d24725-3b18-4d7c-961a-76ac759922d6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:53.394461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d24725-3b18-4d7c-961a-76ac759922d6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:53.394897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-50d24725-3b18-4d7c-961a-76ac759922d6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:53.531933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-50d24725-3b18-4d7c-961a-76ac759922d6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:53.539456 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-50d24725-3b18-4d7c-961a-76ac759922d6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.164608 Aug 09 18:28:53.540072 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4179/7230] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:53 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:54.561158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-28d902a2-3c2b-4128-a699-7fa3cf112902 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:54.561850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-28d902a2-3c2b-4128-a699-7fa3cf112902 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:54.568695 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28d902a2-3c2b-4128-a699-7fa3cf112902 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:54.569190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28d902a2-3c2b-4128-a699-7fa3cf112902 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:54.569635 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28d902a2-3c2b-4128-a699-7fa3cf112902 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:54.570337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28d902a2-3c2b-4128-a699-7fa3cf112902 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:54.570798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28d902a2-3c2b-4128-a699-7fa3cf112902 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:54.571233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-28d902a2-3c2b-4128-a699-7fa3cf112902 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:54.707257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-28d902a2-3c2b-4128-a699-7fa3cf112902 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:54.715430 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-28d902a2-3c2b-4128-a699-7fa3cf112902 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1676 microversion: 2.1 time: 0.159006 Aug 09 18:28:54.716046 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4180/7231] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:54 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:28:55.736957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6ab31dbc-4fd7-42fe-8c73-28cc3f22f144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:28:55.737615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6ab31dbc-4fd7-42fe-8c73-28cc3f22f144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:28:55.744472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ab31dbc-4fd7-42fe-8c73-28cc3f22f144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:55.745439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ab31dbc-4fd7-42fe-8c73-28cc3f22f144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:55.745879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ab31dbc-4fd7-42fe-8c73-28cc3f22f144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:55.746564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ab31dbc-4fd7-42fe-8c73-28cc3f22f144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:28:55.747017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ab31dbc-4fd7-42fe-8c73-28cc3f22f144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:28:55.747442 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6ab31dbc-4fd7-42fe-8c73-28cc3f22f144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:28:55.765681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:28:55.880819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6ab31dbc-4fd7-42fe-8c73-28cc3f22f144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:28:55.888458 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6ab31dbc-4fd7-42fe-8c73-28cc3f22f144 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1679 microversion: 2.1 time: 0.155447 Aug 09 18:28:55.889042 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4181/7232] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:28:55 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:20.076810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a12b9a6a-221d-4cd9-b717-fd3ab03b81ef tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:29:20.079014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a12b9a6a-221d-4cd9-b717-fd3ab03b81ef tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:20.081882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=32 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:29:20.082766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:29:20.089104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a12b9a6a-221d-4cd9-b717-fd3ab03b81ef tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:20.089713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a12b9a6a-221d-4cd9-b717-fd3ab03b81ef tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:20.090173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a12b9a6a-221d-4cd9-b717-fd3ab03b81ef tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:20.090907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a12b9a6a-221d-4cd9-b717-fd3ab03b81ef tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:20.091417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a12b9a6a-221d-4cd9-b717-fd3ab03b81ef tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:20.091929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a12b9a6a-221d-4cd9-b717-fd3ab03b81ef tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:20.147601 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a12b9a6a-221d-4cd9-b717-fd3ab03b81ef tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b/action" status: 200 len: 69376 microversion: 2.1 time: 0.074727 Aug 09 18:29:20.148605 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4182/7233] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:29:20 2022] POST /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b/action => generated 69376 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:29:27.227158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ebe0d3db-899e-4769-940a-4278df8ce353 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:27.227825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ebe0d3db-899e-4769-940a-4278df8ce353 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:27.235553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebe0d3db-899e-4769-940a-4278df8ce353 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:27.236059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebe0d3db-899e-4769-940a-4278df8ce353 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:27.236500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebe0d3db-899e-4769-940a-4278df8ce353 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:27.237190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebe0d3db-899e-4769-940a-4278df8ce353 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:27.237643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebe0d3db-899e-4769-940a-4278df8ce353 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:27.238067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ebe0d3db-899e-4769-940a-4278df8ce353 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:27.264419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ebe0d3db-899e-4769-940a-4278df8ce353 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:29:27.343746 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ebe0d3db-899e-4769-940a-4278df8ce353 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "DELETE /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 204 len: 0 microversion: 2.1 time: 0.121453 Aug 09 18:29:27.344613 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4183/7234] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:29:27 2022] DELETE /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:29:27.406272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-42717256-1d03-4e78-af79-b87314c89edc req-d7041662-f930-4b39-adf7-a3d6ee89fd69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86266ed9-46bb-4703-b742-a6e7851acb9b", "tag": "f6450bcb-2a9d-4367-a031-c4e612e7be9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:29:27.419678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-42717256-1d03-4e78-af79-b87314c89edc req-d7041662-f930-4b39-adf7-a3d6ee89fd69 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:27.420134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-42717256-1d03-4e78-af79-b87314c89edc req-d7041662-f930-4b39-adf7-a3d6ee89fd69 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:27.420569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-42717256-1d03-4e78-af79-b87314c89edc req-d7041662-f930-4b39-adf7-a3d6ee89fd69 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:27.431215 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-42717256-1d03-4e78-af79-b87314c89edc req-d7041662-f930-4b39-adf7-a3d6ee89fd69 service nova] Creating event network-changed:f6450bcb-2a9d-4367-a031-c4e612e7be9a for instance 86266ed9-46bb-4703-b742-a6e7851acb9b on n-h2-845781-6 Aug 09 18:29:27.436196 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-42717256-1d03-4e78-af79-b87314c89edc req-d7041662-f930-4b39-adf7-a3d6ee89fd69 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089945 Aug 09 18:29:27.437001 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4184/7235] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:29:27.441779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a10a345-5004-41f4-bd00-b5c2f9ecede0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:27.442475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a10a345-5004-41f4-bd00-b5c2f9ecede0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:27.449139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a10a345-5004-41f4-bd00-b5c2f9ecede0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:27.449627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a10a345-5004-41f4-bd00-b5c2f9ecede0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:27.450073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a10a345-5004-41f4-bd00-b5c2f9ecede0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:27.450769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a10a345-5004-41f4-bd00-b5c2f9ecede0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:27.451223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a10a345-5004-41f4-bd00-b5c2f9ecede0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:27.451668 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a10a345-5004-41f4-bd00-b5c2f9ecede0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:27.587611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a10a345-5004-41f4-bd00-b5c2f9ecede0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:27.596145 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a10a345-5004-41f4-bd00-b5c2f9ecede0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1685 microversion: 2.1 time: 0.158132 Aug 09 18:29:27.596664 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4185/7236] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:27 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:29:28.618307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ece35c82-c1c8-43ab-b845-d943cdbd4009 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:28.619032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ece35c82-c1c8-43ab-b845-d943cdbd4009 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:28.626659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece35c82-c1c8-43ab-b845-d943cdbd4009 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:28.627152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece35c82-c1c8-43ab-b845-d943cdbd4009 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:28.627602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece35c82-c1c8-43ab-b845-d943cdbd4009 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:28.628332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece35c82-c1c8-43ab-b845-d943cdbd4009 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:28.628793 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece35c82-c1c8-43ab-b845-d943cdbd4009 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:28.629230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ece35c82-c1c8-43ab-b845-d943cdbd4009 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:28.826414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ece35c82-c1c8-43ab-b845-d943cdbd4009 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:28.834102 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ece35c82-c1c8-43ab-b845-d943cdbd4009 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 200 len: 1685 microversion: 2.1 time: 0.219769 Aug 09 18:29:28.834681 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4186/7237] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:28 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 1685 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:29:29.451133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-424cb0e3-5d1c-44db-8fcc-81c471f45cb7 req-bdffaaa9-2bb0-4b2a-af77-6df22f67e5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86266ed9-46bb-4703-b742-a6e7851acb9b", "name": "network-vif-deleted", "tag": "f6450bcb-2a9d-4367-a031-c4e612e7be9a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:29:29.461002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-424cb0e3-5d1c-44db-8fcc-81c471f45cb7 req-bdffaaa9-2bb0-4b2a-af77-6df22f67e5ab service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:29.461480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-424cb0e3-5d1c-44db-8fcc-81c471f45cb7 req-bdffaaa9-2bb0-4b2a-af77-6df22f67e5ab service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:29.461914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-424cb0e3-5d1c-44db-8fcc-81c471f45cb7 req-bdffaaa9-2bb0-4b2a-af77-6df22f67e5ab service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:29.479349 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-424cb0e3-5d1c-44db-8fcc-81c471f45cb7 req-bdffaaa9-2bb0-4b2a-af77-6df22f67e5ab service nova] Creating event network-vif-deleted:f6450bcb-2a9d-4367-a031-c4e612e7be9a for instance 86266ed9-46bb-4703-b742-a6e7851acb9b on n-h2-845781-6 Aug 09 18:29:29.484280 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-424cb0e3-5d1c-44db-8fcc-81c471f45cb7 req-bdffaaa9-2bb0-4b2a-af77-6df22f67e5ab service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036895 Aug 09 18:29:29.484888 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4187/7238] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:29:29.857038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:29.857688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 86266ed9-46bb-4703-b742-a6e7851acb9b] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:29.863879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:29.864364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:29.864804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:29.865493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:29.865948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:29.866376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:29.879612 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] HTTP exception thrown: Instance 86266ed9-46bb-4703-b742-a6e7851acb9b could not be found. Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Request method failure captured: Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b HTTP/1.1 Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qbgQVBZovfKtIvw9tWoOSB5InWZd_5SeMZ1Ca-duEVIHXZ_7xzj1ryt6jeanOuQC_1Qth95PjmzO64kWCTB2FZ6iGuFDP2iC8izCzBFo6pSl2i-h8UuuVg_uY5ygbafuEk4pjthQS-RG6ZhqGUZT6Sxuzr3d2Rt6qENN5e0NwE1Sa0 Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 186a3a4a5e7a43fa8cc168e96f28994a Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 186a3a4a5e7a43fa8cc168e96f28994a Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestNetworkAdvancedServerOps-2008998050-project Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 8c34712ceeb54491889acff0f8f2eddd Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2008998050-project Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 86266ed9-46bb-4703-b742-a6e7851acb9b could not be found. Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '86266ed9-46bb-4703-b742-a6e7851acb9b'} Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86266ed9-46bb-4703-b742-a6e7851acb9b could not be found. Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86266ed9-46bb-4703-b742-a6e7851acb9b could not be found. Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:29:29.881343 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:29:29.886645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:29:29.886645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:29:29.886645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:29:29.886645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:29:29.886645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:29:29.886645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:29:29.886645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86266ed9-46bb-4703-b742-a6e7851acb9b could not be found. Aug 09 18:29:29.886645 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:29:29.886645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Returning 404 to user: Instance 86266ed9-46bb-4703-b742-a6e7851acb9b could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:29:29.886645 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7d044dc7-02f0-4914-80bc-19c9c6e6d27d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b" status: 404 len: 111 microversion: 2.1 time: 0.030596 Aug 09 18:29:29.886645 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4188/7239] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:29 2022] GET /compute/v2.1/servers/86266ed9-46bb-4703-b742-a6e7851acb9b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:29:33.220161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-68976317-be34-40d2-9676-9168ccddb62a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '.version_select at 0x7fbbca7359d0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:33.246998 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-68976317-be34-40d2-9676-9168ccddb62a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-43211818" status: 202 len: 0 microversion: 2.1 time: 0.031345 Aug 09 18:29:33.248060 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4189/7240] 10.222.0.93 () {58 vars in 1278 bytes} [Tue Aug 9 18:29:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-43211818 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:29:33.278544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7a92095d-e911-49e4-916f-e3eb49acdc8d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'create', calling method: .version_select at 0x7fbbca4c45e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-537608220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6pvpYJ7DEYwanwjNBvs0TSrltKXNjcNwjDfC0pydev1kHEepwbeU4cUInZrt5mOxrGQ7LCXViIHVIKdI3GrH89kbgQvIN6AEV/dC+GwJZy/66btN5otkzheLoDXM1J9w=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:29:33.296225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-7a92095d-e911-49e4-916f-e3eb49acdc8d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:29:33.301562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-7a92095d-e911-49e4-916f-e3eb49acdc8d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for user 8c34712ceeb54491889acff0f8f2eddd and project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:29:33.326997 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7a92095d-e911-49e4-916f-e3eb49acdc8d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053064 Aug 09 18:29:33.327606 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4190/7241] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:29:33 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:29:39.343983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1668491139", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "084c941f-438e-40c4-b4c5-2d496a755c92"}], "key_name": "tempest-TestNetworkAdvancedServerOps-537608220", "security_groups": [{"name": "tempest-secgroup-smoke-89000749"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:29:39.472620 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] validate_networks() for [('084c941f-438e-40c4-b4c5-2d496a755c92', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:29:39.871914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:29:39.944684 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:29:39.945487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:29:39.946046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:29:39.946542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:29:39.947106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:29:39.957569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:39.958060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:39.958506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:39.959304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:39.959829 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:39.960313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:39.978786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:29:39.984428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for user 8c34712ceeb54491889acff0f8f2eddd and project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:29:40.003549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:29:40.005901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:29:40.057793 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a7e4749-d1c2-49b5-9b0b-254449186b57 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.717900 Aug 09 18:29:40.065566 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4191/7242] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:29:39 2022] POST /compute/v2.1/servers => generated 404 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:29:40.070991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-344a5d34-288b-4c23-a474-9af35609b6cd tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:40.071275 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-344a5d34-288b-4c23-a474-9af35609b6cd tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:40.131063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-344a5d34-288b-4c23-a474-9af35609b6cd tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:40.140319 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-344a5d34-288b-4c23-a474-9af35609b6cd tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1266 microversion: 2.1 time: 0.073616 Aug 09 18:29:40.140930 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4192/7243] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:40 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:29:41.161090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6ddedf9-b03e-4df6-a49c-b470f6caf70e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:41.161799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e6ddedf9-b03e-4df6-a49c-b470f6caf70e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:41.225455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e6ddedf9-b03e-4df6-a49c-b470f6caf70e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:41.233466 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e6ddedf9-b03e-4df6-a49c-b470f6caf70e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1266 microversion: 2.1 time: 0.076109 Aug 09 18:29:41.234236 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4193/7244] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:41 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:42.254421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c30993c3-78ad-430d-99a9-84a714883191 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:42.255404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c30993c3-78ad-430d-99a9-84a714883191 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:42.313670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c30993c3-78ad-430d-99a9-84a714883191 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:42.321288 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c30993c3-78ad-430d-99a9-84a714883191 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1266 microversion: 2.1 time: 0.070690 Aug 09 18:29:42.322397 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4194/7245] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:42 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1266 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:43.342631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-65b4ad68-8726-4f64-b457-e3402a7b0e52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:43.343250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-65b4ad68-8726-4f64-b457-e3402a7b0e52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:43.398146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-65b4ad68-8726-4f64-b457-e3402a7b0e52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:43.407396 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-65b4ad68-8726-4f64-b457-e3402a7b0e52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1266 microversion: 2.1 time: 0.068863 Aug 09 18:29:43.408077 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4195/7246] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:43 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:44.430647 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-71191e63-2f0d-4047-8e4d-c2a6ed072037 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:44.431846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-71191e63-2f0d-4047-8e4d-c2a6ed072037 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:44.439351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71191e63-2f0d-4047-8e4d-c2a6ed072037 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:44.439886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71191e63-2f0d-4047-8e4d-c2a6ed072037 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:44.440332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71191e63-2f0d-4047-8e4d-c2a6ed072037 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:44.441034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71191e63-2f0d-4047-8e4d-c2a6ed072037 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:44.441499 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71191e63-2f0d-4047-8e4d-c2a6ed072037 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:44.441941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71191e63-2f0d-4047-8e4d-c2a6ed072037 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:44.505670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-71191e63-2f0d-4047-8e4d-c2a6ed072037 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:44.515730 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-71191e63-2f0d-4047-8e4d-c2a6ed072037 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1270 microversion: 2.1 time: 0.088953 Aug 09 18:29:44.516338 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4196/7247] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:44 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:45.536750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-51399caf-ebf8-403b-a9cd-1347ad27de0f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:45.537487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-51399caf-ebf8-403b-a9cd-1347ad27de0f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:45.544873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51399caf-ebf8-403b-a9cd-1347ad27de0f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:45.545371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51399caf-ebf8-403b-a9cd-1347ad27de0f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:45.545818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51399caf-ebf8-403b-a9cd-1347ad27de0f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:45.546560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51399caf-ebf8-403b-a9cd-1347ad27de0f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:45.547022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51399caf-ebf8-403b-a9cd-1347ad27de0f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:45.547805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-51399caf-ebf8-403b-a9cd-1347ad27de0f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:45.656561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-51399caf-ebf8-403b-a9cd-1347ad27de0f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:45.664339 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-51399caf-ebf8-403b-a9cd-1347ad27de0f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1324 microversion: 2.1 time: 0.131359 Aug 09 18:29:45.664819 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4197/7248] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:45 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1324 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:46.519511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d7f8f076-1405-404d-9007-c4340c29b36f req-2244f321-088e-4cea-9f14-ff662eec8bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa36e1be-8552-4203-bff4-2b7e080acc7c", "tag": "d516787a-bc16-4871-9ad6-cf4d0eb51c48"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:29:46.532184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d7f8f076-1405-404d-9007-c4340c29b36f req-2244f321-088e-4cea-9f14-ff662eec8bef service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:46.532698 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d7f8f076-1405-404d-9007-c4340c29b36f req-2244f321-088e-4cea-9f14-ff662eec8bef service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:46.533143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d7f8f076-1405-404d-9007-c4340c29b36f req-2244f321-088e-4cea-9f14-ff662eec8bef service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:46.545821 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d7f8f076-1405-404d-9007-c4340c29b36f req-2244f321-088e-4cea-9f14-ff662eec8bef service nova] Creating event network-changed:d516787a-bc16-4871-9ad6-cf4d0eb51c48 for instance aa36e1be-8552-4203-bff4-2b7e080acc7c on n-h1-845781-6 Aug 09 18:29:46.550627 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d7f8f076-1405-404d-9007-c4340c29b36f req-2244f321-088e-4cea-9f14-ff662eec8bef service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039436 Aug 09 18:29:46.551243 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4198/7249] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:29:46.685825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9049501d-9105-4e61-86a4-7bde4cdc34f0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:46.686654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9049501d-9105-4e61-86a4-7bde4cdc34f0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:46.692767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9049501d-9105-4e61-86a4-7bde4cdc34f0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:46.693257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9049501d-9105-4e61-86a4-7bde4cdc34f0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:46.693696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9049501d-9105-4e61-86a4-7bde4cdc34f0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:46.694387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9049501d-9105-4e61-86a4-7bde4cdc34f0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:46.694843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9049501d-9105-4e61-86a4-7bde4cdc34f0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:46.695266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9049501d-9105-4e61-86a4-7bde4cdc34f0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:46.927877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9049501d-9105-4e61-86a4-7bde4cdc34f0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:46.936184 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9049501d-9105-4e61-86a4-7bde4cdc34f0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1390 microversion: 2.1 time: 0.255093 Aug 09 18:29:46.936783 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4199/7250] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:46 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1390 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:47.956810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e083eab0-b820-451a-883f-7387e9106ac5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:47.957492 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e083eab0-b820-451a-883f-7387e9106ac5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:47.964292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e083eab0-b820-451a-883f-7387e9106ac5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:47.964774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e083eab0-b820-451a-883f-7387e9106ac5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:47.965226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e083eab0-b820-451a-883f-7387e9106ac5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:47.965897 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e083eab0-b820-451a-883f-7387e9106ac5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:47.966352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e083eab0-b820-451a-883f-7387e9106ac5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:47.966776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e083eab0-b820-451a-883f-7387e9106ac5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:48.164059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e083eab0-b820-451a-883f-7387e9106ac5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:48.171723 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e083eab0-b820-451a-883f-7387e9106ac5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1390 microversion: 2.1 time: 0.218786 Aug 09 18:29:48.172589 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4200/7251] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:47 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1390 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:49.193036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4731ea5-ef83-4423-a8d9-69e579b49767 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:49.193728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a4731ea5-ef83-4423-a8d9-69e579b49767 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:49.201074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731ea5-ef83-4423-a8d9-69e579b49767 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:49.201565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731ea5-ef83-4423-a8d9-69e579b49767 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:49.202009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731ea5-ef83-4423-a8d9-69e579b49767 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:49.202708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731ea5-ef83-4423-a8d9-69e579b49767 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:49.203166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731ea5-ef83-4423-a8d9-69e579b49767 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:49.203596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4731ea5-ef83-4423-a8d9-69e579b49767 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:49.340126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a4731ea5-ef83-4423-a8d9-69e579b49767 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:49.347951 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4731ea5-ef83-4423-a8d9-69e579b49767 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1390 microversion: 2.1 time: 0.158806 Aug 09 18:29:49.348527 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4201/7252] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:49 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:50.369231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e3be2c50-db0f-4d26-88bd-c281f175cf5c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:50.370076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e3be2c50-db0f-4d26-88bd-c281f175cf5c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:50.371862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:29:50.373762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:29:50.382627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3be2c50-db0f-4d26-88bd-c281f175cf5c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:50.383351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3be2c50-db0f-4d26-88bd-c281f175cf5c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:50.384047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3be2c50-db0f-4d26-88bd-c281f175cf5c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:50.385108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3be2c50-db0f-4d26-88bd-c281f175cf5c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:50.385808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3be2c50-db0f-4d26-88bd-c281f175cf5c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:50.386459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e3be2c50-db0f-4d26-88bd-c281f175cf5c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:50.531675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e3be2c50-db0f-4d26-88bd-c281f175cf5c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:50.541108 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e3be2c50-db0f-4d26-88bd-c281f175cf5c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1390 microversion: 2.1 time: 0.175792 Aug 09 18:29:50.541703 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4202/7253] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:50 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:51.564332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b25b2bde-a1a5-4761-b1d1-a39f092f8534 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:51.565013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b25b2bde-a1a5-4761-b1d1-a39f092f8534 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:51.572568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25b2bde-a1a5-4761-b1d1-a39f092f8534 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:51.573061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25b2bde-a1a5-4761-b1d1-a39f092f8534 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:51.573501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25b2bde-a1a5-4761-b1d1-a39f092f8534 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:51.574200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25b2bde-a1a5-4761-b1d1-a39f092f8534 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:51.574690 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25b2bde-a1a5-4761-b1d1-a39f092f8534 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:51.575122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25b2bde-a1a5-4761-b1d1-a39f092f8534 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:51.709001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b25b2bde-a1a5-4761-b1d1-a39f092f8534 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:51.718244 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b25b2bde-a1a5-4761-b1d1-a39f092f8534 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1390 microversion: 2.1 time: 0.157585 Aug 09 18:29:51.719408 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4203/7254] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:51 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:52.306910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-80f5a058-ef7d-4611-92f6-17c629fc33db req-34e660c3-427b-4e94-9fa5-07a1cd584c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa36e1be-8552-4203-bff4-2b7e080acc7c", "name": "network-vif-plugged", "status": "completed", "tag": "d516787a-bc16-4871-9ad6-cf4d0eb51c48"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:29:52.316707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-80f5a058-ef7d-4611-92f6-17c629fc33db req-34e660c3-427b-4e94-9fa5-07a1cd584c94 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:52.317191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-80f5a058-ef7d-4611-92f6-17c629fc33db req-34e660c3-427b-4e94-9fa5-07a1cd584c94 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:52.317704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-80f5a058-ef7d-4611-92f6-17c629fc33db req-34e660c3-427b-4e94-9fa5-07a1cd584c94 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:52.329227 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-80f5a058-ef7d-4611-92f6-17c629fc33db req-34e660c3-427b-4e94-9fa5-07a1cd584c94 service nova] Creating event network-vif-plugged:d516787a-bc16-4871-9ad6-cf4d0eb51c48 for instance aa36e1be-8552-4203-bff4-2b7e080acc7c on n-h1-845781-6 Aug 09 18:29:52.334138 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-80f5a058-ef7d-4611-92f6-17c629fc33db req-34e660c3-427b-4e94-9fa5-07a1cd584c94 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088714 Aug 09 18:29:52.334754 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4204/7255] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:29:52.741787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-655c75b4-6f51-4af7-bb84-f1a0ce2d3878 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:52.742506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-655c75b4-6f51-4af7-bb84-f1a0ce2d3878 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:52.749407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-655c75b4-6f51-4af7-bb84-f1a0ce2d3878 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:52.749899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-655c75b4-6f51-4af7-bb84-f1a0ce2d3878 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:52.750349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-655c75b4-6f51-4af7-bb84-f1a0ce2d3878 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:52.751049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-655c75b4-6f51-4af7-bb84-f1a0ce2d3878 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:52.751514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-655c75b4-6f51-4af7-bb84-f1a0ce2d3878 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:52.751976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-655c75b4-6f51-4af7-bb84-f1a0ce2d3878 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:52.886475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-655c75b4-6f51-4af7-bb84-f1a0ce2d3878 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:52.894438 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-655c75b4-6f51-4af7-bb84-f1a0ce2d3878 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1390 microversion: 2.1 time: 0.157785 Aug 09 18:29:52.895022 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4205/7256] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:52 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:53.916259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7f7dba0d-c01d-4ccf-9601-e1a12c81e762 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:53.916951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7f7dba0d-c01d-4ccf-9601-e1a12c81e762 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:53.918968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=18 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:29:53.925416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f7dba0d-c01d-4ccf-9601-e1a12c81e762 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:53.925910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f7dba0d-c01d-4ccf-9601-e1a12c81e762 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:53.926359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f7dba0d-c01d-4ccf-9601-e1a12c81e762 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:53.927068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f7dba0d-c01d-4ccf-9601-e1a12c81e762 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:53.927528 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f7dba0d-c01d-4ccf-9601-e1a12c81e762 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:53.927990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7f7dba0d-c01d-4ccf-9601-e1a12c81e762 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:54.064389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7f7dba0d-c01d-4ccf-9601-e1a12c81e762 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:54.072601 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7f7dba0d-c01d-4ccf-9601-e1a12c81e762 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1562 microversion: 2.1 time: 0.161101 Aug 09 18:29:54.073176 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4206/7257] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:53 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:54.092191 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-73c48080-9f10-417a-a640-3509084bb8f7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:54.092795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-73c48080-9f10-417a-a640-3509084bb8f7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:54.098563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73c48080-9f10-417a-a640-3509084bb8f7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:54.099040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73c48080-9f10-417a-a640-3509084bb8f7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:54.099478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73c48080-9f10-417a-a640-3509084bb8f7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:54.100197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73c48080-9f10-417a-a640-3509084bb8f7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:54.100651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73c48080-9f10-417a-a640-3509084bb8f7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:54.101074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73c48080-9f10-417a-a640-3509084bb8f7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:54.232447 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-73c48080-9f10-417a-a640-3509084bb8f7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:54.240031 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-73c48080-9f10-417a-a640-3509084bb8f7 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1562 microversion: 2.1 time: 0.151656 Aug 09 18:29:54.240601 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4207/7258] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:54 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:29:56.143990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f1d841d1-e032-4ab0-8596-91353e901927 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:29:56.145185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f1d841d1-e032-4ab0-8596-91353e901927 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:29:56.155086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d841d1-e032-4ab0-8596-91353e901927 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:56.155588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d841d1-e032-4ab0-8596-91353e901927 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:56.156089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d841d1-e032-4ab0-8596-91353e901927 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:56.156805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d841d1-e032-4ab0-8596-91353e901927 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:56.157340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d841d1-e032-4ab0-8596-91353e901927 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:56.157915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f1d841d1-e032-4ab0-8596-91353e901927 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:56.297804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f1d841d1-e032-4ab0-8596-91353e901927 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:29:56.305655 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f1d841d1-e032-4ab0-8596-91353e901927 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1562 microversion: 2.1 time: 0.167186 Aug 09 18:29:56.306231 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4208/7259] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:29:56 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:29:56.310858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-29c5d082-3755-471e-9726-27b6f95cfb2f req-7f415cb0-0647-4dae-9eab-162ef4387637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa36e1be-8552-4203-bff4-2b7e080acc7c", "tag": "d516787a-bc16-4871-9ad6-cf4d0eb51c48"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:29:56.320004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-29c5d082-3755-471e-9726-27b6f95cfb2f req-7f415cb0-0647-4dae-9eab-162ef4387637 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:29:56.320795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-29c5d082-3755-471e-9726-27b6f95cfb2f req-7f415cb0-0647-4dae-9eab-162ef4387637 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:29:56.321278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-29c5d082-3755-471e-9726-27b6f95cfb2f req-7f415cb0-0647-4dae-9eab-162ef4387637 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:29:56.332677 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-29c5d082-3755-471e-9726-27b6f95cfb2f req-7f415cb0-0647-4dae-9eab-162ef4387637 service nova] Creating event network-changed:d516787a-bc16-4871-9ad6-cf4d0eb51c48 for instance aa36e1be-8552-4203-bff4-2b7e080acc7c on n-h1-845781-6 Aug 09 18:29:56.339090 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-29c5d082-3755-471e-9726-27b6f95cfb2f req-7f415cb0-0647-4dae-9eab-162ef4387637 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031145 Aug 09 18:29:56.339803 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4209/7260] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:30:19.658769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7ff32feb-e97e-4b16-96b0-094ced00889d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:19.661113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7ff32feb-e97e-4b16-96b0-094ced00889d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:19.664621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=15 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:30:19.665274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=74 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:30:19.671412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff32feb-e97e-4b16-96b0-094ced00889d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:19.671926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff32feb-e97e-4b16-96b0-094ced00889d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:19.672365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff32feb-e97e-4b16-96b0-094ced00889d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:19.673077 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff32feb-e97e-4b16-96b0-094ced00889d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:19.673526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff32feb-e97e-4b16-96b0-094ced00889d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:19.673951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7ff32feb-e97e-4b16-96b0-094ced00889d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:19.731954 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7ff32feb-e97e-4b16-96b0-094ced00889d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c/action" status: 200 len: 24570 microversion: 2.1 time: 0.077214 Aug 09 18:30:19.732648 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4210/7261] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:30:19 2022] POST /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c/action => generated 24570 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:30:30.677710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:30.680592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:30.683259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:30:30.683994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:30:30.694654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:30.695168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:30.695617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:30.696363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:30.696826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:30.697264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:30.739899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:30.747067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Old instance type m1.heat2, new instance type m1.heat {{(pid=119431) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 18:30:30.754399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:30:30.754826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:30:30.755315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:30:30.755764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:30:30.756196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:30:30.827513 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-90bda363-f575-44e0-a7d3-2e865992a44e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c/action" status: 202 len: 0 microversion: 2.1 time: 0.154297 Aug 09 18:30:30.828173 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4211/7262] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:30:30 2022] POST /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:30:30.836251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b2e2746e-9409-4880-a1b0-9a9256f11d52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:30.836861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b2e2746e-9409-4880-a1b0-9a9256f11d52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:30.844274 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2e2746e-9409-4880-a1b0-9a9256f11d52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:30.844762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2e2746e-9409-4880-a1b0-9a9256f11d52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:30.845204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2e2746e-9409-4880-a1b0-9a9256f11d52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:30.845902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2e2746e-9409-4880-a1b0-9a9256f11d52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:30.846360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2e2746e-9409-4880-a1b0-9a9256f11d52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:30.846781 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2e2746e-9409-4880-a1b0-9a9256f11d52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:31.054403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b2e2746e-9409-4880-a1b0-9a9256f11d52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:31.066553 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b2e2746e-9409-4880-a1b0-9a9256f11d52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1689 microversion: 2.1 time: 0.234055 Aug 09 18:30:31.067316 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4212/7263] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:30 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1689 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:32.091340 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-29f3c9c3-b707-41c6-9da4-326040dcbcd9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:32.092354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-29f3c9c3-b707-41c6-9da4-326040dcbcd9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:32.102075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29f3c9c3-b707-41c6-9da4-326040dcbcd9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:32.102582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29f3c9c3-b707-41c6-9da4-326040dcbcd9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:32.103030 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29f3c9c3-b707-41c6-9da4-326040dcbcd9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:32.104541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29f3c9c3-b707-41c6-9da4-326040dcbcd9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:32.105012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29f3c9c3-b707-41c6-9da4-326040dcbcd9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:32.105486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-29f3c9c3-b707-41c6-9da4-326040dcbcd9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:32.263867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-29f3c9c3-b707-41c6-9da4-326040dcbcd9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:32.275056 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-29f3c9c3-b707-41c6-9da4-326040dcbcd9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1689 microversion: 2.1 time: 0.188478 Aug 09 18:30:32.276785 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4213/7264] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:32 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:33.297543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e66c9ea6-3f24-44af-8e3c-262fd3b4ae0d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:33.298216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e66c9ea6-3f24-44af-8e3c-262fd3b4ae0d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:33.305315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66c9ea6-3f24-44af-8e3c-262fd3b4ae0d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:33.305821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66c9ea6-3f24-44af-8e3c-262fd3b4ae0d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:33.306302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66c9ea6-3f24-44af-8e3c-262fd3b4ae0d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:33.307015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66c9ea6-3f24-44af-8e3c-262fd3b4ae0d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:33.307477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66c9ea6-3f24-44af-8e3c-262fd3b4ae0d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:33.307953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e66c9ea6-3f24-44af-8e3c-262fd3b4ae0d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:33.450602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e66c9ea6-3f24-44af-8e3c-262fd3b4ae0d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:33.458260 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e66c9ea6-3f24-44af-8e3c-262fd3b4ae0d tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1694 microversion: 2.1 time: 0.164907 Aug 09 18:30:33.458843 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4214/7265] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:33 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:34.482040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-71ef7248-4204-4b2b-a58b-961c45f84202 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:34.483009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-71ef7248-4204-4b2b-a58b-961c45f84202 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:34.491563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71ef7248-4204-4b2b-a58b-961c45f84202 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:34.492334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71ef7248-4204-4b2b-a58b-961c45f84202 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:34.492779 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71ef7248-4204-4b2b-a58b-961c45f84202 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:34.493682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71ef7248-4204-4b2b-a58b-961c45f84202 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:34.494136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71ef7248-4204-4b2b-a58b-961c45f84202 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:34.494680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-71ef7248-4204-4b2b-a58b-961c45f84202 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:34.646237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-71ef7248-4204-4b2b-a58b-961c45f84202 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:34.654820 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-71ef7248-4204-4b2b-a58b-961c45f84202 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1694 microversion: 2.1 time: 0.177043 Aug 09 18:30:34.655426 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4215/7266] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:34 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:35.678059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-66c27438-f205-47b6-9bc9-535c569a6f52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:35.678795 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-66c27438-f205-47b6-9bc9-535c569a6f52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:35.687576 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c27438-f205-47b6-9bc9-535c569a6f52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:35.688192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c27438-f205-47b6-9bc9-535c569a6f52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:35.688811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c27438-f205-47b6-9bc9-535c569a6f52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:35.689645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c27438-f205-47b6-9bc9-535c569a6f52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:35.690317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c27438-f205-47b6-9bc9-535c569a6f52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:35.690765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-66c27438-f205-47b6-9bc9-535c569a6f52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:35.834862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-66c27438-f205-47b6-9bc9-535c569a6f52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:35.842790 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-66c27438-f205-47b6-9bc9-535c569a6f52 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1694 microversion: 2.1 time: 0.168647 Aug 09 18:30:35.844523 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4216/7267] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:35 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:36.864014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5cdf3759-4fd9-4a5c-9702-fa7d88aaf746 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:36.864715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5cdf3759-4fd9-4a5c-9702-fa7d88aaf746 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:36.872178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cdf3759-4fd9-4a5c-9702-fa7d88aaf746 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:36.872682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cdf3759-4fd9-4a5c-9702-fa7d88aaf746 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:36.873131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cdf3759-4fd9-4a5c-9702-fa7d88aaf746 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:36.873841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cdf3759-4fd9-4a5c-9702-fa7d88aaf746 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:36.874304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cdf3759-4fd9-4a5c-9702-fa7d88aaf746 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:36.874744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5cdf3759-4fd9-4a5c-9702-fa7d88aaf746 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:37.018702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5cdf3759-4fd9-4a5c-9702-fa7d88aaf746 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:37.026268 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5cdf3759-4fd9-4a5c-9702-fa7d88aaf746 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1694 microversion: 2.1 time: 0.166454 Aug 09 18:30:37.026838 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4217/7268] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:36 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:38.048043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d95d6173-5576-4f27-9a12-a6191b1a19b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:38.048736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d95d6173-5576-4f27-9a12-a6191b1a19b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:38.057277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d95d6173-5576-4f27-9a12-a6191b1a19b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:38.057775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d95d6173-5576-4f27-9a12-a6191b1a19b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:38.058215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d95d6173-5576-4f27-9a12-a6191b1a19b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:38.058937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d95d6173-5576-4f27-9a12-a6191b1a19b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:38.059401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d95d6173-5576-4f27-9a12-a6191b1a19b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:38.059879 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d95d6173-5576-4f27-9a12-a6191b1a19b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:38.213105 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d95d6173-5576-4f27-9a12-a6191b1a19b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:38.221477 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d95d6173-5576-4f27-9a12-a6191b1a19b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1694 microversion: 2.1 time: 0.177356 Aug 09 18:30:38.222086 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4218/7269] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:38 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:39.242764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f3e03947-be84-40dc-be6b-ddbd55e5f21f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:39.243360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f3e03947-be84-40dc-be6b-ddbd55e5f21f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:39.250188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e03947-be84-40dc-be6b-ddbd55e5f21f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:39.250671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e03947-be84-40dc-be6b-ddbd55e5f21f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:39.251114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e03947-be84-40dc-be6b-ddbd55e5f21f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:39.251830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e03947-be84-40dc-be6b-ddbd55e5f21f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:39.252281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e03947-be84-40dc-be6b-ddbd55e5f21f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:39.252704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f3e03947-be84-40dc-be6b-ddbd55e5f21f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:39.397973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f3e03947-be84-40dc-be6b-ddbd55e5f21f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:39.405977 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f3e03947-be84-40dc-be6b-ddbd55e5f21f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1694 microversion: 2.1 time: 0.167059 Aug 09 18:30:39.406580 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4219/7270] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:39 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:40.427050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ba9c0cbc-6ff4-472a-aeea-ecbd22a74d29 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:40.427763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ba9c0cbc-6ff4-472a-aeea-ecbd22a74d29 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:40.435074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba9c0cbc-6ff4-472a-aeea-ecbd22a74d29 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:40.435562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba9c0cbc-6ff4-472a-aeea-ecbd22a74d29 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:40.436028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba9c0cbc-6ff4-472a-aeea-ecbd22a74d29 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:40.436728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba9c0cbc-6ff4-472a-aeea-ecbd22a74d29 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:40.437180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba9c0cbc-6ff4-472a-aeea-ecbd22a74d29 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:40.437613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ba9c0cbc-6ff4-472a-aeea-ecbd22a74d29 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:40.585272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ba9c0cbc-6ff4-472a-aeea-ecbd22a74d29 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:40.593595 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ba9c0cbc-6ff4-472a-aeea-ecbd22a74d29 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1694 microversion: 2.1 time: 0.170361 Aug 09 18:30:40.594200 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4220/7271] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:40 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:41.615410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2d36c7fe-5afe-4bbf-9473-94e7aeb0055f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:41.616115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2d36c7fe-5afe-4bbf-9473-94e7aeb0055f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:41.623316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d36c7fe-5afe-4bbf-9473-94e7aeb0055f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:41.623853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d36c7fe-5afe-4bbf-9473-94e7aeb0055f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:41.624303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d36c7fe-5afe-4bbf-9473-94e7aeb0055f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:41.625047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d36c7fe-5afe-4bbf-9473-94e7aeb0055f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:41.625507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d36c7fe-5afe-4bbf-9473-94e7aeb0055f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:41.625938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2d36c7fe-5afe-4bbf-9473-94e7aeb0055f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:41.771617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2d36c7fe-5afe-4bbf-9473-94e7aeb0055f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:41.780397 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2d36c7fe-5afe-4bbf-9473-94e7aeb0055f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1694 microversion: 2.1 time: 0.168788 Aug 09 18:30:41.781370 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4221/7272] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:41 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:42.802483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-05740bd2-3caf-42ec-b978-50d629308072 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:42.803666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-05740bd2-3caf-42ec-b978-50d629308072 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:42.810858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05740bd2-3caf-42ec-b978-50d629308072 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:42.811343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05740bd2-3caf-42ec-b978-50d629308072 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:42.811809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05740bd2-3caf-42ec-b978-50d629308072 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:42.812493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05740bd2-3caf-42ec-b978-50d629308072 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:42.812941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05740bd2-3caf-42ec-b978-50d629308072 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:42.813362 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-05740bd2-3caf-42ec-b978-50d629308072 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:42.966372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-05740bd2-3caf-42ec-b978-50d629308072 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:42.974002 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-05740bd2-3caf-42ec-b978-50d629308072 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1694 microversion: 2.1 time: 0.175424 Aug 09 18:30:42.974621 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4222/7273] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:42 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:43.995496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-de58fd45-d513-4160-b64c-bd9f2d7fb8a4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:43.996226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-de58fd45-d513-4160-b64c-bd9f2d7fb8a4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:44.003017 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de58fd45-d513-4160-b64c-bd9f2d7fb8a4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:44.003503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de58fd45-d513-4160-b64c-bd9f2d7fb8a4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:44.003976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de58fd45-d513-4160-b64c-bd9f2d7fb8a4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:44.004677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de58fd45-d513-4160-b64c-bd9f2d7fb8a4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:44.005136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de58fd45-d513-4160-b64c-bd9f2d7fb8a4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:44.005572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-de58fd45-d513-4160-b64c-bd9f2d7fb8a4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:44.137949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-de58fd45-d513-4160-b64c-bd9f2d7fb8a4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:44.145612 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-de58fd45-d513-4160-b64c-bd9f2d7fb8a4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1694 microversion: 2.1 time: 0.154117 Aug 09 18:30:44.146185 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4223/7274] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:43 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:45.167329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c8eb46d4-06af-4156-99a6-ee34451bc49f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:45.168034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c8eb46d4-06af-4156-99a6-ee34451bc49f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:45.174945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8eb46d4-06af-4156-99a6-ee34451bc49f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:45.175440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8eb46d4-06af-4156-99a6-ee34451bc49f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:45.175913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8eb46d4-06af-4156-99a6-ee34451bc49f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:45.176617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8eb46d4-06af-4156-99a6-ee34451bc49f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:45.177080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8eb46d4-06af-4156-99a6-ee34451bc49f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:45.177517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c8eb46d4-06af-4156-99a6-ee34451bc49f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:45.354580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c8eb46d4-06af-4156-99a6-ee34451bc49f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:45.362408 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c8eb46d4-06af-4156-99a6-ee34451bc49f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1694 microversion: 2.1 time: 0.199090 Aug 09 18:30:45.363001 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4224/7275] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:45 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1694 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:45.942605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-cb26568f-3731-4b90-a42f-2a2d078632e7 req-db79370a-77e6-49d0-9d99-772f22ef643d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa36e1be-8552-4203-bff4-2b7e080acc7c", "name": "network-vif-unplugged", "status": "completed", "tag": "d516787a-bc16-4871-9ad6-cf4d0eb51c48"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:45.952547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cb26568f-3731-4b90-a42f-2a2d078632e7 req-db79370a-77e6-49d0-9d99-772f22ef643d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:45.953058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cb26568f-3731-4b90-a42f-2a2d078632e7 req-db79370a-77e6-49d0-9d99-772f22ef643d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:45.953544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cb26568f-3731-4b90-a42f-2a2d078632e7 req-db79370a-77e6-49d0-9d99-772f22ef643d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:45.967242 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-cb26568f-3731-4b90-a42f-2a2d078632e7 req-db79370a-77e6-49d0-9d99-772f22ef643d service nova] Creating event network-vif-unplugged:d516787a-bc16-4871-9ad6-cf4d0eb51c48 for instance aa36e1be-8552-4203-bff4-2b7e080acc7c on n-h2-845781-6 Aug 09 18:30:45.972982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-cb26568f-3731-4b90-a42f-2a2d078632e7 req-db79370a-77e6-49d0-9d99-772f22ef643d service nova] Instance aa36e1be-8552-4203-bff4-2b7e080acc7c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:30:45.984804 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-cb26568f-3731-4b90-a42f-2a2d078632e7 req-db79370a-77e6-49d0-9d99-772f22ef643d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045960 Aug 09 18:30:45.985632 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4225/7276] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:30:46.385916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f766e295-1f9a-4f84-8e54-0a887a77ddd8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:46.386927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f766e295-1f9a-4f84-8e54-0a887a77ddd8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:46.393654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f766e295-1f9a-4f84-8e54-0a887a77ddd8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:46.394142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f766e295-1f9a-4f84-8e54-0a887a77ddd8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:46.394582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f766e295-1f9a-4f84-8e54-0a887a77ddd8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:46.395399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f766e295-1f9a-4f84-8e54-0a887a77ddd8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:46.395941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f766e295-1f9a-4f84-8e54-0a887a77ddd8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:46.396899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f766e295-1f9a-4f84-8e54-0a887a77ddd8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:46.419086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:30:46.544542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f766e295-1f9a-4f84-8e54-0a887a77ddd8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:46.552853 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f766e295-1f9a-4f84-8e54-0a887a77ddd8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1693 microversion: 2.1 time: 0.172439 Aug 09 18:30:46.553357 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4226/7277] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:46 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:30:47.575301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1b66a4d-6624-4bed-8865-5ac32a3ddd6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:47.576313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e1b66a4d-6624-4bed-8865-5ac32a3ddd6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:47.583359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1b66a4d-6624-4bed-8865-5ac32a3ddd6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:47.584532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1b66a4d-6624-4bed-8865-5ac32a3ddd6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:47.584984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1b66a4d-6624-4bed-8865-5ac32a3ddd6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:47.585708 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1b66a4d-6624-4bed-8865-5ac32a3ddd6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:47.586175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1b66a4d-6624-4bed-8865-5ac32a3ddd6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:47.586609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1b66a4d-6624-4bed-8865-5ac32a3ddd6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:47.729542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e1b66a4d-6624-4bed-8865-5ac32a3ddd6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:47.737468 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1b66a4d-6624-4bed-8865-5ac32a3ddd6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1691 microversion: 2.1 time: 0.166344 Aug 09 18:30:47.738052 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4227/7278] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:47 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:48.026414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d89ac16d-56aa-4311-98ca-ad02b91a1851 req-7b3c3dc1-cce1-4df0-a765-5075332bd169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa36e1be-8552-4203-bff4-2b7e080acc7c", "tag": "d516787a-bc16-4871-9ad6-cf4d0eb51c48"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:48.036468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d89ac16d-56aa-4311-98ca-ad02b91a1851 req-7b3c3dc1-cce1-4df0-a765-5075332bd169 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:48.037000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d89ac16d-56aa-4311-98ca-ad02b91a1851 req-7b3c3dc1-cce1-4df0-a765-5075332bd169 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:48.038100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d89ac16d-56aa-4311-98ca-ad02b91a1851 req-7b3c3dc1-cce1-4df0-a765-5075332bd169 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:48.059636 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d89ac16d-56aa-4311-98ca-ad02b91a1851 req-7b3c3dc1-cce1-4df0-a765-5075332bd169 service nova] Creating event network-changed:d516787a-bc16-4871-9ad6-cf4d0eb51c48 for instance aa36e1be-8552-4203-bff4-2b7e080acc7c on n-h2-845781-6 Aug 09 18:30:48.069365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [req-d89ac16d-56aa-4311-98ca-ad02b91a1851 req-7b3c3dc1-cce1-4df0-a765-5075332bd169 service nova] Instance aa36e1be-8552-4203-bff4-2b7e080acc7c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-845781-6', 'n-h2-845781-6'} {{(pid=119431) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 18:30:48.081964 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d89ac16d-56aa-4311-98ca-ad02b91a1851 req-7b3c3dc1-cce1-4df0-a765-5075332bd169 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060157 Aug 09 18:30:48.083051 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4228/7279] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:30:48.760322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e2e5cf5-10b9-4130-863b-e4fdbb7aa30c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:48.761217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e2e5cf5-10b9-4130-863b-e4fdbb7aa30c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:48.768704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e2e5cf5-10b9-4130-863b-e4fdbb7aa30c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:48.769320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e2e5cf5-10b9-4130-863b-e4fdbb7aa30c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:48.769833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e2e5cf5-10b9-4130-863b-e4fdbb7aa30c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:48.770549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e2e5cf5-10b9-4130-863b-e4fdbb7aa30c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:48.771010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e2e5cf5-10b9-4130-863b-e4fdbb7aa30c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:48.771985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e2e5cf5-10b9-4130-863b-e4fdbb7aa30c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:48.923437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4e2e5cf5-10b9-4130-863b-e4fdbb7aa30c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:48.934446 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e2e5cf5-10b9-4130-863b-e4fdbb7aa30c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1688 microversion: 2.1 time: 0.177634 Aug 09 18:30:48.935277 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4229/7280] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:48 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:48.955706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-79a49ddc-af1d-4feb-b449-61fff5e05d93 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:48.956255 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-79a49ddc-af1d-4feb-b449-61fff5e05d93 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:48.963149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79a49ddc-af1d-4feb-b449-61fff5e05d93 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:48.963669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79a49ddc-af1d-4feb-b449-61fff5e05d93 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:48.964122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79a49ddc-af1d-4feb-b449-61fff5e05d93 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:48.964833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79a49ddc-af1d-4feb-b449-61fff5e05d93 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:48.965552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79a49ddc-af1d-4feb-b449-61fff5e05d93 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:48.965982 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79a49ddc-af1d-4feb-b449-61fff5e05d93 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:49.028961 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-79a49ddc-af1d-4feb-b449-61fff5e05d93 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c/action" status: 204 len: 0 microversion: 2.1 time: 0.077178 Aug 09 18:30:49.029673 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4230/7281] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:30:48 2022] POST /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:30:49.039198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1f84e1a7-409a-4d40-b6b1-2d57a9f7ab15 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:49.040563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1f84e1a7-409a-4d40-b6b1-2d57a9f7ab15 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:49.047102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f84e1a7-409a-4d40-b6b1-2d57a9f7ab15 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:49.048241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f84e1a7-409a-4d40-b6b1-2d57a9f7ab15 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:49.049183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f84e1a7-409a-4d40-b6b1-2d57a9f7ab15 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:49.049527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f84e1a7-409a-4d40-b6b1-2d57a9f7ab15 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:49.049986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f84e1a7-409a-4d40-b6b1-2d57a9f7ab15 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:49.050503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1f84e1a7-409a-4d40-b6b1-2d57a9f7ab15 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:49.297873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1f84e1a7-409a-4d40-b6b1-2d57a9f7ab15 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:49.307580 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1f84e1a7-409a-4d40-b6b1-2d57a9f7ab15 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1688 microversion: 2.1 time: 0.272285 Aug 09 18:30:49.308462 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4231/7282] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:49 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1688 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:49.329555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c7ae94ac-ed6d-4afe-be09-1116213e5d43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:49.330253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c7ae94ac-ed6d-4afe-be09-1116213e5d43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:49.337583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7ae94ac-ed6d-4afe-be09-1116213e5d43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:49.338004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7ae94ac-ed6d-4afe-be09-1116213e5d43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:49.338454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7ae94ac-ed6d-4afe-be09-1116213e5d43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:49.339174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7ae94ac-ed6d-4afe-be09-1116213e5d43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:49.339656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7ae94ac-ed6d-4afe-be09-1116213e5d43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:49.340176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c7ae94ac-ed6d-4afe-be09-1116213e5d43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:49.575380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c7ae94ac-ed6d-4afe-be09-1116213e5d43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:49.583096 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c7ae94ac-ed6d-4afe-be09-1116213e5d43 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1688 microversion: 2.1 time: 0.257457 Aug 09 18:30:49.583797 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4232/7283] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:49 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1688 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:50.604964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6f2a98f-af49-4e3b-909e-7519e0bfc63e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:30:50.605670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b6f2a98f-af49-4e3b-909e-7519e0bfc63e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:30:50.612317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f2a98f-af49-4e3b-909e-7519e0bfc63e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:50.612850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f2a98f-af49-4e3b-909e-7519e0bfc63e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:50.613326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f2a98f-af49-4e3b-909e-7519e0bfc63e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:50.614179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f2a98f-af49-4e3b-909e-7519e0bfc63e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:50.614642 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f2a98f-af49-4e3b-909e-7519e0bfc63e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:50.615717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6f2a98f-af49-4e3b-909e-7519e0bfc63e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:50.749047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b6f2a98f-af49-4e3b-909e-7519e0bfc63e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:30:50.756745 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6f2a98f-af49-4e3b-909e-7519e0bfc63e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1680 microversion: 2.1 time: 0.155688 Aug 09 18:30:50.757317 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4233/7284] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:30:50 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:30:50.987047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5cffdc7c-b046-4ad7-9824-b4f8933dcad6 req-327fafeb-da50-4cf4-8b5c-6f99e277b060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa36e1be-8552-4203-bff4-2b7e080acc7c", "name": "network-vif-plugged", "status": "completed", "tag": "d516787a-bc16-4871-9ad6-cf4d0eb51c48"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:30:50.997797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5cffdc7c-b046-4ad7-9824-b4f8933dcad6 req-327fafeb-da50-4cf4-8b5c-6f99e277b060 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:30:50.998316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5cffdc7c-b046-4ad7-9824-b4f8933dcad6 req-327fafeb-da50-4cf4-8b5c-6f99e277b060 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:30:50.998799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5cffdc7c-b046-4ad7-9824-b4f8933dcad6 req-327fafeb-da50-4cf4-8b5c-6f99e277b060 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:30:51.011423 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5cffdc7c-b046-4ad7-9824-b4f8933dcad6 req-327fafeb-da50-4cf4-8b5c-6f99e277b060 service nova] Creating event network-vif-plugged:d516787a-bc16-4871-9ad6-cf4d0eb51c48 for instance aa36e1be-8552-4203-bff4-2b7e080acc7c on n-h2-845781-6 Aug 09 18:30:51.016593 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5cffdc7c-b046-4ad7-9824-b4f8933dcad6 req-327fafeb-da50-4cf4-8b5c-6f99e277b060 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033423 Aug 09 18:30:51.017419 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4234/7285] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:12.959618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c636c91a-081d-4691-abc1-99c9429896ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:12.964483 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c636c91a-081d-4691-abc1-99c9429896ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:12.968506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=52 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:31:12.969182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:31:12.975367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c636c91a-081d-4691-abc1-99c9429896ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:12.975905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c636c91a-081d-4691-abc1-99c9429896ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:12.976357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c636c91a-081d-4691-abc1-99c9429896ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:12.977080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c636c91a-081d-4691-abc1-99c9429896ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:12.977549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c636c91a-081d-4691-abc1-99c9429896ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:12.977986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c636c91a-081d-4691-abc1-99c9429896ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:13.045625 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c636c91a-081d-4691-abc1-99c9429896ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c/action" status: 200 len: 24578 microversion: 2.1 time: 0.094002 Aug 09 18:31:13.047367 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4235/7286] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:31:12 2022] POST /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c/action => generated 24578 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:31:20.170721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f14b54fd-15ca-4ff1-add4-004ef24eadc5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:20.171381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f14b54fd-15ca-4ff1-add4-004ef24eadc5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:20.178979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f14b54fd-15ca-4ff1-add4-004ef24eadc5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:20.179470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f14b54fd-15ca-4ff1-add4-004ef24eadc5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:20.179944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f14b54fd-15ca-4ff1-add4-004ef24eadc5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:20.180653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f14b54fd-15ca-4ff1-add4-004ef24eadc5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:20.181119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f14b54fd-15ca-4ff1-add4-004ef24eadc5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:20.181552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f14b54fd-15ca-4ff1-add4-004ef24eadc5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:20.210532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f14b54fd-15ca-4ff1-add4-004ef24eadc5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:31:20.307711 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f14b54fd-15ca-4ff1-add4-004ef24eadc5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "DELETE /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 204 len: 0 microversion: 2.1 time: 0.140927 Aug 09 18:31:20.308189 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4236/7287] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:31:20 2022] DELETE /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:31:20.317524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-7c3b077b-de96-42da-a210-e7a47c61e352 req-94ccf4c0-462b-472d-8016-97a8a053c0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa36e1be-8552-4203-bff4-2b7e080acc7c", "tag": "d516787a-bc16-4871-9ad6-cf4d0eb51c48"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:20.327347 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7c3b077b-de96-42da-a210-e7a47c61e352 req-94ccf4c0-462b-472d-8016-97a8a053c0d5 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:20.327864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7c3b077b-de96-42da-a210-e7a47c61e352 req-94ccf4c0-462b-472d-8016-97a8a053c0d5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:20.328307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-7c3b077b-de96-42da-a210-e7a47c61e352 req-94ccf4c0-462b-472d-8016-97a8a053c0d5 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:20.340215 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-7c3b077b-de96-42da-a210-e7a47c61e352 req-94ccf4c0-462b-472d-8016-97a8a053c0d5 service nova] Creating event network-changed:d516787a-bc16-4871-9ad6-cf4d0eb51c48 for instance aa36e1be-8552-4203-bff4-2b7e080acc7c on n-h2-845781-6 Aug 09 18:31:20.345069 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-7c3b077b-de96-42da-a210-e7a47c61e352 req-94ccf4c0-462b-472d-8016-97a8a053c0d5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035605 Aug 09 18:31:20.345757 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4237/7288] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:20.351250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-422d47ed-4287-46aa-9a26-36566b31ef1f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:20.352015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-422d47ed-4287-46aa-9a26-36566b31ef1f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:20.358152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-422d47ed-4287-46aa-9a26-36566b31ef1f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:20.358709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-422d47ed-4287-46aa-9a26-36566b31ef1f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:20.359216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-422d47ed-4287-46aa-9a26-36566b31ef1f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:20.359949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-422d47ed-4287-46aa-9a26-36566b31ef1f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:20.360410 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-422d47ed-4287-46aa-9a26-36566b31ef1f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:20.360845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-422d47ed-4287-46aa-9a26-36566b31ef1f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:20.495441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-422d47ed-4287-46aa-9a26-36566b31ef1f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:20.503132 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-422d47ed-4287-46aa-9a26-36566b31ef1f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1686 microversion: 2.1 time: 0.156324 Aug 09 18:31:20.503741 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4238/7289] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:20 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:31:21.526013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-261dc452-f464-4742-b8ec-51c0b529e725 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:21.526706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-261dc452-f464-4742-b8ec-51c0b529e725 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:21.534409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261dc452-f464-4742-b8ec-51c0b529e725 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:21.534898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261dc452-f464-4742-b8ec-51c0b529e725 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:21.535335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261dc452-f464-4742-b8ec-51c0b529e725 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:21.536070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261dc452-f464-4742-b8ec-51c0b529e725 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:21.536518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261dc452-f464-4742-b8ec-51c0b529e725 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:21.536943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261dc452-f464-4742-b8ec-51c0b529e725 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:22.033322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-261dc452-f464-4742-b8ec-51c0b529e725 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:22.041435 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-261dc452-f464-4742-b8ec-51c0b529e725 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 200 len: 1686 microversion: 2.1 time: 0.519325 Aug 09 18:31:22.052708 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4239/7290] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:21 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 1686 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:22.478623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3d50013f-9b06-4ce7-8dea-bbf2bdf3fe13 req-eedd8c90-7b80-4b52-a46f-72a725285a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa36e1be-8552-4203-bff4-2b7e080acc7c", "name": "network-vif-deleted", "tag": "d516787a-bc16-4871-9ad6-cf4d0eb51c48"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:22.488546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3d50013f-9b06-4ce7-8dea-bbf2bdf3fe13 req-eedd8c90-7b80-4b52-a46f-72a725285a24 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:22.489005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3d50013f-9b06-4ce7-8dea-bbf2bdf3fe13 req-eedd8c90-7b80-4b52-a46f-72a725285a24 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:22.489618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3d50013f-9b06-4ce7-8dea-bbf2bdf3fe13 req-eedd8c90-7b80-4b52-a46f-72a725285a24 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:22.501404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3d50013f-9b06-4ce7-8dea-bbf2bdf3fe13 req-eedd8c90-7b80-4b52-a46f-72a725285a24 service nova] Creating event network-vif-deleted:d516787a-bc16-4871-9ad6-cf4d0eb51c48 for instance aa36e1be-8552-4203-bff4-2b7e080acc7c on n-h2-845781-6 Aug 09 18:31:22.506128 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3d50013f-9b06-4ce7-8dea-bbf2bdf3fe13 req-eedd8c90-7b80-4b52-a46f-72a725285a24 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093519 Aug 09 18:31:22.507258 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4240/7291] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:31:23.066383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:23.067140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: aa36e1be-8552-4203-bff4-2b7e080acc7c] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:23.074073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:23.074566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:23.075011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:23.075739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:23.076201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:23.076636 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:23.090738 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] HTTP exception thrown: Instance aa36e1be-8552-4203-bff4-2b7e080acc7c could not be found. Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Request method failure captured: Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c HTTP/1.1 Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qbgQVBZovfKtIvw9tWoOSB5InWZd_5SeMZ1Ca-duEVIHXZ_7xzj1ryt6jeanOuQC_1Qth95PjmzO64kWCTB2FZ6iGuFDP2iC8izCzBFo6pSl2i-h8UuuVg_uY5ygbafuEk4pjthQS-RG6ZhqGUZT6Sxuzr3d2Rt6qENN5e0NwE1Sa0 Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 186a3a4a5e7a43fa8cc168e96f28994a Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 186a3a4a5e7a43fa8cc168e96f28994a Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestNetworkAdvancedServerOps-2008998050-project Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 8c34712ceeb54491889acff0f8f2eddd Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2008998050-project Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance aa36e1be-8552-4203-bff4-2b7e080acc7c could not be found. Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'aa36e1be-8552-4203-bff4-2b7e080acc7c'} Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa36e1be-8552-4203-bff4-2b7e080acc7c could not be found. Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa36e1be-8552-4203-bff4-2b7e080acc7c could not be found. Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:31:23.092417 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:31:23.097261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:31:23.097261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:31:23.097261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:31:23.097261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:31:23.097261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:31:23.097261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:31:23.097261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa36e1be-8552-4203-bff4-2b7e080acc7c could not be found. Aug 09 18:31:23.097261 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:31:23.097261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Returning 404 to user: Instance aa36e1be-8552-4203-bff4-2b7e080acc7c could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:31:23.097261 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-471295f5-dcb4-42cd-a992-c3002219c400 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c" status: 404 len: 111 microversion: 2.1 time: 0.033134 Aug 09 18:31:23.097261 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4241/7292] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:23 2022] GET /compute/v2.1/servers/aa36e1be-8552-4203-bff4-2b7e080acc7c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:31:26.236385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8fecf745-0e0d-498a-a0b8-78a266b57396 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '.version_select at 0x7fbbca369f70>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:26.271846 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8fecf745-0e0d-498a-a0b8-78a266b57396 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-537608220" status: 202 len: 0 microversion: 2.1 time: 0.039217 Aug 09 18:31:26.273034 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4242/7293] 10.222.0.93 () {58 vars in 1281 bytes} [Tue Aug 9 18:31:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-537608220 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:31:26.301546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c7e4742b-bebc-488f-b010-ea061b99e2cd tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'create', calling method: .version_select at 0x7fbbca3694c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1093029217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5c1YpLWBXbFsk9Vqdf0vy2JpvrYQLvg4D7YRtSIL3vR8pR0ldoVBxFmm4NNmkGpNQeGSmUsDPz0Ry0LwheyII8U2BYEm1B6atbtfESd/Kg2vaAmJO606jS/t9F6eh96w=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:26.317601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c7e4742b-bebc-488f-b010-ea061b99e2cd tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:31:26.325470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-c7e4742b-bebc-488f-b010-ea061b99e2cd tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for user 8c34712ceeb54491889acff0f8f2eddd and project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:31:26.348839 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c7e4742b-bebc-488f-b010-ea061b99e2cd tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052008 Aug 09 18:31:26.349434 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4243/7294] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:31:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:31:31.907925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-36957682", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "2eb89111-0010-49ef-84fe-5ea0502cc222"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1093029217", "security_groups": [{"name": "tempest-secgroup-smoke-955974496"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:32.064238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] validate_networks() for [('2eb89111-0010-49ef-84fe-5ea0502cc222', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:31:32.544955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:31:32.545418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:31:32.545907 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:31:32.546318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:31:32.546935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:31:32.558312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:32.559321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:32.559964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:32.560869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:32.562040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:32.562670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:32.586950 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:31:32.593349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for user 8c34712ceeb54491889acff0f8f2eddd and project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:31:32.607954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:31:32.610509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:31:32.681697 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a8d2b989-4ae0-4906-a987-bf3e4acd25e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.776083 Aug 09 18:31:32.689576 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4244/7295] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:31:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:31:32.702548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e8d2e8d8-b1f6-46cc-8b2e-c488fa1ed4b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:32.703190 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e8d2e8d8-b1f6-46cc-8b2e-c488fa1ed4b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:32.772998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e8d2e8d8-b1f6-46cc-8b2e-c488fa1ed4b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:32.787142 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e8d2e8d8-b1f6-46cc-8b2e-c488fa1ed4b8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1265 microversion: 2.1 time: 0.096277 Aug 09 18:31:32.788523 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4245/7296] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:32 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:31:33.810913 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-67969559-bd71-4caa-82de-8c1a2e4dd58f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:33.811539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-67969559-bd71-4caa-82de-8c1a2e4dd58f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:33.831652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67969559-bd71-4caa-82de-8c1a2e4dd58f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:33.832898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67969559-bd71-4caa-82de-8c1a2e4dd58f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:33.833625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67969559-bd71-4caa-82de-8c1a2e4dd58f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:33.834761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67969559-bd71-4caa-82de-8c1a2e4dd58f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:33.835403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67969559-bd71-4caa-82de-8c1a2e4dd58f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:33.836029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-67969559-bd71-4caa-82de-8c1a2e4dd58f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:33.940969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-67969559-bd71-4caa-82de-8c1a2e4dd58f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:33.957165 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-67969559-bd71-4caa-82de-8c1a2e4dd58f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1325 microversion: 2.1 time: 0.150110 Aug 09 18:31:33.960411 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4246/7297] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:33 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1325 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:31:34.979866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-301a39c1-a5ab-4e2a-8fcc-d439efcf2c7a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:34.980474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-301a39c1-a5ab-4e2a-8fcc-d439efcf2c7a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:34.988478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-301a39c1-a5ab-4e2a-8fcc-d439efcf2c7a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:34.988980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-301a39c1-a5ab-4e2a-8fcc-d439efcf2c7a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:34.989423 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-301a39c1-a5ab-4e2a-8fcc-d439efcf2c7a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:34.990136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-301a39c1-a5ab-4e2a-8fcc-d439efcf2c7a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:34.991129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-301a39c1-a5ab-4e2a-8fcc-d439efcf2c7a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:34.991562 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-301a39c1-a5ab-4e2a-8fcc-d439efcf2c7a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:35.202425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-301a39c1-a5ab-4e2a-8fcc-d439efcf2c7a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:35.210097 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-301a39c1-a5ab-4e2a-8fcc-d439efcf2c7a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1390 microversion: 2.1 time: 0.234142 Aug 09 18:31:35.210679 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4247/7298] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:34 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1390 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:35.469588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-c589a3fa-513d-4eb6-8741-b33b68e5f346 req-581dbe56-af33-42e2-bcfb-db1a9975ab83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb049d56-f09b-4bfa-8f16-408dc2f4e4b0", "tag": "d04c2a2f-d2a7-43c4-8e06-47f3a1882058"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:35.479227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c589a3fa-513d-4eb6-8741-b33b68e5f346 req-581dbe56-af33-42e2-bcfb-db1a9975ab83 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:35.479759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c589a3fa-513d-4eb6-8741-b33b68e5f346 req-581dbe56-af33-42e2-bcfb-db1a9975ab83 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:35.489075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-c589a3fa-513d-4eb6-8741-b33b68e5f346 req-581dbe56-af33-42e2-bcfb-db1a9975ab83 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:35.501148 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-c589a3fa-513d-4eb6-8741-b33b68e5f346 req-581dbe56-af33-42e2-bcfb-db1a9975ab83 service nova] Creating event network-changed:d04c2a2f-d2a7-43c4-8e06-47f3a1882058 for instance bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 on n-h1-845781-6 Aug 09 18:31:35.506786 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-c589a3fa-513d-4eb6-8741-b33b68e5f346 req-581dbe56-af33-42e2-bcfb-db1a9975ab83 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040370 Aug 09 18:31:35.507429 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4248/7299] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:36.233327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-18af2de3-a3f9-4998-a4c9-c44204145e73 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:36.234067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-18af2de3-a3f9-4998-a4c9-c44204145e73 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:36.240454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18af2de3-a3f9-4998-a4c9-c44204145e73 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:36.240953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18af2de3-a3f9-4998-a4c9-c44204145e73 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:36.241400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18af2de3-a3f9-4998-a4c9-c44204145e73 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:36.242145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18af2de3-a3f9-4998-a4c9-c44204145e73 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:36.242604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18af2de3-a3f9-4998-a4c9-c44204145e73 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:36.243037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-18af2de3-a3f9-4998-a4c9-c44204145e73 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:36.380435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-18af2de3-a3f9-4998-a4c9-c44204145e73 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:36.387929 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-18af2de3-a3f9-4998-a4c9-c44204145e73 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1390 microversion: 2.1 time: 0.159720 Aug 09 18:31:36.388746 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4249/7300] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:36 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:37.409569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-332d02f5-fc4b-4374-9436-0d21659075d0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:37.410208 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-332d02f5-fc4b-4374-9436-0d21659075d0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:37.417503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-332d02f5-fc4b-4374-9436-0d21659075d0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:37.417992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-332d02f5-fc4b-4374-9436-0d21659075d0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:37.418435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-332d02f5-fc4b-4374-9436-0d21659075d0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:37.419127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-332d02f5-fc4b-4374-9436-0d21659075d0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:37.419581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-332d02f5-fc4b-4374-9436-0d21659075d0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:37.420034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-332d02f5-fc4b-4374-9436-0d21659075d0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:37.641223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-332d02f5-fc4b-4374-9436-0d21659075d0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:37.648798 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-332d02f5-fc4b-4374-9436-0d21659075d0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1390 microversion: 2.1 time: 0.243093 Aug 09 18:31:37.649378 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4250/7301] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:37 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1390 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:38.669577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-77c472f3-9611-460a-8200-9e7592e6c1bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:38.670235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-77c472f3-9611-460a-8200-9e7592e6c1bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:38.677057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77c472f3-9611-460a-8200-9e7592e6c1bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:38.678053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77c472f3-9611-460a-8200-9e7592e6c1bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:38.678493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77c472f3-9611-460a-8200-9e7592e6c1bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:38.679188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77c472f3-9611-460a-8200-9e7592e6c1bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:38.679666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77c472f3-9611-460a-8200-9e7592e6c1bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:38.680101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77c472f3-9611-460a-8200-9e7592e6c1bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:38.813909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-77c472f3-9611-460a-8200-9e7592e6c1bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:38.822020 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-77c472f3-9611-460a-8200-9e7592e6c1bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1390 microversion: 2.1 time: 0.156318 Aug 09 18:31:38.822596 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4251/7302] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:38 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:39.843126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7564916a-0466-4aa1-999a-f03acb2765f9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:39.843794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7564916a-0466-4aa1-999a-f03acb2765f9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:39.851224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7564916a-0466-4aa1-999a-f03acb2765f9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:39.851734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7564916a-0466-4aa1-999a-f03acb2765f9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:39.852177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7564916a-0466-4aa1-999a-f03acb2765f9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:39.852881 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7564916a-0466-4aa1-999a-f03acb2765f9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:39.853334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7564916a-0466-4aa1-999a-f03acb2765f9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:39.854461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7564916a-0466-4aa1-999a-f03acb2765f9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:39.994634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7564916a-0466-4aa1-999a-f03acb2765f9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:40.002196 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7564916a-0466-4aa1-999a-f03acb2765f9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1390 microversion: 2.1 time: 0.163170 Aug 09 18:31:40.002704 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4252/7303] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:39 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:41.070610 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5858ef9d-3fe8-4b46-8824-fd97a16c1617 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:41.071279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5858ef9d-3fe8-4b46-8824-fd97a16c1617 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:41.077286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5858ef9d-3fe8-4b46-8824-fd97a16c1617 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:41.077778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5858ef9d-3fe8-4b46-8824-fd97a16c1617 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:41.078229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5858ef9d-3fe8-4b46-8824-fd97a16c1617 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:41.078933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5858ef9d-3fe8-4b46-8824-fd97a16c1617 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:41.079393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5858ef9d-3fe8-4b46-8824-fd97a16c1617 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:41.079933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5858ef9d-3fe8-4b46-8824-fd97a16c1617 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:41.219135 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5858ef9d-3fe8-4b46-8824-fd97a16c1617 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:41.227103 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5858ef9d-3fe8-4b46-8824-fd97a16c1617 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1390 microversion: 2.1 time: 0.208586 Aug 09 18:31:41.227690 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4253/7304] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:41 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1390 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:42.248250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-79c1a9ff-4940-41d4-84d9-6f48b9e46e86 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:42.248934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-79c1a9ff-4940-41d4-84d9-6f48b9e46e86 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:42.255694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79c1a9ff-4940-41d4-84d9-6f48b9e46e86 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:42.256175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79c1a9ff-4940-41d4-84d9-6f48b9e46e86 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:42.256637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79c1a9ff-4940-41d4-84d9-6f48b9e46e86 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:42.257324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79c1a9ff-4940-41d4-84d9-6f48b9e46e86 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:42.257775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79c1a9ff-4940-41d4-84d9-6f48b9e46e86 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:42.258199 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-79c1a9ff-4940-41d4-84d9-6f48b9e46e86 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:42.395261 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-79c1a9ff-4940-41d4-84d9-6f48b9e46e86 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:42.403245 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-79c1a9ff-4940-41d4-84d9-6f48b9e46e86 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1390 microversion: 2.1 time: 0.158987 Aug 09 18:31:42.403853 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4254/7305] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:42 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:42.632587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-cbba9014-74d0-4d90-a5d7-d8c889a4d4b2 req-1d574904-ad4e-4974-bc70-85f619c2342b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb049d56-f09b-4bfa-8f16-408dc2f4e4b0", "name": "network-vif-plugged", "status": "completed", "tag": "d04c2a2f-d2a7-43c4-8e06-47f3a1882058"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:42.639102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:31:42.644239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cbba9014-74d0-4d90-a5d7-d8c889a4d4b2 req-1d574904-ad4e-4974-bc70-85f619c2342b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:42.644722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cbba9014-74d0-4d90-a5d7-d8c889a4d4b2 req-1d574904-ad4e-4974-bc70-85f619c2342b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:42.645158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-cbba9014-74d0-4d90-a5d7-d8c889a4d4b2 req-1d574904-ad4e-4974-bc70-85f619c2342b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:42.657237 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-cbba9014-74d0-4d90-a5d7-d8c889a4d4b2 req-1d574904-ad4e-4974-bc70-85f619c2342b service nova] Creating event network-vif-plugged:d04c2a2f-d2a7-43c4-8e06-47f3a1882058 for instance bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 on n-h1-845781-6 Aug 09 18:31:42.662562 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-cbba9014-74d0-4d90-a5d7-d8c889a4d4b2 req-1d574904-ad4e-4974-bc70-85f619c2342b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036500 Aug 09 18:31:42.663502 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4255/7306] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:31:43.421805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:31:43.427008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2a26b291-47ff-466f-bd59-7762fd6819f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:43.428316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2a26b291-47ff-466f-bd59-7762fd6819f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:43.430104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:31:43.436729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a26b291-47ff-466f-bd59-7762fd6819f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:43.437217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a26b291-47ff-466f-bd59-7762fd6819f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:43.437661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a26b291-47ff-466f-bd59-7762fd6819f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:43.438360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a26b291-47ff-466f-bd59-7762fd6819f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:43.438817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a26b291-47ff-466f-bd59-7762fd6819f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:43.439259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2a26b291-47ff-466f-bd59-7762fd6819f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:43.443737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:31:43.583225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2a26b291-47ff-466f-bd59-7762fd6819f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:43.591090 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2a26b291-47ff-466f-bd59-7762fd6819f6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1390 microversion: 2.1 time: 0.170210 Aug 09 18:31:43.591706 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4256/7307] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:43 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:44.612826 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8f7111d0-7d6e-47ec-aa9f-807b5443dc26 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:44.613812 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8f7111d0-7d6e-47ec-aa9f-807b5443dc26 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:44.623898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f7111d0-7d6e-47ec-aa9f-807b5443dc26 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:44.624569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f7111d0-7d6e-47ec-aa9f-807b5443dc26 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:44.625352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f7111d0-7d6e-47ec-aa9f-807b5443dc26 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:44.626364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f7111d0-7d6e-47ec-aa9f-807b5443dc26 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:44.626894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f7111d0-7d6e-47ec-aa9f-807b5443dc26 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:44.627503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8f7111d0-7d6e-47ec-aa9f-807b5443dc26 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:44.760730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8f7111d0-7d6e-47ec-aa9f-807b5443dc26 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:44.768452 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8f7111d0-7d6e-47ec-aa9f-807b5443dc26 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1562 microversion: 2.1 time: 0.160340 Aug 09 18:31:44.769040 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4257/7308] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:44 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:44.789435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-350443b6-00b4-412f-99c5-f6066b81cd65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:44.790084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-350443b6-00b4-412f-99c5-f6066b81cd65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:44.796671 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-350443b6-00b4-412f-99c5-f6066b81cd65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:44.797161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-350443b6-00b4-412f-99c5-f6066b81cd65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:44.797639 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-350443b6-00b4-412f-99c5-f6066b81cd65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:44.798308 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-350443b6-00b4-412f-99c5-f6066b81cd65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:44.798773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-350443b6-00b4-412f-99c5-f6066b81cd65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:44.799201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-350443b6-00b4-412f-99c5-f6066b81cd65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:44.932947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-350443b6-00b4-412f-99c5-f6066b81cd65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:44.940471 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-350443b6-00b4-412f-99c5-f6066b81cd65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1562 microversion: 2.1 time: 0.155473 Aug 09 18:31:44.941043 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4258/7309] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:44 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:31:46.595321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f00e1d6a-9df1-47d7-b471-caf61ce7e136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:31:46.596363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f00e1d6a-9df1-47d7-b471-caf61ce7e136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:31:46.604051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f00e1d6a-9df1-47d7-b471-caf61ce7e136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:46.604544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f00e1d6a-9df1-47d7-b471-caf61ce7e136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:46.604990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f00e1d6a-9df1-47d7-b471-caf61ce7e136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:46.605772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f00e1d6a-9df1-47d7-b471-caf61ce7e136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:46.606441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f00e1d6a-9df1-47d7-b471-caf61ce7e136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:46.606785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f00e1d6a-9df1-47d7-b471-caf61ce7e136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:46.748366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f00e1d6a-9df1-47d7-b471-caf61ce7e136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:31:46.756755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f00e1d6a-9df1-47d7-b471-caf61ce7e136 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1562 microversion: 2.1 time: 0.166862 Aug 09 18:31:46.757338 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4259/7310] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:31:46 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:31:46.764916 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-56f236fc-9415-4880-8cc0-bb354e9bf64a req-2a3ab9a5-220d-48bd-9481-2864f1638e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb049d56-f09b-4bfa-8f16-408dc2f4e4b0", "tag": "d04c2a2f-d2a7-43c4-8e06-47f3a1882058"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:31:46.775039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-56f236fc-9415-4880-8cc0-bb354e9bf64a req-2a3ab9a5-220d-48bd-9481-2864f1638e5b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:31:46.775533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-56f236fc-9415-4880-8cc0-bb354e9bf64a req-2a3ab9a5-220d-48bd-9481-2864f1638e5b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:31:46.776019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-56f236fc-9415-4880-8cc0-bb354e9bf64a req-2a3ab9a5-220d-48bd-9481-2864f1638e5b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:31:46.788324 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-56f236fc-9415-4880-8cc0-bb354e9bf64a req-2a3ab9a5-220d-48bd-9481-2864f1638e5b service nova] Creating event network-changed:d04c2a2f-d2a7-43c4-8e06-47f3a1882058 for instance bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 on n-h1-845781-6 Aug 09 18:31:46.793777 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-56f236fc-9415-4880-8cc0-bb354e9bf64a req-2a3ab9a5-220d-48bd-9481-2864f1638e5b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035249 Aug 09 18:31:46.794559 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4260/7311] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:32:12.052222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=9 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:32:12.052926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=25 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:32:12.057106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9b91a32d-7eed-46c6-ac86-7d0747a974bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:32:12.059477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9b91a32d-7eed-46c6-ac86-7d0747a974bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:12.066389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b91a32d-7eed-46c6-ac86-7d0747a974bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:12.067366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b91a32d-7eed-46c6-ac86-7d0747a974bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:12.067859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b91a32d-7eed-46c6-ac86-7d0747a974bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:12.068550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b91a32d-7eed-46c6-ac86-7d0747a974bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:12.069007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b91a32d-7eed-46c6-ac86-7d0747a974bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:12.069431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b91a32d-7eed-46c6-ac86-7d0747a974bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:12.124116 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9b91a32d-7eed-46c6-ac86-7d0747a974bf tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0/action" status: 200 len: 24562 microversion: 2.1 time: 0.073832 Aug 09 18:32:12.124774 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4261/7312] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:32:12 2022] POST /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0/action => generated 24562 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:32:23.200013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-32aafd00-f724-48ec-b0b4-1955770a9019 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:32:23.202924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:32:23.203583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:32:23.209599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32aafd00-f724-48ec-b0b4-1955770a9019 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:23.210082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32aafd00-f724-48ec-b0b4-1955770a9019 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:23.210515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-32aafd00-f724-48ec-b0b4-1955770a9019 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:23.233859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-32aafd00-f724-48ec-b0b4-1955770a9019 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Going to try to stop instance {{(pid=119431) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 18:32:23.274875 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-32aafd00-f724-48ec-b0b4-1955770a9019 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0/action" status: 202 len: 0 microversion: 2.1 time: 0.078976 Aug 09 18:32:23.275495 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4262/7313] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:32:23 2022] POST /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:32:23.286987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-95170102-5c38-46fa-b1ed-e947a5fad00a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:23.287884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-95170102-5c38-46fa-b1ed-e947a5fad00a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:23.294456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95170102-5c38-46fa-b1ed-e947a5fad00a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:23.295026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95170102-5c38-46fa-b1ed-e947a5fad00a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:23.295683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95170102-5c38-46fa-b1ed-e947a5fad00a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:23.296277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95170102-5c38-46fa-b1ed-e947a5fad00a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:23.296790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95170102-5c38-46fa-b1ed-e947a5fad00a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:23.297245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-95170102-5c38-46fa-b1ed-e947a5fad00a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:23.439788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-95170102-5c38-46fa-b1ed-e947a5fad00a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:23.447637 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-95170102-5c38-46fa-b1ed-e947a5fad00a tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1690 microversion: 2.1 time: 0.165550 Aug 09 18:32:23.448235 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4263/7314] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:23 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:32:24.470435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-379aeef6-b470-4592-a83c-2e33311db2af tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:24.471168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-379aeef6-b470-4592-a83c-2e33311db2af tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:24.477845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379aeef6-b470-4592-a83c-2e33311db2af tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:24.478331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379aeef6-b470-4592-a83c-2e33311db2af tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:24.478770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379aeef6-b470-4592-a83c-2e33311db2af tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:24.479463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379aeef6-b470-4592-a83c-2e33311db2af tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:24.479947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379aeef6-b470-4592-a83c-2e33311db2af tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:24.480376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-379aeef6-b470-4592-a83c-2e33311db2af tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:24.618500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-379aeef6-b470-4592-a83c-2e33311db2af tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:24.626084 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-379aeef6-b470-4592-a83c-2e33311db2af tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1690 microversion: 2.1 time: 0.159528 Aug 09 18:32:24.626658 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4264/7315] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:24 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:32:25.648694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-155cf499-7e7d-4913-927e-3f33d9429f10 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:25.649513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-155cf499-7e7d-4913-927e-3f33d9429f10 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:25.656379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-155cf499-7e7d-4913-927e-3f33d9429f10 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:25.656869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-155cf499-7e7d-4913-927e-3f33d9429f10 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:25.657315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-155cf499-7e7d-4913-927e-3f33d9429f10 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:25.658019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-155cf499-7e7d-4913-927e-3f33d9429f10 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:25.658519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-155cf499-7e7d-4913-927e-3f33d9429f10 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:25.658906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-155cf499-7e7d-4913-927e-3f33d9429f10 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:25.798733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-155cf499-7e7d-4913-927e-3f33d9429f10 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:25.807399 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-155cf499-7e7d-4913-927e-3f33d9429f10 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1690 microversion: 2.1 time: 0.163265 Aug 09 18:32:25.808035 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4265/7316] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:25 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:32:26.829383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bdfaaeea-f873-4a8b-a598-c4e54e6da653 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:26.830082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bdfaaeea-f873-4a8b-a598-c4e54e6da653 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:26.837973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdfaaeea-f873-4a8b-a598-c4e54e6da653 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:26.838710 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdfaaeea-f873-4a8b-a598-c4e54e6da653 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:26.839143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdfaaeea-f873-4a8b-a598-c4e54e6da653 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:26.839862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdfaaeea-f873-4a8b-a598-c4e54e6da653 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:26.840311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdfaaeea-f873-4a8b-a598-c4e54e6da653 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:26.840734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bdfaaeea-f873-4a8b-a598-c4e54e6da653 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:26.977377 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bdfaaeea-f873-4a8b-a598-c4e54e6da653 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:26.985141 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bdfaaeea-f873-4a8b-a598-c4e54e6da653 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1690 microversion: 2.1 time: 0.159643 Aug 09 18:32:26.985731 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4266/7317] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:26 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:32:28.006281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-783a5912-3e08-4f22-ba51-a06143fb8b28 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:28.006988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-783a5912-3e08-4f22-ba51-a06143fb8b28 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:28.013941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a5912-3e08-4f22-ba51-a06143fb8b28 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:28.014435 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a5912-3e08-4f22-ba51-a06143fb8b28 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:28.014884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a5912-3e08-4f22-ba51-a06143fb8b28 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:28.015602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a5912-3e08-4f22-ba51-a06143fb8b28 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:28.016086 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a5912-3e08-4f22-ba51-a06143fb8b28 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:28.016522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-783a5912-3e08-4f22-ba51-a06143fb8b28 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:28.155567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-783a5912-3e08-4f22-ba51-a06143fb8b28 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:28.164600 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-783a5912-3e08-4f22-ba51-a06143fb8b28 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1690 microversion: 2.1 time: 0.162154 Aug 09 18:32:28.165206 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4267/7318] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:28 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:32:29.184939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df743ef3-ea47-40d2-96ae-fd33ba95409e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:29.185559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df743ef3-ea47-40d2-96ae-fd33ba95409e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:29.192449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df743ef3-ea47-40d2-96ae-fd33ba95409e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:29.192939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df743ef3-ea47-40d2-96ae-fd33ba95409e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:29.193380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df743ef3-ea47-40d2-96ae-fd33ba95409e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:29.194073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df743ef3-ea47-40d2-96ae-fd33ba95409e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:29.194530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df743ef3-ea47-40d2-96ae-fd33ba95409e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:29.194959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df743ef3-ea47-40d2-96ae-fd33ba95409e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:29.332113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-df743ef3-ea47-40d2-96ae-fd33ba95409e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:29.345674 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df743ef3-ea47-40d2-96ae-fd33ba95409e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1690 microversion: 2.1 time: 0.164626 Aug 09 18:32:29.346252 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4268/7319] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:29 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:32:30.368068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c1f6e7b9-f822-4779-961b-4233a43dc329 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:30.368712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c1f6e7b9-f822-4779-961b-4233a43dc329 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:30.375387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1f6e7b9-f822-4779-961b-4233a43dc329 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:30.375908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1f6e7b9-f822-4779-961b-4233a43dc329 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:30.376348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1f6e7b9-f822-4779-961b-4233a43dc329 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:30.377031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1f6e7b9-f822-4779-961b-4233a43dc329 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:30.377507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1f6e7b9-f822-4779-961b-4233a43dc329 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:30.377908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c1f6e7b9-f822-4779-961b-4233a43dc329 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:30.508409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c1f6e7b9-f822-4779-961b-4233a43dc329 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:30.515954 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c1f6e7b9-f822-4779-961b-4233a43dc329 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1690 microversion: 2.1 time: 0.152417 Aug 09 18:32:30.516527 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4269/7320] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:30 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:32:31.536811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e7fe8edf-2fca-4687-aaee-de3994bd291e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:31.537472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e7fe8edf-2fca-4687-aaee-de3994bd291e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:31.544392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7fe8edf-2fca-4687-aaee-de3994bd291e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:31.544887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7fe8edf-2fca-4687-aaee-de3994bd291e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:31.545331 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7fe8edf-2fca-4687-aaee-de3994bd291e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:31.546042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7fe8edf-2fca-4687-aaee-de3994bd291e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:31.546504 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7fe8edf-2fca-4687-aaee-de3994bd291e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:31.546938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7fe8edf-2fca-4687-aaee-de3994bd291e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:31.690290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e7fe8edf-2fca-4687-aaee-de3994bd291e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:31.698684 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e7fe8edf-2fca-4687-aaee-de3994bd291e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1690 microversion: 2.1 time: 0.165751 Aug 09 18:32:31.699602 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4270/7321] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:31 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:32:32.720220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-86429aed-1676-4822-9596-62ee8fcda91f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:32.720914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-86429aed-1676-4822-9596-62ee8fcda91f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:32.728401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86429aed-1676-4822-9596-62ee8fcda91f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:32.728893 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86429aed-1676-4822-9596-62ee8fcda91f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:32.729336 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86429aed-1676-4822-9596-62ee8fcda91f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:32.730033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86429aed-1676-4822-9596-62ee8fcda91f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:32.730491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86429aed-1676-4822-9596-62ee8fcda91f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:32.730925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-86429aed-1676-4822-9596-62ee8fcda91f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:32.865443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-86429aed-1676-4822-9596-62ee8fcda91f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:32.873052 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-86429aed-1676-4822-9596-62ee8fcda91f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1690 microversion: 2.1 time: 0.156814 Aug 09 18:32:32.873662 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4271/7322] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:32 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:32:33.894475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-326b05c2-d793-4e2f-8519-f50df01f5235 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:33.895185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-326b05c2-d793-4e2f-8519-f50df01f5235 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:33.902071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-326b05c2-d793-4e2f-8519-f50df01f5235 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:33.902558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-326b05c2-d793-4e2f-8519-f50df01f5235 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:33.903000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-326b05c2-d793-4e2f-8519-f50df01f5235 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:33.903732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-326b05c2-d793-4e2f-8519-f50df01f5235 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:33.904188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-326b05c2-d793-4e2f-8519-f50df01f5235 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:33.904611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-326b05c2-d793-4e2f-8519-f50df01f5235 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:34.036579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-326b05c2-d793-4e2f-8519-f50df01f5235 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:34.044110 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-326b05c2-d793-4e2f-8519-f50df01f5235 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1667 microversion: 2.1 time: 0.153423 Aug 09 18:32:34.044688 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4272/7323] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:33 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:32:35.134459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2eb6eb11-e344-44b6-9e7d-eeb5f9e7acba tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:32:35.136599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2eb6eb11-e344-44b6-9e7d-eeb5f9e7acba tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:35.143426 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2eb6eb11-e344-44b6-9e7d-eeb5f9e7acba tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:35.143955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2eb6eb11-e344-44b6-9e7d-eeb5f9e7acba tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:35.144403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2eb6eb11-e344-44b6-9e7d-eeb5f9e7acba tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:35.145101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2eb6eb11-e344-44b6-9e7d-eeb5f9e7acba tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:35.145567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2eb6eb11-e344-44b6-9e7d-eeb5f9e7acba tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:35.146001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2eb6eb11-e344-44b6-9e7d-eeb5f9e7acba tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:35.208033 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2eb6eb11-e344-44b6-9e7d-eeb5f9e7acba tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0/action" status: 200 len: 38351 microversion: 2.1 time: 0.077341 Aug 09 18:32:35.209001 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4273/7324] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:32:35 2022] POST /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0/action => generated 38351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:32:35.220912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4b90cfd-3d43-4df1-ac7c-af62eba8e0d1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:32:35.228602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4b90cfd-3d43-4df1-ac7c-af62eba8e0d1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:35.229095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4b90cfd-3d43-4df1-ac7c-af62eba8e0d1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:35.229540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4b90cfd-3d43-4df1-ac7c-af62eba8e0d1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:35.252059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d4b90cfd-3d43-4df1-ac7c-af62eba8e0d1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Going to try to start instance {{(pid=119431) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 18:32:35.293476 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d4b90cfd-3d43-4df1-ac7c-af62eba8e0d1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0/action" status: 202 len: 0 microversion: 2.1 time: 0.076329 Aug 09 18:32:35.294520 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4274/7325] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:32:35 2022] POST /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:32:35.304817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-383625a7-5970-402a-90d9-ed64d6a295ab tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:35.305525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-383625a7-5970-402a-90d9-ed64d6a295ab tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:35.312653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-383625a7-5970-402a-90d9-ed64d6a295ab tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:35.313156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-383625a7-5970-402a-90d9-ed64d6a295ab tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:35.313602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-383625a7-5970-402a-90d9-ed64d6a295ab tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:35.314310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-383625a7-5970-402a-90d9-ed64d6a295ab tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:35.314769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-383625a7-5970-402a-90d9-ed64d6a295ab tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:35.315204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-383625a7-5970-402a-90d9-ed64d6a295ab tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:35.544445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-383625a7-5970-402a-90d9-ed64d6a295ab tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:35.551910 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-383625a7-5970-402a-90d9-ed64d6a295ab tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1676 microversion: 2.1 time: 0.252433 Aug 09 18:32:35.552491 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4275/7326] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:35 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1676 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:32:36.577065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ef2194c2-d251-4feb-be0c-419cb693b3ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:32:36.577742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ef2194c2-d251-4feb-be0c-419cb693b3ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:32:36.584579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2194c2-d251-4feb-be0c-419cb693b3ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:36.585092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2194c2-d251-4feb-be0c-419cb693b3ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:36.585558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2194c2-d251-4feb-be0c-419cb693b3ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:36.586254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2194c2-d251-4feb-be0c-419cb693b3ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:32:36.586700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2194c2-d251-4feb-be0c-419cb693b3ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:32:36.587121 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ef2194c2-d251-4feb-be0c-419cb693b3ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:32:36.719193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ef2194c2-d251-4feb-be0c-419cb693b3ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:32:36.722800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:32:36.728267 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ef2194c2-d251-4feb-be0c-419cb693b3ec tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1680 microversion: 2.1 time: 0.155108 Aug 09 18:32:36.728843 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4276/7327] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:32:36 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:02.935564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1768f899-8b8d-4d7c-a8d9-296b67348784 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:33:02.937878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1768f899-8b8d-4d7c-a8d9-296b67348784 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:02.940543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=30 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:02.947262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1768f899-8b8d-4d7c-a8d9-296b67348784 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:02.947786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1768f899-8b8d-4d7c-a8d9-296b67348784 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:02.948230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1768f899-8b8d-4d7c-a8d9-296b67348784 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:02.948947 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1768f899-8b8d-4d7c-a8d9-296b67348784 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:02.949409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1768f899-8b8d-4d7c-a8d9-296b67348784 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:02.949837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1768f899-8b8d-4d7c-a8d9-296b67348784 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:03.016241 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1768f899-8b8d-4d7c-a8d9-296b67348784 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0/action" status: 200 len: 62915 microversion: 2.1 time: 0.085219 Aug 09 18:33:03.016906 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4277/7328] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:33:02 2022] POST /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0/action => generated 62915 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:33:10.166437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b47e6de4-fee8-4fcd-aeff-c89e039dbdb9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:10.167051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b47e6de4-fee8-4fcd-aeff-c89e039dbdb9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:10.174865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b47e6de4-fee8-4fcd-aeff-c89e039dbdb9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:10.175360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b47e6de4-fee8-4fcd-aeff-c89e039dbdb9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:10.175834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b47e6de4-fee8-4fcd-aeff-c89e039dbdb9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:10.176547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b47e6de4-fee8-4fcd-aeff-c89e039dbdb9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:10.177006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b47e6de4-fee8-4fcd-aeff-c89e039dbdb9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:10.177472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b47e6de4-fee8-4fcd-aeff-c89e039dbdb9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:10.204566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b47e6de4-fee8-4fcd-aeff-c89e039dbdb9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:33:10.287480 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b47e6de4-fee8-4fcd-aeff-c89e039dbdb9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 204 len: 0 microversion: 2.1 time: 0.125557 Aug 09 18:33:10.288162 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4278/7329] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:33:10 2022] DELETE /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:33:10.294494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-8ebdac87-b899-4d2b-a6ea-13e9fd9165c1 req-5d2e637e-c90e-4167-a2d6-471093a44fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb049d56-f09b-4bfa-8f16-408dc2f4e4b0", "tag": "d04c2a2f-d2a7-43c4-8e06-47f3a1882058"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:33:10.305037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8ebdac87-b899-4d2b-a6ea-13e9fd9165c1 req-5d2e637e-c90e-4167-a2d6-471093a44fa4 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:10.305664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8ebdac87-b899-4d2b-a6ea-13e9fd9165c1 req-5d2e637e-c90e-4167-a2d6-471093a44fa4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:10.306096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-8ebdac87-b899-4d2b-a6ea-13e9fd9165c1 req-5d2e637e-c90e-4167-a2d6-471093a44fa4 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:10.317345 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-8ebdac87-b899-4d2b-a6ea-13e9fd9165c1 req-5d2e637e-c90e-4167-a2d6-471093a44fa4 service nova] Creating event network-changed:d04c2a2f-d2a7-43c4-8e06-47f3a1882058 for instance bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 on n-h1-845781-6 Aug 09 18:33:10.322852 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-8ebdac87-b899-4d2b-a6ea-13e9fd9165c1 req-5d2e637e-c90e-4167-a2d6-471093a44fa4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033414 Aug 09 18:33:10.323659 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4279/7330] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:10.328604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f0f40654-e5ce-4571-a0e3-693e3ce2d074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:10.329299 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f0f40654-e5ce-4571-a0e3-693e3ce2d074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:10.336462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0f40654-e5ce-4571-a0e3-693e3ce2d074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:10.336944 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0f40654-e5ce-4571-a0e3-693e3ce2d074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:10.337383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0f40654-e5ce-4571-a0e3-693e3ce2d074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:10.338335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0f40654-e5ce-4571-a0e3-693e3ce2d074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:10.338787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0f40654-e5ce-4571-a0e3-693e3ce2d074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:10.339211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f0f40654-e5ce-4571-a0e3-693e3ce2d074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:10.550997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f0f40654-e5ce-4571-a0e3-693e3ce2d074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:10.559902 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f0f40654-e5ce-4571-a0e3-693e3ce2d074 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1686 microversion: 2.1 time: 0.235054 Aug 09 18:33:10.560773 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4280/7331] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:10 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1686 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:33:11.582923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f9f84e7d-e34f-44fa-a939-bd10dbe4f1d8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:11.583651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f9f84e7d-e34f-44fa-a939-bd10dbe4f1d8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:11.591088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f84e7d-e34f-44fa-a939-bd10dbe4f1d8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:11.591566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f84e7d-e34f-44fa-a939-bd10dbe4f1d8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:11.592027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f84e7d-e34f-44fa-a939-bd10dbe4f1d8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:11.592709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f84e7d-e34f-44fa-a939-bd10dbe4f1d8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:11.593160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f84e7d-e34f-44fa-a939-bd10dbe4f1d8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:11.593582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f9f84e7d-e34f-44fa-a939-bd10dbe4f1d8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:11.803724 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f9f84e7d-e34f-44fa-a939-bd10dbe4f1d8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:11.811316 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f9f84e7d-e34f-44fa-a939-bd10dbe4f1d8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1686 microversion: 2.1 time: 0.232340 Aug 09 18:33:11.811934 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4281/7332] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:11 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1686 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:12.446644 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b97a423b-c66f-45bf-b038-efc1bfb9f481 req-cfc78f02-2867-41b6-b4e8-56251637088f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb049d56-f09b-4bfa-8f16-408dc2f4e4b0", "name": "network-vif-deleted", "tag": "d04c2a2f-d2a7-43c4-8e06-47f3a1882058"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:33:12.457051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b97a423b-c66f-45bf-b038-efc1bfb9f481 req-cfc78f02-2867-41b6-b4e8-56251637088f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:12.457534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b97a423b-c66f-45bf-b038-efc1bfb9f481 req-cfc78f02-2867-41b6-b4e8-56251637088f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:12.457972 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b97a423b-c66f-45bf-b038-efc1bfb9f481 req-cfc78f02-2867-41b6-b4e8-56251637088f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:12.470611 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b97a423b-c66f-45bf-b038-efc1bfb9f481 req-cfc78f02-2867-41b6-b4e8-56251637088f service nova] Creating event network-vif-deleted:d04c2a2f-d2a7-43c4-8e06-47f3a1882058 for instance bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 on n-h1-845781-6 Aug 09 18:33:12.477329 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b97a423b-c66f-45bf-b038-efc1bfb9f481 req-cfc78f02-2867-41b6-b4e8-56251637088f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035419 Aug 09 18:33:12.477967 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4282/7333] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:33:12.835568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:12.836497 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:12.844143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:12.844648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:12.845296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:12.846200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:12.846838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:12.847278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:12.885519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:12.886124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:12.886663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:12.887203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lazy-loading 'fault' on Instance uuid bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:33:12.937732 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:12.945555 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-92aaeea4-d083-4cca-96e2-bd9718a7395e tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 200 len: 1355 microversion: 2.1 time: 0.115531 Aug 09 18:33:12.946139 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4283/7334] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:12 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 1355 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:33:13.969827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:13.970513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: bb049d56-f09b-4bfa-8f16-408dc2f4e4b0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:13.977796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:13.978280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:13.978719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:13.979408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:13.979882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:13.980310 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:13.996912 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] HTTP exception thrown: Instance bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 could not be found. Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Request method failure captured: Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 HTTP/1.1 Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qbgQVBZovfKtIvw9tWoOSB5InWZd_5SeMZ1Ca-duEVIHXZ_7xzj1ryt6jeanOuQC_1Qth95PjmzO64kWCTB2FZ6iGuFDP2iC8izCzBFo6pSl2i-h8UuuVg_uY5ygbafuEk4pjthQS-RG6ZhqGUZT6Sxuzr3d2Rt6qENN5e0NwE1Sa0 Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 186a3a4a5e7a43fa8cc168e96f28994a Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 186a3a4a5e7a43fa8cc168e96f28994a Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestNetworkAdvancedServerOps-2008998050-project Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 8c34712ceeb54491889acff0f8f2eddd Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2008998050-project Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 could not be found. Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'bb049d56-f09b-4bfa-8f16-408dc2f4e4b0'} Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 could not be found. Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 could not be found. Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:33:13.998566 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:33:14.003665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:33:14.003665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:33:14.003665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:33:14.003665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:33:14.003665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:33:14.003665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:33:14.003665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 could not be found. Aug 09 18:33:14.003665 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:33:14.003665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Returning 404 to user: Instance bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:33:14.003665 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e85f0a0c-4303-49b3-8cc2-4e0858706ce6 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0" status: 404 len: 111 microversion: 2.1 time: 0.034133 Aug 09 18:33:14.003665 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4284/7335] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:13 2022] GET /compute/v2.1/servers/bb049d56-f09b-4bfa-8f16-408dc2f4e4b0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:33:17.348034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f0df86f0-89de-40ed-9b96-195c4b79a4a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '.version_select at 0x7fbbca2c28b0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:17.374668 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f0df86f0-89de-40ed-9b96-195c4b79a4a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1093029217" status: 202 len: 0 microversion: 2.1 time: 0.029081 Aug 09 18:33:17.374668 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4285/7336] 10.222.0.93 () {58 vars in 1284 bytes} [Tue Aug 9 18:33:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1093029217 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:33:17.406931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e9b8192e-afe9-431b-884e-21f85b1e03a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'create', calling method: .version_select at 0x7fbbca2cfc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1289469233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjdgzY2VtTDWMwCC3RZz7v51H4rXLta7NLjbglfRGODHF9v4BjnUsoEoya3eDzUVQWaY4LRd558Xg4MAnfacWGm8eMNqcNltj+9VEUVx//+Ll/6Dp+HoIfhEiwNq2+X2A=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:33:17.423746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-e9b8192e-afe9-431b-884e-21f85b1e03a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:33:17.428824 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-e9b8192e-afe9-431b-884e-21f85b1e03a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for user 8c34712ceeb54491889acff0f8f2eddd and project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:33:17.451840 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e9b8192e-afe9-431b-884e-21f85b1e03a0 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.048776 Aug 09 18:33:17.452423 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4286/7337] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:33:17 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:33:23.125284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1679002869", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "networks": [{"uuid": "eb1d86db-6296-45a0-b71d-f26319baf5a4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1289469233", "security_groups": [{"name": "tempest-secgroup-smoke-2087010138"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:33:23.251886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] validate_networks() for [('eb1d86db-6296-45a0-b71d-f26319baf5a4', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:33:23.657815 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:33:23.658326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:33:23.658918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:33:23.659405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:33:23.659941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:33:23.670004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:23.670557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:23.671001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:23.671867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:23.672332 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:23.672819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:23.691116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:33:23.697042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Getting quotas for user 8c34712ceeb54491889acff0f8f2eddd and project 186a3a4a5e7a43fa8cc168e96f28994a. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:33:23.709440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:33:23.711895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:33:23.759917 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b2dcbaf-f3c1-4e4c-abf5-da8447c12764 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.638538 Aug 09 18:33:23.766998 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4287/7338] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:33:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:33:23.773726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-dc33eb5a-98b4-40a4-82c5-03641ed255e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:23.774700 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-dc33eb5a-98b4-40a4-82c5-03641ed255e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:23.842865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-dc33eb5a-98b4-40a4-82c5-03641ed255e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:23.851570 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-dc33eb5a-98b4-40a4-82c5-03641ed255e1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1267 microversion: 2.1 time: 0.082599 Aug 09 18:33:23.852728 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4288/7339] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:23 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:24.872870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b03532ae-1ffc-4963-ad65-c93cbaead75c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:24.873542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b03532ae-1ffc-4963-ad65-c93cbaead75c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:24.882350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b03532ae-1ffc-4963-ad65-c93cbaead75c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:24.882859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b03532ae-1ffc-4963-ad65-c93cbaead75c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:24.883330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b03532ae-1ffc-4963-ad65-c93cbaead75c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:24.884544 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b03532ae-1ffc-4963-ad65-c93cbaead75c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:24.885141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b03532ae-1ffc-4963-ad65-c93cbaead75c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:24.885548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b03532ae-1ffc-4963-ad65-c93cbaead75c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:24.989980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b03532ae-1ffc-4963-ad65-c93cbaead75c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:24.998879 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b03532ae-1ffc-4963-ad65-c93cbaead75c tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1325 microversion: 2.1 time: 0.130068 Aug 09 18:33:25.007753 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4289/7340] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:24 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1325 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:33:26.023595 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7fd2b484-fedd-4fd7-892c-74c60c644368 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:26.024618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7fd2b484-fedd-4fd7-892c-74c60c644368 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:26.038525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fd2b484-fedd-4fd7-892c-74c60c644368 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:26.039730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fd2b484-fedd-4fd7-892c-74c60c644368 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:26.050923 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fd2b484-fedd-4fd7-892c-74c60c644368 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:26.052778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fd2b484-fedd-4fd7-892c-74c60c644368 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:26.054145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fd2b484-fedd-4fd7-892c-74c60c644368 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:26.054788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7fd2b484-fedd-4fd7-892c-74c60c644368 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:26.248339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7fd2b484-fedd-4fd7-892c-74c60c644368 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:26.255813 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7fd2b484-fedd-4fd7-892c-74c60c644368 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1393 microversion: 2.1 time: 0.238271 Aug 09 18:33:26.256598 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4290/7341] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:26 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1393 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:26.323421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-140f5bb1-0d3e-4497-8894-249e7e5db0a3 req-032c8154-dc75-4579-98df-b80c4eeab8bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d75c921-de79-4141-8037-91d4e65d0a20", "tag": "9eadf3b3-20e7-4214-b922-a0ca66096146"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:33:26.337036 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-140f5bb1-0d3e-4497-8894-249e7e5db0a3 req-032c8154-dc75-4579-98df-b80c4eeab8bd service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:26.337986 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-140f5bb1-0d3e-4497-8894-249e7e5db0a3 req-032c8154-dc75-4579-98df-b80c4eeab8bd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:26.338433 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-140f5bb1-0d3e-4497-8894-249e7e5db0a3 req-032c8154-dc75-4579-98df-b80c4eeab8bd service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:26.351777 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-140f5bb1-0d3e-4497-8894-249e7e5db0a3 req-032c8154-dc75-4579-98df-b80c4eeab8bd service nova] Creating event network-changed:9eadf3b3-20e7-4214-b922-a0ca66096146 for instance 3d75c921-de79-4141-8037-91d4e65d0a20 on n-h2-845781-6 Aug 09 18:33:26.358655 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-140f5bb1-0d3e-4497-8894-249e7e5db0a3 req-032c8154-dc75-4579-98df-b80c4eeab8bd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042505 Aug 09 18:33:26.359283 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4291/7342] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:33:27.277894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64d384a4-77ff-4421-9a14-d70dec139d9b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:27.278715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-64d384a4-77ff-4421-9a14-d70dec139d9b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:27.285163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64d384a4-77ff-4421-9a14-d70dec139d9b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:27.285658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64d384a4-77ff-4421-9a14-d70dec139d9b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:27.286102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64d384a4-77ff-4421-9a14-d70dec139d9b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:27.286807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64d384a4-77ff-4421-9a14-d70dec139d9b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:27.287262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64d384a4-77ff-4421-9a14-d70dec139d9b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:27.287816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64d384a4-77ff-4421-9a14-d70dec139d9b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:27.425977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-64d384a4-77ff-4421-9a14-d70dec139d9b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:27.434389 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-64d384a4-77ff-4421-9a14-d70dec139d9b tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1393 microversion: 2.1 time: 0.161644 Aug 09 18:33:27.434965 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4292/7343] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:27 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:28.455282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2f560970-b252-4fee-b24b-eaeafa665cb4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:28.456011 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2f560970-b252-4fee-b24b-eaeafa665cb4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:28.463959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f560970-b252-4fee-b24b-eaeafa665cb4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:28.464445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f560970-b252-4fee-b24b-eaeafa665cb4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:28.464890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f560970-b252-4fee-b24b-eaeafa665cb4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:28.465728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f560970-b252-4fee-b24b-eaeafa665cb4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:28.466229 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f560970-b252-4fee-b24b-eaeafa665cb4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:28.466658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2f560970-b252-4fee-b24b-eaeafa665cb4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:28.604109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2f560970-b252-4fee-b24b-eaeafa665cb4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:28.611674 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2f560970-b252-4fee-b24b-eaeafa665cb4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1393 microversion: 2.1 time: 0.160293 Aug 09 18:33:28.612248 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4293/7344] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:28 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:29.634031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6182e0c6-aa30-45ba-b91d-ab8d242d8255 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:29.634723 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6182e0c6-aa30-45ba-b91d-ab8d242d8255 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:29.641728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6182e0c6-aa30-45ba-b91d-ab8d242d8255 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:29.642224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6182e0c6-aa30-45ba-b91d-ab8d242d8255 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:29.642665 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6182e0c6-aa30-45ba-b91d-ab8d242d8255 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:29.643375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6182e0c6-aa30-45ba-b91d-ab8d242d8255 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:29.643867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6182e0c6-aa30-45ba-b91d-ab8d242d8255 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:29.644296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6182e0c6-aa30-45ba-b91d-ab8d242d8255 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:29.805139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6182e0c6-aa30-45ba-b91d-ab8d242d8255 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:29.813070 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6182e0c6-aa30-45ba-b91d-ab8d242d8255 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1393 microversion: 2.1 time: 0.182934 Aug 09 18:33:29.813677 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4294/7345] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:29 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1393 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:30.835170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e7c74f3e-9fa1-4cc3-b554-e981d3a92d92 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:30.835875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e7c74f3e-9fa1-4cc3-b554-e981d3a92d92 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:30.843041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7c74f3e-9fa1-4cc3-b554-e981d3a92d92 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:30.843541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7c74f3e-9fa1-4cc3-b554-e981d3a92d92 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:30.844139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7c74f3e-9fa1-4cc3-b554-e981d3a92d92 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:30.844858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7c74f3e-9fa1-4cc3-b554-e981d3a92d92 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:30.845416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7c74f3e-9fa1-4cc3-b554-e981d3a92d92 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:30.845810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e7c74f3e-9fa1-4cc3-b554-e981d3a92d92 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:30.982107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e7c74f3e-9fa1-4cc3-b554-e981d3a92d92 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:30.989799 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e7c74f3e-9fa1-4cc3-b554-e981d3a92d92 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1393 microversion: 2.1 time: 0.158994 Aug 09 18:33:30.990437 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4295/7346] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:30 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:31.806588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-a5fc62b3-6681-4b3d-ac5a-932820036cd1 req-bd731f34-9773-459b-9b4a-dc1c5a5b1125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d75c921-de79-4141-8037-91d4e65d0a20", "name": "network-vif-plugged", "status": "completed", "tag": "9eadf3b3-20e7-4214-b922-a0ca66096146"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:33:31.817032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a5fc62b3-6681-4b3d-ac5a-932820036cd1 req-bd731f34-9773-459b-9b4a-dc1c5a5b1125 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:31.817549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a5fc62b3-6681-4b3d-ac5a-932820036cd1 req-bd731f34-9773-459b-9b4a-dc1c5a5b1125 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:31.818028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-a5fc62b3-6681-4b3d-ac5a-932820036cd1 req-bd731f34-9773-459b-9b4a-dc1c5a5b1125 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:31.830648 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-a5fc62b3-6681-4b3d-ac5a-932820036cd1 req-bd731f34-9773-459b-9b4a-dc1c5a5b1125 service nova] Creating event network-vif-plugged:9eadf3b3-20e7-4214-b922-a0ca66096146 for instance 3d75c921-de79-4141-8037-91d4e65d0a20 on n-h2-845781-6 Aug 09 18:33:31.836122 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-a5fc62b3-6681-4b3d-ac5a-932820036cd1 req-bd731f34-9773-459b-9b4a-dc1c5a5b1125 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033817 Aug 09 18:33:31.837054 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4296/7347] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:33:32.012111 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b9233050-5980-43dc-bca3-1b0963bf2232 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:32.012816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b9233050-5980-43dc-bca3-1b0963bf2232 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:32.019152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9233050-5980-43dc-bca3-1b0963bf2232 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:32.019658 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9233050-5980-43dc-bca3-1b0963bf2232 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:32.020100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9233050-5980-43dc-bca3-1b0963bf2232 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:32.020851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9233050-5980-43dc-bca3-1b0963bf2232 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:32.021300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9233050-5980-43dc-bca3-1b0963bf2232 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:32.021740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b9233050-5980-43dc-bca3-1b0963bf2232 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:32.196864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b9233050-5980-43dc-bca3-1b0963bf2232 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:32.205016 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b9233050-5980-43dc-bca3-1b0963bf2232 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1393 microversion: 2.1 time: 0.197907 Aug 09 18:33:32.205600 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4297/7348] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:32 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1393 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:33.225715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-24b71596-0eb3-4b9d-9ff3-b0df368b30da tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:33.226359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-24b71596-0eb3-4b9d-9ff3-b0df368b30da tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:33.229064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:33.234482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24b71596-0eb3-4b9d-9ff3-b0df368b30da tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:33.234979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24b71596-0eb3-4b9d-9ff3-b0df368b30da tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:33.235418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24b71596-0eb3-4b9d-9ff3-b0df368b30da tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:33.236141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24b71596-0eb3-4b9d-9ff3-b0df368b30da tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:33.236599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24b71596-0eb3-4b9d-9ff3-b0df368b30da tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:33.237026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-24b71596-0eb3-4b9d-9ff3-b0df368b30da tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:33.243029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:33.391318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-24b71596-0eb3-4b9d-9ff3-b0df368b30da tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:33.399100 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-24b71596-0eb3-4b9d-9ff3-b0df368b30da tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1564 microversion: 2.1 time: 0.177400 Aug 09 18:33:33.399701 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4298/7349] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:33 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1564 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:33.420729 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-64a470a0-9d92-42ce-b0f5-e375106ea8fe tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:33.421337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-64a470a0-9d92-42ce-b0f5-e375106ea8fe tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:33.428053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64a470a0-9d92-42ce-b0f5-e375106ea8fe tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:33.428541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64a470a0-9d92-42ce-b0f5-e375106ea8fe tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:33.429064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64a470a0-9d92-42ce-b0f5-e375106ea8fe tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:33.429771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64a470a0-9d92-42ce-b0f5-e375106ea8fe tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:33.430223 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64a470a0-9d92-42ce-b0f5-e375106ea8fe tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:33.430646 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-64a470a0-9d92-42ce-b0f5-e375106ea8fe tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:33.570712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-64a470a0-9d92-42ce-b0f5-e375106ea8fe tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:33.578740 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-64a470a0-9d92-42ce-b0f5-e375106ea8fe tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1564 microversion: 2.1 time: 0.161834 Aug 09 18:33:33.579334 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4299/7350] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:33 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:35.586742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c72053bc-57e9-4857-9b50-b98ce4821e65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:33:35.587689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c72053bc-57e9-4857-9b50-b98ce4821e65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:35.589577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:35.590449 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:35.597856 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72053bc-57e9-4857-9b50-b98ce4821e65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:35.598360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72053bc-57e9-4857-9b50-b98ce4821e65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:35.598830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72053bc-57e9-4857-9b50-b98ce4821e65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:35.600155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72053bc-57e9-4857-9b50-b98ce4821e65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:35.600617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72053bc-57e9-4857-9b50-b98ce4821e65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:35.601058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c72053bc-57e9-4857-9b50-b98ce4821e65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:35.747108 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c72053bc-57e9-4857-9b50-b98ce4821e65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:33:35.754809 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c72053bc-57e9-4857-9b50-b98ce4821e65 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1564 microversion: 2.1 time: 0.173028 Aug 09 18:33:35.755964 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4300/7351] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:33:35 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:33:35.760368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5a01f8bc-b977-4ff3-b5fd-86e7db23123f req-667a4373-e73d-41c1-951b-6075e4e28265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d75c921-de79-4141-8037-91d4e65d0a20", "tag": "9eadf3b3-20e7-4214-b922-a0ca66096146"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:33:35.770524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5a01f8bc-b977-4ff3-b5fd-86e7db23123f req-667a4373-e73d-41c1-951b-6075e4e28265 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:35.771845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5a01f8bc-b977-4ff3-b5fd-86e7db23123f req-667a4373-e73d-41c1-951b-6075e4e28265 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:35.772472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5a01f8bc-b977-4ff3-b5fd-86e7db23123f req-667a4373-e73d-41c1-951b-6075e4e28265 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:36.050305 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5a01f8bc-b977-4ff3-b5fd-86e7db23123f req-667a4373-e73d-41c1-951b-6075e4e28265 service nova] Creating event network-changed:9eadf3b3-20e7-4214-b922-a0ca66096146 for instance 3d75c921-de79-4141-8037-91d4e65d0a20 on n-h2-845781-6 Aug 09 18:33:36.056331 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5a01f8bc-b977-4ff3-b5fd-86e7db23123f req-667a4373-e73d-41c1-951b-6075e4e28265 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299250 Aug 09 18:33:36.057106 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4301/7352] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:33:57.029767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=7 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:57.030805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=19 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:33:57.036874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-982b04c1-dc83-48a6-8ebe-1ab14bfc0a6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:33:57.039137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-982b04c1-dc83-48a6-8ebe-1ab14bfc0a6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:33:57.046661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-982b04c1-dc83-48a6-8ebe-1ab14bfc0a6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:57.047159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-982b04c1-dc83-48a6-8ebe-1ab14bfc0a6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:57.047615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-982b04c1-dc83-48a6-8ebe-1ab14bfc0a6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:57.048436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-982b04c1-dc83-48a6-8ebe-1ab14bfc0a6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:33:57.048900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-982b04c1-dc83-48a6-8ebe-1ab14bfc0a6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:33:57.049338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-982b04c1-dc83-48a6-8ebe-1ab14bfc0a6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:33:57.105153 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-982b04c1-dc83-48a6-8ebe-1ab14bfc0a6f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20/action" status: 200 len: 24536 microversion: 2.1 time: 0.078176 Aug 09 18:33:57.105829 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4302/7353] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:33:57 2022] POST /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20/action => generated 24536 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:34:08.140773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-37e5158a-b4a6-4778-852f-08a2c25b0d76 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:08.141466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-37e5158a-b4a6-4778-852f-08a2c25b0d76 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:08.144231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:08.145598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:08.153134 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e5158a-b4a6-4778-852f-08a2c25b0d76 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:08.153638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e5158a-b4a6-4778-852f-08a2c25b0d76 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:08.154087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e5158a-b4a6-4778-852f-08a2c25b0d76 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:08.154791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e5158a-b4a6-4778-852f-08a2c25b0d76 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:08.155253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e5158a-b4a6-4778-852f-08a2c25b0d76 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:08.155721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-37e5158a-b4a6-4778-852f-08a2c25b0d76 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:08.179540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-37e5158a-b4a6-4778-852f-08a2c25b0d76 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lazy-loading 'flavor' on Instance uuid 3d75c921-de79-4141-8037-91d4e65d0a20 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:34:08.246571 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-37e5158a-b4a6-4778-852f-08a2c25b0d76 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20/action" status: 202 len: 0 microversion: 2.1 time: 0.109828 Aug 09 18:34:08.247452 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4303/7354] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:34:08 2022] POST /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:34:08.256549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-87458fe1-b978-4c20-9b68-6b8f5bb5f1c4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:08.257281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-87458fe1-b978-4c20-9b68-6b8f5bb5f1c4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:08.263518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87458fe1-b978-4c20-9b68-6b8f5bb5f1c4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:08.264062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87458fe1-b978-4c20-9b68-6b8f5bb5f1c4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:08.264526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87458fe1-b978-4c20-9b68-6b8f5bb5f1c4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:08.265220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87458fe1-b978-4c20-9b68-6b8f5bb5f1c4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:08.265687 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87458fe1-b978-4c20-9b68-6b8f5bb5f1c4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:08.266129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-87458fe1-b978-4c20-9b68-6b8f5bb5f1c4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:08.404404 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-87458fe1-b978-4c20-9b68-6b8f5bb5f1c4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:08.412519 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-87458fe1-b978-4c20-9b68-6b8f5bb5f1c4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1690 microversion: 2.1 time: 0.160670 Aug 09 18:34:08.413120 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4304/7355] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:08 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:09.434605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6fb8546a-7a8e-4d5f-a456-f5de2a309625 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:09.435496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6fb8546a-7a8e-4d5f-a456-f5de2a309625 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:09.443203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6fb8546a-7a8e-4d5f-a456-f5de2a309625 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:09.443682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6fb8546a-7a8e-4d5f-a456-f5de2a309625 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:09.444136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6fb8546a-7a8e-4d5f-a456-f5de2a309625 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:09.444873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6fb8546a-7a8e-4d5f-a456-f5de2a309625 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:09.445333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6fb8546a-7a8e-4d5f-a456-f5de2a309625 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:09.445764 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6fb8546a-7a8e-4d5f-a456-f5de2a309625 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:09.597565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6fb8546a-7a8e-4d5f-a456-f5de2a309625 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:09.606091 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6fb8546a-7a8e-4d5f-a456-f5de2a309625 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1673 microversion: 2.1 time: 0.175444 Aug 09 18:34:09.606680 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4305/7356] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:09 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:10.702163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-811c5709-c302-4672-a444-2ce821b954c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:10.704477 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-811c5709-c302-4672-a444-2ce821b954c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:10.712353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-811c5709-c302-4672-a444-2ce821b954c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:10.712847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-811c5709-c302-4672-a444-2ce821b954c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:10.713291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-811c5709-c302-4672-a444-2ce821b954c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:10.714005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-811c5709-c302-4672-a444-2ce821b954c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:10.714464 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-811c5709-c302-4672-a444-2ce821b954c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:10.714892 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-811c5709-c302-4672-a444-2ce821b954c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:10.770399 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-811c5709-c302-4672-a444-2ce821b954c1 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20/action" status: 200 len: 38376 microversion: 2.1 time: 0.071937 Aug 09 18:34:10.771650 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4306/7357] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:34:10 2022] POST /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20/action => generated 38376 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:34:10.784925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-45f054d5-d3cd-47b0-af4b-8105a0308d30 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:10.785564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-45f054d5-d3cd-47b0-af4b-8105a0308d30 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:10.793417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45f054d5-d3cd-47b0-af4b-8105a0308d30 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:10.793912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45f054d5-d3cd-47b0-af4b-8105a0308d30 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:10.794365 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45f054d5-d3cd-47b0-af4b-8105a0308d30 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:10.795080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45f054d5-d3cd-47b0-af4b-8105a0308d30 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:10.795545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45f054d5-d3cd-47b0-af4b-8105a0308d30 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:10.796013 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-45f054d5-d3cd-47b0-af4b-8105a0308d30 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:10.864819 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-45f054d5-d3cd-47b0-af4b-8105a0308d30 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20/action" status: 202 len: 0 microversion: 2.1 time: 0.083951 Aug 09 18:34:10.865456 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4307/7358] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:34:10 2022] POST /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:34:10.874652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5f37ee39-064b-4731-9990-31dee0250a08 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:10.875386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5f37ee39-064b-4731-9990-31dee0250a08 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:10.881836 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f37ee39-064b-4731-9990-31dee0250a08 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:10.882354 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f37ee39-064b-4731-9990-31dee0250a08 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:10.882784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f37ee39-064b-4731-9990-31dee0250a08 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:10.883503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f37ee39-064b-4731-9990-31dee0250a08 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:10.884004 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f37ee39-064b-4731-9990-31dee0250a08 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:10.884431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5f37ee39-064b-4731-9990-31dee0250a08 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:11.109689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5f37ee39-064b-4731-9990-31dee0250a08 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:11.117319 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5f37ee39-064b-4731-9990-31dee0250a08 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1679 microversion: 2.1 time: 0.247260 Aug 09 18:34:11.117995 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4308/7359] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:10 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:12.138948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5bc7803e-e09e-4489-807b-a56abd51f9c9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:12.139597 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5bc7803e-e09e-4489-807b-a56abd51f9c9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:12.147152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bc7803e-e09e-4489-807b-a56abd51f9c9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:12.147662 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bc7803e-e09e-4489-807b-a56abd51f9c9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:12.148116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bc7803e-e09e-4489-807b-a56abd51f9c9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:12.148827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bc7803e-e09e-4489-807b-a56abd51f9c9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:12.149286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bc7803e-e09e-4489-807b-a56abd51f9c9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:12.149750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5bc7803e-e09e-4489-807b-a56abd51f9c9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:12.295747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5bc7803e-e09e-4489-807b-a56abd51f9c9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:12.304880 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5bc7803e-e09e-4489-807b-a56abd51f9c9 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1679 microversion: 2.1 time: 0.169880 Aug 09 18:34:12.305584 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4309/7360] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:12 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:13.327678 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9d3b4e49-e218-4d0d-99d7-09b619e30aaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:13.328352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9d3b4e49-e218-4d0d-99d7-09b619e30aaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:13.336028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d3b4e49-e218-4d0d-99d7-09b619e30aaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:13.336529 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d3b4e49-e218-4d0d-99d7-09b619e30aaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:13.337230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d3b4e49-e218-4d0d-99d7-09b619e30aaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:13.337943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d3b4e49-e218-4d0d-99d7-09b619e30aaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:13.338408 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d3b4e49-e218-4d0d-99d7-09b619e30aaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:13.338843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9d3b4e49-e218-4d0d-99d7-09b619e30aaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:13.475615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9d3b4e49-e218-4d0d-99d7-09b619e30aaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:13.483721 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9d3b4e49-e218-4d0d-99d7-09b619e30aaa tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1682 microversion: 2.1 time: 0.160252 Aug 09 18:34:13.484303 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4310/7361] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:13 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:13.578623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5082138c-cc37-44be-b208-4cd734aea221 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:13.580749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5082138c-cc37-44be-b208-4cd734aea221 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:13.587123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5082138c-cc37-44be-b208-4cd734aea221 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:13.587617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5082138c-cc37-44be-b208-4cd734aea221 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:13.588074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5082138c-cc37-44be-b208-4cd734aea221 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:13.589101 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5082138c-cc37-44be-b208-4cd734aea221 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:13.589342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5082138c-cc37-44be-b208-4cd734aea221 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:13.589669 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5082138c-cc37-44be-b208-4cd734aea221 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:13.633611 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5082138c-cc37-44be-b208-4cd734aea221 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "POST /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20/action" status: 200 len: 38376 microversion: 2.1 time: 0.058825 Aug 09 18:34:13.634595 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4311/7362] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:34:13 2022] POST /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20/action => generated 38376 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 18:34:14.671454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25430c47-bd07-42ea-895f-e9869fe97db4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:14.672422 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-25430c47-bd07-42ea-895f-e9869fe97db4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:14.681144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25430c47-bd07-42ea-895f-e9869fe97db4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:14.682060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25430c47-bd07-42ea-895f-e9869fe97db4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:14.682270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25430c47-bd07-42ea-895f-e9869fe97db4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:14.683018 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25430c47-bd07-42ea-895f-e9869fe97db4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:14.683486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25430c47-bd07-42ea-895f-e9869fe97db4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:14.683953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25430c47-bd07-42ea-895f-e9869fe97db4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:14.717041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-25430c47-bd07-42ea-895f-e9869fe97db4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:34:14.819240 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-25430c47-bd07-42ea-895f-e9869fe97db4 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 204 len: 0 microversion: 2.1 time: 0.152469 Aug 09 18:34:14.820180 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4312/7363] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:34:14 2022] DELETE /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:34:14.828998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-22162269-d4d3-4248-8318-cbcb61e511b2 req-f5e1a96a-25f8-4adb-b37a-c11a6ac034a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d75c921-de79-4141-8037-91d4e65d0a20", "tag": "9eadf3b3-20e7-4214-b922-a0ca66096146"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:14.841215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-22162269-d4d3-4248-8318-cbcb61e511b2 req-f5e1a96a-25f8-4adb-b37a-c11a6ac034a3 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:14.841713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-22162269-d4d3-4248-8318-cbcb61e511b2 req-f5e1a96a-25f8-4adb-b37a-c11a6ac034a3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:14.842155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-22162269-d4d3-4248-8318-cbcb61e511b2 req-f5e1a96a-25f8-4adb-b37a-c11a6ac034a3 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:14.853920 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-22162269-d4d3-4248-8318-cbcb61e511b2 req-f5e1a96a-25f8-4adb-b37a-c11a6ac034a3 service nova] Creating event network-changed:9eadf3b3-20e7-4214-b922-a0ca66096146 for instance 3d75c921-de79-4141-8037-91d4e65d0a20 on n-h2-845781-6 Aug 09 18:34:14.859008 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-22162269-d4d3-4248-8318-cbcb61e511b2 req-f5e1a96a-25f8-4adb-b37a-c11a6ac034a3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034065 Aug 09 18:34:14.859664 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4313/7364] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:34:14.865508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-63cc925a-8b79-4b10-8290-6f7b6da6334f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:14.866218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-63cc925a-8b79-4b10-8290-6f7b6da6334f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:14.873369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63cc925a-8b79-4b10-8290-6f7b6da6334f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:14.873861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63cc925a-8b79-4b10-8290-6f7b6da6334f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:14.874305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63cc925a-8b79-4b10-8290-6f7b6da6334f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:14.875021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63cc925a-8b79-4b10-8290-6f7b6da6334f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:14.875475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63cc925a-8b79-4b10-8290-6f7b6da6334f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:14.875937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-63cc925a-8b79-4b10-8290-6f7b6da6334f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:15.032390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-63cc925a-8b79-4b10-8290-6f7b6da6334f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:15.041169 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-63cc925a-8b79-4b10-8290-6f7b6da6334f tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1688 microversion: 2.1 time: 0.180285 Aug 09 18:34:15.041771 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4314/7365] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:14 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:16.065220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-58960bdd-6cc2-481a-a28e-dfb51113b152 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:16.065902 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-58960bdd-6cc2-481a-a28e-dfb51113b152 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:16.074149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58960bdd-6cc2-481a-a28e-dfb51113b152 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:16.074682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58960bdd-6cc2-481a-a28e-dfb51113b152 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:16.075138 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58960bdd-6cc2-481a-a28e-dfb51113b152 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:16.075880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58960bdd-6cc2-481a-a28e-dfb51113b152 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:16.076346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58960bdd-6cc2-481a-a28e-dfb51113b152 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:16.076786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-58960bdd-6cc2-481a-a28e-dfb51113b152 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:16.298993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-58960bdd-6cc2-481a-a28e-dfb51113b152 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:16.308388 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-58960bdd-6cc2-481a-a28e-dfb51113b152 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1688 microversion: 2.1 time: 0.247066 Aug 09 18:34:16.308983 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4315/7366] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:16 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:17.025961 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-6d0aa67f-83fc-446a-b94a-a2e873677813 req-2edd9db0-ab5d-40c1-a1c9-4a211482e344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d75c921-de79-4141-8037-91d4e65d0a20", "name": "network-vif-deleted", "tag": "9eadf3b3-20e7-4214-b922-a0ca66096146"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:17.037976 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6d0aa67f-83fc-446a-b94a-a2e873677813 req-2edd9db0-ab5d-40c1-a1c9-4a211482e344 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:17.038498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6d0aa67f-83fc-446a-b94a-a2e873677813 req-2edd9db0-ab5d-40c1-a1c9-4a211482e344 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:17.038985 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-6d0aa67f-83fc-446a-b94a-a2e873677813 req-2edd9db0-ab5d-40c1-a1c9-4a211482e344 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:17.050870 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-6d0aa67f-83fc-446a-b94a-a2e873677813 req-2edd9db0-ab5d-40c1-a1c9-4a211482e344 service nova] Creating event network-vif-deleted:9eadf3b3-20e7-4214-b922-a0ca66096146 for instance 3d75c921-de79-4141-8037-91d4e65d0a20 on n-h2-845781-6 Aug 09 18:34:17.056239 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-6d0aa67f-83fc-446a-b94a-a2e873677813 req-2edd9db0-ab5d-40c1-a1c9-4a211482e344 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034057 Aug 09 18:34:17.056822 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4316/7367] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:34:17.331376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:17.332125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:17.339314 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:17.339837 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:17.340282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:17.340988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:17.341466 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:17.341912 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:17.346832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:17.378427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:17.378967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:17.379413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:17.379956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lazy-loading 'fault' on Instance uuid 3d75c921-de79-4141-8037-91d4e65d0a20 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:34:17.425556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c34712ceeb54491889acff0f8f2eddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '186a3a4a5e7a43fa8cc168e96f28994a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:17.433586 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d4a3281b-52c3-466a-8268-fb3d54a85528 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 200 len: 1357 microversion: 2.1 time: 0.106956 Aug 09 18:34:17.434402 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4317/7368] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:17 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:18.455123 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:18.455825 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] [instance: 3d75c921-de79-4141-8037-91d4e65d0a20] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:18.464359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:18.464857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:18.465306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:18.466012 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:18.466471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:18.466904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:18.480329 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] HTTP exception thrown: Instance 3d75c921-de79-4141-8037-91d4e65d0a20 could not be found. Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Request method failure captured: Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 HTTP/1.1 Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qbgQVBZovfKtIvw9tWoOSB5InWZd_5SeMZ1Ca-duEVIHXZ_7xzj1ryt6jeanOuQC_1Qth95PjmzO64kWCTB2FZ6iGuFDP2iC8izCzBFo6pSl2i-h8UuuVg_uY5ygbafuEk4pjthQS-RG6ZhqGUZT6Sxuzr3d2Rt6qENN5e0NwE1Sa0 Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 186a3a4a5e7a43fa8cc168e96f28994a Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/186a3a4a5e7a43fa8cc168e96f28994a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 186a3a4a5e7a43fa8cc168e96f28994a Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2008998050 Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestNetworkAdvancedServerOps-2008998050-project Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 8c34712ceeb54491889acff0f8f2eddd Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2008998050-project Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 3d75c921-de79-4141-8037-91d4e65d0a20 could not be found. Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '3d75c921-de79-4141-8037-91d4e65d0a20'} Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d75c921-de79-4141-8037-91d4e65d0a20 could not be found. Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d75c921-de79-4141-8037-91d4e65d0a20 could not be found. Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:34:18.481991 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:34:18.486979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:34:18.486979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:34:18.486979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:34:18.486979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:34:18.486979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:34:18.486979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:34:18.486979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d75c921-de79-4141-8037-91d4e65d0a20 could not be found. Aug 09 18:34:18.486979 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:34:18.486979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Returning 404 to user: Instance 3d75c921-de79-4141-8037-91d4e65d0a20 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:34:18.486979 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bbfdc0f4-ed73-481c-baf3-aaf03a62e3f5 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20" status: 404 len: 111 microversion: 2.1 time: 0.032321 Aug 09 18:34:18.486979 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4318/7369] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:18 2022] GET /compute/v2.1/servers/3d75c921-de79-4141-8037-91d4e65d0a20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:34:22.116413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-910ee90d-4cd5-4d0d-8e7e-04d72692c9c8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] Calling method '.version_select at 0x7fbbca5deb80>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:22.139320 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-910ee90d-4cd5-4d0d-8e7e-04d72692c9c8 tempest-TestNetworkAdvancedServerOps-2008998050 tempest-TestNetworkAdvancedServerOps-2008998050-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1289469233" status: 202 len: 0 microversion: 2.1 time: 0.027301 Aug 09 18:34:22.140395 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4319/7370] 10.222.0.93 () {58 vars in 1284 bytes} [Tue Aug 9 18:34:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1289469233 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:34:33.470507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:33.471415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:33.643943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2b65c4c0-ead7-48a5-8adf-e1758309dbcd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Action: 'create', calling method: .version_select at 0x7fbbca4b3c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1064307888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA1gh16giAqG/wpBiLK9NHioug3RNAZswSkY71E90TA8WH5n1Fi1peuu2FZOrobVkjG+yRS20aR1aOY2HnK3Da/heouUsvfQ/wpx8eJg5WWdY8siBvcM7RzuGfgBAY1vQ=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:33.661858 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2b65c4c0-ead7-48a5-8adf-e1758309dbcd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Getting quotas for project 19db25916ce54b5cb76dd46d757321b6. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:34:33.667852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-2b65c4c0-ead7-48a5-8adf-e1758309dbcd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Getting quotas for user fbe62e36a76b4d929225bea32b97c3f9 and project 19db25916ce54b5cb76dd46d757321b6. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:34:33.695963 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2b65c4c0-ead7-48a5-8adf-e1758309dbcd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.231891 Aug 09 18:34:33.696501 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4320/7371] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:34:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:34:34.826762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-874990029", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1064307888", "security_groups": [{"name": "tempest-secgroup-smoke-222006820"}], "networks": [{"uuid": "03ee75c4-2130-4455-9162-71f0e5da6192"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:34.943570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] validate_networks() for [('03ee75c4-2130-4455-9162-71f0e5da6192', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:34:35.356777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:34:35.357205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:34:35.357685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:34:35.358095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:34:35.358508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:34:35.367270 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:35.367791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:35.368231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:35.368954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:35.369441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:35.369863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:35.386179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Getting quotas for project 19db25916ce54b5cb76dd46d757321b6. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:34:35.391357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Getting quotas for user fbe62e36a76b4d929225bea32b97c3f9 and project 19db25916ce54b5cb76dd46d757321b6. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:34:35.404035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:34:35.406305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:34:35.451952 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-27675fc9-ce27-4fc9-bb5d-b1fc00f58658 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.629808 Aug 09 18:34:35.458780 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4321/7372] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:34:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:34:35.464235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4a9829d7-0563-4926-a969-8d453f89bcfc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:35.464848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4a9829d7-0563-4926-a969-8d453f89bcfc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:35.518680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4a9829d7-0563-4926-a969-8d453f89bcfc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:35.526404 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4a9829d7-0563-4926-a969-8d453f89bcfc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1246 microversion: 2.1 time: 0.066106 Aug 09 18:34:35.526996 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4322/7373] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:35 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:36.548153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-200a5250-4102-451b-b11b-9a2aa714a6e7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:36.548917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-200a5250-4102-451b-b11b-9a2aa714a6e7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:36.612371 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-200a5250-4102-451b-b11b-9a2aa714a6e7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:36.619611 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-200a5250-4102-451b-b11b-9a2aa714a6e7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1246 microversion: 2.1 time: 0.075796 Aug 09 18:34:36.620425 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4323/7374] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:36 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:37.641637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e16091f-bc05-4c33-8cbc-f47460a3a45a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:37.642361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e16091f-bc05-4c33-8cbc-f47460a3a45a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:37.699931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e16091f-bc05-4c33-8cbc-f47460a3a45a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:37.707952 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e16091f-bc05-4c33-8cbc-f47460a3a45a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1246 microversion: 2.1 time: 0.070205 Aug 09 18:34:37.708549 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4324/7375] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:37 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:38.728908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2d783b37-444f-49c1-b048-5e9dca85f7c7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:38.729592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2d783b37-444f-49c1-b048-5e9dca85f7c7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:38.783998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2d783b37-444f-49c1-b048-5e9dca85f7c7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:38.791259 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2d783b37-444f-49c1-b048-5e9dca85f7c7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1246 microversion: 2.1 time: 0.066294 Aug 09 18:34:38.791873 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4325/7376] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:38 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1246 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:39.811187 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b45c61dd-17f0-4c30-a5d4-f93e41911a7e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:39.811890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b45c61dd-17f0-4c30-a5d4-f93e41911a7e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:39.819481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45c61dd-17f0-4c30-a5d4-f93e41911a7e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:39.820002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45c61dd-17f0-4c30-a5d4-f93e41911a7e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:39.820451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45c61dd-17f0-4c30-a5d4-f93e41911a7e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:39.821146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45c61dd-17f0-4c30-a5d4-f93e41911a7e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:39.821608 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45c61dd-17f0-4c30-a5d4-f93e41911a7e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:39.822040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b45c61dd-17f0-4c30-a5d4-f93e41911a7e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:39.884984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b45c61dd-17f0-4c30-a5d4-f93e41911a7e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:39.897274 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b45c61dd-17f0-4c30-a5d4-f93e41911a7e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1250 microversion: 2.1 time: 0.089906 Aug 09 18:34:39.897863 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4326/7377] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:39 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:40.918465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d21ed812-4327-47be-8a81-cffefacc4280 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:40.919151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d21ed812-4327-47be-8a81-cffefacc4280 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:40.926088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21ed812-4327-47be-8a81-cffefacc4280 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:40.926578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21ed812-4327-47be-8a81-cffefacc4280 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:40.927022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21ed812-4327-47be-8a81-cffefacc4280 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:40.927787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21ed812-4327-47be-8a81-cffefacc4280 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:40.928251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21ed812-4327-47be-8a81-cffefacc4280 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:40.928685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21ed812-4327-47be-8a81-cffefacc4280 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:40.994979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d21ed812-4327-47be-8a81-cffefacc4280 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:41.002463 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d21ed812-4327-47be-8a81-cffefacc4280 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1304 microversion: 2.1 time: 0.087883 Aug 09 18:34:41.003050 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4327/7378] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:40 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:42.087530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-d1d31d03-77dc-4ce0-81e5-ffd9936595aa req-8f66080d-0eaf-4411-a3f3-7383d463cf49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe97f26-e95d-4817-8260-63d999eb35d0", "tag": "161830e2-fedc-4433-8c24-5babcba5d54c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:42.097180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d1d31d03-77dc-4ce0-81e5-ffd9936595aa req-8f66080d-0eaf-4411-a3f3-7383d463cf49 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:42.097718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d1d31d03-77dc-4ce0-81e5-ffd9936595aa req-8f66080d-0eaf-4411-a3f3-7383d463cf49 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:42.098318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-d1d31d03-77dc-4ce0-81e5-ffd9936595aa req-8f66080d-0eaf-4411-a3f3-7383d463cf49 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:42.110163 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-d1d31d03-77dc-4ce0-81e5-ffd9936595aa req-8f66080d-0eaf-4411-a3f3-7383d463cf49 service nova] Creating event network-changed:161830e2-fedc-4433-8c24-5babcba5d54c for instance 2fe97f26-e95d-4817-8260-63d999eb35d0 on n-h1-845781-6 Aug 09 18:34:42.115709 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-d1d31d03-77dc-4ce0-81e5-ffd9936595aa req-8f66080d-0eaf-4411-a3f3-7383d463cf49 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103629 Aug 09 18:34:42.116323 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4328/7379] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:34:42.121387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6f8bc937-5669-4794-986d-199a75944e04 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:42.122176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6f8bc937-5669-4794-986d-199a75944e04 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:42.128425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f8bc937-5669-4794-986d-199a75944e04 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:42.129454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f8bc937-5669-4794-986d-199a75944e04 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:42.129903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f8bc937-5669-4794-986d-199a75944e04 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:42.130611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f8bc937-5669-4794-986d-199a75944e04 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:42.131072 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f8bc937-5669-4794-986d-199a75944e04 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:42.131505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6f8bc937-5669-4794-986d-199a75944e04 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:42.268558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6f8bc937-5669-4794-986d-199a75944e04 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:42.276426 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6f8bc937-5669-4794-986d-199a75944e04 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1371 microversion: 2.1 time: 0.158947 Aug 09 18:34:42.277013 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4329/7380] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:42 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:34:43.297056 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1654dfa6-4e33-4eee-82d1-a1c48cb6402a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:43.297706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1654dfa6-4e33-4eee-82d1-a1c48cb6402a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:43.305472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1654dfa6-4e33-4eee-82d1-a1c48cb6402a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:43.306089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1654dfa6-4e33-4eee-82d1-a1c48cb6402a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:43.306593 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1654dfa6-4e33-4eee-82d1-a1c48cb6402a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:43.307364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1654dfa6-4e33-4eee-82d1-a1c48cb6402a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:43.307882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1654dfa6-4e33-4eee-82d1-a1c48cb6402a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:43.308315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1654dfa6-4e33-4eee-82d1-a1c48cb6402a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:43.441444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1654dfa6-4e33-4eee-82d1-a1c48cb6402a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:43.449269 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1654dfa6-4e33-4eee-82d1-a1c48cb6402a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1371 microversion: 2.1 time: 0.156114 Aug 09 18:34:43.449863 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4330/7381] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:43 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:44.470096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3396f09e-c9e6-42a3-92bd-91b2e2376cab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:44.470719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3396f09e-c9e6-42a3-92bd-91b2e2376cab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:44.480021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3396f09e-c9e6-42a3-92bd-91b2e2376cab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:44.480758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3396f09e-c9e6-42a3-92bd-91b2e2376cab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:44.481427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3396f09e-c9e6-42a3-92bd-91b2e2376cab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:44.482478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3396f09e-c9e6-42a3-92bd-91b2e2376cab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:44.483185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3396f09e-c9e6-42a3-92bd-91b2e2376cab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:44.483869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3396f09e-c9e6-42a3-92bd-91b2e2376cab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:44.629315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3396f09e-c9e6-42a3-92bd-91b2e2376cab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:44.636959 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3396f09e-c9e6-42a3-92bd-91b2e2376cab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1371 microversion: 2.1 time: 0.170804 Aug 09 18:34:44.637554 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4331/7382] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:44 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:45.657930 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c14a17c7-9434-4fa2-91d9-b28d3a6bd4a7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:45.658560 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c14a17c7-9434-4fa2-91d9-b28d3a6bd4a7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:45.660486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:45.666733 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14a17c7-9434-4fa2-91d9-b28d3a6bd4a7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:45.667246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14a17c7-9434-4fa2-91d9-b28d3a6bd4a7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:45.667709 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14a17c7-9434-4fa2-91d9-b28d3a6bd4a7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:45.668411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14a17c7-9434-4fa2-91d9-b28d3a6bd4a7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:45.669065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14a17c7-9434-4fa2-91d9-b28d3a6bd4a7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:45.669496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c14a17c7-9434-4fa2-91d9-b28d3a6bd4a7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:45.805179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c14a17c7-9434-4fa2-91d9-b28d3a6bd4a7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:45.812747 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c14a17c7-9434-4fa2-91d9-b28d3a6bd4a7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1371 microversion: 2.1 time: 0.158827 Aug 09 18:34:45.813330 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4332/7383] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:45 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:46.834107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2081f545-a460-4ab4-83d2-1201213f9971 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:46.834884 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2081f545-a460-4ab4-83d2-1201213f9971 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:46.842444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2081f545-a460-4ab4-83d2-1201213f9971 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:46.843049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2081f545-a460-4ab4-83d2-1201213f9971 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:46.843502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2081f545-a460-4ab4-83d2-1201213f9971 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:46.844239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2081f545-a460-4ab4-83d2-1201213f9971 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:46.844705 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2081f545-a460-4ab4-83d2-1201213f9971 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:46.845213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2081f545-a460-4ab4-83d2-1201213f9971 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:46.982060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2081f545-a460-4ab4-83d2-1201213f9971 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:46.990368 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2081f545-a460-4ab4-83d2-1201213f9971 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1371 microversion: 2.1 time: 0.160243 Aug 09 18:34:46.990966 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4333/7384] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:46 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:47.411495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ac4cf55a-9e42-46e1-8daa-733c2c35e884 req-17037ab6-e884-451c-9773-488c32087a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe97f26-e95d-4817-8260-63d999eb35d0", "name": "network-vif-plugged", "status": "completed", "tag": "161830e2-fedc-4433-8c24-5babcba5d54c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:47.421226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ac4cf55a-9e42-46e1-8daa-733c2c35e884 req-17037ab6-e884-451c-9773-488c32087a50 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:47.421716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ac4cf55a-9e42-46e1-8daa-733c2c35e884 req-17037ab6-e884-451c-9773-488c32087a50 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:47.422204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ac4cf55a-9e42-46e1-8daa-733c2c35e884 req-17037ab6-e884-451c-9773-488c32087a50 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:47.433645 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ac4cf55a-9e42-46e1-8daa-733c2c35e884 req-17037ab6-e884-451c-9773-488c32087a50 service nova] Creating event network-vif-plugged:161830e2-fedc-4433-8c24-5babcba5d54c for instance 2fe97f26-e95d-4817-8260-63d999eb35d0 on n-h1-845781-6 Aug 09 18:34:47.438606 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ac4cf55a-9e42-46e1-8daa-733c2c35e884 req-17037ab6-e884-451c-9773-488c32087a50 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031426 Aug 09 18:34:47.439211 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4334/7385] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:34:48.012279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5c514f37-2ab7-4d0a-b5bf-ab19fe45224c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:48.012994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5c514f37-2ab7-4d0a-b5bf-ab19fe45224c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:48.019885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c514f37-2ab7-4d0a-b5bf-ab19fe45224c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:48.020383 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c514f37-2ab7-4d0a-b5bf-ab19fe45224c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:48.020828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c514f37-2ab7-4d0a-b5bf-ab19fe45224c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:48.021532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c514f37-2ab7-4d0a-b5bf-ab19fe45224c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:48.021995 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c514f37-2ab7-4d0a-b5bf-ab19fe45224c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:48.022429 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5c514f37-2ab7-4d0a-b5bf-ab19fe45224c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:48.166003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5c514f37-2ab7-4d0a-b5bf-ab19fe45224c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:48.173450 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5c514f37-2ab7-4d0a-b5bf-ab19fe45224c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1371 microversion: 2.1 time: 0.166381 Aug 09 18:34:48.174021 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4335/7386] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:48 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:49.194830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4fd4b6d1-5567-41f8-884b-d23c71a446cc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:49.195547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4fd4b6d1-5567-41f8-884b-d23c71a446cc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:49.197551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=18 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:34:49.203823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd4b6d1-5567-41f8-884b-d23c71a446cc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:49.204320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd4b6d1-5567-41f8-884b-d23c71a446cc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:49.204770 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd4b6d1-5567-41f8-884b-d23c71a446cc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:49.205481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd4b6d1-5567-41f8-884b-d23c71a446cc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:49.205945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd4b6d1-5567-41f8-884b-d23c71a446cc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:49.206381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4fd4b6d1-5567-41f8-884b-d23c71a446cc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:49.341161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4fd4b6d1-5567-41f8-884b-d23c71a446cc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:49.348930 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4fd4b6d1-5567-41f8-884b-d23c71a446cc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1556 microversion: 2.1 time: 0.158495 Aug 09 18:34:49.349507 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4336/7387] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:49 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:49.368424 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-56db6ffa-ac34-4f40-9971-604c33a3b7a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:34:49.369042 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-56db6ffa-ac34-4f40-9971-604c33a3b7a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:34:49.374766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56db6ffa-ac34-4f40-9971-604c33a3b7a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:49.375253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56db6ffa-ac34-4f40-9971-604c33a3b7a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:49.375731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56db6ffa-ac34-4f40-9971-604c33a3b7a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:49.376434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56db6ffa-ac34-4f40-9971-604c33a3b7a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:49.376928 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56db6ffa-ac34-4f40-9971-604c33a3b7a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:49.377366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56db6ffa-ac34-4f40-9971-604c33a3b7a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:49.516752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-56db6ffa-ac34-4f40-9971-604c33a3b7a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:34:49.524932 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-56db6ffa-ac34-4f40-9971-604c33a3b7a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1556 microversion: 2.1 time: 0.160203 Aug 09 18:34:49.525513 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4337/7388] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:34:49 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:34:51.223258 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-030be4dc-3ce8-4347-9d3c-78a925d3d190 req-d00ab325-791c-475c-8723-4f3978a2f274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe97f26-e95d-4817-8260-63d999eb35d0", "tag": "161830e2-fedc-4433-8c24-5babcba5d54c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:34:51.234862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-030be4dc-3ce8-4347-9d3c-78a925d3d190 req-d00ab325-791c-475c-8723-4f3978a2f274 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:34:51.235387 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-030be4dc-3ce8-4347-9d3c-78a925d3d190 req-d00ab325-791c-475c-8723-4f3978a2f274 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:34:51.235919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-030be4dc-3ce8-4347-9d3c-78a925d3d190 req-d00ab325-791c-475c-8723-4f3978a2f274 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:34:51.248387 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-030be4dc-3ce8-4347-9d3c-78a925d3d190 req-d00ab325-791c-475c-8723-4f3978a2f274 service nova] Creating event network-changed:161830e2-fedc-4433-8c24-5babcba5d54c for instance 2fe97f26-e95d-4817-8260-63d999eb35d0 on n-h1-845781-6 Aug 09 18:34:51.253536 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-030be4dc-3ce8-4347-9d3c-78a925d3d190 req-d00ab325-791c-475c-8723-4f3978a2f274 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033928 Aug 09 18:34:51.254656 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4338/7389] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:36:48.430918 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [-] [59dc5572-757a-480c-957b-ef1cabe2d1a7] AMQP server on 10.222.0.93:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 09 18:36:48.431606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:36:48.432360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=68 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:36:48.437846 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0912774a-997a-4ce0-bc52-a7de2c9c1880 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:36:48.438484 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0912774a-997a-4ce0-bc52-a7de2c9c1880 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:48.446736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0912774a-997a-4ce0-bc52-a7de2c9c1880 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:48.447414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0912774a-997a-4ce0-bc52-a7de2c9c1880 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:48.447953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0912774a-997a-4ce0-bc52-a7de2c9c1880 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:48.448783 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0912774a-997a-4ce0-bc52-a7de2c9c1880 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:48.449346 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0912774a-997a-4ce0-bc52-a7de2c9c1880 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:48.449774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0912774a-997a-4ce0-bc52-a7de2c9c1880 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:48.473487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-0912774a-997a-4ce0-bc52-a7de2c9c1880 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lazy-loading 'flavor' on Instance uuid 2fe97f26-e95d-4817-8260-63d999eb35d0 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:36:48.656039 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0912774a-997a-4ce0-bc52-a7de2c9c1880 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "POST /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0/action" status: 202 len: 0 microversion: 2.1 time: 0.227369 Aug 09 18:36:48.656653 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4339/7390] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:36:48 2022] POST /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:36:48.665420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8279fdd1-3796-47f1-a4c1-878593b3566c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:48.666133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8279fdd1-3796-47f1-a4c1-878593b3566c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:48.673194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8279fdd1-3796-47f1-a4c1-878593b3566c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:48.673693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8279fdd1-3796-47f1-a4c1-878593b3566c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:48.674218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8279fdd1-3796-47f1-a4c1-878593b3566c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:48.674857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8279fdd1-3796-47f1-a4c1-878593b3566c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:48.675318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8279fdd1-3796-47f1-a4c1-878593b3566c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:48.675776 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8279fdd1-3796-47f1-a4c1-878593b3566c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:48.817031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8279fdd1-3796-47f1-a4c1-878593b3566c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:48.824610 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8279fdd1-3796-47f1-a4c1-878593b3566c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1681 microversion: 2.1 time: 0.163392 Aug 09 18:36:48.825182 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4340/7391] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:48 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:36:49.845861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c0d663b1-18f4-4078-9e18-1ed2787d5ff7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:49.846621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c0d663b1-18f4-4078-9e18-1ed2787d5ff7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:49.854903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d663b1-18f4-4078-9e18-1ed2787d5ff7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:49.855909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d663b1-18f4-4078-9e18-1ed2787d5ff7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:49.856349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d663b1-18f4-4078-9e18-1ed2787d5ff7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:49.857069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d663b1-18f4-4078-9e18-1ed2787d5ff7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:49.857522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d663b1-18f4-4078-9e18-1ed2787d5ff7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:49.857948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c0d663b1-18f4-4078-9e18-1ed2787d5ff7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:49.863470 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] [59dc5572-757a-480c-957b-ef1cabe2d1a7] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 41078. Aug 09 18:36:49.994201 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c0d663b1-18f4-4078-9e18-1ed2787d5ff7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:50.002415 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c0d663b1-18f4-4078-9e18-1ed2787d5ff7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1681 microversion: 2.1 time: 0.160520 Aug 09 18:36:50.002984 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4341/7392] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:49 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:36:51.023747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0fb99d46-77d6-4fdd-a395-7149ae428271 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:51.024445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0fb99d46-77d6-4fdd-a395-7149ae428271 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:51.030857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fb99d46-77d6-4fdd-a395-7149ae428271 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:51.031353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fb99d46-77d6-4fdd-a395-7149ae428271 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:51.031838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fb99d46-77d6-4fdd-a395-7149ae428271 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:51.032599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fb99d46-77d6-4fdd-a395-7149ae428271 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:51.033062 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fb99d46-77d6-4fdd-a395-7149ae428271 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:51.033591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fb99d46-77d6-4fdd-a395-7149ae428271 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:51.167448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0fb99d46-77d6-4fdd-a395-7149ae428271 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:51.175783 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0fb99d46-77d6-4fdd-a395-7149ae428271 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1681 microversion: 2.1 time: 0.156178 Aug 09 18:36:51.176367 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4342/7393] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:51 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:36:52.197277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b25c4b69-703b-45be-870b-5dbe614efbf0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:52.197948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b25c4b69-703b-45be-870b-5dbe614efbf0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:52.205217 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25c4b69-703b-45be-870b-5dbe614efbf0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:52.205704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25c4b69-703b-45be-870b-5dbe614efbf0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:52.206143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25c4b69-703b-45be-870b-5dbe614efbf0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:52.206839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25c4b69-703b-45be-870b-5dbe614efbf0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:52.207296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25c4b69-703b-45be-870b-5dbe614efbf0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:52.207754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b25c4b69-703b-45be-870b-5dbe614efbf0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:52.342601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b25c4b69-703b-45be-870b-5dbe614efbf0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:52.350453 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b25c4b69-703b-45be-870b-5dbe614efbf0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1681 microversion: 2.1 time: 0.157108 Aug 09 18:36:52.351040 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4343/7394] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:52 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:36:53.371342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9b68391b-0212-4fe8-a0eb-0302d944603e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:53.372065 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9b68391b-0212-4fe8-a0eb-0302d944603e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:53.378766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b68391b-0212-4fe8-a0eb-0302d944603e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:53.379253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b68391b-0212-4fe8-a0eb-0302d944603e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:53.379717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b68391b-0212-4fe8-a0eb-0302d944603e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:53.380407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b68391b-0212-4fe8-a0eb-0302d944603e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:53.380860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b68391b-0212-4fe8-a0eb-0302d944603e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:53.381288 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b68391b-0212-4fe8-a0eb-0302d944603e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:53.514940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9b68391b-0212-4fe8-a0eb-0302d944603e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:53.522494 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9b68391b-0212-4fe8-a0eb-0302d944603e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1681 microversion: 2.1 time: 0.155105 Aug 09 18:36:53.523060 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4344/7395] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:53 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:36:54.545220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4662b585-1605-46e9-b64c-7f72125a56ef tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:54.545934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4662b585-1605-46e9-b64c-7f72125a56ef tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:54.552640 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4662b585-1605-46e9-b64c-7f72125a56ef tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:54.553153 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4662b585-1605-46e9-b64c-7f72125a56ef tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:54.553594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4662b585-1605-46e9-b64c-7f72125a56ef tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:54.554280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4662b585-1605-46e9-b64c-7f72125a56ef tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:54.554737 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4662b585-1605-46e9-b64c-7f72125a56ef tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:54.555158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4662b585-1605-46e9-b64c-7f72125a56ef tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:54.697536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4662b585-1605-46e9-b64c-7f72125a56ef tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:54.705091 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4662b585-1605-46e9-b64c-7f72125a56ef tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1681 microversion: 2.1 time: 0.164366 Aug 09 18:36:54.705660 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4345/7396] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:54 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:36:55.726427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9b7b494a-9a7d-4244-b19c-8839c68bca15 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:55.727124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9b7b494a-9a7d-4244-b19c-8839c68bca15 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:55.733945 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7b494a-9a7d-4244-b19c-8839c68bca15 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:55.734431 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7b494a-9a7d-4244-b19c-8839c68bca15 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:55.734874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7b494a-9a7d-4244-b19c-8839c68bca15 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:55.735570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7b494a-9a7d-4244-b19c-8839c68bca15 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:55.736058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7b494a-9a7d-4244-b19c-8839c68bca15 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:55.736543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9b7b494a-9a7d-4244-b19c-8839c68bca15 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:55.868465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9b7b494a-9a7d-4244-b19c-8839c68bca15 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:55.875971 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9b7b494a-9a7d-4244-b19c-8839c68bca15 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1681 microversion: 2.1 time: 0.153501 Aug 09 18:36:55.876542 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4346/7397] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:55 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:36:56.897571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b73e5e2c-6321-4ed6-8a97-433a337fd68f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:56.898366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b73e5e2c-6321-4ed6-8a97-433a337fd68f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:56.905827 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b73e5e2c-6321-4ed6-8a97-433a337fd68f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:56.906319 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b73e5e2c-6321-4ed6-8a97-433a337fd68f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:56.906763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b73e5e2c-6321-4ed6-8a97-433a337fd68f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:56.907472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b73e5e2c-6321-4ed6-8a97-433a337fd68f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:56.907967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b73e5e2c-6321-4ed6-8a97-433a337fd68f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:56.908400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b73e5e2c-6321-4ed6-8a97-433a337fd68f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:57.044495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b73e5e2c-6321-4ed6-8a97-433a337fd68f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:57.052017 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b73e5e2c-6321-4ed6-8a97-433a337fd68f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1681 microversion: 2.1 time: 0.158399 Aug 09 18:36:57.052585 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4347/7398] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:56 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:36:58.073272 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8a60efb3-3077-452d-9fa4-fcf7bf6c5b7d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:58.073910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8a60efb3-3077-452d-9fa4-fcf7bf6c5b7d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:58.080748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a60efb3-3077-452d-9fa4-fcf7bf6c5b7d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:58.081250 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a60efb3-3077-452d-9fa4-fcf7bf6c5b7d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:58.081701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a60efb3-3077-452d-9fa4-fcf7bf6c5b7d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:58.082407 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a60efb3-3077-452d-9fa4-fcf7bf6c5b7d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:58.082874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a60efb3-3077-452d-9fa4-fcf7bf6c5b7d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:58.083338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8a60efb3-3077-452d-9fa4-fcf7bf6c5b7d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:58.220102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8a60efb3-3077-452d-9fa4-fcf7bf6c5b7d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:58.227704 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8a60efb3-3077-452d-9fa4-fcf7bf6c5b7d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1681 microversion: 2.1 time: 0.158522 Aug 09 18:36:58.228278 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4348/7399] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:58 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:36:59.251222 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-174e0ec5-e9e5-49bd-bee8-e349ea7dbbab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:36:59.251963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-174e0ec5-e9e5-49bd-bee8-e349ea7dbbab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:36:59.259081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-174e0ec5-e9e5-49bd-bee8-e349ea7dbbab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:59.259584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-174e0ec5-e9e5-49bd-bee8-e349ea7dbbab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:59.260155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-174e0ec5-e9e5-49bd-bee8-e349ea7dbbab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:59.260880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-174e0ec5-e9e5-49bd-bee8-e349ea7dbbab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:36:59.261398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-174e0ec5-e9e5-49bd-bee8-e349ea7dbbab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:36:59.262350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-174e0ec5-e9e5-49bd-bee8-e349ea7dbbab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:36:59.404189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-174e0ec5-e9e5-49bd-bee8-e349ea7dbbab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:36:59.412065 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-174e0ec5-e9e5-49bd-bee8-e349ea7dbbab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1702 microversion: 2.1 time: 0.164751 Aug 09 18:36:59.412656 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4349/7400] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:36:59 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1702 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:00.434075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-99012159-599b-4847-9e47-5cf8dbaf9708 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:00.434758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-99012159-599b-4847-9e47-5cf8dbaf9708 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:00.441515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99012159-599b-4847-9e47-5cf8dbaf9708 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:00.441997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99012159-599b-4847-9e47-5cf8dbaf9708 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:00.442432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99012159-599b-4847-9e47-5cf8dbaf9708 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:00.443124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99012159-599b-4847-9e47-5cf8dbaf9708 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:00.443577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99012159-599b-4847-9e47-5cf8dbaf9708 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:00.444028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-99012159-599b-4847-9e47-5cf8dbaf9708 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:00.578304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-99012159-599b-4847-9e47-5cf8dbaf9708 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:00.586191 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-99012159-599b-4847-9e47-5cf8dbaf9708 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1702 microversion: 2.1 time: 0.156445 Aug 09 18:37:00.586771 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4350/7401] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:00 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:01.607530 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1eef3cf1-b61f-4866-998b-3c737fb9b9b5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:01.608284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1eef3cf1-b61f-4866-998b-3c737fb9b9b5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:01.615145 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1eef3cf1-b61f-4866-998b-3c737fb9b9b5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:01.615650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1eef3cf1-b61f-4866-998b-3c737fb9b9b5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:01.616110 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1eef3cf1-b61f-4866-998b-3c737fb9b9b5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:01.616806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1eef3cf1-b61f-4866-998b-3c737fb9b9b5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:01.617267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1eef3cf1-b61f-4866-998b-3c737fb9b9b5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:01.617702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1eef3cf1-b61f-4866-998b-3c737fb9b9b5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:01.749865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1eef3cf1-b61f-4866-998b-3c737fb9b9b5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:01.757664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1eef3cf1-b61f-4866-998b-3c737fb9b9b5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1702 microversion: 2.1 time: 0.154612 Aug 09 18:37:01.758243 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4351/7402] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:01 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1702 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:02.018660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b367718e-7809-447c-b94a-433947df9f13 req-affdcd51-b750-4a96-a205-14c1088fe41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe97f26-e95d-4817-8260-63d999eb35d0", "name": "network-vif-plugged", "status": "completed", "tag": "161830e2-fedc-4433-8c24-5babcba5d54c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:37:02.028819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b367718e-7809-447c-b94a-433947df9f13 req-affdcd51-b750-4a96-a205-14c1088fe41d service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:02.029306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b367718e-7809-447c-b94a-433947df9f13 req-affdcd51-b750-4a96-a205-14c1088fe41d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:02.029746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b367718e-7809-447c-b94a-433947df9f13 req-affdcd51-b750-4a96-a205-14c1088fe41d service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:02.041074 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b367718e-7809-447c-b94a-433947df9f13 req-affdcd51-b750-4a96-a205-14c1088fe41d service nova] Creating event network-vif-plugged:161830e2-fedc-4433-8c24-5babcba5d54c for instance 2fe97f26-e95d-4817-8260-63d999eb35d0 on n-h1-845781-6 Aug 09 18:37:02.046755 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b367718e-7809-447c-b94a-433947df9f13 req-affdcd51-b750-4a96-a205-14c1088fe41d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113432 Aug 09 18:37:02.047346 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4352/7403] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:37:02.780175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-676b58a0-8c20-47b2-891f-9b65f048eddd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:02.781693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-676b58a0-8c20-47b2-891f-9b65f048eddd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:02.790259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-676b58a0-8c20-47b2-891f-9b65f048eddd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:02.790844 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-676b58a0-8c20-47b2-891f-9b65f048eddd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:02.791506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-676b58a0-8c20-47b2-891f-9b65f048eddd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:02.792282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-676b58a0-8c20-47b2-891f-9b65f048eddd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:02.792880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-676b58a0-8c20-47b2-891f-9b65f048eddd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:02.793942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-676b58a0-8c20-47b2-891f-9b65f048eddd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:02.970699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-676b58a0-8c20-47b2-891f-9b65f048eddd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:02.978655 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-676b58a0-8c20-47b2-891f-9b65f048eddd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1697 microversion: 2.1 time: 0.203745 Aug 09 18:37:02.979544 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4353/7404] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:02 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1697 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:37:04.004905 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-10059195-e551-42a1-ba72-7c718e8d2be0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:04.005650 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-10059195-e551-42a1-ba72-7c718e8d2be0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:04.013649 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10059195-e551-42a1-ba72-7c718e8d2be0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:04.014142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10059195-e551-42a1-ba72-7c718e8d2be0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:04.014847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10059195-e551-42a1-ba72-7c718e8d2be0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:04.015941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10059195-e551-42a1-ba72-7c718e8d2be0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:04.017334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10059195-e551-42a1-ba72-7c718e8d2be0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:04.017904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-10059195-e551-42a1-ba72-7c718e8d2be0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:04.024782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:37:04.184534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-10059195-e551-42a1-ba72-7c718e8d2be0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:04.199847 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-10059195-e551-42a1-ba72-7c718e8d2be0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1697 microversion: 2.1 time: 0.197965 Aug 09 18:37:04.200740 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4354/7405] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:03 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1697 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:37:05.221552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e4b8a4ea-3040-4f35-ba48-16351d9d1e88 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:05.222311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e4b8a4ea-3040-4f35-ba48-16351d9d1e88 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:05.232035 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4b8a4ea-3040-4f35-ba48-16351d9d1e88 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:05.232938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4b8a4ea-3040-4f35-ba48-16351d9d1e88 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:05.233335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4b8a4ea-3040-4f35-ba48-16351d9d1e88 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:05.233694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4b8a4ea-3040-4f35-ba48-16351d9d1e88 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:05.234196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4b8a4ea-3040-4f35-ba48-16351d9d1e88 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:05.234555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e4b8a4ea-3040-4f35-ba48-16351d9d1e88 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:05.412053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4b8a4ea-3040-4f35-ba48-16351d9d1e88 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:05.420852 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e4b8a4ea-3040-4f35-ba48-16351d9d1e88 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1697 microversion: 2.1 time: 0.203205 Aug 09 18:37:05.434615 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4355/7406] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:05 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1697 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:06.442351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-025cd428-9804-4a3c-afd7-cbf52649c8d9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:06.443797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-025cd428-9804-4a3c-afd7-cbf52649c8d9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:06.451663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-025cd428-9804-4a3c-afd7-cbf52649c8d9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:06.452243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-025cd428-9804-4a3c-afd7-cbf52649c8d9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:06.452942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-025cd428-9804-4a3c-afd7-cbf52649c8d9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:06.453925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-025cd428-9804-4a3c-afd7-cbf52649c8d9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:06.454491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-025cd428-9804-4a3c-afd7-cbf52649c8d9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:06.455045 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-025cd428-9804-4a3c-afd7-cbf52649c8d9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:06.600245 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-025cd428-9804-4a3c-afd7-cbf52649c8d9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:06.608093 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-025cd428-9804-4a3c-afd7-cbf52649c8d9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1697 microversion: 2.1 time: 0.169593 Aug 09 18:37:06.608669 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4356/7407] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:06 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:37:07.631924 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1746055a-6154-428f-aa21-ef3bc1b45b2e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:07.633185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1746055a-6154-428f-aa21-ef3bc1b45b2e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:07.642472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1746055a-6154-428f-aa21-ef3bc1b45b2e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:07.642969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1746055a-6154-428f-aa21-ef3bc1b45b2e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:07.643412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1746055a-6154-428f-aa21-ef3bc1b45b2e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:07.644170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1746055a-6154-428f-aa21-ef3bc1b45b2e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:07.644720 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1746055a-6154-428f-aa21-ef3bc1b45b2e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:07.645189 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1746055a-6154-428f-aa21-ef3bc1b45b2e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:07.796563 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1746055a-6154-428f-aa21-ef3bc1b45b2e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:07.805282 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1746055a-6154-428f-aa21-ef3bc1b45b2e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1697 microversion: 2.1 time: 0.178500 Aug 09 18:37:07.806161 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4357/7408] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:07 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:37:08.827782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a4fc9ced-5561-47f3-bbc2-3db1d6b33b03 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:08.829490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a4fc9ced-5561-47f3-bbc2-3db1d6b33b03 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:08.841002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4fc9ced-5561-47f3-bbc2-3db1d6b33b03 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:08.841847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4fc9ced-5561-47f3-bbc2-3db1d6b33b03 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:08.842290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4fc9ced-5561-47f3-bbc2-3db1d6b33b03 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:08.842999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4fc9ced-5561-47f3-bbc2-3db1d6b33b03 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:08.843760 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4fc9ced-5561-47f3-bbc2-3db1d6b33b03 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:08.844517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a4fc9ced-5561-47f3-bbc2-3db1d6b33b03 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:09.029436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a4fc9ced-5561-47f3-bbc2-3db1d6b33b03 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:09.038919 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a4fc9ced-5561-47f3-bbc2-3db1d6b33b03 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1697 microversion: 2.1 time: 0.215249 Aug 09 18:37:09.051661 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4358/7409] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:08 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1697 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:10.063784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-706474c3-64a0-4a7f-9c11-fe9f0cca4f56 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:10.065237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-706474c3-64a0-4a7f-9c11-fe9f0cca4f56 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:10.072901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-706474c3-64a0-4a7f-9c11-fe9f0cca4f56 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:10.074257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-706474c3-64a0-4a7f-9c11-fe9f0cca4f56 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:10.075500 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-706474c3-64a0-4a7f-9c11-fe9f0cca4f56 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:10.075801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-706474c3-64a0-4a7f-9c11-fe9f0cca4f56 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:10.076496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-706474c3-64a0-4a7f-9c11-fe9f0cca4f56 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:10.077007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-706474c3-64a0-4a7f-9c11-fe9f0cca4f56 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:10.232287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-706474c3-64a0-4a7f-9c11-fe9f0cca4f56 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:10.245114 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-706474c3-64a0-4a7f-9c11-fe9f0cca4f56 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1697 microversion: 2.1 time: 0.185922 Aug 09 18:37:10.247157 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4359/7410] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:10 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1697 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:11.268007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e359fe76-9d71-433b-8922-23cd6413a573 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:11.268799 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e359fe76-9d71-433b-8922-23cd6413a573 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:11.275872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e359fe76-9d71-433b-8922-23cd6413a573 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:11.277130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e359fe76-9d71-433b-8922-23cd6413a573 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:11.277851 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e359fe76-9d71-433b-8922-23cd6413a573 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:11.278670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e359fe76-9d71-433b-8922-23cd6413a573 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:11.279227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e359fe76-9d71-433b-8922-23cd6413a573 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:11.279769 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e359fe76-9d71-433b-8922-23cd6413a573 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:11.429053 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e359fe76-9d71-433b-8922-23cd6413a573 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:11.437191 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e359fe76-9d71-433b-8922-23cd6413a573 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1697 microversion: 2.1 time: 0.173328 Aug 09 18:37:11.441915 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4360/7411] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:11 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:12.461392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2dfa214-d950-4cdd-b780-84d733ba9872 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:12.462144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2dfa214-d950-4cdd-b780-84d733ba9872 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:12.469385 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2dfa214-d950-4cdd-b780-84d733ba9872 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:12.469883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2dfa214-d950-4cdd-b780-84d733ba9872 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:12.470320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2dfa214-d950-4cdd-b780-84d733ba9872 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:12.471031 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2dfa214-d950-4cdd-b780-84d733ba9872 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:12.471493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2dfa214-d950-4cdd-b780-84d733ba9872 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:12.471951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2dfa214-d950-4cdd-b780-84d733ba9872 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:12.610988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d2dfa214-d950-4cdd-b780-84d733ba9872 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:12.618642 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d2dfa214-d950-4cdd-b780-84d733ba9872 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1679 microversion: 2.1 time: 0.161658 Aug 09 18:37:12.619230 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4361/7412] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:12 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:13.641200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f15ce26d-3941-48ae-b801-8a9a13fc95b6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:13.641946 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f15ce26d-3941-48ae-b801-8a9a13fc95b6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:13.648731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f15ce26d-3941-48ae-b801-8a9a13fc95b6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:13.649220 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f15ce26d-3941-48ae-b801-8a9a13fc95b6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:13.649661 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f15ce26d-3941-48ae-b801-8a9a13fc95b6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:13.650363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f15ce26d-3941-48ae-b801-8a9a13fc95b6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:13.650822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f15ce26d-3941-48ae-b801-8a9a13fc95b6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:13.651254 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f15ce26d-3941-48ae-b801-8a9a13fc95b6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:13.790641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f15ce26d-3941-48ae-b801-8a9a13fc95b6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:13.798760 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f15ce26d-3941-48ae-b801-8a9a13fc95b6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1679 microversion: 2.1 time: 0.161531 Aug 09 18:37:13.799341 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4362/7413] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:13 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:14.819596 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-daf41adc-1122-49bb-a314-1d3b132f662f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:14.820240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-daf41adc-1122-49bb-a314-1d3b132f662f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:14.827107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-daf41adc-1122-49bb-a314-1d3b132f662f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:14.827590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-daf41adc-1122-49bb-a314-1d3b132f662f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:14.828052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-daf41adc-1122-49bb-a314-1d3b132f662f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:14.828742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-daf41adc-1122-49bb-a314-1d3b132f662f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:14.829194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-daf41adc-1122-49bb-a314-1d3b132f662f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:14.829627 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-daf41adc-1122-49bb-a314-1d3b132f662f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:14.973182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-daf41adc-1122-49bb-a314-1d3b132f662f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:14.981664 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-daf41adc-1122-49bb-a314-1d3b132f662f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1682 microversion: 2.1 time: 0.166009 Aug 09 18:37:14.982395 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4363/7414] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:14 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:15.002992 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6a1b0752-7af5-4354-afdf-0f5324524a89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:37:15.003599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6a1b0752-7af5-4354-afdf-0f5324524a89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:15.009734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1b0752-7af5-4354-afdf-0f5324524a89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:15.010231 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1b0752-7af5-4354-afdf-0f5324524a89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:15.010682 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1b0752-7af5-4354-afdf-0f5324524a89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:15.011389 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1b0752-7af5-4354-afdf-0f5324524a89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:15.011890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1b0752-7af5-4354-afdf-0f5324524a89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:15.012324 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6a1b0752-7af5-4354-afdf-0f5324524a89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:15.119166 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6a1b0752-7af5-4354-afdf-0f5324524a89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119431) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 09 18:37:15.191507 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6a1b0752-7af5-4354-afdf-0f5324524a89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "POST /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0/action" status: 202 len: 0 microversion: 2.1 time: 0.193069 Aug 09 18:37:15.193020 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4364/7415] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:37:14 2022] POST /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:37:15.203929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d5ca8c8b-7dc9-4a23-b0a5-2bf44c0c87c3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:15.204569 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d5ca8c8b-7dc9-4a23-b0a5-2bf44c0c87c3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:15.211443 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5ca8c8b-7dc9-4a23-b0a5-2bf44c0c87c3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:15.211967 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5ca8c8b-7dc9-4a23-b0a5-2bf44c0c87c3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:15.212415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5ca8c8b-7dc9-4a23-b0a5-2bf44c0c87c3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:15.213328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5ca8c8b-7dc9-4a23-b0a5-2bf44c0c87c3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:15.213768 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5ca8c8b-7dc9-4a23-b0a5-2bf44c0c87c3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:15.214838 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d5ca8c8b-7dc9-4a23-b0a5-2bf44c0c87c3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:15.399175 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d5ca8c8b-7dc9-4a23-b0a5-2bf44c0c87c3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:15.407879 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d5ca8c8b-7dc9-4a23-b0a5-2bf44c0c87c3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1630 microversion: 2.1 time: 0.209361 Aug 09 18:37:15.408485 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4365/7416] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:15 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1630 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:16.044975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-38a15a9a-1123-42ad-81ab-1b13b96bd387 req-2b46961d-63cf-4c83-97c2-7d9e51492811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe97f26-e95d-4817-8260-63d999eb35d0", "name": "network-vif-unplugged", "status": "completed", "tag": "161830e2-fedc-4433-8c24-5babcba5d54c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:37:16.060801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-38a15a9a-1123-42ad-81ab-1b13b96bd387 req-2b46961d-63cf-4c83-97c2-7d9e51492811 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:16.061300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-38a15a9a-1123-42ad-81ab-1b13b96bd387 req-2b46961d-63cf-4c83-97c2-7d9e51492811 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:16.061906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-38a15a9a-1123-42ad-81ab-1b13b96bd387 req-2b46961d-63cf-4c83-97c2-7d9e51492811 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:16.080899 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.compute.server_external_events [req-38a15a9a-1123-42ad-81ab-1b13b96bd387 req-2b46961d-63cf-4c83-97c2-7d9e51492811 service nova] Unable to find a host for instance 2fe97f26-e95d-4817-8260-63d999eb35d0. Dropping event network-vif-unplugged {{(pid=119431) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 18:37:16.082075 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-38a15a9a-1123-42ad-81ab-1b13b96bd387 req-2b46961d-63cf-4c83-97c2-7d9e51492811 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045481 Aug 09 18:37:16.082892 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4366/7417] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 18:37:16.429599 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1367a06-d0f5-4d7b-b5ac-1a659451962c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:16.430238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d1367a06-d0f5-4d7b-b5ac-1a659451962c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:16.436656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1367a06-d0f5-4d7b-b5ac-1a659451962c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:16.437155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1367a06-d0f5-4d7b-b5ac-1a659451962c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:16.437605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1367a06-d0f5-4d7b-b5ac-1a659451962c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:16.438325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1367a06-d0f5-4d7b-b5ac-1a659451962c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:16.438786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1367a06-d0f5-4d7b-b5ac-1a659451962c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:16.439224 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1367a06-d0f5-4d7b-b5ac-1a659451962c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:16.869868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d1367a06-d0f5-4d7b-b5ac-1a659451962c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:16.877788 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1367a06-d0f5-4d7b-b5ac-1a659451962c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.452420 Aug 09 18:37:16.878391 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4367/7418] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:16 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:37:17.489934 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-2457fac8-7dac-49ae-9b8b-7b7b29803e76 req-b7a92da1-39d7-4632-8aa2-f16e975a31f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe97f26-e95d-4817-8260-63d999eb35d0", "tag": "161830e2-fedc-4433-8c24-5babcba5d54c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:37:17.500074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2457fac8-7dac-49ae-9b8b-7b7b29803e76 req-b7a92da1-39d7-4632-8aa2-f16e975a31f0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:17.500806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2457fac8-7dac-49ae-9b8b-7b7b29803e76 req-b7a92da1-39d7-4632-8aa2-f16e975a31f0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:17.501328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-2457fac8-7dac-49ae-9b8b-7b7b29803e76 req-b7a92da1-39d7-4632-8aa2-f16e975a31f0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:17.516601 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-2457fac8-7dac-49ae-9b8b-7b7b29803e76 req-b7a92da1-39d7-4632-8aa2-f16e975a31f0 service nova] Creating event network-changed:161830e2-fedc-4433-8c24-5babcba5d54c for instance 2fe97f26-e95d-4817-8260-63d999eb35d0 on n-h2-845781-6 Aug 09 18:37:17.522602 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-2457fac8-7dac-49ae-9b8b-7b7b29803e76 req-b7a92da1-39d7-4632-8aa2-f16e975a31f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037982 Aug 09 18:37:17.523675 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4368/7419] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:37:17.900136 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-88ca3674-10d3-4257-995d-b4c5f9ab5f45 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:17.900849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-88ca3674-10d3-4257-995d-b4c5f9ab5f45 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:17.907448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88ca3674-10d3-4257-995d-b4c5f9ab5f45 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:17.907963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88ca3674-10d3-4257-995d-b4c5f9ab5f45 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:17.908401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88ca3674-10d3-4257-995d-b4c5f9ab5f45 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:17.909107 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88ca3674-10d3-4257-995d-b4c5f9ab5f45 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:17.909568 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88ca3674-10d3-4257-995d-b4c5f9ab5f45 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:17.910000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-88ca3674-10d3-4257-995d-b4c5f9ab5f45 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:18.052146 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-88ca3674-10d3-4257-995d-b4c5f9ab5f45 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:18.060582 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-88ca3674-10d3-4257-995d-b4c5f9ab5f45 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.164728 Aug 09 18:37:18.061165 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4369/7420] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:17 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:19.086552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-25be364c-4cad-44f6-8c07-be94599e40f4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:19.088096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-25be364c-4cad-44f6-8c07-be94599e40f4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:19.091808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:37:19.097399 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25be364c-4cad-44f6-8c07-be94599e40f4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:19.098130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25be364c-4cad-44f6-8c07-be94599e40f4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:19.098581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25be364c-4cad-44f6-8c07-be94599e40f4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:19.099298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25be364c-4cad-44f6-8c07-be94599e40f4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:19.099796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25be364c-4cad-44f6-8c07-be94599e40f4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:19.100234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-25be364c-4cad-44f6-8c07-be94599e40f4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:19.265067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-25be364c-4cad-44f6-8c07-be94599e40f4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:19.272849 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-25be364c-4cad-44f6-8c07-be94599e40f4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.193667 Aug 09 18:37:19.273773 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4370/7421] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:19 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:20.295046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4ca0e64d-4cf6-4d25-a8cb-277b7a72e825 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:20.295756 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4ca0e64d-4cf6-4d25-a8cb-277b7a72e825 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:20.302487 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ca0e64d-4cf6-4d25-a8cb-277b7a72e825 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:20.302981 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ca0e64d-4cf6-4d25-a8cb-277b7a72e825 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:20.303460 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ca0e64d-4cf6-4d25-a8cb-277b7a72e825 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:20.304205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ca0e64d-4cf6-4d25-a8cb-277b7a72e825 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:20.304672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ca0e64d-4cf6-4d25-a8cb-277b7a72e825 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:20.305267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ca0e64d-4cf6-4d25-a8cb-277b7a72e825 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:20.310118 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:37:20.451034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4ca0e64d-4cf6-4d25-a8cb-277b7a72e825 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:20.458802 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4ca0e64d-4cf6-4d25-a8cb-277b7a72e825 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.167970 Aug 09 18:37:20.459380 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4371/7422] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:20 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:21.481103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-08fdbc4a-350a-46e6-a418-3e42b0ed2597 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:21.481918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-08fdbc4a-350a-46e6-a418-3e42b0ed2597 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:21.489093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08fdbc4a-350a-46e6-a418-3e42b0ed2597 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:21.489753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08fdbc4a-350a-46e6-a418-3e42b0ed2597 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:21.490239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08fdbc4a-350a-46e6-a418-3e42b0ed2597 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:21.490953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08fdbc4a-350a-46e6-a418-3e42b0ed2597 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:21.491421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08fdbc4a-350a-46e6-a418-3e42b0ed2597 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:21.491882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08fdbc4a-350a-46e6-a418-3e42b0ed2597 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:21.666717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-08fdbc4a-350a-46e6-a418-3e42b0ed2597 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:21.674774 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-08fdbc4a-350a-46e6-a418-3e42b0ed2597 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.198443 Aug 09 18:37:21.675408 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4372/7423] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:21 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:22.698380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b81cd73b-b117-46b5-84bc-015872002949 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:22.699249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b81cd73b-b117-46b5-84bc-015872002949 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:22.706185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b81cd73b-b117-46b5-84bc-015872002949 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:22.706688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b81cd73b-b117-46b5-84bc-015872002949 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:22.707130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b81cd73b-b117-46b5-84bc-015872002949 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:22.707869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b81cd73b-b117-46b5-84bc-015872002949 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:22.708330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b81cd73b-b117-46b5-84bc-015872002949 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:22.708762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b81cd73b-b117-46b5-84bc-015872002949 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:22.844590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b81cd73b-b117-46b5-84bc-015872002949 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:22.852147 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b81cd73b-b117-46b5-84bc-015872002949 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.157742 Aug 09 18:37:22.852715 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4373/7424] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:22 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:37:23.873470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2efc877b-9ebb-4d0d-889e-658a1de28db4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:23.874164 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2efc877b-9ebb-4d0d-889e-658a1de28db4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:23.881006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2efc877b-9ebb-4d0d-889e-658a1de28db4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:23.881496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2efc877b-9ebb-4d0d-889e-658a1de28db4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:23.881943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2efc877b-9ebb-4d0d-889e-658a1de28db4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:23.882656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2efc877b-9ebb-4d0d-889e-658a1de28db4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:23.883119 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2efc877b-9ebb-4d0d-889e-658a1de28db4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:23.883551 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2efc877b-9ebb-4d0d-889e-658a1de28db4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:24.037409 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2efc877b-9ebb-4d0d-889e-658a1de28db4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:24.045982 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2efc877b-9ebb-4d0d-889e-658a1de28db4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.176371 Aug 09 18:37:24.046673 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4374/7425] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:23 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:25.067448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3a5edcda-1ded-4004-a2cf-5b6917059575 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:25.068214 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3a5edcda-1ded-4004-a2cf-5b6917059575 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:25.075997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a5edcda-1ded-4004-a2cf-5b6917059575 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:25.076625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a5edcda-1ded-4004-a2cf-5b6917059575 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:25.077226 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a5edcda-1ded-4004-a2cf-5b6917059575 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:25.078099 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a5edcda-1ded-4004-a2cf-5b6917059575 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:25.078565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a5edcda-1ded-4004-a2cf-5b6917059575 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:25.078997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3a5edcda-1ded-4004-a2cf-5b6917059575 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:25.227313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3a5edcda-1ded-4004-a2cf-5b6917059575 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:25.234963 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3a5edcda-1ded-4004-a2cf-5b6917059575 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.171658 Aug 09 18:37:25.235545 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4375/7426] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:25 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:26.256496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-11437e20-f378-4948-9971-075f95d2357f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:26.257215 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-11437e20-f378-4948-9971-075f95d2357f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:26.264246 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11437e20-f378-4948-9971-075f95d2357f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:26.264739 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11437e20-f378-4948-9971-075f95d2357f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:26.265176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11437e20-f378-4948-9971-075f95d2357f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:26.265874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11437e20-f378-4948-9971-075f95d2357f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:26.266327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11437e20-f378-4948-9971-075f95d2357f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:26.266753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-11437e20-f378-4948-9971-075f95d2357f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:26.425917 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-11437e20-f378-4948-9971-075f95d2357f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:26.433927 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-11437e20-f378-4948-9971-075f95d2357f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.181325 Aug 09 18:37:26.434515 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4376/7427] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:26 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:27.454473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9fbf3fb1-0cf1-443c-bbb2-8b6178cf3652 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:27.455186 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9fbf3fb1-0cf1-443c-bbb2-8b6178cf3652 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:27.462179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fbf3fb1-0cf1-443c-bbb2-8b6178cf3652 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:27.462664 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fbf3fb1-0cf1-443c-bbb2-8b6178cf3652 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:27.463103 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fbf3fb1-0cf1-443c-bbb2-8b6178cf3652 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:27.463821 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fbf3fb1-0cf1-443c-bbb2-8b6178cf3652 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:27.464279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fbf3fb1-0cf1-443c-bbb2-8b6178cf3652 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:27.464706 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9fbf3fb1-0cf1-443c-bbb2-8b6178cf3652 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:27.602203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9fbf3fb1-0cf1-443c-bbb2-8b6178cf3652 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:27.610369 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9fbf3fb1-0cf1-443c-bbb2-8b6178cf3652 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.159916 Aug 09 18:37:27.610942 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4377/7428] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:27 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:28.631929 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75cc853b-24f7-418e-829d-a5cbab5b0638 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:28.632580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75cc853b-24f7-418e-829d-a5cbab5b0638 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:28.639521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75cc853b-24f7-418e-829d-a5cbab5b0638 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:28.640046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75cc853b-24f7-418e-829d-a5cbab5b0638 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:28.640496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75cc853b-24f7-418e-829d-a5cbab5b0638 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:28.641204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75cc853b-24f7-418e-829d-a5cbab5b0638 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:28.641667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75cc853b-24f7-418e-829d-a5cbab5b0638 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:28.642102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75cc853b-24f7-418e-829d-a5cbab5b0638 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:28.792335 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-75cc853b-24f7-418e-829d-a5cbab5b0638 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:28.801146 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75cc853b-24f7-418e-829d-a5cbab5b0638 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.173416 Aug 09 18:37:28.815159 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4378/7429] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:28 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:29.823786 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eff0ed57-5473-4993-8b9e-bbb001b0f9b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:29.824411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eff0ed57-5473-4993-8b9e-bbb001b0f9b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:29.831322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff0ed57-5473-4993-8b9e-bbb001b0f9b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:29.831847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff0ed57-5473-4993-8b9e-bbb001b0f9b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:29.832291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff0ed57-5473-4993-8b9e-bbb001b0f9b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:29.832983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff0ed57-5473-4993-8b9e-bbb001b0f9b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:29.833440 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff0ed57-5473-4993-8b9e-bbb001b0f9b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:29.833867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eff0ed57-5473-4993-8b9e-bbb001b0f9b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:29.967247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eff0ed57-5473-4993-8b9e-bbb001b0f9b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:29.974863 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eff0ed57-5473-4993-8b9e-bbb001b0f9b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.155099 Aug 09 18:37:29.975443 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4379/7430] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:29 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:30.997001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-453b343e-bfa4-4ad7-a2df-02d95e05760b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:30.997619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-453b343e-bfa4-4ad7-a2df-02d95e05760b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:31.004592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-453b343e-bfa4-4ad7-a2df-02d95e05760b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:31.005081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-453b343e-bfa4-4ad7-a2df-02d95e05760b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:31.005519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-453b343e-bfa4-4ad7-a2df-02d95e05760b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:31.006209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-453b343e-bfa4-4ad7-a2df-02d95e05760b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:31.006660 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-453b343e-bfa4-4ad7-a2df-02d95e05760b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:31.007087 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-453b343e-bfa4-4ad7-a2df-02d95e05760b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:31.143867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-453b343e-bfa4-4ad7-a2df-02d95e05760b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:31.151729 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-453b343e-bfa4-4ad7-a2df-02d95e05760b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.158671 Aug 09 18:37:31.152332 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4380/7431] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:30 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:32.174813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-cd5619de-d7e7-4a66-9aaa-a4ca93a50fe8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:32.175456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-cd5619de-d7e7-4a66-9aaa-a4ca93a50fe8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:32.182372 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5619de-d7e7-4a66-9aaa-a4ca93a50fe8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:32.182869 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5619de-d7e7-4a66-9aaa-a4ca93a50fe8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:32.183320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5619de-d7e7-4a66-9aaa-a4ca93a50fe8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:32.184079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5619de-d7e7-4a66-9aaa-a4ca93a50fe8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:32.184598 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5619de-d7e7-4a66-9aaa-a4ca93a50fe8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:32.185038 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-cd5619de-d7e7-4a66-9aaa-a4ca93a50fe8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:32.321163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-cd5619de-d7e7-4a66-9aaa-a4ca93a50fe8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:32.329372 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-cd5619de-d7e7-4a66-9aaa-a4ca93a50fe8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.158634 Aug 09 18:37:32.329958 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4381/7432] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:32 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:32.879554 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-fda820cc-6384-4fbc-a805-01627fe5de93 req-e7a1e373-5894-48c6-84f4-1e58d6b80593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe97f26-e95d-4817-8260-63d999eb35d0", "name": "network-vif-plugged", "status": "completed", "tag": "161830e2-fedc-4433-8c24-5babcba5d54c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:37:32.891005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fda820cc-6384-4fbc-a805-01627fe5de93 req-e7a1e373-5894-48c6-84f4-1e58d6b80593 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:32.892611 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fda820cc-6384-4fbc-a805-01627fe5de93 req-e7a1e373-5894-48c6-84f4-1e58d6b80593 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:32.893064 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-fda820cc-6384-4fbc-a805-01627fe5de93 req-e7a1e373-5894-48c6-84f4-1e58d6b80593 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:32.906700 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-fda820cc-6384-4fbc-a805-01627fe5de93 req-e7a1e373-5894-48c6-84f4-1e58d6b80593 service nova] Creating event network-vif-plugged:161830e2-fedc-4433-8c24-5babcba5d54c for instance 2fe97f26-e95d-4817-8260-63d999eb35d0 on n-h2-845781-6 Aug 09 18:37:32.912463 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-fda820cc-6384-4fbc-a805-01627fe5de93 req-e7a1e373-5894-48c6-84f4-1e58d6b80593 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036890 Aug 09 18:37:32.913126 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4382/7433] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:37:33.351925 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fcc1feb5-7345-442d-a1f2-706e15de0d90 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:33.352652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fcc1feb5-7345-442d-a1f2-706e15de0d90 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:33.359552 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fcc1feb5-7345-442d-a1f2-706e15de0d90 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:33.360092 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fcc1feb5-7345-442d-a1f2-706e15de0d90 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:33.360542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fcc1feb5-7345-442d-a1f2-706e15de0d90 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:33.361259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fcc1feb5-7345-442d-a1f2-706e15de0d90 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:33.361718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fcc1feb5-7345-442d-a1f2-706e15de0d90 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:33.362152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fcc1feb5-7345-442d-a1f2-706e15de0d90 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:33.503322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fcc1feb5-7345-442d-a1f2-706e15de0d90 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:33.511072 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fcc1feb5-7345-442d-a1f2-706e15de0d90 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.164340 Aug 09 18:37:33.511709 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4383/7434] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:33 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:34.532759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a54de589-19e8-41a3-a737-9afbb30814cb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:34.533446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a54de589-19e8-41a3-a737-9afbb30814cb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:34.540591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54de589-19e8-41a3-a737-9afbb30814cb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:34.541093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54de589-19e8-41a3-a737-9afbb30814cb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:34.541541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54de589-19e8-41a3-a737-9afbb30814cb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:34.542267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54de589-19e8-41a3-a737-9afbb30814cb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:34.542731 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54de589-19e8-41a3-a737-9afbb30814cb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:34.543167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a54de589-19e8-41a3-a737-9afbb30814cb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:34.685502 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a54de589-19e8-41a3-a737-9afbb30814cb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:34.693323 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a54de589-19e8-41a3-a737-9afbb30814cb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1688 microversion: 2.1 time: 0.164541 Aug 09 18:37:34.693893 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4384/7435] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:34 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:37:35.714788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1675f3c0-b6b9-42e9-9a45-e63f3dcdb71d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:37:35.715515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1675f3c0-b6b9-42e9-9a45-e63f3dcdb71d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:37:35.722351 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1675f3c0-b6b9-42e9-9a45-e63f3dcdb71d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:35.722843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1675f3c0-b6b9-42e9-9a45-e63f3dcdb71d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:35.723287 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1675f3c0-b6b9-42e9-9a45-e63f3dcdb71d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:35.724020 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1675f3c0-b6b9-42e9-9a45-e63f3dcdb71d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:37:35.724482 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1675f3c0-b6b9-42e9-9a45-e63f3dcdb71d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:37:35.724919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1675f3c0-b6b9-42e9-9a45-e63f3dcdb71d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:37:35.862221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1675f3c0-b6b9-42e9-9a45-e63f3dcdb71d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:37:35.869807 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1675f3c0-b6b9-42e9-9a45-e63f3dcdb71d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1675 microversion: 2.1 time: 0.159253 Aug 09 18:37:35.870388 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4385/7436] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:37:35 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:38:47.531882 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=31 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:38:47.532667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=84 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:38:47.537498 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-74382f98-4391-4551-b348-0fbbe7b044e0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:47.538014 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-74382f98-4391-4551-b348-0fbbe7b044e0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:47.546100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74382f98-4391-4551-b348-0fbbe7b044e0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:47.546615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74382f98-4391-4551-b348-0fbbe7b044e0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:47.547060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74382f98-4391-4551-b348-0fbbe7b044e0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:47.547840 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74382f98-4391-4551-b348-0fbbe7b044e0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:47.548305 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74382f98-4391-4551-b348-0fbbe7b044e0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:47.548738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-74382f98-4391-4551-b348-0fbbe7b044e0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:47.578885 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-74382f98-4391-4551-b348-0fbbe7b044e0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:38:47.674975 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-74382f98-4391-4551-b348-0fbbe7b044e0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 204 len: 0 microversion: 2.1 time: 0.144803 Aug 09 18:38:47.678836 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4386/7437] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:38:47 2022] DELETE /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:38:47.778427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3433a6ae-b16a-42b3-bf9d-96bfe34e80d8 req-5bf791ec-4adc-42e1-8f2d-02f69bb82fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe97f26-e95d-4817-8260-63d999eb35d0", "tag": "161830e2-fedc-4433-8c24-5babcba5d54c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:38:47.790235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3433a6ae-b16a-42b3-bf9d-96bfe34e80d8 req-5bf791ec-4adc-42e1-8f2d-02f69bb82fe2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:47.790738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3433a6ae-b16a-42b3-bf9d-96bfe34e80d8 req-5bf791ec-4adc-42e1-8f2d-02f69bb82fe2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:47.791184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3433a6ae-b16a-42b3-bf9d-96bfe34e80d8 req-5bf791ec-4adc-42e1-8f2d-02f69bb82fe2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:47.803817 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3433a6ae-b16a-42b3-bf9d-96bfe34e80d8 req-5bf791ec-4adc-42e1-8f2d-02f69bb82fe2 service nova] Creating event network-changed:161830e2-fedc-4433-8c24-5babcba5d54c for instance 2fe97f26-e95d-4817-8260-63d999eb35d0 on n-h2-845781-6 Aug 09 18:38:47.810011 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3433a6ae-b16a-42b3-bf9d-96bfe34e80d8 req-5bf791ec-4adc-42e1-8f2d-02f69bb82fe2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132157 Aug 09 18:38:47.811206 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4387/7438] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:38:47.816548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-349d0828-110d-429b-a549-c4d01bd91d8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:47.817281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-349d0828-110d-429b-a549-c4d01bd91d8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:47.824022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-349d0828-110d-429b-a549-c4d01bd91d8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:47.824521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-349d0828-110d-429b-a549-c4d01bd91d8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:47.824966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-349d0828-110d-429b-a549-c4d01bd91d8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:47.825714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-349d0828-110d-429b-a549-c4d01bd91d8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:47.826719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-349d0828-110d-429b-a549-c4d01bd91d8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:47.827155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-349d0828-110d-429b-a549-c4d01bd91d8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:48.037205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-349d0828-110d-429b-a549-c4d01bd91d8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:48.046277 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-349d0828-110d-429b-a549-c4d01bd91d8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1681 microversion: 2.1 time: 0.233772 Aug 09 18:38:48.046877 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4388/7439] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:47 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:38:49.069841 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a6b2add4-566d-44d9-9cde-52a126683cde tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:49.070543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a6b2add4-566d-44d9-9cde-52a126683cde tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:49.079459 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6b2add4-566d-44d9-9cde-52a126683cde tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:49.080069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6b2add4-566d-44d9-9cde-52a126683cde tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:49.080521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6b2add4-566d-44d9-9cde-52a126683cde tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:49.081614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6b2add4-566d-44d9-9cde-52a126683cde tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:49.082281 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6b2add4-566d-44d9-9cde-52a126683cde tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:49.082963 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a6b2add4-566d-44d9-9cde-52a126683cde tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:49.319112 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a6b2add4-566d-44d9-9cde-52a126683cde tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:38:49.327656 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a6b2add4-566d-44d9-9cde-52a126683cde tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 200 len: 1681 microversion: 2.1 time: 0.261790 Aug 09 18:38:49.339970 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4389/7440] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:49 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:38:49.826300 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-793784ce-933d-449c-8528-bcc86e3f20eb req-57a6981e-f5e1-4a26-b8eb-593df9c11269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe97f26-e95d-4817-8260-63d999eb35d0", "name": "network-vif-deleted", "tag": "161830e2-fedc-4433-8c24-5babcba5d54c"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:38:49.837003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-793784ce-933d-449c-8528-bcc86e3f20eb req-57a6981e-f5e1-4a26-b8eb-593df9c11269 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:49.837494 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-793784ce-933d-449c-8528-bcc86e3f20eb req-57a6981e-f5e1-4a26-b8eb-593df9c11269 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:49.837935 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-793784ce-933d-449c-8528-bcc86e3f20eb req-57a6981e-f5e1-4a26-b8eb-593df9c11269 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:49.850670 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-793784ce-933d-449c-8528-bcc86e3f20eb req-57a6981e-f5e1-4a26-b8eb-593df9c11269 service nova] Creating event network-vif-deleted:161830e2-fedc-4433-8c24-5babcba5d54c for instance 2fe97f26-e95d-4817-8260-63d999eb35d0 on n-h2-845781-6 Aug 09 18:38:49.855846 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-793784ce-933d-449c-8528-bcc86e3f20eb req-57a6981e-f5e1-4a26-b8eb-593df9c11269 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033905 Aug 09 18:38:49.856561 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4390/7441] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:38:50.352572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:50.353291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 2fe97f26-e95d-4817-8260-63d999eb35d0] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:38:50.360796 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:50.361294 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:50.361743 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:50.362515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:38:50.362979 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:38:50.363413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:38:50.377465 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] HTTP exception thrown: Instance 2fe97f26-e95d-4817-8260-63d999eb35d0 could not be found. Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Request method failure captured: Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 HTTP/1.1 Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qi0c9K5oaaypD-2edJIh7YJIsvSkIXsBSynvXzBN8D4KosIKZbVT8aDc38hqHHasc2fXkP2Hn7ayE2M1TobymmWxfHADLkxanVNPLgFGluOs7HdifXFI5QfMNblXi-UTcANFTXyAavXscUiZ3ZdVi_uPzk03TY-BvUbs0Mx73olBKs Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 19db25916ce54b5cb76dd46d757321b6 Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestShelveInstance-1729929244 Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_19db25916ce54b5cb76dd46d757321b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/19db25916ce54b5cb76dd46d757321b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/19db25916ce54b5cb76dd46d757321b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/19db25916ce54b5cb76dd46d757321b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestShelveInstance-1729929244 Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 19db25916ce54b5cb76dd46d757321b6 Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestShelveInstance-1729929244 Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestShelveInstance-1729929244-project Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: fbe62e36a76b4d929225bea32b97c3f9 Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestShelveInstance-1729929244-project Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 2fe97f26-e95d-4817-8260-63d999eb35d0 could not be found. Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '2fe97f26-e95d-4817-8260-63d999eb35d0'} Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fe97f26-e95d-4817-8260-63d999eb35d0 could not be found. Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fe97f26-e95d-4817-8260-63d999eb35d0 could not be found. Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:38:50.379127 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:38:50.384170 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:38:50.384170 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:38:50.384170 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:38:50.384170 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:38:50.384170 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:38:50.384170 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fe97f26-e95d-4817-8260-63d999eb35d0 could not be found. Aug 09 18:38:50.384170 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:38:50.384170 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Returning 404 to user: Instance 2fe97f26-e95d-4817-8260-63d999eb35d0 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:38:50.384170 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4887730c-ca44-4df4-9486-4928ea795b39 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0" status: 404 len: 111 microversion: 2.1 time: 0.032389 Aug 09 18:38:50.384170 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4391/7442] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:38:50 2022] GET /compute/v2.1/servers/2fe97f26-e95d-4817-8260-63d999eb35d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:38:50.551880 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a83461a9-bb62-4d79-8218-650a7e0e70e3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '.version_select at 0x7fbbca538dc0>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:38:50.573898 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a83461a9-bb62-4d79-8218-650a7e0e70e3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1064307888" status: 202 len: 0 microversion: 2.1 time: 0.026872 Aug 09 18:38:50.574481 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4392/7443] 10.222.0.93 () {58 vars in 1254 bytes} [Tue Aug 9 18:38:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1064307888 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:38:50.598745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1f7e7245-cc1f-4aa7-9a49-c2073dd5c70d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Action: 'create', calling method: .version_select at 0x7fbbcad368b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1049338098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZHoOFn9TwXMMcplKhy6E+nOymT/cUYsrRbVHkLGZAne5povG6pb/W7EkWsu6e2QLGfkQLzfNdw77pcZZMfGLqMLCogHZtN8VQGJgcGBB2lOGazfSKpqB0ZoOGwVL3uKA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:38:50.615474 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-1f7e7245-cc1f-4aa7-9a49-c2073dd5c70d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Getting quotas for project 19db25916ce54b5cb76dd46d757321b6. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:38:50.620790 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-1f7e7245-cc1f-4aa7-9a49-c2073dd5c70d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Getting quotas for user fbe62e36a76b4d929225bea32b97c3f9 and project 19db25916ce54b5cb76dd46d757321b6. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:38:50.645380 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1f7e7245-cc1f-4aa7-9a49-c2073dd5c70d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.050704 Aug 09 18:38:50.646082 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4393/7444] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:38:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:39:07.912342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:39:07.913114 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:39:07.913741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:39:07.918037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1631326317", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1049338098", "security_groups": [{"name": "tempest-secgroup-smoke-231447028"}], "networks": [{"uuid": "03ee75c4-2130-4455-9162-71f0e5da6192"}], "block_device_mapping_v2": [{"uuid": "0a778dd3-abc4-4f96-8c49-8797b4db184d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:39:08.036472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] validate_networks() for [('03ee75c4-2130-4455-9162-71f0e5da6192', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:39:08.410517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:39:08.410957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:39:08.411457 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:39:08.411949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:39:08.412401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:39:08.422005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:08.422501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:08.422948 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:08.423713 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:08.424180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:08.424617 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:08.441260 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Getting quotas for project 19db25916ce54b5cb76dd46d757321b6. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:39:08.446602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Getting quotas for user fbe62e36a76b4d929225bea32b97c3f9 and project 19db25916ce54b5cb76dd46d757321b6. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:39:08.504771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:39:08.506953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a778dd3-abc4-4f96-8c49-8797b4db184d',volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:39:08.635807 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-40dc9bfc-9f0a-420d-97bd-5ad0d4b9db5e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.725002 Aug 09 18:39:08.643113 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4394/7445] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:39:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:39:08.649828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fe9bb60f-a6a0-4296-bdf9-eb48e4b088f9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:08.649828 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fe9bb60f-a6a0-4296-bdf9-eb48e4b088f9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:08.704774 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fe9bb60f-a6a0-4296-bdf9-eb48e4b088f9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:08.711964 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fe9bb60f-a6a0-4296-bdf9-eb48e4b088f9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1089 microversion: 2.1 time: 0.067261 Aug 09 18:39:08.712550 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4395/7446] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:08 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:09.731508 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e4efa0ed-f630-4997-93ab-646166171dae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:09.732278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e4efa0ed-f630-4997-93ab-646166171dae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:09.790381 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e4efa0ed-f630-4997-93ab-646166171dae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:09.797672 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e4efa0ed-f630-4997-93ab-646166171dae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1089 microversion: 2.1 time: 0.069931 Aug 09 18:39:09.798275 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4396/7447] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:09 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:39:10.818361 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4c18fe1c-e1d9-4a51-b59a-651833027fc9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:10.818987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4c18fe1c-e1d9-4a51-b59a-651833027fc9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:10.877211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4c18fe1c-e1d9-4a51-b59a-651833027fc9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:10.885027 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4c18fe1c-e1d9-4a51-b59a-651833027fc9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1089 microversion: 2.1 time: 0.070391 Aug 09 18:39:10.885941 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4397/7448] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:10 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:11.907007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f81eff03-17f4-411c-a451-874937fc2506 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:11.907707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f81eff03-17f4-411c-a451-874937fc2506 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:11.963577 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f81eff03-17f4-411c-a451-874937fc2506 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:11.971379 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f81eff03-17f4-411c-a451-874937fc2506 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1089 microversion: 2.1 time: 0.068317 Aug 09 18:39:11.972038 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4398/7449] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:11 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:12.991615 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d7cedf87-e378-44da-a1ad-952ddd18dbe5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:12.992295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d7cedf87-e378-44da-a1ad-952ddd18dbe5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:12.999033 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7cedf87-e378-44da-a1ad-952ddd18dbe5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:12.999515 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7cedf87-e378-44da-a1ad-952ddd18dbe5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:12.999987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7cedf87-e378-44da-a1ad-952ddd18dbe5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:13.000688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7cedf87-e378-44da-a1ad-952ddd18dbe5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:13.001149 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7cedf87-e378-44da-a1ad-952ddd18dbe5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:13.001581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d7cedf87-e378-44da-a1ad-952ddd18dbe5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:13.061994 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d7cedf87-e378-44da-a1ad-952ddd18dbe5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:13.070030 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d7cedf87-e378-44da-a1ad-952ddd18dbe5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1139 microversion: 2.1 time: 0.082336 Aug 09 18:39:13.070608 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4399/7450] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:12 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:14.090938 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-546a4249-30fc-4d75-a2b9-023f780aa96c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:14.091900 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-546a4249-30fc-4d75-a2b9-023f780aa96c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:14.101197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-546a4249-30fc-4d75-a2b9-023f780aa96c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:14.101773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-546a4249-30fc-4d75-a2b9-023f780aa96c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:14.102368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-546a4249-30fc-4d75-a2b9-023f780aa96c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:14.103209 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-546a4249-30fc-4d75-a2b9-023f780aa96c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:14.103717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-546a4249-30fc-4d75-a2b9-023f780aa96c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:14.104192 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-546a4249-30fc-4d75-a2b9-023f780aa96c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:14.177612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-546a4249-30fc-4d75-a2b9-023f780aa96c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:14.185767 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-546a4249-30fc-4d75-a2b9-023f780aa96c tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1205 microversion: 2.1 time: 0.098690 Aug 09 18:39:14.186361 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4400/7451] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:14 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1205 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:15.112367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-5d1212a0-3359-4c53-ab69-063a7d654570 req-f7e6a8f0-332a-401f-9e3c-f2208bd766de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f185593-47f5-4e7a-a1f4-f381020b78a4", "tag": "394de0ce-adeb-46c0-8121-ce9e0fb9952a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:39:15.123878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5d1212a0-3359-4c53-ab69-063a7d654570 req-f7e6a8f0-332a-401f-9e3c-f2208bd766de service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:15.124655 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5d1212a0-3359-4c53-ab69-063a7d654570 req-f7e6a8f0-332a-401f-9e3c-f2208bd766de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:15.125327 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-5d1212a0-3359-4c53-ab69-063a7d654570 req-f7e6a8f0-332a-401f-9e3c-f2208bd766de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:15.137908 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-5d1212a0-3359-4c53-ab69-063a7d654570 req-f7e6a8f0-332a-401f-9e3c-f2208bd766de service nova] Creating event network-changed:394de0ce-adeb-46c0-8121-ce9e0fb9952a for instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 on n-h1-845781-6 Aug 09 18:39:15.143524 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-5d1212a0-3359-4c53-ab69-063a7d654570 req-f7e6a8f0-332a-401f-9e3c-f2208bd766de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035435 Aug 09 18:39:15.144718 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4401/7452] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:39:15.216276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a437ba70-b707-4831-96af-95f3bdcf19d2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:15.217001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a437ba70-b707-4831-96af-95f3bdcf19d2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:15.223547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a437ba70-b707-4831-96af-95f3bdcf19d2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:15.224133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a437ba70-b707-4831-96af-95f3bdcf19d2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:15.224531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a437ba70-b707-4831-96af-95f3bdcf19d2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:15.225251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a437ba70-b707-4831-96af-95f3bdcf19d2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:15.225721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a437ba70-b707-4831-96af-95f3bdcf19d2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:15.226152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a437ba70-b707-4831-96af-95f3bdcf19d2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:15.384200 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a437ba70-b707-4831-96af-95f3bdcf19d2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:15.393647 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a437ba70-b707-4831-96af-95f3bdcf19d2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1272 microversion: 2.1 time: 0.181624 Aug 09 18:39:15.394544 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4402/7453] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:15 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:39:16.414969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-eb9ec2d2-0644-4788-9c31-71d556f7a73a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:16.415694 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-eb9ec2d2-0644-4788-9c31-71d556f7a73a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:16.422266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb9ec2d2-0644-4788-9c31-71d556f7a73a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:16.422759 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb9ec2d2-0644-4788-9c31-71d556f7a73a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:16.423211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb9ec2d2-0644-4788-9c31-71d556f7a73a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:16.424126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb9ec2d2-0644-4788-9c31-71d556f7a73a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:16.424594 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb9ec2d2-0644-4788-9c31-71d556f7a73a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:16.425027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-eb9ec2d2-0644-4788-9c31-71d556f7a73a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:16.561888 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-eb9ec2d2-0644-4788-9c31-71d556f7a73a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:16.569644 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-eb9ec2d2-0644-4788-9c31-71d556f7a73a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1272 microversion: 2.1 time: 0.158693 Aug 09 18:39:16.570236 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4403/7454] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:16 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:39:17.590702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6df7857e-bc05-4b76-8a4f-768c4196bbc0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:17.591587 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6df7857e-bc05-4b76-8a4f-768c4196bbc0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:17.598805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df7857e-bc05-4b76-8a4f-768c4196bbc0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:17.599618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df7857e-bc05-4b76-8a4f-768c4196bbc0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:17.600144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df7857e-bc05-4b76-8a4f-768c4196bbc0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:17.601043 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df7857e-bc05-4b76-8a4f-768c4196bbc0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:17.601517 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df7857e-bc05-4b76-8a4f-768c4196bbc0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:17.602069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6df7857e-bc05-4b76-8a4f-768c4196bbc0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:17.754534 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6df7857e-bc05-4b76-8a4f-768c4196bbc0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:17.762882 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6df7857e-bc05-4b76-8a4f-768c4196bbc0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1272 microversion: 2.1 time: 0.176024 Aug 09 18:39:17.763484 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4404/7455] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:17 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:18.785471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a61bf97b-3d30-4548-9184-eb046eff3ab7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:18.786148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a61bf97b-3d30-4548-9184-eb046eff3ab7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:18.788176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:39:18.794681 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a61bf97b-3d30-4548-9184-eb046eff3ab7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:18.795181 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a61bf97b-3d30-4548-9184-eb046eff3ab7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:18.795637 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a61bf97b-3d30-4548-9184-eb046eff3ab7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:18.796348 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a61bf97b-3d30-4548-9184-eb046eff3ab7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:18.796806 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a61bf97b-3d30-4548-9184-eb046eff3ab7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:18.797235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a61bf97b-3d30-4548-9184-eb046eff3ab7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:18.934312 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a61bf97b-3d30-4548-9184-eb046eff3ab7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:18.941889 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a61bf97b-3d30-4548-9184-eb046eff3ab7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1272 microversion: 2.1 time: 0.161083 Aug 09 18:39:18.942465 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4405/7456] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:18 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:19.963034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e8c5c0c6-4bc6-4186-8114-b2b78e4cbac5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:19.963740 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e8c5c0c6-4bc6-4186-8114-b2b78e4cbac5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:19.970909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8c5c0c6-4bc6-4186-8114-b2b78e4cbac5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:19.971398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8c5c0c6-4bc6-4186-8114-b2b78e4cbac5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:19.971865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8c5c0c6-4bc6-4186-8114-b2b78e4cbac5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:19.972565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8c5c0c6-4bc6-4186-8114-b2b78e4cbac5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:19.973019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8c5c0c6-4bc6-4186-8114-b2b78e4cbac5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:19.973448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8c5c0c6-4bc6-4186-8114-b2b78e4cbac5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:20.111282 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e8c5c0c6-4bc6-4186-8114-b2b78e4cbac5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:20.118804 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e8c5c0c6-4bc6-4186-8114-b2b78e4cbac5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1260 microversion: 2.1 time: 0.159950 Aug 09 18:39:20.119378 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4406/7457] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:19 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:21.140143 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-367e963b-d251-4ce5-bfe3-a4401017ff26 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:21.140797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-367e963b-d251-4ce5-bfe3-a4401017ff26 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:21.147238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367e963b-d251-4ce5-bfe3-a4401017ff26 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:21.147749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367e963b-d251-4ce5-bfe3-a4401017ff26 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:21.148184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367e963b-d251-4ce5-bfe3-a4401017ff26 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:21.148872 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367e963b-d251-4ce5-bfe3-a4401017ff26 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:21.149322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367e963b-d251-4ce5-bfe3-a4401017ff26 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:21.149744 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-367e963b-d251-4ce5-bfe3-a4401017ff26 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:21.282396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-367e963b-d251-4ce5-bfe3-a4401017ff26 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:21.289822 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-367e963b-d251-4ce5-bfe3-a4401017ff26 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1260 microversion: 2.1 time: 0.153653 Aug 09 18:39:21.290427 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4407/7458] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:21 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:22.310910 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-47f9899e-00e8-4486-a204-36c29a278cf8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:22.311612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-47f9899e-00e8-4486-a204-36c29a278cf8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:22.313860 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=14 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:39:22.320369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47f9899e-00e8-4486-a204-36c29a278cf8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:22.320867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47f9899e-00e8-4486-a204-36c29a278cf8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:22.321318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47f9899e-00e8-4486-a204-36c29a278cf8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:22.322027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47f9899e-00e8-4486-a204-36c29a278cf8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:22.322526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47f9899e-00e8-4486-a204-36c29a278cf8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:22.322965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47f9899e-00e8-4486-a204-36c29a278cf8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:22.455581 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-47f9899e-00e8-4486-a204-36c29a278cf8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:22.463602 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-47f9899e-00e8-4486-a204-36c29a278cf8 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1260 microversion: 2.1 time: 0.156705 Aug 09 18:39:22.464211 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4408/7459] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:22 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:23.483230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4ceac71d-785d-4436-bc1b-987409600738 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:23.483968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4ceac71d-785d-4436-bc1b-987409600738 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:23.490868 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ceac71d-785d-4436-bc1b-987409600738 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:23.491360 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ceac71d-785d-4436-bc1b-987409600738 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:23.491847 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ceac71d-785d-4436-bc1b-987409600738 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:23.492550 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ceac71d-785d-4436-bc1b-987409600738 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:23.493007 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ceac71d-785d-4436-bc1b-987409600738 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:23.493439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ceac71d-785d-4436-bc1b-987409600738 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:23.629778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4ceac71d-785d-4436-bc1b-987409600738 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:23.637692 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4ceac71d-785d-4436-bc1b-987409600738 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1260 microversion: 2.1 time: 0.158381 Aug 09 18:39:23.638285 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4409/7460] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:23 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:24.658742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d4c2766-b16f-4d2c-b760-c82b92b2819b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:24.659438 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d4c2766-b16f-4d2c-b760-c82b92b2819b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:24.666295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4c2766-b16f-4d2c-b760-c82b92b2819b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:24.666789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4c2766-b16f-4d2c-b760-c82b92b2819b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:24.667234 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4c2766-b16f-4d2c-b760-c82b92b2819b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:24.667984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4c2766-b16f-4d2c-b760-c82b92b2819b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:24.668451 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4c2766-b16f-4d2c-b760-c82b92b2819b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:24.668887 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d4c2766-b16f-4d2c-b760-c82b92b2819b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:24.811130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8d4c2766-b16f-4d2c-b760-c82b92b2819b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:24.819560 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d4c2766-b16f-4d2c-b760-c82b92b2819b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1260 microversion: 2.1 time: 0.164783 Aug 09 18:39:24.820163 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4410/7461] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:24 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:25.840968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c931d4f6-cecd-42f5-bece-e1a5e2e06923 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:25.841667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c931d4f6-cecd-42f5-bece-e1a5e2e06923 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:25.848519 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c931d4f6-cecd-42f5-bece-e1a5e2e06923 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:25.849009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c931d4f6-cecd-42f5-bece-e1a5e2e06923 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:25.849461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c931d4f6-cecd-42f5-bece-e1a5e2e06923 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:25.850156 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c931d4f6-cecd-42f5-bece-e1a5e2e06923 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:25.850619 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c931d4f6-cecd-42f5-bece-e1a5e2e06923 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:25.851051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c931d4f6-cecd-42f5-bece-e1a5e2e06923 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:25.987707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c931d4f6-cecd-42f5-bece-e1a5e2e06923 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:25.995363 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c931d4f6-cecd-42f5-bece-e1a5e2e06923 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1260 microversion: 2.1 time: 0.158462 Aug 09 18:39:25.995980 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4411/7462] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:25 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:27.017541 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-aea73266-afd7-419e-b508-38bf55b6fa8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:27.018273 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-aea73266-afd7-419e-b508-38bf55b6fa8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:27.025297 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea73266-afd7-419e-b508-38bf55b6fa8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:27.025791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea73266-afd7-419e-b508-38bf55b6fa8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:27.026242 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea73266-afd7-419e-b508-38bf55b6fa8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:27.026988 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea73266-afd7-419e-b508-38bf55b6fa8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:27.027677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea73266-afd7-419e-b508-38bf55b6fa8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:27.028125 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-aea73266-afd7-419e-b508-38bf55b6fa8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:27.164453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-aea73266-afd7-419e-b508-38bf55b6fa8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:27.172126 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-aea73266-afd7-419e-b508-38bf55b6fa8f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1260 microversion: 2.1 time: 0.159092 Aug 09 18:39:27.172701 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4412/7463] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:27 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:28.193100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4d2888a6-327c-41e3-a0b5-dc263dcbfbae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:28.193742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4d2888a6-327c-41e3-a0b5-dc263dcbfbae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:28.200600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d2888a6-327c-41e3-a0b5-dc263dcbfbae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:28.201093 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d2888a6-327c-41e3-a0b5-dc263dcbfbae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:28.201535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d2888a6-327c-41e3-a0b5-dc263dcbfbae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:28.202239 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d2888a6-327c-41e3-a0b5-dc263dcbfbae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:28.202699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d2888a6-327c-41e3-a0b5-dc263dcbfbae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:28.203131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d2888a6-327c-41e3-a0b5-dc263dcbfbae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:28.341488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4d2888a6-327c-41e3-a0b5-dc263dcbfbae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:28.349528 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4d2888a6-327c-41e3-a0b5-dc263dcbfbae tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1260 microversion: 2.1 time: 0.160433 Aug 09 18:39:28.350153 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4413/7464] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:28 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:28.596301 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f2b62d96-78f2-4a99-a202-4d8c159478c5 req-471d9013-e008-4cc9-afb6-efee79ec2d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f185593-47f5-4e7a-a1f4-f381020b78a4", "name": "network-vif-plugged", "status": "completed", "tag": "394de0ce-adeb-46c0-8121-ce9e0fb9952a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:39:28.606875 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f2b62d96-78f2-4a99-a202-4d8c159478c5 req-471d9013-e008-4cc9-afb6-efee79ec2d9b service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:28.607378 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f2b62d96-78f2-4a99-a202-4d8c159478c5 req-471d9013-e008-4cc9-afb6-efee79ec2d9b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:28.607931 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f2b62d96-78f2-4a99-a202-4d8c159478c5 req-471d9013-e008-4cc9-afb6-efee79ec2d9b service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:28.619927 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f2b62d96-78f2-4a99-a202-4d8c159478c5 req-471d9013-e008-4cc9-afb6-efee79ec2d9b service nova] Creating event network-vif-plugged:394de0ce-adeb-46c0-8121-ce9e0fb9952a for instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 on n-h1-845781-6 Aug 09 18:39:28.625285 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f2b62d96-78f2-4a99-a202-4d8c159478c5 req-471d9013-e008-4cc9-afb6-efee79ec2d9b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033378 Aug 09 18:39:28.625905 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4414/7465] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:39:29.372091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1a9f0cf5-981b-4997-bf41-f7109a416e7b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:29.372818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1a9f0cf5-981b-4997-bf41-f7109a416e7b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:29.379809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a9f0cf5-981b-4997-bf41-f7109a416e7b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:29.380316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a9f0cf5-981b-4997-bf41-f7109a416e7b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:29.380750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a9f0cf5-981b-4997-bf41-f7109a416e7b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:29.381439 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a9f0cf5-981b-4997-bf41-f7109a416e7b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:29.381890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a9f0cf5-981b-4997-bf41-f7109a416e7b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:29.382316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1a9f0cf5-981b-4997-bf41-f7109a416e7b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:29.517349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1a9f0cf5-981b-4997-bf41-f7109a416e7b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:29.524879 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1a9f0cf5-981b-4997-bf41-f7109a416e7b tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1260 microversion: 2.1 time: 0.158062 Aug 09 18:39:29.525464 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4415/7466] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:29 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:30.546322 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d0a1ef15-788c-411d-8fbf-a519a91d0196 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:30.547000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d0a1ef15-788c-411d-8fbf-a519a91d0196 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:30.557775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0a1ef15-788c-411d-8fbf-a519a91d0196 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:30.558207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0a1ef15-788c-411d-8fbf-a519a91d0196 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:30.558811 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0a1ef15-788c-411d-8fbf-a519a91d0196 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:30.559590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0a1ef15-788c-411d-8fbf-a519a91d0196 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:30.560090 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0a1ef15-788c-411d-8fbf-a519a91d0196 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:30.560531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d0a1ef15-788c-411d-8fbf-a519a91d0196 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:30.579762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=100 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:39:30.693752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d0a1ef15-788c-411d-8fbf-a519a91d0196 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:30.701366 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d0a1ef15-788c-411d-8fbf-a519a91d0196 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1444 microversion: 2.1 time: 0.159009 Aug 09 18:39:30.701941 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4416/7467] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:30 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:30.720823 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b2c7cd09-edcd-4168-95cd-1c90513aa996 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:39:30.721436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b2c7cd09-edcd-4168-95cd-1c90513aa996 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:39:30.727198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c7cd09-edcd-4168-95cd-1c90513aa996 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:30.727718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c7cd09-edcd-4168-95cd-1c90513aa996 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:30.728159 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c7cd09-edcd-4168-95cd-1c90513aa996 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:30.728848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c7cd09-edcd-4168-95cd-1c90513aa996 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:30.729326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c7cd09-edcd-4168-95cd-1c90513aa996 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:30.729753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b2c7cd09-edcd-4168-95cd-1c90513aa996 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:30.864782 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b2c7cd09-edcd-4168-95cd-1c90513aa996 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:39:30.872459 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b2c7cd09-edcd-4168-95cd-1c90513aa996 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1444 microversion: 2.1 time: 0.155291 Aug 09 18:39:30.873040 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4417/7468] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:39:30 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:39:32.760269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-3c11fdd5-9299-4018-9575-7bb8cfb75281 req-aeb7ff9e-bb61-4c73-b976-01bf39ee212c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f185593-47f5-4e7a-a1f4-f381020b78a4", "tag": "394de0ce-adeb-46c0-8121-ce9e0fb9952a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:39:32.770951 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3c11fdd5-9299-4018-9575-7bb8cfb75281 req-aeb7ff9e-bb61-4c73-b976-01bf39ee212c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:39:32.771434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3c11fdd5-9299-4018-9575-7bb8cfb75281 req-aeb7ff9e-bb61-4c73-b976-01bf39ee212c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:39:32.771903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-3c11fdd5-9299-4018-9575-7bb8cfb75281 req-aeb7ff9e-bb61-4c73-b976-01bf39ee212c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:39:32.787615 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-3c11fdd5-9299-4018-9575-7bb8cfb75281 req-aeb7ff9e-bb61-4c73-b976-01bf39ee212c service nova] Creating event network-changed:394de0ce-adeb-46c0-8121-ce9e0fb9952a for instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 on n-h1-845781-6 Aug 09 18:39:32.793048 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-3c11fdd5-9299-4018-9575-7bb8cfb75281 req-aeb7ff9e-bb61-4c73-b976-01bf39ee212c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036628 Aug 09 18:39:32.793681 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4418/7469] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:41:20.815456 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:41:20.816558 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 18:41:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:41:30.133997 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e0ed10f-39e6-43ca-a71e-0dc84cc0a1d8] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:41:30.134795 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [-] [59dc5572-757a-480c-957b-ef1cabe2d1a7] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:41:30.135475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:30.136253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=10 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:30.192850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df7b4ce7-7917-4d26-af27-bdb2eabe1adb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:30.193767 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df7b4ce7-7917-4d26-af27-bdb2eabe1adb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:30.205393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df7b4ce7-7917-4d26-af27-bdb2eabe1adb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:30.206268 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df7b4ce7-7917-4d26-af27-bdb2eabe1adb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:30.206998 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df7b4ce7-7917-4d26-af27-bdb2eabe1adb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:30.208292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df7b4ce7-7917-4d26-af27-bdb2eabe1adb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:30.208831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df7b4ce7-7917-4d26-af27-bdb2eabe1adb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:30.209338 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df7b4ce7-7917-4d26-af27-bdb2eabe1adb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:30.238556 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-df7b4ce7-7917-4d26-af27-bdb2eabe1adb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lazy-loading 'flavor' on Instance uuid 7f185593-47f5-4e7a-a1f4-f381020b78a4 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:41:30.323911 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df7b4ce7-7917-4d26-af27-bdb2eabe1adb tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "POST /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4/action" status: 202 len: 0 microversion: 2.1 time: 0.186989 Aug 09 18:41:30.323911 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4419/7470] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:41:30 2022] POST /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:41:30.331918 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-73464e6e-c9ec-4c59-a828-cc6ee243e8d6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:30.332728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-73464e6e-c9ec-4c59-a828-cc6ee243e8d6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:30.339842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73464e6e-c9ec-4c59-a828-cc6ee243e8d6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:30.340337 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73464e6e-c9ec-4c59-a828-cc6ee243e8d6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:30.340775 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73464e6e-c9ec-4c59-a828-cc6ee243e8d6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:30.341631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73464e6e-c9ec-4c59-a828-cc6ee243e8d6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:30.342177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73464e6e-c9ec-4c59-a828-cc6ee243e8d6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:30.342679 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-73464e6e-c9ec-4c59-a828-cc6ee243e8d6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:30.486835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-73464e6e-c9ec-4c59-a828-cc6ee243e8d6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:30.495579 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-73464e6e-c9ec-4c59-a828-cc6ee243e8d6 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.168868 Aug 09 18:41:30.496191 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4420/7471] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:30 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:31.516808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-47bfd6b1-b3dc-47fe-ab6f-e1a3f02e0816 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:31.517496 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-47bfd6b1-b3dc-47fe-ab6f-e1a3f02e0816 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:31.529692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47bfd6b1-b3dc-47fe-ab6f-e1a3f02e0816 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:31.530211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47bfd6b1-b3dc-47fe-ab6f-e1a3f02e0816 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:31.530648 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47bfd6b1-b3dc-47fe-ab6f-e1a3f02e0816 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:31.531344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47bfd6b1-b3dc-47fe-ab6f-e1a3f02e0816 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:31.531832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47bfd6b1-b3dc-47fe-ab6f-e1a3f02e0816 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:31.532286 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-47bfd6b1-b3dc-47fe-ab6f-e1a3f02e0816 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:31.536210 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] [59dc5572-757a-480c-957b-ef1cabe2d1a7] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 41624. Aug 09 18:41:31.539195 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e0ed10f-39e6-43ca-a71e-0dc84cc0a1d8] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 41622. Aug 09 18:41:31.674748 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-47bfd6b1-b3dc-47fe-ab6f-e1a3f02e0816 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:31.682339 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-47bfd6b1-b3dc-47fe-ab6f-e1a3f02e0816 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.169523 Aug 09 18:41:31.682958 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4421/7472] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:31 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:32.704216 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6b4cfa92-20ff-4c0e-bae7-9d5496be2dbc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:32.704896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6b4cfa92-20ff-4c0e-bae7-9d5496be2dbc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:32.711999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b4cfa92-20ff-4c0e-bae7-9d5496be2dbc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:32.712495 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b4cfa92-20ff-4c0e-bae7-9d5496be2dbc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:32.712939 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b4cfa92-20ff-4c0e-bae7-9d5496be2dbc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:32.713652 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b4cfa92-20ff-4c0e-bae7-9d5496be2dbc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:32.714116 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b4cfa92-20ff-4c0e-bae7-9d5496be2dbc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:32.714547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6b4cfa92-20ff-4c0e-bae7-9d5496be2dbc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:32.847546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6b4cfa92-20ff-4c0e-bae7-9d5496be2dbc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:32.855136 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6b4cfa92-20ff-4c0e-bae7-9d5496be2dbc tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.154916 Aug 09 18:41:32.855724 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4422/7473] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:32 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:33.876789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-34b98e6a-cac0-4334-98b0-ec23d394a265 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:33.877493 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-34b98e6a-cac0-4334-98b0-ec23d394a265 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:33.884501 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b98e6a-cac0-4334-98b0-ec23d394a265 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:33.884997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b98e6a-cac0-4334-98b0-ec23d394a265 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:33.885448 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b98e6a-cac0-4334-98b0-ec23d394a265 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:33.886162 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b98e6a-cac0-4334-98b0-ec23d394a265 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:33.886626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b98e6a-cac0-4334-98b0-ec23d394a265 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:33.887061 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-34b98e6a-cac0-4334-98b0-ec23d394a265 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:34.022522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-34b98e6a-cac0-4334-98b0-ec23d394a265 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:34.030267 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-34b98e6a-cac0-4334-98b0-ec23d394a265 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.158040 Aug 09 18:41:34.031336 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4423/7474] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:33 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:35.052278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c4941fd7-23bc-44df-94f1-8b04800737a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:35.052968 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c4941fd7-23bc-44df-94f1-8b04800737a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:35.059919 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4941fd7-23bc-44df-94f1-8b04800737a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:35.060425 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4941fd7-23bc-44df-94f1-8b04800737a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:35.060873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4941fd7-23bc-44df-94f1-8b04800737a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:35.061601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4941fd7-23bc-44df-94f1-8b04800737a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:35.062559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4941fd7-23bc-44df-94f1-8b04800737a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:35.063003 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c4941fd7-23bc-44df-94f1-8b04800737a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:35.207097 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c4941fd7-23bc-44df-94f1-8b04800737a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:35.215107 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c4941fd7-23bc-44df-94f1-8b04800737a3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.167019 Aug 09 18:41:35.215717 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4424/7475] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:35 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:36.236749 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6669d9de-c546-47a9-8ed7-4883cbb80b91 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:36.237400 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6669d9de-c546-47a9-8ed7-4883cbb80b91 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:36.244342 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6669d9de-c546-47a9-8ed7-4883cbb80b91 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:36.244834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6669d9de-c546-47a9-8ed7-4883cbb80b91 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:36.245279 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6669d9de-c546-47a9-8ed7-4883cbb80b91 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:36.245993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6669d9de-c546-47a9-8ed7-4883cbb80b91 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:36.246456 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6669d9de-c546-47a9-8ed7-4883cbb80b91 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:36.246891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6669d9de-c546-47a9-8ed7-4883cbb80b91 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:36.387185 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6669d9de-c546-47a9-8ed7-4883cbb80b91 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:36.395738 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6669d9de-c546-47a9-8ed7-4883cbb80b91 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.163004 Aug 09 18:41:36.396330 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4425/7476] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:36 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:37.417850 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a1dbcf46-60bb-4930-a3e5-a158ca8db603 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:37.418547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a1dbcf46-60bb-4930-a3e5-a158ca8db603 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:37.425672 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbcf46-60bb-4930-a3e5-a158ca8db603 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:37.426171 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbcf46-60bb-4930-a3e5-a158ca8db603 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:37.426612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbcf46-60bb-4930-a3e5-a158ca8db603 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:37.427321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbcf46-60bb-4930-a3e5-a158ca8db603 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:37.427807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbcf46-60bb-4930-a3e5-a158ca8db603 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:37.428237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a1dbcf46-60bb-4930-a3e5-a158ca8db603 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:37.579079 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a1dbcf46-60bb-4930-a3e5-a158ca8db603 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:37.587505 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a1dbcf46-60bb-4930-a3e5-a158ca8db603 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.173601 Aug 09 18:41:37.588161 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4426/7477] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:37 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:38.610480 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-23b5243f-4aa9-425b-af4b-febdde4cf2c9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:38.611155 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-23b5243f-4aa9-425b-af4b-febdde4cf2c9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:38.618059 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23b5243f-4aa9-425b-af4b-febdde4cf2c9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:38.618555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23b5243f-4aa9-425b-af4b-febdde4cf2c9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:38.619503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23b5243f-4aa9-425b-af4b-febdde4cf2c9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:38.620249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23b5243f-4aa9-425b-af4b-febdde4cf2c9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:38.620717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23b5243f-4aa9-425b-af4b-febdde4cf2c9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:38.621154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-23b5243f-4aa9-425b-af4b-febdde4cf2c9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:38.760198 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-23b5243f-4aa9-425b-af4b-febdde4cf2c9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:38.769328 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-23b5243f-4aa9-425b-af4b-febdde4cf2c9 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.163035 Aug 09 18:41:38.769954 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4427/7478] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:38 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:39.790067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-532d8036-758e-447e-aa84-b6760478bd44 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:39.790685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-532d8036-758e-447e-aa84-b6760478bd44 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:39.797987 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532d8036-758e-447e-aa84-b6760478bd44 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:39.798469 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532d8036-758e-447e-aa84-b6760478bd44 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:39.798909 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532d8036-758e-447e-aa84-b6760478bd44 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:39.799602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532d8036-758e-447e-aa84-b6760478bd44 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:39.800082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532d8036-758e-447e-aa84-b6760478bd44 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:39.800506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-532d8036-758e-447e-aa84-b6760478bd44 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:39.939321 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-532d8036-758e-447e-aa84-b6760478bd44 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:39.947134 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-532d8036-758e-447e-aa84-b6760478bd44 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.161010 Aug 09 18:41:39.947759 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4428/7479] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:39 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:40.969800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b6aba876-4bed-4e75-8a6d-8506c460c1ca tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:40.970532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b6aba876-4bed-4e75-8a6d-8506c460c1ca tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:40.976444 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6aba876-4bed-4e75-8a6d-8506c460c1ca tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:40.976942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6aba876-4bed-4e75-8a6d-8506c460c1ca tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:40.977391 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6aba876-4bed-4e75-8a6d-8506c460c1ca tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:40.978104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6aba876-4bed-4e75-8a6d-8506c460c1ca tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:40.978570 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6aba876-4bed-4e75-8a6d-8506c460c1ca tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:40.979008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b6aba876-4bed-4e75-8a6d-8506c460c1ca tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:41.116298 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b6aba876-4bed-4e75-8a6d-8506c460c1ca tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:41.123833 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b6aba876-4bed-4e75-8a6d-8506c460c1ca tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.159247 Aug 09 18:41:41.124403 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4429/7480] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:40 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:42.145876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e8dddbc7-105b-43ed-adbe-7206e194dbff tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:42.146549 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e8dddbc7-105b-43ed-adbe-7206e194dbff tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:42.153481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8dddbc7-105b-43ed-adbe-7206e194dbff tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:42.153973 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8dddbc7-105b-43ed-adbe-7206e194dbff tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:42.154418 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8dddbc7-105b-43ed-adbe-7206e194dbff tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:42.155131 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8dddbc7-105b-43ed-adbe-7206e194dbff tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:42.155591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8dddbc7-105b-43ed-adbe-7206e194dbff tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:42.156052 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e8dddbc7-105b-43ed-adbe-7206e194dbff tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:42.289037 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e8dddbc7-105b-43ed-adbe-7206e194dbff tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:42.296590 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e8dddbc7-105b-43ed-adbe-7206e194dbff tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.155353 Aug 09 18:41:42.297155 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4430/7481] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:42 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:43.317513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8da50dd-fd1f-40e6-84b5-dad43afb1bab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:43.318172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f8da50dd-fd1f-40e6-84b5-dad43afb1bab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:43.325028 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8da50dd-fd1f-40e6-84b5-dad43afb1bab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:43.325516 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8da50dd-fd1f-40e6-84b5-dad43afb1bab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:43.325958 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8da50dd-fd1f-40e6-84b5-dad43afb1bab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:43.326659 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8da50dd-fd1f-40e6-84b5-dad43afb1bab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:43.327113 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8da50dd-fd1f-40e6-84b5-dad43afb1bab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:43.327542 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8da50dd-fd1f-40e6-84b5-dad43afb1bab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:43.472188 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f8da50dd-fd1f-40e6-84b5-dad43afb1bab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:43.479915 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f8da50dd-fd1f-40e6-84b5-dad43afb1bab tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.166350 Aug 09 18:41:43.480500 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4431/7482] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:43 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:44.501889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7b7b6b1c-511c-4953-9589-9c02b5f7a926 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:44.502621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7b7b6b1c-511c-4953-9589-9c02b5f7a926 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:44.509921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7b6b1c-511c-4953-9589-9c02b5f7a926 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:44.510419 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7b6b1c-511c-4953-9589-9c02b5f7a926 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:44.510866 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7b6b1c-511c-4953-9589-9c02b5f7a926 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:44.511588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7b6b1c-511c-4953-9589-9c02b5f7a926 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:44.512075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7b6b1c-511c-4953-9589-9c02b5f7a926 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:44.512507 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7b7b6b1c-511c-4953-9589-9c02b5f7a926 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:44.676654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7b7b6b1c-511c-4953-9589-9c02b5f7a926 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:44.684907 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7b7b6b1c-511c-4953-9589-9c02b5f7a926 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.187591 Aug 09 18:41:44.685505 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4432/7483] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:44 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:45.706813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-1da008e4-b935-4fb8-afbf-8ee4899e353a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:45.707465 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-1da008e4-b935-4fb8-afbf-8ee4899e353a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:45.714586 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da008e4-b935-4fb8-afbf-8ee4899e353a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:45.715081 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da008e4-b935-4fb8-afbf-8ee4899e353a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:45.715533 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da008e4-b935-4fb8-afbf-8ee4899e353a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:45.716280 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da008e4-b935-4fb8-afbf-8ee4899e353a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:45.716745 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da008e4-b935-4fb8-afbf-8ee4899e353a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:45.717183 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-1da008e4-b935-4fb8-afbf-8ee4899e353a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:45.735730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:41:45.859898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-1da008e4-b935-4fb8-afbf-8ee4899e353a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:45.867610 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-1da008e4-b935-4fb8-afbf-8ee4899e353a tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1510 microversion: 2.1 time: 0.165330 Aug 09 18:41:45.868215 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4433/7484] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:45 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:45.889536 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4e8e9c2c-dcea-469b-b39d-745c89e5c226 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:45.890147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e8e9c2c-dcea-469b-b39d-745c89e5c226 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:45.896712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e8e9c2c-dcea-469b-b39d-745c89e5c226 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:45.897211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e8e9c2c-dcea-469b-b39d-745c89e5c226 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:45.897656 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e8e9c2c-dcea-469b-b39d-745c89e5c226 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:45.898366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e8e9c2c-dcea-469b-b39d-745c89e5c226 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:45.898831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e8e9c2c-dcea-469b-b39d-745c89e5c226 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:45.899262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4e8e9c2c-dcea-469b-b39d-745c89e5c226 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:45.928531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4e8e9c2c-dcea-469b-b39d-745c89e5c226 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119431) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 09 18:41:45.993967 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4e8e9c2c-dcea-469b-b39d-745c89e5c226 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "POST /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4/action" status: 202 len: 0 microversion: 2.1 time: 0.108319 Aug 09 18:41:45.994603 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4434/7485] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:41:45 2022] POST /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:41:46.003196 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0fe19231-ead7-46cd-9e27-6d459b69fb2f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:46.003861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0fe19231-ead7-46cd-9e27-6d459b69fb2f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:46.010140 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe19231-ead7-46cd-9e27-6d459b69fb2f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:46.010632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe19231-ead7-46cd-9e27-6d459b69fb2f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:46.011068 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe19231-ead7-46cd-9e27-6d459b69fb2f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:46.011802 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe19231-ead7-46cd-9e27-6d459b69fb2f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:46.012259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe19231-ead7-46cd-9e27-6d459b69fb2f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:46.012683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0fe19231-ead7-46cd-9e27-6d459b69fb2f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:46.149067 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0fe19231-ead7-46cd-9e27-6d459b69fb2f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:46.157165 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0fe19231-ead7-46cd-9e27-6d459b69fb2f tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1518 microversion: 2.1 time: 0.158315 Aug 09 18:41:46.157818 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4435/7486] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:45 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:47.178313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4ac4768c-40f8-4110-a1c9-0c7a66f28371 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:47.178974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4ac4768c-40f8-4110-a1c9-0c7a66f28371 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:47.186228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac4768c-40f8-4110-a1c9-0c7a66f28371 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:47.186728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac4768c-40f8-4110-a1c9-0c7a66f28371 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:47.187173 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac4768c-40f8-4110-a1c9-0c7a66f28371 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:47.187921 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac4768c-40f8-4110-a1c9-0c7a66f28371 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:47.188376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac4768c-40f8-4110-a1c9-0c7a66f28371 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:47.188807 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4ac4768c-40f8-4110-a1c9-0c7a66f28371 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:47.326311 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4ac4768c-40f8-4110-a1c9-0c7a66f28371 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:47.334811 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4ac4768c-40f8-4110-a1c9-0c7a66f28371 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1520 microversion: 2.1 time: 0.160286 Aug 09 18:41:47.335342 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4436/7487] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:47 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:47.360461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0b223ef3-527f-4a55-b434-77ae56a4ca5a req-234110fc-5c14-44fe-b49e-5e7f775f7efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f185593-47f5-4e7a-a1f4-f381020b78a4", "name": "network-vif-unplugged", "status": "completed", "tag": "394de0ce-adeb-46c0-8121-ce9e0fb9952a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:47.371883 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0b223ef3-527f-4a55-b434-77ae56a4ca5a req-234110fc-5c14-44fe-b49e-5e7f775f7efc service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:47.372805 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0b223ef3-527f-4a55-b434-77ae56a4ca5a req-234110fc-5c14-44fe-b49e-5e7f775f7efc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:47.373160 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0b223ef3-527f-4a55-b434-77ae56a4ca5a req-234110fc-5c14-44fe-b49e-5e7f775f7efc service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:47.385257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.compute.server_external_events [req-0b223ef3-527f-4a55-b434-77ae56a4ca5a req-234110fc-5c14-44fe-b49e-5e7f775f7efc service nova] Unable to find a host for instance 7f185593-47f5-4e7a-a1f4-f381020b78a4. Dropping event network-vif-unplugged {{(pid=119431) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 18:41:47.386164 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0b223ef3-527f-4a55-b434-77ae56a4ca5a req-234110fc-5c14-44fe-b49e-5e7f775f7efc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029977 Aug 09 18:41:47.386932 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4437/7488] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 09 18:41:48.358154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-75f061df-947c-48c1-a471-9df5784ab734 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:48.358848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-75f061df-947c-48c1-a471-9df5784ab734 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:48.366350 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f061df-947c-48c1-a471-9df5784ab734 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:48.366853 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f061df-947c-48c1-a471-9df5784ab734 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:48.367304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f061df-947c-48c1-a471-9df5784ab734 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:48.368039 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f061df-947c-48c1-a471-9df5784ab734 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:48.368535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f061df-947c-48c1-a471-9df5784ab734 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:48.369005 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-75f061df-947c-48c1-a471-9df5784ab734 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:48.511320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-75f061df-947c-48c1-a471-9df5784ab734 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:48.519518 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-75f061df-947c-48c1-a471-9df5784ab734 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1520 microversion: 2.1 time: 0.165406 Aug 09 18:41:48.520119 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4438/7489] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:48 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:49.540623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e1a91847-f84a-4733-a172-453d613cdd51 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:49.541333 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e1a91847-f84a-4733-a172-453d613cdd51 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:49.548605 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1a91847-f84a-4733-a172-453d613cdd51 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:49.549606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1a91847-f84a-4733-a172-453d613cdd51 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:49.550050 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1a91847-f84a-4733-a172-453d613cdd51 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:49.550772 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1a91847-f84a-4733-a172-453d613cdd51 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:49.551227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1a91847-f84a-4733-a172-453d613cdd51 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:49.551715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e1a91847-f84a-4733-a172-453d613cdd51 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:49.692109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e1a91847-f84a-4733-a172-453d613cdd51 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:49.700660 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e1a91847-f84a-4733-a172-453d613cdd51 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1520 microversion: 2.1 time: 0.164007 Aug 09 18:41:49.701254 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4439/7490] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:49 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:50.722115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1a1b55c-be96-4547-b176-c3e4cde6e0da tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:50.722848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d1a1b55c-be96-4547-b176-c3e4cde6e0da tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:50.729794 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1a1b55c-be96-4547-b176-c3e4cde6e0da tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:50.730290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1a1b55c-be96-4547-b176-c3e4cde6e0da tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:50.730741 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1a1b55c-be96-4547-b176-c3e4cde6e0da tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:50.731462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1a1b55c-be96-4547-b176-c3e4cde6e0da tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:50.731953 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1a1b55c-be96-4547-b176-c3e4cde6e0da tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:50.732388 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1a1b55c-be96-4547-b176-c3e4cde6e0da tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:50.871927 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d1a1b55c-be96-4547-b176-c3e4cde6e0da tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:50.880407 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1a1b55c-be96-4547-b176-c3e4cde6e0da tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1520 microversion: 2.1 time: 0.162368 Aug 09 18:41:50.881181 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4440/7491] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:50 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:51.901716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-fe818632-06c3-4207-82ee-6c7076b80736 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:51.902514 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-fe818632-06c3-4207-82ee-6c7076b80736 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:51.909831 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe818632-06c3-4207-82ee-6c7076b80736 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:51.910323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe818632-06c3-4207-82ee-6c7076b80736 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:51.910784 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe818632-06c3-4207-82ee-6c7076b80736 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:51.911470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe818632-06c3-4207-82ee-6c7076b80736 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:51.911949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe818632-06c3-4207-82ee-6c7076b80736 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:51.912379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-fe818632-06c3-4207-82ee-6c7076b80736 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:52.126675 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-fe818632-06c3-4207-82ee-6c7076b80736 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:52.134244 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-fe818632-06c3-4207-82ee-6c7076b80736 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.236551 Aug 09 18:41:52.134825 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4441/7492] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:51 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:41:52.593130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-b77597af-56e5-464c-bfa5-a7f80d303084 req-f0010dd3-d391-41df-82b0-2b59754f770f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f185593-47f5-4e7a-a1f4-f381020b78a4", "tag": "394de0ce-adeb-46c0-8121-ce9e0fb9952a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:41:52.604468 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b77597af-56e5-464c-bfa5-a7f80d303084 req-f0010dd3-d391-41df-82b0-2b59754f770f service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:52.604962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b77597af-56e5-464c-bfa5-a7f80d303084 req-f0010dd3-d391-41df-82b0-2b59754f770f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:52.605471 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-b77597af-56e5-464c-bfa5-a7f80d303084 req-f0010dd3-d391-41df-82b0-2b59754f770f service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:52.616956 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-b77597af-56e5-464c-bfa5-a7f80d303084 req-f0010dd3-d391-41df-82b0-2b59754f770f service nova] Creating event network-changed:394de0ce-adeb-46c0-8121-ce9e0fb9952a for instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 on n-h2-845781-6 Aug 09 18:41:52.622302 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-b77597af-56e5-464c-bfa5-a7f80d303084 req-f0010dd3-d391-41df-82b0-2b59754f770f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034476 Aug 09 18:41:52.623097 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4442/7493] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:41:53.156194 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5a973945-8709-40db-8559-775f4c1b9676 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:53.156911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5a973945-8709-40db-8559-775f4c1b9676 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:53.163184 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a973945-8709-40db-8559-775f4c1b9676 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:53.163703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a973945-8709-40db-8559-775f4c1b9676 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:53.164148 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a973945-8709-40db-8559-775f4c1b9676 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:53.164845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a973945-8709-40db-8559-775f4c1b9676 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:53.165303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a973945-8709-40db-8559-775f4c1b9676 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:53.165736 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5a973945-8709-40db-8559-775f4c1b9676 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:53.297236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5a973945-8709-40db-8559-775f4c1b9676 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:53.305355 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5a973945-8709-40db-8559-775f4c1b9676 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.154586 Aug 09 18:41:53.305943 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4443/7494] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:53 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:54.326870 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-20e4e479-4505-4a72-9672-0382c803bcfa tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:54.327555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-20e4e479-4505-4a72-9672-0382c803bcfa tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:54.335084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20e4e479-4505-4a72-9672-0382c803bcfa tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:54.335571 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20e4e479-4505-4a72-9672-0382c803bcfa tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:54.336329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20e4e479-4505-4a72-9672-0382c803bcfa tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:54.336975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20e4e479-4505-4a72-9672-0382c803bcfa tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:54.337436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20e4e479-4505-4a72-9672-0382c803bcfa tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:54.337891 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-20e4e479-4505-4a72-9672-0382c803bcfa tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:54.474606 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-20e4e479-4505-4a72-9672-0382c803bcfa tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:54.482237 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-20e4e479-4505-4a72-9672-0382c803bcfa tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.159409 Aug 09 18:41:54.482817 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4444/7495] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:54 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:55.503751 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9353fe75-4741-4bb3-9de6-f9576aef6e27 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:55.504437 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9353fe75-4741-4bb3-9de6-f9576aef6e27 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:55.511211 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9353fe75-4741-4bb3-9de6-f9576aef6e27 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:55.511728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9353fe75-4741-4bb3-9de6-f9576aef6e27 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:55.512168 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9353fe75-4741-4bb3-9de6-f9576aef6e27 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:55.512861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9353fe75-4741-4bb3-9de6-f9576aef6e27 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:55.513317 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9353fe75-4741-4bb3-9de6-f9576aef6e27 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:55.513752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9353fe75-4741-4bb3-9de6-f9576aef6e27 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:55.651082 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-9353fe75-4741-4bb3-9de6-f9576aef6e27 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:55.659506 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9353fe75-4741-4bb3-9de6-f9576aef6e27 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.159746 Aug 09 18:41:55.660117 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4445/7496] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:55 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:56.681857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c667b27c-e3a8-4edc-9ffd-43156cf139d0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:56.682555 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c667b27c-e3a8-4edc-9ffd-43156cf139d0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:56.689763 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c667b27c-e3a8-4edc-9ffd-43156cf139d0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:56.690236 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c667b27c-e3a8-4edc-9ffd-43156cf139d0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:56.690703 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c667b27c-e3a8-4edc-9ffd-43156cf139d0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:56.691417 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c667b27c-e3a8-4edc-9ffd-43156cf139d0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:56.691901 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c667b27c-e3a8-4edc-9ffd-43156cf139d0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:56.692328 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c667b27c-e3a8-4edc-9ffd-43156cf139d0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:56.827754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c667b27c-e3a8-4edc-9ffd-43156cf139d0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:56.835917 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c667b27c-e3a8-4edc-9ffd-43156cf139d0 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.158144 Aug 09 18:41:56.836747 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4446/7497] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:56 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:57.857903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-ce165b06-6b9e-4156-b33c-1e5b38abc276 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:57.858584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-ce165b06-6b9e-4156-b33c-1e5b38abc276 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:57.866137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce165b06-6b9e-4156-b33c-1e5b38abc276 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:57.866626 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce165b06-6b9e-4156-b33c-1e5b38abc276 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:57.867066 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce165b06-6b9e-4156-b33c-1e5b38abc276 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:57.867808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce165b06-6b9e-4156-b33c-1e5b38abc276 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:57.868271 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce165b06-6b9e-4156-b33c-1e5b38abc276 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:57.868702 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-ce165b06-6b9e-4156-b33c-1e5b38abc276 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:58.006965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-ce165b06-6b9e-4156-b33c-1e5b38abc276 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:58.014644 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-ce165b06-6b9e-4156-b33c-1e5b38abc276 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.160773 Aug 09 18:41:58.015223 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4447/7498] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:57 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:41:59.035046 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e80ca7c7-17b2-4f1c-9ed7-fa927ea8bff5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:41:59.035771 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e80ca7c7-17b2-4f1c-9ed7-fa927ea8bff5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:41:59.042481 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e80ca7c7-17b2-4f1c-9ed7-fa927ea8bff5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:59.042964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e80ca7c7-17b2-4f1c-9ed7-fa927ea8bff5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:59.043455 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e80ca7c7-17b2-4f1c-9ed7-fa927ea8bff5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:59.044126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e80ca7c7-17b2-4f1c-9ed7-fa927ea8bff5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:41:59.044578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e80ca7c7-17b2-4f1c-9ed7-fa927ea8bff5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:41:59.045008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e80ca7c7-17b2-4f1c-9ed7-fa927ea8bff5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:41:59.173623 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e80ca7c7-17b2-4f1c-9ed7-fa927ea8bff5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:41:59.181721 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e80ca7c7-17b2-4f1c-9ed7-fa927ea8bff5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.150583 Aug 09 18:41:59.182291 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4448/7499] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:41:59 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:42:00.203949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1b65872-7ed8-4f56-bb19-d2d92c2688a5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:00.204685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d1b65872-7ed8-4f56-bb19-d2d92c2688a5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:42:00.208257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:42:00.214553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1b65872-7ed8-4f56-bb19-d2d92c2688a5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:00.215163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1b65872-7ed8-4f56-bb19-d2d92c2688a5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:00.215609 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1b65872-7ed8-4f56-bb19-d2d92c2688a5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:00.216375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1b65872-7ed8-4f56-bb19-d2d92c2688a5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:00.216834 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1b65872-7ed8-4f56-bb19-d2d92c2688a5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:00.217269 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1b65872-7ed8-4f56-bb19-d2d92c2688a5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:00.356392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d1b65872-7ed8-4f56-bb19-d2d92c2688a5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:42:00.364068 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1b65872-7ed8-4f56-bb19-d2d92c2688a5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.164092 Aug 09 18:42:00.364649 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4449/7500] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:42:00 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:42:01.385590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8d654870-48f7-4ba0-93df-585e39117c89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:01.386265 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8d654870-48f7-4ba0-93df-585e39117c89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:42:01.393666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d654870-48f7-4ba0-93df-585e39117c89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:01.394151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d654870-48f7-4ba0-93df-585e39117c89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:01.394585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d654870-48f7-4ba0-93df-585e39117c89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:01.395289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d654870-48f7-4ba0-93df-585e39117c89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:01.396334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d654870-48f7-4ba0-93df-585e39117c89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:01.396334 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8d654870-48f7-4ba0-93df-585e39117c89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:01.415414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:42:01.529330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8d654870-48f7-4ba0-93df-585e39117c89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:42:01.537885 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8d654870-48f7-4ba0-93df-585e39117c89 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.156285 Aug 09 18:42:01.538472 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4450/7501] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:42:01 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:42:02.558368 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-77e0b9ca-c30e-48b2-94d0-80fa1ff55ae4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:02.559041 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-77e0b9ca-c30e-48b2-94d0-80fa1ff55ae4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:42:02.565707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77e0b9ca-c30e-48b2-94d0-80fa1ff55ae4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:02.566247 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77e0b9ca-c30e-48b2-94d0-80fa1ff55ae4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:02.566696 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77e0b9ca-c30e-48b2-94d0-80fa1ff55ae4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:02.567538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77e0b9ca-c30e-48b2-94d0-80fa1ff55ae4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:02.568096 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77e0b9ca-c30e-48b2-94d0-80fa1ff55ae4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:02.568638 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-77e0b9ca-c30e-48b2-94d0-80fa1ff55ae4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:02.712518 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-77e0b9ca-c30e-48b2-94d0-80fa1ff55ae4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:42:02.720196 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-77e0b9ca-c30e-48b2-94d0-80fa1ff55ae4 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.165666 Aug 09 18:42:02.721313 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4451/7502] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:42:02 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:42:03.741941 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-53d08b86-e34d-4239-82db-2eec04b113e5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:03.742633 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-53d08b86-e34d-4239-82db-2eec04b113e5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:42:03.749380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53d08b86-e34d-4239-82db-2eec04b113e5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:03.749852 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53d08b86-e34d-4239-82db-2eec04b113e5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:03.750285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53d08b86-e34d-4239-82db-2eec04b113e5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:03.750970 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53d08b86-e34d-4239-82db-2eec04b113e5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:03.751416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53d08b86-e34d-4239-82db-2eec04b113e5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:03.752618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-53d08b86-e34d-4239-82db-2eec04b113e5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:03.893864 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-53d08b86-e34d-4239-82db-2eec04b113e5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:42:03.903281 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-53d08b86-e34d-4239-82db-2eec04b113e5 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.165126 Aug 09 18:42:03.903923 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4452/7503] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:42:03 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:42:04.034178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-11622cf4-ebcd-4249-aa6f-8416a52c5ed1 req-47f0dc5c-2e8f-419d-942b-56ce3e9cd6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f185593-47f5-4e7a-a1f4-f381020b78a4", "name": "network-vif-plugged", "status": "completed", "tag": "394de0ce-adeb-46c0-8121-ce9e0fb9952a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:42:04.043908 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-11622cf4-ebcd-4249-aa6f-8416a52c5ed1 req-47f0dc5c-2e8f-419d-942b-56ce3e9cd6a9 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:04.044405 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-11622cf4-ebcd-4249-aa6f-8416a52c5ed1 req-47f0dc5c-2e8f-419d-942b-56ce3e9cd6a9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:04.044848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-11622cf4-ebcd-4249-aa6f-8416a52c5ed1 req-47f0dc5c-2e8f-419d-942b-56ce3e9cd6a9 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:04.057101 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-11622cf4-ebcd-4249-aa6f-8416a52c5ed1 req-47f0dc5c-2e8f-419d-942b-56ce3e9cd6a9 service nova] Creating event network-vif-plugged:394de0ce-adeb-46c0-8121-ce9e0fb9952a for instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 on n-h2-845781-6 Aug 09 18:42:04.062139 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-11622cf4-ebcd-4249-aa6f-8416a52c5ed1 req-47f0dc5c-2e8f-419d-942b-56ce3e9cd6a9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083668 Aug 09 18:42:04.062744 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4453/7504] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:42:04.926553 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-093bc1c5-54cb-44a6-8309-f9fb6401620d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:04.927266 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-093bc1c5-54cb-44a6-8309-f9fb6401620d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:42:04.933579 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-093bc1c5-54cb-44a6-8309-f9fb6401620d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:04.934069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-093bc1c5-54cb-44a6-8309-f9fb6401620d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:04.934524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-093bc1c5-54cb-44a6-8309-f9fb6401620d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:04.935213 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-093bc1c5-54cb-44a6-8309-f9fb6401620d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:04.935699 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-093bc1c5-54cb-44a6-8309-f9fb6401620d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:04.936137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-093bc1c5-54cb-44a6-8309-f9fb6401620d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:05.076232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-093bc1c5-54cb-44a6-8309-f9fb6401620d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:42:05.084042 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-093bc1c5-54cb-44a6-8309-f9fb6401620d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1576 microversion: 2.1 time: 0.163025 Aug 09 18:42:05.084621 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4454/7505] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:42:04 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:42:06.105717 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3ef2f872-0d06-4cc3-956f-6910842626b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:42:06.106349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3ef2f872-0d06-4cc3-956f-6910842626b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:42:06.113715 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef2f872-0d06-4cc3-956f-6910842626b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:06.114243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef2f872-0d06-4cc3-956f-6910842626b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:06.114683 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef2f872-0d06-4cc3-956f-6910842626b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:06.115380 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef2f872-0d06-4cc3-956f-6910842626b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:42:06.115873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef2f872-0d06-4cc3-956f-6910842626b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:42:06.116307 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3ef2f872-0d06-4cc3-956f-6910842626b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:42:06.248677 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3ef2f872-0d06-4cc3-956f-6910842626b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:42:06.256232 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3ef2f872-0d06-4cc3-956f-6910842626b7 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1563 microversion: 2.1 time: 0.154505 Aug 09 18:42:06.256828 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4455/7506] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:42:06 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:20.138441 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=13 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:20.139202 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=28 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:20.143326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-90346d8a-fefa-4b7c-8942-4aa488b9585e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:20.143904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-90346d8a-fefa-4b7c-8942-4aa488b9585e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:20.150750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90346d8a-fefa-4b7c-8942-4aa488b9585e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:20.151241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90346d8a-fefa-4b7c-8942-4aa488b9585e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:20.151915 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90346d8a-fefa-4b7c-8942-4aa488b9585e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:20.152632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90346d8a-fefa-4b7c-8942-4aa488b9585e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:20.153095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90346d8a-fefa-4b7c-8942-4aa488b9585e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:20.153535 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-90346d8a-fefa-4b7c-8942-4aa488b9585e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:20.179432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-90346d8a-fefa-4b7c-8942-4aa488b9585e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:43:20.265338 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-90346d8a-fefa-4b7c-8942-4aa488b9585e tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 204 len: 0 microversion: 2.1 time: 0.129526 Aug 09 18:43:20.266372 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4456/7507] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:43:20 2022] DELETE /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 18:43:20.274613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-83458c5f-1654-4792-8f97-307eb988ce7d req-b3b2f25a-208c-473a-b7d4-bc53ac835812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f185593-47f5-4e7a-a1f4-f381020b78a4", "tag": "394de0ce-adeb-46c0-8121-ce9e0fb9952a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:43:20.284161 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-83458c5f-1654-4792-8f97-307eb988ce7d req-b3b2f25a-208c-473a-b7d4-bc53ac835812 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:20.284653 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-83458c5f-1654-4792-8f97-307eb988ce7d req-b3b2f25a-208c-473a-b7d4-bc53ac835812 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:20.285142 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-83458c5f-1654-4792-8f97-307eb988ce7d req-b3b2f25a-208c-473a-b7d4-bc53ac835812 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:20.297047 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-83458c5f-1654-4792-8f97-307eb988ce7d req-b3b2f25a-208c-473a-b7d4-bc53ac835812 service nova] Creating event network-changed:394de0ce-adeb-46c0-8121-ce9e0fb9952a for instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 on n-h2-845781-6 Aug 09 18:43:20.302195 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-83458c5f-1654-4792-8f97-307eb988ce7d req-b3b2f25a-208c-473a-b7d4-bc53ac835812 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031548 Aug 09 18:43:20.302815 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4457/7508] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:43:20.308803 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-82d87a72-67fd-4bc3-9b5a-93715cbabac3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:20.309512 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-82d87a72-67fd-4bc3-9b5a-93715cbabac3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:20.315855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d87a72-67fd-4bc3-9b5a-93715cbabac3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:20.316349 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d87a72-67fd-4bc3-9b5a-93715cbabac3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:20.316787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d87a72-67fd-4bc3-9b5a-93715cbabac3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:20.317491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d87a72-67fd-4bc3-9b5a-93715cbabac3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:20.317949 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d87a72-67fd-4bc3-9b5a-93715cbabac3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:20.318394 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-82d87a72-67fd-4bc3-9b5a-93715cbabac3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:20.469473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-82d87a72-67fd-4bc3-9b5a-93715cbabac3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:20.477310 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-82d87a72-67fd-4bc3-9b5a-93715cbabac3 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.173282 Aug 09 18:43:20.477898 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4458/7509] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:20 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:43:21.499058 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c60943a6-c4a7-4da7-bcea-d335fae5f775 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:21.499742 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c60943a6-c4a7-4da7-bcea-d335fae5f775 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:21.506676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c60943a6-c4a7-4da7-bcea-d335fae5f775 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:21.507163 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c60943a6-c4a7-4da7-bcea-d335fae5f775 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:21.507604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c60943a6-c4a7-4da7-bcea-d335fae5f775 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:21.508323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c60943a6-c4a7-4da7-bcea-d335fae5f775 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:21.508778 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c60943a6-c4a7-4da7-bcea-d335fae5f775 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:21.509204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c60943a6-c4a7-4da7-bcea-d335fae5f775 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:21.653221 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-c60943a6-c4a7-4da7-bcea-d335fae5f775 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:21.660900 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c60943a6-c4a7-4da7-bcea-d335fae5f775 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1569 microversion: 2.1 time: 0.165782 Aug 09 18:43:21.661478 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4459/7510] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:21 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:43:22.316356 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-23557a27-e08e-49bd-bd01-d72c969efac9 req-d1b7969a-c674-49a5-8e7e-d6b9b98009e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f185593-47f5-4e7a-a1f4-f381020b78a4", "name": "network-vif-deleted", "tag": "394de0ce-adeb-46c0-8121-ce9e0fb9952a"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:43:22.326591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-23557a27-e08e-49bd-bd01-d72c969efac9 req-d1b7969a-c674-49a5-8e7e-d6b9b98009e0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:22.327073 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-23557a27-e08e-49bd-bd01-d72c969efac9 req-d1b7969a-c674-49a5-8e7e-d6b9b98009e0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:22.327505 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-23557a27-e08e-49bd-bd01-d72c969efac9 req-d1b7969a-c674-49a5-8e7e-d6b9b98009e0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:22.339093 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-23557a27-e08e-49bd-bd01-d72c969efac9 req-d1b7969a-c674-49a5-8e7e-d6b9b98009e0 service nova] Creating event network-vif-deleted:394de0ce-adeb-46c0-8121-ce9e0fb9952a for instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 on n-h2-845781-6 Aug 09 18:43:22.344207 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-23557a27-e08e-49bd-bd01-d72c969efac9 req-d1b7969a-c674-49a5-8e7e-d6b9b98009e0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109481 Aug 09 18:43:22.345478 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4460/7511] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:43:22.684375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5d944e16-3129-4a65-a6f9-e9f57a1f70bd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:22.685109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-5d944e16-3129-4a65-a6f9-e9f57a1f70bd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:22.691567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d944e16-3129-4a65-a6f9-e9f57a1f70bd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:22.692084 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d944e16-3129-4a65-a6f9-e9f57a1f70bd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:22.692531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d944e16-3129-4a65-a6f9-e9f57a1f70bd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:22.693243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d944e16-3129-4a65-a6f9-e9f57a1f70bd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:22.693718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d944e16-3129-4a65-a6f9-e9f57a1f70bd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:22.694144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-5d944e16-3129-4a65-a6f9-e9f57a1f70bd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:22.759289 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-5d944e16-3129-4a65-a6f9-e9f57a1f70bd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:22.768579 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5d944e16-3129-4a65-a6f9-e9f57a1f70bd tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1220 microversion: 2.1 time: 0.089781 Aug 09 18:43:22.769683 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4461/7512] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:22 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:23.790015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8494c10d-92f8-4448-a914-851daf116364 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:23.790704 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8494c10d-92f8-4448-a914-851daf116364 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:23.798561 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8494c10d-92f8-4448-a914-851daf116364 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:23.799060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8494c10d-92f8-4448-a914-851daf116364 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:23.799509 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8494c10d-92f8-4448-a914-851daf116364 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:23.800267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8494c10d-92f8-4448-a914-851daf116364 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:23.800738 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8494c10d-92f8-4448-a914-851daf116364 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:23.801177 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8494c10d-92f8-4448-a914-851daf116364 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:23.870364 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8494c10d-92f8-4448-a914-851daf116364 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:23.878324 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8494c10d-92f8-4448-a914-851daf116364 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1220 microversion: 2.1 time: 0.092279 Aug 09 18:43:23.878916 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4462/7513] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:23 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:24.902029 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6d377d7c-f003-412f-a632-19a79574340d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:24.902680 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6d377d7c-f003-412f-a632-19a79574340d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:24.909750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d377d7c-f003-412f-a632-19a79574340d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:24.910238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d377d7c-f003-412f-a632-19a79574340d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:24.910676 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d377d7c-f003-412f-a632-19a79574340d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:24.911382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d377d7c-f003-412f-a632-19a79574340d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:24.911878 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d377d7c-f003-412f-a632-19a79574340d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:24.912306 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6d377d7c-f003-412f-a632-19a79574340d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:24.974416 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6d377d7c-f003-412f-a632-19a79574340d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:24.982170 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6d377d7c-f003-412f-a632-19a79574340d tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1220 microversion: 2.1 time: 0.087279 Aug 09 18:43:24.982742 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4463/7514] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:24 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:26.002591 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-809c50be-220d-4a5b-a92a-c444c2991c19 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:26.003235 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-809c50be-220d-4a5b-a92a-c444c2991c19 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:26.010285 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-809c50be-220d-4a5b-a92a-c444c2991c19 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:26.011353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-809c50be-220d-4a5b-a92a-c444c2991c19 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:26.011832 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-809c50be-220d-4a5b-a92a-c444c2991c19 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:26.012540 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-809c50be-220d-4a5b-a92a-c444c2991c19 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:26.012999 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-809c50be-220d-4a5b-a92a-c444c2991c19 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:26.013434 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-809c50be-220d-4a5b-a92a-c444c2991c19 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:26.075890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-809c50be-220d-4a5b-a92a-c444c2991c19 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe62e36a76b4d929225bea32b97c3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19db25916ce54b5cb76dd46d757321b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:26.083869 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-809c50be-220d-4a5b-a92a-c444c2991c19 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 200 len: 1220 microversion: 2.1 time: 0.085272 Aug 09 18:43:26.084460 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4464/7515] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:25 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:27.105475 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:27.106151 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] [instance: 7f185593-47f5-4e7a-a1f4-f381020b78a4] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:27.113100 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:27.113588 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:27.114032 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:27.114726 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:27.115179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:27.115603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:27.132694 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] HTTP exception thrown: Instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 could not be found. Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Request method failure captured: Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 HTTP/1.1 Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qi0c9K5oaaypD-2edJIh7YJIsvSkIXsBSynvXzBN8D4KosIKZbVT8aDc38hqHHasc2fXkP2Hn7ayE2M1TobymmWxfHADLkxanVNPLgFGluOs7HdifXFI5QfMNblXi-UTcANFTXyAavXscUiZ3ZdVi_uPzk03TY-BvUbs0Mx73olBKs Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 19db25916ce54b5cb76dd46d757321b6 Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestShelveInstance-1729929244 Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_19db25916ce54b5cb76dd46d757321b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/19db25916ce54b5cb76dd46d757321b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/19db25916ce54b5cb76dd46d757321b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/19db25916ce54b5cb76dd46d757321b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestShelveInstance-1729929244 Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 19db25916ce54b5cb76dd46d757321b6 Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestShelveInstance-1729929244 Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestShelveInstance-1729929244-project Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: fbe62e36a76b4d929225bea32b97c3f9 Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestShelveInstance-1729929244-project Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 could not be found. Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': '7f185593-47f5-4e7a-a1f4-f381020b78a4'} Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 could not be found. Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 could not be found. Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:43:27.134375 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:43:27.139473 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:43:27.139473 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:43:27.139473 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:43:27.139473 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:43:27.139473 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:43:27.139473 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 could not be found. Aug 09 18:43:27.139473 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:43:27.139473 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Returning 404 to user: Instance 7f185593-47f5-4e7a-a1f4-f381020b78a4 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:43:27.139473 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1c47105-8343-4cd6-9442-998fbe0547df tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4" status: 404 len: 111 microversion: 2.1 time: 0.034833 Aug 09 18:43:27.139473 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4465/7516] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:27 2022] GET /compute/v2.1/servers/7f185593-47f5-4e7a-a1f4-f381020b78a4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:43:27.314049 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f365d727-c97e-4319-b2b0-5ec1f11607e2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] Calling method '.version_select at 0x7fbbca6a3940>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:27.340638 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f365d727-c97e-4319-b2b0-5ec1f11607e2 tempest-TestShelveInstance-1729929244 tempest-TestShelveInstance-1729929244-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1049338098" status: 202 len: 0 microversion: 2.1 time: 0.030520 Aug 09 18:43:27.341236 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4466/7517] 10.222.0.93 () {58 vars in 1254 bytes} [Tue Aug 9 18:43:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1049338098 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 18:43:45.075339 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:45.076757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:45.301420 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bd5eef92-4589-4b51-ab7d-fc8b5b0abca7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Action: 'create', calling method: .version_select at 0x7fbbcbc2d280>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-385240132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbDUNC+WrsJgXi0hL+lc+sNGv8u5CDxNtpUlubeiYzINShkVcf01lsMQZn9jGMdHcLJjTRaRtXlES1I+cwMq1+fmngJnxSAA2Kx0uw4JkfKy03YA4lIyTG8xawE6Z5PGA=="}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:43:45.319259 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-bd5eef92-4589-4b51-ab7d-fc8b5b0abca7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Getting quotas for project 7e3b51fd025f4130a778cb381e0aacb8. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:43:45.325585 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-bd5eef92-4589-4b51-ab7d-fc8b5b0abca7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Getting quotas for user 1418030380a144be9cf77da48e4261d6 and project 7e3b51fd025f4130a778cb381e0aacb8. Resources: {'key_pairs'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:43:45.354035 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bd5eef92-4589-4b51-ab7d-fc8b5b0abca7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.280610 Aug 09 18:43:45.355670 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4467/7518] 10.222.0.93 () {60 vars in 1159 bytes} [Tue Aug 9 18:43:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:43:46.355006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-473319365", "imageRef": "f484be58-00e8-4507-b378-ca7d3c0dd32d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-385240132", "security_groups": [{"name": "tempest-secgroup-smoke-898237845"}], "networks": [{"uuid": "f3202ecc-3452-46bd-84d9-6502d5b7e24f"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:43:46.468830 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] validate_networks() for [('f3202ecc-3452-46bd-84d9-6502d5b7e24f', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:43:46.974076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:43:46.974531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:43:46.975027 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:43:46.975657 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:43:46.976078 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:43:46.985051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:46.985532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:46.985969 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:46.986692 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:46.987150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:46.987573 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:47.005461 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Getting quotas for project 7e3b51fd025f4130a778cb381e0aacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:43:47.011582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Getting quotas for user 1418030380a144be9cf77da48e4261d6 and project 7e3b51fd025f4130a778cb381e0aacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:43:47.024206 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:43:47.026531 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f484be58-00e8-4507-b378-ca7d3c0dd32d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:43:47.074247 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f8eeba7c-0daf-44bf-89a8-b4cc7ce0fd3c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.724215 Aug 09 18:43:47.075212 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4468/7519] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:43:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 18:43:47.085903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-96e858b4-099c-464e-b664-e9822a1cdfa0 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:47.087071 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-96e858b4-099c-464e-b664-e9822a1cdfa0 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:47.148472 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-96e858b4-099c-464e-b664-e9822a1cdfa0 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:47.157291 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-96e858b4-099c-464e-b664-e9822a1cdfa0 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1247 microversion: 2.1 time: 0.075174 Aug 09 18:43:47.171090 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4469/7520] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:47 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:48.178403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e6989f04-75a0-4f57-95d3-32c9d51af899 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:48.179034 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e6989f04-75a0-4f57-95d3-32c9d51af899 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:48.187230 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6989f04-75a0-4f57-95d3-32c9d51af899 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:48.188325 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6989f04-75a0-4f57-95d3-32c9d51af899 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:48.188956 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6989f04-75a0-4f57-95d3-32c9d51af899 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:48.189863 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6989f04-75a0-4f57-95d3-32c9d51af899 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:48.190491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6989f04-75a0-4f57-95d3-32c9d51af899 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:48.191088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e6989f04-75a0-4f57-95d3-32c9d51af899 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:48.403525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e6989f04-75a0-4f57-95d3-32c9d51af899 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:48.411804 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e6989f04-75a0-4f57-95d3-32c9d51af899 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1299 microversion: 2.1 time: 0.237178 Aug 09 18:43:48.420184 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4470/7521] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:48 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1299 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:49.442180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4d1cf65b-a903-4521-9bb9-ee92f947cd9b tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:49.444106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4d1cf65b-a903-4521-9bb9-ee92f947cd9b tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:49.451376 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d1cf65b-a903-4521-9bb9-ee92f947cd9b tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:49.451903 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d1cf65b-a903-4521-9bb9-ee92f947cd9b tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:49.452352 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d1cf65b-a903-4521-9bb9-ee92f947cd9b tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:49.453075 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d1cf65b-a903-4521-9bb9-ee92f947cd9b tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:49.453539 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d1cf65b-a903-4521-9bb9-ee92f947cd9b tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:49.453977 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4d1cf65b-a903-4521-9bb9-ee92f947cd9b tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:49.608291 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-4d1cf65b-a903-4521-9bb9-ee92f947cd9b tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:49.616840 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4d1cf65b-a903-4521-9bb9-ee92f947cd9b tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1372 microversion: 2.1 time: 0.180066 Aug 09 18:43:49.617444 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4471/7522] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:49 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:50.110746 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e1bb8743-0b5c-422b-9efa-e81cff9e9747 req-12e3e83f-e36d-4ecf-8ff2-ec1e47b953de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afaa2e83-e1bf-4668-8b9b-69b891234180", "tag": "e38df482-678d-4fed-a816-89cbdf219001"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:43:50.121761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e1bb8743-0b5c-422b-9efa-e81cff9e9747 req-12e3e83f-e36d-4ecf-8ff2-ec1e47b953de service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:50.122182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e1bb8743-0b5c-422b-9efa-e81cff9e9747 req-12e3e83f-e36d-4ecf-8ff2-ec1e47b953de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:50.122621 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e1bb8743-0b5c-422b-9efa-e81cff9e9747 req-12e3e83f-e36d-4ecf-8ff2-ec1e47b953de service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:50.134770 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e1bb8743-0b5c-422b-9efa-e81cff9e9747 req-12e3e83f-e36d-4ecf-8ff2-ec1e47b953de service nova] Creating event network-changed:e38df482-678d-4fed-a816-89cbdf219001 for instance afaa2e83-e1bf-4668-8b9b-69b891234180 on n-h1-845781-6 Aug 09 18:43:50.140596 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e1bb8743-0b5c-422b-9efa-e81cff9e9747 req-12e3e83f-e36d-4ecf-8ff2-ec1e47b953de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033657 Aug 09 18:43:50.141215 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4472/7523] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:43:50.640178 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3be8a4f5-a429-4105-9f67-bdc7e79c4bfc tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:50.640819 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3be8a4f5-a429-4105-9f67-bdc7e79c4bfc tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:50.647167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be8a4f5-a429-4105-9f67-bdc7e79c4bfc tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:50.647693 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be8a4f5-a429-4105-9f67-bdc7e79c4bfc tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:50.648141 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be8a4f5-a429-4105-9f67-bdc7e79c4bfc tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:50.648861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be8a4f5-a429-4105-9f67-bdc7e79c4bfc tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:50.649401 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be8a4f5-a429-4105-9f67-bdc7e79c4bfc tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:50.649911 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3be8a4f5-a429-4105-9f67-bdc7e79c4bfc tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:50.790002 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3be8a4f5-a429-4105-9f67-bdc7e79c4bfc tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:50.798458 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3be8a4f5-a429-4105-9f67-bdc7e79c4bfc tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1372 microversion: 2.1 time: 0.163744 Aug 09 18:43:50.799045 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4473/7524] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:50 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:51.818513 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-bc14ad7a-16bf-4689-81a5-5ac6f614b307 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:51.819127 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-bc14ad7a-16bf-4689-81a5-5ac6f614b307 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:51.825980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc14ad7a-16bf-4689-81a5-5ac6f614b307 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:51.826467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc14ad7a-16bf-4689-81a5-5ac6f614b307 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:51.826904 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc14ad7a-16bf-4689-81a5-5ac6f614b307 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:51.827602 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc14ad7a-16bf-4689-81a5-5ac6f614b307 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:51.828080 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc14ad7a-16bf-4689-81a5-5ac6f614b307 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:51.828511 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-bc14ad7a-16bf-4689-81a5-5ac6f614b307 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:51.970315 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-bc14ad7a-16bf-4689-81a5-5ac6f614b307 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:51.978192 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-bc14ad7a-16bf-4689-81a5-5ac6f614b307 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1372 microversion: 2.1 time: 0.163684 Aug 09 18:43:51.979282 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4474/7525] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:51 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:53.003734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-56451199-8d7e-4d12-a19f-94d35b0d3dd2 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:53.004415 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-56451199-8d7e-4d12-a19f-94d35b0d3dd2 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:53.011874 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56451199-8d7e-4d12-a19f-94d35b0d3dd2 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:53.012366 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56451199-8d7e-4d12-a19f-94d35b0d3dd2 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:53.012808 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56451199-8d7e-4d12-a19f-94d35b0d3dd2 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:53.013503 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56451199-8d7e-4d12-a19f-94d35b0d3dd2 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:53.013964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56451199-8d7e-4d12-a19f-94d35b0d3dd2 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:53.014395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-56451199-8d7e-4d12-a19f-94d35b0d3dd2 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:53.146761 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-56451199-8d7e-4d12-a19f-94d35b0d3dd2 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:53.154457 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-56451199-8d7e-4d12-a19f-94d35b0d3dd2 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1372 microversion: 2.1 time: 0.154644 Aug 09 18:43:53.155041 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4475/7526] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:52 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:54.175580 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7cf0c41a-0878-476b-ab06-eff8ad752250 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:54.176241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7cf0c41a-0878-476b-ab06-eff8ad752250 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:54.183600 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf0c41a-0878-476b-ab06-eff8ad752250 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:54.184122 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf0c41a-0878-476b-ab06-eff8ad752250 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:54.184558 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf0c41a-0878-476b-ab06-eff8ad752250 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:54.185257 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf0c41a-0878-476b-ab06-eff8ad752250 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:54.185714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf0c41a-0878-476b-ab06-eff8ad752250 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:54.186137 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7cf0c41a-0878-476b-ab06-eff8ad752250 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:54.318777 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7cf0c41a-0878-476b-ab06-eff8ad752250 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:54.326636 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7cf0c41a-0878-476b-ab06-eff8ad752250 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1372 microversion: 2.1 time: 0.154911 Aug 09 18:43:54.327249 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4476/7527] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:54 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:55.348128 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e71dae90-8a10-411a-9177-26ccff6033c6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:55.348813 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e71dae90-8a10-411a-9177-26ccff6033c6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:55.357074 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e71dae90-8a10-411a-9177-26ccff6033c6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:55.357564 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e71dae90-8a10-411a-9177-26ccff6033c6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:55.358010 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e71dae90-8a10-411a-9177-26ccff6033c6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:55.358711 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e71dae90-8a10-411a-9177-26ccff6033c6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:55.359176 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e71dae90-8a10-411a-9177-26ccff6033c6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:55.359612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e71dae90-8a10-411a-9177-26ccff6033c6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:55.496686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e71dae90-8a10-411a-9177-26ccff6033c6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:55.504332 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e71dae90-8a10-411a-9177-26ccff6033c6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1372 microversion: 2.1 time: 0.160181 Aug 09 18:43:55.504913 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4477/7528] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:55 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:55.979316 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-f8d10638-a272-4443-8c8c-396aaa2e5ba2 req-0f86a3ea-5dea-4ab1-878d-2f6d21b872e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afaa2e83-e1bf-4668-8b9b-69b891234180", "name": "network-vif-plugged", "status": "completed", "tag": "e38df482-678d-4fed-a816-89cbdf219001"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:43:55.988766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f8d10638-a272-4443-8c8c-396aaa2e5ba2 req-0f86a3ea-5dea-4ab1-878d-2f6d21b872e2 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:55.989251 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f8d10638-a272-4443-8c8c-396aaa2e5ba2 req-0f86a3ea-5dea-4ab1-878d-2f6d21b872e2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:55.989685 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-f8d10638-a272-4443-8c8c-396aaa2e5ba2 req-0f86a3ea-5dea-4ab1-878d-2f6d21b872e2 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:56.001842 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-f8d10638-a272-4443-8c8c-396aaa2e5ba2 req-0f86a3ea-5dea-4ab1-878d-2f6d21b872e2 service nova] Creating event network-vif-plugged:e38df482-678d-4fed-a816-89cbdf219001 for instance afaa2e83-e1bf-4668-8b9b-69b891234180 on n-h1-845781-6 Aug 09 18:43:56.006822 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-f8d10638-a272-4443-8c8c-396aaa2e5ba2 req-0f86a3ea-5dea-4ab1-878d-2f6d21b872e2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031275 Aug 09 18:43:56.007508 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4478/7529] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:43:56.527165 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-e293d4f3-d7cd-4c9a-b5d0-ec07350171d6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:56.527937 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-e293d4f3-d7cd-4c9a-b5d0-ec07350171d6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:56.534157 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e293d4f3-d7cd-4c9a-b5d0-ec07350171d6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:56.534645 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e293d4f3-d7cd-4c9a-b5d0-ec07350171d6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:56.535102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e293d4f3-d7cd-4c9a-b5d0-ec07350171d6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:56.535954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e293d4f3-d7cd-4c9a-b5d0-ec07350171d6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:56.536421 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e293d4f3-d7cd-4c9a-b5d0-ec07350171d6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:56.536857 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-e293d4f3-d7cd-4c9a-b5d0-ec07350171d6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:56.671755 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-e293d4f3-d7cd-4c9a-b5d0-ec07350171d6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:56.679348 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-e293d4f3-d7cd-4c9a-b5d0-ec07350171d6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1372 microversion: 2.1 time: 0.157869 Aug 09 18:43:56.679971 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4479/7530] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:56 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:57.700276 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2641744e-b437-4652-b267-8c49b2406f37 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:57.700914 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2641744e-b437-4652-b267-8c49b2406f37 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:57.703150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:57.703993 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=12 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:43:57.710898 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2641744e-b437-4652-b267-8c49b2406f37 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:57.711393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2641744e-b437-4652-b267-8c49b2406f37 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:57.712109 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2641744e-b437-4652-b267-8c49b2406f37 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:57.712820 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2641744e-b437-4652-b267-8c49b2406f37 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:57.713267 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2641744e-b437-4652-b267-8c49b2406f37 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:57.713701 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2641744e-b437-4652-b267-8c49b2406f37 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:57.857295 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2641744e-b437-4652-b267-8c49b2406f37 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:57.865196 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2641744e-b437-4652-b267-8c49b2406f37 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1555 microversion: 2.1 time: 0.168831 Aug 09 18:43:57.865820 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4480/7531] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:57 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:57.885506 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-b96db12d-597b-4f0c-ac5c-787f0a4670e5 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:43:57.886130 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-b96db12d-597b-4f0c-ac5c-787f0a4670e5 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:43:57.892318 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b96db12d-597b-4f0c-ac5c-787f0a4670e5 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:57.892810 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b96db12d-597b-4f0c-ac5c-787f0a4670e5 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:57.893256 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b96db12d-597b-4f0c-ac5c-787f0a4670e5 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:57.893962 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b96db12d-597b-4f0c-ac5c-787f0a4670e5 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:57.894430 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b96db12d-597b-4f0c-ac5c-787f0a4670e5 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:57.894867 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-b96db12d-597b-4f0c-ac5c-787f0a4670e5 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:58.030964 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-b96db12d-597b-4f0c-ac5c-787f0a4670e5 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:43:58.038536 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-b96db12d-597b-4f0c-ac5c-787f0a4670e5 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1555 microversion: 2.1 time: 0.156842 Aug 09 18:43:58.039113 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4481/7532] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:43:57 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:43:59.761218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-0f1c8005-7d22-414d-8a31-29addeada18d req-7fd2613f-aa6e-4f24-85c3-00033a21b1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afaa2e83-e1bf-4668-8b9b-69b891234180", "tag": "e38df482-678d-4fed-a816-89cbdf219001"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:43:59.770822 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f1c8005-7d22-414d-8a31-29addeada18d req-7fd2613f-aa6e-4f24-85c3-00033a21b1a0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:43:59.771302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f1c8005-7d22-414d-8a31-29addeada18d req-7fd2613f-aa6e-4f24-85c3-00033a21b1a0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:43:59.772026 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-0f1c8005-7d22-414d-8a31-29addeada18d req-7fd2613f-aa6e-4f24-85c3-00033a21b1a0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:43:59.783461 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-0f1c8005-7d22-414d-8a31-29addeada18d req-7fd2613f-aa6e-4f24-85c3-00033a21b1a0 service nova] Creating event network-changed:e38df482-678d-4fed-a816-89cbdf219001 for instance afaa2e83-e1bf-4668-8b9b-69b891234180 on n-h1-845781-6 Aug 09 18:43:59.788575 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-0f1c8005-7d22-414d-8a31-29addeada18d req-7fd2613f-aa6e-4f24-85c3-00033a21b1a0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084636 Aug 09 18:43:59.789176 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4482/7533] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:45:57.241290 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0e0ed10f-39e6-43ca-a71e-0dc84cc0a1d8] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:45:57.242105 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [-] [59dc5572-757a-480c-957b-ef1cabe2d1a7] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:45:57.242842 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:45:57.244180 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=68 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:45:57.248933 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d2b8fd55-ae71-4347-9853-70c99cc860ea tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1230611623"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:45:57.251357 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d2b8fd55-ae71-4347-9853-70c99cc860ea tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:45:57.259688 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2b8fd55-ae71-4347-9853-70c99cc860ea tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:45:57.260193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2b8fd55-ae71-4347-9853-70c99cc860ea tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:45:57.260641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2b8fd55-ae71-4347-9853-70c99cc860ea tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:45:57.261344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2b8fd55-ae71-4347-9853-70c99cc860ea tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:45:57.261800 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2b8fd55-ae71-4347-9853-70c99cc860ea tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:45:57.262228 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d2b8fd55-ae71-4347-9853-70c99cc860ea tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:45:57.456542 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d2b8fd55-ae71-4347-9853-70c99cc860ea tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "POST /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180/action" status: 202 len: 0 microversion: 2.1 time: 0.217084 Aug 09 18:45:57.457204 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4483/7534] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:45:57 2022] POST /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 09 18:46:02.577855 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ad5c2947-224f-4f4a-b89f-de5e2d4ce074 req-6f0b12b8-591e-4b24-99c3-0784e5b4d732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afaa2e83-e1bf-4668-8b9b-69b891234180", "name": "network-vif-plugged", "status": "completed", "tag": "e38df482-678d-4fed-a816-89cbdf219001"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:46:02.615396 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ad5c2947-224f-4f4a-b89f-de5e2d4ce074 req-6f0b12b8-591e-4b24-99c3-0784e5b4d732 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:02.616390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ad5c2947-224f-4f4a-b89f-de5e2d4ce074 req-6f0b12b8-591e-4b24-99c3-0784e5b4d732 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:02.618895 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ad5c2947-224f-4f4a-b89f-de5e2d4ce074 req-6f0b12b8-591e-4b24-99c3-0784e5b4d732 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:02.636919 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ad5c2947-224f-4f4a-b89f-de5e2d4ce074 req-6f0b12b8-591e-4b24-99c3-0784e5b4d732 service nova] Creating event network-vif-plugged:e38df482-678d-4fed-a816-89cbdf219001 for instance afaa2e83-e1bf-4668-8b9b-69b891234180 on n-h1-845781-6 Aug 09 18:46:02.647888 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ad5c2947-224f-4f4a-b89f-de5e2d4ce074 req-6f0b12b8-591e-4b24-99c3-0784e5b4d732 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075398 Aug 09 18:46:02.649676 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4484/7535] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:46:11.144722 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1810664543", "imageRef": "c3d48e0d-cf32-4215-af30-43d4d6b18264", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-385240132", "security_groups": [{"name": "tempest-secgroup-smoke-898237845"}], "networks": [{"uuid": "f3202ecc-3452-46bd-84d9-6502d5b7e24f"}]}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:46:11.163833 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] [59dc5572-757a-480c-957b-ef1cabe2d1a7] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 42044. Aug 09 18:46:11.169067 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] [0e0ed10f-39e6-43ca-a71e-0dc84cc0a1d8] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 42042. Aug 09 18:46:11.295886 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.network.neutron [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] validate_networks() for [('f3202ecc-3452-46bd-84d9-6502d5b7e24f', None, None, None, None, None)] {{(pid=119431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 18:46:11.754942 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Flavor limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 18:46:11.756060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Image limits 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 18:46:11.756060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Flavor pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 18:46:11.756788 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Image pref 0:0:0 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 18:46:11.756955 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.virt.hardware [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 18:46:11.769926 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:11.770618 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:11.771060 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:11.771849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:11.772386 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:11.772818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:11.793997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Getting quotas for project 7e3b51fd025f4130a778cb381e0aacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 18:46:11.800789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.quota [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Getting quotas for user 1418030380a144be9cf77da48e4261d6 and project 7e3b51fd025f4130a778cb381e0aacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=119431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 18:46:11.817015 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Going to run 1 instances... {{(pid=119431) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 18:46:11.819547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c3d48e0d-cf32-4215-af30-43d4d6b18264',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 18:46:11.866773 n-d-845781-6 devstack@n-api.service[119431]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [6b3ec2f9-1042-4e8c-badc-96a0a986ec88] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 18:46:12.875240 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [6b3ec2f9-1042-4e8c-badc-96a0a986ec88] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 42124. Aug 09 18:46:12.882624 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-4f1158ed-c201-48e0-a5f0-18be9d21b875 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.753088 Aug 09 18:46:12.887702 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4485/7536] 10.222.0.93 () {60 vars in 1147 bytes} [Tue Aug 9 18:46:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 18:46:12.897133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-043da6cc-3eb6-4245-a1d3-d8bd270840ba tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:12.897801 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-043da6cc-3eb6-4245-a1d3-d8bd270840ba tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:12.964718 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-043da6cc-3eb6-4245-a1d3-d8bd270840ba tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:12.973571 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-043da6cc-3eb6-4245-a1d3-d8bd270840ba tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1248 microversion: 2.1 time: 0.081663 Aug 09 18:46:12.973571 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4486/7537] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:12 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:13.998290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-2517cdec-f8c9-4baf-b4c0-4f5993ad8bd1 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:13.999088 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-2517cdec-f8c9-4baf-b4c0-4f5993ad8bd1 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:14.007290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2517cdec-f8c9-4baf-b4c0-4f5993ad8bd1 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:14.007965 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2517cdec-f8c9-4baf-b4c0-4f5993ad8bd1 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:14.008402 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2517cdec-f8c9-4baf-b4c0-4f5993ad8bd1 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:14.010859 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2517cdec-f8c9-4baf-b4c0-4f5993ad8bd1 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:14.011862 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2517cdec-f8c9-4baf-b4c0-4f5993ad8bd1 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:14.012278 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-2517cdec-f8c9-4baf-b4c0-4f5993ad8bd1 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:14.100277 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-2517cdec-f8c9-4baf-b4c0-4f5993ad8bd1 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:14.110509 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-2517cdec-f8c9-4baf-b4c0-4f5993ad8bd1 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1308 microversion: 2.1 time: 0.116209 Aug 09 18:46:14.111833 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4487/7538] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:13 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:14.660714 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-40b36fd3-bd58-4730-ac1a-82e9e4e72c11 req-b51a60a7-9c4c-48dc-a242-bd8adb2706ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afaa2e83-e1bf-4668-8b9b-69b891234180", "name": "network-vif-unplugged", "status": "completed", "tag": "e38df482-678d-4fed-a816-89cbdf219001"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:46:14.685818 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-40b36fd3-bd58-4730-ac1a-82e9e4e72c11 req-b51a60a7-9c4c-48dc-a242-bd8adb2706ad service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:14.689641 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-40b36fd3-bd58-4730-ac1a-82e9e4e72c11 req-b51a60a7-9c4c-48dc-a242-bd8adb2706ad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:14.690382 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-40b36fd3-bd58-4730-ac1a-82e9e4e72c11 req-b51a60a7-9c4c-48dc-a242-bd8adb2706ad service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:14.723967 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-40b36fd3-bd58-4730-ac1a-82e9e4e72c11 req-b51a60a7-9c4c-48dc-a242-bd8adb2706ad service nova] Creating event network-vif-unplugged:e38df482-678d-4fed-a816-89cbdf219001 for instance afaa2e83-e1bf-4668-8b9b-69b891234180 on n-h1-845781-6 Aug 09 18:46:14.741165 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-40b36fd3-bd58-4730-ac1a-82e9e4e72c11 req-b51a60a7-9c4c-48dc-a242-bd8adb2706ad service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080810 Aug 09 18:46:14.751199 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4488/7539] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:46:15.139670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-261867db-caf2-4384-80bf-88548650371c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:15.141115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-261867db-caf2-4384-80bf-88548650371c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:15.156001 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261867db-caf2-4384-80bf-88548650371c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:15.157584 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261867db-caf2-4384-80bf-88548650371c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:15.159304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261867db-caf2-4384-80bf-88548650371c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:15.163182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261867db-caf2-4384-80bf-88548650371c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:15.170712 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261867db-caf2-4384-80bf-88548650371c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:15.174203 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-261867db-caf2-4384-80bf-88548650371c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:15.374393 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-261867db-caf2-4384-80bf-88548650371c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:15.385789 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-261867db-caf2-4384-80bf-88548650371c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1373 microversion: 2.1 time: 0.254299 Aug 09 18:46:15.386405 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4489/7540] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:15 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1373 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:16.424719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-31f27cdf-71be-45e6-b487-022cc71e2650 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:16.426990 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-31f27cdf-71be-45e6-b487-022cc71e2650 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:16.441179 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31f27cdf-71be-45e6-b487-022cc71e2650 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:16.442445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31f27cdf-71be-45e6-b487-022cc71e2650 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:16.443604 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31f27cdf-71be-45e6-b487-022cc71e2650 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:16.445395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31f27cdf-71be-45e6-b487-022cc71e2650 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:16.446557 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31f27cdf-71be-45e6-b487-022cc71e2650 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:16.448139 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-31f27cdf-71be-45e6-b487-022cc71e2650 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:16.714750 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-31f27cdf-71be-45e6-b487-022cc71e2650 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:16.731495 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-31f27cdf-71be-45e6-b487-022cc71e2650 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1373 microversion: 2.1 time: 0.312274 Aug 09 18:46:16.743367 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4490/7541] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:16 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1373 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:46:16.743367 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-1452f419-4d7f-4d1c-8e25-ec0eefc9e4f4 req-ef06a6aa-f7fe-4a56-8008-75f7a515a293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88", "tag": "bf2a5f24-786c-4cbf-89af-20a9a63b2dee"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:46:16.773747 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1452f419-4d7f-4d1c-8e25-ec0eefc9e4f4 req-ef06a6aa-f7fe-4a56-8008-75f7a515a293 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:16.775525 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1452f419-4d7f-4d1c-8e25-ec0eefc9e4f4 req-ef06a6aa-f7fe-4a56-8008-75f7a515a293 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:16.776486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-1452f419-4d7f-4d1c-8e25-ec0eefc9e4f4 req-ef06a6aa-f7fe-4a56-8008-75f7a515a293 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:16.809469 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-1452f419-4d7f-4d1c-8e25-ec0eefc9e4f4 req-ef06a6aa-f7fe-4a56-8008-75f7a515a293 service nova] Creating event network-changed:bf2a5f24-786c-4cbf-89af-20a9a63b2dee for instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 on n-h2-845781-6 Aug 09 18:46:16.816011 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-1452f419-4d7f-4d1c-8e25-ec0eefc9e4f4 req-ef06a6aa-f7fe-4a56-8008-75f7a515a293 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081120 Aug 09 18:46:16.816942 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4491/7542] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:46:17.763241 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-08febc25-3f10-4186-a5ba-71af6b03bac7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:17.764427 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-08febc25-3f10-4186-a5ba-71af6b03bac7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:17.781719 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08febc25-3f10-4186-a5ba-71af6b03bac7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:17.783076 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08febc25-3f10-4186-a5ba-71af6b03bac7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:17.784126 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08febc25-3f10-4186-a5ba-71af6b03bac7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:17.785804 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08febc25-3f10-4186-a5ba-71af6b03bac7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:17.786651 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08febc25-3f10-4186-a5ba-71af6b03bac7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:17.787414 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-08febc25-3f10-4186-a5ba-71af6b03bac7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:18.033547 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-08febc25-3f10-4186-a5ba-71af6b03bac7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:18.051974 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-08febc25-3f10-4186-a5ba-71af6b03bac7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1373 microversion: 2.1 time: 0.299384 Aug 09 18:46:18.053010 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4492/7543] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:17 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1373 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:19.092205 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-19eb5ddb-729c-4d40-a0e7-4ba7295036e3 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:19.093353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-19eb5ddb-729c-4d40-a0e7-4ba7295036e3 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:19.103975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eb5ddb-729c-4d40-a0e7-4ba7295036e3 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:19.104686 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eb5ddb-729c-4d40-a0e7-4ba7295036e3 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:19.105344 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eb5ddb-729c-4d40-a0e7-4ba7295036e3 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:19.106565 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eb5ddb-729c-4d40-a0e7-4ba7295036e3 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:19.107353 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eb5ddb-729c-4d40-a0e7-4ba7295036e3 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:19.108237 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-19eb5ddb-729c-4d40-a0e7-4ba7295036e3 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:19.366730 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-19eb5ddb-729c-4d40-a0e7-4ba7295036e3 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:19.379485 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-19eb5ddb-729c-4d40-a0e7-4ba7295036e3 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1373 microversion: 2.1 time: 0.294284 Aug 09 18:46:19.380774 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4493/7544] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:19 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1373 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:46:20.406313 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d545d020-d4ae-4525-a809-94e18fb4de45 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:20.407089 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d545d020-d4ae-4525-a809-94e18fb4de45 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:20.415326 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d545d020-d4ae-4525-a809-94e18fb4de45 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:20.415943 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d545d020-d4ae-4525-a809-94e18fb4de45 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:20.416392 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d545d020-d4ae-4525-a809-94e18fb4de45 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:20.417152 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d545d020-d4ae-4525-a809-94e18fb4de45 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:20.417616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d545d020-d4ae-4525-a809-94e18fb4de45 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:20.418051 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d545d020-d4ae-4525-a809-94e18fb4de45 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:20.601634 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d545d020-d4ae-4525-a809-94e18fb4de45 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:20.612690 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d545d020-d4ae-4525-a809-94e18fb4de45 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1373 microversion: 2.1 time: 0.211908 Aug 09 18:46:20.613412 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4494/7545] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:20 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1373 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:20.828225 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:46:20.828544 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 18:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:46:21.646616 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a01875ee-2f02-4d2b-9ba5-0bdb819691d9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:21.649843 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a01875ee-2f02-4d2b-9ba5-0bdb819691d9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:21.661797 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01875ee-2f02-4d2b-9ba5-0bdb819691d9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:21.662877 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01875ee-2f02-4d2b-9ba5-0bdb819691d9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:21.663524 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01875ee-2f02-4d2b-9ba5-0bdb819691d9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:21.665120 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01875ee-2f02-4d2b-9ba5-0bdb819691d9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:21.665940 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01875ee-2f02-4d2b-9ba5-0bdb819691d9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:21.666488 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a01875ee-2f02-4d2b-9ba5-0bdb819691d9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:21.782463 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=2 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:46:21.841809 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-a01875ee-2f02-4d2b-9ba5-0bdb819691d9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:21.850372 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a01875ee-2f02-4d2b-9ba5-0bdb819691d9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1373 microversion: 2.1 time: 0.219334 Aug 09 18:46:21.851030 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4495/7546] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:21 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1373 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:22.874450 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-faab2d8e-2f8d-4114-8b69-7e089ea03ae6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:22.875144 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-faab2d8e-2f8d-4114-8b69-7e089ea03ae6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:22.882253 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faab2d8e-2f8d-4114-8b69-7e089ea03ae6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:22.882753 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faab2d8e-2f8d-4114-8b69-7e089ea03ae6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:22.883849 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faab2d8e-2f8d-4114-8b69-7e089ea03ae6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:22.884643 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faab2d8e-2f8d-4114-8b69-7e089ea03ae6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:22.885057 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faab2d8e-2f8d-4114-8b69-7e089ea03ae6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:22.885491 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-faab2d8e-2f8d-4114-8b69-7e089ea03ae6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:22.970006 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell0:SELECT=8 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:46:23.045478 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-faab2d8e-2f8d-4114-8b69-7e089ea03ae6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:23.053827 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-faab2d8e-2f8d-4114-8b69-7e089ea03ae6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1373 microversion: 2.1 time: 0.183793 Aug 09 18:46:23.054449 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4496/7547] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:22 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:24.075009 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-8bb9f9b5-02ea-431e-9f47-296e5ed37c28 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:24.075689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-8bb9f9b5-02ea-431e-9f47-296e5ed37c28 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:24.083069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb9f9b5-02ea-431e-9f47-296e5ed37c28 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:24.083572 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb9f9b5-02ea-431e-9f47-296e5ed37c28 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:24.084047 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb9f9b5-02ea-431e-9f47-296e5ed37c28 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:24.084766 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb9f9b5-02ea-431e-9f47-296e5ed37c28 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:24.085232 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb9f9b5-02ea-431e-9f47-296e5ed37c28 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:24.085670 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-8bb9f9b5-02ea-431e-9f47-296e5ed37c28 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:24.222218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-8bb9f9b5-02ea-431e-9f47-296e5ed37c28 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:24.230368 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-8bb9f9b5-02ea-431e-9f47-296e5ed37c28 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1373 microversion: 2.1 time: 0.159345 Aug 09 18:46:24.230956 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4497/7548] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:24 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:25.251762 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-3fe06b37-c93a-4331-bbd2-dc30cac8ea29 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:25.252406 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-3fe06b37-c93a-4331-bbd2-dc30cac8ea29 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:25.259264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fe06b37-c93a-4331-bbd2-dc30cac8ea29 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:25.259798 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fe06b37-c93a-4331-bbd2-dc30cac8ea29 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:25.260252 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fe06b37-c93a-4331-bbd2-dc30cac8ea29 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:25.260966 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fe06b37-c93a-4331-bbd2-dc30cac8ea29 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:25.261546 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fe06b37-c93a-4331-bbd2-dc30cac8ea29 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:25.261865 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-3fe06b37-c93a-4331-bbd2-dc30cac8ea29 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:25.398218 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-3fe06b37-c93a-4331-bbd2-dc30cac8ea29 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:25.406561 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-3fe06b37-c93a-4331-bbd2-dc30cac8ea29 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1373 microversion: 2.1 time: 0.158670 Aug 09 18:46:25.407144 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4498/7549] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:25 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:26.427752 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d21e0c54-3922-4875-bc3a-6f2398e738e6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:26.428446 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d21e0c54-3922-4875-bc3a-6f2398e738e6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:26.435957 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21e0c54-3922-4875-bc3a-6f2398e738e6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:26.436445 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21e0c54-3922-4875-bc3a-6f2398e738e6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:26.436889 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21e0c54-3922-4875-bc3a-6f2398e738e6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:26.437582 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21e0c54-3922-4875-bc3a-6f2398e738e6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:26.438040 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21e0c54-3922-4875-bc3a-6f2398e738e6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:26.438470 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d21e0c54-3922-4875-bc3a-6f2398e738e6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:26.573791 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d21e0c54-3922-4875-bc3a-6f2398e738e6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:26.581385 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d21e0c54-3922-4875-bc3a-6f2398e738e6 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1373 microversion: 2.1 time: 0.157629 Aug 09 18:46:26.581957 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4499/7550] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:26 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:27.226390 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-74e7208d-a47c-4e92-80dd-4dd80f5eab81 req-f2c9abfa-f569-4209-9fc4-93f830aa5d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88", "name": "network-vif-plugged", "status": "completed", "tag": "bf2a5f24-786c-4cbf-89af-20a9a63b2dee"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:46:27.236936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-74e7208d-a47c-4e92-80dd-4dd80f5eab81 req-f2c9abfa-f569-4209-9fc4-93f830aa5d83 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:27.236936 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-74e7208d-a47c-4e92-80dd-4dd80f5eab81 req-f2c9abfa-f569-4209-9fc4-93f830aa5d83 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:27.237238 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-74e7208d-a47c-4e92-80dd-4dd80f5eab81 req-f2c9abfa-f569-4209-9fc4-93f830aa5d83 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:27.249014 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-74e7208d-a47c-4e92-80dd-4dd80f5eab81 req-f2c9abfa-f569-4209-9fc4-93f830aa5d83 service nova] Creating event network-vif-plugged:bf2a5f24-786c-4cbf-89af-20a9a63b2dee for instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 on n-h2-845781-6 Aug 09 18:46:27.253945 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-74e7208d-a47c-4e92-80dd-4dd80f5eab81 req-f2c9abfa-f569-4209-9fc4-93f830aa5d83 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031667 Aug 09 18:46:27.254701 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4500/7551] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:46:27.604063 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-662f8096-ae1b-464e-a9b6-ea7b4f6b6276 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:27.604757 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-662f8096-ae1b-464e-a9b6-ea7b4f6b6276 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:27.606689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:46:27.612303 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662f8096-ae1b-464e-a9b6-ea7b4f6b6276 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:27.612721 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662f8096-ae1b-464e-a9b6-ea7b4f6b6276 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:27.613195 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662f8096-ae1b-464e-a9b6-ea7b4f6b6276 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:27.613894 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662f8096-ae1b-464e-a9b6-ea7b4f6b6276 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:27.614343 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662f8096-ae1b-464e-a9b6-ea7b4f6b6276 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:27.614773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-662f8096-ae1b-464e-a9b6-ea7b4f6b6276 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:27.620147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:46:27.749323 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-662f8096-ae1b-464e-a9b6-ea7b4f6b6276 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:27.757143 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-662f8096-ae1b-464e-a9b6-ea7b4f6b6276 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1373 microversion: 2.1 time: 0.158227 Aug 09 18:46:27.757759 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4501/7552] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:27 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:28.778436 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-168cb9db-2168-40b1-b64a-fc827f23c167 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:28.779132 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-168cb9db-2168-40b1-b64a-fc827f23c167 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:28.786302 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-168cb9db-2168-40b1-b64a-fc827f23c167 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:28.786816 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-168cb9db-2168-40b1-b64a-fc827f23c167 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:28.787284 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-168cb9db-2168-40b1-b64a-fc827f23c167 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:28.788432 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-168cb9db-2168-40b1-b64a-fc827f23c167 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:28.788559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-168cb9db-2168-40b1-b64a-fc827f23c167 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:28.788890 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-168cb9db-2168-40b1-b64a-fc827f23c167 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:28.950631 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-168cb9db-2168-40b1-b64a-fc827f23c167 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:28.959751 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-168cb9db-2168-40b1-b64a-fc827f23c167 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1556 microversion: 2.1 time: 0.185787 Aug 09 18:46:28.960353 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4502/7553] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:28 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:28.980814 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-f161507e-2bef-4479-9b81-05fe9c6d4340 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:46:28.981462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-f161507e-2bef-4479-9b81-05fe9c6d4340 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:46:28.988264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f161507e-2bef-4479-9b81-05fe9c6d4340 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:28.988758 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f161507e-2bef-4479-9b81-05fe9c6d4340 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:28.989197 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f161507e-2bef-4479-9b81-05fe9c6d4340 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:28.989906 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f161507e-2bef-4479-9b81-05fe9c6d4340 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:28.990363 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f161507e-2bef-4479-9b81-05fe9c6d4340 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:28.990789 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-f161507e-2bef-4479-9b81-05fe9c6d4340 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:29.130526 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-f161507e-2bef-4479-9b81-05fe9c6d4340 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:46:29.139305 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-f161507e-2bef-4479-9b81-05fe9c6d4340 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1556 microversion: 2.1 time: 0.162409 Aug 09 18:46:29.139931 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4503/7554] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:46:28 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:46:31.132008 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ca338afb-4c31-4797-ab37-1c55f3f039ff req-9c4cd927-d804-4646-bcb4-cf676805bdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88", "tag": "bf2a5f24-786c-4cbf-89af-20a9a63b2dee"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:46:31.142412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ca338afb-4c31-4797-ab37-1c55f3f039ff req-9c4cd927-d804-4646-bcb4-cf676805bdc8 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:46:31.142983 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ca338afb-4c31-4797-ab37-1c55f3f039ff req-9c4cd927-d804-4646-bcb4-cf676805bdc8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:46:31.143486 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ca338afb-4c31-4797-ab37-1c55f3f039ff req-9c4cd927-d804-4646-bcb4-cf676805bdc8 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:46:31.155359 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ca338afb-4c31-4797-ab37-1c55f3f039ff req-9c4cd927-d804-4646-bcb4-cf676805bdc8 service nova] Creating event network-changed:bf2a5f24-786c-4cbf-89af-20a9a63b2dee for instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 on n-h2-845781-6 Aug 09 18:46:31.160461 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ca338afb-4c31-4797-ab37-1c55f3f039ff req-9c4cd927-d804-4646-bcb4-cf676805bdc8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032184 Aug 09 18:46:31.161135 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4504/7555] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:48:02.268833 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_api:SELECT=7 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:48:02.269566 n-d-845781-6 devstack@n-api.service[119431]: DEBUG dbcounter [-] [119431] Writing DB stats nova_cell1:SELECT=19 {{(pid=119431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:48:02.274304 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-9215a892-2998-4357-b4bc-4afd2cfa87db tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1603315210"}} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:48:02.277182 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-9215a892-2998-4357-b4bc-4afd2cfa87db tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:48:02.284227 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9215a892-2998-4357-b4bc-4afd2cfa87db tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:02.284625 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9215a892-2998-4357-b4bc-4afd2cfa87db tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:02.285091 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9215a892-2998-4357-b4bc-4afd2cfa87db tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:02.285787 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9215a892-2998-4357-b4bc-4afd2cfa87db tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:02.286240 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9215a892-2998-4357-b4bc-4afd2cfa87db tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:02.286667 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-9215a892-2998-4357-b4bc-4afd2cfa87db tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:02.476893 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-9215a892-2998-4357-b4bc-4afd2cfa87db tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "POST /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88/action" status: 202 len: 0 microversion: 2.1 time: 0.210947 Aug 09 18:48:02.477549 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4505/7556] 10.222.0.93 () {60 vars in 1278 bytes} [Tue Aug 9 18:48:02 2022] POST /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 09 18:48:07.856403 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-87ac0da0-1d08-497e-b940-b6850a3c1840 req-2dedd887-0c19-4bd4-b514-f15ff4d8d1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88", "name": "network-vif-plugged", "status": "completed", "tag": "bf2a5f24-786c-4cbf-89af-20a9a63b2dee"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:48:07.867848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-87ac0da0-1d08-497e-b940-b6850a3c1840 req-2dedd887-0c19-4bd4-b514-f15ff4d8d1b0 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:07.868674 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-87ac0da0-1d08-497e-b940-b6850a3c1840 req-2dedd887-0c19-4bd4-b514-f15ff4d8d1b0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:07.869320 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-87ac0da0-1d08-497e-b940-b6850a3c1840 req-2dedd887-0c19-4bd4-b514-f15ff4d8d1b0 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:07.882026 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-87ac0da0-1d08-497e-b940-b6850a3c1840 req-2dedd887-0c19-4bd4-b514-f15ff4d8d1b0 service nova] Creating event network-vif-plugged:bf2a5f24-786c-4cbf-89af-20a9a63b2dee for instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 on n-h2-845781-6 Aug 09 18:48:07.887461 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-87ac0da0-1d08-497e-b940-b6850a3c1840 req-2dedd887-0c19-4bd4-b514-f15ff4d8d1b0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103592 Aug 09 18:48:07.888670 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4506/7557] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:48:16.154896 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-c355374b-295a-47e2-82ac-1c0f5072f757 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:16.155601 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c355374b-295a-47e2-82ac-1c0f5072f757 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:48:16.162453 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c355374b-295a-47e2-82ac-1c0f5072f757 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:16.162954 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c355374b-295a-47e2-82ac-1c0f5072f757 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:16.163398 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c355374b-295a-47e2-82ac-1c0f5072f757 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:16.164133 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c355374b-295a-47e2-82ac-1c0f5072f757 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:16.164590 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c355374b-295a-47e2-82ac-1c0f5072f757 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:16.165019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-c355374b-295a-47e2-82ac-1c0f5072f757 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:16.192873 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-c355374b-295a-47e2-82ac-1c0f5072f757 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:48:16.271199 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-c355374b-295a-47e2-82ac-1c0f5072f757 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 204 len: 0 microversion: 2.1 time: 0.121913 Aug 09 18:48:16.272111 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4507/7558] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:48:16 2022] DELETE /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:48:16.277603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-ea864bb2-a60b-4bc1-8470-93f4c33316e4 req-867758a9-9422-4613-87c9-223a74f44400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88", "tag": "bf2a5f24-786c-4cbf-89af-20a9a63b2dee"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:48:16.287158 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ea864bb2-a60b-4bc1-8470-93f4c33316e4 req-867758a9-9422-4613-87c9-223a74f44400 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:16.287666 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ea864bb2-a60b-4bc1-8470-93f4c33316e4 req-867758a9-9422-4613-87c9-223a74f44400 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:16.288115 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-ea864bb2-a60b-4bc1-8470-93f4c33316e4 req-867758a9-9422-4613-87c9-223a74f44400 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:16.299707 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-ea864bb2-a60b-4bc1-8470-93f4c33316e4 req-867758a9-9422-4613-87c9-223a74f44400 service nova] Creating event network-changed:bf2a5f24-786c-4cbf-89af-20a9a63b2dee for instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 on n-h2-845781-6 Aug 09 18:48:16.304602 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-ea864bb2-a60b-4bc1-8470-93f4c33316e4 req-867758a9-9422-4613-87c9-223a74f44400 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031475 Aug 09 18:48:16.305240 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4508/7559] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:48:16.310249 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-7da12c09-4abf-4a55-9217-9ff5e2819b6f tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:16.310959 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-7da12c09-4abf-4a55-9217-9ff5e2819b6f tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:48:16.317102 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da12c09-4abf-4a55-9217-9ff5e2819b6f tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:16.317592 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da12c09-4abf-4a55-9217-9ff5e2819b6f tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:16.318069 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da12c09-4abf-4a55-9217-9ff5e2819b6f tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:16.318773 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da12c09-4abf-4a55-9217-9ff5e2819b6f tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:16.319233 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da12c09-4abf-4a55-9217-9ff5e2819b6f tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:16.319689 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-7da12c09-4abf-4a55-9217-9ff5e2819b6f tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:16.462545 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-7da12c09-4abf-4a55-9217-9ff5e2819b6f tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:48:16.470845 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-7da12c09-4abf-4a55-9217-9ff5e2819b6f tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1681 microversion: 2.1 time: 0.164397 Aug 09 18:48:16.471710 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4509/7560] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:48:16 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:48:17.499754 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-047b3da4-8c1d-48ce-a06e-bf21676921d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:17.500454 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-047b3da4-8c1d-48ce-a06e-bf21676921d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:48:17.507532 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047b3da4-8c1d-48ce-a06e-bf21676921d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:17.508070 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047b3da4-8c1d-48ce-a06e-bf21676921d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:17.508522 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047b3da4-8c1d-48ce-a06e-bf21676921d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:17.510290 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047b3da4-8c1d-48ce-a06e-bf21676921d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:17.510765 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047b3da4-8c1d-48ce-a06e-bf21676921d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:17.511207 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-047b3da4-8c1d-48ce-a06e-bf21676921d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:17.654019 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-047b3da4-8c1d-48ce-a06e-bf21676921d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:48:17.661773 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-047b3da4-8c1d-48ce-a06e-bf21676921d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 200 len: 1681 microversion: 2.1 time: 0.165945 Aug 09 18:48:17.662350 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4510/7561] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:48:17 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:48:17.749578 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-e15d5c4f-712a-438b-b1cd-d7f0b704e79c req-7b12c93c-8cd1-4018-8b21-000cd757becb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88", "name": "network-vif-unplugged", "status": "completed", "tag": "bf2a5f24-786c-4cbf-89af-20a9a63b2dee"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:48:17.770716 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e15d5c4f-712a-438b-b1cd-d7f0b704e79c req-7b12c93c-8cd1-4018-8b21-000cd757becb service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:17.771613 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e15d5c4f-712a-438b-b1cd-d7f0b704e79c req-7b12c93c-8cd1-4018-8b21-000cd757becb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:17.772264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-e15d5c4f-712a-438b-b1cd-d7f0b704e79c req-7b12c93c-8cd1-4018-8b21-000cd757becb service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:17.794482 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-e15d5c4f-712a-438b-b1cd-d7f0b704e79c req-7b12c93c-8cd1-4018-8b21-000cd757becb service nova] Creating event network-vif-unplugged:bf2a5f24-786c-4cbf-89af-20a9a63b2dee for instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 on n-h2-845781-6 Aug 09 18:48:17.800479 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-e15d5c4f-712a-438b-b1cd-d7f0b704e79c req-7b12c93c-8cd1-4018-8b21-000cd757becb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055379 Aug 09 18:48:17.801093 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4511/7562] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:48:18.320000 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-03623ebe-1530-4be7-ba80-78b47a5f5e19 req-8cae3272-90e8-4cf6-8b4f-0633df3d0c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88", "name": "network-vif-deleted", "tag": "bf2a5f24-786c-4cbf-89af-20a9a63b2dee"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:48:18.330663 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-03623ebe-1530-4be7-ba80-78b47a5f5e19 req-8cae3272-90e8-4cf6-8b4f-0633df3d0c6c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:18.331147 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-03623ebe-1530-4be7-ba80-78b47a5f5e19 req-8cae3272-90e8-4cf6-8b4f-0633df3d0c6c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:18.331583 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-03623ebe-1530-4be7-ba80-78b47a5f5e19 req-8cae3272-90e8-4cf6-8b4f-0633df3d0c6c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:18.345166 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-03623ebe-1530-4be7-ba80-78b47a5f5e19 req-8cae3272-90e8-4cf6-8b4f-0633df3d0c6c service nova] Creating event network-vif-deleted:bf2a5f24-786c-4cbf-89af-20a9a63b2dee for instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 on n-h2-845781-6 Aug 09 18:48:18.350060 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-03623ebe-1530-4be7-ba80-78b47a5f5e19 req-8cae3272-90e8-4cf6-8b4f-0633df3d0c6c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034774 Aug 09 18:48:18.350672 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4512/7563] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:48:18.688543 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:18.689330 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:48:18.697225 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:18.697785 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:18.698264 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:18.699359 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:18.699835 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:18.700296 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:18.715152 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] HTTP exception thrown: Instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 could not be found. Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Request method failure captured: Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 HTTP/1.1 Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qrbcoVv5aZl5DkTuDn-RD-y95ymIl2OS_c4qsqwRgGlDK7yk0lrB-nZqKimGQnMgOn9X-Uho8YMcuzKWr--ltPKztq83Yg0Jv8Ysg02TGVJnL7puviyu2twmo9n_UQl6POLQrXQ08JQiSyF9y1mpTyvsRRwh1OB12o_0SssQsopyAU Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 7e3b51fd025f4130a778cb381e0aacb8 Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestSnapshotPattern-915134440 Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7e3b51fd025f4130a778cb381e0aacb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7e3b51fd025f4130a778cb381e0aacb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7e3b51fd025f4130a778cb381e0aacb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7e3b51fd025f4130a778cb381e0aacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestSnapshotPattern-915134440 Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 7e3b51fd025f4130a778cb381e0aacb8 Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestSnapshotPattern-915134440 Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestSnapshotPattern-915134440-project Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1418030380a144be9cf77da48e4261d6 Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestSnapshotPattern-915134440-project Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 could not be found. Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88'} Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 could not be found. Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 could not be found. Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:48:18.720707 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:48:18.731154 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:48:18.731154 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:48:18.731154 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:48:18.731154 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:48:18.731154 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:48:18.731154 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 could not be found. Aug 09 18:48:18.731154 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:48:18.731154 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Returning 404 to user: Instance b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:48:18.731154 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-df276e35-11d4-4033-a84e-710d0c0502d7 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88" status: 404 len: 111 microversion: 2.1 time: 0.034348 Aug 09 18:48:18.731154 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4513/7564] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:48:18 2022] GET /compute/v2.1/servers/b7d1d3c2-cf89-4f6b-bfcf-b206b1214e88 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:48:20.369395 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-a5a1ff24-d716-4969-ad01-4662341448bd tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:20.369980 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a5a1ff24-d716-4969-ad01-4662341448bd tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:48:20.377575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a1ff24-d716-4969-ad01-4662341448bd tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:20.378095 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a1ff24-d716-4969-ad01-4662341448bd tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:20.378538 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a1ff24-d716-4969-ad01-4662341448bd tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:20.379243 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a1ff24-d716-4969-ad01-4662341448bd tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:20.379734 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a1ff24-d716-4969-ad01-4662341448bd tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:20.380369 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-a5a1ff24-d716-4969-ad01-4662341448bd tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:20.408603 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-a5a1ff24-d716-4969-ad01-4662341448bd tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Going to try to terminate instance {{(pid=119431) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 18:48:20.486689 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-a5a1ff24-d716-4969-ad01-4662341448bd tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "DELETE /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 204 len: 0 microversion: 2.1 time: 0.121376 Aug 09 18:48:20.487926 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4514/7565] 10.222.0.93 () {58 vars in 1239 bytes} [Tue Aug 9 18:48:20 2022] DELETE /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 18:48:20.495124 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-34dcf2b9-e412-4361-babe-1d29279c46c2 req-89482685-161c-4577-9ad0-ddf880be2a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afaa2e83-e1bf-4668-8b9b-69b891234180", "tag": "e38df482-678d-4fed-a816-89cbdf219001"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:48:20.505527 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-34dcf2b9-e412-4361-babe-1d29279c46c2 req-89482685-161c-4577-9ad0-ddf880be2a1c service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:20.506021 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-34dcf2b9-e412-4361-babe-1d29279c46c2 req-89482685-161c-4577-9ad0-ddf880be2a1c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:20.506575 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-34dcf2b9-e412-4361-babe-1d29279c46c2 req-89482685-161c-4577-9ad0-ddf880be2a1c service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:20.518579 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-34dcf2b9-e412-4361-babe-1d29279c46c2 req-89482685-161c-4577-9ad0-ddf880be2a1c service nova] Creating event network-changed:e38df482-678d-4fed-a816-89cbdf219001 for instance afaa2e83-e1bf-4668-8b9b-69b891234180 on n-h1-845781-6 Aug 09 18:48:20.523457 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-34dcf2b9-e412-4361-babe-1d29279c46c2 req-89482685-161c-4577-9ad0-ddf880be2a1c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033933 Aug 09 18:48:20.524284 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4515/7566] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 18:48:20.529632 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-6caaa0fd-7767-4ab4-b19c-0fb88a898cb9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:20.530411 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-6caaa0fd-7767-4ab4-b19c-0fb88a898cb9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:48:20.537521 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6caaa0fd-7767-4ab4-b19c-0fb88a898cb9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:20.538022 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6caaa0fd-7767-4ab4-b19c-0fb88a898cb9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:20.538467 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6caaa0fd-7767-4ab4-b19c-0fb88a898cb9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:20.539174 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6caaa0fd-7767-4ab4-b19c-0fb88a898cb9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:20.539654 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6caaa0fd-7767-4ab4-b19c-0fb88a898cb9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:20.540104 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-6caaa0fd-7767-4ab4-b19c-0fb88a898cb9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:20.685845 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-6caaa0fd-7767-4ab4-b19c-0fb88a898cb9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:48:20.694651 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-6caaa0fd-7767-4ab4-b19c-0fb88a898cb9 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1679 microversion: 2.1 time: 0.169366 Aug 09 18:48:20.695368 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4516/7567] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:48:20 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 18:48:21.716997 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0e6f58d5-48b3-4741-a292-de5ad561516c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:21.717614 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0e6f58d5-48b3-4741-a292-de5ad561516c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:48:21.724490 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e6f58d5-48b3-4741-a292-de5ad561516c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:21.724974 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e6f58d5-48b3-4741-a292-de5ad561516c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:21.725413 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e6f58d5-48b3-4741-a292-de5ad561516c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:21.726106 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e6f58d5-48b3-4741-a292-de5ad561516c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:21.726559 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e6f58d5-48b3-4741-a292-de5ad561516c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:21.726984 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0e6f58d5-48b3-4741-a292-de5ad561516c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:21.861379 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-0e6f58d5-48b3-4741-a292-de5ad561516c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:48:21.868946 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0e6f58d5-48b3-4741-a292-de5ad561516c tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1679 microversion: 2.1 time: 0.156489 Aug 09 18:48:21.869527 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4517/7568] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:48:21 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:48:22.743548 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [req-387f463e-0778-4c35-9e56-f9e5e47b9c3d req-2e230fe4-64aa-424b-94f8-391094977a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afaa2e83-e1bf-4668-8b9b-69b891234180", "name": "network-vif-deleted", "tag": "e38df482-678d-4fed-a816-89cbdf219001"}]} {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 18:48:22.758952 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-387f463e-0778-4c35-9e56-f9e5e47b9c3d req-2e230fe4-64aa-424b-94f8-391094977a06 service nova] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:22.759374 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-387f463e-0778-4c35-9e56-f9e5e47b9c3d req-2e230fe4-64aa-424b-94f8-391094977a06 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:22.759839 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [req-387f463e-0778-4c35-9e56-f9e5e47b9c3d req-2e230fe4-64aa-424b-94f8-391094977a06 service nova] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:22.771909 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.compute.server_external_events [req-387f463e-0778-4c35-9e56-f9e5e47b9c3d req-2e230fe4-64aa-424b-94f8-391094977a06 service nova] Creating event network-vif-deleted:e38df482-678d-4fed-a816-89cbdf219001 for instance afaa2e83-e1bf-4668-8b9b-69b891234180 on n-h1-845781-6 Aug 09 18:48:22.778798 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [req-387f463e-0778-4c35-9e56-f9e5e47b9c3d req-2e230fe4-64aa-424b-94f8-391094977a06 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038877 Aug 09 18:48:22.779419 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4518/7569] 10.222.0.93 () {64 vars in 1317 bytes} [Tue Aug 9 18:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 18:48:22.890462 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:22.891167 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:48:22.899292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:22.899817 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:22.900262 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:22.901204 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:22.901428 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:22.901861 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:22.933975 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:22.934780 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:22.935329 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:22.935848 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.objects.instance [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lazy-loading 'fault' on Instance uuid afaa2e83-e1bf-4668-8b9b-69b891234180 {{(pid=119431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 18:48:22.977193 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.policy [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418030380a144be9cf77da48e4261d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3b51fd025f4130a778cb381e0aacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119431) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 18:48:22.985098 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-d1866cee-e98c-41bb-9659-8dcef2b25044 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 200 len: 1337 microversion: 2.1 time: 0.098927 Aug 09 18:48:22.985683 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4519/7570] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:48:22 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 1337 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 18:48:24.006485 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:24.007172 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.compute.api [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] [instance: afaa2e83-e1bf-4668-8b9b-69b891234180] Fetching instance by UUID {{(pid=119431) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 18:48:24.014589 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:24.015129 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:24.015567 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:24.016292 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Acquiring lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 18:48:24.016728 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 18:48:24.017150 n-d-845781-6 devstack@n-api.service[119431]: DEBUG oslo_concurrency.lockutils [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Lock "64c82f9d-f90f-4d8d-aa0f-b40fcf077ca3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 18:48:24.030745 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.wsgi [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] HTTP exception thrown: Instance afaa2e83-e1bf-4668-8b9b-69b891234180 could not be found. Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Request method failure captured: Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: request: GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 HTTP/1.1 Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: Accept: application/json Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: Accept-Encoding: identity Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: Connection: close Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: Content-Length: 0 Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: Content-Type: application/json Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: Host: 10.222.0.93 Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: Openstack-System-Scope: None Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: User-Agent: python-urllib3/1.26.11 Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Auth-Token: gAAAAABi8qrbcoVv5aZl5DkTuDn-RD-y95ymIl2OS_c4qsqwRgGlDK7yk0lrB-nZqKimGQnMgOn9X-Uho8YMcuzKWr--ltPKztq83Yg0Jv8Ysg02TGVJnL7puviyu2twmo9n_UQl6POLQrXQ08JQiSyF9y1mpTyvsRRwh1OB12o_0SssQsopyAU Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Id: None Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Domain-Name: None Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Identity-Status: Confirmed Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Is-Admin-Project: True Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Id: default Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Domain-Name: Default Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Id: 7e3b51fd025f4130a778cb381e0aacb8 Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Project-Name: tempest-TestSnapshotPattern-915134440 Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Role: reader,member Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Roles: reader,member Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7e3b51fd025f4130a778cb381e0aacb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7e3b51fd025f4130a778cb381e0aacb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7e3b51fd025f4130a778cb381e0aacb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7e3b51fd025f4130a778cb381e0aacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}] Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant: tempest-TestSnapshotPattern-915134440 Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Id: 7e3b51fd025f4130a778cb381e0aacb8 Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-Tenant-Name: tempest-TestSnapshotPattern-915134440 Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-User: tempest-TestSnapshotPattern-915134440-project Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Id: default Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-User-Domain-Name: Default Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-User-Id: 1418030380a144be9cf77da48e4261d6 Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: X-User-Name: tempest-TestSnapshotPattern-915134440-project Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: method: > Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: exception: Instance afaa2e83-e1bf-4668-8b9b-69b891234180 could not be found. Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: action_args: {'id': 'afaa2e83-e1bf-4668-8b9b-69b891234180'} Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afaa2e83-e1bf-4668-8b9b-69b891234180 could not be found. Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afaa2e83-e1bf-4668-8b9b-69b891234180 could not be found. Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 18:48:24.032412 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:48:24.036876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 18:48:24.036876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 18:48:24.036876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 18:48:24.036876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 18:48:24.036876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 18:48:24.036876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afaa2e83-e1bf-4668-8b9b-69b891234180 could not be found. Aug 09 18:48:24.036876 n-d-845781-6 devstack@n-api.service[119431]: ERROR nova.api.openstack.wsgi Aug 09 18:48:24.036876 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Returning 404 to user: Instance afaa2e83-e1bf-4668-8b9b-69b891234180 could not be found. {{(pid=119431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 18:48:24.036876 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-0a518b23-ad08-4e37-88dc-d530e0590177 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180" status: 404 len: 111 microversion: 2.1 time: 0.031294 Aug 09 18:48:24.036876 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4520/7571] 10.222.0.93 () {58 vars in 1236 bytes} [Tue Aug 9 18:48:24 2022] GET /compute/v2.1/servers/afaa2e83-e1bf-4668-8b9b-69b891234180 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 18:48:24.201612 n-d-845781-6 devstack@n-api.service[119431]: DEBUG nova.api.openstack.wsgi [None req-5776a164-7044-4d7d-ae7e-50143c966149 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] Calling method '.version_select at 0x7fbbcb6a2430>' {{(pid=119431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 18:48:24.228263 n-d-845781-6 devstack@n-api.service[119431]: INFO nova.api.openstack.requestlog [None req-5776a164-7044-4d7d-ae7e-50143c966149 tempest-TestSnapshotPattern-915134440 tempest-TestSnapshotPattern-915134440-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-385240132" status: 202 len: 0 microversion: 2.1 time: 0.031159 Aug 09 18:48:24.228858 n-d-845781-6 devstack@n-api.service[119431]: [pid: 119431|app: 0|req: 4521/7572] 10.222.0.93 () {58 vars in 1254 bytes} [Tue Aug 9 18:48:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-385240132 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 18:51:20.840752 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:51:20.841714 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 18:51:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:51:20.980907 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:51:20.981237 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 18:51:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:53:46.960558 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:53:46.960558 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 18:53:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:54:40.848395 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:54:40.849047 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 18:54:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 18:54:40.991046 n-d-845781-6 devstack@n-api.service[119431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 18:54:40.991307 n-d-845781-6 devstack@n-api.service[119431]: Tue Aug 9 18:54:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!